2024-09-15T23:38:52.725 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T23:38:52.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T23:38:52.840 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906342 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/strays} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906342' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGvK1sEaeAIoXBer2JDri8imU0mNc9y6ooy34P3r9tTRK9u4o1maVLeb9PQ7XM2kQu1YRopJzfEqljFX6w8L9ok= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHHDa0eywcoQTTBdd4tMMb/j8eobhTUIRMDDve6zC41pMEKd5pcsPCLjWjJKekdwlLPcdnDhNLM3Ds41zJHkk2c= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_strays teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T23:38:52.840 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T23:38:52.841 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T23:38:52.841 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T23:38:52.842 INFO:teuthology.task.internal:Checking packages... 2024-09-15T23:38:52.864 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T23:38:52.864 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T23:38:52.864 INFO:teuthology.packaging:ref: None 2024-09-15T23:38:52.864 INFO:teuthology.packaging:tag: None 2024-09-15T23:38:52.864 INFO:teuthology.packaging:branch: squid 2024-09-15T23:38:52.864 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:38:52.864 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-15T23:38:53.093 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-326-g8921c8ef-1jammy 2024-09-15T23:38:53.094 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T23:38:53.109 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T23:38:53.109 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T23:38:53.124 INFO:teuthology.task.internal:Saving configuration 2024-09-15T23:38:53.142 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T23:38:53.160 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T23:38:53.185 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 23:33:00.533591', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFGfpodT24atZ7lMGGtmbddsrEjMFQoTdQyGMPo0AY3z'} 2024-09-15T23:38:53.212 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 23:33:00.532085', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIqQh1yiPMLep2KSSLa2AyW/8169FxrN/Tp79hlLRUn4'} 2024-09-15T23:38:53.212 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T23:38:53.220 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-15T23:38:53.220 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-15T23:38:53.220 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T23:38:53.283 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8f07f570a0>, signals=[15]) 2024-09-15T23:38:53.283 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T23:38:53.290 INFO:teuthology.task.internal:Opening connections... 2024-09-15T23:38:53.290 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:38:53.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:38:53.385 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:38:53.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:38:53.465 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T23:38:53.472 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-09-15T23:38:53.477 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-09-15T23:38:53.477 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-09-15T23:38:53.523 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-15T23:38:53.523 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Ubuntu" 2024-09-15T23:38:53.523 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="22.04" 2024-09-15T23:38:53.523 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-15T23:38:53.523 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_CODENAME=jammy 2024-09-15T23:38:53.523 INFO:teuthology.orchestra.run.smithi112.stdout:ID=ubuntu 2024-09-15T23:38:53.523 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE=debian 2024-09-15T23:38:53.523 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-15T23:38:53.523 INFO:teuthology.orchestra.run.smithi112.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-15T23:38:53.523 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-15T23:38:53.523 INFO:teuthology.orchestra.run.smithi112.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-15T23:38:53.523 INFO:teuthology.orchestra.run.smithi112.stdout:UBUNTU_CODENAME=jammy 2024-09-15T23:38:53.524 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-09-15T23:38:53.545 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-09-15T23:38:53.550 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-09-15T23:38:53.551 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-09-15T23:38:53.596 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-15T23:38:53.596 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2024-09-15T23:38:53.596 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="22.04" 2024-09-15T23:38:53.596 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-15T23:38:53.597 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=jammy 2024-09-15T23:38:53.597 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2024-09-15T23:38:53.597 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2024-09-15T23:38:53.597 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-15T23:38:53.597 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-15T23:38:53.597 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-15T23:38:53.597 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-15T23:38:53.597 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=jammy 2024-09-15T23:38:53.597 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-09-15T23:38:53.621 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T23:38:53.633 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T23:38:53.641 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T23:38:53.641 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-09-15T23:38:53.643 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-09-15T23:38:53.647 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T23:38:53.686 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T23:38:53.687 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-09-15T23:38:53.696 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-09-15T23:38:53.797 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T23:38:53.850 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T23:38:53.865 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-15T23:38:53.865 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-15T23:38:53.866 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T23:38:53.866 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T23:38:53.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:38:53.871 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-15T23:38:53.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:38:53.872 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-09-15T23:38:53.919 INFO:teuthology.orchestra.run.smithi112.stdout:5.15.0-56-generic 2024-09-15T23:38:53.919 INFO:teuthology.task.kernel:Running kernel on smithi112: 5.15.0-56-generic 2024-09-15T23:38:53.919 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get clean 2024-09-15T23:38:53.921 INFO:teuthology.orchestra.run.smithi169.stdout:5.15.0-56-generic 2024-09-15T23:38:53.921 INFO:teuthology.task.kernel:Running kernel on smithi169: 5.15.0-56-generic 2024-09-15T23:38:53.921 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get clean 2024-09-15T23:38:54.044 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-15T23:38:54.059 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-09-15T23:38:54.337 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T23:38:54.345 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T23:38:54.346 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-15T23:38:54.347 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-15T23:38:54.398 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-15T23:38:54.399 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-15T23:38:54.753 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-15T23:38:54.759 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-15T23:38:54.770 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-15T23:38:54.771 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-15T23:38:54.891 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-15T23:38:54.898 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-15T23:38:55.063 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-15T23:38:55.064 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-15T23:38:55.208 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-15T23:38:55.213 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-15T23:38:55.236 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-15T23:38:55.237 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-15T23:38:55.247 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-15T23:38:55.248 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-15T23:38:55.249 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-15T23:38:55.250 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-15T23:38:55.251 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-15T23:38:55.253 INFO:teuthology.orchestra.run.smithi169.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-15T23:38:55.253 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-15T23:38:55.261 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-15T23:38:55.262 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-15T23:38:55.266 INFO:teuthology.orchestra.run.smithi169.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-15T23:38:55.267 INFO:teuthology.orchestra.run.smithi169.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-15T23:38:55.332 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-15T23:38:55.333 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-15T23:38:55.334 INFO:teuthology.orchestra.run.smithi169.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-15T23:38:55.336 INFO:teuthology.orchestra.run.smithi169.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-15T23:38:55.336 INFO:teuthology.orchestra.run.smithi169.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-15T23:38:55.375 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-15T23:38:55.376 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-15T23:38:55.376 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-15T23:38:55.385 INFO:teuthology.orchestra.run.smithi169.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-15T23:38:55.385 INFO:teuthology.orchestra.run.smithi169.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-15T23:38:55.385 INFO:teuthology.orchestra.run.smithi169.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-15T23:38:55.385 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-15T23:38:55.386 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-15T23:38:55.392 INFO:teuthology.orchestra.run.smithi169.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-15T23:38:55.392 INFO:teuthology.orchestra.run.smithi169.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-15T23:38:55.392 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-15T23:38:55.401 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-15T23:38:55.401 INFO:teuthology.orchestra.run.smithi169.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-15T23:38:55.411 INFO:teuthology.orchestra.run.smithi169.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-15T23:38:55.412 INFO:teuthology.orchestra.run.smithi169.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-15T23:38:55.412 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-15T23:38:55.413 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-15T23:38:55.415 INFO:teuthology.orchestra.run.smithi169.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-15T23:38:55.416 INFO:teuthology.orchestra.run.smithi169.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-15T23:38:55.416 INFO:teuthology.orchestra.run.smithi169.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-15T23:38:55.416 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-15T23:38:55.416 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-15T23:38:55.417 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-15T23:38:55.417 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-15T23:38:55.424 INFO:teuthology.orchestra.run.smithi169.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-15T23:38:55.427 INFO:teuthology.orchestra.run.smithi169.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-15T23:38:55.428 INFO:teuthology.orchestra.run.smithi169.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-15T23:38:55.428 INFO:teuthology.orchestra.run.smithi169.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-15T23:38:55.439 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-15T23:38:55.439 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-15T23:38:55.439 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-15T23:38:55.456 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-15T23:38:55.456 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-15T23:38:55.468 INFO:teuthology.orchestra.run.smithi169.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-15T23:38:55.482 INFO:teuthology.orchestra.run.smithi169.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-15T23:38:55.482 INFO:teuthology.orchestra.run.smithi169.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-15T23:38:55.483 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-15T23:38:55.510 INFO:teuthology.orchestra.run.smithi169.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-15T23:38:55.510 INFO:teuthology.orchestra.run.smithi169.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-15T23:38:55.511 INFO:teuthology.orchestra.run.smithi169.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-15T23:38:55.511 INFO:teuthology.orchestra.run.smithi169.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-15T23:38:55.512 INFO:teuthology.orchestra.run.smithi169.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-15T23:38:55.520 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-15T23:38:55.521 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-15T23:38:55.522 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-15T23:38:55.523 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-15T23:38:55.523 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-15T23:38:55.537 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-15T23:38:55.538 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-15T23:38:55.540 INFO:teuthology.orchestra.run.smithi112.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-15T23:38:55.550 INFO:teuthology.orchestra.run.smithi169.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-15T23:38:55.551 INFO:teuthology.orchestra.run.smithi169.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-15T23:38:55.551 INFO:teuthology.orchestra.run.smithi169.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-15T23:38:55.551 INFO:teuthology.orchestra.run.smithi169.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-15T23:39:01.570 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 16.0 MB in 3s (5,759 kB/s) 2024-09-15T23:39:01.597 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 16.0 MB in 3s (5,707 kB/s) 2024-09-15T23:39:03.001 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-09-15T23:39:03.019 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T23:39:03.044 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-15T23:39:03.062 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T23:39:03.084 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-09-15T23:39:03.123 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-15T23:39:03.292 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-09-15T23:39:03.293 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-09-15T23:39:03.332 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-15T23:39:03.333 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-15T23:39:03.481 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T23:39:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T23:39:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T23:39:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T23:39:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-15T23:39:03.483 INFO:teuthology.orchestra.run.smithi169.stdout: python2.7-minimal 2024-09-15T23:39:03.483 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T23:39:03.483 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2024-09-15T23:39:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T23:39:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-15T23:39:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-15T23:39:03.485 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2024-09-15T23:39:03.485 INFO:teuthology.orchestra.run.smithi169.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-15T23:39:03.486 INFO:teuthology.orchestra.run.smithi169.stdout:Recommended packages: 2024-09-15T23:39:03.486 INFO:teuthology.orchestra.run.smithi169.stdout: thermald 2024-09-15T23:39:03.505 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T23:39:03.505 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T23:39:03.505 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T23:39:03.506 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T23:39:03.506 INFO:teuthology.orchestra.run.smithi112.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-15T23:39:03.506 INFO:teuthology.orchestra.run.smithi112.stdout: python2.7-minimal 2024-09-15T23:39:03.506 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T23:39:03.507 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-15T23:39:03.507 INFO:teuthology.orchestra.run.smithi112.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T23:39:03.507 INFO:teuthology.orchestra.run.smithi112.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-15T23:39:03.507 INFO:teuthology.orchestra.run.smithi112.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-15T23:39:03.508 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-15T23:39:03.509 INFO:teuthology.orchestra.run.smithi112.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-15T23:39:03.509 INFO:teuthology.orchestra.run.smithi112.stdout:Recommended packages: 2024-09-15T23:39:03.509 INFO:teuthology.orchestra.run.smithi112.stdout: thermald 2024-09-15T23:39:03.535 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2024-09-15T23:39:03.535 INFO:teuthology.orchestra.run.smithi169.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T23:39:03.535 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-15T23:39:03.535 INFO:teuthology.orchestra.run.smithi169.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-15T23:39:03.537 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages will be upgraded: 2024-09-15T23:39:03.537 INFO:teuthology.orchestra.run.smithi169.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-15T23:39:03.558 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-15T23:39:03.558 INFO:teuthology.orchestra.run.smithi112.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T23:39:03.558 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-15T23:39:03.559 INFO:teuthology.orchestra.run.smithi112.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-15T23:39:03.559 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages will be upgraded: 2024-09-15T23:39:03.560 INFO:teuthology.orchestra.run.smithi112.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-15T23:39:03.610 INFO:teuthology.orchestra.run.smithi112.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T23:39:03.610 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 113 MB of archives. 2024-09-15T23:39:03.610 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-15T23:39:03.610 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-15T23:39:03.717 INFO:teuthology.orchestra.run.smithi169.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T23:39:03.717 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 113 MB of archives. 2024-09-15T23:39:03.717 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-15T23:39:03.717 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-15T23:39:04.048 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-15T23:39:04.153 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-15T23:39:04.942 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-15T23:39:04.942 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-15T23:39:04.943 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-15T23:39:05.061 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-15T23:39:05.083 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-15T23:39:05.139 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-15T23:39:05.492 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-15T23:39:05.556 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 113 MB in 2s (71.6 MB/s) 2024-09-15T23:39:05.769 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-15T23:39:07.737 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-15T23:39:07.738 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-15T23:39:07.738 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-15T23:39:07.748 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-15T23:39:07.752 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T23:39:07.816 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:08.086 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-15T23:39:08.166 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-15T23:39:08.557 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 113 MB in 5s (24.5 MB/s) 2024-09-15T23:39:08.726 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-15T23:39:10.360 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-15T23:39:10.381 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T23:39:10.475 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:10.689 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-15T23:39:10.694 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T23:39:10.759 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:10.913 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-15T23:39:10.933 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T23:39:10.971 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:13.277 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-15T23:39:13.298 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T23:39:13.393 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:13.847 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-15T23:39:13.856 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T23:39:13.896 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:17.416 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T23:39:17.541 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T23:39:17.865 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T23:39:17.986 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T23:39:18.289 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-15T23:39:18.311 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-15T23:39:18.355 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T23:39:20.271 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T23:39:20.372 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T23:39:20.722 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T23:39:20.851 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T23:39:21.162 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-15T23:39:21.184 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-15T23:39:21.228 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T23:39:23.879 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-15T23:39:23.915 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T23:39:23.953 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:27.151 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T23:39:27.255 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-15T23:39:27.273 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T23:39:27.291 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T23:39:27.329 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:27.615 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T23:39:27.736 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:27.862 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-15T23:39:27.990 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:29.335 INFO:teuthology.orchestra.run.smithi112.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-15T23:39:29.336 INFO:teuthology.orchestra.run.smithi112.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-15T23:39:29.336 INFO:teuthology.orchestra.run.smithi112.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-15T23:39:29.336 INFO:teuthology.orchestra.run.smithi112.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-15T23:39:29.493 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:30.813 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T23:39:30.935 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T23:39:31.102 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:31.268 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T23:39:31.389 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:31.515 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-15T23:39:31.652 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:32.470 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-15T23:39:32.572 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-15T23:39:32.680 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:32.746 INFO:teuthology.orchestra.run.smithi112.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-15T23:39:32.747 INFO:teuthology.orchestra.run.smithi112.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-15T23:39:32.994 INFO:teuthology.orchestra.run.smithi169.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-15T23:39:32.994 INFO:teuthology.orchestra.run.smithi169.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-15T23:39:32.994 INFO:teuthology.orchestra.run.smithi169.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-15T23:39:32.995 INFO:teuthology.orchestra.run.smithi169.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-15T23:39:33.155 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:34.531 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:36.658 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-15T23:39:36.784 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-15T23:39:36.910 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T23:39:36.974 INFO:teuthology.orchestra.run.smithi169.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-15T23:39:36.974 INFO:teuthology.orchestra.run.smithi169.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-15T23:39:46.969 INFO:teuthology.orchestra.run.smithi112.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-15T23:39:46.969 INFO:teuthology.orchestra.run.smithi112.stdout:Sourcing file `/etc/default/grub' 2024-09-15T23:39:46.981 INFO:teuthology.orchestra.run.smithi112.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T23:39:46.995 INFO:teuthology.orchestra.run.smithi112.stdout:Generating grub configuration file ... 2024-09-15T23:39:47.248 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T23:39:47.263 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T23:39:47.550 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T23:39:47.555 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T23:39:47.621 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T23:39:47.624 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T23:39:47.787 INFO:teuthology.orchestra.run.smithi112.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T23:39:47.788 INFO:teuthology.orchestra.run.smithi112.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T23:39:47.788 INFO:teuthology.orchestra.run.smithi112.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T23:39:47.844 INFO:teuthology.orchestra.run.smithi112.stdout:done 2024-09-15T23:39:48.298 DEBUG:teuthology.orchestra.run.smithi112:> dpkg -s linux-image-generic 2024-09-15T23:39:48.314 INFO:teuthology.orchestra.run.smithi112.stdout:Package: linux-image-generic 2024-09-15T23:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout:Status: install ok installed 2024-09-15T23:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout:Priority: optional 2024-09-15T23:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout:Section: kernel 2024-09-15T23:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout:Installed-Size: 21 2024-09-15T23:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T23:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: amd64 2024-09-15T23:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout:Source: linux-meta 2024-09-15T23:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout:Version: 5.15.0.121.121 2024-09-15T23:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T23:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T23:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout:Recommends: thermald 2024-09-15T23:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout:Description: Generic Linux kernel image 2024-09-15T23:39:48.315 INFO:teuthology.orchestra.run.smithi112.stdout: This package will always depend on the latest generic kernel image 2024-09-15T23:39:48.316 INFO:teuthology.orchestra.run.smithi112.stdout: available. 2024-09-15T23:39:48.316 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-15T23:39:48.316 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T23:39:48.316 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T23:39:48.316 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-15T23:39:48.316 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T23:39:48.316 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get clean 2024-09-15T23:39:48.528 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-15T23:39:48.692 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T23:39:48.777 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T23:39:48.859 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T23:39:48.940 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T23:39:50.093 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-15T23:39:50.112 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T23:39:50.175 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-15T23:39:50.386 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-15T23:39:50.387 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-15T23:39:50.581 INFO:teuthology.orchestra.run.smithi112.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-15T23:39:50.582 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T23:39:50.582 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T23:39:50.582 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T23:39:50.582 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T23:39:50.582 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T23:39:50.582 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T23:39:50.582 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T23:39:50.625 INFO:teuthology.orchestra.run.smithi112.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T23:39:50.627 DEBUG:teuthology.orchestra.run.smithi112:> dpkg -s linux-image-generic 2024-09-15T23:39:50.643 INFO:teuthology.orchestra.run.smithi112.stdout:Package: linux-image-generic 2024-09-15T23:39:50.643 INFO:teuthology.orchestra.run.smithi112.stdout:Status: install ok installed 2024-09-15T23:39:50.643 INFO:teuthology.orchestra.run.smithi112.stdout:Priority: optional 2024-09-15T23:39:50.643 INFO:teuthology.orchestra.run.smithi112.stdout:Section: kernel 2024-09-15T23:39:50.643 INFO:teuthology.orchestra.run.smithi112.stdout:Installed-Size: 21 2024-09-15T23:39:50.643 INFO:teuthology.orchestra.run.smithi112.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T23:39:50.643 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: amd64 2024-09-15T23:39:50.643 INFO:teuthology.orchestra.run.smithi112.stdout:Source: linux-meta 2024-09-15T23:39:50.643 INFO:teuthology.orchestra.run.smithi112.stdout:Version: 5.15.0.121.121 2024-09-15T23:39:50.643 INFO:teuthology.orchestra.run.smithi112.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T23:39:50.643 INFO:teuthology.orchestra.run.smithi112.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T23:39:50.643 INFO:teuthology.orchestra.run.smithi112.stdout:Recommends: thermald 2024-09-15T23:39:50.644 INFO:teuthology.orchestra.run.smithi112.stdout:Description: Generic Linux kernel image 2024-09-15T23:39:50.644 INFO:teuthology.orchestra.run.smithi112.stdout: This package will always depend on the latest generic kernel image 2024-09-15T23:39:50.644 INFO:teuthology.orchestra.run.smithi112.stdout: available. 2024-09-15T23:39:50.644 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-15T23:39:50.689 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.mi5zaCA69M 2024-09-15T23:39:50.689 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub/grub.cfg /tmp/tmp.mi5zaCA69M 2024-09-15T23:39:50.745 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.mi5zaCA69M 2024-09-15T23:39:50.812 INFO:teuthology.orchestra.run.smithi169.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-15T23:39:50.812 INFO:teuthology.orchestra.run.smithi169.stdout:Sourcing file `/etc/default/grub' 2024-09-15T23:39:50.823 INFO:teuthology.orchestra.run.smithi169.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T23:39:50.846 INFO:teuthology.orchestra.run.smithi169.stdout:Generating grub configuration file ... 2024-09-15T23:39:50.860 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.mi5zaCA69M is 10KB 2024-09-15T23:39:50.874 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.mi5zaCA69M 2024-09-15T23:39:50.879 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-15T23:39:50.937 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:39:50.937 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-15T23:39:50.938 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-15T23:39:51.015 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-15T23:39:51.015 DEBUG:teuthology.orchestra.run.smithi112:> sudo update-grub 2024-09-15T23:39:51.150 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T23:39:51.170 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T23:39:51.475 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T23:39:51.481 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T23:39:51.547 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T23:39:51.552 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T23:39:51.699 INFO:teuthology.orchestra.run.smithi169.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T23:39:51.699 INFO:teuthology.orchestra.run.smithi169.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T23:39:51.700 INFO:teuthology.orchestra.run.smithi169.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T23:39:51.746 INFO:teuthology.orchestra.run.smithi169.stdout:done 2024-09-15T23:39:52.222 DEBUG:teuthology.orchestra.run.smithi169:> dpkg -s linux-image-generic 2024-09-15T23:39:52.243 INFO:teuthology.orchestra.run.smithi169.stdout:Package: linux-image-generic 2024-09-15T23:39:52.243 INFO:teuthology.orchestra.run.smithi169.stdout:Status: install ok installed 2024-09-15T23:39:52.243 INFO:teuthology.orchestra.run.smithi169.stdout:Priority: optional 2024-09-15T23:39:52.243 INFO:teuthology.orchestra.run.smithi169.stdout:Section: kernel 2024-09-15T23:39:52.243 INFO:teuthology.orchestra.run.smithi169.stdout:Installed-Size: 21 2024-09-15T23:39:52.243 INFO:teuthology.orchestra.run.smithi169.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T23:39:52.243 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: amd64 2024-09-15T23:39:52.244 INFO:teuthology.orchestra.run.smithi169.stdout:Source: linux-meta 2024-09-15T23:39:52.244 INFO:teuthology.orchestra.run.smithi169.stdout:Version: 5.15.0.121.121 2024-09-15T23:39:52.244 INFO:teuthology.orchestra.run.smithi169.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T23:39:52.244 INFO:teuthology.orchestra.run.smithi169.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T23:39:52.244 INFO:teuthology.orchestra.run.smithi169.stdout:Recommends: thermald 2024-09-15T23:39:52.244 INFO:teuthology.orchestra.run.smithi169.stdout:Description: Generic Linux kernel image 2024-09-15T23:39:52.244 INFO:teuthology.orchestra.run.smithi169.stdout: This package will always depend on the latest generic kernel image 2024-09-15T23:39:52.244 INFO:teuthology.orchestra.run.smithi169.stdout: available. 2024-09-15T23:39:52.244 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-15T23:39:52.244 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T23:39:52.244 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T23:39:52.245 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-15T23:39:52.245 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi169.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T23:39:52.245 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get clean 2024-09-15T23:39:52.267 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub' 2024-09-15T23:39:52.269 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T23:39:52.270 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-09-15T23:39:52.450 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T23:39:52.457 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T23:39:52.478 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-09-15T23:39:52.598 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T23:39:52.608 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T23:39:52.625 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T23:39:52.720 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T23:39:52.721 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T23:39:52.726 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T23:39:52.768 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T23:39:52.773 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T23:39:52.938 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T23:39:52.938 INFO:teuthology.orchestra.run.smithi112.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T23:39:52.938 INFO:teuthology.orchestra.run.smithi112.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T23:39:52.959 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-09-15T23:39:52.968 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2024-09-15T23:39:54.047 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-09-15T23:39:54.066 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T23:39:54.127 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-09-15T23:39:54.338 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-09-15T23:39:54.338 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-09-15T23:39:54.520 INFO:teuthology.orchestra.run.smithi169.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-15T23:39:54.520 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T23:39:54.520 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T23:39:54.520 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T23:39:54.520 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T23:39:54.521 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T23:39:54.521 INFO:teuthology.orchestra.run.smithi169.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T23:39:54.521 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T23:39:54.559 INFO:teuthology.orchestra.run.smithi169.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T23:39:54.561 DEBUG:teuthology.orchestra.run.smithi169:> dpkg -s linux-image-generic 2024-09-15T23:39:54.577 INFO:teuthology.orchestra.run.smithi169.stdout:Package: linux-image-generic 2024-09-15T23:39:54.577 INFO:teuthology.orchestra.run.smithi169.stdout:Status: install ok installed 2024-09-15T23:39:54.577 INFO:teuthology.orchestra.run.smithi169.stdout:Priority: optional 2024-09-15T23:39:54.577 INFO:teuthology.orchestra.run.smithi169.stdout:Section: kernel 2024-09-15T23:39:54.577 INFO:teuthology.orchestra.run.smithi169.stdout:Installed-Size: 21 2024-09-15T23:39:54.577 INFO:teuthology.orchestra.run.smithi169.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T23:39:54.578 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: amd64 2024-09-15T23:39:54.578 INFO:teuthology.orchestra.run.smithi169.stdout:Source: linux-meta 2024-09-15T23:39:54.578 INFO:teuthology.orchestra.run.smithi169.stdout:Version: 5.15.0.121.121 2024-09-15T23:39:54.578 INFO:teuthology.orchestra.run.smithi169.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T23:39:54.578 INFO:teuthology.orchestra.run.smithi169.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T23:39:54.578 INFO:teuthology.orchestra.run.smithi169.stdout:Recommends: thermald 2024-09-15T23:39:54.578 INFO:teuthology.orchestra.run.smithi169.stdout:Description: Generic Linux kernel image 2024-09-15T23:39:54.578 INFO:teuthology.orchestra.run.smithi169.stdout: This package will always depend on the latest generic kernel image 2024-09-15T23:39:54.578 INFO:teuthology.orchestra.run.smithi169.stdout: available. 2024-09-15T23:39:54.578 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-09-15T23:39:54.623 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.ntH1aHot3A 2024-09-15T23:39:54.624 DEBUG:teuthology.orchestra.run.smithi169:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ntH1aHot3A 2024-09-15T23:39:54.679 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.ntH1aHot3A 2024-09-15T23:39:54.789 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.ntH1aHot3A is 10KB 2024-09-15T23:39:54.801 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.ntH1aHot3A 2024-09-15T23:39:54.807 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-15T23:39:54.859 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:39:54.859 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-15T23:39:54.859 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-15T23:39:54.922 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-15T23:39:54.922 DEBUG:teuthology.orchestra.run.smithi169:> sudo update-grub 2024-09-15T23:39:56.178 INFO:teuthology.orchestra.run.smithi169.stderr:Sourcing file `/etc/default/grub' 2024-09-15T23:39:56.179 INFO:teuthology.orchestra.run.smithi169.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T23:39:56.181 INFO:teuthology.orchestra.run.smithi169.stderr:Generating grub configuration file ... 2024-09-15T23:39:56.341 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T23:39:56.346 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T23:39:56.581 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T23:39:56.586 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T23:39:56.624 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T23:39:56.629 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T23:39:56.738 INFO:teuthology.orchestra.run.smithi169.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T23:39:56.738 INFO:teuthology.orchestra.run.smithi169.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T23:39:56.738 INFO:teuthology.orchestra.run.smithi169.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T23:39:56.752 INFO:teuthology.orchestra.run.smithi169.stderr:done 2024-09-15T23:39:56.761 DEBUG:teuthology.orchestra.run.smithi169:> sudo shutdown -r now 2024-09-15T23:40:22.994 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-15T23:40:22.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T23:40:22.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:40:26.765 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-15T23:40:26.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-15T23:40:26.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:40:41.405 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-15T23:40:45.245 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-09-15T23:40:50.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T23:40:50.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:40:53.469 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-15T23:40:54.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-15T23:40:54.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:40:57.309 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-09-15T23:41:05.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T23:41:05.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:41:09.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-15T23:41:09.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:41:23.901 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-15T23:41:38.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T23:41:38.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:41:38.921 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-15T23:41:56.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T23:41:56.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:41:57.212 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-15T23:41:57.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T23:41:57.821 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-15T23:41:57.821 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-15T23:41:57.869 INFO:teuthology.orchestra.run.smithi112.stdout:5.15.0-121-generic 2024-09-15T23:41:57.869 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-15T23:41:57.869 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T23:41:57.869 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-15T23:41:58.872 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-15T23:41:58.873 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T23:41:59.238 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2024-09-15T23:41:59.279 DEBUG:teuthology.parallel:result is None 2024-09-15T23:42:09.317 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T23:42:24.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-15T23:42:24.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:42:24.547 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-15T23:42:25.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-15T23:42:25.183 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-15T23:42:25.183 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-09-15T23:42:25.228 INFO:teuthology.orchestra.run.smithi169.stdout:5.15.0-121-generic 2024-09-15T23:42:25.228 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-15T23:42:25.228 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T23:42:25.228 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-15T23:42:26.229 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-15T23:42:26.230 DEBUG:teuthology.orchestra.run.smithi169:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T23:42:26.575 INFO:teuthology.orchestra.run.smithi169.stdout:ttyS1 2024-09-15T23:42:26.594 DEBUG:teuthology.parallel:result is None 2024-09-15T23:42:26.594 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T23:42:26.602 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T23:42:26.603 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T23:42:26.605 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T23:42:26.611 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T23:42:26.618 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T23:42:26.630 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T23:42:26.630 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T23:42:26.653 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T23:42:26.719 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T23:42:26.726 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T23:42:26.726 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T23:42:26.729 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T23:42:26.745 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:42:26.749 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:42:26.754 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:42:26.757 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:42:26.758 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T23:42:26.770 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T23:42:26.770 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T23:42:26.806 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T23:42:26.831 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T23:42:26.845 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T23:42:26.845 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T23:42:26.874 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T23:42:26.879 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T23:42:26.925 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T23:42:26.973 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:42:26.973 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T23:42:27.037 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T23:42:27.043 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T23:42:27.090 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:42:27.090 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T23:42:27.160 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-09-15T23:42:27.162 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-09-15T23:42:27.239 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T23:42:27.257 INFO:teuthology.task.internal:Starting timer... 2024-09-15T23:42:27.257 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T23:42:27.277 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T23:42:27.296 DEBUG:teuthology.task.selinux:Excluding smithi112: OS 'ubuntu' does not support SELinux 2024-09-15T23:42:27.296 DEBUG:teuthology.task.selinux:Excluding smithi169: OS 'ubuntu' does not support SELinux 2024-09-15T23:42:27.296 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T23:42:27.296 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-15T23:42:27.296 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T23:42:27.296 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T23:42:27.309 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T23:42:27.321 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T23:42:27.322 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi112.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T23:49:58.065 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2024-09-15T23:49:58.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T23:49:58.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:49:58.153 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-15T23:49:58.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T23:49:58.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-15T23:49:58.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:49:58.312 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-15T23:49:58.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-15T23:49:58.389 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T23:49:58.402 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T23:49:58.402 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T23:49:58.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:49:58.405 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T23:49:58.405 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:49:58.430 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-15T23:49:58.430 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: Command line: ntpd -gq 2024-09-15T23:49:58.430 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: ---------------------------------------------------- 2024-09-15T23:49:58.430 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: ntp-4 is maintained by Network Time Foundation, 2024-09-15T23:49:58.430 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-15T23:49:58.430 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: corporation. Support and training for ntp-4 are 2024-09-15T23:49:58.431 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: available at https://www.nwtime.org/support 2024-09-15T23:49:58.431 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: ---------------------------------------------------- 2024-09-15T23:49:58.431 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: proto: precision = 0.043 usec (-24) 2024-09-15T23:49:58.431 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: basedate set to 2022-02-04 2024-09-15T23:49:58.431 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: gps base set to 2022-02-06 (week 2196) 2024-09-15T23:49:58.432 INFO:teuthology.orchestra.run.smithi112.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T23:49:58.432 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T23:49:58.432 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: restrict ::: KOD does nothing without LIMITED. 2024-09-15T23:49:58.432 INFO:teuthology.orchestra.run.smithi112.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-15T23:49:58.433 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: Listen and drop on 0 v6wildcard [::]:123 2024-09-15T23:49:58.433 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-15T23:49:58.433 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: Listen normally on 2 lo 127.0.0.1:123 2024-09-15T23:49:58.433 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: Listen normally on 3 enp3s0f1 172.21.15.112:123 2024-09-15T23:49:58.433 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: Listen normally on 4 lo [::1]:123 2024-09-15T23:49:58.434 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb69%5]:123 2024-09-15T23:49:58.434 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:49:58 ntpd[18461]: Listening on routing socket on fd #22 for interface updates 2024-09-15T23:49:58.459 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-15T23:49:58.459 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: Command line: ntpd -gq 2024-09-15T23:49:58.460 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: ---------------------------------------------------- 2024-09-15T23:49:58.460 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: ntp-4 is maintained by Network Time Foundation, 2024-09-15T23:49:58.460 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-15T23:49:58.460 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: corporation. Support and training for ntp-4 are 2024-09-15T23:49:58.460 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: available at https://www.nwtime.org/support 2024-09-15T23:49:58.460 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: ---------------------------------------------------- 2024-09-15T23:49:58.461 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: proto: precision = 0.044 usec (-24) 2024-09-15T23:49:58.461 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: basedate set to 2022-02-04 2024-09-15T23:49:58.461 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: gps base set to 2022-02-06 (week 2196) 2024-09-15T23:49:58.461 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T23:49:58.461 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: restrict ::: KOD does nothing without LIMITED. 2024-09-15T23:49:58.461 INFO:teuthology.orchestra.run.smithi169.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T23:49:58.461 INFO:teuthology.orchestra.run.smithi169.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-15T23:49:58.462 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: Listen and drop on 0 v6wildcard [::]:123 2024-09-15T23:49:58.462 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-15T23:49:58.462 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: Listen normally on 2 lo 127.0.0.1:123 2024-09-15T23:49:58.463 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: Listen normally on 3 enp3s0f1 172.21.15.169:123 2024-09-15T23:49:58.463 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: Listen normally on 4 lo [::1]:123 2024-09-15T23:49:58.463 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f4d%5]:123 2024-09-15T23:49:58.463 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:49:58 ntpd[18471]: Listening on routing socket on fd #22 for interface updates 2024-09-15T23:49:59.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:49:59 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:49:59.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:49:59 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:49:59.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:49:59 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:49:59.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:49:59 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:49:59.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:49:59 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:49:59.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:49:59 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:49:59.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:49:59 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:49:59.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:49:59 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:49:59.460 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:49:59 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:49:59.460 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:49:59 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:00.430 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:00 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:00.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:00 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:00.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:00 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:00.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:00 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:00.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:00 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:00.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:00 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:00.460 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:00 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:00.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:00 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:00.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:00 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:00.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:00 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:00.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:00 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:00.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:00 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:01 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:01 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:01 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:01 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:01 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:01 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:01 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:01 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:01 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:01 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:01 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:01 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:01.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:01 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:01.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:01 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:01.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:01 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:01.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:01 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:01.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:01 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:01.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:01 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:02.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:02 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:02.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:02 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:02.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:02 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:02.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:02 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:02.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:02 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:02.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:02 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:02.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:02 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:02.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:02 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:02.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:02 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:02.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:02 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:02.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:02 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:02.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:02 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:02.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:02 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:02.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:02 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:02.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:02 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:02.462 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:02 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:02.462 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:02 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:02.462 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:02 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:03.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:03 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:03.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:03 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:03.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:03 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:03.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:03 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:03.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:03 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:03.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:03 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:03.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:03 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:03.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:03 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:03.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:03 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:03.433 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:03 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:03.433 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:03 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:03.433 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:03 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:03.460 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:03 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:03.460 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:03 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:03.460 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:03 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:03.460 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:03 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:03.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:03 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:03.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:03 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:04.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:04 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:04.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:04 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:04.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:04 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:04.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:04 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:04.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:04 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:04.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:04 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:04.460 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:04 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:04.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:04 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:04.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:04 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:04.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:04 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:04.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:04 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:04.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:04 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:04.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:04 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:04.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:04 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:04.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:04 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:04.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:04 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:04.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:04 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:04.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:04 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:05.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:05 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:05.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:05 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:05.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:05 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:05.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:05 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:05.431 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:05 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:05.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:05 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:05.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:05 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:05.432 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:05 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:05.432 INFO:teuthology.orchestra.run.smithi112.stdout:15 Sep 23:50:05 ntpd[18461]: ntpd: time slew -0.000526 s 2024-09-15T23:50:05.432 INFO:teuthology.orchestra.run.smithi112.stdout:ntpd: time slew -0.000526s 2024-09-15T23:50:05.433 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:05 ntpd[18461]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-15T23:50:05.433 INFO:teuthology.orchestra.run.smithi112.stderr:15 Sep 23:50:05 ntpd[18461]: can't open /var/log/ntpstats/loopstats.20240915: Permission denied 2024-09-15T23:50:05.460 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:05 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:05.460 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:05 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:05.460 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:05 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:05.460 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:05 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:05.460 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:05 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:05.460 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:05 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:05.483 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T23:50:05.483 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2024-09-15T23:50:05.483 INFO:teuthology.orchestra.run.smithi112.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T23:50:05.483 INFO:teuthology.orchestra.run.smithi112.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T23:50:05.483 INFO:teuthology.orchestra.run.smithi112.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T23:50:05.483 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T23:50:06.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:06 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:06.461 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:06 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:06.462 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:06 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:06.462 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:06 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:06.462 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:06 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:06.462 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:06 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:06.462 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:06 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:06.462 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:06 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:06.462 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:06 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T23:50:06.462 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:06 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T23:50:06.462 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:06 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T23:50:06.462 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:06 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T23:50:06.462 INFO:teuthology.orchestra.run.smithi169.stdout:15 Sep 23:50:06 ntpd[18471]: ntpd: time slew -0.000268 s 2024-09-15T23:50:06.463 INFO:teuthology.orchestra.run.smithi169.stdout:ntpd: time slew -0.000268s 2024-09-15T23:50:06.463 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:06 ntpd[18471]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-15T23:50:06.463 INFO:teuthology.orchestra.run.smithi169.stderr:15 Sep 23:50:06 ntpd[18471]: can't open /var/log/ntpstats/loopstats.20240915: Permission denied 2024-09-15T23:50:06.509 INFO:teuthology.orchestra.run.smithi169.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T23:50:06.510 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================== 2024-09-15T23:50:06.510 INFO:teuthology.orchestra.run.smithi169.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T23:50:06.510 INFO:teuthology.orchestra.run.smithi169.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T23:50:06.510 INFO:teuthology.orchestra.run.smithi169.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T23:50:06.510 INFO:teuthology.orchestra.run.smithi169.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T23:50:06.511 INFO:teuthology.run_tasks:Running task install... 2024-09-15T23:50:06.519 DEBUG:teuthology.task.install:project ceph 2024-09-15T23:50:06.519 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T23:50:06.520 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T23:50:06.520 INFO:teuthology.task.install:Using flavor: default 2024-09-15T23:50:06.525 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T23:50:06.525 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T23:50:06.526 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-key list | grep Ceph 2024-09-15T23:50:06.526 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-key list | grep Ceph 2024-09-15T23:50:06.588 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-15T23:50:06.612 INFO:teuthology.orchestra.run.smithi169.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-15T23:50:06.617 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-15T23:50:06.618 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph.com (release key) 2024-09-15T23:50:06.619 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-15T23:50:06.619 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-15T23:50:06.619 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:50:06.641 INFO:teuthology.orchestra.run.smithi169.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-15T23:50:06.641 INFO:teuthology.orchestra.run.smithi169.stdout:uid [ unknown] Ceph.com (release key) 2024-09-15T23:50:06.641 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-15T23:50:06.642 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-15T23:50:06.642 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:50:06.761 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-15T23:50:06.761 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T23:50:06.779 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-15T23:50:06.779 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T23:50:06.873 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:50:06.873 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-15T23:50:06.887 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-15T23:50:06.891 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:50:06.891 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-15T23:50:06.905 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-09-15T23:50:07.056 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T23:50:07.065 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T23:50:07.076 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T23:50:07.082 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T23:50:07.109 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-15T23:50:07.130 INFO:teuthology.orchestra.run.smithi169.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-15T23:50:07.131 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-15T23:50:07.152 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-15T23:50:07.152 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-15T23:50:07.173 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-15T23:50:07.174 INFO:teuthology.orchestra.run.smithi169.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-15T23:50:07.195 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-15T23:50:07.196 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T23:50:07.201 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-15T23:50:07.201 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T23:50:07.223 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-15T23:50:07.279 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T23:50:07.361 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T23:50:07.411 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 29.0 kB in 0s (83.7 kB/s) 2024-09-15T23:50:07.507 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 29.0 kB in 0s (70.4 kB/s) 2024-09-15T23:50:08.422 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-15T23:50:08.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy cephfs-shell=19.1.1-326-g8921c8ef-1jammy cephfs-top=19.1.1-326-g8921c8ef-1jammy cephfs-mirror=19.1.1-326-g8921c8ef-1jammy 2024-09-15T23:50:08.500 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-15T23:50:08.531 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-09-15T23:50:08.548 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy cephfs-shell=19.1.1-326-g8921c8ef-1jammy cephfs-top=19.1.1-326-g8921c8ef-1jammy cephfs-mirror=19.1.1-326-g8921c8ef-1jammy 2024-09-15T23:50:08.613 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-09-15T23:50:08.710 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-15T23:50:08.711 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-15T23:50:08.822 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-09-15T23:50:08.823 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-09-15T23:50:08.901 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T23:50:08.902 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T23:50:08.902 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T23:50:08.902 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T23:50:08.902 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T23:50:08.902 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T23:50:08.902 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T23:50:08.904 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-15T23:50:08.904 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-15T23:50:08.904 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-15T23:50:08.904 INFO:teuthology.orchestra.run.smithi112.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T23:50:08.904 INFO:teuthology.orchestra.run.smithi112.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-15T23:50:08.904 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-15T23:50:08.904 INFO:teuthology.orchestra.run.smithi112.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-15T23:50:08.904 INFO:teuthology.orchestra.run.smithi112.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-15T23:50:08.904 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-15T23:50:08.904 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-15T23:50:08.905 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-15T23:50:08.905 INFO:teuthology.orchestra.run.smithi112.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-15T23:50:08.905 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-15T23:50:08.905 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-15T23:50:08.905 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-15T23:50:08.905 INFO:teuthology.orchestra.run.smithi112.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-15T23:50:08.905 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-15T23:50:08.905 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-15T23:50:08.905 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-15T23:50:08.905 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-15T23:50:08.905 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-15T23:50:08.906 INFO:teuthology.orchestra.run.smithi112.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-15T23:50:08.906 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-15T23:50:08.906 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-15T23:50:08.906 INFO:teuthology.orchestra.run.smithi112.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-15T23:50:08.906 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-15T23:50:08.907 INFO:teuthology.orchestra.run.smithi112.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-15T23:50:08.907 INFO:teuthology.orchestra.run.smithi112.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-15T23:50:08.907 INFO:teuthology.orchestra.run.smithi112.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-15T23:50:08.907 INFO:teuthology.orchestra.run.smithi112.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-15T23:50:08.907 INFO:teuthology.orchestra.run.smithi112.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-15T23:50:08.907 INFO:teuthology.orchestra.run.smithi112.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-15T23:50:08.907 INFO:teuthology.orchestra.run.smithi112.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-15T23:50:08.907 INFO:teuthology.orchestra.run.smithi112.stdout:Recommended packages: 2024-09-15T23:50:08.907 INFO:teuthology.orchestra.run.smithi112.stdout: btrfs-tools 2024-09-15T23:50:09.012 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-15T23:50:09.012 INFO:teuthology.orchestra.run.smithi112.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-15T23:50:09.012 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-15T23:50:09.012 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-15T23:50:09.013 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-15T23:50:09.013 INFO:teuthology.orchestra.run.smithi112.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T23:50:09.013 INFO:teuthology.orchestra.run.smithi112.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-15T23:50:09.013 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-15T23:50:09.014 INFO:teuthology.orchestra.run.smithi112.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-15T23:50:09.014 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-15T23:50:09.014 INFO:teuthology.orchestra.run.smithi112.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-15T23:50:09.014 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-15T23:50:09.014 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-15T23:50:09.014 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-15T23:50:09.014 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-15T23:50:09.014 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-15T23:50:09.014 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-15T23:50:09.014 INFO:teuthology.orchestra.run.smithi112.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-15T23:50:09.015 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-15T23:50:09.015 INFO:teuthology.orchestra.run.smithi112.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-15T23:50:09.015 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-15T23:50:09.015 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-15T23:50:09.015 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-15T23:50:09.015 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-15T23:50:09.015 INFO:teuthology.orchestra.run.smithi112.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-15T23:50:09.015 INFO:teuthology.orchestra.run.smithi112.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-15T23:50:09.015 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-15T23:50:09.015 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-15T23:50:09.015 INFO:teuthology.orchestra.run.smithi112.stdout: socat unzip xmlstarlet zip 2024-09-15T23:50:09.031 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T23:50:09.032 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T23:50:09.032 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T23:50:09.032 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T23:50:09.032 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T23:50:09.032 INFO:teuthology.orchestra.run.smithi169.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T23:50:09.033 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T23:50:09.033 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2024-09-15T23:50:09.033 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-15T23:50:09.033 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-15T23:50:09.034 INFO:teuthology.orchestra.run.smithi169.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T23:50:09.035 INFO:teuthology.orchestra.run.smithi169.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-15T23:50:09.035 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-15T23:50:09.035 INFO:teuthology.orchestra.run.smithi169.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-15T23:50:09.035 INFO:teuthology.orchestra.run.smithi169.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-15T23:50:09.035 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-15T23:50:09.035 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-15T23:50:09.035 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-15T23:50:09.035 INFO:teuthology.orchestra.run.smithi169.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-15T23:50:09.035 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-15T23:50:09.035 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-15T23:50:09.035 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-15T23:50:09.035 INFO:teuthology.orchestra.run.smithi169.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-15T23:50:09.035 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-15T23:50:09.035 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-15T23:50:09.036 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-15T23:50:09.036 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-15T23:50:09.036 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-15T23:50:09.036 INFO:teuthology.orchestra.run.smithi169.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-15T23:50:09.036 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-15T23:50:09.036 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-15T23:50:09.036 INFO:teuthology.orchestra.run.smithi169.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-15T23:50:09.036 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2024-09-15T23:50:09.036 INFO:teuthology.orchestra.run.smithi169.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-15T23:50:09.036 INFO:teuthology.orchestra.run.smithi169.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-15T23:50:09.037 INFO:teuthology.orchestra.run.smithi169.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-15T23:50:09.037 INFO:teuthology.orchestra.run.smithi169.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-15T23:50:09.037 INFO:teuthology.orchestra.run.smithi169.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-15T23:50:09.037 INFO:teuthology.orchestra.run.smithi169.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-15T23:50:09.037 INFO:teuthology.orchestra.run.smithi169.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-15T23:50:09.037 INFO:teuthology.orchestra.run.smithi169.stdout:Recommended packages: 2024-09-15T23:50:09.037 INFO:teuthology.orchestra.run.smithi169.stdout: btrfs-tools 2024-09-15T23:50:09.074 INFO:teuthology.orchestra.run.smithi112.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-15T23:50:09.075 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 181 MB of archives. 2024-09-15T23:50:09.075 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-15T23:50:09.075 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-15T23:50:09.092 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-15T23:50:09.102 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-15T23:50:09.143 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-15T23:50:09.146 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2024-09-15T23:50:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-15T23:50:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-15T23:50:09.146 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-15T23:50:09.148 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-15T23:50:09.148 INFO:teuthology.orchestra.run.smithi169.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T23:50:09.148 INFO:teuthology.orchestra.run.smithi169.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-15T23:50:09.148 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-15T23:50:09.148 INFO:teuthology.orchestra.run.smithi169.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-15T23:50:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-15T23:50:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-15T23:50:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-15T23:50:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-15T23:50:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-15T23:50:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-15T23:50:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-15T23:50:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-15T23:50:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-15T23:50:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-15T23:50:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-15T23:50:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-15T23:50:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-15T23:50:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-15T23:50:09.150 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-15T23:50:09.150 INFO:teuthology.orchestra.run.smithi169.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-15T23:50:09.150 INFO:teuthology.orchestra.run.smithi169.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-15T23:50:09.150 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-15T23:50:09.150 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-15T23:50:09.150 INFO:teuthology.orchestra.run.smithi169.stdout: socat unzip xmlstarlet zip 2024-09-15T23:50:09.159 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-15T23:50:09.164 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-15T23:50:09.167 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-15T23:50:09.178 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-15T23:50:09.209 INFO:teuthology.orchestra.run.smithi169.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-15T23:50:09.209 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 181 MB of archives. 2024-09-15T23:50:09.209 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-15T23:50:09.209 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-15T23:50:09.226 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-15T23:50:09.226 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-15T23:50:09.230 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-15T23:50:09.236 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-15T23:50:09.241 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-15T23:50:09.245 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-15T23:50:09.245 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-15T23:50:09.253 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-15T23:50:09.255 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-15T23:50:09.257 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-15T23:50:09.259 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-15T23:50:09.259 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-15T23:50:09.263 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-15T23:50:09.265 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-15T23:50:09.277 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-15T23:50:09.279 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-15T23:50:09.280 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-15T23:50:09.280 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-15T23:50:09.282 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-15T23:50:09.282 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-15T23:50:09.282 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-15T23:50:09.283 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-15T23:50:09.283 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-15T23:50:09.292 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-15T23:50:09.297 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-15T23:50:09.298 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-15T23:50:09.298 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-15T23:50:09.301 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-15T23:50:09.312 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-15T23:50:09.314 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-15T23:50:09.315 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-15T23:50:09.316 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-15T23:50:09.316 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-15T23:50:09.317 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-15T23:50:09.317 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-15T23:50:09.318 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-15T23:50:09.319 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-15T23:50:09.331 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-15T23:50:09.332 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-15T23:50:09.348 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-15T23:50:09.349 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-15T23:50:09.349 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-15T23:50:09.350 INFO:teuthology.orchestra.run.smithi112.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-15T23:50:09.351 INFO:teuthology.orchestra.run.smithi112.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-15T23:50:09.353 INFO:teuthology.orchestra.run.smithi112.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-15T23:50:09.353 INFO:teuthology.orchestra.run.smithi112.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-15T23:50:09.355 INFO:teuthology.orchestra.run.smithi112.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-15T23:50:09.355 INFO:teuthology.orchestra.run.smithi112.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-15T23:50:09.361 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-15T23:50:09.365 INFO:teuthology.orchestra.run.smithi112.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-15T23:50:09.366 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-15T23:50:09.367 INFO:teuthology.orchestra.run.smithi112.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-15T23:50:09.376 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-15T23:50:09.379 INFO:teuthology.orchestra.run.smithi169.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-15T23:50:09.380 INFO:teuthology.orchestra.run.smithi169.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-15T23:50:09.382 INFO:teuthology.orchestra.run.smithi112.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-15T23:50:09.383 INFO:teuthology.orchestra.run.smithi112.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-15T23:50:09.385 INFO:teuthology.orchestra.run.smithi112.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-15T23:50:09.388 INFO:teuthology.orchestra.run.smithi169.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-15T23:50:09.390 INFO:teuthology.orchestra.run.smithi169.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-15T23:50:09.392 INFO:teuthology.orchestra.run.smithi169.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-15T23:50:09.393 INFO:teuthology.orchestra.run.smithi169.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-15T23:50:09.393 INFO:teuthology.orchestra.run.smithi169.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-15T23:50:09.400 INFO:teuthology.orchestra.run.smithi169.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-15T23:50:09.402 INFO:teuthology.orchestra.run.smithi169.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-15T23:50:09.403 INFO:teuthology.orchestra.run.smithi169.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-15T23:50:09.405 INFO:teuthology.orchestra.run.smithi112.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-15T23:50:09.417 INFO:teuthology.orchestra.run.smithi169.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-15T23:50:09.417 INFO:teuthology.orchestra.run.smithi169.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-15T23:50:09.418 INFO:teuthology.orchestra.run.smithi112.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-15T23:50:09.418 INFO:teuthology.orchestra.run.smithi169.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-15T23:50:09.418 INFO:teuthology.orchestra.run.smithi169.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-15T23:50:09.419 INFO:teuthology.orchestra.run.smithi169.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-15T23:50:09.419 INFO:teuthology.orchestra.run.smithi169.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-15T23:50:09.419 INFO:teuthology.orchestra.run.smithi169.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-15T23:50:09.425 INFO:teuthology.orchestra.run.smithi112.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-15T23:50:09.425 INFO:teuthology.orchestra.run.smithi112.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-15T23:50:09.428 INFO:teuthology.orchestra.run.smithi112.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-15T23:50:09.429 INFO:teuthology.orchestra.run.smithi112.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-15T23:50:09.434 INFO:teuthology.orchestra.run.smithi169.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-15T23:50:09.434 INFO:teuthology.orchestra.run.smithi169.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-15T23:50:09.435 INFO:teuthology.orchestra.run.smithi112.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-15T23:50:09.436 INFO:teuthology.orchestra.run.smithi112.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-15T23:50:09.437 INFO:teuthology.orchestra.run.smithi112.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-15T23:50:09.437 INFO:teuthology.orchestra.run.smithi169.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-15T23:50:09.437 INFO:teuthology.orchestra.run.smithi112.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-15T23:50:09.438 INFO:teuthology.orchestra.run.smithi112.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-15T23:50:09.439 INFO:teuthology.orchestra.run.smithi112.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-15T23:50:09.451 INFO:teuthology.orchestra.run.smithi169.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-15T23:50:09.451 INFO:teuthology.orchestra.run.smithi169.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-15T23:50:09.452 INFO:teuthology.orchestra.run.smithi169.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-15T23:50:09.453 INFO:teuthology.orchestra.run.smithi169.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-15T23:50:09.453 INFO:teuthology.orchestra.run.smithi169.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-15T23:50:09.453 INFO:teuthology.orchestra.run.smithi169.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-15T23:50:09.454 INFO:teuthology.orchestra.run.smithi169.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-15T23:50:09.456 INFO:teuthology.orchestra.run.smithi112.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-15T23:50:09.458 INFO:teuthology.orchestra.run.smithi112.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-15T23:50:09.458 INFO:teuthology.orchestra.run.smithi112.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-15T23:50:09.468 INFO:teuthology.orchestra.run.smithi169.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-15T23:50:09.468 INFO:teuthology.orchestra.run.smithi169.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-15T23:50:09.473 INFO:teuthology.orchestra.run.smithi112.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-15T23:50:09.473 INFO:teuthology.orchestra.run.smithi112.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-15T23:50:09.474 INFO:teuthology.orchestra.run.smithi169.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-15T23:50:09.475 INFO:teuthology.orchestra.run.smithi112.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-15T23:50:09.475 INFO:teuthology.orchestra.run.smithi112.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-15T23:50:09.475 INFO:teuthology.orchestra.run.smithi112.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-15T23:50:09.475 INFO:teuthology.orchestra.run.smithi112.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-15T23:50:09.485 INFO:teuthology.orchestra.run.smithi169.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-15T23:50:09.486 INFO:teuthology.orchestra.run.smithi169.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-15T23:50:09.486 INFO:teuthology.orchestra.run.smithi169.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-15T23:50:09.488 INFO:teuthology.orchestra.run.smithi169.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-15T23:50:09.489 INFO:teuthology.orchestra.run.smithi169.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-15T23:50:09.490 INFO:teuthology.orchestra.run.smithi169.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-15T23:50:09.491 INFO:teuthology.orchestra.run.smithi169.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-15T23:50:09.502 INFO:teuthology.orchestra.run.smithi169.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-15T23:50:09.504 INFO:teuthology.orchestra.run.smithi169.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-15T23:50:09.504 INFO:teuthology.orchestra.run.smithi169.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-15T23:50:09.515 INFO:teuthology.orchestra.run.smithi112.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-15T23:50:09.515 INFO:teuthology.orchestra.run.smithi112.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-15T23:50:09.518 INFO:teuthology.orchestra.run.smithi112.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-15T23:50:09.519 INFO:teuthology.orchestra.run.smithi169.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-15T23:50:09.520 INFO:teuthology.orchestra.run.smithi112.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-15T23:50:09.521 INFO:teuthology.orchestra.run.smithi112.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-15T23:50:09.521 INFO:teuthology.orchestra.run.smithi169.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-15T23:50:09.521 INFO:teuthology.orchestra.run.smithi112.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-15T23:50:09.524 INFO:teuthology.orchestra.run.smithi112.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-15T23:50:09.527 INFO:teuthology.orchestra.run.smithi112.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-15T23:50:09.532 INFO:teuthology.orchestra.run.smithi112.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-15T23:50:09.544 INFO:teuthology.orchestra.run.smithi112.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-15T23:50:09.545 INFO:teuthology.orchestra.run.smithi112.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-15T23:50:09.549 INFO:teuthology.orchestra.run.smithi112.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-15T23:50:09.549 INFO:teuthology.orchestra.run.smithi112.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-15T23:50:09.552 INFO:teuthology.orchestra.run.smithi112.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-15T23:50:09.552 INFO:teuthology.orchestra.run.smithi112.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-15T23:50:09.553 INFO:teuthology.orchestra.run.smithi112.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-15T23:50:09.553 INFO:teuthology.orchestra.run.smithi112.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-15T23:50:09.554 INFO:teuthology.orchestra.run.smithi112.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-15T23:50:09.558 INFO:teuthology.orchestra.run.smithi112.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-15T23:50:09.559 INFO:teuthology.orchestra.run.smithi112.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-15T23:50:09.565 INFO:teuthology.orchestra.run.smithi112.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-15T23:50:09.571 INFO:teuthology.orchestra.run.smithi112.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-15T23:50:09.571 INFO:teuthology.orchestra.run.smithi112.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-15T23:50:09.573 INFO:teuthology.orchestra.run.smithi169.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-15T23:50:09.574 INFO:teuthology.orchestra.run.smithi169.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-15T23:50:09.576 INFO:teuthology.orchestra.run.smithi169.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-15T23:50:09.576 INFO:teuthology.orchestra.run.smithi169.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-15T23:50:09.576 INFO:teuthology.orchestra.run.smithi169.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-15T23:50:09.582 INFO:teuthology.orchestra.run.smithi112.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-15T23:50:09.583 INFO:teuthology.orchestra.run.smithi112.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-15T23:50:09.585 INFO:teuthology.orchestra.run.smithi112.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-15T23:50:09.585 INFO:teuthology.orchestra.run.smithi112.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-15T23:50:09.594 INFO:teuthology.orchestra.run.smithi169.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-15T23:50:09.596 INFO:teuthology.orchestra.run.smithi169.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-15T23:50:09.596 INFO:teuthology.orchestra.run.smithi169.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-15T23:50:09.611 INFO:teuthology.orchestra.run.smithi169.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-15T23:50:09.611 INFO:teuthology.orchestra.run.smithi169.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-15T23:50:09.611 INFO:teuthology.orchestra.run.smithi169.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-15T23:50:09.612 INFO:teuthology.orchestra.run.smithi169.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-15T23:50:09.612 INFO:teuthology.orchestra.run.smithi169.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-15T23:50:09.612 INFO:teuthology.orchestra.run.smithi169.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-15T23:50:09.627 INFO:teuthology.orchestra.run.smithi169.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-15T23:50:09.627 INFO:teuthology.orchestra.run.smithi169.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-15T23:50:09.633 INFO:teuthology.orchestra.run.smithi169.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-15T23:50:09.643 INFO:teuthology.orchestra.run.smithi169.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-15T23:50:09.645 INFO:teuthology.orchestra.run.smithi169.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-15T23:50:09.645 INFO:teuthology.orchestra.run.smithi169.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-15T23:50:09.648 INFO:teuthology.orchestra.run.smithi169.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-15T23:50:09.651 INFO:teuthology.orchestra.run.smithi169.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-15T23:50:09.651 INFO:teuthology.orchestra.run.smithi169.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-15T23:50:09.651 INFO:teuthology.orchestra.run.smithi169.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-15T23:50:09.660 INFO:teuthology.orchestra.run.smithi169.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-15T23:50:09.664 INFO:teuthology.orchestra.run.smithi169.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-15T23:50:09.665 INFO:teuthology.orchestra.run.smithi169.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-15T23:50:09.677 INFO:teuthology.orchestra.run.smithi169.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-15T23:50:09.677 INFO:teuthology.orchestra.run.smithi169.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-15T23:50:09.678 INFO:teuthology.orchestra.run.smithi169.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-15T23:50:09.678 INFO:teuthology.orchestra.run.smithi169.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-15T23:50:09.680 INFO:teuthology.orchestra.run.smithi169.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-15T23:50:09.680 INFO:teuthology.orchestra.run.smithi169.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-15T23:50:09.686 INFO:teuthology.orchestra.run.smithi169.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-15T23:50:09.694 INFO:teuthology.orchestra.run.smithi169.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-15T23:50:09.694 INFO:teuthology.orchestra.run.smithi169.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-15T23:50:09.696 INFO:teuthology.orchestra.run.smithi169.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-15T23:50:09.711 INFO:teuthology.orchestra.run.smithi169.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-15T23:50:10.006 INFO:teuthology.orchestra.run.smithi169.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-15T23:50:10.108 INFO:teuthology.orchestra.run.smithi112.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-15T23:50:10.154 INFO:teuthology.orchestra.run.smithi112.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-15T23:50:10.157 INFO:teuthology.orchestra.run.smithi112.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-15T23:50:10.159 INFO:teuthology.orchestra.run.smithi112.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-15T23:50:10.189 INFO:teuthology.orchestra.run.smithi112.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-15T23:50:10.260 INFO:teuthology.orchestra.run.smithi169.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-15T23:50:10.306 INFO:teuthology.orchestra.run.smithi112.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-15T23:50:10.354 INFO:teuthology.orchestra.run.smithi169.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-15T23:50:10.374 INFO:teuthology.orchestra.run.smithi169.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-15T23:50:10.375 INFO:teuthology.orchestra.run.smithi169.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-15T23:50:10.414 INFO:teuthology.orchestra.run.smithi169.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-15T23:50:10.428 INFO:teuthology.orchestra.run.smithi169.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-15T23:50:10.435 INFO:teuthology.orchestra.run.smithi169.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-15T23:50:10.872 INFO:teuthology.orchestra.run.smithi112.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-15T23:50:10.872 INFO:teuthology.orchestra.run.smithi112.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-15T23:50:10.883 INFO:teuthology.orchestra.run.smithi169.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-15T23:50:10.885 INFO:teuthology.orchestra.run.smithi169.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-15T23:50:10.887 INFO:teuthology.orchestra.run.smithi112.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-15T23:50:10.894 INFO:teuthology.orchestra.run.smithi169.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-15T23:50:10.925 INFO:teuthology.orchestra.run.smithi112.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-15T23:50:10.934 INFO:teuthology.orchestra.run.smithi112.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-15T23:50:10.936 INFO:teuthology.orchestra.run.smithi112.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-15T23:50:10.968 INFO:teuthology.orchestra.run.smithi112.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-15T23:50:11.169 INFO:teuthology.orchestra.run.smithi112.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-15T23:50:11.170 INFO:teuthology.orchestra.run.smithi112.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-15T23:50:12.144 INFO:teuthology.orchestra.run.smithi169.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-15T23:50:12.270 INFO:teuthology.orchestra.run.smithi169.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-15T23:50:12.275 INFO:teuthology.orchestra.run.smithi169.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-15T23:50:12.278 INFO:teuthology.orchestra.run.smithi169.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-15T23:50:12.334 INFO:teuthology.orchestra.run.smithi169.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-15T23:50:12.564 INFO:teuthology.orchestra.run.smithi169.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-15T23:50:12.787 INFO:teuthology.orchestra.run.smithi112.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-15T23:50:12.790 INFO:teuthology.orchestra.run.smithi112.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-326-g8921c8ef-1jammy [237 kB] 2024-09-15T23:50:12.794 INFO:teuthology.orchestra.run.smithi112.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-326-g8921c8ef-1jammy [34.0 kB] 2024-09-15T23:50:12.795 INFO:teuthology.orchestra.run.smithi112.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-326-g8921c8ef-1jammy [23.5 kB] 2024-09-15T23:50:12.796 INFO:teuthology.orchestra.run.smithi112.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-15T23:50:12.797 INFO:teuthology.orchestra.run.smithi112.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-15T23:50:13.121 INFO:teuthology.orchestra.run.smithi112.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-15T23:50:13.272 INFO:teuthology.orchestra.run.smithi169.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-15T23:50:13.273 INFO:teuthology.orchestra.run.smithi169.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-15T23:50:13.289 INFO:teuthology.orchestra.run.smithi169.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-15T23:50:13.331 INFO:teuthology.orchestra.run.smithi169.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-15T23:50:13.341 INFO:teuthology.orchestra.run.smithi169.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-15T23:50:13.343 INFO:teuthology.orchestra.run.smithi169.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-15T23:50:13.364 INFO:teuthology.orchestra.run.smithi169.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-15T23:50:13.491 INFO:teuthology.orchestra.run.smithi169.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-15T23:50:13.491 INFO:teuthology.orchestra.run.smithi169.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-15T23:50:13.754 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 181 MB in 4s (44.2 MB/s) 2024-09-15T23:50:13.896 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-15T23:50:13.996 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-15T23:50:14.001 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-15T23:50:14.045 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-15T23:50:14.356 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-15T23:50:14.382 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-15T23:50:14.423 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T23:50:14.572 INFO:teuthology.orchestra.run.smithi169.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-15T23:50:14.575 INFO:teuthology.orchestra.run.smithi169.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-326-g8921c8ef-1jammy [237 kB] 2024-09-15T23:50:14.579 INFO:teuthology.orchestra.run.smithi169.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-326-g8921c8ef-1jammy [34.0 kB] 2024-09-15T23:50:14.580 INFO:teuthology.orchestra.run.smithi169.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-326-g8921c8ef-1jammy [23.5 kB] 2024-09-15T23:50:14.581 INFO:teuthology.orchestra.run.smithi169.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-15T23:50:14.582 INFO:teuthology.orchestra.run.smithi169.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-15T23:50:14.742 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cmd2. 2024-09-15T23:50:14.768 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-15T23:50:14.770 INFO:teuthology.orchestra.run.smithi169.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-15T23:50:14.809 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-15T23:50:15.148 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-15T23:50:15.171 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-15T23:50:15.245 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T23:50:15.416 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 181 MB in 6s (32.3 MB/s) 2024-09-15T23:50:15.532 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-15T23:50:15.558 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-15T23:50:15.571 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-15T23:50:15.590 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T23:50:15.669 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-15T23:50:15.674 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-15T23:50:15.719 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-15T23:50:15.952 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-15T23:50:15.978 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-15T23:50:16.018 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T23:50:16.081 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-15T23:50:16.107 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-15T23:50:16.139 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T23:50:16.450 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cmd2. 2024-09-15T23:50:16.463 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-15T23:50:16.477 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-15T23:50:16.490 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T23:50:16.517 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-15T23:50:16.538 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T23:50:16.870 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-15T23:50:16.875 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-15T23:50:16.896 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-15T23:50:16.901 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T23:50:16.933 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T23:50:16.978 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T23:50:17.294 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-15T23:50:17.320 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T23:50:17.331 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-15T23:50:17.358 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-15T23:50:17.361 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T23:50:17.398 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T23:50:17.693 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-15T23:50:17.697 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-15T23:50:17.720 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-15T23:50:17.723 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-15T23:50:17.751 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T23:50:17.764 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T23:50:18.050 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librados2. 2024-09-15T23:50:18.076 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../010-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:18.108 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:18.196 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-15T23:50:18.223 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T23:50:18.305 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T23:50:18.536 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librbd1. 2024-09-15T23:50:18.562 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../011-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:18.603 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:18.733 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-15T23:50:18.760 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T23:50:18.808 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T23:50:19.039 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs2. 2024-09-15T23:50:19.065 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:19.105 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:19.219 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-15T23:50:19.246 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T23:50:19.294 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T23:50:19.408 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rados. 2024-09-15T23:50:19.434 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../013-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:19.475 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:19.697 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-15T23:50:19.724 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-15T23:50:19.736 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-15T23:50:19.751 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:50:19.764 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T23:50:19.786 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:20.030 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cephfs. 2024-09-15T23:50:20.056 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:20.092 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librados2. 2024-09-15T23:50:20.096 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:20.118 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../010-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:20.159 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:20.357 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-15T23:50:20.373 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:50:20.407 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:20.695 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librbd1. 2024-09-15T23:50:20.702 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-prettytable. 2024-09-15T23:50:20.722 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../011-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:20.728 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-15T23:50:20.769 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-15T23:50:20.770 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:21.030 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rbd. 2024-09-15T23:50:21.044 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:21.088 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:21.239 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libcephfs2. 2024-09-15T23:50:21.269 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:21.306 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:21.416 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-15T23:50:21.431 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-15T23:50:21.466 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T23:50:21.583 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rados. 2024-09-15T23:50:21.599 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../013-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:21.641 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:21.928 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-15T23:50:21.943 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:50:21.960 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-15T23:50:21.975 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-15T23:50:21.977 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:22.010 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T23:50:22.213 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cephfs. 2024-09-15T23:50:22.240 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:22.280 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:22.304 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-15T23:50:22.319 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-15T23:50:22.363 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T23:50:22.633 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-15T23:50:22.660 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:50:22.699 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:22.725 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua5.1. 2024-09-15T23:50:22.751 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-15T23:50:22.791 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-15T23:50:23.036 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-prettytable. 2024-09-15T23:50:23.063 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-15T23:50:23.086 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-any. 2024-09-15T23:50:23.105 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-15T23:50:23.112 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-15T23:50:23.144 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-15T23:50:23.338 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rbd. 2024-09-15T23:50:23.354 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:23.363 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package zip. 2024-09-15T23:50:23.378 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-15T23:50:23.388 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:23.422 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking zip (3.0-12build2) ... 2024-09-15T23:50:23.717 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-15T23:50:23.741 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package unzip. 2024-09-15T23:50:23.743 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-15T23:50:23.767 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-15T23:50:23.783 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T23:50:23.808 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-15T23:50:24.069 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-15T23:50:24.096 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-15T23:50:24.135 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T23:50:24.187 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package luarocks. 2024-09-15T23:50:24.213 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-15T23:50:24.253 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-15T23:50:24.455 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-15T23:50:24.482 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-15T23:50:24.521 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T23:50:24.644 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librgw2. 2024-09-15T23:50:24.671 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../027-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:24.711 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:24.800 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua5.1. 2024-09-15T23:50:24.816 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-15T23:50:24.850 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-15T23:50:25.169 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua-any. 2024-09-15T23:50:25.185 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-15T23:50:25.227 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-15T23:50:25.288 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rgw. 2024-09-15T23:50:25.303 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:25.349 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:25.463 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package zip. 2024-09-15T23:50:25.478 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-15T23:50:25.522 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking zip (3.0-12build2) ... 2024-09-15T23:50:25.675 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-15T23:50:25.701 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-15T23:50:25.733 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T23:50:25.825 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package unzip. 2024-09-15T23:50:25.851 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-15T23:50:25.892 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-15T23:50:26.052 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libradosstriper1. 2024-09-15T23:50:26.079 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:26.119 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:26.254 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package luarocks. 2024-09-15T23:50:26.280 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-15T23:50:26.320 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-15T23:50:26.556 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-common. 2024-09-15T23:50:26.582 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../031-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:26.622 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:26.695 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librgw2. 2024-09-15T23:50:26.721 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../027-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:26.761 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:27.347 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rgw. 2024-09-15T23:50:27.373 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:27.414 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:27.758 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-15T23:50:27.785 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-15T23:50:27.825 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T23:50:27.986 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-base. 2024-09-15T23:50:28.012 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../032-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:28.053 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:28.161 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libradosstriper1. 2024-09-15T23:50:28.187 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:28.228 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:28.623 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-common. 2024-09-15T23:50:28.632 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-15T23:50:28.649 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../031-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:28.659 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-15T23:50:28.689 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:28.698 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-15T23:50:28.985 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cheroot. 2024-09-15T23:50:29.012 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-15T23:50:29.051 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T23:50:29.388 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-15T23:50:29.414 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-15T23:50:29.454 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-15T23:50:29.732 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-15T23:50:29.759 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-15T23:50:29.799 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-15T23:50:30.102 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-15T23:50:30.128 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-15T23:50:30.138 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-base. 2024-09-15T23:50:30.165 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../032-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:30.168 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-15T23:50:30.206 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:30.471 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempora. 2024-09-15T23:50:30.497 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-15T23:50:30.537 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-15T23:50:30.776 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-15T23:50:30.792 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-15T23:50:30.815 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-portend. 2024-09-15T23:50:30.842 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-15T23:50:30.874 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-15T23:50:31.067 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-15T23:50:31.177 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-15T23:50:31.203 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-15T23:50:31.243 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-15T23:50:31.395 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cheroot. 2024-09-15T23:50:31.422 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-15T23:50:31.462 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T23:50:31.546 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-15T23:50:31.573 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-15T23:50:31.613 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-15T23:50:31.765 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-15T23:50:31.792 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-15T23:50:31.831 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-15T23:50:31.974 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-natsort. 2024-09-15T23:50:32.002 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-15T23:50:32.041 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-15T23:50:32.067 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-15T23:50:32.083 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-15T23:50:32.118 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-15T23:50:32.361 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-logutils. 2024-09-15T23:50:32.388 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-15T23:50:32.427 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-15T23:50:32.429 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-15T23:50:32.455 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-15T23:50:32.496 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-15T23:50:32.730 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-15T23:50:32.746 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-15T23:50:32.798 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-tempora. 2024-09-15T23:50:32.825 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-15T23:50:32.865 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-15T23:50:32.936 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-15T23:50:33.151 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-portend. 2024-09-15T23:50:33.177 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-15T23:50:33.226 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-15T23:50:33.267 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-mako. 2024-09-15T23:50:33.294 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-15T23:50:33.333 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T23:50:33.529 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-15T23:50:33.556 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-15T23:50:33.596 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-15T23:50:33.686 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-15T23:50:33.713 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-15T23:50:33.753 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-15T23:50:33.874 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-15T23:50:33.901 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-15T23:50:33.940 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-15T23:50:34.039 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-15T23:50:34.066 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-15T23:50:34.105 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-15T23:50:34.319 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-natsort. 2024-09-15T23:50:34.346 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-15T23:50:34.358 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webob. 2024-09-15T23:50:34.374 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-15T23:50:34.386 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-15T23:50:34.408 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T23:50:34.697 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-logutils. 2024-09-15T23:50:34.723 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-15T23:50:34.728 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-waitress. 2024-09-15T23:50:34.755 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-15T23:50:34.763 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-15T23:50:34.798 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T23:50:35.066 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-15T23:50:35.093 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-15T23:50:35.106 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempita. 2024-09-15T23:50:35.133 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-15T23:50:35.133 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-15T23:50:35.172 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T23:50:35.394 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-mako. 2024-09-15T23:50:35.410 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-15T23:50:35.444 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T23:50:35.484 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-paste. 2024-09-15T23:50:35.511 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-15T23:50:35.550 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T23:50:35.739 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-15T23:50:35.766 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-15T23:50:35.797 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-15T23:50:35.895 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-15T23:50:35.922 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-15T23:50:35.962 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T23:50:36.109 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-15T23:50:36.135 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-15T23:50:36.193 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-15T23:50:36.264 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-15T23:50:36.292 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-15T23:50:36.331 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-15T23:50:36.520 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-webob. 2024-09-15T23:50:36.547 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-15T23:50:36.587 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T23:50:36.634 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webtest. 2024-09-15T23:50:36.661 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-15T23:50:36.701 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-15T23:50:36.940 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-waitress. 2024-09-15T23:50:36.966 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-15T23:50:36.979 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pecan. 2024-09-15T23:50:37.006 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-15T23:50:37.010 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T23:50:37.037 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T23:50:37.326 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-tempita. 2024-09-15T23:50:37.353 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-15T23:50:37.366 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-certifi. 2024-09-15T23:50:37.383 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-15T23:50:37.393 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T23:50:37.417 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-15T23:50:37.671 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-paste. 2024-09-15T23:50:37.686 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-15T23:50:37.721 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T23:50:37.744 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-idna. 2024-09-15T23:50:37.771 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-15T23:50:37.811 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T23:50:38.040 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-15T23:50:38.056 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-15T23:50:38.099 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T23:50:38.147 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-urllib3. 2024-09-15T23:50:38.174 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-15T23:50:38.214 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T23:50:38.376 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-15T23:50:38.392 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-15T23:50:38.426 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-15T23:50:38.542 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests. 2024-09-15T23:50:38.569 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-15T23:50:38.609 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T23:50:38.705 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-webtest. 2024-09-15T23:50:38.731 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-15T23:50:38.771 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-15T23:50:38.920 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-15T23:50:38.947 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-15T23:50:38.986 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T23:50:39.083 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pecan. 2024-09-15T23:50:39.109 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-15T23:50:39.149 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T23:50:39.298 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-15T23:50:39.325 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:50:39.364 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:39.538 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-certifi. 2024-09-15T23:50:39.564 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-15T23:50:39.604 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-15T23:50:39.753 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-15T23:50:39.780 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:39.819 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:39.940 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-idna. 2024-09-15T23:50:39.967 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-15T23:50:40.032 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T23:50:40.097 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-15T23:50:40.124 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-15T23:50:40.163 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-15T23:50:40.318 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-urllib3. 2024-09-15T23:50:40.334 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-15T23:50:40.368 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T23:50:40.449 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-openssl. 2024-09-15T23:50:40.476 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-15T23:50:40.516 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-15T23:50:40.647 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-requests. 2024-09-15T23:50:40.673 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-15T23:50:40.713 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T23:50:40.869 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr. 2024-09-15T23:50:40.895 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:40.935 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:41.016 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-15T23:50:41.043 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-15T23:50:41.083 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T23:50:41.361 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-15T23:50:41.377 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:50:41.421 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:41.800 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-15T23:50:41.826 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:41.866 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:42.143 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-15T23:50:42.159 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-15T23:50:42.193 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-15T23:50:42.207 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mon. 2024-09-15T23:50:42.233 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:42.273 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:42.902 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-osd. 2024-09-15T23:50:42.928 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:42.968 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:43.339 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-openssl. 2024-09-15T23:50:43.366 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-15T23:50:43.405 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-15T23:50:43.750 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr. 2024-09-15T23:50:43.777 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:43.816 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:44.013 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph. 2024-09-15T23:50:44.028 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../068-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:44.071 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:44.195 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mon. 2024-09-15T23:50:44.222 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:44.253 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:44.348 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-fuse. 2024-09-15T23:50:44.364 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:44.398 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:44.777 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mds. 2024-09-15T23:50:44.803 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:44.843 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:44.865 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-osd. 2024-09-15T23:50:44.892 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:44.931 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:45.246 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephadm. 2024-09-15T23:50:45.272 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../071-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:45.312 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:45.607 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-15T23:50:45.633 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-15T23:50:45.673 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-15T23:50:45.976 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph. 2024-09-15T23:50:46.003 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../068-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:46.043 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:46.043 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-15T23:50:46.058 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T23:50:46.101 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T23:50:46.338 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-fuse. 2024-09-15T23:50:46.364 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:46.396 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:46.932 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mds. 2024-09-15T23:50:46.959 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:46.998 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:47.131 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-babel. 2024-09-15T23:50:47.158 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T23:50:47.197 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T23:50:47.418 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package cephadm. 2024-09-15T23:50:47.445 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../071-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:47.485 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:47.568 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jinja2. 2024-09-15T23:50:47.594 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-15T23:50:47.634 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T23:50:47.780 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-15T23:50:47.806 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-15T23:50:47.848 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-15T23:50:47.987 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-15T23:50:48.014 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:50:48.054 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:48.177 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-15T23:50:48.200 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T23:50:48.240 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T23:50:48.390 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-15T23:50:48.417 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-15T23:50:48.457 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-15T23:50:48.735 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-routes. 2024-09-15T23:50:48.761 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-15T23:50:48.801 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T23:50:49.171 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-15T23:50:49.198 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:50:49.237 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:49.262 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-babel. 2024-09-15T23:50:49.290 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T23:50:49.320 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T23:50:49.607 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jinja2. 2024-09-15T23:50:49.634 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-15T23:50:49.665 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T23:50:49.968 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-15T23:50:49.995 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:50:50.026 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:50.347 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-15T23:50:50.373 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-15T23:50:50.413 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-15T23:50:50.528 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-15T23:50:50.552 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-15T23:50:50.594 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T23:50:50.716 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-routes. 2024-09-15T23:50:50.742 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-15T23:50:50.782 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T23:50:51.090 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-joblib. 2024-09-15T23:50:51.116 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-15T23:50:51.119 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-15T23:50:51.146 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:50:51.147 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T23:50:51.185 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:51.493 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-15T23:50:51.520 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-15T23:50:51.645 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-15T23:50:51.942 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn. 2024-09-15T23:50:51.966 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-15T23:50:51.998 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T23:50:52.568 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-15T23:50:52.595 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-15T23:50:52.641 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T23:50:52.799 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-15T23:50:52.826 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:50:52.865 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:53.156 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-joblib. 2024-09-15T23:50:53.180 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-15T23:50:53.219 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T23:50:53.548 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-15T23:50:53.577 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-15T23:50:53.700 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-15T23:50:53.810 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cachetools. 2024-09-15T23:50:53.837 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-15T23:50:53.876 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-15T23:50:54.003 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-sklearn. 2024-09-15T23:50:54.030 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-15T23:50:54.069 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T23:50:54.338 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-15T23:50:54.365 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-15T23:50:54.404 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-15T23:50:54.741 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-15T23:50:54.768 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-15T23:50:54.787 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-15T23:50:54.807 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T23:50:54.815 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:50:54.879 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:55.119 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rsa. 2024-09-15T23:50:55.146 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-15T23:50:55.185 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-15T23:50:55.481 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-google-auth. 2024-09-15T23:50:55.508 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-15T23:50:55.547 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-15T23:50:55.832 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cachetools. 2024-09-15T23:50:55.859 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-15T23:50:55.884 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-15T23:50:55.898 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-15T23:50:55.911 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-15T23:50:55.950 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T23:50:56.176 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-15T23:50:56.204 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-15T23:50:56.228 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-websocket. 2024-09-15T23:50:56.234 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-15T23:50:56.255 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-15T23:50:56.294 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-15T23:50:56.538 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-15T23:50:56.565 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-15T23:50:56.605 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T23:50:56.623 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-15T23:50:56.650 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-15T23:50:56.689 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T23:50:56.920 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rsa. 2024-09-15T23:50:56.947 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-15T23:50:56.991 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-15T23:50:57.312 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-google-auth. 2024-09-15T23:50:57.339 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-15T23:50:57.378 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-15T23:50:57.403 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-15T23:50:57.420 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:50:57.461 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:57.681 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-15T23:50:57.709 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-15T23:50:57.756 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T23:50:57.790 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-15T23:50:57.806 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-15T23:50:57.848 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T23:50:58.043 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-websocket. 2024-09-15T23:50:58.070 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-15T23:50:58.101 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-15T23:50:58.134 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-15T23:50:58.161 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T23:50:58.192 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T23:50:58.405 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-15T23:50:58.432 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-15T23:50:58.470 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package jq. 2024-09-15T23:50:58.470 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T23:50:58.486 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T23:50:58.528 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-15T23:50:58.764 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package socat. 2024-09-15T23:50:58.780 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-15T23:50:58.822 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-15T23:50:59.143 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-15T23:50:59.159 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package xmlstarlet. 2024-09-15T23:50:59.171 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:50:59.175 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-15T23:50:59.209 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:59.217 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-15T23:50:59.471 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-15T23:50:59.486 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-15T23:50:59.529 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T23:50:59.614 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-test. 2024-09-15T23:50:59.641 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../099-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:50:59.680 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:50:59.841 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-15T23:50:59.868 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T23:50:59.899 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T23:51:00.128 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package jq. 2024-09-15T23:51:00.142 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T23:51:00.185 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-15T23:51:00.446 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package socat. 2024-09-15T23:51:00.462 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-15T23:51:00.504 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-15T23:51:00.799 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package xmlstarlet. 2024-09-15T23:51:00.827 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-15T23:51:00.865 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-15T23:51:01.228 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-test. 2024-09-15T23:51:01.244 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../099-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:51:01.303 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:01.918 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-volume. 2024-09-15T23:51:01.945 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:51:01.984 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:02.519 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-15T23:51:02.519 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:51:02.519 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:02.749 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-colorama. 2024-09-15T23:51:02.777 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-15T23:51:02.807 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-15T23:51:03.043 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephfs-shell. 2024-09-15T23:51:03.067 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:51:03.110 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:03.387 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephfs-top. 2024-09-15T23:51:03.403 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:51:03.446 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:03.698 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-15T23:51:03.726 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:51:03.765 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:03.799 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-volume. 2024-09-15T23:51:03.827 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:51:03.866 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:04.067 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-15T23:51:04.095 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-15T23:51:04.134 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T23:51:04.262 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-15T23:51:04.290 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:51:04.336 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:04.422 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-15T23:51:04.449 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-15T23:51:04.488 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-15T23:51:04.715 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-colorama. 2024-09-15T23:51:04.743 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-15T23:51:04.789 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-15T23:51:04.851 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package nvme-cli. 2024-09-15T23:51:04.878 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-15T23:51:04.917 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T23:51:05.092 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package cephfs-shell. 2024-09-15T23:51:05.120 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:51:05.159 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:05.348 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package pkg-config. 2024-09-15T23:51:05.375 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-15T23:51:05.414 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T23:51:05.445 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package cephfs-top. 2024-09-15T23:51:05.473 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T23:51:05.511 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:05.650 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-15T23:51:05.663 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-15T23:51:05.700 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-15T23:51:05.764 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-15T23:51:05.780 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:51:05.830 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:06.128 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-15T23:51:06.143 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-15T23:51:06.195 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-15T23:51:06.217 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-15T23:51:06.245 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-15T23:51:06.291 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T23:51:06.481 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastescript. 2024-09-15T23:51:06.508 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-15T23:51:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-15T23:51:06.630 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-15T23:51:06.658 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-15T23:51:06.696 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-15T23:51:06.876 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pluggy. 2024-09-15T23:51:06.903 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-15T23:51:06.942 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-15T23:51:07.075 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package nvme-cli. 2024-09-15T23:51:07.103 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-15T23:51:07.141 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T23:51:07.237 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-psutil. 2024-09-15T23:51:07.264 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-15T23:51:07.312 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-15T23:51:07.564 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package pkg-config. 2024-09-15T23:51:07.592 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-15T23:51:07.630 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T23:51:07.648 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-py. 2024-09-15T23:51:07.675 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-15T23:51:07.723 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-15T23:51:07.883 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-15T23:51:07.899 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-15T23:51:07.941 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-15T23:51:08.043 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pygments. 2024-09-15T23:51:08.070 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-15T23:51:08.109 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T23:51:08.370 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-15T23:51:08.398 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-15T23:51:08.436 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-15T23:51:08.538 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-15T23:51:08.554 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-15T23:51:08.596 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-15T23:51:08.748 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pastescript. 2024-09-15T23:51:08.776 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-15T23:51:08.814 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-15T23:51:08.908 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-toml. 2024-09-15T23:51:08.935 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-15T23:51:08.974 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-15T23:51:09.134 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pluggy. 2024-09-15T23:51:09.162 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-15T23:51:09.200 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-15T23:51:09.294 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pytest. 2024-09-15T23:51:09.321 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-15T23:51:09.360 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T23:51:09.481 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-psutil. 2024-09-15T23:51:09.497 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-15T23:51:09.539 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-15T23:51:09.950 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-py. 2024-09-15T23:51:09.978 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-15T23:51:09.989 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplejson. 2024-09-15T23:51:10.016 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-15T23:51:10.017 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-15T23:51:10.055 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-15T23:51:10.328 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pygments. 2024-09-15T23:51:10.333 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-15T23:51:10.349 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-15T23:51:10.356 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-15T23:51:10.391 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-15T23:51:10.394 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T23:51:10.874 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-15T23:51:10.902 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-15T23:51:10.940 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-15T23:51:11.157 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package radosgw. 2024-09-15T23:51:11.181 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../122-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:51:11.228 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:11.260 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-toml. 2024-09-15T23:51:11.287 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-15T23:51:11.326 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-15T23:51:11.604 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pytest. 2024-09-15T23:51:11.620 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-15T23:51:11.654 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T23:51:12.023 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package rbd-fuse. 2024-09-15T23:51:12.024 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-simplejson. 2024-09-15T23:51:12.051 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:51:12.052 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-15T23:51:12.089 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:12.090 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-15T23:51:12.369 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-15T23:51:12.397 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-15T23:51:12.404 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-15T23:51:12.435 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-15T23:51:12.653 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T23:51:12.804 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T23:51:13.070 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-15T23:51:13.197 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package radosgw. 2024-09-15T23:51:13.225 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../122-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:51:13.263 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:13.399 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-15T23:51:13.806 INFO:teuthology.orchestra.run.smithi112.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-15T23:51:13.897 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:14.091 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package rbd-fuse. 2024-09-15T23:51:14.107 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T23:51:14.150 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:14.430 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-15T23:51:14.482 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user cephadm....done 2024-09-15T23:51:14.688 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T23:51:14.697 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T23:51:14.823 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T23:51:15.084 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-15T23:51:15.405 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-15T23:51:15.549 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-15T23:51:15.800 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-15T23:51:15.822 INFO:teuthology.orchestra.run.smithi169.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-15T23:51:15.891 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:15.926 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-15T23:51:16.193 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-15T23:51:16.424 INFO:teuthology.orchestra.run.smithi169.stdout:Adding system user cephadm....done 2024-09-15T23:51:16.461 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T23:51:16.581 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T23:51:16.588 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-15T23:51:16.857 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-15T23:51:16.881 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T23:51:17.108 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-15T23:51:17.234 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-15T23:51:17.241 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-15T23:51:17.468 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-15T23:51:17.485 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-15T23:51:17.719 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T23:51:17.735 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-15T23:51:17.845 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-15T23:51:18.012 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-15T23:51:18.181 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T23:51:18.255 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-15T23:51:18.506 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-15T23:51:18.524 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-15T23:51:18.767 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-15T23:51:18.774 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-15T23:51:19.010 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-15T23:51:19.025 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:19.269 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-15T23:51:19.285 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T23:51:19.436 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T23:51:19.521 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-15T23:51:19.562 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-15T23:51:19.772 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-15T23:51:19.829 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T23:51:19.955 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-15T23:51:20.023 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-15T23:51:20.198 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-15T23:51:20.316 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:20.575 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T23:51:20.579 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-15T23:51:20.612 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-15T23:51:20.685 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T23:51:20.701 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T23:51:20.802 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-15T23:51:20.827 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-15T23:51:21.078 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T23:51:21.170 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T23:51:21.204 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-15T23:51:21.297 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-15T23:51:21.472 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-15T23:51:21.564 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T23:51:21.824 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-15T23:51:21.852 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-15T23:51:21.887 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-15T23:51:21.942 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T23:51:22.043 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-15T23:51:22.125 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up zip (3.0-12build2) ... 2024-09-15T23:51:22.268 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T23:51:22.378 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T23:51:22.529 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-15T23:51:22.796 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T23:51:22.920 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T23:51:23.056 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-15T23:51:23.204 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T23:51:23.330 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-15T23:51:23.366 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up zip (3.0-12build2) ... 2024-09-15T23:51:23.440 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T23:51:23.492 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T23:51:23.732 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-15T23:51:24.100 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-15T23:51:24.127 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T23:51:24.343 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T23:51:24.369 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T23:51:24.495 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-15T23:51:24.638 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T23:51:24.711 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T23:51:24.931 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-15T23:51:25.005 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-15T23:51:25.306 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T23:51:25.315 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-15T23:51:25.558 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T23:51:25.732 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-15T23:51:25.918 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T23:51:25.983 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-15T23:51:26.134 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:26.211 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-15T23:51:26.437 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T23:51:26.512 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T23:51:26.754 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T23:51:26.872 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-15T23:51:27.123 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-15T23:51:27.224 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:27.509 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T23:51:27.801 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T23:51:27.945 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T23:51:28.188 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T23:51:28.339 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-15T23:51:28.607 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T23:51:28.716 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-15T23:51:28.817 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T23:51:29.016 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T23:51:29.102 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-15T23:51:29.225 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T23:51:29.335 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-15T23:51:29.378 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-15T23:51:29.586 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T23:51:29.638 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T23:51:29.713 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-15T23:51:29.764 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-15T23:51:29.838 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T23:51:30.065 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-15T23:51:30.114 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-15T23:51:30.316 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-15T23:51:30.374 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-15T23:51:30.567 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-15T23:51:30.617 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T23:51:30.742 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-15T23:51:30.818 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-15T23:51:31.044 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-15T23:51:31.069 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-15T23:51:31.295 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-15T23:51:31.354 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T23:51:31.472 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-15T23:51:31.563 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-15T23:51:31.748 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T23:51:31.814 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-15T23:51:31.866 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T23:51:32.074 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-15T23:51:32.159 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T23:51:32.333 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T23:51:32.443 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-15T23:51:32.459 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-15T23:51:32.711 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T23:51:32.735 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T23:51:32.837 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-15T23:51:32.852 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T23:51:32.963 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T23:51:33.052 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-15T23:51:33.145 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T23:51:33.289 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T23:51:33.407 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T23:51:33.438 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-15T23:51:33.681 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T23:51:33.784 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-15T23:51:33.807 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-15T23:51:33.916 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T23:51:33.988 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-15T23:51:34.026 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-15T23:51:34.152 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-15T23:51:34.226 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T23:51:34.353 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T23:51:34.404 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T23:51:34.530 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T23:51:34.745 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-15T23:51:34.847 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T23:51:35.005 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-15T23:51:35.106 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-15T23:51:35.140 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T23:51:35.357 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T23:51:35.408 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-15T23:51:35.458 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T23:51:35.628 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-15T23:51:35.768 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T23:51:35.906 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-15T23:51:36.060 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T23:51:36.225 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T23:51:36.336 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-15T23:51:36.475 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-15T23:51:36.556 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-15T23:51:36.816 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-15T23:51:36.894 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-15T23:51:37.067 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T23:51:37.195 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T23:51:37.327 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-15T23:51:37.540 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T23:51:37.666 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:37.775 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:37.876 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-15T23:51:37.981 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-15T23:51:38.212 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:38.296 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T23:51:38.338 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:38.473 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-15T23:51:38.649 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T23:51:38.750 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:38.750 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:38.868 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:38.875 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:38.968 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-15T23:51:39.001 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:39.214 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T23:51:39.214 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T23:51:39.296 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:39.447 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:39.573 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-15T23:51:39.661 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:39.787 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:39.850 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:39.905 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:40.001 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:40.023 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:40.127 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:40.149 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T23:51:40.341 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T23:51:40.341 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T23:51:40.836 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:40.963 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:41.105 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:41.256 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:41.378 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:41.407 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T23:51:41.504 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:41.630 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:41.756 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:41.866 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:41.992 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:42.551 INFO:teuthology.orchestra.run.smithi112.stdout:Adding group ceph....done 2024-09-15T23:51:42.578 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:42.704 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:42.830 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:42.936 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user ceph....done 2024-09-15T23:51:42.956 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:43.082 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:43.087 INFO:teuthology.orchestra.run.smithi112.stdout:Setting system user ceph properties....done 2024-09-15T23:51:43.100 INFO:teuthology.orchestra.run.smithi112.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-15T23:51:43.208 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:43.238 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-15T23:51:43.545 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-15T23:51:43.725 INFO:teuthology.orchestra.run.smithi169.stdout:Adding group ceph....done 2024-09-15T23:51:43.993 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:44.103 INFO:teuthology.orchestra.run.smithi169.stdout:Adding system user ceph....done 2024-09-15T23:51:44.192 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:51:44.192 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:51:44.271 INFO:teuthology.orchestra.run.smithi169.stdout:Setting system user ceph properties....done 2024-09-15T23:51:44.285 INFO:teuthology.orchestra.run.smithi169.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-15T23:51:44.436 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-15T23:51:44.628 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:44.754 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:44.758 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-15T23:51:45.234 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:45.239 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:51:45.239 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:51:45.424 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:51:45.425 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:51:45.677 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:45.869 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:45.978 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:46.215 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-15T23:51:46.415 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:51:46.416 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:51:46.643 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:46.871 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:46.879 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T23:51:46.879 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T23:51:47.228 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-15T23:51:47.337 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:47.558 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T23:51:47.558 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T23:51:47.723 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:47.936 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T23:51:47.936 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T23:51:48.030 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:48.305 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T23:51:48.305 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T23:51:48.392 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:48.585 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T23:51:48.586 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T23:51:48.740 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:48.866 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:49.009 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:49.060 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:49.218 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T23:51:49.218 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T23:51:49.304 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T23:51:49.304 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T23:51:49.677 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:49.778 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:49.819 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:49.880 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:49.945 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:50.022 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:50.096 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:50.229 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T23:51:50.229 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T23:51:50.458 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T23:51:50.567 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T23:51:50.703 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T23:51:50.814 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:50.991 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:51.117 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:51.243 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T23:51:51.479 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T23:51:51.595 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T23:51:51.696 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T23:51:51.841 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T23:51:52.144 INFO:teuthology.orchestra.run.smithi112.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T23:51:52.148 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-15T23:51:52.205 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-15T23:51:52.416 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-15T23:51:52.417 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-15T23:51:52.617 INFO:teuthology.orchestra.run.smithi112.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-15T23:51:52.617 INFO:teuthology.orchestra.run.smithi112.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-15T23:51:52.618 INFO:teuthology.orchestra.run.smithi112.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-15T23:51:52.618 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T23:51:52.618 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T23:51:52.618 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T23:51:52.618 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T23:51:52.619 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T23:51:52.619 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T23:51:52.619 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T23:51:52.619 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-15T23:51:52.619 INFO:teuthology.orchestra.run.smithi112.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-15T23:51:52.619 INFO:teuthology.orchestra.run.smithi112.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-15T23:51:52.620 INFO:teuthology.orchestra.run.smithi112.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-15T23:51:52.620 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-15T23:51:52.620 INFO:teuthology.orchestra.run.smithi112.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T23:51:52.621 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-15T23:51:52.621 INFO:teuthology.orchestra.run.smithi112.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-15T23:51:52.621 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-15T23:51:52.621 INFO:teuthology.orchestra.run.smithi112.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-15T23:51:52.663 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-15T23:51:52.664 INFO:teuthology.orchestra.run.smithi112.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-15T23:51:52.664 INFO:teuthology.orchestra.run.smithi112.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-15T23:51:52.665 INFO:teuthology.orchestra.run.smithi112.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-15T23:51:52.665 INFO:teuthology.orchestra.run.smithi112.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-15T23:51:52.665 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-15T23:51:52.665 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-15T23:51:52.665 INFO:teuthology.orchestra.run.smithi112.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T23:51:52.665 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages will be upgraded: 2024-09-15T23:51:52.666 INFO:teuthology.orchestra.run.smithi112.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-15T23:51:52.846 INFO:teuthology.orchestra.run.smithi112.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-15T23:51:52.846 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 55.8 MB of archives. 2024-09-15T23:51:52.846 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-15T23:51:52.846 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-15T23:51:52.952 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T23:51:53.472 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-15T23:51:53.488 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-15T23:51:53.612 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-15T23:51:53.613 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-15T23:51:53.615 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-15T23:51:53.633 INFO:teuthology.orchestra.run.smithi169.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T23:51:53.636 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-15T23:51:53.643 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-15T23:51:53.644 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-15T23:51:53.692 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-09-15T23:51:53.696 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-15T23:51:53.698 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-15T23:51:53.699 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-15T23:51:53.702 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-15T23:51:53.716 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-15T23:51:53.717 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-15T23:51:53.717 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-15T23:51:53.798 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-15T23:51:53.903 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-09-15T23:51:53.904 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-09-15T23:51:54.093 INFO:teuthology.orchestra.run.smithi169.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-15T23:51:54.093 INFO:teuthology.orchestra.run.smithi169.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-15T23:51:54.093 INFO:teuthology.orchestra.run.smithi169.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-15T23:51:54.093 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T23:51:54.093 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T23:51:54.093 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T23:51:54.093 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T23:51:54.094 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T23:51:54.094 INFO:teuthology.orchestra.run.smithi169.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T23:51:54.094 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T23:51:54.094 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2024-09-15T23:51:54.094 INFO:teuthology.orchestra.run.smithi169.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-15T23:51:54.095 INFO:teuthology.orchestra.run.smithi169.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-15T23:51:54.095 INFO:teuthology.orchestra.run.smithi169.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-15T23:51:54.095 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-15T23:51:54.095 INFO:teuthology.orchestra.run.smithi169.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T23:51:54.096 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2024-09-15T23:51:54.096 INFO:teuthology.orchestra.run.smithi169.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-15T23:51:54.096 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-15T23:51:54.096 INFO:teuthology.orchestra.run.smithi169.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-15T23:51:54.138 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2024-09-15T23:51:54.139 INFO:teuthology.orchestra.run.smithi169.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-15T23:51:54.139 INFO:teuthology.orchestra.run.smithi169.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-15T23:51:54.140 INFO:teuthology.orchestra.run.smithi169.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-15T23:51:54.140 INFO:teuthology.orchestra.run.smithi169.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-15T23:51:54.140 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-15T23:51:54.140 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-15T23:51:54.140 INFO:teuthology.orchestra.run.smithi169.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T23:51:54.140 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages will be upgraded: 2024-09-15T23:51:54.141 INFO:teuthology.orchestra.run.smithi169.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-15T23:51:54.322 INFO:teuthology.orchestra.run.smithi169.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-15T23:51:54.322 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 55.8 MB of archives. 2024-09-15T23:51:54.322 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-15T23:51:54.322 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-15T23:51:54.583 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-15T23:51:54.589 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-15T23:51:54.589 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-15T23:51:54.593 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-15T23:51:54.640 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-15T23:51:54.650 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-15T23:51:54.654 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-15T23:51:54.672 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-15T23:51:54.672 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-15T23:51:54.712 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-15T23:51:54.749 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-15T23:51:54.765 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-15T23:51:54.852 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-15T23:51:54.858 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-15T23:51:54.859 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-15T23:51:54.860 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-15T23:51:54.861 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-15T23:51:54.917 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-15T23:51:54.919 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-15T23:51:54.945 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-15T23:51:54.961 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-15T23:51:55.085 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-15T23:51:55.086 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-15T23:51:55.087 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-15T23:51:55.115 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-15T23:51:55.117 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-15T23:51:55.121 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-15T23:51:55.124 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-15T23:51:55.125 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-15T23:51:55.127 INFO:teuthology.orchestra.run.smithi169.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-15T23:51:55.189 INFO:teuthology.orchestra.run.smithi169.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-15T23:51:55.189 INFO:teuthology.orchestra.run.smithi169.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-15T23:51:55.190 INFO:teuthology.orchestra.run.smithi169.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-15T23:51:55.270 INFO:teuthology.orchestra.run.smithi169.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-15T23:51:55.492 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-15T23:51:55.492 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-15T23:51:55.492 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-15T23:51:55.493 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-15T23:51:55.493 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-15T23:51:55.493 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-15T23:51:55.516 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-15T23:51:55.517 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-15T23:51:55.928 INFO:teuthology.orchestra.run.smithi112.stdout:Preconfiguring packages ... 2024-09-15T23:51:56.055 INFO:teuthology.orchestra.run.smithi169.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-15T23:51:56.060 INFO:teuthology.orchestra.run.smithi169.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-15T23:51:56.060 INFO:teuthology.orchestra.run.smithi169.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-15T23:51:56.067 INFO:teuthology.orchestra.run.smithi169.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-15T23:51:56.067 INFO:teuthology.orchestra.run.smithi169.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-15T23:51:56.078 INFO:teuthology.orchestra.run.smithi169.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-15T23:51:56.082 INFO:teuthology.orchestra.run.smithi169.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-15T23:51:56.092 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 55.8 MB in 3s (19.6 MB/s) 2024-09-15T23:51:56.099 INFO:teuthology.orchestra.run.smithi169.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-15T23:51:56.099 INFO:teuthology.orchestra.run.smithi169.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-15T23:51:56.161 INFO:teuthology.orchestra.run.smithi169.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-15T23:51:56.184 INFO:teuthology.orchestra.run.smithi169.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-15T23:51:56.206 INFO:teuthology.orchestra.run.smithi169.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-15T23:51:56.275 INFO:teuthology.orchestra.run.smithi169.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-15T23:51:56.282 INFO:teuthology.orchestra.run.smithi169.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-15T23:51:56.282 INFO:teuthology.orchestra.run.smithi169.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-15T23:51:56.283 INFO:teuthology.orchestra.run.smithi169.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-15T23:51:56.284 INFO:teuthology.orchestra.run.smithi169.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-15T23:51:56.313 INFO:teuthology.orchestra.run.smithi169.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-15T23:51:56.316 INFO:teuthology.orchestra.run.smithi169.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-15T23:51:56.870 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-15T23:51:56.875 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T23:51:56.876 INFO:teuthology.orchestra.run.smithi169.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-15T23:51:56.876 INFO:teuthology.orchestra.run.smithi169.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-15T23:51:56.876 INFO:teuthology.orchestra.run.smithi169.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-15T23:51:56.876 INFO:teuthology.orchestra.run.smithi169.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-15T23:51:56.876 INFO:teuthology.orchestra.run.smithi169.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-15T23:51:56.877 INFO:teuthology.orchestra.run.smithi169.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-15T23:51:56.904 INFO:teuthology.orchestra.run.smithi169.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-15T23:51:56.904 INFO:teuthology.orchestra.run.smithi169.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-15T23:51:57.045 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T23:51:57.325 INFO:teuthology.orchestra.run.smithi169.stdout:Preconfiguring packages ... 2024-09-15T23:51:57.477 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 55.8 MB in 3s (20.2 MB/s) 2024-09-15T23:51:57.649 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-15T23:51:57.804 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-15T23:51:57.810 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T23:51:57.956 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T23:51:58.543 INFO:teuthology.orchestra.run.smithi112.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-15T23:51:58.737 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-15T23:51:58.815 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package flex. 2024-09-15T23:51:58.908 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-15T23:51:58.914 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-15T23:51:58.956 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-15T23:51:59.455 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T23:51:59.612 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-15T23:51:59.650 INFO:teuthology.orchestra.run.smithi169.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-15T23:51:59.895 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package flex. 2024-09-15T23:51:59.990 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-15T23:51:59.996 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-15T23:51:59.997 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T23:52:00.035 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-15T23:52:00.492 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-15T23:52:00.497 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T23:52:00.577 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T23:52:00.620 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T23:52:00.750 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-15T23:52:01.028 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T23:52:01.159 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T23:52:01.168 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T23:52:01.487 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T23:52:01.647 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-15T23:52:01.653 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T23:52:01.765 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T23:52:01.988 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package bison. 2024-09-15T23:52:02.093 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-15T23:52:02.099 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-15T23:52:02.156 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T23:52:02.232 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T23:52:02.382 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T23:52:02.524 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-15T23:52:02.552 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-15T23:52:02.584 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T23:52:02.701 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T23:52:02.935 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package dump. 2024-09-15T23:52:02.963 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-15T23:52:03.002 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking dump (0.4b47-3) ... 2024-09-15T23:52:03.100 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package bison. 2024-09-15T23:52:03.204 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-15T23:52:03.209 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-15T23:52:03.260 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T23:52:03.289 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package indent. 2024-09-15T23:52:03.305 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T23:52:03.347 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T23:52:03.625 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-15T23:52:03.641 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-15T23:52:03.683 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T23:52:03.753 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-15T23:52:03.782 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-15T23:52:03.820 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T23:52:03.979 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-15T23:52:04.167 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package dump. 2024-09-15T23:52:04.167 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-15T23:52:04.167 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-15T23:52:04.167 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T23:52:04.173 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking dump (0.4b47-3) ... 2024-09-15T23:52:04.265 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-15T23:52:04.281 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-15T23:52:04.323 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T23:52:04.476 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package indent. 2024-09-15T23:52:04.505 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T23:52:04.543 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T23:52:04.652 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-15T23:52:04.680 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-15T23:52:04.718 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T23:52:04.812 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-15T23:52:04.828 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-15T23:52:04.870 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T23:52:04.971 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-15T23:52:04.987 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-15T23:52:05.029 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T23:52:05.150 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-15T23:52:05.166 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-15T23:52:05.200 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T23:52:05.290 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libjson-perl. 2024-09-15T23:52:05.307 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-15T23:52:05.340 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-15T23:52:05.461 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-15T23:52:05.477 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-15T23:52:05.519 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T23:52:05.602 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-15T23:52:05.630 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-15T23:52:05.668 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T23:52:05.847 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-15T23:52:05.875 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-15T23:52:05.914 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T23:52:06.175 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-15T23:52:06.203 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-15T23:52:06.241 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T23:52:06.502 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libjson-perl. 2024-09-15T23:52:06.519 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-15T23:52:06.552 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-15T23:52:06.814 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-15T23:52:06.843 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-15T23:52:06.872 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T23:52:07.498 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-15T23:52:07.526 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T23:52:07.564 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T23:52:07.817 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-15T23:52:07.833 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T23:52:07.867 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T23:52:08.162 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-15T23:52:08.190 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T23:52:08.228 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T23:52:08.573 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-15T23:52:08.601 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-15T23:52:08.639 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T23:52:08.879 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-15T23:52:08.908 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T23:52:08.943 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-15T23:52:10.055 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T23:52:10.056 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-15T23:52:10.056 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T23:52:10.056 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T23:52:10.056 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-15T23:52:10.056 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T23:52:10.056 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T23:52:10.056 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T23:52:10.056 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T23:52:10.056 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-15T23:52:10.057 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T23:52:10.057 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T23:52:10.057 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-15T23:52:10.057 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T23:52:10.057 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T23:52:10.201 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-15T23:52:10.229 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T23:52:10.278 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-15T23:52:10.306 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-15T23:52:10.334 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T23:52:10.344 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T23:52:10.528 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-15T23:52:10.545 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T23:52:10.578 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T23:52:10.631 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-15T23:52:10.659 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T23:52:10.689 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T23:52:11.034 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-15T23:52:11.061 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T23:52:11.065 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-15T23:52:11.093 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-15T23:52:11.100 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T23:52:11.132 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T23:52:11.453 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-15T23:52:11.460 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package modemmanager. 2024-09-15T23:52:11.481 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T23:52:11.488 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T23:52:11.519 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T23:52:11.527 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T23:52:11.822 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-15T23:52:11.839 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T23:52:11.880 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T23:52:12.091 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-15T23:52:12.107 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T23:52:12.134 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package network-manager. 2024-09-15T23:52:12.150 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T23:52:12.162 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T23:52:12.209 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-15T23:52:12.670 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-15T23:52:12.698 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-15T23:52:12.736 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T23:52:12.976 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ppp. 2024-09-15T23:52:13.004 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-15T23:52:13.089 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package modemmanager. 2024-09-15T23:52:13.117 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T23:52:13.156 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T23:52:13.247 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T23:52:13.589 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package pptp-linux. 2024-09-15T23:52:13.618 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-15T23:52:13.656 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-15T23:52:13.838 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package network-manager. 2024-09-15T23:52:13.866 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T23:52:13.913 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-15T23:52:13.917 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-15T23:52:13.945 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-15T23:52:13.984 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-15T23:52:14.245 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-15T23:52:14.261 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-15T23:52:14.295 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-client-common (238) ... 2024-09-15T23:52:14.574 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-15T23:52:14.602 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T23:52:14.640 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T23:52:14.731 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ppp. 2024-09-15T23:52:14.759 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-15T23:52:15.041 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T23:52:15.229 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-common. 2024-09-15T23:52:15.257 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-15T23:52:15.314 INFO:teuthology.orchestra.run.smithi112.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-15T23:52:15.344 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-common (238) ... 2024-09-15T23:52:15.352 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package pptp-linux. 2024-09-15T23:52:15.380 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-15T23:52:15.419 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-15T23:52:15.671 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-15T23:52:15.699 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-15T23:52:15.738 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-15T23:52:15.752 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-14. 2024-09-15T23:52:15.781 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T23:52:15.814 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T23:52:15.999 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-15T23:52:16.024 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-15T23:52:16.074 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking postgresql-client-common (238) ... 2024-09-15T23:52:16.378 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-15T23:52:16.406 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T23:52:16.445 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T23:52:17.047 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql. 2024-09-15T23:52:17.064 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-15T23:52:17.105 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql (14+238) ... 2024-09-15T23:52:17.157 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package postgresql-common. 2024-09-15T23:52:17.186 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-15T23:52:17.260 INFO:teuthology.orchestra.run.smithi169.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-15T23:52:17.297 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking postgresql-common (238) ... 2024-09-15T23:52:17.349 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-client. 2024-09-15T23:52:17.377 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-15T23:52:17.416 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-client (14+238) ... 2024-09-15T23:52:17.645 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-15T23:52:17.661 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-15T23:52:17.703 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-15T23:52:17.798 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package postgresql-14. 2024-09-15T23:52:17.826 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T23:52:17.867 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T23:52:18.022 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package tcl8.6. 2024-09-15T23:52:18.050 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-15T23:52:18.089 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T23:52:18.350 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package tcl. 2024-09-15T23:52:18.378 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-15T23:52:18.422 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-15T23:52:18.769 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package wpasupplicant. 2024-09-15T23:52:18.798 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-15T23:52:18.845 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T23:52:19.198 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package postgresql. 2024-09-15T23:52:19.219 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-15T23:52:19.221 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-15T23:52:19.221 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-15T23:52:19.260 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking postgresql (14+238) ... 2024-09-15T23:52:19.273 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-15T23:52:19.554 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package postgresql-client. 2024-09-15T23:52:19.582 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-15T23:52:19.610 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-15T23:52:19.629 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking postgresql-client (14+238) ... 2024-09-15T23:52:19.638 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-15T23:52:19.676 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T23:52:19.897 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-15T23:52:19.914 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-15T23:52:19.947 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-client-common (238) ... 2024-09-15T23:52:19.956 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-15T23:52:20.165 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-15T23:52:20.284 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package tcl8.6. 2024-09-15T23:52:20.291 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T23:52:20.312 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-15T23:52:20.350 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T23:52:20.417 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T23:52:20.623 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T23:52:20.669 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package tcl. 2024-09-15T23:52:20.697 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-15T23:52:20.750 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-15T23:52:20.878 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T23:52:21.029 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T23:52:21.164 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package wpasupplicant. 2024-09-15T23:52:21.192 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-15T23:52:21.238 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T23:52:21.576 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-15T23:52:21.593 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-15T23:52:21.604 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-15T23:52:21.626 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-15T23:52:21.684 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T23:52:22.088 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-15T23:52:22.104 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T23:52:22.105 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T23:52:22.116 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-15T23:52:22.163 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T23:52:22.449 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up postgresql-client-common (238) ... 2024-09-15T23:52:22.620 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T23:52:22.702 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-15T23:52:22.771 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T23:52:22.853 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T23:52:23.004 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T23:52:23.130 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T23:52:23.256 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T23:52:23.306 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T23:52:23.382 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T23:52:23.432 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-15T23:52:23.575 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T23:52:23.700 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T23:52:23.826 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T23:52:23.840 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-15T23:52:23.921 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T23:52:23.977 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T23:52:24.263 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T23:52:24.263 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T23:52:24.724 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T23:52:24.849 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T23:52:24.850 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up dump (0.4b47-3) ... 2024-09-15T23:52:24.945 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-15T23:52:24.992 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T23:52:25.010 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T23:52:25.143 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T23:52:25.170 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T23:52:25.294 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-15T23:52:25.321 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-15T23:52:25.445 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T23:52:25.472 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-15T23:52:25.588 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T23:52:25.623 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T23:52:25.714 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T23:52:25.729 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-15T23:52:25.791 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T23:52:25.840 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T23:52:25.942 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T23:52:26.118 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T23:52:26.252 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T23:52:26.404 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-15T23:52:26.605 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-client (14+238) ... 2024-09-15T23:52:26.637 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T23:52:26.756 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-15T23:52:26.788 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up dump (0.4b47-3) ... 2024-09-15T23:52:26.882 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-15T23:52:26.956 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T23:52:27.082 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T23:52:27.217 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-15T23:52:27.359 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-15T23:52:27.367 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:27.367 INFO:teuthology.orchestra.run.smithi112.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-15T23:52:27.367 INFO:teuthology.orchestra.run.smithi112.stdout:which means they are currently configured by ifupdown: 2024-09-15T23:52:27.367 INFO:teuthology.orchestra.run.smithi112.stdout:- enp3s0f1 2024-09-15T23:52:27.367 INFO:teuthology.orchestra.run.smithi112.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-15T23:52:27.367 INFO:teuthology.orchestra.run.smithi112.stdout:remove their configuration from /etc/network/interfaces. 2024-09-15T23:52:27.367 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:27.496 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-15T23:52:27.510 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T23:52:27.617 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-15T23:52:27.695 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T23:52:27.846 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T23:52:27.847 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-15T23:52:28.031 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T23:52:28.157 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T23:52:28.168 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-15T23:52:28.283 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-15T23:52:28.460 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up postgresql-client (14+238) ... 2024-09-15T23:52:28.611 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-15T23:52:28.666 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T23:52:28.818 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T23:52:28.944 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-15T23:52:29.095 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-common (238) ... 2024-09-15T23:52:29.123 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:29.123 INFO:teuthology.orchestra.run.smithi169.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-15T23:52:29.123 INFO:teuthology.orchestra.run.smithi169.stdout:which means they are currently configured by ifupdown: 2024-09-15T23:52:29.123 INFO:teuthology.orchestra.run.smithi169.stdout:- enp3s0f1 2024-09-15T23:52:29.123 INFO:teuthology.orchestra.run.smithi169.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-15T23:52:29.123 INFO:teuthology.orchestra.run.smithi169.stdout:remove their configuration from /etc/network/interfaces. 2024-09-15T23:52:29.124 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:29.240 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-15T23:52:29.548 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-15T23:52:29.869 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-15T23:52:30.031 INFO:teuthology.orchestra.run.smithi112.stdout:Adding user postgres to group ssl-cert 2024-09-15T23:52:30.245 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:30.246 INFO:teuthology.orchestra.run.smithi112.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-15T23:52:30.330 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T23:52:30.436 INFO:teuthology.orchestra.run.smithi112.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-15T23:52:30.437 INFO:teuthology.orchestra.run.smithi112.stdout:Removing obsolete dictionary files: 2024-09-15T23:52:30.489 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T23:52:30.615 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-15T23:52:30.742 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up postgresql-common (238) ... 2024-09-15T23:52:30.991 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-15T23:52:31.388 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T23:52:31.619 INFO:teuthology.orchestra.run.smithi169.stdout:Adding user postgres to group ssl-cert 2024-09-15T23:52:31.718 INFO:teuthology.orchestra.run.smithi112.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-15T23:52:31.745 INFO:teuthology.orchestra.run.smithi112.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-15T23:52:31.786 INFO:teuthology.orchestra.run.smithi112.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-15T23:52:31.786 INFO:teuthology.orchestra.run.smithi112.stdout:This user must also own the server process. 2024-09-15T23:52:31.786 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:31.786 INFO:teuthology.orchestra.run.smithi112.stdout:The database cluster will be initialized with locale "en_US". 2024-09-15T23:52:31.786 INFO:teuthology.orchestra.run.smithi112.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-15T23:52:31.786 INFO:teuthology.orchestra.run.smithi112.stdout:The default text search configuration will be set to "english". 2024-09-15T23:52:31.786 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:31.786 INFO:teuthology.orchestra.run.smithi112.stdout:Data page checksums are disabled. 2024-09-15T23:52:31.786 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:31.786 INFO:teuthology.orchestra.run.smithi112.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-15T23:52:31.786 INFO:teuthology.orchestra.run.smithi112.stdout:creating subdirectories ... ok 2024-09-15T23:52:31.786 INFO:teuthology.orchestra.run.smithi112.stdout:selecting dynamic shared memory implementation ... posix 2024-09-15T23:52:31.801 INFO:teuthology.orchestra.run.smithi112.stdout:selecting default max_connections ... 100 2024-09-15T23:52:31.819 INFO:teuthology.orchestra.run.smithi112.stdout:selecting default shared_buffers ... 128MB 2024-09-15T23:52:31.831 INFO:teuthology.orchestra.run.smithi112.stdout:selecting default time zone ... Etc/UTC 2024-09-15T23:52:31.832 INFO:teuthology.orchestra.run.smithi112.stdout:creating configuration files ... ok 2024-09-15T23:52:31.834 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:31.834 INFO:teuthology.orchestra.run.smithi169.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-15T23:52:31.949 INFO:teuthology.orchestra.run.smithi112.stdout:running bootstrap script ... ok 2024-09-15T23:52:32.004 INFO:teuthology.orchestra.run.smithi169.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-15T23:52:32.005 INFO:teuthology.orchestra.run.smithi169.stdout:Removing obsolete dictionary files: 2024-09-15T23:52:32.501 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-15T23:52:32.611 INFO:teuthology.orchestra.run.smithi112.stdout:performing post-bootstrap initialization ... ok 2024-09-15T23:52:32.876 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T23:52:33.211 INFO:teuthology.orchestra.run.smithi169.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-15T23:52:33.228 INFO:teuthology.orchestra.run.smithi169.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-15T23:52:33.270 INFO:teuthology.orchestra.run.smithi169.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-15T23:52:33.270 INFO:teuthology.orchestra.run.smithi169.stdout:This user must also own the server process. 2024-09-15T23:52:33.270 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:33.270 INFO:teuthology.orchestra.run.smithi169.stdout:The database cluster will be initialized with locale "en_US". 2024-09-15T23:52:33.270 INFO:teuthology.orchestra.run.smithi169.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-15T23:52:33.270 INFO:teuthology.orchestra.run.smithi169.stdout:The default text search configuration will be set to "english". 2024-09-15T23:52:33.270 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:33.270 INFO:teuthology.orchestra.run.smithi169.stdout:Data page checksums are disabled. 2024-09-15T23:52:33.270 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:33.270 INFO:teuthology.orchestra.run.smithi169.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-15T23:52:33.270 INFO:teuthology.orchestra.run.smithi169.stdout:creating subdirectories ... ok 2024-09-15T23:52:33.270 INFO:teuthology.orchestra.run.smithi169.stdout:selecting dynamic shared memory implementation ... posix 2024-09-15T23:52:33.282 INFO:teuthology.orchestra.run.smithi169.stdout:selecting default max_connections ... 100 2024-09-15T23:52:33.302 INFO:teuthology.orchestra.run.smithi169.stdout:selecting default shared_buffers ... 128MB 2024-09-15T23:52:33.312 INFO:teuthology.orchestra.run.smithi169.stdout:selecting default time zone ... Etc/UTC 2024-09-15T23:52:33.313 INFO:teuthology.orchestra.run.smithi169.stdout:creating configuration files ... ok 2024-09-15T23:52:33.425 INFO:teuthology.orchestra.run.smithi169.stdout:running bootstrap script ... ok 2024-09-15T23:52:33.567 INFO:teuthology.orchestra.run.smithi112.stdout:syncing data to disk ... ok 2024-09-15T23:52:33.941 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-15T23:52:34.042 INFO:teuthology.orchestra.run.smithi169.stdout:performing post-bootstrap initialization ... ok 2024-09-15T23:52:34.748 INFO:teuthology.orchestra.run.smithi169.stdout:syncing data to disk ... ok 2024-09-15T23:52:35.119 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-15T23:52:36.696 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T23:52:36.822 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-15T23:52:36.922 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up postgresql (14+238) ... 2024-09-15T23:52:37.032 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T23:52:37.158 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T23:52:37.414 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T23:52:37.414 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T23:52:37.943 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T23:52:38.000 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T23:52:38.036 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-15T23:52:38.126 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-15T23:52:38.251 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up postgresql (14+238) ... 2024-09-15T23:52:38.355 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T23:52:38.369 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T23:52:38.470 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T23:52:38.515 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T23:52:38.704 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T23:52:38.704 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T23:52:39.281 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T23:52:39.382 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-15T23:52:39.692 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T23:52:39.853 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T23:52:39.892 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-15T23:52:39.992 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T23:52:40.431 INFO:teuthology.orchestra.run.smithi112.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T23:52:40.437 DEBUG:teuthology.parallel:result is None 2024-09-15T23:52:41.222 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-15T23:52:41.322 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T23:52:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T23:52:41.866 DEBUG:teuthology.parallel:result is None 2024-09-15T23:52:41.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:52:42.014 DEBUG:teuthology.orchestra.run.smithi112:> dpkg-query -W -f '${Version}' ceph 2024-09-15T23:52:42.034 INFO:teuthology.orchestra.run.smithi112.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-15T23:52:42.035 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T23:52:42.035 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-15T23:52:42.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:52:42.176 DEBUG:teuthology.orchestra.run.smithi169:> dpkg-query -W -f '${Version}' ceph 2024-09-15T23:52:42.195 INFO:teuthology.orchestra.run.smithi169.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-15T23:52:42.196 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T23:52:42.196 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-15T23:52:42.197 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T23:52:42.198 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:52:42.198 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T23:52:42.213 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:52:42.213 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T23:52:42.250 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T23:52:42.250 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:52:42.250 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T23:52:42.268 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T23:52:42.324 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:52:42.324 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T23:52:42.337 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T23:52:42.390 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T23:52:42.390 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:52:42.390 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T23:52:42.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T23:52:42.457 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:52:42.457 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T23:52:42.471 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T23:52:42.525 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T23:52:42.526 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:52:42.526 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T23:52:42.539 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T23:52:42.593 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:52:42.593 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T23:52:42.606 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T23:52:42.661 INFO:teuthology.run_tasks:Running task ceph... 2024-09-15T23:52:42.745 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-15T23:52:42.745 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2024-09-15T23:52:42.748 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2024-09-15T23:52:42.761 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-15T23:52:42.761 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T23:52:42.802 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T23:52:42.815 INFO:tasks.ceph:Creating extra log directories... 2024-09-15T23:52:42.815 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T23:52:42.859 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T23:52:42.879 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-15T23:52:42.879 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-15T23:52:42.879 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-15T23:52:42.879 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:52:42.879 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T23:52:42.917 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T23:52:42.992 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:52:42.992 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T23:52:42.998 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T23:52:43.080 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-15T23:52:43.080 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-15T23:52:43.080 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906342', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/strays}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7906342', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3393, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'sleep_before_teardown': 0, 'subset': '294/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGvK1sEaeAIoXBer2JDri8imU0mNc9y6ooy34P3r9tTRK9u4o1maVLeb9PQ7XM2kQu1YRopJzfEqljFX6w8L9ok=', 'smithi169.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHHDa0eywcoQTTBdd4tMMb/j8eobhTUIRMDDve6zC41pMEKd5pcsPCLjWjJKekdwlLPcdnDhNLM3Ds41zJHkk2c='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_strays']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-15T23:52:43.081 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T23:52:43.083 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T23:52:43.123 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T23:52:43.130 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T23:52:43.177 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:52:43.178 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T23:52:43.189 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T23:52:43.190 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-09-15T23:52:43.237 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T23:52:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:52:43.238 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-09-15T23:52:43.238 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:52:43.238 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-15 23:46:27.459720919 +0000 2024-09-15T23:52:43.238 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-15 23:46:27.455720955 +0000 2024-09-15T23:52:43.238 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-15 23:46:27.455720955 +0000 2024-09-15T23:52:43.238 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-15T23:52:43.239 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T23:52:43.292 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-15T23:52:43.292 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-15T23:52:43.292 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000434619 s, 1.2 MB/s 2024-09-15T23:52:43.293 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T23:52:43.342 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-09-15T23:52:43.389 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T23:52:43.390 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:52:43.390 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-15T23:52:43.390 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:52:43.390 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-15 23:46:28.175714524 +0000 2024-09-15T23:52:43.390 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-15 23:46:27.923716775 +0000 2024-09-15T23:52:43.390 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-15 23:46:27.923716775 +0000 2024-09-15T23:52:43.390 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-15T23:52:43.390 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T23:52:43.443 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-15T23:52:43.443 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-15T23:52:43.443 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.00045457 s, 1.1 MB/s 2024-09-15T23:52:43.444 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T23:52:43.494 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-09-15T23:52:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T23:52:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:52:43.546 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-09-15T23:52:43.546 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:52:43.546 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-15 23:46:28.639710380 +0000 2024-09-15T23:52:43.546 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-15 23:46:28.403712488 +0000 2024-09-15T23:52:43.546 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-15 23:46:28.403712488 +0000 2024-09-15T23:52:43.546 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-15T23:52:43.547 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T23:52:43.599 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-15T23:52:43.600 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-15T23:52:43.600 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000397035 s, 1.3 MB/s 2024-09-15T23:52:43.601 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T23:52:43.651 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-09-15T23:52:43.697 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T23:52:43.697 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:52:43.698 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-09-15T23:52:43.698 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:52:43.698 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-15 23:46:29.123706056 +0000 2024-09-15T23:52:43.698 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-15 23:46:28.875708272 +0000 2024-09-15T23:52:43.698 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-15 23:46:28.875708272 +0000 2024-09-15T23:52:43.698 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-15T23:52:43.698 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T23:52:43.752 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-15T23:52:43.752 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-15T23:52:43.752 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000365622 s, 1.4 MB/s 2024-09-15T23:52:43.753 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T23:52:43.802 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T23:52:43.803 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:52:43.803 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T23:52:43.808 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T23:52:43.809 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-09-15T23:52:43.854 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T23:52:43.855 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:52:43.855 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-15T23:52:43.855 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:52:43.855 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-15 23:46:27.685539804 +0000 2024-09-15T23:52:43.855 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-15 23:46:27.433542054 +0000 2024-09-15T23:52:43.855 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-15 23:46:27.433542054 +0000 2024-09-15T23:52:43.855 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-09-15T23:52:43.855 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T23:52:43.909 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-15T23:52:43.909 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-15T23:52:43.909 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000441217 s, 1.2 MB/s 2024-09-15T23:52:43.911 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T23:52:43.963 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-09-15T23:52:44.011 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T23:52:44.011 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:52:44.012 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-09-15T23:52:44.012 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:52:44.012 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-15 23:46:28.189535302 +0000 2024-09-15T23:52:44.012 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-15 23:46:27.937537553 +0000 2024-09-15T23:52:44.012 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-15 23:46:27.937537553 +0000 2024-09-15T23:52:44.013 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-09-15T23:52:44.013 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T23:52:44.065 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-15T23:52:44.065 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-15T23:52:44.065 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000369869 s, 1.4 MB/s 2024-09-15T23:52:44.066 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T23:52:44.116 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-09-15T23:52:44.167 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T23:52:44.167 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:52:44.167 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-09-15T23:52:44.167 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:52:44.168 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-15 23:46:28.669531014 +0000 2024-09-15T23:52:44.168 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-15 23:46:28.441533050 +0000 2024-09-15T23:52:44.168 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-15 23:46:28.441533050 +0000 2024-09-15T23:52:44.168 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-09-15T23:52:44.168 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T23:52:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-15T23:52:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-15T23:52:44.221 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000314016 s, 1.6 MB/s 2024-09-15T23:52:44.222 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T23:52:44.272 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-09-15T23:52:44.318 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T23:52:44.318 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:52:44.318 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-09-15T23:52:44.318 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:52:44.318 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-15 23:46:29.193526334 +0000 2024-09-15T23:52:44.319 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-15 23:46:28.909528870 +0000 2024-09-15T23:52:44.319 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-15 23:46:28.909528870 +0000 2024-09-15T23:52:44.319 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-09-15T23:52:44.319 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T23:52:44.373 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-15T23:52:44.373 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-15T23:52:44.373 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000312275 s, 1.6 MB/s 2024-09-15T23:52:44.374 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T23:52:44.423 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T23:52:44.423 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T23:52:44.424 INFO:tasks.ceph:Generating config... 2024-09-15T23:52:44.425 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-15T23:52:44.425 INFO:tasks.ceph:[client] debug client = 20 2024-09-15T23:52:44.425 INFO:tasks.ceph:[client] debug ms = 1 2024-09-15T23:52:44.425 INFO:tasks.ceph:[client] pid file = 2024-09-15T23:52:44.425 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-15T23:52:44.425 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-15T23:52:44.425 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-15T23:52:44.425 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-15T23:52:44.425 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-15T23:52:44.425 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-15T23:52:44.426 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-15T23:52:44.426 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-15T23:52:44.426 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-15T23:52:44.426 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-15T23:52:44.426 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-15T23:52:44.426 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-15T23:52:44.426 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-15T23:52:44.426 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-15T23:52:44.426 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-15T23:52:44.426 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-15T23:52:44.426 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-15T23:52:44.426 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-15T23:52:44.427 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-15T23:52:44.427 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-15T23:52:44.427 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-15T23:52:44.427 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-15T23:52:44.427 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-15T23:52:44.427 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-15T23:52:44.427 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-15T23:52:44.427 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-15T23:52:44.428 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-15T23:52:44.428 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-15T23:52:44.428 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-15T23:52:44.428 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-15T23:52:44.428 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-15T23:52:44.428 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-15T23:52:44.428 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-15T23:52:44.428 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-15T23:52:44.428 INFO:tasks.ceph:Setting up mon.a... 2024-09-15T23:52:44.429 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-15T23:52:44.463 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.keyring 2024-09-15T23:52:44.479 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-15T23:52:44.556 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T23:52:44.608 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.112'), ('mon.b', '172.21.15.169'), ('mon.c', '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]')] 2024-09-15T23:52:44.608 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-15T23:52:44.609 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:52:44.609 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T23:52:44.653 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.112 --add b 172.21.15.169 --addv c '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:52:44.738 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:52:44.738 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: generated fsid 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:52:44.739 INFO:teuthology.orchestra.run.smithi112.stdout:setting min_mon_release = quincy 2024-09-15T23:52:44.739 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 0 2024-09-15T23:52:44.739 INFO:teuthology.orchestra.run.smithi112.stdout:fsid 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:52:44.739 INFO:teuthology.orchestra.run.smithi112.stdout:last_changed 2024-09-15T23:52:44.739916+0000 2024-09-15T23:52:44.739 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-15T23:52:44.739916+0000 2024-09-15T23:52:44.739 INFO:teuthology.orchestra.run.smithi112.stdout:min_mon_release 17 (quincy) 2024-09-15T23:52:44.739 INFO:teuthology.orchestra.run.smithi112.stdout:election_strategy: 1 2024-09-15T23:52:44.739 INFO:teuthology.orchestra.run.smithi112.stdout:0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.a 2024-09-15T23:52:44.739 INFO:teuthology.orchestra.run.smithi112.stdout:1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2024-09-15T23:52:44.739 INFO:teuthology.orchestra.run.smithi112.stdout:2: [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] mon.c 2024-09-15T23:52:44.739 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-15T23:52:44.740 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T23:52:44.789 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1af6b673-4d40-4109-af4e-78662faa7df8... 2024-09-15T23:52:44.790 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:52:44.834 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:52:44.862 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-15T23:52:44.863 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-09-15T23:52:44.863 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:52:44.863 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-09-15T23:52:44.863 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.863 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-09-15T23:52:44.863 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.863 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-09-15T23:52:44.863 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.863 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-09-15T23:52:44.863 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-09-15T23:52:44.864 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.864 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-09-15T23:52:44.864 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-09-15T23:52:44.864 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.864 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:52:44.864 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-09-15T23:52:44.864 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.864 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:52:44.864 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:52:44.864 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.864 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-09-15T23:52:44.864 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.864 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-09-15T23:52:44.864 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-09-15T23:52:44.865 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:52:44.865 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:52:44.865 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-09-15T23:52:44.865 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:52:44.865 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-09-15T23:52:44.865 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:52:44.865 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:52:44.865 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-09-15T23:52:44.865 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.865 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:52:44.865 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.865 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-09-15T23:52:44.865 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.866 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-09-15T23:52:44.866 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.866 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-09-15T23:52:44.866 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-09-15T23:52:44.866 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-09-15T23:52:44.866 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-15T23:52:44.866 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:52:44.866 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.866 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-09-15T23:52:44.866 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-09-15T23:52:44.866 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.866 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-09-15T23:52:44.867 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-09-15T23:52:44.867 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:52:44.867 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.867 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-09-15T23:52:44.867 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-09-15T23:52:44.867 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.867 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-09-15T23:52:44.867 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-09-15T23:52:44.867 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-09-15T23:52:44.867 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-09-15T23:52:44.867 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.867 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-09-15T23:52:44.867 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-09-15T23:52:44.868 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.868 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:52:44.868 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.868 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-09-15T23:52:44.868 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.868 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-09-15T23:52:44.868 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.868 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:52:44.868 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-09-15T23:52:44.868 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.868 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-09-15T23:52:44.868 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-09-15T23:52:44.868 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-09-15T23:52:44.869 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-09-15T23:52:44.869 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 20 2024-09-15T23:52:44.869 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 20 2024-09-15T23:52:44.869 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:52:44.869 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-09-15T23:52:44.869 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 10 2024-09-15T23:52:44.869 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:52:44.869 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-09-15T23:52:44.869 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:52:44.869 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:52:44.869 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-09-15T23:52:44.869 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-15T23:52:44.870 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.870 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-09-15T23:52:44.870 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:52:44.870 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-09-15T23:52:44.870 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-15T23:52:44.870 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-15T23:52:44.870 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:52:44.870 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:52:44.870 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-09-15T23:52:44.871 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-15T23:52:44.871 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.871 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-09-15T23:52:44.871 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:52:44.871 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-15T23:52:44.871 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-09-15T23:52:44.871 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-15T23:52:44.871 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-09-15T23:52:44.871 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-09-15T23:52:44.871 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:52:44.871 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-09-15T23:52:44.871 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-09-15T23:52:44.871 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: mon down mkfs grace = 300 2024-09-15T23:52:44.872 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on pool no app = False 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-15T23:52:44.873 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds balancer = 20 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2024-09-15T23:52:44.874 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-15T23:52:44.875 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-15T23:52:44.875 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-15T23:52:44.876 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-09-15T23:52:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-09-15T23:52:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:52:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-09-15T23:52:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.876 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-09-15T23:52:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-09-15T23:52:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-09-15T23:52:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-09-15T23:52:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-09-15T23:52:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-09-15T23:52:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:52:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-09-15T23:52:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:52:44.877 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:52:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-09-15T23:52:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-09-15T23:52:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-09-15T23:52:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:52:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:52:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-09-15T23:52:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:52:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-09-15T23:52:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:52:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:52:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-09-15T23:52:44.878 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:52:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-09-15T23:52:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-09-15T23:52:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-09-15T23:52:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-09-15T23:52:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-09-15T23:52:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-15T23:52:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:52:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.879 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-09-15T23:52:44.879 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-09-15T23:52:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-09-15T23:52:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-09-15T23:52:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:52:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-09-15T23:52:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-09-15T23:52:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-09-15T23:52:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-09-15T23:52:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-09-15T23:52:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-09-15T23:52:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-09-15T23:52:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-09-15T23:52:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:52:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-09-15T23:52:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-09-15T23:52:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:52:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-09-15T23:52:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-09-15T23:52:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-09-15T23:52:44.881 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 20 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 20 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 10 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-09-15T23:52:44.882 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:52:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-09-15T23:52:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-15T23:52:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-15T23:52:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:52:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:52:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-09-15T23:52:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-15T23:52:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.883 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-09-15T23:52:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:52:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-15T23:52:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-09-15T23:52:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-15T23:52:44.883 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.884 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-09-15T23:52:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:52:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:52:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: mon down mkfs grace = 300 2024-09-15T23:52:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2024-09-15T23:52:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on pool no app = False 2024-09-15T23:52:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:52:44.885 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-09-15T23:52:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-09-15T23:52:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-09-15T23:52:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-09-15T23:52:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:52:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:52:44.885 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = "" 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2024-09-15T23:52:44.886 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds balancer = 20 2024-09-15T23:52:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:52:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2024-09-15T23:52:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2024-09-15T23:52:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2024-09-15T23:52:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2024-09-15T23:52:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-15T23:52:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-15T23:52:44.887 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-15T23:52:44.887 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-15T23:52:44.887 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-15T23:52:44.969 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-15T23:52:44.970 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:52:44.970 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-15T23:52:44.975 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:52:44.975 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-15T23:52:45.022 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:52:45.022 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:52:45.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T23:52:45.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T23:52:45.086 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:52:45.086 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:52:45.134 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:52:45.135 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:52:45.135 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T23:52:45.135 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T23:52:45.158 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:52:45.158 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:52:45.207 INFO:tasks.ceph:Setting up mon nodes... 2024-09-15T23:52:45.207 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-15T23:52:45.207 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T23:52:45.250 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T23:52:45.253 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T23:52:45.295 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T23:52:45.305 INFO:tasks.ceph:Setting up mds nodes... 2024-09-15T23:52:45.305 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T23:52:45.346 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T23:52:45.349 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-15T23:52:45.405 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-15T23:52:45.490 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-15T23:52:45.493 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-15T23:52:45.551 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T23:52:45.596 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T23:52:45.601 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-15T23:52:45.654 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-15T23:52:45.739 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-15T23:52:45.742 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-15T23:52:45.798 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-15T23:52:45.798 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T23:52:45.834 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-15T23:52:45.843 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-15T23:52:45.919 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-15T23:52:45.930 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-15T23:52:45.966 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-15T23:52:45.978 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-15T23:52:46.052 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-15T23:52:46.063 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-15T23:52:46.063 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T23:52:46.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-15T23:52:46.078 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T23:52:46.078 INFO:tasks.ceph:role: osd.0 2024-09-15T23:52:46.078 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:52:46.079 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T23:52:46.141 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:52:46.141 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:52:46.141 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:52:46.141 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T23:52:46.142 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:52:46.142 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:52:46.142 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:52:46.142 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T23:52:46.142 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:52:46.142 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:52:46.628 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-15T23:52:46.629 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-15T23:52:46.630 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-15T23:52:46.784 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-15T23:52:46.794 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T23:52:46.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:52:46.795 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-15T23:52:46.846 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T23:52:46.847 INFO:tasks.ceph:role: osd.1 2024-09-15T23:52:46.847 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:52:46.847 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T23:52:46.909 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:52:46.909 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:52:46.909 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:52:46.910 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T23:52:46.910 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:52:46.910 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:52:46.910 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:52:46.910 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T23:52:46.910 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:52:46.910 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:52:47.360 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-15T23:52:47.363 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-15T23:52:47.363 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-15T23:52:47.449 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-15T23:52:47.503 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T23:52:47.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:52:47.505 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-15T23:52:47.561 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T23:52:47.561 INFO:tasks.ceph:role: osd.2 2024-09-15T23:52:47.561 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:52:47.561 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T23:52:47.625 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:52:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:52:47.625 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:52:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T23:52:47.626 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:52:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:52:47.626 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:52:47.626 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T23:52:47.626 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:52:47.626 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:52:48.090 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-15T23:52:48.092 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-15T23:52:48.092 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-15T23:52:48.230 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-15T23:52:48.241 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T23:52:48.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:52:48.242 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-15T23:52:48.301 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T23:52:48.301 INFO:tasks.ceph:role: osd.3 2024-09-15T23:52:48.301 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:52:48.301 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T23:52:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:52:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:52:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:52:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T23:52:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:52:48.365 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:52:48.365 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:52:48.366 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T23:52:48.366 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:52:48.366 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:52:48.858 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-15T23:52:48.860 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-15T23:52:48.860 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-15T23:52:49.002 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-15T23:52:49.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:52:49.013 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T23:52:49.014 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:52:49.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:49.120+0000 7f4f79be07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-15T23:52:49.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:49.124+0000 7f4f79be07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-15T23:52:49.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:49.124+0000 7f4f79be07c0 -1 bdev(0x55fde1a2f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-15T23:52:49.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:49.124+0000 7f4f79be07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-15T23:52:52.269 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-15T23:52:52.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:52:52.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:52.364+0000 7f069744c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-15T23:52:52.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:52.364+0000 7f069744c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-15T23:52:52.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:52.364+0000 7f069744c7c0 -1 bdev(0x556dcd439800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-15T23:52:52.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:52.364+0000 7f069744c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-15T23:52:55.486 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-15T23:52:55.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:52:55.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:55.624+0000 7f406b6317c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-15T23:52:55.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:55.624+0000 7f406b6317c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-15T23:52:55.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:55.624+0000 7f406b6317c0 -1 bdev(0x5559dd105800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-15T23:52:55.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:55.624+0000 7f406b6317c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-15T23:52:58.799 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-15T23:52:58.853 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:52:58.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:58.932+0000 7f59856cd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-15T23:52:58.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:58.936+0000 7f59856cd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-15T23:52:58.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:58.936+0000 7f59856cd7c0 -1 bdev(0x555cdb939800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-15T23:52:58.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:52:58.936+0000 7f59856cd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-15T23:53:02.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-15T23:53:02.122 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-15T23:53:02.136 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T23:53:02.136 INFO:tasks.ceph:role: osd.4 2024-09-15T23:53:02.136 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:53:02.136 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T23:53:02.198 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:53:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:53:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:53:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T23:53:02.198 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:53:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:53:02.198 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:53:02.198 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T23:53:02.198 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:53:02.199 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:53:02.668 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-09-15T23:53:02.669 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-09-15T23:53:02.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-15T23:53:02.813 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-15T23:53:02.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:53:02.825 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T23:53:02.825 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-15T23:53:02.881 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T23:53:02.881 INFO:tasks.ceph:role: osd.5 2024-09-15T23:53:02.881 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:53:02.881 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T23:53:02.945 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:53:02.945 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:53:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:53:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T23:53:02.946 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:53:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:53:02.946 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:53:02.946 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T23:53:02.946 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:53:02.946 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:53:03.382 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-09-15T23:53:03.384 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-09-15T23:53:03.385 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-15T23:53:03.447 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-15T23:53:03.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:53:03.498 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T23:53:03.499 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-15T23:53:03.552 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T23:53:03.552 INFO:tasks.ceph:role: osd.6 2024-09-15T23:53:03.552 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:53:03.552 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T23:53:03.612 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:53:03.612 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:53:03.613 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:53:03.613 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T23:53:03.613 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:53:03.613 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:53:03.613 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:53:03.613 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T23:53:03.613 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:53:03.613 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:53:04.074 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-09-15T23:53:04.077 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-09-15T23:53:04.077 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-15T23:53:04.185 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-15T23:53:04.194 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T23:53:04.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:53:04.195 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-15T23:53:04.249 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T23:53:04.250 INFO:tasks.ceph:role: osd.7 2024-09-15T23:53:04.250 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:53:04.250 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T23:53:04.314 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:53:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:53:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:53:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T23:53:04.314 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:53:04.314 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:53:04.314 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:53:04.314 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T23:53:04.315 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:53:04.315 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:53:04.776 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-09-15T23:53:04.778 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-09-15T23:53:04.778 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-15T23:53:04.917 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-15T23:53:04.928 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T23:53:04.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:53:04.930 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:53:05.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:05.032+0000 7f7d7d9377c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-15T23:53:05.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:05.040+0000 7f7d7d9377c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-15T23:53:05.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:05.040+0000 7f7d7d9377c0 -1 bdev(0x5590b1505800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-15T23:53:05.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:05.040+0000 7f7d7d9377c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-15T23:53:08.167 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-15T23:53:08.181 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:53:08.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:08.260+0000 7f8bf04dc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-15T23:53:08.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:08.264+0000 7f8bf04dc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-15T23:53:08.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:08.264+0000 7f8bf04dc7c0 -1 bdev(0x559eb19f5800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-15T23:53:08.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:08.264+0000 7f8bf04dc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-15T23:53:11.417 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-15T23:53:11.474 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:53:11.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:11.556+0000 7f99074c27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-15T23:53:11.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:11.556+0000 7f99074c27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-15T23:53:11.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:11.556+0000 7f99074c27c0 -1 bdev(0x55d5c2afd800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-15T23:53:11.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:11.556+0000 7f99074c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-15T23:53:13.082 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:53:13.085 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:53:14.700 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-15T23:53:14.714 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:53:14.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:14.796+0000 7f62ff6577c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-15T23:53:14.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:14.796+0000 7f62ff6577c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-15T23:53:14.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:14.796+0000 7f62ff6577c0 -1 bdev(0x55591032f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-15T23:53:14.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:14.796+0000 7f62ff6577c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-15T23:53:17.941 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-15T23:53:18.003 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-15T23:53:18.003 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:53:18.003 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-15T23:53:18.017 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:53:18.017 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-15T23:53:18.071 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:53:18.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-15T23:53:18.128 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:53:18.128 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-15T23:53:18.184 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:53:18.184 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-15T23:53:18.241 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:53:18.241 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-15T23:53:18.295 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:53:18.296 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-15T23:53:18.348 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:53:18.348 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-15T23:53:18.362 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:53:18.362 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-15T23:53:18.418 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:53:18.419 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-15T23:53:18.477 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:53:18.477 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-15T23:53:18.533 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:53:18.533 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-15T23:53:18.589 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:53:18.590 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-15T23:53:18.645 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:53:18.645 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-15T23:53:18.700 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:53:18.700 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-15T23:53:18.706 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:53:18.707 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-15T23:53:18.753 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:53:18.753 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-15T23:53:18.759 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:53:18.759 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-15T23:53:18.806 INFO:tasks.ceph:Adding keys to all mons... 2024-09-15T23:53:18.806 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T23:53:18.808 DEBUG:teuthology.orchestra.run.smithi169:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T23:53:18.852 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.y] 2024-09-15T23:53:18.852 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dm5nULDxAAi9UvgPZ7sU/Zz2jLKsu4ng== 2024-09-15T23:53:18.852 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-15T23:53:18.852 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dmPvLEFBAA/WS7KNQ60+LzhOcQyCVWoQ== 2024-09-15T23:53:18.852 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-09-15T23:53:18.852 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dmEbNbHRAAjP+2Z2XYc0tarO48R/ocIQ== 2024-09-15T23:53:18.852 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2024-09-15T23:53:18.852 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBRc+dmnOKMBxAAdaIaYmXKAFGIPTxfYt2apQ== 2024-09-15T23:53:18.852 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2024-09-15T23:53:18.852 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBUc+dmnowGFhAAa3jXrvZ0An+9IwM9988mvQ== 2024-09-15T23:53:18.852 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2024-09-15T23:53:18.852 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBXc+dmnj9kJRAAZbpx5TM2ukiLKqi+iZAE5g== 2024-09-15T23:53:18.853 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2024-09-15T23:53:18.853 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBac+dmAdXtNxAA8g+Nxz1RyVf+P8KOtkw5qw== 2024-09-15T23:53:18.853 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2024-09-15T23:53:18.853 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dm4JK5ERAA3d3OABWXchejCqjJRrhTfQ== 2024-09-15T23:53:18.853 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-09-15T23:53:18.853 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dmN/+jIxAAiXM9onNC3twhiZrqCdWtUQ== 2024-09-15T23:53:18.853 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-09-15T23:53:18.853 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dmg6AqLBAAZ3PKcarPcPfvIWSTnE5uLA== 2024-09-15T23:53:18.853 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.4] 2024-09-15T23:53:18.853 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBhc+dmyOApAhAA9Cv9nW1b5JvO9cH9emao4A== 2024-09-15T23:53:18.853 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.5] 2024-09-15T23:53:18.853 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBkc+dmFIDwDxAAR/59kfrjiLU4emIqtthfRg== 2024-09-15T23:53:18.853 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.6] 2024-09-15T23:53:18.853 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBnc+dmZVB/IRAAFbvodnxisklCL/yuD+F5ew== 2024-09-15T23:53:18.854 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.7] 2024-09-15T23:53:18.854 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBqc+dmuty6LxAAHWB/GByU/hXOL/+dnRpcVA== 2024-09-15T23:53:18.854 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-15T23:53:18.854 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw== 2024-09-15T23:53:18.854 INFO:teuthology.orchestra.run.smithi112.stdout:[client.2] 2024-09-15T23:53:18.854 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dmj2XtNhAAB5620fN0Kr8Cqgd2+1cebg== 2024-09-15T23:53:18.854 INFO:teuthology.orchestra.run.smithi112.stdout:[client.1] 2024-09-15T23:53:18.854 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dmmP6vORAAqxzX3OjoHnionZo1koIqRQ== 2024-09-15T23:53:18.854 INFO:teuthology.orchestra.run.smithi112.stdout:[client.3] 2024-09-15T23:53:18.854 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBOc+dmt+I7AxAA+eyV3eaThbjRNo0zJT9OQg== 2024-09-15T23:53:18.861 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.y] 2024-09-15T23:53:18.861 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBNc+dm5nULDxAAi9UvgPZ7sU/Zz2jLKsu4ng== 2024-09-15T23:53:18.861 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-09-15T23:53:18.861 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBNc+dmPvLEFBAA/WS7KNQ60+LzhOcQyCVWoQ== 2024-09-15T23:53:18.861 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-09-15T23:53:18.861 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBNc+dmEbNbHRAAjP+2Z2XYc0tarO48R/ocIQ== 2024-09-15T23:53:18.861 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.0] 2024-09-15T23:53:18.861 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBRc+dmnOKMBxAAdaIaYmXKAFGIPTxfYt2apQ== 2024-09-15T23:53:18.861 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.1] 2024-09-15T23:53:18.861 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBUc+dmnowGFhAAa3jXrvZ0An+9IwM9988mvQ== 2024-09-15T23:53:18.862 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.2] 2024-09-15T23:53:18.862 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBXc+dmnj9kJRAAZbpx5TM2ukiLKqi+iZAE5g== 2024-09-15T23:53:18.862 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.3] 2024-09-15T23:53:18.862 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBac+dmAdXtNxAA8g+Nxz1RyVf+P8KOtkw5qw== 2024-09-15T23:53:18.862 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.x] 2024-09-15T23:53:18.862 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBNc+dm4JK5ERAA3d3OABWXchejCqjJRrhTfQ== 2024-09-15T23:53:18.862 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-09-15T23:53:18.862 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBNc+dmN/+jIxAAiXM9onNC3twhiZrqCdWtUQ== 2024-09-15T23:53:18.862 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-09-15T23:53:18.863 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBNc+dmg6AqLBAAZ3PKcarPcPfvIWSTnE5uLA== 2024-09-15T23:53:18.863 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.4] 2024-09-15T23:53:18.863 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBhc+dmyOApAhAA9Cv9nW1b5JvO9cH9emao4A== 2024-09-15T23:53:18.863 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.5] 2024-09-15T23:53:18.863 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBkc+dmFIDwDxAAR/59kfrjiLU4emIqtthfRg== 2024-09-15T23:53:18.863 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.6] 2024-09-15T23:53:18.863 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBnc+dmZVB/IRAAFbvodnxisklCL/yuD+F5ew== 2024-09-15T23:53:18.863 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.7] 2024-09-15T23:53:18.863 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBqc+dmuty6LxAAHWB/GByU/hXOL/+dnRpcVA== 2024-09-15T23:53:18.863 INFO:teuthology.orchestra.run.smithi169.stdout:[client.0] 2024-09-15T23:53:18.863 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw== 2024-09-15T23:53:18.864 INFO:teuthology.orchestra.run.smithi169.stdout:[client.2] 2024-09-15T23:53:18.864 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBNc+dmj2XtNhAAB5620fN0Kr8Cqgd2+1cebg== 2024-09-15T23:53:18.864 INFO:teuthology.orchestra.run.smithi169.stdout:[client.1] 2024-09-15T23:53:18.864 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBNc+dmmP6vORAAqxzX3OjoHnionZo1koIqRQ== 2024-09-15T23:53:18.864 INFO:teuthology.orchestra.run.smithi169.stdout:[client.3] 2024-09-15T23:53:18.864 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQBOc+dmt+I7AxAA+eyV3eaThbjRNo0zJT9OQg== 2024-09-15T23:53:18.865 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T23:53:18.898 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T23:53:18.955 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:53:18.958 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:53:19.003 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:53:19.041 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:53:19.085 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.130 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.173 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.210 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.255 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.294 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.335 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.377 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.420 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T23:53:19.466 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T23:53:19.509 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:53:19.550 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:53:19.597 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:53:19.600 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:53:19.689 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.692 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.731 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.774 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.818 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.820 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.900 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.903 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:53:19.980 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:53:19.990 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:53:20.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:53:20.070 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:53:20.152 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:53:20.154 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:53:20.241 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:53:20.243 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:53:20.334 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-15T23:53:20.335 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-15T23:53:20.347 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T23:53:20.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-15T23:53:20.452 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-15T23:53:20.466 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T23:53:20.564 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-15T23:53:20.575 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-15T23:53:20.631 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T23:53:20.730 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-15T23:53:21.169 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:53:21.172 DEBUG:teuthology.orchestra.run.smithi169:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:53:21.218 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-15T23:53:21.219 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-15T23:53:21.219 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-15T23:53:21.221 INFO:tasks.ceph.mon.a:Started 2024-09-15T23:53:21.221 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-15T23:53:21.221 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-15T23:53:21.263 INFO:tasks.ceph.mon.b:Started 2024-09-15T23:53:21.263 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-15T23:53:21.263 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-15T23:53:21.265 INFO:tasks.ceph.mon.c:Started 2024-09-15T23:53:21.265 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-15T23:53:21.266 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-15T23:53:21.266 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-15T23:53:21.268 INFO:tasks.ceph.mgr.y:Started 2024-09-15T23:53:21.268 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-15T23:53:21.269 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-15T23:53:21.271 INFO:tasks.ceph.mgr.x:Started 2024-09-15T23:53:21.271 INFO:tasks.ceph:Setting crush tunables to default 2024-09-15T23:53:21.272 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd crush tunables default 2024-09-15T23:53:21.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f5e267640 1 Processor -- start 2024-09-15T23:53:21.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f5e267640 1 -- start start 2024-09-15T23:53:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f5e267640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f5e267640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 0x7f8f5806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f5e267640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f580d32b0 con 0x7f8f580d2e90 2024-09-15T23:53:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f5e267640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8f580d0300 con 0x7f8f58161a60 2024-09-15T23:53:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f5e267640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8f580cfab0 con 0x7f8f580cf620 2024-09-15T23:53:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f57fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f57fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42738/0 (socket says 172.21.15.112:42738) 2024-09-15T23:53:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f57fff640 1 -- 172.21.15.112:0/1291313035 learned_addr learned my addr 172.21.15.112:0/1291313035 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f5c804640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 0x7f8f5806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f57fff640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 msgr2=0x7f8f580d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T23:53:21.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f57fff640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 msgr2=0x7f8f580d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T23:53:21.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:53:21.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:53:21.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f5c804640 1 -- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 msgr2=0x7f8f5806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-15T23:53:21.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f5c804640 1 -- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 msgr2=0x7f8f5806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T23:53:21.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f5c804640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 0x7f8f5806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:53:21.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.384+0000 7f8f5c804640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 0x7f8f5806d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:53:21.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.588+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:21.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.588+0000 7f8f5c804640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 0x7f8f5806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:21.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.588+0000 7f8f57fff640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 msgr2=0x7f8f580d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-15T23:53:21.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.588+0000 7f8f57fff640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 msgr2=0x7f8f580d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T23:53:21.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.588+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:53:21.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.588+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:53:21.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.588+0000 7f8f5c804640 1 -- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 msgr2=0x7f8f5806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T23:53:21.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.588+0000 7f8f5c804640 1 -- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 msgr2=0x7f8f5806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T23:53:21.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.588+0000 7f8f5c804640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 0x7f8f5806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:53:21.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.588+0000 7f8f5c804640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 0x7f8f5806d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:53:21.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.992+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:21.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.992+0000 7f8f5c804640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 0x7f8f5806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:21.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.992+0000 7f8f57fff640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 msgr2=0x7f8f580d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T23:53:21.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.992+0000 7f8f57fff640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 msgr2=0x7f8f580d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T23:53:21.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.992+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:53:21.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.992+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T23:53:21.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.992+0000 7f8f5c804640 1 -- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 msgr2=0x7f8f5806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-15T23:53:21.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.992+0000 7f8f5c804640 1 -- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 msgr2=0x7f8f5806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T23:53:21.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.992+0000 7f8f5c804640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 0x7f8f5806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:53:21.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:21.992+0000 7f8f5c804640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 0x7f8f5806d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T23:53:22.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:22.796+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:22.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:22.796+0000 7f8f5c804640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 0x7f8f5806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:22.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:22.796+0000 7f8f57fff640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 msgr2=0x7f8f580d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-15T23:53:22.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:22.796+0000 7f8f57fff640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 msgr2=0x7f8f580d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T23:53:22.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:22.796+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:53:22.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:22.796+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T23:53:22.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:22.796+0000 7f8f5c804640 1 -- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 msgr2=0x7f8f5806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T23:53:22.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:22.796+0000 7f8f5c804640 1 -- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 msgr2=0x7f8f5806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T23:53:22.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:22.796+0000 7f8f5c804640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 0x7f8f5806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:53:22.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:22.796+0000 7f8f5c804640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 0x7f8f5806d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T23:53:24.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.388+0000 7f8f55ffb640 1 -- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 msgr2=0x7f8f5806d6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:53:24.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.388+0000 7f8f55ffb640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f580cf620 0x7f8f5806d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:24.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.388+0000 7f8f55ffb640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 msgr2=0x7f8f580d2950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:53:24.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.388+0000 7f8f55ffb640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.112:3300/0 conn(0x7f8f58161a60 0x7f8f580d2950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:24.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.388+0000 7f8f55ffb640 1 -- 172.21.15.112:0/1291313035 >> v1:172.21.15.169:6789/0 conn(0x7f8f580d2e90 legacy=0x7f8f580cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:24.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.388+0000 7f8f55ffb640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 0x7f8f44009820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:24.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.388+0000 7f8f55ffb640 1 -- 172.21.15.112:0/1291313035 --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f580b0f60 con 0x7f8f440036d0 2024-09-15T23:53:24.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.388+0000 7f8f55ffb640 1 -- 172.21.15.112:0/1291313035 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8f580d0300 con 0x7f8f44007380 2024-09-15T23:53:24.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.388+0000 7f8f577fe640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 0x7f8f44009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:24.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.388+0000 7f8f577fe640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 msgr2=0x7f8f44009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T23:53:24.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.388+0000 7f8f577fe640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 msgr2=0x7f8f44009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T23:53:24.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.388+0000 7f8f577fe640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 0x7f8f44009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:53:24.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.388+0000 7f8f577fe640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 0x7f8f44009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:53:24.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.592+0000 7f8f577fe640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 0x7f8f44009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:24.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.592+0000 7f8f577fe640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 msgr2=0x7f8f44009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T23:53:24.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.592+0000 7f8f577fe640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 msgr2=0x7f8f44009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T23:53:24.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.592+0000 7f8f577fe640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 0x7f8f44009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:53:24.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.592+0000 7f8f577fe640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 0x7f8f44009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:53:24.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.996+0000 7f8f577fe640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 0x7f8f44009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:24.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.996+0000 7f8f577fe640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 msgr2=0x7f8f44009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T23:53:24.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.996+0000 7f8f577fe640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 msgr2=0x7f8f44009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T23:53:24.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.996+0000 7f8f577fe640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 0x7f8f44009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:53:24.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:24.996+0000 7f8f577fe640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 0x7f8f44009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T23:53:25.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:25.800+0000 7f8f577fe640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 0x7f8f44009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:25.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:25.800+0000 7f8f577fe640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 msgr2=0x7f8f44009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T23:53:25.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:25.800+0000 7f8f577fe640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 msgr2=0x7f8f44009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T23:53:25.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:25.800+0000 7f8f577fe640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 0x7f8f44009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:53:25.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:25.800+0000 7f8f577fe640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 0x7f8f44009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T23:53:26.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f56ffd640 1 -- 172.21.15.112:0/1291313035 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923701912 0 0) 0x7f8f580b0f60 con 0x7f8f440036d0 2024-09-15T23:53:26.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f56ffd640 1 -- 172.21.15.112:0/1291313035 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f40003530 con 0x7f8f440036d0 2024-09-15T23:53:26.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f56ffd640 1 -- 172.21.15.112:0/1291313035 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2498890925 0 0) 0x7f8f40003530 con 0x7f8f440036d0 2024-09-15T23:53:26.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f56ffd640 1 -- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 msgr2=0x7f8f44009820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:53:26.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f56ffd640 1 --2- 172.21.15.112:0/1291313035 >> v2:172.21.15.169:3300/0 conn(0x7f8f44007380 0x7f8f44009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:26.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f56ffd640 1 -- 172.21.15.112:0/1291313035 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4400af30 con 0x7f8f440036d0 2024-09-15T23:53:26.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f56ffd640 1 -- 172.21.15.112:0/1291313035 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f8f4c009700 con 0x7f8f440036d0 2024-09-15T23:53:26.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f56ffd640 1 -- 172.21.15.112:0/1291313035 >> v1:172.21.15.112:6789/0 conn(0x7f8f440036d0 legacy=0x7f8f44005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:26.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f5c804640 1 -- 172.21.15.112:0/1291313035 reap_dead start 2024-09-15T23:53:26.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f56ffd640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f40003a10 0x7f8f40003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:26.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f56ffd640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f40004810 0x7f8f40004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:26.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f56ffd640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f400053d0 0x7f8f4000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:26.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f56ffd640 1 -- 172.21.15.112:0/1291313035 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8f580d0300 con 0x7f8f40003a10 2024-09-15T23:53:26.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f56ffd640 1 -- 172.21.15.112:0/1291313035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4000c290 con 0x7f8f400053d0 2024-09-15T23:53:26.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f56ffd640 1 -- 172.21.15.112:0/1291313035 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8f4000c490 con 0x7f8f40004810 2024-09-15T23:53:26.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f40003a10 0x7f8f40003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:26.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f577fe640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f40004810 0x7f8f40004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:26.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f5c804640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f400053d0 0x7f8f4000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:26.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f57fff640 1 -- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f40004810 msgr2=0x7f8f40004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:26.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f40004810 0x7f8f40004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:26.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f57fff640 1 -- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f400053d0 msgr2=0x7f8f4000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:26.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f400053d0 0x7f8f4000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:26.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f57fff640 1 -- 172.21.15.112:0/1291313035 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f40003530 con 0x7f8f40003a10 2024-09-15T23:53:26.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.656+0000 7f8f577fe640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f40004810 0x7f8f40004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:53:26.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.660+0000 7f8f57fff640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f40003a10 0x7f8f40003e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0077a0 tx=0x7f8f4c01da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7498b0f9d70391 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:26.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.660+0000 7f8f56ffd640 1 -- 172.21.15.112:0/1291313035 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c0ac070 con 0x7f8f40003a10 2024-09-15T23:53:26.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.660+0000 7f8f56ffd640 1 -- 172.21.15.112:0/1291313035 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f4c0a6610 con 0x7f8f40003a10 2024-09-15T23:53:26.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.660+0000 7f8f56ffd640 1 -- 172.21.15.112:0/1291313035 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c0073f0 con 0x7f8f40003a10 2024-09-15T23:53:26.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.664+0000 7f8f5e267640 1 -- 172.21.15.112:0/1291313035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f40003a10 msgr2=0x7f8f40003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:26.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.664+0000 7f8f5e267640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f40003a10 0x7f8f40003e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0077a0 tx=0x7f8f4c01da00 comp rx=0 tx=0).stop 2024-09-15T23:53:26.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.664+0000 7f8f5e267640 1 -- 172.21.15.112:0/1291313035 shutdown_connections 2024-09-15T23:53:26.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.664+0000 7f8f5e267640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f400053d0 0x7f8f4000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:26.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.664+0000 7f8f5e267640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f40004810 0x7f8f40004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:26.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.664+0000 7f8f5e267640 1 --2- 172.21.15.112:0/1291313035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f40003a10 0x7f8f40003e10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:26.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.664+0000 7f8f5e267640 1 -- 172.21.15.112:0/1291313035 >> 172.21.15.112:0/1291313035 conn(0x7f8f5808bf90 msgr2=0x7f8f5809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:26.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.664+0000 7f8f5e267640 1 -- 172.21.15.112:0/1291313035 shutdown_connections 2024-09-15T23:53:26.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.664+0000 7f8f5e267640 1 -- 172.21.15.112:0/1291313035 wait complete. 2024-09-15T23:53:26.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5e267640 1 Processor -- start 2024-09-15T23:53:26.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5e267640 1 -- start start 2024-09-15T23:53:26.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5e267640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f40003a10 0x7f8f580c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:26.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5e267640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f40004810 0x7f8f58160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:26.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5e267640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f400053d0 0x7f8f580c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:26.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5e267640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8f580cf2e0 con 0x7f8f400053d0 2024-09-15T23:53:26.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5e267640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5806d190 con 0x7f8f40003a10 2024-09-15T23:53:26.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5e267640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8f580cf460 con 0x7f8f40004810 2024-09-15T23:53:26.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5c804640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f400053d0 0x7f8f580c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:26.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5c804640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f400053d0 0x7f8f580c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42798/0 (socket says 172.21.15.112:42798) 2024-09-15T23:53:26.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5c804640 1 -- 172.21.15.112:0/3385688282 learned_addr learned my addr 172.21.15.112:0/3385688282 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:26.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f57fff640 1 --2- 172.21.15.112:0/3385688282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f40003a10 0x7f8f580c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:26.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f577fe640 1 --2- 172.21.15.112:0/3385688282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f40004810 0x7f8f58160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:26.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5c804640 1 -- 172.21.15.112:0/3385688282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f40004810 msgr2=0x7f8f58160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:26.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5c804640 1 --2- 172.21.15.112:0/3385688282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f40004810 0x7f8f58160350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:26.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5c804640 1 -- 172.21.15.112:0/3385688282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f40003a10 msgr2=0x7f8f580c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5c804640 1 --2- 172.21.15.112:0/3385688282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f40003a10 0x7f8f580c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.668+0000 7f8f5c804640 1 -- 172.21.15.112:0/3385688282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f580ca390 con 0x7f8f400053d0 2024-09-15T23:53:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.672+0000 7f8f5c804640 1 --2- 172.21.15.112:0/3385688282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f400053d0 0x7f8f580c99b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f440072f0 tx=0x7f8f50017e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.672+0000 7f8f54ff9640 1 -- 172.21.15.112:0/3385688282 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5000f040 con 0x7f8f400053d0 2024-09-15T23:53:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.672+0000 7f8f54ff9640 1 -- 172.21.15.112:0/3385688282 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f50015b70 con 0x7f8f400053d0 2024-09-15T23:53:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.672+0000 7f8f54ff9640 1 -- 172.21.15.112:0/3385688282 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f50018450 con 0x7f8f400053d0 2024-09-15T23:53:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.672+0000 7f8f5e267640 1 -- 172.21.15.112:0/3385688282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f580c7fb0 con 0x7f8f400053d0 2024-09-15T23:53:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.672+0000 7f8f5e267640 1 -- 172.21.15.112:0/3385688282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f580c8570 con 0x7f8f400053d0 2024-09-15T23:53:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.672+0000 7f8f54ff9640 1 -- 172.21.15.112:0/3385688282 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f500185f0 con 0x7f8f400053d0 2024-09-15T23:53:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.672+0000 7f8f54ff9640 1 -- 172.21.15.112:0/3385688282 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8f5002ac20 con 0x7f8f400053d0 2024-09-15T23:53:26.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.672+0000 7f8f5e267640 1 -- 172.21.15.112:0/3385688282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f580d12b0 con 0x7f8f400053d0 2024-09-15T23:53:26.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.676+0000 7f8f54ff9640 1 -- 172.21.15.112:0/3385688282 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8f500412d0 con 0x7f8f400053d0 2024-09-15T23:53:26.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.740+0000 7f8f5e267640 1 -- 172.21.15.112:0/3385688282 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8f580c7c40 con 0x7f8f400053d0 2024-09-15T23:53:26.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.744+0000 7f8f54ff9640 1 -- 172.21.15.112:0/3385688282 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f8f5002f020 con 0x7f8f400053d0 2024-09-15T23:53:26.744 INFO:teuthology.orchestra.run.smithi112.stderr:adjusted tunables profile to default 2024-09-15T23:53:26.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.744+0000 7f8f5e267640 1 -- 172.21.15.112:0/3385688282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f400053d0 msgr2=0x7f8f580c99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:26.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.744+0000 7f8f5e267640 1 --2- 172.21.15.112:0/3385688282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f400053d0 0x7f8f580c99b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f440072f0 tx=0x7f8f50017e10 comp rx=0 tx=0).stop 2024-09-15T23:53:26.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.744+0000 7f8f5e267640 1 -- 172.21.15.112:0/3385688282 shutdown_connections 2024-09-15T23:53:26.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.744+0000 7f8f5e267640 1 --2- 172.21.15.112:0/3385688282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f400053d0 0x7f8f580c99b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:26.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.744+0000 7f8f5e267640 1 --2- 172.21.15.112:0/3385688282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f40004810 0x7f8f58160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:26.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.744+0000 7f8f5e267640 1 --2- 172.21.15.112:0/3385688282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f40003a10 0x7f8f580c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:26.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.744+0000 7f8f5e267640 1 -- 172.21.15.112:0/3385688282 >> 172.21.15.112:0/3385688282 conn(0x7f8f5808bf90 msgr2=0x7f8f581eda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:26.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.744+0000 7f8f5e267640 1 -- 172.21.15.112:0/3385688282 shutdown_connections 2024-09-15T23:53:26.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:26.744+0000 7f8f5e267640 1 -- 172.21.15.112:0/3385688282 wait complete. 2024-09-15T23:53:26.766 INFO:tasks.ceph:check_enable_crimson: False 2024-09-15T23:53:26.766 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-15T23:53:26.767 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:53:26.767 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-15T23:53:26.780 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:53:26.780 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-15T23:53:26.837 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:53:26.837 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-15T23:53:26.886 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:26.884+0000 7f995c2c9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:53:26.893 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:53:26.893 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-15T23:53:26.944 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:26.940+0000 7f7cec28b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:53:26.948 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:53:26.948 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-15T23:53:26.961 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:53:26.961 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-15T23:53:27.017 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:53:27.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-15T23:53:27.073 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:53:27.073 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-15T23:53:27.129 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new d5a8203b-84d3-480c-8ba8-57f2d5da689f 0 2024-09-15T23:53:27.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.292+0000 7f7dd59ee640 1 Processor -- start 2024-09-15T23:53:27.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.292+0000 7f7dd59ee640 1 -- start start 2024-09-15T23:53:27.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dd59ee640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7dd00cd500 0x7f7dd015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dd59ee640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd0155140 con 0x7f7dd006ccd0 2024-09-15T23:53:27.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dd59ee640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd00b4960 con 0x7f7dd0154d60 2024-09-15T23:53:27.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dd59ee640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7dd00b43a0 con 0x7f7dd00cd500 2024-09-15T23:53:27.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dceffd640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f7dd0154d60 0x7f7dd00b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:54946/0 (socket says 172.21.15.169:54946) 2024-09-15T23:53:27.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dceffd640 1 -- 172.21.15.169:0/2648799109 learned_addr learned my addr 172.21.15.169:0/2648799109 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-15T23:53:27.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dce7fc640 1 --2- 172.21.15.169:0/2648799109 >> v2:172.21.15.112:3300/0 conn(0x7f7dd00cd500 0x7f7dd015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 -- 172.21.15.169:0/2648799109 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322510754 0 0) 0x7f7dd00b4960 con 0x7f7dd0154d60 2024-09-15T23:53:27.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 -- 172.21.15.169:0/2648799109 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dbc003450 con 0x7f7dd0154d60 2024-09-15T23:53:27.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 -- 172.21.15.169:0/2648799109 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2814393036 0 0) 0x7f7dbc003450 con 0x7f7dd0154d60 2024-09-15T23:53:27.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 -- 172.21.15.169:0/2648799109 >> v2:172.21.15.112:3300/0 conn(0x7f7dd00cd500 msgr2=0x7f7dd015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:27.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 --2- 172.21.15.169:0/2648799109 >> v2:172.21.15.112:3300/0 conn(0x7f7dd00cd500 0x7f7dd015b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 -- 172.21.15.169:0/2648799109 >> v1:172.21.15.112:6789/0 conn(0x7f7dd006ccd0 legacy=0x7f7dd00cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 -- 172.21.15.169:0/2648799109 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd00b4680 con 0x7f7dd0154d60 2024-09-15T23:53:27.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 -- 172.21.15.169:0/2648799109 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f7dc8001680 con 0x7f7dd0154d60 2024-09-15T23:53:27.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 -- 172.21.15.169:0/2648799109 >> v1:172.21.15.169:6789/0 conn(0x7f7dd0154d60 legacy=0x7f7dd00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 --2- 172.21.15.169:0/2648799109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dbc003ab0 0x7f7dbc003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 --2- 172.21.15.169:0/2648799109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7dbc008860 0x7f7dbc00acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 --2- 172.21.15.169:0/2648799109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dbc00b570 0x7f7dbc00da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 -- 172.21.15.169:0/2648799109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd00b43a0 con 0x7f7dbc008860 2024-09-15T23:53:27.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 -- 172.21.15.169:0/2648799109 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc00e310 con 0x7f7dbc00b570 2024-09-15T23:53:27.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcdffb640 1 -- 172.21.15.169:0/2648799109 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7dbc00e510 con 0x7f7dbc003ab0 2024-09-15T23:53:27.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcf7fe640 1 --2- 172.21.15.169:0/2648799109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dbc00b570 0x7f7dbc00da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dceffd640 1 --2- 172.21.15.169:0/2648799109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dbc003ab0 0x7f7dbc003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dce7fc640 1 --2- 172.21.15.169:0/2648799109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7dbc008860 0x7f7dbc00acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dceffd640 1 -- 172.21.15.169:0/2648799109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dbc00b570 msgr2=0x7f7dbc00da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:27.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dceffd640 1 --2- 172.21.15.169:0/2648799109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dbc00b570 0x7f7dbc00da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dceffd640 1 -- 172.21.15.169:0/2648799109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7dbc008860 msgr2=0x7f7dbc00acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:27.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dceffd640 1 --2- 172.21.15.169:0/2648799109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7dbc008860 0x7f7dbc00acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dceffd640 1 -- 172.21.15.169:0/2648799109 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc003450 con 0x7f7dbc003ab0 2024-09-15T23:53:27.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcf7fe640 1 --2- 172.21.15.169:0/2648799109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dbc00b570 0x7f7dbc00da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:53:27.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dcf7fe640 1 -- 172.21.15.169:0/2648799109 reap_dead start 2024-09-15T23:53:27.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.296+0000 7f7dceffd640 1 --2- 172.21.15.169:0/2648799109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dbc003ab0 0x7f7dbc003ed0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800c240 tx=0x7f7dc801cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e21f8b4301654473 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:27.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dcdffb640 1 -- 172.21.15.169:0/2648799109 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8007d20 con 0x7f7dbc003ab0 2024-09-15T23:53:27.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dcdffb640 1 -- 172.21.15.169:0/2648799109 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc80a9070 con 0x7f7dbc003ab0 2024-09-15T23:53:27.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dcdffb640 1 -- 172.21.15.169:0/2648799109 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8005da0 con 0x7f7dbc003ab0 2024-09-15T23:53:27.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 -- 172.21.15.169:0/2648799109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dbc003ab0 msgr2=0x7f7dbc003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 --2- 172.21.15.169:0/2648799109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dbc003ab0 0x7f7dbc003ed0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800c240 tx=0x7f7dc801cc40 comp rx=0 tx=0).stop 2024-09-15T23:53:27.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 -- 172.21.15.169:0/2648799109 shutdown_connections 2024-09-15T23:53:27.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 --2- 172.21.15.169:0/2648799109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dbc003ab0 0x7f7dbc003ed0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 -- 172.21.15.169:0/2648799109 >> 172.21.15.169:0/2648799109 conn(0x7f7dd0072670 msgr2=0x7f7dd0072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:27.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 -- 172.21.15.169:0/2648799109 shutdown_connections 2024-09-15T23:53:27.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 -- 172.21.15.169:0/2648799109 wait complete. 2024-09-15T23:53:27.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 Processor -- start 2024-09-15T23:53:27.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 -- start start 2024-09-15T23:53:27.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7dbc003ab0 0x7f7dd0141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dd0150440 0x7f7dd01f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dd01508c0 0x7f7dd01f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd015b940 con 0x7f7dbc003ab0 2024-09-15T23:53:27.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd015b7c0 con 0x7f7dd0150440 2024-09-15T23:53:27.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd015bac0 con 0x7f7dd01508c0 2024-09-15T23:53:27.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dcf7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dd01508c0 0x7f7dd01f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dce7fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dd0150440 0x7f7dd01f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dcf7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dd01508c0 0x7f7dd01f6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:50502/0 (socket says 172.21.15.169:50502) 2024-09-15T23:53:27.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dcf7fe640 1 -- 172.21.15.169:0/1829188144 learned_addr learned my addr 172.21.15.169:0/1829188144 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T23:53:27.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dceffd640 1 --2- 172.21.15.169:0/1829188144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7dbc003ab0 0x7f7dd0141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dce7fc640 1 -- 172.21.15.169:0/1829188144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dd01508c0 msgr2=0x7f7dd01f6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dce7fc640 1 --2- 172.21.15.169:0/1829188144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dd01508c0 0x7f7dd01f6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dce7fc640 1 -- 172.21.15.169:0/1829188144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7dbc003ab0 msgr2=0x7f7dd0141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dce7fc640 1 --2- 172.21.15.169:0/1829188144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7dbc003ab0 0x7f7dd0141180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dce7fc640 1 -- 172.21.15.169:0/1829188144 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd015c200 con 0x7f7dd0150440 2024-09-15T23:53:27.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dce7fc640 1 --2- 172.21.15.169:0/1829188144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dd0150440 0x7f7dd01f6750 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7db8011990 tx=0x7f7db8011e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:27.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dc7fff640 1 -- 172.21.15.169:0/1829188144 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db800fa70 con 0x7f7dd0150440 2024-09-15T23:53:27.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dc7fff640 1 -- 172.21.15.169:0/1829188144 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db800fc10 con 0x7f7dd0150440 2024-09-15T23:53:27.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dc7fff640 1 -- 172.21.15.169:0/1829188144 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db8014440 con 0x7f7dd0150440 2024-09-15T23:53:27.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 -- 172.21.15.169:0/1829188144 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd0150e90 con 0x7f7dd0150440 2024-09-15T23:53:27.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.300+0000 7f7dd59ee640 1 -- 172.21.15.169:0/1829188144 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd015c4a0 con 0x7f7dd0150440 2024-09-15T23:53:27.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.304+0000 7f7dc7fff640 1 -- 172.21.15.169:0/1829188144 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7db8012040 con 0x7f7dd0150440 2024-09-15T23:53:27.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.304+0000 7f7dc7fff640 1 -- 172.21.15.169:0/1829188144 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f7db801d990 con 0x7f7dd0150440 2024-09-15T23:53:27.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.304+0000 7f7dd59ee640 1 -- 172.21.15.169:0/1829188144 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd0068df0 con 0x7f7dd0150440 2024-09-15T23:53:27.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.308+0000 7f7dc7fff640 1 -- 172.21.15.169:0/1829188144 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7db802b020 con 0x7f7dd0150440 2024-09-15T23:53:27.371 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:27.368+0000 7f995c2c9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:53:27.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.376+0000 7f7dd59ee640 1 -- 172.21.15.169:0/1829188144 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d5a8203b-84d3-480c-8ba8-57f2d5da689f", "id": 0} v 0) -- 0x7f7dd00cfeb0 con 0x7f7dd0150440 2024-09-15T23:53:27.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.384+0000 7f7dc7fff640 1 -- 172.21.15.169:0/1829188144 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5a8203b-84d3-480c-8ba8-57f2d5da689f", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f7db8019030 con 0x7f7dd0150440 2024-09-15T23:53:27.389 INFO:teuthology.orchestra.run.smithi169.stdout:0 2024-09-15T23:53:27.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.384+0000 7f7dd59ee640 1 -- 172.21.15.169:0/1829188144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dd0150440 msgr2=0x7f7dd01f6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.384+0000 7f7dd59ee640 1 --2- 172.21.15.169:0/1829188144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dd0150440 0x7f7dd01f6750 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7db8011990 tx=0x7f7db8011e50 comp rx=0 tx=0).stop 2024-09-15T23:53:27.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.384+0000 7f7dd59ee640 1 -- 172.21.15.169:0/1829188144 shutdown_connections 2024-09-15T23:53:27.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.384+0000 7f7dd59ee640 1 --2- 172.21.15.169:0/1829188144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dd01508c0 0x7f7dd01f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.384+0000 7f7dd59ee640 1 --2- 172.21.15.169:0/1829188144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dd0150440 0x7f7dd01f6750 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.384+0000 7f7dd59ee640 1 --2- 172.21.15.169:0/1829188144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7dbc003ab0 0x7f7dd0141180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.384+0000 7f7dd59ee640 1 -- 172.21.15.169:0/1829188144 >> 172.21.15.169:0/1829188144 conn(0x7f7dd0072670 msgr2=0x7f7dd015a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:27.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.384+0000 7f7dd59ee640 1 -- 172.21.15.169:0/1829188144 shutdown_connections 2024-09-15T23:53:27.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.384+0000 7f7dd59ee640 1 -- 172.21.15.169:0/1829188144 wait complete. 2024-09-15T23:53:27.405 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new af18f4ae-8712-4c44-803f-fcf9944ea2db 1 2024-09-15T23:53:27.432 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:27.428+0000 7f7cec28b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:53:27.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.516+0000 7f3bfef2c640 1 Processor -- start 2024-09-15T23:53:27.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.516+0000 7f3bfef2c640 1 -- start start 2024-09-15T23:53:27.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bfef2c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3bf809ac60 0x7f3bf809ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bfef2c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3bf809b040 0x7f3bf80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bfef2c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf80afd80 con 0x7f3bf80b0e20 2024-09-15T23:53:27.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bfef2c640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf80b0060 con 0x7f3bf809ac60 2024-09-15T23:53:27.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bfef2c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf80b0340 con 0x7f3bf809b040 2024-09-15T23:53:27.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bf7fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3bf809b040 0x7f3bf80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bfd4c9640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f3bf80b0e20 0x7f3bf80b1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:54954/0 (socket says 172.21.15.169:54954) 2024-09-15T23:53:27.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bfd4c9640 1 -- 172.21.15.169:0/2954128660 learned_addr learned my addr 172.21.15.169:0/2954128660 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-15T23:53:27.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bfccc8640 1 --2- 172.21.15.169:0/2954128660 >> v2:172.21.15.112:3300/0 conn(0x7f3bf809ac60 0x7f3bf809ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bf77fe640 1 -- 172.21.15.169:0/2954128660 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666287119 0 0) 0x7f3bf80afd80 con 0x7f3bf80b0e20 2024-09-15T23:53:27.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bf7fff640 1 -- 172.21.15.169:0/2954128660 >> v2:172.21.15.112:3300/0 conn(0x7f3bf809ac60 msgr2=0x7f3bf809ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:27.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bf7fff640 1 --2- 172.21.15.169:0/2954128660 >> v2:172.21.15.112:3300/0 conn(0x7f3bf809ac60 0x7f3bf809ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bf7fff640 1 -- 172.21.15.169:0/2954128660 >> v1:172.21.15.169:6789/0 conn(0x7f3bf80b0e20 legacy=0x7f3bf80b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bf7fff640 1 -- 172.21.15.169:0/2954128660 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf80b0620 con 0x7f3bf809b040 2024-09-15T23:53:27.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bfccc8640 1 --2- 172.21.15.169:0/2954128660 >> v2:172.21.15.112:3300/0 conn(0x7f3bf809ac60 0x7f3bf809ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:53:27.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bf7fff640 1 --2- 172.21.15.169:0/2954128660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3bf809b040 0x7f3bf80af730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3be80097c0 tx=0x7f3be801cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8cacbbd10e355f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:27.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bf77fe640 1 -- 172.21.15.169:0/2954128660 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be80b0070 con 0x7f3bf809b040 2024-09-15T23:53:27.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bf77fe640 1 -- 172.21.15.169:0/2954128660 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be80ab600 con 0x7f3bf809b040 2024-09-15T23:53:27.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.520+0000 7f3bf77fe640 1 -- 172.21.15.169:0/2954128660 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be80ab9d0 con 0x7f3bf809b040 2024-09-15T23:53:27.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 -- 172.21.15.169:0/2954128660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3bf809b040 msgr2=0x7f3bf80af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 --2- 172.21.15.169:0/2954128660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3bf809b040 0x7f3bf80af730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3be80097c0 tx=0x7f3be801cdb0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 -- 172.21.15.169:0/2954128660 shutdown_connections 2024-09-15T23:53:27.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 --2- 172.21.15.169:0/2954128660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3bf809b040 0x7f3bf80af730 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 --2- 172.21.15.169:0/2954128660 >> v2:172.21.15.112:3300/0 conn(0x7f3bf809ac60 0x7f3bf809ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 -- 172.21.15.169:0/2954128660 >> 172.21.15.169:0/2954128660 conn(0x7f3bf80b78d0 msgr2=0x7f3bf80b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:27.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 -- 172.21.15.169:0/2954128660 shutdown_connections 2024-09-15T23:53:27.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 -- 172.21.15.169:0/2954128660 wait complete. 2024-09-15T23:53:27.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 Processor -- start 2024-09-15T23:53:27.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 -- start start 2024-09-15T23:53:27.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf809ac60 0x7f3bf814c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3bf809b040 0x7f3bf814eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bf80b0e20 0x7f3bf814d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf815d3a0 con 0x7f3bf809ac60 2024-09-15T23:53:27.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf815d220 con 0x7f3bf80b0e20 2024-09-15T23:53:27.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf815d520 con 0x7f3bf809b040 2024-09-15T23:53:27.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bf7fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3bf809b040 0x7f3bf814eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bf7fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3bf809b040 0x7f3bf814eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:50530/0 (socket says 172.21.15.169:50530) 2024-09-15T23:53:27.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfd4c9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bf80b0e20 0x7f3bf814d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bf7fff640 1 -- 172.21.15.169:0/857467783 learned_addr learned my addr 172.21.15.169:0/857467783 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T23:53:27.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfccc8640 1 --2- 172.21.15.169:0/857467783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf809ac60 0x7f3bf814c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bf7fff640 1 -- 172.21.15.169:0/857467783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bf80b0e20 msgr2=0x7f3bf814d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bf7fff640 1 --2- 172.21.15.169:0/857467783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bf80b0e20 0x7f3bf814d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bf7fff640 1 -- 172.21.15.169:0/857467783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf809ac60 msgr2=0x7f3bf814c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bf7fff640 1 --2- 172.21.15.169:0/857467783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf809ac60 0x7f3bf814c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bf7fff640 1 -- 172.21.15.169:0/857467783 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf814db00 con 0x7f3bf809b040 2024-09-15T23:53:27.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfd4c9640 1 --2- 172.21.15.169:0/857467783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bf80b0e20 0x7f3bf814d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:53:27.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bf7fff640 1 --2- 172.21.15.169:0/857467783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3bf809b040 0x7f3bf814eba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3be8019f80 tx=0x7f3be80190f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:27.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bf57fa640 1 -- 172.21.15.169:0/857467783 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be80b8020 con 0x7f3bf809b040 2024-09-15T23:53:27.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bf57fa640 1 -- 172.21.15.169:0/857467783 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be80b4410 con 0x7f3bf809b040 2024-09-15T23:53:27.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 -- 172.21.15.169:0/857467783 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf814dde0 con 0x7f3bf809b040 2024-09-15T23:53:27.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bf57fa640 1 -- 172.21.15.169:0/857467783 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be80b0040 con 0x7f3bf809b040 2024-09-15T23:53:27.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bfef2c640 1 -- 172.21.15.169:0/857467783 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf814e3a0 con 0x7f3bf809b040 2024-09-15T23:53:27.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bf57fa640 1 -- 172.21.15.169:0/857467783 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3be80bb020 con 0x7f3bf809b040 2024-09-15T23:53:27.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.524+0000 7f3bf57fa640 1 -- 172.21.15.169:0/857467783 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f3be80bdd80 con 0x7f3bf809b040 2024-09-15T23:53:27.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.528+0000 7f3bfef2c640 1 -- 172.21.15.169:0/857467783 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf80b34f0 con 0x7f3bf809b040 2024-09-15T23:53:27.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.528+0000 7f3bf57fa640 1 -- 172.21.15.169:0/857467783 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3be80c2030 con 0x7f3bf809b040 2024-09-15T23:53:27.565 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:27.564+0000 7f995c2c9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:53:27.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.600+0000 7f3bfef2c640 1 -- 172.21.15.169:0/857467783 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "af18f4ae-8712-4c44-803f-fcf9944ea2db", "id": 1} v 0) -- 0x7f3bf80b3210 con 0x7f3bf809b040 2024-09-15T23:53:27.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.608+0000 7f3bf57fa640 1 -- 172.21.15.169:0/857467783 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "af18f4ae-8712-4c44-803f-fcf9944ea2db", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f3be8016090 con 0x7f3bf809b040 2024-09-15T23:53:27.612 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-09-15T23:53:27.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.608+0000 7f3bfef2c640 1 -- 172.21.15.169:0/857467783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3bf809b040 msgr2=0x7f3bf814eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.608+0000 7f3bfef2c640 1 --2- 172.21.15.169:0/857467783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3bf809b040 0x7f3bf814eba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3be8019f80 tx=0x7f3be80190f0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.608+0000 7f3bfef2c640 1 -- 172.21.15.169:0/857467783 shutdown_connections 2024-09-15T23:53:27.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.608+0000 7f3bfef2c640 1 --2- 172.21.15.169:0/857467783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bf80b0e20 0x7f3bf814d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.608+0000 7f3bfef2c640 1 --2- 172.21.15.169:0/857467783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3bf809b040 0x7f3bf814eba0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.608+0000 7f3bfef2c640 1 --2- 172.21.15.169:0/857467783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bf809ac60 0x7f3bf814c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.608+0000 7f3bfef2c640 1 -- 172.21.15.169:0/857467783 >> 172.21.15.169:0/857467783 conn(0x7f3bf80b78d0 msgr2=0x7f3bf8070180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:27.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.612+0000 7f3bfef2c640 1 -- 172.21.15.169:0/857467783 shutdown_connections 2024-09-15T23:53:27.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.612+0000 7f3bfef2c640 1 -- 172.21.15.169:0/857467783 wait complete. 2024-09-15T23:53:27.630 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 5b9bf4e7-3349-4a8d-a55e-7757568d13f4 2 2024-09-15T23:53:27.655 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:27.652+0000 7f7cec28b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:53:27.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.764+0000 7f211464b640 1 Processor -- start 2024-09-15T23:53:27.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.764+0000 7f211464b640 1 -- start start 2024-09-15T23:53:27.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f211464b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f210c070bd0 0x7f210c0cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f211464b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f210c0cf4f0 con 0x7f210c0d0590 2024-09-15T23:53:27.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f211464b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f210c0cf7d0 con 0x7f210c154cd0 2024-09-15T23:53:27.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f211464b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f210c0cfab0 con 0x7f210c070bd0 2024-09-15T23:53:27.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f2112be8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f210c070bd0 0x7f210c0cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f2112be8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f210c070bd0 0x7f210c0cee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:50540/0 (socket says 172.21.15.169:50540) 2024-09-15T23:53:27.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f2112be8640 1 -- 172.21.15.169:0/3468481199 learned_addr learned my addr 172.21.15.169:0/3468481199 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T23:53:27.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f2112be8640 1 -- 172.21.15.169:0/3468481199 >> v1:172.21.15.169:6789/0 conn(0x7f210c154cd0 legacy=0x7f210c15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f21113e5640 1 -- 172.21.15.169:0/3468481199 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2547641166 0 0) 0x7f210c0cf7d0 con 0x7f210c154cd0 2024-09-15T23:53:27.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f2112be8640 1 -- 172.21.15.169:0/3468481199 >> v1:172.21.15.112:6789/0 conn(0x7f210c0d0590 legacy=0x7f210c0704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:27.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f2112be8640 1 -- 172.21.15.169:0/3468481199 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210c0cfd90 con 0x7f210c070bd0 2024-09-15T23:53:27.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f2112be8640 1 --2- 172.21.15.169:0/3468481199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f210c070bd0 0x7f210c0cee50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f210400afc0 tx=0x7f210401db10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e762300aa0fb0203 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:27.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f21113e5640 1 -- 172.21.15.169:0/3468481199 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210400a2d0 con 0x7f210c070bd0 2024-09-15T23:53:27.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f21113e5640 1 -- 172.21.15.169:0/3468481199 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21040a6880 con 0x7f210c070bd0 2024-09-15T23:53:27.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f21113e5640 1 -- 172.21.15.169:0/3468481199 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21040a6c50 con 0x7f210c070bd0 2024-09-15T23:53:27.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f211464b640 1 -- 172.21.15.169:0/3468481199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f210c070bd0 msgr2=0x7f210c0cee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f211464b640 1 --2- 172.21.15.169:0/3468481199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f210c070bd0 0x7f210c0cee50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f210400afc0 tx=0x7f210401db10 comp rx=0 tx=0).stop 2024-09-15T23:53:27.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f211464b640 1 -- 172.21.15.169:0/3468481199 shutdown_connections 2024-09-15T23:53:27.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f211464b640 1 --2- 172.21.15.169:0/3468481199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f210c070bd0 0x7f210c0cee50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f211464b640 1 -- 172.21.15.169:0/3468481199 >> 172.21.15.169:0/3468481199 conn(0x7f210c073580 msgr2=0x7f210c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:27.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f211464b640 1 -- 172.21.15.169:0/3468481199 shutdown_connections 2024-09-15T23:53:27.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.768+0000 7f211464b640 1 -- 172.21.15.169:0/3468481199 wait complete. 2024-09-15T23:53:27.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f211464b640 1 Processor -- start 2024-09-15T23:53:27.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f211464b640 1 -- start start 2024-09-15T23:53:27.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f211464b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f210c070bd0 0x7f210c1525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f211464b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f210c0d0590 0x7f210c145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f211464b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f210c154cd0 0x7f210c1496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f211464b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f210c0b3fd0 con 0x7f210c0d0590 2024-09-15T23:53:27.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f211464b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f210c0b3e50 con 0x7f210c154cd0 2024-09-15T23:53:27.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f211464b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f210c0b4150 con 0x7f210c070bd0 2024-09-15T23:53:27.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f21123e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f210c070bd0 0x7f210c1525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f2112be8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f210c154cd0 0x7f210c1496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f21123e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f210c070bd0 0x7f210c1525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:50554/0 (socket says 172.21.15.169:50554) 2024-09-15T23:53:27.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f21123e7640 1 -- 172.21.15.169:0/3884747770 learned_addr learned my addr 172.21.15.169:0/3884747770 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T23:53:27.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f2111be6640 1 --2- 172.21.15.169:0/3884747770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f210c0d0590 0x7f210c145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f21123e7640 1 -- 172.21.15.169:0/3884747770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f210c154cd0 msgr2=0x7f210c1496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f21123e7640 1 --2- 172.21.15.169:0/3884747770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f210c154cd0 0x7f210c1496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f21123e7640 1 -- 172.21.15.169:0/3884747770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f210c0d0590 msgr2=0x7f210c145190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f21123e7640 1 --2- 172.21.15.169:0/3884747770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f210c0d0590 0x7f210c145190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f21123e7640 1 -- 172.21.15.169:0/3884747770 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210c149c30 con 0x7f210c070bd0 2024-09-15T23:53:27.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f2111be6640 1 --2- 172.21.15.169:0/3884747770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f210c0d0590 0x7f210c145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:53:27.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f21123e7640 1 --2- 172.21.15.169:0/3884747770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f210c070bd0 0x7f210c1525e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f210800c450 tx=0x7f210800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:27.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f2102ffd640 1 -- 172.21.15.169:0/3884747770 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108017070 con 0x7f210c070bd0 2024-09-15T23:53:27.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f2102ffd640 1 -- 172.21.15.169:0/3884747770 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2108005480 con 0x7f210c070bd0 2024-09-15T23:53:27.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f211464b640 1 -- 172.21.15.169:0/3884747770 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210c145900 con 0x7f210c070bd0 2024-09-15T23:53:27.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f2102ffd640 1 -- 172.21.15.169:0/3884747770 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108003840 con 0x7f210c070bd0 2024-09-15T23:53:27.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f211464b640 1 -- 172.21.15.169:0/3884747770 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f210c14b6c0 con 0x7f210c070bd0 2024-09-15T23:53:27.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f2102ffd640 1 -- 172.21.15.169:0/3884747770 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f210801a070 con 0x7f210c070bd0 2024-09-15T23:53:27.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f2102ffd640 1 -- 172.21.15.169:0/3884747770 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f2108012820 con 0x7f210c070bd0 2024-09-15T23:53:27.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.772+0000 7f211464b640 1 -- 172.21.15.169:0/3884747770 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f210c0cee50 con 0x7f210c070bd0 2024-09-15T23:53:27.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.776+0000 7f2102ffd640 1 -- 172.21.15.169:0/3884747770 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2108021070 con 0x7f210c070bd0 2024-09-15T23:53:27.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.840+0000 7f211464b640 1 -- 172.21.15.169:0/3884747770 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5b9bf4e7-3349-4a8d-a55e-7757568d13f4", "id": 2} v 0) -- 0x7f210c14f9e0 con 0x7f210c070bd0 2024-09-15T23:53:27.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.844+0000 7f2102ffd640 1 -- 172.21.15.169:0/3884747770 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5b9bf4e7-3349-4a8d-a55e-7757568d13f4", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f210c149c30 con 0x7f210c070bd0 2024-09-15T23:53:27.849 INFO:teuthology.orchestra.run.smithi169.stdout:2 2024-09-15T23:53:27.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.848+0000 7f211464b640 1 -- 172.21.15.169:0/3884747770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f210c070bd0 msgr2=0x7f210c1525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.848+0000 7f211464b640 1 --2- 172.21.15.169:0/3884747770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f210c070bd0 0x7f210c1525e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f210800c450 tx=0x7f210800c910 comp rx=0 tx=0).stop 2024-09-15T23:53:27.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.848+0000 7f211464b640 1 -- 172.21.15.169:0/3884747770 shutdown_connections 2024-09-15T23:53:27.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.848+0000 7f211464b640 1 --2- 172.21.15.169:0/3884747770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f210c154cd0 0x7f210c1496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.848+0000 7f211464b640 1 --2- 172.21.15.169:0/3884747770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f210c0d0590 0x7f210c145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.848+0000 7f211464b640 1 --2- 172.21.15.169:0/3884747770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f210c070bd0 0x7f210c1525e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.848+0000 7f211464b640 1 -- 172.21.15.169:0/3884747770 >> 172.21.15.169:0/3884747770 conn(0x7f210c073580 msgr2=0x7f210c14ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:27.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.848+0000 7f211464b640 1 -- 172.21.15.169:0/3884747770 shutdown_connections 2024-09-15T23:53:27.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.848+0000 7f211464b640 1 -- 172.21.15.169:0/3884747770 wait complete. 2024-09-15T23:53:27.865 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new f7bf128d-bf69-4f14-b258-4d9dc096e891 3 2024-09-15T23:53:27.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.972+0000 7f4594091640 1 Processor -- start 2024-09-15T23:53:27.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.972+0000 7f4594091640 1 -- start start 2024-09-15T23:53:27.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4594091640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f458c09ac60 0x7f458c09ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4594091640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f458c0af730 0x7f458c15d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4594091640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f458c0afd80 con 0x7f458c09b040 2024-09-15T23:53:27.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4594091640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f458c0afb60 con 0x7f458c0af730 2024-09-15T23:53:27.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4594091640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f458c0b0060 con 0x7f458c09ac60 2024-09-15T23:53:27.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4591e2d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f458c09ac60 0x7f458c09ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4591e2d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f458c09ac60 0x7f458c09ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:49368/0 (socket says 172.21.15.169:49368) 2024-09-15T23:53:27.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f459162c640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f458c09b040 0x7f458c0b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:54968/0 (socket says 172.21.15.169:54968) 2024-09-15T23:53:27.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4591e2d640 1 -- 172.21.15.169:0/180143293 learned_addr learned my addr 172.21.15.169:0/180143293 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T23:53:27.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f459262e640 1 --2- 172.21.15.169:0/180143293 >> v2:172.21.15.112:3300/0 conn(0x7f458c0af730 0x7f458c15d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4591e2d640 1 -- 172.21.15.169:0/180143293 >> v2:172.21.15.112:3300/0 conn(0x7f458c0af730 msgr2=0x7f458c15d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:27.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4590e2b640 1 -- 172.21.15.169:0/180143293 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1392743228 0 0) 0x7f458c0afd80 con 0x7f458c09b040 2024-09-15T23:53:27.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4591e2d640 1 --2- 172.21.15.169:0/180143293 >> v2:172.21.15.112:3300/0 conn(0x7f458c0af730 0x7f458c15d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4591e2d640 1 -- 172.21.15.169:0/180143293 >> v1:172.21.15.169:6789/0 conn(0x7f458c09b040 legacy=0x7f458c0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4591e2d640 1 -- 172.21.15.169:0/180143293 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c0b0340 con 0x7f458c09ac60 2024-09-15T23:53:27.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4591e2d640 1 --2- 172.21.15.169:0/180143293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f458c09ac60 0x7f458c09ba00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f458c0b7d70 tx=0x7f458801c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2085a12c481abf60 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:27.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4590e2b640 1 -- 172.21.15.169:0/180143293 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880b2070 con 0x7f458c09ac60 2024-09-15T23:53:27.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4590e2b640 1 -- 172.21.15.169:0/180143293 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45880ad680 con 0x7f458c09ac60 2024-09-15T23:53:27.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4590e2b640 1 -- 172.21.15.169:0/180143293 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880ada50 con 0x7f458c09ac60 2024-09-15T23:53:27.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4594091640 1 -- 172.21.15.169:0/180143293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f458c09ac60 msgr2=0x7f458c09ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4594091640 1 --2- 172.21.15.169:0/180143293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f458c09ac60 0x7f458c09ba00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f458c0b7d70 tx=0x7f458801c490 comp rx=0 tx=0).stop 2024-09-15T23:53:27.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4594091640 1 -- 172.21.15.169:0/180143293 shutdown_connections 2024-09-15T23:53:27.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4594091640 1 --2- 172.21.15.169:0/180143293 >> v2:172.21.15.112:3300/0 conn(0x7f458c0af730 0x7f458c15d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4594091640 1 --2- 172.21.15.169:0/180143293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f458c09ac60 0x7f458c09ba00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4594091640 1 -- 172.21.15.169:0/180143293 >> 172.21.15.169:0/180143293 conn(0x7f458c0b78d0 msgr2=0x7f458c0b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:27.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4594091640 1 -- 172.21.15.169:0/180143293 shutdown_connections 2024-09-15T23:53:27.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.976+0000 7f4594091640 1 -- 172.21.15.169:0/180143293 wait complete. 2024-09-15T23:53:27.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4594091640 1 Processor -- start 2024-09-15T23:53:27.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4594091640 1 -- start start 2024-09-15T23:53:27.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4594091640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f458c09ac60 0x7f458c149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4594091640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f458c09b040 0x7f458c164ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4594091640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0af730 0x7f458c14d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:27.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4594091640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f458c0b23c0 con 0x7f458c0af730 2024-09-15T23:53:27.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4594091640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f458c15d550 con 0x7f458c09ac60 2024-09-15T23:53:27.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4594091640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f458c0b2540 con 0x7f458c09b040 2024-09-15T23:53:27.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4591e2d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f458c09ac60 0x7f458c149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4591e2d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f458c09ac60 0x7f458c149710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:49376/0 (socket says 172.21.15.169:49376) 2024-09-15T23:53:27.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4591e2d640 1 -- 172.21.15.169:0/1902895527 learned_addr learned my addr 172.21.15.169:0/1902895527 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T23:53:27.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f459162c640 1 --2- 172.21.15.169:0/1902895527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f458c09b040 0x7f458c164ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f459262e640 1 --2- 172.21.15.169:0/1902895527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0af730 0x7f458c14d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:27.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4591e2d640 1 -- 172.21.15.169:0/1902895527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f458c09b040 msgr2=0x7f458c164ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4591e2d640 1 --2- 172.21.15.169:0/1902895527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f458c09b040 0x7f458c164ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4591e2d640 1 -- 172.21.15.169:0/1902895527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0af730 msgr2=0x7f458c14d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:27.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4591e2d640 1 --2- 172.21.15.169:0/1902895527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0af730 0x7f458c14d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:27.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4591e2d640 1 -- 172.21.15.169:0/1902895527 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c1526f0 con 0x7f458c09ac60 2024-09-15T23:53:27.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f459262e640 1 --2- 172.21.15.169:0/1902895527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0af730 0x7f458c14d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:53:27.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4591e2d640 1 --2- 172.21.15.169:0/1902895527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f458c09ac60 0x7f458c149710 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f45880190a0 tx=0x7f458801acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:27.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f45827fc640 1 -- 172.21.15.169:0/1902895527 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880bd070 con 0x7f458c09ac60 2024-09-15T23:53:27.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f45827fc640 1 -- 172.21.15.169:0/1902895527 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45880adc70 con 0x7f458c09ac60 2024-09-15T23:53:27.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f45827fc640 1 -- 172.21.15.169:0/1902895527 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880b2040 con 0x7f458c09ac60 2024-09-15T23:53:27.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4594091640 1 -- 172.21.15.169:0/1902895527 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458c1662e0 con 0x7f458c09ac60 2024-09-15T23:53:27.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4594091640 1 -- 172.21.15.169:0/1902895527 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f458c166860 con 0x7f458c09ac60 2024-09-15T23:53:27.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f45827fc640 1 -- 172.21.15.169:0/1902895527 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f45880c0070 con 0x7f458c09ac60 2024-09-15T23:53:27.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f45827fc640 1 -- 172.21.15.169:0/1902895527 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f45880b5850 con 0x7f458c09ac60 2024-09-15T23:53:27.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.980+0000 7f4594091640 1 -- 172.21.15.169:0/1902895527 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f458c14d770 con 0x7f458c09ac60 2024-09-15T23:53:27.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:27.984+0000 7f45827fc640 1 -- 172.21.15.169:0/1902895527 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4588016110 con 0x7f458c09ac60 2024-09-15T23:53:28.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.052+0000 7f4594091640 1 -- 172.21.15.169:0/1902895527 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f7bf128d-bf69-4f14-b258-4d9dc096e891", "id": 3} v 0) -- 0x7f458c0b3fa0 con 0x7f458c09ac60 2024-09-15T23:53:28.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.056+0000 7f45827fc640 1 -- 172.21.15.169:0/1902895527 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f7bf128d-bf69-4f14-b258-4d9dc096e891", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f45880ade20 con 0x7f458c09ac60 2024-09-15T23:53:28.060 INFO:teuthology.orchestra.run.smithi169.stdout:3 2024-09-15T23:53:28.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.056+0000 7f4594091640 1 -- 172.21.15.169:0/1902895527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f458c09ac60 msgr2=0x7f458c149710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.056+0000 7f4594091640 1 --2- 172.21.15.169:0/1902895527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f458c09ac60 0x7f458c149710 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f45880190a0 tx=0x7f458801acd0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.056+0000 7f4594091640 1 -- 172.21.15.169:0/1902895527 shutdown_connections 2024-09-15T23:53:28.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.056+0000 7f4594091640 1 --2- 172.21.15.169:0/1902895527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f458c0af730 0x7f458c14d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.056+0000 7f4594091640 1 --2- 172.21.15.169:0/1902895527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f458c09b040 0x7f458c164ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.056+0000 7f4594091640 1 --2- 172.21.15.169:0/1902895527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f458c09ac60 0x7f458c149710 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.056+0000 7f4594091640 1 -- 172.21.15.169:0/1902895527 >> 172.21.15.169:0/1902895527 conn(0x7f458c0b78d0 msgr2=0x7f458c0715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:28.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.056+0000 7f4594091640 1 -- 172.21.15.169:0/1902895527 shutdown_connections 2024-09-15T23:53:28.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.056+0000 7f4594091640 1 -- 172.21.15.169:0/1902895527 wait complete. 2024-09-15T23:53:28.077 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 265a62a2-174d-4639-a9a2-2da03049b6c6 4 2024-09-15T23:53:28.110 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:28.108+0000 7f995c2c9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:53:28.163 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:28.160+0000 7f995c2c9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:53:28.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.188+0000 7fb4d31e7640 1 Processor -- start 2024-09-15T23:53:28.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.188+0000 7fb4d31e7640 1 -- start start 2024-09-15T23:53:28.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4d31e7640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb4cc159e30 0x7fb4cc0afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4d31e7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb4cc0b5eb0 0x7fb4cc0b6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4d31e7640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4cc0b0410 con 0x7fb4cc15d190 2024-09-15T23:53:28.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4d31e7640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb4cc0b6860 con 0x7fb4cc159e30 2024-09-15T23:53:28.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4d31e7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb4cc06bd60 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4d1784640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb4cc0b5eb0 0x7fb4cc0b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4d1784640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb4cc0b5eb0 0x7fb4cc0b6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:49384/0 (socket says 172.21.15.169:49384) 2024-09-15T23:53:28.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4d1784640 1 -- 172.21.15.169:0/2523264920 learned_addr learned my addr 172.21.15.169:0/2523264920 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T23:53:28.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4d0f83640 1 --2- 172.21.15.169:0/2523264920 >> v2:172.21.15.112:3300/0 conn(0x7fb4cc159e30 0x7fb4cc0afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4d1784640 1 -- 172.21.15.169:0/2523264920 >> v2:172.21.15.112:3300/0 conn(0x7fb4cc159e30 msgr2=0x7fb4cc0afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:28.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4d1784640 1 --2- 172.21.15.169:0/2523264920 >> v2:172.21.15.112:3300/0 conn(0x7fb4cc159e30 0x7fb4cc0afdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4d1784640 1 -- 172.21.15.169:0/2523264920 >> v1:172.21.15.112:6789/0 conn(0x7fb4cc15d190 legacy=0x7fb4cc06cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:28.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4d1784640 1 -- 172.21.15.169:0/2523264920 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc06c040 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4d1784640 1 --2- 172.21.15.169:0/2523264920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4cc0b5eb0 0x7fb4cc0b6320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0755a0 tx=0x7fb4c401c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=951cc4c553045616 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:28.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4cb7fe640 1 -- 172.21.15.169:0/2523264920 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c40a5780 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4cb7fe640 1 -- 172.21.15.169:0/2523264920 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c40a5920 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.192+0000 7fb4cb7fe640 1 -- 172.21.15.169:0/2523264920 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c40a5cf0 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 -- 172.21.15.169:0/2523264920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4cc0b5eb0 msgr2=0x7fb4cc0b6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 --2- 172.21.15.169:0/2523264920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4cc0b5eb0 0x7fb4cc0b6320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0755a0 tx=0x7fb4c401c9b0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 -- 172.21.15.169:0/2523264920 shutdown_connections 2024-09-15T23:53:28.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 --2- 172.21.15.169:0/2523264920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4cc0b5eb0 0x7fb4cc0b6320 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 --2- 172.21.15.169:0/2523264920 >> v2:172.21.15.112:3300/0 conn(0x7fb4cc159e30 0x7fb4cc0afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 -- 172.21.15.169:0/2523264920 >> 172.21.15.169:0/2523264920 conn(0x7fb4cc073500 msgr2=0x7fb4cc06e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:28.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 -- 172.21.15.169:0/2523264920 shutdown_connections 2024-09-15T23:53:28.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 -- 172.21.15.169:0/2523264920 wait complete. 2024-09-15T23:53:28.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 Processor -- start 2024-09-15T23:53:28.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 -- start start 2024-09-15T23:53:28.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4cc0b5eb0 0x7fb4cc1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4cc159e30 0x7fb4cc14e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4cc15d190 0x7fb4cc144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc15e260 con 0x7fb4cc15d190 2024-09-15T23:53:28.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc15e0e0 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb4cc168e90 con 0x7fb4cc159e30 2024-09-15T23:53:28.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d0f83640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4cc0b5eb0 0x7fb4cc1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d0f83640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4cc0b5eb0 0x7fb4cc1558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:49388/0 (socket says 172.21.15.169:49388) 2024-09-15T23:53:28.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d0f83640 1 -- 172.21.15.169:0/2057434328 learned_addr learned my addr 172.21.15.169:0/2057434328 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4cbfff640 1 --2- 172.21.15.169:0/2057434328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4cc159e30 0x7fb4cc14e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d1784640 1 --2- 172.21.15.169:0/2057434328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4cc15d190 0x7fb4cc144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d0f83640 1 -- 172.21.15.169:0/2057434328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4cc159e30 msgr2=0x7fb4cc14e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d0f83640 1 --2- 172.21.15.169:0/2057434328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4cc159e30 0x7fb4cc14e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d0f83640 1 -- 172.21.15.169:0/2057434328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4cc15d190 msgr2=0x7fb4cc144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d0f83640 1 --2- 172.21.15.169:0/2057434328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4cc15d190 0x7fb4cc144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d0f83640 1 -- 172.21.15.169:0/2057434328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc155ef0 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4cbfff640 1 --2- 172.21.15.169:0/2057434328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4cc159e30 0x7fb4cc14e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d0f83640 1 --2- 172.21.15.169:0/2057434328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4cc0b5eb0 0x7fb4cc1558f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000c7f0 tx=0x7fb4c000ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4c97fa640 1 -- 172.21.15.169:0/2057434328 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0015070 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4c97fa640 1 -- 172.21.15.169:0/2057434328 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c0007820 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4d31e7640 1 -- 172.21.15.169:0/2057434328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4cc14ce10 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.196+0000 7fb4c97fa640 1 -- 172.21.15.169:0/2057434328 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0007c50 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.200+0000 7fb4d31e7640 1 -- 172.21.15.169:0/2057434328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4cc1450b0 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.200+0000 7fb4c97fa640 1 -- 172.21.15.169:0/2057434328 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb4c0018070 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.200+0000 7fb4c97fa640 1 -- 172.21.15.169:0/2057434328 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb4c0011b30 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.200+0000 7fb4d31e7640 1 -- 172.21.15.169:0/2057434328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4cc0b6320 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.200+0000 7fb4c97fa640 1 -- 172.21.15.169:0/2057434328 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb4c0011d80 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.215 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:28.212+0000 7f995c2c9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:53:28.245 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:28.240+0000 7f7cec28b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:53:28.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.268+0000 7fb4d31e7640 1 -- 172.21.15.169:0/2057434328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "265a62a2-174d-4639-a9a2-2da03049b6c6", "id": 4} v 0) -- 0x7fb4cc151d70 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.276+0000 7fb4c97fa640 1 -- 172.21.15.169:0/2057434328 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "265a62a2-174d-4639-a9a2-2da03049b6c6", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fb4c0011750 con 0x7fb4cc0b5eb0 2024-09-15T23:53:28.278 INFO:teuthology.orchestra.run.smithi169.stdout:4 2024-09-15T23:53:28.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.276+0000 7fb4d31e7640 1 -- 172.21.15.169:0/2057434328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4cc0b5eb0 msgr2=0x7fb4cc1558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.276+0000 7fb4d31e7640 1 --2- 172.21.15.169:0/2057434328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4cc0b5eb0 0x7fb4cc1558f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000c7f0 tx=0x7fb4c000ccb0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.276+0000 7fb4d31e7640 1 -- 172.21.15.169:0/2057434328 shutdown_connections 2024-09-15T23:53:28.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.276+0000 7fb4d31e7640 1 --2- 172.21.15.169:0/2057434328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4cc15d190 0x7fb4cc144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.276+0000 7fb4d31e7640 1 --2- 172.21.15.169:0/2057434328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4cc159e30 0x7fb4cc14e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.276+0000 7fb4d31e7640 1 --2- 172.21.15.169:0/2057434328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4cc0b5eb0 0x7fb4cc1558f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.276+0000 7fb4d31e7640 1 -- 172.21.15.169:0/2057434328 >> 172.21.15.169:0/2057434328 conn(0x7fb4cc073500 msgr2=0x7fb4cc1664f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:28.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.276+0000 7fb4d31e7640 1 -- 172.21.15.169:0/2057434328 shutdown_connections 2024-09-15T23:53:28.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.276+0000 7fb4d31e7640 1 -- 172.21.15.169:0/2057434328 wait complete. 2024-09-15T23:53:28.293 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:28.292+0000 7f995c2c9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:53:28.294 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 4d78bc68-38ca-4fd9-9e3f-c50c614a85c2 5 2024-09-15T23:53:28.302 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:28.300+0000 7f7cec28b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:53:28.344 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:28.340+0000 7f995c2c9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:53:28.357 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:28.352+0000 7f7cec28b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:53:28.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92bec0b640 1 Processor -- start 2024-09-15T23:53:28.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92bec0b640 1 -- start start 2024-09-15T23:53:28.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92bec0b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f92b8145d90 0x7f92b80b0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92bec0b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f92b806bcc0 0x7f92b806c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92bec0b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92b80d1d80 con 0x7f92b80d1050 2024-09-15T23:53:28.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92bec0b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f92b806c670 con 0x7f92b8145d90 2024-09-15T23:53:28.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92bec0b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f92b80afa20 con 0x7f92b806bcc0 2024-09-15T23:53:28.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92b7fff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f92b806bcc0 0x7f92b806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92b7fff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f92b806bcc0 0x7f92b806c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:49402/0 (socket says 172.21.15.169:49402) 2024-09-15T23:53:28.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92b7fff640 1 -- 172.21.15.169:0/2723037993 learned_addr learned my addr 172.21.15.169:0/2723037993 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T23:53:28.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92bc9a7640 1 --2- 172.21.15.169:0/2723037993 >> v2:172.21.15.112:3300/0 conn(0x7f92b8145d90 0x7f92b80b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92b7fff640 1 -- 172.21.15.169:0/2723037993 >> v2:172.21.15.112:3300/0 conn(0x7f92b8145d90 msgr2=0x7f92b80b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:28.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92b7fff640 1 --2- 172.21.15.169:0/2723037993 >> v2:172.21.15.112:3300/0 conn(0x7f92b8145d90 0x7f92b80b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92b7fff640 1 -- 172.21.15.169:0/2723037993 >> v1:172.21.15.112:6789/0 conn(0x7f92b80d1050 legacy=0x7f92b80d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:28.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.404+0000 7f92b7fff640 1 -- 172.21.15.169:0/2723037993 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b80afd00 con 0x7f92b806bcc0 2024-09-15T23:53:28.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.408+0000 7f92b7fff640 1 --2- 172.21.15.169:0/2723037993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b806bcc0 0x7f92b806c130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f92b80af1a0 tx=0x7f92ac01c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d818a43a132c94ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:28.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.408+0000 7f92b77fe640 1 -- 172.21.15.169:0/2723037993 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0b2070 con 0x7f92b806bcc0 2024-09-15T23:53:28.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.408+0000 7f92b77fe640 1 -- 172.21.15.169:0/2723037993 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ac0ad640 con 0x7f92b806bcc0 2024-09-15T23:53:28.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.408+0000 7f92b77fe640 1 -- 172.21.15.169:0/2723037993 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0ada10 con 0x7f92b806bcc0 2024-09-15T23:53:28.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.408+0000 7f92bec0b640 1 -- 172.21.15.169:0/2723037993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b806bcc0 msgr2=0x7f92b806c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.408+0000 7f92bec0b640 1 --2- 172.21.15.169:0/2723037993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b806bcc0 0x7f92b806c130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f92b80af1a0 tx=0x7f92ac01c4e0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.408+0000 7f92bec0b640 1 -- 172.21.15.169:0/2723037993 shutdown_connections 2024-09-15T23:53:28.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.408+0000 7f92bec0b640 1 --2- 172.21.15.169:0/2723037993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b806bcc0 0x7f92b806c130 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.408+0000 7f92bec0b640 1 --2- 172.21.15.169:0/2723037993 >> v2:172.21.15.112:3300/0 conn(0x7f92b8145d90 0x7f92b80b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.408+0000 7f92bec0b640 1 -- 172.21.15.169:0/2723037993 >> 172.21.15.169:0/2723037993 conn(0x7f92b809aa00 msgr2=0x7f92b80b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:28.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.408+0000 7f92bec0b640 1 -- 172.21.15.169:0/2723037993 shutdown_connections 2024-09-15T23:53:28.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.408+0000 7f92bec0b640 1 -- 172.21.15.169:0/2723037993 wait complete. 2024-09-15T23:53:28.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bec0b640 1 Processor -- start 2024-09-15T23:53:28.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bec0b640 1 -- start start 2024-09-15T23:53:28.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bec0b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b806bcc0 0x7f92b80cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bec0b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92b80d1050 0x7f92b8141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bec0b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b8145d90 0x7f92b8142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bec0b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f92b80b4a20 con 0x7f92b80d1050 2024-09-15T23:53:28.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bec0b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f92b80b48a0 con 0x7f92b8145d90 2024-09-15T23:53:28.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bec0b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f92b80b4ba0 con 0x7f92b806bcc0 2024-09-15T23:53:28.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bc9a7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b806bcc0 0x7f92b80cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bd1a8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b8145d90 0x7f92b8142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bc9a7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b806bcc0 0x7f92b80cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:50572/0 (socket says 172.21.15.169:50572) 2024-09-15T23:53:28.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bc9a7640 1 -- 172.21.15.169:0/1682050213 learned_addr learned my addr 172.21.15.169:0/1682050213 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T23:53:28.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92b7fff640 1 --2- 172.21.15.169:0/1682050213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92b80d1050 0x7f92b8141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bc9a7640 1 -- 172.21.15.169:0/1682050213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b8145d90 msgr2=0x7f92b8142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bc9a7640 1 --2- 172.21.15.169:0/1682050213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b8145d90 0x7f92b8142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bc9a7640 1 -- 172.21.15.169:0/1682050213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92b80d1050 msgr2=0x7f92b8141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bc9a7640 1 --2- 172.21.15.169:0/1682050213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92b80d1050 0x7f92b8141930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bc9a7640 1 -- 172.21.15.169:0/1682050213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b813eac0 con 0x7f92b806bcc0 2024-09-15T23:53:28.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bd1a8640 1 --2- 172.21.15.169:0/1682050213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b8145d90 0x7f92b8142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:53:28.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92b7fff640 1 --2- 172.21.15.169:0/1682050213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92b80d1050 0x7f92b8141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:53:28.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bc9a7640 1 --2- 172.21.15.169:0/1682050213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b806bcc0 0x7f92b80cfb20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f92a800d800 tx=0x7f92a800dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:28.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92b57fa640 1 -- 172.21.15.169:0/1682050213 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a800b6c0 con 0x7f92b806bcc0 2024-09-15T23:53:28.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92b57fa640 1 -- 172.21.15.169:0/1682050213 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a8019070 con 0x7f92b806bcc0 2024-09-15T23:53:28.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92b57fa640 1 -- 172.21.15.169:0/1682050213 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a800ba60 con 0x7f92b806bcc0 2024-09-15T23:53:28.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bec0b640 1 -- 172.21.15.169:0/1682050213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b813ee00 con 0x7f92b806bcc0 2024-09-15T23:53:28.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bec0b640 1 -- 172.21.15.169:0/1682050213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b8141260 con 0x7f92b806bcc0 2024-09-15T23:53:28.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92b57fa640 1 -- 172.21.15.169:0/1682050213 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f92a800bc00 con 0x7f92b806bcc0 2024-09-15T23:53:28.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92b57fa640 1 -- 172.21.15.169:0/1682050213 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f92a8014a50 con 0x7f92b806bcc0 2024-09-15T23:53:28.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.412+0000 7f92bec0b640 1 -- 172.21.15.169:0/1682050213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b806c130 con 0x7f92b806bcc0 2024-09-15T23:53:28.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.416+0000 7f92b57fa640 1 -- 172.21.15.169:0/1682050213 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f92b813ee00 con 0x7f92b806bcc0 2024-09-15T23:53:28.421 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:28.420+0000 7f995c2c9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:53:28.437 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:28.436+0000 7f7cec28b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:53:28.473 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:28.472+0000 7f995c2c9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:53:28.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.480+0000 7f92bec0b640 1 -- 172.21.15.169:0/1682050213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4d78bc68-38ca-4fd9-9e3f-c50c614a85c2", "id": 5} v 0) -- 0x7f92b80b04f0 con 0x7f92b806bcc0 2024-09-15T23:53:28.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.488+0000 7f92b57fa640 1 -- 172.21.15.169:0/1682050213 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4d78bc68-38ca-4fd9-9e3f-c50c614a85c2", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f92a80144d0 con 0x7f92b806bcc0 2024-09-15T23:53:28.490 INFO:teuthology.orchestra.run.smithi169.stdout:5 2024-09-15T23:53:28.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.488+0000 7f92bec0b640 1 -- 172.21.15.169:0/1682050213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b806bcc0 msgr2=0x7f92b80cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.488+0000 7f92bec0b640 1 --2- 172.21.15.169:0/1682050213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b806bcc0 0x7f92b80cfb20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f92a800d800 tx=0x7f92a800dcc0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.488+0000 7f92bec0b640 1 -- 172.21.15.169:0/1682050213 shutdown_connections 2024-09-15T23:53:28.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.488+0000 7f92bec0b640 1 --2- 172.21.15.169:0/1682050213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92b8145d90 0x7f92b8142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.488+0000 7f92bec0b640 1 --2- 172.21.15.169:0/1682050213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92b80d1050 0x7f92b8141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.488+0000 7f92bec0b640 1 --2- 172.21.15.169:0/1682050213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f92b806bcc0 0x7f92b80cfb20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.488+0000 7f92bec0b640 1 -- 172.21.15.169:0/1682050213 >> 172.21.15.169:0/1682050213 conn(0x7f92b809aa00 msgr2=0x7f92b8144cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:28.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.488+0000 7f92bec0b640 1 -- 172.21.15.169:0/1682050213 shutdown_connections 2024-09-15T23:53:28.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.488+0000 7f92bec0b640 1 -- 172.21.15.169:0/1682050213 wait complete. 2024-09-15T23:53:28.492 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:28.488+0000 7f7cec28b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:53:28.506 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new aab1f298-7384-4353-b144-2c8cf255f9d3 6 2024-09-15T23:53:28.571 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:28.568+0000 7f7cec28b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:53:28.623 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:28.619+0000 7f995c2c9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:53:28.626 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:28.624+0000 7f7cec28b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:53:28.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe180541640 1 Processor -- start 2024-09-15T23:53:28.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe180541640 1 -- start start 2024-09-15T23:53:28.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe180541640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe1780b3790 0x7fe17806d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe180541640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe17806d890 0x7fe17809aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe180541640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17806dd30 con 0x7fe17815f660 2024-09-15T23:53:28.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe180541640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe17806e5d0 con 0x7fe17806d890 2024-09-15T23:53:28.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe180541640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe1780b5ca0 con 0x7fe1780b3790 2024-09-15T23:53:28.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe17e2dd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe1780b3790 0x7fe17806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe17e2dd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe1780b3790 0x7fe17806d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:49430/0 (socket says 172.21.15.169:49430) 2024-09-15T23:53:28.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe17e2dd640 1 -- 172.21.15.169:0/3771084258 learned_addr learned my addr 172.21.15.169:0/3771084258 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T23:53:28.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe17dadc640 1 --2- 172.21.15.169:0/3771084258 >> v2:172.21.15.112:3300/0 conn(0x7fe17806d890 0x7fe17809aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe17e2dd640 1 -- 172.21.15.169:0/3771084258 >> v2:172.21.15.112:3300/0 conn(0x7fe17806d890 msgr2=0x7fe17809aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:28.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe17e2dd640 1 --2- 172.21.15.169:0/3771084258 >> v2:172.21.15.112:3300/0 conn(0x7fe17806d890 0x7fe17809aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe17e2dd640 1 -- 172.21.15.169:0/3771084258 >> v1:172.21.15.112:6789/0 conn(0x7fe17815f660 legacy=0x7fe178161f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:28.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.656+0000 7fe17e2dd640 1 -- 172.21.15.169:0/3771084258 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17806e010 con 0x7fe1780b3790 2024-09-15T23:53:28.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe17e2dd640 1 --2- 172.21.15.169:0/3771084258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1780b3790 0x7fe17806d350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe1780b7d70 tx=0x7fe17401c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd501a15b6839bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:28.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe17d2db640 1 -- 172.21.15.169:0/3771084258 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1740b1070 con 0x7fe1780b3790 2024-09-15T23:53:28.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe17d2db640 1 -- 172.21.15.169:0/3771084258 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1740ac620 con 0x7fe1780b3790 2024-09-15T23:53:28.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe17d2db640 1 -- 172.21.15.169:0/3771084258 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1740ac9f0 con 0x7fe1780b3790 2024-09-15T23:53:28.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 -- 172.21.15.169:0/3771084258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1780b3790 msgr2=0x7fe17806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 --2- 172.21.15.169:0/3771084258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1780b3790 0x7fe17806d350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe1780b7d70 tx=0x7fe17401c4b0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 -- 172.21.15.169:0/3771084258 shutdown_connections 2024-09-15T23:53:28.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 --2- 172.21.15.169:0/3771084258 >> v2:172.21.15.112:3300/0 conn(0x7fe17806d890 0x7fe17809aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 --2- 172.21.15.169:0/3771084258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1780b3790 0x7fe17806d350 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 -- 172.21.15.169:0/3771084258 >> 172.21.15.169:0/3771084258 conn(0x7fe1780b78d0 msgr2=0x7fe1780b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:28.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 -- 172.21.15.169:0/3771084258 shutdown_connections 2024-09-15T23:53:28.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 -- 172.21.15.169:0/3771084258 wait complete. 2024-09-15T23:53:28.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 Processor -- start 2024-09-15T23:53:28.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 -- start start 2024-09-15T23:53:28.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe17806d890 0x7fe17815cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1780b3790 0x7fe17815b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe17815f660 0x7fe178150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe1780b75b0 con 0x7fe17806d890 2024-09-15T23:53:28.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe1780b7430 con 0x7fe17815f660 2024-09-15T23:53:28.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe180541640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe17816b0f0 con 0x7fe1780b3790 2024-09-15T23:53:28.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe17dadc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1780b3790 0x7fe17815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe17dadc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1780b3790 0x7fe17815b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:50586/0 (socket says 172.21.15.169:50586) 2024-09-15T23:53:28.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe17dadc640 1 -- 172.21.15.169:0/3224383471 learned_addr learned my addr 172.21.15.169:0/3224383471 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T23:53:28.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe17eade640 1 --2- 172.21.15.169:0/3224383471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe17815f660 0x7fe178150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.660+0000 7fe17e2dd640 1 --2- 172.21.15.169:0/3224383471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe17806d890 0x7fe17815cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe17dadc640 1 -- 172.21.15.169:0/3224383471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe17815f660 msgr2=0x7fe178150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe17dadc640 1 --2- 172.21.15.169:0/3224383471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe17815f660 0x7fe178150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe17dadc640 1 -- 172.21.15.169:0/3224383471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe17806d890 msgr2=0x7fe17815cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe17dadc640 1 --2- 172.21.15.169:0/3224383471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe17806d890 0x7fe17815cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe17dadc640 1 -- 172.21.15.169:0/3224383471 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17815d470 con 0x7fe1780b3790 2024-09-15T23:53:28.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe17eade640 1 --2- 172.21.15.169:0/3224383471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe17815f660 0x7fe178150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:53:28.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe17dadc640 1 --2- 172.21.15.169:0/3224383471 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1780b3790 0x7fe17815b780 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c820 tx=0x7fe16800cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:28.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe16effd640 1 -- 172.21.15.169:0/3224383471 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168015070 con 0x7fe1780b3790 2024-09-15T23:53:28.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe16effd640 1 -- 172.21.15.169:0/3224383471 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe168007a30 con 0x7fe1780b3790 2024-09-15T23:53:28.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe180541640 1 -- 172.21.15.169:0/3224383471 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe17815d710 con 0x7fe1780b3790 2024-09-15T23:53:28.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe16effd640 1 -- 172.21.15.169:0/3224383471 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168007e20 con 0x7fe1780b3790 2024-09-15T23:53:28.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe180541640 1 -- 172.21.15.169:0/3224383471 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17815dcd0 con 0x7fe1780b3790 2024-09-15T23:53:28.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe16effd640 1 -- 172.21.15.169:0/3224383471 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe168018070 con 0x7fe1780b3790 2024-09-15T23:53:28.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe16effd640 1 -- 172.21.15.169:0/3224383471 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fe1680119e0 con 0x7fe1780b3790 2024-09-15T23:53:28.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe180541640 1 -- 172.21.15.169:0/3224383471 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe17809aa00 con 0x7fe1780b3790 2024-09-15T23:53:28.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.664+0000 7fe16effd640 1 -- 172.21.15.169:0/3224383471 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe168011be0 con 0x7fe1780b3790 2024-09-15T23:53:28.686 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:28.683+0000 7f995c2c9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:53:28.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.728+0000 7fe180541640 1 -- 172.21.15.169:0/3224383471 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aab1f298-7384-4353-b144-2c8cf255f9d3", "id": 6} v 0) -- 0x7fe17815f240 con 0x7fe1780b3790 2024-09-15T23:53:28.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.736+0000 7fe16effd640 1 -- 172.21.15.169:0/3224383471 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aab1f298-7384-4353-b144-2c8cf255f9d3", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fe168011dc0 con 0x7fe1780b3790 2024-09-15T23:53:28.739 INFO:teuthology.orchestra.run.smithi169.stdout:6 2024-09-15T23:53:28.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.736+0000 7fe180541640 1 -- 172.21.15.169:0/3224383471 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1780b3790 msgr2=0x7fe17815b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.736+0000 7fe180541640 1 --2- 172.21.15.169:0/3224383471 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1780b3790 0x7fe17815b780 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c820 tx=0x7fe16800cce0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.736+0000 7fe180541640 1 -- 172.21.15.169:0/3224383471 shutdown_connections 2024-09-15T23:53:28.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.736+0000 7fe180541640 1 --2- 172.21.15.169:0/3224383471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe17815f660 0x7fe178150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.736+0000 7fe180541640 1 --2- 172.21.15.169:0/3224383471 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1780b3790 0x7fe17815b780 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.736+0000 7fe180541640 1 --2- 172.21.15.169:0/3224383471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe17806d890 0x7fe17815cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.736+0000 7fe180541640 1 -- 172.21.15.169:0/3224383471 >> 172.21.15.169:0/3224383471 conn(0x7fe1780b78d0 msgr2=0x7fe178071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:28.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.736+0000 7fe180541640 1 -- 172.21.15.169:0/3224383471 shutdown_connections 2024-09-15T23:53:28.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.736+0000 7fe180541640 1 -- 172.21.15.169:0/3224383471 wait complete. 2024-09-15T23:53:28.756 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 08c893d2-250a-4ee6-89df-5b02cfb0dcce 7 2024-09-15T23:53:28.784 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:28.780+0000 7f7cec28b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:53:28.847 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:28.844+0000 7f7cec28b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:53:28.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.896+0000 7f3c8f689640 1 Processor -- start 2024-09-15T23:53:28.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.896+0000 7f3c8f689640 1 -- start start 2024-09-15T23:53:28.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8f689640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3c8809ac60 0x7f3c8809ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8f689640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3c8809b040 0x7f3c880af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8f689640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c880afd80 con 0x7f3c880b0e20 2024-09-15T23:53:28.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8f689640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3c880b0060 con 0x7f3c8809b040 2024-09-15T23:53:28.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8f689640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f3c880b0340 con 0x7f3c8809ac60 2024-09-15T23:53:28.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8d425640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3c8809ac60 0x7f3c8809ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8dc26640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f3c880b0e20 0x7f3c880b1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:54972/0 (socket says 172.21.15.169:54972) 2024-09-15T23:53:28.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8dc26640 1 -- 172.21.15.169:0/1206908570 learned_addr learned my addr 172.21.15.169:0/1206908570 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-09-15T23:53:28.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8d425640 1 -- 172.21.15.169:0/1206908570 >> v2:172.21.15.112:3300/0 conn(0x7f3c8809b040 msgr2=0x7f3c880af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:28.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8d425640 1 --2- 172.21.15.169:0/1206908570 >> v2:172.21.15.112:3300/0 conn(0x7f3c8809b040 0x7f3c880af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8d425640 1 -- 172.21.15.169:0/1206908570 >> v1:172.21.15.169:6789/0 conn(0x7f3c880b0e20 legacy=0x7f3c880b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8d425640 1 -- 172.21.15.169:0/1206908570 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c880b0620 con 0x7f3c8809ac60 2024-09-15T23:53:28.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c7ffff640 1 -- 172.21.15.169:0/1206908570 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 885124444 0 0) 0x7f3c880afd80 con 0x7f3c880b0e20 2024-09-15T23:53:28.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8d425640 1 --2- 172.21.15.169:0/1206908570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c8809ac60 0x7f3c8809ba00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3c880b7d70 tx=0x7f3c8401ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7139721f20029658 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:28.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c7ffff640 1 -- 172.21.15.169:0/1206908570 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c840b1070 con 0x7f3c8809ac60 2024-09-15T23:53:28.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c7ffff640 1 -- 172.21.15.169:0/1206908570 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c840a8050 con 0x7f3c8809ac60 2024-09-15T23:53:28.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c7ffff640 1 -- 172.21.15.169:0/1206908570 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c840ac860 con 0x7f3c8809ac60 2024-09-15T23:53:28.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8f689640 1 -- 172.21.15.169:0/1206908570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c8809ac60 msgr2=0x7f3c8809ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8f689640 1 --2- 172.21.15.169:0/1206908570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c8809ac60 0x7f3c8809ba00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3c880b7d70 tx=0x7f3c8401ce20 comp rx=0 tx=0).stop 2024-09-15T23:53:28.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8f689640 1 -- 172.21.15.169:0/1206908570 shutdown_connections 2024-09-15T23:53:28.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8f689640 1 --2- 172.21.15.169:0/1206908570 >> v2:172.21.15.112:3300/0 conn(0x7f3c8809b040 0x7f3c880af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8f689640 1 --2- 172.21.15.169:0/1206908570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c8809ac60 0x7f3c8809ba00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8f689640 1 -- 172.21.15.169:0/1206908570 >> 172.21.15.169:0/1206908570 conn(0x7f3c880b78d0 msgr2=0x7f3c880b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:28.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8f689640 1 -- 172.21.15.169:0/1206908570 shutdown_connections 2024-09-15T23:53:28.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.900+0000 7f3c8f689640 1 -- 172.21.15.169:0/1206908570 wait complete. 2024-09-15T23:53:28.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8f689640 1 Processor -- start 2024-09-15T23:53:28.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8f689640 1 -- start start 2024-09-15T23:53:28.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8f689640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c8809ac60 0x7f3c88149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8f689640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c8809b040 0x7f3c881455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8f689640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c880b0e20 0x7f3c881553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:28.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8f689640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8815d3e0 con 0x7f3c8809ac60 2024-09-15T23:53:28.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8f689640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8815d260 con 0x7f3c8809b040 2024-09-15T23:53:28.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8f689640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3c8815d560 con 0x7f3c880b0e20 2024-09-15T23:53:28.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8cc24640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c8809b040 0x7f3c881455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8cc24640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c8809b040 0x7f3c881455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:49460/0 (socket says 172.21.15.169:49460) 2024-09-15T23:53:28.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8cc24640 1 -- 172.21.15.169:0/2979708804 learned_addr learned my addr 172.21.15.169:0/2979708804 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-15T23:53:28.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8dc26640 1 --2- 172.21.15.169:0/2979708804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c880b0e20 0x7f3c881553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8d425640 1 --2- 172.21.15.169:0/2979708804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c8809ac60 0x7f3c88149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:28.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8cc24640 1 -- 172.21.15.169:0/2979708804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c880b0e20 msgr2=0x7f3c881553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8cc24640 1 --2- 172.21.15.169:0/2979708804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c880b0e20 0x7f3c881553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8cc24640 1 -- 172.21.15.169:0/2979708804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c8809ac60 msgr2=0x7f3c88149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8cc24640 1 --2- 172.21.15.169:0/2979708804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c8809ac60 0x7f3c88149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8cc24640 1 -- 172.21.15.169:0/2979708804 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8814a3d0 con 0x7f3c8809b040 2024-09-15T23:53:28.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8cc24640 1 --2- 172.21.15.169:0/2979708804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c8809b040 0x7f3c881455c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800b580 tx=0x7f3c7800ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:28.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c7dffb640 1 -- 172.21.15.169:0/2979708804 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c78014070 con 0x7f3c8809b040 2024-09-15T23:53:28.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c7dffb640 1 -- 172.21.15.169:0/2979708804 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c78010890 con 0x7f3c8809b040 2024-09-15T23:53:28.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c7dffb640 1 -- 172.21.15.169:0/2979708804 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c78010c80 con 0x7f3c8809b040 2024-09-15T23:53:28.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8f689640 1 -- 172.21.15.169:0/2979708804 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c8814a6b0 con 0x7f3c8809b040 2024-09-15T23:53:28.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8f689640 1 -- 172.21.15.169:0/2979708804 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c8814ac70 con 0x7f3c8809b040 2024-09-15T23:53:28.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c7dffb640 1 -- 172.21.15.169:0/2979708804 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3c78017070 con 0x7f3c8809b040 2024-09-15T23:53:28.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c7dffb640 1 -- 172.21.15.169:0/2979708804 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f3c7800fa70 con 0x7f3c8809b040 2024-09-15T23:53:28.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.904+0000 7f3c8f689640 1 -- 172.21.15.169:0/2979708804 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c8815f5e0 con 0x7f3c8809b040 2024-09-15T23:53:28.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.908+0000 7f3c7dffb640 1 -- 172.21.15.169:0/2979708804 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3c7800fd50 con 0x7f3c8809b040 2024-09-15T23:53:28.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.976+0000 7f3c8f689640 1 -- 172.21.15.169:0/2979708804 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "08c893d2-250a-4ee6-89df-5b02cfb0dcce", "id": 7} v 0) -- 0x7f3c8814a0e0 con 0x7f3c8809b040 2024-09-15T23:53:28.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.984+0000 7f3c7dffb640 1 -- 172.21.15.169:0/2979708804 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "08c893d2-250a-4ee6-89df-5b02cfb0dcce", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f3c7800f410 con 0x7f3c8809b040 2024-09-15T23:53:28.989 INFO:teuthology.orchestra.run.smithi169.stdout:7 2024-09-15T23:53:28.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.984+0000 7f3c8f689640 1 -- 172.21.15.169:0/2979708804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c8809b040 msgr2=0x7f3c881455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:28.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.984+0000 7f3c8f689640 1 --2- 172.21.15.169:0/2979708804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c8809b040 0x7f3c881455c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800b580 tx=0x7f3c7800ba40 comp rx=0 tx=0).stop 2024-09-15T23:53:28.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.988+0000 7f3c8f689640 1 -- 172.21.15.169:0/2979708804 shutdown_connections 2024-09-15T23:53:28.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.988+0000 7f3c8f689640 1 --2- 172.21.15.169:0/2979708804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c880b0e20 0x7f3c881553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.988+0000 7f3c8f689640 1 --2- 172.21.15.169:0/2979708804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c8809b040 0x7f3c881455c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.988+0000 7f3c8f689640 1 --2- 172.21.15.169:0/2979708804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c8809ac60 0x7f3c88149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:28.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.988+0000 7f3c8f689640 1 -- 172.21.15.169:0/2979708804 >> 172.21.15.169:0/2979708804 conn(0x7f3c880b78d0 msgr2=0x7f3c8806d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:28.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.988+0000 7f3c8f689640 1 -- 172.21.15.169:0/2979708804 shutdown_connections 2024-09-15T23:53:28.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:53:28.988+0000 7f3c8f689640 1 -- 172.21.15.169:0/2979708804 wait complete. 2024-09-15T23:53:29.004 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-15T23:53:29.004 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-15T23:53:29.007 INFO:tasks.ceph.osd.0:Started 2024-09-15T23:53:29.007 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-15T23:53:29.007 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-15T23:53:29.009 INFO:tasks.ceph.osd.1:Started 2024-09-15T23:53:29.009 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-15T23:53:29.009 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-15T23:53:29.011 INFO:tasks.ceph.osd.2:Started 2024-09-15T23:53:29.011 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-15T23:53:29.011 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-15T23:53:29.013 INFO:tasks.ceph.osd.3:Started 2024-09-15T23:53:29.013 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-15T23:53:29.013 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-15T23:53:29.015 INFO:tasks.ceph.osd.4:Started 2024-09-15T23:53:29.015 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-15T23:53:29.015 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-15T23:53:29.017 INFO:tasks.ceph.osd.5:Started 2024-09-15T23:53:29.017 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-15T23:53:29.018 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-15T23:53:29.019 INFO:tasks.ceph.osd.6:Started 2024-09-15T23:53:29.019 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-15T23:53:29.020 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-15T23:53:29.021 INFO:tasks.ceph.osd.7:Started 2024-09-15T23:53:29.022 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:53:29.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff362161640 1 Processor -- start 2024-09-15T23:53:29.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff362161640 1 -- start start 2024-09-15T23:53:29.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff362161640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff35c09ac60 0x7ff35c09ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:29.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff362161640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff35c0af730 0x7ff35c15d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:29.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff362161640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff35c0afd80 con 0x7ff35c09b040 2024-09-15T23:53:29.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff362161640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff35c0afb60 con 0x7ff35c09ac60 2024-09-15T23:53:29.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff362161640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff35c0b0060 con 0x7ff35c0af730 2024-09-15T23:53:29.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff35b7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff35c09ac60 0x7ff35c09ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:29.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff35affd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff35c09b040 0x7ff35c0b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55694/0 (socket says 172.21.15.112:55694) 2024-09-15T23:53:29.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff35b7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff35c09ac60 0x7ff35c09ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60994/0 (socket says 172.21.15.112:60994) 2024-09-15T23:53:29.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff35affd640 1 -- 172.21.15.112:0/3766181441 learned_addr learned my addr 172.21.15.112:0/3766181441 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:29.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff35bfff640 1 --2- 172.21.15.112:0/3766181441 >> v2:172.21.15.169:3300/0 conn(0x7ff35c0af730 0x7ff35c15d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:29.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff35b7fe640 1 -- 172.21.15.112:0/3766181441 >> v2:172.21.15.169:3300/0 conn(0x7ff35c0af730 msgr2=0x7ff35c15d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:29.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff35b7fe640 1 --2- 172.21.15.112:0/3766181441 >> v2:172.21.15.169:3300/0 conn(0x7ff35c0af730 0x7ff35c15d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:29.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff35b7fe640 1 -- 172.21.15.112:0/3766181441 >> v1:172.21.15.112:6789/0 conn(0x7ff35c09b040 legacy=0x7ff35c0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:29.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.143+0000 7ff35b7fe640 1 -- 172.21.15.112:0/3766181441 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35c0b0340 con 0x7ff35c09ac60 2024-09-15T23:53:29.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.147+0000 7ff35b7fe640 1 --2- 172.21.15.112:0/3766181441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35c09ac60 0x7ff35c09ba00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff35c09b500 tx=0x7ff35401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54441e763748ceca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:29.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.147+0000 7ff35a7fc640 1 -- 172.21.15.112:0/3766181441 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3540b0070 con 0x7ff35c09ac60 2024-09-15T23:53:29.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.147+0000 7ff35a7fc640 1 -- 172.21.15.112:0/3766181441 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3540ab600 con 0x7ff35c09ac60 2024-09-15T23:53:29.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.147+0000 7ff35a7fc640 1 -- 172.21.15.112:0/3766181441 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3540ab9d0 con 0x7ff35c09ac60 2024-09-15T23:53:29.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.147+0000 7ff362161640 1 -- 172.21.15.112:0/3766181441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35c09ac60 msgr2=0x7ff35c09ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:29.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.147+0000 7ff362161640 1 --2- 172.21.15.112:0/3766181441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35c09ac60 0x7ff35c09ba00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff35c09b500 tx=0x7ff35401c3f0 comp rx=0 tx=0).stop 2024-09-15T23:53:29.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.147+0000 7ff362161640 1 -- 172.21.15.112:0/3766181441 shutdown_connections 2024-09-15T23:53:29.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.147+0000 7ff362161640 1 --2- 172.21.15.112:0/3766181441 >> v2:172.21.15.169:3300/0 conn(0x7ff35c0af730 0x7ff35c15d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:29.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.147+0000 7ff362161640 1 --2- 172.21.15.112:0/3766181441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35c09ac60 0x7ff35c09ba00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:29.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.147+0000 7ff362161640 1 -- 172.21.15.112:0/3766181441 >> 172.21.15.112:0/3766181441 conn(0x7ff35c0b78d0 msgr2=0x7ff35c0b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:29.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.147+0000 7ff362161640 1 -- 172.21.15.112:0/3766181441 shutdown_connections 2024-09-15T23:53:29.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.147+0000 7ff362161640 1 -- 172.21.15.112:0/3766181441 wait complete. 2024-09-15T23:53:29.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.147+0000 7ff362161640 1 Processor -- start 2024-09-15T23:53:29.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.147+0000 7ff362161640 1 -- start start 2024-09-15T23:53:29.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff362161640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff35c09ac60 0x7ff35c13ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:29.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff362161640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35c09b040 0x7ff35c153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:29.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff362161640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff35c0af730 0x7ff35c1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:29.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff362161640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c0b23c0 con 0x7ff35c09b040 2024-09-15T23:53:29.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff362161640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c15d550 con 0x7ff35c09ac60 2024-09-15T23:53:29.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff362161640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff35c0b2540 con 0x7ff35c0af730 2024-09-15T23:53:29.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff35affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35c09b040 0x7ff35c153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:29.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff35affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35c09b040 0x7ff35c153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60998/0 (socket says 172.21.15.112:60998) 2024-09-15T23:53:29.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff35affd640 1 -- 172.21.15.112:0/116206738 learned_addr learned my addr 172.21.15.112:0/116206738 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:29.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff35bfff640 1 --2- 172.21.15.112:0/116206738 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff35c0af730 0x7ff35c1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:29.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff35b7fe640 1 --2- 172.21.15.112:0/116206738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff35c09ac60 0x7ff35c13ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:29.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff35affd640 1 -- 172.21.15.112:0/116206738 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff35c0af730 msgr2=0x7ff35c1537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:29.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff35affd640 1 --2- 172.21.15.112:0/116206738 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff35c0af730 0x7ff35c1537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:29.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff35affd640 1 -- 172.21.15.112:0/116206738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff35c09ac60 msgr2=0x7ff35c13ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:29.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff35affd640 1 --2- 172.21.15.112:0/116206738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff35c09ac60 0x7ff35c13ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:29.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff35affd640 1 -- 172.21.15.112:0/116206738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35c14deb0 con 0x7ff35c09b040 2024-09-15T23:53:29.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff35affd640 1 --2- 172.21.15.112:0/116206738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35c09b040 0x7ff35c153290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff34400c420 tx=0x7ff34400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:29.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff353fff640 1 -- 172.21.15.112:0/116206738 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff344017070 con 0x7ff35c09b040 2024-09-15T23:53:29.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff353fff640 1 -- 172.21.15.112:0/116206738 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff344005cf0 con 0x7ff35c09b040 2024-09-15T23:53:29.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff362161640 1 -- 172.21.15.112:0/116206738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff35c14e190 con 0x7ff35c09b040 2024-09-15T23:53:29.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff353fff640 1 -- 172.21.15.112:0/116206738 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3440072f0 con 0x7ff35c09b040 2024-09-15T23:53:29.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff362161640 1 -- 172.21.15.112:0/116206738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff35c13efc0 con 0x7ff35c09b040 2024-09-15T23:53:29.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff353fff640 1 -- 172.21.15.112:0/116206738 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff34401a070 con 0x7ff35c09b040 2024-09-15T23:53:29.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff353fff640 1 -- 172.21.15.112:0/116206738 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff344012ad0 con 0x7ff35c09b040 2024-09-15T23:53:29.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.151+0000 7ff362161640 1 -- 172.21.15.112:0/116206738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff35c0b4210 con 0x7ff35c09b040 2024-09-15T23:53:29.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.155+0000 7ff353fff640 1 -- 172.21.15.112:0/116206738 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff344021020 con 0x7ff35c09b040 2024-09-15T23:53:29.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.219+0000 7ff362161640 1 -- 172.21.15.112:0/116206738 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff35c0b3f30 con 0x7ff35c09b040 2024-09-15T23:53:29.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.219+0000 7ff353fff640 1 -- 172.21.15.112:0/116206738 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff3440075a0 con 0x7ff35c09b040 2024-09-15T23:53:29.224 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:53:29.224 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":10,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:28.983018+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:53:29.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.219+0000 7ff362161640 1 -- 172.21.15.112:0/116206738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35c09b040 msgr2=0x7ff35c153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:29.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.219+0000 7ff362161640 1 --2- 172.21.15.112:0/116206738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35c09b040 0x7ff35c153290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff34400c420 tx=0x7ff34400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:53:29.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.219+0000 7ff362161640 1 -- 172.21.15.112:0/116206738 shutdown_connections 2024-09-15T23:53:29.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.219+0000 7ff362161640 1 --2- 172.21.15.112:0/116206738 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff35c0af730 0x7ff35c1537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:29.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.219+0000 7ff362161640 1 --2- 172.21.15.112:0/116206738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff35c09b040 0x7ff35c153290 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:29.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.219+0000 7ff362161640 1 --2- 172.21.15.112:0/116206738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff35c09ac60 0x7ff35c13ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:29.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.219+0000 7ff362161640 1 -- 172.21.15.112:0/116206738 >> 172.21.15.112:0/116206738 conn(0x7ff35c0b78d0 msgr2=0x7ff35c15bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:29.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.223+0000 7ff362161640 1 -- 172.21.15.112:0/116206738 shutdown_connections 2024-09-15T23:53:29.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:29.223+0000 7ff362161640 1 -- 172.21.15.112:0/116206738 wait complete. 2024-09-15T23:53:29.243 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-15T23:53:29.243 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-15T23:53:29.279 INFO:tasks.ceph.mgr.y.smithi112.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-15T23:53:29.279 INFO:tasks.ceph.mgr.y.smithi112.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-15T23:53:29.279 INFO:tasks.ceph.mgr.y.smithi112.stderr: from numpy import show_config as show_numpy_config 2024-09-15T23:53:29.334 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:29.331+0000 7f995c2c9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:53:29.505 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:29.503+0000 7f995c2c9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:53:29.534 INFO:tasks.ceph.mgr.x.smithi169.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-15T23:53:29.534 INFO:tasks.ceph.mgr.x.smithi169.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-15T23:53:29.534 INFO:tasks.ceph.mgr.x.smithi169.stderr: from numpy import show_config as show_numpy_config 2024-09-15T23:53:29.590 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:29.588+0000 7f7cec28b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:53:29.672 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:29.667+0000 7f995c2c9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:53:29.741 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:29.739+0000 7f995c2c9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:53:29.773 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:29.768+0000 7f7cec28b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:53:29.890 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:29.887+0000 7f995c2c9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:53:29.941 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:29.936+0000 7f7cec28b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:53:30.010 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:30.008+0000 7f7cec28b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:53:30.049 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T23:53:30.158 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:30.156+0000 7f7cec28b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:53:30.163 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-09-15T23:53:30.160+0000 7ff1191777c0 -1 Falling back to public interface 2024-09-15T23:53:30.163 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e121d6640 1 Processor -- start 2024-09-15T23:53:30.163 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e121d6640 1 -- start start 2024-09-15T23:53:30.164 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e121d6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e0c15e900 0x7f9e0c15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:30.164 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e121d6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9e0c15f220 0x7f9e0c06bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:30.165 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e121d6640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0c06ca80 con 0x7f9e0c06c250 2024-09-15T23:53:30.165 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e121d6640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9e0c06cd60 con 0x7f9e0c15f220 2024-09-15T23:53:30.165 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e121d6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0c06d040 con 0x7f9e0c15e900 2024-09-15T23:53:30.165 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e02ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9e0c15f220 0x7f9e0c06bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:30.165 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e0bfff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9e0c06c250 0x7f9e0c0b4340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55704/0 (socket says 172.21.15.112:55704) 2024-09-15T23:53:30.165 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e0bfff640 1 -- 172.21.15.112:0/105527945 learned_addr learned my addr 172.21.15.112:0/105527945 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:30.165 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e0b7fe640 1 --2- 172.21.15.112:0/105527945 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e0c15e900 0x7f9e0c15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:30.165 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e02ffd640 1 -- 172.21.15.112:0/105527945 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e0c15e900 msgr2=0x7f9e0c15ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:30.165 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e02ffd640 1 --2- 172.21.15.112:0/105527945 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e0c15e900 0x7f9e0c15ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:30.165 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e02ffd640 1 -- 172.21.15.112:0/105527945 >> v1:172.21.15.112:6789/0 conn(0x7f9e0c06c250 legacy=0x7f9e0c0b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:30.165 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.159+0000 7f9e02ffd640 1 -- 172.21.15.112:0/105527945 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0c06d320 con 0x7f9e0c15f220 2024-09-15T23:53:30.166 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.163+0000 7f9e02ffd640 1 --2- 172.21.15.112:0/105527945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e0c15f220 0x7f9e0c06bd10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9df40097c0 tx=0x7f9df401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62aea4c764cf23fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:30.167 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.163+0000 7f9e0affd640 1 -- 172.21.15.112:0/105527945 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df40ab640 con 0x7f9e0c15f220 2024-09-15T23:53:30.167 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.163+0000 7f9e0affd640 1 -- 172.21.15.112:0/105527945 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df40b0070 con 0x7f9e0c15f220 2024-09-15T23:53:30.167 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.163+0000 7f9e0affd640 1 -- 172.21.15.112:0/105527945 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df40aba00 con 0x7f9e0c15f220 2024-09-15T23:53:30.168 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.163+0000 7f9e121d6640 1 -- 172.21.15.112:0/105527945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e0c15f220 msgr2=0x7f9e0c06bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:30.168 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.163+0000 7f9e121d6640 1 --2- 172.21.15.112:0/105527945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e0c15f220 0x7f9e0c06bd10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9df40097c0 tx=0x7f9df401c4a0 comp rx=0 tx=0).stop 2024-09-15T23:53:30.168 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.163+0000 7f9e121d6640 1 -- 172.21.15.112:0/105527945 shutdown_connections 2024-09-15T23:53:30.168 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.163+0000 7f9e121d6640 1 --2- 172.21.15.112:0/105527945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e0c15f220 0x7f9e0c06bd10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:30.168 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.163+0000 7f9e121d6640 1 --2- 172.21.15.112:0/105527945 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e0c15e900 0x7f9e0c15ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:30.168 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.163+0000 7f9e121d6640 1 -- 172.21.15.112:0/105527945 >> 172.21.15.112:0/105527945 conn(0x7f9e0c0d0c60 msgr2=0x7f9e0c0d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:30.168 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.163+0000 7f9e121d6640 1 -- 172.21.15.112:0/105527945 shutdown_connections 2024-09-15T23:53:30.168 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.163+0000 7f9e121d6640 1 -- 172.21.15.112:0/105527945 wait complete. 2024-09-15T23:53:30.169 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e121d6640 1 Processor -- start 2024-09-15T23:53:30.169 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e121d6640 1 -- start start 2024-09-15T23:53:30.171 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e121d6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e0c06c250 0x7f9e0c14e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:30.171 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e121d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e0c15e900 0x7f9e0c15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:30.171 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e121d6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e0c15f220 0x7f9e0c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:30.171 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e121d6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c0b5630 con 0x7f9e0c06c250 2024-09-15T23:53:30.172 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e121d6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c0b54b0 con 0x7f9e0c15e900 2024-09-15T23:53:30.172 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e121d6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0c16aed0 con 0x7f9e0c15f220 2024-09-15T23:53:30.172 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e0b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e0c06c250 0x7f9e0c14e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:30.172 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e0b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e0c06c250 0x7f9e0c14e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32772/0 (socket says 172.21.15.112:32772) 2024-09-15T23:53:30.172 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e0b7fe640 1 -- 172.21.15.112:0/748769174 learned_addr learned my addr 172.21.15.112:0/748769174 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:30.172 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e0bfff640 1 --2- 172.21.15.112:0/748769174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e0c15f220 0x7f9e0c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:30.172 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e02ffd640 1 --2- 172.21.15.112:0/748769174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e0c15e900 0x7f9e0c15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:30.172 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e0b7fe640 1 -- 172.21.15.112:0/748769174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e0c15f220 msgr2=0x7f9e0c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:30.172 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e0b7fe640 1 --2- 172.21.15.112:0/748769174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e0c15f220 0x7f9e0c0ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:30.172 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e0b7fe640 1 -- 172.21.15.112:0/748769174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e0c15e900 msgr2=0x7f9e0c15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:30.172 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e0b7fe640 1 --2- 172.21.15.112:0/748769174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e0c15e900 0x7f9e0c15bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:30.172 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e0b7fe640 1 -- 172.21.15.112:0/748769174 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0c159250 con 0x7f9e0c06c250 2024-09-15T23:53:30.173 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e0bfff640 1 --2- 172.21.15.112:0/748769174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e0c15f220 0x7f9e0c0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:53:30.173 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e0b7fe640 1 --2- 172.21.15.112:0/748769174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e0c06c250 0x7f9e0c14e330 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00d5f0 tx=0x7f9dfc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:30.173 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e08ff9640 1 -- 172.21.15.112:0/748769174 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc0125f0 con 0x7f9e0c06c250 2024-09-15T23:53:30.173 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e08ff9640 1 -- 172.21.15.112:0/748769174 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dfc019070 con 0x7f9e0c06c250 2024-09-15T23:53:30.173 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e121d6640 1 -- 172.21.15.112:0/748769174 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e0c159530 con 0x7f9e0c06c250 2024-09-15T23:53:30.173 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e08ff9640 1 -- 172.21.15.112:0/748769174 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc0129b0 con 0x7f9e0c06c250 2024-09-15T23:53:30.173 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e121d6640 1 -- 172.21.15.112:0/748769174 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e0c159af0 con 0x7f9e0c06c250 2024-09-15T23:53:30.173 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e08ff9640 1 -- 172.21.15.112:0/748769174 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9dfc012b50 con 0x7f9e0c06c250 2024-09-15T23:53:30.173 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e08ff9640 1 -- 172.21.15.112:0/748769174 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f9dfc014be0 con 0x7f9e0c06c250 2024-09-15T23:53:30.173 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.167+0000 7f9e121d6640 1 -- 172.21.15.112:0/748769174 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e0c15ece0 con 0x7f9e0c06c250 2024-09-15T23:53:30.174 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.171+0000 7f9e08ff9640 1 -- 172.21.15.112:0/748769174 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9dfc0144d0 con 0x7f9e0c06c250 2024-09-15T23:53:30.210 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-09-15T23:53:30.208+0000 7fe99d4eb7c0 -1 Falling back to public interface 2024-09-15T23:53:30.231 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.227+0000 7f9e121d6640 1 -- 172.21.15.112:0/748769174 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e0c0b2070 con 0x7f9e0c06c250 2024-09-15T23:53:30.232 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.227+0000 7f9e08ff9640 1 -- 172.21.15.112:0/748769174 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9dfc0146b0 con 0x7f9e0c06c250 2024-09-15T23:53:30.232 INFO:teuthology.misc.health.smithi112.stdout: 2024-09-15T23:53:30.232 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":10,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:28.983018+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:53:30.233 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.231+0000 7f9e121d6640 1 -- 172.21.15.112:0/748769174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e0c06c250 msgr2=0x7f9e0c14e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:30.233 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.231+0000 7f9e121d6640 1 --2- 172.21.15.112:0/748769174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e0c06c250 0x7f9e0c14e330 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00d5f0 tx=0x7f9dfc00dab0 comp rx=0 tx=0).stop 2024-09-15T23:53:30.233 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.231+0000 7f9e121d6640 1 -- 172.21.15.112:0/748769174 shutdown_connections 2024-09-15T23:53:30.233 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.231+0000 7f9e121d6640 1 --2- 172.21.15.112:0/748769174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e0c15f220 0x7f9e0c0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:30.233 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.231+0000 7f9e121d6640 1 --2- 172.21.15.112:0/748769174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e0c15e900 0x7f9e0c15bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:30.233 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.231+0000 7f9e121d6640 1 --2- 172.21.15.112:0/748769174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e0c06c250 0x7f9e0c14e330 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:30.233 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.231+0000 7f9e121d6640 1 -- 172.21.15.112:0/748769174 >> 172.21.15.112:0/748769174 conn(0x7f9e0c0d0c60 msgr2=0x7f9e0c0ae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:30.234 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.231+0000 7f9e121d6640 1 -- 172.21.15.112:0/748769174 shutdown_connections 2024-09-15T23:53:30.234 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:30.231+0000 7f9e121d6640 1 -- 172.21.15.112:0/748769174 wait complete. 2024-09-15T23:53:30.234 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-15T23:53:30.231+0000 7f2f04bb57c0 -1 Falling back to public interface 2024-09-15T23:53:30.247 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-15T23:53:30.395 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-09-15T23:53:30.392+0000 7fd4377827c0 -1 Falling back to public interface 2024-09-15T23:53:30.410 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-15T23:53:30.407+0000 7f8702d6f7c0 -1 Falling back to public interface 2024-09-15T23:53:30.425 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-15T23:53:30.423+0000 7f458a5217c0 -1 Falling back to public interface 2024-09-15T23:53:30.430 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-09-15T23:53:30.428+0000 7f932c5727c0 -1 Falling back to public interface 2024-09-15T23:53:30.509 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:30.507+0000 7f995c2c9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:53:30.585 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:30.583+0000 7f995c2c9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:53:30.698 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-15T23:53:30.695+0000 7f42bb4c97c0 -1 Falling back to public interface 2024-09-15T23:53:30.768 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:30.764+0000 7f7cec28b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:53:30.768 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:30.763+0000 7f995c2c9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:53:30.841 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:30.839+0000 7f995c2c9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:53:30.843 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:30.840+0000 7f7cec28b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:53:31.025 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:31.020+0000 7f7cec28b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:53:31.099 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:31.096+0000 7f7cec28b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:53:31.133 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:31.131+0000 7f995c2c9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:53:31.195 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:31.191+0000 7f995c2c9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:53:31.397 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:31.392+0000 7f7cec28b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:53:31.459 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-09-15T23:53:31.456+0000 7f7cec28b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:53:32.236 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:32.231+0000 7f9902e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-15T23:53:32.237 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-15T23:53:32.235+0000 7f9902e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-15T23:53:34.123 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-09-15T23:53:34.120+0000 7ff1191777c0 -1 osd.5 0 log_to_monitors true 2024-09-15T23:53:34.249 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-09-15T23:53:34.244+0000 7fe99d4eb7c0 -1 osd.7 0 log_to_monitors true 2024-09-15T23:53:34.307 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-15T23:53:34.303+0000 7f2f04bb57c0 -1 osd.1 0 log_to_monitors true 2024-09-15T23:53:34.382 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-09-15T23:53:34.380+0000 7fd4377827c0 -1 osd.4 0 log_to_monitors true 2024-09-15T23:53:34.528 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-15T23:53:34.523+0000 7f8702d6f7c0 -1 osd.0 0 log_to_monitors true 2024-09-15T23:53:34.664 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-09-15T23:53:34.660+0000 7f932c5727c0 -1 osd.6 0 log_to_monitors true 2024-09-15T23:53:34.873 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-15T23:53:34.871+0000 7f458a5217c0 -1 osd.2 0 log_to_monitors true 2024-09-15T23:53:35.242 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-15T23:53:35.239+0000 7f42bb4c97c0 -1 osd.3 0 log_to_monitors true 2024-09-15T23:53:36.180 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-09-15T23:53:36.175+0000 7ff115120640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T23:53:36.210 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-09-15T23:53:36.207+0000 7ff10cf55640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:53:37.054 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T23:53:37.186 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86b1bd4640 1 Processor -- start 2024-09-15T23:53:37.186 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86b1bd4640 1 -- start start 2024-09-15T23:53:37.187 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86b1bd4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86ac15b210 0x7f86ac0d1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:37.187 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86b1bd4640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86ac0b41a0 con 0x7f86ac0cf390 2024-09-15T23:53:37.187 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86b1bd4640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86ac0b4480 con 0x7f86ac0cd6a0 2024-09-15T23:53:37.187 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86b1bd4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f86ac0b4db0 con 0x7f86ac15b210 2024-09-15T23:53:37.187 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86abfff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f86ac0cf390 0x7f86ac0b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55706/0 (socket says 172.21.15.112:55706) 2024-09-15T23:53:37.188 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86abfff640 1 -- 172.21.15.112:0/1132125604 learned_addr learned my addr 172.21.15.112:0/1132125604 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:37.189 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86ab7fe640 1 --2- 172.21.15.112:0/1132125604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86ac15b210 0x7f86ac0d1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:37.190 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1004739176 0 0) 0x7f86ac0b41a0 con 0x7f86ac0cf390 2024-09-15T23:53:37.190 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8698003530 con 0x7f86ac0cf390 2024-09-15T23:53:37.190 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3009648105 0 0) 0x7f86ac0b4480 con 0x7f86ac0cd6a0 2024-09-15T23:53:37.190 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86ac0b41a0 con 0x7f86ac0cd6a0 2024-09-15T23:53:37.190 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3930900934 0 0) 0x7f8698003530 con 0x7f86ac0cf390 2024-09-15T23:53:37.190 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86ac15b210 msgr2=0x7f86ac0d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:37.190 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 --2- 172.21.15.112:0/1132125604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86ac15b210 0x7f86ac0d1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:37.190 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 >> v1:172.21.15.169:6789/0 conn(0x7f86ac0cd6a0 legacy=0x7f86ac0cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:37.190 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ac0b4760 con 0x7f86ac0cf390 2024-09-15T23:53:37.190 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f869c001680 con 0x7f86ac0cf390 2024-09-15T23:53:37.190 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 >> v1:172.21.15.112:6789/0 conn(0x7f86ac0cf390 legacy=0x7f86ac0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:37.190 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 --2- 172.21.15.112:0/1132125604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8698003b80 0x7f8698003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:37.190 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 --2- 172.21.15.112:0/1132125604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86ac15b210 0x7f8698004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:37.191 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 --2- 172.21.15.112:0/1132125604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8698004d50 0x7f86980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:37.191 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f86ac0b4db0 con 0x7f8698003b80 2024-09-15T23:53:37.191 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f869800ba80 con 0x7f8698004d50 2024-09-15T23:53:37.191 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f869800bc30 con 0x7f86ac15b210 2024-09-15T23:53:37.191 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86ab7fe640 1 --2- 172.21.15.112:0/1132125604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8698003b80 0x7f8698003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:37.191 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86ab7fe640 1 -- 172.21.15.112:0/1132125604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86ac15b210 msgr2=0x7f8698004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:37.191 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86ab7fe640 1 --2- 172.21.15.112:0/1132125604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86ac15b210 0x7f8698004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:37.191 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86abfff640 1 --2- 172.21.15.112:0/1132125604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8698004d50 0x7f86980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:37.191 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86ab7fe640 1 -- 172.21.15.112:0/1132125604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8698004d50 msgr2=0x7f86980051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:37.191 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86ab7fe640 1 --2- 172.21.15.112:0/1132125604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8698004d50 0x7f86980051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:37.191 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.183+0000 7f86ab7fe640 1 -- 172.21.15.112:0/1132125604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ac0b4760 con 0x7f8698003b80 2024-09-15T23:53:37.192 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.187+0000 7f86ab7fe640 1 --2- 172.21.15.112:0/1132125604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8698003b80 0x7f8698003f80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009fa0 tx=0x7f86a401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b458e1741d124db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:37.192 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.187+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a40b2070 con 0x7f8698003b80 2024-09-15T23:53:37.192 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.187+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a40a5b80 con 0x7f8698003b80 2024-09-15T23:53:37.193 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.187+0000 7f86aa7fc640 1 -- 172.21.15.112:0/1132125604 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4009bf0 con 0x7f8698003b80 2024-09-15T23:53:37.193 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.187+0000 7f86b1bd4640 1 -- 172.21.15.112:0/1132125604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8698003b80 msgr2=0x7f8698003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:37.193 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.187+0000 7f86b1bd4640 1 --2- 172.21.15.112:0/1132125604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8698003b80 0x7f8698003f80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009fa0 tx=0x7f86a401cbc0 comp rx=0 tx=0).stop 2024-09-15T23:53:37.193 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.187+0000 7f86abfff640 1 -- 172.21.15.112:0/1132125604 reap_dead start 2024-09-15T23:53:37.193 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.187+0000 7f86b1bd4640 1 -- 172.21.15.112:0/1132125604 shutdown_connections 2024-09-15T23:53:37.193 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.187+0000 7f86b1bd4640 1 -- 172.21.15.112:0/1132125604 >> 172.21.15.112:0/1132125604 conn(0x7f86ac09a9d0 msgr2=0x7f86ac0b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:37.193 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.187+0000 7f86b1bd4640 1 -- 172.21.15.112:0/1132125604 shutdown_connections 2024-09-15T23:53:37.193 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.187+0000 7f86b1bd4640 1 -- 172.21.15.112:0/1132125604 wait complete. 2024-09-15T23:53:37.194 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86b1bd4640 1 Processor -- start 2024-09-15T23:53:37.194 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86b1bd4640 1 -- start start 2024-09-15T23:53:37.196 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86b1bd4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86ac14eb70 0x7f86ac0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:37.196 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86b1bd4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86ac14ef50 0x7f86ac0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:37.196 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86b1bd4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86ac09e2f0 0x7f86ac09e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:37.196 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86b1bd4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f86ac06bbc0 con 0x7f86ac09e2f0 2024-09-15T23:53:37.196 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86b1bd4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86ac0b6430 con 0x7f86ac14eb70 2024-09-15T23:53:37.197 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86b1bd4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f86ac06bd40 con 0x7f86ac14ef50 2024-09-15T23:53:37.197 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86abfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86ac09e2f0 0x7f86ac09e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:37.197 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86abfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86ac09e2f0 0x7f86ac09e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32916/0 (socket says 172.21.15.112:32916) 2024-09-15T23:53:37.197 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86abfff640 1 -- 172.21.15.112:0/2684483522 learned_addr learned my addr 172.21.15.112:0/2684483522 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:37.197 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86ab7fe640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86ac14eb70 0x7f86ac0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:37.197 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86aaffd640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86ac14ef50 0x7f86ac0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:37.197 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86abfff640 1 -- 172.21.15.112:0/2684483522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86ac14ef50 msgr2=0x7f86ac0b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:37.197 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86abfff640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86ac14ef50 0x7f86ac0b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:37.197 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86abfff640 1 -- 172.21.15.112:0/2684483522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86ac14eb70 msgr2=0x7f86ac0b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:37.197 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86abfff640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86ac14eb70 0x7f86ac0b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:37.197 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86abfff640 1 -- 172.21.15.112:0/2684483522 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ac0ae280 con 0x7f86ac09e2f0 2024-09-15T23:53:37.197 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86ab7fe640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86ac14eb70 0x7f86ac0b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:53:37.197 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86abfff640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86ac09e2f0 0x7f86ac09e7a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f86ac074de0 tx=0x7f869c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:37.198 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86a3fff640 1 -- 172.21.15.112:0/2684483522 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c004ab0 con 0x7f86ac09e2f0 2024-09-15T23:53:37.198 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86a3fff640 1 -- 172.21.15.112:0/2684483522 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f869c004c70 con 0x7f86ac09e2f0 2024-09-15T23:53:37.198 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86b1bd4640 1 -- 172.21.15.112:0/2684483522 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86ac0b2a50 con 0x7f86ac09e2f0 2024-09-15T23:53:37.198 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86a3fff640 1 -- 172.21.15.112:0/2684483522 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c0072b0 con 0x7f86ac09e2f0 2024-09-15T23:53:37.198 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86b1bd4640 1 -- 172.21.15.112:0/2684483522 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86ac0ae800 con 0x7f86ac09e2f0 2024-09-15T23:53:37.199 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.191+0000 7f86b1bd4640 1 -- 172.21.15.112:0/2684483522 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86ac0cec80 con 0x7f86ac09e2f0 2024-09-15T23:53:37.199 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.195+0000 7f86a3fff640 1 -- 172.21.15.112:0/2684483522 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f869c01b020 con 0x7f86ac09e2f0 2024-09-15T23:53:37.199 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.195+0000 7f86a3fff640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f868c067800 0x7f868c069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:37.199 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.195+0000 7f86a3fff640 1 -- 172.21.15.112:0/2684483522 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2495+0+0 (secure 0 0 0) 0x7f869c084bd0 con 0x7f86ac09e2f0 2024-09-15T23:53:37.199 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.195+0000 7f86ab7fe640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f868c067800 0x7f868c069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:37.199 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.195+0000 7f86ab7fe640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f868c067800 0x7f868c069cc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f86a40af000 tx=0x7f86a4004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:37.206 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.203+0000 7f86a3fff640 1 -- 172.21.15.112:0/2684483522 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f869c004e20 con 0x7f86ac09e2f0 2024-09-15T23:53:37.399 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.395+0000 7f86b1bd4640 1 -- 172.21.15.112:0/2684483522 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86ac1e7220 con 0x7f86ac09e2f0 2024-09-15T23:53:37.399 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.395+0000 7f86a3fff640 1 -- 172.21.15.112:0/2684483522 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7590 (secure 0 0 0) 0x7f869c056400 con 0x7f86ac09e2f0 2024-09-15T23:53:37.401 INFO:teuthology.misc.health.smithi112.stdout: 2024-09-15T23:53:37.401 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":14,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:37.240944+0000","last_up_change":"2024-09-15T23:53:36.237157+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:53:37.406 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.403+0000 7f86b1bd4640 1 -- 172.21.15.112:0/2684483522 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f868c067800 msgr2=0x7f868c069cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:37.406 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.403+0000 7f86b1bd4640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f868c067800 0x7f868c069cc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f86a40af000 tx=0x7f86a4004ac0 comp rx=0 tx=0).stop 2024-09-15T23:53:37.406 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.403+0000 7f86b1bd4640 1 -- 172.21.15.112:0/2684483522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86ac09e2f0 msgr2=0x7f86ac09e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:37.406 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.403+0000 7f86b1bd4640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86ac09e2f0 0x7f86ac09e7a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f86ac074de0 tx=0x7f869c00dc00 comp rx=0 tx=0).stop 2024-09-15T23:53:37.406 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.403+0000 7f86b1bd4640 1 -- 172.21.15.112:0/2684483522 shutdown_connections 2024-09-15T23:53:37.406 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.403+0000 7f86b1bd4640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f868c067800 0x7f868c069cc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:37.406 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.403+0000 7f86b1bd4640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86ac09e2f0 0x7f86ac09e7a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:37.406 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.403+0000 7f86b1bd4640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86ac14ef50 0x7f86ac0b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:37.406 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.403+0000 7f86b1bd4640 1 --2- 172.21.15.112:0/2684483522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86ac14eb70 0x7f86ac0b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:37.406 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.403+0000 7f86b1bd4640 1 -- 172.21.15.112:0/2684483522 >> 172.21.15.112:0/2684483522 conn(0x7f86ac09a9d0 msgr2=0x7f86ac15bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:37.406 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.403+0000 7f86b1bd4640 1 -- 172.21.15.112:0/2684483522 shutdown_connections 2024-09-15T23:53:37.406 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:37.403+0000 7f86b1bd4640 1 -- 172.21.15.112:0/2684483522 wait complete. 2024-09-15T23:53:37.427 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-15T23:53:38.014 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-09-15T23:53:38.011+0000 7fe999ca6640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T23:53:38.044 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-09-15T23:53:38.039+0000 7fe9912c9640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:53:38.098 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-09-15T23:53:38.095+0000 7f9328d2d640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T23:53:38.122 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-09-15T23:53:38.119+0000 7fd43372b640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T23:53:38.127 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-09-15T23:53:38.123+0000 7f9320350640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:53:38.149 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-15T23:53:38.143+0000 7f45864ca640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T23:53:38.158 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-09-15T23:53:38.155+0000 7fd42b560640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:53:38.176 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-15T23:53:38.171+0000 7f457e2ff640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:53:38.220 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-15T23:53:38.215+0000 7f2f00b5e640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T23:53:38.246 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-15T23:53:38.243+0000 7f2ef8993640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:53:38.257 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-15T23:53:38.251+0000 7f86fed18640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T23:53:38.286 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-15T23:53:38.283+0000 7f86f6b4d640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:53:38.471 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-15T23:53:38.467+0000 7f42b7472640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T23:53:38.498 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-15T23:53:38.495+0000 7f42af2a7640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:53:43.154 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:53:43.157 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:53:44.235 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T23:53:44.358 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa381e43640 1 Processor -- start 2024-09-15T23:53:44.358 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa381e43640 1 -- start start 2024-09-15T23:53:44.359 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa381e43640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa37c15e580 0x7fa37c06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:44.359 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa381e43640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa37c0cdec0 0x7fa37c0cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:44.359 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa381e43640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa37c15e960 con 0x7fa37c0d04b0 2024-09-15T23:53:44.359 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa381e43640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa37c0ce680 con 0x7fa37c0cdec0 2024-09-15T23:53:44.359 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa381e43640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa37c0ce960 con 0x7fa37c15e580 2024-09-15T23:53:44.359 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa37b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa37c15e580 0x7fa37c06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:44.359 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa37affd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa37c0cdec0 0x7fa37c0cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:44.360 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa37b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa37c15e580 0x7fa37c06e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:50810/0 (socket says 172.21.15.112:50810) 2024-09-15T23:53:44.360 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa37b7fe640 1 -- 172.21.15.112:0/2305132944 learned_addr learned my addr 172.21.15.112:0/2305132944 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:44.360 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa37affd640 1 -- 172.21.15.112:0/2305132944 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa37c15e580 msgr2=0x7fa37c06e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:44.360 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa37affd640 1 --2- 172.21.15.112:0/2305132944 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa37c15e580 0x7fa37c06e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.360 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa37affd640 1 -- 172.21.15.112:0/2305132944 >> v1:172.21.15.169:6789/0 conn(0x7fa37c0d04b0 legacy=0x7fa37c15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:44.361 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa37affd640 1 -- 172.21.15.112:0/2305132944 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37c0cec40 con 0x7fa37c0cdec0 2024-09-15T23:53:44.361 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.358+0000 7fa37b7fe640 1 --2- 172.21.15.112:0/2305132944 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa37c15e580 0x7fa37c06e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:53:44.362 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa37affd640 1 --2- 172.21.15.112:0/2305132944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa37c0cdec0 0x7fa37c0cff70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa3700097c0 tx=0x7fa37001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e4776361227d908 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:44.362 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa37a7fc640 1 -- 172.21.15.112:0/2305132944 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700b0070 con 0x7fa37c0cdec0 2024-09-15T23:53:44.362 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa37a7fc640 1 -- 172.21.15.112:0/2305132944 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3700a4e50 con 0x7fa37c0cdec0 2024-09-15T23:53:44.362 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa37a7fc640 1 -- 172.21.15.112:0/2305132944 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700ab820 con 0x7fa37c0cdec0 2024-09-15T23:53:44.363 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 -- 172.21.15.112:0/2305132944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa37c0cdec0 msgr2=0x7fa37c0cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:44.363 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 --2- 172.21.15.112:0/2305132944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa37c0cdec0 0x7fa37c0cff70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa3700097c0 tx=0x7fa37001c4a0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.363 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 -- 172.21.15.112:0/2305132944 shutdown_connections 2024-09-15T23:53:44.363 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 --2- 172.21.15.112:0/2305132944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa37c0cdec0 0x7fa37c0cff70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.364 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 --2- 172.21.15.112:0/2305132944 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa37c15e580 0x7fa37c06e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.364 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 -- 172.21.15.112:0/2305132944 >> 172.21.15.112:0/2305132944 conn(0x7fa37c06bbc0 msgr2=0x7fa37c06bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:44.364 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 -- 172.21.15.112:0/2305132944 shutdown_connections 2024-09-15T23:53:44.364 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 -- 172.21.15.112:0/2305132944 wait complete. 2024-09-15T23:53:44.364 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 Processor -- start 2024-09-15T23:53:44.364 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 -- start start 2024-09-15T23:53:44.367 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa37c0cdec0 0x7fa37c1694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:44.367 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa37c0d04b0 0x7fa37c167d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:44.367 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa37c15e580 0x7fa37c14e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:44.367 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c0ccaa0 con 0x7fa37c15e580 2024-09-15T23:53:44.367 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c072070 con 0x7fa37c0d04b0 2024-09-15T23:53:44.367 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.362+0000 7fa381e43640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa37c0ccc20 con 0x7fa37c0cdec0 2024-09-15T23:53:44.367 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa37bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa37c15e580 0x7fa37c14e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:44.367 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa37bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa37c15e580 0x7fa37c14e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42706/0 (socket says 172.21.15.112:42706) 2024-09-15T23:53:44.368 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa37bfff640 1 -- 172.21.15.112:0/3311091103 learned_addr learned my addr 172.21.15.112:0/3311091103 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:44.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa37b7fe640 1 --2- 172.21.15.112:0/3311091103 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa37c0cdec0 0x7fa37c1694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:44.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa37affd640 1 --2- 172.21.15.112:0/3311091103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa37c0d04b0 0x7fa37c167d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:44.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa37bfff640 1 -- 172.21.15.112:0/3311091103 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa37c0cdec0 msgr2=0x7fa37c1694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:44.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa37bfff640 1 --2- 172.21.15.112:0/3311091103 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa37c0cdec0 0x7fa37c1694f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa37bfff640 1 -- 172.21.15.112:0/3311091103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa37c0d04b0 msgr2=0x7fa37c167d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:44.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa37bfff640 1 --2- 172.21.15.112:0/3311091103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa37c0d04b0 0x7fa37c167d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa37bfff640 1 -- 172.21.15.112:0/3311091103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37c168450 con 0x7fa37c15e580 2024-09-15T23:53:44.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa37bfff640 1 --2- 172.21.15.112:0/3311091103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa37c15e580 0x7fa37c14e4c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa37400c770 tx=0x7fa37400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:44.369 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa363fff640 1 -- 172.21.15.112:0/3311091103 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374003b80 con 0x7fa37c15e580 2024-09-15T23:53:44.370 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa363fff640 1 -- 172.21.15.112:0/3311091103 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa374003d20 con 0x7fa37c15e580 2024-09-15T23:53:44.370 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa381e43640 1 -- 172.21.15.112:0/3311091103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37c168730 con 0x7fa37c15e580 2024-09-15T23:53:44.370 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa363fff640 1 -- 172.21.15.112:0/3311091103 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37400aa90 con 0x7fa37c15e580 2024-09-15T23:53:44.370 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa381e43640 1 -- 172.21.15.112:0/3311091103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37c168cf0 con 0x7fa37c15e580 2024-09-15T23:53:44.370 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa381e43640 1 -- 172.21.15.112:0/3311091103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa37c0cf660 con 0x7fa37c15e580 2024-09-15T23:53:44.371 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa363fff640 1 -- 172.21.15.112:0/3311091103 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa37400ac30 con 0x7fa37c15e580 2024-09-15T23:53:44.371 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa363fff640 1 --2- 172.21.15.112:0/3311091103 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3680678f0 0x7fa368069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:44.371 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa363fff640 1 -- 172.21.15.112:0/3311091103 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fa374085990 con 0x7fa37c15e580 2024-09-15T23:53:44.371 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa37b7fe640 1 --2- 172.21.15.112:0/3311091103 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3680678f0 0x7fa368069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:44.371 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.366+0000 7fa37b7fe640 1 --2- 172.21.15.112:0/3311091103 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3680678f0 0x7fa368069db0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009a40 tx=0x7fa36c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:44.392 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.390+0000 7fa363fff640 1 -- 172.21.15.112:0/3311091103 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa374056710 con 0x7fa37c15e580 2024-09-15T23:53:44.555 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.554+0000 7fa381e43640 1 -- 172.21.15.112:0/3311091103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa37c073c80 con 0x7fa37c15e580 2024-09-15T23:53:44.557 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.554+0000 7fa363fff640 1 -- 172.21.15.112:0/3311091103 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12908 (secure 0 0 0) 0x7fa374056010 con 0x7fa37c15e580 2024-09-15T23:53:44.557 INFO:teuthology.misc.health.smithi112.stdout: 2024-09-15T23:53:44.557 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":18,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:42.033612+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:53:44.559 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.558+0000 7fa381e43640 1 -- 172.21.15.112:0/3311091103 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3680678f0 msgr2=0x7fa368069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:44.559 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.558+0000 7fa381e43640 1 --2- 172.21.15.112:0/3311091103 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3680678f0 0x7fa368069db0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009a40 tx=0x7fa36c008040 comp rx=0 tx=0).stop 2024-09-15T23:53:44.559 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.558+0000 7fa381e43640 1 -- 172.21.15.112:0/3311091103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa37c15e580 msgr2=0x7fa37c14e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:44.559 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.558+0000 7fa381e43640 1 --2- 172.21.15.112:0/3311091103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa37c15e580 0x7fa37c14e4c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa37400c770 tx=0x7fa37400cc30 comp rx=0 tx=0).stop 2024-09-15T23:53:44.560 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.558+0000 7fa381e43640 1 -- 172.21.15.112:0/3311091103 shutdown_connections 2024-09-15T23:53:44.560 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.558+0000 7fa381e43640 1 --2- 172.21.15.112:0/3311091103 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3680678f0 0x7fa368069db0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.560 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.558+0000 7fa381e43640 1 --2- 172.21.15.112:0/3311091103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa37c15e580 0x7fa37c14e4c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.560 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.558+0000 7fa381e43640 1 --2- 172.21.15.112:0/3311091103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa37c0d04b0 0x7fa37c167d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.560 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.558+0000 7fa381e43640 1 --2- 172.21.15.112:0/3311091103 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa37c0cdec0 0x7fa37c1694f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.560 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.558+0000 7fa381e43640 1 -- 172.21.15.112:0/3311091103 >> 172.21.15.112:0/3311091103 conn(0x7fa37c06bbc0 msgr2=0x7fa37c0cd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:44.560 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.558+0000 7fa381e43640 1 -- 172.21.15.112:0/3311091103 shutdown_connections 2024-09-15T23:53:44.560 INFO:teuthology.misc.health.smithi112.stderr:2024-09-15T23:53:44.558+0000 7fa381e43640 1 -- 172.21.15.112:0/3311091103 wait complete. 2024-09-15T23:53:44.575 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-15T23:53:44.575 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-15T23:53:44.575 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:53:44.575 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:53:44.578 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:53:44.578 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:53:44.578 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:53:44.580 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:53:44.580 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:53:44.580 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:53:44.586 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:53:44.586 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:53:44.586 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:53:44.589 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:53:44.589 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-15T23:53:44.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:53:44.651 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-15T23:53:44.652 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-15T23:53:44.673 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-09-15T23:53:44.674 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-15T23:53:44.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.698+0000 7f2fec373640 1 Processor -- start 2024-09-15T23:53:44.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fec373640 1 -- start start 2024-09-15T23:53:44.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fec373640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe406dc40 0x7f2fe406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:44.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fec373640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe415f180 con 0x7f2fe40b5cf0 2024-09-15T23:53:44.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fec373640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe415f460 con 0x7f2fe415f8d0 2024-09-15T23:53:44.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fec373640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe406d440 con 0x7f2fe406dc40 2024-09-15T23:53:44.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fea10f640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2fe40b5cf0 0x7f2fe415e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53654/0 (socket says 172.21.15.112:53654) 2024-09-15T23:53:44.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fea10f640 1 -- 172.21.15.112:0/3553464335 learned_addr learned my addr 172.21.15.112:0/3553464335 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:44.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe990e640 1 --2- 172.21.15.112:0/3553464335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe406dc40 0x7f2fe406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:44.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 -- 172.21.15.112:0/3553464335 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2311580124 0 0) 0x7f2fe415f180 con 0x7f2fe40b5cf0 2024-09-15T23:53:44.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 -- 172.21.15.112:0/3553464335 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fd0003530 con 0x7f2fe40b5cf0 2024-09-15T23:53:44.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 -- 172.21.15.112:0/3553464335 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4186618732 0 0) 0x7f2fd0003530 con 0x7f2fe40b5cf0 2024-09-15T23:53:44.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 -- 172.21.15.112:0/3553464335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe406dc40 msgr2=0x7f2fe406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:44.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 --2- 172.21.15.112:0/3553464335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe406dc40 0x7f2fe406e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 -- 172.21.15.112:0/3553464335 >> v1:172.21.15.169:6789/0 conn(0x7f2fe415f8d0 legacy=0x7f2fe40b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:44.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 -- 172.21.15.112:0/3553464335 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe415ee80 con 0x7f2fe40b5cf0 2024-09-15T23:53:44.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 -- 172.21.15.112:0/3553464335 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f2fd4001680 con 0x7f2fe40b5cf0 2024-09-15T23:53:44.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe990e640 1 --2- 172.21.15.112:0/3553464335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe406dc40 0x7f2fe406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:53:44.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 -- 172.21.15.112:0/3553464335 >> v1:172.21.15.112:6789/0 conn(0x7f2fe40b5cf0 legacy=0x7f2fe415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:44.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 --2- 172.21.15.112:0/3553464335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd00039f0 0x7f2fd0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:44.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 --2- 172.21.15.112:0/3553464335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fd00043a0 0x7f2fd0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:44.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 --2- 172.21.15.112:0/3553464335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe406dc40 0x7f2fd0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:44.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 -- 172.21.15.112:0/3553464335 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe406d440 con 0x7f2fd00039f0 2024-09-15T23:53:44.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 -- 172.21.15.112:0/3553464335 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd000ba50 con 0x7f2fd00043a0 2024-09-15T23:53:44.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe910d640 1 -- 172.21.15.112:0/3553464335 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2fd000bc50 con 0x7f2fe406dc40 2024-09-15T23:53:44.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fea10f640 1 --2- 172.21.15.112:0/3553464335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd00039f0 0x7f2fd0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:44.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fe990e640 1 --2- 172.21.15.112:0/3553464335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fd00043a0 0x7f2fd0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:44.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fea910640 1 --2- 172.21.15.112:0/3553464335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe406dc40 0x7f2fd0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:44.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fea10f640 1 -- 172.21.15.112:0/3553464335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe406dc40 msgr2=0x7f2fd0005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:44.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fea10f640 1 --2- 172.21.15.112:0/3553464335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe406dc40 0x7f2fd0005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fea10f640 1 -- 172.21.15.112:0/3553464335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fd00043a0 msgr2=0x7f2fd0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:44.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fea10f640 1 --2- 172.21.15.112:0/3553464335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fd00043a0 0x7f2fd0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.702+0000 7f2fea10f640 1 -- 172.21.15.112:0/3553464335 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd0003530 con 0x7f2fd00039f0 2024-09-15T23:53:44.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fea10f640 1 --2- 172.21.15.112:0/3553464335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd00039f0 0x7f2fd0003dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400c240 tx=0x7f2fd401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d37dc2f280e246 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:44.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fe910d640 1 -- 172.21.15.112:0/3553464335 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4007d40 con 0x7f2fd00039f0 2024-09-15T23:53:44.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fe910d640 1 -- 172.21.15.112:0/3553464335 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd40a9070 con 0x7f2fd00039f0 2024-09-15T23:53:44.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fe910d640 1 -- 172.21.15.112:0/3553464335 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4005d40 con 0x7f2fd00039f0 2024-09-15T23:53:44.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 -- 172.21.15.112:0/3553464335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd00039f0 msgr2=0x7f2fd0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:44.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 --2- 172.21.15.112:0/3553464335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd00039f0 0x7f2fd0003dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400c240 tx=0x7f2fd401cca0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fea910640 1 -- 172.21.15.112:0/3553464335 reap_dead start 2024-09-15T23:53:44.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 -- 172.21.15.112:0/3553464335 shutdown_connections 2024-09-15T23:53:44.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 -- 172.21.15.112:0/3553464335 >> 172.21.15.112:0/3553464335 conn(0x7f2fe406c0c0 msgr2=0x7f2fe406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:44.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 -- 172.21.15.112:0/3553464335 shutdown_connections 2024-09-15T23:53:44.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 -- 172.21.15.112:0/3553464335 wait complete. 2024-09-15T23:53:44.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 Processor -- start 2024-09-15T23:53:44.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 -- start start 2024-09-15T23:53:44.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd00039f0 0x7f2fe4161750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:44.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe415caf0 0x7f2fe415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:44.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe40d1e20 0x7f2fe40d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:44.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe4072900 con 0x7f2fd00039f0 2024-09-15T23:53:44.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe40b4c80 con 0x7f2fe40d1e20 2024-09-15T23:53:44.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe406e050 con 0x7f2fe415caf0 2024-09-15T23:53:44.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fea10f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd00039f0 0x7f2fe4161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:44.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fea10f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd00039f0 0x7f2fe4161750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42750/0 (socket says 172.21.15.112:42750) 2024-09-15T23:53:44.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fea10f640 1 -- 172.21.15.112:0/1051018274 learned_addr learned my addr 172.21.15.112:0/1051018274 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:44.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fe990e640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe415caf0 0x7f2fe415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fea910640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe40d1e20 0x7f2fe40d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fea10f640 1 -- 172.21.15.112:0/1051018274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe415caf0 msgr2=0x7f2fe415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fea10f640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe415caf0 0x7f2fe415cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fea10f640 1 -- 172.21.15.112:0/1051018274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe40d1e20 msgr2=0x7f2fe40d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fea10f640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe40d1e20 0x7f2fe40d22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fea10f640 1 -- 172.21.15.112:0/1051018274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe4146310 con 0x7f2fd00039f0 2024-09-15T23:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fea910640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe40d1e20 0x7f2fe40d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fea10f640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd00039f0 0x7f2fe4161750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4001980 tx=0x7f2fd0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fdaffd640 1 -- 172.21.15.112:0/1051018274 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4000ee0 con 0x7f2fd00039f0 2024-09-15T23:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fdaffd640 1 -- 172.21.15.112:0/1051018274 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd4001080 con 0x7f2fd00039f0 2024-09-15T23:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 -- 172.21.15.112:0/1051018274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe4154ce0 con 0x7f2fd00039f0 2024-09-15T23:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fdaffd640 1 -- 172.21.15.112:0/1051018274 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40049f0 con 0x7f2fd00039f0 2024-09-15T23:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.706+0000 7f2fec373640 1 -- 172.21.15.112:0/1051018274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe41552a0 con 0x7f2fd00039f0 2024-09-15T23:53:44.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.710+0000 7f2fec373640 1 -- 172.21.15.112:0/1051018274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe406e3a0 con 0x7f2fd00039f0 2024-09-15T23:53:44.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.710+0000 7f2fdaffd640 1 -- 172.21.15.112:0/1051018274 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2fd4004b90 con 0x7f2fd00039f0 2024-09-15T23:53:44.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.710+0000 7f2fdaffd640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2fc80678f0 0x7f2fc8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:44.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.710+0000 7f2fdaffd640 1 -- 172.21.15.112:0/1051018274 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f2fd411edb0 con 0x7f2fd00039f0 2024-09-15T23:53:44.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.710+0000 7f2fe990e640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2fc80678f0 0x7f2fc8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:44.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.710+0000 7f2fe990e640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2fc80678f0 0x7f2fc8069db0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4162240 tx=0x7f2fe0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:44.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.714+0000 7f2fdaffd640 1 -- 172.21.15.112:0/1051018274 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2fd40169b0 con 0x7f2fd00039f0 2024-09-15T23:53:44.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.894+0000 7f2fec373640 1 -- 172.21.15.112:0/1051018274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fe4069170 con 0x7f2fd00039f0 2024-09-15T23:53:44.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.894+0000 7f2fdaffd640 1 -- 172.21.15.112:0/1051018274 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f2fd40efbb0 con 0x7f2fd00039f0 2024-09-15T23:53:44.896 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:53:44.896 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":2,"btime":"2024-09-15T23:53:44:657506+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3178495253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3178495253},{"type":"v1","addr":"172.21.15.112:6837","nonce":3178495253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T23:53:44.897 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 2 2024-09-15T23:53:44.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.898+0000 7f2fec373640 1 -- 172.21.15.112:0/1051018274 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2fc80678f0 msgr2=0x7f2fc8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:44.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.898+0000 7f2fec373640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2fc80678f0 0x7f2fc8069db0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4162240 tx=0x7f2fe0009190 comp rx=0 tx=0).stop 2024-09-15T23:53:44.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.898+0000 7f2fec373640 1 -- 172.21.15.112:0/1051018274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd00039f0 msgr2=0x7f2fe4161750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:44.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.898+0000 7f2fec373640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd00039f0 0x7f2fe4161750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4001980 tx=0x7f2fd0005840 comp rx=0 tx=0).stop 2024-09-15T23:53:44.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.898+0000 7f2fec373640 1 -- 172.21.15.112:0/1051018274 shutdown_connections 2024-09-15T23:53:44.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.898+0000 7f2fec373640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2fc80678f0 0x7f2fc8069db0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.898+0000 7f2fec373640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe40d1e20 0x7f2fe40d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.898+0000 7f2fec373640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe415caf0 0x7f2fe415cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.898+0000 7f2fec373640 1 --2- 172.21.15.112:0/1051018274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd00039f0 0x7f2fe4161750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:44.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.898+0000 7f2fec373640 1 -- 172.21.15.112:0/1051018274 >> 172.21.15.112:0/1051018274 conn(0x7f2fe406c0c0 msgr2=0x7f2fe415db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:44.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.898+0000 7f2fec373640 1 -- 172.21.15.112:0/1051018274 shutdown_connections 2024-09-15T23:53:44.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:44.898+0000 7f2fec373640 1 -- 172.21.15.112:0/1051018274 wait complete. 2024-09-15T23:53:46.915 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:53:47.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.042+0000 7f19d12b8640 1 Processor -- start 2024-09-15T23:53:47.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.046+0000 7f19d12b8640 1 -- start start 2024-09-15T23:53:47.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.046+0000 7f19d12b8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f19cc070020 0x7f19cc15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.046+0000 7f19d12b8640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19cc0aede0 con 0x7f19cc1520a0 2024-09-15T23:53:47.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.046+0000 7f19d12b8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19cc15fa10 con 0x7f19cc15f1d0 2024-09-15T23:53:47.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.046+0000 7f19d12b8640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f19cc152480 con 0x7f19cc070020 2024-09-15T23:53:47.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.046+0000 7f19caffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f19cc1520a0 0x7f19cc06f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53668/0 (socket says 172.21.15.112:53668) 2024-09-15T23:53:47.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.046+0000 7f19caffd640 1 -- 172.21.15.112:0/2994010681 learned_addr learned my addr 172.21.15.112:0/2994010681 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:47.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.046+0000 7f19ca7fc640 1 --2- 172.21.15.112:0/2994010681 >> v2:172.21.15.112:3300/0 conn(0x7f19cc070020 0x7f19cc15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.046+0000 7f19c9ffb640 1 -- 172.21.15.112:0/2994010681 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3956086002 0 0) 0x7f19cc0aede0 con 0x7f19cc1520a0 2024-09-15T23:53:47.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.046+0000 7f19c9ffb640 1 -- 172.21.15.112:0/2994010681 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19b8003530 con 0x7f19cc1520a0 2024-09-15T23:53:47.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.046+0000 7f19ca7fc640 1 -- 172.21.15.112:0/2994010681 >> v1:172.21.15.169:6789/0 conn(0x7f19cc15f1d0 legacy=0x7f19cc0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:47.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.046+0000 7f19ca7fc640 1 -- 172.21.15.112:0/2994010681 >> v1:172.21.15.112:6789/0 conn(0x7f19cc1520a0 legacy=0x7f19cc06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.046+0000 7f19ca7fc640 1 -- 172.21.15.112:0/2994010681 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19cc074250 con 0x7f19cc070020 2024-09-15T23:53:47.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.046+0000 7f19ca7fc640 1 --2- 172.21.15.112:0/2994010681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19cc070020 0x7f19cc15ec90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f19b40097c0 tx=0x7f19b401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53f15420c1fa1c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:47.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19c9ffb640 1 -- 172.21.15.112:0/2994010681 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc0aeba0 con 0x7f19cc070020 2024-09-15T23:53:47.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19c9ffb640 1 -- 172.21.15.112:0/2994010681 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b40b0070 con 0x7f19cc070020 2024-09-15T23:53:47.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19c9ffb640 1 -- 172.21.15.112:0/2994010681 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b40ab630 con 0x7f19cc070020 2024-09-15T23:53:47.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 -- 172.21.15.112:0/2994010681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19cc070020 msgr2=0x7f19cc15ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 --2- 172.21.15.112:0/2994010681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19cc070020 0x7f19cc15ec90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f19b40097c0 tx=0x7f19b401c430 comp rx=0 tx=0).stop 2024-09-15T23:53:47.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 -- 172.21.15.112:0/2994010681 shutdown_connections 2024-09-15T23:53:47.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 --2- 172.21.15.112:0/2994010681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19cc070020 0x7f19cc15ec90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 -- 172.21.15.112:0/2994010681 >> 172.21.15.112:0/2994010681 conn(0x7f19cc0b1f90 msgr2=0x7f19cc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:47.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 -- 172.21.15.112:0/2994010681 shutdown_connections 2024-09-15T23:53:47.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 -- 172.21.15.112:0/2994010681 wait complete. 2024-09-15T23:53:47.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 Processor -- start 2024-09-15T23:53:47.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 -- start start 2024-09-15T23:53:47.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19cc070020 0x7f19cc0b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19cc1520a0 0x7f19cc1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19cc15f1d0 0x7f19cc0cef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc15f680 con 0x7f19cc070020 2024-09-15T23:53:47.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc073d30 con 0x7f19cc1520a0 2024-09-15T23:53:47.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19d12b8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f19cc168f20 con 0x7f19cc15f1d0 2024-09-15T23:53:47.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19caffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19cc070020 0x7f19cc0b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19caffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19cc070020 0x7f19cc0b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42772/0 (socket says 172.21.15.112:42772) 2024-09-15T23:53:47.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.050+0000 7f19caffd640 1 -- 172.21.15.112:0/2014975361 learned_addr learned my addr 172.21.15.112:0/2014975361 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:47.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19caffd640 1 -- 172.21.15.112:0/2014975361 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19cc15f1d0 msgr2=0x7f19cc0cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19caffd640 1 --2- 172.21.15.112:0/2014975361 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19cc15f1d0 0x7f19cc0cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19caffd640 1 -- 172.21.15.112:0/2014975361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19cc1520a0 msgr2=0x7f19cc1545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19caffd640 1 --2- 172.21.15.112:0/2014975361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19cc1520a0 0x7f19cc1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19caffd640 1 -- 172.21.15.112:0/2014975361 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19cc154c10 con 0x7f19cc070020 2024-09-15T23:53:47.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19caffd640 1 --2- 172.21.15.112:0/2014975361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19cc070020 0x7f19cc0b2910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19c400c480 tx=0x7f19c400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:47.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19c37fe640 1 -- 172.21.15.112:0/2014975361 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4017070 con 0x7f19cc070020 2024-09-15T23:53:47.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19c37fe640 1 -- 172.21.15.112:0/2014975361 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c4005db0 con 0x7f19cc070020 2024-09-15T23:53:47.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19d12b8640 1 -- 172.21.15.112:0/2014975361 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19cc154ef0 con 0x7f19cc070020 2024-09-15T23:53:47.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19c37fe640 1 -- 172.21.15.112:0/2014975361 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4007290 con 0x7f19cc070020 2024-09-15T23:53:47.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19d12b8640 1 -- 172.21.15.112:0/2014975361 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19cc1554b0 con 0x7f19cc070020 2024-09-15T23:53:47.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19d12b8640 1 -- 172.21.15.112:0/2014975361 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19cc15ec90 con 0x7f19cc070020 2024-09-15T23:53:47.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19c37fe640 1 -- 172.21.15.112:0/2014975361 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f19c401a070 con 0x7f19cc070020 2024-09-15T23:53:47.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19c37fe640 1 --2- 172.21.15.112:0/2014975361 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f19ac0678c0 0x7f19ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19c37fe640 1 -- 172.21.15.112:0/2014975361 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f19c4084dc0 con 0x7f19cc070020 2024-09-15T23:53:47.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19ca7fc640 1 --2- 172.21.15.112:0/2014975361 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f19ac0678c0 0x7f19ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.054+0000 7f19ca7fc640 1 --2- 172.21.15.112:0/2014975361 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f19ac0678c0 0x7f19ac069d80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19b40af000 tx=0x7f19b4004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:47.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.058+0000 7f19c37fe640 1 -- 172.21.15.112:0/2014975361 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f19c4055ce0 con 0x7f19cc070020 2024-09-15T23:53:47.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.254+0000 7f19d12b8640 1 -- 172.21.15.112:0/2014975361 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19cc0b3e40 con 0x7f19cc070020 2024-09-15T23:53:47.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.254+0000 7f19c37fe640 1 -- 172.21.15.112:0/2014975361 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7f19c40555e0 con 0x7f19cc070020 2024-09-15T23:53:47.257 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:53:47.257 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":3,"btime":"2024-09-15T23:53:45:658652+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/879130842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":879130842},{"type":"v1","addr":"172.21.15.112:6836","nonce":879130842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3178495253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3178495253},{"type":"v1","addr":"172.21.15.112:6837","nonce":3178495253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/780833913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":780833913},{"type":"v1","addr":"172.21.15.169:6833","nonce":780833913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2205745557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2205745557},{"type":"v1","addr":"172.21.15.169:6835","nonce":2205745557}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-15T23:53:47.257 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 3 2024-09-15T23:53:47.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.258+0000 7f19d12b8640 1 -- 172.21.15.112:0/2014975361 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f19ac0678c0 msgr2=0x7f19ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.258+0000 7f19d12b8640 1 --2- 172.21.15.112:0/2014975361 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f19ac0678c0 0x7f19ac069d80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19b40af000 tx=0x7f19b4004740 comp rx=0 tx=0).stop 2024-09-15T23:53:47.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.258+0000 7f19d12b8640 1 -- 172.21.15.112:0/2014975361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19cc070020 msgr2=0x7f19cc0b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.258+0000 7f19d12b8640 1 --2- 172.21.15.112:0/2014975361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19cc070020 0x7f19cc0b2910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19c400c480 tx=0x7f19c400c940 comp rx=0 tx=0).stop 2024-09-15T23:53:47.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.258+0000 7f19d12b8640 1 -- 172.21.15.112:0/2014975361 shutdown_connections 2024-09-15T23:53:47.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.258+0000 7f19d12b8640 1 --2- 172.21.15.112:0/2014975361 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f19ac0678c0 0x7f19ac069d80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.258+0000 7f19d12b8640 1 --2- 172.21.15.112:0/2014975361 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f19cc15f1d0 0x7f19cc0cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.258+0000 7f19d12b8640 1 --2- 172.21.15.112:0/2014975361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19cc1520a0 0x7f19cc1545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.258+0000 7f19d12b8640 1 --2- 172.21.15.112:0/2014975361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19cc070020 0x7f19cc0b2910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.258+0000 7f19d12b8640 1 -- 172.21.15.112:0/2014975361 >> 172.21.15.112:0/2014975361 conn(0x7f19cc0b1f90 msgr2=0x7f19cc0b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.258+0000 7f19d12b8640 1 -- 172.21.15.112:0/2014975361 shutdown_connections 2024-09-15T23:53:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.258+0000 7f19d12b8640 1 -- 172.21.15.112:0/2014975361 wait complete. 2024-09-15T23:53:47.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:53:47.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f9452ed2640 1 Processor -- start 2024-09-15T23:53:47.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f9452ed2640 1 -- start start 2024-09-15T23:53:47.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f9452ed2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f944c0b03a0 0x7f944c0b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f9452ed2640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f944c0b5c90 con 0x7f944c15e430 2024-09-15T23:53:47.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f9452ed2640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f944c06f940 con 0x7f944c070d40 2024-09-15T23:53:47.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f9452ed2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f944c0b4560 con 0x7f944c0b03a0 2024-09-15T23:53:47.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f9450c6e640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f944c15e430 0x7f944c070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53672/0 (socket says 172.21.15.112:53672) 2024-09-15T23:53:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f9450c6e640 1 -- 172.21.15.112:0/3085397176 learned_addr learned my addr 172.21.15.112:0/3085397176 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 -- 172.21.15.112:0/3085397176 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212320400 0 0) 0x7f944c0b5c90 con 0x7f944c15e430 2024-09-15T23:53:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 -- 172.21.15.112:0/3085397176 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f942c003530 con 0x7f944c15e430 2024-09-15T23:53:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f945146f640 1 --2- 172.21.15.112:0/3085397176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f944c0b03a0 0x7f944c0b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 -- 172.21.15.112:0/3085397176 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2223198248 0 0) 0x7f942c003530 con 0x7f944c15e430 2024-09-15T23:53:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 -- 172.21.15.112:0/3085397176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f944c0b03a0 msgr2=0x7f944c0b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 --2- 172.21.15.112:0/3085397176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f944c0b03a0 0x7f944c0b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 -- 172.21.15.112:0/3085397176 >> v1:172.21.15.169:6789/0 conn(0x7f944c070d40 legacy=0x7f944c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 -- 172.21.15.112:0/3085397176 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c06fbe0 con 0x7f944c15e430 2024-09-15T23:53:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 -- 172.21.15.112:0/3085397176 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f9444001a00 con 0x7f944c15e430 2024-09-15T23:53:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 -- 172.21.15.112:0/3085397176 >> v1:172.21.15.112:6789/0 conn(0x7f944c15e430 legacy=0x7f944c070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 --2- 172.21.15.112:0/3085397176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f942c0039f0 0x7f942c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 --2- 172.21.15.112:0/3085397176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f942c004810 0x7f942c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 --2- 172.21.15.112:0/3085397176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f944c0b03a0 0x7f942c005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 -- 172.21.15.112:0/3085397176 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f942c00bb60 con 0x7f942c004810 2024-09-15T23:53:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 -- 172.21.15.112:0/3085397176 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f942c00bd10 con 0x7f942c0039f0 2024-09-15T23:53:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944b7fe640 1 -- 172.21.15.112:0/3085397176 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f942c00bf10 con 0x7f944c0b03a0 2024-09-15T23:53:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944bfff640 1 --2- 172.21.15.112:0/3085397176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f942c004810 0x7f942c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f9450c6e640 1 --2- 172.21.15.112:0/3085397176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f942c0039f0 0x7f942c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944bfff640 1 -- 172.21.15.112:0/3085397176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f944c0b03a0 msgr2=0x7f942c005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944bfff640 1 --2- 172.21.15.112:0/3085397176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f944c0b03a0 0x7f942c005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944bfff640 1 -- 172.21.15.112:0/3085397176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f942c0039f0 msgr2=0x7f942c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944bfff640 1 --2- 172.21.15.112:0/3085397176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f942c0039f0 0x7f942c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f944bfff640 1 -- 172.21.15.112:0/3085397176 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c003530 con 0x7f942c004810 2024-09-15T23:53:47.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.386+0000 7f9450c6e640 1 --2- 172.21.15.112:0/3085397176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f942c0039f0 0x7f942c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:53:47.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f944bfff640 1 --2- 172.21.15.112:0/3085397176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f942c004810 0x7f942c004c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9434001780 tx=0x7f943401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5265e9d2f81deb1c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:47.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f944b7fe640 1 -- 172.21.15.112:0/3085397176 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94340013a0 con 0x7f942c004810 2024-09-15T23:53:47.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f944b7fe640 1 -- 172.21.15.112:0/3085397176 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94340a9070 con 0x7f942c004810 2024-09-15T23:53:47.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f944b7fe640 1 -- 172.21.15.112:0/3085397176 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434003600 con 0x7f942c004810 2024-09-15T23:53:47.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f9452ed2640 1 -- 172.21.15.112:0/3085397176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f942c004810 msgr2=0x7f942c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f9452ed2640 1 --2- 172.21.15.112:0/3085397176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f942c004810 0x7f942c004c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9434001780 tx=0x7f943401c420 comp rx=0 tx=0).stop 2024-09-15T23:53:47.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f945146f640 1 -- 172.21.15.112:0/3085397176 reap_dead start 2024-09-15T23:53:47.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f9452ed2640 1 -- 172.21.15.112:0/3085397176 shutdown_connections 2024-09-15T23:53:47.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f9452ed2640 1 -- 172.21.15.112:0/3085397176 >> 172.21.15.112:0/3085397176 conn(0x7f944c09aa00 msgr2=0x7f944c0b6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:47.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f9452ed2640 1 -- 172.21.15.112:0/3085397176 shutdown_connections 2024-09-15T23:53:47.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f9452ed2640 1 -- 172.21.15.112:0/3085397176 wait complete. 2024-09-15T23:53:47.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f9452ed2640 1 Processor -- start 2024-09-15T23:53:47.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f9452ed2640 1 -- start start 2024-09-15T23:53:47.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f9452ed2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f942c004810 0x7f944c15a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f9452ed2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f944c14c740 0x7f944c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f9452ed2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f944c1558b0 0x7f944c0b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f9452ed2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f944c0b4020 con 0x7f944c14c740 2024-09-15T23:53:47.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f9452ed2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f944c0b5f90 con 0x7f942c004810 2024-09-15T23:53:47.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f9452ed2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f944c0b41a0 con 0x7f944c1558b0 2024-09-15T23:53:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.390+0000 7f944bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f944c14c740 0x7f944c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f944bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f944c14c740 0x7f944c15a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42800/0 (socket says 172.21.15.112:42800) 2024-09-15T23:53:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f944bfff640 1 -- 172.21.15.112:0/2537124134 learned_addr learned my addr 172.21.15.112:0/2537124134 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f945146f640 1 --2- 172.21.15.112:0/2537124134 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f944c1558b0 0x7f944c0b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f944bfff640 1 -- 172.21.15.112:0/2537124134 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f944c1558b0 msgr2=0x7f944c0b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f944bfff640 1 --2- 172.21.15.112:0/2537124134 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f944c1558b0 0x7f944c0b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f944bfff640 1 -- 172.21.15.112:0/2537124134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f942c004810 msgr2=0x7f944c15a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f944bfff640 1 --2- 172.21.15.112:0/2537124134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f942c004810 0x7f944c15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f944bfff640 1 -- 172.21.15.112:0/2537124134 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c158060 con 0x7f944c14c740 2024-09-15T23:53:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f944bfff640 1 --2- 172.21.15.112:0/2537124134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f944c14c740 0x7f944c15a680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9434001780 tx=0x7f942c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f94497fa640 1 -- 172.21.15.112:0/2537124134 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434007a40 con 0x7f944c14c740 2024-09-15T23:53:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f94497fa640 1 -- 172.21.15.112:0/2537124134 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94340bb070 con 0x7f944c14c740 2024-09-15T23:53:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f9452ed2640 1 -- 172.21.15.112:0/2537124134 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f944c158340 con 0x7f944c14c740 2024-09-15T23:53:47.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f94497fa640 1 -- 172.21.15.112:0/2537124134 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434007260 con 0x7f944c14c740 2024-09-15T23:53:47.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f9452ed2640 1 -- 172.21.15.112:0/2537124134 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944c158900 con 0x7f944c14c740 2024-09-15T23:53:47.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f9452ed2640 1 -- 172.21.15.112:0/2537124134 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f944c070630 con 0x7f944c14c740 2024-09-15T23:53:47.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f94497fa640 1 -- 172.21.15.112:0/2537124134 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f94340b5070 con 0x7f944c14c740 2024-09-15T23:53:47.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f94497fa640 1 --2- 172.21.15.112:0/2537124134 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f94300678c0 0x7f9430069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f94497fa640 1 -- 172.21.15.112:0/2537124134 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f943411f1f0 con 0x7f944c14c740 2024-09-15T23:53:47.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f9450c6e640 1 --2- 172.21.15.112:0/2537124134 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f94300678c0 0x7f9430069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.394+0000 7f9450c6e640 1 --2- 172.21.15.112:0/2537124134 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f94300678c0 0x7f9430069d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9444004c00 tx=0x7f94440012d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:47.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.398+0000 7f94497fa640 1 -- 172.21.15.112:0/2537124134 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9434016130 con 0x7f944c14c740 2024-09-15T23:53:47.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.550+0000 7f9452ed2640 1 -- 172.21.15.112:0/2537124134 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f944c15cd40 con 0x7f944c14c740 2024-09-15T23:53:47.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.550+0000 7f94497fa640 1 -- 172.21.15.112:0/2537124134 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f94340f0110 con 0x7f944c14c740 2024-09-15T23:53:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:53:47.552 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-15T23:53:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:53:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-15T23:53:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-15T23:53:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:53:47.553 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-15T23:53:47.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.554+0000 7f9452ed2640 1 -- 172.21.15.112:0/2537124134 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f94300678c0 msgr2=0x7f9430069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.554+0000 7f9452ed2640 1 --2- 172.21.15.112:0/2537124134 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f94300678c0 0x7f9430069d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9444004c00 tx=0x7f94440012d0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.554+0000 7f9452ed2640 1 -- 172.21.15.112:0/2537124134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f944c14c740 msgr2=0x7f944c15a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.554+0000 7f9452ed2640 1 --2- 172.21.15.112:0/2537124134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f944c14c740 0x7f944c15a680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9434001780 tx=0x7f942c005840 comp rx=0 tx=0).stop 2024-09-15T23:53:47.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.554+0000 7f9452ed2640 1 -- 172.21.15.112:0/2537124134 shutdown_connections 2024-09-15T23:53:47.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.554+0000 7f9452ed2640 1 --2- 172.21.15.112:0/2537124134 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f94300678c0 0x7f9430069d80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.554+0000 7f9452ed2640 1 --2- 172.21.15.112:0/2537124134 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f944c1558b0 0x7f944c0b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.554+0000 7f9452ed2640 1 --2- 172.21.15.112:0/2537124134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f944c14c740 0x7f944c15a680 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.554+0000 7f9452ed2640 1 --2- 172.21.15.112:0/2537124134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f942c004810 0x7f944c15a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.554+0000 7f9452ed2640 1 -- 172.21.15.112:0/2537124134 >> 172.21.15.112:0/2537124134 conn(0x7f944c09aa00 msgr2=0x7f944c074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:47.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.554+0000 7f9452ed2640 1 -- 172.21.15.112:0/2537124134 shutdown_connections 2024-09-15T23:53:47.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.554+0000 7f9452ed2640 1 -- 172.21.15.112:0/2537124134 wait complete. 2024-09-15T23:53:47.569 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:53:47.569 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:53:47.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c2b6c640 1 Processor -- start 2024-09-15T23:53:47.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c2b6c640 1 -- start start 2024-09-15T23:53:47.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c2b6c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff3bc0cebb0 0x7ff3bc0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c2b6c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3bc0b5970 0x7ff3bc0b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c2b6c640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3bc0cf4d0 con 0x7ff3bc0ce6f0 2024-09-15T23:53:47.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c2b6c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff3bc0d0e90 con 0x7ff3bc0cebb0 2024-09-15T23:53:47.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c2b6c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff3bc0cc890 con 0x7ff3bc0b5970 2024-09-15T23:53:47.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bbfff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff3bc0ce6f0 0x7ff3bc0d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53688/0 (socket says 172.21.15.112:53688) 2024-09-15T23:53:47.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bbfff640 1 -- 172.21.15.112:0/273232554 learned_addr learned my addr 172.21.15.112:0/273232554 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:47.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 -- 172.21.15.112:0/273232554 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883622069 0 0) 0x7ff3bc0cf4d0 con 0x7ff3bc0ce6f0 2024-09-15T23:53:47.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 -- 172.21.15.112:0/273232554 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3a8003530 con 0x7ff3bc0ce6f0 2024-09-15T23:53:47.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c1109640 1 --2- 172.21.15.112:0/273232554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3bc0b5970 0x7ff3bc0b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c0908640 1 --2- 172.21.15.112:0/273232554 >> v2:172.21.15.169:3300/0 conn(0x7ff3bc0cebb0 0x7ff3bc0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 -- 172.21.15.112:0/273232554 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2427368562 0 0) 0x7ff3a8003530 con 0x7ff3bc0ce6f0 2024-09-15T23:53:47.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 -- 172.21.15.112:0/273232554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3bc0b5970 msgr2=0x7ff3bc0b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:47.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 --2- 172.21.15.112:0/273232554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3bc0b5970 0x7ff3bc0b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 -- 172.21.15.112:0/273232554 >> v2:172.21.15.169:3300/0 conn(0x7ff3bc0cebb0 msgr2=0x7ff3bc0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:47.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 --2- 172.21.15.112:0/273232554 >> v2:172.21.15.169:3300/0 conn(0x7ff3bc0cebb0 0x7ff3bc0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 -- 172.21.15.112:0/273232554 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3bc0ccb70 con 0x7ff3bc0ce6f0 2024-09-15T23:53:47.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c0908640 1 --2- 172.21.15.112:0/273232554 >> v2:172.21.15.169:3300/0 conn(0x7ff3bc0cebb0 0x7ff3bc0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:53:47.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 -- 172.21.15.112:0/273232554 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7ff3a40016a0 con 0x7ff3bc0ce6f0 2024-09-15T23:53:47.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 -- 172.21.15.112:0/273232554 >> v1:172.21.15.112:6789/0 conn(0x7ff3bc0ce6f0 legacy=0x7ff3bc0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 --2- 172.21.15.112:0/273232554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3a80039c0 0x7ff3a8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 --2- 172.21.15.112:0/273232554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3bc0b5970 0x7ff3a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 --2- 172.21.15.112:0/273232554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a8004d50 0x7ff3a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 -- 172.21.15.112:0/273232554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc0d0e90 con 0x7ff3a80039c0 2024-09-15T23:53:47.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 -- 172.21.15.112:0/273232554 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc0cc890 con 0x7ff3a8004d50 2024-09-15T23:53:47.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3bb7fe640 1 -- 172.21.15.112:0/273232554 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a800bab0 con 0x7ff3bc0b5970 2024-09-15T23:53:47.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c0908640 1 --2- 172.21.15.112:0/273232554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3a80039c0 0x7ff3a8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c0908640 1 -- 172.21.15.112:0/273232554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3bc0b5970 msgr2=0x7ff3a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:47.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c0908640 1 --2- 172.21.15.112:0/273232554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3bc0b5970 0x7ff3a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c0908640 1 -- 172.21.15.112:0/273232554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a8004d50 msgr2=0x7ff3a80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:47.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c0908640 1 --2- 172.21.15.112:0/273232554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a8004d50 0x7ff3a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.694+0000 7ff3c0908640 1 -- 172.21.15.112:0/273232554 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a8003530 con 0x7ff3a80039c0 2024-09-15T23:53:47.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c0908640 1 --2- 172.21.15.112:0/273232554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3a80039c0 0x7ff3a8003de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0073e0 tx=0x7ff3ac01ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585df908219ab733 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:47.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3bb7fe640 1 -- 172.21.15.112:0/273232554 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac0b2070 con 0x7ff3a80039c0 2024-09-15T23:53:47.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3bb7fe640 1 -- 172.21.15.112:0/273232554 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ac0a5df0 con 0x7ff3a80039c0 2024-09-15T23:53:47.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3bb7fe640 1 -- 172.21.15.112:0/273232554 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac009c80 con 0x7ff3a80039c0 2024-09-15T23:53:47.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/273232554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3a80039c0 msgr2=0x7ff3a8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c2b6c640 1 --2- 172.21.15.112:0/273232554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3a80039c0 0x7ff3a8003de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0073e0 tx=0x7ff3ac01ceb0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c1109640 1 -- 172.21.15.112:0/273232554 reap_dead start 2024-09-15T23:53:47.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/273232554 shutdown_connections 2024-09-15T23:53:47.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/273232554 >> 172.21.15.112:0/273232554 conn(0x7ff3bc0700a0 msgr2=0x7ff3bc0704b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:47.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/273232554 shutdown_connections 2024-09-15T23:53:47.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/273232554 wait complete. 2024-09-15T23:53:47.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c2b6c640 1 Processor -- start 2024-09-15T23:53:47.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c2b6c640 1 -- start start 2024-09-15T23:53:47.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c2b6c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a80039c0 0x7ff3bc1f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c2b6c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3bc15f440 0x7ff3bc154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c2b6c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3bc1637b0 0x7ff3bc163c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c2b6c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc0b6560 con 0x7ff3bc15f440 2024-09-15T23:53:47.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c2b6c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc15c3a0 con 0x7ff3a80039c0 2024-09-15T23:53:47.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3c2b6c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff3bc0b66e0 con 0x7ff3bc1637b0 2024-09-15T23:53:47.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.698+0000 7ff3bbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3bc15f440 0x7ff3bc154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3bbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3bc15f440 0x7ff3bc154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42816/0 (socket says 172.21.15.112:42816) 2024-09-15T23:53:47.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3bbfff640 1 -- 172.21.15.112:0/3099438666 learned_addr learned my addr 172.21.15.112:0/3099438666 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:47.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3c0908640 1 --2- 172.21.15.112:0/3099438666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a80039c0 0x7ff3bc1f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3c1109640 1 --2- 172.21.15.112:0/3099438666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3bc1637b0 0x7ff3bc163c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3bbfff640 1 -- 172.21.15.112:0/3099438666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3bc1637b0 msgr2=0x7ff3bc163c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3bbfff640 1 --2- 172.21.15.112:0/3099438666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3bc1637b0 0x7ff3bc163c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3bbfff640 1 -- 172.21.15.112:0/3099438666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a80039c0 msgr2=0x7ff3bc1f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:47.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3bbfff640 1 --2- 172.21.15.112:0/3099438666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a80039c0 0x7ff3bc1f5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:47.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3bbfff640 1 -- 172.21.15.112:0/3099438666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3bc1f6090 con 0x7ff3bc15f440 2024-09-15T23:53:47.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3bbfff640 1 --2- 172.21.15.112:0/3099438666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3bc15f440 0x7ff3bc154b40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400c730 tx=0x7ff3a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:47.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3b97fa640 1 -- 172.21.15.112:0/3099438666 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4018070 con 0x7ff3bc15f440 2024-09-15T23:53:47.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3b97fa640 1 -- 172.21.15.112:0/3099438666 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a4007500 con 0x7ff3bc15f440 2024-09-15T23:53:47.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/3099438666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3bc15f9e0 con 0x7ff3bc15f440 2024-09-15T23:53:47.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3b97fa640 1 -- 172.21.15.112:0/3099438666 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4004a30 con 0x7ff3bc15f440 2024-09-15T23:53:47.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/3099438666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3bc15ffa0 con 0x7ff3bc15f440 2024-09-15T23:53:47.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/3099438666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3bc0b6ac0 con 0x7ff3bc15f440 2024-09-15T23:53:47.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3b97fa640 1 -- 172.21.15.112:0/3099438666 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3a401b070 con 0x7ff3bc15f440 2024-09-15T23:53:47.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3b97fa640 1 --2- 172.21.15.112:0/3099438666 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff39c0678f0 0x7ff39c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:47.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3b97fa640 1 -- 172.21.15.112:0/3099438666 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7ff3a4084e40 con 0x7ff3bc15f440 2024-09-15T23:53:47.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3c0908640 1 --2- 172.21.15.112:0/3099438666 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff39c0678f0 0x7ff39c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:47.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.702+0000 7ff3c0908640 1 --2- 172.21.15.112:0/3099438666 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff39c0678f0 0x7ff39c069db0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0af000 tx=0x7ff3ac004a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:47.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.706+0000 7ff3b97fa640 1 -- 172.21.15.112:0/3099438666 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff3bc1f6090 con 0x7ff3bc15f440 2024-09-15T23:53:47.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:47.866+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/3099438666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff3bc0d1a50 con 0x7ff3bc15f440 2024-09-15T23:53:48.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.678+0000 7ff3b97fa640 1 -- 172.21.15.112:0/3099438666 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7ff3a4055d90 con 0x7ff3bc15f440 2024-09-15T23:53:48.680 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-15T23:53:48.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.682+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/3099438666 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff39c0678f0 msgr2=0x7ff39c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:48.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.682+0000 7ff3c2b6c640 1 --2- 172.21.15.112:0/3099438666 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff39c0678f0 0x7ff39c069db0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0af000 tx=0x7ff3ac004a50 comp rx=0 tx=0).stop 2024-09-15T23:53:48.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.682+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/3099438666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3bc15f440 msgr2=0x7ff3bc154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:48.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.682+0000 7ff3c2b6c640 1 --2- 172.21.15.112:0/3099438666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3bc15f440 0x7ff3bc154b40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400c730 tx=0x7ff3a400cbf0 comp rx=0 tx=0).stop 2024-09-15T23:53:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.682+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/3099438666 shutdown_connections 2024-09-15T23:53:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.682+0000 7ff3c2b6c640 1 --2- 172.21.15.112:0/3099438666 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff39c0678f0 0x7ff39c069db0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.682+0000 7ff3c2b6c640 1 --2- 172.21.15.112:0/3099438666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3bc1637b0 0x7ff3bc163c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.682+0000 7ff3c2b6c640 1 --2- 172.21.15.112:0/3099438666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3bc15f440 0x7ff3bc154b40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.682+0000 7ff3c2b6c640 1 --2- 172.21.15.112:0/3099438666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a80039c0 0x7ff3bc1f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.682+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/3099438666 >> 172.21.15.112:0/3099438666 conn(0x7ff3bc0700a0 msgr2=0x7ff3bc0704b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:48.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.682+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/3099438666 shutdown_connections 2024-09-15T23:53:48.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.682+0000 7ff3c2b6c640 1 -- 172.21.15.112:0/3099438666 wait complete. 2024-09-15T23:53:48.709 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-15T23:53:48.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeb26fa640 1 Processor -- start 2024-09-15T23:53:48.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeb26fa640 1 -- start start 2024-09-15T23:53:48.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeb26fa640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faeac0af170 0x7faeac0b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:48.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeb26fa640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeac0af5c0 0x7faeac0b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:48.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeb26fa640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeac0b5a50 con 0x7faeac15e220 2024-09-15T23:53:48.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeb26fa640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7faeac0b5cf0 con 0x7faeac0af170 2024-09-15T23:53:48.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeb26fa640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faeac0b5fd0 con 0x7faeac0af5c0 2024-09-15T23:53:48.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeab7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faeac0af170 0x7faeac0b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:48.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeab7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faeac0af170 0x7faeac0b6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46902/0 (socket says 172.21.15.112:46902) 2024-09-15T23:53:48.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeab7fe640 1 -- 172.21.15.112:0/1536595717 learned_addr learned my addr 172.21.15.112:0/1536595717 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:48.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeb0c97640 1 --2- 172.21.15.112:0/1536595717 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeac0af5c0 0x7faeac0b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:48.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeab7fe640 1 -- 172.21.15.112:0/1536595717 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeac0af5c0 msgr2=0x7faeac0b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:48.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeab7fe640 1 --2- 172.21.15.112:0/1536595717 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeac0af5c0 0x7faeac0b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:48.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeab7fe640 1 -- 172.21.15.112:0/1536595717 >> v1:172.21.15.169:6789/0 conn(0x7faeac15e220 legacy=0x7faeac09b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:48.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeab7fe640 1 -- 172.21.15.112:0/1536595717 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeac0b62b0 con 0x7faeac0af170 2024-09-15T23:53:48.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.838+0000 7faeb0c97640 1 --2- 172.21.15.112:0/1536595717 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeac0af5c0 0x7faeac0b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:53:48.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.842+0000 7faeab7fe640 1 --2- 172.21.15.112:0/1536595717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faeac0af170 0x7faeac0b6ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faea00098a0 tx=0x7faea001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7a72faba3d2266 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:48.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.842+0000 7faeaaffd640 1 -- 172.21.15.112:0/1536595717 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea00ab620 con 0x7faeac0af170 2024-09-15T23:53:48.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.842+0000 7faeaaffd640 1 -- 172.21.15.112:0/1536595717 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea00b0070 con 0x7faeac0af170 2024-09-15T23:53:48.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.842+0000 7faeaaffd640 1 -- 172.21.15.112:0/1536595717 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea00ab9e0 con 0x7faeac0af170 2024-09-15T23:53:48.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.842+0000 7faeb26fa640 1 -- 172.21.15.112:0/1536595717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faeac0af170 msgr2=0x7faeac0b6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:48.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.842+0000 7faeb26fa640 1 --2- 172.21.15.112:0/1536595717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faeac0af170 0x7faeac0b6ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faea00098a0 tx=0x7faea001c510 comp rx=0 tx=0).stop 2024-09-15T23:53:48.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.842+0000 7faeb26fa640 1 -- 172.21.15.112:0/1536595717 shutdown_connections 2024-09-15T23:53:48.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.842+0000 7faeb26fa640 1 --2- 172.21.15.112:0/1536595717 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeac0af5c0 0x7faeac0b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:48.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.842+0000 7faeb26fa640 1 --2- 172.21.15.112:0/1536595717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faeac0af170 0x7faeac0b6ab0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:48.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.842+0000 7faeb26fa640 1 -- 172.21.15.112:0/1536595717 >> 172.21.15.112:0/1536595717 conn(0x7faeac0b3e90 msgr2=0x7faeac0b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:48.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.842+0000 7faeb26fa640 1 -- 172.21.15.112:0/1536595717 shutdown_connections 2024-09-15T23:53:48.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.842+0000 7faeb26fa640 1 -- 172.21.15.112:0/1536595717 wait complete. 2024-09-15T23:53:48.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb26fa640 1 Processor -- start 2024-09-15T23:53:48.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb26fa640 1 -- start start 2024-09-15T23:53:48.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb26fa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faeac0af170 0x7faeac15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:48.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb26fa640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeac0af5c0 0x7faeac14b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:48.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb26fa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faeac15e220 0x7faeac154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:48.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb26fa640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faeac0b1680 con 0x7faeac15e220 2024-09-15T23:53:48.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb26fa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faeac0b1500 con 0x7faeac0af170 2024-09-15T23:53:48.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb26fa640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faeac16b220 con 0x7faeac0af5c0 2024-09-15T23:53:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb0c97640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faeac15e220 0x7faeac154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb0c97640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faeac15e220 0x7faeac154a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46906/0 (socket says 172.21.15.112:46906) 2024-09-15T23:53:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb0c97640 1 -- 172.21.15.112:0/3254800425 learned_addr learned my addr 172.21.15.112:0/3254800425 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeab7fe640 1 --2- 172.21.15.112:0/3254800425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeac0af5c0 0x7faeac14b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeabfff640 1 --2- 172.21.15.112:0/3254800425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faeac0af170 0x7faeac15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb0c97640 1 -- 172.21.15.112:0/3254800425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeac0af5c0 msgr2=0x7faeac14b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb0c97640 1 --2- 172.21.15.112:0/3254800425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeac0af5c0 0x7faeac14b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb0c97640 1 -- 172.21.15.112:0/3254800425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faeac0af170 msgr2=0x7faeac15d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb0c97640 1 --2- 172.21.15.112:0/3254800425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faeac0af170 0x7faeac15d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb0c97640 1 -- 172.21.15.112:0/3254800425 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeac156530 con 0x7faeac15e220 2024-09-15T23:53:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb0c97640 1 --2- 172.21.15.112:0/3254800425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faeac15e220 0x7faeac154a50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faea4009fa0 tx=0x7faea400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faea8ff9640 1 -- 172.21.15.112:0/3254800425 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea401a070 con 0x7faeac15e220 2024-09-15T23:53:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faea8ff9640 1 -- 172.21.15.112:0/3254800425 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea4003bc0 con 0x7faeac15e220 2024-09-15T23:53:48.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb26fa640 1 -- 172.21.15.112:0/3254800425 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeac0b2340 con 0x7faeac15e220 2024-09-15T23:53:48.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faea8ff9640 1 -- 172.21.15.112:0/3254800425 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4004030 con 0x7faeac15e220 2024-09-15T23:53:48.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb26fa640 1 -- 172.21.15.112:0/3254800425 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeac0b28c0 con 0x7faeac15e220 2024-09-15T23:53:48.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faeb26fa640 1 -- 172.21.15.112:0/3254800425 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeac09b410 con 0x7faeac15e220 2024-09-15T23:53:48.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faea8ff9640 1 -- 172.21.15.112:0/3254800425 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faea401d070 con 0x7faeac15e220 2024-09-15T23:53:48.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.846+0000 7faea8ff9640 1 --2- 172.21.15.112:0/3254800425 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fae980678c0 0x7fae98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:48.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.850+0000 7faea8ff9640 1 -- 172.21.15.112:0/3254800425 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7faea4085e80 con 0x7faeac15e220 2024-09-15T23:53:48.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.850+0000 7faeabfff640 1 --2- 172.21.15.112:0/3254800425 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fae980678c0 0x7fae98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:48.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.850+0000 7faeabfff640 1 --2- 172.21.15.112:0/3254800425 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fae980678c0 0x7fae98069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae9c007fd0 tx=0x7fae9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:48.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:48.854+0000 7faea8ff9640 1 -- 172.21.15.112:0/3254800425 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faea4010070 con 0x7faeac15e220 2024-09-15T23:53:49.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.014+0000 7faeb26fa640 1 -- 172.21.15.112:0/3254800425 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7faeac15d9e0 con 0x7faeac15e220 2024-09-15T23:53:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.682+0000 7faea8ff9640 1 -- 172.21.15.112:0/3254800425 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7faea4056b10 con 0x7faeac15e220 2024-09-15T23:53:49.685 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-15T23:53:49.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.686+0000 7faeb26fa640 1 -- 172.21.15.112:0/3254800425 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fae980678c0 msgr2=0x7fae98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:49.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.686+0000 7faeb26fa640 1 --2- 172.21.15.112:0/3254800425 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fae980678c0 0x7fae98069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae9c007fd0 tx=0x7fae9c009040 comp rx=0 tx=0).stop 2024-09-15T23:53:49.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.686+0000 7faeb26fa640 1 -- 172.21.15.112:0/3254800425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faeac15e220 msgr2=0x7faeac154a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:49.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.686+0000 7faeb26fa640 1 --2- 172.21.15.112:0/3254800425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faeac15e220 0x7faeac154a50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faea4009fa0 tx=0x7faea400d560 comp rx=0 tx=0).stop 2024-09-15T23:53:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.686+0000 7faeb26fa640 1 -- 172.21.15.112:0/3254800425 shutdown_connections 2024-09-15T23:53:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.686+0000 7faeb26fa640 1 --2- 172.21.15.112:0/3254800425 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fae980678c0 0x7fae98069d80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.686+0000 7faeb26fa640 1 --2- 172.21.15.112:0/3254800425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faeac15e220 0x7faeac154a50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.686+0000 7faeb26fa640 1 --2- 172.21.15.112:0/3254800425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeac0af5c0 0x7faeac14b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.686+0000 7faeb26fa640 1 --2- 172.21.15.112:0/3254800425 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faeac0af170 0x7faeac15d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.686+0000 7faeb26fa640 1 -- 172.21.15.112:0/3254800425 >> 172.21.15.112:0/3254800425 conn(0x7faeac0b3e90 msgr2=0x7faeac0b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.686+0000 7faeb26fa640 1 -- 172.21.15.112:0/3254800425 shutdown_connections 2024-09-15T23:53:49.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.686+0000 7faeb26fa640 1 -- 172.21.15.112:0/3254800425 wait complete. 2024-09-15T23:53:49.720 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:53:49.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f70539af640 1 Processor -- start 2024-09-15T23:53:49.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f70539af640 1 -- start start 2024-09-15T23:53:49.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f70539af640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f704c0b3330 0x7f704c0b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:49.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f70539af640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f704c15bc80 0x7f704c0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:49.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f70539af640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f704c0b3c50 con 0x7f704c0b51b0 2024-09-15T23:53:49.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f70539af640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f704c0d0b80 con 0x7f704c0b3330 2024-09-15T23:53:49.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f70539af640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f704c0d0e60 con 0x7f704c15bc80 2024-09-15T23:53:49.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f705174b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f704c0b3330 0x7f704c0b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:49.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f705174b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f704c0b3330 0x7f704c0b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46908/0 (socket says 172.21.15.112:46908) 2024-09-15T23:53:49.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f705174b640 1 -- 172.21.15.112:0/2909223303 learned_addr learned my addr 172.21.15.112:0/2909223303 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:49.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f7051f4c640 1 --2- 172.21.15.112:0/2909223303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f704c15bc80 0x7f704c0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:49.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f705174b640 1 -- 172.21.15.112:0/2909223303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f704c15bc80 msgr2=0x7f704c0b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:49.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f705174b640 1 --2- 172.21.15.112:0/2909223303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f704c15bc80 0x7f704c0b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:49.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f705174b640 1 -- 172.21.15.112:0/2909223303 >> v1:172.21.15.169:6789/0 conn(0x7f704c0b51b0 legacy=0x7f704c15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:49.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f705174b640 1 -- 172.21.15.112:0/2909223303 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f704c0b46d0 con 0x7f704c0b3330 2024-09-15T23:53:49.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f7051f4c640 1 --2- 172.21.15.112:0/2909223303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f704c15bc80 0x7f704c0b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:53:49.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f705174b640 1 --2- 172.21.15.112:0/2909223303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f704c0b3330 0x7f704c0b3710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7048009870 tx=0x7f704801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba45d6b41510f84a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:49.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.846+0000 7f7043fff640 1 -- 172.21.15.112:0/2909223303 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70480b0070 con 0x7f704c0b3330 2024-09-15T23:53:49.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7043fff640 1 -- 172.21.15.112:0/2909223303 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70480ab600 con 0x7f704c0b3330 2024-09-15T23:53:49.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7043fff640 1 -- 172.21.15.112:0/2909223303 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70480ab9d0 con 0x7f704c0b3330 2024-09-15T23:53:49.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 -- 172.21.15.112:0/2909223303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f704c0b3330 msgr2=0x7f704c0b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:49.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 --2- 172.21.15.112:0/2909223303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f704c0b3330 0x7f704c0b3710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7048009870 tx=0x7f704801c490 comp rx=0 tx=0).stop 2024-09-15T23:53:49.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 -- 172.21.15.112:0/2909223303 shutdown_connections 2024-09-15T23:53:49.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 --2- 172.21.15.112:0/2909223303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f704c15bc80 0x7f704c0b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:49.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 --2- 172.21.15.112:0/2909223303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f704c0b3330 0x7f704c0b3710 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:49.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 -- 172.21.15.112:0/2909223303 >> 172.21.15.112:0/2909223303 conn(0x7f704c0b6870 msgr2=0x7f704c0b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:49.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 -- 172.21.15.112:0/2909223303 shutdown_connections 2024-09-15T23:53:49.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 -- 172.21.15.112:0/2909223303 wait complete. 2024-09-15T23:53:49.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 Processor -- start 2024-09-15T23:53:49.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 -- start start 2024-09-15T23:53:49.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f704c0b3330 0x7f704c13fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:49.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f704c0b51b0 0x7f704c1f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:49.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f704c15bc80 0x7f704c1f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:49.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f704c0d05f0 con 0x7f704c15bc80 2024-09-15T23:53:49.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f704c144f10 con 0x7f704c0b51b0 2024-09-15T23:53:49.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f704c0d0770 con 0x7f704c0b3330 2024-09-15T23:53:49.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7051f4c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f704c15bc80 0x7f704c1f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:49.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7051f4c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f704c15bc80 0x7f704c1f5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46918/0 (socket says 172.21.15.112:46918) 2024-09-15T23:53:49.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7051f4c640 1 -- 172.21.15.112:0/334516105 learned_addr learned my addr 172.21.15.112:0/334516105 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:49.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f705174b640 1 --2- 172.21.15.112:0/334516105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f704c0b3330 0x7f704c13fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:49.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7050f4a640 1 --2- 172.21.15.112:0/334516105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f704c0b51b0 0x7f704c1f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:49.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7051f4c640 1 -- 172.21.15.112:0/334516105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f704c0b3330 msgr2=0x7f704c13fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:49.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7051f4c640 1 --2- 172.21.15.112:0/334516105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f704c0b3330 0x7f704c13fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:49.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7051f4c640 1 -- 172.21.15.112:0/334516105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f704c0b51b0 msgr2=0x7f704c1f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:49.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7051f4c640 1 --2- 172.21.15.112:0/334516105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f704c0b51b0 0x7f704c1f55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:49.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7051f4c640 1 -- 172.21.15.112:0/334516105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f704c140110 con 0x7f704c15bc80 2024-09-15T23:53:49.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7051f4c640 1 --2- 172.21.15.112:0/334516105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f704c15bc80 0x7f704c1f5b00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f704400cdb0 tx=0x7f704400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:49.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7041ffb640 1 -- 172.21.15.112:0/334516105 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7044003ba0 con 0x7f704c15bc80 2024-09-15T23:53:49.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7041ffb640 1 -- 172.21.15.112:0/334516105 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7044003d60 con 0x7f704c15bc80 2024-09-15T23:53:49.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 -- 172.21.15.112:0/334516105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f704c140390 con 0x7f704c15bc80 2024-09-15T23:53:49.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f7041ffb640 1 -- 172.21.15.112:0/334516105 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7044004260 con 0x7f704c15bc80 2024-09-15T23:53:49.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.850+0000 7f70539af640 1 -- 172.21.15.112:0/334516105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f704c140950 con 0x7f704c15bc80 2024-09-15T23:53:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.854+0000 7f70539af640 1 -- 172.21.15.112:0/334516105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f704c0b3710 con 0x7f704c15bc80 2024-09-15T23:53:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.854+0000 7f7041ffb640 1 -- 172.21.15.112:0/334516105 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7044004400 con 0x7f704c15bc80 2024-09-15T23:53:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.854+0000 7f7041ffb640 1 --2- 172.21.15.112:0/334516105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f70300678c0 0x7f7030069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.854+0000 7f7041ffb640 1 -- 172.21.15.112:0/334516105 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f7044086660 con 0x7f704c15bc80 2024-09-15T23:53:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.854+0000 7f705174b640 1 --2- 172.21.15.112:0/334516105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f70300678c0 0x7f7030069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:49.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.854+0000 7f705174b640 1 --2- 172.21.15.112:0/334516105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f70300678c0 0x7f7030069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f704c0b6350 tx=0x7f7048008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:49.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:49.858+0000 7f7041ffb640 1 -- 172.21.15.112:0/334516105 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f704c140110 con 0x7f704c15bc80 2024-09-15T23:53:50.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.054+0000 7f70539af640 1 -- 172.21.15.112:0/334516105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f704c0b1910 con 0x7f704c15bc80 2024-09-15T23:53:50.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.750+0000 7f7041ffb640 1 -- 172.21.15.112:0/334516105 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f7044014030 con 0x7f704c15bc80 2024-09-15T23:53:50.761 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T23:53:50.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.766+0000 7f70539af640 1 -- 172.21.15.112:0/334516105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f70300678c0 msgr2=0x7f7030069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:50.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.766+0000 7f70539af640 1 --2- 172.21.15.112:0/334516105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f70300678c0 0x7f7030069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f704c0b6350 tx=0x7f7048008040 comp rx=0 tx=0).stop 2024-09-15T23:53:50.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.766+0000 7f70539af640 1 -- 172.21.15.112:0/334516105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f704c15bc80 msgr2=0x7f704c1f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:50.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.766+0000 7f70539af640 1 --2- 172.21.15.112:0/334516105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f704c15bc80 0x7f704c1f5b00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f704400cdb0 tx=0x7f704400a650 comp rx=0 tx=0).stop 2024-09-15T23:53:50.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.766+0000 7f70539af640 1 -- 172.21.15.112:0/334516105 shutdown_connections 2024-09-15T23:53:50.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.766+0000 7f70539af640 1 --2- 172.21.15.112:0/334516105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f70300678c0 0x7f7030069d80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:50.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.766+0000 7f70539af640 1 --2- 172.21.15.112:0/334516105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f704c15bc80 0x7f704c1f5b00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:50.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.766+0000 7f70539af640 1 --2- 172.21.15.112:0/334516105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f704c0b51b0 0x7f704c1f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:50.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.766+0000 7f70539af640 1 --2- 172.21.15.112:0/334516105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f704c0b3330 0x7f704c13fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:50.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.766+0000 7f70539af640 1 -- 172.21.15.112:0/334516105 >> 172.21.15.112:0/334516105 conn(0x7f704c0b6870 msgr2=0x7f704c0b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:50.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.770+0000 7f70539af640 1 -- 172.21.15.112:0/334516105 shutdown_connections 2024-09-15T23:53:50.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.770+0000 7f70539af640 1 -- 172.21.15.112:0/334516105 wait complete. 2024-09-15T23:53:50.799 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-15T23:53:50.800 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-15T23:53:50.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.918+0000 7fc755123640 1 Processor -- start 2024-09-15T23:53:50.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.918+0000 7fc755123640 1 -- start start 2024-09-15T23:53:50.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc755123640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc75015bec0 0x7fc7500ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:50.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc755123640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc7500af470 0x7fc75006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:50.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc755123640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7500b3290 con 0x7fc75015c2a0 2024-09-15T23:53:50.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc755123640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc7500b3570 con 0x7fc7500af470 2024-09-15T23:53:50.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc755123640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc7500b3850 con 0x7fc75015bec0 2024-09-15T23:53:50.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc74f59e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc7500af470 0x7fc75006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:50.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc74659c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc75015c2a0 0x7fc7500aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45610/0 (socket says 172.21.15.112:45610) 2024-09-15T23:53:50.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc74659c640 1 -- 172.21.15.112:0/104096880 learned_addr learned my addr 172.21.15.112:0/104096880 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:50.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc74f59e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc7500af470 0x7fc75006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46924/0 (socket says 172.21.15.112:46924) 2024-09-15T23:53:50.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc74ed9d640 1 --2- 172.21.15.112:0/104096880 >> v2:172.21.15.169:3300/0 conn(0x7fc75015bec0 0x7fc7500ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:50.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc74f59e640 1 -- 172.21.15.112:0/104096880 >> v2:172.21.15.169:3300/0 conn(0x7fc75015bec0 msgr2=0x7fc7500ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:50.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc74f59e640 1 --2- 172.21.15.112:0/104096880 >> v2:172.21.15.169:3300/0 conn(0x7fc75015bec0 0x7fc7500ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:50.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc74f59e640 1 -- 172.21.15.112:0/104096880 >> v1:172.21.15.112:6789/0 conn(0x7fc75015c2a0 legacy=0x7fc7500aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:50.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc74f59e640 1 -- 172.21.15.112:0/104096880 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7500b3b30 con 0x7fc7500af470 2024-09-15T23:53:50.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc74f59e640 1 --2- 172.21.15.112:0/104096880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7500af470 0x7fc75006e000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc750071710 tx=0x7fc74801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bb8249efe13a0a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:50.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc74e59c640 1 -- 172.21.15.112:0/104096880 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7480b2070 con 0x7fc7500af470 2024-09-15T23:53:50.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc74e59c640 1 -- 172.21.15.112:0/104096880 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7480a59c0 con 0x7fc7500af470 2024-09-15T23:53:50.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.922+0000 7fc74e59c640 1 -- 172.21.15.112:0/104096880 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7480a5d90 con 0x7fc7500af470 2024-09-15T23:53:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 -- 172.21.15.112:0/104096880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7500af470 msgr2=0x7fc75006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 --2- 172.21.15.112:0/104096880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7500af470 0x7fc75006e000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc750071710 tx=0x7fc74801c900 comp rx=0 tx=0).stop 2024-09-15T23:53:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 -- 172.21.15.112:0/104096880 shutdown_connections 2024-09-15T23:53:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 --2- 172.21.15.112:0/104096880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7500af470 0x7fc75006e000 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 --2- 172.21.15.112:0/104096880 >> v2:172.21.15.169:3300/0 conn(0x7fc75015bec0 0x7fc7500ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 -- 172.21.15.112:0/104096880 >> 172.21.15.112:0/104096880 conn(0x7fc7500b1f90 msgr2=0x7fc7500b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 -- 172.21.15.112:0/104096880 shutdown_connections 2024-09-15T23:53:50.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 -- 172.21.15.112:0/104096880 wait complete. 2024-09-15T23:53:50.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 Processor -- start 2024-09-15T23:53:50.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 -- start start 2024-09-15T23:53:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7500af470 0x7fc7501554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc75015bec0 0x7fc750153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc75015c2a0 0x7fc7500b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc75006ed50 con 0x7fc7500af470 2024-09-15T23:53:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7500ad740 con 0x7fc75015c2a0 2024-09-15T23:53:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc75006eed0 con 0x7fc75015bec0 2024-09-15T23:53:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc74ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7500af470 0x7fc7501554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc74ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7500af470 0x7fc7501554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46930/0 (socket says 172.21.15.112:46930) 2024-09-15T23:53:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc74ed9d640 1 -- 172.21.15.112:0/1110227372 learned_addr learned my addr 172.21.15.112:0/1110227372 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:50.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc74659c640 1 --2- 172.21.15.112:0/1110227372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc75015bec0 0x7fc750153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc74ed9d640 1 -- 172.21.15.112:0/1110227372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc75015bec0 msgr2=0x7fc750153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc74ed9d640 1 --2- 172.21.15.112:0/1110227372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc75015bec0 0x7fc750153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc74ed9d640 1 -- 172.21.15.112:0/1110227372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc75015c2a0 msgr2=0x7fc7500b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc74ed9d640 1 --2- 172.21.15.112:0/1110227372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc75015c2a0 0x7fc7500b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc74ed9d640 1 -- 172.21.15.112:0/1110227372 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75014eb30 con 0x7fc7500af470 2024-09-15T23:53:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc74ed9d640 1 --2- 172.21.15.112:0/1110227372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7500af470 0x7fc7501554a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc74000d800 tx=0x7fc74000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc747fff640 1 -- 172.21.15.112:0/1110227372 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74000b6c0 con 0x7fc7500af470 2024-09-15T23:53:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc747fff640 1 -- 172.21.15.112:0/1110227372 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc740019070 con 0x7fc7500af470 2024-09-15T23:53:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 -- 172.21.15.112:0/1110227372 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc750155aa0 con 0x7fc7500af470 2024-09-15T23:53:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc747fff640 1 -- 172.21.15.112:0/1110227372 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74000ba60 con 0x7fc7500af470 2024-09-15T23:53:50.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 -- 172.21.15.112:0/1110227372 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75014f0b0 con 0x7fc7500af470 2024-09-15T23:53:50.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.926+0000 7fc755123640 1 -- 172.21.15.112:0/1110227372 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc75006f260 con 0x7fc7500af470 2024-09-15T23:53:50.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.930+0000 7fc747fff640 1 -- 172.21.15.112:0/1110227372 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc74000bc00 con 0x7fc7500af470 2024-09-15T23:53:50.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.930+0000 7fc747fff640 1 --2- 172.21.15.112:0/1110227372 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7300678c0 0x7fc730069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:50.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.930+0000 7fc747fff640 1 -- 172.21.15.112:0/1110227372 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc740086170 con 0x7fc7500af470 2024-09-15T23:53:50.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.930+0000 7fc74659c640 1 --2- 172.21.15.112:0/1110227372 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7300678c0 0x7fc730069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:50.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.930+0000 7fc74659c640 1 --2- 172.21.15.112:0/1110227372 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7300678c0 0x7fc730069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc75013dd00 tx=0x7fc738009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:50.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:50.934+0000 7fc747fff640 1 -- 172.21.15.112:0/1110227372 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc740056cb0 con 0x7fc7500af470 2024-09-15T23:53:51.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.102+0000 7fc755123640 1 -- 172.21.15.112:0/1110227372 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fc75006fcd0 con 0x7fc7500af470 2024-09-15T23:53:51.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.758+0000 7fc747fff640 1 -- 172.21.15.112:0/1110227372 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7fc7400565b0 con 0x7fc7500af470 2024-09-15T23:53:51.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.762+0000 7fc755123640 1 -- 172.21.15.112:0/1110227372 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7300678c0 msgr2=0x7fc730069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:51.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.762+0000 7fc755123640 1 --2- 172.21.15.112:0/1110227372 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7300678c0 0x7fc730069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc75013dd00 tx=0x7fc738009040 comp rx=0 tx=0).stop 2024-09-15T23:53:51.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.762+0000 7fc755123640 1 -- 172.21.15.112:0/1110227372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7500af470 msgr2=0x7fc7501554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:51.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.762+0000 7fc755123640 1 --2- 172.21.15.112:0/1110227372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7500af470 0x7fc7501554a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc74000d800 tx=0x7fc74000dcc0 comp rx=0 tx=0).stop 2024-09-15T23:53:51.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.762+0000 7fc755123640 1 -- 172.21.15.112:0/1110227372 shutdown_connections 2024-09-15T23:53:51.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.762+0000 7fc755123640 1 --2- 172.21.15.112:0/1110227372 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7300678c0 0x7fc730069d80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:51.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.762+0000 7fc755123640 1 --2- 172.21.15.112:0/1110227372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc75015c2a0 0x7fc7500b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:51.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.762+0000 7fc755123640 1 --2- 172.21.15.112:0/1110227372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc75015bec0 0x7fc750153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:51.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.762+0000 7fc755123640 1 --2- 172.21.15.112:0/1110227372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7500af470 0x7fc7501554a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:51.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.762+0000 7fc755123640 1 -- 172.21.15.112:0/1110227372 >> 172.21.15.112:0/1110227372 conn(0x7fc7500b1f90 msgr2=0x7fc7500cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:51.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.762+0000 7fc755123640 1 -- 172.21.15.112:0/1110227372 shutdown_connections 2024-09-15T23:53:51.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.762+0000 7fc755123640 1 -- 172.21.15.112:0/1110227372 wait complete. 2024-09-15T23:53:51.783 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:53:51.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.918+0000 7f5c5c70b640 1 Processor -- start 2024-09-15T23:53:51.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.918+0000 7f5c5c70b640 1 -- start start 2024-09-15T23:53:51.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c5c70b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5c540cef80 0x7f5c540adf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:51.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c5c70b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c540d0560 0x7f5c540d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:51.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c5c70b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c540cf500 con 0x7f5c5406f4c0 2024-09-15T23:53:51.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c5c70b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5c540ae4b0 con 0x7f5c540cef80 2024-09-15T23:53:51.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c5c70b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5c540ae700 con 0x7f5c540d0560 2024-09-15T23:53:51.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c5a4a7640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5c5406f4c0 0x7f5c541448b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45622/0 (socket says 172.21.15.112:45622) 2024-09-15T23:53:51.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c59ca6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5c540cef80 0x7f5c540adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:51.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c5a4a7640 1 -- 172.21.15.112:0/3642890295 learned_addr learned my addr 172.21.15.112:0/3642890295 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:51.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c5aca8640 1 --2- 172.21.15.112:0/3642890295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c540d0560 0x7f5c540d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:51.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c59ca6640 1 -- 172.21.15.112:0/3642890295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c540d0560 msgr2=0x7f5c540d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:51.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c59ca6640 1 --2- 172.21.15.112:0/3642890295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c540d0560 0x7f5c540d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:51.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c59ca6640 1 -- 172.21.15.112:0/3642890295 >> v1:172.21.15.112:6789/0 conn(0x7f5c5406f4c0 legacy=0x7f5c541448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:51.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c59ca6640 1 -- 172.21.15.112:0/3642890295 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c540cf7a0 con 0x7f5c540cef80 2024-09-15T23:53:51.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c59ca6640 1 --2- 172.21.15.112:0/3642890295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540cef80 0x7f5c540adf70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5c540ae630 tx=0x7f5c4401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4ade3f075f3d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:51.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c594a5640 1 -- 172.21.15.112:0/3642890295 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c440b0070 con 0x7f5c540cef80 2024-09-15T23:53:51.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c594a5640 1 -- 172.21.15.112:0/3642890295 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c440ab600 con 0x7f5c540cef80 2024-09-15T23:53:51.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c594a5640 1 -- 172.21.15.112:0/3642890295 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c440ab9d0 con 0x7f5c540cef80 2024-09-15T23:53:51.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c5c70b640 1 -- 172.21.15.112:0/3642890295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540cef80 msgr2=0x7f5c540adf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:51.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.922+0000 7f5c5c70b640 1 --2- 172.21.15.112:0/3642890295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540cef80 0x7f5c540adf70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5c540ae630 tx=0x7f5c4401c410 comp rx=0 tx=0).stop 2024-09-15T23:53:51.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 -- 172.21.15.112:0/3642890295 shutdown_connections 2024-09-15T23:53:51.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 --2- 172.21.15.112:0/3642890295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c540d0560 0x7f5c540d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:51.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 --2- 172.21.15.112:0/3642890295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540cef80 0x7f5c540adf70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:51.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 -- 172.21.15.112:0/3642890295 >> 172.21.15.112:0/3642890295 conn(0x7f5c5406d1d0 msgr2=0x7f5c5406d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:51.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 -- 172.21.15.112:0/3642890295 shutdown_connections 2024-09-15T23:53:51.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 -- 172.21.15.112:0/3642890295 wait complete. 2024-09-15T23:53:51.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 Processor -- start 2024-09-15T23:53:51.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 -- start start 2024-09-15T23:53:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c5406f4c0 0x7f5c5414e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c540cef80 0x7f5c5415d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540d0560 0x7f5c5415db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5c54167ec0 con 0x7f5c540d0560 2024-09-15T23:53:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5c54167d40 con 0x7f5c540cef80 2024-09-15T23:53:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5c54168040 con 0x7f5c5406f4c0 2024-09-15T23:53:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5aca8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540d0560 0x7f5c5415db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5aca8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540d0560 0x7f5c5415db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46962/0 (socket says 172.21.15.112:46962) 2024-09-15T23:53:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5aca8640 1 -- 172.21.15.112:0/1686628055 learned_addr learned my addr 172.21.15.112:0/1686628055 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5a4a7640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c5406f4c0 0x7f5c5414e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c59ca6640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c540cef80 0x7f5c5415d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5aca8640 1 -- 172.21.15.112:0/1686628055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c5406f4c0 msgr2=0x7f5c5414e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5aca8640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c5406f4c0 0x7f5c5414e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5aca8640 1 -- 172.21.15.112:0/1686628055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c540cef80 msgr2=0x7f5c5415d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5aca8640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c540cef80 0x7f5c5415d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5aca8640 1 -- 172.21.15.112:0/1686628055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c540b5450 con 0x7f5c540d0560 2024-09-15T23:53:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5a4a7640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c5406f4c0 0x7f5c5414e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:53:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5aca8640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540d0560 0x7f5c5415db50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c007e60 tx=0x7f5c4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c4affd640 1 -- 172.21.15.112:0/1686628055 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c014420 con 0x7f5c540d0560 2024-09-15T23:53:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c4affd640 1 -- 172.21.15.112:0/1686628055 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c4c019070 con 0x7f5c540d0560 2024-09-15T23:53:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 -- 172.21.15.112:0/1686628055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c540b5730 con 0x7f5c540d0560 2024-09-15T23:53:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c4affd640 1 -- 172.21.15.112:0/1686628055 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c014820 con 0x7f5c540d0560 2024-09-15T23:53:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 -- 172.21.15.112:0/1686628055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c540b5cf0 con 0x7f5c540d0560 2024-09-15T23:53:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.926+0000 7f5c5c70b640 1 -- 172.21.15.112:0/1686628055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c540adf70 con 0x7f5c540d0560 2024-09-15T23:53:51.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.930+0000 7f5c4affd640 1 -- 172.21.15.112:0/1686628055 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5c4c0149c0 con 0x7f5c540d0560 2024-09-15T23:53:51.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.930+0000 7f5c4affd640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5c380678c0 0x7f5c38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:51.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.930+0000 7f5c4affd640 1 -- 172.21.15.112:0/1686628055 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7f5c4c086610 con 0x7f5c540d0560 2024-09-15T23:53:51.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.930+0000 7f5c5a4a7640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5c380678c0 0x7f5c38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:51.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.930+0000 7f5c5a4a7640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5c380678c0 0x7f5c38069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5c50007fd0 tx=0x7f5c50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:51.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:51.934+0000 7f5c4affd640 1 -- 172.21.15.112:0/1686628055 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5c4c057020 con 0x7f5c540d0560 2024-09-15T23:53:52.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:52.098+0000 7f5c5c70b640 1 -- 172.21.15.112:0/1686628055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f5c541420b0 con 0x7f5c540d0560 2024-09-15T23:53:53.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.770+0000 7f5c4affd640 1 -- 172.21.15.112:0/1686628055 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7f5c4c056920 con 0x7f5c540d0560 2024-09-15T23:53:53.773 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data_ec' created 2024-09-15T23:53:53.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.774+0000 7f5c5c70b640 1 -- 172.21.15.112:0/1686628055 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5c380678c0 msgr2=0x7f5c38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:53.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.774+0000 7f5c5c70b640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5c380678c0 0x7f5c38069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5c50007fd0 tx=0x7f5c50009040 comp rx=0 tx=0).stop 2024-09-15T23:53:53.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.774+0000 7f5c5c70b640 1 -- 172.21.15.112:0/1686628055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540d0560 msgr2=0x7f5c5415db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:53.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.774+0000 7f5c5c70b640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540d0560 0x7f5c5415db50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c007e60 tx=0x7f5c4c00e4b0 comp rx=0 tx=0).stop 2024-09-15T23:53:53.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.774+0000 7f5c5c70b640 1 -- 172.21.15.112:0/1686628055 shutdown_connections 2024-09-15T23:53:53.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.774+0000 7f5c5c70b640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5c380678c0 0x7f5c38069d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:53.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.774+0000 7f5c5c70b640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540d0560 0x7f5c5415db50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:53.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.774+0000 7f5c5c70b640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c540cef80 0x7f5c5415d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:53.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.774+0000 7f5c5c70b640 1 --2- 172.21.15.112:0/1686628055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c5406f4c0 0x7f5c5414e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:53.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.774+0000 7f5c5c70b640 1 -- 172.21.15.112:0/1686628055 >> 172.21.15.112:0/1686628055 conn(0x7f5c5406d1d0 msgr2=0x7f5c54143570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:53.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.774+0000 7f5c5c70b640 1 -- 172.21.15.112:0/1686628055 shutdown_connections 2024-09-15T23:53:53.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.774+0000 7f5c5c70b640 1 -- 172.21.15.112:0/1686628055 wait complete. 2024-09-15T23:53:53.805 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-15T23:53:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.930+0000 7fcfa464a640 1 Processor -- start 2024-09-15T23:53:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.930+0000 7fcfa464a640 1 -- start start 2024-09-15T23:53:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.930+0000 7fcfa464a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcf9c1457a0 0x7fcf9c0d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.930+0000 7fcfa464a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcf9c0cf800 0x7fcf9c0b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.930+0000 7fcfa464a640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf9c0d27a0 con 0x7fcf9c0b4340 2024-09-15T23:53:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.930+0000 7fcfa464a640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcf9c0d1720 con 0x7fcf9c1457a0 2024-09-15T23:53:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.930+0000 7fcfa464a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fcf9c0b4790 con 0x7fcf9c0cf800 2024-09-15T23:53:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.930+0000 7fcfa23e6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcf9c1457a0 0x7fcf9c0d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:53.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.930+0000 7fcfa2be7640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcf9c0b4340 0x7fcf9c15ff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45636/0 (socket says 172.21.15.112:45636) 2024-09-15T23:53:53.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.930+0000 7fcfa2be7640 1 -- 172.21.15.112:0/1554207527 learned_addr learned my addr 172.21.15.112:0/1554207527 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:53.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa1be5640 1 --2- 172.21.15.112:0/1554207527 >> v2:172.21.15.169:3300/0 conn(0x7fcf9c0cf800 0x7fcf9c0b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:53.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa23e6640 1 -- 172.21.15.112:0/1554207527 >> v2:172.21.15.169:3300/0 conn(0x7fcf9c0cf800 msgr2=0x7fcf9c0b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:53.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa23e6640 1 --2- 172.21.15.112:0/1554207527 >> v2:172.21.15.169:3300/0 conn(0x7fcf9c0cf800 0x7fcf9c0b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:53.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa23e6640 1 -- 172.21.15.112:0/1554207527 >> v1:172.21.15.112:6789/0 conn(0x7fcf9c0b4340 legacy=0x7fcf9c15ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:53.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa13e4640 1 -- 172.21.15.112:0/1554207527 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2356200543 0 0) 0x7fcf9c0d27a0 con 0x7fcf9c0b4340 2024-09-15T23:53:53.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa23e6640 1 -- 172.21.15.112:0/1554207527 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9c0d2a80 con 0x7fcf9c1457a0 2024-09-15T23:53:53.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa23e6640 1 --2- 172.21.15.112:0/1554207527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf9c1457a0 0x7fcf9c0d1ea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0cfc70 tx=0x7fcf9801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48935fc064ce8ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:53.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa13e4640 1 -- 172.21.15.112:0/1554207527 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf980b0070 con 0x7fcf9c1457a0 2024-09-15T23:53:53.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa13e4640 1 -- 172.21.15.112:0/1554207527 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf980ab600 con 0x7fcf9c1457a0 2024-09-15T23:53:53.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa13e4640 1 -- 172.21.15.112:0/1554207527 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf980ab9d0 con 0x7fcf9c1457a0 2024-09-15T23:53:53.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa464a640 1 -- 172.21.15.112:0/1554207527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf9c1457a0 msgr2=0x7fcf9c0d1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:53.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa464a640 1 --2- 172.21.15.112:0/1554207527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf9c1457a0 0x7fcf9c0d1ea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0cfc70 tx=0x7fcf9801c3f0 comp rx=0 tx=0).stop 2024-09-15T23:53:53.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa464a640 1 -- 172.21.15.112:0/1554207527 shutdown_connections 2024-09-15T23:53:53.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa464a640 1 --2- 172.21.15.112:0/1554207527 >> v2:172.21.15.169:3300/0 conn(0x7fcf9c0cf800 0x7fcf9c0b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:53.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa464a640 1 --2- 172.21.15.112:0/1554207527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf9c1457a0 0x7fcf9c0d1ea0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:53.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa464a640 1 -- 172.21.15.112:0/1554207527 >> 172.21.15.112:0/1554207527 conn(0x7fcf9c06bcc0 msgr2=0x7fcf9c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:53.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa464a640 1 -- 172.21.15.112:0/1554207527 shutdown_connections 2024-09-15T23:53:53.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.934+0000 7fcfa464a640 1 -- 172.21.15.112:0/1554207527 wait complete. 2024-09-15T23:53:53.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa464a640 1 Processor -- start 2024-09-15T23:53:53.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa464a640 1 -- start start 2024-09-15T23:53:53.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa464a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf9c0b4340 0x7fcf9c158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:53.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa464a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf9c0cf800 0x7fcf9c0cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:53.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa464a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf9c1457a0 0x7fcf9c0cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:53.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa464a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c0b52f0 con 0x7fcf9c0cf800 2024-09-15T23:53:53.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa464a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c0b5170 con 0x7fcf9c0b4340 2024-09-15T23:53:53.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa464a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcf9c1690b0 con 0x7fcf9c1457a0 2024-09-15T23:53:53.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa1be5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf9c0cf800 0x7fcf9c0cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:53.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa1be5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf9c0cf800 0x7fcf9c0cb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46980/0 (socket says 172.21.15.112:46980) 2024-09-15T23:53:53.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa1be5640 1 -- 172.21.15.112:0/1990046670 learned_addr learned my addr 172.21.15.112:0/1990046670 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:53.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa23e6640 1 --2- 172.21.15.112:0/1990046670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf9c0b4340 0x7fcf9c158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:53.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa1be5640 1 -- 172.21.15.112:0/1990046670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf9c1457a0 msgr2=0x7fcf9c0cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:53.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa1be5640 1 --2- 172.21.15.112:0/1990046670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf9c1457a0 0x7fcf9c0cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:53.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa1be5640 1 -- 172.21.15.112:0/1990046670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf9c0b4340 msgr2=0x7fcf9c158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:53.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa1be5640 1 --2- 172.21.15.112:0/1990046670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf9c0b4340 0x7fcf9c158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:53.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa1be5640 1 -- 172.21.15.112:0/1990046670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9c1fa3d0 con 0x7fcf9c0cf800 2024-09-15T23:53:53.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa1be5640 1 --2- 172.21.15.112:0/1990046670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf9c0cf800 0x7fcf9c0cb4f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00d800 tx=0x7fcf8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:53.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcf92ffd640 1 -- 172.21.15.112:0/1990046670 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00b6c0 con 0x7fcf9c0cf800 2024-09-15T23:53:53.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcf92ffd640 1 -- 172.21.15.112:0/1990046670 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf8c019070 con 0x7fcf9c0cf800 2024-09-15T23:53:53.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcf92ffd640 1 -- 172.21.15.112:0/1990046670 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00ba60 con 0x7fcf9c0cf800 2024-09-15T23:53:53.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa464a640 1 -- 172.21.15.112:0/1990046670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9c1fa6b0 con 0x7fcf9c0cf800 2024-09-15T23:53:53.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa464a640 1 -- 172.21.15.112:0/1990046670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf9c1fac70 con 0x7fcf9c0cf800 2024-09-15T23:53:53.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcfa464a640 1 -- 172.21.15.112:0/1990046670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf9c0b3e00 con 0x7fcf9c0cf800 2024-09-15T23:53:53.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.938+0000 7fcf92ffd640 1 -- 172.21.15.112:0/1990046670 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf8c00bc00 con 0x7fcf9c0cf800 2024-09-15T23:53:53.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.942+0000 7fcf92ffd640 1 --2- 172.21.15.112:0/1990046670 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcf800678c0 0x7fcf80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:53.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.942+0000 7fcf92ffd640 1 -- 172.21.15.112:0/1990046670 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7fcf8c086470 con 0x7fcf9c0cf800 2024-09-15T23:53:53.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.942+0000 7fcfa23e6640 1 --2- 172.21.15.112:0/1990046670 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcf800678c0 0x7fcf80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:53.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.942+0000 7fcfa23e6640 1 --2- 172.21.15.112:0/1990046670 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcf800678c0 0x7fcf80069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf980ad000 tx=0x7fcf980a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:53.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:53.946+0000 7fcf92ffd640 1 -- 172.21.15.112:0/1990046670 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcf8c056c90 con 0x7fcf9c0cf800 2024-09-15T23:53:54.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.106+0000 7fcfa464a640 1 -- 172.21.15.112:0/1990046670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fcf9c0b5f90 con 0x7fcf9c0cf800 2024-09-15T23:53:54.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.774+0000 7fcf92ffd640 1 -- 172.21.15.112:0/1990046670 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7fcf8c056590 con 0x7fcf9c0cf800 2024-09-15T23:53:54.776 INFO:teuthology.orchestra.run.smithi112.stderr:set pool 4 allow_ec_overwrites to true 2024-09-15T23:53:54.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.778+0000 7fcfa464a640 1 -- 172.21.15.112:0/1990046670 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcf800678c0 msgr2=0x7fcf80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:54.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.778+0000 7fcfa464a640 1 --2- 172.21.15.112:0/1990046670 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcf800678c0 0x7fcf80069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf980ad000 tx=0x7fcf980a6000 comp rx=0 tx=0).stop 2024-09-15T23:53:54.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.778+0000 7fcfa464a640 1 -- 172.21.15.112:0/1990046670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf9c0cf800 msgr2=0x7fcf9c0cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:54.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.778+0000 7fcfa464a640 1 --2- 172.21.15.112:0/1990046670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf9c0cf800 0x7fcf9c0cb4f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00d800 tx=0x7fcf8c00dcc0 comp rx=0 tx=0).stop 2024-09-15T23:53:54.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.778+0000 7fcfa464a640 1 -- 172.21.15.112:0/1990046670 shutdown_connections 2024-09-15T23:53:54.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.778+0000 7fcfa464a640 1 --2- 172.21.15.112:0/1990046670 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcf800678c0 0x7fcf80069d80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:54.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.778+0000 7fcfa464a640 1 --2- 172.21.15.112:0/1990046670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf9c1457a0 0x7fcf9c0cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:54.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.778+0000 7fcfa464a640 1 --2- 172.21.15.112:0/1990046670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf9c0cf800 0x7fcf9c0cb4f0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00d800 tx=0x7fcf8c00dcc0 comp rx=0 tx=0).stop 2024-09-15T23:53:54.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.778+0000 7fcfa464a640 1 --2- 172.21.15.112:0/1990046670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf9c0b4340 0x7fcf9c158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:54.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.778+0000 7fcfa464a640 1 -- 172.21.15.112:0/1990046670 >> 172.21.15.112:0/1990046670 conn(0x7fcf9c06bcc0 msgr2=0x7fcf9c0d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:54.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.778+0000 7fcfa464a640 1 -- 172.21.15.112:0/1990046670 shutdown_connections 2024-09-15T23:53:54.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.778+0000 7fcfa464a640 1 -- 172.21.15.112:0/1990046670 wait complete. 2024-09-15T23:53:54.814 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-15T23:53:54.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f045bd640 1 Processor -- start 2024-09-15T23:53:54.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f045bd640 1 -- start start 2024-09-15T23:53:54.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f045bd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8efc0b39a0 0x7f8efc06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:54.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f045bd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8efc06e4b0 0x7f8efc072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:54.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f045bd640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8efc06ec60 con 0x7f8efc1587a0 2024-09-15T23:53:54.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f045bd640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8efc06f870 con 0x7f8efc06e4b0 2024-09-15T23:53:54.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f045bd640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8efc06ef40 con 0x7f8efc0b39a0 2024-09-15T23:53:54.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f02b5a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8efc06e4b0 0x7f8efc072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:54.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f02359640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8efc1587a0 0x7f8efc0b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45648/0 (socket says 172.21.15.112:45648) 2024-09-15T23:53:54.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f02359640 1 -- 172.21.15.112:0/2972517059 learned_addr learned my addr 172.21.15.112:0/2972517059 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:54.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f02b5a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8efc06e4b0 0x7f8efc072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46992/0 (socket says 172.21.15.112:46992) 2024-09-15T23:53:54.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f01b58640 1 --2- 172.21.15.112:0/2972517059 >> v2:172.21.15.169:3300/0 conn(0x7f8efc0b39a0 0x7f8efc06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:54.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f02b5a640 1 -- 172.21.15.112:0/2972517059 >> v2:172.21.15.169:3300/0 conn(0x7f8efc0b39a0 msgr2=0x7f8efc06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:54.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f02b5a640 1 --2- 172.21.15.112:0/2972517059 >> v2:172.21.15.169:3300/0 conn(0x7f8efc0b39a0 0x7f8efc06df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:54.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f02b5a640 1 -- 172.21.15.112:0/2972517059 >> v1:172.21.15.112:6789/0 conn(0x7f8efc1587a0 legacy=0x7f8efc0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:54.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.938+0000 7f8f02b5a640 1 -- 172.21.15.112:0/2972517059 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8efc06f220 con 0x7f8efc06e4b0 2024-09-15T23:53:54.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f02b5a640 1 --2- 172.21.15.112:0/2972517059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8efc06e4b0 0x7f8efc072160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0af900 tx=0x7f8ef401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d84979ac1e93845 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:54.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f01357640 1 -- 172.21.15.112:0/2972517059 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef40b2070 con 0x7f8efc06e4b0 2024-09-15T23:53:54.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f01357640 1 -- 172.21.15.112:0/2972517059 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef40a5950 con 0x7f8efc06e4b0 2024-09-15T23:53:54.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f01357640 1 -- 172.21.15.112:0/2972517059 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef40a5d20 con 0x7f8efc06e4b0 2024-09-15T23:53:54.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 -- 172.21.15.112:0/2972517059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8efc06e4b0 msgr2=0x7f8efc072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:54.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 --2- 172.21.15.112:0/2972517059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8efc06e4b0 0x7f8efc072160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0af900 tx=0x7f8ef401c900 comp rx=0 tx=0).stop 2024-09-15T23:53:54.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 -- 172.21.15.112:0/2972517059 shutdown_connections 2024-09-15T23:53:54.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 --2- 172.21.15.112:0/2972517059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8efc06e4b0 0x7f8efc072160 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:54.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 --2- 172.21.15.112:0/2972517059 >> v2:172.21.15.169:3300/0 conn(0x7f8efc0b39a0 0x7f8efc06df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:54.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 -- 172.21.15.112:0/2972517059 >> 172.21.15.112:0/2972517059 conn(0x7f8efc0b1f90 msgr2=0x7f8efc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:54.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 -- 172.21.15.112:0/2972517059 shutdown_connections 2024-09-15T23:53:54.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 -- 172.21.15.112:0/2972517059 wait complete. 2024-09-15T23:53:54.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 Processor -- start 2024-09-15T23:53:54.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 -- start start 2024-09-15T23:53:54.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8efc06e4b0 0x7f8efc1524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:54.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8efc0b39a0 0x7f8efc147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:54.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8efc1587a0 0x7f8efc0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:54.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc073030 con 0x7f8efc06e4b0 2024-09-15T23:53:54.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc072eb0 con 0x7f8efc0b39a0 2024-09-15T23:53:54.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f045bd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8efc0731b0 con 0x7f8efc1587a0 2024-09-15T23:53:54.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f02359640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8efc06e4b0 0x7f8efc1524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:54.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f02359640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8efc06e4b0 0x7f8efc1524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47002/0 (socket says 172.21.15.112:47002) 2024-09-15T23:53:54.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f02359640 1 -- 172.21.15.112:0/1487062564 learned_addr learned my addr 172.21.15.112:0/1487062564 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:54.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f02359640 1 -- 172.21.15.112:0/1487062564 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8efc1587a0 msgr2=0x7f8efc0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:54.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f02359640 1 --2- 172.21.15.112:0/1487062564 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8efc1587a0 0x7f8efc0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:54.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f01b58640 1 --2- 172.21.15.112:0/1487062564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8efc0b39a0 0x7f8efc147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:54.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f02359640 1 -- 172.21.15.112:0/1487062564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8efc0b39a0 msgr2=0x7f8efc147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:54.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f02359640 1 --2- 172.21.15.112:0/1487062564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8efc0b39a0 0x7f8efc147000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:54.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.942+0000 7f8f02359640 1 -- 172.21.15.112:0/1487062564 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8efc15bb30 con 0x7f8efc06e4b0 2024-09-15T23:53:54.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.946+0000 7f8f02359640 1 --2- 172.21.15.112:0/1487062564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8efc06e4b0 0x7f8efc1524d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00c370 tx=0x7f8eec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:54.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.946+0000 7f8ef2ffd640 1 -- 172.21.15.112:0/1487062564 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec017070 con 0x7f8efc06e4b0 2024-09-15T23:53:54.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.946+0000 7f8ef2ffd640 1 -- 172.21.15.112:0/1487062564 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eec005cf0 con 0x7f8efc06e4b0 2024-09-15T23:53:54.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.946+0000 7f8ef2ffd640 1 -- 172.21.15.112:0/1487062564 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0072f0 con 0x7f8efc06e4b0 2024-09-15T23:53:54.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.946+0000 7f8f045bd640 1 -- 172.21.15.112:0/1487062564 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8efc15be10 con 0x7f8efc06e4b0 2024-09-15T23:53:54.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.946+0000 7f8f045bd640 1 -- 172.21.15.112:0/1487062564 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8efc15c3d0 con 0x7f8efc06e4b0 2024-09-15T23:53:54.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.946+0000 7f8f045bd640 1 -- 172.21.15.112:0/1487062564 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8efc072160 con 0x7f8efc06e4b0 2024-09-15T23:53:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.946+0000 7f8ef2ffd640 1 -- 172.21.15.112:0/1487062564 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8eec01a070 con 0x7f8efc06e4b0 2024-09-15T23:53:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.946+0000 7f8ef2ffd640 1 --2- 172.21.15.112:0/1487062564 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8ee00678c0 0x7f8ee0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.946+0000 7f8ef2ffd640 1 -- 172.21.15.112:0/1487062564 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f8eec0852f0 con 0x7f8efc06e4b0 2024-09-15T23:53:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.946+0000 7f8f01b58640 1 --2- 172.21.15.112:0/1487062564 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8ee00678c0 0x7f8ee0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.946+0000 7f8f01b58640 1 --2- 172.21.15.112:0/1487062564 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8ee00678c0 0x7f8ee0069d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8efc156280 tx=0x7f8ef8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:54.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:54.950+0000 7f8ef2ffd640 1 -- 172.21.15.112:0/1487062564 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8eec055ba0 con 0x7f8efc06e4b0 2024-09-15T23:53:55.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.158+0000 7f8f045bd640 1 -- 172.21.15.112:0/1487062564 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f8efc070080 con 0x7f8efc06e4b0 2024-09-15T23:53:55.673 INFO:tasks.ceph.mds.d.smithi169.stderr:2024-09-15T23:53:55.671+0000 7f2e36445640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:53:55.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.806+0000 7f8ef2ffd640 1 -- 172.21.15.112:0/1487062564 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f8eec0554a0 con 0x7f8efc06e4b0 2024-09-15T23:53:55.808 INFO:teuthology.orchestra.run.smithi112.stderr:added data pool 4 to fsmap 2024-09-15T23:53:55.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.810+0000 7f8f045bd640 1 -- 172.21.15.112:0/1487062564 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8ee00678c0 msgr2=0x7f8ee0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:55.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.810+0000 7f8f045bd640 1 --2- 172.21.15.112:0/1487062564 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8ee00678c0 0x7f8ee0069d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8efc156280 tx=0x7f8ef8008040 comp rx=0 tx=0).stop 2024-09-15T23:53:55.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.810+0000 7f8f045bd640 1 -- 172.21.15.112:0/1487062564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8efc06e4b0 msgr2=0x7f8efc1524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:55.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.810+0000 7f8f045bd640 1 --2- 172.21.15.112:0/1487062564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8efc06e4b0 0x7f8efc1524d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00c370 tx=0x7f8eec00c830 comp rx=0 tx=0).stop 2024-09-15T23:53:55.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.810+0000 7f8f045bd640 1 -- 172.21.15.112:0/1487062564 shutdown_connections 2024-09-15T23:53:55.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.810+0000 7f8f045bd640 1 --2- 172.21.15.112:0/1487062564 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8ee00678c0 0x7f8ee0069d80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:55.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.810+0000 7f8f045bd640 1 --2- 172.21.15.112:0/1487062564 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8efc1587a0 0x7f8efc0adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:55.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.810+0000 7f8f045bd640 1 --2- 172.21.15.112:0/1487062564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8efc0b39a0 0x7f8efc147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:55.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.810+0000 7f8f045bd640 1 --2- 172.21.15.112:0/1487062564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8efc06e4b0 0x7f8efc1524d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:55.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.810+0000 7f8f045bd640 1 -- 172.21.15.112:0/1487062564 >> 172.21.15.112:0/1487062564 conn(0x7f8efc0b1f90 msgr2=0x7f8efc15f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:55.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.810+0000 7f8f045bd640 1 -- 172.21.15.112:0/1487062564 shutdown_connections 2024-09-15T23:53:55.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.810+0000 7f8f045bd640 1 -- 172.21.15.112:0/1487062564 wait complete. 2024-09-15T23:53:55.831 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:53:55.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f200e913640 1 Processor -- start 2024-09-15T23:53:55.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f200e913640 1 -- start start 2024-09-15T23:53:55.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f200e913640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f200815bec0 0x7f20080ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f200e913640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f20080af470 0x7f200806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f200e913640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20080b3290 con 0x7f200815c2a0 2024-09-15T23:53:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f200e913640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f20080b3570 con 0x7f20080af470 2024-09-15T23:53:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f200e913640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f20080b3850 con 0x7f200815bec0 2024-09-15T23:53:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f200ceb0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f20080af470 0x7f200806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f200ceb0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f20080af470 0x7f200806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47004/0 (socket says 172.21.15.112:47004) 2024-09-15T23:53:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f200ceb0640 1 -- 172.21.15.112:0/2567013967 learned_addr learned my addr 172.21.15.112:0/2567013967 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f2007fff640 1 --2- 172.21.15.112:0/2567013967 >> v2:172.21.15.169:3300/0 conn(0x7f200815bec0 0x7f20080ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f200ceb0640 1 -- 172.21.15.112:0/2567013967 >> v2:172.21.15.169:3300/0 conn(0x7f200815bec0 msgr2=0x7f20080ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f200ceb0640 1 --2- 172.21.15.112:0/2567013967 >> v2:172.21.15.169:3300/0 conn(0x7f200815bec0 0x7f20080ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f200ceb0640 1 -- 172.21.15.112:0/2567013967 >> v1:172.21.15.169:6789/0 conn(0x7f200815c2a0 legacy=0x7f20080aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:55.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.954+0000 7f200ceb0640 1 -- 172.21.15.112:0/2567013967 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20080b3b30 con 0x7f20080af470 2024-09-15T23:53:55.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.958+0000 7f200ceb0640 1 --2- 172.21.15.112:0/2567013967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20080af470 0x7f200806e000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2008071710 tx=0x7f200001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b33918300988bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:55.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.958+0000 7f2006ffd640 1 -- 172.21.15.112:0/2567013967 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20000a5840 con 0x7f20080af470 2024-09-15T23:53:55.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.958+0000 7f2006ffd640 1 -- 172.21.15.112:0/2567013967 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20000a59e0 con 0x7f20080af470 2024-09-15T23:53:55.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.958+0000 7f2006ffd640 1 -- 172.21.15.112:0/2567013967 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20000a5db0 con 0x7f20080af470 2024-09-15T23:53:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.958+0000 7f200e913640 1 -- 172.21.15.112:0/2567013967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20080af470 msgr2=0x7f200806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.958+0000 7f200e913640 1 --2- 172.21.15.112:0/2567013967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20080af470 0x7f200806e000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2008071710 tx=0x7f200001c980 comp rx=0 tx=0).stop 2024-09-15T23:53:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.958+0000 7f200e913640 1 -- 172.21.15.112:0/2567013967 shutdown_connections 2024-09-15T23:53:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.958+0000 7f200e913640 1 --2- 172.21.15.112:0/2567013967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20080af470 0x7f200806e000 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.958+0000 7f200e913640 1 --2- 172.21.15.112:0/2567013967 >> v2:172.21.15.169:3300/0 conn(0x7f200815bec0 0x7f20080ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.958+0000 7f200e913640 1 -- 172.21.15.112:0/2567013967 >> 172.21.15.112:0/2567013967 conn(0x7f20080b1f90 msgr2=0x7f20080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.958+0000 7f200e913640 1 -- 172.21.15.112:0/2567013967 shutdown_connections 2024-09-15T23:53:55.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.958+0000 7f200e913640 1 -- 172.21.15.112:0/2567013967 wait complete. 2024-09-15T23:53:55.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.958+0000 7f200e913640 1 Processor -- start 2024-09-15T23:53:55.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.958+0000 7f200e913640 1 -- start start 2024-09-15T23:53:55.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200e913640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20080af470 0x7f2008155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:55.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200e913640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f200815bec0 0x7f200814a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:55.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200e913640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f200815c2a0 0x7f200814acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:55.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200e913640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f200806ed50 con 0x7f200815c2a0 2024-09-15T23:53:55.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200e913640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f20080ad740 con 0x7f200815bec0 2024-09-15T23:53:55.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200e913640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f200806eed0 con 0x7f20080af470 2024-09-15T23:53:55.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200ceb0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f200815c2a0 0x7f200814acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:55.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200ceb0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f200815c2a0 0x7f200814acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47006/0 (socket says 172.21.15.112:47006) 2024-09-15T23:53:55.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200ceb0640 1 -- 172.21.15.112:0/1300376013 learned_addr learned my addr 172.21.15.112:0/1300376013 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:55.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f20077fe640 1 --2- 172.21.15.112:0/1300376013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f200815bec0 0x7f200814a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:55.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200ceb0640 1 -- 172.21.15.112:0/1300376013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20080af470 msgr2=0x7f2008155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:55.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200ceb0640 1 --2- 172.21.15.112:0/1300376013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20080af470 0x7f2008155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:55.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200ceb0640 1 -- 172.21.15.112:0/1300376013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f200815bec0 msgr2=0x7f200814a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:55.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200ceb0640 1 --2- 172.21.15.112:0/1300376013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f200815bec0 0x7f200814a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:55.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200ceb0640 1 -- 172.21.15.112:0/1300376013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200815c780 con 0x7f200815c2a0 2024-09-15T23:53:55.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f20077fe640 1 --2- 172.21.15.112:0/1300376013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f200815bec0 0x7f200814a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:53:55.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200ceb0640 1 --2- 172.21.15.112:0/1300376013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f200815c2a0 0x7f200814acd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f200001a5b0 tx=0x7f2000019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:55.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f2004ff9640 1 -- 172.21.15.112:0/1300376013 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20000b8670 con 0x7f200815c2a0 2024-09-15T23:53:55.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f2004ff9640 1 -- 172.21.15.112:0/1300376013 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20000be070 con 0x7f200815c2a0 2024-09-15T23:53:55.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200e913640 1 -- 172.21.15.112:0/1300376013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200815ca60 con 0x7f200815c2a0 2024-09-15T23:53:55.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f2004ff9640 1 -- 172.21.15.112:0/1300376013 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20000b8a50 con 0x7f200815c2a0 2024-09-15T23:53:55.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200e913640 1 -- 172.21.15.112:0/1300376013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200815edb0 con 0x7f200815c2a0 2024-09-15T23:53:55.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f200e913640 1 -- 172.21.15.112:0/1300376013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200806f260 con 0x7f200815c2a0 2024-09-15T23:53:55.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f2004ff9640 1 -- 172.21.15.112:0/1300376013 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f20000b8bf0 con 0x7f200815c2a0 2024-09-15T23:53:55.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f2004ff9640 1 --2- 172.21.15.112:0/1300376013 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ff40678c0 0x7f1ff4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:55.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f2004ff9640 1 -- 172.21.15.112:0/1300376013 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2000121290 con 0x7f200815c2a0 2024-09-15T23:53:55.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.962+0000 7f2007fff640 1 --2- 172.21.15.112:0/1300376013 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ff40678c0 0x7f1ff4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:55.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.966+0000 7f2007fff640 1 --2- 172.21.15.112:0/1300376013 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ff40678c0 0x7f1ff4069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f20080cf510 tx=0x7f1ff8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:55.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:55.966+0000 7f2004ff9640 1 -- 172.21.15.112:0/1300376013 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f20000165a0 con 0x7f200815c2a0 2024-09-15T23:53:56.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.162+0000 7f200e913640 1 -- 172.21.15.112:0/1300376013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f200806fcd0 con 0x7f200815c2a0 2024-09-15T23:53:56.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.162+0000 7f2004ff9640 1 -- 172.21.15.112:0/1300376013 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5225 (secure 0 0 0) 0x7f20000ac3a0 con 0x7f200815c2a0 2024-09-15T23:53:56.165 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:53:56.165 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":6,"btime":"2024-09-15T23:53:55:792566+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/879130842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":879130842},{"type":"v1","addr":"172.21.15.112:6836","nonce":879130842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3178495253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3178495253},{"type":"v1","addr":"172.21.15.112:6837","nonce":3178495253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/780833913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":780833913},{"type":"v1","addr":"172.21.15.169:6833","nonce":780833913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:53:50.059476+0000","modified":"2024-09-15T23:53:55.161446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6835/2205745557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2205745557},{"type":"v1","addr":"172.21.15.169:6835","nonce":2205745557}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-09-15T23:53:56.165 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 6 2024-09-15T23:53:56.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.166+0000 7f200e913640 1 -- 172.21.15.112:0/1300376013 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ff40678c0 msgr2=0x7f1ff4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.166+0000 7f200e913640 1 --2- 172.21.15.112:0/1300376013 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ff40678c0 0x7f1ff4069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f20080cf510 tx=0x7f1ff8008040 comp rx=0 tx=0).stop 2024-09-15T23:53:56.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.166+0000 7f200e913640 1 -- 172.21.15.112:0/1300376013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f200815c2a0 msgr2=0x7f200814acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.166+0000 7f200e913640 1 --2- 172.21.15.112:0/1300376013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f200815c2a0 0x7f200814acd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f200001a5b0 tx=0x7f2000019720 comp rx=0 tx=0).stop 2024-09-15T23:53:56.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.166+0000 7f200e913640 1 -- 172.21.15.112:0/1300376013 shutdown_connections 2024-09-15T23:53:56.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.166+0000 7f200e913640 1 --2- 172.21.15.112:0/1300376013 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ff40678c0 0x7f1ff4069d80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.166+0000 7f200e913640 1 --2- 172.21.15.112:0/1300376013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f200815c2a0 0x7f200814acd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.166+0000 7f200e913640 1 --2- 172.21.15.112:0/1300376013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f200815bec0 0x7f200814a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.166+0000 7f200e913640 1 --2- 172.21.15.112:0/1300376013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f20080af470 0x7f2008155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.166+0000 7f200e913640 1 -- 172.21.15.112:0/1300376013 >> 172.21.15.112:0/1300376013 conn(0x7f20080b1f90 msgr2=0x7f20080cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:56.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.166+0000 7f200e913640 1 -- 172.21.15.112:0/1300376013 shutdown_connections 2024-09-15T23:53:56.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.166+0000 7f200e913640 1 -- 172.21.15.112:0/1300376013 wait complete. 2024-09-15T23:53:56.184 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:53:56.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.301+0000 7f93cd689640 1 Processor -- start 2024-09-15T23:53:56.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.301+0000 7f93cd689640 1 -- start start 2024-09-15T23:53:56.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93cd689640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f93c815bec0 0x7f93c80ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93cd689640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f93c80af470 0x7f93c806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93cd689640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c80b3290 con 0x7f93c815c2a0 2024-09-15T23:53:56.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93cd689640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f93c80b3570 con 0x7f93c80af470 2024-09-15T23:53:56.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93cd689640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f93c80b3850 con 0x7f93c815bec0 2024-09-15T23:53:56.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c77fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f93c80af470 0x7f93c806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:56.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c67fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f93c815c2a0 0x7f93c80aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45662/0 (socket says 172.21.15.112:45662) 2024-09-15T23:53:56.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c67fc640 1 -- 172.21.15.112:0/2161593979 learned_addr learned my addr 172.21.15.112:0/2161593979 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:56.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c77fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f93c80af470 0x7f93c806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47012/0 (socket says 172.21.15.112:47012) 2024-09-15T23:53:56.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c6ffd640 1 --2- 172.21.15.112:0/2161593979 >> v2:172.21.15.169:3300/0 conn(0x7f93c815bec0 0x7f93c80ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:56.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c77fe640 1 -- 172.21.15.112:0/2161593979 >> v2:172.21.15.169:3300/0 conn(0x7f93c815bec0 msgr2=0x7f93c80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:56.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c77fe640 1 --2- 172.21.15.112:0/2161593979 >> v2:172.21.15.169:3300/0 conn(0x7f93c815bec0 0x7f93c80ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c77fe640 1 -- 172.21.15.112:0/2161593979 >> v1:172.21.15.112:6789/0 conn(0x7f93c815c2a0 legacy=0x7f93c80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c77fe640 1 -- 172.21.15.112:0/2161593979 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c80b3b30 con 0x7f93c80af470 2024-09-15T23:53:56.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c5ffb640 1 -- 172.21.15.112:0/2161593979 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 847901761 0 0) 0x7f93c80b3290 con 0x7f93c815c2a0 2024-09-15T23:53:56.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c6ffd640 1 --2- 172.21.15.112:0/2161593979 >> v2:172.21.15.169:3300/0 conn(0x7f93c815bec0 0x7f93c80ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:53:56.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c77fe640 1 --2- 172.21.15.112:0/2161593979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c80af470 0x7f93c806e000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f93c8071710 tx=0x7f93c001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2e118c164d6058 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:56.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c5ffb640 1 -- 172.21.15.112:0/2161593979 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c00ab650 con 0x7f93c80af470 2024-09-15T23:53:56.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c5ffb640 1 -- 172.21.15.112:0/2161593979 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c00b0070 con 0x7f93c80af470 2024-09-15T23:53:56.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.305+0000 7f93c5ffb640 1 -- 172.21.15.112:0/2161593979 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c00aba10 con 0x7f93c80af470 2024-09-15T23:53:56.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 -- 172.21.15.112:0/2161593979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c80af470 msgr2=0x7f93c806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 --2- 172.21.15.112:0/2161593979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c80af470 0x7f93c806e000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f93c8071710 tx=0x7f93c001c450 comp rx=0 tx=0).stop 2024-09-15T23:53:56.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 -- 172.21.15.112:0/2161593979 shutdown_connections 2024-09-15T23:53:56.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 --2- 172.21.15.112:0/2161593979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c80af470 0x7f93c806e000 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 --2- 172.21.15.112:0/2161593979 >> v2:172.21.15.169:3300/0 conn(0x7f93c815bec0 0x7f93c80ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 -- 172.21.15.112:0/2161593979 >> 172.21.15.112:0/2161593979 conn(0x7f93c80b1f90 msgr2=0x7f93c80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:56.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 -- 172.21.15.112:0/2161593979 shutdown_connections 2024-09-15T23:53:56.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 -- 172.21.15.112:0/2161593979 wait complete. 2024-09-15T23:53:56.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 Processor -- start 2024-09-15T23:53:56.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 -- start start 2024-09-15T23:53:56.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93c80af470 0x7f93c8153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c815bec0 0x7f93c81f8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93c815c2a0 0x7f93c814c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f93c806ed50 con 0x7f93c815bec0 2024-09-15T23:53:56.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f93c80ad740 con 0x7f93c80af470 2024-09-15T23:53:56.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f93c806eed0 con 0x7f93c815c2a0 2024-09-15T23:53:56.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93c67fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c815bec0 0x7f93c81f8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:56.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93c67fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c815bec0 0x7f93c81f8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47020/0 (socket says 172.21.15.112:47020) 2024-09-15T23:53:56.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93c67fc640 1 -- 172.21.15.112:0/1303737266 learned_addr learned my addr 172.21.15.112:0/1303737266 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:56.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93c67fc640 1 -- 172.21.15.112:0/1303737266 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93c815c2a0 msgr2=0x7f93c814c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93c67fc640 1 --2- 172.21.15.112:0/1303737266 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93c815c2a0 0x7f93c814c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93c67fc640 1 -- 172.21.15.112:0/1303737266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93c80af470 msgr2=0x7f93c8153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93c67fc640 1 --2- 172.21.15.112:0/1303737266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93c80af470 0x7f93c8153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93c67fc640 1 -- 172.21.15.112:0/1303737266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c8154230 con 0x7f93c815bec0 2024-09-15T23:53:56.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93c67fc640 1 --2- 172.21.15.112:0/1303737266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c815bec0 0x7f93c81f8770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f93b000c750 tx=0x7f93b000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:56.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93bf7fe640 1 -- 172.21.15.112:0/1303737266 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b0018070 con 0x7f93c815bec0 2024-09-15T23:53:56.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93bf7fe640 1 -- 172.21.15.112:0/1303737266 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93b000a640 con 0x7f93c815bec0 2024-09-15T23:53:56.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 -- 172.21.15.112:0/1303737266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c8154510 con 0x7f93c815bec0 2024-09-15T23:53:56.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93bf7fe640 1 -- 172.21.15.112:0/1303737266 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b000ce60 con 0x7f93c815bec0 2024-09-15T23:53:56.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.309+0000 7f93cd689640 1 -- 172.21.15.112:0/1303737266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c8154ad0 con 0x7f93c815bec0 2024-09-15T23:53:56.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.313+0000 7f93cd689640 1 -- 172.21.15.112:0/1303737266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c806f260 con 0x7f93c815bec0 2024-09-15T23:53:56.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.313+0000 7f93bf7fe640 1 -- 172.21.15.112:0/1303737266 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f93b001b070 con 0x7f93c815bec0 2024-09-15T23:53:56.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.313+0000 7f93bf7fe640 1 --2- 172.21.15.112:0/1303737266 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f93a80678c0 0x7f93a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.313+0000 7f93bf7fe640 1 -- 172.21.15.112:0/1303737266 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f93b00855e0 con 0x7f93c815bec0 2024-09-15T23:53:56.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.313+0000 7f93c6ffd640 1 --2- 172.21.15.112:0/1303737266 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f93a80678c0 0x7f93a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:56.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.313+0000 7f93c6ffd640 1 --2- 172.21.15.112:0/1303737266 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f93a80678c0 0x7f93a8069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f93b800a8d0 tx=0x7f93b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:56.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.317+0000 7f93bf7fe640 1 -- 172.21.15.112:0/1303737266 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f93b0055de0 con 0x7f93c815bec0 2024-09-15T23:53:56.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.485+0000 7f93cd689640 1 -- 172.21.15.112:0/1303737266 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93c806fcd0 con 0x7f93c815bec0 2024-09-15T23:53:56.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.489+0000 7f93bf7fe640 1 -- 172.21.15.112:0/1303737266 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7f93b00556e0 con 0x7f93c815bec0 2024-09-15T23:53:56.492 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:53:56.493 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:55.161085+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:53:47.908190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:53:49.056283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:53:52.808895+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:53:56.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.493+0000 7f93cd689640 1 -- 172.21.15.112:0/1303737266 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f93a80678c0 msgr2=0x7f93a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.493+0000 7f93cd689640 1 --2- 172.21.15.112:0/1303737266 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f93a80678c0 0x7f93a8069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f93b800a8d0 tx=0x7f93b8008040 comp rx=0 tx=0).stop 2024-09-15T23:53:56.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.493+0000 7f93cd689640 1 -- 172.21.15.112:0/1303737266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c815bec0 msgr2=0x7f93c81f8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.493+0000 7f93cd689640 1 --2- 172.21.15.112:0/1303737266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c815bec0 0x7f93c81f8770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f93b000c750 tx=0x7f93b000cc10 comp rx=0 tx=0).stop 2024-09-15T23:53:56.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.493+0000 7f93cd689640 1 -- 172.21.15.112:0/1303737266 shutdown_connections 2024-09-15T23:53:56.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.493+0000 7f93cd689640 1 --2- 172.21.15.112:0/1303737266 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f93a80678c0 0x7f93a8069d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.493+0000 7f93cd689640 1 --2- 172.21.15.112:0/1303737266 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93c815c2a0 0x7f93c814c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.493+0000 7f93cd689640 1 --2- 172.21.15.112:0/1303737266 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93c815bec0 0x7f93c81f8770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.493+0000 7f93cd689640 1 --2- 172.21.15.112:0/1303737266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93c80af470 0x7f93c8153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.493+0000 7f93cd689640 1 -- 172.21.15.112:0/1303737266 >> 172.21.15.112:0/1303737266 conn(0x7f93c80b1f90 msgr2=0x7f93c80cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:56.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.493+0000 7f93cd689640 1 -- 172.21.15.112:0/1303737266 shutdown_connections 2024-09-15T23:53:56.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.493+0000 7f93cd689640 1 -- 172.21.15.112:0/1303737266 wait complete. 2024-09-15T23:53:56.512 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:53:56.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bf1bb640 1 Processor -- start 2024-09-15T23:53:56.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bf1bb640 1 -- start start 2024-09-15T23:53:56.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bf1bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7b81457a0 0x7fb7b80d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bf1bb640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7b80d27a0 con 0x7fb7b80b4510 2024-09-15T23:53:56.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bf1bb640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7b80d2a80 con 0x7fb7b80cf800 2024-09-15T23:53:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bf1bb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b80d2d60 con 0x7fb7b81457a0 2024-09-15T23:53:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bd758640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb7b80b4510 0x7fb7b80d0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45674/0 (socket says 172.21.15.112:45674) 2024-09-15T23:53:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bd758640 1 -- 172.21.15.112:0/2914590107 learned_addr learned my addr 172.21.15.112:0/2914590107 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bcf57640 1 --2- 172.21.15.112:0/2914590107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7b81457a0 0x7fb7b80d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 -- 172.21.15.112:0/2914590107 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1994171306 0 0) 0x7fb7b80d27a0 con 0x7fb7b80b4510 2024-09-15T23:53:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 -- 172.21.15.112:0/2914590107 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7a4003530 con 0x7fb7b80b4510 2024-09-15T23:53:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 -- 172.21.15.112:0/2914590107 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3499097724 0 0) 0x7fb7a4003530 con 0x7fb7b80b4510 2024-09-15T23:53:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 -- 172.21.15.112:0/2914590107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7b81457a0 msgr2=0x7fb7b80d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 --2- 172.21.15.112:0/2914590107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7b81457a0 0x7fb7b80d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 -- 172.21.15.112:0/2914590107 >> v1:172.21.15.169:6789/0 conn(0x7fb7b80cf800 legacy=0x7fb7b80b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 -- 172.21.15.112:0/2914590107 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b80d01f0 con 0x7fb7b80b4510 2024-09-15T23:53:56.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 -- 172.21.15.112:0/2914590107 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fb7b0001680 con 0x7fb7b80b4510 2024-09-15T23:53:56.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 -- 172.21.15.112:0/2914590107 >> v1:172.21.15.112:6789/0 conn(0x7fb7b80b4510 legacy=0x7fb7b80d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 --2- 172.21.15.112:0/2914590107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7b81457a0 0x7fb7a40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 --2- 172.21.15.112:0/2914590107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7a4003f70 0x7fb7a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 --2- 172.21.15.112:0/2914590107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7a4004d50 0x7fb7a40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 -- 172.21.15.112:0/2914590107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b80d2d60 con 0x7fb7a4004d50 2024-09-15T23:53:56.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 -- 172.21.15.112:0/2914590107 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a400bb60 con 0x7fb7a4003f70 2024-09-15T23:53:56.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b77fe640 1 -- 172.21.15.112:0/2914590107 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a400bd60 con 0x7fb7b81457a0 2024-09-15T23:53:56.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bd758640 1 --2- 172.21.15.112:0/2914590107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7a4004d50 0x7fb7a40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:56.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bcf57640 1 --2- 172.21.15.112:0/2914590107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7b81457a0 0x7fb7a40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:56.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7b7fff640 1 --2- 172.21.15.112:0/2914590107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7a4003f70 0x7fb7a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:56.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bd758640 1 -- 172.21.15.112:0/2914590107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7b81457a0 msgr2=0x7fb7a40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:56.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bd758640 1 --2- 172.21.15.112:0/2914590107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7b81457a0 0x7fb7a40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bd758640 1 -- 172.21.15.112:0/2914590107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7a4003f70 msgr2=0x7fb7a4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:56.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bd758640 1 --2- 172.21.15.112:0/2914590107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7a4003f70 0x7fb7a4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.641+0000 7fb7bd758640 1 -- 172.21.15.112:0/2914590107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a4003530 con 0x7fb7a4004d50 2024-09-15T23:53:56.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.645+0000 7fb7bd758640 1 --2- 172.21.15.112:0/2914590107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7a4004d50 0x7fb7a40051d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000c210 tx=0x7fb7b001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4110fb137f64d77a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:56.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.645+0000 7fb7b77fe640 1 -- 172.21.15.112:0/2914590107 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0007d20 con 0x7fb7a4004d50 2024-09-15T23:53:56.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.645+0000 7fb7b77fe640 1 -- 172.21.15.112:0/2914590107 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b0005ae0 con 0x7fb7a4004d50 2024-09-15T23:53:56.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.645+0000 7fb7b77fe640 1 -- 172.21.15.112:0/2914590107 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0007070 con 0x7fb7a4004d50 2024-09-15T23:53:56.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.645+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/2914590107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7a4004d50 msgr2=0x7fb7a40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.645+0000 7fb7bf1bb640 1 --2- 172.21.15.112:0/2914590107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7a4004d50 0x7fb7a40051d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000c210 tx=0x7fb7b001f3b0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.645+0000 7fb7bd758640 1 -- 172.21.15.112:0/2914590107 reap_dead start 2024-09-15T23:53:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.645+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/2914590107 shutdown_connections 2024-09-15T23:53:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.645+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/2914590107 >> 172.21.15.112:0/2914590107 conn(0x7fb7b806bcc0 msgr2=0x7fb7b806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.645+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/2914590107 shutdown_connections 2024-09-15T23:53:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.645+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/2914590107 wait complete. 2024-09-15T23:53:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.645+0000 7fb7bf1bb640 1 Processor -- start 2024-09-15T23:53:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.645+0000 7fb7bf1bb640 1 -- start start 2024-09-15T23:53:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bf1bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7b813c4e0 0x7fb7b815ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bf1bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7b81f46b0 0x7fb7b8140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bf1bb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7b815dd30 0x7fb7b8140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bf1bb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b80d2020 con 0x7fb7b813c4e0 2024-09-15T23:53:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bf1bb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b80d1ea0 con 0x7fb7b815dd30 2024-09-15T23:53:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bf1bb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b80d21a0 con 0x7fb7b81f46b0 2024-09-15T23:53:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bcf57640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7b813c4e0 0x7fb7b815ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bcf57640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7b813c4e0 0x7fb7b815ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47048/0 (socket says 172.21.15.112:47048) 2024-09-15T23:53:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bcf57640 1 -- 172.21.15.112:0/762315301 learned_addr learned my addr 172.21.15.112:0/762315301 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7b7fff640 1 --2- 172.21.15.112:0/762315301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7b81f46b0 0x7fb7b8140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bcf57640 1 -- 172.21.15.112:0/762315301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7b81f46b0 msgr2=0x7fb7b8140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bcf57640 1 --2- 172.21.15.112:0/762315301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7b81f46b0 0x7fb7b8140980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bcf57640 1 -- 172.21.15.112:0/762315301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7b815dd30 msgr2=0x7fb7b8140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bcf57640 1 --2- 172.21.15.112:0/762315301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7b815dd30 0x7fb7b8140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bcf57640 1 -- 172.21.15.112:0/762315301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b815f4a0 con 0x7fb7b813c4e0 2024-09-15T23:53:56.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bcf57640 1 --2- 172.21.15.112:0/762315301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7b813c4e0 0x7fb7b815ec00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00115e0 tx=0x7fb7a0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:56.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7b57fa640 1 -- 172.21.15.112:0/762315301 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0015870 con 0x7fb7b813c4e0 2024-09-15T23:53:56.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7b57fa640 1 -- 172.21.15.112:0/762315301 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a0015a10 con 0x7fb7b813c4e0 2024-09-15T23:53:56.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/762315301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b813e150 con 0x7fb7b813c4e0 2024-09-15T23:53:56.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7b57fa640 1 -- 172.21.15.112:0/762315301 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0015dc0 con 0x7fb7b813c4e0 2024-09-15T23:53:56.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/762315301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b815f140 con 0x7fb7b813c4e0 2024-09-15T23:53:56.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/762315301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b80d2580 con 0x7fb7b813c4e0 2024-09-15T23:53:56.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7b57fa640 1 -- 172.21.15.112:0/762315301 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7a000f460 con 0x7fb7b813c4e0 2024-09-15T23:53:56.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7b57fa640 1 --2- 172.21.15.112:0/762315301 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb7980678f0 0x7fb798069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7b7fff640 1 --2- 172.21.15.112:0/762315301 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb7980678f0 0x7fb798069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:56.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7b57fa640 1 -- 172.21.15.112:0/762315301 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb7a00868b0 con 0x7fb7b813c4e0 2024-09-15T23:53:56.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.649+0000 7fb7b7fff640 1 --2- 172.21.15.112:0/762315301 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb7980678f0 0x7fb798069db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8143c20 tx=0x7fb7a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:56.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.653+0000 7fb7b57fa640 1 -- 172.21.15.112:0/762315301 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb7a0019030 con 0x7fb7b813c4e0 2024-09-15T23:53:56.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.809+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/762315301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7b81449f0 con 0x7fb7b813c4e0 2024-09-15T23:53:56.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.813+0000 7fb7b57fa640 1 -- 172.21.15.112:0/762315301 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7fb7a0057140 con 0x7fb7b813c4e0 2024-09-15T23:53:56.815 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:53:56.816 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:55.161085+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:53:47.908190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:53:49.056283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:53:52.808895+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:53:56.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.813+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/762315301 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb7980678f0 msgr2=0x7fb798069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.813+0000 7fb7bf1bb640 1 --2- 172.21.15.112:0/762315301 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb7980678f0 0x7fb798069db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8143c20 tx=0x7fb7a8009040 comp rx=0 tx=0).stop 2024-09-15T23:53:56.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.813+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/762315301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7b813c4e0 msgr2=0x7fb7b815ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.813+0000 7fb7bf1bb640 1 --2- 172.21.15.112:0/762315301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7b813c4e0 0x7fb7b815ec00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00115e0 tx=0x7fb7a0011aa0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.813+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/762315301 shutdown_connections 2024-09-15T23:53:56.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.813+0000 7fb7bf1bb640 1 --2- 172.21.15.112:0/762315301 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb7980678f0 0x7fb798069db0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.813+0000 7fb7bf1bb640 1 --2- 172.21.15.112:0/762315301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7b815dd30 0x7fb7b8140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.813+0000 7fb7bf1bb640 1 --2- 172.21.15.112:0/762315301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7b81f46b0 0x7fb7b8140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.813+0000 7fb7bf1bb640 1 --2- 172.21.15.112:0/762315301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7b813c4e0 0x7fb7b815ec00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.813+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/762315301 >> 172.21.15.112:0/762315301 conn(0x7fb7b806bcc0 msgr2=0x7fb7b806dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:56.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.813+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/762315301 shutdown_connections 2024-09-15T23:53:56.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.813+0000 7fb7bf1bb640 1 -- 172.21.15.112:0/762315301 wait complete. 2024-09-15T23:53:56.852 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:53:56.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.957+0000 7fc7eb0ed640 1 Processor -- start 2024-09-15T23:53:56.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.957+0000 7fc7eb0ed640 1 -- start start 2024-09-15T23:53:56.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7eb0ed640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc7e41520a0 0x7fc7e406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7eb0ed640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc7e406fe50 0x7fc7e415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7eb0ed640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7e4070250 con 0x7fc7e415f1d0 2024-09-15T23:53:56.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7eb0ed640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc7e4152480 con 0x7fc7e406fe50 2024-09-15T23:53:56.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7eb0ed640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc7e40aede0 con 0x7fc7e41520a0 2024-09-15T23:53:56.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7e3fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc7e406fe50 0x7fc7e415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:56.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7e968a640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc7e415f1d0 0x7fc7e4071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45678/0 (socket says 172.21.15.112:45678) 2024-09-15T23:53:56.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7e968a640 1 -- 172.21.15.112:0/3486667493 learned_addr learned my addr 172.21.15.112:0/3486667493 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:56.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7e3fff640 1 -- 172.21.15.112:0/3486667493 >> v2:172.21.15.169:3300/0 conn(0x7fc7e41520a0 msgr2=0x7fc7e406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:56.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7e3fff640 1 --2- 172.21.15.112:0/3486667493 >> v2:172.21.15.169:3300/0 conn(0x7fc7e41520a0 0x7fc7e406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7e3fff640 1 -- 172.21.15.112:0/3486667493 >> v1:172.21.15.112:6789/0 conn(0x7fc7e415f1d0 legacy=0x7fc7e4071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7e3fff640 1 -- 172.21.15.112:0/3486667493 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e415fa10 con 0x7fc7e406fe50 2024-09-15T23:53:56.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7e37fe640 1 -- 172.21.15.112:0/3486667493 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980813612 0 0) 0x7fc7e4070250 con 0x7fc7e415f1d0 2024-09-15T23:53:56.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7e3fff640 1 --2- 172.21.15.112:0/3486667493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e406fe50 0x7fc7e415ec90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4071710 tx=0x7fc7d801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e913352233e7b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:56.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7e37fe640 1 -- 172.21.15.112:0/3486667493 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d80b2070 con 0x7fc7e406fe50 2024-09-15T23:53:56.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7e37fe640 1 -- 172.21.15.112:0/3486667493 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d80a58f0 con 0x7fc7e406fe50 2024-09-15T23:53:56.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7e37fe640 1 -- 172.21.15.112:0/3486667493 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d80a5cc0 con 0x7fc7e406fe50 2024-09-15T23:53:56.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/3486667493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e406fe50 msgr2=0x7fc7e415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7eb0ed640 1 --2- 172.21.15.112:0/3486667493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e406fe50 0x7fc7e415ec90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4071710 tx=0x7fc7d801c910 comp rx=0 tx=0).stop 2024-09-15T23:53:56.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/3486667493 shutdown_connections 2024-09-15T23:53:56.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7eb0ed640 1 --2- 172.21.15.112:0/3486667493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e406fe50 0x7fc7e415ec90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7eb0ed640 1 --2- 172.21.15.112:0/3486667493 >> v2:172.21.15.169:3300/0 conn(0x7fc7e41520a0 0x7fc7e406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/3486667493 >> 172.21.15.112:0/3486667493 conn(0x7fc7e40b1f90 msgr2=0x7fc7e40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:56.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/3486667493 shutdown_connections 2024-09-15T23:53:56.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.961+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/3486667493 wait complete. 2024-09-15T23:53:56.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7eb0ed640 1 Processor -- start 2024-09-15T23:53:56.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7eb0ed640 1 -- start start 2024-09-15T23:53:56.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7eb0ed640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7e406fe50 0x7fc7e40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7eb0ed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e41520a0 0x7fc7e40ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7eb0ed640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7e415f1d0 0x7fc7e40ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7eb0ed640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e4073d30 con 0x7fc7e41520a0 2024-09-15T23:53:56.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7eb0ed640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e4073a50 con 0x7fc7e406fe50 2024-09-15T23:53:56.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7eb0ed640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e415f620 con 0x7fc7e415f1d0 2024-09-15T23:53:56.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7e3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e41520a0 0x7fc7e40ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:56.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7e3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e41520a0 0x7fc7e40ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47068/0 (socket says 172.21.15.112:47068) 2024-09-15T23:53:56.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7e3fff640 1 -- 172.21.15.112:0/4083615883 learned_addr learned my addr 172.21.15.112:0/4083615883 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:56.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7e3fff640 1 -- 172.21.15.112:0/4083615883 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7e415f1d0 msgr2=0x7fc7e40ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7e3fff640 1 --2- 172.21.15.112:0/4083615883 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7e415f1d0 0x7fc7e40ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7e3fff640 1 -- 172.21.15.112:0/4083615883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7e406fe50 msgr2=0x7fc7e40cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:56.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7e3fff640 1 --2- 172.21.15.112:0/4083615883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7e406fe50 0x7fc7e40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:56.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7e3fff640 1 -- 172.21.15.112:0/4083615883 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e414b610 con 0x7fc7e41520a0 2024-09-15T23:53:56.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7e3fff640 1 --2- 172.21.15.112:0/4083615883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e41520a0 0x7fc7e40ce230 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80b0040 tx=0x7fc7d80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:56.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7e17fa640 1 -- 172.21.15.112:0/4083615883 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d80bd020 con 0x7fc7e41520a0 2024-09-15T23:53:56.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7e17fa640 1 -- 172.21.15.112:0/4083615883 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d80b3040 con 0x7fc7e41520a0 2024-09-15T23:53:56.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/4083615883 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e414b8f0 con 0x7fc7e41520a0 2024-09-15T23:53:56.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/4083615883 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e414beb0 con 0x7fc7e41520a0 2024-09-15T23:53:56.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7e17fa640 1 -- 172.21.15.112:0/4083615883 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d80b2050 con 0x7fc7e41520a0 2024-09-15T23:53:56.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/4083615883 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e415ec90 con 0x7fc7e41520a0 2024-09-15T23:53:56.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.965+0000 7fc7e17fa640 1 -- 172.21.15.112:0/4083615883 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc7d80c0070 con 0x7fc7e41520a0 2024-09-15T23:53:56.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.969+0000 7fc7e17fa640 1 --2- 172.21.15.112:0/4083615883 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7d00678f0 0x7fc7d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:56.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.969+0000 7fc7e17fa640 1 -- 172.21.15.112:0/4083615883 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc7d81205d0 con 0x7fc7e41520a0 2024-09-15T23:53:56.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.969+0000 7fc7e8e89640 1 --2- 172.21.15.112:0/4083615883 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7d00678f0 0x7fc7d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:56.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.969+0000 7fc7e8e89640 1 --2- 172.21.15.112:0/4083615883 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7d00678f0 0x7fc7d0069db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009730 tx=0x7fc7dc006ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:56.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:56.973+0000 7fc7e17fa640 1 -- 172.21.15.112:0/4083615883 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc7d8016500 con 0x7fc7e41520a0 2024-09-15T23:53:57.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.153+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/4083615883 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7e406e540 con 0x7fc7e41520a0 2024-09-15T23:53:57.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.153+0000 7fc7e17fa640 1 -- 172.21.15.112:0/4083615883 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5225 (secure 0 0 0) 0x7fc7d80f0dd0 con 0x7fc7e41520a0 2024-09-15T23:53:57.156 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:53:57.156 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":6,"btime":"2024-09-15T23:53:55:792566+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/879130842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":879130842},{"type":"v1","addr":"172.21.15.112:6836","nonce":879130842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3178495253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3178495253},{"type":"v1","addr":"172.21.15.112:6837","nonce":3178495253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/780833913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":780833913},{"type":"v1","addr":"172.21.15.169:6833","nonce":780833913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:53:50.059476+0000","modified":"2024-09-15T23:53:55.161446+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6835/2205745557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2205745557},{"type":"v1","addr":"172.21.15.169:6835","nonce":2205745557}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-09-15T23:53:57.156 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 6 2024-09-15T23:53:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.153+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/4083615883 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7d00678f0 msgr2=0x7fc7d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.153+0000 7fc7eb0ed640 1 --2- 172.21.15.112:0/4083615883 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7d00678f0 0x7fc7d0069db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009730 tx=0x7fc7dc006ca0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.153+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/4083615883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e41520a0 msgr2=0x7fc7e40ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.153+0000 7fc7eb0ed640 1 --2- 172.21.15.112:0/4083615883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e41520a0 0x7fc7e40ce230 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80b0040 tx=0x7fc7d80196b0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.153+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/4083615883 shutdown_connections 2024-09-15T23:53:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.153+0000 7fc7eb0ed640 1 --2- 172.21.15.112:0/4083615883 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7d00678f0 0x7fc7d0069db0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.153+0000 7fc7eb0ed640 1 --2- 172.21.15.112:0/4083615883 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7e415f1d0 0x7fc7e40ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.153+0000 7fc7eb0ed640 1 --2- 172.21.15.112:0/4083615883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e41520a0 0x7fc7e40ce230 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.153+0000 7fc7eb0ed640 1 --2- 172.21.15.112:0/4083615883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7e406fe50 0x7fc7e40cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.153+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/4083615883 >> 172.21.15.112:0/4083615883 conn(0x7fc7e40b1f90 msgr2=0x7fc7e40b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:57.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.157+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/4083615883 shutdown_connections 2024-09-15T23:53:57.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.157+0000 7fc7eb0ed640 1 -- 172.21.15.112:0/4083615883 wait complete. 2024-09-15T23:53:57.174 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:53:57.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f232c097640 1 Processor -- start 2024-09-15T23:53:57.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f232c097640 1 -- start start 2024-09-15T23:53:57.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f232c097640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f232415bec0 0x7f23240ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f232c097640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f232415c2a0 0x7f23240aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f232c097640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23240b3290 con 0x7f23240af2a0 2024-09-15T23:53:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f232c097640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f23240b3570 con 0x7f232415c2a0 2024-09-15T23:53:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f232c097640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f23240b3850 con 0x7f232415bec0 2024-09-15T23:53:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f232a634640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f23240af2a0 0x7f232415fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45690/0 (socket says 172.21.15.112:45690) 2024-09-15T23:53:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f232a634640 1 -- 172.21.15.112:0/593773641 learned_addr learned my addr 172.21.15.112:0/593773641 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f2329632640 1 --2- 172.21.15.112:0/593773641 >> v2:172.21.15.112:3300/0 conn(0x7f232415c2a0 0x7f23240aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f2329e33640 1 --2- 172.21.15.112:0/593773641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f232415bec0 0x7f23240ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f2328e31640 1 -- 172.21.15.112:0/593773641 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987892715 0 0) 0x7f23240b3290 con 0x7f23240af2a0 2024-09-15T23:53:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f2328e31640 1 -- 172.21.15.112:0/593773641 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2310003530 con 0x7f23240af2a0 2024-09-15T23:53:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f2329632640 1 -- 172.21.15.112:0/593773641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f232415bec0 msgr2=0x7f23240ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f2329632640 1 --2- 172.21.15.112:0/593773641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f232415bec0 0x7f23240ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f2329632640 1 -- 172.21.15.112:0/593773641 >> v1:172.21.15.112:6789/0 conn(0x7f23240af2a0 legacy=0x7f232415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:57.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f2328e31640 1 -- 172.21.15.112:0/593773641 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 271371996 0 0) 0x7f2310003530 con 0x7f23240af2a0 2024-09-15T23:53:57.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.305+0000 7f2329632640 1 -- 172.21.15.112:0/593773641 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23240b3b30 con 0x7f232415c2a0 2024-09-15T23:53:57.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2329632640 1 --2- 172.21.15.112:0/593773641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f232415c2a0 0x7f23240aed60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f23140097c0 tx=0x7f231401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4599200779e426c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:57.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2328e31640 1 -- 172.21.15.112:0/593773641 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140b0070 con 0x7f232415c2a0 2024-09-15T23:53:57.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2328e31640 1 -- 172.21.15.112:0/593773641 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23140ab400 con 0x7f232415c2a0 2024-09-15T23:53:57.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2328e31640 1 -- 172.21.15.112:0/593773641 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c001a00 con 0x7f232415c2a0 2024-09-15T23:53:57.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 -- 172.21.15.112:0/593773641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f232415c2a0 msgr2=0x7f23240aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:57.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 --2- 172.21.15.112:0/593773641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f232415c2a0 0x7f23240aed60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f23140097c0 tx=0x7f231401c390 comp rx=0 tx=0).stop 2024-09-15T23:53:57.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 -- 172.21.15.112:0/593773641 shutdown_connections 2024-09-15T23:53:57.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 --2- 172.21.15.112:0/593773641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f232415c2a0 0x7f23240aed60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 --2- 172.21.15.112:0/593773641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f232415bec0 0x7f23240ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 -- 172.21.15.112:0/593773641 >> 172.21.15.112:0/593773641 conn(0x7f23240b1f90 msgr2=0x7f23240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:57.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 -- 172.21.15.112:0/593773641 shutdown_connections 2024-09-15T23:53:57.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 -- 172.21.15.112:0/593773641 wait complete. 2024-09-15T23:53:57.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 Processor -- start 2024-09-15T23:53:57.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 -- start start 2024-09-15T23:53:57.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23240af2a0 0x7f2324153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:57.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f232415bec0 0x7f232415cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:57.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2324072f60 0x7f23240733f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:57.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f23240ad740 con 0x7f23240af2a0 2024-09-15T23:53:57.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f23240afc90 con 0x7f232415bec0 2024-09-15T23:53:57.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2324169000 con 0x7f2324072f60 2024-09-15T23:53:57.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2329e33640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23240af2a0 0x7f2324153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:57.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2329e33640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23240af2a0 0x7f2324153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47088/0 (socket says 172.21.15.112:47088) 2024-09-15T23:53:57.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2329e33640 1 -- 172.21.15.112:0/1637820865 learned_addr learned my addr 172.21.15.112:0/1637820865 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:57.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2329632640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f232415bec0 0x7f232415cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:57.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2329e33640 1 -- 172.21.15.112:0/1637820865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2324072f60 msgr2=0x7f23240733f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:57.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232a634640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2324072f60 0x7f23240733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:57.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2329e33640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2324072f60 0x7f23240733f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2329e33640 1 -- 172.21.15.112:0/1637820865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f232415bec0 msgr2=0x7f232415cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:57.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2329e33640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f232415bec0 0x7f232415cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2329e33640 1 -- 172.21.15.112:0/1637820865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2324154e60 con 0x7f23240af2a0 2024-09-15T23:53:57.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2329632640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f232415bec0 0x7f232415cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:53:57.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f2329e33640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23240af2a0 0x7f2324153d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f232000e870 tx=0x7f232000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:57.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f231a7fc640 1 -- 172.21.15.112:0/1637820865 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320017070 con 0x7f23240af2a0 2024-09-15T23:53:57.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f231a7fc640 1 -- 172.21.15.112:0/1637820865 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232000c940 con 0x7f23240af2a0 2024-09-15T23:53:57.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 -- 172.21.15.112:0/1637820865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f232415d440 con 0x7f23240af2a0 2024-09-15T23:53:57.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f231a7fc640 1 -- 172.21.15.112:0/1637820865 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232000cd10 con 0x7f23240af2a0 2024-09-15T23:53:57.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.309+0000 7f232c097640 1 -- 172.21.15.112:0/1637820865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f232415da00 con 0x7f23240af2a0 2024-09-15T23:53:57.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.313+0000 7f232c097640 1 -- 172.21.15.112:0/1637820865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2324157200 con 0x7f23240af2a0 2024-09-15T23:53:57.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.313+0000 7f231a7fc640 1 -- 172.21.15.112:0/1637820865 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f232001a070 con 0x7f23240af2a0 2024-09-15T23:53:57.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.313+0000 7f231a7fc640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23080678c0 0x7f2308069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:57.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.313+0000 7f231a7fc640 1 -- 172.21.15.112:0/1637820865 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f23200862b0 con 0x7f23240af2a0 2024-09-15T23:53:57.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.313+0000 7f2329632640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23080678c0 0x7f2308069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:57.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.313+0000 7f2329632640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23080678c0 0x7f2308069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23140ad000 tx=0x7f2314008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:57.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.317+0000 7f231a7fc640 1 -- 172.21.15.112:0/1637820865 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2320056ab0 con 0x7f23240af2a0 2024-09-15T23:53:57.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.469+0000 7f232c097640 1 -- 172.21.15.112:0/1637820865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f232406fcd0 con 0x7f23240af2a0 2024-09-15T23:53:57.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.469+0000 7f231a7fc640 1 -- 172.21.15.112:0/1637820865 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7f23200563b0 con 0x7f23240af2a0 2024-09-15T23:53:57.474 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:53:57.474 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:55.161085+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:53:47.908190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:53:49.056283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:53:52.808895+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:53:57.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.473+0000 7f232c097640 1 -- 172.21.15.112:0/1637820865 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23080678c0 msgr2=0x7f2308069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:57.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.473+0000 7f232c097640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23080678c0 0x7f2308069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23140ad000 tx=0x7f2314008040 comp rx=0 tx=0).stop 2024-09-15T23:53:57.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.473+0000 7f232c097640 1 -- 172.21.15.112:0/1637820865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23240af2a0 msgr2=0x7f2324153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:57.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.473+0000 7f232c097640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23240af2a0 0x7f2324153d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f232000e870 tx=0x7f232000ed30 comp rx=0 tx=0).stop 2024-09-15T23:53:57.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.473+0000 7f232c097640 1 -- 172.21.15.112:0/1637820865 shutdown_connections 2024-09-15T23:53:57.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.473+0000 7f232c097640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23080678c0 0x7f2308069d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.473+0000 7f232c097640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2324072f60 0x7f23240733f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.473+0000 7f232c097640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f232415bec0 0x7f232415cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.473+0000 7f232c097640 1 --2- 172.21.15.112:0/1637820865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23240af2a0 0x7f2324153d40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:57.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.473+0000 7f232c097640 1 -- 172.21.15.112:0/1637820865 >> 172.21.15.112:0/1637820865 conn(0x7f23240b1f90 msgr2=0x7f23240751d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:57.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.473+0000 7f232c097640 1 -- 172.21.15.112:0/1637820865 shutdown_connections 2024-09-15T23:53:57.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:57.473+0000 7f232c097640 1 -- 172.21.15.112:0/1637820865 wait complete. 2024-09-15T23:53:57.895 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:53:50.059476+0000', 'modified': '2024-09-15T23:53:55.161446+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.169:6835/2205745557', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 2205745557}, {'type': 'v1', 'addr': '172.21.15.169:6835', 'nonce': 2205745557}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4279, 'qdb_cluster': [4279]} 2024-09-15T23:53:57.895 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:53:57.895 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-15T23:53:58.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b6d7fe640 1 Processor -- start 2024-09-15T23:53:58.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b6d7fe640 1 -- start start 2024-09-15T23:53:58.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b6d7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4b6815bec0 0x7f4b680ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b6d7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b6815c2a0 0x7f4b680aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b6d7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b680b3290 con 0x7f4b680af2a0 2024-09-15T23:53:58.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b6d7fe640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4b680b3570 con 0x7f4b6815bec0 2024-09-15T23:53:58.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b6d7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4b680b3850 con 0x7f4b6815c2a0 2024-09-15T23:53:58.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b66ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4b6815bec0 0x7f4b680ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b66ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4b6815bec0 0x7f4b680ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47092/0 (socket says 172.21.15.112:47092) 2024-09-15T23:53:58.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b66ffd640 1 -- 172.21.15.112:0/2434745083 learned_addr learned my addr 172.21.15.112:0/2434745083 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:58.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b667fc640 1 --2- 172.21.15.112:0/2434745083 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b6815c2a0 0x7f4b680aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b66ffd640 1 -- 172.21.15.112:0/2434745083 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b6815c2a0 msgr2=0x7f4b680aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:58.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b66ffd640 1 --2- 172.21.15.112:0/2434745083 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b6815c2a0 0x7f4b680aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b66ffd640 1 -- 172.21.15.112:0/2434745083 >> v1:172.21.15.169:6789/0 conn(0x7f4b680af2a0 legacy=0x7f4b6815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:58.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.025+0000 7f4b66ffd640 1 -- 172.21.15.112:0/2434745083 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b680b3b30 con 0x7f4b6815bec0 2024-09-15T23:53:58.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.029+0000 7f4b66ffd640 1 --2- 172.21.15.112:0/2434745083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b6815bec0 0x7f4b680ad200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009e50 tx=0x7f4b5001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9059c65dadec47 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:58.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.029+0000 7f4b65ffb640 1 -- 172.21.15.112:0/2434745083 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b500a5840 con 0x7f4b6815bec0 2024-09-15T23:53:58.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.029+0000 7f4b65ffb640 1 -- 172.21.15.112:0/2434745083 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b500a59e0 con 0x7f4b6815bec0 2024-09-15T23:53:58.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.029+0000 7f4b65ffb640 1 -- 172.21.15.112:0/2434745083 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b500a5db0 con 0x7f4b6815bec0 2024-09-15T23:53:58.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.029+0000 7f4b6d7fe640 1 -- 172.21.15.112:0/2434745083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b6815bec0 msgr2=0x7f4b680ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.029+0000 7f4b6d7fe640 1 --2- 172.21.15.112:0/2434745083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b6815bec0 0x7f4b680ad200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009e50 tx=0x7f4b5001c9c0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.029+0000 7f4b6d7fe640 1 -- 172.21.15.112:0/2434745083 shutdown_connections 2024-09-15T23:53:58.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.029+0000 7f4b6d7fe640 1 --2- 172.21.15.112:0/2434745083 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b6815c2a0 0x7f4b680aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.029+0000 7f4b6d7fe640 1 --2- 172.21.15.112:0/2434745083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b6815bec0 0x7f4b680ad200 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.029+0000 7f4b6d7fe640 1 -- 172.21.15.112:0/2434745083 >> 172.21.15.112:0/2434745083 conn(0x7f4b680b1f90 msgr2=0x7f4b680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:58.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.029+0000 7f4b6d7fe640 1 -- 172.21.15.112:0/2434745083 shutdown_connections 2024-09-15T23:53:58.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.029+0000 7f4b6d7fe640 1 -- 172.21.15.112:0/2434745083 wait complete. 2024-09-15T23:53:58.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.029+0000 7f4b6d7fe640 1 Processor -- start 2024-09-15T23:53:58.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.029+0000 7f4b6d7fe640 1 -- start start 2024-09-15T23:53:58.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b6d7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b680af2a0 0x7f4b680998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b6d7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b6815bec0 0x7f4b68153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b6d7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b6815c2a0 0x7f4b6815e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b6d7fe640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4b680ad740 con 0x7f4b6815c2a0 2024-09-15T23:53:58.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b6d7fe640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b680afc90 con 0x7f4b6815bec0 2024-09-15T23:53:58.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b6d7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4b68169000 con 0x7f4b680af2a0 2024-09-15T23:53:58.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b677fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b6815c2a0 0x7f4b6815e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b677fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b6815c2a0 0x7f4b6815e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47106/0 (socket says 172.21.15.112:47106) 2024-09-15T23:53:58.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b677fe640 1 -- 172.21.15.112:0/2892520242 learned_addr learned my addr 172.21.15.112:0/2892520242 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:58.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b66ffd640 1 --2- 172.21.15.112:0/2892520242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b680af2a0 0x7f4b680998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b667fc640 1 --2- 172.21.15.112:0/2892520242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b6815bec0 0x7f4b68153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b677fe640 1 -- 172.21.15.112:0/2892520242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b680af2a0 msgr2=0x7f4b680998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b677fe640 1 --2- 172.21.15.112:0/2892520242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b680af2a0 0x7f4b680998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b677fe640 1 -- 172.21.15.112:0/2892520242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b6815bec0 msgr2=0x7f4b68153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b677fe640 1 --2- 172.21.15.112:0/2892520242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b6815bec0 0x7f4b68153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b677fe640 1 -- 172.21.15.112:0/2892520242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b68154710 con 0x7f4b6815c2a0 2024-09-15T23:53:58.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b677fe640 1 --2- 172.21.15.112:0/2892520242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b6815c2a0 0x7f4b6815e710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4b6000c3c0 tx=0x7f4b6000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:58.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b5f7fe640 1 -- 172.21.15.112:0/2892520242 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60011790 con 0x7f4b6815c2a0 2024-09-15T23:53:58.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b5f7fe640 1 -- 172.21.15.112:0/2892520242 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b60017070 con 0x7f4b6815c2a0 2024-09-15T23:53:58.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b6d7fe640 1 -- 172.21.15.112:0/2892520242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b681549f0 con 0x7f4b6815c2a0 2024-09-15T23:53:58.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b5f7fe640 1 -- 172.21.15.112:0/2892520242 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60011b70 con 0x7f4b6815c2a0 2024-09-15T23:53:58.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b6d7fe640 1 -- 172.21.15.112:0/2892520242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6815cab0 con 0x7f4b6815c2a0 2024-09-15T23:53:58.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b5f7fe640 1 -- 172.21.15.112:0/2892520242 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b60011d10 con 0x7f4b6815c2a0 2024-09-15T23:53:58.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b5f7fe640 1 --2- 172.21.15.112:0/2892520242 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b4c0678c0 0x7f4b4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b5f7fe640 1 -- 172.21.15.112:0/2892520242 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4b60085dc0 con 0x7f4b6815c2a0 2024-09-15T23:53:58.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.033+0000 7f4b66ffd640 1 --2- 172.21.15.112:0/2892520242 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b4c0678c0 0x7f4b4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b66ffd640 1 --2- 172.21.15.112:0/2892520242 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b4c0678c0 0x7f4b4c069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b500ae000 tx=0x7f4b500a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:58.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 Processor -- start 2024-09-15T23:53:58.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 -- start start 2024-09-15T23:53:58.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2db20 0x55c96db2df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2e440 0x55c96dae3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96dae4290 0x55c96dae4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c96d9cbb60 con 0x55c96db2e440 2024-09-15T23:53:58.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c96d932c70 con 0x55c96dae4290 2024-09-15T23:53:58.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55c96d8d8ed0 con 0x55c96db2db20 2024-09-15T23:53:58.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b667fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2e440 0x55c96dae3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b667fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2e440 0x55c96dae3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47116/0 (socket says 172.21.15.112:47116) 2024-09-15T23:53:58.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b667fc640 1 -- 172.21.15.112:0/2696504059 learned_addr learned my addr 172.21.15.112:0/2696504059 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:58.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b66ffd640 1 --2- 172.21.15.112:0/2696504059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2db20 0x55c96db2df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b677fe640 1 --2- 172.21.15.112:0/2696504059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96dae4290 0x55c96dae4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b667fc640 1 -- 172.21.15.112:0/2696504059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2db20 msgr2=0x55c96db2df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:58.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b667fc640 1 --2- 172.21.15.112:0/2696504059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2db20 0x55c96db2df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b667fc640 1 -- 172.21.15.112:0/2696504059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96dae4290 msgr2=0x55c96dae4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:58.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b667fc640 1 --2- 172.21.15.112:0/2696504059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96dae4290 0x55c96dae4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b667fc640 1 -- 172.21.15.112:0/2696504059 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c96d8eae50 con 0x55c96db2e440 2024-09-15T23:53:58.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b677fe640 1 --2- 172.21.15.112:0/2696504059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96dae4290 0x55c96dae4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:53:58.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b667fc640 1 --2- 172.21.15.112:0/2696504059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2e440 0x55c96dae3d50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800b840 tx=0x7f4b5800bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cfe3d905b29df9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:58.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b5cff9640 1 -- 172.21.15.112:0/2696504059 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58016020 con 0x55c96db2e440 2024-09-15T23:53:58.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b5cff9640 1 -- 172.21.15.112:0/2696504059 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b58004440 con 0x55c96db2e440 2024-09-15T23:53:58.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b5cff9640 1 -- 172.21.15.112:0/2696504059 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5800d9c0 con 0x55c96db2e440 2024-09-15T23:53:58.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 -- 172.21.15.112:0/2696504059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2e440 msgr2=0x55c96dae3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 --2- 172.21.15.112:0/2696504059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2e440 0x55c96dae3d50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800b840 tx=0x7f4b5800bd00 comp rx=0 tx=0).stop 2024-09-15T23:53:58.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 -- 172.21.15.112:0/2696504059 shutdown_connections 2024-09-15T23:53:58.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 --2- 172.21.15.112:0/2696504059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96dae4290 0x55c96dae4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 --2- 172.21.15.112:0/2696504059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2e440 0x55c96dae3d50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 --2- 172.21.15.112:0/2696504059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2db20 0x55c96db2df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 -- 172.21.15.112:0/2696504059 >> 172.21.15.112:0/2696504059 conn(0x55c96daea600 msgr2=0x55c96dae2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:58.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 -- 172.21.15.112:0/2696504059 shutdown_connections 2024-09-15T23:53:58.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 -- 172.21.15.112:0/2696504059 wait complete. 2024-09-15T23:53:58.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 -- start start 2024-09-15T23:53:58.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.037+0000 7f4b708ba000 1 Processor -- start 2024-09-15T23:53:58.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2db20 0x55c96dae8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2e440 0x55c96daeecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96dae9390 0x55c96daef230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c96d994b00 con 0x55c96db2e440 2024-09-15T23:53:58.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c96d90d360 con 0x55c96dae9390 2024-09-15T23:53:58.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55c96d90a2d0 con 0x55c96db2db20 2024-09-15T23:53:58.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 10 client.0 _ll_register_callbacks cb 0x55c96dacf820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:53:58.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b667fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2e440 0x55c96daeecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b667fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2e440 0x55c96daeecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47120/0 (socket says 172.21.15.112:47120) 2024-09-15T23:53:58.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b667fc640 1 -- 172.21.15.112:0/4271884743 learned_addr learned my addr 172.21.15.112:0/4271884743 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:58.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b667fc640 1 -- 172.21.15.112:0/4271884743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2db20 msgr2=0x55c96dae8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:58.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b667fc640 1 --2- 172.21.15.112:0/4271884743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2db20 0x55c96dae8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b667fc640 1 -- 172.21.15.112:0/4271884743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96dae9390 msgr2=0x55c96daef230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:58.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b667fc640 1 --2- 172.21.15.112:0/4271884743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96dae9390 0x55c96daef230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b667fc640 1 -- 172.21.15.112:0/4271884743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c96d8d9120 con 0x55c96db2e440 2024-09-15T23:53:58.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b667fc640 1 --2- 172.21.15.112:0/4271884743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2e440 0x55c96daeecf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4b58008010 tx=0x7f4b58004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17da7029ac8a4443 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:58.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:53:58.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b55ffb640 1 -- 172.21.15.112:0/4271884743 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5802b060 con 0x55c96db2e440 2024-09-15T23:53:58.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b55ffb640 1 -- 172.21.15.112:0/4271884743 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4b58004240 con 0x55c96db2e440 2024-09-15T23:53:58.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 1 -- 172.21.15.112:0/4271884743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b58004440 con 0x55c96db2e440 2024-09-15T23:53:58.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b55ffb640 1 -- 172.21.15.112:0/4271884743 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f4b58031050 con 0x55c96db2e440 2024-09-15T23:53:58.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 10 client.4395 fetch_fsmap learned FSMap version 6 2024-09-15T23:53:58.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 1 -- 172.21.15.112:0/4271884743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55c96d8d2450 con 0x55c96db2e440 2024-09-15T23:53:58.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b55ffb640 1 -- 172.21.15.112:0/4271884743 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b58004440 con 0x55c96db2e440 2024-09-15T23:53:58.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b55ffb640 1 -- 172.21.15.112:0/4271884743 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7f4b58034020 con 0x55c96db2e440 2024-09-15T23:53:58.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 10 client.4395 fetch_fsmap finished waiting for FSMap version 6 2024-09-15T23:53:58.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 10 client.4395 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:53:58.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 20 client.4395 populate_metadata read hostname 'smithi112' 2024-09-15T23:53:58.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 1 --2- 172.21.15.112:0/4271884743 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55c96db33f50 0x55c96db34330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 4 client.4395 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:53:58.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b708ba000 1 -- 172.21.15.112:0/4271884743 --> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c96d8ccc00 con 0x55c96db33f50 2024-09-15T23:53:58.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b66ffd640 1 --2- 172.21.15.112:0/4271884743 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55c96db33f50 0x55c96db34330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b55ffb640 10 client.4395 ms_handle_connect on v2:172.21.15.169:6834/2205745557 2024-09-15T23:53:58.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.041+0000 7f4b66ffd640 1 --2- 172.21.15.112:0/4271884743 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55c96db33f50 0x55c96db34330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=406e0612ecec4d2 server_cookie=53b66b320b96eeeb in_seq=0 out_seq=0 2024-09-15T23:53:58.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b55ffb640 1 -- 172.21.15.112:0/4271884743 <== mds.0 v2:172.21.15.169:6834/2205745557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c96d8ccc00 con 0x55c96db33f50 2024-09-15T23:53:58.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b55ffb640 10 client.4395 handle_command_reply: tid=0 2024-09-15T23:53:58.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b708ba000 1 client.4395 shutdown 2024-09-15T23:53:58.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b708ba000 1 -- 172.21.15.112:0/4271884743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2e440 msgr2=0x55c96daeecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b708ba000 1 --2- 172.21.15.112:0/4271884743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2e440 0x55c96daeecf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4b58008010 tx=0x7f4b58004740 comp rx=0 tx=0).stop 2024-09-15T23:53:58.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b708ba000 1 -- 172.21.15.112:0/4271884743 shutdown_connections 2024-09-15T23:53:58.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b708ba000 1 --2- 172.21.15.112:0/4271884743 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55c96db33f50 0x55c96db34330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b708ba000 1 --2- 172.21.15.112:0/4271884743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96dae9390 0x55c96daef230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b708ba000 1 --2- 172.21.15.112:0/4271884743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2e440 0x55c96daeecf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b55ffb640 0 client.4395 ms_handle_reset on v2:172.21.15.169:6834/2205745557 2024-09-15T23:53:58.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b708ba000 1 --2- 172.21.15.112:0/4271884743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2db20 0x55c96dae8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b708ba000 1 -- 172.21.15.112:0/4271884743 >> 172.21.15.112:0/4271884743 conn(0x55c96dae4290 msgr2=0x55c96dae2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:58.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b708ba000 1 -- 172.21.15.112:0/4271884743 shutdown_connections 2024-09-15T23:53:58.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b708ba000 1 -- 172.21.15.112:0/4271884743 wait complete. 2024-09-15T23:53:58.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.045+0000 7f4b708ba000 20 client.4395 trim_cache size 0 max 16384 2024-09-15T23:53:58.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.061+0000 7f4b708ba000 1 Processor -- start 2024-09-15T23:53:58.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.061+0000 7f4b708ba000 1 -- start start 2024-09-15T23:53:58.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96dae9390 0x55c96db44010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2db20 0x55c96db44550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96db2e440 0x55c96db2bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4b68201e50 con 0x55c96dae9390 2024-09-15T23:53:58.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b682011b0 con 0x55c96db2e440 2024-09-15T23:53:58.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4b68201800 con 0x55c96db2db20 2024-09-15T23:53:58.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b66ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96dae9390 0x55c96db44010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b66ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96dae9390 0x55c96db44010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47124/0 (socket says 172.21.15.112:47124) 2024-09-15T23:53:58.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b66ffd640 1 -- 172.21.15.112:0/602330258 learned_addr learned my addr 172.21.15.112:0/602330258 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:58.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b66ffd640 1 -- 172.21.15.112:0/602330258 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2db20 msgr2=0x55c96db44550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:58.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b66ffd640 1 --2- 172.21.15.112:0/602330258 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2db20 0x55c96db44550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b66ffd640 1 -- 172.21.15.112:0/602330258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96db2e440 msgr2=0x55c96db2bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:58.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b66ffd640 1 --2- 172.21.15.112:0/602330258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96db2e440 0x55c96db2bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b66ffd640 1 -- 172.21.15.112:0/602330258 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c96d8b9fd0 con 0x55c96dae9390 2024-09-15T23:53:58.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b66ffd640 1 --2- 172.21.15.112:0/602330258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96dae9390 0x55c96db44010 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4b500af040 tx=0x7f4b50004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9d0b728c429f47 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:58.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b57fff640 1 -- 172.21.15.112:0/602330258 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b500b9650 con 0x55c96dae9390 2024-09-15T23:53:58.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b57fff640 1 -- 172.21.15.112:0/602330258 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b500b97f0 con 0x55c96dae9390 2024-09-15T23:53:58.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b57fff640 1 -- 172.21.15.112:0/602330258 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b500b9bc0 con 0x55c96dae9390 2024-09-15T23:53:58.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 -- 172.21.15.112:0/602330258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96dae9390 msgr2=0x55c96db44010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 --2- 172.21.15.112:0/602330258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96dae9390 0x55c96db44010 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4b500af040 tx=0x7f4b50004ac0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 -- 172.21.15.112:0/602330258 shutdown_connections 2024-09-15T23:53:58.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 --2- 172.21.15.112:0/602330258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96db2e440 0x55c96db2bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 --2- 172.21.15.112:0/602330258 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2db20 0x55c96db44550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 --2- 172.21.15.112:0/602330258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96dae9390 0x55c96db44010 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 -- 172.21.15.112:0/602330258 >> 172.21.15.112:0/602330258 conn(0x55c96dae4290 msgr2=0x55c96dae88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:58.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 -- 172.21.15.112:0/602330258 shutdown_connections 2024-09-15T23:53:58.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 -- 172.21.15.112:0/602330258 wait complete. 2024-09-15T23:53:58.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 -- start start 2024-09-15T23:53:58.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 Processor -- start 2024-09-15T23:53:58.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96dae9390 0x55c96dba4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2db20 0x55c96dba54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2e440 0x55c96db5fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c96d931f80 con 0x55c96db2db20 2024-09-15T23:53:58.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c96d8eaca0 con 0x55c96dae9390 2024-09-15T23:53:58.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55c96d9372a0 con 0x55c96db2e440 2024-09-15T23:53:58.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 10 client.0 _ll_register_callbacks cb 0x7f4b5800b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:53:58.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b667fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2db20 0x55c96dba54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b667fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2db20 0x55c96dba54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47132/0 (socket says 172.21.15.112:47132) 2024-09-15T23:53:58.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b667fc640 1 -- 172.21.15.112:0/279764642 learned_addr learned my addr 172.21.15.112:0/279764642 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:58.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b667fc640 1 -- 172.21.15.112:0/279764642 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2e440 msgr2=0x55c96db5fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:58.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b667fc640 1 --2- 172.21.15.112:0/279764642 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2e440 0x55c96db5fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b667fc640 1 -- 172.21.15.112:0/279764642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96dae9390 msgr2=0x55c96dba4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:58.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b667fc640 1 --2- 172.21.15.112:0/279764642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96dae9390 0x55c96dba4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b667fc640 1 -- 172.21.15.112:0/279764642 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c96d9b5750 con 0x55c96db2db20 2024-09-15T23:53:58.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b667fc640 1 --2- 172.21.15.112:0/279764642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2db20 0x55c96dba54f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800bd40 tx=0x7f4b580046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7263e1bcad647391 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:58.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:53:58.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b55ffb640 1 -- 172.21.15.112:0/279764642 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58016070 con 0x55c96db2db20 2024-09-15T23:53:58.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b55ffb640 1 -- 172.21.15.112:0/279764642 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4b5802c9e0 con 0x55c96db2db20 2024-09-15T23:53:58.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.065+0000 7f4b708ba000 1 -- 172.21.15.112:0/279764642 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b500b97f0 con 0x55c96db2db20 2024-09-15T23:53:58.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b55ffb640 1 -- 172.21.15.112:0/279764642 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f4b58041050 con 0x55c96db2db20 2024-09-15T23:53:58.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 10 client.4401 fetch_fsmap learned FSMap version 6 2024-09-15T23:53:58.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 1 -- 172.21.15.112:0/279764642 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55c96d8c0a30 con 0x55c96db2db20 2024-09-15T23:53:58.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b55ffb640 1 -- 172.21.15.112:0/279764642 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b500b97f0 con 0x55c96db2db20 2024-09-15T23:53:58.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b55ffb640 1 -- 172.21.15.112:0/279764642 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7f4b58044020 con 0x55c96db2db20 2024-09-15T23:53:58.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 10 client.4401 fetch_fsmap finished waiting for FSMap version 6 2024-09-15T23:53:58.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 10 client.4401 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:53:58.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 20 client.4401 populate_metadata read hostname 'smithi112' 2024-09-15T23:53:58.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 1 --2- 172.21.15.112:0/279764642 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55c96db60330 0x55c96db60710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 4 client.4401 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:53:58.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 1 -- 172.21.15.112:0/279764642 --> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] -- command(tid 0: {"prefix": "status"}) -- 0x55c96d9403a0 con 0x55c96db60330 2024-09-15T23:53:58.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b66ffd640 1 --2- 172.21.15.112:0/279764642 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55c96db60330 0x55c96db60710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b66ffd640 1 --2- 172.21.15.112:0/279764642 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55c96db60330 0x55c96db60710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acbb75bf5b73c63a server_cookie=2714bf5269e730bc in_seq=0 out_seq=0 2024-09-15T23:53:58.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b55ffb640 10 client.4401 ms_handle_connect on v2:172.21.15.169:6834/2205745557 2024-09-15T23:53:58.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b55ffb640 1 -- 172.21.15.112:0/279764642 <== mds.0 v2:172.21.15.169:6834/2205745557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55c96d9403a0 con 0x55c96db60330 2024-09-15T23:53:58.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b55ffb640 10 client.4401 handle_command_reply: tid=0 2024-09-15T23:53:58.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 1 client.4401 shutdown 2024-09-15T23:53:58.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 1 -- 172.21.15.112:0/279764642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2db20 msgr2=0x55c96dba54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 1 --2- 172.21.15.112:0/279764642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2db20 0x55c96dba54f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800bd40 tx=0x7f4b580046d0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 1 -- 172.21.15.112:0/279764642 shutdown_connections 2024-09-15T23:53:58.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 1 --2- 172.21.15.112:0/279764642 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55c96db60330 0x55c96db60710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 1 --2- 172.21.15.112:0/279764642 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c96db2e440 0x55c96db5fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 1 --2- 172.21.15.112:0/279764642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c96db2db20 0x55c96dba54f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b55ffb640 0 client.4401 ms_handle_reset on v2:172.21.15.169:6834/2205745557 2024-09-15T23:53:58.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 1 --2- 172.21.15.112:0/279764642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c96dae9390 0x55c96dba4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 1 -- 172.21.15.112:0/279764642 >> 172.21.15.112:0/279764642 conn(0x55c96dae4290 msgr2=0x55c96db43000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:58.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 1 -- 172.21.15.112:0/279764642 shutdown_connections 2024-09-15T23:53:58.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 1 -- 172.21.15.112:0/279764642 wait complete. 2024-09-15T23:53:58.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b708ba000 20 client.4401 trim_cache size 0 max 16384 2024-09-15T23:53:58.077 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:53:58.077 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "1af6b673-4d40-4109-af4e-78662faa7df8", 2024-09-15T23:53:58.077 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-15T23:53:58.077 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4279, 2024-09-15T23:53:58.077 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-15T23:53:58.078 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-15T23:53:58.078 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-15T23:53:58.078 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 7.3165884869999998, 2024-09-15T23:53:58.078 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 6, 2024-09-15T23:53:58.078 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 26, 2024-09-15T23:53:58.078 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 26, 2024-09-15T23:53:58.078 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 13.395118752 2024-09-15T23:53:58.078 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:53:58.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b6d7fe640 1 -- 172.21.15.112:0/2892520242 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b4c0678c0 msgr2=0x7f4b4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b6d7fe640 1 --2- 172.21.15.112:0/2892520242 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b4c0678c0 0x7f4b4c069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b500ae000 tx=0x7f4b500a7070 comp rx=0 tx=0).stop 2024-09-15T23:53:58.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b6d7fe640 1 -- 172.21.15.112:0/2892520242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b6815c2a0 msgr2=0x7f4b6815e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b6d7fe640 1 --2- 172.21.15.112:0/2892520242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b6815c2a0 0x7f4b6815e710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4b6000c3c0 tx=0x7f4b6000c880 comp rx=0 tx=0).stop 2024-09-15T23:53:58.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b6d7fe640 1 -- 172.21.15.112:0/2892520242 shutdown_connections 2024-09-15T23:53:58.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b6d7fe640 1 --2- 172.21.15.112:0/2892520242 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b4c0678c0 0x7f4b4c069d80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b6d7fe640 1 --2- 172.21.15.112:0/2892520242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b6815c2a0 0x7f4b6815e710 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b6d7fe640 1 --2- 172.21.15.112:0/2892520242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b6815bec0 0x7f4b68153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b6d7fe640 1 --2- 172.21.15.112:0/2892520242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b680af2a0 0x7f4b680998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b6d7fe640 1 -- 172.21.15.112:0/2892520242 >> 172.21.15.112:0/2892520242 conn(0x7f4b680b1f90 msgr2=0x7f4b680aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:58.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b6d7fe640 1 -- 172.21.15.112:0/2892520242 shutdown_connections 2024-09-15T23:53:58.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.069+0000 7f4b6d7fe640 1 -- 172.21.15.112:0/2892520242 wait complete. 2024-09-15T23:53:58.089 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T23:53:58.089 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:53:58.089 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:53:58.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.197+0000 7fb359835640 1 Processor -- start 2024-09-15T23:53:58.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.197+0000 7fb359835640 1 -- start start 2024-09-15T23:53:58.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb359835640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb35406f010 0x7fb354166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb359835640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3540b3290 con 0x7fb35415c2a0 2024-09-15T23:53:58.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb359835640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3540b3570 con 0x7fb35415bec0 2024-09-15T23:53:58.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb359835640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb3540b3850 con 0x7fb35406f010 2024-09-15T23:53:58.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb3527fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb35415c2a0 0x7fb3540aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45692/0 (socket says 172.21.15.112:45692) 2024-09-15T23:53:58.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb3527fc640 1 -- 172.21.15.112:0/4158350533 learned_addr learned my addr 172.21.15.112:0/4158350533 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:53:58.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb3537fe640 1 --2- 172.21.15.112:0/4158350533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb35406f010 0x7fb354166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 -- 172.21.15.112:0/4158350533 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671766475 0 0) 0x7fb3540b3290 con 0x7fb35415c2a0 2024-09-15T23:53:58.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 -- 172.21.15.112:0/4158350533 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb340003530 con 0x7fb35415c2a0 2024-09-15T23:53:58.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 -- 172.21.15.112:0/4158350533 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1542099712 0 0) 0x7fb340003530 con 0x7fb35415c2a0 2024-09-15T23:53:58.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 -- 172.21.15.112:0/4158350533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb35406f010 msgr2=0x7fb354166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:58.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 --2- 172.21.15.112:0/4158350533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb35406f010 0x7fb354166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 -- 172.21.15.112:0/4158350533 >> v1:172.21.15.169:6789/0 conn(0x7fb35415bec0 legacy=0x7fb3540ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 -- 172.21.15.112:0/4158350533 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3540b3b30 con 0x7fb35415c2a0 2024-09-15T23:53:58.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 -- 172.21.15.112:0/4158350533 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fb34c001a00 con 0x7fb35415c2a0 2024-09-15T23:53:58.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 -- 172.21.15.112:0/4158350533 >> v1:172.21.15.112:6789/0 conn(0x7fb35415c2a0 legacy=0x7fb3540aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 --2- 172.21.15.112:0/4158350533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400039f0 0x7fb340003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 --2- 172.21.15.112:0/4158350533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb340004810 0x7fb340004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 --2- 172.21.15.112:0/4158350533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb35406f010 0x7fb3400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 -- 172.21.15.112:0/4158350533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb3540b3850 con 0x7fb3400039f0 2024-09-15T23:53:58.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 -- 172.21.15.112:0/4158350533 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb34000ba80 con 0x7fb340004810 2024-09-15T23:53:58.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb351ffb640 1 -- 172.21.15.112:0/4158350533 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb34000bc80 con 0x7fb35406f010 2024-09-15T23:53:58.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb352ffd640 1 --2- 172.21.15.112:0/4158350533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400039f0 0x7fb340003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb3527fc640 1 --2- 172.21.15.112:0/4158350533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb340004810 0x7fb340004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb3537fe640 1 --2- 172.21.15.112:0/4158350533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb35406f010 0x7fb3400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb352ffd640 1 -- 172.21.15.112:0/4158350533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb35406f010 msgr2=0x7fb3400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:58.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb352ffd640 1 --2- 172.21.15.112:0/4158350533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb35406f010 0x7fb3400051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb352ffd640 1 -- 172.21.15.112:0/4158350533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb340004810 msgr2=0x7fb340004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:53:58.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb352ffd640 1 --2- 172.21.15.112:0/4158350533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb340004810 0x7fb340004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.201+0000 7fb352ffd640 1 -- 172.21.15.112:0/4158350533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb340003530 con 0x7fb3400039f0 2024-09-15T23:53:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.205+0000 7fb352ffd640 1 --2- 172.21.15.112:0/4158350533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400039f0 0x7fb340003e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb33c001750 tx=0x7fb33c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1df373763cac44f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.205+0000 7fb351ffb640 1 -- 172.21.15.112:0/4158350533 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0013a0 con 0x7fb3400039f0 2024-09-15T23:53:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.205+0000 7fb351ffb640 1 -- 172.21.15.112:0/4158350533 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33c0a4e50 con 0x7fb3400039f0 2024-09-15T23:53:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.205+0000 7fb351ffb640 1 -- 172.21.15.112:0/4158350533 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c003600 con 0x7fb3400039f0 2024-09-15T23:53:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.205+0000 7fb359835640 1 -- 172.21.15.112:0/4158350533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400039f0 msgr2=0x7fb340003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.205+0000 7fb359835640 1 --2- 172.21.15.112:0/4158350533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400039f0 0x7fb340003e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb33c001750 tx=0x7fb33c01c390 comp rx=0 tx=0).stop 2024-09-15T23:53:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.205+0000 7fb3537fe640 1 -- 172.21.15.112:0/4158350533 reap_dead start 2024-09-15T23:53:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.205+0000 7fb359835640 1 -- 172.21.15.112:0/4158350533 shutdown_connections 2024-09-15T23:53:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.205+0000 7fb359835640 1 -- 172.21.15.112:0/4158350533 >> 172.21.15.112:0/4158350533 conn(0x7fb3540b1f90 msgr2=0x7fb3540b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.205+0000 7fb359835640 1 -- 172.21.15.112:0/4158350533 shutdown_connections 2024-09-15T23:53:58.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.205+0000 7fb359835640 1 -- 172.21.15.112:0/4158350533 wait complete. 2024-09-15T23:53:58.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.205+0000 7fb359835640 1 Processor -- start 2024-09-15T23:53:58.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.205+0000 7fb359835640 1 -- start start 2024-09-15T23:53:58.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb359835640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400039f0 0x7fb35415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb359835640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb35415c750 0x7fb35415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb359835640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb354154420 0x7fb354154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb359835640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb354167980 con 0x7fb3400039f0 2024-09-15T23:53:58.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb359835640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb354167800 con 0x7fb354154420 2024-09-15T23:53:58.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb359835640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb354167b00 con 0x7fb35415c750 2024-09-15T23:53:58.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb352ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400039f0 0x7fb35415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb352ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400039f0 0x7fb35415a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:47148/0 (socket says 172.21.15.112:47148) 2024-09-15T23:53:58.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb352ffd640 1 -- 172.21.15.112:0/2143437577 learned_addr learned my addr 172.21.15.112:0/2143437577 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:53:58.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb3537fe640 1 --2- 172.21.15.112:0/2143437577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb354154420 0x7fb354154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb3527fc640 1 --2- 172.21.15.112:0/2143437577 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb35415c750 0x7fb35415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb352ffd640 1 -- 172.21.15.112:0/2143437577 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb35415c750 msgr2=0x7fb35415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb352ffd640 1 --2- 172.21.15.112:0/2143437577 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb35415c750 0x7fb35415cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb352ffd640 1 -- 172.21.15.112:0/2143437577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb354154420 msgr2=0x7fb354154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb352ffd640 1 --2- 172.21.15.112:0/2143437577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb354154420 0x7fb354154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb352ffd640 1 -- 172.21.15.112:0/2143437577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35415dd60 con 0x7fb3400039f0 2024-09-15T23:53:58.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb352ffd640 1 --2- 172.21.15.112:0/2143437577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400039f0 0x7fb35415a9a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb33c005040 tx=0x7fb340005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:58.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb34bfff640 1 -- 172.21.15.112:0/2143437577 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c000ee0 con 0x7fb3400039f0 2024-09-15T23:53:58.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb34bfff640 1 -- 172.21.15.112:0/2143437577 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33c0bb070 con 0x7fb3400039f0 2024-09-15T23:53:58.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb359835640 1 -- 172.21.15.112:0/2143437577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb35415d4c0 con 0x7fb3400039f0 2024-09-15T23:53:58.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb34bfff640 1 -- 172.21.15.112:0/2143437577 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c007240 con 0x7fb3400039f0 2024-09-15T23:53:58.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb359835640 1 -- 172.21.15.112:0/2143437577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb35415da80 con 0x7fb3400039f0 2024-09-15T23:53:58.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb359835640 1 -- 172.21.15.112:0/2143437577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3540ad200 con 0x7fb3400039f0 2024-09-15T23:53:58.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb34bfff640 1 -- 172.21.15.112:0/2143437577 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb33c0b4040 con 0x7fb3400039f0 2024-09-15T23:53:58.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb34bfff640 1 --2- 172.21.15.112:0/2143437577 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb334067a90 0x7fb334069f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:53:58.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb34bfff640 1 -- 172.21.15.112:0/2143437577 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb33c11fdf0 con 0x7fb3400039f0 2024-09-15T23:53:58.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb3527fc640 1 --2- 172.21.15.112:0/2143437577 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb334067a90 0x7fb334069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:53:58.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.209+0000 7fb3527fc640 1 --2- 172.21.15.112:0/2143437577 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb334067a90 0x7fb334069f50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb34c001380 tx=0x7fb34c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:53:58.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.213+0000 7fb34bfff640 1 -- 172.21.15.112:0/2143437577 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb33c0160d0 con 0x7fb3400039f0 2024-09-15T23:53:58.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.405+0000 7fb359835640 1 -- 172.21.15.112:0/2143437577 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb354075140 con 0x7fb3400039f0 2024-09-15T23:53:58.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.405+0000 7fb34bfff640 1 -- 172.21.15.112:0/2143437577 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fb33c0f05f0 con 0x7fb3400039f0 2024-09-15T23:53:58.410 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T23:53:58.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.409+0000 7fb359835640 1 -- 172.21.15.112:0/2143437577 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb334067a90 msgr2=0x7fb334069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.409+0000 7fb359835640 1 --2- 172.21.15.112:0/2143437577 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb334067a90 0x7fb334069f50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb34c001380 tx=0x7fb34c009040 comp rx=0 tx=0).stop 2024-09-15T23:53:58.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.409+0000 7fb359835640 1 -- 172.21.15.112:0/2143437577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400039f0 msgr2=0x7fb35415a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:53:58.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.409+0000 7fb359835640 1 --2- 172.21.15.112:0/2143437577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400039f0 0x7fb35415a9a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb33c005040 tx=0x7fb340005840 comp rx=0 tx=0).stop 2024-09-15T23:53:58.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.409+0000 7fb359835640 1 -- 172.21.15.112:0/2143437577 shutdown_connections 2024-09-15T23:53:58.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.409+0000 7fb359835640 1 --2- 172.21.15.112:0/2143437577 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb334067a90 0x7fb334069f50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.409+0000 7fb359835640 1 --2- 172.21.15.112:0/2143437577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb354154420 0x7fb354154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.409+0000 7fb359835640 1 --2- 172.21.15.112:0/2143437577 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb35415c750 0x7fb35415cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.409+0000 7fb359835640 1 --2- 172.21.15.112:0/2143437577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3400039f0 0x7fb35415a9a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:53:58.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.409+0000 7fb359835640 1 -- 172.21.15.112:0/2143437577 >> 172.21.15.112:0/2143437577 conn(0x7fb3540b1f90 msgr2=0x7fb354159db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:53:58.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.409+0000 7fb359835640 1 -- 172.21.15.112:0/2143437577 shutdown_connections 2024-09-15T23:53:58.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58.409+0000 7fb359835640 1 -- 172.21.15.112:0/2143437577 wait complete. 2024-09-15T23:53:58.428 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:53:58.428 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:53:58.428 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-15T23:53:58.428 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-15T23:53:58.428 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:53:58.428 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:53:58.428 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:53:58.428 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:53:58.428 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-15T23:53:58.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:53:58.429 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-15T23:53:58.434 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:53:58.434 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:53:58.434 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:53:58.434 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:53:58.434 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-15T23:53:58.434 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:53:58.434 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:53:58.435 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:53:58.435 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-15T23:53:58.435 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:53:58.435 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:53:58.435 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-15T23:53:58.435 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:53:58.435 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:53:58.435 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:53:58.435 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:53:58.435 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T23:53:58.435 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42458sec preferred_lft 42458sec 2024-09-15T23:53:58.435 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2024-09-15T23:53:58.436 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:53:58.436 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T23:53:58.436 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:5c:cd:1e:d6 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:53:58.436 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T23:53:58.436 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:53:58.437 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T23:53:58.437 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:53:58.437 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:53:58.437 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2024-09-15T23:53:58.437 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2024-09-15T23:53:58.437 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2024-09-15T23:53:58.437 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T23:53:58.437 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:53:58.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:53:58.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:53:58.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:53:58.551 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:53:58.601 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-15T23:53:58.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:53:58.603 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-15T23:53:58.669 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-15T23:53:58.669 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:53:58.670 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T23:53:58.670 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:53:58.670 INFO:teuthology.orchestra.run.smithi112.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T23:53:58.670 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T23:53:58.670 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:53:58.670 INFO:teuthology.orchestra.run.smithi112.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:53:58.670 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:53:58.670 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:53:58.670 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:53:58.671 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:53:58.671 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:53:58.671 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:53:58.671 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:53:58.671 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:53:58.671 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:53:58.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:53:58.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:53:58.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:53:58.785 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-15T23:53:58.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:53:58.835 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2024-09-15T23:53:58.882 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:53:58.882 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:53:58.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:53:58.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-15T23:53:58.883 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:53:58.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:53:58.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:53:58.993 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-15T23:53:58.994 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:53:58.994 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:53:58.994 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-15T23:53:58.994 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T23:53:58.994 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-15T23:53:58.994 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-15T23:53:58.994 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-15T23:53:58.994 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:53:59.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:53:59.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:53:59.158 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:53:59.158 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:53:59.158 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-15T23:53:59.158 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T23:53:59.158 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:53:59.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:53:59.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:53:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:53:59.262 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-15T23:53:59.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:53:59.263 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:53:59.311 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-15T23:53:59.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:53:59.311 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:53:59.360 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:53:59.415 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:53:59.463 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:53:59.463 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:53:59.464 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:53:59.464 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:53:59.464 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:53:59.464 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:53:59.464 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:53:59.464 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:53:59.464 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:53:59.464 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:53:59.464 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:53:59.464 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:53:59.464 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:53:59.465 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:53:59.465 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:53:59.465 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:53:59.465 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:53:59.465 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:53:59.465 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:53:59.465 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:53:59.465 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:53:59.465 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:53:59.465 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:53:59.465 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:53:59.465 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:53:59.465 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:53:59.466 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:53:59.466 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:53:59.466 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:53:59.466 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:53:59.466 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:53:59.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:53:59.467 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:53:59.514 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:53:59.515 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-15T23:53:59.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:53:59.572 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:53:59.620 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:53:59.620 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:53:59.620 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:53:59.620 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:53:59.620 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:53:59.620 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:53:59.621 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:53:59.621 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:53:59.621 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:53:59.621 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:53:59.621 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:53:59.621 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:53:59.621 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:53:59.621 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:53:59.621 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:53:59.621 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:53:59.621 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:53:59.621 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:53:59.622 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:53:59.622 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:53:59.622 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:53:59.622 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:53:59.622 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:53:59.622 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:53:59.622 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:53:59.622 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:53:59.622 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:53:59.622 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:53:59.622 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:53:59.622 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:53:59.623 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:53:59.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:53:59.623 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:53:59.638 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi112.stderr:2024-09-15T23:53:59.637+0000 7f041c968580 -1 init, newargv = 0x565030d722f0 newargc=15 2024-09-15T23:53:59.638 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi112.stderr:ceph-fuse[34728]: starting ceph client 2024-09-15T23:53:59.649 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi112.stderr:ceph-fuse[34728]: starting fuse 2024-09-15T23:54:00.744 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:54:00.760 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:00.809 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:54:00.809 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:54:00.809 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:54:00.810 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:54:00.810 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:54:00.810 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:54:00.810 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:54:00.810 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:54:00.810 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:54:00.810 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:54:00.810 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:54:00.810 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:54:00.810 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:00.811 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:54:00.811 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:54:00.811 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:54:00.811 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:54:00.811 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:54:00.811 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:00.811 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:54:00.811 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:00.811 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:54:00.812 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:54:00.812 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:54:00.812 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:54:00.812 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:54:00.812 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:54:00.813 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:54:00.813 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:54:00.813 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:54:00.813 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:54:00.813 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-15T23:54:00.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:00.814 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:54:00.863 INFO:teuthology.orchestra.run.smithi112.stdout:45 2024-09-15T23:54:00.863 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T23:54:00.863 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:54:00.863 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> import re 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:00.864 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2024-09-15T23:54:00.865 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:54:00.865 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:54:00.865 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:54:00.865 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2024-09-15T23:54:00.865 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2024-09-15T23:54:00.865 DEBUG:teuthology.orchestra.run.smithi112:> return f 2024-09-15T23:54:00.865 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:54:00.865 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:00.865 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.admin")) 2024-09-15T23:54:00.865 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:54:00.984 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.admin.34728.asok 2024-09-15T23:54:00.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:00.996 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.34728.asok 2024-09-15T23:54:00.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:00.997 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.34728.asok status 2024-09-15T23:54:01.146 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:54:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2024-09-15T23:54:01.146 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:54:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:54:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "admin", 2024-09-15T23:54:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2024-09-15T23:54:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-15T23:54:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "34728", 2024-09-15T23:54:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2024-09-15T23:54:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2024-09-15T23:54:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2024-09-15T23:54:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4413, 2024-09-15T23:54:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2024-09-15T23:54:01.147 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2024-09-15T23:54:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2024-09-15T23:54:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 4413 2024-09-15T23:54:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:54:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:54:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:54:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1545072342 2024-09-15T23:54:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:54:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:54:01.148 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:54:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1545072342 2024-09-15T23:54:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.4413 192.168.0.1:0/1545072342", 2024-09-15T23:54:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.1:0/1545072342", 2024-09-15T23:54:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2024-09-15T23:54:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 6, 2024-09-15T23:54:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 26, 2024-09-15T23:54:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:54:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2024-09-15T23:54:01.149 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2024-09-15T23:54:01.149 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:54:01.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:01.160 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2024-09-15T23:54:01.160 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:54:01.167 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2024-09-15T23:54:01.167 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:54:01.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:01.167 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:54:01.222 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-15T23:54:01.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:54:01.360 INFO:teuthology.orchestra.run.smithi112.stdout:# file: . 2024-09-15T23:54:01.360 INFO:teuthology.orchestra.run.smithi112.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-15T23:54:01.360 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:01.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:01.368 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:54:01.368 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:54:01.374 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:54:01.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.549+0000 7f9e4e201640 1 Processor -- start 2024-09-15T23:54:01.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.549+0000 7f9e4e201640 1 -- start start 2024-09-15T23:54:01.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.549+0000 7f9e4e201640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9e48070020 0x7f9e4815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:01.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.549+0000 7f9e4e201640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e480aede0 con 0x7f9e481520a0 2024-09-15T23:54:01.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.549+0000 7f9e4e201640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e4815fa10 con 0x7f9e4815f1d0 2024-09-15T23:54:01.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.549+0000 7f9e4e201640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9e48152480 con 0x7f9e48070020 2024-09-15T23:54:01.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.549+0000 7f9e46ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9e48070020 0x7f9e4815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:01.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.549+0000 7f9e46ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9e48070020 0x7f9e4815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57260/0 (socket says 172.21.15.112:57260) 2024-09-15T23:54:01.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.549+0000 7f9e46ffd640 1 -- 172.21.15.112:0/4073751543 learned_addr learned my addr 172.21.15.112:0/4073751543 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:01.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.549+0000 7f9e46ffd640 1 -- 172.21.15.112:0/4073751543 >> v1:172.21.15.169:6789/0 conn(0x7f9e4815f1d0 legacy=0x7f9e480adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:01.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.549+0000 7f9e46ffd640 1 -- 172.21.15.112:0/4073751543 >> v1:172.21.15.112:6789/0 conn(0x7f9e481520a0 legacy=0x7f9e4806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:01.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.549+0000 7f9e46ffd640 1 -- 172.21.15.112:0/4073751543 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e48074250 con 0x7f9e48070020 2024-09-15T23:54:01.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e46ffd640 1 --2- 172.21.15.112:0/4073751543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e48070020 0x7f9e4815ec90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009870 tx=0x7f9e3001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bfeba8291265bb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:01.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e467fc640 1 -- 172.21.15.112:0/4073751543 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e480aeba0 con 0x7f9e48070020 2024-09-15T23:54:01.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e467fc640 1 -- 172.21.15.112:0/4073751543 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e300af070 con 0x7f9e48070020 2024-09-15T23:54:01.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e467fc640 1 -- 172.21.15.112:0/4073751543 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e300aa870 con 0x7f9e48070020 2024-09-15T23:54:01.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 -- 172.21.15.112:0/4073751543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e48070020 msgr2=0x7f9e4815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:01.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 --2- 172.21.15.112:0/4073751543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e48070020 0x7f9e4815ec90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009870 tx=0x7f9e3001c4f0 comp rx=0 tx=0).stop 2024-09-15T23:54:01.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 -- 172.21.15.112:0/4073751543 shutdown_connections 2024-09-15T23:54:01.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 --2- 172.21.15.112:0/4073751543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e48070020 0x7f9e4815ec90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:01.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 -- 172.21.15.112:0/4073751543 >> 172.21.15.112:0/4073751543 conn(0x7f9e480b1f90 msgr2=0x7f9e480b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:01.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 -- 172.21.15.112:0/4073751543 shutdown_connections 2024-09-15T23:54:01.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 -- 172.21.15.112:0/4073751543 wait complete. 2024-09-15T23:54:01.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 Processor -- start 2024-09-15T23:54:01.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 -- start start 2024-09-15T23:54:01.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e48070020 0x7f9e481540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:01.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e481520a0 0x7f9e4815d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:01.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e4815f1d0 0x7f9e4815dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:01.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4815f680 con 0x7f9e4815f1d0 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9e48073d30 con 0x7f9e481520a0 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e4e201640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9e48168f20 con 0x7f9e48070020 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e47fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e4815f1d0 0x7f9e4815dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e47fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e4815f1d0 0x7f9e4815dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57268/0 (socket says 172.21.15.112:57268) 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e47fff640 1 -- 172.21.15.112:0/4035916812 learned_addr learned my addr 172.21.15.112:0/4035916812 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e46ffd640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e481520a0 0x7f9e4815d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e477fe640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e48070020 0x7f9e481540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e47fff640 1 -- 172.21.15.112:0/4035916812 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e48070020 msgr2=0x7f9e481540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e47fff640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e48070020 0x7f9e481540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e47fff640 1 -- 172.21.15.112:0/4035916812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e481520a0 msgr2=0x7f9e4815d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e47fff640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e481520a0 0x7f9e4815d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e47fff640 1 -- 172.21.15.112:0/4035916812 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e48154ad0 con 0x7f9e4815f1d0 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.553+0000 7f9e477fe640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e48070020 0x7f9e481540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.557+0000 7f9e47fff640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e4815f1d0 0x7f9e4815dc40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000c7b0 tx=0x7f9e4000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.557+0000 7f9e3ffff640 1 -- 172.21.15.112:0/4035916812 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40004b70 con 0x7f9e4815f1d0 2024-09-15T23:54:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.557+0000 7f9e3ffff640 1 -- 172.21.15.112:0/4035916812 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e40004d10 con 0x7f9e4815f1d0 2024-09-15T23:54:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.557+0000 7f9e3ffff640 1 -- 172.21.15.112:0/4035916812 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4000aa90 con 0x7f9e4815f1d0 2024-09-15T23:54:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.557+0000 7f9e4e201640 1 -- 172.21.15.112:0/4035916812 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e480cccb0 con 0x7f9e4815f1d0 2024-09-15T23:54:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.557+0000 7f9e4e201640 1 -- 172.21.15.112:0/4035916812 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e480cd270 con 0x7f9e4815f1d0 2024-09-15T23:54:01.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.557+0000 7f9e4e201640 1 -- 172.21.15.112:0/4035916812 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e4815ec90 con 0x7f9e4815f1d0 2024-09-15T23:54:01.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.557+0000 7f9e3ffff640 1 -- 172.21.15.112:0/4035916812 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e4000ac30 con 0x7f9e4815f1d0 2024-09-15T23:54:01.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.557+0000 7f9e3ffff640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9e2c0678c0 0x7f9e2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:01.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.557+0000 7f9e3ffff640 1 -- 172.21.15.112:0/4035916812 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9e40086950 con 0x7f9e4815f1d0 2024-09-15T23:54:01.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.557+0000 7f9e477fe640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9e2c0678c0 0x7f9e2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:01.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.557+0000 7f9e477fe640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9e2c0678c0 0x7f9e2c069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e380016f0 tx=0x7f9e38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:01.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.561+0000 7f9e3ffff640 1 -- 172.21.15.112:0/4035916812 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9e40020070 con 0x7f9e4815f1d0 2024-09-15T23:54:01.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.737+0000 7f9e4e201640 1 -- 172.21.15.112:0/4035916812 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9e48150fc0 con 0x7f9e4815f1d0 2024-09-15T23:54:01.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.737+0000 7f9e3ffff640 1 -- 172.21.15.112:0/4035916812 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f9e40057230 con 0x7f9e4815f1d0 2024-09-15T23:54:01.739 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:54:01.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.737+0000 7f9e4e201640 1 -- 172.21.15.112:0/4035916812 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9e2c0678c0 msgr2=0x7f9e2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:01.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.737+0000 7f9e4e201640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9e2c0678c0 0x7f9e2c069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e380016f0 tx=0x7f9e38009040 comp rx=0 tx=0).stop 2024-09-15T23:54:01.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.737+0000 7f9e4e201640 1 -- 172.21.15.112:0/4035916812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e4815f1d0 msgr2=0x7f9e4815dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:01.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.737+0000 7f9e4e201640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e4815f1d0 0x7f9e4815dc40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000c7b0 tx=0x7f9e4000cc70 comp rx=0 tx=0).stop 2024-09-15T23:54:01.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.737+0000 7f9e4e201640 1 -- 172.21.15.112:0/4035916812 shutdown_connections 2024-09-15T23:54:01.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.737+0000 7f9e4e201640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9e2c0678c0 0x7f9e2c069d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:01.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.737+0000 7f9e4e201640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e4815f1d0 0x7f9e4815dc40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:01.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.737+0000 7f9e4e201640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e481520a0 0x7f9e4815d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:01.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.737+0000 7f9e4e201640 1 --2- 172.21.15.112:0/4035916812 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e48070020 0x7f9e481540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:01.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.737+0000 7f9e4e201640 1 -- 172.21.15.112:0/4035916812 >> 172.21.15.112:0/4035916812 conn(0x7f9e480b1f90 msgr2=0x7f9e4815b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:01.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.737+0000 7f9e4e201640 1 -- 172.21.15.112:0/4035916812 shutdown_connections 2024-09-15T23:54:01.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.737+0000 7f9e4e201640 1 -- 172.21.15.112:0/4035916812 wait complete. 2024-09-15T23:54:01.758 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:54:01.758 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:54:01.764 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:54:01.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.929+0000 7feef3b5b640 1 Processor -- start 2024-09-15T23:54:01.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.929+0000 7feef3b5b640 1 -- start start 2024-09-15T23:54:01.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.929+0000 7feef3b5b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feeec0b39a0 0x7feeec06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:01.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.929+0000 7feef3b5b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeec06e4b0 0x7feeec072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:01.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.929+0000 7feef3b5b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeec06ec60 con 0x7feeec1587a0 2024-09-15T23:54:01.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.929+0000 7feef3b5b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7feeec06f870 con 0x7feeec0b39a0 2024-09-15T23:54:01.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.929+0000 7feef3b5b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feeec06ef40 con 0x7feeec06e4b0 2024-09-15T23:54:01.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.929+0000 7feef10f6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feeec0b39a0 0x7feeec06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:01.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef10f6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feeec0b39a0 0x7feeec06df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57270/0 (socket says 172.21.15.112:57270) 2024-09-15T23:54:01.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef10f6640 1 -- 172.21.15.112:0/1499056153 learned_addr learned my addr 172.21.15.112:0/1499056153 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:01.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef20f8640 1 --2- 172.21.15.112:0/1499056153 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeec06e4b0 0x7feeec072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:01.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef10f6640 1 -- 172.21.15.112:0/1499056153 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeec06e4b0 msgr2=0x7feeec072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:01.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef10f6640 1 --2- 172.21.15.112:0/1499056153 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeec06e4b0 0x7feeec072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:01.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef10f6640 1 -- 172.21.15.112:0/1499056153 >> v1:172.21.15.169:6789/0 conn(0x7feeec1587a0 legacy=0x7feeec0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:01.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef10f6640 1 -- 172.21.15.112:0/1499056153 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeec06f220 con 0x7feeec0b39a0 2024-09-15T23:54:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef10f6640 1 --2- 172.21.15.112:0/1499056153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feeec0b39a0 0x7feeec06df70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feedc009870 tx=0x7feedc01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862955f7eef316d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:01.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef08f5640 1 -- 172.21.15.112:0/1499056153 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc0ab650 con 0x7feeec0b39a0 2024-09-15T23:54:01.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef08f5640 1 -- 172.21.15.112:0/1499056153 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feedc0b0070 con 0x7feeec0b39a0 2024-09-15T23:54:01.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef08f5640 1 -- 172.21.15.112:0/1499056153 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc0aba10 con 0x7feeec0b39a0 2024-09-15T23:54:01.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef3b5b640 1 -- 172.21.15.112:0/1499056153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feeec0b39a0 msgr2=0x7feeec06df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:01.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef3b5b640 1 --2- 172.21.15.112:0/1499056153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feeec0b39a0 0x7feeec06df70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feedc009870 tx=0x7feedc01c530 comp rx=0 tx=0).stop 2024-09-15T23:54:01.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef3b5b640 1 -- 172.21.15.112:0/1499056153 shutdown_connections 2024-09-15T23:54:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef3b5b640 1 --2- 172.21.15.112:0/1499056153 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeec06e4b0 0x7feeec072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef3b5b640 1 --2- 172.21.15.112:0/1499056153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feeec0b39a0 0x7feeec06df70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef3b5b640 1 -- 172.21.15.112:0/1499056153 >> 172.21.15.112:0/1499056153 conn(0x7feeec0b1f90 msgr2=0x7feeec0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef3b5b640 1 -- 172.21.15.112:0/1499056153 shutdown_connections 2024-09-15T23:54:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.933+0000 7feef3b5b640 1 -- 172.21.15.112:0/1499056153 wait complete. 2024-09-15T23:54:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef3b5b640 1 Processor -- start 2024-09-15T23:54:01.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef3b5b640 1 -- start start 2024-09-15T23:54:01.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef3b5b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feeec06e4b0 0x7feeec150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:01.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef3b5b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feeec0b39a0 0x7feeec14c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:01.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef3b5b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeec1587a0 0x7feeec14c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:01.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef3b5b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feeec073030 con 0x7feeec06e4b0 2024-09-15T23:54:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef3b5b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feeec072eb0 con 0x7feeec0b39a0 2024-09-15T23:54:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef3b5b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feeec0731b0 con 0x7feeec1587a0 2024-09-15T23:54:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef18f7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feeec06e4b0 0x7feeec150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef18f7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feeec06e4b0 0x7feeec150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57274/0 (socket says 172.21.15.112:57274) 2024-09-15T23:54:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef18f7640 1 -- 172.21.15.112:0/1071775717 learned_addr learned my addr 172.21.15.112:0/1071775717 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef10f6640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feeec0b39a0 0x7feeec14c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef20f8640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeec1587a0 0x7feeec14c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef18f7640 1 -- 172.21.15.112:0/1071775717 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeec1587a0 msgr2=0x7feeec14c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef18f7640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeec1587a0 0x7feeec14c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef18f7640 1 -- 172.21.15.112:0/1071775717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feeec0b39a0 msgr2=0x7feeec14c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef18f7640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feeec0b39a0 0x7feeec14c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:01.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef18f7640 1 -- 172.21.15.112:0/1071775717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeec153110 con 0x7feeec06e4b0 2024-09-15T23:54:01.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef20f8640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeec1587a0 0x7feeec14c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:01.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef18f7640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feeec06e4b0 0x7feeec150c10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feee800c3c0 tx=0x7feee800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:01.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feee27fc640 1 -- 172.21.15.112:0/1071775717 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee8017070 con 0x7feeec06e4b0 2024-09-15T23:54:01.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feee27fc640 1 -- 172.21.15.112:0/1071775717 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee80052d0 con 0x7feeec06e4b0 2024-09-15T23:54:01.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef3b5b640 1 -- 172.21.15.112:0/1071775717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeec14cef0 con 0x7feeec06e4b0 2024-09-15T23:54:01.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feee27fc640 1 -- 172.21.15.112:0/1071775717 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee8003840 con 0x7feeec06e4b0 2024-09-15T23:54:01.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef3b5b640 1 -- 172.21.15.112:0/1071775717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeec14d4b0 con 0x7feeec06e4b0 2024-09-15T23:54:01.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feef3b5b640 1 -- 172.21.15.112:0/1071775717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeec072160 con 0x7feeec06e4b0 2024-09-15T23:54:01.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.937+0000 7feee27fc640 1 -- 172.21.15.112:0/1071775717 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feee801a070 con 0x7feeec06e4b0 2024-09-15T23:54:01.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.941+0000 7feee27fc640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feed00678c0 0x7feed0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:01.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.941+0000 7feee27fc640 1 -- 172.21.15.112:0/1071775717 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7feee8085310 con 0x7feeec06e4b0 2024-09-15T23:54:01.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.941+0000 7feef10f6640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feed00678c0 0x7feed0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:01.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.941+0000 7feef10f6640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feed00678c0 0x7feed0069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feedc0af000 tx=0x7feedc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:01.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:01.945+0000 7feee27fc640 1 -- 172.21.15.112:0/1071775717 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feee8005480 con 0x7feeec06e4b0 2024-09-15T23:54:02.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.113+0000 7feef3b5b640 1 -- 172.21.15.112:0/1071775717 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7feeec070080 con 0x7feeec06e4b0 2024-09-15T23:54:02.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.117+0000 7feee27fc640 1 -- 172.21.15.112:0/1071775717 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7feee8055b10 con 0x7feeec06e4b0 2024-09-15T23:54:02.118 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:54:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.117+0000 7feef3b5b640 1 -- 172.21.15.112:0/1071775717 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feed00678c0 msgr2=0x7feed0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.117+0000 7feef3b5b640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feed00678c0 0x7feed0069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feedc0af000 tx=0x7feedc008040 comp rx=0 tx=0).stop 2024-09-15T23:54:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.117+0000 7feef3b5b640 1 -- 172.21.15.112:0/1071775717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feeec06e4b0 msgr2=0x7feeec150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.117+0000 7feef3b5b640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feeec06e4b0 0x7feeec150c10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feee800c3c0 tx=0x7feee800c880 comp rx=0 tx=0).stop 2024-09-15T23:54:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.117+0000 7feef3b5b640 1 -- 172.21.15.112:0/1071775717 shutdown_connections 2024-09-15T23:54:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.117+0000 7feef3b5b640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feed00678c0 0x7feed0069d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.117+0000 7feef3b5b640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feeec1587a0 0x7feeec14c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.117+0000 7feef3b5b640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feeec0b39a0 0x7feeec14c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.117+0000 7feef3b5b640 1 --2- 172.21.15.112:0/1071775717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feeec06e4b0 0x7feeec150c10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.117+0000 7feef3b5b640 1 -- 172.21.15.112:0/1071775717 >> 172.21.15.112:0/1071775717 conn(0x7feeec0b1f90 msgr2=0x7feeec157930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:02.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.117+0000 7feef3b5b640 1 -- 172.21.15.112:0/1071775717 shutdown_connections 2024-09-15T23:54:02.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.117+0000 7feef3b5b640 1 -- 172.21.15.112:0/1071775717 wait complete. 2024-09-15T23:54:02.135 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2024-09-15T23:54:02.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:02.135 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:54:02.161 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi112.stderr:ceph-fuse[34728]: fuse finished with error 0 and tester_r 0 2024-09-15T23:54:02.162 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:54:02.228 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:54:02.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:02.228 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-15T23:54:02.244 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:02.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.405+0000 7f700e243640 1 Processor -- start 2024-09-15T23:54:02.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.405+0000 7f700e243640 1 -- start start 2024-09-15T23:54:02.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f700e243640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7008073e60 0x7f700806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f700e243640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f700806fef0 0x7f700815b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f700e243640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f700815bda0 con 0x7f70080b3d50 2024-09-15T23:54:02.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f700e243640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f700806ee50 con 0x7f700806fef0 2024-09-15T23:54:02.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f700e243640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f700806f130 con 0x7f7008073e60 2024-09-15T23:54:02.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f6ffeffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f700806fef0 0x7f700815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:02.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f6ffeffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f700806fef0 0x7f700815b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57290/0 (socket says 172.21.15.112:57290) 2024-09-15T23:54:02.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f6ffeffd640 1 -- 172.21.15.112:0/502848623 learned_addr learned my addr 172.21.15.112:0/502848623 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:02.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f6ffeffd640 1 -- 172.21.15.112:0/502848623 >> v2:172.21.15.169:3300/0 conn(0x7f7008073e60 msgr2=0x7f700806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:02.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f6ffeffd640 1 --2- 172.21.15.112:0/502848623 >> v2:172.21.15.169:3300/0 conn(0x7f7008073e60 0x7f700806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f6ffeffd640 1 -- 172.21.15.112:0/502848623 >> v1:172.21.15.169:6789/0 conn(0x7f70080b3d50 legacy=0x7f70080b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:02.412 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f6ffeffd640 1 -- 172.21.15.112:0/502848623 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700806f410 con 0x7f700806fef0 2024-09-15T23:54:02.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f6ffeffd640 1 --2- 172.21.15.112:0/502848623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f700806fef0 0x7f700815b860 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7008070340 tx=0x7f6ff001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3288e68eaed27 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:02.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f7006ffd640 1 -- 172.21.15.112:0/502848623 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00b0070 con 0x7f700806fef0 2024-09-15T23:54:02.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f7006ffd640 1 -- 172.21.15.112:0/502848623 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff00ab600 con 0x7f700806fef0 2024-09-15T23:54:02.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.409+0000 7f7006ffd640 1 -- 172.21.15.112:0/502848623 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00ab9d0 con 0x7f700806fef0 2024-09-15T23:54:02.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 -- 172.21.15.112:0/502848623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f700806fef0 msgr2=0x7f700815b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:02.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 --2- 172.21.15.112:0/502848623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f700806fef0 0x7f700815b860 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7008070340 tx=0x7f6ff001c450 comp rx=0 tx=0).stop 2024-09-15T23:54:02.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 -- 172.21.15.112:0/502848623 shutdown_connections 2024-09-15T23:54:02.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 --2- 172.21.15.112:0/502848623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f700806fef0 0x7f700815b860 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 --2- 172.21.15.112:0/502848623 >> v2:172.21.15.169:3300/0 conn(0x7f7008073e60 0x7f700806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 -- 172.21.15.112:0/502848623 >> 172.21.15.112:0/502848623 conn(0x7f70080b1f90 msgr2=0x7f70080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:02.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 -- 172.21.15.112:0/502848623 shutdown_connections 2024-09-15T23:54:02.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 -- 172.21.15.112:0/502848623 wait complete. 2024-09-15T23:54:02.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 Processor -- start 2024-09-15T23:54:02.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 -- start start 2024-09-15T23:54:02.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700806fef0 0x7f7008156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7008073e60 0x7f70080cda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70080b3d50 0x7f70080cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f70080729a0 con 0x7f70080b3d50 2024-09-15T23:54:02.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7008072820 con 0x7f7008073e60 2024-09-15T23:54:02.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7008072b20 con 0x7f700806fef0 2024-09-15T23:54:02.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f7007fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70080b3d50 0x7f70080cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:02.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f7007fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70080b3d50 0x7f70080cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57298/0 (socket says 172.21.15.112:57298) 2024-09-15T23:54:02.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f7007fff640 1 -- 172.21.15.112:0/994637049 learned_addr learned my addr 172.21.15.112:0/994637049 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:02.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f6ffeffd640 1 --2- 172.21.15.112:0/994637049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7008073e60 0x7f70080cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:02.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f7007fff640 1 -- 172.21.15.112:0/994637049 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700806fef0 msgr2=0x7f7008156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:02.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f7007fff640 1 --2- 172.21.15.112:0/994637049 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700806fef0 0x7f7008156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f7007fff640 1 -- 172.21.15.112:0/994637049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7008073e60 msgr2=0x7f70080cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:02.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f7007fff640 1 --2- 172.21.15.112:0/994637049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7008073e60 0x7f70080cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f7007fff640 1 -- 172.21.15.112:0/994637049 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7008157440 con 0x7f70080b3d50 2024-09-15T23:54:02.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f7007fff640 1 --2- 172.21.15.112:0/994637049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70080b3d50 0x7f70080cdf50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f700000c780 tx=0x7f700000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:02.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f7004ff9640 1 -- 172.21.15.112:0/994637049 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7000004b70 con 0x7f70080b3d50 2024-09-15T23:54:02.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f7004ff9640 1 -- 172.21.15.112:0/994637049 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7000004d10 con 0x7f70080b3d50 2024-09-15T23:54:02.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 -- 172.21.15.112:0/994637049 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70081fc5e0 con 0x7f70080b3d50 2024-09-15T23:54:02.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f7004ff9640 1 -- 172.21.15.112:0/994637049 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700000aa90 con 0x7f70080b3d50 2024-09-15T23:54:02.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.413+0000 7f700e243640 1 -- 172.21.15.112:0/994637049 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70081434c0 con 0x7f70080b3d50 2024-09-15T23:54:02.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.417+0000 7f700e243640 1 -- 172.21.15.112:0/994637049 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f700815b860 con 0x7f70080b3d50 2024-09-15T23:54:02.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.417+0000 7f7004ff9640 1 -- 172.21.15.112:0/994637049 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f700000ac30 con 0x7f70080b3d50 2024-09-15T23:54:02.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.417+0000 7f7004ff9640 1 --2- 172.21.15.112:0/994637049 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6fe80678c0 0x7f6fe8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.417+0000 7f70077fe640 1 --2- 172.21.15.112:0/994637049 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6fe80678c0 0x7f6fe8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:02.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.417+0000 7f7004ff9640 1 -- 172.21.15.112:0/994637049 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7000086370 con 0x7f70080b3d50 2024-09-15T23:54:02.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.417+0000 7f70077fe640 1 --2- 172.21.15.112:0/994637049 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6fe80678c0 0x7f6fe8069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009730 tx=0x7f6ff8006ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:02.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.421+0000 7f7004ff9640 1 -- 172.21.15.112:0/994637049 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7000020070 con 0x7f70080b3d50 2024-09-15T23:54:02.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.573+0000 7f700e243640 1 -- 172.21.15.112:0/994637049 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7008152f70 con 0x7f70080b3d50 2024-09-15T23:54:02.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.577+0000 7f7004ff9640 1 -- 172.21.15.112:0/994637049 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7f700007de20 con 0x7f70080b3d50 2024-09-15T23:54:02.579 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:02.580 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:55.161085+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:53:47.908190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:53:49.056283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:53:52.808895+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:02.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.577+0000 7f700e243640 1 -- 172.21.15.112:0/994637049 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6fe80678c0 msgr2=0x7f6fe8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:02.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.577+0000 7f700e243640 1 --2- 172.21.15.112:0/994637049 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6fe80678c0 0x7f6fe8069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009730 tx=0x7f6ff8006ca0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.577+0000 7f700e243640 1 -- 172.21.15.112:0/994637049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70080b3d50 msgr2=0x7f70080cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:02.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.577+0000 7f700e243640 1 --2- 172.21.15.112:0/994637049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70080b3d50 0x7f70080cdf50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f700000c780 tx=0x7f700000cc40 comp rx=0 tx=0).stop 2024-09-15T23:54:02.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.577+0000 7f700e243640 1 -- 172.21.15.112:0/994637049 shutdown_connections 2024-09-15T23:54:02.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.577+0000 7f700e243640 1 --2- 172.21.15.112:0/994637049 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6fe80678c0 0x7f6fe8069d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.577+0000 7f700e243640 1 --2- 172.21.15.112:0/994637049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70080b3d50 0x7f70080cdf50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.577+0000 7f700e243640 1 --2- 172.21.15.112:0/994637049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7008073e60 0x7f70080cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.577+0000 7f700e243640 1 --2- 172.21.15.112:0/994637049 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f700806fef0 0x7f7008156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.577+0000 7f700e243640 1 -- 172.21.15.112:0/994637049 >> 172.21.15.112:0/994637049 conn(0x7f70080b1f90 msgr2=0x7f7008158a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:02.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.577+0000 7f700e243640 1 -- 172.21.15.112:0/994637049 shutdown_connections 2024-09-15T23:54:02.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.577+0000 7f700e243640 1 -- 172.21.15.112:0/994637049 wait complete. 2024-09-15T23:54:02.597 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:02.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dd57bc640 1 Processor -- start 2024-09-15T23:54:02.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dd57bc640 1 -- start start 2024-09-15T23:54:02.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dd57bc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd0144d60 0x7f2dd0070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dd57bc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2dd00b4090 0x7f2dd00b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dd57bc640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd0071030 con 0x7f2dd00b4ba0 2024-09-15T23:54:02.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dd57bc640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd0070660 con 0x7f2dd00b4090 2024-09-15T23:54:02.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dd57bc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd006fa50 con 0x7f2dd0144d60 2024-09-15T23:54:02.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcf7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2dd00b4ba0 0x7f2dd00ae610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49648/0 (socket says 172.21.15.112:49648) 2024-09-15T23:54:02.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcf7fe640 1 -- 172.21.15.112:0/1313965676 learned_addr learned my addr 172.21.15.112:0/1313965676 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:02.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dceffd640 1 --2- 172.21.15.112:0/1313965676 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd0144d60 0x7f2dd0070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:02.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dce7fc640 1 --2- 172.21.15.112:0/1313965676 >> v2:172.21.15.169:3300/0 conn(0x7f2dd00b4090 0x7f2dd00b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:02.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 -- 172.21.15.112:0/1313965676 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1218840966 0 0) 0x7f2dd0071030 con 0x7f2dd00b4ba0 2024-09-15T23:54:02.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 -- 172.21.15.112:0/1313965676 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2db8003530 con 0x7f2dd00b4ba0 2024-09-15T23:54:02.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 -- 172.21.15.112:0/1313965676 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2951424068 0 0) 0x7f2db8003530 con 0x7f2dd00b4ba0 2024-09-15T23:54:02.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 -- 172.21.15.112:0/1313965676 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd0144d60 msgr2=0x7f2dd0070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:02.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 --2- 172.21.15.112:0/1313965676 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd0144d60 0x7f2dd0070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 -- 172.21.15.112:0/1313965676 >> v2:172.21.15.169:3300/0 conn(0x7f2dd00b4090 msgr2=0x7f2dd00b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:02.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 --2- 172.21.15.112:0/1313965676 >> v2:172.21.15.169:3300/0 conn(0x7f2dd00b4090 0x7f2dd00b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 -- 172.21.15.112:0/1313965676 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd006fd30 con 0x7f2dd00b4ba0 2024-09-15T23:54:02.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 -- 172.21.15.112:0/1313965676 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f2dc0001680 con 0x7f2dd00b4ba0 2024-09-15T23:54:02.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 -- 172.21.15.112:0/1313965676 >> v1:172.21.15.112:6789/0 conn(0x7f2dd00b4ba0 legacy=0x7f2dd00ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:02.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 --2- 172.21.15.112:0/1313965676 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db80039c0 0x7f2db8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 --2- 172.21.15.112:0/1313965676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db8004810 0x7f2db8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 --2- 172.21.15.112:0/1313965676 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd0144d60 0x7f2db80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 -- 172.21.15.112:0/1313965676 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd0070660 con 0x7f2db8004810 2024-09-15T23:54:02.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 -- 172.21.15.112:0/1313965676 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd006fa50 con 0x7f2db80039c0 2024-09-15T23:54:02.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcdffb640 1 -- 172.21.15.112:0/1313965676 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2db800b9d0 con 0x7f2dd0144d60 2024-09-15T23:54:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dce7fc640 1 --2- 172.21.15.112:0/1313965676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db8004810 0x7f2db8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dceffd640 1 --2- 172.21.15.112:0/1313965676 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db80039c0 0x7f2db8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcf7fe640 1 --2- 172.21.15.112:0/1313965676 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd0144d60 0x7f2db80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dce7fc640 1 -- 172.21.15.112:0/1313965676 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd0144d60 msgr2=0x7f2db80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dce7fc640 1 --2- 172.21.15.112:0/1313965676 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd0144d60 0x7f2db80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dce7fc640 1 -- 172.21.15.112:0/1313965676 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db80039c0 msgr2=0x7f2db8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dce7fc640 1 --2- 172.21.15.112:0/1313965676 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db80039c0 0x7f2db8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dce7fc640 1 -- 172.21.15.112:0/1313965676 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db8003530 con 0x7f2db8004810 2024-09-15T23:54:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dceffd640 1 --2- 172.21.15.112:0/1313965676 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db80039c0 0x7f2db8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:02.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.713+0000 7f2dcf7fe640 1 --2- 172.21.15.112:0/1313965676 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd0144d60 0x7f2db80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:02.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.717+0000 7f2dce7fc640 1 --2- 172.21.15.112:0/1313965676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db8004810 0x7f2db8004c90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4009ab0 tx=0x7f2dc401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49feb9f6bccc3740 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.717+0000 7f2dcdffb640 1 -- 172.21.15.112:0/1313965676 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc40096b0 con 0x7f2db8004810 2024-09-15T23:54:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.717+0000 7f2dcdffb640 1 -- 172.21.15.112:0/1313965676 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc40a64b0 con 0x7f2db8004810 2024-09-15T23:54:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.717+0000 7f2dcdffb640 1 -- 172.21.15.112:0/1313965676 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc40a6860 con 0x7f2db8004810 2024-09-15T23:54:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.717+0000 7f2dd57bc640 1 -- 172.21.15.112:0/1313965676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db8004810 msgr2=0x7f2db8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.717+0000 7f2dd57bc640 1 --2- 172.21.15.112:0/1313965676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db8004810 0x7f2db8004c90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4009ab0 tx=0x7f2dc401ca90 comp rx=0 tx=0).stop 2024-09-15T23:54:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.717+0000 7f2dcf7fe640 1 -- 172.21.15.112:0/1313965676 reap_dead start 2024-09-15T23:54:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.717+0000 7f2dd57bc640 1 -- 172.21.15.112:0/1313965676 shutdown_connections 2024-09-15T23:54:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.717+0000 7f2dd57bc640 1 -- 172.21.15.112:0/1313965676 >> 172.21.15.112:0/1313965676 conn(0x7f2dd009aa00 msgr2=0x7f2dd00b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.717+0000 7f2dd57bc640 1 -- 172.21.15.112:0/1313965676 shutdown_connections 2024-09-15T23:54:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.717+0000 7f2dd57bc640 1 -- 172.21.15.112:0/1313965676 wait complete. 2024-09-15T23:54:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.717+0000 7f2dd57bc640 1 Processor -- start 2024-09-15T23:54:02.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dd57bc640 1 -- start start 2024-09-15T23:54:02.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dd57bc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db8004810 0x7f2dd00ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dd57bc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dd01411c0 0x7f2dd0141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dd57bc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd0150ea0 0x7f2dd0151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dd57bc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd00b6e50 con 0x7f2dd01411c0 2024-09-15T23:54:02.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dd57bc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd00702f0 con 0x7f2db8004810 2024-09-15T23:54:02.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dd57bc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd00b6fd0 con 0x7f2dd0150ea0 2024-09-15T23:54:02.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dce7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dd01411c0 0x7f2dd0141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:02.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dce7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dd01411c0 0x7f2dd0141640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57308/0 (socket says 172.21.15.112:57308) 2024-09-15T23:54:02.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dce7fc640 1 -- 172.21.15.112:0/2277041329 learned_addr learned my addr 172.21.15.112:0/2277041329 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:02.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dceffd640 1 --2- 172.21.15.112:0/2277041329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db8004810 0x7f2dd00ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:02.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dce7fc640 1 -- 172.21.15.112:0/2277041329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd0150ea0 msgr2=0x7f2dd0151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:02.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dcf7fe640 1 --2- 172.21.15.112:0/2277041329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd0150ea0 0x7f2dd0151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:02.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dce7fc640 1 --2- 172.21.15.112:0/2277041329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd0150ea0 0x7f2dd0151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dce7fc640 1 -- 172.21.15.112:0/2277041329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db8004810 msgr2=0x7f2dd00ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dce7fc640 1 --2- 172.21.15.112:0/2277041329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db8004810 0x7f2dd00ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dce7fc640 1 -- 172.21.15.112:0/2277041329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd00aef00 con 0x7f2dd01411c0 2024-09-15T23:54:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dce7fc640 1 --2- 172.21.15.112:0/2277041329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dd01411c0 0x7f2dd0141640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40b0040 tx=0x7f2db8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2db77fe640 1 -- 172.21.15.112:0/2277041329 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4005c70 con 0x7f2dd01411c0 2024-09-15T23:54:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2db77fe640 1 -- 172.21.15.112:0/2277041329 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc40bf070 con 0x7f2dd01411c0 2024-09-15T23:54:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dd57bc640 1 -- 172.21.15.112:0/2277041329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd00af1e0 con 0x7f2dd01411c0 2024-09-15T23:54:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2db77fe640 1 -- 172.21.15.112:0/2277041329 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc40a6880 con 0x7f2dd01411c0 2024-09-15T23:54:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dd57bc640 1 -- 172.21.15.112:0/2277041329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd00af7a0 con 0x7f2dd01411c0 2024-09-15T23:54:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dd57bc640 1 -- 172.21.15.112:0/2277041329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd00b44d0 con 0x7f2dd01411c0 2024-09-15T23:54:02.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2db77fe640 1 -- 172.21.15.112:0/2277041329 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2dc40a6a20 con 0x7f2dd01411c0 2024-09-15T23:54:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2db77fe640 1 --2- 172.21.15.112:0/2277041329 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2dbc0678c0 0x7f2dbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2db77fe640 1 -- 172.21.15.112:0/2277041329 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2dc41207c0 con 0x7f2dd01411c0 2024-09-15T23:54:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.721+0000 7f2dceffd640 1 --2- 172.21.15.112:0/2277041329 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2dbc0678c0 0x7f2dbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.725+0000 7f2dceffd640 1 --2- 172.21.15.112:0/2277041329 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2dbc0678c0 0x7f2dbc069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2dd013c400 tx=0x7f2dc800d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:02.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.729+0000 7f2db77fe640 1 -- 172.21.15.112:0/2277041329 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2dc40167a0 con 0x7f2dd01411c0 2024-09-15T23:54:02.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.885+0000 7f2dd57bc640 1 -- 172.21.15.112:0/2277041329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2dd00b17b0 con 0x7f2dd01411c0 2024-09-15T23:54:02.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.885+0000 7f2db77fe640 1 -- 172.21.15.112:0/2277041329 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7f2dc40f1050 con 0x7f2dd01411c0 2024-09-15T23:54:02.890 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:02.890 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:55.161085+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:53:47.908190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:53:49.056283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:53:52.808895+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:02.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.889+0000 7f2dd57bc640 1 -- 172.21.15.112:0/2277041329 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2dbc0678c0 msgr2=0x7f2dbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:02.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.889+0000 7f2dd57bc640 1 --2- 172.21.15.112:0/2277041329 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2dbc0678c0 0x7f2dbc069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2dd013c400 tx=0x7f2dc800d040 comp rx=0 tx=0).stop 2024-09-15T23:54:02.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.889+0000 7f2dd57bc640 1 -- 172.21.15.112:0/2277041329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dd01411c0 msgr2=0x7f2dd0141640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:02.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.889+0000 7f2dd57bc640 1 --2- 172.21.15.112:0/2277041329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dd01411c0 0x7f2dd0141640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40b0040 tx=0x7f2db8005840 comp rx=0 tx=0).stop 2024-09-15T23:54:02.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.889+0000 7f2dd57bc640 1 -- 172.21.15.112:0/2277041329 shutdown_connections 2024-09-15T23:54:02.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.889+0000 7f2dd57bc640 1 --2- 172.21.15.112:0/2277041329 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2dbc0678c0 0x7f2dbc069d80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.889+0000 7f2dd57bc640 1 --2- 172.21.15.112:0/2277041329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dd0150ea0 0x7f2dd0151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.889+0000 7f2dd57bc640 1 --2- 172.21.15.112:0/2277041329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dd01411c0 0x7f2dd0141640 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.889+0000 7f2dd57bc640 1 --2- 172.21.15.112:0/2277041329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db8004810 0x7f2dd00ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:02.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.889+0000 7f2dd57bc640 1 -- 172.21.15.112:0/2277041329 >> 172.21.15.112:0/2277041329 conn(0x7f2dd009aa00 msgr2=0x7f2dd015c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:02.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.889+0000 7f2dd57bc640 1 -- 172.21.15.112:0/2277041329 shutdown_connections 2024-09-15T23:54:02.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:02.889+0000 7f2dd57bc640 1 -- 172.21.15.112:0/2277041329 wait complete. 2024-09-15T23:54:02.907 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:54:03.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca33b6640 1 Processor -- start 2024-09-15T23:54:03.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca33b6640 1 -- start start 2024-09-15T23:54:03.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca33b6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c15e3e0 0x7f1c9c15f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:03.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca33b6640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c9c0b0770 con 0x7f1c9c072dd0 2024-09-15T23:54:03.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca33b6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c9c0b0a50 con 0x7f1c9c0b3300 2024-09-15T23:54:03.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca33b6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9c15eb10 con 0x7f1c9c15e3e0 2024-09-15T23:54:03.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca0951640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1c9c072dd0 0x7f1c9c0aff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49654/0 (socket says 172.21.15.112:49654) 2024-09-15T23:54:03.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca0951640 1 -- 172.21.15.112:0/668892733 learned_addr learned my addr 172.21.15.112:0/668892733 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:03.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 -- 172.21.15.112:0/668892733 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435530120 0 0) 0x7f1c9c0b0770 con 0x7f1c9c072dd0 2024-09-15T23:54:03.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca1152640 1 --2- 172.21.15.112:0/668892733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c15e3e0 0x7f1c9c15f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:03.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 -- 172.21.15.112:0/668892733 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c84003530 con 0x7f1c9c072dd0 2024-09-15T23:54:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 -- 172.21.15.112:0/668892733 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4006056639 0 0) 0x7f1c84003530 con 0x7f1c9c072dd0 2024-09-15T23:54:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 -- 172.21.15.112:0/668892733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c15e3e0 msgr2=0x7f1c9c15f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 --2- 172.21.15.112:0/668892733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c15e3e0 0x7f1c9c15f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 -- 172.21.15.112:0/668892733 >> v1:172.21.15.169:6789/0 conn(0x7f1c9c0b3300 legacy=0x7f1c9c161e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 -- 172.21.15.112:0/668892733 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9c15edf0 con 0x7f1c9c072dd0 2024-09-15T23:54:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 -- 172.21.15.112:0/668892733 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f1c90001680 con 0x7f1c9c072dd0 2024-09-15T23:54:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 -- 172.21.15.112:0/668892733 >> v1:172.21.15.112:6789/0 conn(0x7f1c9c072dd0 legacy=0x7f1c9c0aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 --2- 172.21.15.112:0/668892733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c840039f0 0x7f1c84003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 --2- 172.21.15.112:0/668892733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c84004810 0x7f1c84004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 --2- 172.21.15.112:0/668892733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c15e3e0 0x7f1c84005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 -- 172.21.15.112:0/668892733 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c15eb10 con 0x7f1c84004810 2024-09-15T23:54:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 -- 172.21.15.112:0/668892733 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8400bb00 con 0x7f1c840039f0 2024-09-15T23:54:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1c9bfff640 1 -- 172.21.15.112:0/668892733 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1c8400bd00 con 0x7f1c9c15e3e0 2024-09-15T23:54:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca0951640 1 --2- 172.21.15.112:0/668892733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c84004810 0x7f1c84004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca1152640 1 --2- 172.21.15.112:0/668892733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c840039f0 0x7f1c84003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca1953640 1 --2- 172.21.15.112:0/668892733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c15e3e0 0x7f1c84005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca0951640 1 -- 172.21.15.112:0/668892733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c15e3e0 msgr2=0x7f1c84005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca0951640 1 --2- 172.21.15.112:0/668892733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c15e3e0 0x7f1c84005210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca0951640 1 -- 172.21.15.112:0/668892733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c840039f0 msgr2=0x7f1c84003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca0951640 1 --2- 172.21.15.112:0/668892733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c840039f0 0x7f1c84003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca0951640 1 -- 172.21.15.112:0/668892733 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c84003530 con 0x7f1c84004810 2024-09-15T23:54:03.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.017+0000 7f1ca1152640 1 --2- 172.21.15.112:0/668892733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c840039f0 0x7f1c84003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:03.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca0951640 1 --2- 172.21.15.112:0/668892733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c84004810 0x7f1c84004c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000c210 tx=0x7f1c9001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ef66595693ce03 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:03.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1c9bfff640 1 -- 172.21.15.112:0/668892733 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90007d20 con 0x7f1c84004810 2024-09-15T23:54:03.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1c9bfff640 1 -- 172.21.15.112:0/668892733 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c900a9070 con 0x7f1c84004810 2024-09-15T23:54:03.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1c9bfff640 1 -- 172.21.15.112:0/668892733 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90005d60 con 0x7f1c84004810 2024-09-15T23:54:03.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca33b6640 1 -- 172.21.15.112:0/668892733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c84004810 msgr2=0x7f1c84004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:03.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca33b6640 1 --2- 172.21.15.112:0/668892733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c84004810 0x7f1c84004c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000c210 tx=0x7f1c9001cc60 comp rx=0 tx=0).stop 2024-09-15T23:54:03.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca1953640 1 -- 172.21.15.112:0/668892733 reap_dead start 2024-09-15T23:54:03.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca33b6640 1 -- 172.21.15.112:0/668892733 shutdown_connections 2024-09-15T23:54:03.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca33b6640 1 -- 172.21.15.112:0/668892733 >> 172.21.15.112:0/668892733 conn(0x7f1c9c0b6870 msgr2=0x7f1c9c0b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:03.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca33b6640 1 -- 172.21.15.112:0/668892733 shutdown_connections 2024-09-15T23:54:03.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca33b6640 1 -- 172.21.15.112:0/668892733 wait complete. 2024-09-15T23:54:03.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca33b6640 1 Processor -- start 2024-09-15T23:54:03.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca33b6640 1 -- start start 2024-09-15T23:54:03.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca33b6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c84004810 0x7f1c9c167a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:03.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca33b6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c0c6b50 0x7f1c9c1f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:03.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca33b6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c1f83c0 0x7f1c9c1f8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:03.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca33b6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c1626b0 con 0x7f1c84004810 2024-09-15T23:54:03.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca33b6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c162530 con 0x7f1c9c1f83c0 2024-09-15T23:54:03.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca33b6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9c162830 con 0x7f1c9c0c6b50 2024-09-15T23:54:03.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca1152640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c84004810 0x7f1c9c167a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:03.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca1152640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c84004810 0x7f1c9c167a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57316/0 (socket says 172.21.15.112:57316) 2024-09-15T23:54:03.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca1152640 1 -- 172.21.15.112:0/974757487 learned_addr learned my addr 172.21.15.112:0/974757487 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:03.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca1953640 1 --2- 172.21.15.112:0/974757487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c1f83c0 0x7f1c9c1f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:03.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca1152640 1 -- 172.21.15.112:0/974757487 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c0c6b50 msgr2=0x7f1c9c1f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:03.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.021+0000 7f1ca1152640 1 --2- 172.21.15.112:0/974757487 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c0c6b50 0x7f1c9c1f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:03.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1ca1152640 1 -- 172.21.15.112:0/974757487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c1f83c0 msgr2=0x7f1c9c1f8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:03.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1ca1152640 1 --2- 172.21.15.112:0/974757487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c1f83c0 0x7f1c9c1f8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:03.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1ca1152640 1 -- 172.21.15.112:0/974757487 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9c165a10 con 0x7f1c84004810 2024-09-15T23:54:03.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1ca1152640 1 --2- 172.21.15.112:0/974757487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c84004810 0x7f1c9c167a70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c010890 tx=0x7f1c8c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:03.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1c99ffb640 1 -- 172.21.15.112:0/974757487 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c00f040 con 0x7f1c84004810 2024-09-15T23:54:03.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1c99ffb640 1 -- 172.21.15.112:0/974757487 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c8c00eb60 con 0x7f1c84004810 2024-09-15T23:54:03.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1ca33b6640 1 -- 172.21.15.112:0/974757487 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9c165cf0 con 0x7f1c84004810 2024-09-15T23:54:03.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1c99ffb640 1 -- 172.21.15.112:0/974757487 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c01c400 con 0x7f1c84004810 2024-09-15T23:54:03.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1ca33b6640 1 -- 172.21.15.112:0/974757487 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9c1662b0 con 0x7f1c84004810 2024-09-15T23:54:03.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1ca33b6640 1 -- 172.21.15.112:0/974757487 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c9c0aff60 con 0x7f1c84004810 2024-09-15T23:54:03.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1c99ffb640 1 -- 172.21.15.112:0/974757487 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c8c01c5a0 con 0x7f1c84004810 2024-09-15T23:54:03.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1c99ffb640 1 --2- 172.21.15.112:0/974757487 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1c880678f0 0x7f1c88069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:03.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1c99ffb640 1 -- 172.21.15.112:0/974757487 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1c8c0865c0 con 0x7f1c84004810 2024-09-15T23:54:03.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1ca0951640 1 --2- 172.21.15.112:0/974757487 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1c880678f0 0x7f1c88069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:03.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.025+0000 7f1ca0951640 1 --2- 172.21.15.112:0/974757487 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1c880678f0 0x7f1c88069db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1c900ab000 tx=0x7f1c9c0b0940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:03.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.029+0000 7f1c99ffb640 1 -- 172.21.15.112:0/974757487 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1c8c018030 con 0x7f1c84004810 2024-09-15T23:54:03.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.225+0000 7f1ca33b6640 1 -- 172.21.15.112:0/974757487 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1c9c06d650 con 0x7f1c84004810 2024-09-15T23:54:03.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.297+0000 7f1c99ffb640 1 -- 172.21.15.112:0/974757487 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f1c8c056e30 con 0x7f1c84004810 2024-09-15T23:54:03.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.301+0000 7f1ca33b6640 1 -- 172.21.15.112:0/974757487 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1c880678f0 msgr2=0x7f1c88069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:03.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.301+0000 7f1ca33b6640 1 --2- 172.21.15.112:0/974757487 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1c880678f0 0x7f1c88069db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1c900ab000 tx=0x7f1c9c0b0940 comp rx=0 tx=0).stop 2024-09-15T23:54:03.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.301+0000 7f1ca33b6640 1 -- 172.21.15.112:0/974757487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c84004810 msgr2=0x7f1c9c167a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:03.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.301+0000 7f1ca33b6640 1 --2- 172.21.15.112:0/974757487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c84004810 0x7f1c9c167a70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c010890 tx=0x7f1c8c010d50 comp rx=0 tx=0).stop 2024-09-15T23:54:03.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.301+0000 7f1ca33b6640 1 -- 172.21.15.112:0/974757487 shutdown_connections 2024-09-15T23:54:03.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.301+0000 7f1ca33b6640 1 --2- 172.21.15.112:0/974757487 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1c880678f0 0x7f1c88069db0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:03.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.301+0000 7f1ca33b6640 1 --2- 172.21.15.112:0/974757487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c9c1f83c0 0x7f1c9c1f8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:03.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.301+0000 7f1ca33b6640 1 --2- 172.21.15.112:0/974757487 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c9c0c6b50 0x7f1c9c1f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:03.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.301+0000 7f1ca33b6640 1 --2- 172.21.15.112:0/974757487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c84004810 0x7f1c9c167a70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:03.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.301+0000 7f1ca33b6640 1 -- 172.21.15.112:0/974757487 >> 172.21.15.112:0/974757487 conn(0x7f1c9c0b6870 msgr2=0x7f1c9c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:03.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.301+0000 7f1ca33b6640 1 -- 172.21.15.112:0/974757487 shutdown_connections 2024-09-15T23:54:03.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.301+0000 7f1ca33b6640 1 -- 172.21.15.112:0/974757487 wait complete. 2024-09-15T23:54:03.321 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-15T23:54:03.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:54:03.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f55ac7640 1 Processor -- start 2024-09-15T23:54:03.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f55ac7640 1 -- start start 2024-09-15T23:54:03.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f55ac7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f5015bec0 0x7f5f500ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:03.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f55ac7640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5f500af470 0x7f5f5006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:03.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f55ac7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f500b3290 con 0x7f5f5015c2a0 2024-09-15T23:54:03.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f55ac7640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5f500b3570 con 0x7f5f500af470 2024-09-15T23:54:03.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f55ac7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5f500b3850 con 0x7f5f5015bec0 2024-09-15T23:54:03.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f4ffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5f500af470 0x7f5f5006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:03.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f4ffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5f500af470 0x7f5f5006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57324/0 (socket says 172.21.15.112:57324) 2024-09-15T23:54:03.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f4ffff640 1 -- 172.21.15.112:0/1072400471 learned_addr learned my addr 172.21.15.112:0/1072400471 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:03.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f4f7fe640 1 --2- 172.21.15.112:0/1072400471 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f5015bec0 0x7f5f500ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:03.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f4ffff640 1 -- 172.21.15.112:0/1072400471 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f5015bec0 msgr2=0x7f5f500ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:03.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f4ffff640 1 --2- 172.21.15.112:0/1072400471 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f5015bec0 0x7f5f500ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:03.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f4ffff640 1 -- 172.21.15.112:0/1072400471 >> v1:172.21.15.169:6789/0 conn(0x7f5f5015c2a0 legacy=0x7f5f500aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:03.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.445+0000 7f5f4ffff640 1 -- 172.21.15.112:0/1072400471 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f500b3b30 con 0x7f5f500af470 2024-09-15T23:54:03.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f4ffff640 1 --2- 172.21.15.112:0/1072400471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f500af470 0x7f5f5006e000 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009e50 tx=0x7f5f4801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fabfeaa4b0990fc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:03.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f4e7fc640 1 -- 172.21.15.112:0/1072400471 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f480a58d0 con 0x7f5f500af470 2024-09-15T23:54:03.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f4e7fc640 1 -- 172.21.15.112:0/1072400471 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f480a5a70 con 0x7f5f500af470 2024-09-15T23:54:03.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f4e7fc640 1 -- 172.21.15.112:0/1072400471 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f480a5e40 con 0x7f5f500af470 2024-09-15T23:54:03.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 -- 172.21.15.112:0/1072400471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f500af470 msgr2=0x7f5f5006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:03.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 --2- 172.21.15.112:0/1072400471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f500af470 0x7f5f5006e000 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009e50 tx=0x7f5f4801ca00 comp rx=0 tx=0).stop 2024-09-15T23:54:03.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 -- 172.21.15.112:0/1072400471 shutdown_connections 2024-09-15T23:54:03.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 --2- 172.21.15.112:0/1072400471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f500af470 0x7f5f5006e000 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:03.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 --2- 172.21.15.112:0/1072400471 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f5015bec0 0x7f5f500ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:03.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 -- 172.21.15.112:0/1072400471 >> 172.21.15.112:0/1072400471 conn(0x7f5f500b1f90 msgr2=0x7f5f500b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:03.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 -- 172.21.15.112:0/1072400471 shutdown_connections 2024-09-15T23:54:03.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 -- 172.21.15.112:0/1072400471 wait complete. 2024-09-15T23:54:03.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 Processor -- start 2024-09-15T23:54:03.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 -- start start 2024-09-15T23:54:03.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f500af470 0x7f5f5014a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:03.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f5015bec0 0x7f5f50073b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:03.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f5015c2a0 0x7f5f50152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:03.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5006ed50 con 0x7f5f5015bec0 2024-09-15T23:54:03.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5f500ad740 con 0x7f5f5015c2a0 2024-09-15T23:54:03.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f55ac7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5006eed0 con 0x7f5f500af470 2024-09-15T23:54:03.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f4effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f5015bec0 0x7f5f50073b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:03.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f4effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f5015bec0 0x7f5f50073b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57328/0 (socket says 172.21.15.112:57328) 2024-09-15T23:54:03.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f4effd640 1 -- 172.21.15.112:0/3937595700 learned_addr learned my addr 172.21.15.112:0/3937595700 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:03.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f4ffff640 1 --2- 172.21.15.112:0/3937595700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f5015c2a0 0x7f5f50152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:03.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f4f7fe640 1 --2- 172.21.15.112:0/3937595700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f500af470 0x7f5f5014a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f4effd640 1 -- 172.21.15.112:0/3937595700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f500af470 msgr2=0x7f5f5014a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.449+0000 7f5f4effd640 1 --2- 172.21.15.112:0/3937595700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f500af470 0x7f5f5014a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f4effd640 1 -- 172.21.15.112:0/3937595700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f5015c2a0 msgr2=0x7f5f50152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f4effd640 1 --2- 172.21.15.112:0/3937595700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f5015c2a0 0x7f5f50152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f4effd640 1 -- 172.21.15.112:0/3937595700 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5014efe0 con 0x7f5f5015bec0 2024-09-15T23:54:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f4effd640 1 --2- 172.21.15.112:0/3937595700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f5015bec0 0x7f5f50073b60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400c310 tx=0x7f5f4400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f37fff640 1 -- 172.21.15.112:0/3937595700 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f440052d0 con 0x7f5f5015bec0 2024-09-15T23:54:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f37fff640 1 -- 172.21.15.112:0/3937595700 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f44005470 con 0x7f5f5015bec0 2024-09-15T23:54:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f55ac7640 1 -- 172.21.15.112:0/3937595700 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f5014f2c0 con 0x7f5f5015bec0 2024-09-15T23:54:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f37fff640 1 -- 172.21.15.112:0/3937595700 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44007260 con 0x7f5f5015bec0 2024-09-15T23:54:03.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f55ac7640 1 -- 172.21.15.112:0/3937595700 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f50153430 con 0x7f5f5015bec0 2024-09-15T23:54:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f37fff640 1 -- 172.21.15.112:0/3937595700 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f44007400 con 0x7f5f5015bec0 2024-09-15T23:54:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f55ac7640 1 -- 172.21.15.112:0/3937595700 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f5006f220 con 0x7f5f5015bec0 2024-09-15T23:54:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f37fff640 1 --2- 172.21.15.112:0/3937595700 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5f3c0678c0 0x7f5f3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f37fff640 1 -- 172.21.15.112:0/3937595700 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5f440854a0 con 0x7f5f5015bec0 2024-09-15T23:54:03.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f4f7fe640 1 --2- 172.21.15.112:0/3937595700 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5f3c0678c0 0x7f5f3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:03.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.453+0000 7f5f4f7fe640 1 --2- 172.21.15.112:0/3937595700 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5f3c0678c0 0x7f5f3c069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f500b1410 tx=0x7f5f40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:03.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.457+0000 7f5f37fff640 1 -- 172.21.15.112:0/3937595700 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5f44055c80 con 0x7f5f5015bec0 2024-09-15T23:54:03.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:03.641+0000 7f5f55ac7640 1 -- 172.21.15.112:0/3937595700 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5f5006fcd0 con 0x7f5f5015bec0 2024-09-15T23:54:04.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.313+0000 7f5f37fff640 1 -- 172.21.15.112:0/3937595700 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f5f44055580 con 0x7f5f5015bec0 2024-09-15T23:54:04.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.313+0000 7f5f55ac7640 1 -- 172.21.15.112:0/3937595700 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5f3c0678c0 msgr2=0x7f5f3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:04.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.313+0000 7f5f55ac7640 1 --2- 172.21.15.112:0/3937595700 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5f3c0678c0 0x7f5f3c069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f500b1410 tx=0x7f5f40008040 comp rx=0 tx=0).stop 2024-09-15T23:54:04.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.313+0000 7f5f55ac7640 1 -- 172.21.15.112:0/3937595700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f5015bec0 msgr2=0x7f5f50073b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:04.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.313+0000 7f5f55ac7640 1 --2- 172.21.15.112:0/3937595700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f5015bec0 0x7f5f50073b60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400c310 tx=0x7f5f4400c7d0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.317+0000 7f5f55ac7640 1 -- 172.21.15.112:0/3937595700 shutdown_connections 2024-09-15T23:54:04.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.317+0000 7f5f55ac7640 1 --2- 172.21.15.112:0/3937595700 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5f3c0678c0 0x7f5f3c069d80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.317+0000 7f5f55ac7640 1 --2- 172.21.15.112:0/3937595700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f5015c2a0 0x7f5f50152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.317+0000 7f5f55ac7640 1 --2- 172.21.15.112:0/3937595700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f5015bec0 0x7f5f50073b60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.317+0000 7f5f55ac7640 1 --2- 172.21.15.112:0/3937595700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f500af470 0x7f5f5014a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.317+0000 7f5f55ac7640 1 -- 172.21.15.112:0/3937595700 >> 172.21.15.112:0/3937595700 conn(0x7f5f500b1f90 msgr2=0x7f5f50075170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:04.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.317+0000 7f5f55ac7640 1 -- 172.21.15.112:0/3937595700 shutdown_connections 2024-09-15T23:54:04.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.317+0000 7f5f55ac7640 1 -- 172.21.15.112:0/3937595700 wait complete. 2024-09-15T23:54:04.339 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:54:04.340 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:54:04.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.461+0000 7f0a568c3640 1 Processor -- start 2024-09-15T23:54:04.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.461+0000 7f0a568c3640 1 -- start start 2024-09-15T23:54:04.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a568c3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a50070020 0x7f0a5015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a568c3640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0a5015f1d0 0x7f0a500adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a568c3640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a500aede0 con 0x7f0a501520a0 2024-09-15T23:54:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a568c3640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f0a50152480 con 0x7f0a5015f1d0 2024-09-15T23:54:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a568c3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0a5015fa10 con 0x7f0a50070020 2024-09-15T23:54:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4ffff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0a501520a0 0x7f0a5006f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49664/0 (socket says 172.21.15.112:49664) 2024-09-15T23:54:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4ffff640 1 -- 172.21.15.112:0/3526185066 learned_addr learned my addr 172.21.15.112:0/3526185066 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4f7fe640 1 --2- 172.21.15.112:0/3526185066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a50070020 0x7f0a5015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a54e60640 1 --2- 172.21.15.112:0/3526185066 >> v2:172.21.15.169:3300/0 conn(0x7f0a5015f1d0 0x7f0a500adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 -- 172.21.15.112:0/3526185066 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 74943237 0 0) 0x7f0a500aede0 con 0x7f0a501520a0 2024-09-15T23:54:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 -- 172.21.15.112:0/3526185066 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a3c003530 con 0x7f0a501520a0 2024-09-15T23:54:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 -- 172.21.15.112:0/3526185066 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4115557964 0 0) 0x7f0a3c003530 con 0x7f0a501520a0 2024-09-15T23:54:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 -- 172.21.15.112:0/3526185066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a50070020 msgr2=0x7f0a5015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 --2- 172.21.15.112:0/3526185066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a50070020 0x7f0a5015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 -- 172.21.15.112:0/3526185066 >> v2:172.21.15.169:3300/0 conn(0x7f0a5015f1d0 msgr2=0x7f0a500adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:04.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 --2- 172.21.15.112:0/3526185066 >> v2:172.21.15.169:3300/0 conn(0x7f0a5015f1d0 0x7f0a500adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 -- 172.21.15.112:0/3526185066 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a50074250 con 0x7f0a501520a0 2024-09-15T23:54:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 -- 172.21.15.112:0/3526185066 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f0a48001a00 con 0x7f0a501520a0 2024-09-15T23:54:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 -- 172.21.15.112:0/3526185066 >> v1:172.21.15.112:6789/0 conn(0x7f0a501520a0 legacy=0x7f0a5006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 --2- 172.21.15.112:0/3526185066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c0039c0 0x7f0a3c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 --2- 172.21.15.112:0/3526185066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a3c004810 0x7f0a3c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 --2- 172.21.15.112:0/3526185066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a50070020 0x7f0a3c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 -- 172.21.15.112:0/3526185066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5015fa10 con 0x7f0a3c004810 2024-09-15T23:54:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 -- 172.21.15.112:0/3526185066 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c00b9d0 con 0x7f0a3c0039c0 2024-09-15T23:54:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4effd640 1 -- 172.21.15.112:0/3526185066 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3c00bb50 con 0x7f0a50070020 2024-09-15T23:54:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4f7fe640 1 --2- 172.21.15.112:0/3526185066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a3c004810 0x7f0a3c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4ffff640 1 --2- 172.21.15.112:0/3526185066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c0039c0 0x7f0a3c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a54e60640 1 --2- 172.21.15.112:0/3526185066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a50070020 0x7f0a3c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4f7fe640 1 -- 172.21.15.112:0/3526185066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a50070020 msgr2=0x7f0a3c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:04.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4f7fe640 1 --2- 172.21.15.112:0/3526185066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a50070020 0x7f0a3c0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4f7fe640 1 -- 172.21.15.112:0/3526185066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c0039c0 msgr2=0x7f0a3c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:04.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4f7fe640 1 --2- 172.21.15.112:0/3526185066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c0039c0 0x7f0a3c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.465+0000 7f0a4f7fe640 1 -- 172.21.15.112:0/3526185066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3c003530 con 0x7f0a3c004810 2024-09-15T23:54:04.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a4f7fe640 1 --2- 172.21.15.112:0/3526185066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a3c004810 0x7f0a3c004c90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009ab0 tx=0x7f0a3801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927f6a728c4fbe69 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:04.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a4effd640 1 -- 172.21.15.112:0/3526185066 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a380096b0 con 0x7f0a3c004810 2024-09-15T23:54:04.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a4effd640 1 -- 172.21.15.112:0/3526185066 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a380a6460 con 0x7f0a3c004810 2024-09-15T23:54:04.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a4effd640 1 -- 172.21.15.112:0/3526185066 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a380a6810 con 0x7f0a3c004810 2024-09-15T23:54:04.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a568c3640 1 -- 172.21.15.112:0/3526185066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a3c004810 msgr2=0x7f0a3c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:04.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a568c3640 1 --2- 172.21.15.112:0/3526185066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a3c004810 0x7f0a3c004c90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009ab0 tx=0x7f0a3801ca50 comp rx=0 tx=0).stop 2024-09-15T23:54:04.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a54e60640 1 -- 172.21.15.112:0/3526185066 reap_dead start 2024-09-15T23:54:04.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a568c3640 1 -- 172.21.15.112:0/3526185066 shutdown_connections 2024-09-15T23:54:04.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a568c3640 1 -- 172.21.15.112:0/3526185066 >> 172.21.15.112:0/3526185066 conn(0x7f0a500b1f90 msgr2=0x7f0a500b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:04.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a568c3640 1 -- 172.21.15.112:0/3526185066 shutdown_connections 2024-09-15T23:54:04.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a568c3640 1 -- 172.21.15.112:0/3526185066 wait complete. 2024-09-15T23:54:04.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a568c3640 1 Processor -- start 2024-09-15T23:54:04.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a568c3640 1 -- start start 2024-09-15T23:54:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a568c3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c004810 0x7f0a50148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a568c3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a5014cfe0 0x7f0a5015c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a568c3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a5014d460 0x7f0a5015ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a568c3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0a50073a50 con 0x7f0a5014d460 2024-09-15T23:54:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a568c3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0a50073770 con 0x7f0a3c004810 2024-09-15T23:54:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a568c3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0a50073d30 con 0x7f0a5014cfe0 2024-09-15T23:54:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a54e60640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a5014d460 0x7f0a5015ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a54e60640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a5014d460 0x7f0a5015ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57346/0 (socket says 172.21.15.112:57346) 2024-09-15T23:54:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a54e60640 1 -- 172.21.15.112:0/4062659426 learned_addr learned my addr 172.21.15.112:0/4062659426 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a4f7fe640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a5014cfe0 0x7f0a5015c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a4ffff640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c004810 0x7f0a50148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a54e60640 1 -- 172.21.15.112:0/4062659426 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a5014cfe0 msgr2=0x7f0a5015c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a54e60640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a5014cfe0 0x7f0a5015c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a54e60640 1 -- 172.21.15.112:0/4062659426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c004810 msgr2=0x7f0a50148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a54e60640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c004810 0x7f0a50148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a54e60640 1 -- 172.21.15.112:0/4062659426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a50148f80 con 0x7f0a5014d460 2024-09-15T23:54:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a4ffff640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c004810 0x7f0a50148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a54e60640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a5014d460 0x7f0a5015ce30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0a500744a0 tx=0x7f0a40010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a4cff9640 1 -- 172.21.15.112:0/4062659426 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000f040 con 0x7f0a5014d460 2024-09-15T23:54:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a4cff9640 1 -- 172.21.15.112:0/4062659426 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a4001c070 con 0x7f0a5014d460 2024-09-15T23:54:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.469+0000 7f0a4cff9640 1 -- 172.21.15.112:0/4062659426 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000eab0 con 0x7f0a5014d460 2024-09-15T23:54:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.473+0000 7f0a568c3640 1 -- 172.21.15.112:0/4062659426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a5015bf90 con 0x7f0a5014d460 2024-09-15T23:54:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.473+0000 7f0a568c3640 1 -- 172.21.15.112:0/4062659426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a5015c550 con 0x7f0a5014d460 2024-09-15T23:54:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.473+0000 7f0a568c3640 1 -- 172.21.15.112:0/4062659426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a5015f680 con 0x7f0a5014d460 2024-09-15T23:54:04.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.473+0000 7f0a4cff9640 1 -- 172.21.15.112:0/4062659426 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0a4000ec50 con 0x7f0a5014d460 2024-09-15T23:54:04.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.473+0000 7f0a4cff9640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0a300678f0 0x7f0a30069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.473+0000 7f0a4cff9640 1 -- 172.21.15.112:0/4062659426 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0a400857c0 con 0x7f0a5014d460 2024-09-15T23:54:04.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.473+0000 7f0a4ffff640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0a300678f0 0x7f0a30069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.473+0000 7f0a4ffff640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0a300678f0 0x7f0a30069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a48001340 tx=0x7f0a48004b70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:04.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.477+0000 7f0a4cff9640 1 -- 172.21.15.112:0/4062659426 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0a40025020 con 0x7f0a5014d460 2024-09-15T23:54:04.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.673+0000 7f0a568c3640 1 -- 172.21.15.112:0/4062659426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a500ae170 con 0x7f0a5014d460 2024-09-15T23:54:04.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.673+0000 7f0a4cff9640 1 -- 172.21.15.112:0/4062659426 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f0a40055970 con 0x7f0a5014d460 2024-09-15T23:54:04.678 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:04.678 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-15T23:54:04:302532+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/879130842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":879130842},{"type":"v1","addr":"172.21.15.112:6836","nonce":879130842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3178495253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3178495253},{"type":"v1","addr":"172.21.15.112:6837","nonce":3178495253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/780833913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":780833913},{"type":"v1","addr":"172.21.15.169:6833","nonce":780833913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:53:50.059476+0000","modified":"2024-09-15T23:54:03.646829+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6835/2205745557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2205745557},{"type":"v1","addr":"172.21.15.169:6835","nonce":2205745557}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-09-15T23:54:04.678 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-15T23:54:04.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.677+0000 7f0a568c3640 1 -- 172.21.15.112:0/4062659426 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0a300678f0 msgr2=0x7f0a30069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:04.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.677+0000 7f0a568c3640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0a300678f0 0x7f0a30069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a48001340 tx=0x7f0a48004b70 comp rx=0 tx=0).stop 2024-09-15T23:54:04.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.677+0000 7f0a568c3640 1 -- 172.21.15.112:0/4062659426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a5014d460 msgr2=0x7f0a5015ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:04.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.677+0000 7f0a568c3640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a5014d460 0x7f0a5015ce30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0a500744a0 tx=0x7f0a40010b70 comp rx=0 tx=0).stop 2024-09-15T23:54:04.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.677+0000 7f0a568c3640 1 -- 172.21.15.112:0/4062659426 shutdown_connections 2024-09-15T23:54:04.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.677+0000 7f0a568c3640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0a300678f0 0x7f0a30069db0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.677+0000 7f0a568c3640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a5014d460 0x7f0a5015ce30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.677+0000 7f0a568c3640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a5014cfe0 0x7f0a5015c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.677+0000 7f0a568c3640 1 --2- 172.21.15.112:0/4062659426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a3c004810 0x7f0a50148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.677+0000 7f0a568c3640 1 -- 172.21.15.112:0/4062659426 >> 172.21.15.112:0/4062659426 conn(0x7f0a500b1f90 msgr2=0x7f0a50151500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:04.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.677+0000 7f0a568c3640 1 -- 172.21.15.112:0/4062659426 shutdown_connections 2024-09-15T23:54:04.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.677+0000 7f0a568c3640 1 -- 172.21.15.112:0/4062659426 wait complete. 2024-09-15T23:54:04.697 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:04.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.809+0000 7f99b41eb640 1 Processor -- start 2024-09-15T23:54:04.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.809+0000 7f99b41eb640 1 -- start start 2024-09-15T23:54:04.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b41eb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f99ac15c2a0 0x7f99ac0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b41eb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f99ac0af2a0 0x7f99ac06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b41eb640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99ac0b3290 con 0x7f99ac15bec0 2024-09-15T23:54:04.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b41eb640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f99ac0b3570 con 0x7f99ac0af2a0 2024-09-15T23:54:04.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b41eb640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f99ac0b3850 con 0x7f99ac15c2a0 2024-09-15T23:54:04.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b2788640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f99ac0af2a0 0x7f99ac06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b2788640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f99ac0af2a0 0x7f99ac06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57350/0 (socket says 172.21.15.112:57350) 2024-09-15T23:54:04.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b2788640 1 -- 172.21.15.112:0/4195781798 learned_addr learned my addr 172.21.15.112:0/4195781798 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:04.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b1786640 1 --2- 172.21.15.112:0/4195781798 >> v2:172.21.15.169:3300/0 conn(0x7f99ac15c2a0 0x7f99ac0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b2788640 1 -- 172.21.15.112:0/4195781798 >> v2:172.21.15.169:3300/0 conn(0x7f99ac15c2a0 msgr2=0x7f99ac0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:04.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b2788640 1 --2- 172.21.15.112:0/4195781798 >> v2:172.21.15.169:3300/0 conn(0x7f99ac15c2a0 0x7f99ac0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b2788640 1 -- 172.21.15.112:0/4195781798 >> v1:172.21.15.169:6789/0 conn(0x7f99ac15bec0 legacy=0x7f99ac0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:04.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b2788640 1 -- 172.21.15.112:0/4195781798 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ac0b3b30 con 0x7f99ac0af2a0 2024-09-15T23:54:04.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b1786640 1 --2- 172.21.15.112:0/4195781798 >> v2:172.21.15.169:3300/0 conn(0x7f99ac15c2a0 0x7f99ac0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:04.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b2788640 1 --2- 172.21.15.112:0/4195781798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ac0af2a0 0x7f99ac06e000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f99ac0ae510 tx=0x7f99a401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bff5f71a5ac4ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:04.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b0f85640 1 -- 172.21.15.112:0/4195781798 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a40a5840 con 0x7f99ac0af2a0 2024-09-15T23:54:04.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b0f85640 1 -- 172.21.15.112:0/4195781798 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a40a59e0 con 0x7f99ac0af2a0 2024-09-15T23:54:04.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.813+0000 7f99b0f85640 1 -- 172.21.15.112:0/4195781798 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a40a5db0 con 0x7f99ac0af2a0 2024-09-15T23:54:04.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 -- 172.21.15.112:0/4195781798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ac0af2a0 msgr2=0x7f99ac06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:04.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 --2- 172.21.15.112:0/4195781798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ac0af2a0 0x7f99ac06e000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f99ac0ae510 tx=0x7f99a401c980 comp rx=0 tx=0).stop 2024-09-15T23:54:04.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 -- 172.21.15.112:0/4195781798 shutdown_connections 2024-09-15T23:54:04.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 --2- 172.21.15.112:0/4195781798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ac0af2a0 0x7f99ac06e000 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 --2- 172.21.15.112:0/4195781798 >> v2:172.21.15.169:3300/0 conn(0x7f99ac15c2a0 0x7f99ac0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 -- 172.21.15.112:0/4195781798 >> 172.21.15.112:0/4195781798 conn(0x7f99ac0b1f90 msgr2=0x7f99ac0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:04.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 -- 172.21.15.112:0/4195781798 shutdown_connections 2024-09-15T23:54:04.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 -- 172.21.15.112:0/4195781798 wait complete. 2024-09-15T23:54:04.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 Processor -- start 2024-09-15T23:54:04.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 -- start start 2024-09-15T23:54:04.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99ac0af2a0 0x7f99ac148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99ac15bec0 0x7f99ac15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ac15c2a0 0x7f99ac15d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac06ed50 con 0x7f99ac15c2a0 2024-09-15T23:54:04.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac0af710 con 0x7f99ac0af2a0 2024-09-15T23:54:04.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f99ac06eed0 con 0x7f99ac15bec0 2024-09-15T23:54:04.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b2788640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ac15c2a0 0x7f99ac15d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b2788640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ac15c2a0 0x7f99ac15d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57362/0 (socket says 172.21.15.112:57362) 2024-09-15T23:54:04.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b2788640 1 -- 172.21.15.112:0/3823483913 learned_addr learned my addr 172.21.15.112:0/3823483913 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:04.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b1786640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99ac15bec0 0x7f99ac15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b1f87640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99ac0af2a0 0x7f99ac148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b2788640 1 -- 172.21.15.112:0/3823483913 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99ac15bec0 msgr2=0x7f99ac15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:04.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b2788640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99ac15bec0 0x7f99ac15f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b2788640 1 -- 172.21.15.112:0/3823483913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99ac0af2a0 msgr2=0x7f99ac148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:04.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b2788640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99ac0af2a0 0x7f99ac148c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b2788640 1 -- 172.21.15.112:0/3823483913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ac154810 con 0x7f99ac15c2a0 2024-09-15T23:54:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b1786640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99ac15bec0 0x7f99ac15f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b2788640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ac15c2a0 0x7f99ac15d060 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f99a401a5b0 tx=0x7f99a4019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99a27fc640 1 -- 172.21.15.112:0/3823483913 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a40bc020 con 0x7f99ac15c2a0 2024-09-15T23:54:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99a27fc640 1 -- 172.21.15.112:0/3823483913 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a40b8880 con 0x7f99ac15c2a0 2024-09-15T23:54:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 -- 172.21.15.112:0/3823483913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ac154af0 con 0x7f99ac15c2a0 2024-09-15T23:54:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99a27fc640 1 -- 172.21.15.112:0/3823483913 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a40b8c70 con 0x7f99ac15c2a0 2024-09-15T23:54:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.817+0000 7f99b41eb640 1 -- 172.21.15.112:0/3823483913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ac1550b0 con 0x7f99ac15c2a0 2024-09-15T23:54:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.821+0000 7f99b41eb640 1 -- 172.21.15.112:0/3823483913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99ac06f260 con 0x7f99ac15c2a0 2024-09-15T23:54:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.821+0000 7f99a27fc640 1 -- 172.21.15.112:0/3823483913 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99a40bf020 con 0x7f99ac15c2a0 2024-09-15T23:54:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.821+0000 7f99a27fc640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f99900678f0 0x7f9990069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.821+0000 7f99a27fc640 1 -- 172.21.15.112:0/3823483913 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f99a4120ba0 con 0x7f99ac15c2a0 2024-09-15T23:54:04.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.821+0000 7f99b1f87640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f99900678f0 0x7f9990069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:04.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.821+0000 7f99b1f87640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f99900678f0 0x7f9990069db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99a8004e30 tx=0x7f99a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:04.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.825+0000 7f99a27fc640 1 -- 172.21.15.112:0/3823483913 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f99a40c7020 con 0x7f99ac15c2a0 2024-09-15T23:54:04.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.977+0000 7f99b41eb640 1 -- 172.21.15.112:0/3823483913 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99ac06fcd0 con 0x7f99ac15c2a0 2024-09-15T23:54:04.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.977+0000 7f99a27fc640 1 -- 172.21.15.112:0/3823483913 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7f99a40165a0 con 0x7f99ac15c2a0 2024-09-15T23:54:04.980 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:04.980 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:55.161085+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:53:47.908190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:53:49.056283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:53:52.808895+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:04.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.981+0000 7f99b41eb640 1 -- 172.21.15.112:0/3823483913 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f99900678f0 msgr2=0x7f9990069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.981+0000 7f99b41eb640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f99900678f0 0x7f9990069db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99a8004e30 tx=0x7f99a8009040 comp rx=0 tx=0).stop 2024-09-15T23:54:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.981+0000 7f99b41eb640 1 -- 172.21.15.112:0/3823483913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ac15c2a0 msgr2=0x7f99ac15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.981+0000 7f99b41eb640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ac15c2a0 0x7f99ac15d060 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f99a401a5b0 tx=0x7f99a4019720 comp rx=0 tx=0).stop 2024-09-15T23:54:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.981+0000 7f99b41eb640 1 -- 172.21.15.112:0/3823483913 shutdown_connections 2024-09-15T23:54:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.981+0000 7f99b41eb640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f99900678f0 0x7f9990069db0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.981+0000 7f99b41eb640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ac15c2a0 0x7f99ac15d060 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.981+0000 7f99b41eb640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99ac15bec0 0x7f99ac15f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.981+0000 7f99b41eb640 1 --2- 172.21.15.112:0/3823483913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99ac0af2a0 0x7f99ac148c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:04.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.981+0000 7f99b41eb640 1 -- 172.21.15.112:0/3823483913 >> 172.21.15.112:0/3823483913 conn(0x7f99ac0b1f90 msgr2=0x7f99ac1597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:04.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.981+0000 7f99b41eb640 1 -- 172.21.15.112:0/3823483913 shutdown_connections 2024-09-15T23:54:04.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:04.981+0000 7f99b41eb640 1 -- 172.21.15.112:0/3823483913 wait complete. 2024-09-15T23:54:04.998 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:54:04.999 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:54:05.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.113+0000 7fecb7c35640 1 Processor -- start 2024-09-15T23:54:05.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.113+0000 7fecb7c35640 1 -- start start 2024-09-15T23:54:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb7c35640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fecb015bec0 0x7fecb00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb7c35640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fecb015c2a0 0x7fecb00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb7c35640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecb00b3290 con 0x7fecb00af2a0 2024-09-15T23:54:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb7c35640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fecb00b3570 con 0x7fecb015bec0 2024-09-15T23:54:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb7c35640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fecb00b3850 con 0x7fecb015c2a0 2024-09-15T23:54:05.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb59d1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fecb015bec0 0x7fecb00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb59d1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fecb015bec0 0x7fecb00ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57370/0 (socket says 172.21.15.112:57370) 2024-09-15T23:54:05.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb59d1640 1 -- 172.21.15.112:0/1231529891 learned_addr learned my addr 172.21.15.112:0/1231529891 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:05.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb51d0640 1 --2- 172.21.15.112:0/1231529891 >> v2:172.21.15.169:3300/0 conn(0x7fecb015c2a0 0x7fecb00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb59d1640 1 -- 172.21.15.112:0/1231529891 >> v2:172.21.15.169:3300/0 conn(0x7fecb015c2a0 msgr2=0x7fecb00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:05.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb59d1640 1 --2- 172.21.15.112:0/1231529891 >> v2:172.21.15.169:3300/0 conn(0x7fecb015c2a0 0x7fecb00aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb59d1640 1 -- 172.21.15.112:0/1231529891 >> v1:172.21.15.169:6789/0 conn(0x7fecb00af2a0 legacy=0x7fecb015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:05.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb59d1640 1 -- 172.21.15.112:0/1231529891 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb00b3b30 con 0x7fecb015bec0 2024-09-15T23:54:05.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb59d1640 1 --2- 172.21.15.112:0/1231529891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecb015bec0 0x7fecb00ad200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fecb00ae510 tx=0x7feca001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2675b37258d9dfb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:05.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb49cf640 1 -- 172.21.15.112:0/1231529891 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca00aa610 con 0x7fecb015bec0 2024-09-15T23:54:05.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb49cf640 1 -- 172.21.15.112:0/1231529891 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca00af070 con 0x7fecb015bec0 2024-09-15T23:54:05.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.117+0000 7fecb49cf640 1 -- 172.21.15.112:0/1231529891 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca00aa9d0 con 0x7fecb015bec0 2024-09-15T23:54:05.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 -- 172.21.15.112:0/1231529891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecb015bec0 msgr2=0x7fecb00ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 --2- 172.21.15.112:0/1231529891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecb015bec0 0x7fecb00ad200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fecb00ae510 tx=0x7feca001c4b0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 -- 172.21.15.112:0/1231529891 shutdown_connections 2024-09-15T23:54:05.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 --2- 172.21.15.112:0/1231529891 >> v2:172.21.15.169:3300/0 conn(0x7fecb015c2a0 0x7fecb00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 --2- 172.21.15.112:0/1231529891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecb015bec0 0x7fecb00ad200 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 -- 172.21.15.112:0/1231529891 >> 172.21.15.112:0/1231529891 conn(0x7fecb00b1f90 msgr2=0x7fecb00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:05.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 -- 172.21.15.112:0/1231529891 shutdown_connections 2024-09-15T23:54:05.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 -- 172.21.15.112:0/1231529891 wait complete. 2024-09-15T23:54:05.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 Processor -- start 2024-09-15T23:54:05.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 -- start start 2024-09-15T23:54:05.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fecb00af2a0 0x7fecb00b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecb015bec0 0x7fecb0158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecb015c2a0 0x7fecb014e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fecb00ad740 con 0x7fecb015bec0 2024-09-15T23:54:05.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fecb00af710 con 0x7fecb015c2a0 2024-09-15T23:54:05.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb7c35640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fecb0169000 con 0x7fecb00af2a0 2024-09-15T23:54:05.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb51d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecb015bec0 0x7fecb0158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb51d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecb015bec0 0x7fecb0158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57378/0 (socket says 172.21.15.112:57378) 2024-09-15T23:54:05.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb51d0640 1 -- 172.21.15.112:0/2703681846 learned_addr learned my addr 172.21.15.112:0/2703681846 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:05.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb59d1640 1 --2- 172.21.15.112:0/2703681846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fecb00af2a0 0x7fecb00b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb51d0640 1 -- 172.21.15.112:0/2703681846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fecb00af2a0 msgr2=0x7fecb00b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb51d0640 1 --2- 172.21.15.112:0/2703681846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fecb00af2a0 0x7fecb00b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb51d0640 1 -- 172.21.15.112:0/2703681846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecb015c2a0 msgr2=0x7fecb014e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb51d0640 1 --2- 172.21.15.112:0/2703681846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecb015c2a0 0x7fecb014e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb51d0640 1 -- 172.21.15.112:0/2703681846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb01576d0 con 0x7fecb015bec0 2024-09-15T23:54:05.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.121+0000 7fecb51d0640 1 --2- 172.21.15.112:0/2703681846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecb015bec0 0x7fecb0158060 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fecac00c610 tx=0x7fecac00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:05.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.125+0000 7feca67fc640 1 -- 172.21.15.112:0/2703681846 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac015070 con 0x7fecb015bec0 2024-09-15T23:54:05.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.125+0000 7feca67fc640 1 -- 172.21.15.112:0/2703681846 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecac004220 con 0x7fecb015bec0 2024-09-15T23:54:05.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.125+0000 7fecb7c35640 1 -- 172.21.15.112:0/2703681846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb0156650 con 0x7fecb015bec0 2024-09-15T23:54:05.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.125+0000 7feca67fc640 1 -- 172.21.15.112:0/2703681846 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac003620 con 0x7fecb015bec0 2024-09-15T23:54:05.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.125+0000 7fecb7c35640 1 -- 172.21.15.112:0/2703681846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb0156ef0 con 0x7fecb015bec0 2024-09-15T23:54:05.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.125+0000 7fecb7c35640 1 -- 172.21.15.112:0/2703681846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecb00ad200 con 0x7fecb015bec0 2024-09-15T23:54:05.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.125+0000 7feca67fc640 1 -- 172.21.15.112:0/2703681846 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fecac0037c0 con 0x7fecb015bec0 2024-09-15T23:54:05.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.125+0000 7feca67fc640 1 --2- 172.21.15.112:0/2703681846 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec940678c0 0x7fec94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.125+0000 7feca67fc640 1 -- 172.21.15.112:0/2703681846 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fecac085d60 con 0x7fecb015bec0 2024-09-15T23:54:05.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.125+0000 7fecb59d1640 1 --2- 172.21.15.112:0/2703681846 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec940678c0 0x7fec94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.125+0000 7fecb59d1640 1 --2- 172.21.15.112:0/2703681846 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec940678c0 0x7fec94069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feca00ae000 tx=0x7feca0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:05.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.129+0000 7feca67fc640 1 -- 172.21.15.112:0/2703681846 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fecac0565f0 con 0x7fecb015bec0 2024-09-15T23:54:05.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.285+0000 7fecb7c35640 1 -- 172.21.15.112:0/2703681846 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fecb009e2c0 con 0x7fec940678c0 2024-09-15T23:54:05.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.293+0000 7feca67fc640 1 -- 172.21.15.112:0/2703681846 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332554 (secure 0 0 0) 0x7fecb009e2c0 con 0x7fec940678c0 2024-09-15T23:54:05.298 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:05.302 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:54:05.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.297+0000 7fecb7c35640 1 -- 172.21.15.112:0/2703681846 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec940678c0 msgr2=0x7fec94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.297+0000 7fecb7c35640 1 --2- 172.21.15.112:0/2703681846 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec940678c0 0x7fec94069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feca00ae000 tx=0x7feca0008040 comp rx=0 tx=0).stop 2024-09-15T23:54:05.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.297+0000 7fecb7c35640 1 -- 172.21.15.112:0/2703681846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecb015bec0 msgr2=0x7fecb0158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.297+0000 7fecb7c35640 1 --2- 172.21.15.112:0/2703681846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecb015bec0 0x7fecb0158060 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fecac00c610 tx=0x7fecac00cad0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.297+0000 7fecb7c35640 1 -- 172.21.15.112:0/2703681846 shutdown_connections 2024-09-15T23:54:05.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.297+0000 7fecb7c35640 1 --2- 172.21.15.112:0/2703681846 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec940678c0 0x7fec94069d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.297+0000 7fecb7c35640 1 --2- 172.21.15.112:0/2703681846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecb015c2a0 0x7fecb014e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.301+0000 7fecb7c35640 1 --2- 172.21.15.112:0/2703681846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecb015bec0 0x7fecb0158060 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.301+0000 7fecb7c35640 1 --2- 172.21.15.112:0/2703681846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fecb00af2a0 0x7fecb00b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.301+0000 7fecb7c35640 1 -- 172.21.15.112:0/2703681846 >> 172.21.15.112:0/2703681846 conn(0x7fecb00b1f90 msgr2=0x7fecb00751d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:05.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.301+0000 7fecb7c35640 1 -- 172.21.15.112:0/2703681846 shutdown_connections 2024-09-15T23:54:05.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.301+0000 7fecb7c35640 1 -- 172.21.15.112:0/2703681846 wait complete. 2024-09-15T23:54:05.317 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-15T23:54:05.235841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219572,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755148,"statfs":{"total":773094113280,"available":772869271552,"internally_reserved":0,"allocated":3416064,"data_stored":2044148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002985"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.337336+0000","last_change":"2024-09-15T23:53:49.717934+0000","last_active":"2024-09-15T23:53:56.337336+0000","last_peered":"2024-09-15T23:53:56.337336+0000","last_clean":"2024-09-15T23:53:56.337336+0000","last_became_active":"2024-09-15T23:53:49.714475+0000","last_became_peered":"2024-09-15T23:53:49.714475+0000","last_unstale":"2024-09-15T23:53:56.337336+0000","last_undegraded":"2024-09-15T23:53:56.337336+0000","last_fullsized":"2024-09-15T23:53:56.337336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:32.423155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806022+0000","last_change":"2024-09-15T23:53:50.763869+0000","last_active":"2024-09-15T23:53:55.806022+0000","last_peered":"2024-09-15T23:53:55.806022+0000","last_clean":"2024-09-15T23:53:55.806022+0000","last_became_active":"2024-09-15T23:53:50.763518+0000","last_became_peered":"2024-09-15T23:53:50.763518+0000","last_unstale":"2024-09-15T23:53:55.806022+0000","last_undegraded":"2024-09-15T23:53:55.806022+0000","last_fullsized":"2024-09-15T23:53:55.806022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:47.362321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334847+0000","last_change":"2024-09-15T23:53:54.833331+0000","last_active":"2024-09-15T23:53:56.334847+0000","last_peered":"2024-09-15T23:53:56.334847+0000","last_clean":"2024-09-15T23:53:56.334847+0000","last_became_active":"2024-09-15T23:53:54.832469+0000","last_became_peered":"2024-09-15T23:53:54.832469+0000","last_unstale":"2024-09-15T23:53:56.334847+0000","last_undegraded":"2024-09-15T23:53:56.334847+0000","last_fullsized":"2024-09-15T23:53:56.334847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:19.976505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806573+0000","last_change":"2024-09-15T23:53:49.732960+0000","last_active":"2024-09-15T23:53:55.806573+0000","last_peered":"2024-09-15T23:53:55.806573+0000","last_clean":"2024-09-15T23:53:55.806573+0000","last_became_active":"2024-09-15T23:53:49.728314+0000","last_became_peered":"2024-09-15T23:53:49.728314+0000","last_unstale":"2024-09-15T23:53:55.806573+0000","last_undegraded":"2024-09-15T23:53:55.806573+0000","last_fullsized":"2024-09-15T23:53:55.806573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:41.274907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807049+0000","last_change":"2024-09-15T23:53:50.778808+0000","last_active":"2024-09-15T23:53:55.807049+0000","last_peered":"2024-09-15T23:53:55.807049+0000","last_clean":"2024-09-15T23:53:55.807049+0000","last_became_active":"2024-09-15T23:53:50.778102+0000","last_became_peered":"2024-09-15T23:53:50.778102+0000","last_unstale":"2024-09-15T23:53:55.807049+0000","last_undegraded":"2024-09-15T23:53:55.807049+0000","last_fullsized":"2024-09-15T23:53:55.807049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:59:38.443508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331942+0000","last_change":"2024-09-15T23:53:54.829460+0000","last_active":"2024-09-15T23:53:56.331942+0000","last_peered":"2024-09-15T23:53:56.331942+0000","last_clean":"2024-09-15T23:53:56.331942+0000","last_became_active":"2024-09-15T23:53:54.828410+0000","last_became_peered":"2024-09-15T23:53:54.828410+0000","last_unstale":"2024-09-15T23:53:56.331942+0000","last_undegraded":"2024-09-15T23:53:56.331942+0000","last_fullsized":"2024-09-15T23:53:56.331942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:01.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334332+0000","last_change":"2024-09-15T23:53:49.709773+0000","last_active":"2024-09-15T23:53:56.334332+0000","last_peered":"2024-09-15T23:53:56.334332+0000","last_clean":"2024-09-15T23:53:56.334332+0000","last_became_active":"2024-09-15T23:53:49.706868+0000","last_became_peered":"2024-09-15T23:53:49.706868+0000","last_unstale":"2024-09-15T23:53:56.334332+0000","last_undegraded":"2024-09-15T23:53:56.334332+0000","last_fullsized":"2024-09-15T23:53:56.334332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:30.316273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332457+0000","last_change":"2024-09-15T23:53:50.774606+0000","last_active":"2024-09-15T23:53:56.332457+0000","last_peered":"2024-09-15T23:53:56.332457+0000","last_clean":"2024-09-15T23:53:56.332457+0000","last_became_active":"2024-09-15T23:53:50.774322+0000","last_became_peered":"2024-09-15T23:53:50.774322+0000","last_unstale":"2024-09-15T23:53:56.332457+0000","last_undegraded":"2024-09-15T23:53:56.332457+0000","last_fullsized":"2024-09-15T23:53:56.332457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:10.630689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331636+0000","last_change":"2024-09-15T23:53:54.826698+0000","last_active":"2024-09-15T23:53:56.331636+0000","last_peered":"2024-09-15T23:53:56.331636+0000","last_clean":"2024-09-15T23:53:56.331636+0000","last_became_active":"2024-09-15T23:53:54.826082+0000","last_became_peered":"2024-09-15T23:53:54.826082+0000","last_unstale":"2024-09-15T23:53:56.331636+0000","last_undegraded":"2024-09-15T23:53:56.331636+0000","last_fullsized":"2024-09-15T23:53:56.331636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:34.967835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334036+0000","last_change":"2024-09-15T23:53:49.728958+0000","last_active":"2024-09-15T23:53:56.334036+0000","last_peered":"2024-09-15T23:53:56.334036+0000","last_clean":"2024-09-15T23:53:56.334036+0000","last_became_active":"2024-09-15T23:53:49.728518+0000","last_became_peered":"2024-09-15T23:53:49.728518+0000","last_unstale":"2024-09-15T23:53:56.334036+0000","last_undegraded":"2024-09-15T23:53:56.334036+0000","last_fullsized":"2024-09-15T23:53:56.334036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:14.375412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800310+0000","last_change":"2024-09-15T23:53:50.774805+0000","last_active":"2024-09-15T23:53:55.800310+0000","last_peered":"2024-09-15T23:53:55.800310+0000","last_clean":"2024-09-15T23:53:55.800310+0000","last_became_active":"2024-09-15T23:53:50.774139+0000","last_became_peered":"2024-09-15T23:53:50.774139+0000","last_unstale":"2024-09-15T23:53:55.800310+0000","last_undegraded":"2024-09-15T23:53:55.800310+0000","last_fullsized":"2024-09-15T23:53:55.800310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:14.717753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331537+0000","last_change":"2024-09-15T23:53:54.838942+0000","last_active":"2024-09-15T23:53:56.331537+0000","last_peered":"2024-09-15T23:53:56.331537+0000","last_clean":"2024-09-15T23:53:56.331537+0000","last_became_active":"2024-09-15T23:53:54.838537+0000","last_became_peered":"2024-09-15T23:53:54.838537+0000","last_unstale":"2024-09-15T23:53:56.331537+0000","last_undegraded":"2024-09-15T23:53:56.331537+0000","last_fullsized":"2024-09-15T23:53:56.331537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:21.696119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799206+0000","last_change":"2024-09-15T23:53:50.762649+0000","last_active":"2024-09-15T23:53:55.799206+0000","last_peered":"2024-09-15T23:53:55.799206+0000","last_clean":"2024-09-15T23:53:55.799206+0000","last_became_active":"2024-09-15T23:53:50.762376+0000","last_became_peered":"2024-09-15T23:53:50.762376+0000","last_unstale":"2024-09-15T23:53:55.799206+0000","last_undegraded":"2024-09-15T23:53:55.799206+0000","last_fullsized":"2024-09-15T23:53:55.799206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:27.451893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799258+0000","last_change":"2024-09-15T23:53:49.707629+0000","last_active":"2024-09-15T23:53:55.799258+0000","last_peered":"2024-09-15T23:53:55.799258+0000","last_clean":"2024-09-15T23:53:55.799258+0000","last_became_active":"2024-09-15T23:53:49.706615+0000","last_became_peered":"2024-09-15T23:53:49.706615+0000","last_unstale":"2024-09-15T23:53:55.799258+0000","last_undegraded":"2024-09-15T23:53:55.799258+0000","last_fullsized":"2024-09-15T23:53:55.799258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:25.059449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799393+0000","last_change":"2024-09-15T23:53:54.831019+0000","last_active":"2024-09-15T23:53:55.799393+0000","last_peered":"2024-09-15T23:53:55.799393+0000","last_clean":"2024-09-15T23:53:55.799393+0000","last_became_active":"2024-09-15T23:53:54.830461+0000","last_became_peered":"2024-09-15T23:53:54.830461+0000","last_unstale":"2024-09-15T23:53:55.799393+0000","last_undegraded":"2024-09-15T23:53:55.799393+0000","last_fullsized":"2024-09-15T23:53:55.799393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:11.816336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336067+0000","last_change":"2024-09-15T23:53:50.769836+0000","last_active":"2024-09-15T23:53:56.336067+0000","last_peered":"2024-09-15T23:53:56.336067+0000","last_clean":"2024-09-15T23:53:56.336067+0000","last_became_active":"2024-09-15T23:53:50.769317+0000","last_became_peered":"2024-09-15T23:53:50.769317+0000","last_unstale":"2024-09-15T23:53:56.336067+0000","last_undegraded":"2024-09-15T23:53:56.336067+0000","last_fullsized":"2024-09-15T23:53:56.336067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805160+0000","last_change":"2024-09-15T23:53:49.724446+0000","last_active":"2024-09-15T23:53:55.805160+0000","last_peered":"2024-09-15T23:53:55.805160+0000","last_clean":"2024-09-15T23:53:55.805160+0000","last_became_active":"2024-09-15T23:53:49.723722+0000","last_became_peered":"2024-09-15T23:53:49.723722+0000","last_unstale":"2024-09-15T23:53:55.805160+0000","last_undegraded":"2024-09-15T23:53:55.805160+0000","last_fullsized":"2024-09-15T23:53:55.805160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:55.009643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333927+0000","last_change":"2024-09-15T23:53:54.827261+0000","last_active":"2024-09-15T23:53:56.333927+0000","last_peered":"2024-09-15T23:53:56.333927+0000","last_clean":"2024-09-15T23:53:56.333927+0000","last_became_active":"2024-09-15T23:53:54.826675+0000","last_became_peered":"2024-09-15T23:53:54.826675+0000","last_unstale":"2024-09-15T23:53:56.333927+0000","last_undegraded":"2024-09-15T23:53:56.333927+0000","last_fullsized":"2024-09-15T23:53:56.333927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:05.187892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334092+0000","last_change":"2024-09-15T23:53:50.758381+0000","last_active":"2024-09-15T23:53:56.334092+0000","last_peered":"2024-09-15T23:53:56.334092+0000","last_clean":"2024-09-15T23:53:56.334092+0000","last_became_active":"2024-09-15T23:53:50.757608+0000","last_became_peered":"2024-09-15T23:53:50.757608+0000","last_unstale":"2024-09-15T23:53:56.334092+0000","last_undegraded":"2024-09-15T23:53:56.334092+0000","last_fullsized":"2024-09-15T23:53:56.334092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:05.877077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335894+0000","last_change":"2024-09-15T23:53:49.722069+0000","last_active":"2024-09-15T23:53:56.335894+0000","last_peered":"2024-09-15T23:53:56.335894+0000","last_clean":"2024-09-15T23:53:56.335894+0000","last_became_active":"2024-09-15T23:53:49.721311+0000","last_became_peered":"2024-09-15T23:53:49.721311+0000","last_unstale":"2024-09-15T23:53:56.335894+0000","last_undegraded":"2024-09-15T23:53:56.335894+0000","last_fullsized":"2024-09-15T23:53:56.335894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:54.905896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336379+0000","last_change":"2024-09-15T23:53:54.834211+0000","last_active":"2024-09-15T23:53:56.336379+0000","last_peered":"2024-09-15T23:53:56.336379+0000","last_clean":"2024-09-15T23:53:56.336379+0000","last_became_active":"2024-09-15T23:53:54.832649+0000","last_became_peered":"2024-09-15T23:53:54.832649+0000","last_unstale":"2024-09-15T23:53:56.336379+0000","last_undegraded":"2024-09-15T23:53:56.336379+0000","last_fullsized":"2024-09-15T23:53:56.336379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:15.794176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798634+0000","last_change":"2024-09-15T23:53:50.765134+0000","last_active":"2024-09-15T23:53:55.798634+0000","last_peered":"2024-09-15T23:53:55.798634+0000","last_clean":"2024-09-15T23:53:55.798634+0000","last_became_active":"2024-09-15T23:53:50.764730+0000","last_became_peered":"2024-09-15T23:53:50.764730+0000","last_unstale":"2024-09-15T23:53:55.798634+0000","last_undegraded":"2024-09-15T23:53:55.798634+0000","last_fullsized":"2024-09-15T23:53:55.798634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:59.810140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332903+0000","last_change":"2024-09-15T23:53:49.705844+0000","last_active":"2024-09-15T23:53:56.332903+0000","last_peered":"2024-09-15T23:53:56.332903+0000","last_clean":"2024-09-15T23:53:56.332903+0000","last_became_active":"2024-09-15T23:53:49.705408+0000","last_became_peered":"2024-09-15T23:53:49.705408+0000","last_unstale":"2024-09-15T23:53:56.332903+0000","last_undegraded":"2024-09-15T23:53:56.332903+0000","last_fullsized":"2024-09-15T23:53:56.332903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.829837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332277+0000","last_change":"2024-09-15T23:53:54.832183+0000","last_active":"2024-09-15T23:53:56.332277+0000","last_peered":"2024-09-15T23:53:56.332277+0000","last_clean":"2024-09-15T23:53:56.332277+0000","last_became_active":"2024-09-15T23:53:54.831797+0000","last_became_peered":"2024-09-15T23:53:54.831797+0000","last_unstale":"2024-09-15T23:53:56.332277+0000","last_undegraded":"2024-09-15T23:53:56.332277+0000","last_fullsized":"2024-09-15T23:53:56.332277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:05.294652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336702+0000","last_change":"2024-09-15T23:53:50.760086+0000","last_active":"2024-09-15T23:53:56.336702+0000","last_peered":"2024-09-15T23:53:56.336702+0000","last_clean":"2024-09-15T23:53:56.336702+0000","last_became_active":"2024-09-15T23:53:50.759518+0000","last_became_peered":"2024-09-15T23:53:50.759518+0000","last_unstale":"2024-09-15T23:53:56.336702+0000","last_undegraded":"2024-09-15T23:53:56.336702+0000","last_fullsized":"2024-09-15T23:53:56.336702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:49.338954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.801439+0000","last_change":"2024-09-15T23:53:49.712525+0000","last_active":"2024-09-15T23:53:55.801439+0000","last_peered":"2024-09-15T23:53:55.801439+0000","last_clean":"2024-09-15T23:53:55.801439+0000","last_became_active":"2024-09-15T23:53:49.711958+0000","last_became_peered":"2024-09-15T23:53:49.711958+0000","last_unstale":"2024-09-15T23:53:55.801439+0000","last_undegraded":"2024-09-15T23:53:55.801439+0000","last_fullsized":"2024-09-15T23:53:55.801439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:29.249885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331564+0000","last_change":"2024-09-15T23:53:54.820216+0000","last_active":"2024-09-15T23:53:56.331564+0000","last_peered":"2024-09-15T23:53:56.331564+0000","last_clean":"2024-09-15T23:53:56.331564+0000","last_became_active":"2024-09-15T23:53:54.819642+0000","last_became_peered":"2024-09-15T23:53:54.819642+0000","last_unstale":"2024-09-15T23:53:56.331564+0000","last_undegraded":"2024-09-15T23:53:56.331564+0000","last_fullsized":"2024-09-15T23:53:56.331564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:58.670287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.337164+0000","last_change":"2024-09-15T23:53:50.764624+0000","last_active":"2024-09-15T23:53:56.337164+0000","last_peered":"2024-09-15T23:53:56.337164+0000","last_clean":"2024-09-15T23:53:56.337164+0000","last_became_active":"2024-09-15T23:53:50.764271+0000","last_became_peered":"2024-09-15T23:53:50.764271+0000","last_unstale":"2024-09-15T23:53:56.337164+0000","last_undegraded":"2024-09-15T23:53:56.337164+0000","last_fullsized":"2024-09-15T23:53:56.337164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:11.898034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336935+0000","last_change":"2024-09-15T23:53:49.722266+0000","last_active":"2024-09-15T23:53:56.336935+0000","last_peered":"2024-09-15T23:53:56.336935+0000","last_clean":"2024-09-15T23:53:56.336935+0000","last_became_active":"2024-09-15T23:53:49.721470+0000","last_became_peered":"2024-09-15T23:53:49.721470+0000","last_unstale":"2024-09-15T23:53:56.336935+0000","last_undegraded":"2024-09-15T23:53:56.336935+0000","last_fullsized":"2024-09-15T23:53:56.336935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:45.659637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334216+0000","last_change":"2024-09-15T23:53:54.818192+0000","last_active":"2024-09-15T23:53:56.334216+0000","last_peered":"2024-09-15T23:53:56.334216+0000","last_clean":"2024-09-15T23:53:56.334216+0000","last_became_active":"2024-09-15T23:53:54.817117+0000","last_became_peered":"2024-09-15T23:53:54.817117+0000","last_unstale":"2024-09-15T23:53:56.334216+0000","last_undegraded":"2024-09-15T23:53:56.334216+0000","last_fullsized":"2024-09-15T23:53:56.334216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:18.414617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807739+0000","last_change":"2024-09-15T23:53:50.753210+0000","last_active":"2024-09-15T23:53:55.807739+0000","last_peered":"2024-09-15T23:53:55.807739+0000","last_clean":"2024-09-15T23:53:55.807739+0000","last_became_active":"2024-09-15T23:53:50.752491+0000","last_became_peered":"2024-09-15T23:53:50.752491+0000","last_unstale":"2024-09-15T23:53:55.807739+0000","last_undegraded":"2024-09-15T23:53:55.807739+0000","last_fullsized":"2024-09-15T23:53:55.807739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:15.892900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.801158+0000","last_change":"2024-09-15T23:53:49.717089+0000","last_active":"2024-09-15T23:53:55.801158+0000","last_peered":"2024-09-15T23:53:55.801158+0000","last_clean":"2024-09-15T23:53:55.801158+0000","last_became_active":"2024-09-15T23:53:49.715862+0000","last_became_peered":"2024-09-15T23:53:49.715862+0000","last_unstale":"2024-09-15T23:53:55.801158+0000","last_undegraded":"2024-09-15T23:53:55.801158+0000","last_fullsized":"2024-09-15T23:53:55.801158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:49.721033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805363+0000","last_change":"2024-09-15T23:53:54.831979+0000","last_active":"2024-09-15T23:53:55.805363+0000","last_peered":"2024-09-15T23:53:55.805363+0000","last_clean":"2024-09-15T23:53:55.805363+0000","last_became_active":"2024-09-15T23:53:54.830505+0000","last_became_peered":"2024-09-15T23:53:54.830505+0000","last_unstale":"2024-09-15T23:53:55.805363+0000","last_undegraded":"2024-09-15T23:53:55.805363+0000","last_fullsized":"2024-09-15T23:53:55.805363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:58.670287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332157+0000","last_change":"2024-09-15T23:53:50.769317+0000","last_active":"2024-09-15T23:53:56.332157+0000","last_peered":"2024-09-15T23:53:56.332157+0000","last_clean":"2024-09-15T23:53:56.332157+0000","last_became_active":"2024-09-15T23:53:50.768788+0000","last_became_peered":"2024-09-15T23:53:50.768788+0000","last_unstale":"2024-09-15T23:53:56.332157+0000","last_undegraded":"2024-09-15T23:53:56.332157+0000","last_fullsized":"2024-09-15T23:53:56.332157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:55.915920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805063+0000","last_change":"2024-09-15T23:53:49.734159+0000","last_active":"2024-09-15T23:53:55.805063+0000","last_peered":"2024-09-15T23:53:55.805063+0000","last_clean":"2024-09-15T23:53:55.805063+0000","last_became_active":"2024-09-15T23:53:49.733298+0000","last_became_peered":"2024-09-15T23:53:49.733298+0000","last_unstale":"2024-09-15T23:53:55.805063+0000","last_undegraded":"2024-09-15T23:53:55.805063+0000","last_fullsized":"2024-09-15T23:53:55.805063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:25.932592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803370+0000","last_change":"2024-09-15T23:53:54.843329+0000","last_active":"2024-09-15T23:53:55.803370+0000","last_peered":"2024-09-15T23:53:55.803370+0000","last_clean":"2024-09-15T23:53:55.803370+0000","last_became_active":"2024-09-15T23:53:54.838912+0000","last_became_peered":"2024-09-15T23:53:54.838912+0000","last_unstale":"2024-09-15T23:53:55.803370+0000","last_undegraded":"2024-09-15T23:53:55.803370+0000","last_fullsized":"2024-09-15T23:53:55.803370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:55.661043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333465+0000","last_change":"2024-09-15T23:53:50.767627+0000","last_active":"2024-09-15T23:53:56.333465+0000","last_peered":"2024-09-15T23:53:56.333465+0000","last_clean":"2024-09-15T23:53:56.333465+0000","last_became_active":"2024-09-15T23:53:50.766671+0000","last_became_peered":"2024-09-15T23:53:50.766671+0000","last_unstale":"2024-09-15T23:53:56.333465+0000","last_undegraded":"2024-09-15T23:53:56.333465+0000","last_fullsized":"2024-09-15T23:53:56.333465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:54.586682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799767+0000","last_change":"2024-09-15T23:53:49.725634+0000","last_active":"2024-09-15T23:53:55.799767+0000","last_peered":"2024-09-15T23:53:55.799767+0000","last_clean":"2024-09-15T23:53:55.799767+0000","last_became_active":"2024-09-15T23:53:49.723832+0000","last_became_peered":"2024-09-15T23:53:49.723832+0000","last_unstale":"2024-09-15T23:53:55.799767+0000","last_undegraded":"2024-09-15T23:53:55.799767+0000","last_fullsized":"2024-09-15T23:53:55.799767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:09.900395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807354+0000","last_change":"2024-09-15T23:53:54.846953+0000","last_active":"2024-09-15T23:53:55.807354+0000","last_peered":"2024-09-15T23:53:55.807354+0000","last_clean":"2024-09-15T23:53:55.807354+0000","last_became_active":"2024-09-15T23:53:54.844217+0000","last_became_peered":"2024-09-15T23:53:54.844217+0000","last_unstale":"2024-09-15T23:53:55.807354+0000","last_undegraded":"2024-09-15T23:53:55.807354+0000","last_fullsized":"2024-09-15T23:53:55.807354+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:25.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803281+0000","last_change":"2024-09-15T23:53:50.763583+0000","last_active":"2024-09-15T23:53:55.803281+0000","last_peered":"2024-09-15T23:53:55.803281+0000","last_clean":"2024-09-15T23:53:55.803281+0000","last_became_active":"2024-09-15T23:53:50.763267+0000","last_became_peered":"2024-09-15T23:53:50.763267+0000","last_unstale":"2024-09-15T23:53:55.803281+0000","last_undegraded":"2024-09-15T23:53:55.803281+0000","last_fullsized":"2024-09-15T23:53:55.803281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:34.077890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335453+0000","last_change":"2024-09-15T23:53:49.725775+0000","last_active":"2024-09-15T23:53:56.335453+0000","last_peered":"2024-09-15T23:53:56.335453+0000","last_clean":"2024-09-15T23:53:56.335453+0000","last_became_active":"2024-09-15T23:53:49.724972+0000","last_became_peered":"2024-09-15T23:53:49.724972+0000","last_unstale":"2024-09-15T23:53:56.335453+0000","last_undegraded":"2024-09-15T23:53:56.335453+0000","last_fullsized":"2024-09-15T23:53:56.335453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:25:03.906556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805542+0000","last_change":"2024-09-15T23:53:54.831426+0000","last_active":"2024-09-15T23:53:55.805542+0000","last_peered":"2024-09-15T23:53:55.805542+0000","last_clean":"2024-09-15T23:53:55.805542+0000","last_became_active":"2024-09-15T23:53:54.830222+0000","last_became_peered":"2024-09-15T23:53:54.830222+0000","last_unstale":"2024-09-15T23:53:55.805542+0000","last_undegraded":"2024-09-15T23:53:55.805542+0000","last_fullsized":"2024-09-15T23:53:55.805542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:01.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804225+0000","last_change":"2024-09-15T23:53:50.749494+0000","last_active":"2024-09-15T23:53:55.804225+0000","last_peered":"2024-09-15T23:53:55.804225+0000","last_clean":"2024-09-15T23:53:55.804225+0000","last_became_active":"2024-09-15T23:53:50.748576+0000","last_became_peered":"2024-09-15T23:53:50.748576+0000","last_unstale":"2024-09-15T23:53:55.804225+0000","last_undegraded":"2024-09-15T23:53:55.804225+0000","last_fullsized":"2024-09-15T23:53:55.804225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:39.100079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799626+0000","last_change":"2024-09-15T23:53:49.725322+0000","last_active":"2024-09-15T23:53:55.799626+0000","last_peered":"2024-09-15T23:53:55.799626+0000","last_clean":"2024-09-15T23:53:55.799626+0000","last_became_active":"2024-09-15T23:53:49.724863+0000","last_became_peered":"2024-09-15T23:53:49.724863+0000","last_unstale":"2024-09-15T23:53:55.799626+0000","last_undegraded":"2024-09-15T23:53:55.799626+0000","last_fullsized":"2024-09-15T23:53:55.799626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:08.552003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805910+0000","last_change":"2024-09-15T23:53:54.839131+0000","last_active":"2024-09-15T23:53:55.805910+0000","last_peered":"2024-09-15T23:53:55.805910+0000","last_clean":"2024-09-15T23:53:55.805910+0000","last_became_active":"2024-09-15T23:53:54.837820+0000","last_became_peered":"2024-09-15T23:53:54.837820+0000","last_unstale":"2024-09-15T23:53:55.805910+0000","last_undegraded":"2024-09-15T23:53:55.805910+0000","last_fullsized":"2024-09-15T23:53:55.805910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:12.392532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334826+0000","last_change":"2024-09-15T23:53:50.760376+0000","last_active":"2024-09-15T23:53:56.334826+0000","last_peered":"2024-09-15T23:53:56.334826+0000","last_clean":"2024-09-15T23:53:56.334826+0000","last_became_active":"2024-09-15T23:53:50.758918+0000","last_became_peered":"2024-09-15T23:53:50.758918+0000","last_unstale":"2024-09-15T23:53:56.334826+0000","last_undegraded":"2024-09-15T23:53:56.334826+0000","last_fullsized":"2024-09-15T23:53:56.334826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:04.750808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799555+0000","last_change":"2024-09-15T23:53:49.707210+0000","last_active":"2024-09-15T23:53:55.799555+0000","last_peered":"2024-09-15T23:53:55.799555+0000","last_clean":"2024-09-15T23:53:55.799555+0000","last_became_active":"2024-09-15T23:53:49.705850+0000","last_became_peered":"2024-09-15T23:53:49.705850+0000","last_unstale":"2024-09-15T23:53:55.799555+0000","last_undegraded":"2024-09-15T23:53:55.799555+0000","last_fullsized":"2024-09-15T23:53:55.799555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:01.693912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331928+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:53:56.331928+0000","last_peered":"2024-09-15T23:53:56.331928+0000","last_clean":"2024-09-15T23:53:56.331928+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:53:56.331928+0000","last_undegraded":"2024-09-15T23:53:56.331928+0000","last_fullsized":"2024-09-15T23:53:56.331928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800931+0000","last_change":"2024-09-15T23:53:54.802294+0000","last_active":"2024-09-15T23:53:55.800931+0000","last_peered":"2024-09-15T23:53:55.800931+0000","last_clean":"2024-09-15T23:53:55.800931+0000","last_became_active":"2024-09-15T23:53:54.801810+0000","last_became_peered":"2024-09-15T23:53:54.801810+0000","last_unstale":"2024-09-15T23:53:55.800931+0000","last_undegraded":"2024-09-15T23:53:55.800931+0000","last_fullsized":"2024-09-15T23:53:55.800931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:31.818261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800591+0000","last_change":"2024-09-15T23:53:50.763308+0000","last_active":"2024-09-15T23:53:55.800591+0000","last_peered":"2024-09-15T23:53:55.800591+0000","last_clean":"2024-09-15T23:53:55.800591+0000","last_became_active":"2024-09-15T23:53:50.763032+0000","last_became_peered":"2024-09-15T23:53:50.763032+0000","last_unstale":"2024-09-15T23:53:55.800591+0000","last_undegraded":"2024-09-15T23:53:55.800591+0000","last_fullsized":"2024-09-15T23:53:55.800591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:48.085914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807911+0000","last_change":"2024-09-15T23:53:49.730437+0000","last_active":"2024-09-15T23:53:55.807911+0000","last_peered":"2024-09-15T23:53:55.807911+0000","last_clean":"2024-09-15T23:53:55.807911+0000","last_became_active":"2024-09-15T23:53:49.729801+0000","last_became_peered":"2024-09-15T23:53:49.729801+0000","last_unstale":"2024-09-15T23:53:55.807911+0000","last_undegraded":"2024-09-15T23:53:55.807911+0000","last_fullsized":"2024-09-15T23:53:55.807911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:56.727393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331703+0000","last_change":"2024-09-15T23:53:54.838987+0000","last_active":"2024-09-15T23:53:56.331703+0000","last_peered":"2024-09-15T23:53:56.331703+0000","last_clean":"2024-09-15T23:53:56.331703+0000","last_became_active":"2024-09-15T23:53:54.838600+0000","last_became_peered":"2024-09-15T23:53:54.838600+0000","last_unstale":"2024-09-15T23:53:56.331703+0000","last_undegraded":"2024-09-15T23:53:56.331703+0000","last_fullsized":"2024-09-15T23:53:56.331703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:55.661043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333855+0000","last_change":"2024-09-15T23:53:50.772514+0000","last_active":"2024-09-15T23:53:56.333855+0000","last_peered":"2024-09-15T23:53:56.333855+0000","last_clean":"2024-09-15T23:53:56.333855+0000","last_became_active":"2024-09-15T23:53:50.771970+0000","last_became_peered":"2024-09-15T23:53:50.771970+0000","last_unstale":"2024-09-15T23:53:56.333855+0000","last_undegraded":"2024-09-15T23:53:56.333855+0000","last_fullsized":"2024-09-15T23:53:56.333855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:17.612514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805841+0000","last_change":"2024-09-15T23:53:49.728617+0000","last_active":"2024-09-15T23:53:55.805841+0000","last_peered":"2024-09-15T23:53:55.805841+0000","last_clean":"2024-09-15T23:53:55.805841+0000","last_became_active":"2024-09-15T23:53:49.727770+0000","last_became_peered":"2024-09-15T23:53:49.727770+0000","last_unstale":"2024-09-15T23:53:55.805841+0000","last_undegraded":"2024-09-15T23:53:55.805841+0000","last_fullsized":"2024-09-15T23:53:55.805841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:51.740913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804252+0000","last_change":"2024-09-15T23:53:54.815958+0000","last_active":"2024-09-15T23:53:55.804252+0000","last_peered":"2024-09-15T23:53:55.804252+0000","last_clean":"2024-09-15T23:53:55.804252+0000","last_became_active":"2024-09-15T23:53:54.814904+0000","last_became_peered":"2024-09-15T23:53:54.814904+0000","last_unstale":"2024-09-15T23:53:55.804252+0000","last_undegraded":"2024-09-15T23:53:55.804252+0000","last_fullsized":"2024-09-15T23:53:55.804252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:56.872305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333379+0000","last_change":"2024-09-15T23:53:50.781321+0000","last_active":"2024-09-15T23:53:56.333379+0000","last_peered":"2024-09-15T23:53:56.333379+0000","last_clean":"2024-09-15T23:53:56.333379+0000","last_became_active":"2024-09-15T23:53:50.780931+0000","last_became_peered":"2024-09-15T23:53:50.780931+0000","last_unstale":"2024-09-15T23:53:56.333379+0000","last_undegraded":"2024-09-15T23:53:56.333379+0000","last_fullsized":"2024-09-15T23:53:56.333379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:54.765704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336877+0000","last_change":"2024-09-15T23:53:49.730687+0000","last_active":"2024-09-15T23:53:56.336877+0000","last_peered":"2024-09-15T23:53:56.336877+0000","last_clean":"2024-09-15T23:53:56.336877+0000","last_became_active":"2024-09-15T23:53:49.729969+0000","last_became_peered":"2024-09-15T23:53:49.729969+0000","last_unstale":"2024-09-15T23:53:56.336877+0000","last_undegraded":"2024-09-15T23:53:56.336877+0000","last_fullsized":"2024-09-15T23:53:56.336877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:55.009643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798438+0000","last_change":"2024-09-15T23:53:54.807204+0000","last_active":"2024-09-15T23:53:55.798438+0000","last_peered":"2024-09-15T23:53:55.798438+0000","last_clean":"2024-09-15T23:53:55.798438+0000","last_became_active":"2024-09-15T23:53:54.806430+0000","last_became_peered":"2024-09-15T23:53:54.806430+0000","last_unstale":"2024-09-15T23:53:55.798438+0000","last_undegraded":"2024-09-15T23:53:55.798438+0000","last_fullsized":"2024-09-15T23:53:55.798438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:24.111672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333084+0000","last_change":"2024-09-15T23:53:50.779517+0000","last_active":"2024-09-15T23:53:56.333084+0000","last_peered":"2024-09-15T23:53:56.333084+0000","last_clean":"2024-09-15T23:53:56.333084+0000","last_became_active":"2024-09-15T23:53:50.779199+0000","last_became_peered":"2024-09-15T23:53:50.779199+0000","last_unstale":"2024-09-15T23:53:56.333084+0000","last_undegraded":"2024-09-15T23:53:56.333084+0000","last_fullsized":"2024-09-15T23:53:56.333084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:39.100079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333514+0000","last_change":"2024-09-15T23:53:49.734270+0000","last_active":"2024-09-15T23:53:56.333514+0000","last_peered":"2024-09-15T23:53:56.333514+0000","last_clean":"2024-09-15T23:53:56.333514+0000","last_became_active":"2024-09-15T23:53:49.729410+0000","last_became_peered":"2024-09-15T23:53:49.729410+0000","last_unstale":"2024-09-15T23:53:56.333514+0000","last_undegraded":"2024-09-15T23:53:56.333514+0000","last_fullsized":"2024-09-15T23:53:56.333514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:32.423155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332767+0000","last_change":"2024-09-15T23:53:54.828876+0000","last_active":"2024-09-15T23:53:56.332767+0000","last_peered":"2024-09-15T23:53:56.332767+0000","last_clean":"2024-09-15T23:53:56.332767+0000","last_became_active":"2024-09-15T23:53:54.828500+0000","last_became_peered":"2024-09-15T23:53:54.828500+0000","last_unstale":"2024-09-15T23:53:56.332767+0000","last_undegraded":"2024-09-15T23:53:56.332767+0000","last_fullsized":"2024-09-15T23:53:56.332767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:03.580557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799130+0000","last_change":"2024-09-15T23:53:50.761067+0000","last_active":"2024-09-15T23:53:55.799130+0000","last_peered":"2024-09-15T23:53:55.799130+0000","last_clean":"2024-09-15T23:53:55.799130+0000","last_became_active":"2024-09-15T23:53:50.760746+0000","last_became_peered":"2024-09-15T23:53:50.760746+0000","last_unstale":"2024-09-15T23:53:55.799130+0000","last_undegraded":"2024-09-15T23:53:55.799130+0000","last_fullsized":"2024-09-15T23:53:55.799130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:37.867754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334428+0000","last_change":"2024-09-15T23:53:49.715804+0000","last_active":"2024-09-15T23:53:56.334428+0000","last_peered":"2024-09-15T23:53:56.334428+0000","last_clean":"2024-09-15T23:53:56.334428+0000","last_became_active":"2024-09-15T23:53:49.715180+0000","last_became_peered":"2024-09-15T23:53:49.715180+0000","last_unstale":"2024-09-15T23:53:56.334428+0000","last_undegraded":"2024-09-15T23:53:56.334428+0000","last_fullsized":"2024-09-15T23:53:56.334428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.829837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806333+0000","last_change":"2024-09-15T23:53:54.838616+0000","last_active":"2024-09-15T23:53:55.806333+0000","last_peered":"2024-09-15T23:53:55.806333+0000","last_clean":"2024-09-15T23:53:55.806333+0000","last_became_active":"2024-09-15T23:53:54.837514+0000","last_became_peered":"2024-09-15T23:53:54.837514+0000","last_unstale":"2024-09-15T23:53:55.806333+0000","last_undegraded":"2024-09-15T23:53:55.806333+0000","last_fullsized":"2024-09-15T23:53:55.806333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:16.570607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331570+0000","last_change":"2024-09-15T23:53:50.773002+0000","last_active":"2024-09-15T23:53:56.331570+0000","last_peered":"2024-09-15T23:53:56.331570+0000","last_clean":"2024-09-15T23:53:56.331570+0000","last_became_active":"2024-09-15T23:53:50.772276+0000","last_became_peered":"2024-09-15T23:53:50.772276+0000","last_unstale":"2024-09-15T23:53:56.331570+0000","last_undegraded":"2024-09-15T23:53:56.331570+0000","last_fullsized":"2024-09-15T23:53:56.331570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:55.915920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333217+0000","last_change":"2024-09-15T23:53:49.700504+0000","last_active":"2024-09-15T23:53:56.333217+0000","last_peered":"2024-09-15T23:53:56.333217+0000","last_clean":"2024-09-15T23:53:56.333217+0000","last_became_active":"2024-09-15T23:53:49.699750+0000","last_became_peered":"2024-09-15T23:53:49.699750+0000","last_unstale":"2024-09-15T23:53:56.333217+0000","last_undegraded":"2024-09-15T23:53:56.333217+0000","last_fullsized":"2024-09-15T23:53:56.333217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:45.659637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806928+0000","last_change":"2024-09-15T23:53:54.824331+0000","last_active":"2024-09-15T23:53:55.806928+0000","last_peered":"2024-09-15T23:53:55.806928+0000","last_clean":"2024-09-15T23:53:55.806928+0000","last_became_active":"2024-09-15T23:53:54.823300+0000","last_became_peered":"2024-09-15T23:53:54.823300+0000","last_unstale":"2024-09-15T23:53:55.806928+0000","last_undegraded":"2024-09-15T23:53:55.806928+0000","last_fullsized":"2024-09-15T23:53:55.806928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:37.095883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798948+0000","last_change":"2024-09-15T23:53:50.775624+0000","last_active":"2024-09-15T23:53:55.798948+0000","last_peered":"2024-09-15T23:53:55.798948+0000","last_clean":"2024-09-15T23:53:55.798948+0000","last_became_active":"2024-09-15T23:53:50.775283+0000","last_became_peered":"2024-09-15T23:53:50.775283+0000","last_unstale":"2024-09-15T23:53:55.798948+0000","last_undegraded":"2024-09-15T23:53:55.798948+0000","last_fullsized":"2024-09-15T23:53:55.798948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:06.300941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799708+0000","last_change":"2024-09-15T23:53:49.723818+0000","last_active":"2024-09-15T23:53:55.799708+0000","last_peered":"2024-09-15T23:53:55.799708+0000","last_clean":"2024-09-15T23:53:55.799708+0000","last_became_active":"2024-09-15T23:53:49.720057+0000","last_became_peered":"2024-09-15T23:53:49.720057+0000","last_unstale":"2024-09-15T23:53:55.799708+0000","last_undegraded":"2024-09-15T23:53:55.799708+0000","last_fullsized":"2024-09-15T23:53:55.799708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:38.734641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807236+0000","last_change":"2024-09-15T23:53:54.846308+0000","last_active":"2024-09-15T23:53:55.807236+0000","last_peered":"2024-09-15T23:53:55.807236+0000","last_clean":"2024-09-15T23:53:55.807236+0000","last_became_active":"2024-09-15T23:53:54.844118+0000","last_became_peered":"2024-09-15T23:53:54.844118+0000","last_unstale":"2024-09-15T23:53:55.807236+0000","last_undegraded":"2024-09-15T23:53:55.807236+0000","last_fullsized":"2024-09-15T23:53:55.807236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:05.294652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804937+0000","last_change":"2024-09-15T23:53:50.760823+0000","last_active":"2024-09-15T23:53:55.804937+0000","last_peered":"2024-09-15T23:53:55.804937+0000","last_clean":"2024-09-15T23:53:55.804937+0000","last_became_active":"2024-09-15T23:53:50.760471+0000","last_became_peered":"2024-09-15T23:53:50.760471+0000","last_unstale":"2024-09-15T23:53:55.804937+0000","last_undegraded":"2024-09-15T23:53:55.804937+0000","last_fullsized":"2024-09-15T23:53:55.804937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:04.750808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336497+0000","last_change":"2024-09-15T23:53:49.719808+0000","last_active":"2024-09-15T23:53:56.336497+0000","last_peered":"2024-09-15T23:53:56.336497+0000","last_clean":"2024-09-15T23:53:56.336497+0000","last_became_active":"2024-09-15T23:53:49.719303+0000","last_became_peered":"2024-09-15T23:53:49.719303+0000","last_unstale":"2024-09-15T23:53:56.336497+0000","last_undegraded":"2024-09-15T23:53:56.336497+0000","last_fullsized":"2024-09-15T23:53:56.336497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:55.009643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800425+0000","last_change":"2024-09-15T23:53:54.807683+0000","last_active":"2024-09-15T23:53:55.800425+0000","last_peered":"2024-09-15T23:53:55.800425+0000","last_clean":"2024-09-15T23:53:55.800425+0000","last_became_active":"2024-09-15T23:53:54.807273+0000","last_became_peered":"2024-09-15T23:53:54.807273+0000","last_unstale":"2024-09-15T23:53:55.800425+0000","last_undegraded":"2024-09-15T23:53:55.800425+0000","last_fullsized":"2024-09-15T23:53:55.800425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:29.903334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334249+0000","last_change":"2024-09-15T23:53:50.778913+0000","last_active":"2024-09-15T23:53:56.334249+0000","last_peered":"2024-09-15T23:53:56.334249+0000","last_clean":"2024-09-15T23:53:56.334249+0000","last_became_active":"2024-09-15T23:53:50.775954+0000","last_became_peered":"2024-09-15T23:53:50.775954+0000","last_unstale":"2024-09-15T23:53:56.334249+0000","last_undegraded":"2024-09-15T23:53:56.334249+0000","last_fullsized":"2024-09-15T23:53:56.334249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:51.577438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:54:01.347228+0000","last_change":"2024-09-15T23:53:49.720597+0000","last_active":"2024-09-15T23:54:01.347228+0000","last_peered":"2024-09-15T23:54:01.347228+0000","last_clean":"2024-09-15T23:54:01.347228+0000","last_became_active":"2024-09-15T23:53:49.717557+0000","last_became_peered":"2024-09-15T23:53:49.717557+0000","last_unstale":"2024-09-15T23:54:01.347228+0000","last_undegraded":"2024-09-15T23:54:01.347228+0000","last_fullsized":"2024-09-15T23:54:01.347228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:05.442964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334641+0000","last_change":"2024-09-15T23:53:54.826160+0000","last_active":"2024-09-15T23:53:56.334641+0000","last_peered":"2024-09-15T23:53:56.334641+0000","last_clean":"2024-09-15T23:53:56.334641+0000","last_became_active":"2024-09-15T23:53:54.824735+0000","last_became_peered":"2024-09-15T23:53:54.824735+0000","last_unstale":"2024-09-15T23:53:56.334641+0000","last_undegraded":"2024-09-15T23:53:56.334641+0000","last_fullsized":"2024-09-15T23:53:56.334641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:05.294652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799239+0000","last_change":"2024-09-15T23:53:50.760066+0000","last_active":"2024-09-15T23:53:55.799239+0000","last_peered":"2024-09-15T23:53:55.799239+0000","last_clean":"2024-09-15T23:53:55.799239+0000","last_became_active":"2024-09-15T23:53:50.759702+0000","last_became_peered":"2024-09-15T23:53:50.759702+0000","last_unstale":"2024-09-15T23:53:55.799239+0000","last_undegraded":"2024-09-15T23:53:55.799239+0000","last_fullsized":"2024-09-15T23:53:55.799239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:11.697485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335921+0000","last_change":"2024-09-15T23:53:49.718600+0000","last_active":"2024-09-15T23:53:56.335921+0000","last_peered":"2024-09-15T23:53:56.335921+0000","last_clean":"2024-09-15T23:53:56.335921+0000","last_became_active":"2024-09-15T23:53:49.718133+0000","last_became_peered":"2024-09-15T23:53:49.718133+0000","last_unstale":"2024-09-15T23:53:56.335921+0000","last_undegraded":"2024-09-15T23:53:56.335921+0000","last_fullsized":"2024-09-15T23:53:56.335921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:56.727393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334929+0000","last_change":"2024-09-15T23:53:54.831611+0000","last_active":"2024-09-15T23:53:56.334929+0000","last_peered":"2024-09-15T23:53:56.334929+0000","last_clean":"2024-09-15T23:53:56.334929+0000","last_became_active":"2024-09-15T23:53:54.830621+0000","last_became_peered":"2024-09-15T23:53:54.830621+0000","last_unstale":"2024-09-15T23:53:56.334929+0000","last_undegraded":"2024-09-15T23:53:56.334929+0000","last_fullsized":"2024-09-15T23:53:56.334929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:25.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807274+0000","last_change":"2024-09-15T23:53:50.766881+0000","last_active":"2024-09-15T23:53:55.807274+0000","last_peered":"2024-09-15T23:53:55.807274+0000","last_clean":"2024-09-15T23:53:55.807274+0000","last_became_active":"2024-09-15T23:53:50.766527+0000","last_became_peered":"2024-09-15T23:53:50.766527+0000","last_unstale":"2024-09-15T23:53:55.807274+0000","last_undegraded":"2024-09-15T23:53:55.807274+0000","last_fullsized":"2024-09-15T23:53:55.807274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:15.908762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334496+0000","last_change":"2024-09-15T23:53:49.704002+0000","last_active":"2024-09-15T23:53:56.334496+0000","last_peered":"2024-09-15T23:53:56.334496+0000","last_clean":"2024-09-15T23:53:56.334496+0000","last_became_active":"2024-09-15T23:53:49.703760+0000","last_became_peered":"2024-09-15T23:53:49.703760+0000","last_unstale":"2024-09-15T23:53:56.334496+0000","last_undegraded":"2024-09-15T23:53:56.334496+0000","last_fullsized":"2024-09-15T23:53:56.334496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:54.905896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334638+0000","last_change":"2024-09-15T23:53:54.835532+0000","last_active":"2024-09-15T23:53:56.334638+0000","last_peered":"2024-09-15T23:53:56.334638+0000","last_clean":"2024-09-15T23:53:56.334638+0000","last_became_active":"2024-09-15T23:53:54.834666+0000","last_became_peered":"2024-09-15T23:53:54.834666+0000","last_unstale":"2024-09-15T23:53:56.334638+0000","last_undegraded":"2024-09-15T23:53:56.334638+0000","last_fullsized":"2024-09-15T23:53:56.334638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:08.834413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333009+0000","last_change":"2024-09-15T23:53:50.768163+0000","last_active":"2024-09-15T23:53:56.333009+0000","last_peered":"2024-09-15T23:53:56.333009+0000","last_clean":"2024-09-15T23:53:56.333009+0000","last_became_active":"2024-09-15T23:53:50.763914+0000","last_became_peered":"2024-09-15T23:53:50.763914+0000","last_unstale":"2024-09-15T23:53:56.333009+0000","last_undegraded":"2024-09-15T23:53:56.333009+0000","last_fullsized":"2024-09-15T23:53:56.333009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:48.894933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332851+0000","last_change":"2024-09-15T23:53:49.720489+0000","last_active":"2024-09-15T23:53:56.332851+0000","last_peered":"2024-09-15T23:53:56.332851+0000","last_clean":"2024-09-15T23:53:56.332851+0000","last_became_active":"2024-09-15T23:53:49.719882+0000","last_became_peered":"2024-09-15T23:53:49.719882+0000","last_unstale":"2024-09-15T23:53:56.332851+0000","last_undegraded":"2024-09-15T23:53:56.332851+0000","last_fullsized":"2024-09-15T23:53:56.332851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:42.225697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335364+0000","last_change":"2024-09-15T23:53:54.834453+0000","last_active":"2024-09-15T23:53:56.335364+0000","last_peered":"2024-09-15T23:53:56.335364+0000","last_clean":"2024-09-15T23:53:56.335364+0000","last_became_active":"2024-09-15T23:53:54.832355+0000","last_became_peered":"2024-09-15T23:53:54.832355+0000","last_unstale":"2024-09-15T23:53:56.335364+0000","last_undegraded":"2024-09-15T23:53:56.335364+0000","last_fullsized":"2024-09-15T23:53:56.335364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:25.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336774+0000","last_change":"2024-09-15T23:53:54.823569+0000","last_active":"2024-09-15T23:53:56.336774+0000","last_peered":"2024-09-15T23:53:56.336774+0000","last_clean":"2024-09-15T23:53:56.336774+0000","last_became_active":"2024-09-15T23:53:54.822582+0000","last_became_peered":"2024-09-15T23:53:54.822582+0000","last_unstale":"2024-09-15T23:53:56.336774+0000","last_undegraded":"2024-09-15T23:53:56.336774+0000","last_fullsized":"2024-09-15T23:53:56.336774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:40.544116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335644+0000","last_change":"2024-09-15T23:53:50.754235+0000","last_active":"2024-09-15T23:53:56.335644+0000","last_peered":"2024-09-15T23:53:56.335644+0000","last_clean":"2024-09-15T23:53:56.335644+0000","last_became_active":"2024-09-15T23:53:50.753479+0000","last_became_peered":"2024-09-15T23:53:50.753479+0000","last_unstale":"2024-09-15T23:53:56.335644+0000","last_undegraded":"2024-09-15T23:53:56.335644+0000","last_fullsized":"2024-09-15T23:53:56.335644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:11.710571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799070+0000","last_change":"2024-09-15T23:53:49.704444+0000","last_active":"2024-09-15T23:53:55.799070+0000","last_peered":"2024-09-15T23:53:55.799070+0000","last_clean":"2024-09-15T23:53:55.799070+0000","last_became_active":"2024-09-15T23:53:49.703888+0000","last_became_peered":"2024-09-15T23:53:49.703888+0000","last_unstale":"2024-09-15T23:53:55.799070+0000","last_undegraded":"2024-09-15T23:53:55.799070+0000","last_fullsized":"2024-09-15T23:53:55.799070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:17.063782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800734+0000","last_change":"2024-09-15T23:53:54.808928+0000","last_active":"2024-09-15T23:53:55.800734+0000","last_peered":"2024-09-15T23:53:55.800734+0000","last_clean":"2024-09-15T23:53:55.800734+0000","last_became_active":"2024-09-15T23:53:54.808284+0000","last_became_peered":"2024-09-15T23:53:54.808284+0000","last_unstale":"2024-09-15T23:53:55.800734+0000","last_undegraded":"2024-09-15T23:53:55.800734+0000","last_fullsized":"2024-09-15T23:53:55.800734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:33.254304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803508+0000","last_change":"2024-09-15T23:53:50.771765+0000","last_active":"2024-09-15T23:53:55.803508+0000","last_peered":"2024-09-15T23:53:55.803508+0000","last_clean":"2024-09-15T23:53:55.803508+0000","last_became_active":"2024-09-15T23:53:50.770972+0000","last_became_peered":"2024-09-15T23:53:50.770972+0000","last_unstale":"2024-09-15T23:53:55.803508+0000","last_undegraded":"2024-09-15T23:53:55.803508+0000","last_fullsized":"2024-09-15T23:53:55.803508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:30.225858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804471+0000","last_change":"2024-09-15T23:53:49.703341+0000","last_active":"2024-09-15T23:53:55.804471+0000","last_peered":"2024-09-15T23:53:55.804471+0000","last_clean":"2024-09-15T23:53:55.804471+0000","last_became_active":"2024-09-15T23:53:49.702534+0000","last_became_peered":"2024-09-15T23:53:49.702534+0000","last_unstale":"2024-09-15T23:53:55.804471+0000","last_undegraded":"2024-09-15T23:53:55.804471+0000","last_fullsized":"2024-09-15T23:53:55.804471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:25:03.906556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799514+0000","last_change":"2024-09-15T23:53:49.724099+0000","last_active":"2024-09-15T23:53:55.799514+0000","last_peered":"2024-09-15T23:53:55.799514+0000","last_clean":"2024-09-15T23:53:55.799514+0000","last_became_active":"2024-09-15T23:53:49.720382+0000","last_became_peered":"2024-09-15T23:53:49.720382+0000","last_unstale":"2024-09-15T23:53:55.799514+0000","last_undegraded":"2024-09-15T23:53:55.799514+0000","last_fullsized":"2024-09-15T23:53:55.799514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:12.046572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335126+0000","last_change":"2024-09-15T23:53:50.772483+0000","last_active":"2024-09-15T23:53:56.335126+0000","last_peered":"2024-09-15T23:53:56.335126+0000","last_clean":"2024-09-15T23:53:56.335126+0000","last_became_active":"2024-09-15T23:53:50.772100+0000","last_became_peered":"2024-09-15T23:53:50.772100+0000","last_unstale":"2024-09-15T23:53:56.335126+0000","last_undegraded":"2024-09-15T23:53:56.335126+0000","last_fullsized":"2024-09-15T23:53:56.335126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:40.820870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336438+0000","last_change":"2024-09-15T23:53:54.834012+0000","last_active":"2024-09-15T23:53:56.336438+0000","last_peered":"2024-09-15T23:53:56.336438+0000","last_clean":"2024-09-15T23:53:56.336438+0000","last_became_active":"2024-09-15T23:53:54.832650+0000","last_became_peered":"2024-09-15T23:53:54.832650+0000","last_unstale":"2024-09-15T23:53:56.336438+0000","last_undegraded":"2024-09-15T23:53:56.336438+0000","last_fullsized":"2024-09-15T23:53:56.336438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:58.849309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804269+0000","last_change":"2024-09-15T23:53:49.727498+0000","last_active":"2024-09-15T23:53:55.804269+0000","last_peered":"2024-09-15T23:53:55.804269+0000","last_clean":"2024-09-15T23:53:55.804269+0000","last_became_active":"2024-09-15T23:53:49.723077+0000","last_became_peered":"2024-09-15T23:53:49.723077+0000","last_unstale":"2024-09-15T23:53:55.804269+0000","last_undegraded":"2024-09-15T23:53:55.804269+0000","last_fullsized":"2024-09-15T23:53:55.804269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:57.542130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332154+0000","last_change":"2024-09-15T23:53:50.761608+0000","last_active":"2024-09-15T23:53:56.332154+0000","last_peered":"2024-09-15T23:53:56.332154+0000","last_clean":"2024-09-15T23:53:56.332154+0000","last_became_active":"2024-09-15T23:53:50.758363+0000","last_became_peered":"2024-09-15T23:53:50.758363+0000","last_unstale":"2024-09-15T23:53:56.332154+0000","last_undegraded":"2024-09-15T23:53:56.332154+0000","last_fullsized":"2024-09-15T23:53:56.332154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335657+0000","last_change":"2024-09-15T23:53:54.841381+0000","last_active":"2024-09-15T23:53:56.335657+0000","last_peered":"2024-09-15T23:53:56.335657+0000","last_clean":"2024-09-15T23:53:56.335657+0000","last_became_active":"2024-09-15T23:53:54.840352+0000","last_became_peered":"2024-09-15T23:53:54.840352+0000","last_unstale":"2024-09-15T23:53:56.335657+0000","last_undegraded":"2024-09-15T23:53:56.335657+0000","last_fullsized":"2024-09-15T23:53:56.335657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:44.904475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332559+0000","last_change":"2024-09-15T23:53:50.768904+0000","last_active":"2024-09-15T23:53:56.332559+0000","last_peered":"2024-09-15T23:53:56.332559+0000","last_clean":"2024-09-15T23:53:56.332559+0000","last_became_active":"2024-09-15T23:53:50.768253+0000","last_became_peered":"2024-09-15T23:53:50.768253+0000","last_unstale":"2024-09-15T23:53:56.332559+0000","last_undegraded":"2024-09-15T23:53:56.332559+0000","last_fullsized":"2024-09-15T23:53:56.332559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:41.573063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335133+0000","last_change":"2024-09-15T23:53:50.776288+0000","last_active":"2024-09-15T23:53:56.335133+0000","last_peered":"2024-09-15T23:53:56.335133+0000","last_clean":"2024-09-15T23:53:56.335133+0000","last_became_active":"2024-09-15T23:53:50.775954+0000","last_became_peered":"2024-09-15T23:53:50.775954+0000","last_unstale":"2024-09-15T23:53:56.335133+0000","last_undegraded":"2024-09-15T23:53:56.335133+0000","last_fullsized":"2024-09-15T23:53:56.335133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.385437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798721+0000","last_change":"2024-09-15T23:53:50.766724+0000","last_active":"2024-09-15T23:53:55.798721+0000","last_peered":"2024-09-15T23:53:55.798721+0000","last_clean":"2024-09-15T23:53:55.798721+0000","last_became_active":"2024-09-15T23:53:50.766294+0000","last_became_peered":"2024-09-15T23:53:50.766294+0000","last_unstale":"2024-09-15T23:53:55.798721+0000","last_undegraded":"2024-09-15T23:53:55.798721+0000","last_fullsized":"2024-09-15T23:53:55.798721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:30.859886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804025+0000","last_change":"2024-09-15T23:53:50.762881+0000","last_active":"2024-09-15T23:53:55.804025+0000","last_peered":"2024-09-15T23:53:55.804025+0000","last_clean":"2024-09-15T23:53:55.804025+0000","last_became_active":"2024-09-15T23:53:50.762510+0000","last_became_peered":"2024-09-15T23:53:50.762510+0000","last_unstale":"2024-09-15T23:53:55.804025+0000","last_undegraded":"2024-09-15T23:53:55.804025+0000","last_fullsized":"2024-09-15T23:53:55.804025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.236567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807695+0000","last_change":"2024-09-15T23:53:50.778010+0000","last_active":"2024-09-15T23:53:55.807695+0000","last_peered":"2024-09-15T23:53:55.807695+0000","last_clean":"2024-09-15T23:53:55.807695+0000","last_became_active":"2024-09-15T23:53:50.777507+0000","last_became_peered":"2024-09-15T23:53:50.777507+0000","last_unstale":"2024-09-15T23:53:55.807695+0000","last_undegraded":"2024-09-15T23:53:55.807695+0000","last_fullsized":"2024-09-15T23:53:55.807695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:35:59.496952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805694+0000","last_change":"2024-09-15T23:53:50.758259+0000","last_active":"2024-09-15T23:53:55.805694+0000","last_peered":"2024-09-15T23:53:55.805694+0000","last_clean":"2024-09-15T23:53:55.805694+0000","last_became_active":"2024-09-15T23:53:50.757961+0000","last_became_peered":"2024-09-15T23:53:50.757961+0000","last_unstale":"2024-09-15T23:53:55.805694+0000","last_undegraded":"2024-09-15T23:53:55.805694+0000","last_fullsized":"2024-09-15T23:53:55.805694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:40.820870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332924+0000","last_change":"2024-09-15T23:53:50.767102+0000","last_active":"2024-09-15T23:53:56.332924+0000","last_peered":"2024-09-15T23:53:56.332924+0000","last_clean":"2024-09-15T23:53:56.332924+0000","last_became_active":"2024-09-15T23:53:50.762579+0000","last_became_peered":"2024-09-15T23:53:50.762579+0000","last_unstale":"2024-09-15T23:53:56.332924+0000","last_undegraded":"2024-09-15T23:53:56.332924+0000","last_fullsized":"2024-09-15T23:53:56.332924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:10.630689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806419+0000","last_change":"2024-09-15T23:53:50.778971+0000","last_active":"2024-09-15T23:53:55.806419+0000","last_peered":"2024-09-15T23:53:55.806419+0000","last_clean":"2024-09-15T23:53:55.806419+0000","last_became_active":"2024-09-15T23:53:50.778504+0000","last_became_peered":"2024-09-15T23:53:50.778504+0000","last_unstale":"2024-09-15T23:53:55.806419+0000","last_undegraded":"2024-09-15T23:53:55.806419+0000","last_fullsized":"2024-09-15T23:53:55.806419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:13.705388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799032+0000","last_change":"2024-09-15T23:53:50.766048+0000","last_active":"2024-09-15T23:53:55.799032+0000","last_peered":"2024-09-15T23:53:55.799032+0000","last_clean":"2024-09-15T23:53:55.799032+0000","last_became_active":"2024-09-15T23:53:50.765747+0000","last_became_peered":"2024-09-15T23:53:50.765747+0000","last_unstale":"2024-09-15T23:53:55.799032+0000","last_undegraded":"2024-09-15T23:53:55.799032+0000","last_fullsized":"2024-09-15T23:53:55.799032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:50.800418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804413+0000","last_change":"2024-09-15T23:53:50.762427+0000","last_active":"2024-09-15T23:53:55.804413+0000","last_peered":"2024-09-15T23:53:55.804413+0000","last_clean":"2024-09-15T23:53:55.804413+0000","last_became_active":"2024-09-15T23:53:50.762044+0000","last_became_peered":"2024-09-15T23:53:50.762044+0000","last_unstale":"2024-09-15T23:53:55.804413+0000","last_undegraded":"2024-09-15T23:53:55.804413+0000","last_fullsized":"2024-09-15T23:53:55.804413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:44.344017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332051+0000","last_change":"2024-09-15T23:53:50.761423+0000","last_active":"2024-09-15T23:53:56.332051+0000","last_peered":"2024-09-15T23:53:56.332051+0000","last_clean":"2024-09-15T23:53:56.332051+0000","last_became_active":"2024-09-15T23:53:50.759524+0000","last_became_peered":"2024-09-15T23:53:50.759524+0000","last_unstale":"2024-09-15T23:53:56.332051+0000","last_undegraded":"2024-09-15T23:53:56.332051+0000","last_fullsized":"2024-09-15T23:53:56.332051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.385437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334830+0000","last_change":"2024-09-15T23:53:50.757892+0000","last_active":"2024-09-15T23:53:56.334830+0000","last_peered":"2024-09-15T23:53:56.334830+0000","last_clean":"2024-09-15T23:53:56.334830+0000","last_became_active":"2024-09-15T23:53:50.757123+0000","last_became_peered":"2024-09-15T23:53:50.757123+0000","last_unstale":"2024-09-15T23:53:56.334830+0000","last_undegraded":"2024-09-15T23:53:56.334830+0000","last_fullsized":"2024-09-15T23:53:56.334830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:15.892900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333812+0000","last_change":"2024-09-15T23:53:50.775664+0000","last_active":"2024-09-15T23:53:56.333812+0000","last_peered":"2024-09-15T23:53:56.333812+0000","last_clean":"2024-09-15T23:53:56.333812+0000","last_became_active":"2024-09-15T23:53:50.774398+0000","last_became_peered":"2024-09-15T23:53:50.774398+0000","last_unstale":"2024-09-15T23:53:56.333812+0000","last_undegraded":"2024-09-15T23:53:56.333812+0000","last_fullsized":"2024-09-15T23:53:56.333812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:01.211047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800852+0000","last_change":"2024-09-15T23:53:50.764281+0000","last_active":"2024-09-15T23:53:55.800852+0000","last_peered":"2024-09-15T23:53:55.800852+0000","last_clean":"2024-09-15T23:53:55.800852+0000","last_became_active":"2024-09-15T23:53:50.763712+0000","last_became_peered":"2024-09-15T23:53:50.763712+0000","last_unstale":"2024-09-15T23:53:55.800852+0000","last_undegraded":"2024-09-15T23:53:55.800852+0000","last_fullsized":"2024-09-15T23:53:55.800852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:27.740625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335860+0000","last_change":"2024-09-15T23:53:50.781321+0000","last_active":"2024-09-15T23:53:56.335860+0000","last_peered":"2024-09-15T23:53:56.335860+0000","last_clean":"2024-09-15T23:53:56.335860+0000","last_became_active":"2024-09-15T23:53:50.781022+0000","last_became_peered":"2024-09-15T23:53:50.781022+0000","last_unstale":"2024-09-15T23:53:56.335860+0000","last_undegraded":"2024-09-15T23:53:56.335860+0000","last_fullsized":"2024-09-15T23:53:56.335860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:10.630689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.801378+0000","last_change":"2024-09-15T23:53:50.773196+0000","last_active":"2024-09-15T23:53:55.801378+0000","last_peered":"2024-09-15T23:53:55.801378+0000","last_clean":"2024-09-15T23:53:55.801378+0000","last_became_active":"2024-09-15T23:53:50.772856+0000","last_became_peered":"2024-09-15T23:53:50.772856+0000","last_unstale":"2024-09-15T23:53:55.801378+0000","last_undegraded":"2024-09-15T23:53:55.801378+0000","last_fullsized":"2024-09-15T23:53:55.801378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:38.917747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798743+0000","last_change":"2024-09-15T23:53:50.770117+0000","last_active":"2024-09-15T23:53:55.798743+0000","last_peered":"2024-09-15T23:53:55.798743+0000","last_clean":"2024-09-15T23:53:55.798743+0000","last_became_active":"2024-09-15T23:53:50.769815+0000","last_became_peered":"2024-09-15T23:53:50.769815+0000","last_unstale":"2024-09-15T23:53:55.798743+0000","last_undegraded":"2024-09-15T23:53:55.798743+0000","last_fullsized":"2024-09-15T23:53:55.798743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:00.830681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804043+0000","last_change":"2024-09-15T23:53:50.776872+0000","last_active":"2024-09-15T23:53:55.804043+0000","last_peered":"2024-09-15T23:53:55.804043+0000","last_clean":"2024-09-15T23:53:55.804043+0000","last_became_active":"2024-09-15T23:53:50.776366+0000","last_became_peered":"2024-09-15T23:53:50.776366+0000","last_unstale":"2024-09-15T23:53:55.804043+0000","last_undegraded":"2024-09-15T23:53:55.804043+0000","last_fullsized":"2024-09-15T23:53:55.804043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:52.879737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804858+0000","last_change":"2024-09-15T23:53:50.762729+0000","last_active":"2024-09-15T23:53:55.804858+0000","last_peered":"2024-09-15T23:53:55.804858+0000","last_clean":"2024-09-15T23:53:55.804858+0000","last_became_active":"2024-09-15T23:53:50.762361+0000","last_became_peered":"2024-09-15T23:53:50.762361+0000","last_unstale":"2024-09-15T23:53:55.804858+0000","last_undegraded":"2024-09-15T23:53:55.804858+0000","last_fullsized":"2024-09-15T23:53:55.804858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:41.573063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806250+0000","last_change":"2024-09-15T23:53:50.768317+0000","last_active":"2024-09-15T23:53:55.806250+0000","last_peered":"2024-09-15T23:53:55.806250+0000","last_clean":"2024-09-15T23:53:55.806250+0000","last_became_active":"2024-09-15T23:53:50.767995+0000","last_became_peered":"2024-09-15T23:53:50.767995+0000","last_unstale":"2024-09-15T23:53:55.806250+0000","last_undegraded":"2024-09-15T23:53:55.806250+0000","last_fullsized":"2024-09-15T23:53:55.806250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:05.877077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333768+0000","last_change":"2024-09-15T23:53:50.776156+0000","last_active":"2024-09-15T23:53:56.333768+0000","last_peered":"2024-09-15T23:53:56.333768+0000","last_clean":"2024-09-15T23:53:56.333768+0000","last_became_active":"2024-09-15T23:53:50.775104+0000","last_became_peered":"2024-09-15T23:53:50.775104+0000","last_unstale":"2024-09-15T23:53:56.333768+0000","last_undegraded":"2024-09-15T23:53:56.333768+0000","last_fullsized":"2024-09-15T23:53:56.333768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:49.338954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334206+0000","last_change":"2024-09-15T23:53:50.773302+0000","last_active":"2024-09-15T23:53:56.334206+0000","last_peered":"2024-09-15T23:53:56.334206+0000","last_clean":"2024-09-15T23:53:56.334206+0000","last_became_active":"2024-09-15T23:53:50.772762+0000","last_became_peered":"2024-09-15T23:53:50.772762+0000","last_unstale":"2024-09-15T23:53:56.334206+0000","last_undegraded":"2024-09-15T23:53:56.334206+0000","last_fullsized":"2024-09-15T23:53:56.334206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:03.053120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334419+0000","last_change":"2024-09-15T23:53:50.766371+0000","last_active":"2024-09-15T23:53:56.334419+0000","last_peered":"2024-09-15T23:53:56.334419+0000","last_clean":"2024-09-15T23:53:56.334419+0000","last_became_active":"2024-09-15T23:53:50.766003+0000","last_became_peered":"2024-09-15T23:53:50.766003+0000","last_unstale":"2024-09-15T23:53:56.334419+0000","last_undegraded":"2024-09-15T23:53:56.334419+0000","last_fullsized":"2024-09-15T23:53:56.334419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:57.559108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332748+0000","last_change":"2024-09-15T23:53:50.772968+0000","last_active":"2024-09-15T23:53:56.332748+0000","last_peered":"2024-09-15T23:53:56.332748+0000","last_clean":"2024-09-15T23:53:56.332748+0000","last_became_active":"2024-09-15T23:53:50.771984+0000","last_became_peered":"2024-09-15T23:53:50.771984+0000","last_unstale":"2024-09-15T23:53:56.332748+0000","last_undegraded":"2024-09-15T23:53:56.332748+0000","last_fullsized":"2024-09-15T23:53:56.332748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:48.894933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803087+0000","last_change":"2024-09-15T23:53:50.775398+0000","last_active":"2024-09-15T23:53:55.803087+0000","last_peered":"2024-09-15T23:53:55.803087+0000","last_clean":"2024-09-15T23:53:55.803087+0000","last_became_active":"2024-09-15T23:53:50.775094+0000","last_became_peered":"2024-09-15T23:53:50.775094+0000","last_unstale":"2024-09-15T23:53:55.803087+0000","last_undegraded":"2024-09-15T23:53:55.803087+0000","last_fullsized":"2024-09-15T23:53:55.803087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:29.418106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333184+0000","last_change":"2024-09-15T23:53:50.760721+0000","last_active":"2024-09-15T23:53:56.333184+0000","last_peered":"2024-09-15T23:53:56.333184+0000","last_clean":"2024-09-15T23:53:56.333184+0000","last_became_active":"2024-09-15T23:53:50.760251+0000","last_became_peered":"2024-09-15T23:53:50.760251+0000","last_unstale":"2024-09-15T23:53:56.333184+0000","last_undegraded":"2024-09-15T23:53:56.333184+0000","last_fullsized":"2024-09-15T23:53:56.333184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:30.884230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331847+0000","last_change":"2024-09-15T23:53:50.760673+0000","last_active":"2024-09-15T23:53:56.331847+0000","last_peered":"2024-09-15T23:53:56.331847+0000","last_clean":"2024-09-15T23:53:56.331847+0000","last_became_active":"2024-09-15T23:53:50.760164+0000","last_became_peered":"2024-09-15T23:53:50.760164+0000","last_unstale":"2024-09-15T23:53:56.331847+0000","last_undegraded":"2024-09-15T23:53:56.331847+0000","last_fullsized":"2024-09-15T23:53:56.331847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.385437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333521+0000","last_change":"2024-09-15T23:53:50.766752+0000","last_active":"2024-09-15T23:53:56.333521+0000","last_peered":"2024-09-15T23:53:56.333521+0000","last_clean":"2024-09-15T23:53:56.333521+0000","last_became_active":"2024-09-15T23:53:50.766370+0000","last_became_peered":"2024-09-15T23:53:50.766370+0000","last_unstale":"2024-09-15T23:53:56.333521+0000","last_undegraded":"2024-09-15T23:53:56.333521+0000","last_fullsized":"2024-09-15T23:53:56.333521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:21.225015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332124+0000","last_change":"2024-09-15T23:53:50.778292+0000","last_active":"2024-09-15T23:53:56.332124+0000","last_peered":"2024-09-15T23:53:56.332124+0000","last_clean":"2024-09-15T23:53:56.332124+0000","last_became_active":"2024-09-15T23:53:50.777039+0000","last_became_peered":"2024-09-15T23:53:50.777039+0000","last_unstale":"2024-09-15T23:53:56.332124+0000","last_undegraded":"2024-09-15T23:53:56.332124+0000","last_fullsized":"2024-09-15T23:53:56.332124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805410+0000","last_change":"2024-09-15T23:53:50.771054+0000","last_active":"2024-09-15T23:53:55.805410+0000","last_peered":"2024-09-15T23:53:55.805410+0000","last_clean":"2024-09-15T23:53:55.805410+0000","last_became_active":"2024-09-15T23:53:50.770590+0000","last_became_peered":"2024-09-15T23:53:50.770590+0000","last_unstale":"2024-09-15T23:53:55.805410+0000","last_undegraded":"2024-09-15T23:53:55.805410+0000","last_fullsized":"2024-09-15T23:53:55.805410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:49.569731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805743+0000","last_change":"2024-09-15T23:53:50.769203+0000","last_active":"2024-09-15T23:53:55.805743+0000","last_peered":"2024-09-15T23:53:55.805743+0000","last_clean":"2024-09-15T23:53:55.805743+0000","last_became_active":"2024-09-15T23:53:50.768887+0000","last_became_peered":"2024-09-15T23:53:50.768887+0000","last_unstale":"2024-09-15T23:53:55.805743+0000","last_undegraded":"2024-09-15T23:53:55.805743+0000","last_fullsized":"2024-09-15T23:53:55.805743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:19.928453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333350+0000","last_change":"2024-09-15T23:53:50.766909+0000","last_active":"2024-09-15T23:53:56.333350+0000","last_peered":"2024-09-15T23:53:56.333350+0000","last_clean":"2024-09-15T23:53:56.333350+0000","last_became_active":"2024-09-15T23:53:50.766411+0000","last_became_peered":"2024-09-15T23:53:50.766411+0000","last_unstale":"2024-09-15T23:53:56.333350+0000","last_undegraded":"2024-09-15T23:53:56.333350+0000","last_fullsized":"2024-09-15T23:53:56.333350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:14.331012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":106766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":111282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":107348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":110610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":868352,"data_stored":697204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":697226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:54:05.326 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:54:05.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f66830640 1 Processor -- start 2024-09-15T23:54:05.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f66830640 1 -- start start 2024-09-15T23:54:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f66830640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5f6015c2a0 0x7f5f600aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f66830640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f600af2a0 0x7f5f6006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f66830640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f600b3290 con 0x7f5f6015bec0 2024-09-15T23:54:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f66830640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5f600b3570 con 0x7f5f6015c2a0 2024-09-15T23:54:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f66830640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5f600b3850 con 0x7f5f600af2a0 2024-09-15T23:54:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f5f7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5f6015c2a0 0x7f5f600aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f5f7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5f6015c2a0 0x7f5f600aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57384/0 (socket says 172.21.15.112:57384) 2024-09-15T23:54:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f5f7fe640 1 -- 172.21.15.112:0/1036020984 learned_addr learned my addr 172.21.15.112:0/1036020984 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f64dcd640 1 --2- 172.21.15.112:0/1036020984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f600af2a0 0x7f5f6006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f5f7fe640 1 -- 172.21.15.112:0/1036020984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f600af2a0 msgr2=0x7f5f6006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f5f7fe640 1 --2- 172.21.15.112:0/1036020984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f600af2a0 0x7f5f6006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f5f7fe640 1 -- 172.21.15.112:0/1036020984 >> v1:172.21.15.169:6789/0 conn(0x7f5f6015bec0 legacy=0x7f5f600ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f5f7fe640 1 -- 172.21.15.112:0/1036020984 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f600b3b30 con 0x7f5f6015c2a0 2024-09-15T23:54:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.473+0000 7f5f64dcd640 1 --2- 172.21.15.112:0/1036020984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f600af2a0 0x7f5f6006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:05.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f5f7fe640 1 --2- 172.21.15.112:0/1036020984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6015c2a0 0x7f5f600aed60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009870 tx=0x7f5f5401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a3c5935b73a810 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:05.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f5effd640 1 -- 172.21.15.112:0/1036020984 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f540aa610 con 0x7f5f6015c2a0 2024-09-15T23:54:05.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f5effd640 1 -- 172.21.15.112:0/1036020984 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f540af070 con 0x7f5f6015c2a0 2024-09-15T23:54:05.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f5effd640 1 -- 172.21.15.112:0/1036020984 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f540aa9d0 con 0x7f5f6015c2a0 2024-09-15T23:54:05.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 -- 172.21.15.112:0/1036020984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6015c2a0 msgr2=0x7f5f600aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 --2- 172.21.15.112:0/1036020984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6015c2a0 0x7f5f600aed60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009870 tx=0x7f5f5401c4f0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 -- 172.21.15.112:0/1036020984 shutdown_connections 2024-09-15T23:54:05.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 --2- 172.21.15.112:0/1036020984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f600af2a0 0x7f5f6006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 --2- 172.21.15.112:0/1036020984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6015c2a0 0x7f5f600aed60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 -- 172.21.15.112:0/1036020984 >> 172.21.15.112:0/1036020984 conn(0x7f5f600b1f90 msgr2=0x7f5f600b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:05.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 -- 172.21.15.112:0/1036020984 shutdown_connections 2024-09-15T23:54:05.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 -- 172.21.15.112:0/1036020984 wait complete. 2024-09-15T23:54:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 Processor -- start 2024-09-15T23:54:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 -- start start 2024-09-15T23:54:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f600af2a0 0x7f5f60164000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f6015bec0 0x7f5f601520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6015c2a0 0x7f5f6014b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6006ed50 con 0x7f5f6015c2a0 2024-09-15T23:54:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5f600af6b0 con 0x7f5f600af2a0 2024-09-15T23:54:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f66830640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5f6006eed0 con 0x7f5f6015bec0 2024-09-15T23:54:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f64dcd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6015c2a0 0x7f5f6014b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f64dcd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6015c2a0 0x7f5f6014b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57394/0 (socket says 172.21.15.112:57394) 2024-09-15T23:54:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f64dcd640 1 -- 172.21.15.112:0/751863551 learned_addr learned my addr 172.21.15.112:0/751863551 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f5f7fe640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f6015bec0 0x7f5f601520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f5ffff640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f600af2a0 0x7f5f60164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f64dcd640 1 -- 172.21.15.112:0/751863551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f6015bec0 msgr2=0x7f5f601520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f64dcd640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f6015bec0 0x7f5f601520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f64dcd640 1 -- 172.21.15.112:0/751863551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f600af2a0 msgr2=0x7f5f60164000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f64dcd640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f600af2a0 0x7f5f60164000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f64dcd640 1 -- 172.21.15.112:0/751863551 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f60156670 con 0x7f5f6015c2a0 2024-09-15T23:54:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.477+0000 7f5f5ffff640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f600af2a0 0x7f5f60164000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.481+0000 7f5f64dcd640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6015c2a0 0x7f5f6014b520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800c7f0 tx=0x7f5f5800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.481+0000 7f5f5cff9640 1 -- 172.21.15.112:0/751863551 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58015070 con 0x7f5f6015c2a0 2024-09-15T23:54:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.481+0000 7f5f5cff9640 1 -- 172.21.15.112:0/751863551 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f58007860 con 0x7f5f6015c2a0 2024-09-15T23:54:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.481+0000 7f5f66830640 1 -- 172.21.15.112:0/751863551 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f60071fb0 con 0x7f5f6015c2a0 2024-09-15T23:54:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.481+0000 7f5f5cff9640 1 -- 172.21.15.112:0/751863551 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58007c50 con 0x7f5f6015c2a0 2024-09-15T23:54:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.481+0000 7f5f66830640 1 -- 172.21.15.112:0/751863551 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f60156950 con 0x7f5f6015c2a0 2024-09-15T23:54:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.481+0000 7f5f66830640 1 -- 172.21.15.112:0/751863551 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f6006e000 con 0x7f5f6015c2a0 2024-09-15T23:54:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.481+0000 7f5f5cff9640 1 -- 172.21.15.112:0/751863551 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f58018070 con 0x7f5f6015c2a0 2024-09-15T23:54:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.481+0000 7f5f5cff9640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5f4c0678c0 0x7f5f4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.481+0000 7f5f5ffff640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5f4c0678c0 0x7f5f4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.481+0000 7f5f5cff9640 1 -- 172.21.15.112:0/751863551 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5f58086100 con 0x7f5f6015c2a0 2024-09-15T23:54:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.481+0000 7f5f5ffff640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5f4c0678c0 0x7f5f4c069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5f50007fd0 tx=0x7f5f50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:05.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.485+0000 7f5f5cff9640 1 -- 172.21.15.112:0/751863551 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5f58056990 con 0x7f5f6015c2a0 2024-09-15T23:54:05.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.645+0000 7f5f66830640 1 -- 172.21.15.112:0/751863551 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f60166dd0 con 0x7f5f4c0678c0 2024-09-15T23:54:05.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.657+0000 7f5f5cff9640 1 -- 172.21.15.112:0/751863551 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332554 (secure 0 0 0) 0x7f5f60166dd0 con 0x7f5f4c0678c0 2024-09-15T23:54:05.661 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:05.664 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:54:05.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.661+0000 7f5f66830640 1 -- 172.21.15.112:0/751863551 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5f4c0678c0 msgr2=0x7f5f4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.661+0000 7f5f66830640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5f4c0678c0 0x7f5f4c069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5f50007fd0 tx=0x7f5f50009040 comp rx=0 tx=0).stop 2024-09-15T23:54:05.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.661+0000 7f5f66830640 1 -- 172.21.15.112:0/751863551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6015c2a0 msgr2=0x7f5f6014b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.661+0000 7f5f66830640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6015c2a0 0x7f5f6014b520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800c7f0 tx=0x7f5f5800ccb0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.661+0000 7f5f66830640 1 -- 172.21.15.112:0/751863551 shutdown_connections 2024-09-15T23:54:05.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.661+0000 7f5f66830640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5f4c0678c0 0x7f5f4c069d80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.661+0000 7f5f66830640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f6015c2a0 0x7f5f6014b520 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.661+0000 7f5f66830640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f6015bec0 0x7f5f601520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.661+0000 7f5f66830640 1 --2- 172.21.15.112:0/751863551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f600af2a0 0x7f5f60164000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.661+0000 7f5f66830640 1 -- 172.21.15.112:0/751863551 >> 172.21.15.112:0/751863551 conn(0x7f5f600b1f90 msgr2=0x7f5f600b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:05.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.661+0000 7f5f66830640 1 -- 172.21.15.112:0/751863551 shutdown_connections 2024-09-15T23:54:05.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.661+0000 7f5f66830640 1 -- 172.21.15.112:0/751863551 wait complete. 2024-09-15T23:54:05.681 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-15T23:54:05.235841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219572,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755148,"statfs":{"total":773094113280,"available":772869271552,"internally_reserved":0,"allocated":3416064,"data_stored":2044148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002985"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.337336+0000","last_change":"2024-09-15T23:53:49.717934+0000","last_active":"2024-09-15T23:53:56.337336+0000","last_peered":"2024-09-15T23:53:56.337336+0000","last_clean":"2024-09-15T23:53:56.337336+0000","last_became_active":"2024-09-15T23:53:49.714475+0000","last_became_peered":"2024-09-15T23:53:49.714475+0000","last_unstale":"2024-09-15T23:53:56.337336+0000","last_undegraded":"2024-09-15T23:53:56.337336+0000","last_fullsized":"2024-09-15T23:53:56.337336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:32.423155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806022+0000","last_change":"2024-09-15T23:53:50.763869+0000","last_active":"2024-09-15T23:53:55.806022+0000","last_peered":"2024-09-15T23:53:55.806022+0000","last_clean":"2024-09-15T23:53:55.806022+0000","last_became_active":"2024-09-15T23:53:50.763518+0000","last_became_peered":"2024-09-15T23:53:50.763518+0000","last_unstale":"2024-09-15T23:53:55.806022+0000","last_undegraded":"2024-09-15T23:53:55.806022+0000","last_fullsized":"2024-09-15T23:53:55.806022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:47.362321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334847+0000","last_change":"2024-09-15T23:53:54.833331+0000","last_active":"2024-09-15T23:53:56.334847+0000","last_peered":"2024-09-15T23:53:56.334847+0000","last_clean":"2024-09-15T23:53:56.334847+0000","last_became_active":"2024-09-15T23:53:54.832469+0000","last_became_peered":"2024-09-15T23:53:54.832469+0000","last_unstale":"2024-09-15T23:53:56.334847+0000","last_undegraded":"2024-09-15T23:53:56.334847+0000","last_fullsized":"2024-09-15T23:53:56.334847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:19.976505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806573+0000","last_change":"2024-09-15T23:53:49.732960+0000","last_active":"2024-09-15T23:53:55.806573+0000","last_peered":"2024-09-15T23:53:55.806573+0000","last_clean":"2024-09-15T23:53:55.806573+0000","last_became_active":"2024-09-15T23:53:49.728314+0000","last_became_peered":"2024-09-15T23:53:49.728314+0000","last_unstale":"2024-09-15T23:53:55.806573+0000","last_undegraded":"2024-09-15T23:53:55.806573+0000","last_fullsized":"2024-09-15T23:53:55.806573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:41.274907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807049+0000","last_change":"2024-09-15T23:53:50.778808+0000","last_active":"2024-09-15T23:53:55.807049+0000","last_peered":"2024-09-15T23:53:55.807049+0000","last_clean":"2024-09-15T23:53:55.807049+0000","last_became_active":"2024-09-15T23:53:50.778102+0000","last_became_peered":"2024-09-15T23:53:50.778102+0000","last_unstale":"2024-09-15T23:53:55.807049+0000","last_undegraded":"2024-09-15T23:53:55.807049+0000","last_fullsized":"2024-09-15T23:53:55.807049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:59:38.443508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331942+0000","last_change":"2024-09-15T23:53:54.829460+0000","last_active":"2024-09-15T23:53:56.331942+0000","last_peered":"2024-09-15T23:53:56.331942+0000","last_clean":"2024-09-15T23:53:56.331942+0000","last_became_active":"2024-09-15T23:53:54.828410+0000","last_became_peered":"2024-09-15T23:53:54.828410+0000","last_unstale":"2024-09-15T23:53:56.331942+0000","last_undegraded":"2024-09-15T23:53:56.331942+0000","last_fullsized":"2024-09-15T23:53:56.331942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:01.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334332+0000","last_change":"2024-09-15T23:53:49.709773+0000","last_active":"2024-09-15T23:53:56.334332+0000","last_peered":"2024-09-15T23:53:56.334332+0000","last_clean":"2024-09-15T23:53:56.334332+0000","last_became_active":"2024-09-15T23:53:49.706868+0000","last_became_peered":"2024-09-15T23:53:49.706868+0000","last_unstale":"2024-09-15T23:53:56.334332+0000","last_undegraded":"2024-09-15T23:53:56.334332+0000","last_fullsized":"2024-09-15T23:53:56.334332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:30.316273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332457+0000","last_change":"2024-09-15T23:53:50.774606+0000","last_active":"2024-09-15T23:53:56.332457+0000","last_peered":"2024-09-15T23:53:56.332457+0000","last_clean":"2024-09-15T23:53:56.332457+0000","last_became_active":"2024-09-15T23:53:50.774322+0000","last_became_peered":"2024-09-15T23:53:50.774322+0000","last_unstale":"2024-09-15T23:53:56.332457+0000","last_undegraded":"2024-09-15T23:53:56.332457+0000","last_fullsized":"2024-09-15T23:53:56.332457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:10.630689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331636+0000","last_change":"2024-09-15T23:53:54.826698+0000","last_active":"2024-09-15T23:53:56.331636+0000","last_peered":"2024-09-15T23:53:56.331636+0000","last_clean":"2024-09-15T23:53:56.331636+0000","last_became_active":"2024-09-15T23:53:54.826082+0000","last_became_peered":"2024-09-15T23:53:54.826082+0000","last_unstale":"2024-09-15T23:53:56.331636+0000","last_undegraded":"2024-09-15T23:53:56.331636+0000","last_fullsized":"2024-09-15T23:53:56.331636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:34.967835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334036+0000","last_change":"2024-09-15T23:53:49.728958+0000","last_active":"2024-09-15T23:53:56.334036+0000","last_peered":"2024-09-15T23:53:56.334036+0000","last_clean":"2024-09-15T23:53:56.334036+0000","last_became_active":"2024-09-15T23:53:49.728518+0000","last_became_peered":"2024-09-15T23:53:49.728518+0000","last_unstale":"2024-09-15T23:53:56.334036+0000","last_undegraded":"2024-09-15T23:53:56.334036+0000","last_fullsized":"2024-09-15T23:53:56.334036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:14.375412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800310+0000","last_change":"2024-09-15T23:53:50.774805+0000","last_active":"2024-09-15T23:53:55.800310+0000","last_peered":"2024-09-15T23:53:55.800310+0000","last_clean":"2024-09-15T23:53:55.800310+0000","last_became_active":"2024-09-15T23:53:50.774139+0000","last_became_peered":"2024-09-15T23:53:50.774139+0000","last_unstale":"2024-09-15T23:53:55.800310+0000","last_undegraded":"2024-09-15T23:53:55.800310+0000","last_fullsized":"2024-09-15T23:53:55.800310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:14.717753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331537+0000","last_change":"2024-09-15T23:53:54.838942+0000","last_active":"2024-09-15T23:53:56.331537+0000","last_peered":"2024-09-15T23:53:56.331537+0000","last_clean":"2024-09-15T23:53:56.331537+0000","last_became_active":"2024-09-15T23:53:54.838537+0000","last_became_peered":"2024-09-15T23:53:54.838537+0000","last_unstale":"2024-09-15T23:53:56.331537+0000","last_undegraded":"2024-09-15T23:53:56.331537+0000","last_fullsized":"2024-09-15T23:53:56.331537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:21.696119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799206+0000","last_change":"2024-09-15T23:53:50.762649+0000","last_active":"2024-09-15T23:53:55.799206+0000","last_peered":"2024-09-15T23:53:55.799206+0000","last_clean":"2024-09-15T23:53:55.799206+0000","last_became_active":"2024-09-15T23:53:50.762376+0000","last_became_peered":"2024-09-15T23:53:50.762376+0000","last_unstale":"2024-09-15T23:53:55.799206+0000","last_undegraded":"2024-09-15T23:53:55.799206+0000","last_fullsized":"2024-09-15T23:53:55.799206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:27.451893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799258+0000","last_change":"2024-09-15T23:53:49.707629+0000","last_active":"2024-09-15T23:53:55.799258+0000","last_peered":"2024-09-15T23:53:55.799258+0000","last_clean":"2024-09-15T23:53:55.799258+0000","last_became_active":"2024-09-15T23:53:49.706615+0000","last_became_peered":"2024-09-15T23:53:49.706615+0000","last_unstale":"2024-09-15T23:53:55.799258+0000","last_undegraded":"2024-09-15T23:53:55.799258+0000","last_fullsized":"2024-09-15T23:53:55.799258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:25.059449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799393+0000","last_change":"2024-09-15T23:53:54.831019+0000","last_active":"2024-09-15T23:53:55.799393+0000","last_peered":"2024-09-15T23:53:55.799393+0000","last_clean":"2024-09-15T23:53:55.799393+0000","last_became_active":"2024-09-15T23:53:54.830461+0000","last_became_peered":"2024-09-15T23:53:54.830461+0000","last_unstale":"2024-09-15T23:53:55.799393+0000","last_undegraded":"2024-09-15T23:53:55.799393+0000","last_fullsized":"2024-09-15T23:53:55.799393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:11.816336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336067+0000","last_change":"2024-09-15T23:53:50.769836+0000","last_active":"2024-09-15T23:53:56.336067+0000","last_peered":"2024-09-15T23:53:56.336067+0000","last_clean":"2024-09-15T23:53:56.336067+0000","last_became_active":"2024-09-15T23:53:50.769317+0000","last_became_peered":"2024-09-15T23:53:50.769317+0000","last_unstale":"2024-09-15T23:53:56.336067+0000","last_undegraded":"2024-09-15T23:53:56.336067+0000","last_fullsized":"2024-09-15T23:53:56.336067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805160+0000","last_change":"2024-09-15T23:53:49.724446+0000","last_active":"2024-09-15T23:53:55.805160+0000","last_peered":"2024-09-15T23:53:55.805160+0000","last_clean":"2024-09-15T23:53:55.805160+0000","last_became_active":"2024-09-15T23:53:49.723722+0000","last_became_peered":"2024-09-15T23:53:49.723722+0000","last_unstale":"2024-09-15T23:53:55.805160+0000","last_undegraded":"2024-09-15T23:53:55.805160+0000","last_fullsized":"2024-09-15T23:53:55.805160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:55.009643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333927+0000","last_change":"2024-09-15T23:53:54.827261+0000","last_active":"2024-09-15T23:53:56.333927+0000","last_peered":"2024-09-15T23:53:56.333927+0000","last_clean":"2024-09-15T23:53:56.333927+0000","last_became_active":"2024-09-15T23:53:54.826675+0000","last_became_peered":"2024-09-15T23:53:54.826675+0000","last_unstale":"2024-09-15T23:53:56.333927+0000","last_undegraded":"2024-09-15T23:53:56.333927+0000","last_fullsized":"2024-09-15T23:53:56.333927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:05.187892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334092+0000","last_change":"2024-09-15T23:53:50.758381+0000","last_active":"2024-09-15T23:53:56.334092+0000","last_peered":"2024-09-15T23:53:56.334092+0000","last_clean":"2024-09-15T23:53:56.334092+0000","last_became_active":"2024-09-15T23:53:50.757608+0000","last_became_peered":"2024-09-15T23:53:50.757608+0000","last_unstale":"2024-09-15T23:53:56.334092+0000","last_undegraded":"2024-09-15T23:53:56.334092+0000","last_fullsized":"2024-09-15T23:53:56.334092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:05.877077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335894+0000","last_change":"2024-09-15T23:53:49.722069+0000","last_active":"2024-09-15T23:53:56.335894+0000","last_peered":"2024-09-15T23:53:56.335894+0000","last_clean":"2024-09-15T23:53:56.335894+0000","last_became_active":"2024-09-15T23:53:49.721311+0000","last_became_peered":"2024-09-15T23:53:49.721311+0000","last_unstale":"2024-09-15T23:53:56.335894+0000","last_undegraded":"2024-09-15T23:53:56.335894+0000","last_fullsized":"2024-09-15T23:53:56.335894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:54.905896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336379+0000","last_change":"2024-09-15T23:53:54.834211+0000","last_active":"2024-09-15T23:53:56.336379+0000","last_peered":"2024-09-15T23:53:56.336379+0000","last_clean":"2024-09-15T23:53:56.336379+0000","last_became_active":"2024-09-15T23:53:54.832649+0000","last_became_peered":"2024-09-15T23:53:54.832649+0000","last_unstale":"2024-09-15T23:53:56.336379+0000","last_undegraded":"2024-09-15T23:53:56.336379+0000","last_fullsized":"2024-09-15T23:53:56.336379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:15.794176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798634+0000","last_change":"2024-09-15T23:53:50.765134+0000","last_active":"2024-09-15T23:53:55.798634+0000","last_peered":"2024-09-15T23:53:55.798634+0000","last_clean":"2024-09-15T23:53:55.798634+0000","last_became_active":"2024-09-15T23:53:50.764730+0000","last_became_peered":"2024-09-15T23:53:50.764730+0000","last_unstale":"2024-09-15T23:53:55.798634+0000","last_undegraded":"2024-09-15T23:53:55.798634+0000","last_fullsized":"2024-09-15T23:53:55.798634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:59.810140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332903+0000","last_change":"2024-09-15T23:53:49.705844+0000","last_active":"2024-09-15T23:53:56.332903+0000","last_peered":"2024-09-15T23:53:56.332903+0000","last_clean":"2024-09-15T23:53:56.332903+0000","last_became_active":"2024-09-15T23:53:49.705408+0000","last_became_peered":"2024-09-15T23:53:49.705408+0000","last_unstale":"2024-09-15T23:53:56.332903+0000","last_undegraded":"2024-09-15T23:53:56.332903+0000","last_fullsized":"2024-09-15T23:53:56.332903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.829837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332277+0000","last_change":"2024-09-15T23:53:54.832183+0000","last_active":"2024-09-15T23:53:56.332277+0000","last_peered":"2024-09-15T23:53:56.332277+0000","last_clean":"2024-09-15T23:53:56.332277+0000","last_became_active":"2024-09-15T23:53:54.831797+0000","last_became_peered":"2024-09-15T23:53:54.831797+0000","last_unstale":"2024-09-15T23:53:56.332277+0000","last_undegraded":"2024-09-15T23:53:56.332277+0000","last_fullsized":"2024-09-15T23:53:56.332277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:05.294652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336702+0000","last_change":"2024-09-15T23:53:50.760086+0000","last_active":"2024-09-15T23:53:56.336702+0000","last_peered":"2024-09-15T23:53:56.336702+0000","last_clean":"2024-09-15T23:53:56.336702+0000","last_became_active":"2024-09-15T23:53:50.759518+0000","last_became_peered":"2024-09-15T23:53:50.759518+0000","last_unstale":"2024-09-15T23:53:56.336702+0000","last_undegraded":"2024-09-15T23:53:56.336702+0000","last_fullsized":"2024-09-15T23:53:56.336702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:49.338954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.801439+0000","last_change":"2024-09-15T23:53:49.712525+0000","last_active":"2024-09-15T23:53:55.801439+0000","last_peered":"2024-09-15T23:53:55.801439+0000","last_clean":"2024-09-15T23:53:55.801439+0000","last_became_active":"2024-09-15T23:53:49.711958+0000","last_became_peered":"2024-09-15T23:53:49.711958+0000","last_unstale":"2024-09-15T23:53:55.801439+0000","last_undegraded":"2024-09-15T23:53:55.801439+0000","last_fullsized":"2024-09-15T23:53:55.801439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:29.249885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331564+0000","last_change":"2024-09-15T23:53:54.820216+0000","last_active":"2024-09-15T23:53:56.331564+0000","last_peered":"2024-09-15T23:53:56.331564+0000","last_clean":"2024-09-15T23:53:56.331564+0000","last_became_active":"2024-09-15T23:53:54.819642+0000","last_became_peered":"2024-09-15T23:53:54.819642+0000","last_unstale":"2024-09-15T23:53:56.331564+0000","last_undegraded":"2024-09-15T23:53:56.331564+0000","last_fullsized":"2024-09-15T23:53:56.331564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:58.670287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.337164+0000","last_change":"2024-09-15T23:53:50.764624+0000","last_active":"2024-09-15T23:53:56.337164+0000","last_peered":"2024-09-15T23:53:56.337164+0000","last_clean":"2024-09-15T23:53:56.337164+0000","last_became_active":"2024-09-15T23:53:50.764271+0000","last_became_peered":"2024-09-15T23:53:50.764271+0000","last_unstale":"2024-09-15T23:53:56.337164+0000","last_undegraded":"2024-09-15T23:53:56.337164+0000","last_fullsized":"2024-09-15T23:53:56.337164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:11.898034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336935+0000","last_change":"2024-09-15T23:53:49.722266+0000","last_active":"2024-09-15T23:53:56.336935+0000","last_peered":"2024-09-15T23:53:56.336935+0000","last_clean":"2024-09-15T23:53:56.336935+0000","last_became_active":"2024-09-15T23:53:49.721470+0000","last_became_peered":"2024-09-15T23:53:49.721470+0000","last_unstale":"2024-09-15T23:53:56.336935+0000","last_undegraded":"2024-09-15T23:53:56.336935+0000","last_fullsized":"2024-09-15T23:53:56.336935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:45.659637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334216+0000","last_change":"2024-09-15T23:53:54.818192+0000","last_active":"2024-09-15T23:53:56.334216+0000","last_peered":"2024-09-15T23:53:56.334216+0000","last_clean":"2024-09-15T23:53:56.334216+0000","last_became_active":"2024-09-15T23:53:54.817117+0000","last_became_peered":"2024-09-15T23:53:54.817117+0000","last_unstale":"2024-09-15T23:53:56.334216+0000","last_undegraded":"2024-09-15T23:53:56.334216+0000","last_fullsized":"2024-09-15T23:53:56.334216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:18.414617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807739+0000","last_change":"2024-09-15T23:53:50.753210+0000","last_active":"2024-09-15T23:53:55.807739+0000","last_peered":"2024-09-15T23:53:55.807739+0000","last_clean":"2024-09-15T23:53:55.807739+0000","last_became_active":"2024-09-15T23:53:50.752491+0000","last_became_peered":"2024-09-15T23:53:50.752491+0000","last_unstale":"2024-09-15T23:53:55.807739+0000","last_undegraded":"2024-09-15T23:53:55.807739+0000","last_fullsized":"2024-09-15T23:53:55.807739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:15.892900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.801158+0000","last_change":"2024-09-15T23:53:49.717089+0000","last_active":"2024-09-15T23:53:55.801158+0000","last_peered":"2024-09-15T23:53:55.801158+0000","last_clean":"2024-09-15T23:53:55.801158+0000","last_became_active":"2024-09-15T23:53:49.715862+0000","last_became_peered":"2024-09-15T23:53:49.715862+0000","last_unstale":"2024-09-15T23:53:55.801158+0000","last_undegraded":"2024-09-15T23:53:55.801158+0000","last_fullsized":"2024-09-15T23:53:55.801158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:49.721033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805363+0000","last_change":"2024-09-15T23:53:54.831979+0000","last_active":"2024-09-15T23:53:55.805363+0000","last_peered":"2024-09-15T23:53:55.805363+0000","last_clean":"2024-09-15T23:53:55.805363+0000","last_became_active":"2024-09-15T23:53:54.830505+0000","last_became_peered":"2024-09-15T23:53:54.830505+0000","last_unstale":"2024-09-15T23:53:55.805363+0000","last_undegraded":"2024-09-15T23:53:55.805363+0000","last_fullsized":"2024-09-15T23:53:55.805363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:58.670287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332157+0000","last_change":"2024-09-15T23:53:50.769317+0000","last_active":"2024-09-15T23:53:56.332157+0000","last_peered":"2024-09-15T23:53:56.332157+0000","last_clean":"2024-09-15T23:53:56.332157+0000","last_became_active":"2024-09-15T23:53:50.768788+0000","last_became_peered":"2024-09-15T23:53:50.768788+0000","last_unstale":"2024-09-15T23:53:56.332157+0000","last_undegraded":"2024-09-15T23:53:56.332157+0000","last_fullsized":"2024-09-15T23:53:56.332157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:55.915920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805063+0000","last_change":"2024-09-15T23:53:49.734159+0000","last_active":"2024-09-15T23:53:55.805063+0000","last_peered":"2024-09-15T23:53:55.805063+0000","last_clean":"2024-09-15T23:53:55.805063+0000","last_became_active":"2024-09-15T23:53:49.733298+0000","last_became_peered":"2024-09-15T23:53:49.733298+0000","last_unstale":"2024-09-15T23:53:55.805063+0000","last_undegraded":"2024-09-15T23:53:55.805063+0000","last_fullsized":"2024-09-15T23:53:55.805063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:25.932592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803370+0000","last_change":"2024-09-15T23:53:54.843329+0000","last_active":"2024-09-15T23:53:55.803370+0000","last_peered":"2024-09-15T23:53:55.803370+0000","last_clean":"2024-09-15T23:53:55.803370+0000","last_became_active":"2024-09-15T23:53:54.838912+0000","last_became_peered":"2024-09-15T23:53:54.838912+0000","last_unstale":"2024-09-15T23:53:55.803370+0000","last_undegraded":"2024-09-15T23:53:55.803370+0000","last_fullsized":"2024-09-15T23:53:55.803370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:55.661043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333465+0000","last_change":"2024-09-15T23:53:50.767627+0000","last_active":"2024-09-15T23:53:56.333465+0000","last_peered":"2024-09-15T23:53:56.333465+0000","last_clean":"2024-09-15T23:53:56.333465+0000","last_became_active":"2024-09-15T23:53:50.766671+0000","last_became_peered":"2024-09-15T23:53:50.766671+0000","last_unstale":"2024-09-15T23:53:56.333465+0000","last_undegraded":"2024-09-15T23:53:56.333465+0000","last_fullsized":"2024-09-15T23:53:56.333465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:54.586682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799767+0000","last_change":"2024-09-15T23:53:49.725634+0000","last_active":"2024-09-15T23:53:55.799767+0000","last_peered":"2024-09-15T23:53:55.799767+0000","last_clean":"2024-09-15T23:53:55.799767+0000","last_became_active":"2024-09-15T23:53:49.723832+0000","last_became_peered":"2024-09-15T23:53:49.723832+0000","last_unstale":"2024-09-15T23:53:55.799767+0000","last_undegraded":"2024-09-15T23:53:55.799767+0000","last_fullsized":"2024-09-15T23:53:55.799767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:09.900395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807354+0000","last_change":"2024-09-15T23:53:54.846953+0000","last_active":"2024-09-15T23:53:55.807354+0000","last_peered":"2024-09-15T23:53:55.807354+0000","last_clean":"2024-09-15T23:53:55.807354+0000","last_became_active":"2024-09-15T23:53:54.844217+0000","last_became_peered":"2024-09-15T23:53:54.844217+0000","last_unstale":"2024-09-15T23:53:55.807354+0000","last_undegraded":"2024-09-15T23:53:55.807354+0000","last_fullsized":"2024-09-15T23:53:55.807354+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:25.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803281+0000","last_change":"2024-09-15T23:53:50.763583+0000","last_active":"2024-09-15T23:53:55.803281+0000","last_peered":"2024-09-15T23:53:55.803281+0000","last_clean":"2024-09-15T23:53:55.803281+0000","last_became_active":"2024-09-15T23:53:50.763267+0000","last_became_peered":"2024-09-15T23:53:50.763267+0000","last_unstale":"2024-09-15T23:53:55.803281+0000","last_undegraded":"2024-09-15T23:53:55.803281+0000","last_fullsized":"2024-09-15T23:53:55.803281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:34.077890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335453+0000","last_change":"2024-09-15T23:53:49.725775+0000","last_active":"2024-09-15T23:53:56.335453+0000","last_peered":"2024-09-15T23:53:56.335453+0000","last_clean":"2024-09-15T23:53:56.335453+0000","last_became_active":"2024-09-15T23:53:49.724972+0000","last_became_peered":"2024-09-15T23:53:49.724972+0000","last_unstale":"2024-09-15T23:53:56.335453+0000","last_undegraded":"2024-09-15T23:53:56.335453+0000","last_fullsized":"2024-09-15T23:53:56.335453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:25:03.906556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805542+0000","last_change":"2024-09-15T23:53:54.831426+0000","last_active":"2024-09-15T23:53:55.805542+0000","last_peered":"2024-09-15T23:53:55.805542+0000","last_clean":"2024-09-15T23:53:55.805542+0000","last_became_active":"2024-09-15T23:53:54.830222+0000","last_became_peered":"2024-09-15T23:53:54.830222+0000","last_unstale":"2024-09-15T23:53:55.805542+0000","last_undegraded":"2024-09-15T23:53:55.805542+0000","last_fullsized":"2024-09-15T23:53:55.805542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:01.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804225+0000","last_change":"2024-09-15T23:53:50.749494+0000","last_active":"2024-09-15T23:53:55.804225+0000","last_peered":"2024-09-15T23:53:55.804225+0000","last_clean":"2024-09-15T23:53:55.804225+0000","last_became_active":"2024-09-15T23:53:50.748576+0000","last_became_peered":"2024-09-15T23:53:50.748576+0000","last_unstale":"2024-09-15T23:53:55.804225+0000","last_undegraded":"2024-09-15T23:53:55.804225+0000","last_fullsized":"2024-09-15T23:53:55.804225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:39.100079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799626+0000","last_change":"2024-09-15T23:53:49.725322+0000","last_active":"2024-09-15T23:53:55.799626+0000","last_peered":"2024-09-15T23:53:55.799626+0000","last_clean":"2024-09-15T23:53:55.799626+0000","last_became_active":"2024-09-15T23:53:49.724863+0000","last_became_peered":"2024-09-15T23:53:49.724863+0000","last_unstale":"2024-09-15T23:53:55.799626+0000","last_undegraded":"2024-09-15T23:53:55.799626+0000","last_fullsized":"2024-09-15T23:53:55.799626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:08.552003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805910+0000","last_change":"2024-09-15T23:53:54.839131+0000","last_active":"2024-09-15T23:53:55.805910+0000","last_peered":"2024-09-15T23:53:55.805910+0000","last_clean":"2024-09-15T23:53:55.805910+0000","last_became_active":"2024-09-15T23:53:54.837820+0000","last_became_peered":"2024-09-15T23:53:54.837820+0000","last_unstale":"2024-09-15T23:53:55.805910+0000","last_undegraded":"2024-09-15T23:53:55.805910+0000","last_fullsized":"2024-09-15T23:53:55.805910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:12.392532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334826+0000","last_change":"2024-09-15T23:53:50.760376+0000","last_active":"2024-09-15T23:53:56.334826+0000","last_peered":"2024-09-15T23:53:56.334826+0000","last_clean":"2024-09-15T23:53:56.334826+0000","last_became_active":"2024-09-15T23:53:50.758918+0000","last_became_peered":"2024-09-15T23:53:50.758918+0000","last_unstale":"2024-09-15T23:53:56.334826+0000","last_undegraded":"2024-09-15T23:53:56.334826+0000","last_fullsized":"2024-09-15T23:53:56.334826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:04.750808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799555+0000","last_change":"2024-09-15T23:53:49.707210+0000","last_active":"2024-09-15T23:53:55.799555+0000","last_peered":"2024-09-15T23:53:55.799555+0000","last_clean":"2024-09-15T23:53:55.799555+0000","last_became_active":"2024-09-15T23:53:49.705850+0000","last_became_peered":"2024-09-15T23:53:49.705850+0000","last_unstale":"2024-09-15T23:53:55.799555+0000","last_undegraded":"2024-09-15T23:53:55.799555+0000","last_fullsized":"2024-09-15T23:53:55.799555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:01.693912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331928+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:53:56.331928+0000","last_peered":"2024-09-15T23:53:56.331928+0000","last_clean":"2024-09-15T23:53:56.331928+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:53:56.331928+0000","last_undegraded":"2024-09-15T23:53:56.331928+0000","last_fullsized":"2024-09-15T23:53:56.331928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800931+0000","last_change":"2024-09-15T23:53:54.802294+0000","last_active":"2024-09-15T23:53:55.800931+0000","last_peered":"2024-09-15T23:53:55.800931+0000","last_clean":"2024-09-15T23:53:55.800931+0000","last_became_active":"2024-09-15T23:53:54.801810+0000","last_became_peered":"2024-09-15T23:53:54.801810+0000","last_unstale":"2024-09-15T23:53:55.800931+0000","last_undegraded":"2024-09-15T23:53:55.800931+0000","last_fullsized":"2024-09-15T23:53:55.800931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:31.818261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800591+0000","last_change":"2024-09-15T23:53:50.763308+0000","last_active":"2024-09-15T23:53:55.800591+0000","last_peered":"2024-09-15T23:53:55.800591+0000","last_clean":"2024-09-15T23:53:55.800591+0000","last_became_active":"2024-09-15T23:53:50.763032+0000","last_became_peered":"2024-09-15T23:53:50.763032+0000","last_unstale":"2024-09-15T23:53:55.800591+0000","last_undegraded":"2024-09-15T23:53:55.800591+0000","last_fullsized":"2024-09-15T23:53:55.800591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:48.085914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807911+0000","last_change":"2024-09-15T23:53:49.730437+0000","last_active":"2024-09-15T23:53:55.807911+0000","last_peered":"2024-09-15T23:53:55.807911+0000","last_clean":"2024-09-15T23:53:55.807911+0000","last_became_active":"2024-09-15T23:53:49.729801+0000","last_became_peered":"2024-09-15T23:53:49.729801+0000","last_unstale":"2024-09-15T23:53:55.807911+0000","last_undegraded":"2024-09-15T23:53:55.807911+0000","last_fullsized":"2024-09-15T23:53:55.807911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:56.727393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331703+0000","last_change":"2024-09-15T23:53:54.838987+0000","last_active":"2024-09-15T23:53:56.331703+0000","last_peered":"2024-09-15T23:53:56.331703+0000","last_clean":"2024-09-15T23:53:56.331703+0000","last_became_active":"2024-09-15T23:53:54.838600+0000","last_became_peered":"2024-09-15T23:53:54.838600+0000","last_unstale":"2024-09-15T23:53:56.331703+0000","last_undegraded":"2024-09-15T23:53:56.331703+0000","last_fullsized":"2024-09-15T23:53:56.331703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:55.661043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333855+0000","last_change":"2024-09-15T23:53:50.772514+0000","last_active":"2024-09-15T23:53:56.333855+0000","last_peered":"2024-09-15T23:53:56.333855+0000","last_clean":"2024-09-15T23:53:56.333855+0000","last_became_active":"2024-09-15T23:53:50.771970+0000","last_became_peered":"2024-09-15T23:53:50.771970+0000","last_unstale":"2024-09-15T23:53:56.333855+0000","last_undegraded":"2024-09-15T23:53:56.333855+0000","last_fullsized":"2024-09-15T23:53:56.333855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:17.612514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805841+0000","last_change":"2024-09-15T23:53:49.728617+0000","last_active":"2024-09-15T23:53:55.805841+0000","last_peered":"2024-09-15T23:53:55.805841+0000","last_clean":"2024-09-15T23:53:55.805841+0000","last_became_active":"2024-09-15T23:53:49.727770+0000","last_became_peered":"2024-09-15T23:53:49.727770+0000","last_unstale":"2024-09-15T23:53:55.805841+0000","last_undegraded":"2024-09-15T23:53:55.805841+0000","last_fullsized":"2024-09-15T23:53:55.805841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:51.740913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804252+0000","last_change":"2024-09-15T23:53:54.815958+0000","last_active":"2024-09-15T23:53:55.804252+0000","last_peered":"2024-09-15T23:53:55.804252+0000","last_clean":"2024-09-15T23:53:55.804252+0000","last_became_active":"2024-09-15T23:53:54.814904+0000","last_became_peered":"2024-09-15T23:53:54.814904+0000","last_unstale":"2024-09-15T23:53:55.804252+0000","last_undegraded":"2024-09-15T23:53:55.804252+0000","last_fullsized":"2024-09-15T23:53:55.804252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:56.872305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333379+0000","last_change":"2024-09-15T23:53:50.781321+0000","last_active":"2024-09-15T23:53:56.333379+0000","last_peered":"2024-09-15T23:53:56.333379+0000","last_clean":"2024-09-15T23:53:56.333379+0000","last_became_active":"2024-09-15T23:53:50.780931+0000","last_became_peered":"2024-09-15T23:53:50.780931+0000","last_unstale":"2024-09-15T23:53:56.333379+0000","last_undegraded":"2024-09-15T23:53:56.333379+0000","last_fullsized":"2024-09-15T23:53:56.333379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:54.765704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336877+0000","last_change":"2024-09-15T23:53:49.730687+0000","last_active":"2024-09-15T23:53:56.336877+0000","last_peered":"2024-09-15T23:53:56.336877+0000","last_clean":"2024-09-15T23:53:56.336877+0000","last_became_active":"2024-09-15T23:53:49.729969+0000","last_became_peered":"2024-09-15T23:53:49.729969+0000","last_unstale":"2024-09-15T23:53:56.336877+0000","last_undegraded":"2024-09-15T23:53:56.336877+0000","last_fullsized":"2024-09-15T23:53:56.336877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:55.009643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798438+0000","last_change":"2024-09-15T23:53:54.807204+0000","last_active":"2024-09-15T23:53:55.798438+0000","last_peered":"2024-09-15T23:53:55.798438+0000","last_clean":"2024-09-15T23:53:55.798438+0000","last_became_active":"2024-09-15T23:53:54.806430+0000","last_became_peered":"2024-09-15T23:53:54.806430+0000","last_unstale":"2024-09-15T23:53:55.798438+0000","last_undegraded":"2024-09-15T23:53:55.798438+0000","last_fullsized":"2024-09-15T23:53:55.798438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:24.111672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333084+0000","last_change":"2024-09-15T23:53:50.779517+0000","last_active":"2024-09-15T23:53:56.333084+0000","last_peered":"2024-09-15T23:53:56.333084+0000","last_clean":"2024-09-15T23:53:56.333084+0000","last_became_active":"2024-09-15T23:53:50.779199+0000","last_became_peered":"2024-09-15T23:53:50.779199+0000","last_unstale":"2024-09-15T23:53:56.333084+0000","last_undegraded":"2024-09-15T23:53:56.333084+0000","last_fullsized":"2024-09-15T23:53:56.333084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:39.100079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333514+0000","last_change":"2024-09-15T23:53:49.734270+0000","last_active":"2024-09-15T23:53:56.333514+0000","last_peered":"2024-09-15T23:53:56.333514+0000","last_clean":"2024-09-15T23:53:56.333514+0000","last_became_active":"2024-09-15T23:53:49.729410+0000","last_became_peered":"2024-09-15T23:53:49.729410+0000","last_unstale":"2024-09-15T23:53:56.333514+0000","last_undegraded":"2024-09-15T23:53:56.333514+0000","last_fullsized":"2024-09-15T23:53:56.333514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:32.423155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332767+0000","last_change":"2024-09-15T23:53:54.828876+0000","last_active":"2024-09-15T23:53:56.332767+0000","last_peered":"2024-09-15T23:53:56.332767+0000","last_clean":"2024-09-15T23:53:56.332767+0000","last_became_active":"2024-09-15T23:53:54.828500+0000","last_became_peered":"2024-09-15T23:53:54.828500+0000","last_unstale":"2024-09-15T23:53:56.332767+0000","last_undegraded":"2024-09-15T23:53:56.332767+0000","last_fullsized":"2024-09-15T23:53:56.332767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:03.580557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799130+0000","last_change":"2024-09-15T23:53:50.761067+0000","last_active":"2024-09-15T23:53:55.799130+0000","last_peered":"2024-09-15T23:53:55.799130+0000","last_clean":"2024-09-15T23:53:55.799130+0000","last_became_active":"2024-09-15T23:53:50.760746+0000","last_became_peered":"2024-09-15T23:53:50.760746+0000","last_unstale":"2024-09-15T23:53:55.799130+0000","last_undegraded":"2024-09-15T23:53:55.799130+0000","last_fullsized":"2024-09-15T23:53:55.799130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:37.867754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334428+0000","last_change":"2024-09-15T23:53:49.715804+0000","last_active":"2024-09-15T23:53:56.334428+0000","last_peered":"2024-09-15T23:53:56.334428+0000","last_clean":"2024-09-15T23:53:56.334428+0000","last_became_active":"2024-09-15T23:53:49.715180+0000","last_became_peered":"2024-09-15T23:53:49.715180+0000","last_unstale":"2024-09-15T23:53:56.334428+0000","last_undegraded":"2024-09-15T23:53:56.334428+0000","last_fullsized":"2024-09-15T23:53:56.334428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.829837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806333+0000","last_change":"2024-09-15T23:53:54.838616+0000","last_active":"2024-09-15T23:53:55.806333+0000","last_peered":"2024-09-15T23:53:55.806333+0000","last_clean":"2024-09-15T23:53:55.806333+0000","last_became_active":"2024-09-15T23:53:54.837514+0000","last_became_peered":"2024-09-15T23:53:54.837514+0000","last_unstale":"2024-09-15T23:53:55.806333+0000","last_undegraded":"2024-09-15T23:53:55.806333+0000","last_fullsized":"2024-09-15T23:53:55.806333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:16.570607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331570+0000","last_change":"2024-09-15T23:53:50.773002+0000","last_active":"2024-09-15T23:53:56.331570+0000","last_peered":"2024-09-15T23:53:56.331570+0000","last_clean":"2024-09-15T23:53:56.331570+0000","last_became_active":"2024-09-15T23:53:50.772276+0000","last_became_peered":"2024-09-15T23:53:50.772276+0000","last_unstale":"2024-09-15T23:53:56.331570+0000","last_undegraded":"2024-09-15T23:53:56.331570+0000","last_fullsized":"2024-09-15T23:53:56.331570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:55.915920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333217+0000","last_change":"2024-09-15T23:53:49.700504+0000","last_active":"2024-09-15T23:53:56.333217+0000","last_peered":"2024-09-15T23:53:56.333217+0000","last_clean":"2024-09-15T23:53:56.333217+0000","last_became_active":"2024-09-15T23:53:49.699750+0000","last_became_peered":"2024-09-15T23:53:49.699750+0000","last_unstale":"2024-09-15T23:53:56.333217+0000","last_undegraded":"2024-09-15T23:53:56.333217+0000","last_fullsized":"2024-09-15T23:53:56.333217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:45.659637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806928+0000","last_change":"2024-09-15T23:53:54.824331+0000","last_active":"2024-09-15T23:53:55.806928+0000","last_peered":"2024-09-15T23:53:55.806928+0000","last_clean":"2024-09-15T23:53:55.806928+0000","last_became_active":"2024-09-15T23:53:54.823300+0000","last_became_peered":"2024-09-15T23:53:54.823300+0000","last_unstale":"2024-09-15T23:53:55.806928+0000","last_undegraded":"2024-09-15T23:53:55.806928+0000","last_fullsized":"2024-09-15T23:53:55.806928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:37.095883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798948+0000","last_change":"2024-09-15T23:53:50.775624+0000","last_active":"2024-09-15T23:53:55.798948+0000","last_peered":"2024-09-15T23:53:55.798948+0000","last_clean":"2024-09-15T23:53:55.798948+0000","last_became_active":"2024-09-15T23:53:50.775283+0000","last_became_peered":"2024-09-15T23:53:50.775283+0000","last_unstale":"2024-09-15T23:53:55.798948+0000","last_undegraded":"2024-09-15T23:53:55.798948+0000","last_fullsized":"2024-09-15T23:53:55.798948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:06.300941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799708+0000","last_change":"2024-09-15T23:53:49.723818+0000","last_active":"2024-09-15T23:53:55.799708+0000","last_peered":"2024-09-15T23:53:55.799708+0000","last_clean":"2024-09-15T23:53:55.799708+0000","last_became_active":"2024-09-15T23:53:49.720057+0000","last_became_peered":"2024-09-15T23:53:49.720057+0000","last_unstale":"2024-09-15T23:53:55.799708+0000","last_undegraded":"2024-09-15T23:53:55.799708+0000","last_fullsized":"2024-09-15T23:53:55.799708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:38.734641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807236+0000","last_change":"2024-09-15T23:53:54.846308+0000","last_active":"2024-09-15T23:53:55.807236+0000","last_peered":"2024-09-15T23:53:55.807236+0000","last_clean":"2024-09-15T23:53:55.807236+0000","last_became_active":"2024-09-15T23:53:54.844118+0000","last_became_peered":"2024-09-15T23:53:54.844118+0000","last_unstale":"2024-09-15T23:53:55.807236+0000","last_undegraded":"2024-09-15T23:53:55.807236+0000","last_fullsized":"2024-09-15T23:53:55.807236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:05.294652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804937+0000","last_change":"2024-09-15T23:53:50.760823+0000","last_active":"2024-09-15T23:53:55.804937+0000","last_peered":"2024-09-15T23:53:55.804937+0000","last_clean":"2024-09-15T23:53:55.804937+0000","last_became_active":"2024-09-15T23:53:50.760471+0000","last_became_peered":"2024-09-15T23:53:50.760471+0000","last_unstale":"2024-09-15T23:53:55.804937+0000","last_undegraded":"2024-09-15T23:53:55.804937+0000","last_fullsized":"2024-09-15T23:53:55.804937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:04.750808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336497+0000","last_change":"2024-09-15T23:53:49.719808+0000","last_active":"2024-09-15T23:53:56.336497+0000","last_peered":"2024-09-15T23:53:56.336497+0000","last_clean":"2024-09-15T23:53:56.336497+0000","last_became_active":"2024-09-15T23:53:49.719303+0000","last_became_peered":"2024-09-15T23:53:49.719303+0000","last_unstale":"2024-09-15T23:53:56.336497+0000","last_undegraded":"2024-09-15T23:53:56.336497+0000","last_fullsized":"2024-09-15T23:53:56.336497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:55.009643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800425+0000","last_change":"2024-09-15T23:53:54.807683+0000","last_active":"2024-09-15T23:53:55.800425+0000","last_peered":"2024-09-15T23:53:55.800425+0000","last_clean":"2024-09-15T23:53:55.800425+0000","last_became_active":"2024-09-15T23:53:54.807273+0000","last_became_peered":"2024-09-15T23:53:54.807273+0000","last_unstale":"2024-09-15T23:53:55.800425+0000","last_undegraded":"2024-09-15T23:53:55.800425+0000","last_fullsized":"2024-09-15T23:53:55.800425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:29.903334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334249+0000","last_change":"2024-09-15T23:53:50.778913+0000","last_active":"2024-09-15T23:53:56.334249+0000","last_peered":"2024-09-15T23:53:56.334249+0000","last_clean":"2024-09-15T23:53:56.334249+0000","last_became_active":"2024-09-15T23:53:50.775954+0000","last_became_peered":"2024-09-15T23:53:50.775954+0000","last_unstale":"2024-09-15T23:53:56.334249+0000","last_undegraded":"2024-09-15T23:53:56.334249+0000","last_fullsized":"2024-09-15T23:53:56.334249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:51.577438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:54:01.347228+0000","last_change":"2024-09-15T23:53:49.720597+0000","last_active":"2024-09-15T23:54:01.347228+0000","last_peered":"2024-09-15T23:54:01.347228+0000","last_clean":"2024-09-15T23:54:01.347228+0000","last_became_active":"2024-09-15T23:53:49.717557+0000","last_became_peered":"2024-09-15T23:53:49.717557+0000","last_unstale":"2024-09-15T23:54:01.347228+0000","last_undegraded":"2024-09-15T23:54:01.347228+0000","last_fullsized":"2024-09-15T23:54:01.347228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:05.442964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334641+0000","last_change":"2024-09-15T23:53:54.826160+0000","last_active":"2024-09-15T23:53:56.334641+0000","last_peered":"2024-09-15T23:53:56.334641+0000","last_clean":"2024-09-15T23:53:56.334641+0000","last_became_active":"2024-09-15T23:53:54.824735+0000","last_became_peered":"2024-09-15T23:53:54.824735+0000","last_unstale":"2024-09-15T23:53:56.334641+0000","last_undegraded":"2024-09-15T23:53:56.334641+0000","last_fullsized":"2024-09-15T23:53:56.334641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:05.294652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799239+0000","last_change":"2024-09-15T23:53:50.760066+0000","last_active":"2024-09-15T23:53:55.799239+0000","last_peered":"2024-09-15T23:53:55.799239+0000","last_clean":"2024-09-15T23:53:55.799239+0000","last_became_active":"2024-09-15T23:53:50.759702+0000","last_became_peered":"2024-09-15T23:53:50.759702+0000","last_unstale":"2024-09-15T23:53:55.799239+0000","last_undegraded":"2024-09-15T23:53:55.799239+0000","last_fullsized":"2024-09-15T23:53:55.799239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:11.697485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335921+0000","last_change":"2024-09-15T23:53:49.718600+0000","last_active":"2024-09-15T23:53:56.335921+0000","last_peered":"2024-09-15T23:53:56.335921+0000","last_clean":"2024-09-15T23:53:56.335921+0000","last_became_active":"2024-09-15T23:53:49.718133+0000","last_became_peered":"2024-09-15T23:53:49.718133+0000","last_unstale":"2024-09-15T23:53:56.335921+0000","last_undegraded":"2024-09-15T23:53:56.335921+0000","last_fullsized":"2024-09-15T23:53:56.335921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:56.727393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334929+0000","last_change":"2024-09-15T23:53:54.831611+0000","last_active":"2024-09-15T23:53:56.334929+0000","last_peered":"2024-09-15T23:53:56.334929+0000","last_clean":"2024-09-15T23:53:56.334929+0000","last_became_active":"2024-09-15T23:53:54.830621+0000","last_became_peered":"2024-09-15T23:53:54.830621+0000","last_unstale":"2024-09-15T23:53:56.334929+0000","last_undegraded":"2024-09-15T23:53:56.334929+0000","last_fullsized":"2024-09-15T23:53:56.334929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:25.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807274+0000","last_change":"2024-09-15T23:53:50.766881+0000","last_active":"2024-09-15T23:53:55.807274+0000","last_peered":"2024-09-15T23:53:55.807274+0000","last_clean":"2024-09-15T23:53:55.807274+0000","last_became_active":"2024-09-15T23:53:50.766527+0000","last_became_peered":"2024-09-15T23:53:50.766527+0000","last_unstale":"2024-09-15T23:53:55.807274+0000","last_undegraded":"2024-09-15T23:53:55.807274+0000","last_fullsized":"2024-09-15T23:53:55.807274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:15.908762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334496+0000","last_change":"2024-09-15T23:53:49.704002+0000","last_active":"2024-09-15T23:53:56.334496+0000","last_peered":"2024-09-15T23:53:56.334496+0000","last_clean":"2024-09-15T23:53:56.334496+0000","last_became_active":"2024-09-15T23:53:49.703760+0000","last_became_peered":"2024-09-15T23:53:49.703760+0000","last_unstale":"2024-09-15T23:53:56.334496+0000","last_undegraded":"2024-09-15T23:53:56.334496+0000","last_fullsized":"2024-09-15T23:53:56.334496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:54.905896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334638+0000","last_change":"2024-09-15T23:53:54.835532+0000","last_active":"2024-09-15T23:53:56.334638+0000","last_peered":"2024-09-15T23:53:56.334638+0000","last_clean":"2024-09-15T23:53:56.334638+0000","last_became_active":"2024-09-15T23:53:54.834666+0000","last_became_peered":"2024-09-15T23:53:54.834666+0000","last_unstale":"2024-09-15T23:53:56.334638+0000","last_undegraded":"2024-09-15T23:53:56.334638+0000","last_fullsized":"2024-09-15T23:53:56.334638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:08.834413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333009+0000","last_change":"2024-09-15T23:53:50.768163+0000","last_active":"2024-09-15T23:53:56.333009+0000","last_peered":"2024-09-15T23:53:56.333009+0000","last_clean":"2024-09-15T23:53:56.333009+0000","last_became_active":"2024-09-15T23:53:50.763914+0000","last_became_peered":"2024-09-15T23:53:50.763914+0000","last_unstale":"2024-09-15T23:53:56.333009+0000","last_undegraded":"2024-09-15T23:53:56.333009+0000","last_fullsized":"2024-09-15T23:53:56.333009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:48.894933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332851+0000","last_change":"2024-09-15T23:53:49.720489+0000","last_active":"2024-09-15T23:53:56.332851+0000","last_peered":"2024-09-15T23:53:56.332851+0000","last_clean":"2024-09-15T23:53:56.332851+0000","last_became_active":"2024-09-15T23:53:49.719882+0000","last_became_peered":"2024-09-15T23:53:49.719882+0000","last_unstale":"2024-09-15T23:53:56.332851+0000","last_undegraded":"2024-09-15T23:53:56.332851+0000","last_fullsized":"2024-09-15T23:53:56.332851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:42.225697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335364+0000","last_change":"2024-09-15T23:53:54.834453+0000","last_active":"2024-09-15T23:53:56.335364+0000","last_peered":"2024-09-15T23:53:56.335364+0000","last_clean":"2024-09-15T23:53:56.335364+0000","last_became_active":"2024-09-15T23:53:54.832355+0000","last_became_peered":"2024-09-15T23:53:54.832355+0000","last_unstale":"2024-09-15T23:53:56.335364+0000","last_undegraded":"2024-09-15T23:53:56.335364+0000","last_fullsized":"2024-09-15T23:53:56.335364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:25.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336774+0000","last_change":"2024-09-15T23:53:54.823569+0000","last_active":"2024-09-15T23:53:56.336774+0000","last_peered":"2024-09-15T23:53:56.336774+0000","last_clean":"2024-09-15T23:53:56.336774+0000","last_became_active":"2024-09-15T23:53:54.822582+0000","last_became_peered":"2024-09-15T23:53:54.822582+0000","last_unstale":"2024-09-15T23:53:56.336774+0000","last_undegraded":"2024-09-15T23:53:56.336774+0000","last_fullsized":"2024-09-15T23:53:56.336774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:40.544116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335644+0000","last_change":"2024-09-15T23:53:50.754235+0000","last_active":"2024-09-15T23:53:56.335644+0000","last_peered":"2024-09-15T23:53:56.335644+0000","last_clean":"2024-09-15T23:53:56.335644+0000","last_became_active":"2024-09-15T23:53:50.753479+0000","last_became_peered":"2024-09-15T23:53:50.753479+0000","last_unstale":"2024-09-15T23:53:56.335644+0000","last_undegraded":"2024-09-15T23:53:56.335644+0000","last_fullsized":"2024-09-15T23:53:56.335644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:11.710571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799070+0000","last_change":"2024-09-15T23:53:49.704444+0000","last_active":"2024-09-15T23:53:55.799070+0000","last_peered":"2024-09-15T23:53:55.799070+0000","last_clean":"2024-09-15T23:53:55.799070+0000","last_became_active":"2024-09-15T23:53:49.703888+0000","last_became_peered":"2024-09-15T23:53:49.703888+0000","last_unstale":"2024-09-15T23:53:55.799070+0000","last_undegraded":"2024-09-15T23:53:55.799070+0000","last_fullsized":"2024-09-15T23:53:55.799070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:17.063782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800734+0000","last_change":"2024-09-15T23:53:54.808928+0000","last_active":"2024-09-15T23:53:55.800734+0000","last_peered":"2024-09-15T23:53:55.800734+0000","last_clean":"2024-09-15T23:53:55.800734+0000","last_became_active":"2024-09-15T23:53:54.808284+0000","last_became_peered":"2024-09-15T23:53:54.808284+0000","last_unstale":"2024-09-15T23:53:55.800734+0000","last_undegraded":"2024-09-15T23:53:55.800734+0000","last_fullsized":"2024-09-15T23:53:55.800734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:33.254304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803508+0000","last_change":"2024-09-15T23:53:50.771765+0000","last_active":"2024-09-15T23:53:55.803508+0000","last_peered":"2024-09-15T23:53:55.803508+0000","last_clean":"2024-09-15T23:53:55.803508+0000","last_became_active":"2024-09-15T23:53:50.770972+0000","last_became_peered":"2024-09-15T23:53:50.770972+0000","last_unstale":"2024-09-15T23:53:55.803508+0000","last_undegraded":"2024-09-15T23:53:55.803508+0000","last_fullsized":"2024-09-15T23:53:55.803508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:30.225858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804471+0000","last_change":"2024-09-15T23:53:49.703341+0000","last_active":"2024-09-15T23:53:55.804471+0000","last_peered":"2024-09-15T23:53:55.804471+0000","last_clean":"2024-09-15T23:53:55.804471+0000","last_became_active":"2024-09-15T23:53:49.702534+0000","last_became_peered":"2024-09-15T23:53:49.702534+0000","last_unstale":"2024-09-15T23:53:55.804471+0000","last_undegraded":"2024-09-15T23:53:55.804471+0000","last_fullsized":"2024-09-15T23:53:55.804471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:25:03.906556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799514+0000","last_change":"2024-09-15T23:53:49.724099+0000","last_active":"2024-09-15T23:53:55.799514+0000","last_peered":"2024-09-15T23:53:55.799514+0000","last_clean":"2024-09-15T23:53:55.799514+0000","last_became_active":"2024-09-15T23:53:49.720382+0000","last_became_peered":"2024-09-15T23:53:49.720382+0000","last_unstale":"2024-09-15T23:53:55.799514+0000","last_undegraded":"2024-09-15T23:53:55.799514+0000","last_fullsized":"2024-09-15T23:53:55.799514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:12.046572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335126+0000","last_change":"2024-09-15T23:53:50.772483+0000","last_active":"2024-09-15T23:53:56.335126+0000","last_peered":"2024-09-15T23:53:56.335126+0000","last_clean":"2024-09-15T23:53:56.335126+0000","last_became_active":"2024-09-15T23:53:50.772100+0000","last_became_peered":"2024-09-15T23:53:50.772100+0000","last_unstale":"2024-09-15T23:53:56.335126+0000","last_undegraded":"2024-09-15T23:53:56.335126+0000","last_fullsized":"2024-09-15T23:53:56.335126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:40.820870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336438+0000","last_change":"2024-09-15T23:53:54.834012+0000","last_active":"2024-09-15T23:53:56.336438+0000","last_peered":"2024-09-15T23:53:56.336438+0000","last_clean":"2024-09-15T23:53:56.336438+0000","last_became_active":"2024-09-15T23:53:54.832650+0000","last_became_peered":"2024-09-15T23:53:54.832650+0000","last_unstale":"2024-09-15T23:53:56.336438+0000","last_undegraded":"2024-09-15T23:53:56.336438+0000","last_fullsized":"2024-09-15T23:53:56.336438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:58.849309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804269+0000","last_change":"2024-09-15T23:53:49.727498+0000","last_active":"2024-09-15T23:53:55.804269+0000","last_peered":"2024-09-15T23:53:55.804269+0000","last_clean":"2024-09-15T23:53:55.804269+0000","last_became_active":"2024-09-15T23:53:49.723077+0000","last_became_peered":"2024-09-15T23:53:49.723077+0000","last_unstale":"2024-09-15T23:53:55.804269+0000","last_undegraded":"2024-09-15T23:53:55.804269+0000","last_fullsized":"2024-09-15T23:53:55.804269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:57.542130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332154+0000","last_change":"2024-09-15T23:53:50.761608+0000","last_active":"2024-09-15T23:53:56.332154+0000","last_peered":"2024-09-15T23:53:56.332154+0000","last_clean":"2024-09-15T23:53:56.332154+0000","last_became_active":"2024-09-15T23:53:50.758363+0000","last_became_peered":"2024-09-15T23:53:50.758363+0000","last_unstale":"2024-09-15T23:53:56.332154+0000","last_undegraded":"2024-09-15T23:53:56.332154+0000","last_fullsized":"2024-09-15T23:53:56.332154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335657+0000","last_change":"2024-09-15T23:53:54.841381+0000","last_active":"2024-09-15T23:53:56.335657+0000","last_peered":"2024-09-15T23:53:56.335657+0000","last_clean":"2024-09-15T23:53:56.335657+0000","last_became_active":"2024-09-15T23:53:54.840352+0000","last_became_peered":"2024-09-15T23:53:54.840352+0000","last_unstale":"2024-09-15T23:53:56.335657+0000","last_undegraded":"2024-09-15T23:53:56.335657+0000","last_fullsized":"2024-09-15T23:53:56.335657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:44.904475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332559+0000","last_change":"2024-09-15T23:53:50.768904+0000","last_active":"2024-09-15T23:53:56.332559+0000","last_peered":"2024-09-15T23:53:56.332559+0000","last_clean":"2024-09-15T23:53:56.332559+0000","last_became_active":"2024-09-15T23:53:50.768253+0000","last_became_peered":"2024-09-15T23:53:50.768253+0000","last_unstale":"2024-09-15T23:53:56.332559+0000","last_undegraded":"2024-09-15T23:53:56.332559+0000","last_fullsized":"2024-09-15T23:53:56.332559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:41.573063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335133+0000","last_change":"2024-09-15T23:53:50.776288+0000","last_active":"2024-09-15T23:53:56.335133+0000","last_peered":"2024-09-15T23:53:56.335133+0000","last_clean":"2024-09-15T23:53:56.335133+0000","last_became_active":"2024-09-15T23:53:50.775954+0000","last_became_peered":"2024-09-15T23:53:50.775954+0000","last_unstale":"2024-09-15T23:53:56.335133+0000","last_undegraded":"2024-09-15T23:53:56.335133+0000","last_fullsized":"2024-09-15T23:53:56.335133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.385437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798721+0000","last_change":"2024-09-15T23:53:50.766724+0000","last_active":"2024-09-15T23:53:55.798721+0000","last_peered":"2024-09-15T23:53:55.798721+0000","last_clean":"2024-09-15T23:53:55.798721+0000","last_became_active":"2024-09-15T23:53:50.766294+0000","last_became_peered":"2024-09-15T23:53:50.766294+0000","last_unstale":"2024-09-15T23:53:55.798721+0000","last_undegraded":"2024-09-15T23:53:55.798721+0000","last_fullsized":"2024-09-15T23:53:55.798721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:30.859886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804025+0000","last_change":"2024-09-15T23:53:50.762881+0000","last_active":"2024-09-15T23:53:55.804025+0000","last_peered":"2024-09-15T23:53:55.804025+0000","last_clean":"2024-09-15T23:53:55.804025+0000","last_became_active":"2024-09-15T23:53:50.762510+0000","last_became_peered":"2024-09-15T23:53:50.762510+0000","last_unstale":"2024-09-15T23:53:55.804025+0000","last_undegraded":"2024-09-15T23:53:55.804025+0000","last_fullsized":"2024-09-15T23:53:55.804025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.236567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807695+0000","last_change":"2024-09-15T23:53:50.778010+0000","last_active":"2024-09-15T23:53:55.807695+0000","last_peered":"2024-09-15T23:53:55.807695+0000","last_clean":"2024-09-15T23:53:55.807695+0000","last_became_active":"2024-09-15T23:53:50.777507+0000","last_became_peered":"2024-09-15T23:53:50.777507+0000","last_unstale":"2024-09-15T23:53:55.807695+0000","last_undegraded":"2024-09-15T23:53:55.807695+0000","last_fullsized":"2024-09-15T23:53:55.807695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:35:59.496952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805694+0000","last_change":"2024-09-15T23:53:50.758259+0000","last_active":"2024-09-15T23:53:55.805694+0000","last_peered":"2024-09-15T23:53:55.805694+0000","last_clean":"2024-09-15T23:53:55.805694+0000","last_became_active":"2024-09-15T23:53:50.757961+0000","last_became_peered":"2024-09-15T23:53:50.757961+0000","last_unstale":"2024-09-15T23:53:55.805694+0000","last_undegraded":"2024-09-15T23:53:55.805694+0000","last_fullsized":"2024-09-15T23:53:55.805694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:40.820870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332924+0000","last_change":"2024-09-15T23:53:50.767102+0000","last_active":"2024-09-15T23:53:56.332924+0000","last_peered":"2024-09-15T23:53:56.332924+0000","last_clean":"2024-09-15T23:53:56.332924+0000","last_became_active":"2024-09-15T23:53:50.762579+0000","last_became_peered":"2024-09-15T23:53:50.762579+0000","last_unstale":"2024-09-15T23:53:56.332924+0000","last_undegraded":"2024-09-15T23:53:56.332924+0000","last_fullsized":"2024-09-15T23:53:56.332924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:10.630689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806419+0000","last_change":"2024-09-15T23:53:50.778971+0000","last_active":"2024-09-15T23:53:55.806419+0000","last_peered":"2024-09-15T23:53:55.806419+0000","last_clean":"2024-09-15T23:53:55.806419+0000","last_became_active":"2024-09-15T23:53:50.778504+0000","last_became_peered":"2024-09-15T23:53:50.778504+0000","last_unstale":"2024-09-15T23:53:55.806419+0000","last_undegraded":"2024-09-15T23:53:55.806419+0000","last_fullsized":"2024-09-15T23:53:55.806419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:13.705388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799032+0000","last_change":"2024-09-15T23:53:50.766048+0000","last_active":"2024-09-15T23:53:55.799032+0000","last_peered":"2024-09-15T23:53:55.799032+0000","last_clean":"2024-09-15T23:53:55.799032+0000","last_became_active":"2024-09-15T23:53:50.765747+0000","last_became_peered":"2024-09-15T23:53:50.765747+0000","last_unstale":"2024-09-15T23:53:55.799032+0000","last_undegraded":"2024-09-15T23:53:55.799032+0000","last_fullsized":"2024-09-15T23:53:55.799032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:50.800418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804413+0000","last_change":"2024-09-15T23:53:50.762427+0000","last_active":"2024-09-15T23:53:55.804413+0000","last_peered":"2024-09-15T23:53:55.804413+0000","last_clean":"2024-09-15T23:53:55.804413+0000","last_became_active":"2024-09-15T23:53:50.762044+0000","last_became_peered":"2024-09-15T23:53:50.762044+0000","last_unstale":"2024-09-15T23:53:55.804413+0000","last_undegraded":"2024-09-15T23:53:55.804413+0000","last_fullsized":"2024-09-15T23:53:55.804413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:44.344017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332051+0000","last_change":"2024-09-15T23:53:50.761423+0000","last_active":"2024-09-15T23:53:56.332051+0000","last_peered":"2024-09-15T23:53:56.332051+0000","last_clean":"2024-09-15T23:53:56.332051+0000","last_became_active":"2024-09-15T23:53:50.759524+0000","last_became_peered":"2024-09-15T23:53:50.759524+0000","last_unstale":"2024-09-15T23:53:56.332051+0000","last_undegraded":"2024-09-15T23:53:56.332051+0000","last_fullsized":"2024-09-15T23:53:56.332051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.385437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334830+0000","last_change":"2024-09-15T23:53:50.757892+0000","last_active":"2024-09-15T23:53:56.334830+0000","last_peered":"2024-09-15T23:53:56.334830+0000","last_clean":"2024-09-15T23:53:56.334830+0000","last_became_active":"2024-09-15T23:53:50.757123+0000","last_became_peered":"2024-09-15T23:53:50.757123+0000","last_unstale":"2024-09-15T23:53:56.334830+0000","last_undegraded":"2024-09-15T23:53:56.334830+0000","last_fullsized":"2024-09-15T23:53:56.334830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:15.892900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333812+0000","last_change":"2024-09-15T23:53:50.775664+0000","last_active":"2024-09-15T23:53:56.333812+0000","last_peered":"2024-09-15T23:53:56.333812+0000","last_clean":"2024-09-15T23:53:56.333812+0000","last_became_active":"2024-09-15T23:53:50.774398+0000","last_became_peered":"2024-09-15T23:53:50.774398+0000","last_unstale":"2024-09-15T23:53:56.333812+0000","last_undegraded":"2024-09-15T23:53:56.333812+0000","last_fullsized":"2024-09-15T23:53:56.333812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:01.211047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800852+0000","last_change":"2024-09-15T23:53:50.764281+0000","last_active":"2024-09-15T23:53:55.800852+0000","last_peered":"2024-09-15T23:53:55.800852+0000","last_clean":"2024-09-15T23:53:55.800852+0000","last_became_active":"2024-09-15T23:53:50.763712+0000","last_became_peered":"2024-09-15T23:53:50.763712+0000","last_unstale":"2024-09-15T23:53:55.800852+0000","last_undegraded":"2024-09-15T23:53:55.800852+0000","last_fullsized":"2024-09-15T23:53:55.800852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:27.740625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335860+0000","last_change":"2024-09-15T23:53:50.781321+0000","last_active":"2024-09-15T23:53:56.335860+0000","last_peered":"2024-09-15T23:53:56.335860+0000","last_clean":"2024-09-15T23:53:56.335860+0000","last_became_active":"2024-09-15T23:53:50.781022+0000","last_became_peered":"2024-09-15T23:53:50.781022+0000","last_unstale":"2024-09-15T23:53:56.335860+0000","last_undegraded":"2024-09-15T23:53:56.335860+0000","last_fullsized":"2024-09-15T23:53:56.335860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:10.630689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.801378+0000","last_change":"2024-09-15T23:53:50.773196+0000","last_active":"2024-09-15T23:53:55.801378+0000","last_peered":"2024-09-15T23:53:55.801378+0000","last_clean":"2024-09-15T23:53:55.801378+0000","last_became_active":"2024-09-15T23:53:50.772856+0000","last_became_peered":"2024-09-15T23:53:50.772856+0000","last_unstale":"2024-09-15T23:53:55.801378+0000","last_undegraded":"2024-09-15T23:53:55.801378+0000","last_fullsized":"2024-09-15T23:53:55.801378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:38.917747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798743+0000","last_change":"2024-09-15T23:53:50.770117+0000","last_active":"2024-09-15T23:53:55.798743+0000","last_peered":"2024-09-15T23:53:55.798743+0000","last_clean":"2024-09-15T23:53:55.798743+0000","last_became_active":"2024-09-15T23:53:50.769815+0000","last_became_peered":"2024-09-15T23:53:50.769815+0000","last_unstale":"2024-09-15T23:53:55.798743+0000","last_undegraded":"2024-09-15T23:53:55.798743+0000","last_fullsized":"2024-09-15T23:53:55.798743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:00.830681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804043+0000","last_change":"2024-09-15T23:53:50.776872+0000","last_active":"2024-09-15T23:53:55.804043+0000","last_peered":"2024-09-15T23:53:55.804043+0000","last_clean":"2024-09-15T23:53:55.804043+0000","last_became_active":"2024-09-15T23:53:50.776366+0000","last_became_peered":"2024-09-15T23:53:50.776366+0000","last_unstale":"2024-09-15T23:53:55.804043+0000","last_undegraded":"2024-09-15T23:53:55.804043+0000","last_fullsized":"2024-09-15T23:53:55.804043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:52.879737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804858+0000","last_change":"2024-09-15T23:53:50.762729+0000","last_active":"2024-09-15T23:53:55.804858+0000","last_peered":"2024-09-15T23:53:55.804858+0000","last_clean":"2024-09-15T23:53:55.804858+0000","last_became_active":"2024-09-15T23:53:50.762361+0000","last_became_peered":"2024-09-15T23:53:50.762361+0000","last_unstale":"2024-09-15T23:53:55.804858+0000","last_undegraded":"2024-09-15T23:53:55.804858+0000","last_fullsized":"2024-09-15T23:53:55.804858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:41.573063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806250+0000","last_change":"2024-09-15T23:53:50.768317+0000","last_active":"2024-09-15T23:53:55.806250+0000","last_peered":"2024-09-15T23:53:55.806250+0000","last_clean":"2024-09-15T23:53:55.806250+0000","last_became_active":"2024-09-15T23:53:50.767995+0000","last_became_peered":"2024-09-15T23:53:50.767995+0000","last_unstale":"2024-09-15T23:53:55.806250+0000","last_undegraded":"2024-09-15T23:53:55.806250+0000","last_fullsized":"2024-09-15T23:53:55.806250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:05.877077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333768+0000","last_change":"2024-09-15T23:53:50.776156+0000","last_active":"2024-09-15T23:53:56.333768+0000","last_peered":"2024-09-15T23:53:56.333768+0000","last_clean":"2024-09-15T23:53:56.333768+0000","last_became_active":"2024-09-15T23:53:50.775104+0000","last_became_peered":"2024-09-15T23:53:50.775104+0000","last_unstale":"2024-09-15T23:53:56.333768+0000","last_undegraded":"2024-09-15T23:53:56.333768+0000","last_fullsized":"2024-09-15T23:53:56.333768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:49.338954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334206+0000","last_change":"2024-09-15T23:53:50.773302+0000","last_active":"2024-09-15T23:53:56.334206+0000","last_peered":"2024-09-15T23:53:56.334206+0000","last_clean":"2024-09-15T23:53:56.334206+0000","last_became_active":"2024-09-15T23:53:50.772762+0000","last_became_peered":"2024-09-15T23:53:50.772762+0000","last_unstale":"2024-09-15T23:53:56.334206+0000","last_undegraded":"2024-09-15T23:53:56.334206+0000","last_fullsized":"2024-09-15T23:53:56.334206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:03.053120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334419+0000","last_change":"2024-09-15T23:53:50.766371+0000","last_active":"2024-09-15T23:53:56.334419+0000","last_peered":"2024-09-15T23:53:56.334419+0000","last_clean":"2024-09-15T23:53:56.334419+0000","last_became_active":"2024-09-15T23:53:50.766003+0000","last_became_peered":"2024-09-15T23:53:50.766003+0000","last_unstale":"2024-09-15T23:53:56.334419+0000","last_undegraded":"2024-09-15T23:53:56.334419+0000","last_fullsized":"2024-09-15T23:53:56.334419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:57.559108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332748+0000","last_change":"2024-09-15T23:53:50.772968+0000","last_active":"2024-09-15T23:53:56.332748+0000","last_peered":"2024-09-15T23:53:56.332748+0000","last_clean":"2024-09-15T23:53:56.332748+0000","last_became_active":"2024-09-15T23:53:50.771984+0000","last_became_peered":"2024-09-15T23:53:50.771984+0000","last_unstale":"2024-09-15T23:53:56.332748+0000","last_undegraded":"2024-09-15T23:53:56.332748+0000","last_fullsized":"2024-09-15T23:53:56.332748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:48.894933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803087+0000","last_change":"2024-09-15T23:53:50.775398+0000","last_active":"2024-09-15T23:53:55.803087+0000","last_peered":"2024-09-15T23:53:55.803087+0000","last_clean":"2024-09-15T23:53:55.803087+0000","last_became_active":"2024-09-15T23:53:50.775094+0000","last_became_peered":"2024-09-15T23:53:50.775094+0000","last_unstale":"2024-09-15T23:53:55.803087+0000","last_undegraded":"2024-09-15T23:53:55.803087+0000","last_fullsized":"2024-09-15T23:53:55.803087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:29.418106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333184+0000","last_change":"2024-09-15T23:53:50.760721+0000","last_active":"2024-09-15T23:53:56.333184+0000","last_peered":"2024-09-15T23:53:56.333184+0000","last_clean":"2024-09-15T23:53:56.333184+0000","last_became_active":"2024-09-15T23:53:50.760251+0000","last_became_peered":"2024-09-15T23:53:50.760251+0000","last_unstale":"2024-09-15T23:53:56.333184+0000","last_undegraded":"2024-09-15T23:53:56.333184+0000","last_fullsized":"2024-09-15T23:53:56.333184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:30.884230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331847+0000","last_change":"2024-09-15T23:53:50.760673+0000","last_active":"2024-09-15T23:53:56.331847+0000","last_peered":"2024-09-15T23:53:56.331847+0000","last_clean":"2024-09-15T23:53:56.331847+0000","last_became_active":"2024-09-15T23:53:50.760164+0000","last_became_peered":"2024-09-15T23:53:50.760164+0000","last_unstale":"2024-09-15T23:53:56.331847+0000","last_undegraded":"2024-09-15T23:53:56.331847+0000","last_fullsized":"2024-09-15T23:53:56.331847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.385437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333521+0000","last_change":"2024-09-15T23:53:50.766752+0000","last_active":"2024-09-15T23:53:56.333521+0000","last_peered":"2024-09-15T23:53:56.333521+0000","last_clean":"2024-09-15T23:53:56.333521+0000","last_became_active":"2024-09-15T23:53:50.766370+0000","last_became_peered":"2024-09-15T23:53:50.766370+0000","last_unstale":"2024-09-15T23:53:56.333521+0000","last_undegraded":"2024-09-15T23:53:56.333521+0000","last_fullsized":"2024-09-15T23:53:56.333521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:21.225015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332124+0000","last_change":"2024-09-15T23:53:50.778292+0000","last_active":"2024-09-15T23:53:56.332124+0000","last_peered":"2024-09-15T23:53:56.332124+0000","last_clean":"2024-09-15T23:53:56.332124+0000","last_became_active":"2024-09-15T23:53:50.777039+0000","last_became_peered":"2024-09-15T23:53:50.777039+0000","last_unstale":"2024-09-15T23:53:56.332124+0000","last_undegraded":"2024-09-15T23:53:56.332124+0000","last_fullsized":"2024-09-15T23:53:56.332124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805410+0000","last_change":"2024-09-15T23:53:50.771054+0000","last_active":"2024-09-15T23:53:55.805410+0000","last_peered":"2024-09-15T23:53:55.805410+0000","last_clean":"2024-09-15T23:53:55.805410+0000","last_became_active":"2024-09-15T23:53:50.770590+0000","last_became_peered":"2024-09-15T23:53:50.770590+0000","last_unstale":"2024-09-15T23:53:55.805410+0000","last_undegraded":"2024-09-15T23:53:55.805410+0000","last_fullsized":"2024-09-15T23:53:55.805410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:49.569731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805743+0000","last_change":"2024-09-15T23:53:50.769203+0000","last_active":"2024-09-15T23:53:55.805743+0000","last_peered":"2024-09-15T23:53:55.805743+0000","last_clean":"2024-09-15T23:53:55.805743+0000","last_became_active":"2024-09-15T23:53:50.768887+0000","last_became_peered":"2024-09-15T23:53:50.768887+0000","last_unstale":"2024-09-15T23:53:55.805743+0000","last_undegraded":"2024-09-15T23:53:55.805743+0000","last_fullsized":"2024-09-15T23:53:55.805743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:19.928453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333350+0000","last_change":"2024-09-15T23:53:50.766909+0000","last_active":"2024-09-15T23:53:56.333350+0000","last_peered":"2024-09-15T23:53:56.333350+0000","last_clean":"2024-09-15T23:53:56.333350+0000","last_became_active":"2024-09-15T23:53:50.766411+0000","last_became_peered":"2024-09-15T23:53:50.766411+0000","last_unstale":"2024-09-15T23:53:56.333350+0000","last_undegraded":"2024-09-15T23:53:56.333350+0000","last_fullsized":"2024-09-15T23:53:56.333350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:14.331012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":106766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":111282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":107348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":110610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":868352,"data_stored":697204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":697226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:54:05.686 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:54:05.686 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T23:54:05.687 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-15T23:54:05.687 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-15T23:54:05.687 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-15T23:54:05.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f6595e92640 1 Processor -- start 2024-09-15T23:54:05.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f6595e92640 1 -- start start 2024-09-15T23:54:05.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f6595e92640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65900adf80 0x7f659015f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f6595e92640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65900af630 con 0x7f65901554c0 2024-09-15T23:54:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f6595e92640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65900af910 con 0x7f65901550e0 2024-09-15T23:54:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f6595e92640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f65900afbf0 con 0x7f65900adf80 2024-09-15T23:54:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658ffff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f65901554c0 0x7f65900b5f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49670/0 (socket says 172.21.15.112:49670) 2024-09-15T23:54:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658ffff640 1 -- 172.21.15.112:0/3707668770 learned_addr learned my addr 172.21.15.112:0/3707668770 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658effd640 1 --2- 172.21.15.112:0/3707668770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65900adf80 0x7f659015f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 -- 172.21.15.112:0/3707668770 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1696549530 0 0) 0x7f65900af630 con 0x7f65901554c0 2024-09-15T23:54:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 -- 172.21.15.112:0/3707668770 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6570003530 con 0x7f65901554c0 2024-09-15T23:54:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 -- 172.21.15.112:0/3707668770 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1484918158 0 0) 0x7f6570003530 con 0x7f65901554c0 2024-09-15T23:54:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 -- 172.21.15.112:0/3707668770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65900adf80 msgr2=0x7f659015f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 --2- 172.21.15.112:0/3707668770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65900adf80 0x7f659015f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 -- 172.21.15.112:0/3707668770 >> v1:172.21.15.169:6789/0 conn(0x7f65901550e0 legacy=0x7f65900ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 -- 172.21.15.112:0/3707668770 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65900afed0 con 0x7f65901554c0 2024-09-15T23:54:05.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 -- 172.21.15.112:0/3707668770 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f6580001680 con 0x7f65901554c0 2024-09-15T23:54:05.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 -- 172.21.15.112:0/3707668770 >> v1:172.21.15.112:6789/0 conn(0x7f65901554c0 legacy=0x7f65900b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 --2- 172.21.15.112:0/3707668770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65900adf80 0x7f65700039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 --2- 172.21.15.112:0/3707668770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6570003f70 0x7f6570004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 --2- 172.21.15.112:0/3707668770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6570004d50 0x7f65700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 -- 172.21.15.112:0/3707668770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f65900afbf0 con 0x7f6570003f70 2024-09-15T23:54:05.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 -- 172.21.15.112:0/3707668770 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f657000bab0 con 0x7f6570004d50 2024-09-15T23:54:05.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658e7fc640 1 -- 172.21.15.112:0/3707668770 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f657000bcb0 con 0x7f65900adf80 2024-09-15T23:54:05.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658effd640 1 --2- 172.21.15.112:0/3707668770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6570003f70 0x7f6570004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658f7fe640 1 --2- 172.21.15.112:0/3707668770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65900adf80 0x7f65700039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658ffff640 1 --2- 172.21.15.112:0/3707668770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6570004d50 0x7f65700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658effd640 1 -- 172.21.15.112:0/3707668770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65900adf80 msgr2=0x7f65700039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:05.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658effd640 1 --2- 172.21.15.112:0/3707668770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65900adf80 0x7f65700039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658effd640 1 -- 172.21.15.112:0/3707668770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6570004d50 msgr2=0x7f65700051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:05.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658effd640 1 --2- 172.21.15.112:0/3707668770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6570004d50 0x7f65700051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658effd640 1 -- 172.21.15.112:0/3707668770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6570003530 con 0x7f6570003f70 2024-09-15T23:54:05.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.849+0000 7f658ffff640 1 --2- 172.21.15.112:0/3707668770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6570004d50 0x7f65700051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.853+0000 7f658effd640 1 --2- 172.21.15.112:0/3707668770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6570003f70 0x7f6570004810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6578009ae0 tx=0x7f657801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e954f0ade9d33db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.853+0000 7f658e7fc640 1 -- 172.21.15.112:0/3707668770 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65780b2070 con 0x7f6570003f70 2024-09-15T23:54:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.853+0000 7f658e7fc640 1 -- 172.21.15.112:0/3707668770 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65780a5660 con 0x7f6570003f70 2024-09-15T23:54:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.853+0000 7f658e7fc640 1 -- 172.21.15.112:0/3707668770 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65780096b0 con 0x7f6570003f70 2024-09-15T23:54:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.853+0000 7f6595e92640 1 -- 172.21.15.112:0/3707668770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6570003f70 msgr2=0x7f6570004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.853+0000 7f6595e92640 1 --2- 172.21.15.112:0/3707668770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6570003f70 0x7f6570004810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6578009ae0 tx=0x7f657801ca70 comp rx=0 tx=0).stop 2024-09-15T23:54:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.853+0000 7f658ffff640 1 -- 172.21.15.112:0/3707668770 reap_dead start 2024-09-15T23:54:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.853+0000 7f6595e92640 1 -- 172.21.15.112:0/3707668770 shutdown_connections 2024-09-15T23:54:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.853+0000 7f6595e92640 1 -- 172.21.15.112:0/3707668770 >> 172.21.15.112:0/3707668770 conn(0x7f6590072ec0 msgr2=0x7f65900732d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.853+0000 7f6595e92640 1 -- 172.21.15.112:0/3707668770 shutdown_connections 2024-09-15T23:54:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.853+0000 7f6595e92640 1 -- 172.21.15.112:0/3707668770 wait complete. 2024-09-15T23:54:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.853+0000 7f6595e92640 1 Processor -- start 2024-09-15T23:54:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.853+0000 7f6595e92640 1 -- start start 2024-09-15T23:54:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6595e92640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6570003f70 0x7f65900b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6595e92640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f659014e140 0x7f659014e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6595e92640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6590156b60 0x7f6590156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6595e92640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f659006f930 con 0x7f659014e140 2024-09-15T23:54:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6595e92640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f659006f7b0 con 0x7f6570003f70 2024-09-15T23:54:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6595e92640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f659006fab0 con 0x7f6590156b60 2024-09-15T23:54:05.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f658effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f659014e140 0x7f659014e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f658effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f659014e140 0x7f659014e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57410/0 (socket says 172.21.15.112:57410) 2024-09-15T23:54:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f658effd640 1 -- 172.21.15.112:0/3180527822 learned_addr learned my addr 172.21.15.112:0/3180527822 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f658f7fe640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6570003f70 0x7f65900b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f658ffff640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6590156b60 0x7f6590156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f658effd640 1 -- 172.21.15.112:0/3180527822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6590156b60 msgr2=0x7f6590156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f658effd640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6590156b60 0x7f6590156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f658effd640 1 -- 172.21.15.112:0/3180527822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6570003f70 msgr2=0x7f65900b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f658effd640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6570003f70 0x7f65900b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f658effd640 1 -- 172.21.15.112:0/3180527822 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659014eb00 con 0x7f659014e140 2024-09-15T23:54:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f658f7fe640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6570003f70 0x7f65900b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f658effd640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f659014e140 0x7f659014e5c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f657801c8a0 tx=0x7f6570005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6587fff640 1 -- 172.21.15.112:0/3180527822 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65780b2040 con 0x7f659014e140 2024-09-15T23:54:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6587fff640 1 -- 172.21.15.112:0/3180527822 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6578004020 con 0x7f659014e140 2024-09-15T23:54:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6595e92640 1 -- 172.21.15.112:0/3180527822 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6590157890 con 0x7f659014e140 2024-09-15T23:54:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6587fff640 1 -- 172.21.15.112:0/3180527822 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6580001d50 con 0x7f659014e140 2024-09-15T23:54:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6595e92640 1 -- 172.21.15.112:0/3180527822 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6590157e50 con 0x7f659014e140 2024-09-15T23:54:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6595e92640 1 -- 172.21.15.112:0/3180527822 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65900af070 con 0x7f659014e140 2024-09-15T23:54:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6587fff640 1 -- 172.21.15.112:0/3180527822 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65780c0060 con 0x7f659014e140 2024-09-15T23:54:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6587fff640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f65740678f0 0x7f6574069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:05.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f6587fff640 1 -- 172.21.15.112:0/3180527822 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f657811f980 con 0x7f659014e140 2024-09-15T23:54:05.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f658f7fe640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f65740678f0 0x7f6574069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:05.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.857+0000 7f658f7fe640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f65740678f0 0x7f6574069db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6588001dd0 tx=0x7f6588009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:05.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:05.861+0000 7f6587fff640 1 -- 172.21.15.112:0/3180527822 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6578016780 con 0x7f659014e140 2024-09-15T23:54:06.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.065+0000 7f6595e92640 1 -- 172.21.15.112:0/3180527822 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f659006f400 con 0x7f659014e140 2024-09-15T23:54:06.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.069+0000 7f6587fff640 1 -- 172.21.15.112:0/3180527822 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166894 (secure 0 0 0) 0x7f65780f00e0 con 0x7f659014e140 2024-09-15T23:54:06.074 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:06.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.073+0000 7f6595e92640 1 -- 172.21.15.112:0/3180527822 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f65740678f0 msgr2=0x7f6574069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.073+0000 7f6595e92640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f65740678f0 0x7f6574069db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6588001dd0 tx=0x7f6588009040 comp rx=0 tx=0).stop 2024-09-15T23:54:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.073+0000 7f6595e92640 1 -- 172.21.15.112:0/3180527822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f659014e140 msgr2=0x7f659014e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.073+0000 7f6595e92640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f659014e140 0x7f659014e5c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f657801c8a0 tx=0x7f6570005840 comp rx=0 tx=0).stop 2024-09-15T23:54:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.073+0000 7f6595e92640 1 -- 172.21.15.112:0/3180527822 shutdown_connections 2024-09-15T23:54:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.073+0000 7f6595e92640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f65740678f0 0x7f6574069db0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.073+0000 7f6595e92640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6590156b60 0x7f6590156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.073+0000 7f6595e92640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f659014e140 0x7f659014e5c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.073+0000 7f6595e92640 1 --2- 172.21.15.112:0/3180527822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6570003f70 0x7f65900b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.073+0000 7f6595e92640 1 -- 172.21.15.112:0/3180527822 >> 172.21.15.112:0/3180527822 conn(0x7f6590072ec0 msgr2=0x7f65900732d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.073+0000 7f6595e92640 1 -- 172.21.15.112:0/3180527822 shutdown_connections 2024-09-15T23:54:06.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.073+0000 7f6595e92640 1 -- 172.21.15.112:0/3180527822 wait complete. 2024-09-15T23:54:06.091 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3086417580},{"type":"v1","addr":"172.21.15.112:6833","nonce":3086417580}]},"active_addr":"172.21.15.112:6833/3086417580","active_change":"2024-09-15T23:53:31.216531+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":1732672235}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3119862945}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3151765781}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":3212479099}]}]} 2024-09-15T23:54:06.096 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-15T23:54:06.096 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-15T23:54:06.096 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:06.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.213+0000 7fe068fb5640 1 Processor -- start 2024-09-15T23:54:06.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.213+0000 7fe068fb5640 1 -- start start 2024-09-15T23:54:06.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe068fb5640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe06406f010 0x7fe064166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe068fb5640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0640b3290 con 0x7fe06415c2a0 2024-09-15T23:54:06.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe068fb5640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0640b3570 con 0x7fe06415bec0 2024-09-15T23:54:06.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe068fb5640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe0640b3850 con 0x7fe06406f010 2024-09-15T23:54:06.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe061d9b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe06415c2a0 0x7fe0640aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49672/0 (socket says 172.21.15.112:49672) 2024-09-15T23:54:06.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe061d9b640 1 -- 172.21.15.112:0/1158895550 learned_addr learned my addr 172.21.15.112:0/1158895550 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:06.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe062d9d640 1 --2- 172.21.15.112:0/1158895550 >> v2:172.21.15.169:3300/0 conn(0x7fe06406f010 0x7fe064166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 -- 172.21.15.112:0/1158895550 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867579993 0 0) 0x7fe0640b3290 con 0x7fe06415c2a0 2024-09-15T23:54:06.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 -- 172.21.15.112:0/1158895550 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe04c003530 con 0x7fe06415c2a0 2024-09-15T23:54:06.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 -- 172.21.15.112:0/1158895550 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 611075790 0 0) 0x7fe04c003530 con 0x7fe06415c2a0 2024-09-15T23:54:06.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 -- 172.21.15.112:0/1158895550 >> v2:172.21.15.169:3300/0 conn(0x7fe06406f010 msgr2=0x7fe064166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 --2- 172.21.15.112:0/1158895550 >> v2:172.21.15.169:3300/0 conn(0x7fe06406f010 0x7fe064166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 -- 172.21.15.112:0/1158895550 >> v1:172.21.15.169:6789/0 conn(0x7fe06415bec0 legacy=0x7fe0640ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 -- 172.21.15.112:0/1158895550 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0640b3b30 con 0x7fe06415c2a0 2024-09-15T23:54:06.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 -- 172.21.15.112:0/1158895550 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fe054001680 con 0x7fe06415c2a0 2024-09-15T23:54:06.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 -- 172.21.15.112:0/1158895550 >> v1:172.21.15.112:6789/0 conn(0x7fe06415c2a0 legacy=0x7fe0640aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 --2- 172.21.15.112:0/1158895550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe04c0039c0 0x7fe04c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 --2- 172.21.15.112:0/1158895550 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe04c004810 0x7fe04c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 --2- 172.21.15.112:0/1158895550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c0051d0 0x7fe04c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 -- 172.21.15.112:0/1158895550 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe0640b3850 con 0x7fe04c0051d0 2024-09-15T23:54:06.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 -- 172.21.15.112:0/1158895550 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c00c070 con 0x7fe04c0039c0 2024-09-15T23:54:06.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06159a640 1 -- 172.21.15.112:0/1158895550 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe04c00c270 con 0x7fe04c004810 2024-09-15T23:54:06.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe062d9d640 1 --2- 172.21.15.112:0/1158895550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c0051d0 0x7fe04c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06259c640 1 --2- 172.21.15.112:0/1158895550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe04c0039c0 0x7fe04c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe062d9d640 1 -- 172.21.15.112:0/1158895550 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe04c004810 msgr2=0x7fe04c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe061d9b640 1 --2- 172.21.15.112:0/1158895550 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe04c004810 0x7fe04c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe062d9d640 1 --2- 172.21.15.112:0/1158895550 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe04c004810 0x7fe04c004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe062d9d640 1 -- 172.21.15.112:0/1158895550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe04c0039c0 msgr2=0x7fe04c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe062d9d640 1 --2- 172.21.15.112:0/1158895550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe04c0039c0 0x7fe04c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe062d9d640 1 -- 172.21.15.112:0/1158895550 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04c003530 con 0x7fe04c0051d0 2024-09-15T23:54:06.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.217+0000 7fe06259c640 1 --2- 172.21.15.112:0/1158895550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe04c0039c0 0x7fe04c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:06.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe062d9d640 1 -- 172.21.15.112:0/1158895550 reap_dead start 2024-09-15T23:54:06.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe062d9d640 1 --2- 172.21.15.112:0/1158895550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c0051d0 0x7fe04c00b9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009f70 tx=0x7fe05c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0f572c340e1b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe06159a640 1 -- 172.21.15.112:0/1158895550 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c0b2070 con 0x7fe04c0051d0 2024-09-15T23:54:06.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe06159a640 1 -- 172.21.15.112:0/1158895550 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe05c0a5d30 con 0x7fe04c0051d0 2024-09-15T23:54:06.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe06159a640 1 -- 172.21.15.112:0/1158895550 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c009bf0 con 0x7fe04c0051d0 2024-09-15T23:54:06.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 -- 172.21.15.112:0/1158895550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c0051d0 msgr2=0x7fe04c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 --2- 172.21.15.112:0/1158895550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c0051d0 0x7fe04c00b9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009f70 tx=0x7fe05c01cc60 comp rx=0 tx=0).stop 2024-09-15T23:54:06.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 -- 172.21.15.112:0/1158895550 shutdown_connections 2024-09-15T23:54:06.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 --2- 172.21.15.112:0/1158895550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe04c0051d0 0x7fe04c00b9d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 -- 172.21.15.112:0/1158895550 >> 172.21.15.112:0/1158895550 conn(0x7fe0640b1f90 msgr2=0x7fe0640b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:06.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 -- 172.21.15.112:0/1158895550 shutdown_connections 2024-09-15T23:54:06.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 -- 172.21.15.112:0/1158895550 wait complete. 2024-09-15T23:54:06.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 Processor -- start 2024-09-15T23:54:06.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 -- start start 2024-09-15T23:54:06.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe04c0051d0 0x7fe0641e5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0640734f0 0x7fe0641e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0641574e0 0x7fe0641e7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe0640afc90 con 0x7fe0640734f0 2024-09-15T23:54:06.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0640b40f0 con 0x7fe0641574e0 2024-09-15T23:54:06.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe068fb5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe0640ad200 con 0x7fe04c0051d0 2024-09-15T23:54:06.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe061d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0640734f0 0x7fe0641e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe061d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0640734f0 0x7fe0641e6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57428/0 (socket says 172.21.15.112:57428) 2024-09-15T23:54:06.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe061d9b640 1 -- 172.21.15.112:0/4063225936 learned_addr learned my addr 172.21.15.112:0/4063225936 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:06.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe06259c640 1 --2- 172.21.15.112:0/4063225936 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe04c0051d0 0x7fe0641e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe062d9d640 1 --2- 172.21.15.112:0/4063225936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0641574e0 0x7fe0641e7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe061d9b640 1 -- 172.21.15.112:0/4063225936 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe04c0051d0 msgr2=0x7fe0641e5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe061d9b640 1 --2- 172.21.15.112:0/4063225936 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe04c0051d0 0x7fe0641e5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe061d9b640 1 -- 172.21.15.112:0/4063225936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0641574e0 msgr2=0x7fe0641e7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe061d9b640 1 --2- 172.21.15.112:0/4063225936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0641574e0 0x7fe0641e7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe061d9b640 1 -- 172.21.15.112:0/4063225936 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0641e7500 con 0x7fe0640734f0 2024-09-15T23:54:06.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe061d9b640 1 --2- 172.21.15.112:0/4063225936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0640734f0 0x7fe0641e6fc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe05400d7d0 tx=0x7fe05400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.221+0000 7fe052ffd640 1 -- 172.21.15.112:0/4063225936 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe054019070 con 0x7fe0640734f0 2024-09-15T23:54:06.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.225+0000 7fe052ffd640 1 -- 172.21.15.112:0/4063225936 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0540074e0 con 0x7fe0640734f0 2024-09-15T23:54:06.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.225+0000 7fe052ffd640 1 -- 172.21.15.112:0/4063225936 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0540049f0 con 0x7fe0640734f0 2024-09-15T23:54:06.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.225+0000 7fe068fb5640 1 -- 172.21.15.112:0/4063225936 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0641e5f20 con 0x7fe0640734f0 2024-09-15T23:54:06.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.225+0000 7fe068fb5640 1 -- 172.21.15.112:0/4063225936 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0641e67c0 con 0x7fe0640734f0 2024-09-15T23:54:06.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.225+0000 7fe068fb5640 1 -- 172.21.15.112:0/4063225936 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0640ad590 con 0x7fe0640734f0 2024-09-15T23:54:06.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.225+0000 7fe052ffd640 1 -- 172.21.15.112:0/4063225936 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe05401c070 con 0x7fe0640734f0 2024-09-15T23:54:06.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.225+0000 7fe052ffd640 1 --2- 172.21.15.112:0/4063225936 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe0440678f0 0x7fe044069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.225+0000 7fe052ffd640 1 -- 172.21.15.112:0/4063225936 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe0540859f0 con 0x7fe0640734f0 2024-09-15T23:54:06.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.225+0000 7fe06259c640 1 --2- 172.21.15.112:0/4063225936 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe0440678f0 0x7fe044069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.225+0000 7fe06259c640 1 --2- 172.21.15.112:0/4063225936 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe0440678f0 0x7fe044069db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe058000f70 tx=0x7fe058009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.229+0000 7fe052ffd640 1 -- 172.21.15.112:0/4063225936 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe054056160 con 0x7fe0640734f0 2024-09-15T23:54:06.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.385+0000 7fe068fb5640 1 -- 172.21.15.112:0/4063225936 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe06406fcd0 con 0x7fe0640734f0 2024-09-15T23:54:06.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.385+0000 7fe052ffd640 1 -- 172.21.15.112:0/4063225936 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7fe054055a60 con 0x7fe0640734f0 2024-09-15T23:54:06.389 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:06.389 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:55.161085+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:53:47.908190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:53:49.056283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:53:52.808895+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:06.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.389+0000 7fe068fb5640 1 -- 172.21.15.112:0/4063225936 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe0440678f0 msgr2=0x7fe044069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.389+0000 7fe068fb5640 1 --2- 172.21.15.112:0/4063225936 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe0440678f0 0x7fe044069db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe058000f70 tx=0x7fe058009040 comp rx=0 tx=0).stop 2024-09-15T23:54:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.389+0000 7fe068fb5640 1 -- 172.21.15.112:0/4063225936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0640734f0 msgr2=0x7fe0641e6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.389+0000 7fe068fb5640 1 --2- 172.21.15.112:0/4063225936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0640734f0 0x7fe0641e6fc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe05400d7d0 tx=0x7fe05400dc90 comp rx=0 tx=0).stop 2024-09-15T23:54:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.389+0000 7fe068fb5640 1 -- 172.21.15.112:0/4063225936 shutdown_connections 2024-09-15T23:54:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.389+0000 7fe068fb5640 1 --2- 172.21.15.112:0/4063225936 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe0440678f0 0x7fe044069db0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.389+0000 7fe068fb5640 1 --2- 172.21.15.112:0/4063225936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0641574e0 0x7fe0641e7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.389+0000 7fe068fb5640 1 --2- 172.21.15.112:0/4063225936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0640734f0 0x7fe0641e6fc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.389+0000 7fe068fb5640 1 --2- 172.21.15.112:0/4063225936 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe04c0051d0 0x7fe0641e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.389+0000 7fe068fb5640 1 -- 172.21.15.112:0/4063225936 >> 172.21.15.112:0/4063225936 conn(0x7fe0640b1f90 msgr2=0x7fe06415a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.389+0000 7fe068fb5640 1 -- 172.21.15.112:0/4063225936 shutdown_connections 2024-09-15T23:54:06.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.389+0000 7fe068fb5640 1 -- 172.21.15.112:0/4063225936 wait complete. 2024-09-15T23:54:06.406 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-15T23:54:06.406 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:06.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183fff9640 1 Processor -- start 2024-09-15T23:54:06.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183fff9640 1 -- start start 2024-09-15T23:54:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183fff9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1838070020 0x7f183815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183fff9640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18380aede0 con 0x7f183815f1d0 2024-09-15T23:54:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183fff9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183815fa10 con 0x7f18381520a0 2024-09-15T23:54:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183fff9640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1838152480 con 0x7f1838070020 2024-09-15T23:54:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183e596640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f183815f1d0 0x7f18380adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49676/0 (socket says 172.21.15.112:49676) 2024-09-15T23:54:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183e596640 1 -- 172.21.15.112:0/4156658934 learned_addr learned my addr 172.21.15.112:0/4156658934 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183d594640 1 --2- 172.21.15.112:0/4156658934 >> v2:172.21.15.169:3300/0 conn(0x7f1838070020 0x7f183815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 -- 172.21.15.112:0/4156658934 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2649334038 0 0) 0x7f18380aede0 con 0x7f183815f1d0 2024-09-15T23:54:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 -- 172.21.15.112:0/4156658934 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1824003530 con 0x7f183815f1d0 2024-09-15T23:54:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 -- 172.21.15.112:0/4156658934 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3152165461 0 0) 0x7f1824003530 con 0x7f183815f1d0 2024-09-15T23:54:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 -- 172.21.15.112:0/4156658934 >> v2:172.21.15.169:3300/0 conn(0x7f1838070020 msgr2=0x7f183815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 --2- 172.21.15.112:0/4156658934 >> v2:172.21.15.169:3300/0 conn(0x7f1838070020 0x7f183815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 -- 172.21.15.112:0/4156658934 >> v1:172.21.15.169:6789/0 conn(0x7f18381520a0 legacy=0x7f183806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 -- 172.21.15.112:0/4156658934 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1838074250 con 0x7f183815f1d0 2024-09-15T23:54:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 -- 172.21.15.112:0/4156658934 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f1830001a00 con 0x7f183815f1d0 2024-09-15T23:54:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 -- 172.21.15.112:0/4156658934 >> v1:172.21.15.112:6789/0 conn(0x7f183815f1d0 legacy=0x7f18380adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 --2- 172.21.15.112:0/4156658934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18240039c0 0x7f1824003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 --2- 172.21.15.112:0/4156658934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1824004810 0x7f1824004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 --2- 172.21.15.112:0/4156658934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18240051d0 0x7f182400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 -- 172.21.15.112:0/4156658934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f182400c040 con 0x7f18240039c0 2024-09-15T23:54:06.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 -- 172.21.15.112:0/4156658934 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f182400c1f0 con 0x7f1824004810 2024-09-15T23:54:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183cd93640 1 -- 172.21.15.112:0/4156658934 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f182400c3f0 con 0x7f18240051d0 2024-09-15T23:54:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183dd95640 1 --2- 172.21.15.112:0/4156658934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18240039c0 0x7f1824003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183d594640 1 --2- 172.21.15.112:0/4156658934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1824004810 0x7f1824004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183dd95640 1 -- 172.21.15.112:0/4156658934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18240051d0 msgr2=0x7f182400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183dd95640 1 --2- 172.21.15.112:0/4156658934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18240051d0 0x7f182400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183dd95640 1 -- 172.21.15.112:0/4156658934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1824004810 msgr2=0x7f1824004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183dd95640 1 --2- 172.21.15.112:0/4156658934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1824004810 0x7f1824004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183dd95640 1 -- 172.21.15.112:0/4156658934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1824003530 con 0x7f18240039c0 2024-09-15T23:54:06.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.525+0000 7f183e596640 1 -- 172.21.15.112:0/4156658934 reap_dead start 2024-09-15T23:54:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183dd95640 1 --2- 172.21.15.112:0/4156658934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18240039c0 0x7f1824003de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1834001780 tx=0x7f183401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a229819c1e91f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183cd93640 1 -- 172.21.15.112:0/4156658934 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18340013a0 con 0x7f18240039c0 2024-09-15T23:54:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183cd93640 1 -- 172.21.15.112:0/4156658934 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18340052f0 con 0x7f18240039c0 2024-09-15T23:54:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183cd93640 1 -- 172.21.15.112:0/4156658934 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834003840 con 0x7f18240039c0 2024-09-15T23:54:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 -- 172.21.15.112:0/4156658934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18240039c0 msgr2=0x7f1824003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 --2- 172.21.15.112:0/4156658934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18240039c0 0x7f1824003de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1834001780 tx=0x7f183401c3d0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 -- 172.21.15.112:0/4156658934 shutdown_connections 2024-09-15T23:54:06.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 --2- 172.21.15.112:0/4156658934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18240039c0 0x7f1824003de0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 -- 172.21.15.112:0/4156658934 >> 172.21.15.112:0/4156658934 conn(0x7f18380b1f90 msgr2=0x7f18380b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 -- 172.21.15.112:0/4156658934 shutdown_connections 2024-09-15T23:54:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 -- 172.21.15.112:0/4156658934 wait complete. 2024-09-15T23:54:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 Processor -- start 2024-09-15T23:54:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 -- start start 2024-09-15T23:54:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18240039c0 0x7f183809dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f183814f550 0x7f183806e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1838140480 0x7f183806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1838073d30 con 0x7f18240039c0 2024-09-15T23:54:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1838073a50 con 0x7f183814f550 2024-09-15T23:54:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183fff9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f183815f5e0 con 0x7f1838140480 2024-09-15T23:54:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.529+0000 7f183dd95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18240039c0 0x7f183809dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183dd95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18240039c0 0x7f183809dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57444/0 (socket says 172.21.15.112:57444) 2024-09-15T23:54:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183dd95640 1 -- 172.21.15.112:0/2730208963 learned_addr learned my addr 172.21.15.112:0/2730208963 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183d594640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f183814f550 0x7f183806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183e596640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1838140480 0x7f183806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183dd95640 1 -- 172.21.15.112:0/2730208963 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1838140480 msgr2=0x7f183806ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183dd95640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1838140480 0x7f183806ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183dd95640 1 -- 172.21.15.112:0/2730208963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f183814f550 msgr2=0x7f183806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183dd95640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f183814f550 0x7f183806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183dd95640 1 -- 172.21.15.112:0/2730208963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183809e290 con 0x7f18240039c0 2024-09-15T23:54:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183d594640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f183814f550 0x7f183806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183dd95640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18240039c0 0x7f183809dd50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f183401c200 tx=0x7f1824005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f182e7fc640 1 -- 172.21.15.112:0/2730208963 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834007a40 con 0x7f18240039c0 2024-09-15T23:54:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f182e7fc640 1 -- 172.21.15.112:0/2730208963 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18340ba070 con 0x7f18240039c0 2024-09-15T23:54:06.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183fff9640 1 -- 172.21.15.112:0/2730208963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1838140a50 con 0x7f18240039c0 2024-09-15T23:54:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f182e7fc640 1 -- 172.21.15.112:0/2730208963 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18340013a0 con 0x7f18240039c0 2024-09-15T23:54:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183fff9640 1 -- 172.21.15.112:0/2730208963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1838141010 con 0x7f18240039c0 2024-09-15T23:54:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183fff9640 1 -- 172.21.15.112:0/2730208963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1838068e50 con 0x7f18240039c0 2024-09-15T23:54:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f182e7fc640 1 -- 172.21.15.112:0/2730208963 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f18340052f0 con 0x7f18240039c0 2024-09-15T23:54:06.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f182e7fc640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f181c0678f0 0x7f181c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183d594640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f181c0678f0 0x7f181c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f182e7fc640 1 -- 172.21.15.112:0/2730208963 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1834120370 con 0x7f18240039c0 2024-09-15T23:54:06.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.533+0000 7f183d594640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f181c0678f0 0x7f181c069db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f18381415d0 tx=0x7f1828008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.537+0000 7f182e7fc640 1 -- 172.21.15.112:0/2730208963 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1834016110 con 0x7f18240039c0 2024-09-15T23:54:06.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.705+0000 7f183fff9640 1 -- 172.21.15.112:0/2730208963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18380aede0 con 0x7f18240039c0 2024-09-15T23:54:06.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.705+0000 7f182e7fc640 1 -- 172.21.15.112:0/2730208963 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7f18340f0c00 con 0x7f18240039c0 2024-09-15T23:54:06.709 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:06.710 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:55.161085+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:53:47.908190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:53:49.056283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:53:52.808895+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:06.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.709+0000 7f183fff9640 1 -- 172.21.15.112:0/2730208963 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f181c0678f0 msgr2=0x7f181c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.709+0000 7f183fff9640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f181c0678f0 0x7f181c069db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f18381415d0 tx=0x7f1828008040 comp rx=0 tx=0).stop 2024-09-15T23:54:06.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.709+0000 7f183fff9640 1 -- 172.21.15.112:0/2730208963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18240039c0 msgr2=0x7f183809dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.709+0000 7f183fff9640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18240039c0 0x7f183809dd50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f183401c200 tx=0x7f1824005840 comp rx=0 tx=0).stop 2024-09-15T23:54:06.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.709+0000 7f183fff9640 1 -- 172.21.15.112:0/2730208963 shutdown_connections 2024-09-15T23:54:06.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.709+0000 7f183fff9640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f181c0678f0 0x7f181c069db0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.709+0000 7f183fff9640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1838140480 0x7f183806ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.709+0000 7f183fff9640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f183814f550 0x7f183806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.709+0000 7f183fff9640 1 --2- 172.21.15.112:0/2730208963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18240039c0 0x7f183809dd50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.709+0000 7f183fff9640 1 -- 172.21.15.112:0/2730208963 >> 172.21.15.112:0/2730208963 conn(0x7f18380b1f90 msgr2=0x7f183815da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:06.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.709+0000 7f183fff9640 1 -- 172.21.15.112:0/2730208963 shutdown_connections 2024-09-15T23:54:06.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.709+0000 7f183fff9640 1 -- 172.21.15.112:0/2730208963 wait complete. 2024-09-15T23:54:06.729 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-15T23:54:06.730 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-15T23:54:06.730 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-15T23:54:06.731 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-15T23:54:06.731 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-15T23:54:06.732 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-15T23:54:06.732 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-15T23:54:06.733 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-15T23:54:06.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7faf1f923640 1 Processor -- start 2024-09-15T23:54:06.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7faf1f923640 1 -- start start 2024-09-15T23:54:06.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7faf1f923640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faf180b2fd0 0x7faf180b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7faf1f923640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf1815aec0 con 0x7faf18072db0 2024-09-15T23:54:06.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7faf1f923640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf1815b1a0 con 0x7faf1815a200 2024-09-15T23:54:06.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7faf1f923640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7faf1815b480 con 0x7faf180b2fd0 2024-09-15T23:54:06.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7faf1cebe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7faf18072db0 0x7faf18072340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49692/0 (socket says 172.21.15.112:49692) 2024-09-15T23:54:06.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7faf1dec0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faf180b2fd0 0x7faf180b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7faf1d6bf640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7faf1815a200 0x7faf1815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:35112/0 (socket says 172.21.15.112:35112) 2024-09-15T23:54:06.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7faf1cebe640 1 -- 172.21.15.112:0/2306007969 learned_addr learned my addr 172.21.15.112:0/2306007969 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:06.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7faf0ffff640 1 -- 172.21.15.112:0/2306007969 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3312914436 0 0) 0x7faf1815aec0 con 0x7faf18072db0 2024-09-15T23:54:06.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7faf1dec0640 1 -- 172.21.15.112:0/2306007969 >> v1:172.21.15.169:6789/0 conn(0x7faf1815a200 legacy=0x7faf1815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7faf1dec0640 1 -- 172.21.15.112:0/2306007969 >> v1:172.21.15.112:6789/0 conn(0x7faf18072db0 legacy=0x7faf18072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7faf1dec0640 1 -- 172.21.15.112:0/2306007969 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf18071e20 con 0x7faf180b2fd0 2024-09-15T23:54:06.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7f7e91e10640 1 Processor -- start 2024-09-15T23:54:06.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7f7e91e10640 1 -- start start 2024-09-15T23:54:06.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7f8e0b05e640 1 Processor -- start 2024-09-15T23:54:06.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7f8e0b05e640 1 -- start start 2024-09-15T23:54:06.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7f7e91e10640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e8c08b530 0x7f7e8c0b3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7f7e91e10640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7e8c16def0 0x7f7e8c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7f7e91e10640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e8c0b3e40 con 0x7f7e8c16e330 2024-09-15T23:54:06.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7f7e91e10640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7e8c0cd900 con 0x7f7e8c16def0 2024-09-15T23:54:06.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.909+0000 7f7e91e10640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8c0cdbe0 con 0x7f7e8c08b530 2024-09-15T23:54:06.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e9160f640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7e8c16e330 0x7f7e8c0ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49708/0 (socket says 172.21.15.112:49708) 2024-09-15T23:54:06.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e9160f640 1 -- 172.21.15.112:0/274067021 learned_addr learned my addr 172.21.15.112:0/274067021 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:06.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 -- 172.21.15.112:0/274067021 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3827259134 0 0) 0x7f7e8c0b3e40 con 0x7f7e8c16e330 2024-09-15T23:54:06.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 -- 172.21.15.112:0/274067021 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e7c003530 con 0x7f7e8c16e330 2024-09-15T23:54:06.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 -- 172.21.15.112:0/274067021 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 822312553 0 0) 0x7f7e7c003530 con 0x7f7e8c16e330 2024-09-15T23:54:06.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 -- 172.21.15.112:0/274067021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e8c08b530 msgr2=0x7f7e8c0b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 --2- 172.21.15.112:0/274067021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e8c08b530 0x7f7e8c0b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 -- 172.21.15.112:0/274067021 >> v2:172.21.15.169:3300/0 conn(0x7f7e8c16def0 msgr2=0x7f7e8c0b4d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:54:06.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 --2- 172.21.15.112:0/274067021 >> v2:172.21.15.169:3300/0 conn(0x7f7e8c16def0 0x7f7e8c0b4d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 -- 172.21.15.112:0/274067021 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c0cdec0 con 0x7f7e8c16e330 2024-09-15T23:54:06.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 -- 172.21.15.112:0/274067021 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f7e84001a20 con 0x7f7e8c16e330 2024-09-15T23:54:06.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 -- 172.21.15.112:0/274067021 >> v1:172.21.15.112:6789/0 conn(0x7f7e8c16e330 legacy=0x7f7e8c0ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 --2- 172.21.15.112:0/274067021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7c0039c0 0x7f7e7c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 --2- 172.21.15.112:0/274067021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7c004810 0x7f7e7c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 --2- 172.21.15.112:0/274067021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7c0052f0 0x7f7e7c01c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f8e0b05e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e04070560 0x7f8e040d0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f8e0b05e640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e040b0b70 con 0x7f8e04070940 2024-09-15T23:54:06.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f8e0b05e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e0415bf70 con 0x7f8e040d0c80 2024-09-15T23:54:06.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f8e0b05e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8e0415c250 con 0x7f8e04070560 2024-09-15T23:54:06.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f8e095fb640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8e04070940 0x7f8e0415c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49712/0 (socket says 172.21.15.112:49712) 2024-09-15T23:54:06.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f8e095fb640 1 -- 172.21.15.112:0/188691300 learned_addr learned my addr 172.21.15.112:0/188691300 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:06.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f8e08dfa640 1 --2- 172.21.15.112:0/188691300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e04070560 0x7f8e040d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8bfff640 1 --2- 172.21.15.112:0/274067021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7c004810 0x7f7e7c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 -- 172.21.15.112:0/274067021 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c0cd900 con 0x7f7e7c004810 2024-09-15T23:54:06.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 -- 172.21.15.112:0/274067021 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c0cdbe0 con 0x7f7e7c0039c0 2024-09-15T23:54:06.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8b7fe640 1 -- 172.21.15.112:0/274067021 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7e7c01d1f0 con 0x7f7e7c0052f0 2024-09-15T23:54:06.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f4a5e96c640 1 Processor -- start 2024-09-15T23:54:06.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f4a5e96c640 1 -- start start 2024-09-15T23:54:06.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f8e037fe640 1 -- 172.21.15.112:0/188691300 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1842409633 0 0) 0x7f8e040b0b70 con 0x7f8e04070940 2024-09-15T23:54:06.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f8e037fe640 1 -- 172.21.15.112:0/188691300 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8df4005740 con 0x7f8e04070940 2024-09-15T23:54:06.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f8e037fe640 1 -- 172.21.15.112:0/188691300 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4211484020 0 0) 0x7f8e0415bf70 con 0x7f8e040d0c80 2024-09-15T23:54:06.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f8e037fe640 1 -- 172.21.15.112:0/188691300 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e040b0b70 con 0x7f8e040d0c80 2024-09-15T23:54:06.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f5ac640d640 1 Processor -- start 2024-09-15T23:54:06.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f5ac640d640 1 -- start start 2024-09-15T23:54:06.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e9160f640 1 --2- 172.21.15.112:0/274067021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7c0052f0 0x7f7e7c01c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8bfff640 1 -- 172.21.15.112:0/274067021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7c0052f0 msgr2=0x7f7e7c01c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8bfff640 1 --2- 172.21.15.112:0/274067021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7c0052f0 0x7f7e7c01c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8bfff640 1 -- 172.21.15.112:0/274067021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7c0039c0 msgr2=0x7f7e7c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8bfff640 1 --2- 172.21.15.112:0/274067021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7c0039c0 0x7f7e7c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f7e8bfff640 1 -- 172.21.15.112:0/274067021 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c003530 con 0x7f7e7c004810 2024-09-15T23:54:06.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7faf1dec0640 1 --2- 172.21.15.112:0/2306007969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf180b2fd0 0x7faf180b3420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faf080071d0 tx=0x7faf0801d470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=574bea7194eb3973 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f4a5e96c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a580cd3e0 0x7f4a5815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7faf0ffff640 1 -- 172.21.15.112:0/2306007969 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf080b2070 con 0x7faf180b2fd0 2024-09-15T23:54:06.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7faf0ffff640 1 -- 172.21.15.112:0/2306007969 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf08008be0 con 0x7faf180b2fd0 2024-09-15T23:54:06.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7faf0ffff640 1 -- 172.21.15.112:0/2306007969 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0800a0d0 con 0x7faf180b2fd0 2024-09-15T23:54:06.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f8e08dfa640 1 -- 172.21.15.112:0/188691300 >> v1:172.21.15.169:6789/0 conn(0x7f8e040d0c80 legacy=0x7f8e0415b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f8e08dfa640 1 -- 172.21.15.112:0/188691300 >> v1:172.21.15.112:6789/0 conn(0x7f8e04070940 legacy=0x7f8e0415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f8e08dfa640 1 -- 172.21.15.112:0/188691300 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e040cff60 con 0x7f8e04070560 2024-09-15T23:54:06.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f4a5e96c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a580b5200 0x7f4a580b5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f4a5e96c640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a580cd8e0 con 0x7f4a5815f520 2024-09-15T23:54:06.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f4a5e96c640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4a5815d330 con 0x7f4a580cd3e0 2024-09-15T23:54:06.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f4a5e96c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4a580ccc80 con 0x7f4a580b5200 2024-09-15T23:54:06.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f4a5d169640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a580cd3e0 0x7f4a5815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f4a5d169640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a580cd3e0 0x7f4a5815cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57450/0 (socket says 172.21.15.112:57450) 2024-09-15T23:54:06.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f4a5d169640 1 -- 172.21.15.112:0/318479899 learned_addr learned my addr 172.21.15.112:0/318479899 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:06.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f4a5d169640 1 -- 172.21.15.112:0/318479899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a580b5200 msgr2=0x7f4a580b5690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:54:06.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f4a5d169640 1 --2- 172.21.15.112:0/318479899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a580b5200 0x7f4a580b5690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f4a5d169640 1 -- 172.21.15.112:0/318479899 >> v1:172.21.15.112:6789/0 conn(0x7f4a5815f520 legacy=0x7f4a5815d560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:54:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f4a5d169640 1 -- 172.21.15.112:0/318479899 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a580cdbc0 con 0x7f4a580cd3e0 2024-09-15T23:54:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f62be366640 1 Processor -- start 2024-09-15T23:54:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f62be366640 1 -- start start 2024-09-15T23:54:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7faf1f923640 1 -- 172.21.15.112:0/2306007969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf180b2fd0 msgr2=0x7faf180b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7faf1f923640 1 --2- 172.21.15.112:0/2306007969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf180b2fd0 0x7faf180b3420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faf080071d0 tx=0x7faf0801d470 comp rx=0 tx=0).stop 2024-09-15T23:54:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7faf1f923640 1 -- 172.21.15.112:0/2306007969 shutdown_connections 2024-09-15T23:54:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7faf1f923640 1 --2- 172.21.15.112:0/2306007969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf180b2fd0 0x7faf180b3420 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7faf1f923640 1 -- 172.21.15.112:0/2306007969 >> 172.21.15.112:0/2306007969 conn(0x7faf180b1cd0 msgr2=0x7faf180b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f5ac640d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ac00b5910 0x7f5ac00c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f5ac640d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5ac00d2f90 0x7f5ac00b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f5ac640d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac00d4c00 con 0x7f5ac00d2080 2024-09-15T23:54:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62be366640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62b81625d0 0x7f62b81660c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62be366640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b80cf050 con 0x7f62b8067a00 2024-09-15T23:54:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62be366640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b80b3b30 con 0x7f62b80af7d0 2024-09-15T23:54:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62be366640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f62b81629b0 con 0x7f62b81625d0 2024-09-15T23:54:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7faf1f923640 1 -- 172.21.15.112:0/2306007969 shutdown_connections 2024-09-15T23:54:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b77fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f62b8067a00 0x7f62b80ce230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49728/0 (socket says 172.21.15.112:49728) 2024-09-15T23:54:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b77fe640 1 -- 172.21.15.112:0/1352431509 learned_addr learned my addr 172.21.15.112:0/1352431509 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f7e8bfff640 1 --2- 172.21.15.112:0/274067021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7c004810 0x7f7e7c004c90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7e800097d0 tx=0x7f7e8001c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38afdc9660ef2a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b7fff640 1 --2- 172.21.15.112:0/1352431509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62b81625d0 0x7f62b81660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f5ac640d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac00d51c0 con 0x7f5ac00d2f90 2024-09-15T23:54:06.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f5ac640d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac00d49b0 con 0x7f5ac00b5910 2024-09-15T23:54:06.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f5abf7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5ac00d2080 0x7f5ac00d2880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49724/0 (socket says 172.21.15.112:49724) 2024-09-15T23:54:06.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.913+0000 7f5abf7fe640 1 -- 172.21.15.112:0/2961144353 learned_addr learned my addr 172.21.15.112:0/2961144353 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 -- 172.21.15.112:0/2961144353 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1711536982 0 0) 0x7f5ac00d4c00 con 0x7f5ac00d2080 2024-09-15T23:54:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 -- 172.21.15.112:0/2961144353 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa8003530 con 0x7f5ac00d2080 2024-09-15T23:54:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abffff640 1 --2- 172.21.15.112:0/2961144353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ac00b5910 0x7f5ac00c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 -- 172.21.15.112:0/2961144353 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 953552563 0 0) 0x7f5aa8003530 con 0x7f5ac00d2080 2024-09-15T23:54:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 -- 172.21.15.112:0/2961144353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ac00b5910 msgr2=0x7f5ac00c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 --2- 172.21.15.112:0/2961144353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ac00b5910 0x7f5ac00c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 -- 172.21.15.112:0/2961144353 >> v2:172.21.15.169:3300/0 conn(0x7f5ac00d2f90 msgr2=0x7f5ac00b70d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:54:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 --2- 172.21.15.112:0/2961144353 >> v2:172.21.15.169:3300/0 conn(0x7f5ac00d2f90 0x7f5ac00b70d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 -- 172.21.15.112:0/2961144353 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac00d4ee0 con 0x7f5ac00d2080 2024-09-15T23:54:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 -- 172.21.15.112:0/2961144353 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f5ab0001680 con 0x7f5ac00d2080 2024-09-15T23:54:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 -- 172.21.15.112:0/2961144353 >> v1:172.21.15.112:6789/0 conn(0x7f5ac00d2080 legacy=0x7f5ac00d2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 --2- 172.21.15.112:0/2961144353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aa80039c0 0x7f5aa8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 --2- 172.21.15.112:0/2961144353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5aa8004810 0x7f5aa8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 --2- 172.21.15.112:0/2961144353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5aa80051d0 0x7f5aa800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 -- 172.21.15.112:0/2961144353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac00d49b0 con 0x7f5aa80051d0 2024-09-15T23:54:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 -- 172.21.15.112:0/2961144353 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa800c040 con 0x7f5aa8004810 2024-09-15T23:54:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abeffd640 1 -- 172.21.15.112:0/2961144353 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa800c240 con 0x7f5aa80039c0 2024-09-15T23:54:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abf7fe640 1 --2- 172.21.15.112:0/2961144353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5aa8004810 0x7f5aa8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abffff640 1 --2- 172.21.15.112:0/2961144353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aa80039c0 0x7f5aa8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5ac49aa640 1 --2- 172.21.15.112:0/2961144353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5aa80051d0 0x7f5aa800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7faf1f923640 1 -- 172.21.15.112:0/2306007969 wait complete. 2024-09-15T23:54:06.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abffff640 1 -- 172.21.15.112:0/2961144353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5aa8004810 msgr2=0x7f5aa8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 -- 172.21.15.112:0/1352431509 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1554714927 0 0) 0x7f62b80cf050 con 0x7f62b8067a00 2024-09-15T23:54:06.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 -- 172.21.15.112:0/1352431509 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62a0003530 con 0x7f62b8067a00 2024-09-15T23:54:06.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abffff640 1 --2- 172.21.15.112:0/2961144353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5aa8004810 0x7f5aa8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abffff640 1 -- 172.21.15.112:0/2961144353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5aa80051d0 msgr2=0x7f5aa800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abffff640 1 --2- 172.21.15.112:0/2961144353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5aa80051d0 0x7f5aa800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5abffff640 1 -- 172.21.15.112:0/2961144353 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac00d4ee0 con 0x7f5aa80039c0 2024-09-15T23:54:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f8e08dfa640 1 --2- 172.21.15.112:0/188691300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e04070560 0x7f8e040d0740 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8df80097f0 tx=0x7f8df801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc761b728a32e8d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f7e8b7fe640 1 -- 172.21.15.112:0/274067021 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e800b0070 con 0x7f7e7c004810 2024-09-15T23:54:06.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f7e8b7fe640 1 -- 172.21.15.112:0/274067021 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e800ab600 con 0x7f7e7c004810 2024-09-15T23:54:06.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f7e8b7fe640 1 -- 172.21.15.112:0/274067021 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e800093d0 con 0x7f7e7c004810 2024-09-15T23:54:06.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f8e037fe640 1 -- 172.21.15.112:0/188691300 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df80a7070 con 0x7f8e04070560 2024-09-15T23:54:06.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 -- 172.21.15.112:0/1352431509 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1095139501 0 0) 0x7f62a0003530 con 0x7f62b8067a00 2024-09-15T23:54:06.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 -- 172.21.15.112:0/1352431509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62b81625d0 msgr2=0x7f62b81660c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 --2- 172.21.15.112:0/1352431509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62b81625d0 0x7f62b81660c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 -- 172.21.15.112:0/1352431509 >> v1:172.21.15.169:6789/0 conn(0x7f62b80af7d0 legacy=0x7f62b80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 -- 172.21.15.112:0/1352431509 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b8166d20 con 0x7f62b8067a00 2024-09-15T23:54:06.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f8e037fe640 1 -- 172.21.15.112:0/188691300 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df80b0070 con 0x7f8e04070560 2024-09-15T23:54:06.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7faf1f923640 1 Processor -- start 2024-09-15T23:54:06.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f8e037fe640 1 -- 172.21.15.112:0/188691300 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df80ab870 con 0x7f8e04070560 2024-09-15T23:54:06.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f7e91e10640 1 -- 172.21.15.112:0/274067021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7c004810 msgr2=0x7f7e7c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f7e91e10640 1 --2- 172.21.15.112:0/274067021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7c004810 0x7f7e7c004c90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7e800097d0 tx=0x7f7e8001c300 comp rx=0 tx=0).stop 2024-09-15T23:54:06.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f5ac49aa640 1 --2- 172.21.15.112:0/2961144353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5aa80051d0 0x7f5aa800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:54:06.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f8e0b05e640 1 -- 172.21.15.112:0/188691300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e04070560 msgr2=0x7f8e040d0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f8e0b05e640 1 --2- 172.21.15.112:0/188691300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e04070560 0x7f8e040d0740 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8df80097f0 tx=0x7f8df801c4b0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f7e9160f640 1 -- 172.21.15.112:0/274067021 reap_dead start 2024-09-15T23:54:06.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f4a5d169640 1 --2- 172.21.15.112:0/318479899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a580cd3e0 0x7f4a5815cdf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009870 tx=0x7f4a4c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b36daeb8fe380cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f7e91e10640 1 -- 172.21.15.112:0/274067021 shutdown_connections 2024-09-15T23:54:06.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f7e91e10640 1 -- 172.21.15.112:0/274067021 >> 172.21.15.112:0/274067021 conn(0x7f7e8c06d960 msgr2=0x7f7e8c06dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:06.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 -- 172.21.15.112:0/1352431509 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f62a8001660 con 0x7f62b8067a00 2024-09-15T23:54:06.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 -- 172.21.15.112:0/1352431509 >> v1:172.21.15.112:6789/0 conn(0x7f62b8067a00 legacy=0x7f62b80ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 --2- 172.21.15.112:0/1352431509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62a0003a10 0x7f62a0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 --2- 172.21.15.112:0/1352431509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62a0004810 0x7f62a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 --2- 172.21.15.112:0/1352431509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62b81625d0 0x7f62a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 -- 172.21.15.112:0/1352431509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f62a000bb10 con 0x7f62a0004810 2024-09-15T23:54:06.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 -- 172.21.15.112:0/1352431509 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62a000bcc0 con 0x7f62a0003a10 2024-09-15T23:54:06.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62b6ffd640 1 -- 172.21.15.112:0/1352431509 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f62a000bec0 con 0x7f62b81625d0 2024-09-15T23:54:06.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f7e91e10640 1 -- 172.21.15.112:0/274067021 shutdown_connections 2024-09-15T23:54:06.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f62bc903640 1 --2- 172.21.15.112:0/1352431509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62b81625d0 0x7f62a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f62b7fff640 1 --2- 172.21.15.112:0/1352431509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62a0003a10 0x7f62a0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7faf1f923640 1 -- start start 2024-09-15T23:54:06.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1f923640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf18072db0 0x7faf181fb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1f923640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf180b2fd0 0x7faf18164000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1f923640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf1815a200 0x7faf1814b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1f923640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faf18168050 con 0x7faf1815a200 2024-09-15T23:54:06.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1f923640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf18167ed0 con 0x7faf180b2fd0 2024-09-15T23:54:06.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1f923640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faf181681d0 con 0x7faf18072db0 2024-09-15T23:54:06.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.917+0000 7f7e91e10640 1 -- 172.21.15.112:0/274067021 wait complete. 2024-09-15T23:54:06.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1dec0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf1815a200 0x7faf1814b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1dec0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf1815a200 0x7faf1814b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57486/0 (socket says 172.21.15.112:57486) 2024-09-15T23:54:06.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1dec0640 1 -- 172.21.15.112:0/4009195778 learned_addr learned my addr 172.21.15.112:0/4009195778 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:06.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1cebe640 1 --2- 172.21.15.112:0/4009195778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf180b2fd0 0x7faf18164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f8e0b05e640 1 -- 172.21.15.112:0/188691300 shutdown_connections 2024-09-15T23:54:06.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f8e0b05e640 1 --2- 172.21.15.112:0/188691300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e04070560 0x7f8e040d0740 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f8e0b05e640 1 -- 172.21.15.112:0/188691300 >> 172.21.15.112:0/188691300 conn(0x7f8e0406ed30 msgr2=0x7f8e0406f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:06.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f8e0b05e640 1 -- 172.21.15.112:0/188691300 shutdown_connections 2024-09-15T23:54:06.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f62b77fe640 1 --2- 172.21.15.112:0/1352431509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62a0004810 0x7f62a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f62b7fff640 1 -- 172.21.15.112:0/1352431509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62b81625d0 msgr2=0x7f62a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f62b7fff640 1 --2- 172.21.15.112:0/1352431509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62b81625d0 0x7f62a00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f62b7fff640 1 -- 172.21.15.112:0/1352431509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62a0004810 msgr2=0x7f62a0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f62b7fff640 1 --2- 172.21.15.112:0/1352431509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62a0004810 0x7f62a0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1d6bf640 1 --2- 172.21.15.112:0/4009195778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf18072db0 0x7faf181fb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f62b7fff640 1 -- 172.21.15.112:0/1352431509 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a000c180 con 0x7f62a0003a10 2024-09-15T23:54:06.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7ffb60fe6640 1 Processor -- start 2024-09-15T23:54:06.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7ffb60fe6640 1 -- start start 2024-09-15T23:54:06.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f8e0b05e640 1 -- 172.21.15.112:0/188691300 wait complete. 2024-09-15T23:54:06.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1dec0640 1 -- 172.21.15.112:0/4009195778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf18072db0 msgr2=0x7faf181fb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1dec0640 1 --2- 172.21.15.112:0/4009195778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf18072db0 0x7faf181fb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1dec0640 1 -- 172.21.15.112:0/4009195778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf180b2fd0 msgr2=0x7faf18164000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1dec0640 1 --2- 172.21.15.112:0/4009195778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf180b2fd0 0x7faf18164000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1dec0640 1 -- 172.21.15.112:0/4009195778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf18164750 con 0x7faf1815a200 2024-09-15T23:54:06.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f5abffff640 1 --2- 172.21.15.112:0/2961144353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aa80039c0 0x7f5aa8003de0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5ac009da30 tx=0x7f5ab801cd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93b9e76ad52b0901 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1dec0640 1 --2- 172.21.15.112:0/4009195778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf1815a200 0x7faf1814b760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faf080071d0 tx=0x7faf0801a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f5abeffd640 1 -- 172.21.15.112:0/2961144353 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80b2070 con 0x7f5aa80039c0 2024-09-15T23:54:06.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf0dffb640 1 -- 172.21.15.112:0/4009195778 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf080b2040 con 0x7faf1815a200 2024-09-15T23:54:06.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e91e10640 1 Processor -- start 2024-09-15T23:54:06.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf0dffb640 1 -- 172.21.15.112:0/4009195778 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0800a460 con 0x7faf1815a200 2024-09-15T23:54:06.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7ffb60fe6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ffb54036060 0x7ffb54036440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf0dffb640 1 -- 172.21.15.112:0/4009195778 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0800a830 con 0x7faf1815a200 2024-09-15T23:54:06.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7faf1f923640 1 -- 172.21.15.112:0/4009195778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf18164a30 con 0x7faf1815a200 2024-09-15T23:54:06.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f5abeffd640 1 -- 172.21.15.112:0/2961144353 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab80a5c20 con 0x7f5aa80039c0 2024-09-15T23:54:06.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f5abeffd640 1 -- 172.21.15.112:0/2961144353 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8009b20 con 0x7f5aa80039c0 2024-09-15T23:54:06.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7ffb60fe6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb54039ca0 0x7ffb5403a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7ffb60fe6640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb54054d90 con 0x7ffb54036c00 2024-09-15T23:54:06.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f8e0b05e640 1 Processor -- start 2024-09-15T23:54:06.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7ffb5ad9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb54039ca0 0x7ffb5403a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7ffb5ad9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb54039ca0 0x7ffb5403a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:53510/0 (socket says 172.21.15.112:53510) 2024-09-15T23:54:06.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7ffb5ad9d640 1 -- 172.21.15.112:0/1630371842 learned_addr learned my addr 172.21.15.112:0/1630371842 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:06.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7ffb60fe6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ffb54007490 con 0x7ffb54036060 2024-09-15T23:54:06.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7ffb60fe6640 1 -- 172.21.15.112:0/1630371842 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ffb54036980 con 0x7ffb54039ca0 2024-09-15T23:54:06.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f8e0b05e640 1 -- start start 2024-09-15T23:54:06.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e91e10640 1 -- start start 2024-09-15T23:54:06.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e91e10640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e8c15d520 0x7f7e8c1650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e91e10640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e8c15d900 0x7f7e8c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e91e10640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e8c15e930 0x7f7e8c1630b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e91e10640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c0b3a80 con 0x7f7e8c15d520 2024-09-15T23:54:06.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e91e10640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c0b3900 con 0x7f7e8c15d900 2024-09-15T23:54:06.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e91e10640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8c0b3c00 con 0x7f7e8c15e930 2024-09-15T23:54:06.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f5ac640d640 1 -- 172.21.15.112:0/2961144353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aa80039c0 msgr2=0x7f5aa8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f5ac640d640 1 --2- 172.21.15.112:0/2961144353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aa80039c0 0x7f5aa8003de0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5ac009da30 tx=0x7f5ab801cd20 comp rx=0 tx=0).stop 2024-09-15T23:54:06.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f5ac49aa640 1 -- 172.21.15.112:0/2961144353 reap_dead start 2024-09-15T23:54:06.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e90e0e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e8c15d520 0x7f7e8c1650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e8bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e8c15d900 0x7f7e8c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e90e0e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e8c15d520 0x7f7e8c1650c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57502/0 (socket says 172.21.15.112:57502) 2024-09-15T23:54:06.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e90e0e640 1 -- 172.21.15.112:0/4139728553 learned_addr learned my addr 172.21.15.112:0/4139728553 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:06.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e9160f640 1 --2- 172.21.15.112:0/4139728553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e8c15e930 0x7f7e8c1630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7faf1f923640 1 -- 172.21.15.112:0/4009195778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf18164ff0 con 0x7faf1815a200 2024-09-15T23:54:06.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e90e0e640 1 -- 172.21.15.112:0/4139728553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e8c15e930 msgr2=0x7f7e8c1630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e90e0e640 1 --2- 172.21.15.112:0/4139728553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e8c15e930 0x7f7e8c1630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e90e0e640 1 -- 172.21.15.112:0/4139728553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e8c15d900 msgr2=0x7f7e8c15e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e90e0e640 1 --2- 172.21.15.112:0/4139728553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e8c15d900 0x7f7e8c15e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f7e90e0e640 1 -- 172.21.15.112:0/4139728553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c164040 con 0x7f7e8c15d520 2024-09-15T23:54:06.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f5ac640d640 1 -- 172.21.15.112:0/2961144353 shutdown_connections 2024-09-15T23:54:06.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.921+0000 7f5ac640d640 1 -- 172.21.15.112:0/2961144353 >> 172.21.15.112:0/2961144353 conn(0x7f5ac009d570 msgr2=0x7f5ac00d42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:06.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f5ac640d640 1 -- 172.21.15.112:0/2961144353 shutdown_connections 2024-09-15T23:54:06.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f5ac640d640 1 -- 172.21.15.112:0/2961144353 wait complete. 2024-09-15T23:54:06.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7ffb5959a640 1 -- 172.21.15.112:0/1630371842 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3637763778 0 0) 0x7ffb54054d90 con 0x7ffb54036c00 2024-09-15T23:54:06.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7ffb5959a640 1 -- 172.21.15.112:0/1630371842 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb44005740 con 0x7ffb54036c00 2024-09-15T23:54:06.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f7e90e0e640 1 --2- 172.21.15.112:0/4139728553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e8c15d520 0x7f7e8c1650c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e78006fd0 tx=0x7f7e7800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e0b05e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e04070560 0x7f8e04137a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e0b05e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e04070940 0x7f8e04154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e0b05e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e040d0c80 0x7f8e041548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e0b05e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0415ceb0 con 0x7f8e040d0c80 2024-09-15T23:54:06.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e0b05e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0415cd30 con 0x7f8e04070560 2024-09-15T23:54:06.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e0b05e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8e0406bcc0 con 0x7f8e04070940 2024-09-15T23:54:06.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f62b7fff640 1 --2- 172.21.15.112:0/1352431509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62a0003a10 0x7f62a0003e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62b0009f90 tx=0x7f62b001cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=145a92183af4b24 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f4a5c968640 1 -- 172.21.15.112:0/318479899 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0b0070 con 0x7f4a580cd3e0 2024-09-15T23:54:06.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7ffb5ad9d640 1 -- 172.21.15.112:0/1630371842 >> v2:172.21.15.169:3300/0 conn(0x7ffb54036060 msgr2=0x7ffb54036440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7ffb5ad9d640 1 --2- 172.21.15.112:0/1630371842 >> v2:172.21.15.169:3300/0 conn(0x7ffb54036060 0x7ffb54036440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7ffb5ad9d640 1 -- 172.21.15.112:0/1630371842 >> v1:172.21.15.112:6789/0 conn(0x7ffb54036c00 legacy=0x7ffb54006d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7ffb5959a640 1 -- 172.21.15.112:0/1630371842 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 440514509 0 0) 0x7ffb44005740 con 0x7ffb54036c00 2024-09-15T23:54:06.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7ffb5ad9d640 1 -- 172.21.15.112:0/1630371842 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb54009c70 con 0x7ffb54039ca0 2024-09-15T23:54:06.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e03fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e04070940 0x7f8e04154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f4a5c968640 1 -- 172.21.15.112:0/318479899 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4c0ab600 con 0x7f4a580cd3e0 2024-09-15T23:54:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f7e897fa640 1 -- 172.21.15.112:0/4139728553 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78015020 con 0x7f7e8c15d520 2024-09-15T23:54:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e03fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e04070940 0x7f8e04154390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:53530/0 (socket says 172.21.15.112:53530) 2024-09-15T23:54:06.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e03fff640 1 -- 172.21.15.112:0/3766413731 learned_addr learned my addr 172.21.15.112:0/3766413731 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e08dfa640 1 --2- 172.21.15.112:0/3766413731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e04070560 0x7f8e04137a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f7e91e10640 1 -- 172.21.15.112:0/4139728553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8c164300 con 0x7f7e8c15d520 2024-09-15T23:54:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f7e91e10640 1 -- 172.21.15.112:0/4139728553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8c1648c0 con 0x7f7e8c15d520 2024-09-15T23:54:06.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f7e897fa640 1 -- 172.21.15.112:0/4139728553 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e78011830 con 0x7f7e8c15d520 2024-09-15T23:54:06.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e08dfa640 1 -- 172.21.15.112:0/3766413731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e04070940 msgr2=0x7f8e04154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e08dfa640 1 --2- 172.21.15.112:0/3766413731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8e04070940 0x7f8e04154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e08dfa640 1 -- 172.21.15.112:0/3766413731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e040d0c80 msgr2=0x7f8e041548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e08dfa640 1 --2- 172.21.15.112:0/3766413731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e040d0c80 0x7f8e041548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e08dfa640 1 -- 172.21.15.112:0/3766413731 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e04137fc0 con 0x7f8e04070560 2024-09-15T23:54:06.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7faf0dffb640 1 -- 172.21.15.112:0/4009195778 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf080bf020 con 0x7faf1815a200 2024-09-15T23:54:06.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7faf0dffb640 1 --2- 172.21.15.112:0/4009195778 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faefc0678f0 0x7faefc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7faf1d6bf640 1 --2- 172.21.15.112:0/4009195778 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faefc0678f0 0x7faefc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f4a5e96c640 1 -- 172.21.15.112:0/318479899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a580cd3e0 msgr2=0x7f4a5815cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f4a5e96c640 1 --2- 172.21.15.112:0/318479899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a580cd3e0 0x7f4a5815cdf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009870 tx=0x7f4a4c01c540 comp rx=0 tx=0).stop 2024-09-15T23:54:06.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f4a5e96c640 1 -- 172.21.15.112:0/318479899 shutdown_connections 2024-09-15T23:54:06.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f4a5e96c640 1 --2- 172.21.15.112:0/318479899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a580b5200 0x7f4a580b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f4a5e96c640 1 --2- 172.21.15.112:0/318479899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a580cd3e0 0x7f4a5815cdf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f4a5e96c640 1 -- 172.21.15.112:0/318479899 >> 172.21.15.112:0/318479899 conn(0x7f4a5806d960 msgr2=0x7f4a5806dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:06.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f4a5e96c640 1 -- 172.21.15.112:0/318479899 shutdown_connections 2024-09-15T23:54:06.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7faf0dffb640 1 -- 172.21.15.112:0/4009195778 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faf08124060 con 0x7faf1815a200 2024-09-15T23:54:06.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f4a5e96c640 1 -- 172.21.15.112:0/318479899 wait complete. 2024-09-15T23:54:06.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7faf1f923640 1 --2- 172.21.15.112:0/4009195778 >> [v2:172.21.15.112:6800/686325648,v1:172.21.15.112:6801/686325648] conn(0x7faf18165230 0x7faf181549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7faf1f923640 1 -- 172.21.15.112:0/4009195778 --> [v2:172.21.15.112:6800/686325648,v1:172.21.15.112:6801/686325648] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf181557b0 con 0x7faf18165230 2024-09-15T23:54:06.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7faf1cebe640 1 --2- 172.21.15.112:0/4009195778 >> [v2:172.21.15.112:6800/686325648,v1:172.21.15.112:6801/686325648] conn(0x7faf18165230 0x7faf181549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7faf1d6bf640 1 --2- 172.21.15.112:0/4009195778 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faefc0678f0 0x7faefc069db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faf10007fd0 tx=0x7faf10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7faf1cebe640 1 --2- 172.21.15.112:0/4009195778 >> [v2:172.21.15.112:6800/686325648,v1:172.21.15.112:6801/686325648] conn(0x7faf18165230 0x7faf181549e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e08dfa640 1 --2- 172.21.15.112:0/3766413731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e04070560 0x7f8e04137a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8df80ac000 tx=0x7f8df801acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f7e897fa640 1 -- 172.21.15.112:0/4139728553 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78011c40 con 0x7f7e8c15d520 2024-09-15T23:54:06.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f7e91e10640 1 -- 172.21.15.112:0/4139728553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7e6c001040 con 0x7f7e8c15d520 2024-09-15T23:54:06.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f62b6ffd640 1 -- 172.21.15.112:0/1352431509 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b00b2070 con 0x7f62a0003a10 2024-09-15T23:54:06.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f62b6ffd640 1 -- 172.21.15.112:0/1352431509 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b00a5c30 con 0x7f62a0003a10 2024-09-15T23:54:06.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f62b6ffd640 1 -- 172.21.15.112:0/1352431509 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b0009c10 con 0x7f62a0003a10 2024-09-15T23:54:06.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7faf0dffb640 1 -- 172.21.15.112:0/4009195778 <== osd.1 v2:172.21.15.112:6800/686325648 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faf140072e0 con 0x7faf18165230 2024-09-15T23:54:06.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f62be366640 1 -- 172.21.15.112:0/1352431509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62a0003a10 msgr2=0x7f62a0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f62be366640 1 --2- 172.21.15.112:0/1352431509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62a0003a10 0x7f62a0003e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62b0009f90 tx=0x7f62b001cc20 comp rx=0 tx=0).stop 2024-09-15T23:54:06.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f62bc903640 1 -- 172.21.15.112:0/1352431509 reap_dead start 2024-09-15T23:54:06.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f62be366640 1 -- 172.21.15.112:0/1352431509 shutdown_connections 2024-09-15T23:54:06.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f62be366640 1 -- 172.21.15.112:0/1352431509 >> 172.21.15.112:0/1352431509 conn(0x7f62b80d0660 msgr2=0x7f62b80d0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:06.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f5ac640d640 1 Processor -- start 2024-09-15T23:54:06.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e017fa640 1 -- 172.21.15.112:0/3766413731 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8006e20 con 0x7f8e04070560 2024-09-15T23:54:06.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e017fa640 1 -- 172.21.15.112:0/3766413731 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df80b5600 con 0x7f8e04070560 2024-09-15T23:54:06.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e017fa640 1 -- 172.21.15.112:0/3766413731 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df80b59b0 con 0x7f8e04070560 2024-09-15T23:54:06.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e0b05e640 1 -- 172.21.15.112:0/3766413731 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e041530c0 con 0x7f8e04070560 2024-09-15T23:54:06.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f8e0b05e640 1 -- 172.21.15.112:0/3766413731 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e04153680 con 0x7f8e04070560 2024-09-15T23:54:06.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7ffb5ad9d640 1 --2- 172.21.15.112:0/1630371842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb54039ca0 0x7ffb5403a0b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0652f0 tx=0x7ffb5c087570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9d874025bf18ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f4a5e96c640 1 Processor -- start 2024-09-15T23:54:06.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.925+0000 7f4a5e96c640 1 -- start start 2024-09-15T23:54:06.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5e96c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a580b5200 0x7f4a5814ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5e96c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a580cd3e0 0x7f4a58155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5e96c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a5815f520 0x7f4a58157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5e96c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4a580740f0 con 0x7f4a580b5200 2024-09-15T23:54:06.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5e96c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4a58073f70 con 0x7f4a5815f520 2024-09-15T23:54:06.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5e96c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4a580b5000 con 0x7f4a580cd3e0 2024-09-15T23:54:06.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f62be366640 1 -- 172.21.15.112:0/1352431509 shutdown_connections 2024-09-15T23:54:06.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5ac640d640 1 -- start start 2024-09-15T23:54:06.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f8e0b05e640 1 -- 172.21.15.112:0/3766413731 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8de4001040 con 0x7f8e04070560 2024-09-15T23:54:06.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5d96a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a580b5200 0x7f4a5814ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5d96a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a580b5200 0x7f4a5814ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57522/0 (socket says 172.21.15.112:57522) 2024-09-15T23:54:06.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5d96a640 1 -- 172.21.15.112:0/2545468195 learned_addr learned my addr 172.21.15.112:0/2545468195 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:06.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5e16b640 1 --2- 172.21.15.112:0/2545468195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a5815f520 0x7f4a58157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5d169640 1 --2- 172.21.15.112:0/2545468195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a580cd3e0 0x7f4a58155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5d96a640 1 -- 172.21.15.112:0/2545468195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a580cd3e0 msgr2=0x7f4a58155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5d96a640 1 --2- 172.21.15.112:0/2545468195 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a580cd3e0 0x7f4a58155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5d96a640 1 -- 172.21.15.112:0/2545468195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a5815f520 msgr2=0x7f4a58157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5d96a640 1 --2- 172.21.15.112:0/2545468195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a5815f520 0x7f4a58157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5d96a640 1 -- 172.21.15.112:0/2545468195 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a58158cc0 con 0x7f4a580b5200 2024-09-15T23:54:06.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5d96a640 1 --2- 172.21.15.112:0/2545468195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a580b5200 0x7f4a5814ba60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000ba50 tx=0x7f4a5000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5ac640d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aa80039c0 0x7f5ac0203960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5ac640d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ac015fdf0 0x7f5ac00cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5ac640d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ac00cb370 0x7f5ac0162050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5ac640d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac00c6f30 con 0x7f5ac015fdf0 2024-09-15T23:54:06.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5ac640d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac00cfdd0 con 0x7f5ac00cb370 2024-09-15T23:54:06.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5ac640d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac00c70b0 con 0x7f5aa80039c0 2024-09-15T23:54:06.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7ffb5959a640 1 -- 172.21.15.112:0/1630371842 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb50001680 con 0x7ffb54039ca0 2024-09-15T23:54:06.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a4a7fc640 1 -- 172.21.15.112:0/2545468195 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50019070 con 0x7f4a580b5200 2024-09-15T23:54:06.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a4a7fc640 1 -- 172.21.15.112:0/2545468195 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5000cc10 con 0x7f4a580b5200 2024-09-15T23:54:06.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5e96c640 1 -- 172.21.15.112:0/2545468195 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a58158700 con 0x7f4a580b5200 2024-09-15T23:54:06.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7ffb5959a640 1 -- 172.21.15.112:0/1630371842 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5c06de50 con 0x7ffb54039ca0 2024-09-15T23:54:06.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7ffb5959a640 1 -- 172.21.15.112:0/1630371842 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c072040 con 0x7ffb54039ca0 2024-09-15T23:54:06.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a4a7fc640 1 -- 172.21.15.112:0/2545468195 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50014440 con 0x7f4a580b5200 2024-09-15T23:54:06.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5abffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aa80039c0 0x7f5ac0203960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5abffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aa80039c0 0x7f5ac0203960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:53546/0 (socket says 172.21.15.112:53546) 2024-09-15T23:54:06.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5abffff640 1 -- 172.21.15.112:0/1342887995 learned_addr learned my addr 172.21.15.112:0/1342887995 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:06.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a5e96c640 1 -- 172.21.15.112:0/2545468195 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a5814e480 con 0x7f4a580b5200 2024-09-15T23:54:06.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f62be366640 1 -- 172.21.15.112:0/1352431509 wait complete. 2024-09-15T23:54:06.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5abffff640 1 -- 172.21.15.112:0/1342887995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ac00cb370 msgr2=0x7f5ac0162050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:54:06.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5abffff640 1 --2- 172.21.15.112:0/1342887995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ac00cb370 0x7f5ac0162050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5abffff640 1 -- 172.21.15.112:0/1342887995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ac015fdf0 msgr2=0x7f5ac00cdfb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:54:06.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5abffff640 1 --2- 172.21.15.112:0/1342887995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ac015fdf0 0x7f5ac00cdfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f62be366640 1 Processor -- start 2024-09-15T23:54:06.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5abffff640 1 -- 172.21.15.112:0/1342887995 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac006d250 con 0x7f5aa80039c0 2024-09-15T23:54:06.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f62be366640 1 -- start start 2024-09-15T23:54:06.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7ffb60fe6640 1 -- 172.21.15.112:0/1630371842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb54039ca0 msgr2=0x7ffb5403a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7ffb60fe6640 1 --2- 172.21.15.112:0/1630371842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb54039ca0 0x7ffb5403a0b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0652f0 tx=0x7ffb5c087570 comp rx=0 tx=0).stop 2024-09-15T23:54:06.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f8e017fa640 1 -- 172.21.15.112:0/3766413731 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8df80bd070 con 0x7f8e04070560 2024-09-15T23:54:06.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f8e017fa640 1 --2- 172.21.15.112:0/3766413731 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8de8067990 0x7f8de8069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f8e017fa640 1 -- 172.21.15.112:0/3766413731 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8df81208c0 con 0x7f8e04070560 2024-09-15T23:54:06.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f8e017fa640 1 --2- 172.21.15.112:0/3766413731 >> [v2:172.21.15.169:6800/2810276484,v1:172.21.15.169:6801/2810276484] conn(0x7f8de8071110 0x7f8de8073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f8e017fa640 1 -- 172.21.15.112:0/3766413731 --> [v2:172.21.15.169:6800/2810276484,v1:172.21.15.169:6801/2810276484] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8df80b3e90 con 0x7f8de8071110 2024-09-15T23:54:06.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f8e017fa640 1 -- 172.21.15.112:0/3766413731 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8df8120cb0 con 0x7f8e04070560 2024-09-15T23:54:06.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f5abffff640 1 --2- 172.21.15.112:0/1342887995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aa80039c0 0x7f5ac0203960 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8098740 tx=0x7f5aa8005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7ffb60fe6640 1 -- 172.21.15.112:0/1630371842 shutdown_connections 2024-09-15T23:54:06.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7ffb60fe6640 1 --2- 172.21.15.112:0/1630371842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb54039ca0 0x7ffb5403a0b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7ffb60fe6640 1 --2- 172.21.15.112:0/1630371842 >> v2:172.21.15.169:3300/0 conn(0x7ffb54036060 0x7ffb54036440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7ffb60fe6640 1 -- 172.21.15.112:0/1630371842 >> 172.21.15.112:0/1630371842 conn(0x7ffb5401d970 msgr2=0x7ffb540545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:06.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f4a4a7fc640 1 -- 172.21.15.112:0/2545468195 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a50007370 con 0x7f4a580b5200 2024-09-15T23:54:06.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f8e03fff640 1 --2- 172.21.15.112:0/3766413731 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8de8067990 0x7f8de8069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7ffb60fe6640 1 -- 172.21.15.112:0/1630371842 shutdown_connections 2024-09-15T23:54:06.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f7e897fa640 1 -- 172.21.15.112:0/4139728553 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7e78018020 con 0x7f7e8c15d520 2024-09-15T23:54:06.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f8e095fb640 1 --2- 172.21.15.112:0/3766413731 >> [v2:172.21.15.169:6800/2810276484,v1:172.21.15.169:6801/2810276484] conn(0x7f8de8071110 0x7f8de8073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f4a4a7fc640 1 --2- 172.21.15.112:0/2545468195 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4a3c067940 0x7f4a3c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f5abcff9640 1 -- 172.21.15.112:0/1342887995 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80b2040 con 0x7f5aa80039c0 2024-09-15T23:54:06.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f5abcff9640 1 -- 172.21.15.112:0/1342887995 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab80bd070 con 0x7f5aa80039c0 2024-09-15T23:54:06.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f5abcff9640 1 -- 172.21.15.112:0/1342887995 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8003e60 con 0x7f5aa80039c0 2024-09-15T23:54:06.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.929+0000 7f62be366640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b814d480 0x7f62b81655e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62be366640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b815a470 0x7f62b815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f4a4a7fc640 1 -- 172.21.15.112:0/2545468195 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4a50085a30 con 0x7f4a580b5200 2024-09-15T23:54:06.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62be366640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62b81fbc10 0x7f62b81fc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f4a5d169640 1 --2- 172.21.15.112:0/2545468195 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4a3c067940 0x7f4a3c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62be366640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f62b80cf320 con 0x7f62b814d480 2024-09-15T23:54:06.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62be366640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62b80cfca0 con 0x7f62b815a470 2024-09-15T23:54:06.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62be366640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f62b80cf4a0 con 0x7f62b81fbc10 2024-09-15T23:54:06.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f5ac640d640 1 -- 172.21.15.112:0/1342887995 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac006d530 con 0x7f5aa80039c0 2024-09-15T23:54:06.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f5ac640d640 1 -- 172.21.15.112:0/1342887995 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac00ce4f0 con 0x7f5aa80039c0 2024-09-15T23:54:06.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7ffb60fe6640 1 -- 172.21.15.112:0/1630371842 wait complete. 2024-09-15T23:54:06.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62b77fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b815a470 0x7f62b815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62b77fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b815a470 0x7f62b815a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:50104/0 (socket says 172.21.15.112:50104) 2024-09-15T23:54:06.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62b77fe640 1 -- 172.21.15.112:0/3421906392 learned_addr learned my addr 172.21.15.112:0/3421906392 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:06.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62bc903640 1 --2- 172.21.15.112:0/3421906392 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62b81fbc10 0x7f62b81fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62b77fe640 1 -- 172.21.15.112:0/3421906392 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62b81fbc10 msgr2=0x7f62b81fc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62b77fe640 1 --2- 172.21.15.112:0/3421906392 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62b81fbc10 0x7f62b81fc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62b77fe640 1 -- 172.21.15.112:0/3421906392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b814d480 msgr2=0x7f62b81655e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62b77fe640 1 --2- 172.21.15.112:0/3421906392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62b814d480 0x7f62b81655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62b77fe640 1 -- 172.21.15.112:0/3421906392 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b81637c0 con 0x7f62b815a470 2024-09-15T23:54:06.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f4a5d169640 1 --2- 172.21.15.112:0/2545468195 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4a3c067940 0x7f4a3c069e00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0ad000 tx=0x7f4a4c0a4f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f8e03fff640 1 --2- 172.21.15.112:0/3766413731 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8de8067990 0x7f8de8069e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8e04158310 tx=0x7f8df0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7ffb60fe6640 1 Processor -- start 2024-09-15T23:54:06.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62b77fe640 1 --2- 172.21.15.112:0/3421906392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b815a470 0x7f62b815a8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f62a800e780 tx=0x7f62a800ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f5ac640d640 1 -- 172.21.15.112:0/1342887995 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ac0161620 con 0x7f5aa80039c0 2024-09-15T23:54:06.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f4a5e96c640 1 --2- 172.21.15.112:0/2545468195 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x7f4a40001660 0x7f4a40003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f4a5e96c640 1 -- 172.21.15.112:0/2545468195 --> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a40006bc0 con 0x7f4a40001660 2024-09-15T23:54:06.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f7e897fa640 1 --2- 172.21.15.112:0/4139728553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7e700679c0 0x7f7e70069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62b4ff9640 1 -- 172.21.15.112:0/3421906392 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a800ee30 con 0x7f62b815a470 2024-09-15T23:54:06.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62b4ff9640 1 -- 172.21.15.112:0/3421906392 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a8018070 con 0x7f62b815a470 2024-09-15T23:54:06.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f4a5e16b640 1 --2- 172.21.15.112:0/2545468195 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x7f4a40001660 0x7f4a40003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62b4ff9640 1 -- 172.21.15.112:0/3421906392 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a800cb30 con 0x7f62b815a470 2024-09-15T23:54:06.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f7e897fa640 1 -- 172.21.15.112:0/4139728553 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7e78085e90 con 0x7f7e8c15d520 2024-09-15T23:54:06.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0d2ff5640 1 Processor -- start 2024-09-15T23:54:06.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f7e897fa640 1 --2- 172.21.15.112:0/4139728553 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x7f7e70071140 0x7f7e70073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f7e897fa640 1 -- 172.21.15.112:0/4139728553 --> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e78004460 con 0x7f7e70071140 2024-09-15T23:54:06.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f7e897fa640 1 -- 172.21.15.112:0/4139728553 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7e7808b3b0 con 0x7f7e8c15d520 2024-09-15T23:54:06.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62be366640 1 -- 172.21.15.112:0/3421906392 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b8163aa0 con 0x7f62b815a470 2024-09-15T23:54:06.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f62be366640 1 -- 172.21.15.112:0/3421906392 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b8164060 con 0x7f62b815a470 2024-09-15T23:54:06.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0d2ff5640 1 -- start start 2024-09-15T23:54:06.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0d2ff5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0cc073a10 0x7fc0cc0b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0d2ff5640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc0cc099280 0x7fc0cc0b5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0d2ff5640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0cc0b2d00 con 0x7fc0cc098bc0 2024-09-15T23:54:06.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0d2ff5640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc0cc0b2740 con 0x7fc0cc099280 2024-09-15T23:54:06.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0d2ff5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc0cc0b2a20 con 0x7fc0cc073a10 2024-09-15T23:54:06.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0d0d91640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc0cc098bc0 0x7fc0cc073300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49736/0 (socket says 172.21.15.112:49736) 2024-09-15T23:54:06.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0d0d91640 1 -- 172.21.15.112:0/3423759620 learned_addr learned my addr 172.21.15.112:0/3423759620 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:06.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0cb7fe640 1 -- 172.21.15.112:0/3423759620 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 440101104 0 0) 0x7fc0cc0b2d00 con 0x7fc0cc098bc0 2024-09-15T23:54:06.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0cb7fe640 1 -- 172.21.15.112:0/3423759620 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0bc003510 con 0x7fc0cc098bc0 2024-09-15T23:54:06.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0d1592640 1 --2- 172.21.15.112:0/3423759620 >> v2:172.21.15.169:3300/0 conn(0x7fc0cc099280 0x7fc0cc0b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0cbfff640 1 --2- 172.21.15.112:0/3423759620 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0cc073a10 0x7fc0cc0b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7ffb60fe6640 1 -- start start 2024-09-15T23:54:06.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0d1592640 1 -- 172.21.15.112:0/3423759620 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0cc073a10 msgr2=0x7fc0cc0b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:06.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0d1592640 1 --2- 172.21.15.112:0/3423759620 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0cc073a10 0x7fc0cc0b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0d1592640 1 -- 172.21.15.112:0/3423759620 >> v1:172.21.15.112:6789/0 conn(0x7fc0cc098bc0 legacy=0x7fc0cc073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7fc0d1592640 1 -- 172.21.15.112:0/3423759620 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0cc0b3330 con 0x7fc0cc099280 2024-09-15T23:54:06.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f4a5e16b640 1 --2- 172.21.15.112:0/2545468195 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x7f4a40001660 0x7f4a40003b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f62be366640 1 -- 172.21.15.112:0/3421906392 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f62b814dee0 con 0x7f62b815a470 2024-09-15T23:54:06.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb60fe6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb54036060 0x7ffb54046cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f5abcff9640 1 -- 172.21.15.112:0/1342887995 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ab8004570 con 0x7f5aa80039c0 2024-09-15T23:54:06.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f7e9160f640 1 --2- 172.21.15.112:0/4139728553 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x7f7e70071140 0x7f7e70073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb60fe6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb54036c00 0x7ffb541aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.933+0000 7f7e8bfff640 1 --2- 172.21.15.112:0/4139728553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7e700679c0 0x7f7e70069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f8e095fb640 1 --2- 172.21.15.112:0/3766413731 >> [v2:172.21.15.169:6800/2810276484,v1:172.21.15.169:6801/2810276484] conn(0x7f8de8071110 0x7f8de8073550 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f5abcff9640 1 --2- 172.21.15.112:0/1342887995 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5aac067940 0x7f5aac069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb60fe6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb54039ca0 0x7ffb540f7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb60fe6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffb541117a0 con 0x7ffb54039ca0 2024-09-15T23:54:06.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb60fe6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffb54111620 con 0x7ffb54036060 2024-09-15T23:54:06.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb60fe6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ffb54111920 con 0x7ffb54036c00 2024-09-15T23:54:06.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f7e8bfff640 1 --2- 172.21.15.112:0/4139728553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7e700679c0 0x7f7e70069e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7e800ad000 tx=0x7f7e80004780 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f5abcff9640 1 -- 172.21.15.112:0/1342887995 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5ab8121c90 con 0x7f5aa80039c0 2024-09-15T23:54:06.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f5abf7fe640 1 --2- 172.21.15.112:0/1342887995 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5aac067940 0x7f5aac069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f7e9160f640 1 --2- 172.21.15.112:0/4139728553 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x7f7e70071140 0x7f7e70073580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f5abcff9640 1 --2- 172.21.15.112:0/1342887995 >> [v2:172.21.15.169:6816/2075680198,v1:172.21.15.169:6817/2075680198] conn(0x7f5aac0710b0 0x7f5aac0734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f5abcff9640 1 -- 172.21.15.112:0/1342887995 --> [v2:172.21.15.169:6816/2075680198,v1:172.21.15.169:6817/2075680198] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ab80afe90 con 0x7f5aac0710b0 2024-09-15T23:54:06.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f5abcff9640 1 -- 172.21.15.112:0/1342887995 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5ab8122170 con 0x7f5aa80039c0 2024-09-15T23:54:06.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb5ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb54039ca0 0x7ffb540f7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb5ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb54039ca0 0x7ffb540f7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57552/0 (socket says 172.21.15.112:57552) 2024-09-15T23:54:06.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb5ad9d640 1 -- 172.21.15.112:0/845346836 learned_addr learned my addr 172.21.15.112:0/845346836 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:06.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb59d9b640 1 --2- 172.21.15.112:0/845346836 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb54036c00 0x7ffb541aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb5ad9d640 1 -- 172.21.15.112:0/845346836 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb54036c00 msgr2=0x7ffb541aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb5ad9d640 1 --2- 172.21.15.112:0/845346836 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb54036c00 0x7ffb541aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb5ad9d640 1 -- 172.21.15.112:0/845346836 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb54036060 msgr2=0x7ffb54046cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:06.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb5ad9d640 1 --2- 172.21.15.112:0/845346836 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb54036060 0x7ffb54046cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:06.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f5abf7fe640 1 --2- 172.21.15.112:0/1342887995 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5aac067940 0x7f5aac069e00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0000fc0 tx=0x7f5ab0007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb5ad9d640 1 -- 172.21.15.112:0/845346836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb540326a0 con 0x7ffb54039ca0 2024-09-15T23:54:06.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb5ad9d640 1 --2- 172.21.15.112:0/845346836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb54039ca0 0x7ffb540f7980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c074530 tx=0x7ffb5c085e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:06.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb4affd640 1 -- 172.21.15.112:0/845346836 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c128070 con 0x7ffb54039ca0 2024-09-15T23:54:06.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f5ac49aa640 1 --2- 172.21.15.112:0/1342887995 >> [v2:172.21.15.169:6816/2075680198,v1:172.21.15.169:6817/2075680198] conn(0x7f5aac0710b0 0x7f5aac0734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f7e897fa640 1 -- 172.21.15.112:0/4139728553 <== osd.2 v2:172.21.15.112:6816/4134332386 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e78004460 con 0x7f7e70071140 2024-09-15T23:54:06.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f62b4ff9640 1 -- 172.21.15.112:0/3421906392 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f62a800ccd0 con 0x7f62b815a470 2024-09-15T23:54:06.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f62b4ff9640 1 --2- 172.21.15.112:0/3421906392 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f62a40678c0 0x7f62a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f62b4ff9640 1 -- 172.21.15.112:0/3421906392 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f62a80867f0 con 0x7f62b815a470 2024-09-15T23:54:06.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f62b4ff9640 1 --2- 172.21.15.112:0/3421906392 >> [v2:172.21.15.112:6824/79312720,v1:172.21.15.112:6825/79312720] conn(0x7f62a4070f40 0x7f62a4073380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:06.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f62b4ff9640 1 -- 172.21.15.112:0/3421906392 --> [v2:172.21.15.112:6824/79312720,v1:172.21.15.112:6825/79312720] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62a801ee50 con 0x7f62a4070f40 2024-09-15T23:54:06.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f62b4ff9640 1 -- 172.21.15.112:0/3421906392 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f62a8086c80 con 0x7f62b815a470 2024-09-15T23:54:06.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f62bc903640 1 --2- 172.21.15.112:0/3421906392 >> [v2:172.21.15.112:6824/79312720,v1:172.21.15.112:6825/79312720] conn(0x7f62a4070f40 0x7f62a4073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:06.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f5ac49aa640 1 --2- 172.21.15.112:0/1342887995 >> [v2:172.21.15.169:6816/2075680198,v1:172.21.15.169:6817/2075680198] conn(0x7f5aac0710b0 0x7f5aac0734f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb4affd640 1 -- 172.21.15.112:0/845346836 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5c121460 con 0x7ffb54039ca0 2024-09-15T23:54:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb4affd640 1 -- 172.21.15.112:0/845346836 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c121850 con 0x7ffb54039ca0 2024-09-15T23:54:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb60fe6640 1 -- 172.21.15.112:0/845346836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb54032920 con 0x7ffb54039ca0 2024-09-15T23:54:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f4a4a7fc640 1 -- 172.21.15.112:0/2545468195 <== osd.7 v2:172.21.15.169:6808/189050588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4a40006bc0 con 0x7f4a40001660 2024-09-15T23:54:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7f62b7fff640 1 --2- 172.21.15.112:0/3421906392 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f62a40678c0 0x7f62a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb4affd640 1 -- 172.21.15.112:0/845346836 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffb5c1219f0 con 0x7ffb54039ca0 2024-09-15T23:54:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.937+0000 7ffb60fe6640 1 -- 172.21.15.112:0/845346836 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb54032ee0 con 0x7ffb54039ca0 2024-09-15T23:54:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.941+0000 7ffb4affd640 1 --2- 172.21.15.112:0/845346836 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffb3c0678c0 0x7ffb3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.941+0000 7ffb4affd640 1 -- 172.21.15.112:0/845346836 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ffb5c18a610 con 0x7ffb54039ca0 2024-09-15T23:54:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.941+0000 7ffb5a59c640 1 --2- 172.21.15.112:0/845346836 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffb3c0678c0 0x7ffb3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.941+0000 7f5abcff9640 1 -- 172.21.15.112:0/1342887995 <== osd.4 v2:172.21.15.169:6816/2075680198 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ab80afe90 con 0x7f5aac0710b0 2024-09-15T23:54:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.941+0000 7ffb60fe6640 1 --2- 172.21.15.112:0/845346836 >> [v2:172.21.15.169:6824/1324680124,v1:172.21.15.169:6825/1324680124] conn(0x7ffb54033120 0x7ffb540f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.941+0000 7ffb60fe6640 1 -- 172.21.15.112:0/845346836 --> [v2:172.21.15.169:6824/1324680124,v1:172.21.15.169:6825/1324680124] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb54036440 con 0x7ffb54033120 2024-09-15T23:54:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.941+0000 7f62bc903640 1 --2- 172.21.15.112:0/3421906392 >> [v2:172.21.15.112:6824/79312720,v1:172.21.15.112:6825/79312720] conn(0x7f62a4070f40 0x7f62a4073380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.941+0000 7f62b7fff640 1 --2- 172.21.15.112:0/3421906392 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f62a40678c0 0x7f62a4069d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f62b00af000 tx=0x7f62b001b460 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.941+0000 7ffb59d9b640 1 --2- 172.21.15.112:0/845346836 >> [v2:172.21.15.169:6824/1324680124,v1:172.21.15.169:6825/1324680124] conn(0x7ffb54033120 0x7ffb540f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.941+0000 7ffb5a59c640 1 --2- 172.21.15.112:0/845346836 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffb3c0678c0 0x7ffb3c069d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009670 tx=0x7ffb4c006bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.941+0000 7ffb59d9b640 1 --2- 172.21.15.112:0/845346836 >> [v2:172.21.15.169:6824/1324680124,v1:172.21.15.169:6825/1324680124] conn(0x7ffb54033120 0x7ffb540f7ec0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.941+0000 7ffb4affd640 1 -- 172.21.15.112:0/845346836 <== osd.6 v2:172.21.15.169:6824/1324680124 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb54036440 con 0x7ffb54033120 2024-09-15T23:54:07.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.949+0000 7f62b4ff9640 1 -- 172.21.15.112:0/3421906392 <== osd.3 v2:172.21.15.112:6824/79312720 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f62a801ee50 con 0x7f62a4070f40 2024-09-15T23:54:07.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.949+0000 7fc0d1592640 1 --2- 172.21.15.112:0/3423759620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0cc099280 0x7fc0cc0b5360 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4008600 tx=0x7fc0c40253d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dfc1d5bede75379 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.941+0000 7f8e017fa640 1 -- 172.21.15.112:0/3766413731 <== osd.5 v2:172.21.15.169:6800/2810276484 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8df80b3e90 con 0x7f8de8071110 2024-09-15T23:54:07.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.949+0000 7fc0cb7fe640 1 -- 172.21.15.112:0/3423759620 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c400d2d0 con 0x7fc0cc099280 2024-09-15T23:54:07.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.949+0000 7fc0cb7fe640 1 -- 172.21.15.112:0/3423759620 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c40b8070 con 0x7fc0cc099280 2024-09-15T23:54:07.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.949+0000 7fc0cb7fe640 1 -- 172.21.15.112:0/3423759620 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c400b740 con 0x7fc0cc099280 2024-09-15T23:54:07.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.949+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3423759620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0cc099280 msgr2=0x7fc0cc0b5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.949+0000 7fc0d2ff5640 1 --2- 172.21.15.112:0/3423759620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0cc099280 0x7fc0cc0b5360 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4008600 tx=0x7fc0c40253d0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.949+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3423759620 shutdown_connections 2024-09-15T23:54:07.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.949+0000 7fc0d2ff5640 1 --2- 172.21.15.112:0/3423759620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0cc099280 0x7fc0cc0b5360 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.949+0000 7fc0d2ff5640 1 --2- 172.21.15.112:0/3423759620 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0cc073a10 0x7fc0cc0b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.949+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3423759620 >> 172.21.15.112:0/3423759620 conn(0x7fc0cc06c740 msgr2=0x7fc0cc0b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.949+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3423759620 shutdown_connections 2024-09-15T23:54:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.949+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3423759620 wait complete. 2024-09-15T23:54:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.949+0000 7fc0d2ff5640 1 Processor -- start 2024-09-15T23:54:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d2ff5640 1 -- start start 2024-09-15T23:54:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d2ff5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0cc073a10 0x7fc0cc09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d2ff5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0cc098bc0 0x7fc0cc206990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d2ff5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0cc099280 0x7fc0cc206ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d2ff5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc0aeba0 con 0x7fc0cc098bc0 2024-09-15T23:54:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d2ff5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc0aea20 con 0x7fc0cc073a10 2024-09-15T23:54:07.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d2ff5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc0cc0aed20 con 0x7fc0cc099280 2024-09-15T23:54:07.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0cbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0cc098bc0 0x7fc0cc206990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0cbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0cc098bc0 0x7fc0cc206990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57562/0 (socket says 172.21.15.112:57562) 2024-09-15T23:54:07.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0cbfff640 1 -- 172.21.15.112:0/3219523117 learned_addr learned my addr 172.21.15.112:0/3219523117 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:07.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d1592640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0cc099280 0x7fc0cc206ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d0d91640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0cc073a10 0x7fc0cc09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d1592640 1 -- 172.21.15.112:0/3219523117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0cc073a10 msgr2=0x7fc0cc09bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d1592640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0cc073a10 0x7fc0cc09bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d1592640 1 -- 172.21.15.112:0/3219523117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0cc098bc0 msgr2=0x7fc0cc206990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d1592640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0cc098bc0 0x7fc0cc206990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d1592640 1 -- 172.21.15.112:0/3219523117 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0cc09c750 con 0x7fc0cc099280 2024-09-15T23:54:07.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0cbfff640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0cc098bc0 0x7fc0cc206990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:54:07.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d1592640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0cc099280 0x7fc0cc206ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40b4000 tx=0x7fc0c4022190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0c97fa640 1 -- 172.21.15.112:0/3219523117 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c400b740 con 0x7fc0cc099280 2024-09-15T23:54:07.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3219523117 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0cc09ca30 con 0x7fc0cc099280 2024-09-15T23:54:07.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3219523117 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0cc091720 con 0x7fc0cc099280 2024-09-15T23:54:07.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0c97fa640 1 -- 172.21.15.112:0/3219523117 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c40c1070 con 0x7fc0cc099280 2024-09-15T23:54:07.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7fc0c97fa640 1 -- 172.21.15.112:0/3219523117 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c400bae0 con 0x7fc0cc099280 2024-09-15T23:54:07.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.953+0000 7f4a5e96c640 1 -- 172.21.15.112:0/2545468195 --> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4a40005ca0 con 0x7f4a40001660 2024-09-15T23:54:07.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.957+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3219523117 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0ac001040 con 0x7fc0cc099280 2024-09-15T23:54:07.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.957+0000 7f4a4a7fc640 1 -- 172.21.15.112:0/2545468195 <== osd.7 v2:172.21.15.169:6808/189050588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4a40005ca0 con 0x7f4a40001660 2024-09-15T23:54:07.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.957+0000 7fc0c97fa640 1 -- 172.21.15.112:0/3219523117 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc0c400bc80 con 0x7fc0cc099280 2024-09-15T23:54:07.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.957+0000 7fc0c97fa640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc0b00678c0 0x7fc0b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.957+0000 7fc0d0d91640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc0b00678c0 0x7fc0b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.957+0000 7fc0c97fa640 1 -- 172.21.15.112:0/3219523117 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc0c412a070 con 0x7fc0cc099280 2024-09-15T23:54:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.957+0000 7fc0c97fa640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.112:6808/537028791,v1:172.21.15.112:6809/537028791] conn(0x7fc0b0071040 0x7fc0b0073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.957+0000 7fc0c97fa640 1 -- 172.21.15.112:0/3219523117 --> [v2:172.21.15.112:6808/537028791,v1:172.21.15.112:6809/537028791] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0b0073b50 con 0x7fc0b0071040 2024-09-15T23:54:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.957+0000 7fc0c97fa640 1 -- 172.21.15.112:0/3219523117 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc0c412a460 con 0x7fc0cc099280 2024-09-15T23:54:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.957+0000 7fc0cbfff640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.112:6808/537028791,v1:172.21.15.112:6809/537028791] conn(0x7fc0b0071040 0x7fc0b0073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.957+0000 7fc0d0d91640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc0b00678c0 0x7fc0b0069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00011f0 tx=0x7fc0c0007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.957+0000 7fc0cbfff640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.112:6808/537028791,v1:172.21.15.112:6809/537028791] conn(0x7fc0b0071040 0x7fc0b0073480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.957+0000 7faf1f923640 1 -- 172.21.15.112:0/4009195778 --> [v2:172.21.15.112:6800/686325648,v1:172.21.15.112:6801/686325648] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faf180b3420 con 0x7faf18165230 2024-09-15T23:54:07.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7faf0dffb640 1 -- 172.21.15.112:0/4009195778 <== osd.1 v2:172.21.15.112:6800/686325648 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faf180b3420 con 0x7faf18165230 2024-09-15T23:54:07.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.957+0000 7f4a5e96c640 1 -- 172.21.15.112:0/2545468195 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x7f4a40001660 msgr2=0x7f4a40003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7f4a5e96c640 1 --2- 172.21.15.112:0/2545468195 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x7f4a40001660 0x7f4a40003b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7f4a5e96c640 1 -- 172.21.15.112:0/2545468195 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4a3c067940 msgr2=0x7f4a3c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7f4a5e96c640 1 --2- 172.21.15.112:0/2545468195 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4a3c067940 0x7f4a3c069e00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0ad000 tx=0x7f4a4c0a4f90 comp rx=0 tx=0).stop 2024-09-15T23:54:07.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7f4a5e96c640 1 -- 172.21.15.112:0/2545468195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a580b5200 msgr2=0x7f4a5814ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7f4a5e96c640 1 --2- 172.21.15.112:0/2545468195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a580b5200 0x7f4a5814ba60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000ba50 tx=0x7f4a5000bf10 comp rx=0 tx=0).stop 2024-09-15T23:54:07.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7f4a5e16b640 1 -- 172.21.15.112:0/2545468195 reap_dead start 2024-09-15T23:54:07.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7f4a5e96c640 1 -- 172.21.15.112:0/2545468195 shutdown_connections 2024-09-15T23:54:07.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7f4a5e96c640 1 -- 172.21.15.112:0/2545468195 >> 172.21.15.112:0/2545468195 conn(0x7f4a5806d960 msgr2=0x7f4a5806f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7f4a5e96c640 1 -- 172.21.15.112:0/2545468195 shutdown_connections 2024-09-15T23:54:07.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7f4a5e96c640 1 -- 172.21.15.112:0/2545468195 wait complete. 2024-09-15T23:54:07.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7faf1f923640 1 -- 172.21.15.112:0/4009195778 >> [v2:172.21.15.112:6800/686325648,v1:172.21.15.112:6801/686325648] conn(0x7faf18165230 msgr2=0x7faf181549e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7faf1f923640 1 --2- 172.21.15.112:0/4009195778 >> [v2:172.21.15.112:6800/686325648,v1:172.21.15.112:6801/686325648] conn(0x7faf18165230 0x7faf181549e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7faf1f923640 1 -- 172.21.15.112:0/4009195778 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faefc0678f0 msgr2=0x7faefc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7faf1f923640 1 --2- 172.21.15.112:0/4009195778 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faefc0678f0 0x7faefc069db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faf10007fd0 tx=0x7faf10009040 comp rx=0 tx=0).stop 2024-09-15T23:54:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7faf1f923640 1 -- 172.21.15.112:0/4009195778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf1815a200 msgr2=0x7faf1814b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7faf1f923640 1 --2- 172.21.15.112:0/4009195778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf1815a200 0x7faf1814b760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faf080071d0 tx=0x7faf0801a210 comp rx=0 tx=0).stop 2024-09-15T23:54:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7faf1dec0640 1 -- 172.21.15.112:0/4009195778 reap_dead start 2024-09-15T23:54:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7faf1f923640 1 -- 172.21.15.112:0/4009195778 shutdown_connections 2024-09-15T23:54:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7faf1f923640 1 -- 172.21.15.112:0/4009195778 >> 172.21.15.112:0/4009195778 conn(0x7faf180b1cd0 msgr2=0x7faf18072340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7fc0c97fa640 1 -- 172.21.15.112:0/3219523117 <== osd.0 v2:172.21.15.112:6808/537028791 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc0b0073b50 con 0x7fc0b0071040 2024-09-15T23:54:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7faf1f923640 1 -- 172.21.15.112:0/4009195778 shutdown_connections 2024-09-15T23:54:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.961+0000 7faf1f923640 1 -- 172.21.15.112:0/4009195778 wait complete. 2024-09-15T23:54:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.965+0000 7f7e91e10640 1 -- 172.21.15.112:0/4139728553 --> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7e6c002de0 con 0x7f7e70071140 2024-09-15T23:54:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.965+0000 7f7e897fa640 1 -- 172.21.15.112:0/4139728553 <== osd.2 v2:172.21.15.112:6816/4134332386 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7e6c002de0 con 0x7f7e70071140 2024-09-15T23:54:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.965+0000 7f7e91e10640 1 -- 172.21.15.112:0/4139728553 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x7f7e70071140 msgr2=0x7f7e70073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.965+0000 7f7e91e10640 1 --2- 172.21.15.112:0/4139728553 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x7f7e70071140 0x7f7e70073580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.965+0000 7f7e91e10640 1 -- 172.21.15.112:0/4139728553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7e700679c0 msgr2=0x7f7e70069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.965+0000 7f7e91e10640 1 --2- 172.21.15.112:0/4139728553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7e700679c0 0x7f7e70069e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7e800ad000 tx=0x7f7e80004780 comp rx=0 tx=0).stop 2024-09-15T23:54:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.965+0000 7f7e91e10640 1 -- 172.21.15.112:0/4139728553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e8c15d520 msgr2=0x7f7e8c1650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.965+0000 7f7e91e10640 1 --2- 172.21.15.112:0/4139728553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e8c15d520 0x7f7e8c1650c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e78006fd0 tx=0x7f7e7800b890 comp rx=0 tx=0).stop 2024-09-15T23:54:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.965+0000 7f7e9160f640 1 -- 172.21.15.112:0/4139728553 reap_dead start 2024-09-15T23:54:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.965+0000 7f7e91e10640 1 -- 172.21.15.112:0/4139728553 shutdown_connections 2024-09-15T23:54:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.965+0000 7f7e91e10640 1 -- 172.21.15.112:0/4139728553 >> 172.21.15.112:0/4139728553 conn(0x7f7e8c06d960 msgr2=0x7f7e8c073ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7f7e91e10640 1 -- 172.21.15.112:0/4139728553 shutdown_connections 2024-09-15T23:54:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7f7e91e10640 1 -- 172.21.15.112:0/4139728553 wait complete. 2024-09-15T23:54:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7f5ac640d640 1 -- 172.21.15.112:0/1342887995 --> [v2:172.21.15.169:6816/2075680198,v1:172.21.15.169:6817/2075680198] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ac00b7270 con 0x7f5aac0710b0 2024-09-15T23:54:07.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7ffb60fe6640 1 -- 172.21.15.112:0/845346836 --> [v2:172.21.15.169:6824/1324680124,v1:172.21.15.169:6825/1324680124] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffb54033960 con 0x7ffb54033120 2024-09-15T23:54:07.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7ffb4affd640 1 -- 172.21.15.112:0/845346836 <== osd.6 v2:172.21.15.169:6824/1324680124 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffb54033960 con 0x7ffb54033120 2024-09-15T23:54:07.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7f8e0b05e640 1 -- 172.21.15.112:0/3766413731 --> [v2:172.21.15.169:6800/2810276484,v1:172.21.15.169:6801/2810276484] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8de4002d60 con 0x7f8de8071110 2024-09-15T23:54:07.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7ffb60fe6640 1 -- 172.21.15.112:0/845346836 >> [v2:172.21.15.169:6824/1324680124,v1:172.21.15.169:6825/1324680124] conn(0x7ffb54033120 msgr2=0x7ffb540f7ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7ffb60fe6640 1 --2- 172.21.15.112:0/845346836 >> [v2:172.21.15.169:6824/1324680124,v1:172.21.15.169:6825/1324680124] conn(0x7ffb54033120 0x7ffb540f7ec0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7ffb60fe6640 1 -- 172.21.15.112:0/845346836 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffb3c0678c0 msgr2=0x7ffb3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7ffb60fe6640 1 --2- 172.21.15.112:0/845346836 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffb3c0678c0 0x7ffb3c069d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009670 tx=0x7ffb4c006bf0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7ffb60fe6640 1 -- 172.21.15.112:0/845346836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb54039ca0 msgr2=0x7ffb540f7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7ffb60fe6640 1 --2- 172.21.15.112:0/845346836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb54039ca0 0x7ffb540f7980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c074530 tx=0x7ffb5c085e60 comp rx=0 tx=0).stop 2024-09-15T23:54:07.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7ffb5ad9d640 1 -- 172.21.15.112:0/845346836 reap_dead start 2024-09-15T23:54:07.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7f8e017fa640 1 -- 172.21.15.112:0/3766413731 <== osd.5 v2:172.21.15.169:6800/2810276484 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8de4002d60 con 0x7f8de8071110 2024-09-15T23:54:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7ffb60fe6640 1 -- 172.21.15.112:0/845346836 shutdown_connections 2024-09-15T23:54:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7ffb60fe6640 1 -- 172.21.15.112:0/845346836 >> 172.21.15.112:0/845346836 conn(0x7ffb5401d970 msgr2=0x7ffb540f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7ffb60fe6640 1 -- 172.21.15.112:0/845346836 shutdown_connections 2024-09-15T23:54:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7ffb60fe6640 1 -- 172.21.15.112:0/845346836 wait complete. 2024-09-15T23:54:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7f8deeffd640 1 -- 172.21.15.112:0/3766413731 >> [v2:172.21.15.169:6800/2810276484,v1:172.21.15.169:6801/2810276484] conn(0x7f8de8071110 msgr2=0x7f8de8073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7f8deeffd640 1 --2- 172.21.15.112:0/3766413731 >> [v2:172.21.15.169:6800/2810276484,v1:172.21.15.169:6801/2810276484] conn(0x7f8de8071110 0x7f8de8073550 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7f5abcff9640 1 -- 172.21.15.112:0/1342887995 <== osd.4 v2:172.21.15.169:6816/2075680198 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5ac00b7270 con 0x7f5aac0710b0 2024-09-15T23:54:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7f8deeffd640 1 -- 172.21.15.112:0/3766413731 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8de8067990 msgr2=0x7f8de8069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7f8deeffd640 1 --2- 172.21.15.112:0/3766413731 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8de8067990 0x7f8de8069e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8e04158310 tx=0x7f8df0009040 comp rx=0 tx=0).stop 2024-09-15T23:54:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7f8deeffd640 1 -- 172.21.15.112:0/3766413731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e04070560 msgr2=0x7f8e04137a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7f8deeffd640 1 --2- 172.21.15.112:0/3766413731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8e04070560 0x7f8e04137a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8df80ac000 tx=0x7f8df801acf0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.969+0000 7f8e095fb640 1 -- 172.21.15.112:0/3766413731 reap_dead start 2024-09-15T23:54:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.973+0000 7f8deeffd640 1 -- 172.21.15.112:0/3766413731 shutdown_connections 2024-09-15T23:54:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.973+0000 7f8deeffd640 1 -- 172.21.15.112:0/3766413731 >> 172.21.15.112:0/3766413731 conn(0x7f8e0406ed30 msgr2=0x7f8e040b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.973+0000 7f8deeffd640 1 -- 172.21.15.112:0/3766413731 shutdown_connections 2024-09-15T23:54:07.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.973+0000 7f8deeffd640 1 -- 172.21.15.112:0/3766413731 wait complete. 2024-09-15T23:54:07.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f5ac640d640 1 -- 172.21.15.112:0/1342887995 >> [v2:172.21.15.169:6816/2075680198,v1:172.21.15.169:6817/2075680198] conn(0x7f5aac0710b0 msgr2=0x7f5aac0734f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f5ac640d640 1 --2- 172.21.15.112:0/1342887995 >> [v2:172.21.15.169:6816/2075680198,v1:172.21.15.169:6817/2075680198] conn(0x7f5aac0710b0 0x7f5aac0734f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f5ac640d640 1 -- 172.21.15.112:0/1342887995 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5aac067940 msgr2=0x7f5aac069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f5ac640d640 1 --2- 172.21.15.112:0/1342887995 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5aac067940 0x7f5aac069e00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0000fc0 tx=0x7f5ab0007980 comp rx=0 tx=0).stop 2024-09-15T23:54:07.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f62be366640 1 -- 172.21.15.112:0/3421906392 --> [v2:172.21.15.112:6824/79312720,v1:172.21.15.112:6825/79312720] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f62b814dee0 con 0x7f62a4070f40 2024-09-15T23:54:07.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f5ac640d640 1 -- 172.21.15.112:0/1342887995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aa80039c0 msgr2=0x7f5ac0203960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f5ac640d640 1 --2- 172.21.15.112:0/1342887995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5aa80039c0 0x7f5ac0203960 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8098740 tx=0x7f5aa8005840 comp rx=0 tx=0).stop 2024-09-15T23:54:07.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f5ac49aa640 1 -- 172.21.15.112:0/1342887995 reap_dead start 2024-09-15T23:54:07.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f62b4ff9640 1 -- 172.21.15.112:0/3421906392 <== osd.3 v2:172.21.15.112:6824/79312720 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f62b814dee0 con 0x7f62a4070f40 2024-09-15T23:54:07.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f5ac640d640 1 -- 172.21.15.112:0/1342887995 shutdown_connections 2024-09-15T23:54:07.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f5ac640d640 1 -- 172.21.15.112:0/1342887995 >> 172.21.15.112:0/1342887995 conn(0x7f5ac009d570 msgr2=0x7f5ac00b8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f5ac640d640 1 -- 172.21.15.112:0/1342887995 shutdown_connections 2024-09-15T23:54:07.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f5ac640d640 1 -- 172.21.15.112:0/1342887995 wait complete. 2024-09-15T23:54:07.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f629e7fc640 1 -- 172.21.15.112:0/3421906392 >> [v2:172.21.15.112:6824/79312720,v1:172.21.15.112:6825/79312720] conn(0x7f62a4070f40 msgr2=0x7f62a4073380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f629e7fc640 1 --2- 172.21.15.112:0/3421906392 >> [v2:172.21.15.112:6824/79312720,v1:172.21.15.112:6825/79312720] conn(0x7f62a4070f40 0x7f62a4073380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f629e7fc640 1 -- 172.21.15.112:0/3421906392 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f62a40678c0 msgr2=0x7f62a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f629e7fc640 1 --2- 172.21.15.112:0/3421906392 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f62a40678c0 0x7f62a4069d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f62b00af000 tx=0x7f62b001b460 comp rx=0 tx=0).stop 2024-09-15T23:54:07.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f629e7fc640 1 -- 172.21.15.112:0/3421906392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b815a470 msgr2=0x7f62b815a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f629e7fc640 1 --2- 172.21.15.112:0/3421906392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b815a470 0x7f62b815a8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f62a800e780 tx=0x7f62a800ec40 comp rx=0 tx=0).stop 2024-09-15T23:54:07.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f62bc903640 1 -- 172.21.15.112:0/3421906392 reap_dead start 2024-09-15T23:54:07.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f629e7fc640 1 -- 172.21.15.112:0/3421906392 shutdown_connections 2024-09-15T23:54:07.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f629e7fc640 1 -- 172.21.15.112:0/3421906392 >> 172.21.15.112:0/3421906392 conn(0x7f62b80d0660 msgr2=0x7f62b80ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f629e7fc640 1 -- 172.21.15.112:0/3421906392 shutdown_connections 2024-09-15T23:54:07.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.977+0000 7f629e7fc640 1 -- 172.21.15.112:0/3421906392 wait complete. 2024-09-15T23:54:07.030 INFO:teuthology.orchestra.run.smithi112.stdout:64424509449 2024-09-15T23:54:07.031 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-15T23:54:07.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.993+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3219523117 --> [v2:172.21.15.112:6808/537028791,v1:172.21.15.112:6809/537028791] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc0ac002d60 con 0x7fc0b0071040 2024-09-15T23:54:07.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.993+0000 7fc0c97fa640 1 -- 172.21.15.112:0/3219523117 <== osd.0 v2:172.21.15.112:6808/537028791 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc0ac002d60 con 0x7fc0b0071040 2024-09-15T23:54:07.032 INFO:teuthology.orchestra.run.smithi112.stdout:64424509449 2024-09-15T23:54:07.033 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T23:54:07.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.993+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3219523117 >> [v2:172.21.15.112:6808/537028791,v1:172.21.15.112:6809/537028791] conn(0x7fc0b0071040 msgr2=0x7fc0b0073480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.993+0000 7fc0d2ff5640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.112:6808/537028791,v1:172.21.15.112:6809/537028791] conn(0x7fc0b0071040 0x7fc0b0073480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.993+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3219523117 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc0b00678c0 msgr2=0x7fc0b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.993+0000 7fc0d2ff5640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc0b00678c0 0x7fc0b0069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00011f0 tx=0x7fc0c0007d40 comp rx=0 tx=0).stop 2024-09-15T23:54:07.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.993+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3219523117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0cc099280 msgr2=0x7fc0cc206ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.993+0000 7fc0d2ff5640 1 --2- 172.21.15.112:0/3219523117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0cc099280 0x7fc0cc206ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40b4000 tx=0x7fc0c4022190 comp rx=0 tx=0).stop 2024-09-15T23:54:07.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.993+0000 7fc0d1592640 1 -- 172.21.15.112:0/3219523117 reap_dead start 2024-09-15T23:54:07.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.993+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3219523117 shutdown_connections 2024-09-15T23:54:07.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.993+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3219523117 >> 172.21.15.112:0/3219523117 conn(0x7fc0cc06c740 msgr2=0x7fc0cc0b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.993+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3219523117 shutdown_connections 2024-09-15T23:54:07.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:06.997+0000 7fc0d2ff5640 1 -- 172.21.15.112:0/3219523117 wait complete. 2024-09-15T23:54:07.036 INFO:teuthology.orchestra.run.smithi112.stdout:64424509450 2024-09-15T23:54:07.037 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T23:54:07.037 INFO:teuthology.orchestra.run.smithi112.stdout:64424509448 2024-09-15T23:54:07.038 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-15T23:54:07.038 INFO:teuthology.orchestra.run.smithi112.stdout:55834574856 2024-09-15T23:54:07.039 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T23:54:07.039 INFO:teuthology.orchestra.run.smithi112.stdout:64424509449 2024-09-15T23:54:07.040 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T23:54:07.040 INFO:teuthology.orchestra.run.smithi112.stdout:64424509449 2024-09-15T23:54:07.041 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T23:54:07.041 INFO:teuthology.orchestra.run.smithi112.stdout:64424509448 2024-09-15T23:54:07.042 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T23:54:07.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc91728640 1 Processor -- start 2024-09-15T23:54:07.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f310a2c8640 1 Processor -- start 2024-09-15T23:54:07.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a759e640 1 Processor -- start 2024-09-15T23:54:07.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f310a2c8640 1 -- start start 2024-09-15T23:54:07.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a759e640 1 -- start start 2024-09-15T23:54:07.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f891d958640 1 Processor -- start 2024-09-15T23:54:07.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f891d958640 1 -- start start 2024-09-15T23:54:07.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc91728640 1 -- start start 2024-09-15T23:54:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f223af89640 1 Processor -- start 2024-09-15T23:54:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f223af89640 1 -- start start 2024-09-15T23:54:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f7d9359e640 1 Processor -- start 2024-09-15T23:54:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f7d9359e640 1 -- start start 2024-09-15T23:54:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a759e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f25a0056610 0x7f25a00e6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a759e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25a00063e0 0x7f25a0006870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a759e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a0057830 con 0x7f25a00e2d20 2024-09-15T23:54:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a759e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f25a0056a50 con 0x7f25a0056610 2024-09-15T23:54:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a759e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f25a0057ab0 con 0x7f25a00063e0 2024-09-15T23:54:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc91728640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcc8c154d60 0x7fcc8c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc91728640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc8c0cd500 0x7fcc8c15b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc91728640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcc8c06ccd0 0x7fcc8c06d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc91728640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcc8c06d660 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f310a2c8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f31040b5d90 0x7f3104071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f310a2c8640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3104072fa0 con 0x7f31040720e0 2024-09-15T23:54:07.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f310a2c8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3104073280 con 0x7f3104140800 2024-09-15T23:54:07.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f310a2c8640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f31041614a0 con 0x7f31040b5d90 2024-09-15T23:54:07.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f891d958640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89180cf2e0 0x7f8918072080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f891d958640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89180ce0f0 con 0x7f891806fcb0 2024-09-15T23:54:07.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f891d958640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89180ce3d0 con 0x7f8918071c10 2024-09-15T23:54:07.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f891d958640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f89180ce6b0 con 0x7f89180cf2e0 2024-09-15T23:54:07.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc91728640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fcc8c155140 con 0x7fcc8c154d60 2024-09-15T23:54:07.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc91728640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcc8c0b4960 con 0x7fcc8c0cd500 2024-09-15T23:54:07.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a5d9b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f25a0056610 0x7f25a00e6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a6d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25a00063e0 0x7f25a0006870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a6d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25a00063e0 0x7f25a0006870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:53578/0 (socket says 172.21.15.112:53578) 2024-09-15T23:54:07.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a6d9d640 1 -- 172.21.15.112:0/2554166298 learned_addr learned my addr 172.21.15.112:0/2554166298 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc8affd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcc8c154d60 0x7fcc8c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc8b7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcc8c06ccd0 0x7fcc8c06d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc8b7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcc8c06ccd0 0x7fcc8c06d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57566/0 (socket says 172.21.15.112:57566) 2024-09-15T23:54:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc8b7fe640 1 -- 172.21.15.112:0/1411223690 learned_addr learned my addr 172.21.15.112:0/1411223690 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc8affd640 1 --2- 172.21.15.112:0/1411223690 >> v2:172.21.15.169:3300/0 conn(0x7fcc8c154d60 0x7fcc8c0b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:50140/0 (socket says 172.21.15.112:50140) 2024-09-15T23:54:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc8a7fc640 1 --2- 172.21.15.112:0/1411223690 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc8c0cd500 0x7fcc8c15b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc8b7fe640 1 -- 172.21.15.112:0/1411223690 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc8c0cd500 msgr2=0x7fcc8c15b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc8b7fe640 1 --2- 172.21.15.112:0/1411223690 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc8c0cd500 0x7fcc8c15b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc8b7fe640 1 -- 172.21.15.112:0/1411223690 >> v2:172.21.15.169:3300/0 conn(0x7fcc8c154d60 msgr2=0x7fcc8c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc8b7fe640 1 --2- 172.21.15.112:0/1411223690 >> v2:172.21.15.169:3300/0 conn(0x7fcc8c154d60 0x7fcc8c0b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7fcc8b7fe640 1 -- 172.21.15.112:0/1411223690 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8c0b43a0 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f3109ac7640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f31040720e0 0x7f3104072500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49748/0 (socket says 172.21.15.112:49748) 2024-09-15T23:54:07.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f3109ac7640 1 -- 172.21.15.112:0/3490613393 learned_addr learned my addr 172.21.15.112:0/3490613393 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:07.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f3108ac5640 1 --2- 172.21.15.112:0/3490613393 >> v2:172.21.15.112:3300/0 conn(0x7f31040b5d90 0x7f3104071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f223af89640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f223406e7d0 0x7f223406ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f223af89640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f223415a7c0 0x7f2234067a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f223af89640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22341611b0 con 0x7f223406f380 2024-09-15T23:54:07.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f223af89640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f223406c6d0 con 0x7f223415a7c0 2024-09-15T23:54:07.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f223af89640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f223406c9b0 con 0x7f223406e7d0 2024-09-15T23:54:07.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f223a788640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f223406f380 0x7f22340b4d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:35164/0 (socket says 172.21.15.112:35164) 2024-09-15T23:54:07.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f223a788640 1 -- 172.21.15.112:0/3889859842 learned_addr learned my addr 172.21.15.112:0/3889859842 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:07.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f2239f87640 1 --2- 172.21.15.112:0/3889859842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f223406e7d0 0x7f223406ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f891c956640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f891806fcb0 0x7f8918159e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49750/0 (socket says 172.21.15.112:49750) 2024-09-15T23:54:07.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f891c956640 1 -- 172.21.15.112:0/1425359323 learned_addr learned my addr 172.21.15.112:0/1425359323 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:07.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f891d157640 1 --2- 172.21.15.112:0/1425359323 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89180cf2e0 0x7f8918072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f7d9359e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d8c0deb70 0x7f7d8c006d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7feb2f735640 1 Processor -- start 2024-09-15T23:54:07.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7feb2f735640 1 -- start start 2024-09-15T23:54:07.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7feb2f735640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feb280733e0 0x7feb28165b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7feb2f735640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb280b4c80 con 0x7feb2815aeb0 2024-09-15T23:54:07.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7feb2f735640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb280b4f50 con 0x7feb2815b290 2024-09-15T23:54:07.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7feb2f735640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7feb280b5230 con 0x7feb280733e0 2024-09-15T23:54:07.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7feb2dcd2640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7feb280733e0 0x7feb28165b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7feb2d4d1640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7feb2815aeb0 0x7feb280b4570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49760/0 (socket says 172.21.15.112:49760) 2024-09-15T23:54:07.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7feb2d4d1640 1 -- 172.21.15.112:0/294303061 learned_addr learned my addr 172.21.15.112:0/294303061 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:07.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f89177fe640 1 -- 172.21.15.112:0/1425359323 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2204268400 0 0) 0x7f89180ce0f0 con 0x7f891806fcb0 2024-09-15T23:54:07.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f89177fe640 1 -- 172.21.15.112:0/1425359323 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8900003530 con 0x7f891806fcb0 2024-09-15T23:54:07.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2053849545 0 0) 0x7f3104072fa0 con 0x7f31040720e0 2024-09-15T23:54:07.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7feb1ffff640 1 -- 172.21.15.112:0/294303061 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 773593278 0 0) 0x7feb280b4c80 con 0x7feb2815aeb0 2024-09-15T23:54:07.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7feb1ffff640 1 -- 172.21.15.112:0/294303061 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb14005740 con 0x7feb2815aeb0 2024-09-15T23:54:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30f0003530 con 0x7f31040720e0 2024-09-15T23:54:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 129363658 0 0) 0x7f3104073280 con 0x7f3104140800 2024-09-15T23:54:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3104072fa0 con 0x7f3104140800 2024-09-15T23:54:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f2238f85640 1 -- 172.21.15.112:0/3889859842 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 764199406 0 0) 0x7f22341611b0 con 0x7f223406f380 2024-09-15T23:54:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f2238f85640 1 -- 172.21.15.112:0/3889859842 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2220003530 con 0x7f223406f380 2024-09-15T23:54:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f891d157640 1 -- 172.21.15.112:0/1425359323 >> v1:172.21.15.169:6789/0 conn(0x7f8918071c10 legacy=0x7f89180cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f891d157640 1 -- 172.21.15.112:0/1425359323 >> v1:172.21.15.112:6789/0 conn(0x7f891806fcb0 legacy=0x7f8918159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f891d157640 1 -- 172.21.15.112:0/1425359323 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891815a520 con 0x7f89180cf2e0 2024-09-15T23:54:07.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a5d9b640 1 -- 172.21.15.112:0/2554166298 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25a00063e0 msgr2=0x7f25a0006870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:07.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a5d9b640 1 --2- 172.21.15.112:0/2554166298 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25a00063e0 0x7f25a0006870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a5d9b640 1 -- 172.21.15.112:0/2554166298 >> v1:172.21.15.169:6789/0 conn(0x7f25a00e2d20 legacy=0x7f25a00e66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f25a5d9b640 1 -- 172.21.15.112:0/2554166298 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a0057d90 con 0x7f25a0056610 2024-09-15T23:54:07.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.245+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1670671075 0 0) 0x7f30f0003530 con 0x7f31040720e0 2024-09-15T23:54:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 >> v2:172.21.15.112:3300/0 conn(0x7f31040b5d90 msgr2=0x7f3104071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f30fbfff640 1 --2- 172.21.15.112:0/3490613393 >> v2:172.21.15.112:3300/0 conn(0x7f31040b5d90 0x7f3104071ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 >> v1:172.21.15.169:6789/0 conn(0x7f3104140800 legacy=0x7f31040b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3104073560 con 0x7f31040720e0 2024-09-15T23:54:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f30f4001680 con 0x7f31040720e0 2024-09-15T23:54:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 >> v1:172.21.15.112:6789/0 conn(0x7f31040720e0 legacy=0x7f3104072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f30fbfff640 1 --2- 172.21.15.112:0/3490613393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30f0003b50 0x7f30f0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f30fbfff640 1 --2- 172.21.15.112:0/3490613393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30f0004810 0x7f30f0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f30fbfff640 1 --2- 172.21.15.112:0/3490613393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30f00051d0 0x7f30f00141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f31041614a0 con 0x7f30f0004810 2024-09-15T23:54:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30f0014860 con 0x7f30f0003b50 2024-09-15T23:54:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f30f0014a60 con 0x7f30f00051d0 2024-09-15T23:54:07.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7feb2dcd2640 1 -- 172.21.15.112:0/294303061 >> v1:172.21.15.169:6789/0 conn(0x7feb2815b290 legacy=0x7feb28072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:07.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7feb2dcd2640 1 -- 172.21.15.112:0/294303061 >> v1:172.21.15.112:6789/0 conn(0x7feb2815aeb0 legacy=0x7feb280b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7feb2dcd2640 1 -- 172.21.15.112:0/294303061 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb280b5510 con 0x7feb280733e0 2024-09-15T23:54:07.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f3109ac7640 1 --2- 172.21.15.112:0/3490613393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30f00051d0 0x7f30f00141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f7d9359e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7d8c00a380 0x7f7d8c00a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f7d9359e640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d8c00ace0 con 0x7f7d8c005a70 2024-09-15T23:54:07.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f7d9359e640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8c01c530 con 0x7f7d8c00a380 2024-09-15T23:54:07.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f7d9359e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c050210 con 0x7f7d8c0deb70 2024-09-15T23:54:07.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f7d91d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7d8c00a380 0x7f7d8c00a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f7d91d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7d8c00a380 0x7f7d8c00a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57586/0 (socket says 172.21.15.112:57586) 2024-09-15T23:54:07.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f7d91d9b640 1 -- 172.21.15.112:0/4183205137 learned_addr learned my addr 172.21.15.112:0/4183205137 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:07.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f3109ac7640 1 -- 172.21.15.112:0/3490613393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30f0003b50 msgr2=0x7f30f0003f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:54:07.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f3109ac7640 1 --2- 172.21.15.112:0/3490613393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30f0003b50 0x7f30f0003f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f3109ac7640 1 -- 172.21.15.112:0/3490613393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30f0004810 msgr2=0x7f30f0004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:54:07.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f3109ac7640 1 --2- 172.21.15.112:0/3490613393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30f0004810 0x7f30f0004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f3109ac7640 1 -- 172.21.15.112:0/3490613393 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3104073560 con 0x7f30f00051d0 2024-09-15T23:54:07.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f2239f87640 1 -- 172.21.15.112:0/3889859842 >> v2:172.21.15.112:3300/0 conn(0x7f223415a7c0 msgr2=0x7f2234067a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:07.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f2239f87640 1 --2- 172.21.15.112:0/3889859842 >> v2:172.21.15.112:3300/0 conn(0x7f223415a7c0 0x7f2234067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f2239f87640 1 -- 172.21.15.112:0/3889859842 >> v1:172.21.15.169:6789/0 conn(0x7f223406f380 legacy=0x7f22340b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f2239f87640 1 -- 172.21.15.112:0/3889859842 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223406cc90 con 0x7f223406e7d0 2024-09-15T23:54:07.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f7d91d9b640 1 -- 172.21.15.112:0/4183205137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d8c0deb70 msgr2=0x7f7d8c006d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:54:07.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f7d91d9b640 1 --2- 172.21.15.112:0/4183205137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d8c0deb70 0x7f7d8c006d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f7d91d9b640 1 -- 172.21.15.112:0/4183205137 >> v1:172.21.15.112:6789/0 conn(0x7f7d8c005a70 legacy=0x7f7d8c005f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:07.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f7d91d9b640 1 -- 172.21.15.112:0/4183205137 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c0504f0 con 0x7f7d8c00a380 2024-09-15T23:54:07.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7fcc8b7fe640 1 --2- 172.21.15.112:0/1411223690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc8c06ccd0 0x7fcc8c06d120 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c073870 tx=0x7fcc84020da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e886a84b1f0ec754 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f891d157640 1 --2- 172.21.15.112:0/1425359323 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89180cf2e0 0x7f8918072080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8910009dc0 tx=0x7f891001f140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=895393207674814d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f25a5d9b640 1 --2- 172.21.15.112:0/2554166298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25a0056610 0x7f25a00e6db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f259c0097c0 tx=0x7f259c01c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba99b94e1a4588ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7fcc89ffb640 1 -- 172.21.15.112:0/1411223690 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc840a9ac0 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f25a559a640 1 -- 172.21.15.112:0/2554166298 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c0b0070 con 0x7f25a0056610 2024-09-15T23:54:07.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7fcc89ffb640 1 -- 172.21.15.112:0/1411223690 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc840a9c60 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f89177fe640 1 -- 172.21.15.112:0/1425359323 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89100b4070 con 0x7f89180cf2e0 2024-09-15T23:54:07.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f25a559a640 1 -- 172.21.15.112:0/2554166298 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259c0ab600 con 0x7f25a0056610 2024-09-15T23:54:07.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f25a559a640 1 -- 172.21.15.112:0/2554166298 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c0aba10 con 0x7f25a0056610 2024-09-15T23:54:07.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7feb2dcd2640 1 --2- 172.21.15.112:0/294303061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb280733e0 0x7feb28165b30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feb240097c0 tx=0x7feb2401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5088446f03337e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7f2239f87640 1 --2- 172.21.15.112:0/3889859842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f223406e7d0 0x7f223406ecb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f222c009d90 tx=0x7f222c01c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b423fa7e7ba0e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f2238f85640 1 -- 172.21.15.112:0/3889859842 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c0b2070 con 0x7f223406e7d0 2024-09-15T23:54:07.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f89177fe640 1 -- 172.21.15.112:0/1425359323 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89100af600 con 0x7f89180cf2e0 2024-09-15T23:54:07.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f89177fe640 1 -- 172.21.15.112:0/1425359323 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89100af9b0 con 0x7f89180cf2e0 2024-09-15T23:54:07.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f3109ac7640 1 -- 172.21.15.112:0/3490613393 reap_dead start 2024-09-15T23:54:07.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f2238f85640 1 -- 172.21.15.112:0/3889859842 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222c0a5910 con 0x7f223406e7d0 2024-09-15T23:54:07.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f2238f85640 1 -- 172.21.15.112:0/3889859842 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c0a5cc0 con 0x7f223406e7d0 2024-09-15T23:54:07.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fcc91728640 1 -- 172.21.15.112:0/1411223690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc8c06ccd0 msgr2=0x7fcc8c06d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fcc91728640 1 --2- 172.21.15.112:0/1411223690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc8c06ccd0 0x7fcc8c06d120 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c073870 tx=0x7fcc84020da0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fcc89ffb640 1 -- 172.21.15.112:0/1411223690 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc840b1610 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 -- 172.21.15.112:0/2554166298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25a0056610 msgr2=0x7f25a00e6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 --2- 172.21.15.112:0/2554166298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25a0056610 0x7f25a00e6db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f259c0097c0 tx=0x7f259c01c420 comp rx=0 tx=0).stop 2024-09-15T23:54:07.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7feb1ffff640 1 -- 172.21.15.112:0/294303061 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb240b0070 con 0x7feb280733e0 2024-09-15T23:54:07.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7feb1ffff640 1 -- 172.21.15.112:0/294303061 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb240ab600 con 0x7feb280733e0 2024-09-15T23:54:07.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.249+0000 7feb1ffff640 1 -- 172.21.15.112:0/294303061 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb240ab9d0 con 0x7feb280733e0 2024-09-15T23:54:07.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fcc91728640 1 -- 172.21.15.112:0/1411223690 shutdown_connections 2024-09-15T23:54:07.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fcc91728640 1 --2- 172.21.15.112:0/1411223690 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc8c06ccd0 0x7fcc8c06d120 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fcc91728640 1 --2- 172.21.15.112:0/1411223690 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc8c0cd500 0x7fcc8c15b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fcc91728640 1 --2- 172.21.15.112:0/1411223690 >> v2:172.21.15.169:3300/0 conn(0x7fcc8c154d60 0x7fcc8c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fcc91728640 1 -- 172.21.15.112:0/1411223690 >> 172.21.15.112:0/1411223690 conn(0x7fcc8c072670 msgr2=0x7fcc8c072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f3109ac7640 1 --2- 172.21.15.112:0/3490613393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30f00051d0 0x7f30f00141e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30f400c290 tx=0x7f30f401f3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baece48c4170c30b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 -- 172.21.15.112:0/2554166298 shutdown_connections 2024-09-15T23:54:07.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 --2- 172.21.15.112:0/2554166298 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25a00063e0 0x7f25a0006870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 --2- 172.21.15.112:0/2554166298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25a0056610 0x7f25a00e6db0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 -- 172.21.15.112:0/2554166298 >> 172.21.15.112:0/2554166298 conn(0x7f25a003a530 msgr2=0x7f25a003a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fcc91728640 1 -- 172.21.15.112:0/1411223690 shutdown_connections 2024-09-15T23:54:07.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 -- 172.21.15.112:0/2554166298 shutdown_connections 2024-09-15T23:54:07.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4007d40 con 0x7f30f00051d0 2024-09-15T23:54:07.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f7d91d9b640 1 --2- 172.21.15.112:0/4183205137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d8c00a380 0x7f7d8c00a7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7d84008870 tx=0x7f7d84021240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc19fb682b2cfa70 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f4005ae0 con 0x7f30f00051d0 2024-09-15T23:54:07.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f30fbfff640 1 -- 172.21.15.112:0/3490613393 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4007070 con 0x7f30f00051d0 2024-09-15T23:54:07.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7feb2f735640 1 -- 172.21.15.112:0/294303061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb280733e0 msgr2=0x7feb28165b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7feb2f735640 1 --2- 172.21.15.112:0/294303061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb280733e0 0x7feb28165b30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feb240097c0 tx=0x7feb2401c3c0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f891d958640 1 -- 172.21.15.112:0/1425359323 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89180cf2e0 msgr2=0x7f8918072080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f891d958640 1 --2- 172.21.15.112:0/1425359323 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89180cf2e0 0x7f8918072080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8910009dc0 tx=0x7f891001f140 comp rx=0 tx=0).stop 2024-09-15T23:54:07.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f223af89640 1 -- 172.21.15.112:0/3889859842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f223406e7d0 msgr2=0x7f223406ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f223af89640 1 --2- 172.21.15.112:0/3889859842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f223406e7d0 0x7f223406ecb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f222c009d90 tx=0x7f222c01c980 comp rx=0 tx=0).stop 2024-09-15T23:54:07.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7feb2f735640 1 -- 172.21.15.112:0/294303061 shutdown_connections 2024-09-15T23:54:07.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7feb2f735640 1 --2- 172.21.15.112:0/294303061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb280733e0 0x7feb28165b30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7feb2f735640 1 -- 172.21.15.112:0/294303061 >> 172.21.15.112:0/294303061 conn(0x7feb2806cdd0 msgr2=0x7feb2806d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 -- 172.21.15.112:0/2554166298 wait complete. 2024-09-15T23:54:07.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 Processor -- start 2024-09-15T23:54:07.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fcc91728640 1 -- 172.21.15.112:0/1411223690 wait complete. 2024-09-15T23:54:07.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fcc91728640 1 Processor -- start 2024-09-15T23:54:07.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f310a2c8640 1 -- 172.21.15.112:0/3490613393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30f00051d0 msgr2=0x7f30f00141e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f310a2c8640 1 --2- 172.21.15.112:0/3490613393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30f00051d0 0x7f30f00141e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30f400c290 tx=0x7f30f401f3f0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f310a2c8640 1 -- 172.21.15.112:0/3490613393 shutdown_connections 2024-09-15T23:54:07.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f310a2c8640 1 --2- 172.21.15.112:0/3490613393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30f00051d0 0x7f30f00141e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f310a2c8640 1 -- 172.21.15.112:0/3490613393 >> 172.21.15.112:0/3490613393 conn(0x7f31040b1bf0 msgr2=0x7f31040b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f310a2c8640 1 -- 172.21.15.112:0/3490613393 shutdown_connections 2024-09-15T23:54:07.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f310a2c8640 1 -- 172.21.15.112:0/3490613393 wait complete. 2024-09-15T23:54:07.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f223af89640 1 -- 172.21.15.112:0/3889859842 shutdown_connections 2024-09-15T23:54:07.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f223af89640 1 --2- 172.21.15.112:0/3889859842 >> v2:172.21.15.112:3300/0 conn(0x7f223415a7c0 0x7f2234067a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f223af89640 1 --2- 172.21.15.112:0/3889859842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f223406e7d0 0x7f223406ecb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f223af89640 1 -- 172.21.15.112:0/3889859842 >> 172.21.15.112:0/3889859842 conn(0x7f22340d0890 msgr2=0x7f22340d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f223af89640 1 -- 172.21.15.112:0/3889859842 shutdown_connections 2024-09-15T23:54:07.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f223af89640 1 -- 172.21.15.112:0/3889859842 wait complete. 2024-09-15T23:54:07.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f891d958640 1 -- 172.21.15.112:0/1425359323 shutdown_connections 2024-09-15T23:54:07.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f891d958640 1 --2- 172.21.15.112:0/1425359323 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89180cf2e0 0x7f8918072080 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f891d958640 1 -- 172.21.15.112:0/1425359323 >> 172.21.15.112:0/1425359323 conn(0x7f89180b1dd0 msgr2=0x7f89180b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f891d958640 1 -- 172.21.15.112:0/1425359323 shutdown_connections 2024-09-15T23:54:07.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f7d9159a640 1 -- 172.21.15.112:0/4183205137 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d840b8070 con 0x7f7d8c00a380 2024-09-15T23:54:07.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f7d9159a640 1 -- 172.21.15.112:0/4183205137 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d840b3410 con 0x7f7d8c00a380 2024-09-15T23:54:07.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f7d9159a640 1 -- 172.21.15.112:0/4183205137 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d840b37e0 con 0x7f7d8c00a380 2024-09-15T23:54:07.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7feb2f735640 1 -- 172.21.15.112:0/294303061 shutdown_connections 2024-09-15T23:54:07.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7feb2f735640 1 -- 172.21.15.112:0/294303061 wait complete. 2024-09-15T23:54:07.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fb8f5e7e640 1 Processor -- start 2024-09-15T23:54:07.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fb8f5e7e640 1 -- start start 2024-09-15T23:54:07.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f7d9359e640 1 -- 172.21.15.112:0/4183205137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d8c00a380 msgr2=0x7f7d8c00a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f7d9359e640 1 --2- 172.21.15.112:0/4183205137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d8c00a380 0x7f7d8c00a7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7d84008870 tx=0x7f7d84021240 comp rx=0 tx=0).stop 2024-09-15T23:54:07.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f223af89640 1 Processor -- start 2024-09-15T23:54:07.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f7d9359e640 1 -- 172.21.15.112:0/4183205137 shutdown_connections 2024-09-15T23:54:07.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f7d9359e640 1 --2- 172.21.15.112:0/4183205137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d8c00a380 0x7f7d8c00a7a0 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7d84008870 tx=0x7f7d84021240 comp rx=0 tx=0).stop 2024-09-15T23:54:07.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f7d9359e640 1 --2- 172.21.15.112:0/4183205137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d8c0deb70 0x7f7d8c006d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f7d9359e640 1 -- 172.21.15.112:0/4183205137 >> 172.21.15.112:0/4183205137 conn(0x7f7d8c0360a0 msgr2=0x7f7d8c0364b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7feb2f735640 1 Processor -- start 2024-09-15T23:54:07.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 -- start start 2024-09-15T23:54:07.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25a00063e0 0x7f25a00536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25a0056610 0x7f25a004e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25a00e2d20 0x7f25a003ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00edb50 con 0x7f25a0056610 2024-09-15T23:54:07.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00ed9d0 con 0x7f25a00e2d20 2024-09-15T23:54:07.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f25a759e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f25a00edcd0 con 0x7f25a00063e0 2024-09-15T23:54:07.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f25a659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25a00063e0 0x7f25a00536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f25a659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25a00063e0 0x7f25a00536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:53628/0 (socket says 172.21.15.112:53628) 2024-09-15T23:54:07.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f25a659c640 1 -- 172.21.15.112:0/2064828603 learned_addr learned my addr 172.21.15.112:0/2064828603 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:07.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f25a5d9b640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25a0056610 0x7f25a004e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f25a6d9d640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25a00e2d20 0x7f25a003ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fcc91728640 1 -- start start 2024-09-15T23:54:07.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc91728640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc8c06ccd0 0x7fcc8c142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc91728640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc8c0cd500 0x7fcc8c155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc91728640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc8c154d60 0x7fcc8c155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc91728640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8c15bc70 con 0x7fcc8c0cd500 2024-09-15T23:54:07.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc91728640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8c15baf0 con 0x7fcc8c154d60 2024-09-15T23:54:07.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc91728640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcc8c0cecd0 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc8affd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc8c06ccd0 0x7fcc8c142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc8affd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc8c06ccd0 0x7fcc8c142c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:53674/0 (socket says 172.21.15.112:53674) 2024-09-15T23:54:07.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc8affd640 1 -- 172.21.15.112:0/844474709 learned_addr learned my addr 172.21.15.112:0/844474709 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:07.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc8b7fe640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc8c154d60 0x7fcc8c155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f310a2c8640 1 Processor -- start 2024-09-15T23:54:07.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f310a2c8640 1 -- start start 2024-09-15T23:54:07.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f223af89640 1 -- start start 2024-09-15T23:54:07.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f223af89640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f223406e7d0 0x7f22340ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f223af89640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f223406f380 0x7f223414e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f223af89640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f223415a7c0 0x7f22340a9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f223af89640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f22340680c0 con 0x7f223415a7c0 2024-09-15T23:54:07.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f223af89640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2234067f40 con 0x7f223406e7d0 2024-09-15T23:54:07.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f223af89640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f22340b4640 con 0x7f223406f380 2024-09-15T23:54:07.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f2239786640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f223406f380 0x7f223414e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f2239f87640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f223406e7d0 0x7f22340ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f2239f87640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f223406e7d0 0x7f22340ab1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:50188/0 (socket says 172.21.15.112:50188) 2024-09-15T23:54:07.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f2239f87640 1 -- 172.21.15.112:0/2401414762 learned_addr learned my addr 172.21.15.112:0/2401414762 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:07.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f891d958640 1 -- 172.21.15.112:0/1425359323 wait complete. 2024-09-15T23:54:07.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f891d958640 1 Processor -- start 2024-09-15T23:54:07.282 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f891d958640 1 -- start start 2024-09-15T23:54:07.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f891d958640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f891806fcb0 0x7f89180b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f891d958640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8918071c10 0x7f891815ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f891d958640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89180cf2e0 0x7f891814a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f891d958640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f89180b4a80 con 0x7f89180cf2e0 2024-09-15T23:54:07.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f891d958640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f89180b4900 con 0x7f8918071c10 2024-09-15T23:54:07.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f891c956640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f891806fcb0 0x7f89180b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f891c956640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f891806fcb0 0x7f89180b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:53652/0 (socket says 172.21.15.112:53652) 2024-09-15T23:54:07.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f891c956640 1 -- 172.21.15.112:0/498846430 learned_addr learned my addr 172.21.15.112:0/498846430 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:07.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f891d958640 1 -- 172.21.15.112:0/498846430 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f89180b4c00 con 0x7f891806fcb0 2024-09-15T23:54:07.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f8917fff640 1 --2- 172.21.15.112:0/498846430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8918071c10 0x7f891815ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f7d9359e640 1 -- 172.21.15.112:0/4183205137 shutdown_connections 2024-09-15T23:54:07.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7f7d9359e640 1 -- 172.21.15.112:0/4183205137 wait complete. 2024-09-15T23:54:07.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9359e640 1 Processor -- start 2024-09-15T23:54:07.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9359e640 1 -- start start 2024-09-15T23:54:07.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7feb2f735640 1 -- start start 2024-09-15T23:54:07.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2f735640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb280733e0 0x7feb28155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2f735640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb2815aeb0 0x7feb28151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2f735640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb2815b290 0x7feb28151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2f735640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feb2806c8a0 con 0x7feb2815aeb0 2024-09-15T23:54:07.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2f735640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb2806c720 con 0x7feb280733e0 2024-09-15T23:54:07.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2f735640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feb2806ca20 con 0x7feb2815b290 2024-09-15T23:54:07.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2ccd0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb2815aeb0 0x7feb28151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2ccd0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb2815aeb0 0x7feb28151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57606/0 (socket says 172.21.15.112:57606) 2024-09-15T23:54:07.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2ccd0640 1 -- 172.21.15.112:0/3117851857 learned_addr learned my addr 172.21.15.112:0/3117851857 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:07.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2d4d1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb280733e0 0x7feb28155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fb8f4e7c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb8f015e3a0 0x7fb8f00d0c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49774/0 (socket says 172.21.15.112:49774) 2024-09-15T23:54:07.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.253+0000 7fb8f4e7c640 1 -- 172.21.15.112:0/985310322 learned_addr learned my addr 172.21.15.112:0/985310322 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:07.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8f5e7e640 1 --2- 172.21.15.112:0/985310322 >> v2:172.21.15.169:3300/0 conn(0x7fb8f0161f20 0x7fb8f00cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8f5e7e640 1 --2- 172.21.15.112:0/985310322 >> v2:172.21.15.112:3300/0 conn(0x7fb8f00d3f70 0x7fb8f00d4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/985310322 --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f00d4940 con 0x7fb8f015e3a0 2024-09-15T23:54:07.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/985310322 --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb8f00b42b0 con 0x7fb8f00d3f70 2024-09-15T23:54:07.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/985310322 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb8f00d1460 con 0x7fb8f0161f20 2024-09-15T23:54:07.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8effff640 1 --2- 172.21.15.112:0/985310322 >> v2:172.21.15.169:3300/0 conn(0x7fb8f0161f20 0x7fb8f00cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f25a659c640 1 -- 172.21.15.112:0/2064828603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25a00e2d20 msgr2=0x7f25a003ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f25a659c640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25a00e2d20 0x7f25a003ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f25a659c640 1 -- 172.21.15.112:0/2064828603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25a0056610 msgr2=0x7f25a004e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f25a659c640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25a0056610 0x7f25a004e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f25a659c640 1 -- 172.21.15.112:0/2064828603 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a004ee90 con 0x7f25a00063e0 2024-09-15T23:54:07.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f25a6d9d640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25a00e2d20 0x7f25a003ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:54:07.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f310a2c8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30f00051d0 0x7f31041443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f310a2c8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31040c50c0 0x7f3104145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f310a2c8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31040c5540 0x7f31041461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f310a2c8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3104140be0 con 0x7f31040c5540 2024-09-15T23:54:07.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f310a2c8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31040b31b0 con 0x7f31040c50c0 2024-09-15T23:54:07.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f310a2c8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3104071ba0 con 0x7f30f00051d0 2024-09-15T23:54:07.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f223a788640 1 --2- 172.21.15.112:0/2401414762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f223415a7c0 0x7f22340a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2dcd2640 1 --2- 172.21.15.112:0/3117851857 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb2815b290 0x7feb28151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2ccd0640 1 -- 172.21.15.112:0/3117851857 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb2815b290 msgr2=0x7feb28151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2ccd0640 1 --2- 172.21.15.112:0/3117851857 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb2815b290 0x7feb28151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2ccd0640 1 -- 172.21.15.112:0/3117851857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb280733e0 msgr2=0x7feb28155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2ccd0640 1 --2- 172.21.15.112:0/3117851857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb280733e0 0x7feb28155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8ef7fe640 1 -- 172.21.15.112:0/985310322 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300295465 0 0) 0x7fb8f00d4940 con 0x7fb8f015e3a0 2024-09-15T23:54:07.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2ccd0640 1 -- 172.21.15.112:0/3117851857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb28069080 con 0x7feb2815aeb0 2024-09-15T23:54:07.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8ef7fe640 1 -- 172.21.15.112:0/985310322 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8e0003530 con 0x7fb8f015e3a0 2024-09-15T23:54:07.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8f567d640 1 --2- 172.21.15.112:0/985310322 >> v2:172.21.15.112:3300/0 conn(0x7fb8f00d3f70 0x7fb8f00d4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc8affd640 1 -- 172.21.15.112:0/844474709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc8c154d60 msgr2=0x7fcc8c155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc8affd640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc8c154d60 0x7fcc8c155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc8affd640 1 -- 172.21.15.112:0/844474709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc8c0cd500 msgr2=0x7fcc8c155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc8a7fc640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc8c0cd500 0x7fcc8c155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f8917fff640 1 -- 172.21.15.112:0/498846430 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f891806fcb0 msgr2=0x7f89180b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f8917fff640 1 --2- 172.21.15.112:0/498846430 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f891806fcb0 0x7f89180b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f8917fff640 1 -- 172.21.15.112:0/498846430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89180cf2e0 msgr2=0x7f891814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f8917fff640 1 --2- 172.21.15.112:0/498846430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89180cf2e0 0x7f891814a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f8917fff640 1 -- 172.21.15.112:0/498846430 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891814e840 con 0x7f8918071c10 2024-09-15T23:54:07.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc8affd640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc8c0cd500 0x7fcc8c155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc8affd640 1 -- 172.21.15.112:0/844474709 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8c156620 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc8a7fc640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc8c0cd500 0x7fcc8c155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:07.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9359e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d8c005a70 0x7f7d8c0defe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f25a659c640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25a00063e0 0x7f25a00536b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f259800c3f0 tx=0x7f259800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f3109ac7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31040c5540 0x7f31041461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f3109ac7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31040c5540 0x7f31041461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57628/0 (socket says 172.21.15.112:57628) 2024-09-15T23:54:07.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f3109ac7640 1 -- 172.21.15.112:0/3121672109 learned_addr learned my addr 172.21.15.112:0/3121672109 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:07.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f31092c6640 1 --2- 172.21.15.112:0/3121672109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30f00051d0 0x7f31041443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f2239f87640 1 -- 172.21.15.112:0/2401414762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f223406f380 msgr2=0x7f223414e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f2239f87640 1 --2- 172.21.15.112:0/2401414762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f223406f380 0x7f223414e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f2239f87640 1 -- 172.21.15.112:0/2401414762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f223415a7c0 msgr2=0x7f22340a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f2239f87640 1 --2- 172.21.15.112:0/2401414762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f223415a7c0 0x7f22340a9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f2239f87640 1 -- 172.21.15.112:0/2401414762 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223415f030 con 0x7f223406e7d0 2024-09-15T23:54:07.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9359e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d8c0deb70 0x7f7d8c0e1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9359e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d8c17c2b0 0x7f7d8c04a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9359e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c033c00 con 0x7f7d8c0deb70 2024-09-15T23:54:07.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9359e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c01c780 con 0x7f7d8c17c2b0 2024-09-15T23:54:07.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9359e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c007260 con 0x7f7d8c005a70 2024-09-15T23:54:07.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2ccd0640 1 --2- 172.21.15.112:0/3117851857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb2815aeb0 0x7feb28151610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feb1800c490 tx=0x7feb18001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc8affd640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc8c06ccd0 0x7fcc8c142c70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00e930 tx=0x7fcc7c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f3109ac7640 1 -- 172.21.15.112:0/3121672109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30f00051d0 msgr2=0x7f31041443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f3109ac7640 1 --2- 172.21.15.112:0/3121672109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30f00051d0 0x7f31041443c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f3109ac7640 1 -- 172.21.15.112:0/3121672109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31040c50c0 msgr2=0x7f3104145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f3109ac7640 1 --2- 172.21.15.112:0/3121672109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31040c50c0 0x7f3104145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f3109ac7640 1 -- 172.21.15.112:0/3121672109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3104146930 con 0x7f31040c5540 2024-09-15T23:54:07.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8effff640 1 -- 172.21.15.112:0/985310322 >> v2:172.21.15.112:3300/0 conn(0x7fb8f00d3f70 msgr2=0x7fb8f00d4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:07.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9259c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d8c005a70 0x7f7d8c0defe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9259c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d8c005a70 0x7f7d8c0defe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:53688/0 (socket says 172.21.15.112:53688) 2024-09-15T23:54:07.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9259c640 1 -- 172.21.15.112:0/84062329 learned_addr learned my addr 172.21.15.112:0/84062329 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:07.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8effff640 1 --2- 172.21.15.112:0/985310322 >> v2:172.21.15.112:3300/0 conn(0x7fb8f00d3f70 0x7fb8f00d4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8effff640 1 -- 172.21.15.112:0/985310322 >> v1:172.21.15.112:6789/0 conn(0x7fb8f015e3a0 legacy=0x7fb8f00d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb1dffb640 1 -- 172.21.15.112:0/3117851857 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb18017070 con 0x7feb2815aeb0 2024-09-15T23:54:07.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb1dffb640 1 -- 172.21.15.112:0/3117851857 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb18003600 con 0x7feb2815aeb0 2024-09-15T23:54:07.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb1dffb640 1 -- 172.21.15.112:0/3117851857 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb18003a30 con 0x7feb2815aeb0 2024-09-15T23:54:07.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2f735640 1 -- 172.21.15.112:0/3117851857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb28152f10 con 0x7feb2815aeb0 2024-09-15T23:54:07.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d92d9d640 1 --2- 172.21.15.112:0/84062329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d8c17c2b0 0x7f7d8c04a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f2596ffd640 1 -- 172.21.15.112:0/2064828603 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2598017070 con 0x7f25a00063e0 2024-09-15T23:54:07.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d91d9b640 1 --2- 172.21.15.112:0/84062329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d8c0deb70 0x7f7d8c0e1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f25a759e640 1 -- 172.21.15.112:0/2064828603 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a000da30 con 0x7f25a00063e0 2024-09-15T23:54:07.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7feb2f735640 1 -- 172.21.15.112:0/3117851857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb281534d0 con 0x7feb2815aeb0 2024-09-15T23:54:07.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f25a759e640 1 -- 172.21.15.112:0/2064828603 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a000d750 con 0x7f25a00063e0 2024-09-15T23:54:07.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f2596ffd640 1 -- 172.21.15.112:0/2064828603 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25980052d0 con 0x7f25a00063e0 2024-09-15T23:54:07.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f2596ffd640 1 -- 172.21.15.112:0/2064828603 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25980054c0 con 0x7f25a00063e0 2024-09-15T23:54:07.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc737fe640 1 -- 172.21.15.112:0/844474709 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c017070 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc91728640 1 -- 172.21.15.112:0/844474709 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc8c156900 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc91728640 1 -- 172.21.15.112:0/844474709 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc8c156ec0 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc737fe640 1 -- 172.21.15.112:0/844474709 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc7c00ca00 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fcc737fe640 1 -- 172.21.15.112:0/844474709 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c00cdb0 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f2239f87640 1 --2- 172.21.15.112:0/2401414762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f223406e7d0 0x7f22340ab1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f222c01a5b0 tx=0x7f222c019720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f222a7fc640 1 -- 172.21.15.112:0/2401414762 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c0bd020 con 0x7f223406e7d0 2024-09-15T23:54:07.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f222a7fc640 1 -- 172.21.15.112:0/2401414762 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222c003ba0 con 0x7f223406e7d0 2024-09-15T23:54:07.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f222a7fc640 1 -- 172.21.15.112:0/2401414762 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c0b2040 con 0x7f223406e7d0 2024-09-15T23:54:07.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f8917fff640 1 --2- 172.21.15.112:0/498846430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8918071c10 0x7f891815ce80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f890c000f70 tx=0x7f890c00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f89157fa640 1 -- 172.21.15.112:0/498846430 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c017070 con 0x7f8918071c10 2024-09-15T23:54:07.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9259c640 1 -- 172.21.15.112:0/84062329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d8c17c2b0 msgr2=0x7f7d8c04a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9259c640 1 --2- 172.21.15.112:0/84062329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d8c17c2b0 0x7f7d8c04a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9259c640 1 -- 172.21.15.112:0/84062329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d8c0deb70 msgr2=0x7f7d8c0e1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9259c640 1 --2- 172.21.15.112:0/84062329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d8c0deb70 0x7f7d8c0e1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f7d9259c640 1 -- 172.21.15.112:0/84062329 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c0e0660 con 0x7f7d8c005a70 2024-09-15T23:54:07.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f89157fa640 1 -- 172.21.15.112:0/498846430 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f890c0052d0 con 0x7f8918071c10 2024-09-15T23:54:07.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7f891d958640 1 -- 172.21.15.112:0/498846430 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891814eb20 con 0x7f8918071c10 2024-09-15T23:54:07.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f223af89640 1 -- 172.21.15.112:0/2401414762 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223415f310 con 0x7f223406e7d0 2024-09-15T23:54:07.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f223af89640 1 -- 172.21.15.112:0/2401414762 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f223415f8d0 con 0x7f223406e7d0 2024-09-15T23:54:07.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f891d958640 1 -- 172.21.15.112:0/498846430 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f891814f0e0 con 0x7f8918071c10 2024-09-15T23:54:07.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f89157fa640 1 -- 172.21.15.112:0/498846430 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c0054c0 con 0x7f8918071c10 2024-09-15T23:54:07.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f891d958640 1 -- 172.21.15.112:0/498846430 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89180b5000 con 0x7f8918071c10 2024-09-15T23:54:07.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f223af89640 1 -- 172.21.15.112:0/2401414762 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f223406ecb0 con 0x7f223406e7d0 2024-09-15T23:54:07.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8ef7fe640 1 -- 172.21.15.112:0/985310322 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1683331970 0 0) 0x7fb8e0003530 con 0x7fb8f015e3a0 2024-09-15T23:54:07.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8effff640 1 -- 172.21.15.112:0/985310322 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f00d1740 con 0x7fb8f0161f20 2024-09-15T23:54:07.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.257+0000 7fb8f567d640 1 --2- 172.21.15.112:0/985310322 >> v2:172.21.15.112:3300/0 conn(0x7fb8f00d3f70 0x7fb8f00d4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:54:07.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7fcc91728640 1 -- 172.21.15.112:0/844474709 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc6c0052a0 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7feb2f735640 1 -- 172.21.15.112:0/3117851857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb28072cd0 con 0x7feb2815aeb0 2024-09-15T23:54:07.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f25a759e640 1 -- 172.21.15.112:0/2064828603 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258c0052a0 con 0x7f25a00063e0 2024-09-15T23:54:07.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f3109ac7640 1 --2- 172.21.15.112:0/3121672109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31040c5540 0x7f31041461e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f30f401fc90 tx=0x7f30f0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f7d9259c640 1 --2- 172.21.15.112:0/84062329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d8c005a70 0x7f7d8c0defe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800b450 tx=0x7f7d8800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f30f9ffb640 1 -- 172.21.15.112:0/3121672109 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4007d40 con 0x7f31040c5540 2024-09-15T23:54:07.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f2596ffd640 1 -- 172.21.15.112:0/2064828603 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f259801a070 con 0x7f25a00063e0 2024-09-15T23:54:07.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f2596ffd640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f25880678c0 0x7f2588069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f2596ffd640 1 -- 172.21.15.112:0/2064828603 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f25980854f0 con 0x7f25a00063e0 2024-09-15T23:54:07.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f25a5d9b640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f25880678c0 0x7f2588069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7fcc737fe640 1 -- 172.21.15.112:0/844474709 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcc7c01a070 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7fcc737fe640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcc780678f0 0x7fcc78069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7fcc737fe640 1 -- 172.21.15.112:0/844474709 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcc7c086880 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f89157fa640 1 -- 172.21.15.112:0/498846430 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f890c01a070 con 0x7f8918071c10 2024-09-15T23:54:07.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7fcc8a7fc640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcc780678f0 0x7fcc78069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f89157fa640 1 --2- 172.21.15.112:0/498846430 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8904067910 0x7f8904069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7f89157fa640 1 -- 172.21.15.112:0/498846430 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f890c0856a0 con 0x7f8918071c10 2024-09-15T23:54:07.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7f25a5d9b640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f25880678c0 0x7f2588069d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f259c0ad000 tx=0x7f259c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7f891c956640 1 --2- 172.21.15.112:0/498846430 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8904067910 0x7f8904069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7f222a7fc640 1 -- 172.21.15.112:0/2401414762 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f222c0c0020 con 0x7f223406e7d0 2024-09-15T23:54:07.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7f891c956640 1 --2- 172.21.15.112:0/498846430 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8904067910 0x7f8904069dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8908007fd0 tx=0x7f8908007e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7f222a7fc640 1 --2- 172.21.15.112:0/2401414762 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2218067910 0x7f2218069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7fcc8a7fc640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcc780678f0 0x7fcc78069db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c14c360 tx=0x7fcc80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.261+0000 7f310a2c8640 1 -- 172.21.15.112:0/3121672109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3104146c10 con 0x7f31040c5540 2024-09-15T23:54:07.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7f310a2c8640 1 -- 172.21.15.112:0/3121672109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31041471d0 con 0x7f31040c5540 2024-09-15T23:54:07.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7f2239786640 1 --2- 172.21.15.112:0/2401414762 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2218067910 0x7f2218069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7f310a2c8640 1 -- 172.21.15.112:0/3121672109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31040b5680 con 0x7f31040c5540 2024-09-15T23:54:07.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7f2239786640 1 --2- 172.21.15.112:0/2401414762 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2218067910 0x7f2218069dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2224006fd0 tx=0x7f2224008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7feb1dffb640 1 -- 172.21.15.112:0/3117851857 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb1801a070 con 0x7feb2815aeb0 2024-09-15T23:54:07.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7feb1dffb640 1 --2- 172.21.15.112:0/3117851857 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feb0c067990 0x7feb0c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7feb2d4d1640 1 --2- 172.21.15.112:0/3117851857 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feb0c067990 0x7feb0c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7feb1dffb640 1 -- 172.21.15.112:0/3117851857 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7feb180857f0 con 0x7feb2815aeb0 2024-09-15T23:54:07.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7fb8effff640 1 --2- 172.21.15.112:0/985310322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f0161f20 0x7fb8f00cedd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb8f00c7d40 tx=0x7fb8dc01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c528a5754a6e0d8b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.265+0000 7feb2d4d1640 1 --2- 172.21.15.112:0/3117851857 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feb0c067990 0x7feb0c069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feb20001570 tx=0x7feb20001aa0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.269+0000 7f30f9ffb640 1 -- 172.21.15.112:0/3121672109 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f40047f0 con 0x7f31040c5540 2024-09-15T23:54:07.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.269+0000 7feb1dffb640 1 -- 172.21.15.112:0/3117851857 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feb18021020 con 0x7feb2815aeb0 2024-09-15T23:54:07.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.269+0000 7f30f9ffb640 1 -- 172.21.15.112:0/3121672109 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4001680 con 0x7f31040c5540 2024-09-15T23:54:07.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.269+0000 7f30f9ffb640 1 -- 172.21.15.112:0/3121672109 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f30f4007070 con 0x7f31040c5540 2024-09-15T23:54:07.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.269+0000 7f30f9ffb640 1 --2- 172.21.15.112:0/3121672109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f30e80678f0 0x7f30e8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.269+0000 7f30f9ffb640 1 -- 172.21.15.112:0/3121672109 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f30f4123a20 con 0x7f31040c5540 2024-09-15T23:54:07.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.269+0000 7f31092c6640 1 --2- 172.21.15.112:0/3121672109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f30e80678f0 0x7f30e8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.273+0000 7f31092c6640 1 --2- 172.21.15.112:0/3121672109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f30e80678f0 0x7f30e8069db0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3100000f70 tx=0x7f3100009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.273+0000 7f30f9ffb640 1 -- 172.21.15.112:0/3121672109 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f30f40b7070 con 0x7f31040c5540 2024-09-15T23:54:07.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.285+0000 7f222a7fc640 1 -- 172.21.15.112:0/2401414762 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f222c0c3e00 con 0x7f223406e7d0 2024-09-15T23:54:07.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.285+0000 7f7d82ffd640 1 -- 172.21.15.112:0/84062329 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88015020 con 0x7f7d8c005a70 2024-09-15T23:54:07.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.285+0000 7f2596ffd640 1 -- 172.21.15.112:0/2064828603 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f25a0057830 con 0x7f25a00063e0 2024-09-15T23:54:07.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.285+0000 7f89157fa640 1 -- 172.21.15.112:0/498846430 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f890c021020 con 0x7f8918071c10 2024-09-15T23:54:07.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.285+0000 7f7d9359e640 1 -- 172.21.15.112:0/84062329 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8c0df5c0 con 0x7f7d8c005a70 2024-09-15T23:54:07.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.285+0000 7fb8ef7fe640 1 -- 172.21.15.112:0/985310322 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc0b0070 con 0x7fb8f0161f20 2024-09-15T23:54:07.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.285+0000 7f7d9359e640 1 -- 172.21.15.112:0/84062329 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8c0dfe60 con 0x7f7d8c005a70 2024-09-15T23:54:07.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.289+0000 7f7d9359e640 1 -- 172.21.15.112:0/84062329 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8c00bbd0 con 0x7f7d8c005a70 2024-09-15T23:54:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.297+0000 7f7d82ffd640 1 -- 172.21.15.112:0/84062329 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d88011890 con 0x7f7d8c005a70 2024-09-15T23:54:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.297+0000 7f7d82ffd640 1 -- 172.21.15.112:0/84062329 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88011c40 con 0x7f7d8c005a70 2024-09-15T23:54:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.297+0000 7fb8ef7fe640 1 -- 172.21.15.112:0/985310322 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8dc0ab400 con 0x7fb8f0161f20 2024-09-15T23:54:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.297+0000 7fb8ef7fe640 1 -- 172.21.15.112:0/985310322 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4001680 con 0x7fb8f0161f20 2024-09-15T23:54:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7fcc737fe640 1 -- 172.21.15.112:0/844474709 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcc7c0570a0 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7f222a7fc640 1 -- 172.21.15.112:0/2401414762 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f222c0c8020 con 0x7f223406e7d0 2024-09-15T23:54:07.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/985310322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f0161f20 msgr2=0x7fb8f00cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7fb8f5e7e640 1 --2- 172.21.15.112:0/985310322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f0161f20 0x7fb8f00cedd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb8f00c7d40 tx=0x7fb8dc01c370 comp rx=0 tx=0).stop 2024-09-15T23:54:07.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/985310322 shutdown_connections 2024-09-15T23:54:07.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7fb8f5e7e640 1 --2- 172.21.15.112:0/985310322 >> v2:172.21.15.112:3300/0 conn(0x7fb8f00d3f70 0x7fb8f00d4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7fb8f5e7e640 1 --2- 172.21.15.112:0/985310322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f0161f20 0x7fb8f00cedd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/985310322 >> 172.21.15.112:0/985310322 conn(0x7fb8f008bf90 msgr2=0x7fb8f009d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/985310322 shutdown_connections 2024-09-15T23:54:07.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/985310322 wait complete. 2024-09-15T23:54:07.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7fb8f5e7e640 1 Processor -- start 2024-09-15T23:54:07.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7f7d82ffd640 1 -- 172.21.15.112:0/84062329 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7d88018020 con 0x7f7d8c005a70 2024-09-15T23:54:07.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7f7d82ffd640 1 --2- 172.21.15.112:0/84062329 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7d740678c0 0x7f7d74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7f7d82ffd640 1 -- 172.21.15.112:0/84062329 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7d880864f0 con 0x7f7d8c005a70 2024-09-15T23:54:07.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7f7d91d9b640 1 --2- 172.21.15.112:0/84062329 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7d740678c0 0x7f7d74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.301+0000 7fb8f5e7e640 1 -- start start 2024-09-15T23:54:07.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f5e7e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f00d3f70 0x7fb8f006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7f7d91d9b640 1 --2- 172.21.15.112:0/84062329 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7d740678c0 0x7f7d74069d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7d840b5000 tx=0x7f7d84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f4e7c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f00d3f70 0x7fb8f006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f4e7c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f00d3f70 0x7fb8f006dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57642/0 (socket says 172.21.15.112:57642) 2024-09-15T23:54:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f4e7c640 1 -- 172.21.15.112:0/545732166 learned_addr learned my addr 172.21.15.112:0/545732166 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f5e7e640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f015e3a0 0x7fb8f0203050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f5e7e640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f0161f20 0x7fb8f015ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/545732166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f00cf490 con 0x7fb8f00d3f70 2024-09-15T23:54:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/545732166 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f00cf310 con 0x7fb8f015e3a0 2024-09-15T23:54:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/545732166 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f00b4f50 con 0x7fb8f0161f20 2024-09-15T23:54:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f567d640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f0161f20 0x7fb8f015ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f4e7c640 1 -- 172.21.15.112:0/545732166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f0161f20 msgr2=0x7fb8f015ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f4e7c640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f0161f20 0x7fb8f015ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f4e7c640 1 -- 172.21.15.112:0/545732166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f015e3a0 msgr2=0x7fb8f0203050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:54:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f4e7c640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f015e3a0 0x7fb8f0203050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f4e7c640 1 -- 172.21.15.112:0/545732166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f00c99d0 con 0x7fb8f00d3f70 2024-09-15T23:54:07.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.305+0000 7fb8f4e7c640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f00d3f70 0x7fb8f006dde0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c6f0 tx=0x7fb8e400caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.309+0000 7fb8ed7fa640 1 -- 172.21.15.112:0/545732166 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4005cf0 con 0x7fb8f00d3f70 2024-09-15T23:54:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.309+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/545732166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f0203590 con 0x7fb8f00d3f70 2024-09-15T23:54:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.309+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/545732166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f00c9f70 con 0x7fb8f00d3f70 2024-09-15T23:54:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.309+0000 7fb8ed7fa640 1 -- 172.21.15.112:0/545732166 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e4007070 con 0x7fb8f00d3f70 2024-09-15T23:54:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.309+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/545732166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f00cedd0 con 0x7fb8f00d3f70 2024-09-15T23:54:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.309+0000 7fb8ed7fa640 1 -- 172.21.15.112:0/545732166 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40074a0 con 0x7fb8f00d3f70 2024-09-15T23:54:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.309+0000 7fb8ed7fa640 1 -- 172.21.15.112:0/545732166 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb8e4025430 con 0x7fb8f00d3f70 2024-09-15T23:54:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.313+0000 7fb8ed7fa640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8d40679f0 0x7fb8d4069eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.313+0000 7fb8ed7fa640 1 -- 172.21.15.112:0/545732166 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb8e4086900 con 0x7fb8f00d3f70 2024-09-15T23:54:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.313+0000 7fb8effff640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8d40679f0 0x7fb8d4069eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.313+0000 7fb8effff640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8d40679f0 0x7fb8d4069eb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0ad000 tx=0x7fb8dc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.313+0000 7f7d82ffd640 1 -- 172.21.15.112:0/84062329 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7d8801f020 con 0x7f7d8c005a70 2024-09-15T23:54:07.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.321+0000 7fb8ed7fa640 1 -- 172.21.15.112:0/545732166 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb8e4057170 con 0x7fb8f00d3f70 2024-09-15T23:54:07.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.565+0000 7feb2f735640 1 -- 172.21.15.112:0/3117851857 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7feb2806f4d0 con 0x7feb2815aeb0 2024-09-15T23:54:07.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.565+0000 7feb1dffb640 1 -- 172.21.15.112:0/3117851857 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb18055a10 con 0x7feb2815aeb0 2024-09-15T23:54:07.570 INFO:teuthology.orchestra.run.smithi112.stdout:64424509449 2024-09-15T23:54:07.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.569+0000 7feb0b7fe640 1 -- 172.21.15.112:0/3117851857 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feb0c067990 msgr2=0x7feb0c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.569+0000 7feb0b7fe640 1 --2- 172.21.15.112:0/3117851857 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feb0c067990 0x7feb0c069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feb20001570 tx=0x7feb20001aa0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.569+0000 7feb0b7fe640 1 -- 172.21.15.112:0/3117851857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb2815aeb0 msgr2=0x7feb28151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.569+0000 7feb0b7fe640 1 --2- 172.21.15.112:0/3117851857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb2815aeb0 0x7feb28151610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feb1800c490 tx=0x7feb18001e80 comp rx=0 tx=0).stop 2024-09-15T23:54:07.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.569+0000 7feb0b7fe640 1 -- 172.21.15.112:0/3117851857 shutdown_connections 2024-09-15T23:54:07.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.569+0000 7feb0b7fe640 1 --2- 172.21.15.112:0/3117851857 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feb0c067990 0x7feb0c069e50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.569+0000 7feb0b7fe640 1 --2- 172.21.15.112:0/3117851857 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb2815b290 0x7feb28151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.569+0000 7feb0b7fe640 1 --2- 172.21.15.112:0/3117851857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb2815aeb0 0x7feb28151610 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.569+0000 7feb0b7fe640 1 --2- 172.21.15.112:0/3117851857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb280733e0 0x7feb28155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.569+0000 7feb0b7fe640 1 -- 172.21.15.112:0/3117851857 >> 172.21.15.112:0/3117851857 conn(0x7feb2806cdd0 msgr2=0x7feb28159730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.569+0000 7feb0b7fe640 1 -- 172.21.15.112:0/3117851857 shutdown_connections 2024-09-15T23:54:07.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.569+0000 7feb0b7fe640 1 -- 172.21.15.112:0/3117851857 wait complete. 2024-09-15T23:54:07.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.577+0000 7f310a2c8640 1 -- 172.21.15.112:0/3121672109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f31040b3400 con 0x7f31040c5540 2024-09-15T23:54:07.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.577+0000 7f30f9ffb640 1 -- 172.21.15.112:0/3121672109 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f30f4019100 con 0x7f31040c5540 2024-09-15T23:54:07.582 INFO:teuthology.orchestra.run.smithi112.stdout:64424509450 2024-09-15T23:54:07.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.581+0000 7f310a2c8640 1 -- 172.21.15.112:0/3121672109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f30e80678f0 msgr2=0x7f30e8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.581+0000 7f310a2c8640 1 --2- 172.21.15.112:0/3121672109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f30e80678f0 0x7f30e8069db0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3100000f70 tx=0x7f3100009040 comp rx=0 tx=0).stop 2024-09-15T23:54:07.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.581+0000 7f310a2c8640 1 -- 172.21.15.112:0/3121672109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31040c5540 msgr2=0x7f31041461e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.581+0000 7f310a2c8640 1 --2- 172.21.15.112:0/3121672109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31040c5540 0x7f31041461e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f30f401fc90 tx=0x7f30f0005840 comp rx=0 tx=0).stop 2024-09-15T23:54:07.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.581+0000 7f310a2c8640 1 -- 172.21.15.112:0/3121672109 shutdown_connections 2024-09-15T23:54:07.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.581+0000 7f310a2c8640 1 --2- 172.21.15.112:0/3121672109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f30e80678f0 0x7f30e8069db0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.581+0000 7f310a2c8640 1 --2- 172.21.15.112:0/3121672109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31040c5540 0x7f31041461e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.581+0000 7f310a2c8640 1 --2- 172.21.15.112:0/3121672109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31040c50c0 0x7f3104145ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.581+0000 7f310a2c8640 1 --2- 172.21.15.112:0/3121672109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30f00051d0 0x7f31041443c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.581+0000 7f310a2c8640 1 -- 172.21.15.112:0/3121672109 >> 172.21.15.112:0/3121672109 conn(0x7f31040b1bf0 msgr2=0x7f310413f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.581+0000 7f310a2c8640 1 -- 172.21.15.112:0/3121672109 shutdown_connections 2024-09-15T23:54:07.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.581+0000 7f310a2c8640 1 -- 172.21.15.112:0/3121672109 wait complete. 2024-09-15T23:54:07.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-09-15T23:54:07.596 DEBUG:teuthology.parallel:result is None 2024-09-15T23:54:07.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.597+0000 7f891d958640 1 -- 172.21.15.112:0/498846430 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f89180b25c0 con 0x7f8918071c10 2024-09-15T23:54:07.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.597+0000 7f89157fa640 1 -- 172.21.15.112:0/498846430 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f890c0558c0 con 0x7f8918071c10 2024-09-15T23:54:07.600 INFO:teuthology.orchestra.run.smithi112.stdout:55834574856 2024-09-15T23:54:07.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.597+0000 7f891d958640 1 -- 172.21.15.112:0/498846430 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8904067910 msgr2=0x7f8904069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.601+0000 7f891d958640 1 --2- 172.21.15.112:0/498846430 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8904067910 0x7f8904069dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8908007fd0 tx=0x7f8908007e20 comp rx=0 tx=0).stop 2024-09-15T23:54:07.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.601+0000 7f891d958640 1 -- 172.21.15.112:0/498846430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8918071c10 msgr2=0x7f891815ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.601+0000 7f891d958640 1 --2- 172.21.15.112:0/498846430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8918071c10 0x7f891815ce80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f890c000f70 tx=0x7f890c00c890 comp rx=0 tx=0).stop 2024-09-15T23:54:07.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.601+0000 7f891d958640 1 -- 172.21.15.112:0/498846430 shutdown_connections 2024-09-15T23:54:07.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.601+0000 7f891d958640 1 --2- 172.21.15.112:0/498846430 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8904067910 0x7f8904069dd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.601+0000 7f891d958640 1 --2- 172.21.15.112:0/498846430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89180cf2e0 0x7f891814a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.601+0000 7f891d958640 1 --2- 172.21.15.112:0/498846430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8918071c10 0x7f891815ce80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.601+0000 7f891d958640 1 --2- 172.21.15.112:0/498846430 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f891806fcb0 0x7f89180b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.601+0000 7f891d958640 1 -- 172.21.15.112:0/498846430 >> 172.21.15.112:0/498846430 conn(0x7f89180b1dd0 msgr2=0x7f89180afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.601+0000 7f891d958640 1 -- 172.21.15.112:0/498846430 shutdown_connections 2024-09-15T23:54:07.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.601+0000 7f891d958640 1 -- 172.21.15.112:0/498846430 wait complete. 2024-09-15T23:54:07.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.2 2024-09-15T23:54:07.607 DEBUG:teuthology.parallel:result is None 2024-09-15T23:54:07.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.609+0000 7f25a759e640 1 -- 172.21.15.112:0/2064828603 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f258c005860 con 0x7f25a00063e0 2024-09-15T23:54:07.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.609+0000 7f2596ffd640 1 -- 172.21.15.112:0/2064828603 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2598055680 con 0x7f25a00063e0 2024-09-15T23:54:07.613 INFO:teuthology.orchestra.run.smithi112.stdout:64424509449 2024-09-15T23:54:07.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.613+0000 7f25a759e640 1 -- 172.21.15.112:0/2064828603 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f25880678c0 msgr2=0x7f2588069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.613+0000 7f25a759e640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f25880678c0 0x7f2588069d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f259c0ad000 tx=0x7f259c0a6000 comp rx=0 tx=0).stop 2024-09-15T23:54:07.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.613+0000 7f25a759e640 1 -- 172.21.15.112:0/2064828603 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25a00063e0 msgr2=0x7f25a00536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.613+0000 7f25a759e640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25a00063e0 0x7f25a00536b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f259800c3f0 tx=0x7f259800c8b0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.613+0000 7f25a759e640 1 -- 172.21.15.112:0/2064828603 shutdown_connections 2024-09-15T23:54:07.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.613+0000 7f25a759e640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f25880678c0 0x7f2588069d80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.613+0000 7f25a759e640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25a00e2d20 0x7f25a003ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.613+0000 7f25a759e640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25a0056610 0x7f25a004e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.613+0000 7f25a759e640 1 --2- 172.21.15.112:0/2064828603 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f25a00063e0 0x7f25a00536b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.613+0000 7f25a759e640 1 -- 172.21.15.112:0/2064828603 >> 172.21.15.112:0/2064828603 conn(0x7f25a003a530 msgr2=0x7f25a00e6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.613+0000 7f25a759e640 1 -- 172.21.15.112:0/2064828603 shutdown_connections 2024-09-15T23:54:07.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.613+0000 7f25a759e640 1 -- 172.21.15.112:0/2064828603 wait complete. 2024-09-15T23:54:07.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2024-09-15T23:54:07.619 DEBUG:teuthology.parallel:result is None 2024-09-15T23:54:07.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.617+0000 7fcc91728640 1 -- 172.21.15.112:0/844474709 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fcc6c005860 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.617+0000 7fcc737fe640 1 -- 172.21.15.112:0/844474709 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcc7c0569a0 con 0x7fcc8c06ccd0 2024-09-15T23:54:07.621 INFO:teuthology.orchestra.run.smithi112.stdout:64424509449 2024-09-15T23:54:07.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.621+0000 7fcc91728640 1 -- 172.21.15.112:0/844474709 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcc780678f0 msgr2=0x7fcc78069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.621+0000 7fcc91728640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcc780678f0 0x7fcc78069db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c14c360 tx=0x7fcc80008040 comp rx=0 tx=0).stop 2024-09-15T23:54:07.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.621+0000 7fcc91728640 1 -- 172.21.15.112:0/844474709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc8c06ccd0 msgr2=0x7fcc8c142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.621+0000 7fcc91728640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc8c06ccd0 0x7fcc8c142c70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00e930 tx=0x7fcc7c00edf0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.621+0000 7fcc91728640 1 -- 172.21.15.112:0/844474709 shutdown_connections 2024-09-15T23:54:07.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.621+0000 7fcc91728640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcc780678f0 0x7fcc78069db0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.621+0000 7fcc91728640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc8c154d60 0x7fcc8c155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.621+0000 7fcc91728640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc8c0cd500 0x7fcc8c155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.621+0000 7fcc91728640 1 --2- 172.21.15.112:0/844474709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc8c06ccd0 0x7fcc8c142c70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.621+0000 7fcc91728640 1 -- 172.21.15.112:0/844474709 >> 172.21.15.112:0/844474709 conn(0x7fcc8c072670 msgr2=0x7fcc8c06c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.621+0000 7fcc91728640 1 -- 172.21.15.112:0/844474709 shutdown_connections 2024-09-15T23:54:07.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.621+0000 7fcc91728640 1 -- 172.21.15.112:0/844474709 wait complete. 2024-09-15T23:54:07.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.625+0000 7f223af89640 1 -- 172.21.15.112:0/2401414762 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f223414eed0 con 0x7f223406e7d0 2024-09-15T23:54:07.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.625+0000 7f222a7fc640 1 -- 172.21.15.112:0/2401414762 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f222c0165a0 con 0x7f223406e7d0 2024-09-15T23:54:07.628 INFO:teuthology.orchestra.run.smithi112.stdout:64424509448 2024-09-15T23:54:07.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.629+0000 7f223af89640 1 -- 172.21.15.112:0/2401414762 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2218067910 msgr2=0x7f2218069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.629+0000 7f223af89640 1 --2- 172.21.15.112:0/2401414762 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2218067910 0x7f2218069dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2224006fd0 tx=0x7f2224008040 comp rx=0 tx=0).stop 2024-09-15T23:54:07.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.629+0000 7f223af89640 1 -- 172.21.15.112:0/2401414762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f223406e7d0 msgr2=0x7f22340ab1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.629+0000 7f223af89640 1 --2- 172.21.15.112:0/2401414762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f223406e7d0 0x7f22340ab1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f222c01a5b0 tx=0x7f222c019720 comp rx=0 tx=0).stop 2024-09-15T23:54:07.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.629+0000 7f223af89640 1 -- 172.21.15.112:0/2401414762 shutdown_connections 2024-09-15T23:54:07.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.629+0000 7f223af89640 1 --2- 172.21.15.112:0/2401414762 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2218067910 0x7f2218069dd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.629+0000 7f223af89640 1 --2- 172.21.15.112:0/2401414762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f223415a7c0 0x7f22340a9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.629+0000 7f223af89640 1 --2- 172.21.15.112:0/2401414762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f223406f380 0x7f223414e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.629+0000 7f223af89640 1 --2- 172.21.15.112:0/2401414762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f223406e7d0 0x7f22340ab1b0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f222c01a5b0 tx=0x7f222c019720 comp rx=0 tx=0).stop 2024-09-15T23:54:07.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.629+0000 7f223af89640 1 -- 172.21.15.112:0/2401414762 >> 172.21.15.112:0/2401414762 conn(0x7f22340d0890 msgr2=0x7f22340b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.629+0000 7f223af89640 1 -- 172.21.15.112:0/2401414762 shutdown_connections 2024-09-15T23:54:07.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.629+0000 7f223af89640 1 -- 172.21.15.112:0/2401414762 wait complete. 2024-09-15T23:54:07.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.633+0000 7f7d9359e640 1 -- 172.21.15.112:0/84062329 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7d8c0340b0 con 0x7f7d8c005a70 2024-09-15T23:54:07.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.633+0000 7f7d82ffd640 1 -- 172.21.15.112:0/84062329 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7d8800d040 con 0x7f7d8c005a70 2024-09-15T23:54:07.635 INFO:teuthology.orchestra.run.smithi112.stdout:64424509449 2024-09-15T23:54:07.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.633+0000 7f7d9359e640 1 -- 172.21.15.112:0/84062329 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7d740678c0 msgr2=0x7f7d74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.633+0000 7f7d9359e640 1 --2- 172.21.15.112:0/84062329 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7d740678c0 0x7f7d74069d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7d840b5000 tx=0x7f7d84008040 comp rx=0 tx=0).stop 2024-09-15T23:54:07.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.633+0000 7f7d9359e640 1 -- 172.21.15.112:0/84062329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d8c005a70 msgr2=0x7f7d8c0defe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.633+0000 7f7d9359e640 1 --2- 172.21.15.112:0/84062329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d8c005a70 0x7f7d8c0defe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800b450 tx=0x7f7d8800b910 comp rx=0 tx=0).stop 2024-09-15T23:54:07.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.633+0000 7f7d9359e640 1 -- 172.21.15.112:0/84062329 shutdown_connections 2024-09-15T23:54:07.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.633+0000 7f7d9359e640 1 --2- 172.21.15.112:0/84062329 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7d740678c0 0x7f7d74069d80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.633+0000 7f7d9359e640 1 --2- 172.21.15.112:0/84062329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d8c17c2b0 0x7f7d8c04a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.633+0000 7f7d9359e640 1 --2- 172.21.15.112:0/84062329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d8c0deb70 0x7f7d8c0e1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.633+0000 7f7d9359e640 1 --2- 172.21.15.112:0/84062329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d8c005a70 0x7f7d8c0defe0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.633+0000 7f7d9359e640 1 -- 172.21.15.112:0/84062329 >> 172.21.15.112:0/84062329 conn(0x7f7d8c0360a0 msgr2=0x7f7d8c035540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.633+0000 7f7d9359e640 1 -- 172.21.15.112:0/84062329 shutdown_connections 2024-09-15T23:54:07.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.637+0000 7f7d9359e640 1 -- 172.21.15.112:0/84062329 wait complete. 2024-09-15T23:54:07.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.1 2024-09-15T23:54:07.641 DEBUG:teuthology.parallel:result is None 2024-09-15T23:54:07.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.7 2024-09-15T23:54:07.643 DEBUG:teuthology.parallel:result is None 2024-09-15T23:54:07.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2024-09-15T23:54:07.655 DEBUG:teuthology.parallel:result is None 2024-09-15T23:54:07.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.653+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/545732166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb8f009d910 con 0x7fb8f00d3f70 2024-09-15T23:54:07.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.653+0000 7fb8ed7fa640 1 -- 172.21.15.112:0/545732166 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8e4056a70 con 0x7fb8f00d3f70 2024-09-15T23:54:07.656 INFO:teuthology.orchestra.run.smithi112.stdout:64424509448 2024-09-15T23:54:07.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2024-09-15T23:54:07.659 DEBUG:teuthology.parallel:result is None 2024-09-15T23:54:07.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.657+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/545732166 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8d40679f0 msgr2=0x7fb8d4069eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.657+0000 7fb8f5e7e640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8d40679f0 0x7fb8d4069eb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0ad000 tx=0x7fb8dc0a6000 comp rx=0 tx=0).stop 2024-09-15T23:54:07.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.657+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/545732166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f00d3f70 msgr2=0x7fb8f006dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.657+0000 7fb8f5e7e640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f00d3f70 0x7fb8f006dde0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c6f0 tx=0x7fb8e400caf0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.657+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/545732166 shutdown_connections 2024-09-15T23:54:07.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.657+0000 7fb8f5e7e640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8d40679f0 0x7fb8d4069eb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.657+0000 7fb8f5e7e640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f0161f20 0x7fb8f015ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.657+0000 7fb8f5e7e640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f015e3a0 0x7fb8f0203050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.657+0000 7fb8f5e7e640 1 --2- 172.21.15.112:0/545732166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f00d3f70 0x7fb8f006dde0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.657+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/545732166 >> 172.21.15.112:0/545732166 conn(0x7fb8f008bf90 msgr2=0x7fb8f015b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.657+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/545732166 shutdown_connections 2024-09-15T23:54:07.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.657+0000 7fb8f5e7e640 1 -- 172.21.15.112:0/545732166 wait complete. 2024-09-15T23:54:07.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.0 2024-09-15T23:54:07.673 DEBUG:teuthology.parallel:result is None 2024-09-15T23:54:07.673 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:54:07.673 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:54:07.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.817+0000 7f5c08950640 1 Processor -- start 2024-09-15T23:54:07.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.817+0000 7f5c08950640 1 -- start start 2024-09-15T23:54:07.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c08950640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5c041587a0 0x7f5c040b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c08950640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c0406ec60 con 0x7f5c0406e680 2024-09-15T23:54:07.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c08950640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c0406ef40 con 0x7f5c040b37d0 2024-09-15T23:54:07.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c08950640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5c040b3c40 con 0x7f5c041587a0 2024-09-15T23:54:07.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c0259c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5c041587a0 0x7f5c040b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c0259c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5c041587a0 0x7f5c040b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57652/0 (socket says 172.21.15.112:57652) 2024-09-15T23:54:07.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c02d9d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5c0406e680 0x7f5c04072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49782/0 (socket says 172.21.15.112:49782) 2024-09-15T23:54:07.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c0259c640 1 -- 172.21.15.112:0/718241553 learned_addr learned my addr 172.21.15.112:0/718241553 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:07.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c0259c640 1 -- 172.21.15.112:0/718241553 >> v1:172.21.15.169:6789/0 conn(0x7f5c040b37d0 legacy=0x7f5c0406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:07.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c0259c640 1 -- 172.21.15.112:0/718241553 >> v1:172.21.15.112:6789/0 conn(0x7f5c0406e680 legacy=0x7f5c04072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c0159a640 1 -- 172.21.15.112:0/718241553 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1896571055 0 0) 0x7f5c0406ec60 con 0x7f5c0406e680 2024-09-15T23:54:07.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c0259c640 1 -- 172.21.15.112:0/718241553 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0406f220 con 0x7f5c041587a0 2024-09-15T23:54:07.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c0259c640 1 --2- 172.21.15.112:0/718241553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c041587a0 0x7f5c040b3290 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009870 tx=0x7f5bf401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e585d760d5ea60f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c0159a640 1 -- 172.21.15.112:0/718241553 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40b0070 con 0x7f5c041587a0 2024-09-15T23:54:07.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c0159a640 1 -- 172.21.15.112:0/718241553 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf40ab600 con 0x7f5c041587a0 2024-09-15T23:54:07.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c0159a640 1 -- 172.21.15.112:0/718241553 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40ab9d0 con 0x7f5c041587a0 2024-09-15T23:54:07.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c08950640 1 -- 172.21.15.112:0/718241553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c041587a0 msgr2=0x7f5c040b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c08950640 1 --2- 172.21.15.112:0/718241553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c041587a0 0x7f5c040b3290 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009870 tx=0x7f5bf401c520 comp rx=0 tx=0).stop 2024-09-15T23:54:07.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c08950640 1 -- 172.21.15.112:0/718241553 shutdown_connections 2024-09-15T23:54:07.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c08950640 1 --2- 172.21.15.112:0/718241553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c041587a0 0x7f5c040b3290 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c08950640 1 -- 172.21.15.112:0/718241553 >> 172.21.15.112:0/718241553 conn(0x7f5c040b1f90 msgr2=0x7f5c040b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:07.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c08950640 1 -- 172.21.15.112:0/718241553 shutdown_connections 2024-09-15T23:54:07.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.821+0000 7f5c08950640 1 -- 172.21.15.112:0/718241553 wait complete. 2024-09-15T23:54:07.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c08950640 1 Processor -- start 2024-09-15T23:54:07.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c08950640 1 -- start start 2024-09-15T23:54:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c08950640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c0406e680 0x7f5c0415b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c08950640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c040b37d0 0x7f5c04099540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c08950640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c041587a0 0x7f5c04099a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c08950640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0416c200 con 0x7f5c041587a0 2024-09-15T23:54:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c08950640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5c04073310 con 0x7f5c040b37d0 2024-09-15T23:54:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c08950640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0416c380 con 0x7f5c0406e680 2024-09-15T23:54:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c02d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c041587a0 0x7f5c04099a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c02d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c041587a0 0x7f5c04099a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57654/0 (socket says 172.21.15.112:57654) 2024-09-15T23:54:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c02d9d640 1 -- 172.21.15.112:0/671777370 learned_addr learned my addr 172.21.15.112:0/671777370 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c02d9d640 1 -- 172.21.15.112:0/671777370 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c0406e680 msgr2=0x7f5c0415b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c02d9d640 1 --2- 172.21.15.112:0/671777370 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c0406e680 0x7f5c0415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c02d9d640 1 -- 172.21.15.112:0/671777370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c040b37d0 msgr2=0x7f5c04099540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c01d9b640 1 --2- 172.21.15.112:0/671777370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c040b37d0 0x7f5c04099540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c02d9d640 1 --2- 172.21.15.112:0/671777370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c040b37d0 0x7f5c04099540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c02d9d640 1 -- 172.21.15.112:0/671777370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0409d4a0 con 0x7f5c041587a0 2024-09-15T23:54:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c02d9d640 1 --2- 172.21.15.112:0/671777370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c041587a0 0x7f5c04099a80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00c4b0 tx=0x7f5bfc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5bf2ffd640 1 -- 172.21.15.112:0/671777370 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc018070 con 0x7f5c041587a0 2024-09-15T23:54:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5bf2ffd640 1 -- 172.21.15.112:0/671777370 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bfc0074e0 con 0x7f5c041587a0 2024-09-15T23:54:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c08950640 1 -- 172.21.15.112:0/671777370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0409d9f0 con 0x7f5c041587a0 2024-09-15T23:54:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5bf2ffd640 1 -- 172.21.15.112:0/671777370 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc004a30 con 0x7f5c041587a0 2024-09-15T23:54:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c08950640 1 -- 172.21.15.112:0/671777370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c0409b4e0 con 0x7f5c041587a0 2024-09-15T23:54:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5c08950640 1 -- 172.21.15.112:0/671777370 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c040b3290 con 0x7f5c041587a0 2024-09-15T23:54:07.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.825+0000 7f5bf2ffd640 1 -- 172.21.15.112:0/671777370 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5bfc01b070 con 0x7f5c041587a0 2024-09-15T23:54:07.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.829+0000 7f5bf2ffd640 1 --2- 172.21.15.112:0/671777370 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5be40678f0 0x7f5be4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:07.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.829+0000 7f5c0259c640 1 --2- 172.21.15.112:0/671777370 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5be40678f0 0x7f5be4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:07.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.829+0000 7f5bf2ffd640 1 -- 172.21.15.112:0/671777370 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5bfc0851e0 con 0x7f5c041587a0 2024-09-15T23:54:07.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.829+0000 7f5c0259c640 1 --2- 172.21.15.112:0/671777370 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5be40678f0 0x7f5be4069db0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40ad000 tx=0x7f5bf4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:07.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.833+0000 7f5bf2ffd640 1 -- 172.21.15.112:0/671777370 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5bfc0559e0 con 0x7f5c041587a0 2024-09-15T23:54:07.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:07.977+0000 7f5c08950640 1 -- 172.21.15.112:0/671777370 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c04070080 con 0x7f5be40678f0 2024-09-15T23:54:08.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.001+0000 7f5bf2ffd640 1 -- 172.21.15.112:0/671777370 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332530 (secure 0 0 0) 0x7f5c04070080 con 0x7f5be40678f0 2024-09-15T23:54:08.006 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:08.008 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:54:08.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.005+0000 7f5c08950640 1 -- 172.21.15.112:0/671777370 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5be40678f0 msgr2=0x7f5be4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.005+0000 7f5c08950640 1 --2- 172.21.15.112:0/671777370 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5be40678f0 0x7f5be4069db0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40ad000 tx=0x7f5bf4008040 comp rx=0 tx=0).stop 2024-09-15T23:54:08.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.005+0000 7f5c08950640 1 -- 172.21.15.112:0/671777370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c041587a0 msgr2=0x7f5c04099a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.005+0000 7f5c08950640 1 --2- 172.21.15.112:0/671777370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c041587a0 0x7f5c04099a80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00c4b0 tx=0x7f5bfc00c970 comp rx=0 tx=0).stop 2024-09-15T23:54:08.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.005+0000 7f5c08950640 1 -- 172.21.15.112:0/671777370 shutdown_connections 2024-09-15T23:54:08.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.005+0000 7f5c08950640 1 --2- 172.21.15.112:0/671777370 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5be40678f0 0x7f5be4069db0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.005+0000 7f5c08950640 1 --2- 172.21.15.112:0/671777370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c041587a0 0x7f5c04099a80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.005+0000 7f5c08950640 1 --2- 172.21.15.112:0/671777370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c040b37d0 0x7f5c04099540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.005+0000 7f5c08950640 1 --2- 172.21.15.112:0/671777370 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c0406e680 0x7f5c0415b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.005+0000 7f5c08950640 1 -- 172.21.15.112:0/671777370 >> 172.21.15.112:0/671777370 conn(0x7f5c040b1f90 msgr2=0x7f5c040aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:08.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.005+0000 7f5c08950640 1 -- 172.21.15.112:0/671777370 shutdown_connections 2024-09-15T23:54:08.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.005+0000 7f5c08950640 1 -- 172.21.15.112:0/671777370 wait complete. 2024-09-15T23:54:08.022 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-15T23:54:07.236867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219572,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755148,"statfs":{"total":773094113280,"available":772869271552,"internally_reserved":0,"allocated":3416064,"data_stored":2044148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.441706"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.337336+0000","last_change":"2024-09-15T23:53:49.717934+0000","last_active":"2024-09-15T23:53:56.337336+0000","last_peered":"2024-09-15T23:53:56.337336+0000","last_clean":"2024-09-15T23:53:56.337336+0000","last_became_active":"2024-09-15T23:53:49.714475+0000","last_became_peered":"2024-09-15T23:53:49.714475+0000","last_unstale":"2024-09-15T23:53:56.337336+0000","last_undegraded":"2024-09-15T23:53:56.337336+0000","last_fullsized":"2024-09-15T23:53:56.337336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:32.423155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806022+0000","last_change":"2024-09-15T23:53:50.763869+0000","last_active":"2024-09-15T23:53:55.806022+0000","last_peered":"2024-09-15T23:53:55.806022+0000","last_clean":"2024-09-15T23:53:55.806022+0000","last_became_active":"2024-09-15T23:53:50.763518+0000","last_became_peered":"2024-09-15T23:53:50.763518+0000","last_unstale":"2024-09-15T23:53:55.806022+0000","last_undegraded":"2024-09-15T23:53:55.806022+0000","last_fullsized":"2024-09-15T23:53:55.806022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:47.362321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334847+0000","last_change":"2024-09-15T23:53:54.833331+0000","last_active":"2024-09-15T23:53:56.334847+0000","last_peered":"2024-09-15T23:53:56.334847+0000","last_clean":"2024-09-15T23:53:56.334847+0000","last_became_active":"2024-09-15T23:53:54.832469+0000","last_became_peered":"2024-09-15T23:53:54.832469+0000","last_unstale":"2024-09-15T23:53:56.334847+0000","last_undegraded":"2024-09-15T23:53:56.334847+0000","last_fullsized":"2024-09-15T23:53:56.334847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:19.976505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806573+0000","last_change":"2024-09-15T23:53:49.732960+0000","last_active":"2024-09-15T23:53:55.806573+0000","last_peered":"2024-09-15T23:53:55.806573+0000","last_clean":"2024-09-15T23:53:55.806573+0000","last_became_active":"2024-09-15T23:53:49.728314+0000","last_became_peered":"2024-09-15T23:53:49.728314+0000","last_unstale":"2024-09-15T23:53:55.806573+0000","last_undegraded":"2024-09-15T23:53:55.806573+0000","last_fullsized":"2024-09-15T23:53:55.806573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:41.274907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807049+0000","last_change":"2024-09-15T23:53:50.778808+0000","last_active":"2024-09-15T23:53:55.807049+0000","last_peered":"2024-09-15T23:53:55.807049+0000","last_clean":"2024-09-15T23:53:55.807049+0000","last_became_active":"2024-09-15T23:53:50.778102+0000","last_became_peered":"2024-09-15T23:53:50.778102+0000","last_unstale":"2024-09-15T23:53:55.807049+0000","last_undegraded":"2024-09-15T23:53:55.807049+0000","last_fullsized":"2024-09-15T23:53:55.807049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:59:38.443508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331942+0000","last_change":"2024-09-15T23:53:54.829460+0000","last_active":"2024-09-15T23:53:56.331942+0000","last_peered":"2024-09-15T23:53:56.331942+0000","last_clean":"2024-09-15T23:53:56.331942+0000","last_became_active":"2024-09-15T23:53:54.828410+0000","last_became_peered":"2024-09-15T23:53:54.828410+0000","last_unstale":"2024-09-15T23:53:56.331942+0000","last_undegraded":"2024-09-15T23:53:56.331942+0000","last_fullsized":"2024-09-15T23:53:56.331942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:01.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334332+0000","last_change":"2024-09-15T23:53:49.709773+0000","last_active":"2024-09-15T23:53:56.334332+0000","last_peered":"2024-09-15T23:53:56.334332+0000","last_clean":"2024-09-15T23:53:56.334332+0000","last_became_active":"2024-09-15T23:53:49.706868+0000","last_became_peered":"2024-09-15T23:53:49.706868+0000","last_unstale":"2024-09-15T23:53:56.334332+0000","last_undegraded":"2024-09-15T23:53:56.334332+0000","last_fullsized":"2024-09-15T23:53:56.334332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:30.316273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332457+0000","last_change":"2024-09-15T23:53:50.774606+0000","last_active":"2024-09-15T23:53:56.332457+0000","last_peered":"2024-09-15T23:53:56.332457+0000","last_clean":"2024-09-15T23:53:56.332457+0000","last_became_active":"2024-09-15T23:53:50.774322+0000","last_became_peered":"2024-09-15T23:53:50.774322+0000","last_unstale":"2024-09-15T23:53:56.332457+0000","last_undegraded":"2024-09-15T23:53:56.332457+0000","last_fullsized":"2024-09-15T23:53:56.332457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:10.630689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331636+0000","last_change":"2024-09-15T23:53:54.826698+0000","last_active":"2024-09-15T23:53:56.331636+0000","last_peered":"2024-09-15T23:53:56.331636+0000","last_clean":"2024-09-15T23:53:56.331636+0000","last_became_active":"2024-09-15T23:53:54.826082+0000","last_became_peered":"2024-09-15T23:53:54.826082+0000","last_unstale":"2024-09-15T23:53:56.331636+0000","last_undegraded":"2024-09-15T23:53:56.331636+0000","last_fullsized":"2024-09-15T23:53:56.331636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:34.967835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334036+0000","last_change":"2024-09-15T23:53:49.728958+0000","last_active":"2024-09-15T23:53:56.334036+0000","last_peered":"2024-09-15T23:53:56.334036+0000","last_clean":"2024-09-15T23:53:56.334036+0000","last_became_active":"2024-09-15T23:53:49.728518+0000","last_became_peered":"2024-09-15T23:53:49.728518+0000","last_unstale":"2024-09-15T23:53:56.334036+0000","last_undegraded":"2024-09-15T23:53:56.334036+0000","last_fullsized":"2024-09-15T23:53:56.334036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:14.375412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800310+0000","last_change":"2024-09-15T23:53:50.774805+0000","last_active":"2024-09-15T23:53:55.800310+0000","last_peered":"2024-09-15T23:53:55.800310+0000","last_clean":"2024-09-15T23:53:55.800310+0000","last_became_active":"2024-09-15T23:53:50.774139+0000","last_became_peered":"2024-09-15T23:53:50.774139+0000","last_unstale":"2024-09-15T23:53:55.800310+0000","last_undegraded":"2024-09-15T23:53:55.800310+0000","last_fullsized":"2024-09-15T23:53:55.800310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:14.717753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331537+0000","last_change":"2024-09-15T23:53:54.838942+0000","last_active":"2024-09-15T23:53:56.331537+0000","last_peered":"2024-09-15T23:53:56.331537+0000","last_clean":"2024-09-15T23:53:56.331537+0000","last_became_active":"2024-09-15T23:53:54.838537+0000","last_became_peered":"2024-09-15T23:53:54.838537+0000","last_unstale":"2024-09-15T23:53:56.331537+0000","last_undegraded":"2024-09-15T23:53:56.331537+0000","last_fullsized":"2024-09-15T23:53:56.331537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:21.696119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799206+0000","last_change":"2024-09-15T23:53:50.762649+0000","last_active":"2024-09-15T23:53:55.799206+0000","last_peered":"2024-09-15T23:53:55.799206+0000","last_clean":"2024-09-15T23:53:55.799206+0000","last_became_active":"2024-09-15T23:53:50.762376+0000","last_became_peered":"2024-09-15T23:53:50.762376+0000","last_unstale":"2024-09-15T23:53:55.799206+0000","last_undegraded":"2024-09-15T23:53:55.799206+0000","last_fullsized":"2024-09-15T23:53:55.799206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:27.451893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799258+0000","last_change":"2024-09-15T23:53:49.707629+0000","last_active":"2024-09-15T23:53:55.799258+0000","last_peered":"2024-09-15T23:53:55.799258+0000","last_clean":"2024-09-15T23:53:55.799258+0000","last_became_active":"2024-09-15T23:53:49.706615+0000","last_became_peered":"2024-09-15T23:53:49.706615+0000","last_unstale":"2024-09-15T23:53:55.799258+0000","last_undegraded":"2024-09-15T23:53:55.799258+0000","last_fullsized":"2024-09-15T23:53:55.799258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:25.059449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799393+0000","last_change":"2024-09-15T23:53:54.831019+0000","last_active":"2024-09-15T23:53:55.799393+0000","last_peered":"2024-09-15T23:53:55.799393+0000","last_clean":"2024-09-15T23:53:55.799393+0000","last_became_active":"2024-09-15T23:53:54.830461+0000","last_became_peered":"2024-09-15T23:53:54.830461+0000","last_unstale":"2024-09-15T23:53:55.799393+0000","last_undegraded":"2024-09-15T23:53:55.799393+0000","last_fullsized":"2024-09-15T23:53:55.799393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:11.816336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336067+0000","last_change":"2024-09-15T23:53:50.769836+0000","last_active":"2024-09-15T23:53:56.336067+0000","last_peered":"2024-09-15T23:53:56.336067+0000","last_clean":"2024-09-15T23:53:56.336067+0000","last_became_active":"2024-09-15T23:53:50.769317+0000","last_became_peered":"2024-09-15T23:53:50.769317+0000","last_unstale":"2024-09-15T23:53:56.336067+0000","last_undegraded":"2024-09-15T23:53:56.336067+0000","last_fullsized":"2024-09-15T23:53:56.336067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805160+0000","last_change":"2024-09-15T23:53:49.724446+0000","last_active":"2024-09-15T23:53:55.805160+0000","last_peered":"2024-09-15T23:53:55.805160+0000","last_clean":"2024-09-15T23:53:55.805160+0000","last_became_active":"2024-09-15T23:53:49.723722+0000","last_became_peered":"2024-09-15T23:53:49.723722+0000","last_unstale":"2024-09-15T23:53:55.805160+0000","last_undegraded":"2024-09-15T23:53:55.805160+0000","last_fullsized":"2024-09-15T23:53:55.805160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:55.009643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333927+0000","last_change":"2024-09-15T23:53:54.827261+0000","last_active":"2024-09-15T23:53:56.333927+0000","last_peered":"2024-09-15T23:53:56.333927+0000","last_clean":"2024-09-15T23:53:56.333927+0000","last_became_active":"2024-09-15T23:53:54.826675+0000","last_became_peered":"2024-09-15T23:53:54.826675+0000","last_unstale":"2024-09-15T23:53:56.333927+0000","last_undegraded":"2024-09-15T23:53:56.333927+0000","last_fullsized":"2024-09-15T23:53:56.333927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:05.187892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334092+0000","last_change":"2024-09-15T23:53:50.758381+0000","last_active":"2024-09-15T23:53:56.334092+0000","last_peered":"2024-09-15T23:53:56.334092+0000","last_clean":"2024-09-15T23:53:56.334092+0000","last_became_active":"2024-09-15T23:53:50.757608+0000","last_became_peered":"2024-09-15T23:53:50.757608+0000","last_unstale":"2024-09-15T23:53:56.334092+0000","last_undegraded":"2024-09-15T23:53:56.334092+0000","last_fullsized":"2024-09-15T23:53:56.334092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:05.877077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335894+0000","last_change":"2024-09-15T23:53:49.722069+0000","last_active":"2024-09-15T23:53:56.335894+0000","last_peered":"2024-09-15T23:53:56.335894+0000","last_clean":"2024-09-15T23:53:56.335894+0000","last_became_active":"2024-09-15T23:53:49.721311+0000","last_became_peered":"2024-09-15T23:53:49.721311+0000","last_unstale":"2024-09-15T23:53:56.335894+0000","last_undegraded":"2024-09-15T23:53:56.335894+0000","last_fullsized":"2024-09-15T23:53:56.335894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:54.905896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336379+0000","last_change":"2024-09-15T23:53:54.834211+0000","last_active":"2024-09-15T23:53:56.336379+0000","last_peered":"2024-09-15T23:53:56.336379+0000","last_clean":"2024-09-15T23:53:56.336379+0000","last_became_active":"2024-09-15T23:53:54.832649+0000","last_became_peered":"2024-09-15T23:53:54.832649+0000","last_unstale":"2024-09-15T23:53:56.336379+0000","last_undegraded":"2024-09-15T23:53:56.336379+0000","last_fullsized":"2024-09-15T23:53:56.336379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:15.794176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798634+0000","last_change":"2024-09-15T23:53:50.765134+0000","last_active":"2024-09-15T23:53:55.798634+0000","last_peered":"2024-09-15T23:53:55.798634+0000","last_clean":"2024-09-15T23:53:55.798634+0000","last_became_active":"2024-09-15T23:53:50.764730+0000","last_became_peered":"2024-09-15T23:53:50.764730+0000","last_unstale":"2024-09-15T23:53:55.798634+0000","last_undegraded":"2024-09-15T23:53:55.798634+0000","last_fullsized":"2024-09-15T23:53:55.798634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:59.810140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332903+0000","last_change":"2024-09-15T23:53:49.705844+0000","last_active":"2024-09-15T23:53:56.332903+0000","last_peered":"2024-09-15T23:53:56.332903+0000","last_clean":"2024-09-15T23:53:56.332903+0000","last_became_active":"2024-09-15T23:53:49.705408+0000","last_became_peered":"2024-09-15T23:53:49.705408+0000","last_unstale":"2024-09-15T23:53:56.332903+0000","last_undegraded":"2024-09-15T23:53:56.332903+0000","last_fullsized":"2024-09-15T23:53:56.332903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.829837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332277+0000","last_change":"2024-09-15T23:53:54.832183+0000","last_active":"2024-09-15T23:53:56.332277+0000","last_peered":"2024-09-15T23:53:56.332277+0000","last_clean":"2024-09-15T23:53:56.332277+0000","last_became_active":"2024-09-15T23:53:54.831797+0000","last_became_peered":"2024-09-15T23:53:54.831797+0000","last_unstale":"2024-09-15T23:53:56.332277+0000","last_undegraded":"2024-09-15T23:53:56.332277+0000","last_fullsized":"2024-09-15T23:53:56.332277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:05.294652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336702+0000","last_change":"2024-09-15T23:53:50.760086+0000","last_active":"2024-09-15T23:53:56.336702+0000","last_peered":"2024-09-15T23:53:56.336702+0000","last_clean":"2024-09-15T23:53:56.336702+0000","last_became_active":"2024-09-15T23:53:50.759518+0000","last_became_peered":"2024-09-15T23:53:50.759518+0000","last_unstale":"2024-09-15T23:53:56.336702+0000","last_undegraded":"2024-09-15T23:53:56.336702+0000","last_fullsized":"2024-09-15T23:53:56.336702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:49.338954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.801439+0000","last_change":"2024-09-15T23:53:49.712525+0000","last_active":"2024-09-15T23:53:55.801439+0000","last_peered":"2024-09-15T23:53:55.801439+0000","last_clean":"2024-09-15T23:53:55.801439+0000","last_became_active":"2024-09-15T23:53:49.711958+0000","last_became_peered":"2024-09-15T23:53:49.711958+0000","last_unstale":"2024-09-15T23:53:55.801439+0000","last_undegraded":"2024-09-15T23:53:55.801439+0000","last_fullsized":"2024-09-15T23:53:55.801439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:29.249885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331564+0000","last_change":"2024-09-15T23:53:54.820216+0000","last_active":"2024-09-15T23:53:56.331564+0000","last_peered":"2024-09-15T23:53:56.331564+0000","last_clean":"2024-09-15T23:53:56.331564+0000","last_became_active":"2024-09-15T23:53:54.819642+0000","last_became_peered":"2024-09-15T23:53:54.819642+0000","last_unstale":"2024-09-15T23:53:56.331564+0000","last_undegraded":"2024-09-15T23:53:56.331564+0000","last_fullsized":"2024-09-15T23:53:56.331564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:58.670287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.337164+0000","last_change":"2024-09-15T23:53:50.764624+0000","last_active":"2024-09-15T23:53:56.337164+0000","last_peered":"2024-09-15T23:53:56.337164+0000","last_clean":"2024-09-15T23:53:56.337164+0000","last_became_active":"2024-09-15T23:53:50.764271+0000","last_became_peered":"2024-09-15T23:53:50.764271+0000","last_unstale":"2024-09-15T23:53:56.337164+0000","last_undegraded":"2024-09-15T23:53:56.337164+0000","last_fullsized":"2024-09-15T23:53:56.337164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:11.898034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336935+0000","last_change":"2024-09-15T23:53:49.722266+0000","last_active":"2024-09-15T23:53:56.336935+0000","last_peered":"2024-09-15T23:53:56.336935+0000","last_clean":"2024-09-15T23:53:56.336935+0000","last_became_active":"2024-09-15T23:53:49.721470+0000","last_became_peered":"2024-09-15T23:53:49.721470+0000","last_unstale":"2024-09-15T23:53:56.336935+0000","last_undegraded":"2024-09-15T23:53:56.336935+0000","last_fullsized":"2024-09-15T23:53:56.336935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:45.659637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334216+0000","last_change":"2024-09-15T23:53:54.818192+0000","last_active":"2024-09-15T23:53:56.334216+0000","last_peered":"2024-09-15T23:53:56.334216+0000","last_clean":"2024-09-15T23:53:56.334216+0000","last_became_active":"2024-09-15T23:53:54.817117+0000","last_became_peered":"2024-09-15T23:53:54.817117+0000","last_unstale":"2024-09-15T23:53:56.334216+0000","last_undegraded":"2024-09-15T23:53:56.334216+0000","last_fullsized":"2024-09-15T23:53:56.334216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:18.414617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807739+0000","last_change":"2024-09-15T23:53:50.753210+0000","last_active":"2024-09-15T23:53:55.807739+0000","last_peered":"2024-09-15T23:53:55.807739+0000","last_clean":"2024-09-15T23:53:55.807739+0000","last_became_active":"2024-09-15T23:53:50.752491+0000","last_became_peered":"2024-09-15T23:53:50.752491+0000","last_unstale":"2024-09-15T23:53:55.807739+0000","last_undegraded":"2024-09-15T23:53:55.807739+0000","last_fullsized":"2024-09-15T23:53:55.807739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:15.892900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.801158+0000","last_change":"2024-09-15T23:53:49.717089+0000","last_active":"2024-09-15T23:53:55.801158+0000","last_peered":"2024-09-15T23:53:55.801158+0000","last_clean":"2024-09-15T23:53:55.801158+0000","last_became_active":"2024-09-15T23:53:49.715862+0000","last_became_peered":"2024-09-15T23:53:49.715862+0000","last_unstale":"2024-09-15T23:53:55.801158+0000","last_undegraded":"2024-09-15T23:53:55.801158+0000","last_fullsized":"2024-09-15T23:53:55.801158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:49.721033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805363+0000","last_change":"2024-09-15T23:53:54.831979+0000","last_active":"2024-09-15T23:53:55.805363+0000","last_peered":"2024-09-15T23:53:55.805363+0000","last_clean":"2024-09-15T23:53:55.805363+0000","last_became_active":"2024-09-15T23:53:54.830505+0000","last_became_peered":"2024-09-15T23:53:54.830505+0000","last_unstale":"2024-09-15T23:53:55.805363+0000","last_undegraded":"2024-09-15T23:53:55.805363+0000","last_fullsized":"2024-09-15T23:53:55.805363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:58.670287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332157+0000","last_change":"2024-09-15T23:53:50.769317+0000","last_active":"2024-09-15T23:53:56.332157+0000","last_peered":"2024-09-15T23:53:56.332157+0000","last_clean":"2024-09-15T23:53:56.332157+0000","last_became_active":"2024-09-15T23:53:50.768788+0000","last_became_peered":"2024-09-15T23:53:50.768788+0000","last_unstale":"2024-09-15T23:53:56.332157+0000","last_undegraded":"2024-09-15T23:53:56.332157+0000","last_fullsized":"2024-09-15T23:53:56.332157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:55.915920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805063+0000","last_change":"2024-09-15T23:53:49.734159+0000","last_active":"2024-09-15T23:53:55.805063+0000","last_peered":"2024-09-15T23:53:55.805063+0000","last_clean":"2024-09-15T23:53:55.805063+0000","last_became_active":"2024-09-15T23:53:49.733298+0000","last_became_peered":"2024-09-15T23:53:49.733298+0000","last_unstale":"2024-09-15T23:53:55.805063+0000","last_undegraded":"2024-09-15T23:53:55.805063+0000","last_fullsized":"2024-09-15T23:53:55.805063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:25.932592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803370+0000","last_change":"2024-09-15T23:53:54.843329+0000","last_active":"2024-09-15T23:53:55.803370+0000","last_peered":"2024-09-15T23:53:55.803370+0000","last_clean":"2024-09-15T23:53:55.803370+0000","last_became_active":"2024-09-15T23:53:54.838912+0000","last_became_peered":"2024-09-15T23:53:54.838912+0000","last_unstale":"2024-09-15T23:53:55.803370+0000","last_undegraded":"2024-09-15T23:53:55.803370+0000","last_fullsized":"2024-09-15T23:53:55.803370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:55.661043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333465+0000","last_change":"2024-09-15T23:53:50.767627+0000","last_active":"2024-09-15T23:53:56.333465+0000","last_peered":"2024-09-15T23:53:56.333465+0000","last_clean":"2024-09-15T23:53:56.333465+0000","last_became_active":"2024-09-15T23:53:50.766671+0000","last_became_peered":"2024-09-15T23:53:50.766671+0000","last_unstale":"2024-09-15T23:53:56.333465+0000","last_undegraded":"2024-09-15T23:53:56.333465+0000","last_fullsized":"2024-09-15T23:53:56.333465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:54.586682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799767+0000","last_change":"2024-09-15T23:53:49.725634+0000","last_active":"2024-09-15T23:53:55.799767+0000","last_peered":"2024-09-15T23:53:55.799767+0000","last_clean":"2024-09-15T23:53:55.799767+0000","last_became_active":"2024-09-15T23:53:49.723832+0000","last_became_peered":"2024-09-15T23:53:49.723832+0000","last_unstale":"2024-09-15T23:53:55.799767+0000","last_undegraded":"2024-09-15T23:53:55.799767+0000","last_fullsized":"2024-09-15T23:53:55.799767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:09.900395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807354+0000","last_change":"2024-09-15T23:53:54.846953+0000","last_active":"2024-09-15T23:53:55.807354+0000","last_peered":"2024-09-15T23:53:55.807354+0000","last_clean":"2024-09-15T23:53:55.807354+0000","last_became_active":"2024-09-15T23:53:54.844217+0000","last_became_peered":"2024-09-15T23:53:54.844217+0000","last_unstale":"2024-09-15T23:53:55.807354+0000","last_undegraded":"2024-09-15T23:53:55.807354+0000","last_fullsized":"2024-09-15T23:53:55.807354+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:25.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803281+0000","last_change":"2024-09-15T23:53:50.763583+0000","last_active":"2024-09-15T23:53:55.803281+0000","last_peered":"2024-09-15T23:53:55.803281+0000","last_clean":"2024-09-15T23:53:55.803281+0000","last_became_active":"2024-09-15T23:53:50.763267+0000","last_became_peered":"2024-09-15T23:53:50.763267+0000","last_unstale":"2024-09-15T23:53:55.803281+0000","last_undegraded":"2024-09-15T23:53:55.803281+0000","last_fullsized":"2024-09-15T23:53:55.803281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:34.077890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335453+0000","last_change":"2024-09-15T23:53:49.725775+0000","last_active":"2024-09-15T23:53:56.335453+0000","last_peered":"2024-09-15T23:53:56.335453+0000","last_clean":"2024-09-15T23:53:56.335453+0000","last_became_active":"2024-09-15T23:53:49.724972+0000","last_became_peered":"2024-09-15T23:53:49.724972+0000","last_unstale":"2024-09-15T23:53:56.335453+0000","last_undegraded":"2024-09-15T23:53:56.335453+0000","last_fullsized":"2024-09-15T23:53:56.335453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:25:03.906556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805542+0000","last_change":"2024-09-15T23:53:54.831426+0000","last_active":"2024-09-15T23:53:55.805542+0000","last_peered":"2024-09-15T23:53:55.805542+0000","last_clean":"2024-09-15T23:53:55.805542+0000","last_became_active":"2024-09-15T23:53:54.830222+0000","last_became_peered":"2024-09-15T23:53:54.830222+0000","last_unstale":"2024-09-15T23:53:55.805542+0000","last_undegraded":"2024-09-15T23:53:55.805542+0000","last_fullsized":"2024-09-15T23:53:55.805542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:01.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804225+0000","last_change":"2024-09-15T23:53:50.749494+0000","last_active":"2024-09-15T23:53:55.804225+0000","last_peered":"2024-09-15T23:53:55.804225+0000","last_clean":"2024-09-15T23:53:55.804225+0000","last_became_active":"2024-09-15T23:53:50.748576+0000","last_became_peered":"2024-09-15T23:53:50.748576+0000","last_unstale":"2024-09-15T23:53:55.804225+0000","last_undegraded":"2024-09-15T23:53:55.804225+0000","last_fullsized":"2024-09-15T23:53:55.804225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:39.100079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799626+0000","last_change":"2024-09-15T23:53:49.725322+0000","last_active":"2024-09-15T23:53:55.799626+0000","last_peered":"2024-09-15T23:53:55.799626+0000","last_clean":"2024-09-15T23:53:55.799626+0000","last_became_active":"2024-09-15T23:53:49.724863+0000","last_became_peered":"2024-09-15T23:53:49.724863+0000","last_unstale":"2024-09-15T23:53:55.799626+0000","last_undegraded":"2024-09-15T23:53:55.799626+0000","last_fullsized":"2024-09-15T23:53:55.799626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:08.552003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805910+0000","last_change":"2024-09-15T23:53:54.839131+0000","last_active":"2024-09-15T23:53:55.805910+0000","last_peered":"2024-09-15T23:53:55.805910+0000","last_clean":"2024-09-15T23:53:55.805910+0000","last_became_active":"2024-09-15T23:53:54.837820+0000","last_became_peered":"2024-09-15T23:53:54.837820+0000","last_unstale":"2024-09-15T23:53:55.805910+0000","last_undegraded":"2024-09-15T23:53:55.805910+0000","last_fullsized":"2024-09-15T23:53:55.805910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:12.392532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334826+0000","last_change":"2024-09-15T23:53:50.760376+0000","last_active":"2024-09-15T23:53:56.334826+0000","last_peered":"2024-09-15T23:53:56.334826+0000","last_clean":"2024-09-15T23:53:56.334826+0000","last_became_active":"2024-09-15T23:53:50.758918+0000","last_became_peered":"2024-09-15T23:53:50.758918+0000","last_unstale":"2024-09-15T23:53:56.334826+0000","last_undegraded":"2024-09-15T23:53:56.334826+0000","last_fullsized":"2024-09-15T23:53:56.334826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:04.750808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799555+0000","last_change":"2024-09-15T23:53:49.707210+0000","last_active":"2024-09-15T23:53:55.799555+0000","last_peered":"2024-09-15T23:53:55.799555+0000","last_clean":"2024-09-15T23:53:55.799555+0000","last_became_active":"2024-09-15T23:53:49.705850+0000","last_became_peered":"2024-09-15T23:53:49.705850+0000","last_unstale":"2024-09-15T23:53:55.799555+0000","last_undegraded":"2024-09-15T23:53:55.799555+0000","last_fullsized":"2024-09-15T23:53:55.799555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:01.693912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331928+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:53:56.331928+0000","last_peered":"2024-09-15T23:53:56.331928+0000","last_clean":"2024-09-15T23:53:56.331928+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:53:56.331928+0000","last_undegraded":"2024-09-15T23:53:56.331928+0000","last_fullsized":"2024-09-15T23:53:56.331928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800931+0000","last_change":"2024-09-15T23:53:54.802294+0000","last_active":"2024-09-15T23:53:55.800931+0000","last_peered":"2024-09-15T23:53:55.800931+0000","last_clean":"2024-09-15T23:53:55.800931+0000","last_became_active":"2024-09-15T23:53:54.801810+0000","last_became_peered":"2024-09-15T23:53:54.801810+0000","last_unstale":"2024-09-15T23:53:55.800931+0000","last_undegraded":"2024-09-15T23:53:55.800931+0000","last_fullsized":"2024-09-15T23:53:55.800931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:31.818261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800591+0000","last_change":"2024-09-15T23:53:50.763308+0000","last_active":"2024-09-15T23:53:55.800591+0000","last_peered":"2024-09-15T23:53:55.800591+0000","last_clean":"2024-09-15T23:53:55.800591+0000","last_became_active":"2024-09-15T23:53:50.763032+0000","last_became_peered":"2024-09-15T23:53:50.763032+0000","last_unstale":"2024-09-15T23:53:55.800591+0000","last_undegraded":"2024-09-15T23:53:55.800591+0000","last_fullsized":"2024-09-15T23:53:55.800591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:48.085914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807911+0000","last_change":"2024-09-15T23:53:49.730437+0000","last_active":"2024-09-15T23:53:55.807911+0000","last_peered":"2024-09-15T23:53:55.807911+0000","last_clean":"2024-09-15T23:53:55.807911+0000","last_became_active":"2024-09-15T23:53:49.729801+0000","last_became_peered":"2024-09-15T23:53:49.729801+0000","last_unstale":"2024-09-15T23:53:55.807911+0000","last_undegraded":"2024-09-15T23:53:55.807911+0000","last_fullsized":"2024-09-15T23:53:55.807911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:56.727393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331703+0000","last_change":"2024-09-15T23:53:54.838987+0000","last_active":"2024-09-15T23:53:56.331703+0000","last_peered":"2024-09-15T23:53:56.331703+0000","last_clean":"2024-09-15T23:53:56.331703+0000","last_became_active":"2024-09-15T23:53:54.838600+0000","last_became_peered":"2024-09-15T23:53:54.838600+0000","last_unstale":"2024-09-15T23:53:56.331703+0000","last_undegraded":"2024-09-15T23:53:56.331703+0000","last_fullsized":"2024-09-15T23:53:56.331703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:55.661043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333855+0000","last_change":"2024-09-15T23:53:50.772514+0000","last_active":"2024-09-15T23:53:56.333855+0000","last_peered":"2024-09-15T23:53:56.333855+0000","last_clean":"2024-09-15T23:53:56.333855+0000","last_became_active":"2024-09-15T23:53:50.771970+0000","last_became_peered":"2024-09-15T23:53:50.771970+0000","last_unstale":"2024-09-15T23:53:56.333855+0000","last_undegraded":"2024-09-15T23:53:56.333855+0000","last_fullsized":"2024-09-15T23:53:56.333855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:17.612514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805841+0000","last_change":"2024-09-15T23:53:49.728617+0000","last_active":"2024-09-15T23:53:55.805841+0000","last_peered":"2024-09-15T23:53:55.805841+0000","last_clean":"2024-09-15T23:53:55.805841+0000","last_became_active":"2024-09-15T23:53:49.727770+0000","last_became_peered":"2024-09-15T23:53:49.727770+0000","last_unstale":"2024-09-15T23:53:55.805841+0000","last_undegraded":"2024-09-15T23:53:55.805841+0000","last_fullsized":"2024-09-15T23:53:55.805841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:51.740913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804252+0000","last_change":"2024-09-15T23:53:54.815958+0000","last_active":"2024-09-15T23:53:55.804252+0000","last_peered":"2024-09-15T23:53:55.804252+0000","last_clean":"2024-09-15T23:53:55.804252+0000","last_became_active":"2024-09-15T23:53:54.814904+0000","last_became_peered":"2024-09-15T23:53:54.814904+0000","last_unstale":"2024-09-15T23:53:55.804252+0000","last_undegraded":"2024-09-15T23:53:55.804252+0000","last_fullsized":"2024-09-15T23:53:55.804252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:56.872305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333379+0000","last_change":"2024-09-15T23:53:50.781321+0000","last_active":"2024-09-15T23:53:56.333379+0000","last_peered":"2024-09-15T23:53:56.333379+0000","last_clean":"2024-09-15T23:53:56.333379+0000","last_became_active":"2024-09-15T23:53:50.780931+0000","last_became_peered":"2024-09-15T23:53:50.780931+0000","last_unstale":"2024-09-15T23:53:56.333379+0000","last_undegraded":"2024-09-15T23:53:56.333379+0000","last_fullsized":"2024-09-15T23:53:56.333379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:54.765704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336877+0000","last_change":"2024-09-15T23:53:49.730687+0000","last_active":"2024-09-15T23:53:56.336877+0000","last_peered":"2024-09-15T23:53:56.336877+0000","last_clean":"2024-09-15T23:53:56.336877+0000","last_became_active":"2024-09-15T23:53:49.729969+0000","last_became_peered":"2024-09-15T23:53:49.729969+0000","last_unstale":"2024-09-15T23:53:56.336877+0000","last_undegraded":"2024-09-15T23:53:56.336877+0000","last_fullsized":"2024-09-15T23:53:56.336877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:55.009643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798438+0000","last_change":"2024-09-15T23:53:54.807204+0000","last_active":"2024-09-15T23:53:55.798438+0000","last_peered":"2024-09-15T23:53:55.798438+0000","last_clean":"2024-09-15T23:53:55.798438+0000","last_became_active":"2024-09-15T23:53:54.806430+0000","last_became_peered":"2024-09-15T23:53:54.806430+0000","last_unstale":"2024-09-15T23:53:55.798438+0000","last_undegraded":"2024-09-15T23:53:55.798438+0000","last_fullsized":"2024-09-15T23:53:55.798438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:24.111672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333084+0000","last_change":"2024-09-15T23:53:50.779517+0000","last_active":"2024-09-15T23:53:56.333084+0000","last_peered":"2024-09-15T23:53:56.333084+0000","last_clean":"2024-09-15T23:53:56.333084+0000","last_became_active":"2024-09-15T23:53:50.779199+0000","last_became_peered":"2024-09-15T23:53:50.779199+0000","last_unstale":"2024-09-15T23:53:56.333084+0000","last_undegraded":"2024-09-15T23:53:56.333084+0000","last_fullsized":"2024-09-15T23:53:56.333084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:39.100079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333514+0000","last_change":"2024-09-15T23:53:49.734270+0000","last_active":"2024-09-15T23:53:56.333514+0000","last_peered":"2024-09-15T23:53:56.333514+0000","last_clean":"2024-09-15T23:53:56.333514+0000","last_became_active":"2024-09-15T23:53:49.729410+0000","last_became_peered":"2024-09-15T23:53:49.729410+0000","last_unstale":"2024-09-15T23:53:56.333514+0000","last_undegraded":"2024-09-15T23:53:56.333514+0000","last_fullsized":"2024-09-15T23:53:56.333514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:32.423155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332767+0000","last_change":"2024-09-15T23:53:54.828876+0000","last_active":"2024-09-15T23:53:56.332767+0000","last_peered":"2024-09-15T23:53:56.332767+0000","last_clean":"2024-09-15T23:53:56.332767+0000","last_became_active":"2024-09-15T23:53:54.828500+0000","last_became_peered":"2024-09-15T23:53:54.828500+0000","last_unstale":"2024-09-15T23:53:56.332767+0000","last_undegraded":"2024-09-15T23:53:56.332767+0000","last_fullsized":"2024-09-15T23:53:56.332767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:03.580557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799130+0000","last_change":"2024-09-15T23:53:50.761067+0000","last_active":"2024-09-15T23:53:55.799130+0000","last_peered":"2024-09-15T23:53:55.799130+0000","last_clean":"2024-09-15T23:53:55.799130+0000","last_became_active":"2024-09-15T23:53:50.760746+0000","last_became_peered":"2024-09-15T23:53:50.760746+0000","last_unstale":"2024-09-15T23:53:55.799130+0000","last_undegraded":"2024-09-15T23:53:55.799130+0000","last_fullsized":"2024-09-15T23:53:55.799130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:37.867754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334428+0000","last_change":"2024-09-15T23:53:49.715804+0000","last_active":"2024-09-15T23:53:56.334428+0000","last_peered":"2024-09-15T23:53:56.334428+0000","last_clean":"2024-09-15T23:53:56.334428+0000","last_became_active":"2024-09-15T23:53:49.715180+0000","last_became_peered":"2024-09-15T23:53:49.715180+0000","last_unstale":"2024-09-15T23:53:56.334428+0000","last_undegraded":"2024-09-15T23:53:56.334428+0000","last_fullsized":"2024-09-15T23:53:56.334428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.829837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806333+0000","last_change":"2024-09-15T23:53:54.838616+0000","last_active":"2024-09-15T23:53:55.806333+0000","last_peered":"2024-09-15T23:53:55.806333+0000","last_clean":"2024-09-15T23:53:55.806333+0000","last_became_active":"2024-09-15T23:53:54.837514+0000","last_became_peered":"2024-09-15T23:53:54.837514+0000","last_unstale":"2024-09-15T23:53:55.806333+0000","last_undegraded":"2024-09-15T23:53:55.806333+0000","last_fullsized":"2024-09-15T23:53:55.806333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:16.570607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331570+0000","last_change":"2024-09-15T23:53:50.773002+0000","last_active":"2024-09-15T23:53:56.331570+0000","last_peered":"2024-09-15T23:53:56.331570+0000","last_clean":"2024-09-15T23:53:56.331570+0000","last_became_active":"2024-09-15T23:53:50.772276+0000","last_became_peered":"2024-09-15T23:53:50.772276+0000","last_unstale":"2024-09-15T23:53:56.331570+0000","last_undegraded":"2024-09-15T23:53:56.331570+0000","last_fullsized":"2024-09-15T23:53:56.331570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:55.915920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333217+0000","last_change":"2024-09-15T23:53:49.700504+0000","last_active":"2024-09-15T23:53:56.333217+0000","last_peered":"2024-09-15T23:53:56.333217+0000","last_clean":"2024-09-15T23:53:56.333217+0000","last_became_active":"2024-09-15T23:53:49.699750+0000","last_became_peered":"2024-09-15T23:53:49.699750+0000","last_unstale":"2024-09-15T23:53:56.333217+0000","last_undegraded":"2024-09-15T23:53:56.333217+0000","last_fullsized":"2024-09-15T23:53:56.333217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:45.659637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806928+0000","last_change":"2024-09-15T23:53:54.824331+0000","last_active":"2024-09-15T23:53:55.806928+0000","last_peered":"2024-09-15T23:53:55.806928+0000","last_clean":"2024-09-15T23:53:55.806928+0000","last_became_active":"2024-09-15T23:53:54.823300+0000","last_became_peered":"2024-09-15T23:53:54.823300+0000","last_unstale":"2024-09-15T23:53:55.806928+0000","last_undegraded":"2024-09-15T23:53:55.806928+0000","last_fullsized":"2024-09-15T23:53:55.806928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:37.095883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798948+0000","last_change":"2024-09-15T23:53:50.775624+0000","last_active":"2024-09-15T23:53:55.798948+0000","last_peered":"2024-09-15T23:53:55.798948+0000","last_clean":"2024-09-15T23:53:55.798948+0000","last_became_active":"2024-09-15T23:53:50.775283+0000","last_became_peered":"2024-09-15T23:53:50.775283+0000","last_unstale":"2024-09-15T23:53:55.798948+0000","last_undegraded":"2024-09-15T23:53:55.798948+0000","last_fullsized":"2024-09-15T23:53:55.798948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:06.300941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799708+0000","last_change":"2024-09-15T23:53:49.723818+0000","last_active":"2024-09-15T23:53:55.799708+0000","last_peered":"2024-09-15T23:53:55.799708+0000","last_clean":"2024-09-15T23:53:55.799708+0000","last_became_active":"2024-09-15T23:53:49.720057+0000","last_became_peered":"2024-09-15T23:53:49.720057+0000","last_unstale":"2024-09-15T23:53:55.799708+0000","last_undegraded":"2024-09-15T23:53:55.799708+0000","last_fullsized":"2024-09-15T23:53:55.799708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:38.734641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807236+0000","last_change":"2024-09-15T23:53:54.846308+0000","last_active":"2024-09-15T23:53:55.807236+0000","last_peered":"2024-09-15T23:53:55.807236+0000","last_clean":"2024-09-15T23:53:55.807236+0000","last_became_active":"2024-09-15T23:53:54.844118+0000","last_became_peered":"2024-09-15T23:53:54.844118+0000","last_unstale":"2024-09-15T23:53:55.807236+0000","last_undegraded":"2024-09-15T23:53:55.807236+0000","last_fullsized":"2024-09-15T23:53:55.807236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:05.294652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804937+0000","last_change":"2024-09-15T23:53:50.760823+0000","last_active":"2024-09-15T23:53:55.804937+0000","last_peered":"2024-09-15T23:53:55.804937+0000","last_clean":"2024-09-15T23:53:55.804937+0000","last_became_active":"2024-09-15T23:53:50.760471+0000","last_became_peered":"2024-09-15T23:53:50.760471+0000","last_unstale":"2024-09-15T23:53:55.804937+0000","last_undegraded":"2024-09-15T23:53:55.804937+0000","last_fullsized":"2024-09-15T23:53:55.804937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:04.750808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336497+0000","last_change":"2024-09-15T23:53:49.719808+0000","last_active":"2024-09-15T23:53:56.336497+0000","last_peered":"2024-09-15T23:53:56.336497+0000","last_clean":"2024-09-15T23:53:56.336497+0000","last_became_active":"2024-09-15T23:53:49.719303+0000","last_became_peered":"2024-09-15T23:53:49.719303+0000","last_unstale":"2024-09-15T23:53:56.336497+0000","last_undegraded":"2024-09-15T23:53:56.336497+0000","last_fullsized":"2024-09-15T23:53:56.336497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:55.009643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800425+0000","last_change":"2024-09-15T23:53:54.807683+0000","last_active":"2024-09-15T23:53:55.800425+0000","last_peered":"2024-09-15T23:53:55.800425+0000","last_clean":"2024-09-15T23:53:55.800425+0000","last_became_active":"2024-09-15T23:53:54.807273+0000","last_became_peered":"2024-09-15T23:53:54.807273+0000","last_unstale":"2024-09-15T23:53:55.800425+0000","last_undegraded":"2024-09-15T23:53:55.800425+0000","last_fullsized":"2024-09-15T23:53:55.800425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:29.903334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334249+0000","last_change":"2024-09-15T23:53:50.778913+0000","last_active":"2024-09-15T23:53:56.334249+0000","last_peered":"2024-09-15T23:53:56.334249+0000","last_clean":"2024-09-15T23:53:56.334249+0000","last_became_active":"2024-09-15T23:53:50.775954+0000","last_became_peered":"2024-09-15T23:53:50.775954+0000","last_unstale":"2024-09-15T23:53:56.334249+0000","last_undegraded":"2024-09-15T23:53:56.334249+0000","last_fullsized":"2024-09-15T23:53:56.334249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:51.577438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:54:01.347228+0000","last_change":"2024-09-15T23:53:49.720597+0000","last_active":"2024-09-15T23:54:01.347228+0000","last_peered":"2024-09-15T23:54:01.347228+0000","last_clean":"2024-09-15T23:54:01.347228+0000","last_became_active":"2024-09-15T23:53:49.717557+0000","last_became_peered":"2024-09-15T23:53:49.717557+0000","last_unstale":"2024-09-15T23:54:01.347228+0000","last_undegraded":"2024-09-15T23:54:01.347228+0000","last_fullsized":"2024-09-15T23:54:01.347228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:05.442964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334641+0000","last_change":"2024-09-15T23:53:54.826160+0000","last_active":"2024-09-15T23:53:56.334641+0000","last_peered":"2024-09-15T23:53:56.334641+0000","last_clean":"2024-09-15T23:53:56.334641+0000","last_became_active":"2024-09-15T23:53:54.824735+0000","last_became_peered":"2024-09-15T23:53:54.824735+0000","last_unstale":"2024-09-15T23:53:56.334641+0000","last_undegraded":"2024-09-15T23:53:56.334641+0000","last_fullsized":"2024-09-15T23:53:56.334641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:05.294652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799239+0000","last_change":"2024-09-15T23:53:50.760066+0000","last_active":"2024-09-15T23:53:55.799239+0000","last_peered":"2024-09-15T23:53:55.799239+0000","last_clean":"2024-09-15T23:53:55.799239+0000","last_became_active":"2024-09-15T23:53:50.759702+0000","last_became_peered":"2024-09-15T23:53:50.759702+0000","last_unstale":"2024-09-15T23:53:55.799239+0000","last_undegraded":"2024-09-15T23:53:55.799239+0000","last_fullsized":"2024-09-15T23:53:55.799239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:11.697485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335921+0000","last_change":"2024-09-15T23:53:49.718600+0000","last_active":"2024-09-15T23:53:56.335921+0000","last_peered":"2024-09-15T23:53:56.335921+0000","last_clean":"2024-09-15T23:53:56.335921+0000","last_became_active":"2024-09-15T23:53:49.718133+0000","last_became_peered":"2024-09-15T23:53:49.718133+0000","last_unstale":"2024-09-15T23:53:56.335921+0000","last_undegraded":"2024-09-15T23:53:56.335921+0000","last_fullsized":"2024-09-15T23:53:56.335921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:56.727393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334929+0000","last_change":"2024-09-15T23:53:54.831611+0000","last_active":"2024-09-15T23:53:56.334929+0000","last_peered":"2024-09-15T23:53:56.334929+0000","last_clean":"2024-09-15T23:53:56.334929+0000","last_became_active":"2024-09-15T23:53:54.830621+0000","last_became_peered":"2024-09-15T23:53:54.830621+0000","last_unstale":"2024-09-15T23:53:56.334929+0000","last_undegraded":"2024-09-15T23:53:56.334929+0000","last_fullsized":"2024-09-15T23:53:56.334929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:25.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807274+0000","last_change":"2024-09-15T23:53:50.766881+0000","last_active":"2024-09-15T23:53:55.807274+0000","last_peered":"2024-09-15T23:53:55.807274+0000","last_clean":"2024-09-15T23:53:55.807274+0000","last_became_active":"2024-09-15T23:53:50.766527+0000","last_became_peered":"2024-09-15T23:53:50.766527+0000","last_unstale":"2024-09-15T23:53:55.807274+0000","last_undegraded":"2024-09-15T23:53:55.807274+0000","last_fullsized":"2024-09-15T23:53:55.807274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:15.908762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334496+0000","last_change":"2024-09-15T23:53:49.704002+0000","last_active":"2024-09-15T23:53:56.334496+0000","last_peered":"2024-09-15T23:53:56.334496+0000","last_clean":"2024-09-15T23:53:56.334496+0000","last_became_active":"2024-09-15T23:53:49.703760+0000","last_became_peered":"2024-09-15T23:53:49.703760+0000","last_unstale":"2024-09-15T23:53:56.334496+0000","last_undegraded":"2024-09-15T23:53:56.334496+0000","last_fullsized":"2024-09-15T23:53:56.334496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:54.905896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334638+0000","last_change":"2024-09-15T23:53:54.835532+0000","last_active":"2024-09-15T23:53:56.334638+0000","last_peered":"2024-09-15T23:53:56.334638+0000","last_clean":"2024-09-15T23:53:56.334638+0000","last_became_active":"2024-09-15T23:53:54.834666+0000","last_became_peered":"2024-09-15T23:53:54.834666+0000","last_unstale":"2024-09-15T23:53:56.334638+0000","last_undegraded":"2024-09-15T23:53:56.334638+0000","last_fullsized":"2024-09-15T23:53:56.334638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:08.834413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333009+0000","last_change":"2024-09-15T23:53:50.768163+0000","last_active":"2024-09-15T23:53:56.333009+0000","last_peered":"2024-09-15T23:53:56.333009+0000","last_clean":"2024-09-15T23:53:56.333009+0000","last_became_active":"2024-09-15T23:53:50.763914+0000","last_became_peered":"2024-09-15T23:53:50.763914+0000","last_unstale":"2024-09-15T23:53:56.333009+0000","last_undegraded":"2024-09-15T23:53:56.333009+0000","last_fullsized":"2024-09-15T23:53:56.333009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:48.894933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332851+0000","last_change":"2024-09-15T23:53:49.720489+0000","last_active":"2024-09-15T23:53:56.332851+0000","last_peered":"2024-09-15T23:53:56.332851+0000","last_clean":"2024-09-15T23:53:56.332851+0000","last_became_active":"2024-09-15T23:53:49.719882+0000","last_became_peered":"2024-09-15T23:53:49.719882+0000","last_unstale":"2024-09-15T23:53:56.332851+0000","last_undegraded":"2024-09-15T23:53:56.332851+0000","last_fullsized":"2024-09-15T23:53:56.332851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:42.225697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335364+0000","last_change":"2024-09-15T23:53:54.834453+0000","last_active":"2024-09-15T23:53:56.335364+0000","last_peered":"2024-09-15T23:53:56.335364+0000","last_clean":"2024-09-15T23:53:56.335364+0000","last_became_active":"2024-09-15T23:53:54.832355+0000","last_became_peered":"2024-09-15T23:53:54.832355+0000","last_unstale":"2024-09-15T23:53:56.335364+0000","last_undegraded":"2024-09-15T23:53:56.335364+0000","last_fullsized":"2024-09-15T23:53:56.335364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:25.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336774+0000","last_change":"2024-09-15T23:53:54.823569+0000","last_active":"2024-09-15T23:53:56.336774+0000","last_peered":"2024-09-15T23:53:56.336774+0000","last_clean":"2024-09-15T23:53:56.336774+0000","last_became_active":"2024-09-15T23:53:54.822582+0000","last_became_peered":"2024-09-15T23:53:54.822582+0000","last_unstale":"2024-09-15T23:53:56.336774+0000","last_undegraded":"2024-09-15T23:53:56.336774+0000","last_fullsized":"2024-09-15T23:53:56.336774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:40.544116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335644+0000","last_change":"2024-09-15T23:53:50.754235+0000","last_active":"2024-09-15T23:53:56.335644+0000","last_peered":"2024-09-15T23:53:56.335644+0000","last_clean":"2024-09-15T23:53:56.335644+0000","last_became_active":"2024-09-15T23:53:50.753479+0000","last_became_peered":"2024-09-15T23:53:50.753479+0000","last_unstale":"2024-09-15T23:53:56.335644+0000","last_undegraded":"2024-09-15T23:53:56.335644+0000","last_fullsized":"2024-09-15T23:53:56.335644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:11.710571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799070+0000","last_change":"2024-09-15T23:53:49.704444+0000","last_active":"2024-09-15T23:53:55.799070+0000","last_peered":"2024-09-15T23:53:55.799070+0000","last_clean":"2024-09-15T23:53:55.799070+0000","last_became_active":"2024-09-15T23:53:49.703888+0000","last_became_peered":"2024-09-15T23:53:49.703888+0000","last_unstale":"2024-09-15T23:53:55.799070+0000","last_undegraded":"2024-09-15T23:53:55.799070+0000","last_fullsized":"2024-09-15T23:53:55.799070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:17.063782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800734+0000","last_change":"2024-09-15T23:53:54.808928+0000","last_active":"2024-09-15T23:53:55.800734+0000","last_peered":"2024-09-15T23:53:55.800734+0000","last_clean":"2024-09-15T23:53:55.800734+0000","last_became_active":"2024-09-15T23:53:54.808284+0000","last_became_peered":"2024-09-15T23:53:54.808284+0000","last_unstale":"2024-09-15T23:53:55.800734+0000","last_undegraded":"2024-09-15T23:53:55.800734+0000","last_fullsized":"2024-09-15T23:53:55.800734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:33.254304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803508+0000","last_change":"2024-09-15T23:53:50.771765+0000","last_active":"2024-09-15T23:53:55.803508+0000","last_peered":"2024-09-15T23:53:55.803508+0000","last_clean":"2024-09-15T23:53:55.803508+0000","last_became_active":"2024-09-15T23:53:50.770972+0000","last_became_peered":"2024-09-15T23:53:50.770972+0000","last_unstale":"2024-09-15T23:53:55.803508+0000","last_undegraded":"2024-09-15T23:53:55.803508+0000","last_fullsized":"2024-09-15T23:53:55.803508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:30.225858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804471+0000","last_change":"2024-09-15T23:53:49.703341+0000","last_active":"2024-09-15T23:53:55.804471+0000","last_peered":"2024-09-15T23:53:55.804471+0000","last_clean":"2024-09-15T23:53:55.804471+0000","last_became_active":"2024-09-15T23:53:49.702534+0000","last_became_peered":"2024-09-15T23:53:49.702534+0000","last_unstale":"2024-09-15T23:53:55.804471+0000","last_undegraded":"2024-09-15T23:53:55.804471+0000","last_fullsized":"2024-09-15T23:53:55.804471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:25:03.906556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799514+0000","last_change":"2024-09-15T23:53:49.724099+0000","last_active":"2024-09-15T23:53:55.799514+0000","last_peered":"2024-09-15T23:53:55.799514+0000","last_clean":"2024-09-15T23:53:55.799514+0000","last_became_active":"2024-09-15T23:53:49.720382+0000","last_became_peered":"2024-09-15T23:53:49.720382+0000","last_unstale":"2024-09-15T23:53:55.799514+0000","last_undegraded":"2024-09-15T23:53:55.799514+0000","last_fullsized":"2024-09-15T23:53:55.799514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:12.046572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335126+0000","last_change":"2024-09-15T23:53:50.772483+0000","last_active":"2024-09-15T23:53:56.335126+0000","last_peered":"2024-09-15T23:53:56.335126+0000","last_clean":"2024-09-15T23:53:56.335126+0000","last_became_active":"2024-09-15T23:53:50.772100+0000","last_became_peered":"2024-09-15T23:53:50.772100+0000","last_unstale":"2024-09-15T23:53:56.335126+0000","last_undegraded":"2024-09-15T23:53:56.335126+0000","last_fullsized":"2024-09-15T23:53:56.335126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:40.820870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336438+0000","last_change":"2024-09-15T23:53:54.834012+0000","last_active":"2024-09-15T23:53:56.336438+0000","last_peered":"2024-09-15T23:53:56.336438+0000","last_clean":"2024-09-15T23:53:56.336438+0000","last_became_active":"2024-09-15T23:53:54.832650+0000","last_became_peered":"2024-09-15T23:53:54.832650+0000","last_unstale":"2024-09-15T23:53:56.336438+0000","last_undegraded":"2024-09-15T23:53:56.336438+0000","last_fullsized":"2024-09-15T23:53:56.336438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:58.849309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804269+0000","last_change":"2024-09-15T23:53:49.727498+0000","last_active":"2024-09-15T23:53:55.804269+0000","last_peered":"2024-09-15T23:53:55.804269+0000","last_clean":"2024-09-15T23:53:55.804269+0000","last_became_active":"2024-09-15T23:53:49.723077+0000","last_became_peered":"2024-09-15T23:53:49.723077+0000","last_unstale":"2024-09-15T23:53:55.804269+0000","last_undegraded":"2024-09-15T23:53:55.804269+0000","last_fullsized":"2024-09-15T23:53:55.804269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:57.542130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332154+0000","last_change":"2024-09-15T23:53:50.761608+0000","last_active":"2024-09-15T23:53:56.332154+0000","last_peered":"2024-09-15T23:53:56.332154+0000","last_clean":"2024-09-15T23:53:56.332154+0000","last_became_active":"2024-09-15T23:53:50.758363+0000","last_became_peered":"2024-09-15T23:53:50.758363+0000","last_unstale":"2024-09-15T23:53:56.332154+0000","last_undegraded":"2024-09-15T23:53:56.332154+0000","last_fullsized":"2024-09-15T23:53:56.332154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335657+0000","last_change":"2024-09-15T23:53:54.841381+0000","last_active":"2024-09-15T23:53:56.335657+0000","last_peered":"2024-09-15T23:53:56.335657+0000","last_clean":"2024-09-15T23:53:56.335657+0000","last_became_active":"2024-09-15T23:53:54.840352+0000","last_became_peered":"2024-09-15T23:53:54.840352+0000","last_unstale":"2024-09-15T23:53:56.335657+0000","last_undegraded":"2024-09-15T23:53:56.335657+0000","last_fullsized":"2024-09-15T23:53:56.335657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:44.904475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332559+0000","last_change":"2024-09-15T23:53:50.768904+0000","last_active":"2024-09-15T23:53:56.332559+0000","last_peered":"2024-09-15T23:53:56.332559+0000","last_clean":"2024-09-15T23:53:56.332559+0000","last_became_active":"2024-09-15T23:53:50.768253+0000","last_became_peered":"2024-09-15T23:53:50.768253+0000","last_unstale":"2024-09-15T23:53:56.332559+0000","last_undegraded":"2024-09-15T23:53:56.332559+0000","last_fullsized":"2024-09-15T23:53:56.332559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:41.573063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335133+0000","last_change":"2024-09-15T23:53:50.776288+0000","last_active":"2024-09-15T23:53:56.335133+0000","last_peered":"2024-09-15T23:53:56.335133+0000","last_clean":"2024-09-15T23:53:56.335133+0000","last_became_active":"2024-09-15T23:53:50.775954+0000","last_became_peered":"2024-09-15T23:53:50.775954+0000","last_unstale":"2024-09-15T23:53:56.335133+0000","last_undegraded":"2024-09-15T23:53:56.335133+0000","last_fullsized":"2024-09-15T23:53:56.335133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.385437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798721+0000","last_change":"2024-09-15T23:53:50.766724+0000","last_active":"2024-09-15T23:53:55.798721+0000","last_peered":"2024-09-15T23:53:55.798721+0000","last_clean":"2024-09-15T23:53:55.798721+0000","last_became_active":"2024-09-15T23:53:50.766294+0000","last_became_peered":"2024-09-15T23:53:50.766294+0000","last_unstale":"2024-09-15T23:53:55.798721+0000","last_undegraded":"2024-09-15T23:53:55.798721+0000","last_fullsized":"2024-09-15T23:53:55.798721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:30.859886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804025+0000","last_change":"2024-09-15T23:53:50.762881+0000","last_active":"2024-09-15T23:53:55.804025+0000","last_peered":"2024-09-15T23:53:55.804025+0000","last_clean":"2024-09-15T23:53:55.804025+0000","last_became_active":"2024-09-15T23:53:50.762510+0000","last_became_peered":"2024-09-15T23:53:50.762510+0000","last_unstale":"2024-09-15T23:53:55.804025+0000","last_undegraded":"2024-09-15T23:53:55.804025+0000","last_fullsized":"2024-09-15T23:53:55.804025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.236567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807695+0000","last_change":"2024-09-15T23:53:50.778010+0000","last_active":"2024-09-15T23:53:55.807695+0000","last_peered":"2024-09-15T23:53:55.807695+0000","last_clean":"2024-09-15T23:53:55.807695+0000","last_became_active":"2024-09-15T23:53:50.777507+0000","last_became_peered":"2024-09-15T23:53:50.777507+0000","last_unstale":"2024-09-15T23:53:55.807695+0000","last_undegraded":"2024-09-15T23:53:55.807695+0000","last_fullsized":"2024-09-15T23:53:55.807695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:35:59.496952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805694+0000","last_change":"2024-09-15T23:53:50.758259+0000","last_active":"2024-09-15T23:53:55.805694+0000","last_peered":"2024-09-15T23:53:55.805694+0000","last_clean":"2024-09-15T23:53:55.805694+0000","last_became_active":"2024-09-15T23:53:50.757961+0000","last_became_peered":"2024-09-15T23:53:50.757961+0000","last_unstale":"2024-09-15T23:53:55.805694+0000","last_undegraded":"2024-09-15T23:53:55.805694+0000","last_fullsized":"2024-09-15T23:53:55.805694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:40.820870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332924+0000","last_change":"2024-09-15T23:53:50.767102+0000","last_active":"2024-09-15T23:53:56.332924+0000","last_peered":"2024-09-15T23:53:56.332924+0000","last_clean":"2024-09-15T23:53:56.332924+0000","last_became_active":"2024-09-15T23:53:50.762579+0000","last_became_peered":"2024-09-15T23:53:50.762579+0000","last_unstale":"2024-09-15T23:53:56.332924+0000","last_undegraded":"2024-09-15T23:53:56.332924+0000","last_fullsized":"2024-09-15T23:53:56.332924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:10.630689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806419+0000","last_change":"2024-09-15T23:53:50.778971+0000","last_active":"2024-09-15T23:53:55.806419+0000","last_peered":"2024-09-15T23:53:55.806419+0000","last_clean":"2024-09-15T23:53:55.806419+0000","last_became_active":"2024-09-15T23:53:50.778504+0000","last_became_peered":"2024-09-15T23:53:50.778504+0000","last_unstale":"2024-09-15T23:53:55.806419+0000","last_undegraded":"2024-09-15T23:53:55.806419+0000","last_fullsized":"2024-09-15T23:53:55.806419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:13.705388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799032+0000","last_change":"2024-09-15T23:53:50.766048+0000","last_active":"2024-09-15T23:53:55.799032+0000","last_peered":"2024-09-15T23:53:55.799032+0000","last_clean":"2024-09-15T23:53:55.799032+0000","last_became_active":"2024-09-15T23:53:50.765747+0000","last_became_peered":"2024-09-15T23:53:50.765747+0000","last_unstale":"2024-09-15T23:53:55.799032+0000","last_undegraded":"2024-09-15T23:53:55.799032+0000","last_fullsized":"2024-09-15T23:53:55.799032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:50.800418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804413+0000","last_change":"2024-09-15T23:53:50.762427+0000","last_active":"2024-09-15T23:53:55.804413+0000","last_peered":"2024-09-15T23:53:55.804413+0000","last_clean":"2024-09-15T23:53:55.804413+0000","last_became_active":"2024-09-15T23:53:50.762044+0000","last_became_peered":"2024-09-15T23:53:50.762044+0000","last_unstale":"2024-09-15T23:53:55.804413+0000","last_undegraded":"2024-09-15T23:53:55.804413+0000","last_fullsized":"2024-09-15T23:53:55.804413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:44.344017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332051+0000","last_change":"2024-09-15T23:53:50.761423+0000","last_active":"2024-09-15T23:53:56.332051+0000","last_peered":"2024-09-15T23:53:56.332051+0000","last_clean":"2024-09-15T23:53:56.332051+0000","last_became_active":"2024-09-15T23:53:50.759524+0000","last_became_peered":"2024-09-15T23:53:50.759524+0000","last_unstale":"2024-09-15T23:53:56.332051+0000","last_undegraded":"2024-09-15T23:53:56.332051+0000","last_fullsized":"2024-09-15T23:53:56.332051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.385437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334830+0000","last_change":"2024-09-15T23:53:50.757892+0000","last_active":"2024-09-15T23:53:56.334830+0000","last_peered":"2024-09-15T23:53:56.334830+0000","last_clean":"2024-09-15T23:53:56.334830+0000","last_became_active":"2024-09-15T23:53:50.757123+0000","last_became_peered":"2024-09-15T23:53:50.757123+0000","last_unstale":"2024-09-15T23:53:56.334830+0000","last_undegraded":"2024-09-15T23:53:56.334830+0000","last_fullsized":"2024-09-15T23:53:56.334830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:15.892900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333812+0000","last_change":"2024-09-15T23:53:50.775664+0000","last_active":"2024-09-15T23:53:56.333812+0000","last_peered":"2024-09-15T23:53:56.333812+0000","last_clean":"2024-09-15T23:53:56.333812+0000","last_became_active":"2024-09-15T23:53:50.774398+0000","last_became_peered":"2024-09-15T23:53:50.774398+0000","last_unstale":"2024-09-15T23:53:56.333812+0000","last_undegraded":"2024-09-15T23:53:56.333812+0000","last_fullsized":"2024-09-15T23:53:56.333812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:01.211047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800852+0000","last_change":"2024-09-15T23:53:50.764281+0000","last_active":"2024-09-15T23:53:55.800852+0000","last_peered":"2024-09-15T23:53:55.800852+0000","last_clean":"2024-09-15T23:53:55.800852+0000","last_became_active":"2024-09-15T23:53:50.763712+0000","last_became_peered":"2024-09-15T23:53:50.763712+0000","last_unstale":"2024-09-15T23:53:55.800852+0000","last_undegraded":"2024-09-15T23:53:55.800852+0000","last_fullsized":"2024-09-15T23:53:55.800852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:27.740625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335860+0000","last_change":"2024-09-15T23:53:50.781321+0000","last_active":"2024-09-15T23:53:56.335860+0000","last_peered":"2024-09-15T23:53:56.335860+0000","last_clean":"2024-09-15T23:53:56.335860+0000","last_became_active":"2024-09-15T23:53:50.781022+0000","last_became_peered":"2024-09-15T23:53:50.781022+0000","last_unstale":"2024-09-15T23:53:56.335860+0000","last_undegraded":"2024-09-15T23:53:56.335860+0000","last_fullsized":"2024-09-15T23:53:56.335860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:10.630689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.801378+0000","last_change":"2024-09-15T23:53:50.773196+0000","last_active":"2024-09-15T23:53:55.801378+0000","last_peered":"2024-09-15T23:53:55.801378+0000","last_clean":"2024-09-15T23:53:55.801378+0000","last_became_active":"2024-09-15T23:53:50.772856+0000","last_became_peered":"2024-09-15T23:53:50.772856+0000","last_unstale":"2024-09-15T23:53:55.801378+0000","last_undegraded":"2024-09-15T23:53:55.801378+0000","last_fullsized":"2024-09-15T23:53:55.801378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:38.917747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798743+0000","last_change":"2024-09-15T23:53:50.770117+0000","last_active":"2024-09-15T23:53:55.798743+0000","last_peered":"2024-09-15T23:53:55.798743+0000","last_clean":"2024-09-15T23:53:55.798743+0000","last_became_active":"2024-09-15T23:53:50.769815+0000","last_became_peered":"2024-09-15T23:53:50.769815+0000","last_unstale":"2024-09-15T23:53:55.798743+0000","last_undegraded":"2024-09-15T23:53:55.798743+0000","last_fullsized":"2024-09-15T23:53:55.798743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:00.830681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804043+0000","last_change":"2024-09-15T23:53:50.776872+0000","last_active":"2024-09-15T23:53:55.804043+0000","last_peered":"2024-09-15T23:53:55.804043+0000","last_clean":"2024-09-15T23:53:55.804043+0000","last_became_active":"2024-09-15T23:53:50.776366+0000","last_became_peered":"2024-09-15T23:53:50.776366+0000","last_unstale":"2024-09-15T23:53:55.804043+0000","last_undegraded":"2024-09-15T23:53:55.804043+0000","last_fullsized":"2024-09-15T23:53:55.804043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:52.879737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804858+0000","last_change":"2024-09-15T23:53:50.762729+0000","last_active":"2024-09-15T23:53:55.804858+0000","last_peered":"2024-09-15T23:53:55.804858+0000","last_clean":"2024-09-15T23:53:55.804858+0000","last_became_active":"2024-09-15T23:53:50.762361+0000","last_became_peered":"2024-09-15T23:53:50.762361+0000","last_unstale":"2024-09-15T23:53:55.804858+0000","last_undegraded":"2024-09-15T23:53:55.804858+0000","last_fullsized":"2024-09-15T23:53:55.804858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:41.573063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806250+0000","last_change":"2024-09-15T23:53:50.768317+0000","last_active":"2024-09-15T23:53:55.806250+0000","last_peered":"2024-09-15T23:53:55.806250+0000","last_clean":"2024-09-15T23:53:55.806250+0000","last_became_active":"2024-09-15T23:53:50.767995+0000","last_became_peered":"2024-09-15T23:53:50.767995+0000","last_unstale":"2024-09-15T23:53:55.806250+0000","last_undegraded":"2024-09-15T23:53:55.806250+0000","last_fullsized":"2024-09-15T23:53:55.806250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:05.877077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333768+0000","last_change":"2024-09-15T23:53:50.776156+0000","last_active":"2024-09-15T23:53:56.333768+0000","last_peered":"2024-09-15T23:53:56.333768+0000","last_clean":"2024-09-15T23:53:56.333768+0000","last_became_active":"2024-09-15T23:53:50.775104+0000","last_became_peered":"2024-09-15T23:53:50.775104+0000","last_unstale":"2024-09-15T23:53:56.333768+0000","last_undegraded":"2024-09-15T23:53:56.333768+0000","last_fullsized":"2024-09-15T23:53:56.333768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:49.338954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334206+0000","last_change":"2024-09-15T23:53:50.773302+0000","last_active":"2024-09-15T23:53:56.334206+0000","last_peered":"2024-09-15T23:53:56.334206+0000","last_clean":"2024-09-15T23:53:56.334206+0000","last_became_active":"2024-09-15T23:53:50.772762+0000","last_became_peered":"2024-09-15T23:53:50.772762+0000","last_unstale":"2024-09-15T23:53:56.334206+0000","last_undegraded":"2024-09-15T23:53:56.334206+0000","last_fullsized":"2024-09-15T23:53:56.334206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:03.053120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334419+0000","last_change":"2024-09-15T23:53:50.766371+0000","last_active":"2024-09-15T23:53:56.334419+0000","last_peered":"2024-09-15T23:53:56.334419+0000","last_clean":"2024-09-15T23:53:56.334419+0000","last_became_active":"2024-09-15T23:53:50.766003+0000","last_became_peered":"2024-09-15T23:53:50.766003+0000","last_unstale":"2024-09-15T23:53:56.334419+0000","last_undegraded":"2024-09-15T23:53:56.334419+0000","last_fullsized":"2024-09-15T23:53:56.334419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:57.559108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332748+0000","last_change":"2024-09-15T23:53:50.772968+0000","last_active":"2024-09-15T23:53:56.332748+0000","last_peered":"2024-09-15T23:53:56.332748+0000","last_clean":"2024-09-15T23:53:56.332748+0000","last_became_active":"2024-09-15T23:53:50.771984+0000","last_became_peered":"2024-09-15T23:53:50.771984+0000","last_unstale":"2024-09-15T23:53:56.332748+0000","last_undegraded":"2024-09-15T23:53:56.332748+0000","last_fullsized":"2024-09-15T23:53:56.332748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:48.894933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803087+0000","last_change":"2024-09-15T23:53:50.775398+0000","last_active":"2024-09-15T23:53:55.803087+0000","last_peered":"2024-09-15T23:53:55.803087+0000","last_clean":"2024-09-15T23:53:55.803087+0000","last_became_active":"2024-09-15T23:53:50.775094+0000","last_became_peered":"2024-09-15T23:53:50.775094+0000","last_unstale":"2024-09-15T23:53:55.803087+0000","last_undegraded":"2024-09-15T23:53:55.803087+0000","last_fullsized":"2024-09-15T23:53:55.803087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:29.418106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333184+0000","last_change":"2024-09-15T23:53:50.760721+0000","last_active":"2024-09-15T23:53:56.333184+0000","last_peered":"2024-09-15T23:53:56.333184+0000","last_clean":"2024-09-15T23:53:56.333184+0000","last_became_active":"2024-09-15T23:53:50.760251+0000","last_became_peered":"2024-09-15T23:53:50.760251+0000","last_unstale":"2024-09-15T23:53:56.333184+0000","last_undegraded":"2024-09-15T23:53:56.333184+0000","last_fullsized":"2024-09-15T23:53:56.333184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:30.884230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331847+0000","last_change":"2024-09-15T23:53:50.760673+0000","last_active":"2024-09-15T23:53:56.331847+0000","last_peered":"2024-09-15T23:53:56.331847+0000","last_clean":"2024-09-15T23:53:56.331847+0000","last_became_active":"2024-09-15T23:53:50.760164+0000","last_became_peered":"2024-09-15T23:53:50.760164+0000","last_unstale":"2024-09-15T23:53:56.331847+0000","last_undegraded":"2024-09-15T23:53:56.331847+0000","last_fullsized":"2024-09-15T23:53:56.331847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.385437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333521+0000","last_change":"2024-09-15T23:53:50.766752+0000","last_active":"2024-09-15T23:53:56.333521+0000","last_peered":"2024-09-15T23:53:56.333521+0000","last_clean":"2024-09-15T23:53:56.333521+0000","last_became_active":"2024-09-15T23:53:50.766370+0000","last_became_peered":"2024-09-15T23:53:50.766370+0000","last_unstale":"2024-09-15T23:53:56.333521+0000","last_undegraded":"2024-09-15T23:53:56.333521+0000","last_fullsized":"2024-09-15T23:53:56.333521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:21.225015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332124+0000","last_change":"2024-09-15T23:53:50.778292+0000","last_active":"2024-09-15T23:53:56.332124+0000","last_peered":"2024-09-15T23:53:56.332124+0000","last_clean":"2024-09-15T23:53:56.332124+0000","last_became_active":"2024-09-15T23:53:50.777039+0000","last_became_peered":"2024-09-15T23:53:50.777039+0000","last_unstale":"2024-09-15T23:53:56.332124+0000","last_undegraded":"2024-09-15T23:53:56.332124+0000","last_fullsized":"2024-09-15T23:53:56.332124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805410+0000","last_change":"2024-09-15T23:53:50.771054+0000","last_active":"2024-09-15T23:53:55.805410+0000","last_peered":"2024-09-15T23:53:55.805410+0000","last_clean":"2024-09-15T23:53:55.805410+0000","last_became_active":"2024-09-15T23:53:50.770590+0000","last_became_peered":"2024-09-15T23:53:50.770590+0000","last_unstale":"2024-09-15T23:53:55.805410+0000","last_undegraded":"2024-09-15T23:53:55.805410+0000","last_fullsized":"2024-09-15T23:53:55.805410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:49.569731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805743+0000","last_change":"2024-09-15T23:53:50.769203+0000","last_active":"2024-09-15T23:53:55.805743+0000","last_peered":"2024-09-15T23:53:55.805743+0000","last_clean":"2024-09-15T23:53:55.805743+0000","last_became_active":"2024-09-15T23:53:50.768887+0000","last_became_peered":"2024-09-15T23:53:50.768887+0000","last_unstale":"2024-09-15T23:53:55.805743+0000","last_undegraded":"2024-09-15T23:53:55.805743+0000","last_fullsized":"2024-09-15T23:53:55.805743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:19.928453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333350+0000","last_change":"2024-09-15T23:53:50.766909+0000","last_active":"2024-09-15T23:53:56.333350+0000","last_peered":"2024-09-15T23:53:56.333350+0000","last_clean":"2024-09-15T23:53:56.333350+0000","last_became_active":"2024-09-15T23:53:50.766411+0000","last_became_peered":"2024-09-15T23:53:50.766411+0000","last_unstale":"2024-09-15T23:53:56.333350+0000","last_undegraded":"2024-09-15T23:53:56.333350+0000","last_fullsized":"2024-09-15T23:53:56.333350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:14.331012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":106766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":111282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":107348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":110610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":868352,"data_stored":697204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":697226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:54:08.027 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:54:08.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cef0eb640 1 Processor -- start 2024-09-15T23:54:08.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cef0eb640 1 -- start start 2024-09-15T23:54:08.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cef0eb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ce81520a0 0x7f6ce806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cef0eb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ce806fe50 0x7f6ce815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cef0eb640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ce8070250 con 0x7f6ce815f1d0 2024-09-15T23:54:08.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cef0eb640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6ce8152480 con 0x7f6ce81520a0 2024-09-15T23:54:08.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cef0eb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce80aede0 con 0x7f6ce806fe50 2024-09-15T23:54:08.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cece87640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ce81520a0 0x7f6ce806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cece87640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ce81520a0 0x7f6ce806f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57670/0 (socket says 172.21.15.112:57670) 2024-09-15T23:54:08.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cece87640 1 -- 172.21.15.112:0/957665328 learned_addr learned my addr 172.21.15.112:0/957665328 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:08.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6ce7fff640 1 --2- 172.21.15.112:0/957665328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ce806fe50 0x7f6ce815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cece87640 1 -- 172.21.15.112:0/957665328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ce806fe50 msgr2=0x7f6ce815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:08.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cece87640 1 --2- 172.21.15.112:0/957665328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ce806fe50 0x7f6ce815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cece87640 1 -- 172.21.15.112:0/957665328 >> v1:172.21.15.112:6789/0 conn(0x7f6ce815f1d0 legacy=0x7f6ce8071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cece87640 1 -- 172.21.15.112:0/957665328 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce815fa10 con 0x7f6ce81520a0 2024-09-15T23:54:08.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6ce7fff640 1 --2- 172.21.15.112:0/957665328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ce806fe50 0x7f6ce815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:08.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6cece87640 1 --2- 172.21.15.112:0/957665328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce81520a0 0x7f6ce806f910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009e50 tx=0x7f6cd801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0874f3e04ad084f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:08.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6ce77fe640 1 -- 172.21.15.112:0/957665328 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80a57f0 con 0x7f6ce81520a0 2024-09-15T23:54:08.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6ce77fe640 1 -- 172.21.15.112:0/957665328 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd80a5990 con 0x7f6ce81520a0 2024-09-15T23:54:08.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.177+0000 7f6ce77fe640 1 -- 172.21.15.112:0/957665328 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80a5d60 con 0x7f6ce81520a0 2024-09-15T23:54:08.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 -- 172.21.15.112:0/957665328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce81520a0 msgr2=0x7f6ce806f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 --2- 172.21.15.112:0/957665328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce81520a0 0x7f6ce806f910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009e50 tx=0x7f6cd801ca10 comp rx=0 tx=0).stop 2024-09-15T23:54:08.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 -- 172.21.15.112:0/957665328 shutdown_connections 2024-09-15T23:54:08.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 --2- 172.21.15.112:0/957665328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ce806fe50 0x7f6ce815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 --2- 172.21.15.112:0/957665328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce81520a0 0x7f6ce806f910 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 -- 172.21.15.112:0/957665328 >> 172.21.15.112:0/957665328 conn(0x7f6ce80b1f90 msgr2=0x7f6ce80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:08.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 -- 172.21.15.112:0/957665328 shutdown_connections 2024-09-15T23:54:08.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 -- 172.21.15.112:0/957665328 wait complete. 2024-09-15T23:54:08.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 Processor -- start 2024-09-15T23:54:08.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 -- start start 2024-09-15T23:54:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce806fe50 0x7f6ce81f9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ce81520a0 0x7f6ce814e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ce815f1d0 0x7f6ce81517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce8073d30 con 0x7f6ce806fe50 2024-09-15T23:54:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce8073a50 con 0x7f6ce815f1d0 2024-09-15T23:54:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce815f600 con 0x7f6ce81520a0 2024-09-15T23:54:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cece87640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce806fe50 0x7f6ce81f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cece87640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce806fe50 0x7f6ce81f9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:57684/0 (socket says 172.21.15.112:57684) 2024-09-15T23:54:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cece87640 1 -- 172.21.15.112:0/2496232746 learned_addr learned my addr 172.21.15.112:0/2496232746 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cece87640 1 -- 172.21.15.112:0/2496232746 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ce81520a0 msgr2=0x7f6ce814e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cece87640 1 --2- 172.21.15.112:0/2496232746 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ce81520a0 0x7f6ce814e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cece87640 1 -- 172.21.15.112:0/2496232746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ce815f1d0 msgr2=0x7f6ce81517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cece87640 1 --2- 172.21.15.112:0/2496232746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ce815f1d0 0x7f6ce81517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cece87640 1 -- 172.21.15.112:0/2496232746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce80cca60 con 0x7f6ce806fe50 2024-09-15T23:54:08.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cece87640 1 --2- 172.21.15.112:0/2496232746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce806fe50 0x7f6ce81f9430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6cd80af040 tx=0x7f6cd80197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:08.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6ce57fa640 1 -- 172.21.15.112:0/2496232746 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80b8880 con 0x7f6ce806fe50 2024-09-15T23:54:08.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6ce57fa640 1 -- 172.21.15.112:0/2496232746 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd80be070 con 0x7f6ce806fe50 2024-09-15T23:54:08.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 -- 172.21.15.112:0/2496232746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce814f6c0 con 0x7f6ce806fe50 2024-09-15T23:54:08.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6ce57fa640 1 -- 172.21.15.112:0/2496232746 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80b8cc0 con 0x7f6ce806fe50 2024-09-15T23:54:08.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 -- 172.21.15.112:0/2496232746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce81f8950 con 0x7f6ce806fe50 2024-09-15T23:54:08.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.181+0000 7f6cef0eb640 1 -- 172.21.15.112:0/2496232746 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ce815ec90 con 0x7f6ce806fe50 2024-09-15T23:54:08.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.185+0000 7f6ce57fa640 1 -- 172.21.15.112:0/2496232746 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6cd80c3460 con 0x7f6ce806fe50 2024-09-15T23:54:08.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.185+0000 7f6ce57fa640 1 --2- 172.21.15.112:0/2496232746 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6cc80678c0 0x7f6cc8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.185+0000 7f6ce57fa640 1 -- 172.21.15.112:0/2496232746 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6cd8121d40 con 0x7f6ce806fe50 2024-09-15T23:54:08.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.185+0000 7f6ce7fff640 1 --2- 172.21.15.112:0/2496232746 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6cc80678c0 0x7f6cc8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.185+0000 7f6ce7fff640 1 --2- 172.21.15.112:0/2496232746 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6cc80678c0 0x7f6cc8069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6ce814a040 tx=0x7f6cd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:08.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.189+0000 7f6ce57fa640 1 -- 172.21.15.112:0/2496232746 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6cd8016600 con 0x7f6ce806fe50 2024-09-15T23:54:08.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.333+0000 7f6cef0eb640 1 -- 172.21.15.112:0/2496232746 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ce815acc0 con 0x7f6cc80678c0 2024-09-15T23:54:08.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.345+0000 7f6ce57fa640 1 -- 172.21.15.112:0/2496232746 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332530 (secure 0 0 0) 0x7f6ce815acc0 con 0x7f6cc80678c0 2024-09-15T23:54:08.352 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:08.354 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:54:08.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.349+0000 7f6cef0eb640 1 -- 172.21.15.112:0/2496232746 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6cc80678c0 msgr2=0x7f6cc8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.349+0000 7f6cef0eb640 1 --2- 172.21.15.112:0/2496232746 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6cc80678c0 0x7f6cc8069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6ce814a040 tx=0x7f6cd0008040 comp rx=0 tx=0).stop 2024-09-15T23:54:08.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.349+0000 7f6cef0eb640 1 -- 172.21.15.112:0/2496232746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce806fe50 msgr2=0x7f6ce81f9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.349+0000 7f6cef0eb640 1 --2- 172.21.15.112:0/2496232746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce806fe50 0x7f6ce81f9430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6cd80af040 tx=0x7f6cd80197b0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.349+0000 7f6cef0eb640 1 -- 172.21.15.112:0/2496232746 shutdown_connections 2024-09-15T23:54:08.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.349+0000 7f6cef0eb640 1 --2- 172.21.15.112:0/2496232746 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6cc80678c0 0x7f6cc8069d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.349+0000 7f6cef0eb640 1 --2- 172.21.15.112:0/2496232746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ce815f1d0 0x7f6ce81517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.349+0000 7f6cef0eb640 1 --2- 172.21.15.112:0/2496232746 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ce81520a0 0x7f6ce814e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.349+0000 7f6cef0eb640 1 --2- 172.21.15.112:0/2496232746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ce806fe50 0x7f6ce81f9430 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.349+0000 7f6cef0eb640 1 -- 172.21.15.112:0/2496232746 >> 172.21.15.112:0/2496232746 conn(0x7f6ce80b1f90 msgr2=0x7f6ce815df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:08.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.349+0000 7f6cef0eb640 1 -- 172.21.15.112:0/2496232746 shutdown_connections 2024-09-15T23:54:08.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.349+0000 7f6cef0eb640 1 -- 172.21.15.112:0/2496232746 wait complete. 2024-09-15T23:54:08.368 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-15T23:54:07.236867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219572,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755148,"statfs":{"total":773094113280,"available":772869271552,"internally_reserved":0,"allocated":3416064,"data_stored":2044148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.441706"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.337336+0000","last_change":"2024-09-15T23:53:49.717934+0000","last_active":"2024-09-15T23:53:56.337336+0000","last_peered":"2024-09-15T23:53:56.337336+0000","last_clean":"2024-09-15T23:53:56.337336+0000","last_became_active":"2024-09-15T23:53:49.714475+0000","last_became_peered":"2024-09-15T23:53:49.714475+0000","last_unstale":"2024-09-15T23:53:56.337336+0000","last_undegraded":"2024-09-15T23:53:56.337336+0000","last_fullsized":"2024-09-15T23:53:56.337336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:32.423155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806022+0000","last_change":"2024-09-15T23:53:50.763869+0000","last_active":"2024-09-15T23:53:55.806022+0000","last_peered":"2024-09-15T23:53:55.806022+0000","last_clean":"2024-09-15T23:53:55.806022+0000","last_became_active":"2024-09-15T23:53:50.763518+0000","last_became_peered":"2024-09-15T23:53:50.763518+0000","last_unstale":"2024-09-15T23:53:55.806022+0000","last_undegraded":"2024-09-15T23:53:55.806022+0000","last_fullsized":"2024-09-15T23:53:55.806022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:47.362321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334847+0000","last_change":"2024-09-15T23:53:54.833331+0000","last_active":"2024-09-15T23:53:56.334847+0000","last_peered":"2024-09-15T23:53:56.334847+0000","last_clean":"2024-09-15T23:53:56.334847+0000","last_became_active":"2024-09-15T23:53:54.832469+0000","last_became_peered":"2024-09-15T23:53:54.832469+0000","last_unstale":"2024-09-15T23:53:56.334847+0000","last_undegraded":"2024-09-15T23:53:56.334847+0000","last_fullsized":"2024-09-15T23:53:56.334847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:19.976505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806573+0000","last_change":"2024-09-15T23:53:49.732960+0000","last_active":"2024-09-15T23:53:55.806573+0000","last_peered":"2024-09-15T23:53:55.806573+0000","last_clean":"2024-09-15T23:53:55.806573+0000","last_became_active":"2024-09-15T23:53:49.728314+0000","last_became_peered":"2024-09-15T23:53:49.728314+0000","last_unstale":"2024-09-15T23:53:55.806573+0000","last_undegraded":"2024-09-15T23:53:55.806573+0000","last_fullsized":"2024-09-15T23:53:55.806573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:41.274907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807049+0000","last_change":"2024-09-15T23:53:50.778808+0000","last_active":"2024-09-15T23:53:55.807049+0000","last_peered":"2024-09-15T23:53:55.807049+0000","last_clean":"2024-09-15T23:53:55.807049+0000","last_became_active":"2024-09-15T23:53:50.778102+0000","last_became_peered":"2024-09-15T23:53:50.778102+0000","last_unstale":"2024-09-15T23:53:55.807049+0000","last_undegraded":"2024-09-15T23:53:55.807049+0000","last_fullsized":"2024-09-15T23:53:55.807049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:59:38.443508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331942+0000","last_change":"2024-09-15T23:53:54.829460+0000","last_active":"2024-09-15T23:53:56.331942+0000","last_peered":"2024-09-15T23:53:56.331942+0000","last_clean":"2024-09-15T23:53:56.331942+0000","last_became_active":"2024-09-15T23:53:54.828410+0000","last_became_peered":"2024-09-15T23:53:54.828410+0000","last_unstale":"2024-09-15T23:53:56.331942+0000","last_undegraded":"2024-09-15T23:53:56.331942+0000","last_fullsized":"2024-09-15T23:53:56.331942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:01.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334332+0000","last_change":"2024-09-15T23:53:49.709773+0000","last_active":"2024-09-15T23:53:56.334332+0000","last_peered":"2024-09-15T23:53:56.334332+0000","last_clean":"2024-09-15T23:53:56.334332+0000","last_became_active":"2024-09-15T23:53:49.706868+0000","last_became_peered":"2024-09-15T23:53:49.706868+0000","last_unstale":"2024-09-15T23:53:56.334332+0000","last_undegraded":"2024-09-15T23:53:56.334332+0000","last_fullsized":"2024-09-15T23:53:56.334332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:30.316273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332457+0000","last_change":"2024-09-15T23:53:50.774606+0000","last_active":"2024-09-15T23:53:56.332457+0000","last_peered":"2024-09-15T23:53:56.332457+0000","last_clean":"2024-09-15T23:53:56.332457+0000","last_became_active":"2024-09-15T23:53:50.774322+0000","last_became_peered":"2024-09-15T23:53:50.774322+0000","last_unstale":"2024-09-15T23:53:56.332457+0000","last_undegraded":"2024-09-15T23:53:56.332457+0000","last_fullsized":"2024-09-15T23:53:56.332457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:10.630689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331636+0000","last_change":"2024-09-15T23:53:54.826698+0000","last_active":"2024-09-15T23:53:56.331636+0000","last_peered":"2024-09-15T23:53:56.331636+0000","last_clean":"2024-09-15T23:53:56.331636+0000","last_became_active":"2024-09-15T23:53:54.826082+0000","last_became_peered":"2024-09-15T23:53:54.826082+0000","last_unstale":"2024-09-15T23:53:56.331636+0000","last_undegraded":"2024-09-15T23:53:56.331636+0000","last_fullsized":"2024-09-15T23:53:56.331636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:34.967835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334036+0000","last_change":"2024-09-15T23:53:49.728958+0000","last_active":"2024-09-15T23:53:56.334036+0000","last_peered":"2024-09-15T23:53:56.334036+0000","last_clean":"2024-09-15T23:53:56.334036+0000","last_became_active":"2024-09-15T23:53:49.728518+0000","last_became_peered":"2024-09-15T23:53:49.728518+0000","last_unstale":"2024-09-15T23:53:56.334036+0000","last_undegraded":"2024-09-15T23:53:56.334036+0000","last_fullsized":"2024-09-15T23:53:56.334036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:14.375412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800310+0000","last_change":"2024-09-15T23:53:50.774805+0000","last_active":"2024-09-15T23:53:55.800310+0000","last_peered":"2024-09-15T23:53:55.800310+0000","last_clean":"2024-09-15T23:53:55.800310+0000","last_became_active":"2024-09-15T23:53:50.774139+0000","last_became_peered":"2024-09-15T23:53:50.774139+0000","last_unstale":"2024-09-15T23:53:55.800310+0000","last_undegraded":"2024-09-15T23:53:55.800310+0000","last_fullsized":"2024-09-15T23:53:55.800310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:14.717753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331537+0000","last_change":"2024-09-15T23:53:54.838942+0000","last_active":"2024-09-15T23:53:56.331537+0000","last_peered":"2024-09-15T23:53:56.331537+0000","last_clean":"2024-09-15T23:53:56.331537+0000","last_became_active":"2024-09-15T23:53:54.838537+0000","last_became_peered":"2024-09-15T23:53:54.838537+0000","last_unstale":"2024-09-15T23:53:56.331537+0000","last_undegraded":"2024-09-15T23:53:56.331537+0000","last_fullsized":"2024-09-15T23:53:56.331537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:21.696119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799206+0000","last_change":"2024-09-15T23:53:50.762649+0000","last_active":"2024-09-15T23:53:55.799206+0000","last_peered":"2024-09-15T23:53:55.799206+0000","last_clean":"2024-09-15T23:53:55.799206+0000","last_became_active":"2024-09-15T23:53:50.762376+0000","last_became_peered":"2024-09-15T23:53:50.762376+0000","last_unstale":"2024-09-15T23:53:55.799206+0000","last_undegraded":"2024-09-15T23:53:55.799206+0000","last_fullsized":"2024-09-15T23:53:55.799206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:27.451893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799258+0000","last_change":"2024-09-15T23:53:49.707629+0000","last_active":"2024-09-15T23:53:55.799258+0000","last_peered":"2024-09-15T23:53:55.799258+0000","last_clean":"2024-09-15T23:53:55.799258+0000","last_became_active":"2024-09-15T23:53:49.706615+0000","last_became_peered":"2024-09-15T23:53:49.706615+0000","last_unstale":"2024-09-15T23:53:55.799258+0000","last_undegraded":"2024-09-15T23:53:55.799258+0000","last_fullsized":"2024-09-15T23:53:55.799258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:25.059449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799393+0000","last_change":"2024-09-15T23:53:54.831019+0000","last_active":"2024-09-15T23:53:55.799393+0000","last_peered":"2024-09-15T23:53:55.799393+0000","last_clean":"2024-09-15T23:53:55.799393+0000","last_became_active":"2024-09-15T23:53:54.830461+0000","last_became_peered":"2024-09-15T23:53:54.830461+0000","last_unstale":"2024-09-15T23:53:55.799393+0000","last_undegraded":"2024-09-15T23:53:55.799393+0000","last_fullsized":"2024-09-15T23:53:55.799393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:11.816336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336067+0000","last_change":"2024-09-15T23:53:50.769836+0000","last_active":"2024-09-15T23:53:56.336067+0000","last_peered":"2024-09-15T23:53:56.336067+0000","last_clean":"2024-09-15T23:53:56.336067+0000","last_became_active":"2024-09-15T23:53:50.769317+0000","last_became_peered":"2024-09-15T23:53:50.769317+0000","last_unstale":"2024-09-15T23:53:56.336067+0000","last_undegraded":"2024-09-15T23:53:56.336067+0000","last_fullsized":"2024-09-15T23:53:56.336067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805160+0000","last_change":"2024-09-15T23:53:49.724446+0000","last_active":"2024-09-15T23:53:55.805160+0000","last_peered":"2024-09-15T23:53:55.805160+0000","last_clean":"2024-09-15T23:53:55.805160+0000","last_became_active":"2024-09-15T23:53:49.723722+0000","last_became_peered":"2024-09-15T23:53:49.723722+0000","last_unstale":"2024-09-15T23:53:55.805160+0000","last_undegraded":"2024-09-15T23:53:55.805160+0000","last_fullsized":"2024-09-15T23:53:55.805160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:55.009643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333927+0000","last_change":"2024-09-15T23:53:54.827261+0000","last_active":"2024-09-15T23:53:56.333927+0000","last_peered":"2024-09-15T23:53:56.333927+0000","last_clean":"2024-09-15T23:53:56.333927+0000","last_became_active":"2024-09-15T23:53:54.826675+0000","last_became_peered":"2024-09-15T23:53:54.826675+0000","last_unstale":"2024-09-15T23:53:56.333927+0000","last_undegraded":"2024-09-15T23:53:56.333927+0000","last_fullsized":"2024-09-15T23:53:56.333927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:05.187892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334092+0000","last_change":"2024-09-15T23:53:50.758381+0000","last_active":"2024-09-15T23:53:56.334092+0000","last_peered":"2024-09-15T23:53:56.334092+0000","last_clean":"2024-09-15T23:53:56.334092+0000","last_became_active":"2024-09-15T23:53:50.757608+0000","last_became_peered":"2024-09-15T23:53:50.757608+0000","last_unstale":"2024-09-15T23:53:56.334092+0000","last_undegraded":"2024-09-15T23:53:56.334092+0000","last_fullsized":"2024-09-15T23:53:56.334092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:05.877077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335894+0000","last_change":"2024-09-15T23:53:49.722069+0000","last_active":"2024-09-15T23:53:56.335894+0000","last_peered":"2024-09-15T23:53:56.335894+0000","last_clean":"2024-09-15T23:53:56.335894+0000","last_became_active":"2024-09-15T23:53:49.721311+0000","last_became_peered":"2024-09-15T23:53:49.721311+0000","last_unstale":"2024-09-15T23:53:56.335894+0000","last_undegraded":"2024-09-15T23:53:56.335894+0000","last_fullsized":"2024-09-15T23:53:56.335894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:54.905896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336379+0000","last_change":"2024-09-15T23:53:54.834211+0000","last_active":"2024-09-15T23:53:56.336379+0000","last_peered":"2024-09-15T23:53:56.336379+0000","last_clean":"2024-09-15T23:53:56.336379+0000","last_became_active":"2024-09-15T23:53:54.832649+0000","last_became_peered":"2024-09-15T23:53:54.832649+0000","last_unstale":"2024-09-15T23:53:56.336379+0000","last_undegraded":"2024-09-15T23:53:56.336379+0000","last_fullsized":"2024-09-15T23:53:56.336379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:15.794176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798634+0000","last_change":"2024-09-15T23:53:50.765134+0000","last_active":"2024-09-15T23:53:55.798634+0000","last_peered":"2024-09-15T23:53:55.798634+0000","last_clean":"2024-09-15T23:53:55.798634+0000","last_became_active":"2024-09-15T23:53:50.764730+0000","last_became_peered":"2024-09-15T23:53:50.764730+0000","last_unstale":"2024-09-15T23:53:55.798634+0000","last_undegraded":"2024-09-15T23:53:55.798634+0000","last_fullsized":"2024-09-15T23:53:55.798634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:59.810140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332903+0000","last_change":"2024-09-15T23:53:49.705844+0000","last_active":"2024-09-15T23:53:56.332903+0000","last_peered":"2024-09-15T23:53:56.332903+0000","last_clean":"2024-09-15T23:53:56.332903+0000","last_became_active":"2024-09-15T23:53:49.705408+0000","last_became_peered":"2024-09-15T23:53:49.705408+0000","last_unstale":"2024-09-15T23:53:56.332903+0000","last_undegraded":"2024-09-15T23:53:56.332903+0000","last_fullsized":"2024-09-15T23:53:56.332903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.829837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332277+0000","last_change":"2024-09-15T23:53:54.832183+0000","last_active":"2024-09-15T23:53:56.332277+0000","last_peered":"2024-09-15T23:53:56.332277+0000","last_clean":"2024-09-15T23:53:56.332277+0000","last_became_active":"2024-09-15T23:53:54.831797+0000","last_became_peered":"2024-09-15T23:53:54.831797+0000","last_unstale":"2024-09-15T23:53:56.332277+0000","last_undegraded":"2024-09-15T23:53:56.332277+0000","last_fullsized":"2024-09-15T23:53:56.332277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:05.294652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336702+0000","last_change":"2024-09-15T23:53:50.760086+0000","last_active":"2024-09-15T23:53:56.336702+0000","last_peered":"2024-09-15T23:53:56.336702+0000","last_clean":"2024-09-15T23:53:56.336702+0000","last_became_active":"2024-09-15T23:53:50.759518+0000","last_became_peered":"2024-09-15T23:53:50.759518+0000","last_unstale":"2024-09-15T23:53:56.336702+0000","last_undegraded":"2024-09-15T23:53:56.336702+0000","last_fullsized":"2024-09-15T23:53:56.336702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:49.338954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.801439+0000","last_change":"2024-09-15T23:53:49.712525+0000","last_active":"2024-09-15T23:53:55.801439+0000","last_peered":"2024-09-15T23:53:55.801439+0000","last_clean":"2024-09-15T23:53:55.801439+0000","last_became_active":"2024-09-15T23:53:49.711958+0000","last_became_peered":"2024-09-15T23:53:49.711958+0000","last_unstale":"2024-09-15T23:53:55.801439+0000","last_undegraded":"2024-09-15T23:53:55.801439+0000","last_fullsized":"2024-09-15T23:53:55.801439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:29.249885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331564+0000","last_change":"2024-09-15T23:53:54.820216+0000","last_active":"2024-09-15T23:53:56.331564+0000","last_peered":"2024-09-15T23:53:56.331564+0000","last_clean":"2024-09-15T23:53:56.331564+0000","last_became_active":"2024-09-15T23:53:54.819642+0000","last_became_peered":"2024-09-15T23:53:54.819642+0000","last_unstale":"2024-09-15T23:53:56.331564+0000","last_undegraded":"2024-09-15T23:53:56.331564+0000","last_fullsized":"2024-09-15T23:53:56.331564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:58.670287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.337164+0000","last_change":"2024-09-15T23:53:50.764624+0000","last_active":"2024-09-15T23:53:56.337164+0000","last_peered":"2024-09-15T23:53:56.337164+0000","last_clean":"2024-09-15T23:53:56.337164+0000","last_became_active":"2024-09-15T23:53:50.764271+0000","last_became_peered":"2024-09-15T23:53:50.764271+0000","last_unstale":"2024-09-15T23:53:56.337164+0000","last_undegraded":"2024-09-15T23:53:56.337164+0000","last_fullsized":"2024-09-15T23:53:56.337164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:11.898034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336935+0000","last_change":"2024-09-15T23:53:49.722266+0000","last_active":"2024-09-15T23:53:56.336935+0000","last_peered":"2024-09-15T23:53:56.336935+0000","last_clean":"2024-09-15T23:53:56.336935+0000","last_became_active":"2024-09-15T23:53:49.721470+0000","last_became_peered":"2024-09-15T23:53:49.721470+0000","last_unstale":"2024-09-15T23:53:56.336935+0000","last_undegraded":"2024-09-15T23:53:56.336935+0000","last_fullsized":"2024-09-15T23:53:56.336935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:45.659637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334216+0000","last_change":"2024-09-15T23:53:54.818192+0000","last_active":"2024-09-15T23:53:56.334216+0000","last_peered":"2024-09-15T23:53:56.334216+0000","last_clean":"2024-09-15T23:53:56.334216+0000","last_became_active":"2024-09-15T23:53:54.817117+0000","last_became_peered":"2024-09-15T23:53:54.817117+0000","last_unstale":"2024-09-15T23:53:56.334216+0000","last_undegraded":"2024-09-15T23:53:56.334216+0000","last_fullsized":"2024-09-15T23:53:56.334216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:18.414617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807739+0000","last_change":"2024-09-15T23:53:50.753210+0000","last_active":"2024-09-15T23:53:55.807739+0000","last_peered":"2024-09-15T23:53:55.807739+0000","last_clean":"2024-09-15T23:53:55.807739+0000","last_became_active":"2024-09-15T23:53:50.752491+0000","last_became_peered":"2024-09-15T23:53:50.752491+0000","last_unstale":"2024-09-15T23:53:55.807739+0000","last_undegraded":"2024-09-15T23:53:55.807739+0000","last_fullsized":"2024-09-15T23:53:55.807739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:15.892900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.801158+0000","last_change":"2024-09-15T23:53:49.717089+0000","last_active":"2024-09-15T23:53:55.801158+0000","last_peered":"2024-09-15T23:53:55.801158+0000","last_clean":"2024-09-15T23:53:55.801158+0000","last_became_active":"2024-09-15T23:53:49.715862+0000","last_became_peered":"2024-09-15T23:53:49.715862+0000","last_unstale":"2024-09-15T23:53:55.801158+0000","last_undegraded":"2024-09-15T23:53:55.801158+0000","last_fullsized":"2024-09-15T23:53:55.801158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:49.721033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805363+0000","last_change":"2024-09-15T23:53:54.831979+0000","last_active":"2024-09-15T23:53:55.805363+0000","last_peered":"2024-09-15T23:53:55.805363+0000","last_clean":"2024-09-15T23:53:55.805363+0000","last_became_active":"2024-09-15T23:53:54.830505+0000","last_became_peered":"2024-09-15T23:53:54.830505+0000","last_unstale":"2024-09-15T23:53:55.805363+0000","last_undegraded":"2024-09-15T23:53:55.805363+0000","last_fullsized":"2024-09-15T23:53:55.805363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:58.670287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332157+0000","last_change":"2024-09-15T23:53:50.769317+0000","last_active":"2024-09-15T23:53:56.332157+0000","last_peered":"2024-09-15T23:53:56.332157+0000","last_clean":"2024-09-15T23:53:56.332157+0000","last_became_active":"2024-09-15T23:53:50.768788+0000","last_became_peered":"2024-09-15T23:53:50.768788+0000","last_unstale":"2024-09-15T23:53:56.332157+0000","last_undegraded":"2024-09-15T23:53:56.332157+0000","last_fullsized":"2024-09-15T23:53:56.332157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:55.915920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805063+0000","last_change":"2024-09-15T23:53:49.734159+0000","last_active":"2024-09-15T23:53:55.805063+0000","last_peered":"2024-09-15T23:53:55.805063+0000","last_clean":"2024-09-15T23:53:55.805063+0000","last_became_active":"2024-09-15T23:53:49.733298+0000","last_became_peered":"2024-09-15T23:53:49.733298+0000","last_unstale":"2024-09-15T23:53:55.805063+0000","last_undegraded":"2024-09-15T23:53:55.805063+0000","last_fullsized":"2024-09-15T23:53:55.805063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:25.932592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803370+0000","last_change":"2024-09-15T23:53:54.843329+0000","last_active":"2024-09-15T23:53:55.803370+0000","last_peered":"2024-09-15T23:53:55.803370+0000","last_clean":"2024-09-15T23:53:55.803370+0000","last_became_active":"2024-09-15T23:53:54.838912+0000","last_became_peered":"2024-09-15T23:53:54.838912+0000","last_unstale":"2024-09-15T23:53:55.803370+0000","last_undegraded":"2024-09-15T23:53:55.803370+0000","last_fullsized":"2024-09-15T23:53:55.803370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:55.661043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333465+0000","last_change":"2024-09-15T23:53:50.767627+0000","last_active":"2024-09-15T23:53:56.333465+0000","last_peered":"2024-09-15T23:53:56.333465+0000","last_clean":"2024-09-15T23:53:56.333465+0000","last_became_active":"2024-09-15T23:53:50.766671+0000","last_became_peered":"2024-09-15T23:53:50.766671+0000","last_unstale":"2024-09-15T23:53:56.333465+0000","last_undegraded":"2024-09-15T23:53:56.333465+0000","last_fullsized":"2024-09-15T23:53:56.333465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:54.586682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799767+0000","last_change":"2024-09-15T23:53:49.725634+0000","last_active":"2024-09-15T23:53:55.799767+0000","last_peered":"2024-09-15T23:53:55.799767+0000","last_clean":"2024-09-15T23:53:55.799767+0000","last_became_active":"2024-09-15T23:53:49.723832+0000","last_became_peered":"2024-09-15T23:53:49.723832+0000","last_unstale":"2024-09-15T23:53:55.799767+0000","last_undegraded":"2024-09-15T23:53:55.799767+0000","last_fullsized":"2024-09-15T23:53:55.799767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:09.900395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807354+0000","last_change":"2024-09-15T23:53:54.846953+0000","last_active":"2024-09-15T23:53:55.807354+0000","last_peered":"2024-09-15T23:53:55.807354+0000","last_clean":"2024-09-15T23:53:55.807354+0000","last_became_active":"2024-09-15T23:53:54.844217+0000","last_became_peered":"2024-09-15T23:53:54.844217+0000","last_unstale":"2024-09-15T23:53:55.807354+0000","last_undegraded":"2024-09-15T23:53:55.807354+0000","last_fullsized":"2024-09-15T23:53:55.807354+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:25.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803281+0000","last_change":"2024-09-15T23:53:50.763583+0000","last_active":"2024-09-15T23:53:55.803281+0000","last_peered":"2024-09-15T23:53:55.803281+0000","last_clean":"2024-09-15T23:53:55.803281+0000","last_became_active":"2024-09-15T23:53:50.763267+0000","last_became_peered":"2024-09-15T23:53:50.763267+0000","last_unstale":"2024-09-15T23:53:55.803281+0000","last_undegraded":"2024-09-15T23:53:55.803281+0000","last_fullsized":"2024-09-15T23:53:55.803281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:34.077890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335453+0000","last_change":"2024-09-15T23:53:49.725775+0000","last_active":"2024-09-15T23:53:56.335453+0000","last_peered":"2024-09-15T23:53:56.335453+0000","last_clean":"2024-09-15T23:53:56.335453+0000","last_became_active":"2024-09-15T23:53:49.724972+0000","last_became_peered":"2024-09-15T23:53:49.724972+0000","last_unstale":"2024-09-15T23:53:56.335453+0000","last_undegraded":"2024-09-15T23:53:56.335453+0000","last_fullsized":"2024-09-15T23:53:56.335453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:25:03.906556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805542+0000","last_change":"2024-09-15T23:53:54.831426+0000","last_active":"2024-09-15T23:53:55.805542+0000","last_peered":"2024-09-15T23:53:55.805542+0000","last_clean":"2024-09-15T23:53:55.805542+0000","last_became_active":"2024-09-15T23:53:54.830222+0000","last_became_peered":"2024-09-15T23:53:54.830222+0000","last_unstale":"2024-09-15T23:53:55.805542+0000","last_undegraded":"2024-09-15T23:53:55.805542+0000","last_fullsized":"2024-09-15T23:53:55.805542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:01.642713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804225+0000","last_change":"2024-09-15T23:53:50.749494+0000","last_active":"2024-09-15T23:53:55.804225+0000","last_peered":"2024-09-15T23:53:55.804225+0000","last_clean":"2024-09-15T23:53:55.804225+0000","last_became_active":"2024-09-15T23:53:50.748576+0000","last_became_peered":"2024-09-15T23:53:50.748576+0000","last_unstale":"2024-09-15T23:53:55.804225+0000","last_undegraded":"2024-09-15T23:53:55.804225+0000","last_fullsized":"2024-09-15T23:53:55.804225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:39.100079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799626+0000","last_change":"2024-09-15T23:53:49.725322+0000","last_active":"2024-09-15T23:53:55.799626+0000","last_peered":"2024-09-15T23:53:55.799626+0000","last_clean":"2024-09-15T23:53:55.799626+0000","last_became_active":"2024-09-15T23:53:49.724863+0000","last_became_peered":"2024-09-15T23:53:49.724863+0000","last_unstale":"2024-09-15T23:53:55.799626+0000","last_undegraded":"2024-09-15T23:53:55.799626+0000","last_fullsized":"2024-09-15T23:53:55.799626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:08.552003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805910+0000","last_change":"2024-09-15T23:53:54.839131+0000","last_active":"2024-09-15T23:53:55.805910+0000","last_peered":"2024-09-15T23:53:55.805910+0000","last_clean":"2024-09-15T23:53:55.805910+0000","last_became_active":"2024-09-15T23:53:54.837820+0000","last_became_peered":"2024-09-15T23:53:54.837820+0000","last_unstale":"2024-09-15T23:53:55.805910+0000","last_undegraded":"2024-09-15T23:53:55.805910+0000","last_fullsized":"2024-09-15T23:53:55.805910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:12.392532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334826+0000","last_change":"2024-09-15T23:53:50.760376+0000","last_active":"2024-09-15T23:53:56.334826+0000","last_peered":"2024-09-15T23:53:56.334826+0000","last_clean":"2024-09-15T23:53:56.334826+0000","last_became_active":"2024-09-15T23:53:50.758918+0000","last_became_peered":"2024-09-15T23:53:50.758918+0000","last_unstale":"2024-09-15T23:53:56.334826+0000","last_undegraded":"2024-09-15T23:53:56.334826+0000","last_fullsized":"2024-09-15T23:53:56.334826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:04.750808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799555+0000","last_change":"2024-09-15T23:53:49.707210+0000","last_active":"2024-09-15T23:53:55.799555+0000","last_peered":"2024-09-15T23:53:55.799555+0000","last_clean":"2024-09-15T23:53:55.799555+0000","last_became_active":"2024-09-15T23:53:49.705850+0000","last_became_peered":"2024-09-15T23:53:49.705850+0000","last_unstale":"2024-09-15T23:53:55.799555+0000","last_undegraded":"2024-09-15T23:53:55.799555+0000","last_fullsized":"2024-09-15T23:53:55.799555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:01.693912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331928+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:53:56.331928+0000","last_peered":"2024-09-15T23:53:56.331928+0000","last_clean":"2024-09-15T23:53:56.331928+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:53:56.331928+0000","last_undegraded":"2024-09-15T23:53:56.331928+0000","last_fullsized":"2024-09-15T23:53:56.331928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800931+0000","last_change":"2024-09-15T23:53:54.802294+0000","last_active":"2024-09-15T23:53:55.800931+0000","last_peered":"2024-09-15T23:53:55.800931+0000","last_clean":"2024-09-15T23:53:55.800931+0000","last_became_active":"2024-09-15T23:53:54.801810+0000","last_became_peered":"2024-09-15T23:53:54.801810+0000","last_unstale":"2024-09-15T23:53:55.800931+0000","last_undegraded":"2024-09-15T23:53:55.800931+0000","last_fullsized":"2024-09-15T23:53:55.800931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:31.818261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800591+0000","last_change":"2024-09-15T23:53:50.763308+0000","last_active":"2024-09-15T23:53:55.800591+0000","last_peered":"2024-09-15T23:53:55.800591+0000","last_clean":"2024-09-15T23:53:55.800591+0000","last_became_active":"2024-09-15T23:53:50.763032+0000","last_became_peered":"2024-09-15T23:53:50.763032+0000","last_unstale":"2024-09-15T23:53:55.800591+0000","last_undegraded":"2024-09-15T23:53:55.800591+0000","last_fullsized":"2024-09-15T23:53:55.800591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:48.085914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807911+0000","last_change":"2024-09-15T23:53:49.730437+0000","last_active":"2024-09-15T23:53:55.807911+0000","last_peered":"2024-09-15T23:53:55.807911+0000","last_clean":"2024-09-15T23:53:55.807911+0000","last_became_active":"2024-09-15T23:53:49.729801+0000","last_became_peered":"2024-09-15T23:53:49.729801+0000","last_unstale":"2024-09-15T23:53:55.807911+0000","last_undegraded":"2024-09-15T23:53:55.807911+0000","last_fullsized":"2024-09-15T23:53:55.807911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:56.727393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331703+0000","last_change":"2024-09-15T23:53:54.838987+0000","last_active":"2024-09-15T23:53:56.331703+0000","last_peered":"2024-09-15T23:53:56.331703+0000","last_clean":"2024-09-15T23:53:56.331703+0000","last_became_active":"2024-09-15T23:53:54.838600+0000","last_became_peered":"2024-09-15T23:53:54.838600+0000","last_unstale":"2024-09-15T23:53:56.331703+0000","last_undegraded":"2024-09-15T23:53:56.331703+0000","last_fullsized":"2024-09-15T23:53:56.331703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:55.661043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333855+0000","last_change":"2024-09-15T23:53:50.772514+0000","last_active":"2024-09-15T23:53:56.333855+0000","last_peered":"2024-09-15T23:53:56.333855+0000","last_clean":"2024-09-15T23:53:56.333855+0000","last_became_active":"2024-09-15T23:53:50.771970+0000","last_became_peered":"2024-09-15T23:53:50.771970+0000","last_unstale":"2024-09-15T23:53:56.333855+0000","last_undegraded":"2024-09-15T23:53:56.333855+0000","last_fullsized":"2024-09-15T23:53:56.333855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:17.612514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805841+0000","last_change":"2024-09-15T23:53:49.728617+0000","last_active":"2024-09-15T23:53:55.805841+0000","last_peered":"2024-09-15T23:53:55.805841+0000","last_clean":"2024-09-15T23:53:55.805841+0000","last_became_active":"2024-09-15T23:53:49.727770+0000","last_became_peered":"2024-09-15T23:53:49.727770+0000","last_unstale":"2024-09-15T23:53:55.805841+0000","last_undegraded":"2024-09-15T23:53:55.805841+0000","last_fullsized":"2024-09-15T23:53:55.805841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:51.740913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804252+0000","last_change":"2024-09-15T23:53:54.815958+0000","last_active":"2024-09-15T23:53:55.804252+0000","last_peered":"2024-09-15T23:53:55.804252+0000","last_clean":"2024-09-15T23:53:55.804252+0000","last_became_active":"2024-09-15T23:53:54.814904+0000","last_became_peered":"2024-09-15T23:53:54.814904+0000","last_unstale":"2024-09-15T23:53:55.804252+0000","last_undegraded":"2024-09-15T23:53:55.804252+0000","last_fullsized":"2024-09-15T23:53:55.804252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:56.872305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333379+0000","last_change":"2024-09-15T23:53:50.781321+0000","last_active":"2024-09-15T23:53:56.333379+0000","last_peered":"2024-09-15T23:53:56.333379+0000","last_clean":"2024-09-15T23:53:56.333379+0000","last_became_active":"2024-09-15T23:53:50.780931+0000","last_became_peered":"2024-09-15T23:53:50.780931+0000","last_unstale":"2024-09-15T23:53:56.333379+0000","last_undegraded":"2024-09-15T23:53:56.333379+0000","last_fullsized":"2024-09-15T23:53:56.333379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:54.765704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336877+0000","last_change":"2024-09-15T23:53:49.730687+0000","last_active":"2024-09-15T23:53:56.336877+0000","last_peered":"2024-09-15T23:53:56.336877+0000","last_clean":"2024-09-15T23:53:56.336877+0000","last_became_active":"2024-09-15T23:53:49.729969+0000","last_became_peered":"2024-09-15T23:53:49.729969+0000","last_unstale":"2024-09-15T23:53:56.336877+0000","last_undegraded":"2024-09-15T23:53:56.336877+0000","last_fullsized":"2024-09-15T23:53:56.336877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:55.009643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798438+0000","last_change":"2024-09-15T23:53:54.807204+0000","last_active":"2024-09-15T23:53:55.798438+0000","last_peered":"2024-09-15T23:53:55.798438+0000","last_clean":"2024-09-15T23:53:55.798438+0000","last_became_active":"2024-09-15T23:53:54.806430+0000","last_became_peered":"2024-09-15T23:53:54.806430+0000","last_unstale":"2024-09-15T23:53:55.798438+0000","last_undegraded":"2024-09-15T23:53:55.798438+0000","last_fullsized":"2024-09-15T23:53:55.798438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:24.111672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333084+0000","last_change":"2024-09-15T23:53:50.779517+0000","last_active":"2024-09-15T23:53:56.333084+0000","last_peered":"2024-09-15T23:53:56.333084+0000","last_clean":"2024-09-15T23:53:56.333084+0000","last_became_active":"2024-09-15T23:53:50.779199+0000","last_became_peered":"2024-09-15T23:53:50.779199+0000","last_unstale":"2024-09-15T23:53:56.333084+0000","last_undegraded":"2024-09-15T23:53:56.333084+0000","last_fullsized":"2024-09-15T23:53:56.333084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:39.100079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333514+0000","last_change":"2024-09-15T23:53:49.734270+0000","last_active":"2024-09-15T23:53:56.333514+0000","last_peered":"2024-09-15T23:53:56.333514+0000","last_clean":"2024-09-15T23:53:56.333514+0000","last_became_active":"2024-09-15T23:53:49.729410+0000","last_became_peered":"2024-09-15T23:53:49.729410+0000","last_unstale":"2024-09-15T23:53:56.333514+0000","last_undegraded":"2024-09-15T23:53:56.333514+0000","last_fullsized":"2024-09-15T23:53:56.333514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:32.423155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332767+0000","last_change":"2024-09-15T23:53:54.828876+0000","last_active":"2024-09-15T23:53:56.332767+0000","last_peered":"2024-09-15T23:53:56.332767+0000","last_clean":"2024-09-15T23:53:56.332767+0000","last_became_active":"2024-09-15T23:53:54.828500+0000","last_became_peered":"2024-09-15T23:53:54.828500+0000","last_unstale":"2024-09-15T23:53:56.332767+0000","last_undegraded":"2024-09-15T23:53:56.332767+0000","last_fullsized":"2024-09-15T23:53:56.332767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:03.580557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799130+0000","last_change":"2024-09-15T23:53:50.761067+0000","last_active":"2024-09-15T23:53:55.799130+0000","last_peered":"2024-09-15T23:53:55.799130+0000","last_clean":"2024-09-15T23:53:55.799130+0000","last_became_active":"2024-09-15T23:53:50.760746+0000","last_became_peered":"2024-09-15T23:53:50.760746+0000","last_unstale":"2024-09-15T23:53:55.799130+0000","last_undegraded":"2024-09-15T23:53:55.799130+0000","last_fullsized":"2024-09-15T23:53:55.799130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:37.867754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334428+0000","last_change":"2024-09-15T23:53:49.715804+0000","last_active":"2024-09-15T23:53:56.334428+0000","last_peered":"2024-09-15T23:53:56.334428+0000","last_clean":"2024-09-15T23:53:56.334428+0000","last_became_active":"2024-09-15T23:53:49.715180+0000","last_became_peered":"2024-09-15T23:53:49.715180+0000","last_unstale":"2024-09-15T23:53:56.334428+0000","last_undegraded":"2024-09-15T23:53:56.334428+0000","last_fullsized":"2024-09-15T23:53:56.334428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:40.829837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806333+0000","last_change":"2024-09-15T23:53:54.838616+0000","last_active":"2024-09-15T23:53:55.806333+0000","last_peered":"2024-09-15T23:53:55.806333+0000","last_clean":"2024-09-15T23:53:55.806333+0000","last_became_active":"2024-09-15T23:53:54.837514+0000","last_became_peered":"2024-09-15T23:53:54.837514+0000","last_unstale":"2024-09-15T23:53:55.806333+0000","last_undegraded":"2024-09-15T23:53:55.806333+0000","last_fullsized":"2024-09-15T23:53:55.806333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:16.570607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331570+0000","last_change":"2024-09-15T23:53:50.773002+0000","last_active":"2024-09-15T23:53:56.331570+0000","last_peered":"2024-09-15T23:53:56.331570+0000","last_clean":"2024-09-15T23:53:56.331570+0000","last_became_active":"2024-09-15T23:53:50.772276+0000","last_became_peered":"2024-09-15T23:53:50.772276+0000","last_unstale":"2024-09-15T23:53:56.331570+0000","last_undegraded":"2024-09-15T23:53:56.331570+0000","last_fullsized":"2024-09-15T23:53:56.331570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:55.915920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333217+0000","last_change":"2024-09-15T23:53:49.700504+0000","last_active":"2024-09-15T23:53:56.333217+0000","last_peered":"2024-09-15T23:53:56.333217+0000","last_clean":"2024-09-15T23:53:56.333217+0000","last_became_active":"2024-09-15T23:53:49.699750+0000","last_became_peered":"2024-09-15T23:53:49.699750+0000","last_unstale":"2024-09-15T23:53:56.333217+0000","last_undegraded":"2024-09-15T23:53:56.333217+0000","last_fullsized":"2024-09-15T23:53:56.333217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:45.659637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806928+0000","last_change":"2024-09-15T23:53:54.824331+0000","last_active":"2024-09-15T23:53:55.806928+0000","last_peered":"2024-09-15T23:53:55.806928+0000","last_clean":"2024-09-15T23:53:55.806928+0000","last_became_active":"2024-09-15T23:53:54.823300+0000","last_became_peered":"2024-09-15T23:53:54.823300+0000","last_unstale":"2024-09-15T23:53:55.806928+0000","last_undegraded":"2024-09-15T23:53:55.806928+0000","last_fullsized":"2024-09-15T23:53:55.806928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:37.095883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798948+0000","last_change":"2024-09-15T23:53:50.775624+0000","last_active":"2024-09-15T23:53:55.798948+0000","last_peered":"2024-09-15T23:53:55.798948+0000","last_clean":"2024-09-15T23:53:55.798948+0000","last_became_active":"2024-09-15T23:53:50.775283+0000","last_became_peered":"2024-09-15T23:53:50.775283+0000","last_unstale":"2024-09-15T23:53:55.798948+0000","last_undegraded":"2024-09-15T23:53:55.798948+0000","last_fullsized":"2024-09-15T23:53:55.798948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:06.300941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799708+0000","last_change":"2024-09-15T23:53:49.723818+0000","last_active":"2024-09-15T23:53:55.799708+0000","last_peered":"2024-09-15T23:53:55.799708+0000","last_clean":"2024-09-15T23:53:55.799708+0000","last_became_active":"2024-09-15T23:53:49.720057+0000","last_became_peered":"2024-09-15T23:53:49.720057+0000","last_unstale":"2024-09-15T23:53:55.799708+0000","last_undegraded":"2024-09-15T23:53:55.799708+0000","last_fullsized":"2024-09-15T23:53:55.799708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:38.734641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807236+0000","last_change":"2024-09-15T23:53:54.846308+0000","last_active":"2024-09-15T23:53:55.807236+0000","last_peered":"2024-09-15T23:53:55.807236+0000","last_clean":"2024-09-15T23:53:55.807236+0000","last_became_active":"2024-09-15T23:53:54.844118+0000","last_became_peered":"2024-09-15T23:53:54.844118+0000","last_unstale":"2024-09-15T23:53:55.807236+0000","last_undegraded":"2024-09-15T23:53:55.807236+0000","last_fullsized":"2024-09-15T23:53:55.807236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:05.294652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804937+0000","last_change":"2024-09-15T23:53:50.760823+0000","last_active":"2024-09-15T23:53:55.804937+0000","last_peered":"2024-09-15T23:53:55.804937+0000","last_clean":"2024-09-15T23:53:55.804937+0000","last_became_active":"2024-09-15T23:53:50.760471+0000","last_became_peered":"2024-09-15T23:53:50.760471+0000","last_unstale":"2024-09-15T23:53:55.804937+0000","last_undegraded":"2024-09-15T23:53:55.804937+0000","last_fullsized":"2024-09-15T23:53:55.804937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:04.750808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336497+0000","last_change":"2024-09-15T23:53:49.719808+0000","last_active":"2024-09-15T23:53:56.336497+0000","last_peered":"2024-09-15T23:53:56.336497+0000","last_clean":"2024-09-15T23:53:56.336497+0000","last_became_active":"2024-09-15T23:53:49.719303+0000","last_became_peered":"2024-09-15T23:53:49.719303+0000","last_unstale":"2024-09-15T23:53:56.336497+0000","last_undegraded":"2024-09-15T23:53:56.336497+0000","last_fullsized":"2024-09-15T23:53:56.336497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:55.009643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800425+0000","last_change":"2024-09-15T23:53:54.807683+0000","last_active":"2024-09-15T23:53:55.800425+0000","last_peered":"2024-09-15T23:53:55.800425+0000","last_clean":"2024-09-15T23:53:55.800425+0000","last_became_active":"2024-09-15T23:53:54.807273+0000","last_became_peered":"2024-09-15T23:53:54.807273+0000","last_unstale":"2024-09-15T23:53:55.800425+0000","last_undegraded":"2024-09-15T23:53:55.800425+0000","last_fullsized":"2024-09-15T23:53:55.800425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:29.903334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334249+0000","last_change":"2024-09-15T23:53:50.778913+0000","last_active":"2024-09-15T23:53:56.334249+0000","last_peered":"2024-09-15T23:53:56.334249+0000","last_clean":"2024-09-15T23:53:56.334249+0000","last_became_active":"2024-09-15T23:53:50.775954+0000","last_became_peered":"2024-09-15T23:53:50.775954+0000","last_unstale":"2024-09-15T23:53:56.334249+0000","last_undegraded":"2024-09-15T23:53:56.334249+0000","last_fullsized":"2024-09-15T23:53:56.334249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:51.577438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:54:01.347228+0000","last_change":"2024-09-15T23:53:49.720597+0000","last_active":"2024-09-15T23:54:01.347228+0000","last_peered":"2024-09-15T23:54:01.347228+0000","last_clean":"2024-09-15T23:54:01.347228+0000","last_became_active":"2024-09-15T23:53:49.717557+0000","last_became_peered":"2024-09-15T23:53:49.717557+0000","last_unstale":"2024-09-15T23:54:01.347228+0000","last_undegraded":"2024-09-15T23:54:01.347228+0000","last_fullsized":"2024-09-15T23:54:01.347228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:05.442964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334641+0000","last_change":"2024-09-15T23:53:54.826160+0000","last_active":"2024-09-15T23:53:56.334641+0000","last_peered":"2024-09-15T23:53:56.334641+0000","last_clean":"2024-09-15T23:53:56.334641+0000","last_became_active":"2024-09-15T23:53:54.824735+0000","last_became_peered":"2024-09-15T23:53:54.824735+0000","last_unstale":"2024-09-15T23:53:56.334641+0000","last_undegraded":"2024-09-15T23:53:56.334641+0000","last_fullsized":"2024-09-15T23:53:56.334641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:05.294652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799239+0000","last_change":"2024-09-15T23:53:50.760066+0000","last_active":"2024-09-15T23:53:55.799239+0000","last_peered":"2024-09-15T23:53:55.799239+0000","last_clean":"2024-09-15T23:53:55.799239+0000","last_became_active":"2024-09-15T23:53:50.759702+0000","last_became_peered":"2024-09-15T23:53:50.759702+0000","last_unstale":"2024-09-15T23:53:55.799239+0000","last_undegraded":"2024-09-15T23:53:55.799239+0000","last_fullsized":"2024-09-15T23:53:55.799239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:11.697485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335921+0000","last_change":"2024-09-15T23:53:49.718600+0000","last_active":"2024-09-15T23:53:56.335921+0000","last_peered":"2024-09-15T23:53:56.335921+0000","last_clean":"2024-09-15T23:53:56.335921+0000","last_became_active":"2024-09-15T23:53:49.718133+0000","last_became_peered":"2024-09-15T23:53:49.718133+0000","last_unstale":"2024-09-15T23:53:56.335921+0000","last_undegraded":"2024-09-15T23:53:56.335921+0000","last_fullsized":"2024-09-15T23:53:56.335921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:56.727393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334929+0000","last_change":"2024-09-15T23:53:54.831611+0000","last_active":"2024-09-15T23:53:56.334929+0000","last_peered":"2024-09-15T23:53:56.334929+0000","last_clean":"2024-09-15T23:53:56.334929+0000","last_became_active":"2024-09-15T23:53:54.830621+0000","last_became_peered":"2024-09-15T23:53:54.830621+0000","last_unstale":"2024-09-15T23:53:56.334929+0000","last_undegraded":"2024-09-15T23:53:56.334929+0000","last_fullsized":"2024-09-15T23:53:56.334929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:25.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807274+0000","last_change":"2024-09-15T23:53:50.766881+0000","last_active":"2024-09-15T23:53:55.807274+0000","last_peered":"2024-09-15T23:53:55.807274+0000","last_clean":"2024-09-15T23:53:55.807274+0000","last_became_active":"2024-09-15T23:53:50.766527+0000","last_became_peered":"2024-09-15T23:53:50.766527+0000","last_unstale":"2024-09-15T23:53:55.807274+0000","last_undegraded":"2024-09-15T23:53:55.807274+0000","last_fullsized":"2024-09-15T23:53:55.807274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:15.908762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334496+0000","last_change":"2024-09-15T23:53:49.704002+0000","last_active":"2024-09-15T23:53:56.334496+0000","last_peered":"2024-09-15T23:53:56.334496+0000","last_clean":"2024-09-15T23:53:56.334496+0000","last_became_active":"2024-09-15T23:53:49.703760+0000","last_became_peered":"2024-09-15T23:53:49.703760+0000","last_unstale":"2024-09-15T23:53:56.334496+0000","last_undegraded":"2024-09-15T23:53:56.334496+0000","last_fullsized":"2024-09-15T23:53:56.334496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:54.905896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334638+0000","last_change":"2024-09-15T23:53:54.835532+0000","last_active":"2024-09-15T23:53:56.334638+0000","last_peered":"2024-09-15T23:53:56.334638+0000","last_clean":"2024-09-15T23:53:56.334638+0000","last_became_active":"2024-09-15T23:53:54.834666+0000","last_became_peered":"2024-09-15T23:53:54.834666+0000","last_unstale":"2024-09-15T23:53:56.334638+0000","last_undegraded":"2024-09-15T23:53:56.334638+0000","last_fullsized":"2024-09-15T23:53:56.334638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:08.834413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333009+0000","last_change":"2024-09-15T23:53:50.768163+0000","last_active":"2024-09-15T23:53:56.333009+0000","last_peered":"2024-09-15T23:53:56.333009+0000","last_clean":"2024-09-15T23:53:56.333009+0000","last_became_active":"2024-09-15T23:53:50.763914+0000","last_became_peered":"2024-09-15T23:53:50.763914+0000","last_unstale":"2024-09-15T23:53:56.333009+0000","last_undegraded":"2024-09-15T23:53:56.333009+0000","last_fullsized":"2024-09-15T23:53:56.333009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:48.894933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332851+0000","last_change":"2024-09-15T23:53:49.720489+0000","last_active":"2024-09-15T23:53:56.332851+0000","last_peered":"2024-09-15T23:53:56.332851+0000","last_clean":"2024-09-15T23:53:56.332851+0000","last_became_active":"2024-09-15T23:53:49.719882+0000","last_became_peered":"2024-09-15T23:53:49.719882+0000","last_unstale":"2024-09-15T23:53:56.332851+0000","last_undegraded":"2024-09-15T23:53:56.332851+0000","last_fullsized":"2024-09-15T23:53:56.332851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:42.225697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335364+0000","last_change":"2024-09-15T23:53:54.834453+0000","last_active":"2024-09-15T23:53:56.335364+0000","last_peered":"2024-09-15T23:53:56.335364+0000","last_clean":"2024-09-15T23:53:56.335364+0000","last_became_active":"2024-09-15T23:53:54.832355+0000","last_became_peered":"2024-09-15T23:53:54.832355+0000","last_unstale":"2024-09-15T23:53:56.335364+0000","last_undegraded":"2024-09-15T23:53:56.335364+0000","last_fullsized":"2024-09-15T23:53:56.335364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:25.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336774+0000","last_change":"2024-09-15T23:53:54.823569+0000","last_active":"2024-09-15T23:53:56.336774+0000","last_peered":"2024-09-15T23:53:56.336774+0000","last_clean":"2024-09-15T23:53:56.336774+0000","last_became_active":"2024-09-15T23:53:54.822582+0000","last_became_peered":"2024-09-15T23:53:54.822582+0000","last_unstale":"2024-09-15T23:53:56.336774+0000","last_undegraded":"2024-09-15T23:53:56.336774+0000","last_fullsized":"2024-09-15T23:53:56.336774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:40.544116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335644+0000","last_change":"2024-09-15T23:53:50.754235+0000","last_active":"2024-09-15T23:53:56.335644+0000","last_peered":"2024-09-15T23:53:56.335644+0000","last_clean":"2024-09-15T23:53:56.335644+0000","last_became_active":"2024-09-15T23:53:50.753479+0000","last_became_peered":"2024-09-15T23:53:50.753479+0000","last_unstale":"2024-09-15T23:53:56.335644+0000","last_undegraded":"2024-09-15T23:53:56.335644+0000","last_fullsized":"2024-09-15T23:53:56.335644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:11.710571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799070+0000","last_change":"2024-09-15T23:53:49.704444+0000","last_active":"2024-09-15T23:53:55.799070+0000","last_peered":"2024-09-15T23:53:55.799070+0000","last_clean":"2024-09-15T23:53:55.799070+0000","last_became_active":"2024-09-15T23:53:49.703888+0000","last_became_peered":"2024-09-15T23:53:49.703888+0000","last_unstale":"2024-09-15T23:53:55.799070+0000","last_undegraded":"2024-09-15T23:53:55.799070+0000","last_fullsized":"2024-09-15T23:53:55.799070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:17.063782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800734+0000","last_change":"2024-09-15T23:53:54.808928+0000","last_active":"2024-09-15T23:53:55.800734+0000","last_peered":"2024-09-15T23:53:55.800734+0000","last_clean":"2024-09-15T23:53:55.800734+0000","last_became_active":"2024-09-15T23:53:54.808284+0000","last_became_peered":"2024-09-15T23:53:54.808284+0000","last_unstale":"2024-09-15T23:53:55.800734+0000","last_undegraded":"2024-09-15T23:53:55.800734+0000","last_fullsized":"2024-09-15T23:53:55.800734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:33.254304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803508+0000","last_change":"2024-09-15T23:53:50.771765+0000","last_active":"2024-09-15T23:53:55.803508+0000","last_peered":"2024-09-15T23:53:55.803508+0000","last_clean":"2024-09-15T23:53:55.803508+0000","last_became_active":"2024-09-15T23:53:50.770972+0000","last_became_peered":"2024-09-15T23:53:50.770972+0000","last_unstale":"2024-09-15T23:53:55.803508+0000","last_undegraded":"2024-09-15T23:53:55.803508+0000","last_fullsized":"2024-09-15T23:53:55.803508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:30.225858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804471+0000","last_change":"2024-09-15T23:53:49.703341+0000","last_active":"2024-09-15T23:53:55.804471+0000","last_peered":"2024-09-15T23:53:55.804471+0000","last_clean":"2024-09-15T23:53:55.804471+0000","last_became_active":"2024-09-15T23:53:49.702534+0000","last_became_peered":"2024-09-15T23:53:49.702534+0000","last_unstale":"2024-09-15T23:53:55.804471+0000","last_undegraded":"2024-09-15T23:53:55.804471+0000","last_fullsized":"2024-09-15T23:53:55.804471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:25:03.906556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799514+0000","last_change":"2024-09-15T23:53:49.724099+0000","last_active":"2024-09-15T23:53:55.799514+0000","last_peered":"2024-09-15T23:53:55.799514+0000","last_clean":"2024-09-15T23:53:55.799514+0000","last_became_active":"2024-09-15T23:53:49.720382+0000","last_became_peered":"2024-09-15T23:53:49.720382+0000","last_unstale":"2024-09-15T23:53:55.799514+0000","last_undegraded":"2024-09-15T23:53:55.799514+0000","last_fullsized":"2024-09-15T23:53:55.799514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:12.046572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335126+0000","last_change":"2024-09-15T23:53:50.772483+0000","last_active":"2024-09-15T23:53:56.335126+0000","last_peered":"2024-09-15T23:53:56.335126+0000","last_clean":"2024-09-15T23:53:56.335126+0000","last_became_active":"2024-09-15T23:53:50.772100+0000","last_became_peered":"2024-09-15T23:53:50.772100+0000","last_unstale":"2024-09-15T23:53:56.335126+0000","last_undegraded":"2024-09-15T23:53:56.335126+0000","last_fullsized":"2024-09-15T23:53:56.335126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:40.820870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.336438+0000","last_change":"2024-09-15T23:53:54.834012+0000","last_active":"2024-09-15T23:53:56.336438+0000","last_peered":"2024-09-15T23:53:56.336438+0000","last_clean":"2024-09-15T23:53:56.336438+0000","last_became_active":"2024-09-15T23:53:54.832650+0000","last_became_peered":"2024-09-15T23:53:54.832650+0000","last_unstale":"2024-09-15T23:53:56.336438+0000","last_undegraded":"2024-09-15T23:53:56.336438+0000","last_fullsized":"2024-09-15T23:53:56.336438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:58.849309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804269+0000","last_change":"2024-09-15T23:53:49.727498+0000","last_active":"2024-09-15T23:53:55.804269+0000","last_peered":"2024-09-15T23:53:55.804269+0000","last_clean":"2024-09-15T23:53:55.804269+0000","last_became_active":"2024-09-15T23:53:49.723077+0000","last_became_peered":"2024-09-15T23:53:49.723077+0000","last_unstale":"2024-09-15T23:53:55.804269+0000","last_undegraded":"2024-09-15T23:53:55.804269+0000","last_fullsized":"2024-09-15T23:53:55.804269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:48.671040+0000","last_clean_scrub_stamp":"2024-09-15T23:53:48.671040+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:57.542130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332154+0000","last_change":"2024-09-15T23:53:50.761608+0000","last_active":"2024-09-15T23:53:56.332154+0000","last_peered":"2024-09-15T23:53:56.332154+0000","last_clean":"2024-09-15T23:53:56.332154+0000","last_became_active":"2024-09-15T23:53:50.758363+0000","last_became_peered":"2024-09-15T23:53:50.758363+0000","last_unstale":"2024-09-15T23:53:56.332154+0000","last_undegraded":"2024-09-15T23:53:56.332154+0000","last_fullsized":"2024-09-15T23:53:56.332154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335657+0000","last_change":"2024-09-15T23:53:54.841381+0000","last_active":"2024-09-15T23:53:56.335657+0000","last_peered":"2024-09-15T23:53:56.335657+0000","last_clean":"2024-09-15T23:53:56.335657+0000","last_became_active":"2024-09-15T23:53:54.840352+0000","last_became_peered":"2024-09-15T23:53:54.840352+0000","last_unstale":"2024-09-15T23:53:56.335657+0000","last_undegraded":"2024-09-15T23:53:56.335657+0000","last_fullsized":"2024-09-15T23:53:56.335657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:53.764669+0000","last_clean_scrub_stamp":"2024-09-15T23:53:53.764669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:44.904475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332559+0000","last_change":"2024-09-15T23:53:50.768904+0000","last_active":"2024-09-15T23:53:56.332559+0000","last_peered":"2024-09-15T23:53:56.332559+0000","last_clean":"2024-09-15T23:53:56.332559+0000","last_became_active":"2024-09-15T23:53:50.768253+0000","last_became_peered":"2024-09-15T23:53:50.768253+0000","last_unstale":"2024-09-15T23:53:56.332559+0000","last_undegraded":"2024-09-15T23:53:56.332559+0000","last_fullsized":"2024-09-15T23:53:56.332559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:41.573063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335133+0000","last_change":"2024-09-15T23:53:50.776288+0000","last_active":"2024-09-15T23:53:56.335133+0000","last_peered":"2024-09-15T23:53:56.335133+0000","last_clean":"2024-09-15T23:53:56.335133+0000","last_became_active":"2024-09-15T23:53:50.775954+0000","last_became_peered":"2024-09-15T23:53:50.775954+0000","last_unstale":"2024-09-15T23:53:56.335133+0000","last_undegraded":"2024-09-15T23:53:56.335133+0000","last_fullsized":"2024-09-15T23:53:56.335133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.385437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798721+0000","last_change":"2024-09-15T23:53:50.766724+0000","last_active":"2024-09-15T23:53:55.798721+0000","last_peered":"2024-09-15T23:53:55.798721+0000","last_clean":"2024-09-15T23:53:55.798721+0000","last_became_active":"2024-09-15T23:53:50.766294+0000","last_became_peered":"2024-09-15T23:53:50.766294+0000","last_unstale":"2024-09-15T23:53:55.798721+0000","last_undegraded":"2024-09-15T23:53:55.798721+0000","last_fullsized":"2024-09-15T23:53:55.798721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:30.859886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804025+0000","last_change":"2024-09-15T23:53:50.762881+0000","last_active":"2024-09-15T23:53:55.804025+0000","last_peered":"2024-09-15T23:53:55.804025+0000","last_clean":"2024-09-15T23:53:55.804025+0000","last_became_active":"2024-09-15T23:53:50.762510+0000","last_became_peered":"2024-09-15T23:53:50.762510+0000","last_unstale":"2024-09-15T23:53:55.804025+0000","last_undegraded":"2024-09-15T23:53:55.804025+0000","last_fullsized":"2024-09-15T23:53:55.804025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.236567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.807695+0000","last_change":"2024-09-15T23:53:50.778010+0000","last_active":"2024-09-15T23:53:55.807695+0000","last_peered":"2024-09-15T23:53:55.807695+0000","last_clean":"2024-09-15T23:53:55.807695+0000","last_became_active":"2024-09-15T23:53:50.777507+0000","last_became_peered":"2024-09-15T23:53:50.777507+0000","last_unstale":"2024-09-15T23:53:55.807695+0000","last_undegraded":"2024-09-15T23:53:55.807695+0000","last_fullsized":"2024-09-15T23:53:55.807695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:35:59.496952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805694+0000","last_change":"2024-09-15T23:53:50.758259+0000","last_active":"2024-09-15T23:53:55.805694+0000","last_peered":"2024-09-15T23:53:55.805694+0000","last_clean":"2024-09-15T23:53:55.805694+0000","last_became_active":"2024-09-15T23:53:50.757961+0000","last_became_peered":"2024-09-15T23:53:50.757961+0000","last_unstale":"2024-09-15T23:53:55.805694+0000","last_undegraded":"2024-09-15T23:53:55.805694+0000","last_fullsized":"2024-09-15T23:53:55.805694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:40.820870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332924+0000","last_change":"2024-09-15T23:53:50.767102+0000","last_active":"2024-09-15T23:53:56.332924+0000","last_peered":"2024-09-15T23:53:56.332924+0000","last_clean":"2024-09-15T23:53:56.332924+0000","last_became_active":"2024-09-15T23:53:50.762579+0000","last_became_peered":"2024-09-15T23:53:50.762579+0000","last_unstale":"2024-09-15T23:53:56.332924+0000","last_undegraded":"2024-09-15T23:53:56.332924+0000","last_fullsized":"2024-09-15T23:53:56.332924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:10.630689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806419+0000","last_change":"2024-09-15T23:53:50.778971+0000","last_active":"2024-09-15T23:53:55.806419+0000","last_peered":"2024-09-15T23:53:55.806419+0000","last_clean":"2024-09-15T23:53:55.806419+0000","last_became_active":"2024-09-15T23:53:50.778504+0000","last_became_peered":"2024-09-15T23:53:50.778504+0000","last_unstale":"2024-09-15T23:53:55.806419+0000","last_undegraded":"2024-09-15T23:53:55.806419+0000","last_fullsized":"2024-09-15T23:53:55.806419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:13.705388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.799032+0000","last_change":"2024-09-15T23:53:50.766048+0000","last_active":"2024-09-15T23:53:55.799032+0000","last_peered":"2024-09-15T23:53:55.799032+0000","last_clean":"2024-09-15T23:53:55.799032+0000","last_became_active":"2024-09-15T23:53:50.765747+0000","last_became_peered":"2024-09-15T23:53:50.765747+0000","last_unstale":"2024-09-15T23:53:55.799032+0000","last_undegraded":"2024-09-15T23:53:55.799032+0000","last_fullsized":"2024-09-15T23:53:55.799032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:50.800418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804413+0000","last_change":"2024-09-15T23:53:50.762427+0000","last_active":"2024-09-15T23:53:55.804413+0000","last_peered":"2024-09-15T23:53:55.804413+0000","last_clean":"2024-09-15T23:53:55.804413+0000","last_became_active":"2024-09-15T23:53:50.762044+0000","last_became_peered":"2024-09-15T23:53:50.762044+0000","last_unstale":"2024-09-15T23:53:55.804413+0000","last_undegraded":"2024-09-15T23:53:55.804413+0000","last_fullsized":"2024-09-15T23:53:55.804413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:44.344017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332051+0000","last_change":"2024-09-15T23:53:50.761423+0000","last_active":"2024-09-15T23:53:56.332051+0000","last_peered":"2024-09-15T23:53:56.332051+0000","last_clean":"2024-09-15T23:53:56.332051+0000","last_became_active":"2024-09-15T23:53:50.759524+0000","last_became_peered":"2024-09-15T23:53:50.759524+0000","last_unstale":"2024-09-15T23:53:56.332051+0000","last_undegraded":"2024-09-15T23:53:56.332051+0000","last_fullsized":"2024-09-15T23:53:56.332051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.385437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334830+0000","last_change":"2024-09-15T23:53:50.757892+0000","last_active":"2024-09-15T23:53:56.334830+0000","last_peered":"2024-09-15T23:53:56.334830+0000","last_clean":"2024-09-15T23:53:56.334830+0000","last_became_active":"2024-09-15T23:53:50.757123+0000","last_became_peered":"2024-09-15T23:53:50.757123+0000","last_unstale":"2024-09-15T23:53:56.334830+0000","last_undegraded":"2024-09-15T23:53:56.334830+0000","last_fullsized":"2024-09-15T23:53:56.334830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:15.892900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333812+0000","last_change":"2024-09-15T23:53:50.775664+0000","last_active":"2024-09-15T23:53:56.333812+0000","last_peered":"2024-09-15T23:53:56.333812+0000","last_clean":"2024-09-15T23:53:56.333812+0000","last_became_active":"2024-09-15T23:53:50.774398+0000","last_became_peered":"2024-09-15T23:53:50.774398+0000","last_unstale":"2024-09-15T23:53:56.333812+0000","last_undegraded":"2024-09-15T23:53:56.333812+0000","last_fullsized":"2024-09-15T23:53:56.333812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:01.211047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.800852+0000","last_change":"2024-09-15T23:53:50.764281+0000","last_active":"2024-09-15T23:53:55.800852+0000","last_peered":"2024-09-15T23:53:55.800852+0000","last_clean":"2024-09-15T23:53:55.800852+0000","last_became_active":"2024-09-15T23:53:50.763712+0000","last_became_peered":"2024-09-15T23:53:50.763712+0000","last_unstale":"2024-09-15T23:53:55.800852+0000","last_undegraded":"2024-09-15T23:53:55.800852+0000","last_fullsized":"2024-09-15T23:53:55.800852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:27.740625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.335860+0000","last_change":"2024-09-15T23:53:50.781321+0000","last_active":"2024-09-15T23:53:56.335860+0000","last_peered":"2024-09-15T23:53:56.335860+0000","last_clean":"2024-09-15T23:53:56.335860+0000","last_became_active":"2024-09-15T23:53:50.781022+0000","last_became_peered":"2024-09-15T23:53:50.781022+0000","last_unstale":"2024-09-15T23:53:56.335860+0000","last_undegraded":"2024-09-15T23:53:56.335860+0000","last_fullsized":"2024-09-15T23:53:56.335860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:10.630689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.801378+0000","last_change":"2024-09-15T23:53:50.773196+0000","last_active":"2024-09-15T23:53:55.801378+0000","last_peered":"2024-09-15T23:53:55.801378+0000","last_clean":"2024-09-15T23:53:55.801378+0000","last_became_active":"2024-09-15T23:53:50.772856+0000","last_became_peered":"2024-09-15T23:53:50.772856+0000","last_unstale":"2024-09-15T23:53:55.801378+0000","last_undegraded":"2024-09-15T23:53:55.801378+0000","last_fullsized":"2024-09-15T23:53:55.801378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:38.917747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.798743+0000","last_change":"2024-09-15T23:53:50.770117+0000","last_active":"2024-09-15T23:53:55.798743+0000","last_peered":"2024-09-15T23:53:55.798743+0000","last_clean":"2024-09-15T23:53:55.798743+0000","last_became_active":"2024-09-15T23:53:50.769815+0000","last_became_peered":"2024-09-15T23:53:50.769815+0000","last_unstale":"2024-09-15T23:53:55.798743+0000","last_undegraded":"2024-09-15T23:53:55.798743+0000","last_fullsized":"2024-09-15T23:53:55.798743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:00.830681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804043+0000","last_change":"2024-09-15T23:53:50.776872+0000","last_active":"2024-09-15T23:53:55.804043+0000","last_peered":"2024-09-15T23:53:55.804043+0000","last_clean":"2024-09-15T23:53:55.804043+0000","last_became_active":"2024-09-15T23:53:50.776366+0000","last_became_peered":"2024-09-15T23:53:50.776366+0000","last_unstale":"2024-09-15T23:53:55.804043+0000","last_undegraded":"2024-09-15T23:53:55.804043+0000","last_fullsized":"2024-09-15T23:53:55.804043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:52.879737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.804858+0000","last_change":"2024-09-15T23:53:50.762729+0000","last_active":"2024-09-15T23:53:55.804858+0000","last_peered":"2024-09-15T23:53:55.804858+0000","last_clean":"2024-09-15T23:53:55.804858+0000","last_became_active":"2024-09-15T23:53:50.762361+0000","last_became_peered":"2024-09-15T23:53:50.762361+0000","last_unstale":"2024-09-15T23:53:55.804858+0000","last_undegraded":"2024-09-15T23:53:55.804858+0000","last_fullsized":"2024-09-15T23:53:55.804858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:41.573063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.806250+0000","last_change":"2024-09-15T23:53:50.768317+0000","last_active":"2024-09-15T23:53:55.806250+0000","last_peered":"2024-09-15T23:53:55.806250+0000","last_clean":"2024-09-15T23:53:55.806250+0000","last_became_active":"2024-09-15T23:53:50.767995+0000","last_became_peered":"2024-09-15T23:53:50.767995+0000","last_unstale":"2024-09-15T23:53:55.806250+0000","last_undegraded":"2024-09-15T23:53:55.806250+0000","last_fullsized":"2024-09-15T23:53:55.806250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:05.877077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333768+0000","last_change":"2024-09-15T23:53:50.776156+0000","last_active":"2024-09-15T23:53:56.333768+0000","last_peered":"2024-09-15T23:53:56.333768+0000","last_clean":"2024-09-15T23:53:56.333768+0000","last_became_active":"2024-09-15T23:53:50.775104+0000","last_became_peered":"2024-09-15T23:53:50.775104+0000","last_unstale":"2024-09-15T23:53:56.333768+0000","last_undegraded":"2024-09-15T23:53:56.333768+0000","last_fullsized":"2024-09-15T23:53:56.333768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:49.338954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334206+0000","last_change":"2024-09-15T23:53:50.773302+0000","last_active":"2024-09-15T23:53:56.334206+0000","last_peered":"2024-09-15T23:53:56.334206+0000","last_clean":"2024-09-15T23:53:56.334206+0000","last_became_active":"2024-09-15T23:53:50.772762+0000","last_became_peered":"2024-09-15T23:53:50.772762+0000","last_unstale":"2024-09-15T23:53:56.334206+0000","last_undegraded":"2024-09-15T23:53:56.334206+0000","last_fullsized":"2024-09-15T23:53:56.334206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:03.053120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.334419+0000","last_change":"2024-09-15T23:53:50.766371+0000","last_active":"2024-09-15T23:53:56.334419+0000","last_peered":"2024-09-15T23:53:56.334419+0000","last_clean":"2024-09-15T23:53:56.334419+0000","last_became_active":"2024-09-15T23:53:50.766003+0000","last_became_peered":"2024-09-15T23:53:50.766003+0000","last_unstale":"2024-09-15T23:53:56.334419+0000","last_undegraded":"2024-09-15T23:53:56.334419+0000","last_fullsized":"2024-09-15T23:53:56.334419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:57.559108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332748+0000","last_change":"2024-09-15T23:53:50.772968+0000","last_active":"2024-09-15T23:53:56.332748+0000","last_peered":"2024-09-15T23:53:56.332748+0000","last_clean":"2024-09-15T23:53:56.332748+0000","last_became_active":"2024-09-15T23:53:50.771984+0000","last_became_peered":"2024-09-15T23:53:50.771984+0000","last_unstale":"2024-09-15T23:53:56.332748+0000","last_undegraded":"2024-09-15T23:53:56.332748+0000","last_fullsized":"2024-09-15T23:53:56.332748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:48.894933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.803087+0000","last_change":"2024-09-15T23:53:50.775398+0000","last_active":"2024-09-15T23:53:55.803087+0000","last_peered":"2024-09-15T23:53:55.803087+0000","last_clean":"2024-09-15T23:53:55.803087+0000","last_became_active":"2024-09-15T23:53:50.775094+0000","last_became_peered":"2024-09-15T23:53:50.775094+0000","last_unstale":"2024-09-15T23:53:55.803087+0000","last_undegraded":"2024-09-15T23:53:55.803087+0000","last_fullsized":"2024-09-15T23:53:55.803087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:29.418106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333184+0000","last_change":"2024-09-15T23:53:50.760721+0000","last_active":"2024-09-15T23:53:56.333184+0000","last_peered":"2024-09-15T23:53:56.333184+0000","last_clean":"2024-09-15T23:53:56.333184+0000","last_became_active":"2024-09-15T23:53:50.760251+0000","last_became_peered":"2024-09-15T23:53:50.760251+0000","last_unstale":"2024-09-15T23:53:56.333184+0000","last_undegraded":"2024-09-15T23:53:56.333184+0000","last_fullsized":"2024-09-15T23:53:56.333184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:30.884230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.331847+0000","last_change":"2024-09-15T23:53:50.760673+0000","last_active":"2024-09-15T23:53:56.331847+0000","last_peered":"2024-09-15T23:53:56.331847+0000","last_clean":"2024-09-15T23:53:56.331847+0000","last_became_active":"2024-09-15T23:53:50.760164+0000","last_became_peered":"2024-09-15T23:53:50.760164+0000","last_unstale":"2024-09-15T23:53:56.331847+0000","last_undegraded":"2024-09-15T23:53:56.331847+0000","last_fullsized":"2024-09-15T23:53:56.331847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.385437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333521+0000","last_change":"2024-09-15T23:53:50.766752+0000","last_active":"2024-09-15T23:53:56.333521+0000","last_peered":"2024-09-15T23:53:56.333521+0000","last_clean":"2024-09-15T23:53:56.333521+0000","last_became_active":"2024-09-15T23:53:50.766370+0000","last_became_peered":"2024-09-15T23:53:50.766370+0000","last_unstale":"2024-09-15T23:53:56.333521+0000","last_undegraded":"2024-09-15T23:53:56.333521+0000","last_fullsized":"2024-09-15T23:53:56.333521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:21.225015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.332124+0000","last_change":"2024-09-15T23:53:50.778292+0000","last_active":"2024-09-15T23:53:56.332124+0000","last_peered":"2024-09-15T23:53:56.332124+0000","last_clean":"2024-09-15T23:53:56.332124+0000","last_became_active":"2024-09-15T23:53:50.777039+0000","last_became_peered":"2024-09-15T23:53:50.777039+0000","last_unstale":"2024-09-15T23:53:56.332124+0000","last_undegraded":"2024-09-15T23:53:56.332124+0000","last_fullsized":"2024-09-15T23:53:56.332124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.326297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805410+0000","last_change":"2024-09-15T23:53:50.771054+0000","last_active":"2024-09-15T23:53:55.805410+0000","last_peered":"2024-09-15T23:53:55.805410+0000","last_clean":"2024-09-15T23:53:55.805410+0000","last_became_active":"2024-09-15T23:53:50.770590+0000","last_became_peered":"2024-09-15T23:53:50.770590+0000","last_unstale":"2024-09-15T23:53:55.805410+0000","last_undegraded":"2024-09-15T23:53:55.805410+0000","last_fullsized":"2024-09-15T23:53:55.805410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:49.569731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:55.805743+0000","last_change":"2024-09-15T23:53:50.769203+0000","last_active":"2024-09-15T23:53:55.805743+0000","last_peered":"2024-09-15T23:53:55.805743+0000","last_clean":"2024-09-15T23:53:55.805743+0000","last_became_active":"2024-09-15T23:53:50.768887+0000","last_became_peered":"2024-09-15T23:53:50.768887+0000","last_unstale":"2024-09-15T23:53:55.805743+0000","last_undegraded":"2024-09-15T23:53:55.805743+0000","last_fullsized":"2024-09-15T23:53:55.805743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:19.928453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T23:53:56.333350+0000","last_change":"2024-09-15T23:53:50.766909+0000","last_active":"2024-09-15T23:53:56.333350+0000","last_peered":"2024-09-15T23:53:56.333350+0000","last_clean":"2024-09-15T23:53:56.333350+0000","last_became_active":"2024-09-15T23:53:50.766411+0000","last_became_peered":"2024-09-15T23:53:50.766411+0000","last_unstale":"2024-09-15T23:53:56.333350+0000","last_undegraded":"2024-09-15T23:53:56.333350+0000","last_fullsized":"2024-09-15T23:53:56.333350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:49.681064+0000","last_clean_scrub_stamp":"2024-09-15T23:53:49.681064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:14.331012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":106766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":111282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":107348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":110610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":868352,"data_stored":697204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":697226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:54:08.373 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:54:08.373 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T23:54:08.373 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-15T23:54:08.373 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T23:54:08.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.521+0000 7fa65124d640 1 Processor -- start 2024-09-15T23:54:08.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.521+0000 7fa65124d640 1 -- start start 2024-09-15T23:54:08.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa65124d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa64c0d3060 0x7fa64c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa65124d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa64c0cf450 0x7fa64c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa65124d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa64c0d0300 con 0x7fa64c161a60 2024-09-15T23:54:08.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa65124d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa64c0b0f60 con 0x7fa64c0d3060 2024-09-15T23:54:08.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa65124d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa64c0cfd40 con 0x7fa64c0cf450 2024-09-15T23:54:08.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64ad9d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa64c161a60 0x7fa64c0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36180/0 (socket says 172.21.15.112:36180) 2024-09-15T23:54:08.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64ad9d640 1 -- 172.21.15.112:0/2744677592 learned_addr learned my addr 172.21.15.112:0/2744677592 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:08.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64b59e640 1 --2- 172.21.15.112:0/2744677592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa64c0cf450 0x7fa64c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64a59c640 1 --2- 172.21.15.112:0/2744677592 >> v2:172.21.15.169:3300/0 conn(0x7fa64c0d3060 0x7fa64c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 -- 172.21.15.112:0/2744677592 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2272590486 0 0) 0x7fa640001120 con 0x7fa64c161a60 2024-09-15T23:54:08.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 -- 172.21.15.112:0/2744677592 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa634003530 con 0x7fa64c161a60 2024-09-15T23:54:08.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 -- 172.21.15.112:0/2744677592 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2579106939 0 0) 0x7fa634003530 con 0x7fa64c161a60 2024-09-15T23:54:08.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 -- 172.21.15.112:0/2744677592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa64c0cf450 msgr2=0x7fa64c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:08.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 --2- 172.21.15.112:0/2744677592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa64c0cf450 0x7fa64c06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 -- 172.21.15.112:0/2744677592 >> v2:172.21.15.169:3300/0 conn(0x7fa64c0d3060 msgr2=0x7fa64c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:08.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 --2- 172.21.15.112:0/2744677592 >> v2:172.21.15.169:3300/0 conn(0x7fa64c0d3060 0x7fa64c0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 -- 172.21.15.112:0/2744677592 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa64c0d0020 con 0x7fa64c161a60 2024-09-15T23:54:08.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 -- 172.21.15.112:0/2744677592 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fa640001850 con 0x7fa64c161a60 2024-09-15T23:54:08.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 -- 172.21.15.112:0/2744677592 >> v1:172.21.15.112:6789/0 conn(0x7fa64c161a60 legacy=0x7fa64c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 --2- 172.21.15.112:0/2744677592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6340039c0 0x7fa634003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 --2- 172.21.15.112:0/2744677592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa64c0cf450 0x7fa634004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 --2- 172.21.15.112:0/2744677592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa634004d50 0x7fa6340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 -- 172.21.15.112:0/2744677592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa64c0b0f60 con 0x7fa6340039c0 2024-09-15T23:54:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 -- 172.21.15.112:0/2744677592 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa64c0cfd40 con 0x7fa634004d50 2024-09-15T23:54:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 -- 172.21.15.112:0/2744677592 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa63400bb30 con 0x7fa64c0cf450 2024-09-15T23:54:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64ad9d640 1 --2- 172.21.15.112:0/2744677592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6340039c0 0x7fa634003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64a59c640 1 --2- 172.21.15.112:0/2744677592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa64c0cf450 0x7fa634004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64ad9d640 1 -- 172.21.15.112:0/2744677592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa64c0cf450 msgr2=0x7fa634004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64b59e640 1 --2- 172.21.15.112:0/2744677592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa634004d50 0x7fa6340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64ad9d640 1 --2- 172.21.15.112:0/2744677592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa64c0cf450 0x7fa634004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64ad9d640 1 -- 172.21.15.112:0/2744677592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa634004d50 msgr2=0x7fa6340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64ad9d640 1 --2- 172.21.15.112:0/2744677592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa634004d50 0x7fa6340051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64ad9d640 1 -- 172.21.15.112:0/2744677592 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa634003530 con 0x7fa6340039c0 2024-09-15T23:54:08.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64b59e640 1 --2- 172.21.15.112:0/2744677592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa634004d50 0x7fa6340051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64ad9d640 1 --2- 172.21.15.112:0/2744677592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6340039c0 0x7fa634003de0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa64000c4c0 tx=0x7fa64001cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbf9d7252f7e85f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 -- 172.21.15.112:0/2744677592 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64000c0e0 con 0x7fa6340039c0 2024-09-15T23:54:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 -- 172.21.15.112:0/2744677592 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6400a9020 con 0x7fa6340039c0 2024-09-15T23:54:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa649d9b640 1 -- 172.21.15.112:0/2744677592 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6400a5970 con 0x7fa6340039c0 2024-09-15T23:54:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa65124d640 1 -- 172.21.15.112:0/2744677592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6340039c0 msgr2=0x7fa634003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa65124d640 1 --2- 172.21.15.112:0/2744677592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6340039c0 0x7fa634003de0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa64000c4c0 tx=0x7fa64001cc90 comp rx=0 tx=0).stop 2024-09-15T23:54:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa64b59e640 1 -- 172.21.15.112:0/2744677592 reap_dead start 2024-09-15T23:54:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa65124d640 1 -- 172.21.15.112:0/2744677592 shutdown_connections 2024-09-15T23:54:08.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.525+0000 7fa65124d640 1 -- 172.21.15.112:0/2744677592 >> 172.21.15.112:0/2744677592 conn(0x7fa64c08bf90 msgr2=0x7fa64c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa65124d640 1 -- 172.21.15.112:0/2744677592 shutdown_connections 2024-09-15T23:54:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa65124d640 1 -- 172.21.15.112:0/2744677592 wait complete. 2024-09-15T23:54:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa65124d640 1 Processor -- start 2024-09-15T23:54:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa65124d640 1 -- start start 2024-09-15T23:54:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa65124d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6340039c0 0x7fa64c150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa65124d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa64c0b9960 0x7fa64c0b9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa65124d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa64c160690 0x7fa64c160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa65124d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa64c06e250 con 0x7fa6340039c0 2024-09-15T23:54:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa65124d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa64c06e0d0 con 0x7fa64c160690 2024-09-15T23:54:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa65124d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa64c06e3d0 con 0x7fa64c0b9960 2024-09-15T23:54:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa64ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6340039c0 0x7fa64c150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa64ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6340039c0 0x7fa64c150bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58826/0 (socket says 172.21.15.112:58826) 2024-09-15T23:54:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa64ad9d640 1 -- 172.21.15.112:0/4204412184 learned_addr learned my addr 172.21.15.112:0/4204412184 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa64ad9d640 1 -- 172.21.15.112:0/4204412184 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa64c0b9960 msgr2=0x7fa64c0b9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa64ad9d640 1 --2- 172.21.15.112:0/4204412184 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa64c0b9960 0x7fa64c0b9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa64ad9d640 1 -- 172.21.15.112:0/4204412184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa64c160690 msgr2=0x7fa64c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa64ad9d640 1 --2- 172.21.15.112:0/4204412184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa64c160690 0x7fa64c160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa64ad9d640 1 -- 172.21.15.112:0/4204412184 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa64c151130 con 0x7fa6340039c0 2024-09-15T23:54:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa64ad9d640 1 --2- 172.21.15.112:0/4204412184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6340039c0 0x7fa64c150bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa64000c4c0 tx=0x7fa634005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa6337fe640 1 -- 172.21.15.112:0/4204412184 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6400a5970 con 0x7fa6340039c0 2024-09-15T23:54:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa6337fe640 1 -- 172.21.15.112:0/4204412184 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6400a5b10 con 0x7fa6340039c0 2024-09-15T23:54:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa65124d640 1 -- 172.21.15.112:0/4204412184 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa64c09e110 con 0x7fa6340039c0 2024-09-15T23:54:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa6337fe640 1 -- 172.21.15.112:0/4204412184 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6400047f0 con 0x7fa6340039c0 2024-09-15T23:54:08.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa65124d640 1 -- 172.21.15.112:0/4204412184 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa64c09e6d0 con 0x7fa6340039c0 2024-09-15T23:54:08.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.529+0000 7fa65124d640 1 -- 172.21.15.112:0/4204412184 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa64c06e670 con 0x7fa6340039c0 2024-09-15T23:54:08.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.533+0000 7fa6337fe640 1 -- 172.21.15.112:0/4204412184 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa640004990 con 0x7fa6340039c0 2024-09-15T23:54:08.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.533+0000 7fa6337fe640 1 --2- 172.21.15.112:0/4204412184 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6380678f0 0x7fa638069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.533+0000 7fa6337fe640 1 -- 172.21.15.112:0/4204412184 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa64011f210 con 0x7fa6340039c0 2024-09-15T23:54:08.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.533+0000 7fa64a59c640 1 --2- 172.21.15.112:0/4204412184 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6380678f0 0x7fa638069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.533+0000 7fa64a59c640 1 --2- 172.21.15.112:0/4204412184 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6380678f0 0x7fa638069db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa63c006aa0 tx=0x7fa63c006a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:08.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.537+0000 7fa6337fe640 1 -- 172.21.15.112:0/4204412184 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa6400b4070 con 0x7fa6340039c0 2024-09-15T23:54:08.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.717+0000 7fa65124d640 1 -- 172.21.15.112:0/4204412184 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa64c0b2520 con 0x7fa6340039c0 2024-09-15T23:54:08.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.721+0000 7fa6337fe640 1 -- 172.21.15.112:0/4204412184 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa64c0d0300 con 0x7fa6340039c0 2024-09-15T23:54:08.722 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:08.723 INFO:teuthology.orchestra.run.smithi112.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T23:54:08.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.721+0000 7fa65124d640 1 -- 172.21.15.112:0/4204412184 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6380678f0 msgr2=0x7fa638069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.721+0000 7fa65124d640 1 --2- 172.21.15.112:0/4204412184 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6380678f0 0x7fa638069db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa63c006aa0 tx=0x7fa63c006a30 comp rx=0 tx=0).stop 2024-09-15T23:54:08.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.721+0000 7fa65124d640 1 -- 172.21.15.112:0/4204412184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6340039c0 msgr2=0x7fa64c150bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.721+0000 7fa65124d640 1 --2- 172.21.15.112:0/4204412184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6340039c0 0x7fa64c150bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa64000c4c0 tx=0x7fa634005840 comp rx=0 tx=0).stop 2024-09-15T23:54:08.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.721+0000 7fa65124d640 1 -- 172.21.15.112:0/4204412184 shutdown_connections 2024-09-15T23:54:08.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.721+0000 7fa65124d640 1 --2- 172.21.15.112:0/4204412184 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6380678f0 0x7fa638069db0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.721+0000 7fa65124d640 1 --2- 172.21.15.112:0/4204412184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa64c160690 0x7fa64c160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.721+0000 7fa65124d640 1 --2- 172.21.15.112:0/4204412184 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa64c0b9960 0x7fa64c0b9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.721+0000 7fa65124d640 1 --2- 172.21.15.112:0/4204412184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6340039c0 0x7fa64c150bf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.721+0000 7fa65124d640 1 -- 172.21.15.112:0/4204412184 >> 172.21.15.112:0/4204412184 conn(0x7fa64c08bf90 msgr2=0x7fa64c0b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:08.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.721+0000 7fa65124d640 1 -- 172.21.15.112:0/4204412184 shutdown_connections 2024-09-15T23:54:08.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.721+0000 7fa65124d640 1 -- 172.21.15.112:0/4204412184 wait complete. 2024-09-15T23:54:08.740 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-15T23:54:08.740 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:54:08.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.849+0000 7f8aa21e7640 1 Processor -- start 2024-09-15T23:54:08.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.849+0000 7f8aa21e7640 1 -- start start 2024-09-15T23:54:08.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8aa21e7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8a9c06df70 0x7f8a9c1634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8aa21e7640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a9c06e470 con 0x7f8a9c1630c0 2024-09-15T23:54:08.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8aa21e7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a9c06e750 con 0x7f8a9c0b3290 2024-09-15T23:54:08.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8aa21e7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8a9c06fc20 con 0x7f8a9c06df70 2024-09-15T23:54:08.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9b7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8a9c1630c0 0x7f8a9c06f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36190/0 (socket says 172.21.15.112:36190) 2024-09-15T23:54:08.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9b7fe640 1 -- 172.21.15.112:0/2946393528 learned_addr learned my addr 172.21.15.112:0/2946393528 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:08.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 -- 172.21.15.112:0/2946393528 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352782952 0 0) 0x7f8a9c06e470 con 0x7f8a9c1630c0 2024-09-15T23:54:08.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 -- 172.21.15.112:0/2946393528 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a88003530 con 0x7f8a9c1630c0 2024-09-15T23:54:08.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 -- 172.21.15.112:0/2946393528 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4141970429 0 0) 0x7f8a88003530 con 0x7f8a9c1630c0 2024-09-15T23:54:08.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 -- 172.21.15.112:0/2946393528 >> v2:172.21.15.169:3300/0 conn(0x7f8a9c06df70 msgr2=0x7f8a9c1634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:08.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 --2- 172.21.15.112:0/2946393528 >> v2:172.21.15.169:3300/0 conn(0x7f8a9c06df70 0x7f8a9c1634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 -- 172.21.15.112:0/2946393528 >> v1:172.21.15.169:6789/0 conn(0x7f8a9c0b3290 legacy=0x7f8a9c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 -- 172.21.15.112:0/2946393528 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c06ea30 con 0x7f8a9c1630c0 2024-09-15T23:54:08.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 -- 172.21.15.112:0/2946393528 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f8a8c001680 con 0x7f8a9c1630c0 2024-09-15T23:54:08.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 -- 172.21.15.112:0/2946393528 >> v1:172.21.15.112:6789/0 conn(0x7f8a9c1630c0 legacy=0x7f8a9c06f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 --2- 172.21.15.112:0/2946393528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a880039c0 0x7f8a88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 --2- 172.21.15.112:0/2946393528 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a88004810 0x7f8a88004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 --2- 172.21.15.112:0/2946393528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a880052f0 0x7f8a8800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 -- 172.21.15.112:0/2946393528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c06fc20 con 0x7f8a880052f0 2024-09-15T23:54:08.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 -- 172.21.15.112:0/2946393528 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8800c1f0 con 0x7f8a880039c0 2024-09-15T23:54:08.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9affd640 1 -- 172.21.15.112:0/2946393528 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8a8800c3f0 con 0x7f8a88004810 2024-09-15T23:54:08.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9bfff640 1 --2- 172.21.15.112:0/2946393528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a880052f0 0x7f8a8800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9b7fe640 1 --2- 172.21.15.112:0/2946393528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a880039c0 0x7f8a88003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9bfff640 1 -- 172.21.15.112:0/2946393528 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a88004810 msgr2=0x7f8a88004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:08.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9bfff640 1 --2- 172.21.15.112:0/2946393528 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a88004810 0x7f8a88004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9bfff640 1 -- 172.21.15.112:0/2946393528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a880039c0 msgr2=0x7f8a88003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:08.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9bfff640 1 --2- 172.21.15.112:0/2946393528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a880039c0 0x7f8a88003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.853+0000 7f8a9bfff640 1 -- 172.21.15.112:0/2946393528 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a88003530 con 0x7f8a880052f0 2024-09-15T23:54:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9bfff640 1 -- 172.21.15.112:0/2946393528 reap_dead start 2024-09-15T23:54:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9bfff640 1 --2- 172.21.15.112:0/2946393528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a880052f0 0x7f8a8800b9d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8a94001e70 tx=0x7f8a9401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3864152185b975 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9affd640 1 -- 172.21.15.112:0/2946393528 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94001a90 con 0x7f8a880052f0 2024-09-15T23:54:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9affd640 1 -- 172.21.15.112:0/2946393528 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a94003bc0 con 0x7f8a880052f0 2024-09-15T23:54:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9affd640 1 -- 172.21.15.112:0/2946393528 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94005020 con 0x7f8a880052f0 2024-09-15T23:54:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2946393528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a880052f0 msgr2=0x7f8a8800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 --2- 172.21.15.112:0/2946393528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a880052f0 0x7f8a8800b9d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8a94001e70 tx=0x7f8a9401c780 comp rx=0 tx=0).stop 2024-09-15T23:54:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2946393528 shutdown_connections 2024-09-15T23:54:08.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 --2- 172.21.15.112:0/2946393528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a880052f0 0x7f8a8800b9d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2946393528 >> 172.21.15.112:0/2946393528 conn(0x7f8a9c0b1f90 msgr2=0x7f8a9c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:08.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2946393528 shutdown_connections 2024-09-15T23:54:08.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2946393528 wait complete. 2024-09-15T23:54:08.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 Processor -- start 2024-09-15T23:54:08.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 -- start start 2024-09-15T23:54:08.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a880052f0 0x7f8a9c1ec090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a9c1f8740 0x7f8a9c1fb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a9c0732a0 0x7f8a9c073720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c0b3720 con 0x7f8a880052f0 2024-09-15T23:54:08.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c06eff0 con 0x7f8a9c1f8740 2024-09-15T23:54:08.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8a9c0b38a0 con 0x7f8a9c0732a0 2024-09-15T23:54:08.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a880052f0 0x7f8a9c1ec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a880052f0 0x7f8a9c1ec090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58842/0 (socket says 172.21.15.112:58842) 2024-09-15T23:54:08.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9b7fe640 1 -- 172.21.15.112:0/2244230875 learned_addr learned my addr 172.21.15.112:0/2244230875 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:08.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9bfff640 1 --2- 172.21.15.112:0/2244230875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a9c0732a0 0x7f8a9c073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a93fff640 1 --2- 172.21.15.112:0/2244230875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a9c1f8740 0x7f8a9c1fb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9b7fe640 1 -- 172.21.15.112:0/2244230875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a9c0732a0 msgr2=0x7f8a9c073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9b7fe640 1 --2- 172.21.15.112:0/2244230875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a9c0732a0 0x7f8a9c073720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9b7fe640 1 -- 172.21.15.112:0/2244230875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a9c1f8740 msgr2=0x7f8a9c1fb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:08.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9b7fe640 1 --2- 172.21.15.112:0/2244230875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a9c1f8740 0x7f8a9c1fb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:08.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9b7fe640 1 -- 172.21.15.112:0/2244230875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c1627f0 con 0x7f8a880052f0 2024-09-15T23:54:08.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a9b7fe640 1 --2- 172.21.15.112:0/2244230875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a880052f0 0x7f8a9c1ec090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c001060 tx=0x7f8a8c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:08.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a98ff9640 1 -- 172.21.15.112:0/2244230875 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c00c870 con 0x7f8a880052f0 2024-09-15T23:54:08.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a98ff9640 1 -- 172.21.15.112:0/2244230875 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a8c018070 con 0x7f8a880052f0 2024-09-15T23:54:08.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2244230875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9c1ec670 con 0x7f8a880052f0 2024-09-15T23:54:08.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8a98ff9640 1 -- 172.21.15.112:0/2244230875 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c00cc70 con 0x7f8a880052f0 2024-09-15T23:54:08.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.857+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2244230875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9c1ecc30 con 0x7f8a880052f0 2024-09-15T23:54:08.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.861+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2244230875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a9c073c60 con 0x7f8a880052f0 2024-09-15T23:54:08.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.861+0000 7f8a98ff9640 1 -- 172.21.15.112:0/2244230875 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a8c01d460 con 0x7f8a880052f0 2024-09-15T23:54:08.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.861+0000 7f8a98ff9640 1 --2- 172.21.15.112:0/2244230875 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8a7c067940 0x7f8a7c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:08.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.861+0000 7f8a93fff640 1 --2- 172.21.15.112:0/2244230875 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8a7c067940 0x7f8a7c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:08.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.861+0000 7f8a98ff9640 1 -- 172.21.15.112:0/2244230875 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8a8c085d50 con 0x7f8a880052f0 2024-09-15T23:54:08.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.861+0000 7f8a93fff640 1 --2- 172.21.15.112:0/2244230875 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8a7c067940 0x7f8a7c069e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0cf830 tx=0x7f8a84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:08.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:08.865+0000 7f8a98ff9640 1 -- 172.21.15.112:0/2244230875 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8a8c055fe0 con 0x7f8a880052f0 2024-09-15T23:54:09.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.045+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2244230875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a9c070080 con 0x7f8a880052f0 2024-09-15T23:54:09.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.045+0000 7f8a98ff9640 1 -- 172.21.15.112:0/2244230875 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f8a8c05a2e0 con 0x7f8a880052f0 2024-09-15T23:54:09.050 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:09.050 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-15T23:54:04:302532+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/879130842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":879130842},{"type":"v1","addr":"172.21.15.112:6836","nonce":879130842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3178495253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3178495253},{"type":"v1","addr":"172.21.15.112:6837","nonce":3178495253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/780833913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":780833913},{"type":"v1","addr":"172.21.15.169:6833","nonce":780833913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:53:50.059476+0000","modified":"2024-09-15T23:54:03.646829+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6835/2205745557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2205745557},{"type":"v1","addr":"172.21.15.169:6835","nonce":2205745557}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-09-15T23:54:09.050 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-15T23:54:09.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.049+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2244230875 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8a7c067940 msgr2=0x7f8a7c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.049+0000 7f8aa21e7640 1 --2- 172.21.15.112:0/2244230875 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8a7c067940 0x7f8a7c069e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0cf830 tx=0x7f8a84008040 comp rx=0 tx=0).stop 2024-09-15T23:54:09.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.049+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2244230875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a880052f0 msgr2=0x7f8a9c1ec090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.049+0000 7f8aa21e7640 1 --2- 172.21.15.112:0/2244230875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a880052f0 0x7f8a9c1ec090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c001060 tx=0x7f8a8c00ec80 comp rx=0 tx=0).stop 2024-09-15T23:54:09.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.049+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2244230875 shutdown_connections 2024-09-15T23:54:09.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.049+0000 7f8aa21e7640 1 --2- 172.21.15.112:0/2244230875 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8a7c067940 0x7f8a7c069e00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.049+0000 7f8aa21e7640 1 --2- 172.21.15.112:0/2244230875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a9c0732a0 0x7f8a9c073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.049+0000 7f8aa21e7640 1 --2- 172.21.15.112:0/2244230875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a9c1f8740 0x7f8a9c1fb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.049+0000 7f8aa21e7640 1 --2- 172.21.15.112:0/2244230875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a880052f0 0x7f8a9c1ec090 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.049+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2244230875 >> 172.21.15.112:0/2244230875 conn(0x7f8a9c0b1f90 msgr2=0x7f8a9c0b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:09.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.049+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2244230875 shutdown_connections 2024-09-15T23:54:09.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.049+0000 7f8aa21e7640 1 -- 172.21.15.112:0/2244230875 wait complete. 2024-09-15T23:54:09.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:54:09.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f206130d640 1 Processor -- start 2024-09-15T23:54:09.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f206130d640 1 -- start start 2024-09-15T23:54:09.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f206130d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f205c161a60 0x7f205c0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f206130d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f205c0cf620 0x7f205c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f206130d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f205c0d32b0 con 0x7f205c0d2e90 2024-09-15T23:54:09.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f206130d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f205c0d0300 con 0x7f205c161a60 2024-09-15T23:54:09.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f206130d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f205c0cfab0 con 0x7f205c0cf620 2024-09-15T23:54:09.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f20527fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f205c0d2e90 0x7f205c0cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36202/0 (socket says 172.21.15.112:36202) 2024-09-15T23:54:09.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f20527fc640 1 -- 172.21.15.112:0/3858622232 learned_addr learned my addr 172.21.15.112:0/3858622232 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:09.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205b7fe640 1 --2- 172.21.15.112:0/3858622232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f205c0cf620 0x7f205c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205affd640 1 --2- 172.21.15.112:0/3858622232 >> v2:172.21.15.169:3300/0 conn(0x7f205c161a60 0x7f205c0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 -- 172.21.15.112:0/3858622232 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3247481380 0 0) 0x7f205c0d32b0 con 0x7f205c0d2e90 2024-09-15T23:54:09.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 -- 172.21.15.112:0/3858622232 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2048003530 con 0x7f205c0d2e90 2024-09-15T23:54:09.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 -- 172.21.15.112:0/3858622232 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 568221179 0 0) 0x7f2048003530 con 0x7f205c0d2e90 2024-09-15T23:54:09.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 -- 172.21.15.112:0/3858622232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f205c0cf620 msgr2=0x7f205c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:09.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 --2- 172.21.15.112:0/3858622232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f205c0cf620 0x7f205c06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 -- 172.21.15.112:0/3858622232 >> v2:172.21.15.169:3300/0 conn(0x7f205c161a60 msgr2=0x7f205c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:09.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 --2- 172.21.15.112:0/3858622232 >> v2:172.21.15.169:3300/0 conn(0x7f205c161a60 0x7f205c0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 -- 172.21.15.112:0/3858622232 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205c0b0f60 con 0x7f205c0d2e90 2024-09-15T23:54:09.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 -- 172.21.15.112:0/3858622232 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f2044001680 con 0x7f205c0d2e90 2024-09-15T23:54:09.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 -- 172.21.15.112:0/3858622232 >> v1:172.21.15.112:6789/0 conn(0x7f205c0d2e90 legacy=0x7f205c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 --2- 172.21.15.112:0/3858622232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20480039c0 0x7f2048003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 --2- 172.21.15.112:0/3858622232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2048004810 0x7f2048004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 --2- 172.21.15.112:0/3858622232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f205c0cf620 0x7f20480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 -- 172.21.15.112:0/3858622232 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f205c0d0300 con 0x7f2048004810 2024-09-15T23:54:09.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 -- 172.21.15.112:0/3858622232 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f205c0cfab0 con 0x7f20480039c0 2024-09-15T23:54:09.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205a7fc640 1 -- 172.21.15.112:0/3858622232 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f204800b9d0 con 0x7f205c0cf620 2024-09-15T23:54:09.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f20527fc640 1 --2- 172.21.15.112:0/3858622232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2048004810 0x7f2048004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f205affd640 1 --2- 172.21.15.112:0/3858622232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20480039c0 0x7f2048003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f20527fc640 1 -- 172.21.15.112:0/3858622232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f205c0cf620 msgr2=0x7f20480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:09.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f20527fc640 1 --2- 172.21.15.112:0/3858622232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f205c0cf620 0x7f20480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f20527fc640 1 -- 172.21.15.112:0/3858622232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20480039c0 msgr2=0x7f2048003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:09.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f20527fc640 1 --2- 172.21.15.112:0/3858622232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20480039c0 0x7f2048003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.173+0000 7f20527fc640 1 -- 172.21.15.112:0/3858622232 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2048003530 con 0x7f2048004810 2024-09-15T23:54:09.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f20527fc640 1 --2- 172.21.15.112:0/3858622232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2048004810 0x7f2048004c90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f204400c210 tx=0x7f204401cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823bc3493a371f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:09.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f205a7fc640 1 -- 172.21.15.112:0/3858622232 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044007d80 con 0x7f2048004810 2024-09-15T23:54:09.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f205a7fc640 1 -- 172.21.15.112:0/3858622232 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20440a9020 con 0x7f2048004810 2024-09-15T23:54:09.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f205a7fc640 1 -- 172.21.15.112:0/3858622232 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20440058e0 con 0x7f2048004810 2024-09-15T23:54:09.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 -- 172.21.15.112:0/3858622232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2048004810 msgr2=0x7f2048004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 --2- 172.21.15.112:0/3858622232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2048004810 0x7f2048004c90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f204400c210 tx=0x7f204401cc70 comp rx=0 tx=0).stop 2024-09-15T23:54:09.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f205b7fe640 1 -- 172.21.15.112:0/3858622232 reap_dead start 2024-09-15T23:54:09.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 -- 172.21.15.112:0/3858622232 shutdown_connections 2024-09-15T23:54:09.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 -- 172.21.15.112:0/3858622232 >> 172.21.15.112:0/3858622232 conn(0x7f205c08bf90 msgr2=0x7f205c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:09.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 -- 172.21.15.112:0/3858622232 shutdown_connections 2024-09-15T23:54:09.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 -- 172.21.15.112:0/3858622232 wait complete. 2024-09-15T23:54:09.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 Processor -- start 2024-09-15T23:54:09.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 -- start start 2024-09-15T23:54:09.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2048004810 0x7f205c0ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f205c0c81d0 0x7f205c152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f205c0b3cd0 0x7f205c0b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f205c06dec0 con 0x7f2048004810 2024-09-15T23:54:09.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f205c06d190 con 0x7f205c0c81d0 2024-09-15T23:54:09.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f205c06e040 con 0x7f205c0b3cd0 2024-09-15T23:54:09.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f205affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2048004810 0x7f205c0ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f205affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2048004810 0x7f205c0ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58854/0 (socket says 172.21.15.112:58854) 2024-09-15T23:54:09.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f205affd640 1 -- 172.21.15.112:0/1754186974 learned_addr learned my addr 172.21.15.112:0/1754186974 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:09.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f20527fc640 1 --2- 172.21.15.112:0/1754186974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f205c0c81d0 0x7f205c152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f205affd640 1 -- 172.21.15.112:0/1754186974 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f205c0b3cd0 msgr2=0x7f205c0b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f205affd640 1 --2- 172.21.15.112:0/1754186974 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f205c0b3cd0 0x7f205c0b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f205affd640 1 -- 172.21.15.112:0/1754186974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f205c0c81d0 msgr2=0x7f205c152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f205affd640 1 --2- 172.21.15.112:0/1754186974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f205c0c81d0 0x7f205c152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f205affd640 1 -- 172.21.15.112:0/1754186974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205c0cada0 con 0x7f2048004810 2024-09-15T23:54:09.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f205affd640 1 --2- 172.21.15.112:0/1754186974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2048004810 0x7f205c0ca670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f204c010870 tx=0x7f204c010d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:09.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f2053fff640 1 -- 172.21.15.112:0/1754186974 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c00f040 con 0x7f2048004810 2024-09-15T23:54:09.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f2053fff640 1 -- 172.21.15.112:0/1754186974 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204c00eb00 con 0x7f2048004810 2024-09-15T23:54:09.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 -- 172.21.15.112:0/1754186974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205c0b76b0 con 0x7f2048004810 2024-09-15T23:54:09.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f2053fff640 1 -- 172.21.15.112:0/1754186974 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c01c400 con 0x7f2048004810 2024-09-15T23:54:09.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.177+0000 7f206130d640 1 -- 172.21.15.112:0/1754186974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f205c0b7c70 con 0x7f2048004810 2024-09-15T23:54:09.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.181+0000 7f206130d640 1 -- 172.21.15.112:0/1754186974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f205c06e400 con 0x7f2048004810 2024-09-15T23:54:09.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.181+0000 7f2053fff640 1 -- 172.21.15.112:0/1754186974 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f204c01c5a0 con 0x7f2048004810 2024-09-15T23:54:09.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.181+0000 7f2053fff640 1 --2- 172.21.15.112:0/1754186974 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f203c0678c0 0x7f203c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.181+0000 7f2053fff640 1 -- 172.21.15.112:0/1754186974 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f204c086550 con 0x7f2048004810 2024-09-15T23:54:09.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.181+0000 7f20527fc640 1 --2- 172.21.15.112:0/1754186974 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f203c0678c0 0x7f203c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.181+0000 7f20527fc640 1 --2- 172.21.15.112:0/1754186974 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f203c0678c0 0x7f203c069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f20440aa000 tx=0x7f2044001a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:09.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.185+0000 7f2053fff640 1 -- 172.21.15.112:0/1754186974 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f204c018030 con 0x7f2048004810 2024-09-15T23:54:09.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.369+0000 7f206130d640 1 -- 172.21.15.112:0/1754186974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f205c0b4690 con 0x7f2048004810 2024-09-15T23:54:09.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.369+0000 7f2053fff640 1 -- 172.21.15.112:0/1754186974 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f204c056e10 con 0x7f2048004810 2024-09-15T23:54:09.374 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:09.374 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-15T23:54:04:302532+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/879130842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":879130842},{"type":"v1","addr":"172.21.15.112:6836","nonce":879130842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3178495253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3178495253},{"type":"v1","addr":"172.21.15.112:6837","nonce":3178495253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/780833913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":780833913},{"type":"v1","addr":"172.21.15.169:6833","nonce":780833913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:53:50.059476+0000","modified":"2024-09-15T23:54:03.646829+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6835/2205745557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2205745557},{"type":"v1","addr":"172.21.15.169:6835","nonce":2205745557}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-09-15T23:54:09.374 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-15T23:54:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.373+0000 7f206130d640 1 -- 172.21.15.112:0/1754186974 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f203c0678c0 msgr2=0x7f203c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.373+0000 7f206130d640 1 --2- 172.21.15.112:0/1754186974 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f203c0678c0 0x7f203c069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f20440aa000 tx=0x7f2044001a50 comp rx=0 tx=0).stop 2024-09-15T23:54:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.373+0000 7f206130d640 1 -- 172.21.15.112:0/1754186974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2048004810 msgr2=0x7f205c0ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.373+0000 7f206130d640 1 --2- 172.21.15.112:0/1754186974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2048004810 0x7f205c0ca670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f204c010870 tx=0x7f204c010d30 comp rx=0 tx=0).stop 2024-09-15T23:54:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.373+0000 7f206130d640 1 -- 172.21.15.112:0/1754186974 shutdown_connections 2024-09-15T23:54:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.373+0000 7f206130d640 1 --2- 172.21.15.112:0/1754186974 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f203c0678c0 0x7f203c069d80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.373+0000 7f206130d640 1 --2- 172.21.15.112:0/1754186974 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f205c0b3cd0 0x7f205c0b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.373+0000 7f206130d640 1 --2- 172.21.15.112:0/1754186974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f205c0c81d0 0x7f205c152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.373+0000 7f206130d640 1 --2- 172.21.15.112:0/1754186974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2048004810 0x7f205c0ca670 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.373+0000 7f206130d640 1 -- 172.21.15.112:0/1754186974 >> 172.21.15.112:0/1754186974 conn(0x7f205c08bf90 msgr2=0x7f205c0d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:09.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.373+0000 7f206130d640 1 -- 172.21.15.112:0/1754186974 shutdown_connections 2024-09-15T23:54:09.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.373+0000 7f206130d640 1 -- 172.21.15.112:0/1754186974 wait complete. 2024-09-15T23:54:09.391 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:09.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.493+0000 7f9be6b18640 1 Processor -- start 2024-09-15T23:54:09.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.493+0000 7f9be6b18640 1 -- start start 2024-09-15T23:54:09.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be6b18640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9be0070020 0x7f9be015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be6b18640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9be015f1d0 0x7f9be00adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be6b18640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be00aede0 con 0x7f9be01520a0 2024-09-15T23:54:09.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be6b18640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9be0152480 con 0x7f9be0070020 2024-09-15T23:54:09.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be6b18640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9be015fa10 con 0x7f9be015f1d0 2024-09-15T23:54:09.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be48b4640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9be01520a0 0x7f9be006f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36208/0 (socket says 172.21.15.112:36208) 2024-09-15T23:54:09.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be48b4640 1 -- 172.21.15.112:0/322629735 learned_addr learned my addr 172.21.15.112:0/322629735 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:09.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdffff640 1 --2- 172.21.15.112:0/322629735 >> v2:172.21.15.169:3300/0 conn(0x7f9be0070020 0x7f9be015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be50b5640 1 --2- 172.21.15.112:0/322629735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9be015f1d0 0x7f9be00adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 -- 172.21.15.112:0/322629735 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1847106793 0 0) 0x7f9be00aede0 con 0x7f9be01520a0 2024-09-15T23:54:09.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 -- 172.21.15.112:0/322629735 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bcc003530 con 0x7f9be01520a0 2024-09-15T23:54:09.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 -- 172.21.15.112:0/322629735 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2082039815 0 0) 0x7f9bcc003530 con 0x7f9be01520a0 2024-09-15T23:54:09.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 -- 172.21.15.112:0/322629735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9be015f1d0 msgr2=0x7f9be00adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:09.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 --2- 172.21.15.112:0/322629735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9be015f1d0 0x7f9be00adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 -- 172.21.15.112:0/322629735 >> v2:172.21.15.169:3300/0 conn(0x7f9be0070020 msgr2=0x7f9be015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:09.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 --2- 172.21.15.112:0/322629735 >> v2:172.21.15.169:3300/0 conn(0x7f9be0070020 0x7f9be015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 -- 172.21.15.112:0/322629735 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be0074250 con 0x7f9be01520a0 2024-09-15T23:54:09.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 -- 172.21.15.112:0/322629735 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f9bd0001a00 con 0x7f9be01520a0 2024-09-15T23:54:09.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 -- 172.21.15.112:0/322629735 >> v1:172.21.15.112:6789/0 conn(0x7f9be01520a0 legacy=0x7f9be006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 --2- 172.21.15.112:0/322629735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bcc0039c0 0x7f9bcc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 --2- 172.21.15.112:0/322629735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9bcc004810 0x7f9bcc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 --2- 172.21.15.112:0/322629735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9be015f1d0 0x7f9bcc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 -- 172.21.15.112:0/322629735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9be015fa10 con 0x7f9bcc0039c0 2024-09-15T23:54:09.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 -- 172.21.15.112:0/322629735 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc00dbe0 con 0x7f9bcc004810 2024-09-15T23:54:09.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdf7fe640 1 -- 172.21.15.112:0/322629735 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9bcc00dd60 con 0x7f9be015f1d0 2024-09-15T23:54:09.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be48b4640 1 --2- 172.21.15.112:0/322629735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bcc0039c0 0x7f9bcc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9bdffff640 1 --2- 172.21.15.112:0/322629735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9bcc004810 0x7f9bcc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be50b5640 1 --2- 172.21.15.112:0/322629735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9be015f1d0 0x7f9bcc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be48b4640 1 -- 172.21.15.112:0/322629735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9be015f1d0 msgr2=0x7f9bcc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:09.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be48b4640 1 --2- 172.21.15.112:0/322629735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9be015f1d0 0x7f9bcc0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be48b4640 1 -- 172.21.15.112:0/322629735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9bcc004810 msgr2=0x7f9bcc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:09.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be48b4640 1 --2- 172.21.15.112:0/322629735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9bcc004810 0x7f9bcc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be48b4640 1 -- 172.21.15.112:0/322629735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bcc003530 con 0x7f9bcc0039c0 2024-09-15T23:54:09.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.497+0000 7f9be48b4640 1 --2- 172.21.15.112:0/322629735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bcc0039c0 0x7f9bcc003de0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000a870 tx=0x7f9bd001d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6f528485695e3f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:09.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdf7fe640 1 -- 172.21.15.112:0/322629735 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd000a4c0 con 0x7f9bcc0039c0 2024-09-15T23:54:09.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdf7fe640 1 -- 172.21.15.112:0/322629735 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd00ad630 con 0x7f9bcc0039c0 2024-09-15T23:54:09.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdf7fe640 1 -- 172.21.15.112:0/322629735 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd00ada20 con 0x7f9bcc0039c0 2024-09-15T23:54:09.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 -- 172.21.15.112:0/322629735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bcc0039c0 msgr2=0x7f9bcc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 --2- 172.21.15.112:0/322629735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bcc0039c0 0x7f9bcc003de0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000a870 tx=0x7f9bd001d370 comp rx=0 tx=0).stop 2024-09-15T23:54:09.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be50b5640 1 -- 172.21.15.112:0/322629735 reap_dead start 2024-09-15T23:54:09.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 -- 172.21.15.112:0/322629735 shutdown_connections 2024-09-15T23:54:09.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 -- 172.21.15.112:0/322629735 >> 172.21.15.112:0/322629735 conn(0x7f9be00b1f90 msgr2=0x7f9be00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:09.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 -- 172.21.15.112:0/322629735 shutdown_connections 2024-09-15T23:54:09.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 -- 172.21.15.112:0/322629735 wait complete. 2024-09-15T23:54:09.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 Processor -- start 2024-09-15T23:54:09.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 -- start start 2024-09-15T23:54:09.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9bcc0039c0 0x7f9be015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9be015db90 0x7f9be0154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9be00afe00 0x7f9be00b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9be015f5e0 con 0x7f9be015db90 2024-09-15T23:54:09.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9be0073d30 con 0x7f9be00afe00 2024-09-15T23:54:09.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9be015f760 con 0x7f9bcc0039c0 2024-09-15T23:54:09.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9be015db90 0x7f9be0154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9be015db90 0x7f9be0154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58882/0 (socket says 172.21.15.112:58882) 2024-09-15T23:54:09.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdffff640 1 -- 172.21.15.112:0/137278517 learned_addr learned my addr 172.21.15.112:0/137278517 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:09.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdffff640 1 -- 172.21.15.112:0/137278517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9bcc0039c0 msgr2=0x7f9be015bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdffff640 1 --2- 172.21.15.112:0/137278517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9bcc0039c0 0x7f9be015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdffff640 1 -- 172.21.15.112:0/137278517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9be00afe00 msgr2=0x7f9be00b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdffff640 1 --2- 172.21.15.112:0/137278517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9be00afe00 0x7f9be00b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdffff640 1 -- 172.21.15.112:0/137278517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be00b1dc0 con 0x7f9be015db90 2024-09-15T23:54:09.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdffff640 1 --2- 172.21.15.112:0/137278517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9be015db90 0x7f9be0154c80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8011600 tx=0x7f9bc8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:09.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdd7fa640 1 -- 172.21.15.112:0/137278517 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8015870 con 0x7f9be015db90 2024-09-15T23:54:09.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdd7fa640 1 -- 172.21.15.112:0/137278517 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc8015a10 con 0x7f9be015db90 2024-09-15T23:54:09.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 -- 172.21.15.112:0/137278517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be01f7870 con 0x7f9be015db90 2024-09-15T23:54:09.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9bdd7fa640 1 -- 172.21.15.112:0/137278517 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8015e00 con 0x7f9be015db90 2024-09-15T23:54:09.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.501+0000 7f9be6b18640 1 -- 172.21.15.112:0/137278517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be015c380 con 0x7f9be015db90 2024-09-15T23:54:09.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.505+0000 7f9be6b18640 1 -- 172.21.15.112:0/137278517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9be006e540 con 0x7f9be015db90 2024-09-15T23:54:09.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.505+0000 7f9bdd7fa640 1 -- 172.21.15.112:0/137278517 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9bc800f490 con 0x7f9be015db90 2024-09-15T23:54:09.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.505+0000 7f9bdd7fa640 1 --2- 172.21.15.112:0/137278517 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9bc00678c0 0x7f9bc0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.505+0000 7f9bdd7fa640 1 -- 172.21.15.112:0/137278517 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9bc8086860 con 0x7f9be015db90 2024-09-15T23:54:09.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.505+0000 7f9be48b4640 1 --2- 172.21.15.112:0/137278517 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9bc00678c0 0x7f9bc0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.505+0000 7f9be48b4640 1 --2- 172.21.15.112:0/137278517 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9bc00678c0 0x7f9bc0069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00ad000 tx=0x7f9be0155b40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:09.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.509+0000 7f9bdd7fa640 1 -- 172.21.15.112:0/137278517 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9bc8019030 con 0x7f9be015db90 2024-09-15T23:54:09.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.661+0000 7f9be6b18640 1 -- 172.21.15.112:0/137278517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9be01551c0 con 0x7f9be015db90 2024-09-15T23:54:09.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.661+0000 7f9bdd7fa640 1 -- 172.21.15.112:0/137278517 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7f9bc8057050 con 0x7f9be015db90 2024-09-15T23:54:09.666 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:09.666 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:55.161085+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:53:47.908190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:53:49.056283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:53:52.808895+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:09.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.665+0000 7f9be6b18640 1 -- 172.21.15.112:0/137278517 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9bc00678c0 msgr2=0x7f9bc0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.665+0000 7f9be6b18640 1 --2- 172.21.15.112:0/137278517 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9bc00678c0 0x7f9bc0069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00ad000 tx=0x7f9be0155b40 comp rx=0 tx=0).stop 2024-09-15T23:54:09.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.665+0000 7f9be6b18640 1 -- 172.21.15.112:0/137278517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9be015db90 msgr2=0x7f9be0154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.665+0000 7f9be6b18640 1 --2- 172.21.15.112:0/137278517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9be015db90 0x7f9be0154c80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8011600 tx=0x7f9bc8011ac0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.665+0000 7f9be6b18640 1 -- 172.21.15.112:0/137278517 shutdown_connections 2024-09-15T23:54:09.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.665+0000 7f9be6b18640 1 --2- 172.21.15.112:0/137278517 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9bc00678c0 0x7f9bc0069d80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.665+0000 7f9be6b18640 1 --2- 172.21.15.112:0/137278517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9be00afe00 0x7f9be00b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.665+0000 7f9be6b18640 1 --2- 172.21.15.112:0/137278517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9be015db90 0x7f9be0154c80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.665+0000 7f9be6b18640 1 --2- 172.21.15.112:0/137278517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9bcc0039c0 0x7f9be015bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.665+0000 7f9be6b18640 1 -- 172.21.15.112:0/137278517 >> 172.21.15.112:0/137278517 conn(0x7f9be00b1f90 msgr2=0x7f9be0072520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:09.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.665+0000 7f9be6b18640 1 -- 172.21.15.112:0/137278517 shutdown_connections 2024-09-15T23:54:09.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.665+0000 7f9be6b18640 1 -- 172.21.15.112:0/137278517 wait complete. 2024-09-15T23:54:09.683 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:54:09.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad81ee640 1 Processor -- start 2024-09-15T23:54:09.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad81ee640 1 -- start start 2024-09-15T23:54:09.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad81ee640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faad0161a60 0x7faad00d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad81ee640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faad00d32b0 con 0x7faad00d2e90 2024-09-15T23:54:09.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad81ee640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faad00d0300 con 0x7faad00cf620 2024-09-15T23:54:09.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad81ee640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7faad00cfa90 con 0x7faad0161a60 2024-09-15T23:54:09.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad5789640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7faad00d2e90 0x7faad00cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36210/0 (socket says 172.21.15.112:36210) 2024-09-15T23:54:09.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad5789640 1 -- 172.21.15.112:0/3522872654 learned_addr learned my addr 172.21.15.112:0/3522872654 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:09.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad4f88640 1 -- 172.21.15.112:0/3522872654 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212600876 0 0) 0x7faad00d32b0 con 0x7faad00d2e90 2024-09-15T23:54:09.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad5f8a640 1 --2- 172.21.15.112:0/3522872654 >> v2:172.21.15.169:3300/0 conn(0x7faad0161a60 0x7faad00d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad4f88640 1 -- 172.21.15.112:0/3522872654 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faab8003530 con 0x7faad00d2e90 2024-09-15T23:54:09.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad4f88640 1 -- 172.21.15.112:0/3522872654 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1469675373 0 0) 0x7faab8003530 con 0x7faad00d2e90 2024-09-15T23:54:09.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad4f88640 1 -- 172.21.15.112:0/3522872654 >> v2:172.21.15.169:3300/0 conn(0x7faad0161a60 msgr2=0x7faad00d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:09.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad4f88640 1 --2- 172.21.15.112:0/3522872654 >> v2:172.21.15.169:3300/0 conn(0x7faad0161a60 0x7faad00d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.785+0000 7faad4f88640 1 -- 172.21.15.112:0/3522872654 >> v1:172.21.15.169:6789/0 conn(0x7faad00cf620 legacy=0x7faad006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:09.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad4f88640 1 -- 172.21.15.112:0/3522872654 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad00b0f60 con 0x7faad00d2e90 2024-09-15T23:54:09.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad4f88640 1 -- 172.21.15.112:0/3522872654 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7faac4001680 con 0x7faad00d2e90 2024-09-15T23:54:09.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad4f88640 1 -- 172.21.15.112:0/3522872654 >> v1:172.21.15.112:6789/0 conn(0x7faad00d2e90 legacy=0x7faad00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad4f88640 1 --2- 172.21.15.112:0/3522872654 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faab80039c0 0x7faab8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad4f88640 1 --2- 172.21.15.112:0/3522872654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab8004810 0x7faab8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad4f88640 1 --2- 172.21.15.112:0/3522872654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faab80052f0 0x7faab800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad4f88640 1 -- 172.21.15.112:0/3522872654 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faad00cfa90 con 0x7faab8004810 2024-09-15T23:54:09.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad4f88640 1 -- 172.21.15.112:0/3522872654 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faab800c1c0 con 0x7faab80052f0 2024-09-15T23:54:09.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad4f88640 1 -- 172.21.15.112:0/3522872654 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faab800c3c0 con 0x7faab80039c0 2024-09-15T23:54:09.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad5789640 1 --2- 172.21.15.112:0/3522872654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab8004810 0x7faab8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad5f8a640 1 --2- 172.21.15.112:0/3522872654 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faab80039c0 0x7faab8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad678b640 1 --2- 172.21.15.112:0/3522872654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faab80052f0 0x7faab800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad5789640 1 -- 172.21.15.112:0/3522872654 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faab80039c0 msgr2=0x7faab8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:09.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad5789640 1 --2- 172.21.15.112:0/3522872654 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faab80039c0 0x7faab8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad5789640 1 -- 172.21.15.112:0/3522872654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faab80052f0 msgr2=0x7faab800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:09.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad5789640 1 --2- 172.21.15.112:0/3522872654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faab80052f0 0x7faab800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad5789640 1 -- 172.21.15.112:0/3522872654 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab8003530 con 0x7faab8004810 2024-09-15T23:54:09.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad678b640 1 --2- 172.21.15.112:0/3522872654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faab80052f0 0x7faab800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:09.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad678b640 1 -- 172.21.15.112:0/3522872654 reap_dead start 2024-09-15T23:54:09.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad5789640 1 --2- 172.21.15.112:0/3522872654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab8004810 0x7faab8004c90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faac4001ec0 tx=0x7faac401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104abba6f3a105a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:09.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad4f88640 1 -- 172.21.15.112:0/3522872654 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4007d40 con 0x7faab8004810 2024-09-15T23:54:09.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad4f88640 1 -- 172.21.15.112:0/3522872654 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac40a9070 con 0x7faab8004810 2024-09-15T23:54:09.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad4f88640 1 -- 172.21.15.112:0/3522872654 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4005d80 con 0x7faab8004810 2024-09-15T23:54:09.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad81ee640 1 -- 172.21.15.112:0/3522872654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab8004810 msgr2=0x7faab8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad81ee640 1 --2- 172.21.15.112:0/3522872654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab8004810 0x7faab8004c90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faac4001ec0 tx=0x7faac401cc30 comp rx=0 tx=0).stop 2024-09-15T23:54:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad81ee640 1 -- 172.21.15.112:0/3522872654 shutdown_connections 2024-09-15T23:54:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad81ee640 1 --2- 172.21.15.112:0/3522872654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab8004810 0x7faab8004c90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad81ee640 1 -- 172.21.15.112:0/3522872654 >> 172.21.15.112:0/3522872654 conn(0x7faad008bf90 msgr2=0x7faad009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad81ee640 1 -- 172.21.15.112:0/3522872654 shutdown_connections 2024-09-15T23:54:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.789+0000 7faad81ee640 1 -- 172.21.15.112:0/3522872654 wait complete. 2024-09-15T23:54:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad81ee640 1 Processor -- start 2024-09-15T23:54:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad81ee640 1 -- start start 2024-09-15T23:54:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad81ee640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faab8004810 0x7faad0155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad81ee640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faad00b9f20 0x7faad00b8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad81ee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faad00b4af0 0x7faad00b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad81ee640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faad00cf320 con 0x7faad00b4af0 2024-09-15T23:54:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad81ee640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faad006d190 con 0x7faad00b9f20 2024-09-15T23:54:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad81ee640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faad00cf4a0 con 0x7faab8004810 2024-09-15T23:54:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad678b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faad00b4af0 0x7faad00b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad678b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faad00b4af0 0x7faad00b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58904/0 (socket says 172.21.15.112:58904) 2024-09-15T23:54:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad678b640 1 -- 172.21.15.112:0/572371326 learned_addr learned my addr 172.21.15.112:0/572371326 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad5f8a640 1 --2- 172.21.15.112:0/572371326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faab8004810 0x7faad0155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad5789640 1 --2- 172.21.15.112:0/572371326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faad00b9f20 0x7faad00b8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad678b640 1 -- 172.21.15.112:0/572371326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faab8004810 msgr2=0x7faad0155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad678b640 1 --2- 172.21.15.112:0/572371326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faab8004810 0x7faad0155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad678b640 1 -- 172.21.15.112:0/572371326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faad00b9f20 msgr2=0x7faad00b8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad678b640 1 --2- 172.21.15.112:0/572371326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faad00b9f20 0x7faad00b8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad678b640 1 -- 172.21.15.112:0/572371326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad00b72d0 con 0x7faad00b4af0 2024-09-15T23:54:09.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad678b640 1 --2- 172.21.15.112:0/572371326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faad00b4af0 0x7faad00b4fa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faad00b6f60 tx=0x7faac800d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:09.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faace7fc640 1 -- 172.21.15.112:0/572371326 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8018070 con 0x7faad00b4af0 2024-09-15T23:54:09.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faace7fc640 1 -- 172.21.15.112:0/572371326 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac80052f0 con 0x7faad00b4af0 2024-09-15T23:54:09.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad81ee640 1 -- 172.21.15.112:0/572371326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad00b75b0 con 0x7faad00b4af0 2024-09-15T23:54:09.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faace7fc640 1 -- 172.21.15.112:0/572371326 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8003840 con 0x7faad00b4af0 2024-09-15T23:54:09.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad81ee640 1 -- 172.21.15.112:0/572371326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad00b7b70 con 0x7faad00b4af0 2024-09-15T23:54:09.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faad81ee640 1 -- 172.21.15.112:0/572371326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad00d12b0 con 0x7faad00b4af0 2024-09-15T23:54:09.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faace7fc640 1 -- 172.21.15.112:0/572371326 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faac801b070 con 0x7faad00b4af0 2024-09-15T23:54:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.793+0000 7faace7fc640 1 --2- 172.21.15.112:0/572371326 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faabc0678f0 0x7faabc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.797+0000 7faace7fc640 1 -- 172.21.15.112:0/572371326 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faac80857a0 con 0x7faad00b4af0 2024-09-15T23:54:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.797+0000 7faad5f8a640 1 --2- 172.21.15.112:0/572371326 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faabc0678f0 0x7faabc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.797+0000 7faad5f8a640 1 --2- 172.21.15.112:0/572371326 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faabc0678f0 0x7faabc069db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faac00043b0 tx=0x7faac000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:09.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.797+0000 7faace7fc640 1 -- 172.21.15.112:0/572371326 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faac8022020 con 0x7faad00b4af0 2024-09-15T23:54:09.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.981+0000 7faad81ee640 1 -- 172.21.15.112:0/572371326 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faad00b37e0 con 0x7faad00b4af0 2024-09-15T23:54:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.981+0000 7faace7fc640 1 -- 172.21.15.112:0/572371326 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7faad00d0300 con 0x7faad00b4af0 2024-09-15T23:54:09.984 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:09.984 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-15T23:54:04:302532+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/879130842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":879130842},{"type":"v1","addr":"172.21.15.112:6836","nonce":879130842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3178495253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3178495253},{"type":"v1","addr":"172.21.15.112:6837","nonce":3178495253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/780833913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":780833913},{"type":"v1","addr":"172.21.15.169:6833","nonce":780833913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:53:50.059476+0000","modified":"2024-09-15T23:54:03.646829+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6835/2205745557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2205745557},{"type":"v1","addr":"172.21.15.169:6835","nonce":2205745557}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-09-15T23:54:09.985 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-15T23:54:09.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.985+0000 7faad81ee640 1 -- 172.21.15.112:0/572371326 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faabc0678f0 msgr2=0x7faabc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.985+0000 7faad81ee640 1 --2- 172.21.15.112:0/572371326 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faabc0678f0 0x7faabc069db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faac00043b0 tx=0x7faac000b040 comp rx=0 tx=0).stop 2024-09-15T23:54:09.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.985+0000 7faad81ee640 1 -- 172.21.15.112:0/572371326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faad00b4af0 msgr2=0x7faad00b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.985+0000 7faad81ee640 1 --2- 172.21.15.112:0/572371326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faad00b4af0 0x7faad00b4fa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faad00b6f60 tx=0x7faac800d660 comp rx=0 tx=0).stop 2024-09-15T23:54:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.985+0000 7faad81ee640 1 -- 172.21.15.112:0/572371326 shutdown_connections 2024-09-15T23:54:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.985+0000 7faad81ee640 1 --2- 172.21.15.112:0/572371326 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faabc0678f0 0x7faabc069db0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.985+0000 7faad81ee640 1 --2- 172.21.15.112:0/572371326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faad00b4af0 0x7faad00b4fa0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.985+0000 7faad81ee640 1 --2- 172.21.15.112:0/572371326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faad00b9f20 0x7faad00b8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.985+0000 7faad81ee640 1 --2- 172.21.15.112:0/572371326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faab8004810 0x7faad0155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.985+0000 7faad81ee640 1 -- 172.21.15.112:0/572371326 >> 172.21.15.112:0/572371326 conn(0x7faad008bf90 msgr2=0x7faad00cacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.985+0000 7faad81ee640 1 -- 172.21.15.112:0/572371326 shutdown_connections 2024-09-15T23:54:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:09.985+0000 7faad81ee640 1 -- 172.21.15.112:0/572371326 wait complete. 2024-09-15T23:54:10.404 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:53:50.059476+0000', 'modified': '2024-09-15T23:54:03.646829+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.169:6835/2205745557', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 2205745557}, {'type': 'v1', 'addr': '172.21.15.169:6835', 'nonce': 2205745557}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4279, 'qdb_cluster': [4279]} 2024-09-15T23:54:10.405 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:54:10.405 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-15T23:54:10.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa3a4d04640 1 Processor -- start 2024-09-15T23:54:10.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa3a4d04640 1 -- start start 2024-09-15T23:54:10.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa3a4d04640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa3a01587a0 0x7fa3a00b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa3a4d04640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa3a006e680 0x7fa3a0072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa3a4d04640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3a006ec60 con 0x7fa3a00b37d0 2024-09-15T23:54:10.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa3a4d04640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a00b3c40 con 0x7fa3a01587a0 2024-09-15T23:54:10.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa3a4d04640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a006f870 con 0x7fa3a006e680 2024-09-15T23:54:10.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa39dd9b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa3a00b37d0 0x7fa3a006df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36220/0 (socket says 172.21.15.112:36220) 2024-09-15T23:54:10.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa39dd9b640 1 -- 172.21.15.112:0/734686385 learned_addr learned my addr 172.21.15.112:0/734686385 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:10.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa39e59c640 1 --2- 172.21.15.112:0/734686385 >> v2:172.21.15.112:3300/0 conn(0x7fa3a01587a0 0x7fa3a00b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:10.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa39ed9d640 1 --2- 172.21.15.112:0/734686385 >> v2:172.21.15.169:3300/0 conn(0x7fa3a006e680 0x7fa3a0072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:10.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa39d59a640 1 -- 172.21.15.112:0/734686385 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2792406796 0 0) 0x7fa3a006ec60 con 0x7fa3a00b37d0 2024-09-15T23:54:10.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa39d59a640 1 -- 172.21.15.112:0/734686385 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa38c003530 con 0x7fa3a00b37d0 2024-09-15T23:54:10.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa39e59c640 1 -- 172.21.15.112:0/734686385 >> v2:172.21.15.169:3300/0 conn(0x7fa3a006e680 msgr2=0x7fa3a0072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:10.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa39e59c640 1 --2- 172.21.15.112:0/734686385 >> v2:172.21.15.169:3300/0 conn(0x7fa3a006e680 0x7fa3a0072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa39e59c640 1 -- 172.21.15.112:0/734686385 >> v1:172.21.15.112:6789/0 conn(0x7fa3a00b37d0 legacy=0x7fa3a006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:10.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.533+0000 7fa39e59c640 1 -- 172.21.15.112:0/734686385 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a006ef40 con 0x7fa3a01587a0 2024-09-15T23:54:10.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.537+0000 7fa39e59c640 1 --2- 172.21.15.112:0/734686385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3a01587a0 0x7fa3a00b3290 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00af930 tx=0x7fa39001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef484e0d2af5682 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:10.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.537+0000 7fa39d59a640 1 -- 172.21.15.112:0/734686385 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3900b2070 con 0x7fa3a01587a0 2024-09-15T23:54:10.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.537+0000 7fa39d59a640 1 -- 172.21.15.112:0/734686385 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3900a9070 con 0x7fa3a01587a0 2024-09-15T23:54:10.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.537+0000 7fa39d59a640 1 -- 172.21.15.112:0/734686385 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3900ad860 con 0x7fa3a01587a0 2024-09-15T23:54:10.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.537+0000 7fa3a4d04640 1 -- 172.21.15.112:0/734686385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3a01587a0 msgr2=0x7fa3a00b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:10.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.537+0000 7fa3a4d04640 1 --2- 172.21.15.112:0/734686385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3a01587a0 0x7fa3a00b3290 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00af930 tx=0x7fa39001c450 comp rx=0 tx=0).stop 2024-09-15T23:54:10.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.537+0000 7fa3a4d04640 1 -- 172.21.15.112:0/734686385 shutdown_connections 2024-09-15T23:54:10.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.537+0000 7fa3a4d04640 1 --2- 172.21.15.112:0/734686385 >> v2:172.21.15.169:3300/0 conn(0x7fa3a006e680 0x7fa3a0072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.537+0000 7fa3a4d04640 1 --2- 172.21.15.112:0/734686385 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3a01587a0 0x7fa3a00b3290 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.537+0000 7fa3a4d04640 1 -- 172.21.15.112:0/734686385 >> 172.21.15.112:0/734686385 conn(0x7fa3a00b1f90 msgr2=0x7fa3a00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:10.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.537+0000 7fa3a4d04640 1 -- 172.21.15.112:0/734686385 shutdown_connections 2024-09-15T23:54:10.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.537+0000 7fa3a4d04640 1 -- 172.21.15.112:0/734686385 wait complete. 2024-09-15T23:54:10.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa3a4d04640 1 Processor -- start 2024-09-15T23:54:10.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa3a4d04640 1 -- start start 2024-09-15T23:54:10.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa3a4d04640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3a006e680 0x7fa3a0146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa3a4d04640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3a00b37d0 0x7fa3a0154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa3a4d04640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3a01587a0 0x7fa3a0154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa3a4d04640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0073030 con 0x7fa3a01587a0 2024-09-15T23:54:10.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa3a4d04640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0072eb0 con 0x7fa3a006e680 2024-09-15T23:54:10.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa3a4d04640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a00731b0 con 0x7fa3a00b37d0 2024-09-15T23:54:10.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa39ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3a01587a0 0x7fa3a0154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:10.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa39ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3a01587a0 0x7fa3a0154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58928/0 (socket says 172.21.15.112:58928) 2024-09-15T23:54:10.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa39ed9d640 1 -- 172.21.15.112:0/1776742154 learned_addr learned my addr 172.21.15.112:0/1776742154 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:10.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa39e59c640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3a006e680 0x7fa3a0146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:10.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa39dd9b640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3a00b37d0 0x7fa3a0154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:10.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa39ed9d640 1 -- 172.21.15.112:0/1776742154 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3a00b37d0 msgr2=0x7fa3a0154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:10.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa39ed9d640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3a00b37d0 0x7fa3a0154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa39ed9d640 1 -- 172.21.15.112:0/1776742154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3a006e680 msgr2=0x7fa3a0146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:10.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa39ed9d640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3a006e680 0x7fa3a0146010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa39ed9d640 1 -- 172.21.15.112:0/1776742154 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a00ae380 con 0x7fa3a01587a0 2024-09-15T23:54:10.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa39e59c640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3a006e680 0x7fa3a0146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:10.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa39ed9d640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3a01587a0 0x7fa3a0154c50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa39800d560 tx=0x7fa39800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:10.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa396ffd640 1 -- 172.21.15.112:0/1776742154 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3980125f0 con 0x7fa3a01587a0 2024-09-15T23:54:10.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa396ffd640 1 -- 172.21.15.112:0/1776742154 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa398019070 con 0x7fa3a01587a0 2024-09-15T23:54:10.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa3a4d04640 1 -- 172.21.15.112:0/1776742154 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a00ae660 con 0x7fa3a01587a0 2024-09-15T23:54:10.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa396ffd640 1 -- 172.21.15.112:0/1776742154 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3980129f0 con 0x7fa3a01587a0 2024-09-15T23:54:10.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa3a4d04640 1 -- 172.21.15.112:0/1776742154 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a00aec20 con 0x7fa3a01587a0 2024-09-15T23:54:10.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa396ffd640 1 -- 172.21.15.112:0/1776742154 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa398012b90 con 0x7fa3a01587a0 2024-09-15T23:54:10.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.541+0000 7fa396ffd640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3800678f0 0x7fa380069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa39e59c640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3800678f0 0x7fa380069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:10.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa396ffd640 1 -- 172.21.15.112:0/1776742154 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa398086390 con 0x7fa3a01587a0 2024-09-15T23:54:10.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa39e59c640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3800678f0 0x7fa380069db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa3900af000 tx=0x7fa3900a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:10.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 Processor -- start 2024-09-15T23:54:10.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 -- start start 2024-09-15T23:54:10.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a94cb20 0x55a92a94cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a902d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a903290 0x55a92a903670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a92a7eab60 con 0x55a92a94d440 2024-09-15T23:54:10.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a92a751c70 con 0x55a92a94cb20 2024-09-15T23:54:10.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55a92a6f7ed0 con 0x55a92a903290 2024-09-15T23:54:10.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa39dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a902d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:10.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa39dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a902d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58936/0 (socket says 172.21.15.112:58936) 2024-09-15T23:54:10.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa39dd9b640 1 -- 172.21.15.112:0/2862863880 learned_addr learned my addr 172.21.15.112:0/2862863880 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:10.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa39dd9b640 1 -- 172.21.15.112:0/2862863880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a903290 msgr2=0x55a92a903670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:10.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa39dd9b640 1 --2- 172.21.15.112:0/2862863880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a903290 0x55a92a903670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa39dd9b640 1 -- 172.21.15.112:0/2862863880 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a94cb20 msgr2=0x55a92a94cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:10.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa39dd9b640 1 --2- 172.21.15.112:0/2862863880 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a94cb20 0x55a92a94cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa39dd9b640 1 -- 172.21.15.112:0/2862863880 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a92a709e50 con 0x55a92a94d440 2024-09-15T23:54:10.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa39dd9b640 1 --2- 172.21.15.112:0/2862863880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a902d50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa388002130 tx=0x7fa38800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab04cdb464a9904a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:10.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa37ffff640 1 -- 172.21.15.112:0/2862863880 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388004d70 con 0x55a92a94d440 2024-09-15T23:54:10.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa37ffff640 1 -- 172.21.15.112:0/2862863880 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa388007110 con 0x55a92a94d440 2024-09-15T23:54:10.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa37ffff640 1 -- 172.21.15.112:0/2862863880 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388007500 con 0x55a92a94d440 2024-09-15T23:54:10.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/2862863880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 msgr2=0x55a92a902d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:10.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/2862863880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a902d50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa388002130 tx=0x7fa38800d520 comp rx=0 tx=0).stop 2024-09-15T23:54:10.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/2862863880 shutdown_connections 2024-09-15T23:54:10.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/2862863880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a903290 0x55a92a903670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/2862863880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a902d50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/2862863880 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a94cb20 0x55a92a94cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/2862863880 >> 172.21.15.112:0/2862863880 conn(0x55a92a909600 msgr2=0x55a92a901630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:10.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/2862863880 shutdown_connections 2024-09-15T23:54:10.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/2862863880 wait complete. 2024-09-15T23:54:10.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 -- start start 2024-09-15T23:54:10.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.545+0000 7fa3a7dc0000 1 Processor -- start 2024-09-15T23:54:10.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a94cb20 0x55a92a907e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a90dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a908390 0x55a92a90e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a92a7b3b00 con 0x55a92a94d440 2024-09-15T23:54:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a92a72c360 con 0x55a92a908390 2024-09-15T23:54:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55a92a7292d0 con 0x55a92a94cb20 2024-09-15T23:54:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 10 client.0 _ll_register_callbacks cb 0x55a92a8ee820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:54:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa39dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a90dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa39dd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a90dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58938/0 (socket says 172.21.15.112:58938) 2024-09-15T23:54:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa39dd9b640 1 -- 172.21.15.112:0/244476224 learned_addr learned my addr 172.21.15.112:0/244476224 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa39e59c640 1 --2- 172.21.15.112:0/244476224 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a94cb20 0x55a92a907e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa39ed9d640 1 --2- 172.21.15.112:0/244476224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a908390 0x55a92a90e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa39dd9b640 1 -- 172.21.15.112:0/244476224 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a94cb20 msgr2=0x55a92a907e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:10.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa39dd9b640 1 --2- 172.21.15.112:0/244476224 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a94cb20 0x55a92a907e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa39dd9b640 1 -- 172.21.15.112:0/244476224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a908390 msgr2=0x55a92a90e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa39dd9b640 1 --2- 172.21.15.112:0/244476224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a908390 0x55a92a90e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa39dd9b640 1 -- 172.21.15.112:0/244476224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a92a6f8120 con 0x55a92a94d440 2024-09-15T23:54:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa39ed9d640 1 --2- 172.21.15.112:0/244476224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a908390 0x55a92a90e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa39dd9b640 1 --2- 172.21.15.112:0/244476224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a90dcf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55a92a809ac0 tx=0x7fa388000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b50aacc8cbf801 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa37d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:54:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa37d7fa640 1 -- 172.21.15.112:0/244476224 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388023020 con 0x55a92a94d440 2024-09-15T23:54:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa37d7fa640 1 -- 172.21.15.112:0/244476224 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa3880075f0 con 0x55a92a94d440 2024-09-15T23:54:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/244476224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa388007110 con 0x55a92a94d440 2024-09-15T23:54:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa37d7fa640 1 -- 172.21.15.112:0/244476224 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fa38802d050 con 0x55a92a94d440 2024-09-15T23:54:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 10 client.4641 fetch_fsmap learned FSMap version 8 2024-09-15T23:54:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/244476224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55a92a6f1450 con 0x55a92a94d440 2024-09-15T23:54:10.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa37d7fa640 1 -- 172.21.15.112:0/244476224 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa388007110 con 0x55a92a94d440 2024-09-15T23:54:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa37d7fa640 1 -- 172.21.15.112:0/244476224 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7fa388030020 con 0x55a92a94d440 2024-09-15T23:54:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 10 client.4641 fetch_fsmap finished waiting for FSMap version 8 2024-09-15T23:54:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 10 client.4641 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:54:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 20 client.4641 populate_metadata read hostname 'smithi112' 2024-09-15T23:54:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/244476224 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55a92a952f50 0x55a92a953330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 4 client.4641 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:54:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/244476224 --> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a92a6ebc00 con 0x55a92a952f50 2024-09-15T23:54:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa39e59c640 1 --2- 172.21.15.112:0/244476224 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55a92a952f50 0x55a92a953330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa39e59c640 1 --2- 172.21.15.112:0/244476224 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55a92a952f50 0x55a92a953330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=151b8f87b46a6c9e server_cookie=59a635d8f79afe48 in_seq=0 out_seq=0 2024-09-15T23:54:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.549+0000 7fa37d7fa640 10 client.4641 ms_handle_connect on v2:172.21.15.169:6834/2205745557 2024-09-15T23:54:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa37d7fa640 1 -- 172.21.15.112:0/244476224 <== mds.0 v2:172.21.15.169:6834/2205745557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a92a6ebc00 con 0x55a92a952f50 2024-09-15T23:54:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa37d7fa640 10 client.4641 handle_command_reply: tid=0 2024-09-15T23:54:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa3a7dc0000 1 client.4641 shutdown 2024-09-15T23:54:10.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/244476224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 msgr2=0x55a92a90dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/244476224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a90dcf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55a92a809ac0 tx=0x7fa388000f50 comp rx=0 tx=0).stop 2024-09-15T23:54:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/244476224 shutdown_connections 2024-09-15T23:54:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/244476224 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55a92a952f50 0x55a92a953330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/244476224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a908390 0x55a92a90e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/244476224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a90dcf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa37d7fa640 0 client.4641 ms_handle_reset on v2:172.21.15.169:6834/2205745557 2024-09-15T23:54:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/244476224 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a94cb20 0x55a92a907e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/244476224 >> 172.21.15.112:0/244476224 conn(0x55a92a903290 msgr2=0x55a92a901d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/244476224 shutdown_connections 2024-09-15T23:54:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/244476224 wait complete. 2024-09-15T23:54:10.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.553+0000 7fa3a7dc0000 20 client.4641 trim_cache size 0 max 16384 2024-09-15T23:54:10.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa3a7dc0000 1 Processor -- start 2024-09-15T23:54:10.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa3a7dc0000 1 -- start start 2024-09-15T23:54:10.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa3a7dc0000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a908390 0x55a92a963080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa3a7dc0000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a94cb20 0x55a92a9635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa3a7dc0000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a94ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa3a7dc0000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a02039b0 con 0x55a92a94d440 2024-09-15T23:54:10.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa3a7dc0000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0202d40 con 0x55a92a94cb20 2024-09-15T23:54:10.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa3a7dc0000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a0203360 con 0x55a92a908390 2024-09-15T23:54:10.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa39ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a94ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:10.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa39ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a94ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58946/0 (socket says 172.21.15.112:58946) 2024-09-15T23:54:10.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa39ed9d640 1 -- 172.21.15.112:0/963129008 learned_addr learned my addr 172.21.15.112:0/963129008 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:10.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa39ed9d640 1 -- 172.21.15.112:0/963129008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a908390 msgr2=0x55a92a963080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:10.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa39ed9d640 1 --2- 172.21.15.112:0/963129008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a908390 0x55a92a963080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa39ed9d640 1 -- 172.21.15.112:0/963129008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a94cb20 msgr2=0x55a92a9635c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:10.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa39ed9d640 1 --2- 172.21.15.112:0/963129008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a94cb20 0x55a92a9635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa39ed9d640 1 -- 172.21.15.112:0/963129008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a92a94d270 con 0x55a92a94d440 2024-09-15T23:54:10.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa39ed9d640 1 --2- 172.21.15.112:0/963129008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a94ac20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa39805eb30 tx=0x7fa398056c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21ab97528a4454b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:10.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa37f7fe640 1 -- 172.21.15.112:0/963129008 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39806e070 con 0x55a92a94d440 2024-09-15T23:54:10.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa37f7fe640 1 -- 172.21.15.112:0/963129008 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39805f060 con 0x55a92a94d440 2024-09-15T23:54:10.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.569+0000 7fa37f7fe640 1 -- 172.21.15.112:0/963129008 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398012e80 con 0x55a92a94d440 2024-09-15T23:54:10.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/963129008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 msgr2=0x55a92a94ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:10.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/963129008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a94ac20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa39805eb30 tx=0x7fa398056c40 comp rx=0 tx=0).stop 2024-09-15T23:54:10.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/963129008 shutdown_connections 2024-09-15T23:54:10.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/963129008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a94ac20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/963129008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a94cb20 0x55a92a9635c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/963129008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a908390 0x55a92a963080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/963129008 >> 172.21.15.112:0/963129008 conn(0x55a92a903290 msgr2=0x55a92a907ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:10.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/963129008 shutdown_connections 2024-09-15T23:54:10.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/963129008 wait complete. 2024-09-15T23:54:10.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 -- start start 2024-09-15T23:54:10.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 Processor -- start 2024-09-15T23:54:10.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a908390 0x55a92a9bf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a94cb20 0x55a92a9567f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a956d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a92a750f80 con 0x55a92a94d440 2024-09-15T23:54:10.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a92a709ca0 con 0x55a92a908390 2024-09-15T23:54:10.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55a92a7562a0 con 0x55a92a94cb20 2024-09-15T23:54:10.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 10 client.0 _ll_register_callbacks cb 0x7fa388001fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:54:10.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa39ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a956d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:10.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa39ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a956d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58962/0 (socket says 172.21.15.112:58962) 2024-09-15T23:54:10.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa39ed9d640 1 -- 172.21.15.112:0/4067359994 learned_addr learned my addr 172.21.15.112:0/4067359994 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:10.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa39ed9d640 1 -- 172.21.15.112:0/4067359994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a94cb20 msgr2=0x55a92a9567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:10.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa39ed9d640 1 --2- 172.21.15.112:0/4067359994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a94cb20 0x55a92a9567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa39ed9d640 1 -- 172.21.15.112:0/4067359994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a908390 msgr2=0x55a92a9bf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:10.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa39ed9d640 1 --2- 172.21.15.112:0/4067359994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a908390 0x55a92a9bf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa39ed9d640 1 -- 172.21.15.112:0/4067359994 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a92a6d8fd0 con 0x55a92a94d440 2024-09-15T23:54:10.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa39ed9d640 1 --2- 172.21.15.112:0/4067359994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a956d30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa398056d30 tx=0x7fa398006d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab50854db994b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:10.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa37d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:54:10.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa37d7fa640 1 -- 172.21.15.112:0/4067359994 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39806e040 con 0x55a92a94d440 2024-09-15T23:54:10.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa37d7fa640 1 -- 172.21.15.112:0/4067359994 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa398054780 con 0x55a92a94d440 2024-09-15T23:54:10.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/4067359994 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa39805f060 con 0x55a92a94d440 2024-09-15T23:54:10.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa37d7fa640 1 -- 172.21.15.112:0/4067359994 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fa398084050 con 0x55a92a94d440 2024-09-15T23:54:10.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 10 client.4647 fetch_fsmap learned FSMap version 8 2024-09-15T23:54:10.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/4067359994 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55a92a7d4750 con 0x55a92a94d440 2024-09-15T23:54:10.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa37d7fa640 1 -- 172.21.15.112:0/4067359994 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39805f060 con 0x55a92a94d440 2024-09-15T23:54:10.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa37d7fa640 1 -- 172.21.15.112:0/4067359994 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7fa398013070 con 0x55a92a94d440 2024-09-15T23:54:10.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2024-09-15T23:54:10.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 10 client.4647 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:54:10.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 20 client.4647 populate_metadata read hostname 'smithi112' 2024-09-15T23:54:10.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/4067359994 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55a92a957270 0x55a92a957650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:10.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 4 client.4647 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:54:10.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/4067359994 --> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] -- command(tid 0: {"prefix": "status"}) -- 0x55a92a75f3a0 con 0x55a92a957270 2024-09-15T23:54:10.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa39e59c640 1 --2- 172.21.15.112:0/4067359994 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55a92a957270 0x55a92a957650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:10.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa37d7fa640 10 client.4647 ms_handle_connect on v2:172.21.15.169:6834/2205745557 2024-09-15T23:54:10.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.573+0000 7fa39e59c640 1 --2- 172.21.15.112:0/4067359994 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55a92a957270 0x55a92a957650 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8352d63ed9963bd0 server_cookie=4d5d17b5800c10eb in_seq=0 out_seq=0 2024-09-15T23:54:10.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa37d7fa640 1 -- 172.21.15.112:0/4067359994 <== mds.0 v2:172.21.15.169:6834/2205745557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55a92a75f3a0 con 0x55a92a957270 2024-09-15T23:54:10.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa37d7fa640 10 client.4647 handle_command_reply: tid=0 2024-09-15T23:54:10.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a7dc0000 1 client.4647 shutdown 2024-09-15T23:54:10.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/4067359994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 msgr2=0x55a92a956d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:10.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/4067359994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a956d30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa398056d30 tx=0x7fa398006d90 comp rx=0 tx=0).stop 2024-09-15T23:54:10.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/4067359994 shutdown_connections 2024-09-15T23:54:10.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/4067359994 >> [v2:172.21.15.169:6834/2205745557,v1:172.21.15.169:6835/2205745557] conn(0x55a92a957270 0x55a92a957650 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/4067359994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a92a94d440 0x55a92a956d30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/4067359994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55a92a94cb20 0x55a92a9567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a7dc0000 1 --2- 172.21.15.112:0/4067359994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a92a908390 0x55a92a9bf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa37d7fa640 0 client.4647 ms_handle_reset on v2:172.21.15.169:6834/2205745557 2024-09-15T23:54:10.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/4067359994 >> 172.21.15.112:0/4067359994 conn(0x55a92a903290 msgr2=0x55a92a962070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:10.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/4067359994 shutdown_connections 2024-09-15T23:54:10.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a7dc0000 1 -- 172.21.15.112:0/4067359994 wait complete. 2024-09-15T23:54:10.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a7dc0000 20 client.4647 trim_cache size 0 max 16384 2024-09-15T23:54:10.584 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:54:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "1af6b673-4d40-4109-af4e-78662faa7df8", 2024-09-15T23:54:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-15T23:54:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4279, 2024-09-15T23:54:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-15T23:54:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-15T23:54:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-15T23:54:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 19.823190727, 2024-09-15T23:54:10.584 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 8, 2024-09-15T23:54:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 26, 2024-09-15T23:54:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 26, 2024-09-15T23:54:10.585 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 25.901722565 2024-09-15T23:54:10.585 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:54:10.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a4d04640 1 -- 172.21.15.112:0/1776742154 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3800678f0 msgr2=0x7fa380069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a4d04640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3800678f0 0x7fa380069db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa3900af000 tx=0x7fa3900a7000 comp rx=0 tx=0).stop 2024-09-15T23:54:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a4d04640 1 -- 172.21.15.112:0/1776742154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3a01587a0 msgr2=0x7fa3a0154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a4d04640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3a01587a0 0x7fa3a0154c50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa39800d560 tx=0x7fa39800da20 comp rx=0 tx=0).stop 2024-09-15T23:54:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a4d04640 1 -- 172.21.15.112:0/1776742154 shutdown_connections 2024-09-15T23:54:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a4d04640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3800678f0 0x7fa380069db0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a4d04640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3a01587a0 0x7fa3a0154c50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a4d04640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3a00b37d0 0x7fa3a0154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a4d04640 1 --2- 172.21.15.112:0/1776742154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3a006e680 0x7fa3a0146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a4d04640 1 -- 172.21.15.112:0/1776742154 >> 172.21.15.112:0/1776742154 conn(0x7fa3a00b1f90 msgr2=0x7fa3a0151bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a4d04640 1 -- 172.21.15.112:0/1776742154 shutdown_connections 2024-09-15T23:54:10.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:10.577+0000 7fa3a4d04640 1 -- 172.21.15.112:0/1776742154 wait complete. 2024-09-15T23:54:10.594 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T23:54:10.603 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T23:54:10.603 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T23:54:10.604 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T23:54:10.604 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-15T23:54:10.625 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-15T23:54:10.625 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-15T23:54:10.626 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-15T23:54:10.626 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T23:54:10.626 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:10.626 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-15T23:54:10.626 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T23:54:10.626 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-15T23:54:10.626 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-15T23:54:10.626 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T23:54:10.626 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T23:54:10.626 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-15T23:54:10.626 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T23:54:10.626 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-15T23:54:10.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:10.627 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-15T23:54:10.632 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-15T23:54:10.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:10.633 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:54:10.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:10.684 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-15T23:54:10.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:10.880 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-09-15T23:54:10.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:10.886 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link delete ceph-brx 2024-09-15T23:54:10.947 INFO:teuthology.orchestra.run.smithi169.stderr:Cannot find device "ceph-brx" 2024-09-15T23:54:10.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:54:10.949 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-15T23:54:10.949 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-15T23:54:10.949 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:54:11.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e552df640 1 Processor -- start 2024-09-15T23:54:11.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e552df640 1 -- start start 2024-09-15T23:54:11.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e552df640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0e50143fe0 0x7f0e501443c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:11.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e552df640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0e500ae630 0x7f0e5006ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:11.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e552df640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e50070440 0x7f0e500708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:11.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e552df640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0e500b6c50 con 0x7f0e500ae630 2024-09-15T23:54:11.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e552df640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f0e500b6ea0 con 0x7f0e50143fe0 2024-09-15T23:54:11.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e552df640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0e500b51d0 con 0x7f0e50070440 2024-09-15T23:54:11.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e4e7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0e500ae630 0x7f0e5006ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:11.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e4e7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0e500ae630 0x7f0e5006ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58976/0 (socket says 172.21.15.112:58976) 2024-09-15T23:54:11.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e4e7fc640 1 -- 172.21.15.112:0/1359109019 learned_addr learned my addr 172.21.15.112:0/1359109019 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:11.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e4f7fe640 1 --2- 172.21.15.112:0/1359109019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e50070440 0x7f0e500708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:11.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e4e7fc640 1 -- 172.21.15.112:0/1359109019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e50070440 msgr2=0x7f0e500708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:11.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e4e7fc640 1 --2- 172.21.15.112:0/1359109019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e50070440 0x7f0e500708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:11.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e4effd640 1 --2- 172.21.15.112:0/1359109019 >> v2:172.21.15.169:3300/0 conn(0x7f0e50143fe0 0x7f0e501443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:11.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e4e7fc640 1 -- 172.21.15.112:0/1359109019 >> v2:172.21.15.169:3300/0 conn(0x7f0e50143fe0 msgr2=0x7f0e501443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:11.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e4e7fc640 1 --2- 172.21.15.112:0/1359109019 >> v2:172.21.15.169:3300/0 conn(0x7f0e50143fe0 0x7f0e501443c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:11.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e4e7fc640 1 -- 172.21.15.112:0/1359109019 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e500b54b0 con 0x7f0e500ae630 2024-09-15T23:54:11.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.081+0000 7f0e4f7fe640 1 --2- 172.21.15.112:0/1359109019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e50070440 0x7f0e500708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:11.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.085+0000 7f0e4e7fc640 1 --2- 172.21.15.112:0/1359109019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e500ae630 0x7f0e5006ff00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0e5006ea70 tx=0x7f0e4401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac131e778620b2bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:11.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.085+0000 7f0e4dffb640 1 -- 172.21.15.112:0/1359109019 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e440b0070 con 0x7f0e500ae630 2024-09-15T23:54:11.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.085+0000 7f0e4dffb640 1 -- 172.21.15.112:0/1359109019 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e440ab600 con 0x7f0e500ae630 2024-09-15T23:54:11.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.085+0000 7f0e4dffb640 1 -- 172.21.15.112:0/1359109019 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e440ab9d0 con 0x7f0e500ae630 2024-09-15T23:54:11.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.085+0000 7f0e552df640 1 -- 172.21.15.112:0/1359109019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e500ae630 msgr2=0x7f0e5006ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:11.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.085+0000 7f0e552df640 1 --2- 172.21.15.112:0/1359109019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e500ae630 0x7f0e5006ff00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0e5006ea70 tx=0x7f0e4401c490 comp rx=0 tx=0).stop 2024-09-15T23:54:11.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.085+0000 7f0e552df640 1 -- 172.21.15.112:0/1359109019 shutdown_connections 2024-09-15T23:54:11.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.085+0000 7f0e552df640 1 --2- 172.21.15.112:0/1359109019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e500ae630 0x7f0e5006ff00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:11.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.085+0000 7f0e552df640 1 --2- 172.21.15.112:0/1359109019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e50070440 0x7f0e500708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:11.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.085+0000 7f0e552df640 1 --2- 172.21.15.112:0/1359109019 >> v2:172.21.15.169:3300/0 conn(0x7f0e50143fe0 0x7f0e501443c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:11.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.085+0000 7f0e552df640 1 -- 172.21.15.112:0/1359109019 >> 172.21.15.112:0/1359109019 conn(0x7f0e5009aa00 msgr2=0x7f0e500b6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:11.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.085+0000 7f0e552df640 1 -- 172.21.15.112:0/1359109019 shutdown_connections 2024-09-15T23:54:11.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.085+0000 7f0e552df640 1 -- 172.21.15.112:0/1359109019 wait complete. 2024-09-15T23:54:11.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e552df640 1 Processor -- start 2024-09-15T23:54:11.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e552df640 1 -- start start 2024-09-15T23:54:11.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e552df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e50070440 0x7f0e50157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:11.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e552df640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e500ae630 0x7f0e5015d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:11.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e552df640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e50143fe0 0x7f0e5013cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:11.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e552df640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5015f7c0 con 0x7f0e50070440 2024-09-15T23:54:11.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e552df640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5015f640 con 0x7f0e500ae630 2024-09-15T23:54:11.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e552df640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5015f940 con 0x7f0e50143fe0 2024-09-15T23:54:11.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e4effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e50070440 0x7f0e50157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:11.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e4effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e50070440 0x7f0e50157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58980/0 (socket says 172.21.15.112:58980) 2024-09-15T23:54:11.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e4effd640 1 -- 172.21.15.112:0/857324094 learned_addr learned my addr 172.21.15.112:0/857324094 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:11.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e4f7fe640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e50143fe0 0x7f0e5013cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:11.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e4e7fc640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e500ae630 0x7f0e5015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:11.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e4effd640 1 -- 172.21.15.112:0/857324094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e50143fe0 msgr2=0x7f0e5013cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:11.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e4effd640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e50143fe0 0x7f0e5013cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:11.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e4effd640 1 -- 172.21.15.112:0/857324094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e500ae630 msgr2=0x7f0e5015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:11.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e4effd640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e500ae630 0x7f0e5015d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:11.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e4effd640 1 -- 172.21.15.112:0/857324094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5015dbc0 con 0x7f0e50070440 2024-09-15T23:54:11.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e4f7fe640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e50143fe0 0x7f0e5013cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:54:11.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e4effd640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e50070440 0x7f0e50157140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000c7f0 tx=0x7f0e4000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:11.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e377fe640 1 -- 172.21.15.112:0/857324094 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e40015070 con 0x7f0e50070440 2024-09-15T23:54:11.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e377fe640 1 -- 172.21.15.112:0/857324094 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e40007820 con 0x7f0e50070440 2024-09-15T23:54:11.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e552df640 1 -- 172.21.15.112:0/857324094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e5015e060 con 0x7f0e50070440 2024-09-15T23:54:11.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e377fe640 1 -- 172.21.15.112:0/857324094 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e40007c10 con 0x7f0e50070440 2024-09-15T23:54:11.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e552df640 1 -- 172.21.15.112:0/857324094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e5013c1c0 con 0x7f0e50070440 2024-09-15T23:54:11.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e552df640 1 -- 172.21.15.112:0/857324094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e5006ff00 con 0x7f0e50070440 2024-09-15T23:54:11.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.089+0000 7f0e377fe640 1 -- 172.21.15.112:0/857324094 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e40018070 con 0x7f0e50070440 2024-09-15T23:54:11.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.093+0000 7f0e377fe640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0e3c0678c0 0x7f0e3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:11.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.093+0000 7f0e377fe640 1 -- 172.21.15.112:0/857324094 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0e40086000 con 0x7f0e50070440 2024-09-15T23:54:11.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.093+0000 7f0e4e7fc640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0e3c0678c0 0x7f0e3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:11.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.093+0000 7f0e4e7fc640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0e3c0678c0 0x7f0e3c069d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e440ad000 tx=0x7f0e44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:11.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.097+0000 7f0e377fe640 1 -- 172.21.15.112:0/857324094 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0e5015dbc0 con 0x7f0e50070440 2024-09-15T23:54:11.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.293+0000 7f0e552df640 1 -- 172.21.15.112:0/857324094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0e500d1c20 con 0x7f0e50070440 2024-09-15T23:54:11.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.293+0000 7f0e377fe640 1 -- 172.21.15.112:0/857324094 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f0e40056800 con 0x7f0e50070440 2024-09-15T23:54:11.297 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T23:54:11.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.297+0000 7f0e552df640 1 -- 172.21.15.112:0/857324094 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0e3c0678c0 msgr2=0x7f0e3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:11.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.297+0000 7f0e552df640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0e3c0678c0 0x7f0e3c069d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e440ad000 tx=0x7f0e44008040 comp rx=0 tx=0).stop 2024-09-15T23:54:11.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.297+0000 7f0e552df640 1 -- 172.21.15.112:0/857324094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e50070440 msgr2=0x7f0e50157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:11.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.297+0000 7f0e552df640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e50070440 0x7f0e50157140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000c7f0 tx=0x7f0e4000ccb0 comp rx=0 tx=0).stop 2024-09-15T23:54:11.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.297+0000 7f0e552df640 1 -- 172.21.15.112:0/857324094 shutdown_connections 2024-09-15T23:54:11.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.297+0000 7f0e552df640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0e3c0678c0 0x7f0e3c069d80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:11.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.297+0000 7f0e552df640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e50143fe0 0x7f0e5013cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:11.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.297+0000 7f0e552df640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e500ae630 0x7f0e5015d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:11.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.297+0000 7f0e552df640 1 --2- 172.21.15.112:0/857324094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e50070440 0x7f0e50157140 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:11.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.297+0000 7f0e552df640 1 -- 172.21.15.112:0/857324094 >> 172.21.15.112:0/857324094 conn(0x7f0e5009aa00 msgr2=0x7f0e50158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:11.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.297+0000 7f0e552df640 1 -- 172.21.15.112:0/857324094 shutdown_connections 2024-09-15T23:54:11.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11.297+0000 7f0e552df640 1 -- 172.21.15.112:0/857324094 wait complete. 2024-09-15T23:54:11.315 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:54:11.315 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:54:11.315 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-15T23:54:11.315 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:54:11.315 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:11.316 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:54:11.316 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:54:11.316 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:54:11.316 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:54:11.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:11.316 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-15T23:54:11.321 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:54:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:54:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:54:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-15T23:54:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:11.322 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-15T23:54:11.322 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-15T23:54:11.322 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:11.323 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:54:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T23:54:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42445sec preferred_lft 42445sec 2024-09-15T23:54:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2024-09-15T23:54:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:11.323 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T23:54:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:5c:cd:1e:d6 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T23:54:11.323 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:11.323 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T23:54:11.324 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:11.324 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:54:11.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2024-09-15T23:54:11.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2024-09-15T23:54:11.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2024-09-15T23:54:11.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T23:54:11.324 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:54:11.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:11.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:11.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:11.441 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:54:11.490 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-15T23:54:11.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:11.491 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-15T23:54:11.541 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-15T23:54:11.542 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:54:11.542 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T23:54:11.542 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:54:11.542 INFO:teuthology.orchestra.run.smithi112.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T23:54:11.542 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T23:54:11.542 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:54:11.542 INFO:teuthology.orchestra.run.smithi112.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:11.542 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:11.542 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:11.542 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:54:11.542 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:11.543 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:54:11.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:54:11.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:54:11.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:54:11.543 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:54:11.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:11.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:11.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:11.659 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-15T23:54:11.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:11.708 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2024-09-15T23:54:11.755 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:11.755 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:54:11.756 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:11.756 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T23:54:11.756 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:54:11.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:11.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:11.871 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T23:54:11.871 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:11.871 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:54:11.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T23:54:11.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T23:54:11.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T23:54:11.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T23:54:11.872 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T23:54:11.872 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:54:11.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:11.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:11.960 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:11.960 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:54:11.960 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-15T23:54:11.960 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T23:54:11.960 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:54:12.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:12.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:12.066 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T23:54:12.066 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:54:12.066 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:12.114 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:54:12.114 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:54:12.115 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:12.161 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:54:12.211 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:12.262 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:54:12.262 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:54:12.263 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:54:12.263 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:54:12.263 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:54:12.263 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:54:12.263 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:54:12.263 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:54:12.263 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:54:12.263 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:54:12.263 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:54:12.263 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:54:12.263 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:12.263 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:54:12.263 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:54:12.263 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:54:12.264 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:54:12.264 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:54:12.264 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:12.264 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:54:12.264 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:12.264 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:54:12.264 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:54:12.264 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:54:12.264 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:54:12.264 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:54:12.265 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:54:12.265 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:54:12.265 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:54:12.265 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:12.265 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:12.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:12.266 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:54:12.314 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:54:12.314 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T23:54:12.359 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:54:12.373 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:12.419 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:54:12.419 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:54:12.419 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:54:12.419 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:54:12.419 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:54:12.419 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:54:12.419 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:54:12.419 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:54:12.419 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:54:12.419 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:54:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:54:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:54:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:54:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:54:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:54:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:54:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:54:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:54:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:54:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:54:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:54:12.421 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:54:12.421 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:54:12.421 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:54:12.421 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:54:12.421 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:54:12.421 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:12.421 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:12.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:12.422 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:54:12.437 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:2024-09-15T23:54:12.433+0000 7efe45b68580 -1 init, newargv = 0x557e252437b0 newargc=15 2024-09-15T23:54:12.438 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[35913]: starting ceph client 2024-09-15T23:54:12.444 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[35913]: starting fuse 2024-09-15T23:54:13.201 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:54:13.204 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:54:13.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:54:13.560 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:54:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:54:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:54:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:54:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:54:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:54:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:54:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:54:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:54:13.609 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:54:13.609 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:54:13.609 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:54:13.609 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:13.609 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:54:13.609 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:54:13.609 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:54:13.609 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:54:13.609 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:54:13.609 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:13.609 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:54:13.609 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:13.609 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:54:13.610 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:54:13.610 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:54:13.610 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:54:13.610 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:54:13.610 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:54:13.610 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:54:13.610 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:54:13.610 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:13.610 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:13.610 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:13.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:13.611 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:54:13.659 INFO:teuthology.orchestra.run.smithi112.stdout:45 2024-09-15T23:54:13.659 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T23:54:13.659 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:54:13.659 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2024-09-15T23:54:13.660 DEBUG:teuthology.orchestra.run.smithi112:> import re 2024-09-15T23:54:13.660 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:54:13.660 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-15T23:54:13.660 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:13.660 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2024-09-15T23:54:13.660 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:54:13.660 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2024-09-15T23:54:13.660 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:54:13.660 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> return f 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:13.661 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.0")) 2024-09-15T23:54:13.662 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:54:13.788 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.0.35913.asok 2024-09-15T23:54:13.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:13.799 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35913.asok 2024-09-15T23:54:13.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:13.799 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35913.asok status 2024-09-15T23:54:13.955 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:54:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2024-09-15T23:54:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:54:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:54:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "0", 2024-09-15T23:54:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2024-09-15T23:54:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:54:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "35913", 2024-09-15T23:54:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2024-09-15T23:54:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:13.956 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2024-09-15T23:54:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2024-09-15T23:54:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4659, 2024-09-15T23:54:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2024-09-15T23:54:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2024-09-15T23:54:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2024-09-15T23:54:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 4659 2024-09-15T23:54:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:54:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:54:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:54:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3584085360 2024-09-15T23:54:13.957 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:54:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:54:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:54:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3584085360 2024-09-15T23:54:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.4659 192.168.0.1:0/3584085360", 2024-09-15T23:54:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.1:0/3584085360", 2024-09-15T23:54:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2024-09-15T23:54:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 8, 2024-09-15T23:54:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 26, 2024-09-15T23:54:13.958 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:54:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2024-09-15T23:54:13.959 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2024-09-15T23:54:13.959 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:54:13.969 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-15T23:54:13.969 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:54:14.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.089+0000 7f2fabfb2640 1 Processor -- start 2024-09-15T23:54:14.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.089+0000 7f2fabfb2640 1 -- start start 2024-09-15T23:54:14.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fabfb2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa40cf620 0x7f2fa4168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:14.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fabfb2640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fa40d0300 con 0x7f2fa4161a60 2024-09-15T23:54:14.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fabfb2640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fa40cfab0 con 0x7f2fa40d3060 2024-09-15T23:54:14.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fabfb2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa406e6c0 con 0x7f2fa40cf620 2024-09-15T23:54:14.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa9d4e640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2fa4161a60 0x7f2fa40d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36236/0 (socket says 172.21.15.112:36236) 2024-09-15T23:54:14.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa9d4e640 1 -- 172.21.15.112:0/1492042092 learned_addr learned my addr 172.21.15.112:0/1492042092 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:14.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2faa54f640 1 --2- 172.21.15.112:0/1492042092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa40cf620 0x7f2fa4168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:14.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 -- 172.21.15.112:0/1492042092 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2786961379 0 0) 0x7f2fa0001120 con 0x7f2fa4161a60 2024-09-15T23:54:14.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 -- 172.21.15.112:0/1492042092 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f90003530 con 0x7f2fa4161a60 2024-09-15T23:54:14.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 -- 172.21.15.112:0/1492042092 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3828635506 0 0) 0x7f2f90003530 con 0x7f2fa4161a60 2024-09-15T23:54:14.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 -- 172.21.15.112:0/1492042092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa40cf620 msgr2=0x7f2fa4168f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:14.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 --2- 172.21.15.112:0/1492042092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa40cf620 0x7f2fa4168f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:14.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 -- 172.21.15.112:0/1492042092 >> v1:172.21.15.169:6789/0 conn(0x7f2fa40d3060 legacy=0x7f2fa40cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:14.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 -- 172.21.15.112:0/1492042092 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa40b0f60 con 0x7f2fa4161a60 2024-09-15T23:54:14.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 -- 172.21.15.112:0/1492042092 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f2fa0001850 con 0x7f2fa4161a60 2024-09-15T23:54:14.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 -- 172.21.15.112:0/1492042092 >> v1:172.21.15.112:6789/0 conn(0x7f2fa4161a60 legacy=0x7f2fa40d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 --2- 172.21.15.112:0/1492042092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f900039f0 0x7f2f90003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 --2- 172.21.15.112:0/1492042092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f90004810 0x7f2f90004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 --2- 172.21.15.112:0/1492042092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa40cf620 0x7f2f9000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 -- 172.21.15.112:0/1492042092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa406e6c0 con 0x7f2f90004810 2024-09-15T23:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 -- 172.21.15.112:0/1492042092 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2f90005530 con 0x7f2f900039f0 2024-09-15T23:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 -- 172.21.15.112:0/1492042092 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9000bf10 con 0x7f2fa40cf620 2024-09-15T23:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa954d640 1 --2- 172.21.15.112:0/1492042092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f90004810 0x7f2f90004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2faa54f640 1 --2- 172.21.15.112:0/1492042092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa40cf620 0x7f2f9000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa9d4e640 1 --2- 172.21.15.112:0/1492042092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f900039f0 0x7f2f90003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa954d640 1 -- 172.21.15.112:0/1492042092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa40cf620 msgr2=0x7f2f9000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa954d640 1 --2- 172.21.15.112:0/1492042092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa40cf620 0x7f2f9000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa954d640 1 -- 172.21.15.112:0/1492042092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f900039f0 msgr2=0x7f2f90003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:14.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa954d640 1 --2- 172.21.15.112:0/1492042092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f900039f0 0x7f2f90003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:14.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa954d640 1 -- 172.21.15.112:0/1492042092 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f90003530 con 0x7f2f90004810 2024-09-15T23:54:14.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa9d4e640 1 --2- 172.21.15.112:0/1492042092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f900039f0 0x7f2f90003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:14.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2faa54f640 1 --2- 172.21.15.112:0/1492042092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa40cf620 0x7f2f9000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:14.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa954d640 1 --2- 172.21.15.112:0/1492042092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f90004810 0x7f2f90004c90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2f94001780 tx=0x7f2f9401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758d7d71621b256 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:14.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.093+0000 7f2fa8d4c640 1 -- 172.21.15.112:0/1492042092 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f940013a0 con 0x7f2f90004810 2024-09-15T23:54:14.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fa8d4c640 1 -- 172.21.15.112:0/1492042092 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f940052f0 con 0x7f2f90004810 2024-09-15T23:54:14.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fa8d4c640 1 -- 172.21.15.112:0/1492042092 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94003840 con 0x7f2f90004810 2024-09-15T23:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 -- 172.21.15.112:0/1492042092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f90004810 msgr2=0x7f2f90004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 --2- 172.21.15.112:0/1492042092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f90004810 0x7f2f90004c90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2f94001780 tx=0x7f2f9401c3f0 comp rx=0 tx=0).stop 2024-09-15T23:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2faa54f640 1 -- 172.21.15.112:0/1492042092 reap_dead start 2024-09-15T23:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 -- 172.21.15.112:0/1492042092 shutdown_connections 2024-09-15T23:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 -- 172.21.15.112:0/1492042092 >> 172.21.15.112:0/1492042092 conn(0x7f2fa408bf90 msgr2=0x7f2fa409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 -- 172.21.15.112:0/1492042092 shutdown_connections 2024-09-15T23:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 -- 172.21.15.112:0/1492042092 wait complete. 2024-09-15T23:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 Processor -- start 2024-09-15T23:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 -- start start 2024-09-15T23:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f90004810 0x7f2fa40b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa4156660 0x7f2fa40cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:14.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fa415e530 0x7f2fa415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:14.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa4169720 con 0x7f2fa415e530 2024-09-15T23:54:14.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa406d190 con 0x7f2f90004810 2024-09-15T23:54:14.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa41698a0 con 0x7f2fa4156660 2024-09-15T23:54:14.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2faa54f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fa415e530 0x7f2fa415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:14.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2faa54f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fa415e530 0x7f2fa415e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:58992/0 (socket says 172.21.15.112:58992) 2024-09-15T23:54:14.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2faa54f640 1 -- 172.21.15.112:0/2834960976 learned_addr learned my addr 172.21.15.112:0/2834960976 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:14.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fa9d4e640 1 --2- 172.21.15.112:0/2834960976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f90004810 0x7f2fa40b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:14.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fa954d640 1 --2- 172.21.15.112:0/2834960976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa4156660 0x7f2fa40cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:14.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2faa54f640 1 -- 172.21.15.112:0/2834960976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa4156660 msgr2=0x7f2fa40cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:14.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2faa54f640 1 --2- 172.21.15.112:0/2834960976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa4156660 0x7f2fa40cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:14.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2faa54f640 1 -- 172.21.15.112:0/2834960976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f90004810 msgr2=0x7f2fa40b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:14.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2faa54f640 1 --2- 172.21.15.112:0/2834960976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f90004810 0x7f2fa40b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:14.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2faa54f640 1 -- 172.21.15.112:0/2834960976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa4156ae0 con 0x7f2fa415e530 2024-09-15T23:54:14.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2faa54f640 1 --2- 172.21.15.112:0/2834960976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fa415e530 0x7f2fa415e9b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2fa408dd40 tx=0x7f2f9c009d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:14.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2f9a7fc640 1 -- 172.21.15.112:0/2834960976 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c019070 con 0x7f2fa415e530 2024-09-15T23:54:14.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2f9a7fc640 1 -- 172.21.15.112:0/2834960976 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9c007cb0 con 0x7f2fa415e530 2024-09-15T23:54:14.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 -- 172.21.15.112:0/2834960976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa40ccd90 con 0x7f2fa415e530 2024-09-15T23:54:14.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2f9a7fc640 1 -- 172.21.15.112:0/2834960976 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c007e60 con 0x7f2fa415e530 2024-09-15T23:54:14.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.097+0000 7f2fabfb2640 1 -- 172.21.15.112:0/2834960976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa40cd350 con 0x7f2fa415e530 2024-09-15T23:54:14.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.101+0000 7f2fabfb2640 1 -- 172.21.15.112:0/2834960976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa415eef0 con 0x7f2fa415e530 2024-09-15T23:54:14.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.101+0000 7f2f9a7fc640 1 -- 172.21.15.112:0/2834960976 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2f9c01c070 con 0x7f2fa415e530 2024-09-15T23:54:14.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.101+0000 7f2f9a7fc640 1 --2- 172.21.15.112:0/2834960976 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2f880678c0 0x7f2f88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:14.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.101+0000 7f2f9a7fc640 1 -- 172.21.15.112:0/2834960976 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2f9c085aa0 con 0x7f2fa415e530 2024-09-15T23:54:14.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.101+0000 7f2fa9d4e640 1 --2- 172.21.15.112:0/2834960976 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2f880678c0 0x7f2f88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:14.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.101+0000 7f2fa9d4e640 1 --2- 172.21.15.112:0/2834960976 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2f880678c0 0x7f2f88069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00019c0 tx=0x7f2fa0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:14.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.105+0000 7f2f9a7fc640 1 -- 172.21.15.112:0/2834960976 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2f9c0562a0 con 0x7f2fa415e530 2024-09-15T23:54:14.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.305+0000 7f2fabfb2640 1 -- 172.21.15.112:0/2834960976 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2fa40cef10 con 0x7f2fa415e530 2024-09-15T23:54:14.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.305+0000 7f2f9a7fc640 1 -- 172.21.15.112:0/2834960976 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f2f9c055ba0 con 0x7f2fa415e530 2024-09-15T23:54:14.309 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T23:54:14.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.309+0000 7f2fabfb2640 1 -- 172.21.15.112:0/2834960976 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2f880678c0 msgr2=0x7f2f88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:14.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.309+0000 7f2fabfb2640 1 --2- 172.21.15.112:0/2834960976 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2f880678c0 0x7f2f88069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00019c0 tx=0x7f2fa0009040 comp rx=0 tx=0).stop 2024-09-15T23:54:14.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.309+0000 7f2fabfb2640 1 -- 172.21.15.112:0/2834960976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fa415e530 msgr2=0x7f2fa415e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.309+0000 7f2fabfb2640 1 --2- 172.21.15.112:0/2834960976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fa415e530 0x7f2fa415e9b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2fa408dd40 tx=0x7f2f9c009d50 comp rx=0 tx=0).stop 2024-09-15T23:54:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.309+0000 7f2fabfb2640 1 -- 172.21.15.112:0/2834960976 shutdown_connections 2024-09-15T23:54:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.309+0000 7f2fabfb2640 1 --2- 172.21.15.112:0/2834960976 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2f880678c0 0x7f2f88069d80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.309+0000 7f2fabfb2640 1 --2- 172.21.15.112:0/2834960976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fa415e530 0x7f2fa415e9b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.309+0000 7f2fabfb2640 1 --2- 172.21.15.112:0/2834960976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa4156660 0x7f2fa40cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.309+0000 7f2fabfb2640 1 --2- 172.21.15.112:0/2834960976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f90004810 0x7f2fa40b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.309+0000 7f2fabfb2640 1 -- 172.21.15.112:0/2834960976 >> 172.21.15.112:0/2834960976 conn(0x7f2fa408bf90 msgr2=0x7f2fa40b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.309+0000 7f2fabfb2640 1 -- 172.21.15.112:0/2834960976 shutdown_connections 2024-09-15T23:54:14.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14.309+0000 7f2fabfb2640 1 -- 172.21.15.112:0/2834960976 wait complete. 2024-09-15T23:54:14.326 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:54:14.326 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:54:14.327 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-15T23:54:14.327 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-15T23:54:14.327 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-15T23:54:14.327 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:54:14.327 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:54:14.327 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:54:14.328 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-15T23:54:14.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:14.328 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-15T23:54:14.334 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:54:14.334 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:54:14.334 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:54:14.334 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.334 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-15T23:54:14.335 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.335 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:14.335 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:14.335 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-15T23:54:14.335 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:14.335 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:14.335 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-15T23:54:14.335 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:14.335 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:14.335 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:54:14.335 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:14.336 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T23:54:14.336 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42442sec preferred_lft 42442sec 2024-09-15T23:54:14.336 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2024-09-15T23:54:14.336 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.336 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T23:54:14.337 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:5c:cd:1e:d6 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:14.337 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T23:54:14.337 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.337 INFO:teuthology.orchestra.run.smithi112.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:54:14.337 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:14.337 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:54:14.337 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.337 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T23:54:14.337 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.337 INFO:teuthology.orchestra.run.smithi112.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:54:14.338 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:14.338 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T23:54:14.338 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:14.338 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:54:14.389 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-15T23:54:14.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:14.390 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-15T23:54:14.442 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-15T23:54:14.443 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:54:14.443 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T23:54:14.443 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:54:14.443 INFO:teuthology.orchestra.run.smithi112.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T23:54:14.443 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T23:54:14.443 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:54:14.443 INFO:teuthology.orchestra.run.smithi112.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:14.443 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:14.443 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:14.443 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:54:14.444 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:14.444 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:54:14.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:54:14.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:54:14.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:54:14.444 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:54:14.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:14.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:14.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:14.562 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-15T23:54:14.611 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:54:14.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:14.611 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2024-09-15T23:54:14.658 INFO:teuthology.orchestra.run.smithi112.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-15T23:54:14.659 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:14.659 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:54:14.659 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:54:14.659 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-15T23:54:14.659 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:54:14.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:14.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:14.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:14.772 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-15T23:54:14.785 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:54:14.785 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:54:14.785 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:54:14.786 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.786 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-15T23:54:14.786 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.786 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:54:14.786 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether aa:97:15:4d:9a:f1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T23:54:14.786 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T23:54:14.786 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.786 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::a897:15ff:fe4d:9af1/64 scope link 2024-09-15T23:54:14.786 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:14.788 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-15T23:54:14.841 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:54:14.841 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:54:14.841 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:54:14.841 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.841 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-15T23:54:14.841 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.841 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:54:14.841 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether aa:97:15:4d:9a:f1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T23:54:14.842 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T23:54:14.842 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.842 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::a897:15ff:fe4d:9af1/64 scope link 2024-09-15T23:54:14.842 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:14.843 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-15T23:54:14.843 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:14.843 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:54:14.843 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-15T23:54:14.843 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-15T23:54:14.844 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-15T23:54:14.844 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-15T23:54:14.844 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-15T23:54:14.844 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:54:14.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:14.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:14.982 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:14.982 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:54:14.982 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.1 up 2024-09-15T23:54:14.982 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.1 master ceph-brx 2024-09-15T23:54:14.982 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:54:15.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:15.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:15.090 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-15T23:54:15.090 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:54:15.090 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-15T23:54:15.142 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-15T23:54:15.142 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:54:15.143 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-15T23:54:15.189 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:54:15.248 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:15.295 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:54:15.296 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:54:15.296 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:54:15.296 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:54:15.296 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:54:15.296 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:54:15.296 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:54:15.296 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:54:15.296 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:54:15.296 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:54:15.296 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:54:15.296 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:54:15.297 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:15.297 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:54:15.297 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:54:15.297 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:54:15.297 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:54:15.297 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:54:15.297 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:15.297 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:54:15.297 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:15.297 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:54:15.297 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:54:15.297 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:54:15.298 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:54:15.298 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:54:15.298 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:54:15.298 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:54:15.298 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:54:15.298 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:15.298 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:15.298 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:15.298 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:54:15.298 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:54:15.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:15.299 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:54:15.347 INFO:teuthology.orchestra.run.smithi112.stdout:45 2024-09-15T23:54:15.347 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-15T23:54:15.347 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-15T23:54:15.395 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:54:15.410 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:15.459 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:54:15.459 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:54:15.460 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:54:15.460 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:54:15.460 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:54:15.460 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:54:15.460 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:54:15.460 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:54:15.460 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:54:15.460 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:54:15.460 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:54:15.460 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:54:15.460 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:15.461 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:54:15.461 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:54:15.461 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:54:15.461 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:54:15.461 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:54:15.461 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:15.461 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:54:15.461 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:15.461 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:54:15.461 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:54:15.461 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:54:15.462 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:54:15.462 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:54:15.462 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:54:15.462 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:54:15.462 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:54:15.462 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:15.462 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:15.462 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:15.462 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:54:15.462 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:54:15.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:15.463 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:54:15.472 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi112.stderr:2024-09-15T23:54:15.469+0000 7feb5de2f580 -1 init, newargv = 0x5603efa2d0c0 newargc=15 2024-09-15T23:54:15.472 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi112.stderr:ceph-fuse[36060]: starting ceph client 2024-09-15T23:54:15.476 INFO:teuthology.orchestra.run.smithi112.stdout:45 2024-09-15T23:54:15.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi112.stderr:ceph-fuse[36060]: starting fuse 2024-09-15T23:54:16.578 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:54:16.596 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:16.644 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:54:16.644 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:54:16.644 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:54:16.644 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:54:16.644 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:54:16.645 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:54:16.645 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:54:16.645 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:54:16.645 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:54:16.645 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:54:16.645 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:54:16.646 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:54:16.646 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:16.646 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:54:16.646 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:54:16.646 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:54:16.646 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:54:16.647 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:54:16.647 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:16.647 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:54:16.647 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:16.647 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:54:16.647 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:54:16.648 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:54:16.648 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:54:16.648 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:54:16.648 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:54:16.648 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:54:16.648 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:54:16.648 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:16.649 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:16.649 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:16.649 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:54:16.649 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:54:16.649 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.2 2024-09-15T23:54:16.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:16.651 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:54:16.699 INFO:teuthology.orchestra.run.smithi112.stdout:45 2024-09-15T23:54:16.699 INFO:teuthology.orchestra.run.smithi112.stdout:46 2024-09-15T23:54:16.699 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-15T23:54:16.699 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:54:16.699 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2024-09-15T23:54:16.699 DEBUG:teuthology.orchestra.run.smithi112:> import re 2024-09-15T23:54:16.700 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:54:16.700 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-15T23:54:16.700 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:16.700 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2024-09-15T23:54:16.700 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-15T23:54:16.700 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2024-09-15T23:54:16.700 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-15T23:54:16.700 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:16.700 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2024-09-15T23:54:16.700 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2024-09-15T23:54:16.700 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2024-09-15T23:54:16.700 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2024-09-15T23:54:16.700 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:16.700 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2024-09-15T23:54:16.701 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:54:16.701 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:54:16.701 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:54:16.701 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2024-09-15T23:54:16.701 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2024-09-15T23:54:16.701 DEBUG:teuthology.orchestra.run.smithi112:> return f 2024-09-15T23:54:16.701 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:54:16.701 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:16.701 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.2")) 2024-09-15T23:54:16.701 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:54:16.820 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.2.36060.asok 2024-09-15T23:54:16.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:16.832 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.36060.asok 2024-09-15T23:54:16.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:16.832 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.36060.asok status 2024-09-15T23:54:16.981 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:54:16.981 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2024-09-15T23:54:16.981 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:54:16.981 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:54:16.981 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "2", 2024-09-15T23:54:16.981 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2024-09-15T23:54:16.982 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-15T23:54:16.982 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "36060", 2024-09-15T23:54:16.982 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2024-09-15T23:54:16.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:16.982 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2024-09-15T23:54:16.982 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2024-09-15T23:54:16.982 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4671, 2024-09-15T23:54:16.982 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2024-09-15T23:54:16.982 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2024-09-15T23:54:16.982 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2024-09-15T23:54:16.982 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 4671 2024-09-15T23:54:16.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:16.983 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:54:16.983 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:54:16.983 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:54:16.983 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2328643943 2024-09-15T23:54:16.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:16.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:16.984 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:54:16.984 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:54:16.984 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:54:16.984 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2328643943 2024-09-15T23:54:16.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:16.984 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.4671 192.168.0.2:0/2328643943", 2024-09-15T23:54:16.984 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.2:0/2328643943", 2024-09-15T23:54:16.984 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2024-09-15T23:54:16.984 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 8, 2024-09-15T23:54:16.984 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 26, 2024-09-15T23:54:16.985 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:54:16.985 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2024-09-15T23:54:16.985 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2024-09-15T23:54:16.985 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:54:16.995 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-15T23:54:16.995 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:54:17.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.113+0000 7f907488e640 1 Processor -- start 2024-09-15T23:54:17.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.113+0000 7f907488e640 1 -- start start 2024-09-15T23:54:17.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.113+0000 7f907488e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f907009b040 0x7f907009ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:17.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.113+0000 7f907488e640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90700afd80 con 0x7f90700af730 2024-09-15T23:54:17.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.113+0000 7f907488e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90700b0060 con 0x7f907009ac60 2024-09-15T23:54:17.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.113+0000 7f907488e640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f90700b0340 con 0x7f907009b040 2024-09-15T23:54:17.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.113+0000 7f906dd9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f907009b040 0x7f907009ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:17.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.113+0000 7f906dd9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f907009b040 0x7f907009ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59000/0 (socket says 172.21.15.112:59000) 2024-09-15T23:54:17.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.113+0000 7f906dd9b640 1 -- 172.21.15.112:0/2678637408 learned_addr learned my addr 172.21.15.112:0/2678637408 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:17.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.113+0000 7f906ed9d640 1 --1- 172.21.15.112:0/2678637408 >> v1:172.21.15.112:6789/0 conn(0x7f90700af730 0x7f907015d010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36246/0 (socket says 172.21.15.112:36246) 2024-09-15T23:54:17.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.113+0000 7f906dd9b640 1 -- 172.21.15.112:0/2678637408 >> v1:172.21.15.169:6789/0 conn(0x7f907009ac60 legacy=0x7f90700b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:17.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.113+0000 7f906dd9b640 1 -- 172.21.15.112:0/2678637408 >> v1:172.21.15.112:6789/0 conn(0x7f90700af730 legacy=0x7f907015d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:17.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.113+0000 7f906dd9b640 1 -- 172.21.15.112:0/2678637408 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90700b0620 con 0x7f907009b040 2024-09-15T23:54:17.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.113+0000 7f906d59a640 1 -- 172.21.15.112:0/2678637408 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2004068895 0 0) 0x7f90700afd80 con 0x7f90700af730 2024-09-15T23:54:17.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f906dd9b640 1 --2- 172.21.15.112:0/2678637408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f907009b040 0x7f907009ba00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9058009870 tx=0x7f905801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bfe4729d620943 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:17.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f906d59a640 1 -- 172.21.15.112:0/2678637408 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90580b0070 con 0x7f907009b040 2024-09-15T23:54:17.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f906d59a640 1 -- 172.21.15.112:0/2678637408 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90580ab600 con 0x7f907009b040 2024-09-15T23:54:17.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f906d59a640 1 -- 172.21.15.112:0/2678637408 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90580ab9d0 con 0x7f907009b040 2024-09-15T23:54:17.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 -- 172.21.15.112:0/2678637408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f907009b040 msgr2=0x7f907009ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:17.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 --2- 172.21.15.112:0/2678637408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f907009b040 0x7f907009ba00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9058009870 tx=0x7f905801c490 comp rx=0 tx=0).stop 2024-09-15T23:54:17.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 -- 172.21.15.112:0/2678637408 shutdown_connections 2024-09-15T23:54:17.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 --2- 172.21.15.112:0/2678637408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f907009b040 0x7f907009ba00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:17.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 -- 172.21.15.112:0/2678637408 >> 172.21.15.112:0/2678637408 conn(0x7f90700b78d0 msgr2=0x7f90700b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:17.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 -- 172.21.15.112:0/2678637408 shutdown_connections 2024-09-15T23:54:17.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 -- 172.21.15.112:0/2678637408 wait complete. 2024-09-15T23:54:17.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 Processor -- start 2024-09-15T23:54:17.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 -- start start 2024-09-15T23:54:17.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f907009ac60 0x7f9070152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:17.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f907009b040 0x7f907014b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:17.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90700af730 0x7f907015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:17.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9070169d80 con 0x7f90700af730 2024-09-15T23:54:17.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f90700b2610 con 0x7f907009b040 2024-09-15T23:54:17.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f907488e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9070169f00 con 0x7f907009ac60 2024-09-15T23:54:17.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f906ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90700af730 0x7f907015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:17.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f906ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90700af730 0x7f907015c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59004/0 (socket says 172.21.15.112:59004) 2024-09-15T23:54:17.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f906ed9d640 1 -- 172.21.15.112:0/61448062 learned_addr learned my addr 172.21.15.112:0/61448062 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:17.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f906dd9b640 1 --2- 172.21.15.112:0/61448062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f907009b040 0x7f907014b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:17.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f906e59c640 1 --2- 172.21.15.112:0/61448062 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f907009ac60 0x7f9070152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:17.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f906ed9d640 1 -- 172.21.15.112:0/61448062 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f907009ac60 msgr2=0x7f9070152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:17.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f906ed9d640 1 --2- 172.21.15.112:0/61448062 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f907009ac60 0x7f9070152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:17.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f906ed9d640 1 -- 172.21.15.112:0/61448062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f907009b040 msgr2=0x7f907014b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:17.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f906ed9d640 1 --2- 172.21.15.112:0/61448062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f907009b040 0x7f907014b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:17.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.117+0000 7f906ed9d640 1 -- 172.21.15.112:0/61448062 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907014bae0 con 0x7f90700af730 2024-09-15T23:54:17.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.121+0000 7f906ed9d640 1 --2- 172.21.15.112:0/61448062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90700af730 0x7f907015c890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f906800c7a0 tx=0x7f906800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:17.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.121+0000 7f9066ffd640 1 -- 172.21.15.112:0/61448062 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068018070 con 0x7f90700af730 2024-09-15T23:54:17.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.121+0000 7f9066ffd640 1 -- 172.21.15.112:0/61448062 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f906800a640 con 0x7f90700af730 2024-09-15T23:54:17.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.121+0000 7f907488e640 1 -- 172.21.15.112:0/61448062 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f907014bdc0 con 0x7f90700af730 2024-09-15T23:54:17.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.121+0000 7f9066ffd640 1 -- 172.21.15.112:0/61448062 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906800aab0 con 0x7f90700af730 2024-09-15T23:54:17.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.121+0000 7f907488e640 1 -- 172.21.15.112:0/61448062 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f907014c380 con 0x7f90700af730 2024-09-15T23:54:17.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.121+0000 7f907488e640 1 -- 172.21.15.112:0/61448062 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90700b32d0 con 0x7f90700af730 2024-09-15T23:54:17.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.121+0000 7f9066ffd640 1 -- 172.21.15.112:0/61448062 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f906801b070 con 0x7f90700af730 2024-09-15T23:54:17.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.121+0000 7f9066ffd640 1 --2- 172.21.15.112:0/61448062 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f90500678c0 0x7f9050069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:17.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.121+0000 7f906e59c640 1 --2- 172.21.15.112:0/61448062 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f90500678c0 0x7f9050069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:17.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.121+0000 7f9066ffd640 1 -- 172.21.15.112:0/61448062 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9068085650 con 0x7f90700af730 2024-09-15T23:54:17.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.121+0000 7f906e59c640 1 --2- 172.21.15.112:0/61448062 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f90500678c0 0x7f9050069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f907015d5b0 tx=0x7f9060008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:17.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.125+0000 7f9066ffd640 1 -- 172.21.15.112:0/61448062 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9068055e50 con 0x7f90700af730 2024-09-15T23:54:17.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.325+0000 7f907488e640 1 -- 172.21.15.112:0/61448062 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f907014f780 con 0x7f90700af730 2024-09-15T23:54:17.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.325+0000 7f9066ffd640 1 -- 172.21.15.112:0/61448062 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f9068055750 con 0x7f90700af730 2024-09-15T23:54:17.329 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T23:54:17.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.329+0000 7f907488e640 1 -- 172.21.15.112:0/61448062 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f90500678c0 msgr2=0x7f9050069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:17.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.329+0000 7f907488e640 1 --2- 172.21.15.112:0/61448062 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f90500678c0 0x7f9050069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f907015d5b0 tx=0x7f9060008040 comp rx=0 tx=0).stop 2024-09-15T23:54:17.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.329+0000 7f907488e640 1 -- 172.21.15.112:0/61448062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90700af730 msgr2=0x7f907015c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:17.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.329+0000 7f907488e640 1 --2- 172.21.15.112:0/61448062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90700af730 0x7f907015c890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f906800c7a0 tx=0x7f906800cc60 comp rx=0 tx=0).stop 2024-09-15T23:54:17.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.329+0000 7f907488e640 1 -- 172.21.15.112:0/61448062 shutdown_connections 2024-09-15T23:54:17.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.329+0000 7f907488e640 1 --2- 172.21.15.112:0/61448062 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f90500678c0 0x7f9050069d80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:17.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.329+0000 7f907488e640 1 --2- 172.21.15.112:0/61448062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90700af730 0x7f907015c890 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:17.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.329+0000 7f907488e640 1 --2- 172.21.15.112:0/61448062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f907009b040 0x7f907014b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:17.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.329+0000 7f907488e640 1 --2- 172.21.15.112:0/61448062 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f907009ac60 0x7f9070152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:17.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.329+0000 7f907488e640 1 -- 172.21.15.112:0/61448062 >> 172.21.15.112:0/61448062 conn(0x7f90700b78d0 msgr2=0x7f907014e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:17.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.329+0000 7f907488e640 1 -- 172.21.15.112:0/61448062 shutdown_connections 2024-09-15T23:54:17.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:17.329+0000 7f907488e640 1 -- 172.21.15.112:0/61448062 wait complete. 2024-09-15T23:54:17.347 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:54:17.347 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:54:17.347 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi169.front.sepia.ceph.com 2024-09-15T23:54:17.347 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T23:54:17.347 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T23:54:17.347 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:54:17.347 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:54:17.347 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:54:17.347 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:54:17.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:17.347 DEBUG:teuthology.orchestra.run.smithi169:> ip addr 2024-09-15T23:54:17.354 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:54:17.354 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:54:17.354 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:54:17.355 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:17.355 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2024-09-15T23:54:17.355 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:17.355 INFO:teuthology.orchestra.run.smithi169.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:17.355 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b4 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:17.355 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f0 2024-09-15T23:54:17.355 INFO:teuthology.orchestra.run.smithi169.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:17.355 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b5 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:17.355 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f1 2024-09-15T23:54:17.355 INFO:teuthology.orchestra.run.smithi169.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:17.355 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:17.355 INFO:teuthology.orchestra.run.smithi169.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:54:17.355 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:17.356 INFO:teuthology.orchestra.run.smithi169.stdout: inet 172.21.15.169/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T23:54:17.356 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft 42446sec preferred_lft 42446sec 2024-09-15T23:54:17.356 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::ec4:7aff:fe88:7f4d/64 scope link 2024-09-15T23:54:17.356 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:17.356 INFO:teuthology.orchestra.run.smithi169.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T23:54:17.356 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 02:42:46:19:76:90 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:17.356 INFO:teuthology.orchestra.run.smithi169.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T23:54:17.356 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:17.356 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T23:54:17.356 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:17.356 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-09-15T23:54:17.357 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link add name ceph-brx type bridge 2024-09-15T23:54:17.357 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip addr flush dev ceph-brx 2024-09-15T23:54:17.357 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set ceph-brx up 2024-09-15T23:54:17.357 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T23:54:17.357 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-09-15T23:54:17.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:17.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:17.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:17.483 DEBUG:teuthology.orchestra.run.smithi169:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:54:17.492 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-09-15T23:54:17.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:17.494 DEBUG:teuthology.orchestra.run.smithi169:> route 2024-09-15T23:54:17.566 INFO:teuthology.orchestra.run.smithi169.stdout:Kernel IP routing table 2024-09-15T23:54:17.566 INFO:teuthology.orchestra.run.smithi169.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:54:17.566 INFO:teuthology.orchestra.run.smithi169.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T23:54:17.566 INFO:teuthology.orchestra.run.smithi169.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:54:17.566 INFO:teuthology.orchestra.run.smithi169.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T23:54:17.566 INFO:teuthology.orchestra.run.smithi169.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T23:54:17.566 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:54:17.566 INFO:teuthology.orchestra.run.smithi169.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:17.566 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:17.567 INFO:teuthology.orchestra.run.smithi169.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:17.567 INFO:teuthology.orchestra.run.smithi169.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:54:17.567 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:17.567 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-09-15T23:54:17.567 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:54:17.567 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:54:17.567 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:54:17.567 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-09-15T23:54:17.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:17.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:17.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:17.693 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-09-15T23:54:17.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:17.699 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list-id 2024-09-15T23:54:17.747 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:17.747 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-09-15T23:54:17.747 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:54:17.747 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-15T23:54:17.747 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-09-15T23:54:17.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:17.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:17.867 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-15T23:54:17.867 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:17.867 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-09-15T23:54:17.867 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-15T23:54:17.867 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T23:54:17.867 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-15T23:54:17.867 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-15T23:54:17.868 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-15T23:54:17.868 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-09-15T23:54:17.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:17.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:17.975 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:17.975 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-09-15T23:54:17.976 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set brx.0 up 2024-09-15T23:54:17.976 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T23:54:17.976 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-09-15T23:54:18.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:18.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:18.079 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-15T23:54:18.080 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:54:18.080 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T23:54:18.126 INFO:teuthology.orchestra.run.smithi169.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:54:18.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:54:18.126 DEBUG:teuthology.orchestra.run.smithi169:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:54:18.173 DEBUG:teuthology.orchestra.run.smithi169:> sudo modprobe fuse 2024-09-15T23:54:18.229 DEBUG:teuthology.orchestra.run.smithi169:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:18.275 INFO:teuthology.orchestra.run.smithi169.stdout:/sys 2024-09-15T23:54:18.275 INFO:teuthology.orchestra.run.smithi169.stdout:/proc 2024-09-15T23:54:18.276 INFO:teuthology.orchestra.run.smithi169.stdout:/dev 2024-09-15T23:54:18.276 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/pts 2024-09-15T23:54:18.276 INFO:teuthology.orchestra.run.smithi169.stdout:/run 2024-09-15T23:54:18.276 INFO:teuthology.orchestra.run.smithi169.stdout:/ 2024-09-15T23:54:18.276 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/security 2024-09-15T23:54:18.276 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/shm 2024-09-15T23:54:18.276 INFO:teuthology.orchestra.run.smithi169.stdout:/run/lock 2024-09-15T23:54:18.276 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/cgroup 2024-09-15T23:54:18.276 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/pstore 2024-09-15T23:54:18.277 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/bpf 2024-09-15T23:54:18.277 INFO:teuthology.orchestra.run.smithi169.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:18.277 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/hugepages 2024-09-15T23:54:18.277 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/mqueue 2024-09-15T23:54:18.277 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/debug 2024-09-15T23:54:18.277 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/tracing 2024-09-15T23:54:18.277 INFO:teuthology.orchestra.run.smithi169.stdout:/proc/fs/nfsd 2024-09-15T23:54:18.277 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:18.277 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/config 2024-09-15T23:54:18.277 INFO:teuthology.orchestra.run.smithi169.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:18.277 INFO:teuthology.orchestra.run.smithi169.stdout:/run/rpc_pipefs 2024-09-15T23:54:18.277 INFO:teuthology.orchestra.run.smithi169.stdout:/run/user/1000 2024-09-15T23:54:18.277 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph 2024-09-15T23:54:18.277 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-4 2024-09-15T23:54:18.278 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-5 2024-09-15T23:54:18.278 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-6 2024-09-15T23:54:18.278 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-7 2024-09-15T23:54:18.278 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns 2024-09-15T23:54:18.278 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:54:18.278 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:54:18.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:18.279 DEBUG:teuthology.orchestra.run.smithi169:> ls /sys/fs/fuse/connections 2024-09-15T23:54:18.326 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:54:18.326 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-15T23:54:18.372 DEBUG:teuthology.orchestra.run.smithi169:> sudo modprobe fuse 2024-09-15T23:54:18.385 DEBUG:teuthology.orchestra.run.smithi169:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:18.434 INFO:teuthology.orchestra.run.smithi169.stdout:/sys 2024-09-15T23:54:18.435 INFO:teuthology.orchestra.run.smithi169.stdout:/proc 2024-09-15T23:54:18.435 INFO:teuthology.orchestra.run.smithi169.stdout:/dev 2024-09-15T23:54:18.435 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/pts 2024-09-15T23:54:18.435 INFO:teuthology.orchestra.run.smithi169.stdout:/run 2024-09-15T23:54:18.435 INFO:teuthology.orchestra.run.smithi169.stdout:/ 2024-09-15T23:54:18.435 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/security 2024-09-15T23:54:18.435 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/shm 2024-09-15T23:54:18.435 INFO:teuthology.orchestra.run.smithi169.stdout:/run/lock 2024-09-15T23:54:18.436 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/cgroup 2024-09-15T23:54:18.436 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/pstore 2024-09-15T23:54:18.436 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/bpf 2024-09-15T23:54:18.436 INFO:teuthology.orchestra.run.smithi169.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:18.436 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/hugepages 2024-09-15T23:54:18.436 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/mqueue 2024-09-15T23:54:18.436 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/debug 2024-09-15T23:54:18.436 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/tracing 2024-09-15T23:54:18.436 INFO:teuthology.orchestra.run.smithi169.stdout:/proc/fs/nfsd 2024-09-15T23:54:18.436 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:18.436 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/config 2024-09-15T23:54:18.436 INFO:teuthology.orchestra.run.smithi169.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:18.437 INFO:teuthology.orchestra.run.smithi169.stdout:/run/rpc_pipefs 2024-09-15T23:54:18.437 INFO:teuthology.orchestra.run.smithi169.stdout:/run/user/1000 2024-09-15T23:54:18.437 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph 2024-09-15T23:54:18.437 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-4 2024-09-15T23:54:18.437 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-5 2024-09-15T23:54:18.437 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-6 2024-09-15T23:54:18.437 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-7 2024-09-15T23:54:18.437 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns 2024-09-15T23:54:18.437 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:54:18.437 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:54:18.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:18.438 DEBUG:teuthology.orchestra.run.smithi169:> ls /sys/fs/fuse/connections 2024-09-15T23:54:18.447 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi169.stderr:2024-09-15T23:54:18.446+0000 7fb39b7aa580 -1 init, newargv = 0x562b9fe90fc0 newargc=15 2024-09-15T23:54:18.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi169.stderr:ceph-fuse[34295]: starting ceph client 2024-09-15T23:54:18.453 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi169.stderr:ceph-fuse[34295]: starting fuse 2024-09-15T23:54:19.553 DEBUG:teuthology.orchestra.run.smithi169:> sudo modprobe fuse 2024-09-15T23:54:19.569 DEBUG:teuthology.orchestra.run.smithi169:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:19.617 INFO:teuthology.orchestra.run.smithi169.stdout:/sys 2024-09-15T23:54:19.617 INFO:teuthology.orchestra.run.smithi169.stdout:/proc 2024-09-15T23:54:19.617 INFO:teuthology.orchestra.run.smithi169.stdout:/dev 2024-09-15T23:54:19.617 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/pts 2024-09-15T23:54:19.617 INFO:teuthology.orchestra.run.smithi169.stdout:/run 2024-09-15T23:54:19.618 INFO:teuthology.orchestra.run.smithi169.stdout:/ 2024-09-15T23:54:19.618 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/security 2024-09-15T23:54:19.618 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/shm 2024-09-15T23:54:19.618 INFO:teuthology.orchestra.run.smithi169.stdout:/run/lock 2024-09-15T23:54:19.618 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/cgroup 2024-09-15T23:54:19.618 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/pstore 2024-09-15T23:54:19.618 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/bpf 2024-09-15T23:54:19.618 INFO:teuthology.orchestra.run.smithi169.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:19.618 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/hugepages 2024-09-15T23:54:19.618 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/mqueue 2024-09-15T23:54:19.618 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/debug 2024-09-15T23:54:19.618 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/tracing 2024-09-15T23:54:19.618 INFO:teuthology.orchestra.run.smithi169.stdout:/proc/fs/nfsd 2024-09-15T23:54:19.619 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:19.619 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/config 2024-09-15T23:54:19.619 INFO:teuthology.orchestra.run.smithi169.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:19.619 INFO:teuthology.orchestra.run.smithi169.stdout:/run/rpc_pipefs 2024-09-15T23:54:19.619 INFO:teuthology.orchestra.run.smithi169.stdout:/run/user/1000 2024-09-15T23:54:19.619 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph 2024-09-15T23:54:19.619 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-4 2024-09-15T23:54:19.619 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-5 2024-09-15T23:54:19.619 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-6 2024-09-15T23:54:19.619 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-7 2024-09-15T23:54:19.619 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns 2024-09-15T23:54:19.619 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:54:19.619 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:54:19.619 INFO:teuthology.orchestra.run.smithi169.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-15T23:54:19.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:19.620 DEBUG:teuthology.orchestra.run.smithi169:> ls /sys/fs/fuse/connections 2024-09-15T23:54:19.667 INFO:teuthology.orchestra.run.smithi169.stdout:45 2024-09-15T23:54:19.667 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T23:54:19.667 DEBUG:teuthology.orchestra.run.smithi169:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:54:19.667 DEBUG:teuthology.orchestra.run.smithi169:> import glob 2024-09-15T23:54:19.667 DEBUG:teuthology.orchestra.run.smithi169:> import re 2024-09-15T23:54:19.667 DEBUG:teuthology.orchestra.run.smithi169:> import os 2024-09-15T23:54:19.667 DEBUG:teuthology.orchestra.run.smithi169:> import subprocess 2024-09-15T23:54:19.667 DEBUG:teuthology.orchestra.run.smithi169:> 2024-09-15T23:54:19.667 DEBUG:teuthology.orchestra.run.smithi169:> def _find_admin_socket(client_name): 2024-09-15T23:54:19.668 DEBUG:teuthology.orchestra.run.smithi169:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:54:19.668 DEBUG:teuthology.orchestra.run.smithi169:> files = glob.glob(asok_path) 2024-09-15T23:54:19.668 DEBUG:teuthology.orchestra.run.smithi169:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:54:19.668 DEBUG:teuthology.orchestra.run.smithi169:> 2024-09-15T23:54:19.668 DEBUG:teuthology.orchestra.run.smithi169:> # Given a non-glob path, it better be there 2024-09-15T23:54:19.668 DEBUG:teuthology.orchestra.run.smithi169:> if "*" not in asok_path: 2024-09-15T23:54:19.668 DEBUG:teuthology.orchestra.run.smithi169:> assert(len(files) == 1) 2024-09-15T23:54:19.668 DEBUG:teuthology.orchestra.run.smithi169:> return files[0] 2024-09-15T23:54:19.668 DEBUG:teuthology.orchestra.run.smithi169:> 2024-09-15T23:54:19.668 DEBUG:teuthology.orchestra.run.smithi169:> for f in files: 2024-09-15T23:54:19.668 DEBUG:teuthology.orchestra.run.smithi169:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:54:19.668 DEBUG:teuthology.orchestra.run.smithi169:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:54:19.668 DEBUG:teuthology.orchestra.run.smithi169:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:54:19.668 DEBUG:teuthology.orchestra.run.smithi169:> contents = proc_f.read() 2024-09-15T23:54:19.669 DEBUG:teuthology.orchestra.run.smithi169:> if mountpoint in contents: 2024-09-15T23:54:19.669 DEBUG:teuthology.orchestra.run.smithi169:> return f 2024-09-15T23:54:19.669 DEBUG:teuthology.orchestra.run.smithi169:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:54:19.669 DEBUG:teuthology.orchestra.run.smithi169:> 2024-09-15T23:54:19.669 DEBUG:teuthology.orchestra.run.smithi169:> print(_find_admin_socket("client.1")) 2024-09-15T23:54:19.669 DEBUG:teuthology.orchestra.run.smithi169:> ' 2024-09-15T23:54:19.791 INFO:teuthology.orchestra.run.smithi169.stdout:/var/run/ceph/ceph-client.1.34295.asok 2024-09-15T23:54:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:19.803 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34295.asok 2024-09-15T23:54:19.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:19.803 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.34295.asok status 2024-09-15T23:54:19.954 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-15T23:54:19.954 INFO:teuthology.orchestra.run.smithi169.stdout: "metadata": { 2024-09-15T23:54:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:54:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:54:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "entity_id": "1", 2024-09-15T23:54:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "hostname": "smithi169", 2024-09-15T23:54:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-15T23:54:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "pid": "34295", 2024-09-15T23:54:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: "root": "/" 2024-09-15T23:54:19.955 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T23:54:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: "dentry_count": 0, 2024-09-15T23:54:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: "dentry_pinned_count": 0, 2024-09-15T23:54:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: "id": 4474, 2024-09-15T23:54:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: "inst": { 2024-09-15T23:54:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: "name": { 2024-09-15T23:54:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "client", 2024-09-15T23:54:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: "num": 4474 2024-09-15T23:54:19.956 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T23:54:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": { 2024-09-15T23:54:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "v1", 2024-09-15T23:54:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:54:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: "nonce": 723048728 2024-09-15T23:54:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T23:54:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T23:54:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": { 2024-09-15T23:54:19.957 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "v1", 2024-09-15T23:54:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:54:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "nonce": 723048728 2024-09-15T23:54:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T23:54:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "inst_str": "client.4474 192.168.0.1:0/723048728", 2024-09-15T23:54:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "addr_str": "192.168.0.1:0/723048728", 2024-09-15T23:54:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "inode_count": 1, 2024-09-15T23:54:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_epoch": 8, 2024-09-15T23:54:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_epoch": 26, 2024-09-15T23:54:19.958 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:54:19.959 INFO:teuthology.orchestra.run.smithi169.stdout: "blocklisted": false, 2024-09-15T23:54:19.959 INFO:teuthology.orchestra.run.smithi169.stdout: "fs_name": "cephfs" 2024-09-15T23:54:19.959 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-15T23:54:19.968 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-15T23:54:19.968 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:54:20.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.097+0000 7fb67002d640 1 Processor -- start 2024-09-15T23:54:20.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.097+0000 7fb67002d640 1 -- start start 2024-09-15T23:54:20.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.097+0000 7fb67002d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb66815bec0 0x7fb6680ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:20.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.097+0000 7fb67002d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6680b3290 con 0x7fb66815c2a0 2024-09-15T23:54:20.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.097+0000 7fb67002d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6680b3570 con 0x7fb6680af470 2024-09-15T23:54:20.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.097+0000 7fb67002d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb6680b3850 con 0x7fb66815bec0 2024-09-15T23:54:20.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.097+0000 7fb66ddc9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb66815bec0 0x7fb6680ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:20.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.097+0000 7fb66d5c8640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb66815c2a0 0x7fb6680aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51638/0 (socket says 172.21.15.112:51638) 2024-09-15T23:54:20.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.097+0000 7fb66d5c8640 1 -- 172.21.15.112:0/1830649100 learned_addr learned my addr 172.21.15.112:0/1830649100 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:20.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.097+0000 7fb66ddc9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb66815bec0 0x7fb6680ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41974/0 (socket says 172.21.15.112:41974) 2024-09-15T23:54:20.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.097+0000 7fb66ddc9640 1 -- 172.21.15.112:0/1830649100 >> v1:172.21.15.169:6789/0 conn(0x7fb6680af470 legacy=0x7fb66806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:20.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.097+0000 7fb66ddc9640 1 -- 172.21.15.112:0/1830649100 >> v1:172.21.15.112:6789/0 conn(0x7fb66815c2a0 legacy=0x7fb6680aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:20.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.097+0000 7fb66cdc7640 1 -- 172.21.15.112:0/1830649100 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779498947 0 0) 0x7fb6680b3290 con 0x7fb66815c2a0 2024-09-15T23:54:20.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.097+0000 7fb66ddc9640 1 -- 172.21.15.112:0/1830649100 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6680b3b30 con 0x7fb66815bec0 2024-09-15T23:54:20.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66ddc9640 1 --2- 172.21.15.112:0/1830649100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb66815bec0 0x7fb6680ad200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb6640097c0 tx=0x7fb66401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5c8b85f8269890 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:20.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66cdc7640 1 -- 172.21.15.112:0/1830649100 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6640b2070 con 0x7fb66815bec0 2024-09-15T23:54:20.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66cdc7640 1 -- 172.21.15.112:0/1830649100 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6640ad680 con 0x7fb66815bec0 2024-09-15T23:54:20.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66cdc7640 1 -- 172.21.15.112:0/1830649100 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6640ada50 con 0x7fb66815bec0 2024-09-15T23:54:20.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 -- 172.21.15.112:0/1830649100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb66815bec0 msgr2=0x7fb6680ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:20.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 --2- 172.21.15.112:0/1830649100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb66815bec0 0x7fb6680ad200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb6640097c0 tx=0x7fb66401c470 comp rx=0 tx=0).stop 2024-09-15T23:54:20.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 -- 172.21.15.112:0/1830649100 shutdown_connections 2024-09-15T23:54:20.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 --2- 172.21.15.112:0/1830649100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb66815bec0 0x7fb6680ad200 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:20.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 -- 172.21.15.112:0/1830649100 >> 172.21.15.112:0/1830649100 conn(0x7fb6680b1f90 msgr2=0x7fb6680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:20.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 -- 172.21.15.112:0/1830649100 shutdown_connections 2024-09-15T23:54:20.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 -- 172.21.15.112:0/1830649100 wait complete. 2024-09-15T23:54:20.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 Processor -- start 2024-09-15T23:54:20.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 -- start start 2024-09-15T23:54:20.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6680af470 0x7fb668157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:20.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb66815bec0 0x7fb668147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb66815c2a0 0x7fb668155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb66806ef20 con 0x7fb66815c2a0 2024-09-15T23:54:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb6680ad740 con 0x7fb6680af470 2024-09-15T23:54:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb67002d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb66806f0a0 con 0x7fb66815bec0 2024-09-15T23:54:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66e5ca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb66815c2a0 0x7fb668155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66e5ca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb66815c2a0 0x7fb668155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41988/0 (socket says 172.21.15.112:41988) 2024-09-15T23:54:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66e5ca640 1 -- 172.21.15.112:0/3789732339 learned_addr learned my addr 172.21.15.112:0/3789732339 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66ddc9640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6680af470 0x7fb668157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66d5c8640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb66815bec0 0x7fb668147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66e5ca640 1 -- 172.21.15.112:0/3789732339 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb66815bec0 msgr2=0x7fb668147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66e5ca640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb66815bec0 0x7fb668147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66e5ca640 1 -- 172.21.15.112:0/3789732339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6680af470 msgr2=0x7fb668157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:20.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66e5ca640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6680af470 0x7fb668157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66e5ca640 1 -- 172.21.15.112:0/3789732339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb668158110 con 0x7fb66815c2a0 2024-09-15T23:54:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66ddc9640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6680af470 0x7fb668157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.101+0000 7fb66e5ca640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb66815c2a0 0x7fb668155b20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb66000c7a0 tx=0x7fb66000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.105+0000 7fb65e7fc640 1 -- 172.21.15.112:0/3789732339 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660003b80 con 0x7fb66815c2a0 2024-09-15T23:54:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.105+0000 7fb65e7fc640 1 -- 172.21.15.112:0/3789732339 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb660003d20 con 0x7fb66815c2a0 2024-09-15T23:54:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.105+0000 7fb67002d640 1 -- 172.21.15.112:0/3789732339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb668156b30 con 0x7fb66815c2a0 2024-09-15T23:54:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.105+0000 7fb65e7fc640 1 -- 172.21.15.112:0/3789732339 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66000aa90 con 0x7fb66815c2a0 2024-09-15T23:54:20.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.105+0000 7fb67002d640 1 -- 172.21.15.112:0/3789732339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6681570f0 con 0x7fb66815c2a0 2024-09-15T23:54:20.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.105+0000 7fb67002d640 1 -- 172.21.15.112:0/3789732339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6680ad200 con 0x7fb66815c2a0 2024-09-15T23:54:20.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.105+0000 7fb65e7fc640 1 -- 172.21.15.112:0/3789732339 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb66000ac30 con 0x7fb66815c2a0 2024-09-15T23:54:20.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.105+0000 7fb65e7fc640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb64c0678c0 0x7fb64c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:20.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.105+0000 7fb65e7fc640 1 -- 172.21.15.112:0/3789732339 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb660085f10 con 0x7fb66815c2a0 2024-09-15T23:54:20.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.105+0000 7fb66ddc9640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb64c0678c0 0x7fb64c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:20.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.105+0000 7fb66ddc9640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb64c0678c0 0x7fb64c069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6640af000 tx=0x7fb664008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:20.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.109+0000 7fb65e7fc640 1 -- 172.21.15.112:0/3789732339 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb660056710 con 0x7fb66815c2a0 2024-09-15T23:54:20.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.301+0000 7fb67002d640 1 -- 172.21.15.112:0/3789732339 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb6680d07a0 con 0x7fb66815c2a0 2024-09-15T23:54:20.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.301+0000 7fb65e7fc640 1 -- 172.21.15.112:0/3789732339 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fb660056010 con 0x7fb66815c2a0 2024-09-15T23:54:20.303 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T23:54:20.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.301+0000 7fb67002d640 1 -- 172.21.15.112:0/3789732339 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb64c0678c0 msgr2=0x7fb64c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:20.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.301+0000 7fb67002d640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb64c0678c0 0x7fb64c069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb6640af000 tx=0x7fb664008040 comp rx=0 tx=0).stop 2024-09-15T23:54:20.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.301+0000 7fb67002d640 1 -- 172.21.15.112:0/3789732339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb66815c2a0 msgr2=0x7fb668155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:20.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.301+0000 7fb67002d640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb66815c2a0 0x7fb668155b20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb66000c7a0 tx=0x7fb66000cc60 comp rx=0 tx=0).stop 2024-09-15T23:54:20.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.301+0000 7fb67002d640 1 -- 172.21.15.112:0/3789732339 shutdown_connections 2024-09-15T23:54:20.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.301+0000 7fb67002d640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb64c0678c0 0x7fb64c069d80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:20.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.301+0000 7fb67002d640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb66815c2a0 0x7fb668155b20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:20.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.301+0000 7fb67002d640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb66815bec0 0x7fb668147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:20.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.301+0000 7fb67002d640 1 --2- 172.21.15.112:0/3789732339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb6680af470 0x7fb668157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:20.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.301+0000 7fb67002d640 1 -- 172.21.15.112:0/3789732339 >> 172.21.15.112:0/3789732339 conn(0x7fb6680b1f90 msgr2=0x7fb668150a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:20.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.301+0000 7fb67002d640 1 -- 172.21.15.112:0/3789732339 shutdown_connections 2024-09-15T23:54:20.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:20.301+0000 7fb67002d640 1 -- 172.21.15.112:0/3789732339 wait complete. 2024-09-15T23:54:20.321 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:54:20.321 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:54:20.321 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi169.front.sepia.ceph.com 2024-09-15T23:54:20.321 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-15T23:54:20.321 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-15T23:54:20.321 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:54:20.321 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:54:20.321 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:54:20.322 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-15T23:54:20.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:20.322 DEBUG:teuthology.orchestra.run.smithi169:> ip addr 2024-09-15T23:54:20.329 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:54:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:54:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:54:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2024-09-15T23:54:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.329 INFO:teuthology.orchestra.run.smithi169.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:20.329 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b4 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f0 2024-09-15T23:54:20.330 INFO:teuthology.orchestra.run.smithi169.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b5 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f1 2024-09-15T23:54:20.330 INFO:teuthology.orchestra.run.smithi169.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:20.330 INFO:teuthology.orchestra.run.smithi169.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:54:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: inet 172.21.15.169/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T23:54:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft 42443sec preferred_lft 42443sec 2024-09-15T23:54:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::ec4:7aff:fe88:7f4d/64 scope link 2024-09-15T23:54:20.330 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.330 INFO:teuthology.orchestra.run.smithi169.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T23:54:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 02:42:46:19:76:90 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T23:54:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.331 INFO:teuthology.orchestra.run.smithi169.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:54:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:54:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T23:54:20.331 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.331 INFO:teuthology.orchestra.run.smithi169.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:54:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:54:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T23:54:20.332 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:20.332 DEBUG:teuthology.orchestra.run.smithi169:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:54:20.382 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-09-15T23:54:20.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:20.384 DEBUG:teuthology.orchestra.run.smithi169:> route 2024-09-15T23:54:20.439 INFO:teuthology.orchestra.run.smithi169.stdout:Kernel IP routing table 2024-09-15T23:54:20.440 INFO:teuthology.orchestra.run.smithi169.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:54:20.440 INFO:teuthology.orchestra.run.smithi169.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T23:54:20.440 INFO:teuthology.orchestra.run.smithi169.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:54:20.440 INFO:teuthology.orchestra.run.smithi169.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T23:54:20.440 INFO:teuthology.orchestra.run.smithi169.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T23:54:20.440 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:54:20.440 INFO:teuthology.orchestra.run.smithi169.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:20.440 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:20.440 INFO:teuthology.orchestra.run.smithi169.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:20.440 INFO:teuthology.orchestra.run.smithi169.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:54:20.441 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:20.441 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-09-15T23:54:20.441 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:54:20.441 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:54:20.441 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:54:20.441 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-09-15T23:54:20.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:20.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:20.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:20.566 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-09-15T23:54:20.571 INFO:teuthology.orchestra.run.smithi169.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T23:54:20.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:20.572 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list-id 2024-09-15T23:54:20.618 INFO:teuthology.orchestra.run.smithi169.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-15T23:54:20.619 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:20.619 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-09-15T23:54:20.619 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T23:54:20.619 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-15T23:54:20.619 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-09-15T23:54:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:20.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:20.739 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-15T23:54:20.752 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:54:20.752 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:54:20.752 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:54:20.753 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.753 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2024-09-15T23:54:20.753 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.753 INFO:teuthology.orchestra.run.smithi169.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:54:20.753 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 1a:f7:74:4e:77:ae brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T23:54:20.753 INFO:teuthology.orchestra.run.smithi169.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T23:54:20.753 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.753 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::18f7:74ff:fe4e:77ae/64 scope link 2024-09-15T23:54:20.753 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:20.754 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-15T23:54:20.810 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:54:20.810 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:54:20.811 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:54:20.811 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.811 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2024-09-15T23:54:20.811 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.811 INFO:teuthology.orchestra.run.smithi169.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:54:20.811 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 1a:f7:74:4e:77:ae brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T23:54:20.811 INFO:teuthology.orchestra.run.smithi169.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T23:54:20.811 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.811 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::18f7:74ff:fe4e:77ae/64 scope link 2024-09-15T23:54:20.812 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:20.812 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-15T23:54:20.813 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:20.813 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-09-15T23:54:20.813 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-15T23:54:20.813 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-15T23:54:20.813 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-15T23:54:20.813 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-15T23:54:20.813 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-15T23:54:20.813 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-09-15T23:54:20.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:20.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:20.955 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:20.955 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-09-15T23:54:20.955 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set brx.1 up 2024-09-15T23:54:20.955 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set dev brx.1 master ceph-brx 2024-09-15T23:54:20.955 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-09-15T23:54:20.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:21.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:21.014 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-15T23:54:21.014 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:54:21.015 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-15T23:54:21.062 INFO:teuthology.orchestra.run.smithi169.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-15T23:54:21.062 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:54:21.062 DEBUG:teuthology.orchestra.run.smithi169:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-15T23:54:21.113 DEBUG:teuthology.orchestra.run.smithi169:> sudo modprobe fuse 2024-09-15T23:54:21.169 DEBUG:teuthology.orchestra.run.smithi169:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:21.216 INFO:teuthology.orchestra.run.smithi169.stdout:/sys 2024-09-15T23:54:21.216 INFO:teuthology.orchestra.run.smithi169.stdout:/proc 2024-09-15T23:54:21.216 INFO:teuthology.orchestra.run.smithi169.stdout:/dev 2024-09-15T23:54:21.216 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/pts 2024-09-15T23:54:21.216 INFO:teuthology.orchestra.run.smithi169.stdout:/run 2024-09-15T23:54:21.216 INFO:teuthology.orchestra.run.smithi169.stdout:/ 2024-09-15T23:54:21.216 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/security 2024-09-15T23:54:21.216 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/shm 2024-09-15T23:54:21.216 INFO:teuthology.orchestra.run.smithi169.stdout:/run/lock 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/cgroup 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/pstore 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/bpf 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/hugepages 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/mqueue 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/debug 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/tracing 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/proc/fs/nfsd 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/config 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/run/rpc_pipefs 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/run/user/1000 2024-09-15T23:54:21.217 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph 2024-09-15T23:54:21.218 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-4 2024-09-15T23:54:21.218 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-5 2024-09-15T23:54:21.218 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-6 2024-09-15T23:54:21.218 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-7 2024-09-15T23:54:21.218 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns 2024-09-15T23:54:21.218 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:54:21.218 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:54:21.218 INFO:teuthology.orchestra.run.smithi169.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-15T23:54:21.218 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T23:54:21.218 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T23:54:21.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:21.219 DEBUG:teuthology.orchestra.run.smithi169:> ls /sys/fs/fuse/connections 2024-09-15T23:54:21.271 INFO:teuthology.orchestra.run.smithi169.stdout:45 2024-09-15T23:54:21.271 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-15T23:54:21.271 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-15T23:54:21.315 DEBUG:teuthology.orchestra.run.smithi169:> sudo modprobe fuse 2024-09-15T23:54:21.330 DEBUG:teuthology.orchestra.run.smithi169:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:21.379 INFO:teuthology.orchestra.run.smithi169.stdout:/sys 2024-09-15T23:54:21.379 INFO:teuthology.orchestra.run.smithi169.stdout:/proc 2024-09-15T23:54:21.379 INFO:teuthology.orchestra.run.smithi169.stdout:/dev 2024-09-15T23:54:21.379 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/pts 2024-09-15T23:54:21.379 INFO:teuthology.orchestra.run.smithi169.stdout:/run 2024-09-15T23:54:21.379 INFO:teuthology.orchestra.run.smithi169.stdout:/ 2024-09-15T23:54:21.379 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/security 2024-09-15T23:54:21.380 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/shm 2024-09-15T23:54:21.380 INFO:teuthology.orchestra.run.smithi169.stdout:/run/lock 2024-09-15T23:54:21.380 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/cgroup 2024-09-15T23:54:21.380 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/pstore 2024-09-15T23:54:21.380 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/bpf 2024-09-15T23:54:21.380 INFO:teuthology.orchestra.run.smithi169.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:21.380 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/hugepages 2024-09-15T23:54:21.380 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/mqueue 2024-09-15T23:54:21.380 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/debug 2024-09-15T23:54:21.380 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/tracing 2024-09-15T23:54:21.380 INFO:teuthology.orchestra.run.smithi169.stdout:/proc/fs/nfsd 2024-09-15T23:54:21.380 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:21.380 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/config 2024-09-15T23:54:21.380 INFO:teuthology.orchestra.run.smithi169.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:21.381 INFO:teuthology.orchestra.run.smithi169.stdout:/run/rpc_pipefs 2024-09-15T23:54:21.381 INFO:teuthology.orchestra.run.smithi169.stdout:/run/user/1000 2024-09-15T23:54:21.381 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph 2024-09-15T23:54:21.381 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-4 2024-09-15T23:54:21.381 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-5 2024-09-15T23:54:21.381 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-6 2024-09-15T23:54:21.381 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-7 2024-09-15T23:54:21.381 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns 2024-09-15T23:54:21.381 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:54:21.381 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:54:21.381 INFO:teuthology.orchestra.run.smithi169.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-15T23:54:21.381 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T23:54:21.381 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T23:54:21.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:21.382 DEBUG:teuthology.orchestra.run.smithi169:> ls /sys/fs/fuse/connections 2024-09-15T23:54:21.392 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi169.stderr:2024-09-15T23:54:21.390+0000 7fae0c1bb580 -1 init, newargv = 0x55cc662d3d50 newargc=15 2024-09-15T23:54:21.393 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi169.stderr:ceph-fuse[34414]: starting ceph client 2024-09-15T23:54:21.396 INFO:teuthology.orchestra.run.smithi169.stdout:45 2024-09-15T23:54:21.398 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi169.stderr:ceph-fuse[34414]: starting fuse 2024-09-15T23:54:22.499 DEBUG:teuthology.orchestra.run.smithi169:> sudo modprobe fuse 2024-09-15T23:54:22.517 DEBUG:teuthology.orchestra.run.smithi169:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:22.564 INFO:teuthology.orchestra.run.smithi169.stdout:/sys 2024-09-15T23:54:22.564 INFO:teuthology.orchestra.run.smithi169.stdout:/proc 2024-09-15T23:54:22.564 INFO:teuthology.orchestra.run.smithi169.stdout:/dev 2024-09-15T23:54:22.564 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/pts 2024-09-15T23:54:22.564 INFO:teuthology.orchestra.run.smithi169.stdout:/run 2024-09-15T23:54:22.564 INFO:teuthology.orchestra.run.smithi169.stdout:/ 2024-09-15T23:54:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/security 2024-09-15T23:54:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/shm 2024-09-15T23:54:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:/run/lock 2024-09-15T23:54:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/cgroup 2024-09-15T23:54:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/pstore 2024-09-15T23:54:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/bpf 2024-09-15T23:54:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/hugepages 2024-09-15T23:54:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:/dev/mqueue 2024-09-15T23:54:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/debug 2024-09-15T23:54:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/tracing 2024-09-15T23:54:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:/proc/fs/nfsd 2024-09-15T23:54:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:22.565 INFO:teuthology.orchestra.run.smithi169.stdout:/sys/kernel/config 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/run/rpc_pipefs 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/run/user/1000 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-4 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-5 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-6 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/var/lib/ceph/osd/ceph-7 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T23:54:22.566 INFO:teuthology.orchestra.run.smithi169.stdout:/home/ubuntu/cephtest/mnt.3 2024-09-15T23:54:22.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:22.567 DEBUG:teuthology.orchestra.run.smithi169:> ls /sys/fs/fuse/connections 2024-09-15T23:54:22.614 INFO:teuthology.orchestra.run.smithi169.stdout:45 2024-09-15T23:54:22.615 INFO:teuthology.orchestra.run.smithi169.stdout:46 2024-09-15T23:54:22.615 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-15T23:54:22.615 DEBUG:teuthology.orchestra.run.smithi169:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:54:22.615 DEBUG:teuthology.orchestra.run.smithi169:> import glob 2024-09-15T23:54:22.615 DEBUG:teuthology.orchestra.run.smithi169:> import re 2024-09-15T23:54:22.615 DEBUG:teuthology.orchestra.run.smithi169:> import os 2024-09-15T23:54:22.615 DEBUG:teuthology.orchestra.run.smithi169:> import subprocess 2024-09-15T23:54:22.615 DEBUG:teuthology.orchestra.run.smithi169:> 2024-09-15T23:54:22.615 DEBUG:teuthology.orchestra.run.smithi169:> def _find_admin_socket(client_name): 2024-09-15T23:54:22.616 DEBUG:teuthology.orchestra.run.smithi169:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-15T23:54:22.616 DEBUG:teuthology.orchestra.run.smithi169:> files = glob.glob(asok_path) 2024-09-15T23:54:22.616 DEBUG:teuthology.orchestra.run.smithi169:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-15T23:54:22.616 DEBUG:teuthology.orchestra.run.smithi169:> 2024-09-15T23:54:22.616 DEBUG:teuthology.orchestra.run.smithi169:> # Given a non-glob path, it better be there 2024-09-15T23:54:22.616 DEBUG:teuthology.orchestra.run.smithi169:> if "*" not in asok_path: 2024-09-15T23:54:22.616 DEBUG:teuthology.orchestra.run.smithi169:> assert(len(files) == 1) 2024-09-15T23:54:22.616 DEBUG:teuthology.orchestra.run.smithi169:> return files[0] 2024-09-15T23:54:22.616 DEBUG:teuthology.orchestra.run.smithi169:> 2024-09-15T23:54:22.616 DEBUG:teuthology.orchestra.run.smithi169:> for f in files: 2024-09-15T23:54:22.616 DEBUG:teuthology.orchestra.run.smithi169:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:54:22.616 DEBUG:teuthology.orchestra.run.smithi169:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:54:22.616 DEBUG:teuthology.orchestra.run.smithi169:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:54:22.616 DEBUG:teuthology.orchestra.run.smithi169:> contents = proc_f.read() 2024-09-15T23:54:22.617 DEBUG:teuthology.orchestra.run.smithi169:> if mountpoint in contents: 2024-09-15T23:54:22.617 DEBUG:teuthology.orchestra.run.smithi169:> return f 2024-09-15T23:54:22.617 DEBUG:teuthology.orchestra.run.smithi169:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:54:22.617 DEBUG:teuthology.orchestra.run.smithi169:> 2024-09-15T23:54:22.617 DEBUG:teuthology.orchestra.run.smithi169:> print(_find_admin_socket("client.3")) 2024-09-15T23:54:22.617 DEBUG:teuthology.orchestra.run.smithi169:> ' 2024-09-15T23:54:22.743 INFO:teuthology.orchestra.run.smithi169.stdout:/var/run/ceph/ceph-client.3.34414.asok 2024-09-15T23:54:22.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-15T23:54:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:22.755 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.34414.asok 2024-09-15T23:54:22.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:22.755 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.34414.asok status 2024-09-15T23:54:22.911 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-15T23:54:22.912 INFO:teuthology.orchestra.run.smithi169.stdout: "metadata": { 2024-09-15T23:54:22.912 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:54:22.912 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:54:22.912 INFO:teuthology.orchestra.run.smithi169.stdout: "entity_id": "3", 2024-09-15T23:54:22.912 INFO:teuthology.orchestra.run.smithi169.stdout: "hostname": "smithi169", 2024-09-15T23:54:22.912 INFO:teuthology.orchestra.run.smithi169.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-15T23:54:22.912 INFO:teuthology.orchestra.run.smithi169.stdout: "pid": "34414", 2024-09-15T23:54:22.912 INFO:teuthology.orchestra.run.smithi169.stdout: "root": "/" 2024-09-15T23:54:22.912 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T23:54:22.912 INFO:teuthology.orchestra.run.smithi169.stdout: "dentry_count": 0, 2024-09-15T23:54:22.912 INFO:teuthology.orchestra.run.smithi169.stdout: "dentry_pinned_count": 0, 2024-09-15T23:54:22.912 INFO:teuthology.orchestra.run.smithi169.stdout: "id": 4483, 2024-09-15T23:54:22.912 INFO:teuthology.orchestra.run.smithi169.stdout: "inst": { 2024-09-15T23:54:22.913 INFO:teuthology.orchestra.run.smithi169.stdout: "name": { 2024-09-15T23:54:22.913 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "client", 2024-09-15T23:54:22.913 INFO:teuthology.orchestra.run.smithi169.stdout: "num": 4483 2024-09-15T23:54:22.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T23:54:22.913 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": { 2024-09-15T23:54:22.913 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "v1", 2024-09-15T23:54:22.913 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:54:22.913 INFO:teuthology.orchestra.run.smithi169.stdout: "nonce": 70129471 2024-09-15T23:54:22.913 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-15T23:54:22.913 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T23:54:22.913 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": { 2024-09-15T23:54:22.913 INFO:teuthology.orchestra.run.smithi169.stdout: "type": "v1", 2024-09-15T23:54:22.913 INFO:teuthology.orchestra.run.smithi169.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:54:22.914 INFO:teuthology.orchestra.run.smithi169.stdout: "nonce": 70129471 2024-09-15T23:54:22.914 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-15T23:54:22.914 INFO:teuthology.orchestra.run.smithi169.stdout: "inst_str": "client.4483 192.168.0.2:0/70129471", 2024-09-15T23:54:22.914 INFO:teuthology.orchestra.run.smithi169.stdout: "addr_str": "192.168.0.2:0/70129471", 2024-09-15T23:54:22.914 INFO:teuthology.orchestra.run.smithi169.stdout: "inode_count": 1, 2024-09-15T23:54:22.914 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_epoch": 8, 2024-09-15T23:54:22.914 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_epoch": 26, 2024-09-15T23:54:22.914 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:54:22.914 INFO:teuthology.orchestra.run.smithi169.stdout: "blocklisted": false, 2024-09-15T23:54:22.914 INFO:teuthology.orchestra.run.smithi169.stdout: "fs_name": "cephfs" 2024-09-15T23:54:22.914 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-15T23:54:22.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:23.069 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2024-09-15T23:54:23.069 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:23.096 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2024-09-15T23:54:23.096 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:23.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:23.097 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:23.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:23.159 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2024-09-15T23:54:23.159 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-15T23:54:23.208 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2024-09-15T23:54:23.208 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-15T23:54:23.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:23.208 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-15T23:54:23.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:23.265 DEBUG:teuthology.orchestra.run.smithi169:> stat --file-system '--printf=%T 2024-09-15T23:54:23.266 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-15T23:54:23.273 INFO:teuthology.orchestra.run.smithi169.stdout:fuseblk 2024-09-15T23:54:23.273 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-15T23:54:23.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:23.274 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:54:23.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:23.334 DEBUG:teuthology.orchestra.run.smithi169:> stat --file-system '--printf=%T 2024-09-15T23:54:23.334 DEBUG:teuthology.orchestra.run.smithi169:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-15T23:54:23.384 INFO:teuthology.orchestra.run.smithi169.stdout:fuseblk 2024-09-15T23:54:23.384 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-15T23:54:23.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:23.385 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-15T23:54:23.440 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-15T23:54:23.497 INFO:tasks.cephfs_test_runner:Starting test: test_dir_deletion (tasks.cephfs.test_strays.TestStrays) That when deleting a bunch of dentries and the containing 2024-09-15T23:54:23.497 INFO:tasks.cephfs_test_runner:test_dir_deletion (tasks.cephfs.test_strays.TestStrays) 2024-09-15T23:54:23.498 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:23.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff2192ee640 1 Processor -- start 2024-09-15T23:54:23.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff2192ee640 1 -- start start 2024-09-15T23:54:23.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff2192ee640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff21415bec0 0x7ff2140ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:23.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff2192ee640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff21415c2a0 0x7ff2140aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff2192ee640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2140b3290 con 0x7ff2140af2a0 2024-09-15T23:54:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff2192ee640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff2140b3570 con 0x7ff21415bec0 2024-09-15T23:54:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff2192ee640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff2140b3850 con 0x7ff21415c2a0 2024-09-15T23:54:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff212ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff21415bec0 0x7ff2140ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff212ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff21415bec0 0x7ff2140ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41990/0 (socket says 172.21.15.112:41990) 2024-09-15T23:54:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff212ffd640 1 -- 172.21.15.112:0/3311746785 learned_addr learned my addr 172.21.15.112:0/3311746785 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff2127fc640 1 --2- 172.21.15.112:0/3311746785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff21415c2a0 0x7ff2140aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff212ffd640 1 -- 172.21.15.112:0/3311746785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff21415c2a0 msgr2=0x7ff2140aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff212ffd640 1 --2- 172.21.15.112:0/3311746785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff21415c2a0 0x7ff2140aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff212ffd640 1 -- 172.21.15.112:0/3311746785 >> v1:172.21.15.169:6789/0 conn(0x7ff2140af2a0 legacy=0x7ff21415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:23.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.625+0000 7ff212ffd640 1 -- 172.21.15.112:0/3311746785 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2140b3b30 con 0x7ff21415bec0 2024-09-15T23:54:23.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.629+0000 7ff212ffd640 1 --2- 172.21.15.112:0/3311746785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff21415bec0 0x7ff2140ad200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff204009870 tx=0x7ff20401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e8a970adf83401 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:23.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.629+0000 7ff211ffb640 1 -- 172.21.15.112:0/3311746785 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2040a95f0 con 0x7ff21415bec0 2024-09-15T23:54:23.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.629+0000 7ff211ffb640 1 -- 172.21.15.112:0/3311746785 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2040a9790 con 0x7ff21415bec0 2024-09-15T23:54:23.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.629+0000 7ff211ffb640 1 -- 172.21.15.112:0/3311746785 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2040a9b60 con 0x7ff21415bec0 2024-09-15T23:54:23.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.629+0000 7ff2192ee640 1 -- 172.21.15.112:0/3311746785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff21415bec0 msgr2=0x7ff2140ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:23.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.629+0000 7ff2192ee640 1 --2- 172.21.15.112:0/3311746785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff21415bec0 0x7ff2140ad200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff204009870 tx=0x7ff20401c530 comp rx=0 tx=0).stop 2024-09-15T23:54:23.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.629+0000 7ff2192ee640 1 -- 172.21.15.112:0/3311746785 shutdown_connections 2024-09-15T23:54:23.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.629+0000 7ff2192ee640 1 --2- 172.21.15.112:0/3311746785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff21415c2a0 0x7ff2140aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.629+0000 7ff2192ee640 1 --2- 172.21.15.112:0/3311746785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff21415bec0 0x7ff2140ad200 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.629+0000 7ff2192ee640 1 -- 172.21.15.112:0/3311746785 >> 172.21.15.112:0/3311746785 conn(0x7ff2140b1f90 msgr2=0x7ff2140b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:23.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.629+0000 7ff2192ee640 1 -- 172.21.15.112:0/3311746785 shutdown_connections 2024-09-15T23:54:23.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.629+0000 7ff2192ee640 1 -- 172.21.15.112:0/3311746785 wait complete. 2024-09-15T23:54:23.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.629+0000 7ff2192ee640 1 Processor -- start 2024-09-15T23:54:23.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.629+0000 7ff2192ee640 1 -- start start 2024-09-15T23:54:23.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff2192ee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140af2a0 0x7ff2141f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff2192ee640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff21415bec0 0x7ff214145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff2192ee640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff21415c2a0 0x7ff214157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff2192ee640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff2140af6b0 con 0x7ff2140af2a0 2024-09-15T23:54:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff2192ee640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2140ad740 con 0x7ff21415c2a0 2024-09-15T23:54:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff2192ee640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff214169000 con 0x7ff21415bec0 2024-09-15T23:54:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff212ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140af2a0 0x7ff2141f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff212ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140af2a0 0x7ff2141f7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42000/0 (socket says 172.21.15.112:42000) 2024-09-15T23:54:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff212ffd640 1 -- 172.21.15.112:0/470413126 learned_addr learned my addr 172.21.15.112:0/470413126 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff2127fc640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff21415bec0 0x7ff214145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff212ffd640 1 -- 172.21.15.112:0/470413126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff21415bec0 msgr2=0x7ff214145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff212ffd640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff21415bec0 0x7ff214145680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff2137fe640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff21415c2a0 0x7ff214157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:23.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff212ffd640 1 -- 172.21.15.112:0/470413126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff21415c2a0 msgr2=0x7ff214157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:23.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff212ffd640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff21415c2a0 0x7ff214157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff212ffd640 1 -- 172.21.15.112:0/470413126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff214145bc0 con 0x7ff2140af2a0 2024-09-15T23:54:23.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff2137fe640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff21415c2a0 0x7ff214157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:23.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff212ffd640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140af2a0 0x7ff2141f7230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff2040ab040 tx=0x7ff20401ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:23.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff1fb7fe640 1 -- 172.21.15.112:0/470413126 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2040b1800 con 0x7ff2140af2a0 2024-09-15T23:54:23.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff1fb7fe640 1 -- 172.21.15.112:0/470413126 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2040b19a0 con 0x7ff2140af2a0 2024-09-15T23:54:23.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff2192ee640 1 -- 172.21.15.112:0/470413126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff214072710 con 0x7ff2140af2a0 2024-09-15T23:54:23.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff1fb7fe640 1 -- 172.21.15.112:0/470413126 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2040b1d90 con 0x7ff2140af2a0 2024-09-15T23:54:23.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff2192ee640 1 -- 172.21.15.112:0/470413126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff214072cd0 con 0x7ff2140af2a0 2024-09-15T23:54:23.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff2192ee640 1 -- 172.21.15.112:0/470413126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2140ad200 con 0x7ff2140af2a0 2024-09-15T23:54:23.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff1fb7fe640 1 -- 172.21.15.112:0/470413126 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff2040c2060 con 0x7ff2140af2a0 2024-09-15T23:54:23.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff1fb7fe640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff2000678c0 0x7ff200069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:23.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff1fb7fe640 1 -- 172.21.15.112:0/470413126 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff204120640 con 0x7ff2140af2a0 2024-09-15T23:54:23.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff2127fc640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff2000678c0 0x7ff200069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:23.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.633+0000 7ff2127fc640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff2000678c0 0x7ff200069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff2141587c0 tx=0x7ff208008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:23.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.637+0000 7ff1fb7fe640 1 -- 172.21.15.112:0/470413126 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff2040b6070 con 0x7ff2140af2a0 2024-09-15T23:54:23.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.801+0000 7ff2192ee640 1 -- 172.21.15.112:0/470413126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff21406fcd0 con 0x7ff2140af2a0 2024-09-15T23:54:23.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.805+0000 7ff1fb7fe640 1 -- 172.21.15.112:0/470413126 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7ff2040ad020 con 0x7ff2140af2a0 2024-09-15T23:54:23.806 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:23.807 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:55.161085+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:53:47.908190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:53:49.056283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:53:52.808895+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:23.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.805+0000 7ff2192ee640 1 -- 172.21.15.112:0/470413126 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff2000678c0 msgr2=0x7ff200069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:23.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.805+0000 7ff2192ee640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff2000678c0 0x7ff200069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff2141587c0 tx=0x7ff208008040 comp rx=0 tx=0).stop 2024-09-15T23:54:23.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.805+0000 7ff2192ee640 1 -- 172.21.15.112:0/470413126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140af2a0 msgr2=0x7ff2141f7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:23.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.805+0000 7ff2192ee640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140af2a0 0x7ff2141f7230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff2040ab040 tx=0x7ff20401ad70 comp rx=0 tx=0).stop 2024-09-15T23:54:23.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.805+0000 7ff2192ee640 1 -- 172.21.15.112:0/470413126 shutdown_connections 2024-09-15T23:54:23.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.805+0000 7ff2192ee640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff2000678c0 0x7ff200069d80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.805+0000 7ff2192ee640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff21415c2a0 0x7ff214157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.805+0000 7ff2192ee640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff21415bec0 0x7ff214145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.805+0000 7ff2192ee640 1 --2- 172.21.15.112:0/470413126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140af2a0 0x7ff2141f7230 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.805+0000 7ff2192ee640 1 -- 172.21.15.112:0/470413126 >> 172.21.15.112:0/470413126 conn(0x7ff2140b1f90 msgr2=0x7ff2140cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:23.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.805+0000 7ff2192ee640 1 -- 172.21.15.112:0/470413126 shutdown_connections 2024-09-15T23:54:23.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.805+0000 7ff2192ee640 1 -- 172.21.15.112:0/470413126 wait complete. 2024-09-15T23:54:23.825 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:53:39.301069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T23:53:47.908190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T23:53:49.056283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-15T23:53:52.808895+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-15T23:54:23.825 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:54:23.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.945+0000 7f3a018e1640 1 Processor -- start 2024-09-15T23:54:23.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.945+0000 7f3a018e1640 1 -- start start 2024-09-15T23:54:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f3a018e1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39fc1520a0 0x7f39fc06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f3a018e1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f39fc06fe50 0x7f39fc15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f3a018e1640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f39fc15f1d0 0x7f39fc071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f3a018e1640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f39fc152480 con 0x7f39fc06fe50 2024-09-15T23:54:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f3a018e1640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f39fc070250 con 0x7f39fc15f1d0 2024-09-15T23:54:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f3a018e1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc0aede0 con 0x7f39fc1520a0 2024-09-15T23:54:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f39f27fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f39fc06fe50 0x7f39fc15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f39f27fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f39fc06fe50 0x7f39fc15ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42012/0 (socket says 172.21.15.112:42012) 2024-09-15T23:54:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f39f27fc640 1 -- 172.21.15.112:0/3551190130 learned_addr learned my addr 172.21.15.112:0/3551190130 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f39fb7fe640 1 --2- 172.21.15.112:0/3551190130 >> v2:172.21.15.169:3300/0 conn(0x7f39fc15f1d0 0x7f39fc071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:23.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f39faffd640 1 --2- 172.21.15.112:0/3551190130 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39fc1520a0 0x7f39fc06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:23.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f39f27fc640 1 -- 172.21.15.112:0/3551190130 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39fc1520a0 msgr2=0x7f39fc06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:23.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f39f27fc640 1 --2- 172.21.15.112:0/3551190130 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39fc1520a0 0x7f39fc06f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f39f27fc640 1 -- 172.21.15.112:0/3551190130 >> v2:172.21.15.169:3300/0 conn(0x7f39fc15f1d0 msgr2=0x7f39fc071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:23.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f39f27fc640 1 --2- 172.21.15.112:0/3551190130 >> v2:172.21.15.169:3300/0 conn(0x7f39fc15f1d0 0x7f39fc071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f39f27fc640 1 -- 172.21.15.112:0/3551190130 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc15fa10 con 0x7f39fc06fe50 2024-09-15T23:54:23.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f39f27fc640 1 --2- 172.21.15.112:0/3551190130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39fc06fe50 0x7f39fc15ec90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f39fc06e250 tx=0x7f39e401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514c5bf1132040a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:23.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.949+0000 7f39fa7fc640 1 -- 172.21.15.112:0/3551190130 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e40b0070 con 0x7f39fc06fe50 2024-09-15T23:54:23.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39fa7fc640 1 -- 172.21.15.112:0/3551190130 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e40ab600 con 0x7f39fc06fe50 2024-09-15T23:54:23.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39fa7fc640 1 -- 172.21.15.112:0/3551190130 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e40ab9d0 con 0x7f39fc06fe50 2024-09-15T23:54:23.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 -- 172.21.15.112:0/3551190130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39fc06fe50 msgr2=0x7f39fc15ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:23.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 --2- 172.21.15.112:0/3551190130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39fc06fe50 0x7f39fc15ec90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f39fc06e250 tx=0x7f39e401c240 comp rx=0 tx=0).stop 2024-09-15T23:54:23.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 -- 172.21.15.112:0/3551190130 shutdown_connections 2024-09-15T23:54:23.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 --2- 172.21.15.112:0/3551190130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39fc06fe50 0x7f39fc15ec90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 --2- 172.21.15.112:0/3551190130 >> v2:172.21.15.169:3300/0 conn(0x7f39fc15f1d0 0x7f39fc071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 --2- 172.21.15.112:0/3551190130 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39fc1520a0 0x7f39fc06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 -- 172.21.15.112:0/3551190130 >> 172.21.15.112:0/3551190130 conn(0x7f39fc0b1f90 msgr2=0x7f39fc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:23.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 -- 172.21.15.112:0/3551190130 shutdown_connections 2024-09-15T23:54:23.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 -- 172.21.15.112:0/3551190130 wait complete. 2024-09-15T23:54:23.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 Processor -- start 2024-09-15T23:54:23.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 -- start start 2024-09-15T23:54:23.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39fc06fe50 0x7f39fc1f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:23.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39fc1520a0 0x7f39fc0b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:23.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39fc15f1d0 0x7f39fc1f9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:23.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc073d30 con 0x7f39fc06fe50 2024-09-15T23:54:23.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc073a50 con 0x7f39fc15f1d0 2024-09-15T23:54:23.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f3a018e1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc15f5e0 con 0x7f39fc1520a0 2024-09-15T23:54:23.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39faffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39fc06fe50 0x7f39fc1f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:23.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39faffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39fc06fe50 0x7f39fc1f72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42020/0 (socket says 172.21.15.112:42020) 2024-09-15T23:54:23.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39faffd640 1 -- 172.21.15.112:0/2191275347 learned_addr learned my addr 172.21.15.112:0/2191275347 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:23.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39f27fc640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39fc1520a0 0x7f39fc0b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:23.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39fb7fe640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39fc15f1d0 0x7f39fc1f9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:23.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39faffd640 1 -- 172.21.15.112:0/2191275347 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39fc1520a0 msgr2=0x7f39fc0b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39faffd640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39fc1520a0 0x7f39fc0b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39faffd640 1 -- 172.21.15.112:0/2191275347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39fc15f1d0 msgr2=0x7f39fc1f9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39faffd640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39fc15f1d0 0x7f39fc1f9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39faffd640 1 -- 172.21.15.112:0/2191275347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc164f70 con 0x7f39fc06fe50 2024-09-15T23:54:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39f27fc640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39fc1520a0 0x7f39fc0b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39fb7fe640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39fc15f1d0 0x7f39fc1f9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.953+0000 7f39faffd640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39fc06fe50 0x7f39fc1f72e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00d800 tx=0x7f39ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.957+0000 7f39f8ff9640 1 -- 172.21.15.112:0/2191275347 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec018020 con 0x7f39fc06fe50 2024-09-15T23:54:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.957+0000 7f39f8ff9640 1 -- 172.21.15.112:0/2191275347 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ec0096a0 con 0x7f39fc06fe50 2024-09-15T23:54:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.957+0000 7f3a018e1640 1 -- 172.21.15.112:0/2191275347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39fc165250 con 0x7f39fc06fe50 2024-09-15T23:54:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.957+0000 7f39f8ff9640 1 -- 172.21.15.112:0/2191275347 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec009a50 con 0x7f39fc06fe50 2024-09-15T23:54:23.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.957+0000 7f3a018e1640 1 -- 172.21.15.112:0/2191275347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39fc165af0 con 0x7f39fc06fe50 2024-09-15T23:54:23.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.957+0000 7f3a018e1640 1 -- 172.21.15.112:0/2191275347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39fc165420 con 0x7f39fc06fe50 2024-09-15T23:54:23.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.957+0000 7f39f8ff9640 1 -- 172.21.15.112:0/2191275347 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f39ec01b020 con 0x7f39fc06fe50 2024-09-15T23:54:23.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.957+0000 7f39f8ff9640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f39dc0678c0 0x7f39dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:23.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.957+0000 7f39f8ff9640 1 -- 172.21.15.112:0/2191275347 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f39ec086650 con 0x7f39fc06fe50 2024-09-15T23:54:23.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.957+0000 7f39f27fc640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f39dc0678c0 0x7f39dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:23.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.957+0000 7f39f27fc640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f39dc0678c0 0x7f39dc069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f39e40ad000 tx=0x7f39e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:23.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:23.961+0000 7f39f8ff9640 1 -- 172.21.15.112:0/2191275347 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f39ec022020 con 0x7f39fc06fe50 2024-09-15T23:54:24.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.113+0000 7f3a018e1640 1 -- 172.21.15.112:0/2191275347 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f39fc15ec90 con 0x7f39fc06fe50 2024-09-15T23:54:24.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.113+0000 7f39f8ff9640 1 -- 172.21.15.112:0/2191275347 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f39ec056db0 con 0x7f39fc06fe50 2024-09-15T23:54:24.115 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-15T23:54:24.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.113+0000 7f3a018e1640 1 -- 172.21.15.112:0/2191275347 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f39dc0678c0 msgr2=0x7f39dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.113+0000 7f3a018e1640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f39dc0678c0 0x7f39dc069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f39e40ad000 tx=0x7f39e4008040 comp rx=0 tx=0).stop 2024-09-15T23:54:24.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.113+0000 7f3a018e1640 1 -- 172.21.15.112:0/2191275347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39fc06fe50 msgr2=0x7f39fc1f72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.113+0000 7f3a018e1640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39fc06fe50 0x7f39fc1f72e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00d800 tx=0x7f39ec00dcc0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.113+0000 7f3a018e1640 1 -- 172.21.15.112:0/2191275347 shutdown_connections 2024-09-15T23:54:24.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.113+0000 7f3a018e1640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f39dc0678c0 0x7f39dc069d80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.113+0000 7f3a018e1640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39fc15f1d0 0x7f39fc1f9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.113+0000 7f3a018e1640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39fc1520a0 0x7f39fc0b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.113+0000 7f3a018e1640 1 --2- 172.21.15.112:0/2191275347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39fc06fe50 0x7f39fc1f72e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.113+0000 7f3a018e1640 1 -- 172.21.15.112:0/2191275347 >> 172.21.15.112:0/2191275347 conn(0x7f39fc0b1f90 msgr2=0x7f39fc06f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:24.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.113+0000 7f3a018e1640 1 -- 172.21.15.112:0/2191275347 shutdown_connections 2024-09-15T23:54:24.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.113+0000 7f3a018e1640 1 -- 172.21.15.112:0/2191275347 wait complete. 2024-09-15T23:54:24.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T23:54:24.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.249+0000 7f2a4688b640 1 Processor -- start 2024-09-15T23:54:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.249+0000 7f2a4688b640 1 -- start start 2024-09-15T23:54:24.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.249+0000 7f2a4688b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2a4006f010 0x7f2a40166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.249+0000 7f2a4688b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a400b3290 con 0x7f2a4015c2a0 2024-09-15T23:54:24.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.249+0000 7f2a4688b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a400b3570 con 0x7f2a4015bec0 2024-09-15T23:54:24.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.249+0000 7f2a4688b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2a400b3850 con 0x7f2a4006f010 2024-09-15T23:54:24.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.249+0000 7f2a44e28640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2a4006f010 0x7f2a40166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.249+0000 7f2a44e28640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2a4006f010 0x7f2a40166ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42028/0 (socket says 172.21.15.112:42028) 2024-09-15T23:54:24.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.249+0000 7f2a44e28640 1 -- 172.21.15.112:0/1637420747 learned_addr learned my addr 172.21.15.112:0/1637420747 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.249+0000 7f2a44e28640 1 -- 172.21.15.112:0/1637420747 >> v1:172.21.15.169:6789/0 conn(0x7f2a4015bec0 legacy=0x7f2a400ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.249+0000 7f2a44e28640 1 -- 172.21.15.112:0/1637420747 >> v1:172.21.15.112:6789/0 conn(0x7f2a4015c2a0 legacy=0x7f2a400aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.249+0000 7f2a44e28640 1 -- 172.21.15.112:0/1637420747 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a400b3b30 con 0x7f2a4006f010 2024-09-15T23:54:24.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a44e28640 1 --2- 172.21.15.112:0/1637420747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4006f010 0x7f2a40166ff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009e50 tx=0x7f2a3801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a91c298a4db838 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:24.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a3effd640 1 -- 172.21.15.112:0/1637420747 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a380a57e0 con 0x7f2a4006f010 2024-09-15T23:54:24.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a3effd640 1 -- 172.21.15.112:0/1637420747 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a380a5980 con 0x7f2a4006f010 2024-09-15T23:54:24.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a3effd640 1 -- 172.21.15.112:0/1637420747 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a380a5d50 con 0x7f2a4006f010 2024-09-15T23:54:24.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 -- 172.21.15.112:0/1637420747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4006f010 msgr2=0x7f2a40166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 --2- 172.21.15.112:0/1637420747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4006f010 0x7f2a40166ff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009e50 tx=0x7f2a3801ca00 comp rx=0 tx=0).stop 2024-09-15T23:54:24.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 -- 172.21.15.112:0/1637420747 shutdown_connections 2024-09-15T23:54:24.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 --2- 172.21.15.112:0/1637420747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4006f010 0x7f2a40166ff0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 -- 172.21.15.112:0/1637420747 >> 172.21.15.112:0/1637420747 conn(0x7f2a400b1f90 msgr2=0x7f2a400b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:24.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 -- 172.21.15.112:0/1637420747 shutdown_connections 2024-09-15T23:54:24.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 -- 172.21.15.112:0/1637420747 wait complete. 2024-09-15T23:54:24.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 Processor -- start 2024-09-15T23:54:24.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 -- start start 2024-09-15T23:54:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a4006f010 0x7f2a40153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4015bec0 0x7f2a40158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a4015c2a0 0x7f2a40158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2a40169ed0 con 0x7f2a4015bec0 2024-09-15T23:54:24.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2a40169d50 con 0x7f2a4006f010 2024-09-15T23:54:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a4688b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2a4016a050 con 0x7f2a4015c2a0 2024-09-15T23:54:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a3f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4015bec0 0x7f2a40158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a3f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4015bec0 0x7f2a40158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42040/0 (socket says 172.21.15.112:42040) 2024-09-15T23:54:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a3f7fe640 1 -- 172.21.15.112:0/1180501321 learned_addr learned my addr 172.21.15.112:0/1180501321 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a3f7fe640 1 -- 172.21.15.112:0/1180501321 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a4015c2a0 msgr2=0x7f2a40158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a3f7fe640 1 --2- 172.21.15.112:0/1180501321 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a4015c2a0 0x7f2a40158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a3f7fe640 1 -- 172.21.15.112:0/1180501321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a4006f010 msgr2=0x7f2a40153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a3ffff640 1 --2- 172.21.15.112:0/1180501321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a4006f010 0x7f2a40153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a3f7fe640 1 --2- 172.21.15.112:0/1180501321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a4006f010 0x7f2a40153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a3f7fe640 1 -- 172.21.15.112:0/1180501321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a40154030 con 0x7f2a4015bec0 2024-09-15T23:54:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.253+0000 7f2a3f7fe640 1 --2- 172.21.15.112:0/1180501321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4015bec0 0x7f2a40158320 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400c390 tx=0x7f2a3400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.257+0000 7f2a3cff9640 1 -- 172.21.15.112:0/1180501321 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34017070 con 0x7f2a4015bec0 2024-09-15T23:54:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.257+0000 7f2a3cff9640 1 -- 172.21.15.112:0/1180501321 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a340052d0 con 0x7f2a4015bec0 2024-09-15T23:54:24.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.257+0000 7f2a4688b640 1 -- 172.21.15.112:0/1180501321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a40154310 con 0x7f2a4015bec0 2024-09-15T23:54:24.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.257+0000 7f2a3cff9640 1 -- 172.21.15.112:0/1180501321 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34003820 con 0x7f2a4015bec0 2024-09-15T23:54:24.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.257+0000 7f2a4688b640 1 -- 172.21.15.112:0/1180501321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a401548d0 con 0x7f2a4015bec0 2024-09-15T23:54:24.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.257+0000 7f2a4688b640 1 -- 172.21.15.112:0/1180501321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a400ad200 con 0x7f2a4015bec0 2024-09-15T23:54:24.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.257+0000 7f2a3cff9640 1 -- 172.21.15.112:0/1180501321 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2a3401a070 con 0x7f2a4015bec0 2024-09-15T23:54:24.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.257+0000 7f2a3cff9640 1 --2- 172.21.15.112:0/1180501321 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2a2c0678c0 0x7f2a2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.257+0000 7f2a3cff9640 1 -- 172.21.15.112:0/1180501321 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2a34085380 con 0x7f2a4015bec0 2024-09-15T23:54:24.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.257+0000 7f2a3ffff640 1 --2- 172.21.15.112:0/1180501321 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2a2c0678c0 0x7f2a2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.257+0000 7f2a3ffff640 1 --2- 172.21.15.112:0/1180501321 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2a2c0678c0 0x7f2a2c069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2a30007fd0 tx=0x7f2a30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:24.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.261+0000 7f2a3cff9640 1 -- 172.21.15.112:0/1180501321 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2a34005480 con 0x7f2a4015bec0 2024-09-15T23:54:24.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.413+0000 7f2a4688b640 1 -- 172.21.15.112:0/1180501321 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2a400d0dc0 con 0x7f2a4015bec0 2024-09-15T23:54:24.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.413+0000 7f2a3cff9640 1 -- 172.21.15.112:0/1180501321 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f2a34055b80 con 0x7f2a4015bec0 2024-09-15T23:54:24.415 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2024-09-15T23:54:24.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.413+0000 7f2a4688b640 1 -- 172.21.15.112:0/1180501321 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2a2c0678c0 msgr2=0x7f2a2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.413+0000 7f2a4688b640 1 --2- 172.21.15.112:0/1180501321 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2a2c0678c0 0x7f2a2c069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2a30007fd0 tx=0x7f2a30009040 comp rx=0 tx=0).stop 2024-09-15T23:54:24.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.413+0000 7f2a4688b640 1 -- 172.21.15.112:0/1180501321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4015bec0 msgr2=0x7f2a40158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.413+0000 7f2a4688b640 1 --2- 172.21.15.112:0/1180501321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4015bec0 0x7f2a40158320 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400c390 tx=0x7f2a3400c850 comp rx=0 tx=0).stop 2024-09-15T23:54:24.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.413+0000 7f2a4688b640 1 -- 172.21.15.112:0/1180501321 shutdown_connections 2024-09-15T23:54:24.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.413+0000 7f2a4688b640 1 --2- 172.21.15.112:0/1180501321 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2a2c0678c0 0x7f2a2c069d80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.413+0000 7f2a4688b640 1 --2- 172.21.15.112:0/1180501321 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2a4015c2a0 0x7f2a40158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.413+0000 7f2a4688b640 1 --2- 172.21.15.112:0/1180501321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2a4015bec0 0x7f2a40158320 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.413+0000 7f2a4688b640 1 --2- 172.21.15.112:0/1180501321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a4006f010 0x7f2a40153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.413+0000 7f2a4688b640 1 -- 172.21.15.112:0/1180501321 >> 172.21.15.112:0/1180501321 conn(0x7f2a400b1f90 msgr2=0x7f2a40159db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:24.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.413+0000 7f2a4688b640 1 -- 172.21.15.112:0/1180501321 shutdown_connections 2024-09-15T23:54:24.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.413+0000 7f2a4688b640 1 -- 172.21.15.112:0/1180501321 wait complete. 2024-09-15T23:54:24.433 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T23:54:24.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7fafa1616640 1 Processor -- start 2024-09-15T23:54:24.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7fafa1616640 1 -- start start 2024-09-15T23:54:24.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7fafa1616640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faf9c15bec0 0x7faf9c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7fafa1616640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9c0af470 0x7faf9c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7fafa1616640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9c0b3290 con 0x7faf9c15c2a0 2024-09-15T23:54:24.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7fafa1616640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7faf9c0b3570 con 0x7faf9c15bec0 2024-09-15T23:54:24.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7fafa1616640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faf9c0b3850 con 0x7faf9c0af470 2024-09-15T23:54:24.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7faf9affd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faf9c15bec0 0x7faf9c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7faf9b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9c0af470 0x7faf9c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7faf9affd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faf9c15bec0 0x7faf9c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:50196/0 (socket says 172.21.15.112:50196) 2024-09-15T23:54:24.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7faf9a7fc640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7faf9c15c2a0 0x7faf9c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:60956/0 (socket says 172.21.15.112:60956) 2024-09-15T23:54:24.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7faf9affd640 1 -- 172.21.15.112:0/3276545741 learned_addr learned my addr 172.21.15.112:0/3276545741 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:24.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7faf9affd640 1 -- 172.21.15.112:0/3276545741 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9c0af470 msgr2=0x7faf9c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:24.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7faf9affd640 1 --2- 172.21.15.112:0/3276545741 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9c0af470 0x7faf9c06e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7faf9affd640 1 -- 172.21.15.112:0/3276545741 >> v1:172.21.15.169:6789/0 conn(0x7faf9c15c2a0 legacy=0x7faf9c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.557+0000 7faf9affd640 1 -- 172.21.15.112:0/3276545741 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c0b3b30 con 0x7faf9c15bec0 2024-09-15T23:54:24.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.561+0000 7faf9affd640 1 --2- 172.21.15.112:0/3276545741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf9c15bec0 0x7faf9c0ad200 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009870 tx=0x7faf8c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31fd0a30ef5cbbbd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:24.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.561+0000 7faf99ffb640 1 -- 172.21.15.112:0/3276545741 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0aa600 con 0x7faf9c15bec0 2024-09-15T23:54:24.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.561+0000 7faf99ffb640 1 -- 172.21.15.112:0/3276545741 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf8c0af070 con 0x7faf9c15bec0 2024-09-15T23:54:24.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.561+0000 7faf99ffb640 1 -- 172.21.15.112:0/3276545741 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0aa9c0 con 0x7faf9c15bec0 2024-09-15T23:54:24.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.561+0000 7fafa1616640 1 -- 172.21.15.112:0/3276545741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf9c15bec0 msgr2=0x7faf9c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.561+0000 7fafa1616640 1 --2- 172.21.15.112:0/3276545741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf9c15bec0 0x7faf9c0ad200 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009870 tx=0x7faf8c01c4a0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.561+0000 7fafa1616640 1 -- 172.21.15.112:0/3276545741 shutdown_connections 2024-09-15T23:54:24.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.561+0000 7fafa1616640 1 --2- 172.21.15.112:0/3276545741 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9c0af470 0x7faf9c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.561+0000 7fafa1616640 1 --2- 172.21.15.112:0/3276545741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf9c15bec0 0x7faf9c0ad200 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.561+0000 7fafa1616640 1 -- 172.21.15.112:0/3276545741 >> 172.21.15.112:0/3276545741 conn(0x7faf9c0b1f90 msgr2=0x7faf9c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:24.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.561+0000 7fafa1616640 1 -- 172.21.15.112:0/3276545741 shutdown_connections 2024-09-15T23:54:24.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.561+0000 7fafa1616640 1 -- 172.21.15.112:0/3276545741 wait complete. 2024-09-15T23:54:24.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.561+0000 7fafa1616640 1 Processor -- start 2024-09-15T23:54:24.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.561+0000 7fafa1616640 1 -- start start 2024-09-15T23:54:24.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7fafa1616640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf9c0af470 0x7faf9c072570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7fafa1616640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9c15bec0 0x7faf9c072e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7fafa1616640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf9c15c2a0 0x7faf9c0733a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7fafa1616640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c06ed50 con 0x7faf9c0af470 2024-09-15T23:54:24.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7fafa1616640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c0ad740 con 0x7faf9c15c2a0 2024-09-15T23:54:24.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7fafa1616640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faf9c06eed0 con 0x7faf9c15bec0 2024-09-15T23:54:24.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf9affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf9c0af470 0x7faf9c072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf9affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf9c0af470 0x7faf9c072570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42050/0 (socket says 172.21.15.112:42050) 2024-09-15T23:54:24.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf9affd640 1 -- 172.21.15.112:0/2251106022 learned_addr learned my addr 172.21.15.112:0/2251106022 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:24.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf9b7fe640 1 --2- 172.21.15.112:0/2251106022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf9c15c2a0 0x7faf9c0733a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf9a7fc640 1 --2- 172.21.15.112:0/2251106022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9c15bec0 0x7faf9c072e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf9affd640 1 -- 172.21.15.112:0/2251106022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9c15bec0 msgr2=0x7faf9c072e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf9affd640 1 --2- 172.21.15.112:0/2251106022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9c15bec0 0x7faf9c072e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf9affd640 1 -- 172.21.15.112:0/2251106022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf9c15c2a0 msgr2=0x7faf9c0733a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf9affd640 1 --2- 172.21.15.112:0/2251106022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf9c15c2a0 0x7faf9c0733a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf9affd640 1 -- 172.21.15.112:0/2251106022 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c165100 con 0x7faf9c0af470 2024-09-15T23:54:24.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf9affd640 1 --2- 172.21.15.112:0/2251106022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf9c0af470 0x7faf9c072570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0ac040 tx=0x7faf8c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:24.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf837fe640 1 -- 172.21.15.112:0/2251106022 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0bd5f0 con 0x7faf9c0af470 2024-09-15T23:54:24.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf837fe640 1 -- 172.21.15.112:0/2251106022 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf8c0bd790 con 0x7faf9c0af470 2024-09-15T23:54:24.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf837fe640 1 -- 172.21.15.112:0/2251106022 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0bdb80 con 0x7faf9c0af470 2024-09-15T23:54:24.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7fafa1616640 1 -- 172.21.15.112:0/2251106022 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9c1653e0 con 0x7faf9c0af470 2024-09-15T23:54:24.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7fafa1616640 1 -- 172.21.15.112:0/2251106022 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf9c072ab0 con 0x7faf9c0af470 2024-09-15T23:54:24.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7fafa1616640 1 -- 172.21.15.112:0/2251106022 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf9c06e000 con 0x7faf9c0af470 2024-09-15T23:54:24.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf837fe640 1 -- 172.21.15.112:0/2251106022 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf8c0a9070 con 0x7faf9c0af470 2024-09-15T23:54:24.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf837fe640 1 --2- 172.21.15.112:0/2251106022 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf880678c0 0x7faf88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf9a7fc640 1 --2- 172.21.15.112:0/2251106022 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf880678c0 0x7faf88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf837fe640 1 -- 172.21.15.112:0/2251106022 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faf8c1209f0 con 0x7faf9c0af470 2024-09-15T23:54:24.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.565+0000 7faf9a7fc640 1 --2- 172.21.15.112:0/2251106022 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf880678c0 0x7faf88069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faf9c15efe0 tx=0x7faf90007cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:24.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.569+0000 7faf837fe640 1 -- 172.21.15.112:0/2251106022 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faf8c0c3060 con 0x7faf9c0af470 2024-09-15T23:54:24.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.733+0000 7fafa1616640 1 -- 172.21.15.112:0/2251106022 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faf9c06e000 con 0x7faf9c0af470 2024-09-15T23:54:24.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.733+0000 7faf837fe640 1 -- 172.21.15.112:0/2251106022 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7faf8c016150 con 0x7faf9c0af470 2024-09-15T23:54:24.737 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2024-09-15T23:54:24.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.737+0000 7fafa1616640 1 -- 172.21.15.112:0/2251106022 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf880678c0 msgr2=0x7faf88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.737+0000 7fafa1616640 1 --2- 172.21.15.112:0/2251106022 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf880678c0 0x7faf88069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faf9c15efe0 tx=0x7faf90007cf0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.737+0000 7fafa1616640 1 -- 172.21.15.112:0/2251106022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf9c0af470 msgr2=0x7faf9c072570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.737+0000 7fafa1616640 1 --2- 172.21.15.112:0/2251106022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf9c0af470 0x7faf9c072570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0ac040 tx=0x7faf8c01ace0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.737+0000 7fafa1616640 1 -- 172.21.15.112:0/2251106022 shutdown_connections 2024-09-15T23:54:24.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.737+0000 7fafa1616640 1 --2- 172.21.15.112:0/2251106022 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf880678c0 0x7faf88069d80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.737+0000 7fafa1616640 1 --2- 172.21.15.112:0/2251106022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf9c15c2a0 0x7faf9c0733a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.737+0000 7fafa1616640 1 --2- 172.21.15.112:0/2251106022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf9c15bec0 0x7faf9c072e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.737+0000 7fafa1616640 1 --2- 172.21.15.112:0/2251106022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf9c0af470 0x7faf9c072570 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.737+0000 7fafa1616640 1 -- 172.21.15.112:0/2251106022 >> 172.21.15.112:0/2251106022 conn(0x7faf9c0b1f90 msgr2=0x7faf9c0b1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:24.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.737+0000 7fafa1616640 1 -- 172.21.15.112:0/2251106022 shutdown_connections 2024-09-15T23:54:24.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.737+0000 7fafa1616640 1 -- 172.21.15.112:0/2251106022 wait complete. 2024-09-15T23:54:24.755 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-15T23:54:24.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd292093640 1 Processor -- start 2024-09-15T23:54:24.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd292093640 1 -- start start 2024-09-15T23:54:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd292093640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd28c0b5cf0 0x7fd28c15e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd292093640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd28c15f8d0 0x7fd28c15fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd292093640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28c15f180 con 0x7fd28c15ecb0 2024-09-15T23:54:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd292093640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd28c160270 con 0x7fd28c15f8d0 2024-09-15T23:54:24.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd292093640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd28c15f460 con 0x7fd28c0b5cf0 2024-09-15T23:54:24.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd28bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd28c15f8d0 0x7fd28c15fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd28bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd28c15f8d0 0x7fd28c15fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42056/0 (socket says 172.21.15.112:42056) 2024-09-15T23:54:24.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd28bfff640 1 -- 172.21.15.112:0/2143724322 learned_addr learned my addr 172.21.15.112:0/2143724322 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:24.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd28b7fe640 1 --2- 172.21.15.112:0/2143724322 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd28c0b5cf0 0x7fd28c15e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd28bfff640 1 -- 172.21.15.112:0/2143724322 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd28c0b5cf0 msgr2=0x7fd28c15e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:24.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd28bfff640 1 --2- 172.21.15.112:0/2143724322 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd28c0b5cf0 0x7fd28c15e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd28bfff640 1 -- 172.21.15.112:0/2143724322 >> v1:172.21.15.169:6789/0 conn(0x7fd28c15ecb0 legacy=0x7fd28c06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:24.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.873+0000 7fd28bfff640 1 -- 172.21.15.112:0/2143724322 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c06d440 con 0x7fd28c15f8d0 2024-09-15T23:54:24.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd28bfff640 1 --2- 172.21.15.112:0/2143724322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28c15f8d0 0x7fd28c15fd30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd284009e50 tx=0x7fd28401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6197c186de1d4af server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd28a7fc640 1 -- 172.21.15.112:0/2143724322 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2840a55e0 con 0x7fd28c15f8d0 2024-09-15T23:54:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd28a7fc640 1 -- 172.21.15.112:0/2143724322 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2840a5780 con 0x7fd28c15f8d0 2024-09-15T23:54:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd28a7fc640 1 -- 172.21.15.112:0/2143724322 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2840a5b50 con 0x7fd28c15f8d0 2024-09-15T23:54:24.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 -- 172.21.15.112:0/2143724322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28c15f8d0 msgr2=0x7fd28c15fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 --2- 172.21.15.112:0/2143724322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28c15f8d0 0x7fd28c15fd30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd284009e50 tx=0x7fd28401c960 comp rx=0 tx=0).stop 2024-09-15T23:54:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 -- 172.21.15.112:0/2143724322 shutdown_connections 2024-09-15T23:54:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 --2- 172.21.15.112:0/2143724322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28c15f8d0 0x7fd28c15fd30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 --2- 172.21.15.112:0/2143724322 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd28c0b5cf0 0x7fd28c15e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 -- 172.21.15.112:0/2143724322 >> 172.21.15.112:0/2143724322 conn(0x7fd28c06c0c0 msgr2=0x7fd28c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 -- 172.21.15.112:0/2143724322 shutdown_connections 2024-09-15T23:54:24.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 -- 172.21.15.112:0/2143724322 wait complete. 2024-09-15T23:54:24.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 Processor -- start 2024-09-15T23:54:24.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 -- start start 2024-09-15T23:54:24.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd28c0b5cf0 0x7fd28c165670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd28c15ecb0 0x7fd28c152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28c15f8d0 0x7fd28c157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c16b0a0 con 0x7fd28c15f8d0 2024-09-15T23:54:24.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c16af20 con 0x7fd28c15ecb0 2024-09-15T23:54:24.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd292093640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd28c16b220 con 0x7fd28c0b5cf0 2024-09-15T23:54:24.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd28bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28c15f8d0 0x7fd28c157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd28bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28c15f8d0 0x7fd28c157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42072/0 (socket says 172.21.15.112:42072) 2024-09-15T23:54:24.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd28bfff640 1 -- 172.21.15.112:0/2028890766 learned_addr learned my addr 172.21.15.112:0/2028890766 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:24.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd28affd640 1 --2- 172.21.15.112:0/2028890766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd28c15ecb0 0x7fd28c152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd28bfff640 1 -- 172.21.15.112:0/2028890766 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd28c0b5cf0 msgr2=0x7fd28c165670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd28bfff640 1 --2- 172.21.15.112:0/2028890766 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd28c0b5cf0 0x7fd28c165670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd28bfff640 1 -- 172.21.15.112:0/2028890766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd28c15ecb0 msgr2=0x7fd28c152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:24.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.877+0000 7fd28bfff640 1 --2- 172.21.15.112:0/2028890766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd28c15ecb0 0x7fd28c152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:24.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.881+0000 7fd28bfff640 1 -- 172.21.15.112:0/2028890766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c163630 con 0x7fd28c15f8d0 2024-09-15T23:54:24.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.881+0000 7fd28affd640 1 --2- 172.21.15.112:0/2028890766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd28c15ecb0 0x7fd28c152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:24.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.881+0000 7fd28bfff640 1 --2- 172.21.15.112:0/2028890766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28c15f8d0 0x7fd28c157e70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd2840af040 tx=0x7fd284019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:24.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.881+0000 7fd273fff640 1 -- 172.21.15.112:0/2028890766 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2840bc020 con 0x7fd28c15f8d0 2024-09-15T23:54:24.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.881+0000 7fd273fff640 1 -- 172.21.15.112:0/2028890766 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2840b8670 con 0x7fd28c15f8d0 2024-09-15T23:54:24.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.881+0000 7fd292093640 1 -- 172.21.15.112:0/2028890766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28c163910 con 0x7fd28c15f8d0 2024-09-15T23:54:24.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.881+0000 7fd273fff640 1 -- 172.21.15.112:0/2028890766 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2840b8aa0 con 0x7fd28c15f8d0 2024-09-15T23:54:24.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.881+0000 7fd292093640 1 -- 172.21.15.112:0/2028890766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28c163ed0 con 0x7fd28c15f8d0 2024-09-15T23:54:24.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.881+0000 7fd292093640 1 -- 172.21.15.112:0/2028890766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28c15e770 con 0x7fd28c15f8d0 2024-09-15T23:54:24.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.881+0000 7fd273fff640 1 -- 172.21.15.112:0/2028890766 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2840bf020 con 0x7fd28c15f8d0 2024-09-15T23:54:24.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.881+0000 7fd273fff640 1 --2- 172.21.15.112:0/2028890766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2780678c0 0x7fd278069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:24.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.881+0000 7fd273fff640 1 -- 172.21.15.112:0/2028890766 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd284121100 con 0x7fd28c15f8d0 2024-09-15T23:54:24.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.881+0000 7fd28b7fe640 1 --2- 172.21.15.112:0/2028890766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2780678c0 0x7fd278069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:24.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.881+0000 7fd28b7fe640 1 --2- 172.21.15.112:0/2028890766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2780678c0 0x7fd278069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0b3c70 tx=0x7fd27c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:24.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:24.885+0000 7fd273fff640 1 -- 172.21.15.112:0/2028890766 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd2840c6030 con 0x7fd28c15f8d0 2024-09-15T23:54:25.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.048+0000 7fd292093640 1 -- 172.21.15.112:0/2028890766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd28c0724d0 con 0x7fd28c15f8d0 2024-09-15T23:54:25.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.048+0000 7fd273fff640 1 -- 172.21.15.112:0/2028890766 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fd2840165e0 con 0x7fd28c15f8d0 2024-09-15T23:54:25.052 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 32 2024-09-15T23:54:25.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.048+0000 7fd292093640 1 -- 172.21.15.112:0/2028890766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2780678c0 msgr2=0x7fd278069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:25.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.048+0000 7fd292093640 1 --2- 172.21.15.112:0/2028890766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2780678c0 0x7fd278069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0b3c70 tx=0x7fd27c008040 comp rx=0 tx=0).stop 2024-09-15T23:54:25.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.048+0000 7fd292093640 1 -- 172.21.15.112:0/2028890766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28c15f8d0 msgr2=0x7fd28c157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:25.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.048+0000 7fd292093640 1 --2- 172.21.15.112:0/2028890766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28c15f8d0 0x7fd28c157e70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd2840af040 tx=0x7fd284019700 comp rx=0 tx=0).stop 2024-09-15T23:54:25.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.048+0000 7fd292093640 1 -- 172.21.15.112:0/2028890766 shutdown_connections 2024-09-15T23:54:25.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.048+0000 7fd292093640 1 --2- 172.21.15.112:0/2028890766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2780678c0 0x7fd278069d80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:25.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.048+0000 7fd292093640 1 --2- 172.21.15.112:0/2028890766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd28c15f8d0 0x7fd28c157e70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:25.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.048+0000 7fd292093640 1 --2- 172.21.15.112:0/2028890766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd28c15ecb0 0x7fd28c152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:25.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.048+0000 7fd292093640 1 --2- 172.21.15.112:0/2028890766 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd28c0b5cf0 0x7fd28c165670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:25.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.048+0000 7fd292093640 1 -- 172.21.15.112:0/2028890766 >> 172.21.15.112:0/2028890766 conn(0x7fd28c06c0c0 msgr2=0x7fd28c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:25.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.052+0000 7fd292093640 1 -- 172.21.15.112:0/2028890766 shutdown_connections 2024-09-15T23:54:25.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.052+0000 7fd292093640 1 -- 172.21.15.112:0/2028890766 wait complete. 2024-09-15T23:54:25.070 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_dir_deletion' 2024-09-15T23:54:25.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f2e23640 1 Processor -- start 2024-09-15T23:54:25.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f2e23640 1 -- start start 2024-09-15T23:54:25.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f2e23640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec1520a0 0x7ff7ec06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:25.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f2e23640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff7ec15f3a0 0x7ff7ec0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:25.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f2e23640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7ec070250 con 0x7ff7ec06fe50 2024-09-15T23:54:25.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f2e23640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff7ec152480 con 0x7ff7ec15f3a0 2024-09-15T23:54:25.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f2e23640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ec0aede0 con 0x7ff7ec1520a0 2024-09-15T23:54:25.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f13c0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff7ec15f3a0 0x7ff7ec0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:25.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f13c0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff7ec15f3a0 0x7ff7ec0adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42088/0 (socket says 172.21.15.112:42088) 2024-09-15T23:54:25.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f13c0640 1 -- 172.21.15.112:0/4152079994 learned_addr learned my addr 172.21.15.112:0/4152079994 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:25.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f0bbf640 1 --2- 172.21.15.112:0/4152079994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec1520a0 0x7ff7ec06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:25.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f13c0640 1 -- 172.21.15.112:0/4152079994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec1520a0 msgr2=0x7ff7ec06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:25.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f13c0640 1 --2- 172.21.15.112:0/4152079994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec1520a0 0x7ff7ec06f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:25.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f13c0640 1 -- 172.21.15.112:0/4152079994 >> v1:172.21.15.169:6789/0 conn(0x7ff7ec06fe50 legacy=0x7ff7ec15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:25.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.188+0000 7ff7f13c0640 1 -- 172.21.15.112:0/4152079994 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec15fa10 con 0x7ff7ec15f3a0 2024-09-15T23:54:25.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f13c0640 1 --2- 172.21.15.112:0/4152079994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec15f3a0 0x7ff7ec0adc80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009e50 tx=0x7ff7e401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c519926d0f795c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:25.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7eb7fe640 1 -- 172.21.15.112:0/4152079994 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40a5900 con 0x7ff7ec15f3a0 2024-09-15T23:54:25.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7eb7fe640 1 -- 172.21.15.112:0/4152079994 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e40a5aa0 con 0x7ff7ec15f3a0 2024-09-15T23:54:25.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7eb7fe640 1 -- 172.21.15.112:0/4152079994 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40ad3f0 con 0x7ff7ec15f3a0 2024-09-15T23:54:25.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 -- 172.21.15.112:0/4152079994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec15f3a0 msgr2=0x7ff7ec0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:25.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 --2- 172.21.15.112:0/4152079994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec15f3a0 0x7ff7ec0adc80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009e50 tx=0x7ff7e401ca30 comp rx=0 tx=0).stop 2024-09-15T23:54:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 -- 172.21.15.112:0/4152079994 shutdown_connections 2024-09-15T23:54:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 --2- 172.21.15.112:0/4152079994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec15f3a0 0x7ff7ec0adc80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 --2- 172.21.15.112:0/4152079994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec1520a0 0x7ff7ec06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 -- 172.21.15.112:0/4152079994 >> 172.21.15.112:0/4152079994 conn(0x7ff7ec0b1f90 msgr2=0x7ff7ec0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 -- 172.21.15.112:0/4152079994 shutdown_connections 2024-09-15T23:54:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 -- 172.21.15.112:0/4152079994 wait complete. 2024-09-15T23:54:25.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 Processor -- start 2024-09-15T23:54:25.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 -- start start 2024-09-15T23:54:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec06fe50 0x7ff7ec148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec1520a0 0x7ff7ec15b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec15f3a0 0x7ff7ec15be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec073d30 con 0x7ff7ec1520a0 2024-09-15T23:54:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec073a50 con 0x7ff7ec15f3a0 2024-09-15T23:54:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f2e23640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ec167f10 con 0x7ff7ec06fe50 2024-09-15T23:54:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7ebfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec1520a0 0x7ff7ec15b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7ebfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec1520a0 0x7ff7ec15b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42090/0 (socket says 172.21.15.112:42090) 2024-09-15T23:54:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7ebfff640 1 -- 172.21.15.112:0/2961606860 learned_addr learned my addr 172.21.15.112:0/2961606860 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:25.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f0bbf640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec06fe50 0x7ff7ec148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f13c0640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec15f3a0 0x7ff7ec15be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7ebfff640 1 -- 172.21.15.112:0/2961606860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec06fe50 msgr2=0x7ff7ec148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7ebfff640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec06fe50 0x7ff7ec148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7ebfff640 1 -- 172.21.15.112:0/2961606860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec15f3a0 msgr2=0x7ff7ec15be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7ebfff640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec15f3a0 0x7ff7ec15be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7ebfff640 1 -- 172.21.15.112:0/2961606860 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec1f90e0 con 0x7ff7ec1520a0 2024-09-15T23:54:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f13c0640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec15f3a0 0x7ff7ec15be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7f0bbf640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec06fe50 0x7ff7ec148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.192+0000 7ff7ebfff640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec1520a0 0x7ff7ec15b8f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800c340 tx=0x7ff7d800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.196+0000 7ff7e97fa640 1 -- 172.21.15.112:0/2961606860 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d80052d0 con 0x7ff7ec1520a0 2024-09-15T23:54:25.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.196+0000 7ff7e97fa640 1 -- 172.21.15.112:0/2961606860 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d8005470 con 0x7ff7ec1520a0 2024-09-15T23:54:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.196+0000 7ff7f2e23640 1 -- 172.21.15.112:0/2961606860 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ec1f9380 con 0x7ff7ec1520a0 2024-09-15T23:54:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.196+0000 7ff7e97fa640 1 -- 172.21.15.112:0/2961606860 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8007260 con 0x7ff7ec1520a0 2024-09-15T23:54:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.196+0000 7ff7f2e23640 1 -- 172.21.15.112:0/2961606860 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ec1f9940 con 0x7ff7ec1520a0 2024-09-15T23:54:25.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.196+0000 7ff7f2e23640 1 -- 172.21.15.112:0/2961606860 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7ec06f910 con 0x7ff7ec1520a0 2024-09-15T23:54:25.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.196+0000 7ff7e97fa640 1 -- 172.21.15.112:0/2961606860 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7d8007400 con 0x7ff7ec1520a0 2024-09-15T23:54:25.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.196+0000 7ff7e97fa640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff7d00678c0 0x7ff7d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:25.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.196+0000 7ff7e97fa640 1 -- 172.21.15.112:0/2961606860 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff7d80853c0 con 0x7ff7ec1520a0 2024-09-15T23:54:25.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.196+0000 7ff7f0bbf640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff7d00678c0 0x7ff7d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:25.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.196+0000 7ff7f0bbf640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff7d00678c0 0x7ff7d0069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009840 tx=0x7ff7e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:25.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.200+0000 7ff7e97fa640 1 -- 172.21.15.112:0/2961606860 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff7d8055c50 con 0x7ff7ec1520a0 2024-09-15T23:54:25.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:25.408+0000 7ff7f2e23640 1 -- 172.21.15.112:0/2961606860 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]} v 0) -- 0x7ff7ec151e80 con 0x7ff7ec1520a0 2024-09-15T23:54:26.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.416+0000 7ff7e97fa640 1 -- 172.21.15.112:0/2961606860 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]}]=0 v53) ==== 135+0+0 (secure 0 0 0) 0x7ff7d8055550 con 0x7ff7ec1520a0 2024-09-15T23:54:26.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.416+0000 7ff7f2e23640 1 -- 172.21.15.112:0/2961606860 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff7d00678c0 msgr2=0x7ff7d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:26.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.416+0000 7ff7f2e23640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff7d00678c0 0x7ff7d0069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009840 tx=0x7ff7e0008040 comp rx=0 tx=0).stop 2024-09-15T23:54:26.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.416+0000 7ff7f2e23640 1 -- 172.21.15.112:0/2961606860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec1520a0 msgr2=0x7ff7ec15b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:26.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.416+0000 7ff7f2e23640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec1520a0 0x7ff7ec15b8f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800c340 tx=0x7ff7d800c800 comp rx=0 tx=0).stop 2024-09-15T23:54:26.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.416+0000 7ff7f2e23640 1 -- 172.21.15.112:0/2961606860 shutdown_connections 2024-09-15T23:54:26.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.416+0000 7ff7f2e23640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff7d00678c0 0x7ff7d0069d80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:26.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.416+0000 7ff7f2e23640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7ec15f3a0 0x7ff7ec15be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:26.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.416+0000 7ff7f2e23640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec1520a0 0x7ff7ec15b8f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:26.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.416+0000 7ff7f2e23640 1 --2- 172.21.15.112:0/2961606860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7ec06fe50 0x7ff7ec148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:26.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.416+0000 7ff7f2e23640 1 -- 172.21.15.112:0/2961606860 >> 172.21.15.112:0/2961606860 conn(0x7ff7ec0b1f90 msgr2=0x7ff7ec0cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:26.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.416+0000 7ff7f2e23640 1 -- 172.21.15.112:0/2961606860 shutdown_connections 2024-09-15T23:54:26.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.416+0000 7ff7f2e23640 1 -- 172.21.15.112:0/2961606860 wait complete. 2024-09-15T23:54:26.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:54:26.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f6d71640 1 Processor -- start 2024-09-15T23:54:26.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f6d71640 1 -- start start 2024-09-15T23:54:26.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f6d71640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f93f0161a60 0x7f93f00d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:26.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f6d71640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f93f00cf620 0x7f93f006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:26.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f6d71640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93f00d32b0 con 0x7f93f00d2e90 2024-09-15T23:54:26.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f6d71640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f93f00d0300 con 0x7f93f0161a60 2024-09-15T23:54:26.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f6d71640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f93f00cfa90 con 0x7f93f00cf620 2024-09-15T23:54:26.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f4b0d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f93f0161a60 0x7f93f00d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:26.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f4b0d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f93f0161a60 0x7f93f00d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42096/0 (socket says 172.21.15.112:42096) 2024-09-15T23:54:26.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f4b0d640 1 -- 172.21.15.112:0/2355480045 learned_addr learned my addr 172.21.15.112:0/2355480045 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:26.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f530e640 1 --2- 172.21.15.112:0/2355480045 >> v2:172.21.15.169:3300/0 conn(0x7f93f00cf620 0x7f93f006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:26.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f4b0d640 1 -- 172.21.15.112:0/2355480045 >> v2:172.21.15.169:3300/0 conn(0x7f93f00cf620 msgr2=0x7f93f006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:26.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f4b0d640 1 --2- 172.21.15.112:0/2355480045 >> v2:172.21.15.169:3300/0 conn(0x7f93f00cf620 0x7f93f006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:26.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f4b0d640 1 -- 172.21.15.112:0/2355480045 >> v1:172.21.15.169:6789/0 conn(0x7f93f00d2e90 legacy=0x7f93f00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:26.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f4b0d640 1 -- 172.21.15.112:0/2355480045 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f00b0f60 con 0x7f93f0161a60 2024-09-15T23:54:26.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.568+0000 7f93f530e640 1 --2- 172.21.15.112:0/2355480045 >> v2:172.21.15.169:3300/0 conn(0x7f93f00cf620 0x7f93f006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:26.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f4b0d640 1 --2- 172.21.15.112:0/2355480045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f0161a60 0x7f93f00d2950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f93f00ce950 tx=0x7f93e001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6a52cf6b1f7e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:26.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93ef7fe640 1 -- 172.21.15.112:0/2355480045 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e00ab620 con 0x7f93f0161a60 2024-09-15T23:54:26.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93ef7fe640 1 -- 172.21.15.112:0/2355480045 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e00b0070 con 0x7f93f0161a60 2024-09-15T23:54:26.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93ef7fe640 1 -- 172.21.15.112:0/2355480045 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e00ab9e0 con 0x7f93f0161a60 2024-09-15T23:54:26.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 -- 172.21.15.112:0/2355480045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f0161a60 msgr2=0x7f93f00d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:26.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 --2- 172.21.15.112:0/2355480045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f0161a60 0x7f93f00d2950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f93f00ce950 tx=0x7f93e001c420 comp rx=0 tx=0).stop 2024-09-15T23:54:26.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 -- 172.21.15.112:0/2355480045 shutdown_connections 2024-09-15T23:54:26.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 --2- 172.21.15.112:0/2355480045 >> v2:172.21.15.169:3300/0 conn(0x7f93f00cf620 0x7f93f006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:26.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 --2- 172.21.15.112:0/2355480045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f0161a60 0x7f93f00d2950 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:26.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 -- 172.21.15.112:0/2355480045 >> 172.21.15.112:0/2355480045 conn(0x7f93f008bf90 msgr2=0x7f93f009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:26.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 -- 172.21.15.112:0/2355480045 shutdown_connections 2024-09-15T23:54:26.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 -- 172.21.15.112:0/2355480045 wait complete. 2024-09-15T23:54:26.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 Processor -- start 2024-09-15T23:54:26.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 -- start start 2024-09-15T23:54:26.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93f00cf620 0x7f93f01527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:26.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f00d2e90 0x7f93f015b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:26.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93f0161a60 0x7f93f00b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:26.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f93f006e400 con 0x7f93f00d2e90 2024-09-15T23:54:26.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f93f006d190 con 0x7f93f00cf620 2024-09-15T23:54:26.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93f6d71640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f93f006e580 con 0x7f93f0161a60 2024-09-15T23:54:26.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93effff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f00d2e90 0x7f93f015b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:26.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93effff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f00d2e90 0x7f93f015b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42102/0 (socket says 172.21.15.112:42102) 2024-09-15T23:54:26.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.572+0000 7f93effff640 1 -- 172.21.15.112:0/1750168513 learned_addr learned my addr 172.21.15.112:0/1750168513 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:26.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93f530e640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93f0161a60 0x7f93f00b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:26.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93f4b0d640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93f00cf620 0x7f93f01527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:26.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93effff640 1 -- 172.21.15.112:0/1750168513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93f0161a60 msgr2=0x7f93f00b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:26.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93effff640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93f0161a60 0x7f93f00b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:26.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93effff640 1 -- 172.21.15.112:0/1750168513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93f00cf620 msgr2=0x7f93f01527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:26.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93effff640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93f00cf620 0x7f93f01527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:26.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93effff640 1 -- 172.21.15.112:0/1750168513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f00b9850 con 0x7f93f00d2e90 2024-09-15T23:54:26.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93f530e640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93f0161a60 0x7f93f00b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:26.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93f4b0d640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93f00cf620 0x7f93f01527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:26.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93effff640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f00d2e90 0x7f93f015b0f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f93d800b410 tx=0x7f93d800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:26.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93ed7fa640 1 -- 172.21.15.112:0/1750168513 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8015030 con 0x7f93f00d2e90 2024-09-15T23:54:26.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93ed7fa640 1 -- 172.21.15.112:0/1750168513 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d8004020 con 0x7f93f00d2e90 2024-09-15T23:54:26.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93f6d71640 1 -- 172.21.15.112:0/1750168513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f00b9b30 con 0x7f93f00d2e90 2024-09-15T23:54:26.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93ed7fa640 1 -- 172.21.15.112:0/1750168513 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8004450 con 0x7f93f00d2e90 2024-09-15T23:54:26.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93f6d71640 1 -- 172.21.15.112:0/1750168513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f015b630 con 0x7f93f00d2e90 2024-09-15T23:54:26.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93f6d71640 1 -- 172.21.15.112:0/1750168513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93f00ba050 con 0x7f93f00d2e90 2024-09-15T23:54:26.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93ed7fa640 1 -- 172.21.15.112:0/1750168513 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f93d8018070 con 0x7f93f00d2e90 2024-09-15T23:54:26.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93ed7fa640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f93d00678c0 0x7f93d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:26.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93ed7fa640 1 -- 172.21.15.112:0/1750168513 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f93d8085bf0 con 0x7f93f00d2e90 2024-09-15T23:54:26.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93f4b0d640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f93d00678c0 0x7f93d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:26.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.576+0000 7f93f4b0d640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f93d00678c0 0x7f93d0069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93e00af000 tx=0x7f93e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:26.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.580+0000 7f93ed7fa640 1 -- 172.21.15.112:0/1750168513 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f93d8056400 con 0x7f93f00d2e90 2024-09-15T23:54:26.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.744+0000 7f93f6d71640 1 -- 172.21.15.112:0/1750168513 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f93f006d6b0 con 0x7f93f00d2e90 2024-09-15T23:54:26.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.748+0000 7f93ed7fa640 1 -- 172.21.15.112:0/1750168513 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f93d8055d00 con 0x7f93f00d2e90 2024-09-15T23:54:26.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.748+0000 7f93f6d71640 1 -- 172.21.15.112:0/1750168513 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f93d00678c0 msgr2=0x7f93d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:26.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.748+0000 7f93f6d71640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f93d00678c0 0x7f93d0069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93e00af000 tx=0x7f93e0008040 comp rx=0 tx=0).stop 2024-09-15T23:54:26.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.748+0000 7f93f6d71640 1 -- 172.21.15.112:0/1750168513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f00d2e90 msgr2=0x7f93f015b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:26.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.748+0000 7f93f6d71640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f00d2e90 0x7f93f015b0f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f93d800b410 tx=0x7f93d800b8d0 comp rx=0 tx=0).stop 2024-09-15T23:54:26.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.748+0000 7f93f6d71640 1 -- 172.21.15.112:0/1750168513 shutdown_connections 2024-09-15T23:54:26.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.748+0000 7f93f6d71640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f93d00678c0 0x7f93d0069d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:26.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.748+0000 7f93f6d71640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93f0161a60 0x7f93f00b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:26.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.748+0000 7f93f6d71640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93f00d2e90 0x7f93f015b0f0 secure :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f93d800b410 tx=0x7f93d800b8d0 comp rx=0 tx=0).stop 2024-09-15T23:54:26.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.748+0000 7f93f6d71640 1 --2- 172.21.15.112:0/1750168513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93f00cf620 0x7f93f01527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:26.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.748+0000 7f93f6d71640 1 -- 172.21.15.112:0/1750168513 >> 172.21.15.112:0/1750168513 conn(0x7f93f008bf90 msgr2=0x7f93f00b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:26.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.748+0000 7f93f6d71640 1 -- 172.21.15.112:0/1750168513 shutdown_connections 2024-09-15T23:54:26.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:26.748+0000 7f93f6d71640 1 -- 172.21.15.112:0/1750168513 wait complete. 2024-09-15T23:54:26.771 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:54:26.771 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:54:26.843 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:54:26.920 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:54:26.920 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:54:26.920 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:54:26.926 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:54:26.926 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:54:26.975 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:54:27.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cc5b54640 1 Processor -- start 2024-09-15T23:54:27.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cc5b54640 1 -- start start 2024-09-15T23:54:27.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cc5b54640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc006f9b0 0x7f0cc00b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cc5b54640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc0070830 con 0x7f0cc006bcc0 2024-09-15T23:54:27.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cc5b54640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc00b5af0 con 0x7f0cc0147c90 2024-09-15T23:54:27.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cc5b54640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc0148070 con 0x7f0cc006f9b0 2024-09-15T23:54:27.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbffff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0cc006bcc0 0x7f0cc00ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51656/0 (socket says 172.21.15.112:51656) 2024-09-15T23:54:27.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbffff640 1 -- 172.21.15.112:0/2553335491 learned_addr learned my addr 172.21.15.112:0/2553335491 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:27.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbeffd640 1 --2- 172.21.15.112:0/2553335491 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc006f9b0 0x7f0cc00b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 -- 172.21.15.112:0/2553335491 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158694687 0 0) 0x7f0cc0070830 con 0x7f0cc006bcc0 2024-09-15T23:54:27.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 -- 172.21.15.112:0/2553335491 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ca8003530 con 0x7f0cc006bcc0 2024-09-15T23:54:27.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 -- 172.21.15.112:0/2553335491 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1149915321 0 0) 0x7f0ca8003530 con 0x7f0cc006bcc0 2024-09-15T23:54:27.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 -- 172.21.15.112:0/2553335491 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc006f9b0 msgr2=0x7f0cc00b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:27.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 --2- 172.21.15.112:0/2553335491 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc006f9b0 0x7f0cc00b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 -- 172.21.15.112:0/2553335491 >> v1:172.21.15.169:6789/0 conn(0x7f0cc0147c90 legacy=0x7f0cc00b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 -- 172.21.15.112:0/2553335491 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc006ff50 con 0x7f0cc006bcc0 2024-09-15T23:54:27.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 -- 172.21.15.112:0/2553335491 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f0cb8001a00 con 0x7f0cc006bcc0 2024-09-15T23:54:27.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbeffd640 1 --2- 172.21.15.112:0/2553335491 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc006f9b0 0x7f0cc00b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:54:27.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 -- 172.21.15.112:0/2553335491 >> v1:172.21.15.112:6789/0 conn(0x7f0cc006bcc0 legacy=0x7f0cc00ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 --2- 172.21.15.112:0/2553335491 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc006f9b0 0x7f0ca80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 --2- 172.21.15.112:0/2553335491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ca8004030 0x7f0ca8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 --2- 172.21.15.112:0/2553335491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ca8004d50 0x7f0ca80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 -- 172.21.15.112:0/2553335491 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca800bb60 con 0x7f0ca8004d50 2024-09-15T23:54:27.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 -- 172.21.15.112:0/2553335491 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca800bd10 con 0x7f0ca8004030 2024-09-15T23:54:27.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbe7fc640 1 -- 172.21.15.112:0/2553335491 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca800bf10 con 0x7f0cc006f9b0 2024-09-15T23:54:27.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbffff640 1 --2- 172.21.15.112:0/2553335491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ca8004d50 0x7f0ca80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbf7fe640 1 --2- 172.21.15.112:0/2553335491 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc006f9b0 0x7f0ca80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbeffd640 1 --2- 172.21.15.112:0/2553335491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ca8004030 0x7f0ca8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbffff640 1 -- 172.21.15.112:0/2553335491 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc006f9b0 msgr2=0x7f0ca80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:27.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbffff640 1 --2- 172.21.15.112:0/2553335491 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc006f9b0 0x7f0ca80039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbffff640 1 -- 172.21.15.112:0/2553335491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ca8004030 msgr2=0x7f0ca8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:27.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbffff640 1 --2- 172.21.15.112:0/2553335491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ca8004030 0x7f0ca8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.144+0000 7f0cbffff640 1 -- 172.21.15.112:0/2553335491 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca8003530 con 0x7f0ca8004d50 2024-09-15T23:54:27.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.148+0000 7f0cbffff640 1 --2- 172.21.15.112:0/2553335491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ca8004d50 0x7f0ca80051d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800a7b0 tx=0x7f0cb801d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9937c6c1d504869 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:27.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.148+0000 7f0cbe7fc640 1 -- 172.21.15.112:0/2553335491 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb800a3d0 con 0x7f0ca8004d50 2024-09-15T23:54:27.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.148+0000 7f0cbe7fc640 1 -- 172.21.15.112:0/2553335491 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb80ad630 con 0x7f0ca8004d50 2024-09-15T23:54:27.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.148+0000 7f0cbe7fc640 1 -- 172.21.15.112:0/2553335491 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80adaa0 con 0x7f0ca8004d50 2024-09-15T23:54:27.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.148+0000 7f0cc5b54640 1 -- 172.21.15.112:0/2553335491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ca8004d50 msgr2=0x7f0ca80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.148+0000 7f0cc5b54640 1 --2- 172.21.15.112:0/2553335491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ca8004d50 0x7f0ca80051d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800a7b0 tx=0x7f0cb801d2e0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.148+0000 7f0cbffff640 1 -- 172.21.15.112:0/2553335491 reap_dead start 2024-09-15T23:54:27.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.148+0000 7f0cc5b54640 1 -- 172.21.15.112:0/2553335491 shutdown_connections 2024-09-15T23:54:27.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.148+0000 7f0cc5b54640 1 -- 172.21.15.112:0/2553335491 >> 172.21.15.112:0/2553335491 conn(0x7f0cc009aa00 msgr2=0x7f0cc00b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:27.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.148+0000 7f0cc5b54640 1 -- 172.21.15.112:0/2553335491 shutdown_connections 2024-09-15T23:54:27.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.148+0000 7f0cc5b54640 1 -- 172.21.15.112:0/2553335491 wait complete. 2024-09-15T23:54:27.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.148+0000 7f0cc5b54640 1 Processor -- start 2024-09-15T23:54:27.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.148+0000 7f0cc5b54640 1 -- start start 2024-09-15T23:54:27.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cc5b54640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cc01f3fa0 0x7f0cc015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cc5b54640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cc00cde50 0x7f0cc01f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cc5b54640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc01f48c0 0x7f0cc01f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cc5b54640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00b5fd0 con 0x7f0cc01f3fa0 2024-09-15T23:54:27.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cc5b54640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc0070db0 con 0x7f0cc00cde50 2024-09-15T23:54:27.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cc5b54640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc00b6150 con 0x7f0cc01f48c0 2024-09-15T23:54:27.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cbf7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cc01f3fa0 0x7f0cc015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cbf7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cc01f3fa0 0x7f0cc015fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42122/0 (socket says 172.21.15.112:42122) 2024-09-15T23:54:27.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cbf7fe640 1 -- 172.21.15.112:0/176635681 learned_addr learned my addr 172.21.15.112:0/176635681 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:27.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cbeffd640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cc00cde50 0x7f0cc01f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cbffff640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc01f48c0 0x7f0cc01f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cbf7fe640 1 -- 172.21.15.112:0/176635681 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc01f48c0 msgr2=0x7f0cc01f50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cbf7fe640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc01f48c0 0x7f0cc01f50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cbf7fe640 1 -- 172.21.15.112:0/176635681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cc00cde50 msgr2=0x7f0cc01f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cbf7fe640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cc00cde50 0x7f0cc01f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cbf7fe640 1 -- 172.21.15.112:0/176635681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc0160790 con 0x7f0cc01f3fa0 2024-09-15T23:54:27.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cbffff640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc01f48c0 0x7f0cc01f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:27.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cbf7fe640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cc01f3fa0 0x7f0cc015fe20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000e4d0 tx=0x7f0cb000e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:27.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0ca7fff640 1 -- 172.21.15.112:0/176635681 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00053a0 con 0x7f0cc01f3fa0 2024-09-15T23:54:27.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0ca7fff640 1 -- 172.21.15.112:0/176635681 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb0018070 con 0x7f0cc01f3fa0 2024-09-15T23:54:27.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cc5b54640 1 -- 172.21.15.112:0/176635681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc0160a70 con 0x7f0cc01f3fa0 2024-09-15T23:54:27.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0ca7fff640 1 -- 172.21.15.112:0/176635681 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0003820 con 0x7f0cc01f3fa0 2024-09-15T23:54:27.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cc5b54640 1 -- 172.21.15.112:0/176635681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc0161030 con 0x7f0cc01f3fa0 2024-09-15T23:54:27.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cc5b54640 1 -- 172.21.15.112:0/176635681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc006c150 con 0x7f0cc01f3fa0 2024-09-15T23:54:27.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0ca7fff640 1 -- 172.21.15.112:0/176635681 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0cb00039c0 con 0x7f0cc01f3fa0 2024-09-15T23:54:27.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0ca7fff640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0cac0678c0 0x7f0cac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0ca7fff640 1 -- 172.21.15.112:0/176635681 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0cb0085cc0 con 0x7f0cc01f3fa0 2024-09-15T23:54:27.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cbeffd640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0cac0678c0 0x7f0cac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.152+0000 7f0cbeffd640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0cac0678c0 0x7f0cac069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0cc009c1f0 tx=0x7f0cb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:27.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.156+0000 7f0ca7fff640 1 -- 172.21.15.112:0/176635681 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0cb00564c0 con 0x7f0cc01f3fa0 2024-09-15T23:54:27.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.328+0000 7f0cc5b54640 1 -- 172.21.15.112:0/176635681 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0cc006efa0 con 0x7f0cc01f3fa0 2024-09-15T23:54:27.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.328+0000 7f0ca7fff640 1 -- 172.21.15.112:0/176635681 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f0cb0055dc0 con 0x7f0cc01f3fa0 2024-09-15T23:54:27.333 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:54:27.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.332+0000 7f0cc5b54640 1 -- 172.21.15.112:0/176635681 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0cac0678c0 msgr2=0x7f0cac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.332+0000 7f0cc5b54640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0cac0678c0 0x7f0cac069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0cc009c1f0 tx=0x7f0cb4008040 comp rx=0 tx=0).stop 2024-09-15T23:54:27.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.332+0000 7f0cc5b54640 1 -- 172.21.15.112:0/176635681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cc01f3fa0 msgr2=0x7f0cc015fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.332+0000 7f0cc5b54640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cc01f3fa0 0x7f0cc015fe20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000e4d0 tx=0x7f0cb000e990 comp rx=0 tx=0).stop 2024-09-15T23:54:27.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.332+0000 7f0cc5b54640 1 -- 172.21.15.112:0/176635681 shutdown_connections 2024-09-15T23:54:27.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.332+0000 7f0cc5b54640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0cac0678c0 0x7f0cac069d80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.332+0000 7f0cc5b54640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0cc01f48c0 0x7f0cc01f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.332+0000 7f0cc5b54640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cc00cde50 0x7f0cc01f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.332+0000 7f0cc5b54640 1 --2- 172.21.15.112:0/176635681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cc01f3fa0 0x7f0cc015fe20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.332+0000 7f0cc5b54640 1 -- 172.21.15.112:0/176635681 >> 172.21.15.112:0/176635681 conn(0x7f0cc009aa00 msgr2=0x7f0cc00b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:27.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.332+0000 7f0cc5b54640 1 -- 172.21.15.112:0/176635681 shutdown_connections 2024-09-15T23:54:27.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.332+0000 7f0cc5b54640 1 -- 172.21.15.112:0/176635681 wait complete. 2024-09-15T23:54:27.351 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:54:27.351 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:54:27.357 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:54:27.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7223982640 1 Processor -- start 2024-09-15T23:54:27.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7223982640 1 -- start start 2024-09-15T23:54:27.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7223982640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f721c0b3330 0x7f721c0b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7223982640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f721c15bc80 0x7f721c0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7223982640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f721c0b3c50 con 0x7f721c0b51b0 2024-09-15T23:54:27.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7223982640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f721c0d0b80 con 0x7f721c0b3330 2024-09-15T23:54:27.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7223982640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f721c0d0e60 con 0x7f721c15bc80 2024-09-15T23:54:27.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7220f1d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f721c0b51b0 0x7f721c15b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51660/0 (socket says 172.21.15.112:51660) 2024-09-15T23:54:27.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7220f1d640 1 -- 172.21.15.112:0/3381183066 learned_addr learned my addr 172.21.15.112:0/3381183066 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:27.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f722171e640 1 --2- 172.21.15.112:0/3381183066 >> v2:172.21.15.169:3300/0 conn(0x7f721c0b3330 0x7f721c0b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7221f1f640 1 --2- 172.21.15.112:0/3381183066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f721c15bc80 0x7f721c0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 -- 172.21.15.112:0/3381183066 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3670877721 0 0) 0x7f721c0b3c50 con 0x7f721c0b51b0 2024-09-15T23:54:27.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 -- 172.21.15.112:0/3381183066 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7208003530 con 0x7f721c0b51b0 2024-09-15T23:54:27.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 -- 172.21.15.112:0/3381183066 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 388876309 0 0) 0x7f7208003530 con 0x7f721c0b51b0 2024-09-15T23:54:27.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 -- 172.21.15.112:0/3381183066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f721c15bc80 msgr2=0x7f721c0b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:27.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 --2- 172.21.15.112:0/3381183066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f721c15bc80 0x7f721c0b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 -- 172.21.15.112:0/3381183066 >> v2:172.21.15.169:3300/0 conn(0x7f721c0b3330 msgr2=0x7f721c0b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:27.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 --2- 172.21.15.112:0/3381183066 >> v2:172.21.15.169:3300/0 conn(0x7f721c0b3330 0x7f721c0b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 -- 172.21.15.112:0/3381183066 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721c0b46d0 con 0x7f721c0b51b0 2024-09-15T23:54:27.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 -- 172.21.15.112:0/3381183066 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f720c001680 con 0x7f721c0b51b0 2024-09-15T23:54:27.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 -- 172.21.15.112:0/3381183066 >> v1:172.21.15.112:6789/0 conn(0x7f721c0b51b0 legacy=0x7f721c15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 --2- 172.21.15.112:0/3381183066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f721c15bc80 0x7f72080039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 --2- 172.21.15.112:0/3381183066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7208003f40 0x7f7208004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 --2- 172.21.15.112:0/3381183066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7208004d50 0x7f72080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 -- 172.21.15.112:0/3381183066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f721c0d0b80 con 0x7f7208004d50 2024-09-15T23:54:27.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 -- 172.21.15.112:0/3381183066 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f721c0d0e60 con 0x7f7208003f40 2024-09-15T23:54:27.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7213fff640 1 -- 172.21.15.112:0/3381183066 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f720800ba20 con 0x7f721c15bc80 2024-09-15T23:54:27.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7221f1f640 1 --2- 172.21.15.112:0/3381183066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7208004d50 0x7f72080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f722171e640 1 --2- 172.21.15.112:0/3381183066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f721c15bc80 0x7f72080039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7220f1d640 1 --2- 172.21.15.112:0/3381183066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7208003f40 0x7f7208004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7221f1f640 1 -- 172.21.15.112:0/3381183066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f721c15bc80 msgr2=0x7f72080039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:27.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7221f1f640 1 --2- 172.21.15.112:0/3381183066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f721c15bc80 0x7f72080039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7221f1f640 1 -- 172.21.15.112:0/3381183066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7208003f40 msgr2=0x7f7208004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:27.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7221f1f640 1 --2- 172.21.15.112:0/3381183066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7208003f40 0x7f7208004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.520+0000 7f7221f1f640 1 -- 172.21.15.112:0/3381183066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7208003530 con 0x7f7208004d50 2024-09-15T23:54:27.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.524+0000 7f7221f1f640 1 --2- 172.21.15.112:0/3381183066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7208004d50 0x7f72080051d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7214009fc0 tx=0x7f721401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9520531b25e13b50 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:27.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.524+0000 7f7213fff640 1 -- 172.21.15.112:0/3381183066 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72140b2070 con 0x7f7208004d50 2024-09-15T23:54:27.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.524+0000 7f7213fff640 1 -- 172.21.15.112:0/3381183066 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72140a5b40 con 0x7f7208004d50 2024-09-15T23:54:27.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.524+0000 7f7213fff640 1 -- 172.21.15.112:0/3381183066 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7214009c10 con 0x7f7208004d50 2024-09-15T23:54:27.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.524+0000 7f7223982640 1 -- 172.21.15.112:0/3381183066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7208004d50 msgr2=0x7f72080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.524+0000 7f7223982640 1 --2- 172.21.15.112:0/3381183066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7208004d50 0x7f72080051d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7214009fc0 tx=0x7f721401cc40 comp rx=0 tx=0).stop 2024-09-15T23:54:27.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.524+0000 7f7221f1f640 1 -- 172.21.15.112:0/3381183066 reap_dead start 2024-09-15T23:54:27.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.524+0000 7f7223982640 1 -- 172.21.15.112:0/3381183066 shutdown_connections 2024-09-15T23:54:27.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.524+0000 7f7223982640 1 -- 172.21.15.112:0/3381183066 >> 172.21.15.112:0/3381183066 conn(0x7f721c0b6870 msgr2=0x7f721c0b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:27.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.524+0000 7f7223982640 1 -- 172.21.15.112:0/3381183066 shutdown_connections 2024-09-15T23:54:27.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.524+0000 7f7223982640 1 -- 172.21.15.112:0/3381183066 wait complete. 2024-09-15T23:54:27.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.524+0000 7f7223982640 1 Processor -- start 2024-09-15T23:54:27.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.524+0000 7f7223982640 1 -- start start 2024-09-15T23:54:27.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7223982640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7208004d50 0x7f721c140ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7223982640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f721c13efd0 0x7f721c15a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7223982640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f721c15a6f0 0x7f721c13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7223982640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f721c144d00 con 0x7f7208004d50 2024-09-15T23:54:27.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7223982640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f721c0b4c90 con 0x7f721c15a6f0 2024-09-15T23:54:27.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7223982640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f721c144e80 con 0x7f721c13efd0 2024-09-15T23:54:27.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f722171e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7208004d50 0x7f721c140ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f722171e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7208004d50 0x7f721c140ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42134/0 (socket says 172.21.15.112:42134) 2024-09-15T23:54:27.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f722171e640 1 -- 172.21.15.112:0/1446677608 learned_addr learned my addr 172.21.15.112:0/1446677608 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:27.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7221f1f640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f721c15a6f0 0x7f721c13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7220f1d640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f721c13efd0 0x7f721c15a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f722171e640 1 -- 172.21.15.112:0/1446677608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f721c13efd0 msgr2=0x7f721c15a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f722171e640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f721c13efd0 0x7f721c15a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f722171e640 1 -- 172.21.15.112:0/1446677608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f721c15a6f0 msgr2=0x7f721c13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f722171e640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f721c15a6f0 0x7f721c13c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f722171e640 1 -- 172.21.15.112:0/1446677608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721c15cc50 con 0x7f7208004d50 2024-09-15T23:54:27.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7221f1f640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f721c15a6f0 0x7f721c13c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:27.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f722171e640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7208004d50 0x7f721c140ca0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7218011630 tx=0x7f7218011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:27.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7211ffb640 1 -- 172.21.15.112:0/1446677608 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721800f920 con 0x7f7208004d50 2024-09-15T23:54:27.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7211ffb640 1 -- 172.21.15.112:0/1446677608 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721800fac0 con 0x7f7208004d50 2024-09-15T23:54:27.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7211ffb640 1 -- 172.21.15.112:0/1446677608 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721800fe70 con 0x7f7208004d50 2024-09-15T23:54:27.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7223982640 1 -- 172.21.15.112:0/1446677608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f721c13fc00 con 0x7f7208004d50 2024-09-15T23:54:27.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7223982640 1 -- 172.21.15.112:0/1446677608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f721c1401c0 con 0x7f7208004d50 2024-09-15T23:54:27.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7223982640 1 -- 172.21.15.112:0/1446677608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f721c1408e0 con 0x7f7208004d50 2024-09-15T23:54:27.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7211ffb640 1 -- 172.21.15.112:0/1446677608 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7218015460 con 0x7f7208004d50 2024-09-15T23:54:27.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7211ffb640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f72000678c0 0x7f7200069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7211ffb640 1 -- 172.21.15.112:0/1446677608 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f72180868c0 con 0x7f7208004d50 2024-09-15T23:54:27.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7220f1d640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f72000678c0 0x7f7200069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.528+0000 7f7220f1d640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f72000678c0 0x7f7200069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f720c001060 tx=0x7f720c004810 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:27.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.532+0000 7f7211ffb640 1 -- 172.21.15.112:0/1446677608 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7218019030 con 0x7f7208004d50 2024-09-15T23:54:27.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.704+0000 7f7223982640 1 -- 172.21.15.112:0/1446677608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f721c0b55d0 con 0x7f7208004d50 2024-09-15T23:54:27.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.708+0000 7f7211ffb640 1 -- 172.21.15.112:0/1446677608 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f7218057150 con 0x7f7208004d50 2024-09-15T23:54:27.710 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:54:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.708+0000 7f7223982640 1 -- 172.21.15.112:0/1446677608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f72000678c0 msgr2=0x7f7200069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.708+0000 7f7223982640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f72000678c0 0x7f7200069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f720c001060 tx=0x7f720c004810 comp rx=0 tx=0).stop 2024-09-15T23:54:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.708+0000 7f7223982640 1 -- 172.21.15.112:0/1446677608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7208004d50 msgr2=0x7f721c140ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.708+0000 7f7223982640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7208004d50 0x7f721c140ca0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7218011630 tx=0x7f7218011af0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.708+0000 7f7223982640 1 -- 172.21.15.112:0/1446677608 shutdown_connections 2024-09-15T23:54:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.708+0000 7f7223982640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f72000678c0 0x7f7200069d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.708+0000 7f7223982640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f721c15a6f0 0x7f721c13c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.708+0000 7f7223982640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f721c13efd0 0x7f721c15a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.708+0000 7f7223982640 1 --2- 172.21.15.112:0/1446677608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7208004d50 0x7f721c140ca0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.708+0000 7f7223982640 1 -- 172.21.15.112:0/1446677608 >> 172.21.15.112:0/1446677608 conn(0x7f721c0b6870 msgr2=0x7f721c0b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:27.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.708+0000 7f7223982640 1 -- 172.21.15.112:0/1446677608 shutdown_connections 2024-09-15T23:54:27.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.708+0000 7f7223982640 1 -- 172.21.15.112:0/1446677608 wait complete. 2024-09-15T23:54:27.730 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2024-09-15T23:54:27.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:27.730 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:27.742 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:54:27.742 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:54:27.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:27.743 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:54:27.795 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:54:27.795 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:54:27.802 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:54:27.802 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:54:27.851 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:54:27.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.976+0000 7f1a0da2d640 1 Processor -- start 2024-09-15T23:54:27.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.976+0000 7f1a0da2d640 1 -- start start 2024-09-15T23:54:27.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.976+0000 7f1a0da2d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1a0815c2a0 0x7f1a080aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.976+0000 7f1a0da2d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a080b3290 con 0x7f1a0815bec0 2024-09-15T23:54:27.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.976+0000 7f1a0da2d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a080b3570 con 0x7f1a080af2a0 2024-09-15T23:54:27.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.976+0000 7f1a0da2d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1a080b3850 con 0x7f1a0815c2a0 2024-09-15T23:54:27.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.976+0000 7f1a067fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1a0815c2a0 0x7f1a080aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.976+0000 7f1a06ffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1a0815bec0 0x7f1a080ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51664/0 (socket says 172.21.15.112:51664) 2024-09-15T23:54:27.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.976+0000 7f1a06ffd640 1 -- 172.21.15.112:0/1904515980 learned_addr learned my addr 172.21.15.112:0/1904515980 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:27.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a067fc640 1 -- 172.21.15.112:0/1904515980 >> v1:172.21.15.169:6789/0 conn(0x7f1a080af2a0 legacy=0x7f1a0806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:27.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a067fc640 1 -- 172.21.15.112:0/1904515980 >> v1:172.21.15.112:6789/0 conn(0x7f1a0815bec0 legacy=0x7f1a080ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a05ffb640 1 -- 172.21.15.112:0/1904515980 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 272773288 0 0) 0x7f1a080b3290 con 0x7f1a0815bec0 2024-09-15T23:54:27.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a067fc640 1 -- 172.21.15.112:0/1904515980 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a080b3b30 con 0x7f1a0815c2a0 2024-09-15T23:54:27.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a067fc640 1 --2- 172.21.15.112:0/1904515980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a0815c2a0 0x7f1a080aed60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009d90 tx=0x7f19f801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7d16e2f4e02b0f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:27.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a05ffb640 1 -- 172.21.15.112:0/1904515980 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f80b2070 con 0x7f1a0815c2a0 2024-09-15T23:54:27.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a05ffb640 1 -- 172.21.15.112:0/1904515980 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f80a59c0 con 0x7f1a0815c2a0 2024-09-15T23:54:27.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a05ffb640 1 -- 172.21.15.112:0/1904515980 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f80a5d90 con 0x7f1a0815c2a0 2024-09-15T23:54:27.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a0da2d640 1 -- 172.21.15.112:0/1904515980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a0815c2a0 msgr2=0x7f1a080aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a0da2d640 1 --2- 172.21.15.112:0/1904515980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a0815c2a0 0x7f1a080aed60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009d90 tx=0x7f19f801c900 comp rx=0 tx=0).stop 2024-09-15T23:54:27.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a0da2d640 1 -- 172.21.15.112:0/1904515980 shutdown_connections 2024-09-15T23:54:27.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a0da2d640 1 --2- 172.21.15.112:0/1904515980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a0815c2a0 0x7f1a080aed60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a0da2d640 1 -- 172.21.15.112:0/1904515980 >> 172.21.15.112:0/1904515980 conn(0x7f1a080b1f90 msgr2=0x7f1a080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:27.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a0da2d640 1 -- 172.21.15.112:0/1904515980 shutdown_connections 2024-09-15T23:54:27.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.980+0000 7f1a0da2d640 1 -- 172.21.15.112:0/1904515980 wait complete. 2024-09-15T23:54:27.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a0da2d640 1 Processor -- start 2024-09-15T23:54:27.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a0da2d640 1 -- start start 2024-09-15T23:54:27.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a0da2d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a080af2a0 0x7f1a08145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a0da2d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a0815bec0 0x7f1a080cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a0da2d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a0815c2a0 0x7f1a080d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a0da2d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0806ef20 con 0x7f1a080af2a0 2024-09-15T23:54:27.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a0da2d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1a080af710 con 0x7f1a0815bec0 2024-09-15T23:54:27.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a0da2d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0806f0a0 con 0x7f1a0815c2a0 2024-09-15T23:54:27.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a06ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a080af2a0 0x7f1a08145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a06ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a080af2a0 0x7f1a08145ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42152/0 (socket says 172.21.15.112:42152) 2024-09-15T23:54:27.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a06ffd640 1 -- 172.21.15.112:0/295142078 learned_addr learned my addr 172.21.15.112:0/295142078 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:27.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a06ffd640 1 -- 172.21.15.112:0/295142078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a0815c2a0 msgr2=0x7f1a080d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a06ffd640 1 --2- 172.21.15.112:0/295142078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a0815c2a0 0x7f1a080d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a06ffd640 1 -- 172.21.15.112:0/295142078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a0815bec0 msgr2=0x7f1a080cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:27.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a06ffd640 1 --2- 172.21.15.112:0/295142078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a0815bec0 0x7f1a080cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:27.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a06ffd640 1 -- 172.21.15.112:0/295142078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a08157230 con 0x7f1a080af2a0 2024-09-15T23:54:27.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a06ffd640 1 --2- 172.21.15.112:0/295142078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a080af2a0 0x7f1a08145ed0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0011f0 tx=0x7f19fc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:27.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f19effff640 1 -- 172.21.15.112:0/295142078 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc018070 con 0x7f1a080af2a0 2024-09-15T23:54:27.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f19effff640 1 -- 172.21.15.112:0/295142078 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19fc0074e0 con 0x7f1a080af2a0 2024-09-15T23:54:27.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a0da2d640 1 -- 172.21.15.112:0/295142078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a08157510 con 0x7f1a080af2a0 2024-09-15T23:54:27.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f19effff640 1 -- 172.21.15.112:0/295142078 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc004a10 con 0x7f1a080af2a0 2024-09-15T23:54:27.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a0da2d640 1 -- 172.21.15.112:0/295142078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a08157ad0 con 0x7f1a080af2a0 2024-09-15T23:54:27.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f1a0da2d640 1 -- 172.21.15.112:0/295142078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a080aed60 con 0x7f1a080af2a0 2024-09-15T23:54:27.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.984+0000 7f19effff640 1 -- 172.21.15.112:0/295142078 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f19fc01b070 con 0x7f1a080af2a0 2024-09-15T23:54:27.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.988+0000 7f19effff640 1 --2- 172.21.15.112:0/295142078 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f19f40678c0 0x7f19f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:27.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.988+0000 7f1a067fc640 1 --2- 172.21.15.112:0/295142078 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f19f40678c0 0x7f19f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:27.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.988+0000 7f19effff640 1 -- 172.21.15.112:0/295142078 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f19fc085370 con 0x7f1a080af2a0 2024-09-15T23:54:27.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.988+0000 7f1a067fc640 1 --2- 172.21.15.112:0/295142078 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f19f40678c0 0x7f19f4069d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f19f80af000 tx=0x7f19f8004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:27.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:27.992+0000 7f19effff640 1 -- 172.21.15.112:0/295142078 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f19fc055b70 con 0x7f1a080af2a0 2024-09-15T23:54:28.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.168+0000 7f1a0da2d640 1 -- 172.21.15.112:0/295142078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1a0806fcd0 con 0x7f1a080af2a0 2024-09-15T23:54:28.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.168+0000 7f19effff640 1 -- 172.21.15.112:0/295142078 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f19fc055470 con 0x7f1a080af2a0 2024-09-15T23:54:28.172 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:54:28.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.172+0000 7f1a0da2d640 1 -- 172.21.15.112:0/295142078 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f19f40678c0 msgr2=0x7f19f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:28.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.172+0000 7f1a0da2d640 1 --2- 172.21.15.112:0/295142078 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f19f40678c0 0x7f19f4069d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f19f80af000 tx=0x7f19f8004ac0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.172+0000 7f1a0da2d640 1 -- 172.21.15.112:0/295142078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a080af2a0 msgr2=0x7f1a08145ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:28.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.172+0000 7f1a0da2d640 1 --2- 172.21.15.112:0/295142078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a080af2a0 0x7f1a08145ed0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0011f0 tx=0x7f19fc00c9b0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.172+0000 7f1a0da2d640 1 -- 172.21.15.112:0/295142078 shutdown_connections 2024-09-15T23:54:28.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.172+0000 7f1a0da2d640 1 --2- 172.21.15.112:0/295142078 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f19f40678c0 0x7f19f4069d80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.172+0000 7f1a0da2d640 1 --2- 172.21.15.112:0/295142078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a0815c2a0 0x7f1a080d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.172+0000 7f1a0da2d640 1 --2- 172.21.15.112:0/295142078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a0815bec0 0x7f1a080cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.172+0000 7f1a0da2d640 1 --2- 172.21.15.112:0/295142078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a080af2a0 0x7f1a08145ed0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.172+0000 7f1a0da2d640 1 -- 172.21.15.112:0/295142078 >> 172.21.15.112:0/295142078 conn(0x7f1a080b1f90 msgr2=0x7f1a0814ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:28.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.172+0000 7f1a0da2d640 1 -- 172.21.15.112:0/295142078 shutdown_connections 2024-09-15T23:54:28.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.172+0000 7f1a0da2d640 1 -- 172.21.15.112:0/295142078 wait complete. 2024-09-15T23:54:28.192 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:54:28.192 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:54:28.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:54:28.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e3d30640 1 Processor -- start 2024-09-15T23:54:28.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e3d30640 1 -- start start 2024-09-15T23:54:28.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e3d30640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f81dc0b38e0 0x7f81dc0d4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:28.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e3d30640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f81dc0d4750 0x7f81dc06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:28.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e3d30640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81dc0d2b20 con 0x7f81dc15e470 2024-09-15T23:54:28.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e3d30640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f81dc0d3bc0 con 0x7f81dc0d4750 2024-09-15T23:54:28.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e3d30640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f81dc0d4ba0 con 0x7f81dc0b38e0 2024-09-15T23:54:28.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e22cd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f81dc0d4750 0x7f81dc06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:28.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e22cd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f81dc0d4750 0x7f81dc06d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42154/0 (socket says 172.21.15.112:42154) 2024-09-15T23:54:28.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e22cd640 1 -- 172.21.15.112:0/1304519041 learned_addr learned my addr 172.21.15.112:0/1304519041 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:28.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e12cb640 1 --2- 172.21.15.112:0/1304519041 >> v2:172.21.15.169:3300/0 conn(0x7f81dc0b38e0 0x7f81dc0d4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:28.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e22cd640 1 -- 172.21.15.112:0/1304519041 >> v2:172.21.15.169:3300/0 conn(0x7f81dc0b38e0 msgr2=0x7f81dc0d4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:28.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e22cd640 1 --2- 172.21.15.112:0/1304519041 >> v2:172.21.15.169:3300/0 conn(0x7f81dc0b38e0 0x7f81dc0d4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e22cd640 1 -- 172.21.15.112:0/1304519041 >> v1:172.21.15.169:6789/0 conn(0x7f81dc15e470 legacy=0x7f81dc0d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:28.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.312+0000 7f81e22cd640 1 -- 172.21.15.112:0/1304519041 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81dc0d2e00 con 0x7f81dc0d4750 2024-09-15T23:54:28.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.316+0000 7f81e22cd640 1 --2- 172.21.15.112:0/1304519041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81dc0d4750 0x7f81dc06d1b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f81dc09dda0 tx=0x7f81d401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e400e9465fa84b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:28.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.316+0000 7f81e0aca640 1 -- 172.21.15.112:0/1304519041 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d40a55e0 con 0x7f81dc0d4750 2024-09-15T23:54:28.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.316+0000 7f81e0aca640 1 -- 172.21.15.112:0/1304519041 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d40a5780 con 0x7f81dc0d4750 2024-09-15T23:54:28.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.316+0000 7f81e0aca640 1 -- 172.21.15.112:0/1304519041 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d40a5b50 con 0x7f81dc0d4750 2024-09-15T23:54:28.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.316+0000 7f81e3d30640 1 -- 172.21.15.112:0/1304519041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81dc0d4750 msgr2=0x7f81dc06d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:28.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.316+0000 7f81e3d30640 1 --2- 172.21.15.112:0/1304519041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81dc0d4750 0x7f81dc06d1b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f81dc09dda0 tx=0x7f81d401c920 comp rx=0 tx=0).stop 2024-09-15T23:54:28.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.316+0000 7f81e3d30640 1 -- 172.21.15.112:0/1304519041 shutdown_connections 2024-09-15T23:54:28.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.316+0000 7f81e3d30640 1 --2- 172.21.15.112:0/1304519041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81dc0d4750 0x7f81dc06d1b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.316+0000 7f81e3d30640 1 --2- 172.21.15.112:0/1304519041 >> v2:172.21.15.169:3300/0 conn(0x7f81dc0b38e0 0x7f81dc0d4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.316+0000 7f81e3d30640 1 -- 172.21.15.112:0/1304519041 >> 172.21.15.112:0/1304519041 conn(0x7f81dc09d730 msgr2=0x7f81dc08bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:28.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.316+0000 7f81e3d30640 1 -- 172.21.15.112:0/1304519041 shutdown_connections 2024-09-15T23:54:28.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.316+0000 7f81e3d30640 1 -- 172.21.15.112:0/1304519041 wait complete. 2024-09-15T23:54:28.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.316+0000 7f81e3d30640 1 Processor -- start 2024-09-15T23:54:28.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.316+0000 7f81e3d30640 1 -- start start 2024-09-15T23:54:28.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e3d30640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81dc0b38e0 0x7f81dc0b9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:28.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e3d30640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81dc0d4750 0x7f81dc15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:28.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e3d30640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81dc15e470 0x7f81dc15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:28.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e3d30640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc06e310 con 0x7f81dc15e470 2024-09-15T23:54:28.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e3d30640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc06e190 con 0x7f81dc0b38e0 2024-09-15T23:54:28.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e3d30640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f81dc16b200 con 0x7f81dc0d4750 2024-09-15T23:54:28.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e22cd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81dc15e470 0x7f81dc15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:28.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e22cd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81dc15e470 0x7f81dc15b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42156/0 (socket says 172.21.15.112:42156) 2024-09-15T23:54:28.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e22cd640 1 -- 172.21.15.112:0/4284495109 learned_addr learned my addr 172.21.15.112:0/4284495109 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:28.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e12cb640 1 --2- 172.21.15.112:0/4284495109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81dc0d4750 0x7f81dc15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:28.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e1acc640 1 --2- 172.21.15.112:0/4284495109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81dc0b38e0 0x7f81dc0b9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:28.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e22cd640 1 -- 172.21.15.112:0/4284495109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81dc0d4750 msgr2=0x7f81dc15ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:28.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e22cd640 1 --2- 172.21.15.112:0/4284495109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81dc0d4750 0x7f81dc15ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e22cd640 1 -- 172.21.15.112:0/4284495109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81dc0b38e0 msgr2=0x7f81dc0b9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:28.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e22cd640 1 --2- 172.21.15.112:0/4284495109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81dc0b38e0 0x7f81dc0b9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e22cd640 1 -- 172.21.15.112:0/4284495109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81dc0b8bf0 con 0x7f81dc15e470 2024-09-15T23:54:28.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e22cd640 1 --2- 172.21.15.112:0/4284495109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81dc15e470 0x7f81dc15b280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f81d401a550 tx=0x7f81d40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:28.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81d27fc640 1 -- 172.21.15.112:0/4284495109 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d40bc020 con 0x7f81dc15e470 2024-09-15T23:54:28.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81d27fc640 1 -- 172.21.15.112:0/4284495109 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d40b8690 con 0x7f81dc15e470 2024-09-15T23:54:28.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81d27fc640 1 -- 172.21.15.112:0/4284495109 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d4009510 con 0x7f81dc15e470 2024-09-15T23:54:28.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e3d30640 1 -- 172.21.15.112:0/4284495109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81dc15b7c0 con 0x7f81dc15e470 2024-09-15T23:54:28.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e3d30640 1 -- 172.21.15.112:0/4284495109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81dc0b2f20 con 0x7f81dc15e470 2024-09-15T23:54:28.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e3d30640 1 -- 172.21.15.112:0/4284495109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81dc0d4210 con 0x7f81dc15e470 2024-09-15T23:54:28.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81d27fc640 1 -- 172.21.15.112:0/4284495109 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f81d40bf020 con 0x7f81dc15e470 2024-09-15T23:54:28.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81d27fc640 1 --2- 172.21.15.112:0/4284495109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f81c00678f0 0x7f81c0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:28.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81e1acc640 1 --2- 172.21.15.112:0/4284495109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f81c00678f0 0x7f81c0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:28.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.320+0000 7f81d27fc640 1 -- 172.21.15.112:0/4284495109 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f81d4120840 con 0x7f81dc15e470 2024-09-15T23:54:28.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.324+0000 7f81e1acc640 1 --2- 172.21.15.112:0/4284495109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f81c00678f0 0x7f81c0069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f81d8004e30 tx=0x7f81d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:28.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.324+0000 7f81d27fc640 1 -- 172.21.15.112:0/4284495109 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f81d40c7020 con 0x7f81dc15e470 2024-09-15T23:54:28.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.488+0000 7f81e3d30640 1 -- 172.21.15.112:0/4284495109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f81dc0d2420 con 0x7f81dc15e470 2024-09-15T23:54:28.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.488+0000 7f81d27fc640 1 -- 172.21.15.112:0/4284495109 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f81dc0b8bf0 con 0x7f81dc15e470 2024-09-15T23:54:28.493 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:54:28.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.492+0000 7f81e3d30640 1 -- 172.21.15.112:0/4284495109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f81c00678f0 msgr2=0x7f81c0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:28.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.492+0000 7f81e3d30640 1 --2- 172.21.15.112:0/4284495109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f81c00678f0 0x7f81c0069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f81d8004e30 tx=0x7f81d8009040 comp rx=0 tx=0).stop 2024-09-15T23:54:28.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.492+0000 7f81e3d30640 1 -- 172.21.15.112:0/4284495109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81dc15e470 msgr2=0x7f81dc15b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:28.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.492+0000 7f81e3d30640 1 --2- 172.21.15.112:0/4284495109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81dc15e470 0x7f81dc15b280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f81d401a550 tx=0x7f81d40196c0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.492+0000 7f81e3d30640 1 -- 172.21.15.112:0/4284495109 shutdown_connections 2024-09-15T23:54:28.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.492+0000 7f81e3d30640 1 --2- 172.21.15.112:0/4284495109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f81c00678f0 0x7f81c0069db0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.492+0000 7f81e3d30640 1 --2- 172.21.15.112:0/4284495109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81dc15e470 0x7f81dc15b280 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.492+0000 7f81e3d30640 1 --2- 172.21.15.112:0/4284495109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81dc0d4750 0x7f81dc15ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.492+0000 7f81e3d30640 1 --2- 172.21.15.112:0/4284495109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81dc0b38e0 0x7f81dc0b9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.492+0000 7f81e3d30640 1 -- 172.21.15.112:0/4284495109 >> 172.21.15.112:0/4284495109 conn(0x7f81dc09d730 msgr2=0x7f81dc15e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:28.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.492+0000 7f81e3d30640 1 -- 172.21.15.112:0/4284495109 shutdown_connections 2024-09-15T23:54:28.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.492+0000 7f81e3d30640 1 -- 172.21.15.112:0/4284495109 wait complete. 2024-09-15T23:54:28.511 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi169.front.sepia.ceph.com... 2024-09-15T23:54:28.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:28.511 DEBUG:teuthology.orchestra.run.smithi169:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-15T23:54:28.537 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:54:28.537 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:54:28.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:28.537 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:54:28.588 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:54:28.588 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:54:28.594 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:54:28.594 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:54:28.643 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:54:28.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647ed2c640 1 Processor -- start 2024-09-15T23:54:28.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647ed2c640 1 -- start start 2024-09-15T23:54:28.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647ed2c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64781457a0 0x7f64780d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:28.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647ed2c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f64780cf800 0x7f64780b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:28.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647ed2c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f64780b4340 0x7f647815ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:28.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647ed2c640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f64780b4790 con 0x7f64780b4340 2024-09-15T23:54:28.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647ed2c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f64780d27a0 con 0x7f64780cf800 2024-09-15T23:54:28.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647ed2c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f64780d2a80 con 0x7f64781457a0 2024-09-15T23:54:28.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647d2c9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f64780b4340 0x7f647815ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:28.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647d2c9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f64780b4340 0x7f647815ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52086/0 (socket says 172.21.15.112:52086) 2024-09-15T23:54:28.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647d2c9640 1 -- 172.21.15.112:0/321701144 learned_addr learned my addr 172.21.15.112:0/321701144 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:28.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647cac8640 1 --2- 172.21.15.112:0/321701144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64781457a0 0x7f64780d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:28.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647d2c9640 1 -- 172.21.15.112:0/321701144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64781457a0 msgr2=0x7f64780d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:28.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647d2c9640 1 --2- 172.21.15.112:0/321701144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64781457a0 0x7f64780d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f6477fff640 1 --2- 172.21.15.112:0/321701144 >> v2:172.21.15.169:3300/0 conn(0x7f64780cf800 0x7f64780b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:28.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647d2c9640 1 -- 172.21.15.112:0/321701144 >> v2:172.21.15.169:3300/0 conn(0x7f64780cf800 msgr2=0x7f64780b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:28.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647d2c9640 1 --2- 172.21.15.112:0/321701144 >> v2:172.21.15.169:3300/0 conn(0x7f64780cf800 0x7f64780b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647d2c9640 1 -- 172.21.15.112:0/321701144 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64780d2d60 con 0x7f64780b4340 2024-09-15T23:54:28.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f647cac8640 1 --2- 172.21.15.112:0/321701144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64781457a0 0x7f64780d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:28.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.804+0000 7f6477fff640 1 --2- 172.21.15.112:0/321701144 >> v2:172.21.15.169:3300/0 conn(0x7f64780cf800 0x7f64780b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:28.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f647d2c9640 1 --2- 172.21.15.112:0/321701144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64780b4340 0x7f647815ff20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f64780d32a0 tx=0x7f647001c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2529f9a438e1bed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:28.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f64777fe640 1 -- 172.21.15.112:0/321701144 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64700a9430 con 0x7f64780b4340 2024-09-15T23:54:28.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f64777fe640 1 -- 172.21.15.112:0/321701144 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64700ae070 con 0x7f64780b4340 2024-09-15T23:54:28.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f64777fe640 1 -- 172.21.15.112:0/321701144 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64700a97f0 con 0x7f64780b4340 2024-09-15T23:54:28.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f647ed2c640 1 -- 172.21.15.112:0/321701144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64780b4340 msgr2=0x7f647815ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:28.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f647ed2c640 1 --2- 172.21.15.112:0/321701144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64780b4340 0x7f647815ff20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f64780d32a0 tx=0x7f647001c6a0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f647ed2c640 1 -- 172.21.15.112:0/321701144 shutdown_connections 2024-09-15T23:54:28.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f647ed2c640 1 --2- 172.21.15.112:0/321701144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64780b4340 0x7f647815ff20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f647ed2c640 1 --2- 172.21.15.112:0/321701144 >> v2:172.21.15.169:3300/0 conn(0x7f64780cf800 0x7f64780b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f647ed2c640 1 --2- 172.21.15.112:0/321701144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64781457a0 0x7f64780d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f647ed2c640 1 -- 172.21.15.112:0/321701144 >> 172.21.15.112:0/321701144 conn(0x7f647806bcc0 msgr2=0x7f647806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:28.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f647ed2c640 1 -- 172.21.15.112:0/321701144 shutdown_connections 2024-09-15T23:54:28.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f647ed2c640 1 -- 172.21.15.112:0/321701144 wait complete. 2024-09-15T23:54:28.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f647ed2c640 1 Processor -- start 2024-09-15T23:54:28.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.808+0000 7f647ed2c640 1 -- start start 2024-09-15T23:54:28.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647ed2c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64780b4340 0x7f6478161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:28.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647ed2c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64780cf800 0x7f64781fb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:28.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647ed2c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64781457a0 0x7f64780b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:28.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647ed2c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f64780d0890 con 0x7f64781457a0 2024-09-15T23:54:28.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647ed2c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f64780d0710 con 0x7f64780cf800 2024-09-15T23:54:28.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647ed2c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f64780d0a10 con 0x7f64780b4340 2024-09-15T23:54:28.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647d2c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64781457a0 0x7f64780b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:28.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647d2c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64781457a0 0x7f64780b2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52088/0 (socket says 172.21.15.112:52088) 2024-09-15T23:54:28.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647d2c9640 1 -- 172.21.15.112:0/1684924633 learned_addr learned my addr 172.21.15.112:0/1684924633 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:28.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647cac8640 1 --2- 172.21.15.112:0/1684924633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64780b4340 0x7f6478161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:28.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f6477fff640 1 --2- 172.21.15.112:0/1684924633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64780cf800 0x7f64781fb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:28.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647d2c9640 1 -- 172.21.15.112:0/1684924633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64780b4340 msgr2=0x7f6478161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:28.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647d2c9640 1 --2- 172.21.15.112:0/1684924633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64780b4340 0x7f6478161050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647d2c9640 1 -- 172.21.15.112:0/1684924633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64780cf800 msgr2=0x7f64781fb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:28.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647d2c9640 1 --2- 172.21.15.112:0/1684924633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64780cf800 0x7f64781fb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647d2c9640 1 -- 172.21.15.112:0/1684924633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64781fb7a0 con 0x7f64781457a0 2024-09-15T23:54:28.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647d2c9640 1 --2- 172.21.15.112:0/1684924633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64781457a0 0x7f64780b2f40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f64700ab040 tx=0x7f6470019440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:28.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f64757fa640 1 -- 172.21.15.112:0/1684924633 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64700b8070 con 0x7f64781457a0 2024-09-15T23:54:28.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f64757fa640 1 -- 172.21.15.112:0/1684924633 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64700a98c0 con 0x7f64781457a0 2024-09-15T23:54:28.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f64757fa640 1 -- 172.21.15.112:0/1684924633 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64700a9cb0 con 0x7f64781457a0 2024-09-15T23:54:28.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647ed2c640 1 -- 172.21.15.112:0/1684924633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6478161630 con 0x7f64781457a0 2024-09-15T23:54:28.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647ed2c640 1 -- 172.21.15.112:0/1684924633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6478161bf0 con 0x7f64781457a0 2024-09-15T23:54:28.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647ed2c640 1 -- 172.21.15.112:0/1684924633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64780b3e00 con 0x7f64781457a0 2024-09-15T23:54:28.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f64757fa640 1 -- 172.21.15.112:0/1684924633 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f64700c5430 con 0x7f64781457a0 2024-09-15T23:54:28.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f64757fa640 1 --2- 172.21.15.112:0/1684924633 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f64640678c0 0x7f6464069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:28.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f647cac8640 1 --2- 172.21.15.112:0/1684924633 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f64640678c0 0x7f6464069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:28.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.812+0000 7f64757fa640 1 -- 172.21.15.112:0/1684924633 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f64701203f0 con 0x7f64781457a0 2024-09-15T23:54:28.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.816+0000 7f647cac8640 1 --2- 172.21.15.112:0/1684924633 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f64640678c0 0x7f6464069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6468006fd0 tx=0x7f6468008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:28.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.820+0000 7f64757fa640 1 -- 172.21.15.112:0/1684924633 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f64781fb7a0 con 0x7f64781457a0 2024-09-15T23:54:28.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.992+0000 7f647ed2c640 1 -- 172.21.15.112:0/1684924633 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f647806d530 con 0x7f64781457a0 2024-09-15T23:54:28.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.992+0000 7f64757fa640 1 -- 172.21.15.112:0/1684924633 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f64700165e0 con 0x7f64781457a0 2024-09-15T23:54:28.997 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:54:28.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.996+0000 7f647ed2c640 1 -- 172.21.15.112:0/1684924633 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f64640678c0 msgr2=0x7f6464069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:28.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.996+0000 7f647ed2c640 1 --2- 172.21.15.112:0/1684924633 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f64640678c0 0x7f6464069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6468006fd0 tx=0x7f6468008040 comp rx=0 tx=0).stop 2024-09-15T23:54:28.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.996+0000 7f647ed2c640 1 -- 172.21.15.112:0/1684924633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64781457a0 msgr2=0x7f64780b2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:28.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.996+0000 7f647ed2c640 1 --2- 172.21.15.112:0/1684924633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64781457a0 0x7f64780b2f40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f64700ab040 tx=0x7f6470019440 comp rx=0 tx=0).stop 2024-09-15T23:54:28.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.996+0000 7f647ed2c640 1 -- 172.21.15.112:0/1684924633 shutdown_connections 2024-09-15T23:54:28.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.996+0000 7f647ed2c640 1 --2- 172.21.15.112:0/1684924633 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f64640678c0 0x7f6464069d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.996+0000 7f647ed2c640 1 --2- 172.21.15.112:0/1684924633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64781457a0 0x7f64780b2f40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:28.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.996+0000 7f647ed2c640 1 --2- 172.21.15.112:0/1684924633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64780cf800 0x7f64781fb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.996+0000 7f647ed2c640 1 --2- 172.21.15.112:0/1684924633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64780b4340 0x7f6478161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.996+0000 7f647ed2c640 1 -- 172.21.15.112:0/1684924633 >> 172.21.15.112:0/1684924633 conn(0x7f647806bcc0 msgr2=0x7f64780cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:29.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.996+0000 7f647ed2c640 1 -- 172.21.15.112:0/1684924633 shutdown_connections 2024-09-15T23:54:29.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:28.996+0000 7f647ed2c640 1 -- 172.21.15.112:0/1684924633 wait complete. 2024-09-15T23:54:29.015 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:54:29.015 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:54:29.020 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:54:29.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f712b6e7640 1 Processor -- start 2024-09-15T23:54:29.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f712b6e7640 1 -- start start 2024-09-15T23:54:29.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f712b6e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71240b39a0 0x7f712406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f712b6e7640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f712406e4b0 0x7f7124072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f712b6e7640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f712406ec60 con 0x7f71241587a0 2024-09-15T23:54:29.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f712b6e7640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f712406f870 con 0x7f712406e4b0 2024-09-15T23:54:29.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f712b6e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f712406ef40 con 0x7f71240b39a0 2024-09-15T23:54:29.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f7129c84640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f712406e4b0 0x7f7124072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f7129483640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f71241587a0 0x7f71240b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45540/0 (socket says 172.21.15.112:45540) 2024-09-15T23:54:29.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f7129483640 1 -- 172.21.15.112:0/450999627 learned_addr learned my addr 172.21.15.112:0/450999627 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:29.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f7128c82640 1 --2- 172.21.15.112:0/450999627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71240b39a0 0x7f712406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f711bfff640 1 -- 172.21.15.112:0/450999627 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 914022336 0 0) 0x7f712406ec60 con 0x7f71241587a0 2024-09-15T23:54:29.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f711bfff640 1 -- 172.21.15.112:0/450999627 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7110003530 con 0x7f71241587a0 2024-09-15T23:54:29.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f7129c84640 1 -- 172.21.15.112:0/450999627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71240b39a0 msgr2=0x7f712406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:29.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f7129c84640 1 --2- 172.21.15.112:0/450999627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71240b39a0 0x7f712406df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f7129c84640 1 -- 172.21.15.112:0/450999627 >> v1:172.21.15.112:6789/0 conn(0x7f71241587a0 legacy=0x7f71240b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.176+0000 7f7129c84640 1 -- 172.21.15.112:0/450999627 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f712406f220 con 0x7f712406e4b0 2024-09-15T23:54:29.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f7129c84640 1 --2- 172.21.15.112:0/450999627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f712406e4b0 0x7f7124072160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f711c009d90 tx=0x7f711c01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f63735196c2bdf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:29.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f711bfff640 1 -- 172.21.15.112:0/450999627 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c0b2070 con 0x7f712406e4b0 2024-09-15T23:54:29.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f711bfff640 1 -- 172.21.15.112:0/450999627 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711c0a5a20 con 0x7f712406e4b0 2024-09-15T23:54:29.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f711bfff640 1 -- 172.21.15.112:0/450999627 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c0a5dd0 con 0x7f712406e4b0 2024-09-15T23:54:29.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 -- 172.21.15.112:0/450999627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f712406e4b0 msgr2=0x7f7124072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 --2- 172.21.15.112:0/450999627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f712406e4b0 0x7f7124072160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f711c009d90 tx=0x7f711c01d3a0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 -- 172.21.15.112:0/450999627 shutdown_connections 2024-09-15T23:54:29.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 --2- 172.21.15.112:0/450999627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f712406e4b0 0x7f7124072160 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 --2- 172.21.15.112:0/450999627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71240b39a0 0x7f712406df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 -- 172.21.15.112:0/450999627 >> 172.21.15.112:0/450999627 conn(0x7f71240b1f90 msgr2=0x7f71240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:29.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 -- 172.21.15.112:0/450999627 shutdown_connections 2024-09-15T23:54:29.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 -- 172.21.15.112:0/450999627 wait complete. 2024-09-15T23:54:29.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 Processor -- start 2024-09-15T23:54:29.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 -- start start 2024-09-15T23:54:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f712406e4b0 0x7f7124154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71240b39a0 0x7f7124147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71241587a0 0x7f7124152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7124073030 con 0x7f712406e4b0 2024-09-15T23:54:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7124072eb0 con 0x7f71240b39a0 2024-09-15T23:54:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f712b6e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f71240731b0 con 0x7f71241587a0 2024-09-15T23:54:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f7129483640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f712406e4b0 0x7f7124154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f7129483640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f712406e4b0 0x7f7124154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52096/0 (socket says 172.21.15.112:52096) 2024-09-15T23:54:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.180+0000 7f7129483640 1 -- 172.21.15.112:0/3341062855 learned_addr learned my addr 172.21.15.112:0/3341062855 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7129c84640 1 --2- 172.21.15.112:0/3341062855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71241587a0 0x7f7124152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7129483640 1 -- 172.21.15.112:0/3341062855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71241587a0 msgr2=0x7f7124152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7128c82640 1 --2- 172.21.15.112:0/3341062855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71240b39a0 0x7f7124147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7129483640 1 --2- 172.21.15.112:0/3341062855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71241587a0 0x7f7124152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7129483640 1 -- 172.21.15.112:0/3341062855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71240b39a0 msgr2=0x7f7124147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7129483640 1 --2- 172.21.15.112:0/3341062855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71240b39a0 0x7f7124147020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7129483640 1 -- 172.21.15.112:0/3341062855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7124154670 con 0x7f712406e4b0 2024-09-15T23:54:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7129483640 1 --2- 172.21.15.112:0/3341062855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f712406e4b0 0x7f7124154130 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f712000c3f0 tx=0x7f712000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7119ffb640 1 -- 172.21.15.112:0/3341062855 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7120017070 con 0x7f712406e4b0 2024-09-15T23:54:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7119ffb640 1 -- 172.21.15.112:0/3341062855 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7120005cf0 con 0x7f712406e4b0 2024-09-15T23:54:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f712b6e7640 1 -- 172.21.15.112:0/3341062855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7124147560 con 0x7f712406e4b0 2024-09-15T23:54:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7119ffb640 1 -- 172.21.15.112:0/3341062855 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71200072f0 con 0x7f712406e4b0 2024-09-15T23:54:29.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f712b6e7640 1 -- 172.21.15.112:0/3341062855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7124151f10 con 0x7f712406e4b0 2024-09-15T23:54:29.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f712b6e7640 1 -- 172.21.15.112:0/3341062855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7124072160 con 0x7f712406e4b0 2024-09-15T23:54:29.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7119ffb640 1 -- 172.21.15.112:0/3341062855 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f712001a070 con 0x7f712406e4b0 2024-09-15T23:54:29.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7119ffb640 1 --2- 172.21.15.112:0/3341062855 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f71080678c0 0x7f7108069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7119ffb640 1 -- 172.21.15.112:0/3341062855 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7120085740 con 0x7f712406e4b0 2024-09-15T23:54:29.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7128c82640 1 --2- 172.21.15.112:0/3341062855 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f71080678c0 0x7f7108069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.184+0000 7f7128c82640 1 --2- 172.21.15.112:0/3341062855 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f71080678c0 0x7f7108069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7124169180 tx=0x7f7114008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:29.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.188+0000 7f7119ffb640 1 -- 172.21.15.112:0/3341062855 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7120021020 con 0x7f712406e4b0 2024-09-15T23:54:29.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.348+0000 7f712b6e7640 1 -- 172.21.15.112:0/3341062855 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f71240b52b0 con 0x7f712406e4b0 2024-09-15T23:54:29.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.348+0000 7f7119ffb640 1 -- 172.21.15.112:0/3341062855 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f7124154670 con 0x7f712406e4b0 2024-09-15T23:54:29.353 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:54:29.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.352+0000 7f712b6e7640 1 -- 172.21.15.112:0/3341062855 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f71080678c0 msgr2=0x7f7108069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.352+0000 7f712b6e7640 1 --2- 172.21.15.112:0/3341062855 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f71080678c0 0x7f7108069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7124169180 tx=0x7f7114008040 comp rx=0 tx=0).stop 2024-09-15T23:54:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.352+0000 7f712b6e7640 1 -- 172.21.15.112:0/3341062855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f712406e4b0 msgr2=0x7f7124154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.352+0000 7f712b6e7640 1 --2- 172.21.15.112:0/3341062855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f712406e4b0 0x7f7124154130 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f712000c3f0 tx=0x7f712000c8b0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.352+0000 7f712b6e7640 1 -- 172.21.15.112:0/3341062855 shutdown_connections 2024-09-15T23:54:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.352+0000 7f712b6e7640 1 --2- 172.21.15.112:0/3341062855 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f71080678c0 0x7f7108069d80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.352+0000 7f712b6e7640 1 --2- 172.21.15.112:0/3341062855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f71241587a0 0x7f7124152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.352+0000 7f712b6e7640 1 --2- 172.21.15.112:0/3341062855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71240b39a0 0x7f7124147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.352+0000 7f712b6e7640 1 --2- 172.21.15.112:0/3341062855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f712406e4b0 0x7f7124154130 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.352+0000 7f712b6e7640 1 -- 172.21.15.112:0/3341062855 >> 172.21.15.112:0/3341062855 conn(0x7f71240b1f90 msgr2=0x7f7124160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:29.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.352+0000 7f712b6e7640 1 -- 172.21.15.112:0/3341062855 shutdown_connections 2024-09-15T23:54:29.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.352+0000 7f712b6e7640 1 -- 172.21.15.112:0/3341062855 wait complete. 2024-09-15T23:54:29.371 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2024-09-15T23:54:29.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:29.371 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-15T23:54:29.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:54:29.383 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:54:29.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:29.383 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-15T23:54:29.434 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:54:29.434 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:54:29.441 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:54:29.441 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:54:29.487 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:54:29.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.604+0000 7f2800750640 1 Processor -- start 2024-09-15T23:54:29.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.604+0000 7f2800750640 1 -- start start 2024-09-15T23:54:29.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.604+0000 7f2800750640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27f815e5f0 0x7f27f806d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.604+0000 7f2800750640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f27f80cfaf0 0x7f27f80d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.604+0000 7f2800750640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27f806d9c0 con 0x7f27f80ce9d0 2024-09-15T23:54:29.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.604+0000 7f2800750640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f27f806dca0 con 0x7f27f80cfaf0 2024-09-15T23:54:29.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.604+0000 7f2800750640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f27f806df80 con 0x7f27f815e5f0 2024-09-15T23:54:29.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.604+0000 7f27feced640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f27f80cfaf0 0x7f27f80d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.604+0000 7f27feced640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f27f80cfaf0 0x7f27f80d2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52104/0 (socket says 172.21.15.112:52104) 2024-09-15T23:54:29.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.604+0000 7f27feced640 1 -- 172.21.15.112:0/955834270 learned_addr learned my addr 172.21.15.112:0/955834270 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:29.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.604+0000 7f27feced640 1 -- 172.21.15.112:0/955834270 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27f815e5f0 msgr2=0x7f27f806d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:29.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.604+0000 7f27feced640 1 --2- 172.21.15.112:0/955834270 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27f815e5f0 0x7f27f806d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.604+0000 7f27feced640 1 -- 172.21.15.112:0/955834270 >> v1:172.21.15.112:6789/0 conn(0x7f27f80ce9d0 legacy=0x7f27f80cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.604+0000 7f27feced640 1 -- 172.21.15.112:0/955834270 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f806e260 con 0x7f27f80cfaf0 2024-09-15T23:54:29.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27feced640 1 --2- 172.21.15.112:0/955834270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f80cfaf0 0x7f27f80d2b60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009e50 tx=0x7f27f001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472d3584357553c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:29.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27fd4ea640 1 -- 172.21.15.112:0/955834270 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00a5810 con 0x7f27f80cfaf0 2024-09-15T23:54:29.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27fd4ea640 1 -- 172.21.15.112:0/955834270 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f00a59b0 con 0x7f27f80cfaf0 2024-09-15T23:54:29.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27fd4ea640 1 -- 172.21.15.112:0/955834270 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00a5d80 con 0x7f27f80cfaf0 2024-09-15T23:54:29.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 -- 172.21.15.112:0/955834270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f80cfaf0 msgr2=0x7f27f80d2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 --2- 172.21.15.112:0/955834270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f80cfaf0 0x7f27f80d2b60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009e50 tx=0x7f27f001ca30 comp rx=0 tx=0).stop 2024-09-15T23:54:29.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 -- 172.21.15.112:0/955834270 shutdown_connections 2024-09-15T23:54:29.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 --2- 172.21.15.112:0/955834270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f80cfaf0 0x7f27f80d2b60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 --2- 172.21.15.112:0/955834270 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27f815e5f0 0x7f27f806d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 -- 172.21.15.112:0/955834270 >> 172.21.15.112:0/955834270 conn(0x7f27f8074030 msgr2=0x7f27f809d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:29.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 -- 172.21.15.112:0/955834270 shutdown_connections 2024-09-15T23:54:29.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 -- 172.21.15.112:0/955834270 wait complete. 2024-09-15T23:54:29.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 Processor -- start 2024-09-15T23:54:29.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 -- start start 2024-09-15T23:54:29.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27f80cfaf0 0x7f27f815d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f81562a0 0x7f27f814d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27f814dca0 0x7f27f80c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f27f80d3c40 con 0x7f27f81562a0 2024-09-15T23:54:29.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f27f80d3ac0 con 0x7f27f814dca0 2024-09-15T23:54:29.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f2800750640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f27f816afa0 con 0x7f27f80cfaf0 2024-09-15T23:54:29.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27fdceb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f81562a0 0x7f27f814d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27fdceb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f81562a0 0x7f27f814d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52110/0 (socket says 172.21.15.112:52110) 2024-09-15T23:54:29.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27fdceb640 1 -- 172.21.15.112:0/1558074978 learned_addr learned my addr 172.21.15.112:0/1558074978 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:29.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27feced640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27f814dca0 0x7f27f80c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27fe4ec640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27f80cfaf0 0x7f27f815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27fdceb640 1 -- 172.21.15.112:0/1558074978 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27f80cfaf0 msgr2=0x7f27f815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27fdceb640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27f80cfaf0 0x7f27f815d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27fdceb640 1 -- 172.21.15.112:0/1558074978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27f814dca0 msgr2=0x7f27f80c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27fdceb640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27f814dca0 0x7f27f80c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27fdceb640 1 -- 172.21.15.112:0/1558074978 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f8157410 con 0x7f27f81562a0 2024-09-15T23:54:29.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.608+0000 7f27feced640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27f814dca0 0x7f27f80c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:29.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.612+0000 7f27fdceb640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f81562a0 0x7f27f814d760 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c430 tx=0x7f27e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:29.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.612+0000 7f27eeffd640 1 -- 172.21.15.112:0/1558074978 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e80052d0 con 0x7f27f81562a0 2024-09-15T23:54:29.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.612+0000 7f27eeffd640 1 -- 172.21.15.112:0/1558074978 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e8005470 con 0x7f27f81562a0 2024-09-15T23:54:29.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.612+0000 7f2800750640 1 -- 172.21.15.112:0/1558074978 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f8156e50 con 0x7f27f81562a0 2024-09-15T23:54:29.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.612+0000 7f27eeffd640 1 -- 172.21.15.112:0/1558074978 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8007260 con 0x7f27f81562a0 2024-09-15T23:54:29.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.612+0000 7f2800750640 1 -- 172.21.15.112:0/1558074978 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f815ce20 con 0x7f27f81562a0 2024-09-15T23:54:29.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.612+0000 7f2800750640 1 -- 172.21.15.112:0/1558074978 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f814e0b0 con 0x7f27f81562a0 2024-09-15T23:54:29.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.612+0000 7f27eeffd640 1 -- 172.21.15.112:0/1558074978 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f27e8007400 con 0x7f27f81562a0 2024-09-15T23:54:29.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.612+0000 7f27eeffd640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f27dc0678f0 0x7f27dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.612+0000 7f27eeffd640 1 -- 172.21.15.112:0/1558074978 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f27e80854a0 con 0x7f27f81562a0 2024-09-15T23:54:29.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.612+0000 7f27fe4ec640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f27dc0678f0 0x7f27dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.612+0000 7f27fe4ec640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f27dc0678f0 0x7f27dc069db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f27f80cb310 tx=0x7f27f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:29.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.616+0000 7f27eeffd640 1 -- 172.21.15.112:0/1558074978 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f27e8055c90 con 0x7f27f81562a0 2024-09-15T23:54:29.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.784+0000 7f2800750640 1 -- 172.21.15.112:0/1558074978 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f27f80d2b60 con 0x7f27f81562a0 2024-09-15T23:54:29.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.784+0000 7f27eeffd640 1 -- 172.21.15.112:0/1558074978 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f27e8055590 con 0x7f27f81562a0 2024-09-15T23:54:29.787 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:54:29.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.784+0000 7f2800750640 1 -- 172.21.15.112:0/1558074978 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f27dc0678f0 msgr2=0x7f27dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.784+0000 7f2800750640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f27dc0678f0 0x7f27dc069db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f27f80cb310 tx=0x7f27f4008040 comp rx=0 tx=0).stop 2024-09-15T23:54:29.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.784+0000 7f2800750640 1 -- 172.21.15.112:0/1558074978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f81562a0 msgr2=0x7f27f814d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.784+0000 7f2800750640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f81562a0 0x7f27f814d760 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c430 tx=0x7f27e800c8f0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.784+0000 7f2800750640 1 -- 172.21.15.112:0/1558074978 shutdown_connections 2024-09-15T23:54:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.784+0000 7f2800750640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f27dc0678f0 0x7f27dc069db0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.784+0000 7f2800750640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27f814dca0 0x7f27f80c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.784+0000 7f2800750640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27f81562a0 0x7f27f814d760 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.784+0000 7f2800750640 1 --2- 172.21.15.112:0/1558074978 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27f80cfaf0 0x7f27f815d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.784+0000 7f2800750640 1 -- 172.21.15.112:0/1558074978 >> 172.21.15.112:0/1558074978 conn(0x7f27f80ce9d0 msgr2=0x7f27f80b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.784+0000 7f2800750640 1 -- 172.21.15.112:0/1558074978 shutdown_connections 2024-09-15T23:54:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.784+0000 7f2800750640 1 -- 172.21.15.112:0/1558074978 wait complete. 2024-09-15T23:54:29.805 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:54:29.805 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:54:29.811 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:54:29.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd5292c640 1 Processor -- start 2024-09-15T23:54:29.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd5292c640 1 -- start start 2024-09-15T23:54:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd5292c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4c15bec0 0x7fcd4c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd5292c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcd4c0af470 0x7fcd4c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd5292c640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd4c0b3290 con 0x7fcd4c15c2a0 2024-09-15T23:54:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd5292c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fcd4c0b3570 con 0x7fcd4c0af470 2024-09-15T23:54:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd5292c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4c0b3850 con 0x7fcd4c15bec0 2024-09-15T23:54:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4b7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcd4c15c2a0 0x7fcd4c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45546/0 (socket says 172.21.15.112:45546) 2024-09-15T23:54:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4b7fe640 1 -- 172.21.15.112:0/4163328047 learned_addr learned my addr 172.21.15.112:0/4163328047 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 -- 172.21.15.112:0/4163328047 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3552922050 0 0) 0x7fcd4c0b3290 con 0x7fcd4c15c2a0 2024-09-15T23:54:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd50ec9640 1 --2- 172.21.15.112:0/4163328047 >> v2:172.21.15.169:3300/0 conn(0x7fcd4c0af470 0x7fcd4c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4bfff640 1 --2- 172.21.15.112:0/4163328047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4c15bec0 0x7fcd4c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 -- 172.21.15.112:0/4163328047 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd34003530 con 0x7fcd4c15c2a0 2024-09-15T23:54:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 -- 172.21.15.112:0/4163328047 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2219334632 0 0) 0x7fcd34003530 con 0x7fcd4c15c2a0 2024-09-15T23:54:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 -- 172.21.15.112:0/4163328047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4c15bec0 msgr2=0x7fcd4c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 --2- 172.21.15.112:0/4163328047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4c15bec0 0x7fcd4c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 -- 172.21.15.112:0/4163328047 >> v2:172.21.15.169:3300/0 conn(0x7fcd4c0af470 msgr2=0x7fcd4c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 --2- 172.21.15.112:0/4163328047 >> v2:172.21.15.169:3300/0 conn(0x7fcd4c0af470 0x7fcd4c06e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 -- 172.21.15.112:0/4163328047 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c0b3b30 con 0x7fcd4c15c2a0 2024-09-15T23:54:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 -- 172.21.15.112:0/4163328047 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fcd40001680 con 0x7fcd4c15c2a0 2024-09-15T23:54:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 -- 172.21.15.112:0/4163328047 >> v1:172.21.15.112:6789/0 conn(0x7fcd4c15c2a0 legacy=0x7fcd4c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 --2- 172.21.15.112:0/4163328047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd340039c0 0x7fcd34003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 --2- 172.21.15.112:0/4163328047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4c15bec0 0x7fcd34004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 --2- 172.21.15.112:0/4163328047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd34004d50 0x7fcd340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 -- 172.21.15.112:0/4163328047 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c0b3570 con 0x7fcd340039c0 2024-09-15T23:54:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 -- 172.21.15.112:0/4163328047 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c0b3850 con 0x7fcd34004d50 2024-09-15T23:54:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4affd640 1 -- 172.21.15.112:0/4163328047 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3400b9d0 con 0x7fcd4c15bec0 2024-09-15T23:54:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4bfff640 1 --2- 172.21.15.112:0/4163328047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd340039c0 0x7fcd34003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4bfff640 1 -- 172.21.15.112:0/4163328047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4c15bec0 msgr2=0x7fcd34004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:29.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4bfff640 1 --2- 172.21.15.112:0/4163328047 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4c15bec0 0x7fcd34004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4bfff640 1 -- 172.21.15.112:0/4163328047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd34004d50 msgr2=0x7fcd340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:29.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4bfff640 1 --2- 172.21.15.112:0/4163328047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd34004d50 0x7fcd340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.924+0000 7fcd4bfff640 1 -- 172.21.15.112:0/4163328047 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd34003530 con 0x7fcd340039c0 2024-09-15T23:54:29.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.928+0000 7fcd4bfff640 1 --2- 172.21.15.112:0/4163328047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd340039c0 0x7fcd34003de0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009ae0 tx=0x7fcd3c01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d76815c089bc94 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:29.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.928+0000 7fcd4affd640 1 -- 172.21.15.112:0/4163328047 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0b2070 con 0x7fcd340039c0 2024-09-15T23:54:29.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.928+0000 7fcd4affd640 1 -- 172.21.15.112:0/4163328047 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3c0a5650 con 0x7fcd340039c0 2024-09-15T23:54:29.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.928+0000 7fcd4affd640 1 -- 172.21.15.112:0/4163328047 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0096b0 con 0x7fcd340039c0 2024-09-15T23:54:29.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.928+0000 7fcd5292c640 1 -- 172.21.15.112:0/4163328047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd340039c0 msgr2=0x7fcd34003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.928+0000 7fcd5292c640 1 --2- 172.21.15.112:0/4163328047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd340039c0 0x7fcd34003de0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009ae0 tx=0x7fcd3c01ca80 comp rx=0 tx=0).stop 2024-09-15T23:54:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.928+0000 7fcd50ec9640 1 -- 172.21.15.112:0/4163328047 reap_dead start 2024-09-15T23:54:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.928+0000 7fcd5292c640 1 -- 172.21.15.112:0/4163328047 shutdown_connections 2024-09-15T23:54:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.928+0000 7fcd5292c640 1 -- 172.21.15.112:0/4163328047 >> 172.21.15.112:0/4163328047 conn(0x7fcd4c0b1f90 msgr2=0x7fcd4c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.928+0000 7fcd5292c640 1 -- 172.21.15.112:0/4163328047 shutdown_connections 2024-09-15T23:54:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.928+0000 7fcd5292c640 1 -- 172.21.15.112:0/4163328047 wait complete. 2024-09-15T23:54:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.928+0000 7fcd5292c640 1 Processor -- start 2024-09-15T23:54:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.928+0000 7fcd5292c640 1 -- start start 2024-09-15T23:54:29.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd5292c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd340039c0 0x7fcd4c150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd5292c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4c1e96f0 0x7fcd4c1539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd5292c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd4c1e8100 0x7fcd4c1e9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd5292c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c0ad790 con 0x7fcd340039c0 2024-09-15T23:54:29.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd5292c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c0ad610 con 0x7fcd4c1e8100 2024-09-15T23:54:29.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd5292c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4c06ed50 con 0x7fcd4c1e96f0 2024-09-15T23:54:29.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd4bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd340039c0 0x7fcd4c150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd4bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd340039c0 0x7fcd4c150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52122/0 (socket says 172.21.15.112:52122) 2024-09-15T23:54:29.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd4bfff640 1 -- 172.21.15.112:0/49335448 learned_addr learned my addr 172.21.15.112:0/49335448 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:29.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd4bfff640 1 -- 172.21.15.112:0/49335448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4c1e96f0 msgr2=0x7fcd4c1539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd4b7fe640 1 --2- 172.21.15.112:0/49335448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4c1e96f0 0x7fcd4c1539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd4bfff640 1 --2- 172.21.15.112:0/49335448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4c1e96f0 0x7fcd4c1539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd4bfff640 1 -- 172.21.15.112:0/49335448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd4c1e8100 msgr2=0x7fcd4c1e9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:29.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd50ec9640 1 --2- 172.21.15.112:0/49335448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd4c1e8100 0x7fcd4c1e9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd4bfff640 1 --2- 172.21.15.112:0/49335448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd4c1e8100 0x7fcd4c1e9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:29.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd4bfff640 1 -- 172.21.15.112:0/49335448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c1e8650 con 0x7fcd340039c0 2024-09-15T23:54:29.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd4bfff640 1 --2- 172.21.15.112:0/49335448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd340039c0 0x7fcd4c150ae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c01c8b0 tx=0x7fcd34005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:29.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd48ff9640 1 -- 172.21.15.112:0/49335448 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0bd070 con 0x7fcd340039c0 2024-09-15T23:54:29.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd48ff9640 1 -- 172.21.15.112:0/49335448 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3c004030 con 0x7fcd340039c0 2024-09-15T23:54:29.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd48ff9640 1 -- 172.21.15.112:0/49335448 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0b2040 con 0x7fcd340039c0 2024-09-15T23:54:29.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd5292c640 1 -- 172.21.15.112:0/49335448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4c1e8930 con 0x7fcd340039c0 2024-09-15T23:54:29.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd5292c640 1 -- 172.21.15.112:0/49335448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4c1e8ef0 con 0x7fcd340039c0 2024-09-15T23:54:29.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd5292c640 1 -- 172.21.15.112:0/49335448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd4c06f130 con 0x7fcd340039c0 2024-09-15T23:54:29.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd48ff9640 1 -- 172.21.15.112:0/49335448 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcd3c0c0070 con 0x7fcd340039c0 2024-09-15T23:54:29.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd48ff9640 1 --2- 172.21.15.112:0/49335448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcd380678c0 0x7fcd38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:29.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd48ff9640 1 -- 172.21.15.112:0/49335448 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcd3c11fca0 con 0x7fcd340039c0 2024-09-15T23:54:29.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd4b7fe640 1 --2- 172.21.15.112:0/49335448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcd380678c0 0x7fcd38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:29.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.932+0000 7fcd4b7fe640 1 --2- 172.21.15.112:0/49335448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcd380678c0 0x7fcd38069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c1f87f0 tx=0x7fcd40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:29.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:29.936+0000 7fcd48ff9640 1 -- 172.21.15.112:0/49335448 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcd3c0167c0 con 0x7fcd340039c0 2024-09-15T23:54:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.112+0000 7fcd5292c640 1 -- 172.21.15.112:0/49335448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcd4c1ea890 con 0x7fcd340039c0 2024-09-15T23:54:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.112+0000 7fcd48ff9640 1 -- 172.21.15.112:0/49335448 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fcd3c0efe40 con 0x7fcd340039c0 2024-09-15T23:54:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:54:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.116+0000 7fcd5292c640 1 -- 172.21.15.112:0/49335448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcd380678c0 msgr2=0x7fcd38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.116+0000 7fcd5292c640 1 --2- 172.21.15.112:0/49335448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcd380678c0 0x7fcd38069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c1f87f0 tx=0x7fcd40009040 comp rx=0 tx=0).stop 2024-09-15T23:54:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.116+0000 7fcd5292c640 1 -- 172.21.15.112:0/49335448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd340039c0 msgr2=0x7fcd4c150ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.116+0000 7fcd5292c640 1 --2- 172.21.15.112:0/49335448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd340039c0 0x7fcd4c150ae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c01c8b0 tx=0x7fcd34005840 comp rx=0 tx=0).stop 2024-09-15T23:54:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.116+0000 7fcd5292c640 1 -- 172.21.15.112:0/49335448 shutdown_connections 2024-09-15T23:54:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.116+0000 7fcd5292c640 1 --2- 172.21.15.112:0/49335448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcd380678c0 0x7fcd38069d80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.116+0000 7fcd5292c640 1 --2- 172.21.15.112:0/49335448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd4c1e8100 0x7fcd4c1e9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.116+0000 7fcd5292c640 1 --2- 172.21.15.112:0/49335448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4c1e96f0 0x7fcd4c1539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.116+0000 7fcd5292c640 1 --2- 172.21.15.112:0/49335448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd340039c0 0x7fcd4c150ae0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.116+0000 7fcd5292c640 1 -- 172.21.15.112:0/49335448 >> 172.21.15.112:0/49335448 conn(0x7fcd4c0b1f90 msgr2=0x7fcd4c1599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:30.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.116+0000 7fcd5292c640 1 -- 172.21.15.112:0/49335448 shutdown_connections 2024-09-15T23:54:30.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.116+0000 7fcd5292c640 1 -- 172.21.15.112:0/49335448 wait complete. 2024-09-15T23:54:30.135 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi169.front.sepia.ceph.com... 2024-09-15T23:54:30.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:30.136 DEBUG:teuthology.orchestra.run.smithi169:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-15T23:54:30.150 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:54:30.150 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:54:30.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:30.150 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-15T23:54:30.199 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:54:30.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:54:30.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f6694894640 1 Processor -- start 2024-09-15T23:54:30.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f6694894640 1 -- start start 2024-09-15T23:54:30.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f6694894640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f669015e5f0 0x7f669006d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f6694894640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66900ce9d0 0x7f66900cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f6694894640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669006d9c0 con 0x7f66900cf920 2024-09-15T23:54:30.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f6694894640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f669006dca0 con 0x7f669015e5f0 2024-09-15T23:54:30.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f6694894640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f669006df80 con 0x7f66900ce9d0 2024-09-15T23:54:30.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668ed9d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f66900cf920 0x7f66900d0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45558/0 (socket says 172.21.15.112:45558) 2024-09-15T23:54:30.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668ed9d640 1 -- 172.21.15.112:0/640102490 learned_addr learned my addr 172.21.15.112:0/640102490 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:30.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668e59c640 1 --2- 172.21.15.112:0/640102490 >> v2:172.21.15.169:3300/0 conn(0x7f669015e5f0 0x7f669006d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f6685d9b640 1 --2- 172.21.15.112:0/640102490 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66900ce9d0 0x7f66900cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 -- 172.21.15.112:0/640102490 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128829642 0 0) 0x7f669006d9c0 con 0x7f66900cf920 2024-09-15T23:54:30.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 -- 172.21.15.112:0/640102490 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f667c003530 con 0x7f66900cf920 2024-09-15T23:54:30.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 -- 172.21.15.112:0/640102490 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4165865406 0 0) 0x7f667c003530 con 0x7f66900cf920 2024-09-15T23:54:30.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 -- 172.21.15.112:0/640102490 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66900ce9d0 msgr2=0x7f66900cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:30.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 --2- 172.21.15.112:0/640102490 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66900ce9d0 0x7f66900cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 -- 172.21.15.112:0/640102490 >> v2:172.21.15.169:3300/0 conn(0x7f669015e5f0 msgr2=0x7f669006d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:30.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 --2- 172.21.15.112:0/640102490 >> v2:172.21.15.169:3300/0 conn(0x7f669015e5f0 0x7f669006d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 -- 172.21.15.112:0/640102490 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669006e260 con 0x7f66900cf920 2024-09-15T23:54:30.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 -- 172.21.15.112:0/640102490 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f6688001a00 con 0x7f66900cf920 2024-09-15T23:54:30.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 -- 172.21.15.112:0/640102490 >> v1:172.21.15.112:6789/0 conn(0x7f66900cf920 legacy=0x7f66900d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 --2- 172.21.15.112:0/640102490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f667c0039c0 0x7f667c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 --2- 172.21.15.112:0/640102490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f667c004810 0x7f667c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 --2- 172.21.15.112:0/640102490 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66900ce9d0 0x7f667c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 -- 172.21.15.112:0/640102490 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f669006dca0 con 0x7f667c0039c0 2024-09-15T23:54:30.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 -- 172.21.15.112:0/640102490 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f669006df80 con 0x7f667c004810 2024-09-15T23:54:30.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668dd9b640 1 -- 172.21.15.112:0/640102490 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f667c00b9d0 con 0x7f66900ce9d0 2024-09-15T23:54:30.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668e59c640 1 --2- 172.21.15.112:0/640102490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f667c0039c0 0x7f667c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f6685d9b640 1 --2- 172.21.15.112:0/640102490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f667c004810 0x7f667c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668ed9d640 1 --2- 172.21.15.112:0/640102490 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66900ce9d0 0x7f667c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668e59c640 1 -- 172.21.15.112:0/640102490 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66900ce9d0 msgr2=0x7f667c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:30.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668e59c640 1 --2- 172.21.15.112:0/640102490 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66900ce9d0 0x7f667c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668e59c640 1 -- 172.21.15.112:0/640102490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f667c004810 msgr2=0x7f667c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:30.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668e59c640 1 --2- 172.21.15.112:0/640102490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f667c004810 0x7f667c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668e59c640 1 -- 172.21.15.112:0/640102490 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667c003530 con 0x7f667c0039c0 2024-09-15T23:54:30.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f668ed9d640 1 --2- 172.21.15.112:0/640102490 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66900ce9d0 0x7f667c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:30.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.320+0000 7f6685d9b640 1 --2- 172.21.15.112:0/640102490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f667c004810 0x7f667c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:30.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.324+0000 7f668e59c640 1 --2- 172.21.15.112:0/640102490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f667c0039c0 0x7f667c003de0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6680009ae0 tx=0x7f668001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5462fd5f0ec1ad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:30.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.324+0000 7f668dd9b640 1 -- 172.21.15.112:0/640102490 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66800096b0 con 0x7f667c0039c0 2024-09-15T23:54:30.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.324+0000 7f668dd9b640 1 -- 172.21.15.112:0/640102490 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66800a64c0 con 0x7f667c0039c0 2024-09-15T23:54:30.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.324+0000 7f668dd9b640 1 -- 172.21.15.112:0/640102490 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66800a68b0 con 0x7f667c0039c0 2024-09-15T23:54:30.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.324+0000 7f6694894640 1 -- 172.21.15.112:0/640102490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f667c0039c0 msgr2=0x7f667c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.324+0000 7f6694894640 1 --2- 172.21.15.112:0/640102490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f667c0039c0 0x7f667c003de0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6680009ae0 tx=0x7f668001cab0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.324+0000 7f668ed9d640 1 -- 172.21.15.112:0/640102490 reap_dead start 2024-09-15T23:54:30.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.324+0000 7f6694894640 1 -- 172.21.15.112:0/640102490 shutdown_connections 2024-09-15T23:54:30.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.324+0000 7f6694894640 1 -- 172.21.15.112:0/640102490 >> 172.21.15.112:0/640102490 conn(0x7f6690074030 msgr2=0x7f669009d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:30.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.324+0000 7f6694894640 1 -- 172.21.15.112:0/640102490 shutdown_connections 2024-09-15T23:54:30.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.324+0000 7f6694894640 1 -- 172.21.15.112:0/640102490 wait complete. 2024-09-15T23:54:30.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6694894640 1 Processor -- start 2024-09-15T23:54:30.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6694894640 1 -- start start 2024-09-15T23:54:30.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6694894640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6690164720 0x7f66900b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6694894640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66900b8a20 0x7f66900cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6694894640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6690164b00 0x7f66900cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6694894640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f66901691a0 con 0x7f66900b8a20 2024-09-15T23:54:30.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6694894640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66900cfd70 con 0x7f6690164b00 2024-09-15T23:54:30.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6694894640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6690169320 con 0x7f6690164720 2024-09-15T23:54:30.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6685d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66900b8a20 0x7f66900cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6685d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66900b8a20 0x7f66900cb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52132/0 (socket says 172.21.15.112:52132) 2024-09-15T23:54:30.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6685d9b640 1 -- 172.21.15.112:0/1322460222 learned_addr learned my addr 172.21.15.112:0/1322460222 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:30.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6685d9b640 1 -- 172.21.15.112:0/1322460222 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6690164720 msgr2=0x7f66900b99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6685d9b640 1 --2- 172.21.15.112:0/1322460222 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6690164720 0x7f66900b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6685d9b640 1 -- 172.21.15.112:0/1322460222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6690164b00 msgr2=0x7f66900cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6685d9b640 1 --2- 172.21.15.112:0/1322460222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6690164b00 0x7f66900cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6685d9b640 1 -- 172.21.15.112:0/1322460222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66900cdd90 con 0x7f66900b8a20 2024-09-15T23:54:30.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6685d9b640 1 --2- 172.21.15.112:0/1322460222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66900b8a20 0x7f66900cb450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6678009fd0 tx=0x7f6678010d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:30.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f66877fe640 1 -- 172.21.15.112:0/1322460222 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667800f040 con 0x7f66900b8a20 2024-09-15T23:54:30.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f66877fe640 1 -- 172.21.15.112:0/1322460222 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6678004220 con 0x7f66900b8a20 2024-09-15T23:54:30.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6694894640 1 -- 172.21.15.112:0/1322460222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66900ba170 con 0x7f66900b8a20 2024-09-15T23:54:30.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f66877fe640 1 -- 172.21.15.112:0/1322460222 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667800e960 con 0x7f66900b8a20 2024-09-15T23:54:30.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6694894640 1 -- 172.21.15.112:0/1322460222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66900b7f40 con 0x7f66900b8a20 2024-09-15T23:54:30.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f6694894640 1 -- 172.21.15.112:0/1322460222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f669006d090 con 0x7f66900b8a20 2024-09-15T23:54:30.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f66877fe640 1 -- 172.21.15.112:0/1322460222 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f667800eb00 con 0x7f66900b8a20 2024-09-15T23:54:30.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f66877fe640 1 --2- 172.21.15.112:0/1322460222 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66700678c0 0x7f6670069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f66877fe640 1 -- 172.21.15.112:0/1322460222 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6678086120 con 0x7f66900b8a20 2024-09-15T23:54:30.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.328+0000 7f668e59c640 1 --2- 172.21.15.112:0/1322460222 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66700678c0 0x7f6670069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.332+0000 7f668e59c640 1 --2- 172.21.15.112:0/1322460222 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66700678c0 0x7f6670069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f66800af000 tx=0x7f6680004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:30.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.332+0000 7f66877fe640 1 -- 172.21.15.112:0/1322460222 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6678018030 con 0x7f66900b8a20 2024-09-15T23:54:30.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.524+0000 7f6694894640 1 -- 172.21.15.112:0/1322460222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66900d4c10 con 0x7f66900b8a20 2024-09-15T23:54:30.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.524+0000 7f66877fe640 1 -- 172.21.15.112:0/1322460222 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f6678056880 con 0x7f66900b8a20 2024-09-15T23:54:30.530 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:30.530 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-15T23:54:04:302532+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/879130842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":879130842},{"type":"v1","addr":"172.21.15.112:6836","nonce":879130842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3178495253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3178495253},{"type":"v1","addr":"172.21.15.112:6837","nonce":3178495253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/780833913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":780833913},{"type":"v1","addr":"172.21.15.169:6833","nonce":780833913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:53:50.059476+0000","modified":"2024-09-15T23:54:03.646829+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6835/2205745557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2205745557},{"type":"v1","addr":"172.21.15.169:6835","nonce":2205745557}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-09-15T23:54:30.530 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-15T23:54:30.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.528+0000 7f6694894640 1 -- 172.21.15.112:0/1322460222 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66700678c0 msgr2=0x7f6670069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.528+0000 7f6694894640 1 --2- 172.21.15.112:0/1322460222 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66700678c0 0x7f6670069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f66800af000 tx=0x7f6680004740 comp rx=0 tx=0).stop 2024-09-15T23:54:30.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.528+0000 7f6694894640 1 -- 172.21.15.112:0/1322460222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66900b8a20 msgr2=0x7f66900cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.528+0000 7f6694894640 1 --2- 172.21.15.112:0/1322460222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66900b8a20 0x7f66900cb450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6678009fd0 tx=0x7f6678010d60 comp rx=0 tx=0).stop 2024-09-15T23:54:30.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.528+0000 7f6694894640 1 -- 172.21.15.112:0/1322460222 shutdown_connections 2024-09-15T23:54:30.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.528+0000 7f6694894640 1 --2- 172.21.15.112:0/1322460222 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66700678c0 0x7f6670069d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.528+0000 7f6694894640 1 --2- 172.21.15.112:0/1322460222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6690164b00 0x7f66900cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.528+0000 7f6694894640 1 --2- 172.21.15.112:0/1322460222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66900b8a20 0x7f66900cb450 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.528+0000 7f6694894640 1 --2- 172.21.15.112:0/1322460222 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6690164720 0x7f66900b99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.528+0000 7f6694894640 1 -- 172.21.15.112:0/1322460222 >> 172.21.15.112:0/1322460222 conn(0x7f66900d4790 msgr2=0x7f66900b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:30.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.528+0000 7f6694894640 1 -- 172.21.15.112:0/1322460222 shutdown_connections 2024-09-15T23:54:30.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.528+0000 7f6694894640 1 -- 172.21.15.112:0/1322460222 wait complete. 2024-09-15T23:54:30.547 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:54:30.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa38972b640 1 Processor -- start 2024-09-15T23:54:30.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa38972b640 1 -- start start 2024-09-15T23:54:30.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa38972b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa38415f830 0x7fa38406bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa38972b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38415fc10 con 0x7fa38415eee0 2024-09-15T23:54:30.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa38972b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa384160c90 con 0x7fa38415d290 2024-09-15T23:54:30.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa38972b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa38415da40 con 0x7fa38415f830 2024-09-15T23:54:30.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3837fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa38415eee0 0x7fa384160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45568/0 (socket says 172.21.15.112:45568) 2024-09-15T23:54:30.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3837fe640 1 -- 172.21.15.112:0/3777997255 learned_addr learned my addr 172.21.15.112:0/3777997255 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:30.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa382ffd640 1 --2- 172.21.15.112:0/3777997255 >> v2:172.21.15.169:3300/0 conn(0x7fa38415f830 0x7fa38406bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 -- 172.21.15.112:0/3777997255 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767412 0 0) 0x7fa38415fc10 con 0x7fa38415eee0 2024-09-15T23:54:30.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 -- 172.21.15.112:0/3777997255 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa370003530 con 0x7fa38415eee0 2024-09-15T23:54:30.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 -- 172.21.15.112:0/3777997255 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1085891589 0 0) 0x7fa370003530 con 0x7fa38415eee0 2024-09-15T23:54:30.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 -- 172.21.15.112:0/3777997255 >> v2:172.21.15.169:3300/0 conn(0x7fa38415f830 msgr2=0x7fa38406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:30.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 --2- 172.21.15.112:0/3777997255 >> v2:172.21.15.169:3300/0 conn(0x7fa38415f830 0x7fa38406bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 -- 172.21.15.112:0/3777997255 >> v1:172.21.15.169:6789/0 conn(0x7fa38415d290 legacy=0x7fa38415fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 -- 172.21.15.112:0/3777997255 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38415d800 con 0x7fa38415eee0 2024-09-15T23:54:30.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 -- 172.21.15.112:0/3777997255 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fa37c001a00 con 0x7fa38415eee0 2024-09-15T23:54:30.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 -- 172.21.15.112:0/3777997255 >> v1:172.21.15.112:6789/0 conn(0x7fa38415eee0 legacy=0x7fa384160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 --2- 172.21.15.112:0/3777997255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3700039c0 0x7fa370003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 --2- 172.21.15.112:0/3777997255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa370004810 0x7fa370004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 --2- 172.21.15.112:0/3777997255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3700051d0 0x7fa37000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 -- 172.21.15.112:0/3777997255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa38415da40 con 0x7fa370004810 2024-09-15T23:54:30.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 -- 172.21.15.112:0/3777997255 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa37000c070 con 0x7fa3700039c0 2024-09-15T23:54:30.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3827fc640 1 -- 172.21.15.112:0/3777997255 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa37000c270 con 0x7fa3700051d0 2024-09-15T23:54:30.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa37bfff640 1 --2- 172.21.15.112:0/3777997255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa370004810 0x7fa370004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa382ffd640 1 --2- 172.21.15.112:0/3777997255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3700039c0 0x7fa370003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3837fe640 1 --2- 172.21.15.112:0/3777997255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3700051d0 0x7fa37000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa37bfff640 1 -- 172.21.15.112:0/3777997255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3700051d0 msgr2=0x7fa37000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:30.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa37bfff640 1 --2- 172.21.15.112:0/3777997255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3700051d0 0x7fa37000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa37bfff640 1 -- 172.21.15.112:0/3777997255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3700039c0 msgr2=0x7fa370003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:30.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa37bfff640 1 --2- 172.21.15.112:0/3777997255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3700039c0 0x7fa370003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa37bfff640 1 -- 172.21.15.112:0/3777997255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa370003530 con 0x7fa370004810 2024-09-15T23:54:30.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.652+0000 7fa3837fe640 1 -- 172.21.15.112:0/3777997255 reap_dead start 2024-09-15T23:54:30.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa37bfff640 1 --2- 172.21.15.112:0/3777997255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa370004810 0x7fa370004c90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa36c001780 tx=0x7fa36c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc051bb976b3691 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:30.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa3827fc640 1 -- 172.21.15.112:0/3777997255 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0013a0 con 0x7fa370004810 2024-09-15T23:54:30.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa3827fc640 1 -- 172.21.15.112:0/3777997255 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c0052f0 con 0x7fa370004810 2024-09-15T23:54:30.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa3827fc640 1 -- 172.21.15.112:0/3777997255 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c003840 con 0x7fa370004810 2024-09-15T23:54:30.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 -- 172.21.15.112:0/3777997255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa370004810 msgr2=0x7fa370004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 --2- 172.21.15.112:0/3777997255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa370004810 0x7fa370004c90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa36c001780 tx=0x7fa36c01c400 comp rx=0 tx=0).stop 2024-09-15T23:54:30.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 -- 172.21.15.112:0/3777997255 shutdown_connections 2024-09-15T23:54:30.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 --2- 172.21.15.112:0/3777997255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa370004810 0x7fa370004c90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 -- 172.21.15.112:0/3777997255 >> 172.21.15.112:0/3777997255 conn(0x7fa3840b6800 msgr2=0x7fa3840b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:30.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 -- 172.21.15.112:0/3777997255 shutdown_connections 2024-09-15T23:54:30.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 -- 172.21.15.112:0/3777997255 wait complete. 2024-09-15T23:54:30.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 Processor -- start 2024-09-15T23:54:30.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 -- start start 2024-09-15T23:54:30.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa370004810 0x7fa38414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3841f22d0 0x7fa3841e6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3841e72b0 0x7fa384152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa3840b3b30 con 0x7fa3841e72b0 2024-09-15T23:54:30.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa3840b3850 con 0x7fa370004810 2024-09-15T23:54:30.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa38972b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa384073460 con 0x7fa3841f22d0 2024-09-15T23:54:30.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa3837fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3841e72b0 0x7fa384152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa3837fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3841e72b0 0x7fa384152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52140/0 (socket says 172.21.15.112:52140) 2024-09-15T23:54:30.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa3837fe640 1 -- 172.21.15.112:0/3875279341 learned_addr learned my addr 172.21.15.112:0/3875279341 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:30.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa382ffd640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa370004810 0x7fa38414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa37bfff640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3841f22d0 0x7fa3841e6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa3837fe640 1 -- 172.21.15.112:0/3875279341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3841f22d0 msgr2=0x7fa3841e6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa3837fe640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3841f22d0 0x7fa3841e6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa3837fe640 1 -- 172.21.15.112:0/3875279341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa370004810 msgr2=0x7fa38414e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa3837fe640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa370004810 0x7fa38414e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa3837fe640 1 -- 172.21.15.112:0/3875279341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3841e88d0 con 0x7fa3841e72b0 2024-09-15T23:54:30.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.656+0000 7fa37bfff640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3841f22d0 0x7fa3841e6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:30.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.660+0000 7fa3837fe640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3841e72b0 0x7fa384152060 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa384071880 tx=0x7fa37c0119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:30.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.660+0000 7fa37b7fe640 1 -- 172.21.15.112:0/3875279341 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c010040 con 0x7fa3841e72b0 2024-09-15T23:54:30.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.660+0000 7fa37b7fe640 1 -- 172.21.15.112:0/3875279341 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37c01a070 con 0x7fa3841e72b0 2024-09-15T23:54:30.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.660+0000 7fa38972b640 1 -- 172.21.15.112:0/3875279341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38414eb70 con 0x7fa3841e72b0 2024-09-15T23:54:30.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.660+0000 7fa37b7fe640 1 -- 172.21.15.112:0/3875279341 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c013ae0 con 0x7fa3841e72b0 2024-09-15T23:54:30.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.660+0000 7fa38972b640 1 -- 172.21.15.112:0/3875279341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa38414ee10 con 0x7fa3841e72b0 2024-09-15T23:54:30.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.660+0000 7fa38972b640 1 -- 172.21.15.112:0/3875279341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa38409aa00 con 0x7fa3841e72b0 2024-09-15T23:54:30.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.660+0000 7fa37b7fe640 1 -- 172.21.15.112:0/3875279341 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa37c013c80 con 0x7fa3841e72b0 2024-09-15T23:54:30.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.660+0000 7fa37b7fe640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3640678c0 0x7fa364069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.660+0000 7fa37b7fe640 1 -- 172.21.15.112:0/3875279341 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa37c088e50 con 0x7fa3841e72b0 2024-09-15T23:54:30.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.660+0000 7fa382ffd640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3640678c0 0x7fa364069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.660+0000 7fa382ffd640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3640678c0 0x7fa364069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa384070f70 tx=0x7fa374008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:30.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.664+0000 7fa37b7fe640 1 -- 172.21.15.112:0/3875279341 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa37c059660 con 0x7fa3841e72b0 2024-09-15T23:54:30.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.852+0000 7fa38972b640 1 -- 172.21.15.112:0/3875279341 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa38406e7c0 con 0x7fa3841e72b0 2024-09-15T23:54:30.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.852+0000 7fa37b7fe640 1 -- 172.21.15.112:0/3875279341 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7fa37c058f60 con 0x7fa3841e72b0 2024-09-15T23:54:30.857 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:30.857 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-15T23:54:04:302532+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/879130842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":879130842},{"type":"v1","addr":"172.21.15.112:6836","nonce":879130842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3178495253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3178495253},{"type":"v1","addr":"172.21.15.112:6837","nonce":3178495253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/780833913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":780833913},{"type":"v1","addr":"172.21.15.169:6833","nonce":780833913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:53:50.059476+0000","modified":"2024-09-15T23:54:03.646829+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6835/2205745557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2205745557},{"type":"v1","addr":"172.21.15.169:6835","nonce":2205745557}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-09-15T23:54:30.857 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-15T23:54:30.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.856+0000 7fa38972b640 1 -- 172.21.15.112:0/3875279341 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3640678c0 msgr2=0x7fa364069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.856+0000 7fa38972b640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3640678c0 0x7fa364069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa384070f70 tx=0x7fa374008040 comp rx=0 tx=0).stop 2024-09-15T23:54:30.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.856+0000 7fa38972b640 1 -- 172.21.15.112:0/3875279341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3841e72b0 msgr2=0x7fa384152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.856+0000 7fa38972b640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3841e72b0 0x7fa384152060 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa384071880 tx=0x7fa37c0119f0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.856+0000 7fa38972b640 1 -- 172.21.15.112:0/3875279341 shutdown_connections 2024-09-15T23:54:30.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.856+0000 7fa38972b640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa3640678c0 0x7fa364069d80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.856+0000 7fa38972b640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3841e72b0 0x7fa384152060 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.856+0000 7fa38972b640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3841f22d0 0x7fa3841e6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.856+0000 7fa38972b640 1 --2- 172.21.15.112:0/3875279341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa370004810 0x7fa38414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.856+0000 7fa38972b640 1 -- 172.21.15.112:0/3875279341 >> 172.21.15.112:0/3875279341 conn(0x7fa3840b6800 msgr2=0x7fa3840b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:30.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.856+0000 7fa38972b640 1 -- 172.21.15.112:0/3875279341 shutdown_connections 2024-09-15T23:54:30.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.856+0000 7fa38972b640 1 -- 172.21.15.112:0/3875279341 wait complete. 2024-09-15T23:54:30.874 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:30.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7ed7dc640 1 Processor -- start 2024-09-15T23:54:30.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7ed7dc640 1 -- start start 2024-09-15T23:54:30.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7ed7dc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7e806df70 0x7fe7e81634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7ed7dc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7e80b3290 0x7fe7e80b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7ed7dc640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7e806e470 con 0x7fe7e81630c0 2024-09-15T23:54:30.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7ed7dc640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe7e806fc20 con 0x7fe7e806df70 2024-09-15T23:54:30.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7ed7dc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e806e750 con 0x7fe7e80b3290 2024-09-15T23:54:30.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7e67fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7e806df70 0x7fe7e81634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7e67fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7e806df70 0x7fe7e81634a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52146/0 (socket says 172.21.15.112:52146) 2024-09-15T23:54:30.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7e67fc640 1 -- 172.21.15.112:0/39726037 learned_addr learned my addr 172.21.15.112:0/39726037 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:30.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7e77fe640 1 --2- 172.21.15.112:0/39726037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7e80b3290 0x7fe7e80b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7e67fc640 1 -- 172.21.15.112:0/39726037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7e80b3290 msgr2=0x7fe7e80b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:30.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7e67fc640 1 --2- 172.21.15.112:0/39726037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7e80b3290 0x7fe7e80b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7e67fc640 1 -- 172.21.15.112:0/39726037 >> v1:172.21.15.169:6789/0 conn(0x7fe7e81630c0 legacy=0x7fe7e806f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:30.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.976+0000 7fe7e67fc640 1 -- 172.21.15.112:0/39726037 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e806ea30 con 0x7fe7e806df70 2024-09-15T23:54:30.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.980+0000 7fe7e67fc640 1 --2- 172.21.15.112:0/39726037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e806df70 0x7fe7e81634a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009870 tx=0x7fe7d801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb23e07dd44321c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:30.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.980+0000 7fe7e5ffb640 1 -- 172.21.15.112:0/39726037 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80b2070 con 0x7fe7e806df70 2024-09-15T23:54:30.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.980+0000 7fe7e5ffb640 1 -- 172.21.15.112:0/39726037 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7d80a9070 con 0x7fe7e806df70 2024-09-15T23:54:30.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.980+0000 7fe7e5ffb640 1 -- 172.21.15.112:0/39726037 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80ad880 con 0x7fe7e806df70 2024-09-15T23:54:30.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.980+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/39726037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e806df70 msgr2=0x7fe7e81634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.980+0000 7fe7ed7dc640 1 --2- 172.21.15.112:0/39726037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e806df70 0x7fe7e81634a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009870 tx=0x7fe7d801c560 comp rx=0 tx=0).stop 2024-09-15T23:54:30.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.980+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/39726037 shutdown_connections 2024-09-15T23:54:30.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.980+0000 7fe7ed7dc640 1 --2- 172.21.15.112:0/39726037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7e80b3290 0x7fe7e80b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.980+0000 7fe7ed7dc640 1 --2- 172.21.15.112:0/39726037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e806df70 0x7fe7e81634a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.980+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/39726037 >> 172.21.15.112:0/39726037 conn(0x7fe7e80b1f90 msgr2=0x7fe7e80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:30.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.980+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/39726037 shutdown_connections 2024-09-15T23:54:30.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.980+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/39726037 wait complete. 2024-09-15T23:54:30.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.980+0000 7fe7ed7dc640 1 Processor -- start 2024-09-15T23:54:30.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.980+0000 7fe7ed7dc640 1 -- start start 2024-09-15T23:54:30.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7ed7dc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7e806df70 0x7fe7e8153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7ed7dc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e80b3290 0x7fe7e80adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7ed7dc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7e81630c0 0x7fe7e8154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7ed7dc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e816f5f0 con 0x7fe7e80b3290 2024-09-15T23:54:30.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7ed7dc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e816f770 con 0x7fe7e806df70 2024-09-15T23:54:30.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7ed7dc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e816f8f0 con 0x7fe7e81630c0 2024-09-15T23:54:30.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7e67fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e80b3290 0x7fe7e80adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7e67fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e80b3290 0x7fe7e80adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52158/0 (socket says 172.21.15.112:52158) 2024-09-15T23:54:30.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7e67fc640 1 -- 172.21.15.112:0/2499773237 learned_addr learned my addr 172.21.15.112:0/2499773237 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:30.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7e6ffd640 1 --2- 172.21.15.112:0/2499773237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7e806df70 0x7fe7e8153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7e77fe640 1 --2- 172.21.15.112:0/2499773237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7e81630c0 0x7fe7e8154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7e67fc640 1 -- 172.21.15.112:0/2499773237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7e81630c0 msgr2=0x7fe7e8154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7e67fc640 1 --2- 172.21.15.112:0/2499773237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7e81630c0 0x7fe7e8154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7e67fc640 1 -- 172.21.15.112:0/2499773237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7e806df70 msgr2=0x7fe7e8153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:30.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7e67fc640 1 --2- 172.21.15.112:0/2499773237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7e806df70 0x7fe7e8153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:30.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7e67fc640 1 -- 172.21.15.112:0/2499773237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e80ae3e0 con 0x7fe7e80b3290 2024-09-15T23:54:30.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7e67fc640 1 --2- 172.21.15.112:0/2499773237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e80b3290 0x7fe7e80adea0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe7d801a190 tx=0x7fe7d8019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:30.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7cf7fe640 1 -- 172.21.15.112:0/2499773237 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80bb070 con 0x7fe7e80b3290 2024-09-15T23:54:30.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7cf7fe640 1 -- 172.21.15.112:0/2499773237 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7d80addb0 con 0x7fe7e80b3290 2024-09-15T23:54:30.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/2499773237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e8153b40 con 0x7fe7e80b3290 2024-09-15T23:54:30.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7cf7fe640 1 -- 172.21.15.112:0/2499773237 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80b2040 con 0x7fe7e80b3290 2024-09-15T23:54:30.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/2499773237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e809aaa0 con 0x7fe7e80b3290 2024-09-15T23:54:30.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/2499773237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e81634a0 con 0x7fe7e80b3290 2024-09-15T23:54:30.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7cf7fe640 1 -- 172.21.15.112:0/2499773237 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe7d80be070 con 0x7fe7e80b3290 2024-09-15T23:54:30.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7cf7fe640 1 --2- 172.21.15.112:0/2499773237 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe7d40678c0 0x7fe7d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:30.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7e6ffd640 1 --2- 172.21.15.112:0/2499773237 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe7d40678c0 0x7fe7d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:30.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7cf7fe640 1 -- 172.21.15.112:0/2499773237 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe7d811eff0 con 0x7fe7e80b3290 2024-09-15T23:54:30.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.984+0000 7fe7e6ffd640 1 --2- 172.21.15.112:0/2499773237 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe7d40678c0 0x7fe7d4069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8165120 tx=0x7fe7dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:30.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:30.988+0000 7fe7cf7fe640 1 -- 172.21.15.112:0/2499773237 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe7d8016150 con 0x7fe7e80b3290 2024-09-15T23:54:31.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.148+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/2499773237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7e8070080 con 0x7fe7e80b3290 2024-09-15T23:54:31.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.148+0000 7fe7cf7fe640 1 -- 172.21.15.112:0/2499773237 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18614 (secure 0 0 0) 0x7fe7d80ef7f0 con 0x7fe7e80b3290 2024-09-15T23:54:31.154 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:31.154 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":26,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:53:55.161085+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:53:47.908190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:53:49.056283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:53:52.808895+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:31.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.152+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/2499773237 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe7d40678c0 msgr2=0x7fe7d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.152+0000 7fe7ed7dc640 1 --2- 172.21.15.112:0/2499773237 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe7d40678c0 0x7fe7d4069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8165120 tx=0x7fe7dc009040 comp rx=0 tx=0).stop 2024-09-15T23:54:31.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.152+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/2499773237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e80b3290 msgr2=0x7fe7e80adea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.152+0000 7fe7ed7dc640 1 --2- 172.21.15.112:0/2499773237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e80b3290 0x7fe7e80adea0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe7d801a190 tx=0x7fe7d8019300 comp rx=0 tx=0).stop 2024-09-15T23:54:31.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.152+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/2499773237 shutdown_connections 2024-09-15T23:54:31.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.152+0000 7fe7ed7dc640 1 --2- 172.21.15.112:0/2499773237 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe7d40678c0 0x7fe7d4069d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.152+0000 7fe7ed7dc640 1 --2- 172.21.15.112:0/2499773237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7e81630c0 0x7fe7e8154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.152+0000 7fe7ed7dc640 1 --2- 172.21.15.112:0/2499773237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7e80b3290 0x7fe7e80adea0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.152+0000 7fe7ed7dc640 1 --2- 172.21.15.112:0/2499773237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7e806df70 0x7fe7e8153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.152+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/2499773237 >> 172.21.15.112:0/2499773237 conn(0x7fe7e80b1f90 msgr2=0x7fe7e8072f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:31.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.152+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/2499773237 shutdown_connections 2024-09-15T23:54:31.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.152+0000 7fe7ed7dc640 1 -- 172.21.15.112:0/2499773237 wait complete. 2024-09-15T23:54:31.172 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:54:31.172 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:54:31.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.288+0000 7fed41a56640 1 Processor -- start 2024-09-15T23:54:31.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.288+0000 7fed41a56640 1 -- start start 2024-09-15T23:54:31.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.288+0000 7fed41a56640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fed3c1550e0 0x7fed3c15f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed41a56640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3c0af630 con 0x7fed3c0adf80 2024-09-15T23:54:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed41a56640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3c0af910 con 0x7fed3c1554c0 2024-09-15T23:54:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed41a56640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fed3c0afbf0 con 0x7fed3c1550e0 2024-09-15T23:54:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed3b7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fed3c0adf80 0x7fed3c0b5f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45578/0 (socket says 172.21.15.112:45578) 2024-09-15T23:54:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed3b7fe640 1 -- 172.21.15.112:0/2521441481 learned_addr learned my addr 172.21.15.112:0/2521441481 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed3affd640 1 --2- 172.21.15.112:0/2521441481 >> v2:172.21.15.169:3300/0 conn(0x7fed3c1550e0 0x7fed3c15f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 -- 172.21.15.112:0/2521441481 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1032985292 0 0) 0x7fed3c0af630 con 0x7fed3c0adf80 2024-09-15T23:54:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 -- 172.21.15.112:0/2521441481 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed24003530 con 0x7fed3c0adf80 2024-09-15T23:54:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 -- 172.21.15.112:0/2521441481 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2217415735 0 0) 0x7fed24003530 con 0x7fed3c0adf80 2024-09-15T23:54:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 -- 172.21.15.112:0/2521441481 >> v2:172.21.15.169:3300/0 conn(0x7fed3c1550e0 msgr2=0x7fed3c15f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:31.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 --2- 172.21.15.112:0/2521441481 >> v2:172.21.15.169:3300/0 conn(0x7fed3c1550e0 0x7fed3c15f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 -- 172.21.15.112:0/2521441481 >> v1:172.21.15.169:6789/0 conn(0x7fed3c1554c0 legacy=0x7fed3c0ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 -- 172.21.15.112:0/2521441481 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c0afed0 con 0x7fed3c0adf80 2024-09-15T23:54:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 -- 172.21.15.112:0/2521441481 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fed2c001680 con 0x7fed3c0adf80 2024-09-15T23:54:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 -- 172.21.15.112:0/2521441481 >> v1:172.21.15.112:6789/0 conn(0x7fed3c0adf80 legacy=0x7fed3c0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 --2- 172.21.15.112:0/2521441481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed240039c0 0x7fed24003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 --2- 172.21.15.112:0/2521441481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed24004810 0x7fed24004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 --2- 172.21.15.112:0/2521441481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed240051d0 0x7fed2400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 -- 172.21.15.112:0/2521441481 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c0afbf0 con 0x7fed240051d0 2024-09-15T23:54:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 -- 172.21.15.112:0/2521441481 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fed2400c070 con 0x7fed240039c0 2024-09-15T23:54:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 -- 172.21.15.112:0/2521441481 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fed2400c270 con 0x7fed24004810 2024-09-15T23:54:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed3b7fe640 1 --2- 172.21.15.112:0/2521441481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed240051d0 0x7fed2400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed3affd640 1 --2- 172.21.15.112:0/2521441481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed240039c0 0x7fed24003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed3b7fe640 1 -- 172.21.15.112:0/2521441481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed24004810 msgr2=0x7fed24004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:31.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed3b7fe640 1 --2- 172.21.15.112:0/2521441481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed24004810 0x7fed24004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed3b7fe640 1 -- 172.21.15.112:0/2521441481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed240039c0 msgr2=0x7fed24003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:31.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed3b7fe640 1 --2- 172.21.15.112:0/2521441481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed240039c0 0x7fed24003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed3b7fe640 1 -- 172.21.15.112:0/2521441481 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed24003530 con 0x7fed240051d0 2024-09-15T23:54:31.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed3b7fe640 1 -- 172.21.15.112:0/2521441481 reap_dead start 2024-09-15T23:54:31.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed3b7fe640 1 --2- 172.21.15.112:0/2521441481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed240051d0 0x7fed2400b9d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fed3c072450 tx=0x7fed2c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad797d35d03392be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:31.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 -- 172.21.15.112:0/2521441481 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c007d20 con 0x7fed240051d0 2024-09-15T23:54:31.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 -- 172.21.15.112:0/2521441481 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2c0a9070 con 0x7fed240051d0 2024-09-15T23:54:31.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.292+0000 7fed39ffb640 1 -- 172.21.15.112:0/2521441481 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0a5d60 con 0x7fed240051d0 2024-09-15T23:54:31.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 -- 172.21.15.112:0/2521441481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed240051d0 msgr2=0x7fed2400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 --2- 172.21.15.112:0/2521441481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed240051d0 0x7fed2400b9d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fed3c072450 tx=0x7fed2c01cc20 comp rx=0 tx=0).stop 2024-09-15T23:54:31.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 -- 172.21.15.112:0/2521441481 shutdown_connections 2024-09-15T23:54:31.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 --2- 172.21.15.112:0/2521441481 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed240051d0 0x7fed2400b9d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 -- 172.21.15.112:0/2521441481 >> 172.21.15.112:0/2521441481 conn(0x7fed3c072ec0 msgr2=0x7fed3c0732d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:31.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 -- 172.21.15.112:0/2521441481 shutdown_connections 2024-09-15T23:54:31.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 -- 172.21.15.112:0/2521441481 wait complete. 2024-09-15T23:54:31.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 Processor -- start 2024-09-15T23:54:31.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 -- start start 2024-09-15T23:54:31.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed240051d0 0x7fed3c1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed3c153dd0 0x7fed3c144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed3c154250 0x7fed3c144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c0af1f0 con 0x7fed3c154250 2024-09-15T23:54:31.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c0af070 con 0x7fed240051d0 2024-09-15T23:54:31.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c0af370 con 0x7fed3c153dd0 2024-09-15T23:54:31.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed3b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed3c154250 0x7fed3c144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed3b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed3c154250 0x7fed3c144640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52178/0 (socket says 172.21.15.112:52178) 2024-09-15T23:54:31.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed3b7fe640 1 -- 172.21.15.112:0/2208078451 learned_addr learned my addr 172.21.15.112:0/2208078451 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:31.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed3affd640 1 --2- 172.21.15.112:0/2208078451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed240051d0 0x7fed3c1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed3a7fc640 1 --2- 172.21.15.112:0/2208078451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed3c153dd0 0x7fed3c144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed3b7fe640 1 -- 172.21.15.112:0/2208078451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed3c153dd0 msgr2=0x7fed3c144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed3b7fe640 1 --2- 172.21.15.112:0/2208078451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed3c153dd0 0x7fed3c144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed3b7fe640 1 -- 172.21.15.112:0/2208078451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed240051d0 msgr2=0x7fed3c1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed3b7fe640 1 --2- 172.21.15.112:0/2208078451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed240051d0 0x7fed3c1595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed3b7fe640 1 -- 172.21.15.112:0/2208078451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c142110 con 0x7fed3c154250 2024-09-15T23:54:31.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed3b7fe640 1 --2- 172.21.15.112:0/2208078451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed3c154250 0x7fed3c144640 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fed2c01d4c0 tx=0x7fed24005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:31.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed23fff640 1 -- 172.21.15.112:0/2208078451 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c007d20 con 0x7fed3c154250 2024-09-15T23:54:31.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed23fff640 1 -- 172.21.15.112:0/2208078451 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2c0b2020 con 0x7fed3c154250 2024-09-15T23:54:31.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 -- 172.21.15.112:0/2208078451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3c1423f0 con 0x7fed3c154250 2024-09-15T23:54:31.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed23fff640 1 -- 172.21.15.112:0/2208078451 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0049f0 con 0x7fed3c154250 2024-09-15T23:54:31.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 -- 172.21.15.112:0/2208078451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3c1429b0 con 0x7fed3c154250 2024-09-15T23:54:31.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.296+0000 7fed41a56640 1 -- 172.21.15.112:0/2208078451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3c0af5e0 con 0x7fed3c154250 2024-09-15T23:54:31.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.300+0000 7fed23fff640 1 -- 172.21.15.112:0/2208078451 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed2c004b90 con 0x7fed3c154250 2024-09-15T23:54:31.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.300+0000 7fed23fff640 1 --2- 172.21.15.112:0/2208078451 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fed280678f0 0x7fed28069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.300+0000 7fed23fff640 1 -- 172.21.15.112:0/2208078451 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fed2c11fb30 con 0x7fed3c154250 2024-09-15T23:54:31.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.300+0000 7fed3affd640 1 --2- 172.21.15.112:0/2208078451 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fed280678f0 0x7fed28069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.300+0000 7fed3affd640 1 --2- 172.21.15.112:0/2208078451 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fed280678f0 0x7fed28069db0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed3c15fbb0 tx=0x7fed3400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:31.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.304+0000 7fed23fff640 1 -- 172.21.15.112:0/2208078451 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fed2c0bc070 con 0x7fed3c154250 2024-09-15T23:54:31.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.504+0000 7fed41a56640 1 -- 172.21.15.112:0/2208078451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed3c15f3c0 con 0x7fed3c154250 2024-09-15T23:54:31.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.504+0000 7fed23fff640 1 -- 172.21.15.112:0/2208078451 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7fed2c016930 con 0x7fed3c154250 2024-09-15T23:54:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:31.509 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-15T23:54:04:302532+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/879130842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":879130842},{"type":"v1","addr":"172.21.15.112:6836","nonce":879130842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3178495253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3178495253},{"type":"v1","addr":"172.21.15.112:6837","nonce":3178495253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/780833913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":780833913},{"type":"v1","addr":"172.21.15.169:6833","nonce":780833913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:53:50.059476+0000","modified":"2024-09-15T23:54:03.646829+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6835/2205745557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2205745557},{"type":"v1","addr":"172.21.15.169:6835","nonce":2205745557}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-09-15T23:54:31.509 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-15T23:54:31.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.508+0000 7fed41a56640 1 -- 172.21.15.112:0/2208078451 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fed280678f0 msgr2=0x7fed28069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.508+0000 7fed41a56640 1 --2- 172.21.15.112:0/2208078451 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fed280678f0 0x7fed28069db0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed3c15fbb0 tx=0x7fed3400b040 comp rx=0 tx=0).stop 2024-09-15T23:54:31.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.508+0000 7fed41a56640 1 -- 172.21.15.112:0/2208078451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed3c154250 msgr2=0x7fed3c144640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.508+0000 7fed41a56640 1 --2- 172.21.15.112:0/2208078451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed3c154250 0x7fed3c144640 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fed2c01d4c0 tx=0x7fed24005840 comp rx=0 tx=0).stop 2024-09-15T23:54:31.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.508+0000 7fed41a56640 1 -- 172.21.15.112:0/2208078451 shutdown_connections 2024-09-15T23:54:31.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.508+0000 7fed41a56640 1 --2- 172.21.15.112:0/2208078451 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fed280678f0 0x7fed28069db0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.508+0000 7fed41a56640 1 --2- 172.21.15.112:0/2208078451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed3c154250 0x7fed3c144640 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.508+0000 7fed41a56640 1 --2- 172.21.15.112:0/2208078451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fed3c153dd0 0x7fed3c144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.508+0000 7fed41a56640 1 --2- 172.21.15.112:0/2208078451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed240051d0 0x7fed3c1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.508+0000 7fed41a56640 1 -- 172.21.15.112:0/2208078451 >> 172.21.15.112:0/2208078451 conn(0x7fed3c072ec0 msgr2=0x7fed3c0b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:31.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.508+0000 7fed41a56640 1 -- 172.21.15.112:0/2208078451 shutdown_connections 2024-09-15T23:54:31.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.508+0000 7fed41a56640 1 -- 172.21.15.112:0/2208078451 wait complete. 2024-09-15T23:54:31.527 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:54:31.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.628+0000 7f7da4636640 1 Processor -- start 2024-09-15T23:54:31.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.628+0000 7f7da4636640 1 -- start start 2024-09-15T23:54:31.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da4636640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c15f830 0x7f7d9c06bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da4636640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7d9c15d290 0x7f7d9c06c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da4636640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9c15fc10 con 0x7f7d9c09aa00 2024-09-15T23:54:31.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da4636640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7d9c15da40 con 0x7f7d9c15d290 2024-09-15T23:54:31.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da4636640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9c15d800 con 0x7f7d9c15f830 2024-09-15T23:54:31.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da2bd3640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7d9c09aa00 0x7f7d9c15fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45592/0 (socket says 172.21.15.112:45592) 2024-09-15T23:54:31.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da2bd3640 1 -- 172.21.15.112:0/58926605 learned_addr learned my addr 172.21.15.112:0/58926605 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:31.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da23d2640 1 --2- 172.21.15.112:0/58926605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c15f830 0x7f7d9c06bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 -- 172.21.15.112:0/58926605 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4165126868 0 0) 0x7f7d9c15fc10 con 0x7f7d9c09aa00 2024-09-15T23:54:31.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 -- 172.21.15.112:0/58926605 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d88003530 con 0x7f7d9c09aa00 2024-09-15T23:54:31.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da1bd1640 1 --2- 172.21.15.112:0/58926605 >> v2:172.21.15.169:3300/0 conn(0x7f7d9c15d290 0x7f7d9c06c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 -- 172.21.15.112:0/58926605 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 765108303 0 0) 0x7f7d88003530 con 0x7f7d9c09aa00 2024-09-15T23:54:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 -- 172.21.15.112:0/58926605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c15f830 msgr2=0x7f7d9c06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 --2- 172.21.15.112:0/58926605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c15f830 0x7f7d9c06bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 -- 172.21.15.112:0/58926605 >> v2:172.21.15.169:3300/0 conn(0x7f7d9c15d290 msgr2=0x7f7d9c06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 --2- 172.21.15.112:0/58926605 >> v2:172.21.15.169:3300/0 conn(0x7f7d9c15d290 0x7f7d9c06c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 -- 172.21.15.112:0/58926605 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9c0b3570 con 0x7f7d9c09aa00 2024-09-15T23:54:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 -- 172.21.15.112:0/58926605 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f7d98001680 con 0x7f7d9c09aa00 2024-09-15T23:54:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 -- 172.21.15.112:0/58926605 >> v1:172.21.15.112:6789/0 conn(0x7f7d9c09aa00 legacy=0x7f7d9c15fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 --2- 172.21.15.112:0/58926605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c15f830 0x7f7d880039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 --2- 172.21.15.112:0/58926605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d88003f40 0x7f7d88004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 --2- 172.21.15.112:0/58926605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d88004d50 0x7f7d880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 -- 172.21.15.112:0/58926605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c15da40 con 0x7f7d88003f40 2024-09-15T23:54:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 -- 172.21.15.112:0/58926605 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c15d800 con 0x7f7d88004d50 2024-09-15T23:54:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da13d0640 1 -- 172.21.15.112:0/58926605 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8800b9d0 con 0x7f7d9c15f830 2024-09-15T23:54:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da1bd1640 1 --2- 172.21.15.112:0/58926605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d88003f40 0x7f7d88004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da23d2640 1 --2- 172.21.15.112:0/58926605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c15f830 0x7f7d880039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da2bd3640 1 --2- 172.21.15.112:0/58926605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d88004d50 0x7f7d880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da1bd1640 1 -- 172.21.15.112:0/58926605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c15f830 msgr2=0x7f7d880039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da1bd1640 1 --2- 172.21.15.112:0/58926605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c15f830 0x7f7d880039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da1bd1640 1 -- 172.21.15.112:0/58926605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d88004d50 msgr2=0x7f7d880051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da1bd1640 1 --2- 172.21.15.112:0/58926605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d88004d50 0x7f7d880051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da1bd1640 1 -- 172.21.15.112:0/58926605 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d88003530 con 0x7f7d88003f40 2024-09-15T23:54:31.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.632+0000 7f7da23d2640 1 --2- 172.21.15.112:0/58926605 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c15f830 0x7f7d880039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:54:31.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da1bd1640 1 --2- 172.21.15.112:0/58926605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d88003f40 0x7f7d88004810 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009f90 tx=0x7f7d9001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29795cf117df566 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:31.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da13d0640 1 -- 172.21.15.112:0/58926605 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d900b2070 con 0x7f7d88003f40 2024-09-15T23:54:31.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da13d0640 1 -- 172.21.15.112:0/58926605 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d900a5b80 con 0x7f7d88003f40 2024-09-15T23:54:31.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da13d0640 1 -- 172.21.15.112:0/58926605 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90009c10 con 0x7f7d88003f40 2024-09-15T23:54:31.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da4636640 1 -- 172.21.15.112:0/58926605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d88003f40 msgr2=0x7f7d88004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da4636640 1 --2- 172.21.15.112:0/58926605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d88003f40 0x7f7d88004810 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009f90 tx=0x7f7d9001cc20 comp rx=0 tx=0).stop 2024-09-15T23:54:31.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da2bd3640 1 -- 172.21.15.112:0/58926605 reap_dead start 2024-09-15T23:54:31.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da4636640 1 -- 172.21.15.112:0/58926605 shutdown_connections 2024-09-15T23:54:31.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da4636640 1 -- 172.21.15.112:0/58926605 >> 172.21.15.112:0/58926605 conn(0x7f7d9c0b6800 msgr2=0x7f7d9c0b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:31.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da4636640 1 -- 172.21.15.112:0/58926605 shutdown_connections 2024-09-15T23:54:31.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da4636640 1 -- 172.21.15.112:0/58926605 wait complete. 2024-09-15T23:54:31.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da4636640 1 Processor -- start 2024-09-15T23:54:31.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da4636640 1 -- start start 2024-09-15T23:54:31.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da4636640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d9c0b1200 0x7f7d9c140230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da4636640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c0cdda0 0x7f7d9c140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da4636640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d9c0b15e0 0x7f7d9c1432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da4636640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c073460 con 0x7f7d9c0b15e0 2024-09-15T23:54:31.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da4636640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c0b3b30 con 0x7f7d9c0b1200 2024-09-15T23:54:31.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da4636640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9c0735e0 con 0x7f7d9c0cdda0 2024-09-15T23:54:31.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da2bd3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d9c0b15e0 0x7f7d9c1432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da2bd3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d9c0b15e0 0x7f7d9c1432d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52198/0 (socket says 172.21.15.112:52198) 2024-09-15T23:54:31.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da2bd3640 1 -- 172.21.15.112:0/3915404993 learned_addr learned my addr 172.21.15.112:0/3915404993 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:31.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da23d2640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d9c0b1200 0x7f7d9c140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da1bd1640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c0cdda0 0x7f7d9c140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da2bd3640 1 -- 172.21.15.112:0/3915404993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c0cdda0 msgr2=0x7f7d9c140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da2bd3640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c0cdda0 0x7f7d9c140770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da2bd3640 1 -- 172.21.15.112:0/3915404993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d9c0b1200 msgr2=0x7f7d9c140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da2bd3640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d9c0b1200 0x7f7d9c140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da2bd3640 1 -- 172.21.15.112:0/3915404993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9c141140 con 0x7f7d9c0b15e0 2024-09-15T23:54:31.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.636+0000 7f7da1bd1640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c0cdda0 0x7f7d9c140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:31.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.640+0000 7f7da2bd3640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d9c0b15e0 0x7f7d9c1432d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c15dbc0 tx=0x7f7d98011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:31.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.640+0000 7f7d8effd640 1 -- 172.21.15.112:0/3915404993 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98010040 con 0x7f7d9c0b15e0 2024-09-15T23:54:31.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.640+0000 7f7d8effd640 1 -- 172.21.15.112:0/3915404993 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d9801a070 con 0x7f7d9c0b15e0 2024-09-15T23:54:31.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.640+0000 7f7da4636640 1 -- 172.21.15.112:0/3915404993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d9c141420 con 0x7f7d9c0b15e0 2024-09-15T23:54:31.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.640+0000 7f7d8effd640 1 -- 172.21.15.112:0/3915404993 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9800fb00 con 0x7f7d9c0b15e0 2024-09-15T23:54:31.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.640+0000 7f7da4636640 1 -- 172.21.15.112:0/3915404993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d9c143810 con 0x7f7d9c0b15e0 2024-09-15T23:54:31.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.640+0000 7f7da4636640 1 -- 172.21.15.112:0/3915404993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d9c06bcc0 con 0x7f7d9c0b15e0 2024-09-15T23:54:31.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.640+0000 7f7d8effd640 1 -- 172.21.15.112:0/3915404993 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7d9800fca0 con 0x7f7d9c0b15e0 2024-09-15T23:54:31.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.640+0000 7f7d8effd640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7d800678f0 0x7f7d80069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.640+0000 7f7d8effd640 1 -- 172.21.15.112:0/3915404993 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f7d98088d20 con 0x7f7d9c0b15e0 2024-09-15T23:54:31.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.640+0000 7f7da23d2640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7d800678f0 0x7f7d80069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.640+0000 7f7da23d2640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7d800678f0 0x7f7d80069db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7d940099d0 tx=0x7f7d94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:31.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.644+0000 7f7d8effd640 1 -- 172.21.15.112:0/3915404993 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7d98059580 con 0x7f7d9c0b15e0 2024-09-15T23:54:31.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.828+0000 7f7da4636640 1 -- 172.21.15.112:0/3915404993 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d9c06e7c0 con 0x7f7d9c0b15e0 2024-09-15T23:54:31.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.828+0000 7f7d8effd640 1 -- 172.21.15.112:0/3915404993 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f7d98058e80 con 0x7f7d9c0b15e0 2024-09-15T23:54:31.832 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:31.832 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":8,"btime":"2024-09-15T23:54:04:302532+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/879130842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":879130842},{"type":"v1","addr":"172.21.15.112:6836","nonce":879130842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3178495253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3178495253},{"type":"v1","addr":"172.21.15.112:6837","nonce":3178495253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/780833913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":780833913},{"type":"v1","addr":"172.21.15.169:6833","nonce":780833913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:53:50.059476+0000","modified":"2024-09-15T23:54:03.646829+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6835/2205745557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2205745557},{"type":"v1","addr":"172.21.15.169:6835","nonce":2205745557}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-09-15T23:54:31.832 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 8 2024-09-15T23:54:31.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.828+0000 7f7da4636640 1 -- 172.21.15.112:0/3915404993 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7d800678f0 msgr2=0x7f7d80069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.828+0000 7f7da4636640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7d800678f0 0x7f7d80069db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7d940099d0 tx=0x7f7d94008040 comp rx=0 tx=0).stop 2024-09-15T23:54:31.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.828+0000 7f7da4636640 1 -- 172.21.15.112:0/3915404993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d9c0b15e0 msgr2=0x7f7d9c1432d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.828+0000 7f7da4636640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d9c0b15e0 0x7f7d9c1432d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c15dbc0 tx=0x7f7d98011b60 comp rx=0 tx=0).stop 2024-09-15T23:54:31.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.832+0000 7f7da4636640 1 -- 172.21.15.112:0/3915404993 shutdown_connections 2024-09-15T23:54:31.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.832+0000 7f7da4636640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7d800678f0 0x7f7d80069db0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.832+0000 7f7da4636640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d9c0b15e0 0x7f7d9c1432d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.832+0000 7f7da4636640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d9c0cdda0 0x7f7d9c140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.832+0000 7f7da4636640 1 --2- 172.21.15.112:0/3915404993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d9c0b1200 0x7f7d9c140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.832+0000 7f7da4636640 1 -- 172.21.15.112:0/3915404993 >> 172.21.15.112:0/3915404993 conn(0x7f7d9c0b6800 msgr2=0x7f7d9c0b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:31.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.832+0000 7f7da4636640 1 -- 172.21.15.112:0/3915404993 shutdown_connections 2024-09-15T23:54:31.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.832+0000 7f7da4636640 1 -- 172.21.15.112:0/3915404993 wait complete. 2024-09-15T23:54:31.850 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:31.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.960+0000 7f7ace7fd640 1 Processor -- start 2024-09-15T23:54:31.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.960+0000 7f7ace7fd640 1 -- start start 2024-09-15T23:54:31.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ace7fd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac80d3060 0x7f7ac80cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ace7fd640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac80d0300 con 0x7f7ac80cf450 2024-09-15T23:54:31.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ace7fd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac80b0f60 con 0x7f7ac8161a60 2024-09-15T23:54:31.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ace7fd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac80cfd40 con 0x7f7ac80d3060 2024-09-15T23:54:31.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7accd9a640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7ac80cf450 0x7f7ac806d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45608/0 (socket says 172.21.15.112:45608) 2024-09-15T23:54:31.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7accd9a640 1 -- 172.21.15.112:0/3290888765 learned_addr learned my addr 172.21.15.112:0/3290888765 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:31.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 -- 172.21.15.112:0/3290888765 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528508149 0 0) 0x7f7ac00014a0 con 0x7f7ac80cf450 2024-09-15T23:54:31.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac77fe640 1 --2- 172.21.15.112:0/3290888765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac80d3060 0x7f7ac80cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 -- 172.21.15.112:0/3290888765 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ab0003530 con 0x7f7ac80cf450 2024-09-15T23:54:31.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 -- 172.21.15.112:0/3290888765 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 383258352 0 0) 0x7f7ab0003530 con 0x7f7ac80cf450 2024-09-15T23:54:31.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 -- 172.21.15.112:0/3290888765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac80d3060 msgr2=0x7f7ac80cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:31.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 --2- 172.21.15.112:0/3290888765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac80d3060 0x7f7ac80cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 -- 172.21.15.112:0/3290888765 >> v1:172.21.15.169:6789/0 conn(0x7f7ac8161a60 legacy=0x7f7ac80d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 -- 172.21.15.112:0/3290888765 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac80d0020 con 0x7f7ac80cf450 2024-09-15T23:54:31.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 -- 172.21.15.112:0/3290888765 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f7ac0001bd0 con 0x7f7ac80cf450 2024-09-15T23:54:31.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 -- 172.21.15.112:0/3290888765 >> v1:172.21.15.112:6789/0 conn(0x7f7ac80cf450 legacy=0x7f7ac806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 --2- 172.21.15.112:0/3290888765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab00039f0 0x7f7ab0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 --2- 172.21.15.112:0/3290888765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ab0004810 0x7f7ab0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 --2- 172.21.15.112:0/3290888765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac80d3060 0x7f7ab000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 -- 172.21.15.112:0/3290888765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac80cfd40 con 0x7f7ab00039f0 2024-09-15T23:54:31.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 -- 172.21.15.112:0/3290888765 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab0005530 con 0x7f7ab0004810 2024-09-15T23:54:31.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac6ffd640 1 -- 172.21.15.112:0/3290888765 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab000bf10 con 0x7f7ac80d3060 2024-09-15T23:54:31.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac7fff640 1 --2- 172.21.15.112:0/3290888765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab00039f0 0x7f7ab0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac77fe640 1 --2- 172.21.15.112:0/3290888765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ab0004810 0x7f7ab0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7accd9a640 1 --2- 172.21.15.112:0/3290888765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac80d3060 0x7f7ab000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac7fff640 1 -- 172.21.15.112:0/3290888765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac80d3060 msgr2=0x7f7ab000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:31.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac7fff640 1 --2- 172.21.15.112:0/3290888765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac80d3060 0x7f7ab000b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac7fff640 1 -- 172.21.15.112:0/3290888765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ab0004810 msgr2=0x7f7ab0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:31.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac7fff640 1 --2- 172.21.15.112:0/3290888765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ab0004810 0x7f7ab0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac7fff640 1 -- 172.21.15.112:0/3290888765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab0003530 con 0x7f7ab00039f0 2024-09-15T23:54:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.964+0000 7f7ac7fff640 1 --2- 172.21.15.112:0/3290888765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab00039f0 0x7f7ab0003e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8001780 tx=0x7f7ab801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbcff11c3284300 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ac6ffd640 1 -- 172.21.15.112:0/3290888765 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab80013a0 con 0x7f7ab00039f0 2024-09-15T23:54:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ac6ffd640 1 -- 172.21.15.112:0/3290888765 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab80052f0 con 0x7f7ab00039f0 2024-09-15T23:54:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ac6ffd640 1 -- 172.21.15.112:0/3290888765 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8003840 con 0x7f7ab00039f0 2024-09-15T23:54:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 -- 172.21.15.112:0/3290888765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab00039f0 msgr2=0x7f7ab0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 --2- 172.21.15.112:0/3290888765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ab00039f0 0x7f7ab0003e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8001780 tx=0x7f7ab801c3f0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7accd9a640 1 -- 172.21.15.112:0/3290888765 reap_dead start 2024-09-15T23:54:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 -- 172.21.15.112:0/3290888765 shutdown_connections 2024-09-15T23:54:31.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 -- 172.21.15.112:0/3290888765 >> 172.21.15.112:0/3290888765 conn(0x7f7ac808bf90 msgr2=0x7f7ac809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:31.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 -- 172.21.15.112:0/3290888765 shutdown_connections 2024-09-15T23:54:31.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 -- 172.21.15.112:0/3290888765 wait complete. 2024-09-15T23:54:31.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 Processor -- start 2024-09-15T23:54:31.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 -- start start 2024-09-15T23:54:31.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ab00039f0 0x7f7ac8163d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac8157c10 0x7f7ac81573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac80cb900 0x7f7ac80cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac80cfa00 con 0x7f7ac80cb900 2024-09-15T23:54:31.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac80cf880 con 0x7f7ab00039f0 2024-09-15T23:54:31.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac80cef10 con 0x7f7ac8157c10 2024-09-15T23:54:31.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7accd9a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac80cb900 0x7f7ac80cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7accd9a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac80cb900 0x7f7ac80cbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52208/0 (socket says 172.21.15.112:52208) 2024-09-15T23:54:31.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7accd9a640 1 -- 172.21.15.112:0/2832582516 learned_addr learned my addr 172.21.15.112:0/2832582516 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:31.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ac77fe640 1 --2- 172.21.15.112:0/2832582516 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac8157c10 0x7f7ac81573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ac7fff640 1 --2- 172.21.15.112:0/2832582516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ab00039f0 0x7f7ac8163d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7accd9a640 1 -- 172.21.15.112:0/2832582516 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac8157c10 msgr2=0x7f7ac81573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7accd9a640 1 --2- 172.21.15.112:0/2832582516 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac8157c10 0x7f7ac81573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7accd9a640 1 -- 172.21.15.112:0/2832582516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ab00039f0 msgr2=0x7f7ac8163d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:31.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7accd9a640 1 --2- 172.21.15.112:0/2832582516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ab00039f0 0x7f7ac8163d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:31.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7accd9a640 1 -- 172.21.15.112:0/2832582516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac8164290 con 0x7f7ac80cb900 2024-09-15T23:54:31.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7accd9a640 1 --2- 172.21.15.112:0/2832582516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac80cb900 0x7f7ac80cbd80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7ac808dd40 tx=0x7f7ac000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:31.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ac4ff9640 1 -- 172.21.15.112:0/2832582516 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0004d70 con 0x7f7ac80cb900 2024-09-15T23:54:31.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ac4ff9640 1 -- 172.21.15.112:0/2832582516 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac000bb80 con 0x7f7ac80cb900 2024-09-15T23:54:31.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 -- 172.21.15.112:0/2832582516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac80b93c0 con 0x7f7ac80cb900 2024-09-15T23:54:31.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ac4ff9640 1 -- 172.21.15.112:0/2832582516 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0007070 con 0x7f7ac80cb900 2024-09-15T23:54:31.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.968+0000 7f7ace7fd640 1 -- 172.21.15.112:0/2832582516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac8164810 con 0x7f7ac80cb900 2024-09-15T23:54:31.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.972+0000 7f7ace7fd640 1 -- 172.21.15.112:0/2832582516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac806d6b0 con 0x7f7ac80cb900 2024-09-15T23:54:31.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.972+0000 7f7ac4ff9640 1 -- 172.21.15.112:0/2832582516 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7ac001b020 con 0x7f7ac80cb900 2024-09-15T23:54:31.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.972+0000 7f7ac4ff9640 1 --2- 172.21.15.112:0/2832582516 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7ab40678c0 0x7f7ab4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:31.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.972+0000 7f7ac4ff9640 1 -- 172.21.15.112:0/2832582516 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f7ac00862d0 con 0x7f7ac80cb900 2024-09-15T23:54:31.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.972+0000 7f7ac7fff640 1 --2- 172.21.15.112:0/2832582516 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7ab40678c0 0x7f7ab4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:31.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.972+0000 7f7ac7fff640 1 --2- 172.21.15.112:0/2832582516 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7ab40678c0 0x7f7ab4069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8001750 tx=0x7f7ab80011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:31.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:31.976+0000 7f7ac4ff9640 1 -- 172.21.15.112:0/2832582516 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7ac80d0300 con 0x7f7ac80cb900 2024-09-15T23:54:32.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.136+0000 7f7ace7fd640 1 -- 172.21.15.112:0/2832582516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ac80b43c0 con 0x7f7ac80cb900 2024-09-15T23:54:32.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.140+0000 7f7ac4ff9640 1 -- 172.21.15.112:0/2832582516 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18709 (secure 0 0 0) 0x7f7ac00563b0 con 0x7f7ac80cb900 2024-09-15T23:54:32.144 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:32.145 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":27,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:54:31.432719+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:53:47.908190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:53:49.056283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:53:52.808895+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:32.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.144+0000 7f7ace7fd640 1 -- 172.21.15.112:0/2832582516 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7ab40678c0 msgr2=0x7f7ab4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:32.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.144+0000 7f7ace7fd640 1 --2- 172.21.15.112:0/2832582516 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7ab40678c0 0x7f7ab4069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8001750 tx=0x7f7ab80011a0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.144+0000 7f7ace7fd640 1 -- 172.21.15.112:0/2832582516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac80cb900 msgr2=0x7f7ac80cbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:32.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.144+0000 7f7ace7fd640 1 --2- 172.21.15.112:0/2832582516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac80cb900 0x7f7ac80cbd80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7ac808dd40 tx=0x7f7ac000b4a0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.144+0000 7f7ace7fd640 1 -- 172.21.15.112:0/2832582516 shutdown_connections 2024-09-15T23:54:32.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.144+0000 7f7ace7fd640 1 --2- 172.21.15.112:0/2832582516 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7ab40678c0 0x7f7ab4069d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.144+0000 7f7ace7fd640 1 --2- 172.21.15.112:0/2832582516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ac80cb900 0x7f7ac80cbd80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.144+0000 7f7ace7fd640 1 --2- 172.21.15.112:0/2832582516 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ac8157c10 0x7f7ac81573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.144+0000 7f7ace7fd640 1 --2- 172.21.15.112:0/2832582516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ab00039f0 0x7f7ac8163d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.144+0000 7f7ace7fd640 1 -- 172.21.15.112:0/2832582516 >> 172.21.15.112:0/2832582516 conn(0x7f7ac808bf90 msgr2=0x7f7ac80b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:32.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.144+0000 7f7ace7fd640 1 -- 172.21.15.112:0/2832582516 shutdown_connections 2024-09-15T23:54:32.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.144+0000 7f7ace7fd640 1 -- 172.21.15.112:0/2832582516 wait complete. 2024-09-15T23:54:32.165 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:54:32.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c21252640 1 Processor -- start 2024-09-15T23:54:32.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c21252640 1 -- start start 2024-09-15T23:54:32.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c21252640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c1c15bec0 0x7f2c1c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c21252640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1c0b3290 con 0x7f2c1c15c2a0 2024-09-15T23:54:32.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c21252640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1c0b3570 con 0x7f2c1c0af470 2024-09-15T23:54:32.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c21252640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1c0b3850 con 0x7f2c1c15bec0 2024-09-15T23:54:32.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c1a59c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2c1c15c2a0 0x7f2c1c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45624/0 (socket says 172.21.15.112:45624) 2024-09-15T23:54:32.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c1a59c640 1 -- 172.21.15.112:0/404647462 learned_addr learned my addr 172.21.15.112:0/404647462 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:32.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c1ad9d640 1 --2- 172.21.15.112:0/404647462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c1c15bec0 0x7f2c1c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 -- 172.21.15.112:0/404647462 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999682551 0 0) 0x7f2c1c0b3290 con 0x7f2c1c15c2a0 2024-09-15T23:54:32.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 -- 172.21.15.112:0/404647462 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c04003530 con 0x7f2c1c15c2a0 2024-09-15T23:54:32.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 -- 172.21.15.112:0/404647462 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1324350175 0 0) 0x7f2c04003530 con 0x7f2c1c15c2a0 2024-09-15T23:54:32.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 -- 172.21.15.112:0/404647462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c1c15bec0 msgr2=0x7f2c1c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:32.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 --2- 172.21.15.112:0/404647462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c1c15bec0 0x7f2c1c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 -- 172.21.15.112:0/404647462 >> v1:172.21.15.169:6789/0 conn(0x7f2c1c0af470 legacy=0x7f2c1c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:32.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 -- 172.21.15.112:0/404647462 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1c0b3b30 con 0x7f2c1c15c2a0 2024-09-15T23:54:32.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 -- 172.21.15.112:0/404647462 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f2c0c001680 con 0x7f2c1c15c2a0 2024-09-15T23:54:32.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 -- 172.21.15.112:0/404647462 >> v1:172.21.15.112:6789/0 conn(0x7f2c1c15c2a0 legacy=0x7f2c1c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:32.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 --2- 172.21.15.112:0/404647462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c040039f0 0x7f2c04003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 --2- 172.21.15.112:0/404647462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c04004810 0x7f2c04004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 --2- 172.21.15.112:0/404647462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c1c15bec0 0x7f2c040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 -- 172.21.15.112:0/404647462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c0b3850 con 0x7f2c040039f0 2024-09-15T23:54:32.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 -- 172.21.15.112:0/404647462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0400bab0 con 0x7f2c04004810 2024-09-15T23:54:32.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c19d9b640 1 -- 172.21.15.112:0/404647462 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2c0400bcb0 con 0x7f2c1c15bec0 2024-09-15T23:54:32.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c1ad9d640 1 --2- 172.21.15.112:0/404647462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c040039f0 0x7f2c04003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c1a59c640 1 --2- 172.21.15.112:0/404647462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c04004810 0x7f2c04004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c1b59e640 1 --2- 172.21.15.112:0/404647462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c1c15bec0 0x7f2c040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c1ad9d640 1 -- 172.21.15.112:0/404647462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c1c15bec0 msgr2=0x7f2c040051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:32.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c1ad9d640 1 --2- 172.21.15.112:0/404647462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c1c15bec0 0x7f2c040051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c1ad9d640 1 -- 172.21.15.112:0/404647462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c04004810 msgr2=0x7f2c04004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:32.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c1ad9d640 1 --2- 172.21.15.112:0/404647462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c04004810 0x7f2c04004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.280+0000 7f2c1ad9d640 1 -- 172.21.15.112:0/404647462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c04003530 con 0x7f2c040039f0 2024-09-15T23:54:32.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c1ad9d640 1 --2- 172.21.15.112:0/404647462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c040039f0 0x7f2c04003e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009ab0 tx=0x7f2c1001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c074b95a5c99f7ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:32.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c19d9b640 1 -- 172.21.15.112:0/404647462 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c100b2070 con 0x7f2c040039f0 2024-09-15T23:54:32.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c19d9b640 1 -- 172.21.15.112:0/404647462 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c100a55d0 con 0x7f2c040039f0 2024-09-15T23:54:32.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c19d9b640 1 -- 172.21.15.112:0/404647462 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c100096b0 con 0x7f2c040039f0 2024-09-15T23:54:32.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c21252640 1 -- 172.21.15.112:0/404647462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c040039f0 msgr2=0x7f2c04003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:32.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c21252640 1 --2- 172.21.15.112:0/404647462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c040039f0 0x7f2c04003e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009ab0 tx=0x7f2c1001ca00 comp rx=0 tx=0).stop 2024-09-15T23:54:32.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c1b59e640 1 -- 172.21.15.112:0/404647462 reap_dead start 2024-09-15T23:54:32.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c21252640 1 -- 172.21.15.112:0/404647462 shutdown_connections 2024-09-15T23:54:32.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c21252640 1 -- 172.21.15.112:0/404647462 >> 172.21.15.112:0/404647462 conn(0x7f2c1c0b1f90 msgr2=0x7f2c1c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:32.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c21252640 1 -- 172.21.15.112:0/404647462 shutdown_connections 2024-09-15T23:54:32.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c21252640 1 -- 172.21.15.112:0/404647462 wait complete. 2024-09-15T23:54:32.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c21252640 1 Processor -- start 2024-09-15T23:54:32.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c21252640 1 -- start start 2024-09-15T23:54:32.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c21252640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c040039f0 0x7f2c1c153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c21252640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c1c0b1670 0x7f2c1c0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c21252640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c1c14da90 0x7f2c1c0d0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c21252640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c0ad790 con 0x7f2c1c14da90 2024-09-15T23:54:32.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c21252640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c0ad610 con 0x7f2c1c0b1670 2024-09-15T23:54:32.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.284+0000 7f2c21252640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1c06ef20 con 0x7f2c040039f0 2024-09-15T23:54:32.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c1b59e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c1c14da90 0x7f2c1c0d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c1b59e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c1c14da90 0x7f2c1c0d0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52212/0 (socket says 172.21.15.112:52212) 2024-09-15T23:54:32.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c1b59e640 1 -- 172.21.15.112:0/690282758 learned_addr learned my addr 172.21.15.112:0/690282758 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:32.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c1ad9d640 1 --2- 172.21.15.112:0/690282758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c040039f0 0x7f2c1c153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c1a59c640 1 --2- 172.21.15.112:0/690282758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c1c0b1670 0x7f2c1c0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c1b59e640 1 -- 172.21.15.112:0/690282758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c040039f0 msgr2=0x7f2c1c153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:32.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c1b59e640 1 --2- 172.21.15.112:0/690282758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c040039f0 0x7f2c1c153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c1b59e640 1 -- 172.21.15.112:0/690282758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c1c0b1670 msgr2=0x7f2c1c0cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:32.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c1b59e640 1 --2- 172.21.15.112:0/690282758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c1c0b1670 0x7f2c1c0cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c1b59e640 1 -- 172.21.15.112:0/690282758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1c1f7450 con 0x7f2c1c14da90 2024-09-15T23:54:32.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c1b59e640 1 --2- 172.21.15.112:0/690282758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c1c14da90 0x7f2c1c0d0350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0b5950 tx=0x7f2c1400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:32.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c037fe640 1 -- 172.21.15.112:0/690282758 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c14018070 con 0x7f2c1c14da90 2024-09-15T23:54:32.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c037fe640 1 -- 172.21.15.112:0/690282758 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c14003b80 con 0x7f2c1c14da90 2024-09-15T23:54:32.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c21252640 1 -- 172.21.15.112:0/690282758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1c072990 con 0x7f2c1c14da90 2024-09-15T23:54:32.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c037fe640 1 -- 172.21.15.112:0/690282758 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c14005070 con 0x7f2c1c14da90 2024-09-15T23:54:32.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c21252640 1 -- 172.21.15.112:0/690282758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1c072f50 con 0x7f2c1c14da90 2024-09-15T23:54:32.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c21252640 1 -- 172.21.15.112:0/690282758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1c06e000 con 0x7f2c1c14da90 2024-09-15T23:54:32.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c037fe640 1 -- 172.21.15.112:0/690282758 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2c1401b070 con 0x7f2c1c14da90 2024-09-15T23:54:32.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c037fe640 1 --2- 172.21.15.112:0/690282758 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2c080678f0 0x7f2c08069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c037fe640 1 -- 172.21.15.112:0/690282758 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f2c14085690 con 0x7f2c1c14da90 2024-09-15T23:54:32.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c1ad9d640 1 --2- 172.21.15.112:0/690282758 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2c080678f0 0x7f2c08069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.288+0000 7f2c1ad9d640 1 --2- 172.21.15.112:0/690282758 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2c080678f0 0x7f2c08069db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2c100af000 tx=0x7f2c100046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:32.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.292+0000 7f2c037fe640 1 -- 172.21.15.112:0/690282758 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2c14055e50 con 0x7f2c1c14da90 2024-09-15T23:54:32.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.492+0000 7f2c21252640 1 -- 172.21.15.112:0/690282758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2c1c075780 con 0x7f2c1c14da90 2024-09-15T23:54:32.497 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-15T23:54:32.492+0000 7fae14e39640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:54:32.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.496+0000 7f2c037fe640 1 -- 172.21.15.112:0/690282758 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f2c14055750 con 0x7f2c1c14da90 2024-09-15T23:54:32.501 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:54:32.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.500+0000 7f2c21252640 1 -- 172.21.15.112:0/690282758 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2c080678f0 msgr2=0x7f2c08069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:32.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.500+0000 7f2c21252640 1 --2- 172.21.15.112:0/690282758 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2c080678f0 0x7f2c08069db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2c100af000 tx=0x7f2c100046d0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.500+0000 7f2c21252640 1 -- 172.21.15.112:0/690282758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c1c14da90 msgr2=0x7f2c1c0d0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:32.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.500+0000 7f2c21252640 1 --2- 172.21.15.112:0/690282758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c1c14da90 0x7f2c1c0d0350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0b5950 tx=0x7f2c1400dc00 comp rx=0 tx=0).stop 2024-09-15T23:54:32.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.500+0000 7f2c21252640 1 -- 172.21.15.112:0/690282758 shutdown_connections 2024-09-15T23:54:32.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.500+0000 7f2c21252640 1 --2- 172.21.15.112:0/690282758 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2c080678f0 0x7f2c08069db0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.500+0000 7f2c21252640 1 --2- 172.21.15.112:0/690282758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c1c14da90 0x7f2c1c0d0350 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.500+0000 7f2c21252640 1 --2- 172.21.15.112:0/690282758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c1c0b1670 0x7f2c1c0cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.500+0000 7f2c21252640 1 --2- 172.21.15.112:0/690282758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c040039f0 0x7f2c1c153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.500+0000 7f2c21252640 1 -- 172.21.15.112:0/690282758 >> 172.21.15.112:0/690282758 conn(0x7f2c1c0b1f90 msgr2=0x7f2c1c155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:32.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.500+0000 7f2c21252640 1 -- 172.21.15.112:0/690282758 shutdown_connections 2024-09-15T23:54:32.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.500+0000 7f2c21252640 1 -- 172.21.15.112:0/690282758 wait complete. 2024-09-15T23:54:32.518 INFO:tasks.ceph.mds.d.smithi169.stderr: -3366> 2024-09-15T23:53:55.671+0000 7f2e36445640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:54:32.521 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:54:32.567 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.636+0000 7f663bae8640 1 Processor -- start 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.636+0000 7f663bae8640 1 -- start start 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f663bae8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6634161a60 0x7f66340d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f663bae8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66340d2e90 0x7f66340cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f663bae8640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f66340cf450 0x7f66340d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f663bae8640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f66340d32b0 con 0x7f6634161a60 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f663bae8640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f66340d0300 con 0x7f66340cf450 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f663bae8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f66340b0f60 con 0x7f66340d2e90 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f6639884640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6634161a60 0x7f66340d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f6639884640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6634161a60 0x7f66340d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52228/0 (socket says 172.21.15.112:52228) 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f6639884640 1 -- 172.21.15.112:0/1460511858 learned_addr learned my addr 172.21.15.112:0/1460511858 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f6639083640 1 --2- 172.21.15.112:0/1460511858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66340d2e90 0x7f66340cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f6639884640 1 -- 172.21.15.112:0/1460511858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66340d2e90 msgr2=0x7f66340cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f6639884640 1 --2- 172.21.15.112:0/1460511858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66340d2e90 0x7f66340cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f6639884640 1 -- 172.21.15.112:0/1460511858 >> v2:172.21.15.169:3300/0 conn(0x7f66340cf450 msgr2=0x7f66340d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f663a085640 1 --2- 172.21.15.112:0/1460511858 >> v2:172.21.15.169:3300/0 conn(0x7f66340cf450 0x7f66340d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f6639884640 1 --2- 172.21.15.112:0/1460511858 >> v2:172.21.15.169:3300/0 conn(0x7f66340cf450 0x7f66340d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f6639884640 1 -- 172.21.15.112:0/1460511858 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66340cfd40 con 0x7f6634161a60 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f6639884640 1 --2- 172.21.15.112:0/1460511858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6634161a60 0x7f66340d2950 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f66340d23a0 tx=0x7f663001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e87e0fdbba0767 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f6638882640 1 -- 172.21.15.112:0/1460511858 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66300ab620 con 0x7f6634161a60 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f6638882640 1 -- 172.21.15.112:0/1460511858 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66300b0070 con 0x7f6634161a60 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.640+0000 7f6638882640 1 -- 172.21.15.112:0/1460511858 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66300ab9e0 con 0x7f6634161a60 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 -- 172.21.15.112:0/1460511858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6634161a60 msgr2=0x7f66340d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 --2- 172.21.15.112:0/1460511858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6634161a60 0x7f66340d2950 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f66340d23a0 tx=0x7f663001c460 comp rx=0 tx=0).stop 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 -- 172.21.15.112:0/1460511858 shutdown_connections 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 --2- 172.21.15.112:0/1460511858 >> v2:172.21.15.169:3300/0 conn(0x7f66340cf450 0x7f66340d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 --2- 172.21.15.112:0/1460511858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66340d2e90 0x7f66340cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 --2- 172.21.15.112:0/1460511858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6634161a60 0x7f66340d2950 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 -- 172.21.15.112:0/1460511858 >> 172.21.15.112:0/1460511858 conn(0x7f663408bf90 msgr2=0x7f663409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 -- 172.21.15.112:0/1460511858 shutdown_connections 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 -- 172.21.15.112:0/1460511858 wait complete. 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 Processor -- start 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 -- start start 2024-09-15T23:54:32.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66340cf450 0x7f6634150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66340d2e90 0x7f66341502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6634161a60 0x7f66341507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f663406d830 con 0x7f6634161a60 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f663406d6b0 con 0x7f66340d2e90 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f663406d9b0 con 0x7f66340cf450 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663a085640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6634161a60 0x7f66341507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663a085640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6634161a60 0x7f66341507e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52242/0 (socket says 172.21.15.112:52242) 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663a085640 1 -- 172.21.15.112:0/1724141220 learned_addr learned my addr 172.21.15.112:0/1724141220 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f6639083640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66340d2e90 0x7f66341502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f6639884640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66340cf450 0x7f6634150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663a085640 1 -- 172.21.15.112:0/1724141220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66340cf450 msgr2=0x7f6634150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663a085640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66340cf450 0x7f6634150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663a085640 1 -- 172.21.15.112:0/1724141220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66340d2e90 msgr2=0x7f66341502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663a085640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66340d2e90 0x7f66341502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663a085640 1 -- 172.21.15.112:0/1724141220 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66340cca40 con 0x7f6634161a60 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f6639083640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66340d2e90 0x7f66341502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663a085640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6634161a60 0x7f66341507e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f662c00cd20 tx=0x7f662c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f662a7fc640 1 -- 172.21.15.112:0/1724141220 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c003ba0 con 0x7f6634161a60 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f662a7fc640 1 -- 172.21.15.112:0/1724141220 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f662c003d40 con 0x7f6634161a60 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 -- 172.21.15.112:0/1724141220 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66340ccd20 con 0x7f6634161a60 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f662a7fc640 1 -- 172.21.15.112:0/1724141220 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c004240 con 0x7f6634161a60 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 -- 172.21.15.112:0/1724141220 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66341591a0 con 0x7f6634161a60 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.644+0000 7f663bae8640 1 -- 172.21.15.112:0/1724141220 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66340cef10 con 0x7f6634161a60 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.648+0000 7f662a7fc640 1 -- 172.21.15.112:0/1724141220 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f662c0043e0 con 0x7f6634161a60 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.648+0000 7f662a7fc640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66180678c0 0x7f6618069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.648+0000 7f6639884640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66180678c0 0x7f6618069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.648+0000 7f662a7fc640 1 -- 172.21.15.112:0/1724141220 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6676+0+0 (secure 0 0 0) 0x7f662c086e30 con 0x7f6634161a60 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.648+0000 7f6639884640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66180678c0 0x7f6618069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f66300af000 tx=0x7f66300a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:32.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.652+0000 7f662a7fc640 1 -- 172.21.15.112:0/1724141220 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f662c057710 con 0x7f6634161a60 2024-09-15T23:54:32.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:32.828+0000 7f663bae8640 1 -- 172.21.15.112:0/1724141220 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f66340b37e0 con 0x7f6634161a60 2024-09-15T23:54:33.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.504+0000 7f662a7fc640 1 -- 172.21.15.112:0/1724141220 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f662c057010 con 0x7f6634161a60 2024-09-15T23:54:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.508+0000 7f663bae8640 1 -- 172.21.15.112:0/1724141220 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66180678c0 msgr2=0x7f6618069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.508+0000 7f663bae8640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66180678c0 0x7f6618069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f66300af000 tx=0x7f66300a7000 comp rx=0 tx=0).stop 2024-09-15T23:54:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.508+0000 7f663bae8640 1 -- 172.21.15.112:0/1724141220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6634161a60 msgr2=0x7f66341507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.508+0000 7f663bae8640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6634161a60 0x7f66341507e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f662c00cd20 tx=0x7f662c00a660 comp rx=0 tx=0).stop 2024-09-15T23:54:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.508+0000 7f663bae8640 1 -- 172.21.15.112:0/1724141220 shutdown_connections 2024-09-15T23:54:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.508+0000 7f663bae8640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66180678c0 0x7f6618069d80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.508+0000 7f663bae8640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6634161a60 0x7f66341507e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.508+0000 7f663bae8640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66340d2e90 0x7f66341502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.508+0000 7f663bae8640 1 --2- 172.21.15.112:0/1724141220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f66340cf450 0x7f6634150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:33.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.508+0000 7f663bae8640 1 -- 172.21.15.112:0/1724141220 >> 172.21.15.112:0/1724141220 conn(0x7f663408bf90 msgr2=0x7f66340d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:33.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.508+0000 7f663bae8640 1 -- 172.21.15.112:0/1724141220 shutdown_connections 2024-09-15T23:54:33.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.508+0000 7f663bae8640 1 -- 172.21.15.112:0/1724141220 wait complete. 2024-09-15T23:54:33.544 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:54:33.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.668+0000 7f34e3873640 1 Processor -- start 2024-09-15T23:54:33.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.668+0000 7f34e3873640 1 -- start start 2024-09-15T23:54:33.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.668+0000 7f34e3873640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f34dc15bec0 0x7f34dc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:33.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.668+0000 7f34e3873640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34dc15c2a0 0x7f34dc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:33.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.668+0000 7f34e3873640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34dc0b3290 con 0x7f34dc0af2a0 2024-09-15T23:54:33.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.668+0000 7f34e3873640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f34dc0b3570 con 0x7f34dc15c2a0 2024-09-15T23:54:33.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.668+0000 7f34e3873640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f34dc0b3850 con 0x7f34dc15bec0 2024-09-15T23:54:33.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e0e0e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34dc15c2a0 0x7f34dc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:33.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e0e0e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34dc15c2a0 0x7f34dc0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52250/0 (socket says 172.21.15.112:52250) 2024-09-15T23:54:33.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e0e0e640 1 -- 172.21.15.112:0/3806064347 learned_addr learned my addr 172.21.15.112:0/3806064347 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:33.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e160f640 1 --2- 172.21.15.112:0/3806064347 >> v2:172.21.15.169:3300/0 conn(0x7f34dc15bec0 0x7f34dc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:33.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e0e0e640 1 -- 172.21.15.112:0/3806064347 >> v2:172.21.15.169:3300/0 conn(0x7f34dc15bec0 msgr2=0x7f34dc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:33.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e0e0e640 1 --2- 172.21.15.112:0/3806064347 >> v2:172.21.15.169:3300/0 conn(0x7f34dc15bec0 0x7f34dc0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:33.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e0e0e640 1 -- 172.21.15.112:0/3806064347 >> v1:172.21.15.169:6789/0 conn(0x7f34dc0af2a0 legacy=0x7f34dc15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:33.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e0e0e640 1 -- 172.21.15.112:0/3806064347 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34dc0b3b30 con 0x7f34dc15c2a0 2024-09-15T23:54:33.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e0e0e640 1 --2- 172.21.15.112:0/3806064347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34dc15c2a0 0x7f34dc0aed60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f34dc071710 tx=0x7f34cc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584bb2f94278c9ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:33.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34d3fff640 1 -- 172.21.15.112:0/3806064347 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0aa650 con 0x7f34dc15c2a0 2024-09-15T23:54:33.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34d3fff640 1 -- 172.21.15.112:0/3806064347 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34cc0af070 con 0x7f34dc15c2a0 2024-09-15T23:54:33.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34d3fff640 1 -- 172.21.15.112:0/3806064347 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0aaa10 con 0x7f34dc15c2a0 2024-09-15T23:54:33.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e3873640 1 -- 172.21.15.112:0/3806064347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34dc15c2a0 msgr2=0x7f34dc0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:33.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e3873640 1 --2- 172.21.15.112:0/3806064347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34dc15c2a0 0x7f34dc0aed60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f34dc071710 tx=0x7f34cc01c4f0 comp rx=0 tx=0).stop 2024-09-15T23:54:33.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e3873640 1 -- 172.21.15.112:0/3806064347 shutdown_connections 2024-09-15T23:54:33.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e3873640 1 --2- 172.21.15.112:0/3806064347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34dc15c2a0 0x7f34dc0aed60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:33.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e3873640 1 --2- 172.21.15.112:0/3806064347 >> v2:172.21.15.169:3300/0 conn(0x7f34dc15bec0 0x7f34dc0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:33.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e3873640 1 -- 172.21.15.112:0/3806064347 >> 172.21.15.112:0/3806064347 conn(0x7f34dc0b1f90 msgr2=0x7f34dc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:33.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e3873640 1 -- 172.21.15.112:0/3806064347 shutdown_connections 2024-09-15T23:54:33.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.672+0000 7f34e3873640 1 -- 172.21.15.112:0/3806064347 wait complete. 2024-09-15T23:54:33.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e3873640 1 Processor -- start 2024-09-15T23:54:33.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e3873640 1 -- start start 2024-09-15T23:54:33.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e3873640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34dc0af2a0 0x7f34dc150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:33.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e3873640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34dc15bec0 0x7f34dc15db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:33.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e3873640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34dc15c2a0 0x7f34dc072d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:33.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e3873640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc0af6b0 con 0x7f34dc15bec0 2024-09-15T23:54:33.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e3873640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc0ad740 con 0x7f34dc15c2a0 2024-09-15T23:54:33.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e3873640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f34dc169000 con 0x7f34dc0af2a0 2024-09-15T23:54:33.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e0e0e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34dc15bec0 0x7f34dc15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:33.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e0e0e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34dc15bec0 0x7f34dc15db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52262/0 (socket says 172.21.15.112:52262) 2024-09-15T23:54:33.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e0e0e640 1 -- 172.21.15.112:0/3377204209 learned_addr learned my addr 172.21.15.112:0/3377204209 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:33.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e160f640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34dc0af2a0 0x7f34dc150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:33.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e0e0e640 1 -- 172.21.15.112:0/3377204209 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34dc0af2a0 msgr2=0x7f34dc150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:33.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e1e10640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34dc15c2a0 0x7f34dc072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:33.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e0e0e640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34dc0af2a0 0x7f34dc150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:33.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e0e0e640 1 -- 172.21.15.112:0/3377204209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34dc15c2a0 msgr2=0x7f34dc072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:33.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e0e0e640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34dc15c2a0 0x7f34dc072d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:33.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e0e0e640 1 -- 172.21.15.112:0/3377204209 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34dc15e3d0 con 0x7f34dc15bec0 2024-09-15T23:54:33.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e160f640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34dc0af2a0 0x7f34dc150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:33.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e0e0e640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34dc15bec0 0x7f34dc15db80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0ac040 tx=0x7f34cc019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:33.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34d1ffb640 1 -- 172.21.15.112:0/3377204209 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0be610 con 0x7f34dc15bec0 2024-09-15T23:54:33.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34d1ffb640 1 -- 172.21.15.112:0/3377204209 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34cc0a6040 con 0x7f34dc15bec0 2024-09-15T23:54:33.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e3873640 1 -- 172.21.15.112:0/3377204209 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34dc15e6b0 con 0x7f34dc15bec0 2024-09-15T23:54:33.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34d1ffb640 1 -- 172.21.15.112:0/3377204209 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0be9f0 con 0x7f34dc15bec0 2024-09-15T23:54:33.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e3873640 1 -- 172.21.15.112:0/3377204209 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34dc15ec70 con 0x7f34dc15bec0 2024-09-15T23:54:33.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34e3873640 1 -- 172.21.15.112:0/3377204209 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34dc0ad200 con 0x7f34dc15bec0 2024-09-15T23:54:33.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.676+0000 7f34d1ffb640 1 -- 172.21.15.112:0/3377204209 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f34cc0bc020 con 0x7f34dc15bec0 2024-09-15T23:54:33.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.680+0000 7f34d1ffb640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34c00678c0 0x7f34c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:33.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.680+0000 7f34d1ffb640 1 -- 172.21.15.112:0/3377204209 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6676+0+0 (secure 0 0 0) 0x7f34cc120950 con 0x7f34dc15bec0 2024-09-15T23:54:33.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.680+0000 7f34e160f640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34c00678c0 0x7f34c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:33.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.680+0000 7f34e160f640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34c00678c0 0x7f34c0069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f34d4007520 tx=0x7f34d400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:33.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.684+0000 7f34d1ffb640 1 -- 172.21.15.112:0/3377204209 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f34cc0c3060 con 0x7f34dc15bec0 2024-09-15T23:54:33.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:33.844+0000 7f34e3873640 1 -- 172.21.15.112:0/3377204209 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f34dc06fcd0 con 0x7f34dc15bec0 2024-09-15T23:54:34.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.508+0000 7f34d1ffb640 1 -- 172.21.15.112:0/3377204209 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7f34cc016110 con 0x7f34dc15bec0 2024-09-15T23:54:34.511 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:54:34.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.512+0000 7f34e3873640 1 -- 172.21.15.112:0/3377204209 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34c00678c0 msgr2=0x7f34c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:34.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.512+0000 7f34e3873640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34c00678c0 0x7f34c0069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f34d4007520 tx=0x7f34d400b040 comp rx=0 tx=0).stop 2024-09-15T23:54:34.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.512+0000 7f34e3873640 1 -- 172.21.15.112:0/3377204209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34dc15bec0 msgr2=0x7f34dc15db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:34.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.512+0000 7f34e3873640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34dc15bec0 0x7f34dc15db80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0ac040 tx=0x7f34cc019290 comp rx=0 tx=0).stop 2024-09-15T23:54:34.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.512+0000 7f34e3873640 1 -- 172.21.15.112:0/3377204209 shutdown_connections 2024-09-15T23:54:34.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.512+0000 7f34e3873640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34c00678c0 0x7f34c0069d80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:34.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.512+0000 7f34e3873640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34dc15c2a0 0x7f34dc072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:34.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.512+0000 7f34e3873640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34dc15bec0 0x7f34dc15db80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:34.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.512+0000 7f34e3873640 1 --2- 172.21.15.112:0/3377204209 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34dc0af2a0 0x7f34dc150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:34.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.512+0000 7f34e3873640 1 -- 172.21.15.112:0/3377204209 >> 172.21.15.112:0/3377204209 conn(0x7f34dc0b1f90 msgr2=0x7f34dc0b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:34.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.512+0000 7f34e3873640 1 -- 172.21.15.112:0/3377204209 shutdown_connections 2024-09-15T23:54:34.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.512+0000 7f34e3873640 1 -- 172.21.15.112:0/3377204209 wait complete. 2024-09-15T23:54:34.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:54:34.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.668+0000 7f2cc3f2e640 1 Processor -- start 2024-09-15T23:54:34.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.668+0000 7f2cc3f2e640 1 -- start start 2024-09-15T23:54:34.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.668+0000 7f2cc3f2e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cbc144d60 0x7f2cbc070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:34.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc3f2e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2cbc0b4090 0x7f2cbc0b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:34.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc3f2e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cbc071030 con 0x7f2cbc0b4ba0 2024-09-15T23:54:34.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc3f2e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2cbc070660 con 0x7f2cbc0b4090 2024-09-15T23:54:34.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc3f2e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2cbc06fa50 con 0x7f2cbc144d60 2024-09-15T23:54:34.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc14c9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2cbc0b4090 0x7f2cbc0b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:34.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc1cca640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cbc144d60 0x7f2cbc070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:34.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc14c9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2cbc0b4090 0x7f2cbc0b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:46248/0 (socket says 172.21.15.112:46248) 2024-09-15T23:54:34.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc14c9640 1 -- 172.21.15.112:0/563050731 learned_addr learned my addr 172.21.15.112:0/563050731 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:34.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc24cb640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f2cbc0b4ba0 0x7f2cbc0ae610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:55294/0 (socket says 172.21.15.112:55294) 2024-09-15T23:54:34.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc1cca640 1 -- 172.21.15.112:0/563050731 >> v2:172.21.15.169:3300/0 conn(0x7f2cbc0b4090 msgr2=0x7f2cbc0b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:34.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc1cca640 1 --2- 172.21.15.112:0/563050731 >> v2:172.21.15.169:3300/0 conn(0x7f2cbc0b4090 0x7f2cbc0b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:34.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc1cca640 1 -- 172.21.15.112:0/563050731 >> v1:172.21.15.169:6789/0 conn(0x7f2cbc0b4ba0 legacy=0x7f2cbc0ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:34.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc1cca640 1 -- 172.21.15.112:0/563050731 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cbc06fd30 con 0x7f2cbc144d60 2024-09-15T23:54:34.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc14c9640 1 --2- 172.21.15.112:0/563050731 >> v2:172.21.15.169:3300/0 conn(0x7f2cbc0b4090 0x7f2cbc0b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:54:34.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.672+0000 7f2cc1cca640 1 --2- 172.21.15.112:0/563050731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cbc144d60 0x7f2cbc070af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0097c0 tx=0x7f2cac01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ecb4bdfee97effd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:34.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc0cc8640 1 -- 172.21.15.112:0/563050731 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0b0070 con 0x7f2cbc144d60 2024-09-15T23:54:34.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc0cc8640 1 -- 172.21.15.112:0/563050731 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cac0ab600 con 0x7f2cbc144d60 2024-09-15T23:54:34.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc0cc8640 1 -- 172.21.15.112:0/563050731 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0ab9d0 con 0x7f2cbc144d60 2024-09-15T23:54:34.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/563050731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cbc144d60 msgr2=0x7f2cbc070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:34.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 --2- 172.21.15.112:0/563050731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cbc144d60 0x7f2cbc070af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0097c0 tx=0x7f2cac01c4a0 comp rx=0 tx=0).stop 2024-09-15T23:54:34.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/563050731 shutdown_connections 2024-09-15T23:54:34.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 --2- 172.21.15.112:0/563050731 >> v2:172.21.15.169:3300/0 conn(0x7f2cbc0b4090 0x7f2cbc0b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:34.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 --2- 172.21.15.112:0/563050731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cbc144d60 0x7f2cbc070af0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:34.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/563050731 >> 172.21.15.112:0/563050731 conn(0x7f2cbc09aa00 msgr2=0x7f2cbc0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:34.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/563050731 shutdown_connections 2024-09-15T23:54:34.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/563050731 wait complete. 2024-09-15T23:54:34.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 Processor -- start 2024-09-15T23:54:34.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 -- start start 2024-09-15T23:54:34.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cbc0b4090 0x7f2cbc13dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:34.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cbc0b4ba0 0x7f2cbc15b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:34.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2cbc144d60 0x7f2cbc0b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:34.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc0b6fd0 con 0x7f2cbc0b4090 2024-09-15T23:54:34.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc0b6e50 con 0x7f2cbc144d60 2024-09-15T23:54:34.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc3f2e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2cbc0af130 con 0x7f2cbc0b4ba0 2024-09-15T23:54:34.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc1cca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cbc0b4090 0x7f2cbc13dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:34.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc1cca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cbc0b4090 0x7f2cbc13dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52278/0 (socket says 172.21.15.112:52278) 2024-09-15T23:54:34.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.676+0000 7f2cc1cca640 1 -- 172.21.15.112:0/2692512127 learned_addr learned my addr 172.21.15.112:0/2692512127 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:34.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cc24cb640 1 --2- 172.21.15.112:0/2692512127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2cbc144d60 0x7f2cbc0b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:34.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cc14c9640 1 --2- 172.21.15.112:0/2692512127 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cbc0b4ba0 0x7f2cbc15b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:34.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cc1cca640 1 -- 172.21.15.112:0/2692512127 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cbc0b4ba0 msgr2=0x7f2cbc15b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:34.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cc1cca640 1 --2- 172.21.15.112:0/2692512127 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cbc0b4ba0 0x7f2cbc15b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:34.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cc1cca640 1 -- 172.21.15.112:0/2692512127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2cbc144d60 msgr2=0x7f2cbc0b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:34.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cc1cca640 1 --2- 172.21.15.112:0/2692512127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2cbc144d60 0x7f2cbc0b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:34.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cc1cca640 1 -- 172.21.15.112:0/2692512127 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cbc15c170 con 0x7f2cbc0b4090 2024-09-15T23:54:34.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cc1cca640 1 --2- 172.21.15.112:0/2692512127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cbc0b4090 0x7f2cbc13dd10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2cac01a0d0 tx=0x7f2cac019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:34.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cba7fc640 1 -- 172.21.15.112:0/2692512127 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0b0040 con 0x7f2cbc0b4090 2024-09-15T23:54:34.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cba7fc640 1 -- 172.21.15.112:0/2692512127 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cac0ab400 con 0x7f2cbc0b4090 2024-09-15T23:54:34.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/2692512127 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cbc15c450 con 0x7f2cbc0b4090 2024-09-15T23:54:34.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cba7fc640 1 -- 172.21.15.112:0/2692512127 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac006e20 con 0x7f2cbc0b4090 2024-09-15T23:54:34.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/2692512127 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cbc15ca10 con 0x7f2cbc0b4090 2024-09-15T23:54:34.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/2692512127 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cbc0b44d0 con 0x7f2cbc0b4090 2024-09-15T23:54:34.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cba7fc640 1 -- 172.21.15.112:0/2692512127 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2cac0c0020 con 0x7f2cbc0b4090 2024-09-15T23:54:34.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cba7fc640 1 --2- 172.21.15.112:0/2692512127 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2ca80678c0 0x7f2ca8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:34.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cc14c9640 1 --2- 172.21.15.112:0/2692512127 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2ca80678c0 0x7f2ca8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:34.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cba7fc640 1 -- 172.21.15.112:0/2692512127 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6238+0+0 (secure 0 0 0) 0x7f2cac11fd20 con 0x7f2cbc0b4090 2024-09-15T23:54:34.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.680+0000 7f2cc14c9640 1 --2- 172.21.15.112:0/2692512127 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2ca80678c0 0x7f2ca8069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc13f510 tx=0x7f2cb000d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:34.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.688+0000 7f2cba7fc640 1 -- 172.21.15.112:0/2692512127 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2cac0c7020 con 0x7f2cbc0b4090 2024-09-15T23:54:34.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:34.856+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/2692512127 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2cbc164150 con 0x7f2cbc0b4090 2024-09-15T23:54:35.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.516+0000 7f2cba7fc640 1 -- 172.21.15.112:0/2692512127 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7f2cac016090 con 0x7f2cbc0b4090 2024-09-15T23:54:35.519 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-15T23:54:35.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.524+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/2692512127 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2ca80678c0 msgr2=0x7f2ca8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:35.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.524+0000 7f2cc3f2e640 1 --2- 172.21.15.112:0/2692512127 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2ca80678c0 0x7f2ca8069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc13f510 tx=0x7f2cb000d040 comp rx=0 tx=0).stop 2024-09-15T23:54:35.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.524+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/2692512127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cbc0b4090 msgr2=0x7f2cbc13dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:35.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.524+0000 7f2cc3f2e640 1 --2- 172.21.15.112:0/2692512127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cbc0b4090 0x7f2cbc13dd10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2cac01a0d0 tx=0x7f2cac019240 comp rx=0 tx=0).stop 2024-09-15T23:54:35.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.524+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/2692512127 shutdown_connections 2024-09-15T23:54:35.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.524+0000 7f2cc3f2e640 1 --2- 172.21.15.112:0/2692512127 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2ca80678c0 0x7f2ca8069d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:35.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.524+0000 7f2cc3f2e640 1 --2- 172.21.15.112:0/2692512127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2cbc144d60 0x7f2cbc0b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:35.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.524+0000 7f2cc3f2e640 1 --2- 172.21.15.112:0/2692512127 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2cbc0b4ba0 0x7f2cbc15b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:35.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.524+0000 7f2cc3f2e640 1 --2- 172.21.15.112:0/2692512127 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cbc0b4090 0x7f2cbc13dd10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:35.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.524+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/2692512127 >> 172.21.15.112:0/2692512127 conn(0x7f2cbc09aa00 msgr2=0x7f2cbc074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:35.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.524+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/2692512127 shutdown_connections 2024-09-15T23:54:35.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.524+0000 7f2cc3f2e640 1 -- 172.21.15.112:0/2692512127 wait complete. 2024-09-15T23:54:35.551 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-15T23:54:35.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8d7933640 1 Processor -- start 2024-09-15T23:54:35.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8d7933640 1 -- start start 2024-09-15T23:54:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8d7933640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc8d015f3a0 0x7fc8d0165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8d7933640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8d00aede0 con 0x7fc8d0070020 2024-09-15T23:54:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8d7933640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8d015fa10 con 0x7fc8d01520a0 2024-09-15T23:54:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8d7933640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc8d0152480 con 0x7fc8d015f3a0 2024-09-15T23:54:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8d4ece640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc8d0070020 0x7fc8d015ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45640/0 (socket says 172.21.15.112:45640) 2024-09-15T23:54:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8d4ece640 1 -- 172.21.15.112:0/775019048 learned_addr learned my addr 172.21.15.112:0/775019048 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8d5ed0640 1 --2- 172.21.15.112:0/775019048 >> v2:172.21.15.169:3300/0 conn(0x7fc8d015f3a0 0x7fc8d0165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8cffff640 1 -- 172.21.15.112:0/775019048 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404254953 0 0) 0x7fc8d00aede0 con 0x7fc8d0070020 2024-09-15T23:54:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8cffff640 1 -- 172.21.15.112:0/775019048 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8b8003530 con 0x7fc8d0070020 2024-09-15T23:54:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8cffff640 1 -- 172.21.15.112:0/775019048 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 408317981 0 0) 0x7fc8b8003530 con 0x7fc8d0070020 2024-09-15T23:54:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8cffff640 1 -- 172.21.15.112:0/775019048 >> v2:172.21.15.169:3300/0 conn(0x7fc8d015f3a0 msgr2=0x7fc8d0165f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:35.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8cffff640 1 --2- 172.21.15.112:0/775019048 >> v2:172.21.15.169:3300/0 conn(0x7fc8d015f3a0 0x7fc8d0165f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.672+0000 7fc8cffff640 1 -- 172.21.15.112:0/775019048 >> v1:172.21.15.169:6789/0 conn(0x7fc8d01520a0 legacy=0x7fc8d006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8cffff640 1 -- 172.21.15.112:0/775019048 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d0074250 con 0x7fc8d0070020 2024-09-15T23:54:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8cffff640 1 -- 172.21.15.112:0/775019048 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fc8c4001a00 con 0x7fc8d0070020 2024-09-15T23:54:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8cffff640 1 -- 172.21.15.112:0/775019048 >> v1:172.21.15.112:6789/0 conn(0x7fc8d0070020 legacy=0x7fc8d015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8cffff640 1 --2- 172.21.15.112:0/775019048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8b80039c0 0x7fc8b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8cffff640 1 --2- 172.21.15.112:0/775019048 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8b8004810 0x7fc8b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8cffff640 1 --2- 172.21.15.112:0/775019048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8b80051d0 0x7fc8b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8cffff640 1 -- 172.21.15.112:0/775019048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b800c040 con 0x7fc8b80051d0 2024-09-15T23:54:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8cffff640 1 -- 172.21.15.112:0/775019048 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b800c1f0 con 0x7fc8b80039c0 2024-09-15T23:54:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8cffff640 1 -- 172.21.15.112:0/775019048 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b800c3f0 con 0x7fc8b8004810 2024-09-15T23:54:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d5ed0640 1 --2- 172.21.15.112:0/775019048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8b80051d0 0x7fc8b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:35.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d5ed0640 1 -- 172.21.15.112:0/775019048 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8b8004810 msgr2=0x7fc8b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d4ece640 1 --2- 172.21.15.112:0/775019048 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8b8004810 0x7fc8b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d5ed0640 1 --2- 172.21.15.112:0/775019048 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8b8004810 0x7fc8b8004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d56cf640 1 --2- 172.21.15.112:0/775019048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8b80039c0 0x7fc8b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d5ed0640 1 -- 172.21.15.112:0/775019048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8b80039c0 msgr2=0x7fc8b8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d5ed0640 1 --2- 172.21.15.112:0/775019048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8b80039c0 0x7fc8b8003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d5ed0640 1 -- 172.21.15.112:0/775019048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b8003530 con 0x7fc8b80051d0 2024-09-15T23:54:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d5ed0640 1 -- 172.21.15.112:0/775019048 reap_dead start 2024-09-15T23:54:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d5ed0640 1 --2- 172.21.15.112:0/775019048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8b80051d0 0x7fc8b800b9d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009ae0 tx=0x7fc8c001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6aad66439359f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8cffff640 1 -- 172.21.15.112:0/775019048 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c00096b0 con 0x7fc8b80051d0 2024-09-15T23:54:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8cffff640 1 -- 172.21.15.112:0/775019048 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c0004020 con 0x7fc8b80051d0 2024-09-15T23:54:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8cffff640 1 -- 172.21.15.112:0/775019048 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0004410 con 0x7fc8b80051d0 2024-09-15T23:54:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d7933640 1 -- 172.21.15.112:0/775019048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8b80051d0 msgr2=0x7fc8b800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d7933640 1 --2- 172.21.15.112:0/775019048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8b80051d0 0x7fc8b800b9d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009ae0 tx=0x7fc8c001cab0 comp rx=0 tx=0).stop 2024-09-15T23:54:35.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d7933640 1 -- 172.21.15.112:0/775019048 shutdown_connections 2024-09-15T23:54:35.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d7933640 1 --2- 172.21.15.112:0/775019048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8b80051d0 0x7fc8b800b9d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:35.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d7933640 1 -- 172.21.15.112:0/775019048 >> 172.21.15.112:0/775019048 conn(0x7fc8d00b1f90 msgr2=0x7fc8d00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:35.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d7933640 1 -- 172.21.15.112:0/775019048 shutdown_connections 2024-09-15T23:54:35.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.676+0000 7fc8d7933640 1 -- 172.21.15.112:0/775019048 wait complete. 2024-09-15T23:54:35.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d7933640 1 Processor -- start 2024-09-15T23:54:35.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d7933640 1 -- start start 2024-09-15T23:54:35.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d7933640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8b80051d0 0x7fc8d0147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:35.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d7933640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8d015c910 0x7fc8d01f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:35.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d7933640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8d015cd90 0x7fc8d01f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:35.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d7933640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d0073770 con 0x7fc8b80051d0 2024-09-15T23:54:35.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d7933640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d015f850 con 0x7fc8d015c910 2024-09-15T23:54:35.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d7933640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d0073a50 con 0x7fc8d015cd90 2024-09-15T23:54:35.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d56cf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8b80051d0 0x7fc8d0147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:35.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d56cf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8b80051d0 0x7fc8d0147500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52294/0 (socket says 172.21.15.112:52294) 2024-09-15T23:54:35.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d56cf640 1 -- 172.21.15.112:0/1440703884 learned_addr learned my addr 172.21.15.112:0/1440703884 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:35.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d4ece640 1 --2- 172.21.15.112:0/1440703884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8d015c910 0x7fc8d01f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:35.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d5ed0640 1 --2- 172.21.15.112:0/1440703884 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8d015cd90 0x7fc8d01f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:35.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d56cf640 1 -- 172.21.15.112:0/1440703884 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8d015cd90 msgr2=0x7fc8d01f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:35.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d56cf640 1 --2- 172.21.15.112:0/1440703884 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8d015cd90 0x7fc8d01f35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:35.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d56cf640 1 -- 172.21.15.112:0/1440703884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8d015c910 msgr2=0x7fc8d01f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:35.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d56cf640 1 --2- 172.21.15.112:0/1440703884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8d015c910 0x7fc8d01f30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:35.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d56cf640 1 -- 172.21.15.112:0/1440703884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d0152860 con 0x7fc8b80051d0 2024-09-15T23:54:35.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d56cf640 1 --2- 172.21.15.112:0/1440703884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8b80051d0 0x7fc8d0147500 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800d4c0 tx=0x7fc8c800d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:35.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8cdffb640 1 -- 172.21.15.112:0/1440703884 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8005480 con 0x7fc8b80051d0 2024-09-15T23:54:35.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8cdffb640 1 -- 172.21.15.112:0/1440703884 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c8017070 con 0x7fc8b80051d0 2024-09-15T23:54:35.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d7933640 1 -- 172.21.15.112:0/1440703884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d0152b40 con 0x7fc8b80051d0 2024-09-15T23:54:35.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8cdffb640 1 -- 172.21.15.112:0/1440703884 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8003840 con 0x7fc8b80051d0 2024-09-15T23:54:35.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d7933640 1 -- 172.21.15.112:0/1440703884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d0153100 con 0x7fc8b80051d0 2024-09-15T23:54:35.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8d7933640 1 -- 172.21.15.112:0/1440703884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d0068e50 con 0x7fc8b80051d0 2024-09-15T23:54:35.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.680+0000 7fc8cdffb640 1 -- 172.21.15.112:0/1440703884 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc8c80039e0 con 0x7fc8b80051d0 2024-09-15T23:54:35.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.684+0000 7fc8cdffb640 1 --2- 172.21.15.112:0/1440703884 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc8bc0678c0 0x7fc8bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:35.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.684+0000 7fc8d4ece640 1 --2- 172.21.15.112:0/1440703884 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc8bc0678c0 0x7fc8bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:35.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.684+0000 7fc8cdffb640 1 -- 172.21.15.112:0/1440703884 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5795+0+0 (secure 0 0 0) 0x7fc8c8085b70 con 0x7fc8b80051d0 2024-09-15T23:54:35.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.684+0000 7fc8d4ece640 1 --2- 172.21.15.112:0/1440703884 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc8bc0678c0 0x7fc8bc069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4001340 tx=0x7fc8c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:35.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.688+0000 7fc8cdffb640 1 -- 172.21.15.112:0/1440703884 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc8c80565c0 con 0x7fc8b80051d0 2024-09-15T23:54:35.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:35.848+0000 7fc8d7933640 1 -- 172.21.15.112:0/1440703884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc8d009cd40 con 0x7fc8b80051d0 2024-09-15T23:54:36.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.516+0000 7fc8cdffb640 1 -- 172.21.15.112:0/1440703884 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7fc8c8055ec0 con 0x7fc8b80051d0 2024-09-15T23:54:36.522 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data_ec' removed 2024-09-15T23:54:36.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.520+0000 7fc8d7933640 1 -- 172.21.15.112:0/1440703884 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc8bc0678c0 msgr2=0x7fc8bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:36.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.520+0000 7fc8d7933640 1 --2- 172.21.15.112:0/1440703884 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc8bc0678c0 0x7fc8bc069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4001340 tx=0x7fc8c4009040 comp rx=0 tx=0).stop 2024-09-15T23:54:36.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.520+0000 7fc8d7933640 1 -- 172.21.15.112:0/1440703884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8b80051d0 msgr2=0x7fc8d0147500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:36.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.520+0000 7fc8d7933640 1 --2- 172.21.15.112:0/1440703884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8b80051d0 0x7fc8d0147500 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800d4c0 tx=0x7fc8c800d980 comp rx=0 tx=0).stop 2024-09-15T23:54:36.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.520+0000 7fc8d7933640 1 -- 172.21.15.112:0/1440703884 shutdown_connections 2024-09-15T23:54:36.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.520+0000 7fc8d7933640 1 --2- 172.21.15.112:0/1440703884 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc8bc0678c0 0x7fc8bc069d80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:36.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.520+0000 7fc8d7933640 1 --2- 172.21.15.112:0/1440703884 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8d015cd90 0x7fc8d01f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:36.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.520+0000 7fc8d7933640 1 --2- 172.21.15.112:0/1440703884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8d015c910 0x7fc8d01f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:36.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.520+0000 7fc8d7933640 1 --2- 172.21.15.112:0/1440703884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8b80051d0 0x7fc8d0147500 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:36.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.520+0000 7fc8d7933640 1 -- 172.21.15.112:0/1440703884 >> 172.21.15.112:0/1440703884 conn(0x7fc8d00b1f90 msgr2=0x7fc8d015d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:36.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.520+0000 7fc8d7933640 1 -- 172.21.15.112:0/1440703884 shutdown_connections 2024-09-15T23:54:36.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.520+0000 7fc8d7933640 1 -- 172.21.15.112:0/1440703884 wait complete. 2024-09-15T23:54:36.549 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:54:36.549 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:54:36.549 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:54:36.549 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:54:36.549 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:54:36.550 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:54:36.550 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:54:36.550 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:54:36.550 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:54:36.550 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:54:36.550 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:54:36.550 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:54:36.551 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:54:36.551 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:54:36.551 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:54:36.551 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:54:36.560 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:54:36.560 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:54:36.562 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:54:36.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:54:36.565 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:54:36.565 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:54:36.566 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:54:36.566 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:54:36.607 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:54:36.607 DEBUG:teuthology.parallel:result is None 2024-09-15T23:54:36.608 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:54:36.609 DEBUG:teuthology.parallel:result is None 2024-09-15T23:54:36.611 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:54:36.611 DEBUG:teuthology.parallel:result is None 2024-09-15T23:54:36.612 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:54:36.612 DEBUG:teuthology.parallel:result is None 2024-09-15T23:54:36.612 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:54:36.670 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-15T23:54:36.672 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-15T23:54:36.679 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-15T23:54:36.681 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-09-15T23:54:36.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2af545a640 1 Processor -- start 2024-09-15T23:54:36.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2af545a640 1 -- start start 2024-09-15T23:54:36.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2af545a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2af01520a0 0x7f2af006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:36.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2af545a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2af015f3a0 0x7f2af00adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:36.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2af545a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af0070250 con 0x7f2af006fe50 2024-09-15T23:54:36.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2af545a640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2af0152480 con 0x7f2af01520a0 2024-09-15T23:54:36.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2af545a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2af00aede0 con 0x7f2af015f3a0 2024-09-15T23:54:36.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2aeeffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2af01520a0 0x7f2af006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:36.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2aeeffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2af01520a0 0x7f2af006f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52334/0 (socket says 172.21.15.112:52334) 2024-09-15T23:54:36.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2aeeffd640 1 -- 172.21.15.112:0/3637659501 learned_addr learned my addr 172.21.15.112:0/3637659501 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:36.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2aef7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2af015f3a0 0x7f2af00adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:36.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2aeeffd640 1 -- 172.21.15.112:0/3637659501 >> v2:172.21.15.169:3300/0 conn(0x7f2af015f3a0 msgr2=0x7f2af00adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:36.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2aeeffd640 1 --2- 172.21.15.112:0/3637659501 >> v2:172.21.15.169:3300/0 conn(0x7f2af015f3a0 0x7f2af00adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:36.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2aeeffd640 1 -- 172.21.15.112:0/3637659501 >> v1:172.21.15.169:6789/0 conn(0x7f2af006fe50 legacy=0x7f2af015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:36.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2aeeffd640 1 -- 172.21.15.112:0/3637659501 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af015fa10 con 0x7f2af01520a0 2024-09-15T23:54:36.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.740+0000 7f2aef7fe640 1 --2- 172.21.15.112:0/3637659501 >> v2:172.21.15.169:3300/0 conn(0x7f2af015f3a0 0x7f2af00adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:54:36.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2aeeffd640 1 --2- 172.21.15.112:0/3637659501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2af01520a0 0x7f2af006f910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2af0155b40 tx=0x7f2ae001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a607ced4fd1b8011 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:36.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2aedffb640 1 -- 172.21.15.112:0/3637659501 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae00ab610 con 0x7f2af01520a0 2024-09-15T23:54:36.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2aedffb640 1 -- 172.21.15.112:0/3637659501 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae00b0070 con 0x7f2af01520a0 2024-09-15T23:54:36.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2aedffb640 1 -- 172.21.15.112:0/3637659501 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae00ab9d0 con 0x7f2af01520a0 2024-09-15T23:54:36.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 -- 172.21.15.112:0/3637659501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2af01520a0 msgr2=0x7f2af006f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:36.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 --2- 172.21.15.112:0/3637659501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2af01520a0 0x7f2af006f910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2af0155b40 tx=0x7f2ae001c520 comp rx=0 tx=0).stop 2024-09-15T23:54:36.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 -- 172.21.15.112:0/3637659501 shutdown_connections 2024-09-15T23:54:36.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 --2- 172.21.15.112:0/3637659501 >> v2:172.21.15.169:3300/0 conn(0x7f2af015f3a0 0x7f2af00adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:36.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 --2- 172.21.15.112:0/3637659501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2af01520a0 0x7f2af006f910 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:36.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 -- 172.21.15.112:0/3637659501 >> 172.21.15.112:0/3637659501 conn(0x7f2af00b1f90 msgr2=0x7f2af00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:36.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 -- 172.21.15.112:0/3637659501 shutdown_connections 2024-09-15T23:54:36.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 -- 172.21.15.112:0/3637659501 wait complete. 2024-09-15T23:54:36.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 Processor -- start 2024-09-15T23:54:36.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 -- start start 2024-09-15T23:54:36.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2af006fe50 0x7f2af015abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:36.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2af01520a0 0x7f2af006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:36.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2af015f3a0 0x7f2af006f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:36.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2af0073d30 con 0x7f2af015f3a0 2024-09-15T23:54:36.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2af0073a50 con 0x7f2af01520a0 2024-09-15T23:54:36.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2af545a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2af0167f10 con 0x7f2af006fe50 2024-09-15T23:54:36.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2aef7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2af015f3a0 0x7f2af006f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:36.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2aef7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2af015f3a0 0x7f2af006f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52348/0 (socket says 172.21.15.112:52348) 2024-09-15T23:54:36.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2aef7fe640 1 -- 172.21.15.112:0/1525688964 learned_addr learned my addr 172.21.15.112:0/1525688964 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:36.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2aeeffd640 1 --2- 172.21.15.112:0/1525688964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2af006fe50 0x7f2af015abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:36.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2aee7fc640 1 --2- 172.21.15.112:0/1525688964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2af01520a0 0x7f2af006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:36.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2aef7fe640 1 -- 172.21.15.112:0/1525688964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2af006fe50 msgr2=0x7f2af015abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:36.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2aef7fe640 1 --2- 172.21.15.112:0/1525688964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2af006fe50 0x7f2af015abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:36.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2aef7fe640 1 -- 172.21.15.112:0/1525688964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2af01520a0 msgr2=0x7f2af006eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:36.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2aef7fe640 1 --2- 172.21.15.112:0/1525688964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2af01520a0 0x7f2af006eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:36.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.744+0000 7f2aef7fe640 1 -- 172.21.15.112:0/1525688964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af01f6960 con 0x7f2af015f3a0 2024-09-15T23:54:36.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.748+0000 7f2aef7fe640 1 --2- 172.21.15.112:0/1525688964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2af015f3a0 0x7f2af006f2e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009f00 tx=0x7f2ae800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:36.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.748+0000 7f2ad77fe640 1 -- 172.21.15.112:0/1525688964 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8018030 con 0x7f2af015f3a0 2024-09-15T23:54:36.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.748+0000 7f2ad77fe640 1 -- 172.21.15.112:0/1525688964 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae800ce50 con 0x7f2af015f3a0 2024-09-15T23:54:36.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.748+0000 7f2af545a640 1 -- 172.21.15.112:0/1525688964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af01f5de0 con 0x7f2af015f3a0 2024-09-15T23:54:36.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.748+0000 7f2ad77fe640 1 -- 172.21.15.112:0/1525688964 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8003bc0 con 0x7f2af015f3a0 2024-09-15T23:54:36.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.748+0000 7f2af545a640 1 -- 172.21.15.112:0/1525688964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af01f63a0 con 0x7f2af015f3a0 2024-09-15T23:54:36.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.748+0000 7f2af545a640 1 -- 172.21.15.112:0/1525688964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2af006f910 con 0x7f2af015f3a0 2024-09-15T23:54:36.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.748+0000 7f2ad77fe640 1 -- 172.21.15.112:0/1525688964 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ae801b070 con 0x7f2af015f3a0 2024-09-15T23:54:36.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.748+0000 7f2ad77fe640 1 --2- 172.21.15.112:0/1525688964 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2adc0678f0 0x7f2adc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:36.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.748+0000 7f2aeeffd640 1 --2- 172.21.15.112:0/1525688964 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2adc0678f0 0x7f2adc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:36.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.748+0000 7f2ad77fe640 1 -- 172.21.15.112:0/1525688964 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5335+0+0 (secure 0 0 0) 0x7f2ae8086550 con 0x7f2af015f3a0 2024-09-15T23:54:36.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.748+0000 7f2aeeffd640 1 --2- 172.21.15.112:0/1525688964 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2adc0678f0 0x7f2adc069db0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00af000 tx=0x7f2ae00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:36.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.752+0000 7f2ad77fe640 1 -- 172.21.15.112:0/1525688964 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2ae8010040 con 0x7f2af015f3a0 2024-09-15T23:54:36.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:36.924+0000 7f2af545a640 1 -- 172.21.15.112:0/1525688964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2af00d0030 con 0x7f2af015f3a0 2024-09-15T23:54:37.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.548+0000 7f2ad77fe640 1 -- 172.21.15.112:0/1525688964 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) ==== 97+0+0 (secure 0 0 0) 0x7f2ae80571f0 con 0x7f2af015f3a0 2024-09-15T23:54:37.554 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-15T23:54:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.552+0000 7f2af545a640 1 -- 172.21.15.112:0/1525688964 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2adc0678f0 msgr2=0x7f2adc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.552+0000 7f2af545a640 1 --2- 172.21.15.112:0/1525688964 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2adc0678f0 0x7f2adc069db0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00af000 tx=0x7f2ae00a7000 comp rx=0 tx=0).stop 2024-09-15T23:54:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.552+0000 7f2af545a640 1 -- 172.21.15.112:0/1525688964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2af015f3a0 msgr2=0x7f2af006f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.552+0000 7f2af545a640 1 --2- 172.21.15.112:0/1525688964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2af015f3a0 0x7f2af006f2e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009f00 tx=0x7f2ae800c490 comp rx=0 tx=0).stop 2024-09-15T23:54:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.552+0000 7f2af545a640 1 -- 172.21.15.112:0/1525688964 shutdown_connections 2024-09-15T23:54:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.552+0000 7f2af545a640 1 --2- 172.21.15.112:0/1525688964 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2adc0678f0 0x7f2adc069db0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.552+0000 7f2af545a640 1 --2- 172.21.15.112:0/1525688964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2af015f3a0 0x7f2af006f2e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.552+0000 7f2af545a640 1 --2- 172.21.15.112:0/1525688964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2af01520a0 0x7f2af006eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:37.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.552+0000 7f2af545a640 1 --2- 172.21.15.112:0/1525688964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2af006fe50 0x7f2af015abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:37.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.552+0000 7f2af545a640 1 -- 172.21.15.112:0/1525688964 >> 172.21.15.112:0/1525688964 conn(0x7f2af00b1f90 msgr2=0x7f2af015c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:37.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.552+0000 7f2af545a640 1 -- 172.21.15.112:0/1525688964 shutdown_connections 2024-09-15T23:54:37.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.552+0000 7f2af545a640 1 -- 172.21.15.112:0/1525688964 wait complete. 2024-09-15T23:54:37.579 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:54:37.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15ac56c640 1 Processor -- start 2024-09-15T23:54:37.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15ac56c640 1 -- start start 2024-09-15T23:54:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15ac56c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f15a4145d90 0x7f15a40b0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15ac56c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f15a40d1760 0x7f15a406c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15ac56c640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15a40d1d80 con 0x7f15a406bcc0 2024-09-15T23:54:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15ac56c640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f15a406c670 con 0x7f15a4145d90 2024-09-15T23:54:37.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15ac56c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f15a40afa20 con 0x7f15a40d1760 2024-09-15T23:54:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15aa308640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f15a4145d90 0x7f15a40b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15a9b07640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f15a406bcc0 0x7f15a40d1050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45650/0 (socket says 172.21.15.112:45650) 2024-09-15T23:54:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15a9b07640 1 -- 172.21.15.112:0/2365432731 learned_addr learned my addr 172.21.15.112:0/2365432731 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15aab09640 1 --2- 172.21.15.112:0/2365432731 >> v2:172.21.15.169:3300/0 conn(0x7f15a40d1760 0x7f15a406c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15aa308640 1 -- 172.21.15.112:0/2365432731 >> v2:172.21.15.169:3300/0 conn(0x7f15a40d1760 msgr2=0x7f15a406c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15aa308640 1 --2- 172.21.15.112:0/2365432731 >> v2:172.21.15.169:3300/0 conn(0x7f15a40d1760 0x7f15a406c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15aa308640 1 -- 172.21.15.112:0/2365432731 >> v1:172.21.15.112:6789/0 conn(0x7f15a406bcc0 legacy=0x7f15a40d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15aa308640 1 -- 172.21.15.112:0/2365432731 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a40afd00 con 0x7f15a4145d90 2024-09-15T23:54:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15a9306640 1 -- 172.21.15.112:0/2365432731 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1751343874 0 0) 0x7f15a40d1d80 con 0x7f15a406bcc0 2024-09-15T23:54:37.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.700+0000 7f15aab09640 1 --2- 172.21.15.112:0/2365432731 >> v2:172.21.15.169:3300/0 conn(0x7f15a40d1760 0x7f15a406c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:37.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15aa308640 1 --2- 172.21.15.112:0/2365432731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15a4145d90 0x7f15a40b0500 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f15a409af50 tx=0x7f159401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec69c7f87812b69 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:37.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15a9306640 1 -- 172.21.15.112:0/2365432731 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15940b0070 con 0x7f15a4145d90 2024-09-15T23:54:37.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15a9306640 1 -- 172.21.15.112:0/2365432731 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15940ab600 con 0x7f15a4145d90 2024-09-15T23:54:37.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15a9306640 1 -- 172.21.15.112:0/2365432731 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15940ab9d0 con 0x7f15a4145d90 2024-09-15T23:54:37.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 -- 172.21.15.112:0/2365432731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15a4145d90 msgr2=0x7f15a40b0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:37.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 --2- 172.21.15.112:0/2365432731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15a4145d90 0x7f15a40b0500 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f15a409af50 tx=0x7f159401c480 comp rx=0 tx=0).stop 2024-09-15T23:54:37.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 -- 172.21.15.112:0/2365432731 shutdown_connections 2024-09-15T23:54:37.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 --2- 172.21.15.112:0/2365432731 >> v2:172.21.15.169:3300/0 conn(0x7f15a40d1760 0x7f15a406c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 --2- 172.21.15.112:0/2365432731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15a4145d90 0x7f15a40b0500 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 -- 172.21.15.112:0/2365432731 >> 172.21.15.112:0/2365432731 conn(0x7f15a409aa00 msgr2=0x7f15a40b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 -- 172.21.15.112:0/2365432731 shutdown_connections 2024-09-15T23:54:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 -- 172.21.15.112:0/2365432731 wait complete. 2024-09-15T23:54:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 Processor -- start 2024-09-15T23:54:37.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 -- start start 2024-09-15T23:54:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15a406bcc0 0x7f15a414c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:37.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15a40d1760 0x7f15a415bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15a4145d90 0x7f15a40b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f15a40b4a20 con 0x7f15a406bcc0 2024-09-15T23:54:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15a40b48a0 con 0x7f15a4145d90 2024-09-15T23:54:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15ac56c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f15a40b4ba0 con 0x7f15a40d1760 2024-09-15T23:54:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15aa308640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15a406bcc0 0x7f15a414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15aa308640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15a406bcc0 0x7f15a414c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52368/0 (socket says 172.21.15.112:52368) 2024-09-15T23:54:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15aa308640 1 -- 172.21.15.112:0/3277648065 learned_addr learned my addr 172.21.15.112:0/3277648065 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15a9b07640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15a40d1760 0x7f15a415bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:37.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15aab09640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15a4145d90 0x7f15a40b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:37.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15aa308640 1 -- 172.21.15.112:0/3277648065 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15a40d1760 msgr2=0x7f15a415bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:37.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15aa308640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15a40d1760 0x7f15a415bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:37.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15aa308640 1 -- 172.21.15.112:0/3277648065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15a4145d90 msgr2=0x7f15a40b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:37.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15aa308640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15a4145d90 0x7f15a40b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:37.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15aa308640 1 -- 172.21.15.112:0/3277648065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a415ef40 con 0x7f15a406bcc0 2024-09-15T23:54:37.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15a9b07640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15a40d1760 0x7f15a415bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:37.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f15aa308640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15a406bcc0 0x7f15a414c860 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f15940ae040 tx=0x7f159401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:37.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.704+0000 7f159affd640 1 -- 172.21.15.112:0/3277648065 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15940b0050 con 0x7f15a406bcc0 2024-09-15T23:54:37.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.708+0000 7f159affd640 1 -- 172.21.15.112:0/3277648065 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15940bc070 con 0x7f15a406bcc0 2024-09-15T23:54:37.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.708+0000 7f159affd640 1 -- 172.21.15.112:0/3277648065 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15940b5a70 con 0x7f15a406bcc0 2024-09-15T23:54:37.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.708+0000 7f15ac56c640 1 -- 172.21.15.112:0/3277648065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a415f220 con 0x7f15a406bcc0 2024-09-15T23:54:37.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.708+0000 7f15ac56c640 1 -- 172.21.15.112:0/3277648065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a415ebf0 con 0x7f15a406bcc0 2024-09-15T23:54:37.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.708+0000 7f15ac56c640 1 -- 172.21.15.112:0/3277648065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a40d1d80 con 0x7f15a406bcc0 2024-09-15T23:54:37.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.708+0000 7f159affd640 1 -- 172.21.15.112:0/3277648065 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f15940b5c10 con 0x7f15a406bcc0 2024-09-15T23:54:37.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.708+0000 7f159affd640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15880678c0 0x7f1588069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:37.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.708+0000 7f159affd640 1 -- 172.21.15.112:0/3277648065 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f1594120ed0 con 0x7f15a406bcc0 2024-09-15T23:54:37.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.708+0000 7f15a9b07640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15880678c0 0x7f1588069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:37.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.708+0000 7f15a9b07640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15880678c0 0x7f1588069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f15a0007fd0 tx=0x7f15a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:37.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.712+0000 7f159affd640 1 -- 172.21.15.112:0/3277648065 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1594016070 con 0x7f15a406bcc0 2024-09-15T23:54:37.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.932+0000 7f15ac56c640 1 -- 172.21.15.112:0/3277648065 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f15a4160cb0 con 0x7f15a406bcc0 2024-09-15T23:54:37.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.932+0000 7f159affd640 1 -- 172.21.15.112:0/3277648065 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f15940aa3a0 con 0x7f15a406bcc0 2024-09-15T23:54:37.937 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:37.937 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:54:37.937 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-15T23:54:37.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-15T23:54:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmPvLEFBAA/WS7KNQ60+LzhOcQyCVWoQ==", 2024-09-15T23:54:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:54:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:54:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:54:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-15T23:54:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmN/+jIxAAiXM9onNC3twhiZrqCdWtUQ==", 2024-09-15T23:54:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.938 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:54:37.939 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:54:37.939 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:54:37.939 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.939 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-15T23:54:37.939 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmEbNbHRAAjP+2Z2XYc0tarO48R/ocIQ==", 2024-09-15T23:54:37.939 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.939 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:54:37.939 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:54:37.939 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:54:37.939 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.940 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-15T23:54:37.940 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmg6AqLBAAZ3PKcarPcPfvIWSTnE5uLA==", 2024-09-15T23:54:37.940 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.940 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:54:37.940 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:54:37.940 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:54:37.940 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.940 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.940 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-15T23:54:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBRc+dmnOKMBxAAdaIaYmXKAFGIPTxfYt2apQ==", 2024-09-15T23:54:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:54:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:54:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-15T23:54:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBUc+dmnowGFhAAa3jXrvZ0An+9IwM9988mvQ==", 2024-09-15T23:54:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:54:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:54:37.941 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.942 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.942 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-15T23:54:37.942 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBXc+dmnj9kJRAAZbpx5TM2ukiLKqi+iZAE5g==", 2024-09-15T23:54:37.942 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.942 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:54:37.942 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:54:37.942 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.942 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.942 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-15T23:54:37.942 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBac+dmAdXtNxAA8g+Nxz1RyVf+P8KOtkw5qw==", 2024-09-15T23:54:37.943 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.943 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:54:37.943 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:54:37.943 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.943 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.943 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-15T23:54:37.943 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBhc+dmyOApAhAA9Cv9nW1b5JvO9cH9emao4A==", 2024-09-15T23:54:37.943 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.943 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:54:37.943 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:54:37.943 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.943 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.944 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-15T23:54:37.944 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBkc+dmFIDwDxAAR/59kfrjiLU4emIqtthfRg==", 2024-09-15T23:54:37.944 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.944 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:54:37.944 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:54:37.944 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.944 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.944 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-15T23:54:37.944 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBnc+dmZVB/IRAAFbvodnxisklCL/yuD+F5ew==", 2024-09-15T23:54:37.945 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.945 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:54:37.945 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:54:37.945 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.945 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.945 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-15T23:54:37.945 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBqc+dmuty6LxAAHWB/GByU/hXOL/+dnRpcVA==", 2024-09-15T23:54:37.945 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.945 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:54:37.945 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:54:37.945 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.946 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.946 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-15T23:54:37.946 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw==", 2024-09-15T23:54:37.946 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.946 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:54:37.946 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:54:37.946 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:54:37.946 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:54:37.946 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.946 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmmP6vORAAqxzX3OjoHnionZo1koIqRQ==", 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmj2XtNhAAB5620fN0Kr8Cqgd2+1cebg==", 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:54:37.947 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:54:37.948 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:54:37.948 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.948 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-15T23:54:37.948 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBOc+dmt+I7AxAA+eyV3eaThbjRNo0zJT9OQg==", 2024-09-15T23:54:37.948 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.948 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:54:37.948 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:54:37.948 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:54:37.948 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:54:37.948 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-15T23:54:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBMc+dmDuzBORAAzpiXmO3QO+1RKRvPGQLViQ==", 2024-09-15T23:54:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:54:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:54:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:54:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-mds", 2024-09-15T23:54:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQB2c+dmnqNyJBAA3pY8mb9ZrtZFJMWvJ/6htg==", 2024-09-15T23:54:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-mds" 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-mgr", 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQB2c+dmaLxyJBAABu2yDvW1yC2UQebIZHMfmA==", 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-osd", 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQB2c+dmmtJyJBAAjyGv5uz1KG/b7kmPy41E+Q==", 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-osd" 2024-09-15T23:54:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rbd", 2024-09-15T23:54:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQB2c+dmc+dyJBAAOG2NMBktaGkqJltgkZNlEg==", 2024-09-15T23:54:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-15T23:54:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-15T23:54:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQB2c+dmS/1yJBAA+1HCaWQV1vqsxZgMYZK9qQ==", 2024-09-15T23:54:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-15T23:54:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.bootstrap-rgw", 2024-09-15T23:54:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQB2c+dm2BNzJBAAB0vz+nSovt9fcJIgBsfu0Q==", 2024-09-15T23:54:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-15T23:54:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-15T23:54:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dm4JK5ERAA3d3OABWXchejCqjJRrhTfQ==", 2024-09-15T23:54:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:54:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-15T23:54:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-15T23:54:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dm5nULDxAAi9UvgPZ7sU/Zz2jLKsu4ng==", 2024-09-15T23:54:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:54:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:54:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-15T23:54:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:54:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-15T23:54:37.954 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:54:37.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.936+0000 7f15ac56c640 1 -- 172.21.15.112:0/3277648065 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15880678c0 msgr2=0x7f1588069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:37.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.936+0000 7f15ac56c640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15880678c0 0x7f1588069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f15a0007fd0 tx=0x7f15a0009040 comp rx=0 tx=0).stop 2024-09-15T23:54:37.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.936+0000 7f15ac56c640 1 -- 172.21.15.112:0/3277648065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15a406bcc0 msgr2=0x7f15a414c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:37.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.936+0000 7f15ac56c640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15a406bcc0 0x7f15a414c860 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f15940ae040 tx=0x7f159401acc0 comp rx=0 tx=0).stop 2024-09-15T23:54:37.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.936+0000 7f15ac56c640 1 -- 172.21.15.112:0/3277648065 shutdown_connections 2024-09-15T23:54:37.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.936+0000 7f15ac56c640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15880678c0 0x7f1588069d80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:37.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.936+0000 7f15ac56c640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15a4145d90 0x7f15a40b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:37.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.936+0000 7f15ac56c640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15a40d1760 0x7f15a415bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:37.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.936+0000 7f15ac56c640 1 --2- 172.21.15.112:0/3277648065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15a406bcc0 0x7f15a414c860 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:37.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.936+0000 7f15ac56c640 1 -- 172.21.15.112:0/3277648065 >> 172.21.15.112:0/3277648065 conn(0x7f15a409aa00 msgr2=0x7f15a4074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:37.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.936+0000 7f15ac56c640 1 -- 172.21.15.112:0/3277648065 shutdown_connections 2024-09-15T23:54:37.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:37.936+0000 7f15ac56c640 1 -- 172.21.15.112:0/3277648065 wait complete. 2024-09-15T23:54:37.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-15T23:54:38.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517fe1b640 1 Processor -- start 2024-09-15T23:54:38.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517fe1b640 1 -- start start 2024-09-15T23:54:38.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517fe1b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5178161a60 0x7f51780d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517fe1b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f51780d2e90 0x7f51780cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517fe1b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f51780cf450 0x7f51780d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517fe1b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f51780d32b0 con 0x7f51780cf450 2024-09-15T23:54:38.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517fe1b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f51780d0300 con 0x7f51780d2e90 2024-09-15T23:54:38.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517fe1b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f51780b0f60 con 0x7f5178161a60 2024-09-15T23:54:38.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517e3b8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f51780cf450 0x7f51780d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517e3b8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f51780cf450 0x7f51780d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52372/0 (socket says 172.21.15.112:52372) 2024-09-15T23:54:38.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517e3b8640 1 -- 172.21.15.112:0/1108925381 learned_addr learned my addr 172.21.15.112:0/1108925381 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:38.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517d3b6640 1 --2- 172.21.15.112:0/1108925381 >> v2:172.21.15.169:3300/0 conn(0x7f51780d2e90 0x7f51780cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517dbb7640 1 --2- 172.21.15.112:0/1108925381 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5178161a60 0x7f51780d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517e3b8640 1 -- 172.21.15.112:0/1108925381 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5178161a60 msgr2=0x7f51780d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:38.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517e3b8640 1 --2- 172.21.15.112:0/1108925381 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5178161a60 0x7f51780d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517e3b8640 1 -- 172.21.15.112:0/1108925381 >> v2:172.21.15.169:3300/0 conn(0x7f51780d2e90 msgr2=0x7f51780cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:38.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517e3b8640 1 --2- 172.21.15.112:0/1108925381 >> v2:172.21.15.169:3300/0 conn(0x7f51780d2e90 0x7f51780cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517e3b8640 1 -- 172.21.15.112:0/1108925381 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51780cfd40 con 0x7f51780cf450 2024-09-15T23:54:38.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.072+0000 7f517d3b6640 1 --2- 172.21.15.112:0/1108925381 >> v2:172.21.15.169:3300/0 conn(0x7f51780d2e90 0x7f51780cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:54:38.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517e3b8640 1 --2- 172.21.15.112:0/1108925381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51780cf450 0x7f51780d0a10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f51780d1ef0 tx=0x7f517001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f594fb4e3cacf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:38.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517cbb5640 1 -- 172.21.15.112:0/1108925381 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51700a57b0 con 0x7f51780cf450 2024-09-15T23:54:38.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517cbb5640 1 -- 172.21.15.112:0/1108925381 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51700a5950 con 0x7f51780cf450 2024-09-15T23:54:38.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517cbb5640 1 -- 172.21.15.112:0/1108925381 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51700a5d20 con 0x7f51780cf450 2024-09-15T23:54:38.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517fe1b640 1 -- 172.21.15.112:0/1108925381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51780cf450 msgr2=0x7f51780d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517fe1b640 1 --2- 172.21.15.112:0/1108925381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51780cf450 0x7f51780d0a10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f51780d1ef0 tx=0x7f517001c930 comp rx=0 tx=0).stop 2024-09-15T23:54:38.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517fe1b640 1 -- 172.21.15.112:0/1108925381 shutdown_connections 2024-09-15T23:54:38.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517fe1b640 1 --2- 172.21.15.112:0/1108925381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51780cf450 0x7f51780d0a10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517fe1b640 1 --2- 172.21.15.112:0/1108925381 >> v2:172.21.15.169:3300/0 conn(0x7f51780d2e90 0x7f51780cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517fe1b640 1 --2- 172.21.15.112:0/1108925381 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5178161a60 0x7f51780d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517fe1b640 1 -- 172.21.15.112:0/1108925381 >> 172.21.15.112:0/1108925381 conn(0x7f517808bf90 msgr2=0x7f517809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:38.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517fe1b640 1 -- 172.21.15.112:0/1108925381 shutdown_connections 2024-09-15T23:54:38.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517fe1b640 1 -- 172.21.15.112:0/1108925381 wait complete. 2024-09-15T23:54:38.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517fe1b640 1 Processor -- start 2024-09-15T23:54:38.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.076+0000 7f517fe1b640 1 -- start start 2024-09-15T23:54:38.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517fe1b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51780cf450 0x7f517815c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517fe1b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51780d2e90 0x7f5178151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517fe1b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5178161a60 0x7f51780cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517fe1b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f51780cfa80 con 0x7f51780cf450 2024-09-15T23:54:38.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517fe1b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f51780cf900 con 0x7f5178161a60 2024-09-15T23:54:38.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517fe1b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f517806d6b0 con 0x7f51780d2e90 2024-09-15T23:54:38.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517dbb7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51780cf450 0x7f517815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517dbb7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51780cf450 0x7f517815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52376/0 (socket says 172.21.15.112:52376) 2024-09-15T23:54:38.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517dbb7640 1 -- 172.21.15.112:0/659447 learned_addr learned my addr 172.21.15.112:0/659447 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:38.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517d3b6640 1 --2- 172.21.15.112:0/659447 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51780d2e90 0x7f5178151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517e3b8640 1 --2- 172.21.15.112:0/659447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5178161a60 0x7f51780cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517dbb7640 1 -- 172.21.15.112:0/659447 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51780d2e90 msgr2=0x7f5178151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517dbb7640 1 --2- 172.21.15.112:0/659447 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51780d2e90 0x7f5178151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517dbb7640 1 -- 172.21.15.112:0/659447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5178161a60 msgr2=0x7f51780cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517dbb7640 1 --2- 172.21.15.112:0/659447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5178161a60 0x7f51780cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517dbb7640 1 -- 172.21.15.112:0/659447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51780b21a0 con 0x7f51780cf450 2024-09-15T23:54:38.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517dbb7640 1 --2- 172.21.15.112:0/659447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51780cf450 0x7f517815c070 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f517400d620 tx=0x7f517400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:38.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f516e7fc640 1 -- 172.21.15.112:0/659447 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517400b620 con 0x7f51780cf450 2024-09-15T23:54:38.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f516e7fc640 1 -- 172.21.15.112:0/659447 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5174019070 con 0x7f51780cf450 2024-09-15T23:54:38.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517fe1b640 1 -- 172.21.15.112:0/659447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f517815afd0 con 0x7f51780cf450 2024-09-15T23:54:38.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f516e7fc640 1 -- 172.21.15.112:0/659447 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517400b9e0 con 0x7f51780cf450 2024-09-15T23:54:38.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517fe1b640 1 -- 172.21.15.112:0/659447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f517815b590 con 0x7f51780cf450 2024-09-15T23:54:38.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517fe1b640 1 -- 172.21.15.112:0/659447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51780cef10 con 0x7f51780cf450 2024-09-15T23:54:38.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f516e7fc640 1 -- 172.21.15.112:0/659447 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f517400bb80 con 0x7f51780cf450 2024-09-15T23:54:38.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f516e7fc640 1 --2- 172.21.15.112:0/659447 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f515c0678f0 0x7f515c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f516e7fc640 1 -- 172.21.15.112:0/659447 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f5174085eb0 con 0x7f51780cf450 2024-09-15T23:54:38.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.080+0000 7f517d3b6640 1 --2- 172.21.15.112:0/659447 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f515c0678f0 0x7f515c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.084+0000 7f517d3b6640 1 --2- 172.21.15.112:0/659447 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f515c0678f0 0x7f515c069db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f517815a690 tx=0x7f5168008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:38.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.088+0000 7f516e7fc640 1 -- 172.21.15.112:0/659447 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5174056bb0 con 0x7f51780cf450 2024-09-15T23:54:38.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.304+0000 7f517fe1b640 1 -- 172.21.15.112:0/659447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f517815a100 con 0x7f51780cf450 2024-09-15T23:54:38.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.304+0000 7f516e7fc640 1 -- 172.21.15.112:0/659447 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f51740564b0 con 0x7f51780cf450 2024-09-15T23:54:38.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.308+0000 7f517fe1b640 1 -- 172.21.15.112:0/659447 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f515c0678f0 msgr2=0x7f515c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.308+0000 7f517fe1b640 1 --2- 172.21.15.112:0/659447 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f515c0678f0 0x7f515c069db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f517815a690 tx=0x7f5168008040 comp rx=0 tx=0).stop 2024-09-15T23:54:38.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.308+0000 7f517fe1b640 1 -- 172.21.15.112:0/659447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51780cf450 msgr2=0x7f517815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.308+0000 7f517fe1b640 1 --2- 172.21.15.112:0/659447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51780cf450 0x7f517815c070 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f517400d620 tx=0x7f517400dae0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.308+0000 7f517fe1b640 1 -- 172.21.15.112:0/659447 shutdown_connections 2024-09-15T23:54:38.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.308+0000 7f517fe1b640 1 --2- 172.21.15.112:0/659447 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f515c0678f0 0x7f515c069db0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.308+0000 7f517fe1b640 1 --2- 172.21.15.112:0/659447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5178161a60 0x7f51780cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.308+0000 7f517fe1b640 1 --2- 172.21.15.112:0/659447 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51780d2e90 0x7f5178151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.308+0000 7f517fe1b640 1 --2- 172.21.15.112:0/659447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51780cf450 0x7f517815c070 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.308+0000 7f517fe1b640 1 -- 172.21.15.112:0/659447 >> 172.21.15.112:0/659447 conn(0x7f517808bf90 msgr2=0x7f517815d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:38.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.308+0000 7f517fe1b640 1 -- 172.21.15.112:0/659447 shutdown_connections 2024-09-15T23:54:38.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.308+0000 7f517fe1b640 1 -- 172.21.15.112:0/659447 wait complete. 2024-09-15T23:54:38.328 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-15T23:54:38.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02cb283640 1 Processor -- start 2024-09-15T23:54:38.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02cb283640 1 -- start start 2024-09-15T23:54:38.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02cb283640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02c4161a60 0x7f02c40d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02cb283640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02c40cf620 0x7f02c406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02cb283640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c40d32b0 con 0x7f02c40d2e90 2024-09-15T23:54:38.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02cb283640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f02c40d0300 con 0x7f02c4161a60 2024-09-15T23:54:38.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02cb283640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f02c40cfab0 con 0x7f02c40cf620 2024-09-15T23:54:38.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02c901f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02c4161a60 0x7f02c40d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02c901f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f02c4161a60 0x7f02c40d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50168/0 (socket says 172.21.15.112:50168) 2024-09-15T23:54:38.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02c901f640 1 -- 172.21.15.112:0/3270258596 learned_addr learned my addr 172.21.15.112:0/3270258596 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:38.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02c9820640 1 --2- 172.21.15.112:0/3270258596 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02c40cf620 0x7f02c406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02c901f640 1 -- 172.21.15.112:0/3270258596 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02c40cf620 msgr2=0x7f02c406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:38.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02c901f640 1 --2- 172.21.15.112:0/3270258596 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02c40cf620 0x7f02c406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02c901f640 1 -- 172.21.15.112:0/3270258596 >> v1:172.21.15.169:6789/0 conn(0x7f02c40d2e90 legacy=0x7f02c40cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.444+0000 7f02c901f640 1 -- 172.21.15.112:0/3270258596 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c40b0f60 con 0x7f02c4161a60 2024-09-15T23:54:38.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02c901f640 1 --2- 172.21.15.112:0/3270258596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02c4161a60 0x7f02c40d2950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009870 tx=0x7f02c001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4537f757a6952a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02bbfff640 1 -- 172.21.15.112:0/3270258596 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c00aa600 con 0x7f02c4161a60 2024-09-15T23:54:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02bbfff640 1 -- 172.21.15.112:0/3270258596 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c00af070 con 0x7f02c4161a60 2024-09-15T23:54:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02bbfff640 1 -- 172.21.15.112:0/3270258596 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c00aa9c0 con 0x7f02c4161a60 2024-09-15T23:54:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 -- 172.21.15.112:0/3270258596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02c4161a60 msgr2=0x7f02c40d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 --2- 172.21.15.112:0/3270258596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02c4161a60 0x7f02c40d2950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009870 tx=0x7f02c001c4a0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 -- 172.21.15.112:0/3270258596 shutdown_connections 2024-09-15T23:54:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 --2- 172.21.15.112:0/3270258596 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02c40cf620 0x7f02c406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 --2- 172.21.15.112:0/3270258596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02c4161a60 0x7f02c40d2950 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 -- 172.21.15.112:0/3270258596 >> 172.21.15.112:0/3270258596 conn(0x7f02c408bf90 msgr2=0x7f02c409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 -- 172.21.15.112:0/3270258596 shutdown_connections 2024-09-15T23:54:38.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 -- 172.21.15.112:0/3270258596 wait complete. 2024-09-15T23:54:38.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 Processor -- start 2024-09-15T23:54:38.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 -- start start 2024-09-15T23:54:38.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02c40cf620 0x7f02c414f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02c40d2e90 0x7f02c4150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02c4161a60 0x7f02c415f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f02c406e400 con 0x7f02c40cf620 2024-09-15T23:54:38.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02c406d190 con 0x7f02c40d2e90 2024-09-15T23:54:38.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02cb283640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f02c406e580 con 0x7f02c4161a60 2024-09-15T23:54:38.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02c901f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02c40cf620 0x7f02c414f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02c901f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02c40cf620 0x7f02c414f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50170/0 (socket says 172.21.15.112:50170) 2024-09-15T23:54:38.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.448+0000 7f02c901f640 1 -- 172.21.15.112:0/3393982715 learned_addr learned my addr 172.21.15.112:0/3393982715 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:38.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02c9820640 1 --2- 172.21.15.112:0/3393982715 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02c4161a60 0x7f02c415f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02c881e640 1 --2- 172.21.15.112:0/3393982715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02c40d2e90 0x7f02c4150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02c901f640 1 -- 172.21.15.112:0/3393982715 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02c4161a60 msgr2=0x7f02c415f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02c901f640 1 --2- 172.21.15.112:0/3393982715 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02c4161a60 0x7f02c415f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02c901f640 1 -- 172.21.15.112:0/3393982715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02c40d2e90 msgr2=0x7f02c4150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02c901f640 1 --2- 172.21.15.112:0/3393982715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02c40d2e90 0x7f02c4150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02c901f640 1 -- 172.21.15.112:0/3393982715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c415fb90 con 0x7f02c40cf620 2024-09-15T23:54:38.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02c901f640 1 --2- 172.21.15.112:0/3393982715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02c40cf620 0x7f02c414f570 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f02c001ab50 tx=0x7f02c001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:38.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02b9ffb640 1 -- 172.21.15.112:0/3393982715 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c00bd5f0 con 0x7f02c40cf620 2024-09-15T23:54:38.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02b9ffb640 1 -- 172.21.15.112:0/3393982715 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c00bd790 con 0x7f02c40cf620 2024-09-15T23:54:38.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02cb283640 1 -- 172.21.15.112:0/3393982715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c415fe70 con 0x7f02c40cf620 2024-09-15T23:54:38.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02b9ffb640 1 -- 172.21.15.112:0/3393982715 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c00bdb80 con 0x7f02c40cf620 2024-09-15T23:54:38.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02cb283640 1 -- 172.21.15.112:0/3393982715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c415f7d0 con 0x7f02c40cf620 2024-09-15T23:54:38.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02cb283640 1 -- 172.21.15.112:0/3393982715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c406d6b0 con 0x7f02c40cf620 2024-09-15T23:54:38.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02b9ffb640 1 -- 172.21.15.112:0/3393982715 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f02c00a9070 con 0x7f02c40cf620 2024-09-15T23:54:38.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02b9ffb640 1 --2- 172.21.15.112:0/3393982715 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f02a80678c0 0x7f02a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02b9ffb640 1 -- 172.21.15.112:0/3393982715 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f02c0120210 con 0x7f02c40cf620 2024-09-15T23:54:38.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02c881e640 1 --2- 172.21.15.112:0/3393982715 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f02a80678c0 0x7f02a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.452+0000 7f02c881e640 1 --2- 172.21.15.112:0/3393982715 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f02a80678c0 0x7f02a8069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f02c40b9a50 tx=0x7f02b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:38.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.456+0000 7f02b9ffb640 1 -- 172.21.15.112:0/3393982715 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f02c00c3060 con 0x7f02c40cf620 2024-09-15T23:54:38.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.672+0000 7f02cb283640 1 -- 172.21.15.112:0/3393982715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f02c4160320 con 0x7f02c40cf620 2024-09-15T23:54:38.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.676+0000 7f02b9ffb640 1 -- 172.21.15.112:0/3393982715 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f02c0016150 con 0x7f02c40cf620 2024-09-15T23:54:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.676+0000 7f02cb283640 1 -- 172.21.15.112:0/3393982715 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f02a80678c0 msgr2=0x7f02a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.676+0000 7f02cb283640 1 --2- 172.21.15.112:0/3393982715 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f02a80678c0 0x7f02a8069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f02c40b9a50 tx=0x7f02b4009040 comp rx=0 tx=0).stop 2024-09-15T23:54:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.676+0000 7f02cb283640 1 -- 172.21.15.112:0/3393982715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02c40cf620 msgr2=0x7f02c414f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.676+0000 7f02cb283640 1 --2- 172.21.15.112:0/3393982715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02c40cf620 0x7f02c414f570 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f02c001ab50 tx=0x7f02c001ace0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.676+0000 7f02cb283640 1 -- 172.21.15.112:0/3393982715 shutdown_connections 2024-09-15T23:54:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.676+0000 7f02cb283640 1 --2- 172.21.15.112:0/3393982715 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f02a80678c0 0x7f02a8069d80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.676+0000 7f02cb283640 1 --2- 172.21.15.112:0/3393982715 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f02c4161a60 0x7f02c415f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.676+0000 7f02cb283640 1 --2- 172.21.15.112:0/3393982715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02c40d2e90 0x7f02c4150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.676+0000 7f02cb283640 1 --2- 172.21.15.112:0/3393982715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02c40cf620 0x7f02c414f570 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.676+0000 7f02cb283640 1 -- 172.21.15.112:0/3393982715 >> 172.21.15.112:0/3393982715 conn(0x7f02c408bf90 msgr2=0x7f02c40d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.676+0000 7f02cb283640 1 -- 172.21.15.112:0/3393982715 shutdown_connections 2024-09-15T23:54:38.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.676+0000 7f02cb283640 1 -- 172.21.15.112:0/3393982715 wait complete. 2024-09-15T23:54:38.701 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-15T23:54:38.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a19c17640 1 Processor -- start 2024-09-15T23:54:38.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a19c17640 1 -- start start 2024-09-15T23:54:38.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a19c17640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7a14161a60 0x7f7a140d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a19c17640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a140d2e90 0x7f7a140cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a19c17640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a140d32b0 con 0x7f7a140cf450 2024-09-15T23:54:38.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a19c17640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7a140d0300 con 0x7f7a14161a60 2024-09-15T23:54:38.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a19c17640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7a1406e6c0 con 0x7f7a140d2e90 2024-09-15T23:54:38.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a13fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7a140cf450 0x7f7a140d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59686/0 (socket says 172.21.15.112:59686) 2024-09-15T23:54:38.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a13fff640 1 -- 172.21.15.112:0/3611822973 learned_addr learned my addr 172.21.15.112:0/3611822973 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:38.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a12ffd640 1 --2- 172.21.15.112:0/3611822973 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a140d2e90 0x7f7a140cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a137fe640 1 --2- 172.21.15.112:0/3611822973 >> v2:172.21.15.169:3300/0 conn(0x7f7a14161a60 0x7f7a140d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 -- 172.21.15.112:0/3611822973 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 772738073 0 0) 0x7f7a140d32b0 con 0x7f7a140cf450 2024-09-15T23:54:38.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 -- 172.21.15.112:0/3611822973 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79fc003530 con 0x7f7a140cf450 2024-09-15T23:54:38.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 -- 172.21.15.112:0/3611822973 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 113216451 0 0) 0x7f79fc003530 con 0x7f7a140cf450 2024-09-15T23:54:38.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 -- 172.21.15.112:0/3611822973 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a140d2e90 msgr2=0x7f7a140cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:38.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 --2- 172.21.15.112:0/3611822973 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a140d2e90 0x7f7a140cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 -- 172.21.15.112:0/3611822973 >> v2:172.21.15.169:3300/0 conn(0x7f7a14161a60 msgr2=0x7f7a140d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:38.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 --2- 172.21.15.112:0/3611822973 >> v2:172.21.15.169:3300/0 conn(0x7f7a14161a60 0x7f7a140d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 -- 172.21.15.112:0/3611822973 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a140b0f60 con 0x7f7a140cf450 2024-09-15T23:54:38.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 -- 172.21.15.112:0/3611822973 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f7a0c001a00 con 0x7f7a140cf450 2024-09-15T23:54:38.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 -- 172.21.15.112:0/3611822973 >> v1:172.21.15.112:6789/0 conn(0x7f7a140cf450 legacy=0x7f7a140d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 --2- 172.21.15.112:0/3611822973 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a140d2e90 0x7f79fc0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 --2- 172.21.15.112:0/3611822973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79fc003f40 0x7f79fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 --2- 172.21.15.112:0/3611822973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79fc004d50 0x7f79fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 -- 172.21.15.112:0/3611822973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7a140d0300 con 0x7f79fc003f40 2024-09-15T23:54:38.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 -- 172.21.15.112:0/3611822973 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1406e6c0 con 0x7f79fc004d50 2024-09-15T23:54:38.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a127fc640 1 -- 172.21.15.112:0/3611822973 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f79fc00ba20 con 0x7f7a140d2e90 2024-09-15T23:54:38.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a12ffd640 1 --2- 172.21.15.112:0/3611822973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79fc003f40 0x7f79fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a137fe640 1 --2- 172.21.15.112:0/3611822973 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a140d2e90 0x7f79fc0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a13fff640 1 --2- 172.21.15.112:0/3611822973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79fc004d50 0x7f79fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a12ffd640 1 -- 172.21.15.112:0/3611822973 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a140d2e90 msgr2=0x7f79fc0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:38.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a12ffd640 1 --2- 172.21.15.112:0/3611822973 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a140d2e90 0x7f79fc0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a12ffd640 1 -- 172.21.15.112:0/3611822973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79fc004d50 msgr2=0x7f79fc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:38.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a12ffd640 1 --2- 172.21.15.112:0/3611822973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79fc004d50 0x7f79fc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a12ffd640 1 -- 172.21.15.112:0/3611822973 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79fc003530 con 0x7f79fc003f40 2024-09-15T23:54:38.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.816+0000 7f7a13fff640 1 --2- 172.21.15.112:0/3611822973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79fc004d50 0x7f79fc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:38.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.820+0000 7f7a12ffd640 1 --2- 172.21.15.112:0/3611822973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79fc003f40 0x7f79fc004810 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009af0 tx=0x7f7a0801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c8c9930d31c898 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:38.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.820+0000 7f7a127fc640 1 -- 172.21.15.112:0/3611822973 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a080b2070 con 0x7f79fc003f40 2024-09-15T23:54:38.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.820+0000 7f7a127fc640 1 -- 172.21.15.112:0/3611822973 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a080a55d0 con 0x7f79fc003f40 2024-09-15T23:54:38.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.820+0000 7f7a127fc640 1 -- 172.21.15.112:0/3611822973 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a08009690 con 0x7f79fc003f40 2024-09-15T23:54:38.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.820+0000 7f7a19c17640 1 -- 172.21.15.112:0/3611822973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79fc003f40 msgr2=0x7f79fc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.820+0000 7f7a19c17640 1 --2- 172.21.15.112:0/3611822973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79fc003f40 0x7f79fc004810 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009af0 tx=0x7f7a0801ca00 comp rx=0 tx=0).stop 2024-09-15T23:54:38.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.820+0000 7f7a13fff640 1 -- 172.21.15.112:0/3611822973 reap_dead start 2024-09-15T23:54:38.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.820+0000 7f7a19c17640 1 -- 172.21.15.112:0/3611822973 shutdown_connections 2024-09-15T23:54:38.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.820+0000 7f7a19c17640 1 -- 172.21.15.112:0/3611822973 >> 172.21.15.112:0/3611822973 conn(0x7f7a1408bf90 msgr2=0x7f7a1409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:38.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.820+0000 7f7a19c17640 1 -- 172.21.15.112:0/3611822973 shutdown_connections 2024-09-15T23:54:38.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.820+0000 7f7a19c17640 1 -- 172.21.15.112:0/3611822973 wait complete. 2024-09-15T23:54:38.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.820+0000 7f7a19c17640 1 Processor -- start 2024-09-15T23:54:38.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.820+0000 7f7a19c17640 1 -- start start 2024-09-15T23:54:38.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a19c17640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79fc003f40 0x7f7a14154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a19c17640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a140b50c0 0x7f7a140b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a19c17640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a140b9370 0x7f7a140b9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a19c17640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1406d190 con 0x7f79fc003f40 2024-09-15T23:54:38.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a19c17640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7a140d1930 con 0x7f7a140b50c0 2024-09-15T23:54:38.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a19c17640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7a140cf880 con 0x7f7a140b9370 2024-09-15T23:54:38.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a137fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79fc003f40 0x7f7a14154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a137fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79fc003f40 0x7f7a14154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50174/0 (socket says 172.21.15.112:50174) 2024-09-15T23:54:38.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a137fe640 1 -- 172.21.15.112:0/290774971 learned_addr learned my addr 172.21.15.112:0/290774971 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:38.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a12ffd640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a140b50c0 0x7f7a140b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a13fff640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a140b9370 0x7f7a140b9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a137fe640 1 -- 172.21.15.112:0/290774971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a140b9370 msgr2=0x7f7a140b9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a137fe640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a140b9370 0x7f7a140b9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a137fe640 1 -- 172.21.15.112:0/290774971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a140b50c0 msgr2=0x7f7a140b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:38.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a137fe640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a140b50c0 0x7f7a140b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:38.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a137fe640 1 -- 172.21.15.112:0/290774971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a140cca90 con 0x7f79fc003f40 2024-09-15T23:54:38.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a12ffd640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a140b50c0 0x7f7a140b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:38.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a13fff640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a140b9370 0x7f7a140b9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:38.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a137fe640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79fc003f40 0x7f7a14154640 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7a04011660 tx=0x7f7a04011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:38.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f79fbfff640 1 -- 172.21.15.112:0/290774971 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0400f9c0 con 0x7f79fc003f40 2024-09-15T23:54:38.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f79fbfff640 1 -- 172.21.15.112:0/290774971 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a0400fb60 con 0x7f79fc003f40 2024-09-15T23:54:38.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a19c17640 1 -- 172.21.15.112:0/290774971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a140ccd70 con 0x7f79fc003f40 2024-09-15T23:54:38.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f79fbfff640 1 -- 172.21.15.112:0/290774971 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a04015460 con 0x7f79fc003f40 2024-09-15T23:54:38.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a19c17640 1 -- 172.21.15.112:0/290774971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a140cd330 con 0x7f79fc003f40 2024-09-15T23:54:38.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a19c17640 1 -- 172.21.15.112:0/290774971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a140d3270 con 0x7f79fc003f40 2024-09-15T23:54:38.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f79fbfff640 1 -- 172.21.15.112:0/290774971 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a04015600 con 0x7f79fc003f40 2024-09-15T23:54:38.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f79fbfff640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7a000678c0 0x7f7a00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:38.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f79fbfff640 1 -- 172.21.15.112:0/290774971 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f7a04086560 con 0x7f79fc003f40 2024-09-15T23:54:38.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a12ffd640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7a000678c0 0x7f7a00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:38.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.824+0000 7f7a12ffd640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7a000678c0 0x7f7a00069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7a080af000 tx=0x7f7a080046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:38.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:38.828+0000 7f79fbfff640 1 -- 172.21.15.112:0/290774971 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a04019030 con 0x7f79fc003f40 2024-09-15T23:54:39.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.052+0000 7f7a19c17640 1 -- 172.21.15.112:0/290774971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f7a140b2f00 con 0x7f79fc003f40 2024-09-15T23:54:39.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.056+0000 7f79fbfff640 1 -- 172.21.15.112:0/290774971 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f7a04057260 con 0x7f79fc003f40 2024-09-15T23:54:39.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.056+0000 7f7a19c17640 1 -- 172.21.15.112:0/290774971 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7a000678c0 msgr2=0x7f7a00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.056+0000 7f7a19c17640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7a000678c0 0x7f7a00069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7a080af000 tx=0x7f7a080046d0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.056+0000 7f7a19c17640 1 -- 172.21.15.112:0/290774971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79fc003f40 msgr2=0x7f7a14154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.056+0000 7f7a19c17640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79fc003f40 0x7f7a14154640 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7a04011660 tx=0x7f7a04011b20 comp rx=0 tx=0).stop 2024-09-15T23:54:39.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.056+0000 7f7a19c17640 1 -- 172.21.15.112:0/290774971 shutdown_connections 2024-09-15T23:54:39.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.056+0000 7f7a19c17640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7a000678c0 0x7f7a00069d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.056+0000 7f7a19c17640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a140b9370 0x7f7a140b9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.056+0000 7f7a19c17640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a140b50c0 0x7f7a140b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.056+0000 7f7a19c17640 1 --2- 172.21.15.112:0/290774971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79fc003f40 0x7f7a14154640 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.056+0000 7f7a19c17640 1 -- 172.21.15.112:0/290774971 >> 172.21.15.112:0/290774971 conn(0x7f7a1408bf90 msgr2=0x7f7a141604e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:39.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.056+0000 7f7a19c17640 1 -- 172.21.15.112:0/290774971 shutdown_connections 2024-09-15T23:54:39.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.056+0000 7f7a19c17640 1 -- 172.21.15.112:0/290774971 wait complete. 2024-09-15T23:54:39.078 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-15T23:54:39.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbffe2d640 1 Processor -- start 2024-09-15T23:54:39.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbffe2d640 1 -- start start 2024-09-15T23:54:39.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbffe2d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbf815bec0 0x7fbbf80ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbffe2d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbbf815c2a0 0x7fbbf80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbffe2d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbf80b3290 con 0x7fbbf80af2a0 2024-09-15T23:54:39.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbffe2d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbbf80b3570 con 0x7fbbf815c2a0 2024-09-15T23:54:39.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbffe2d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf80b3850 con 0x7fbbf815bec0 2024-09-15T23:54:39.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbfd3c8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbbf815c2a0 0x7fbbf80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbfd3c8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbbf815c2a0 0x7fbbf80aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50188/0 (socket says 172.21.15.112:50188) 2024-09-15T23:54:39.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbfd3c8640 1 -- 172.21.15.112:0/3507788246 learned_addr learned my addr 172.21.15.112:0/3507788246 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:39.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbfdbc9640 1 --2- 172.21.15.112:0/3507788246 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbf815bec0 0x7fbbf80ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbfd3c8640 1 -- 172.21.15.112:0/3507788246 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbf815bec0 msgr2=0x7fbbf80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:39.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbfd3c8640 1 --2- 172.21.15.112:0/3507788246 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbf815bec0 0x7fbbf80ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbfd3c8640 1 -- 172.21.15.112:0/3507788246 >> v1:172.21.15.169:6789/0 conn(0x7fbbf80af2a0 legacy=0x7fbbf815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.200+0000 7fbbfd3c8640 1 -- 172.21.15.112:0/3507788246 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf80b3b30 con 0x7fbbf815c2a0 2024-09-15T23:54:39.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbfd3c8640 1 --2- 172.21.15.112:0/3507788246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbf815c2a0 0x7fbbf80aed60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009870 tx=0x7fbbe801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f07e0d7608bf36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:39.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbfcbc7640 1 -- 172.21.15.112:0/3507788246 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe80a95f0 con 0x7fbbf815c2a0 2024-09-15T23:54:39.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbfcbc7640 1 -- 172.21.15.112:0/3507788246 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe80a9790 con 0x7fbbf815c2a0 2024-09-15T23:54:39.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbfcbc7640 1 -- 172.21.15.112:0/3507788246 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe80a9b60 con 0x7fbbf815c2a0 2024-09-15T23:54:39.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 -- 172.21.15.112:0/3507788246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbf815c2a0 msgr2=0x7fbbf80aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 --2- 172.21.15.112:0/3507788246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbf815c2a0 0x7fbbf80aed60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009870 tx=0x7fbbe801c530 comp rx=0 tx=0).stop 2024-09-15T23:54:39.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 -- 172.21.15.112:0/3507788246 shutdown_connections 2024-09-15T23:54:39.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 --2- 172.21.15.112:0/3507788246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbf815c2a0 0x7fbbf80aed60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 --2- 172.21.15.112:0/3507788246 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbf815bec0 0x7fbbf80ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 -- 172.21.15.112:0/3507788246 >> 172.21.15.112:0/3507788246 conn(0x7fbbf80b1f90 msgr2=0x7fbbf80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:39.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 -- 172.21.15.112:0/3507788246 shutdown_connections 2024-09-15T23:54:39.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 -- 172.21.15.112:0/3507788246 wait complete. 2024-09-15T23:54:39.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 Processor -- start 2024-09-15T23:54:39.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 -- start start 2024-09-15T23:54:39.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbf80af2a0 0x7fbbf81f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbf815bec0 0x7fbbf81507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbf815c2a0 0x7fbbf81f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf80af6b0 con 0x7fbbf80af2a0 2024-09-15T23:54:39.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf80ad740 con 0x7fbbf815bec0 2024-09-15T23:54:39.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbffe2d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf8169000 con 0x7fbbf815c2a0 2024-09-15T23:54:39.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbfdbc9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbf80af2a0 0x7fbbf81f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbfdbc9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbf80af2a0 0x7fbbf81f69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50192/0 (socket says 172.21.15.112:50192) 2024-09-15T23:54:39.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbfdbc9640 1 -- 172.21.15.112:0/1596689766 learned_addr learned my addr 172.21.15.112:0/1596689766 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:39.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbfd3c8640 1 --2- 172.21.15.112:0/1596689766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbf815bec0 0x7fbbf81507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbfe3ca640 1 --2- 172.21.15.112:0/1596689766 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbf815c2a0 0x7fbbf81f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbfdbc9640 1 -- 172.21.15.112:0/1596689766 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbf815c2a0 msgr2=0x7fbbf81f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbfdbc9640 1 --2- 172.21.15.112:0/1596689766 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbf815c2a0 0x7fbbf81f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbfdbc9640 1 -- 172.21.15.112:0/1596689766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbf815bec0 msgr2=0x7fbbf81507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbfdbc9640 1 --2- 172.21.15.112:0/1596689766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbf815bec0 0x7fbbf81507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.204+0000 7fbbfdbc9640 1 -- 172.21.15.112:0/1596689766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf8068e50 con 0x7fbbf80af2a0 2024-09-15T23:54:39.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.208+0000 7fbbfdbc9640 1 --2- 172.21.15.112:0/1596689766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbf80af2a0 0x7fbbf81f69b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400d800 tx=0x7fbbf400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:39.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.208+0000 7fbbee7fc640 1 -- 172.21.15.112:0/1596689766 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400b6c0 con 0x7fbbf80af2a0 2024-09-15T23:54:39.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.208+0000 7fbbee7fc640 1 -- 172.21.15.112:0/1596689766 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf4019070 con 0x7fbbf80af2a0 2024-09-15T23:54:39.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.208+0000 7fbbee7fc640 1 -- 172.21.15.112:0/1596689766 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400ba60 con 0x7fbbf80af2a0 2024-09-15T23:54:39.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.208+0000 7fbbffe2d640 1 -- 172.21.15.112:0/1596689766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf81f6f90 con 0x7fbbf80af2a0 2024-09-15T23:54:39.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.208+0000 7fbbffe2d640 1 -- 172.21.15.112:0/1596689766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf81f7550 con 0x7fbbf80af2a0 2024-09-15T23:54:39.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.208+0000 7fbbffe2d640 1 -- 172.21.15.112:0/1596689766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf80ad200 con 0x7fbbf80af2a0 2024-09-15T23:54:39.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.208+0000 7fbbee7fc640 1 -- 172.21.15.112:0/1596689766 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbbf400bc00 con 0x7fbbf80af2a0 2024-09-15T23:54:39.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.208+0000 7fbbee7fc640 1 --2- 172.21.15.112:0/1596689766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbbdc0678c0 0x7fbbdc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.208+0000 7fbbee7fc640 1 -- 172.21.15.112:0/1596689766 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fbbf4085f90 con 0x7fbbf80af2a0 2024-09-15T23:54:39.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.208+0000 7fbbfd3c8640 1 --2- 172.21.15.112:0/1596689766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbbdc0678c0 0x7fbbdc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.208+0000 7fbbfd3c8640 1 --2- 172.21.15.112:0/1596689766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbbdc0678c0 0x7fbbdc069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80ae000 tx=0x7fbbe80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:39.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.212+0000 7fbbee7fc640 1 -- 172.21.15.112:0/1596689766 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbbf4056c90 con 0x7fbbf80af2a0 2024-09-15T23:54:39.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.424+0000 7fbbffe2d640 1 -- 172.21.15.112:0/1596689766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fbbf806fcd0 con 0x7fbbf80af2a0 2024-09-15T23:54:39.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.428+0000 7fbbee7fc640 1 -- 172.21.15.112:0/1596689766 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fbbf4056590 con 0x7fbbf80af2a0 2024-09-15T23:54:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.428+0000 7fbbffe2d640 1 -- 172.21.15.112:0/1596689766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbbdc0678c0 msgr2=0x7fbbdc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.428+0000 7fbbffe2d640 1 --2- 172.21.15.112:0/1596689766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbbdc0678c0 0x7fbbdc069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80ae000 tx=0x7fbbe80a7000 comp rx=0 tx=0).stop 2024-09-15T23:54:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.428+0000 7fbbffe2d640 1 -- 172.21.15.112:0/1596689766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbf80af2a0 msgr2=0x7fbbf81f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.428+0000 7fbbffe2d640 1 --2- 172.21.15.112:0/1596689766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbf80af2a0 0x7fbbf81f69b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400d800 tx=0x7fbbf400dcc0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.428+0000 7fbbffe2d640 1 -- 172.21.15.112:0/1596689766 shutdown_connections 2024-09-15T23:54:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.428+0000 7fbbffe2d640 1 --2- 172.21.15.112:0/1596689766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbbdc0678c0 0x7fbbdc069d80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.428+0000 7fbbffe2d640 1 --2- 172.21.15.112:0/1596689766 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbf815c2a0 0x7fbbf81f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.428+0000 7fbbffe2d640 1 --2- 172.21.15.112:0/1596689766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbf815bec0 0x7fbbf81507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.428+0000 7fbbffe2d640 1 --2- 172.21.15.112:0/1596689766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbbf80af2a0 0x7fbbf81f69b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.428+0000 7fbbffe2d640 1 -- 172.21.15.112:0/1596689766 >> 172.21.15.112:0/1596689766 conn(0x7fbbf80b1f90 msgr2=0x7fbbf815b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:39.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.428+0000 7fbbffe2d640 1 -- 172.21.15.112:0/1596689766 shutdown_connections 2024-09-15T23:54:39.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.428+0000 7fbbffe2d640 1 -- 172.21.15.112:0/1596689766 wait complete. 2024-09-15T23:54:39.449 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-15T23:54:39.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.560+0000 7f63a0de0640 1 Processor -- start 2024-09-15T23:54:39.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.560+0000 7f63a0de0640 1 -- start start 2024-09-15T23:54:39.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.560+0000 7f63a0de0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f639c144b50 0x7f639c0b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.560+0000 7f63a0de0640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f639c070f50 con 0x7f639c0b4d60 2024-09-15T23:54:39.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.560+0000 7f63a0de0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f639c0706b0 con 0x7f639c070090 2024-09-15T23:54:39.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.560+0000 7f63a0de0640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f639c0b51d0 con 0x7f639c144b50 2024-09-15T23:54:39.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.560+0000 7f6399d9b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f639c0b4d60 0x7f639c06f980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59698/0 (socket says 172.21.15.112:59698) 2024-09-15T23:54:39.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.560+0000 7f639a59c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f639c144b50 0x7f639c0b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.560+0000 7f6399d9b640 1 -- 172.21.15.112:0/3654007295 learned_addr learned my addr 172.21.15.112:0/3654007295 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:39.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.560+0000 7f639a59c640 1 -- 172.21.15.112:0/3654007295 >> v1:172.21.15.169:6789/0 conn(0x7f639c070090 legacy=0x7f639c0aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:39.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.560+0000 7f639a59c640 1 -- 172.21.15.112:0/3654007295 >> v1:172.21.15.112:6789/0 conn(0x7f639c0b4d60 legacy=0x7f639c06f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.560+0000 7f639959a640 1 -- 172.21.15.112:0/3654007295 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134197025 0 0) 0x7f639c070f50 con 0x7f639c0b4d60 2024-09-15T23:54:39.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.560+0000 7f639a59c640 1 -- 172.21.15.112:0/3654007295 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639c070990 con 0x7f639c144b50 2024-09-15T23:54:39.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f639a59c640 1 --2- 172.21.15.112:0/3654007295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f639c144b50 0x7f639c0b4820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f638c0097c0 tx=0x7f638c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897fccca24bee8f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:39.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f639959a640 1 -- 172.21.15.112:0/3654007295 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c0b0070 con 0x7f639c144b50 2024-09-15T23:54:39.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f639959a640 1 -- 172.21.15.112:0/3654007295 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638c0ab600 con 0x7f639c144b50 2024-09-15T23:54:39.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f639959a640 1 -- 172.21.15.112:0/3654007295 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c0ab9d0 con 0x7f639c144b50 2024-09-15T23:54:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 -- 172.21.15.112:0/3654007295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f639c144b50 msgr2=0x7f639c0b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 --2- 172.21.15.112:0/3654007295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f639c144b50 0x7f639c0b4820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f638c0097c0 tx=0x7f638c01c460 comp rx=0 tx=0).stop 2024-09-15T23:54:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 -- 172.21.15.112:0/3654007295 shutdown_connections 2024-09-15T23:54:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 --2- 172.21.15.112:0/3654007295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f639c144b50 0x7f639c0b4820 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 -- 172.21.15.112:0/3654007295 >> 172.21.15.112:0/3654007295 conn(0x7f639c0b6650 msgr2=0x7f639c0b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 -- 172.21.15.112:0/3654007295 shutdown_connections 2024-09-15T23:54:39.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 -- 172.21.15.112:0/3654007295 wait complete. 2024-09-15T23:54:39.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 Processor -- start 2024-09-15T23:54:39.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 -- start start 2024-09-15T23:54:39.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f639c070090 0x7f639c14b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f639c0b4d60 0x7f639c15d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f639c144b50 0x7f639c0b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f639c0b0000 con 0x7f639c144b50 2024-09-15T23:54:39.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f639c0afe80 con 0x7f639c0b4d60 2024-09-15T23:54:39.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f63a0de0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f639c168e60 con 0x7f639c070090 2024-09-15T23:54:39.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f639ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f639c144b50 0x7f639c0b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f639ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f639c144b50 0x7f639c0b2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50200/0 (socket says 172.21.15.112:50200) 2024-09-15T23:54:39.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f639ad9d640 1 -- 172.21.15.112:0/2253901553 learned_addr learned my addr 172.21.15.112:0/2253901553 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:39.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f639a59c640 1 --2- 172.21.15.112:0/2253901553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f639c070090 0x7f639c14b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f6399d9b640 1 --2- 172.21.15.112:0/2253901553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f639c0b4d60 0x7f639c15d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f639ad9d640 1 -- 172.21.15.112:0/2253901553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f639c070090 msgr2=0x7f639c14b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f639ad9d640 1 --2- 172.21.15.112:0/2253901553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f639c070090 0x7f639c14b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f639ad9d640 1 -- 172.21.15.112:0/2253901553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f639c0b4d60 msgr2=0x7f639c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f639ad9d640 1 --2- 172.21.15.112:0/2253901553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f639c0b4d60 0x7f639c15d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f639ad9d640 1 -- 172.21.15.112:0/2253901553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639c15e100 con 0x7f639c144b50 2024-09-15T23:54:39.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f639ad9d640 1 --2- 172.21.15.112:0/2253901553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f639c144b50 0x7f639c0b2f90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f639400c780 tx=0x7f639400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:39.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.564+0000 7f638affd640 1 -- 172.21.15.112:0/2253901553 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6394004b70 con 0x7f639c144b50 2024-09-15T23:54:39.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.568+0000 7f638affd640 1 -- 172.21.15.112:0/2253901553 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6394004d10 con 0x7f639c144b50 2024-09-15T23:54:39.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.568+0000 7f63a0de0640 1 -- 172.21.15.112:0/2253901553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639c15e3e0 con 0x7f639c144b50 2024-09-15T23:54:39.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.568+0000 7f638affd640 1 -- 172.21.15.112:0/2253901553 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639400aa90 con 0x7f639c144b50 2024-09-15T23:54:39.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.568+0000 7f63a0de0640 1 -- 172.21.15.112:0/2253901553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f639c15e9a0 con 0x7f639c144b50 2024-09-15T23:54:39.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.568+0000 7f63a0de0640 1 -- 172.21.15.112:0/2253901553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f639c0b4820 con 0x7f639c144b50 2024-09-15T23:54:39.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.568+0000 7f638affd640 1 -- 172.21.15.112:0/2253901553 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f639400ac30 con 0x7f639c144b50 2024-09-15T23:54:39.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.568+0000 7f638affd640 1 --2- 172.21.15.112:0/2253901553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f637c0678c0 0x7f637c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.568+0000 7f638affd640 1 -- 172.21.15.112:0/2253901553 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f6394085e20 con 0x7f639c144b50 2024-09-15T23:54:39.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.568+0000 7f639a59c640 1 --2- 172.21.15.112:0/2253901553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f637c0678c0 0x7f637c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.568+0000 7f639a59c640 1 --2- 172.21.15.112:0/2253901553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f637c0678c0 0x7f637c069d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f638c0ad000 tx=0x7f638c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:39.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.572+0000 7f638affd640 1 -- 172.21.15.112:0/2253901553 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6394020070 con 0x7f639c144b50 2024-09-15T23:54:39.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.792+0000 7f63a0de0640 1 -- 172.21.15.112:0/2253901553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f639c0d1850 con 0x7f639c144b50 2024-09-15T23:54:39.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.796+0000 7f638affd640 1 -- 172.21.15.112:0/2253901553 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f6394056a90 con 0x7f639c144b50 2024-09-15T23:54:39.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.796+0000 7f63a0de0640 1 -- 172.21.15.112:0/2253901553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f637c0678c0 msgr2=0x7f637c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.796+0000 7f63a0de0640 1 --2- 172.21.15.112:0/2253901553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f637c0678c0 0x7f637c069d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f638c0ad000 tx=0x7f638c0a6000 comp rx=0 tx=0).stop 2024-09-15T23:54:39.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.796+0000 7f63a0de0640 1 -- 172.21.15.112:0/2253901553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f639c144b50 msgr2=0x7f639c0b2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.796+0000 7f63a0de0640 1 --2- 172.21.15.112:0/2253901553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f639c144b50 0x7f639c0b2f90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f639400c780 tx=0x7f639400cc40 comp rx=0 tx=0).stop 2024-09-15T23:54:39.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.796+0000 7f63a0de0640 1 -- 172.21.15.112:0/2253901553 shutdown_connections 2024-09-15T23:54:39.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.796+0000 7f63a0de0640 1 --2- 172.21.15.112:0/2253901553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f637c0678c0 0x7f637c069d80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.796+0000 7f63a0de0640 1 --2- 172.21.15.112:0/2253901553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f639c144b50 0x7f639c0b2f90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.796+0000 7f63a0de0640 1 --2- 172.21.15.112:0/2253901553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f639c0b4d60 0x7f639c15d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.796+0000 7f63a0de0640 1 --2- 172.21.15.112:0/2253901553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f639c070090 0x7f639c14b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.796+0000 7f63a0de0640 1 -- 172.21.15.112:0/2253901553 >> 172.21.15.112:0/2253901553 conn(0x7f639c0b6650 msgr2=0x7f639c13f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:39.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.796+0000 7f63a0de0640 1 -- 172.21.15.112:0/2253901553 shutdown_connections 2024-09-15T23:54:39.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.796+0000 7f63a0de0640 1 -- 172.21.15.112:0/2253901553 wait complete. 2024-09-15T23:54:39.818 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-15T23:54:39.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.924+0000 7fea026f9640 1 Processor -- start 2024-09-15T23:54:39.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.924+0000 7fea026f9640 1 -- start start 2024-09-15T23:54:39.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fea026f9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe9fc15bec0 0x7fe9fc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fea026f9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe9fc0af470 0x7fe9fc06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fea026f9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9fc0b3290 con 0x7fe9fc15c2a0 2024-09-15T23:54:39.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fea026f9640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe9fc0b3570 con 0x7fe9fc15bec0 2024-09-15T23:54:39.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fea026f9640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe9fc0b3850 con 0x7fe9fc0af470 2024-09-15T23:54:39.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fe9fbfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe9fc15bec0 0x7fe9fc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fe9fbfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe9fc15bec0 0x7fe9fc0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50202/0 (socket says 172.21.15.112:50202) 2024-09-15T23:54:39.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fe9fbfff640 1 -- 172.21.15.112:0/164256827 learned_addr learned my addr 172.21.15.112:0/164256827 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:39.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fe9fbfff640 1 -- 172.21.15.112:0/164256827 >> v2:172.21.15.169:3300/0 conn(0x7fe9fc0af470 msgr2=0x7fe9fc06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:39.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fea00c96640 1 --2- 172.21.15.112:0/164256827 >> v2:172.21.15.169:3300/0 conn(0x7fe9fc0af470 0x7fe9fc06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fe9fbfff640 1 --2- 172.21.15.112:0/164256827 >> v2:172.21.15.169:3300/0 conn(0x7fe9fc0af470 0x7fe9fc06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fe9fbfff640 1 -- 172.21.15.112:0/164256827 >> v1:172.21.15.169:6789/0 conn(0x7fe9fc15c2a0 legacy=0x7fe9fc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:39.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fe9fbfff640 1 -- 172.21.15.112:0/164256827 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc0b3b30 con 0x7fe9fc15bec0 2024-09-15T23:54:39.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fe9fbfff640 1 --2- 172.21.15.112:0/164256827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9fc15bec0 0x7fe9fc0ad200 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0b2fb0 tx=0x7fe9ec01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3271285bfc5d75a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:39.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fe9fb7fe640 1 -- 172.21.15.112:0/164256827 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec0b1070 con 0x7fe9fc15bec0 2024-09-15T23:54:39.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fe9fb7fe640 1 -- 172.21.15.112:0/164256827 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ec0ac620 con 0x7fe9fc15bec0 2024-09-15T23:54:39.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fe9fb7fe640 1 -- 172.21.15.112:0/164256827 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec0ac9f0 con 0x7fe9fc15bec0 2024-09-15T23:54:39.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fea026f9640 1 -- 172.21.15.112:0/164256827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9fc15bec0 msgr2=0x7fe9fc0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fea026f9640 1 --2- 172.21.15.112:0/164256827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9fc15bec0 0x7fe9fc0ad200 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0b2fb0 tx=0x7fe9ec01c4b0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fea026f9640 1 -- 172.21.15.112:0/164256827 shutdown_connections 2024-09-15T23:54:39.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fea026f9640 1 --2- 172.21.15.112:0/164256827 >> v2:172.21.15.169:3300/0 conn(0x7fe9fc0af470 0x7fe9fc06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fea026f9640 1 --2- 172.21.15.112:0/164256827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9fc15bec0 0x7fe9fc0ad200 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fea026f9640 1 -- 172.21.15.112:0/164256827 >> 172.21.15.112:0/164256827 conn(0x7fe9fc0b1f90 msgr2=0x7fe9fc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:39.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fea026f9640 1 -- 172.21.15.112:0/164256827 shutdown_connections 2024-09-15T23:54:39.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.928+0000 7fea026f9640 1 -- 172.21.15.112:0/164256827 wait complete. 2024-09-15T23:54:39.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea026f9640 1 Processor -- start 2024-09-15T23:54:39.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea026f9640 1 -- start start 2024-09-15T23:54:39.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea026f9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9fc0af470 0x7fe9fc152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea026f9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9fc15bec0 0x7fe9fc149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea026f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9fc15c2a0 0x7fe9fc0737f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea026f9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc06ed50 con 0x7fe9fc15c2a0 2024-09-15T23:54:39.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea026f9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc0ad740 con 0x7fe9fc15bec0 2024-09-15T23:54:39.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea026f9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe9fc06eed0 con 0x7fe9fc0af470 2024-09-15T23:54:39.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea00c96640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9fc15c2a0 0x7fe9fc0737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea00c96640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9fc15c2a0 0x7fe9fc0737f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50210/0 (socket says 172.21.15.112:50210) 2024-09-15T23:54:39.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea00c96640 1 -- 172.21.15.112:0/283501373 learned_addr learned my addr 172.21.15.112:0/283501373 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:39.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fe9f37fe640 1 --2- 172.21.15.112:0/283501373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9fc15bec0 0x7fe9fc149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fe9fbfff640 1 --2- 172.21.15.112:0/283501373 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9fc0af470 0x7fe9fc152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea00c96640 1 -- 172.21.15.112:0/283501373 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9fc0af470 msgr2=0x7fe9fc152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea00c96640 1 --2- 172.21.15.112:0/283501373 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9fc0af470 0x7fe9fc152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea00c96640 1 -- 172.21.15.112:0/283501373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9fc15bec0 msgr2=0x7fe9fc149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:39.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea00c96640 1 --2- 172.21.15.112:0/283501373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9fc15bec0 0x7fe9fc149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:39.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea00c96640 1 -- 172.21.15.112:0/283501373 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc1662e0 con 0x7fe9fc15c2a0 2024-09-15T23:54:39.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea00c96640 1 --2- 172.21.15.112:0/283501373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9fc15c2a0 0x7fe9fc0737f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400cda0 tx=0x7fe9f400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:39.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fe9f97fa640 1 -- 172.21.15.112:0/283501373 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4003ba0 con 0x7fe9fc15c2a0 2024-09-15T23:54:39.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fe9f97fa640 1 -- 172.21.15.112:0/283501373 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f4003d40 con 0x7fe9fc15c2a0 2024-09-15T23:54:39.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea026f9640 1 -- 172.21.15.112:0/283501373 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9fc166580 con 0x7fe9fc15c2a0 2024-09-15T23:54:39.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fe9f97fa640 1 -- 172.21.15.112:0/283501373 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4004240 con 0x7fe9fc15c2a0 2024-09-15T23:54:39.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea026f9640 1 -- 172.21.15.112:0/283501373 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9fc071fb0 con 0x7fe9fc15c2a0 2024-09-15T23:54:39.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fea026f9640 1 -- 172.21.15.112:0/283501373 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9fc06e000 con 0x7fe9fc15c2a0 2024-09-15T23:54:39.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fe9f97fa640 1 -- 172.21.15.112:0/283501373 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9f40043e0 con 0x7fe9fc15c2a0 2024-09-15T23:54:39.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fe9f97fa640 1 --2- 172.21.15.112:0/283501373 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9dc0678c0 0x7fe9dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:39.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fe9f97fa640 1 -- 172.21.15.112:0/283501373 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fe9f4086500 con 0x7fe9fc15c2a0 2024-09-15T23:54:39.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.932+0000 7fe9fbfff640 1 --2- 172.21.15.112:0/283501373 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9dc0678c0 0x7fe9dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:39.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.936+0000 7fe9fbfff640 1 --2- 172.21.15.112:0/283501373 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9dc0678c0 0x7fe9dc069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0ae000 tx=0x7fe9ec0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:39.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:39.936+0000 7fe9f97fa640 1 -- 172.21.15.112:0/283501373 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe9f4057290 con 0x7fe9fc15c2a0 2024-09-15T23:54:40.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.152+0000 7fea026f9640 1 -- 172.21.15.112:0/283501373 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fe9fc06fcd0 con 0x7fe9fc15c2a0 2024-09-15T23:54:40.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.156+0000 7fe9f97fa640 1 -- 172.21.15.112:0/283501373 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fe9f4056b90 con 0x7fe9fc15c2a0 2024-09-15T23:54:40.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.156+0000 7fea026f9640 1 -- 172.21.15.112:0/283501373 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9dc0678c0 msgr2=0x7fe9dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:40.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.156+0000 7fea026f9640 1 --2- 172.21.15.112:0/283501373 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9dc0678c0 0x7fe9dc069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0ae000 tx=0x7fe9ec0a7000 comp rx=0 tx=0).stop 2024-09-15T23:54:40.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.156+0000 7fea026f9640 1 -- 172.21.15.112:0/283501373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9fc15c2a0 msgr2=0x7fe9fc0737f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:40.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.156+0000 7fea026f9640 1 --2- 172.21.15.112:0/283501373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9fc15c2a0 0x7fe9fc0737f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400cda0 tx=0x7fe9f400a660 comp rx=0 tx=0).stop 2024-09-15T23:54:40.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.156+0000 7fea026f9640 1 -- 172.21.15.112:0/283501373 shutdown_connections 2024-09-15T23:54:40.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.156+0000 7fea026f9640 1 --2- 172.21.15.112:0/283501373 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9dc0678c0 0x7fe9dc069d80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.156+0000 7fea026f9640 1 --2- 172.21.15.112:0/283501373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9fc15c2a0 0x7fe9fc0737f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.156+0000 7fea026f9640 1 --2- 172.21.15.112:0/283501373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9fc15bec0 0x7fe9fc149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.156+0000 7fea026f9640 1 --2- 172.21.15.112:0/283501373 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9fc0af470 0x7fe9fc152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.156+0000 7fea026f9640 1 -- 172.21.15.112:0/283501373 >> 172.21.15.112:0/283501373 conn(0x7fe9fc0b1f90 msgr2=0x7fe9fc15a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:40.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.156+0000 7fea026f9640 1 -- 172.21.15.112:0/283501373 shutdown_connections 2024-09-15T23:54:40.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.156+0000 7fea026f9640 1 -- 172.21.15.112:0/283501373 wait complete. 2024-09-15T23:54:40.177 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:54:40.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1abcda640 1 Processor -- start 2024-09-15T23:54:40.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1abcda640 1 -- start start 2024-09-15T23:54:40.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1abcda640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc1a41520a0 0x7fc1a406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:40.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1abcda640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc1a415f3a0 0x7fc1a40adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:40.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1abcda640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a4070250 con 0x7fc1a406fe50 2024-09-15T23:54:40.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1abcda640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc1a4152480 con 0x7fc1a41520a0 2024-09-15T23:54:40.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1abcda640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc1a40aede0 con 0x7fc1a415f3a0 2024-09-15T23:54:40.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1a9a76640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc1a41520a0 0x7fc1a406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:40.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1a9275640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc1a406fe50 0x7fc1a415ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59706/0 (socket says 172.21.15.112:59706) 2024-09-15T23:54:40.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1a9275640 1 -- 172.21.15.112:0/3465654401 learned_addr learned my addr 172.21.15.112:0/3465654401 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:40.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1aa277640 1 --2- 172.21.15.112:0/3465654401 >> v2:172.21.15.169:3300/0 conn(0x7fc1a415f3a0 0x7fc1a40adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:40.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1a9a76640 1 -- 172.21.15.112:0/3465654401 >> v2:172.21.15.169:3300/0 conn(0x7fc1a415f3a0 msgr2=0x7fc1a40adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:40.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1a9a76640 1 --2- 172.21.15.112:0/3465654401 >> v2:172.21.15.169:3300/0 conn(0x7fc1a415f3a0 0x7fc1a40adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1a9a76640 1 -- 172.21.15.112:0/3465654401 >> v1:172.21.15.112:6789/0 conn(0x7fc1a406fe50 legacy=0x7fc1a415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:40.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1a8a74640 1 -- 172.21.15.112:0/3465654401 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2164671766 0 0) 0x7fc1a4070250 con 0x7fc1a406fe50 2024-09-15T23:54:40.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.292+0000 7fc1a9a76640 1 -- 172.21.15.112:0/3465654401 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a415fa10 con 0x7fc1a41520a0 2024-09-15T23:54:40.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1a9a76640 1 --2- 172.21.15.112:0/3465654401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a41520a0 0x7fc1a406f910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4155b40 tx=0x7fc1a001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fabb30e0484ba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:40.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1a8a74640 1 -- 172.21.15.112:0/3465654401 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a00b0070 con 0x7fc1a41520a0 2024-09-15T23:54:40.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1a8a74640 1 -- 172.21.15.112:0/3465654401 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a00ab600 con 0x7fc1a41520a0 2024-09-15T23:54:40.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1a8a74640 1 -- 172.21.15.112:0/3465654401 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a00ab9d0 con 0x7fc1a41520a0 2024-09-15T23:54:40.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 -- 172.21.15.112:0/3465654401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a41520a0 msgr2=0x7fc1a406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:40.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 --2- 172.21.15.112:0/3465654401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a41520a0 0x7fc1a406f910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4155b40 tx=0x7fc1a001c480 comp rx=0 tx=0).stop 2024-09-15T23:54:40.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 -- 172.21.15.112:0/3465654401 shutdown_connections 2024-09-15T23:54:40.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 --2- 172.21.15.112:0/3465654401 >> v2:172.21.15.169:3300/0 conn(0x7fc1a415f3a0 0x7fc1a40adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 --2- 172.21.15.112:0/3465654401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a41520a0 0x7fc1a406f910 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 -- 172.21.15.112:0/3465654401 >> 172.21.15.112:0/3465654401 conn(0x7fc1a40b1f90 msgr2=0x7fc1a40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:40.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 -- 172.21.15.112:0/3465654401 shutdown_connections 2024-09-15T23:54:40.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 -- 172.21.15.112:0/3465654401 wait complete. 2024-09-15T23:54:40.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 Processor -- start 2024-09-15T23:54:40.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 -- start start 2024-09-15T23:54:40.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a406fe50 0x7fc1a40adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:40.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1a41520a0 0x7fc1a4145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:40.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a415f3a0 0x7fc1a40cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:40.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a4073d30 con 0x7fc1a406fe50 2024-09-15T23:54:40.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a4073a50 con 0x7fc1a41520a0 2024-09-15T23:54:40.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1abcda640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a4167f10 con 0x7fc1a415f3a0 2024-09-15T23:54:40.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1a9a76640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a406fe50 0x7fc1a40adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:40.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1a9a76640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a406fe50 0x7fc1a40adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50228/0 (socket says 172.21.15.112:50228) 2024-09-15T23:54:40.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1a9a76640 1 -- 172.21.15.112:0/2184901227 learned_addr learned my addr 172.21.15.112:0/2184901227 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:40.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1a9a76640 1 -- 172.21.15.112:0/2184901227 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a415f3a0 msgr2=0x7fc1a40cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:40.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1a9a76640 1 --2- 172.21.15.112:0/2184901227 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a415f3a0 0x7fc1a40cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1a9a76640 1 -- 172.21.15.112:0/2184901227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1a41520a0 msgr2=0x7fc1a4145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:40.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1a9a76640 1 --2- 172.21.15.112:0/2184901227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1a41520a0 0x7fc1a4145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1a9a76640 1 -- 172.21.15.112:0/2184901227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a41484b0 con 0x7fc1a406fe50 2024-09-15T23:54:40.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.296+0000 7fc1a9a76640 1 --2- 172.21.15.112:0/2184901227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a406fe50 0x7fc1a40adc40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc1a001a0b0 tx=0x7fc1a001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:40.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.300+0000 7fc19a7fc640 1 -- 172.21.15.112:0/2184901227 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a00b0050 con 0x7fc1a406fe50 2024-09-15T23:54:40.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.300+0000 7fc19a7fc640 1 -- 172.21.15.112:0/2184901227 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a00b1040 con 0x7fc1a406fe50 2024-09-15T23:54:40.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.300+0000 7fc1abcda640 1 -- 172.21.15.112:0/2184901227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a41464d0 con 0x7fc1a406fe50 2024-09-15T23:54:40.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.300+0000 7fc19a7fc640 1 -- 172.21.15.112:0/2184901227 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0004220 con 0x7fc1a406fe50 2024-09-15T23:54:40.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.300+0000 7fc1abcda640 1 -- 172.21.15.112:0/2184901227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a4146a90 con 0x7fc1a406fe50 2024-09-15T23:54:40.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.300+0000 7fc1abcda640 1 -- 172.21.15.112:0/2184901227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a406f910 con 0x7fc1a406fe50 2024-09-15T23:54:40.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.300+0000 7fc19a7fc640 1 -- 172.21.15.112:0/2184901227 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc1a00be060 con 0x7fc1a406fe50 2024-09-15T23:54:40.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.300+0000 7fc19a7fc640 1 --2- 172.21.15.112:0/2184901227 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc1880678c0 0x7fc188069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:40.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.300+0000 7fc19a7fc640 1 -- 172.21.15.112:0/2184901227 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fc1a011f540 con 0x7fc1a406fe50 2024-09-15T23:54:40.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.300+0000 7fc1a9275640 1 --2- 172.21.15.112:0/2184901227 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc1880678c0 0x7fc188069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:40.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.300+0000 7fc1a9275640 1 --2- 172.21.15.112:0/2184901227 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc1880678c0 0x7fc188069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc1940015a0 tx=0x7fc194007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:40.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.304+0000 7fc19a7fc640 1 -- 172.21.15.112:0/2184901227 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc1a0016070 con 0x7fc1a406fe50 2024-09-15T23:54:40.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.456+0000 7fc1abcda640 1 -- 172.21.15.112:0/2184901227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc1a415b030 con 0x7fc1a406fe50 2024-09-15T23:54:40.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.456+0000 7fc19a7fc640 1 -- 172.21.15.112:0/2184901227 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) ==== 84+0+65 (secure 0 0 0) 0x7fc1a00f0230 con 0x7fc1a406fe50 2024-09-15T23:54:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:40.461 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-15T23:54:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:54:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-15T23:54:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-15T23:54:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:40.461 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-15T23:54:40.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.460+0000 7fc1abcda640 1 -- 172.21.15.112:0/2184901227 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc1880678c0 msgr2=0x7fc188069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.460+0000 7fc1abcda640 1 --2- 172.21.15.112:0/2184901227 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc1880678c0 0x7fc188069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc1940015a0 tx=0x7fc194007970 comp rx=0 tx=0).stop 2024-09-15T23:54:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.460+0000 7fc1abcda640 1 -- 172.21.15.112:0/2184901227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a406fe50 msgr2=0x7fc1a40adc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.460+0000 7fc1abcda640 1 --2- 172.21.15.112:0/2184901227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a406fe50 0x7fc1a40adc40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc1a001a0b0 tx=0x7fc1a001acc0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.460+0000 7fc1abcda640 1 -- 172.21.15.112:0/2184901227 shutdown_connections 2024-09-15T23:54:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.460+0000 7fc1abcda640 1 --2- 172.21.15.112:0/2184901227 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc1880678c0 0x7fc188069d80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.460+0000 7fc1abcda640 1 --2- 172.21.15.112:0/2184901227 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a415f3a0 0x7fc1a40cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.460+0000 7fc1abcda640 1 --2- 172.21.15.112:0/2184901227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1a41520a0 0x7fc1a4145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.460+0000 7fc1abcda640 1 --2- 172.21.15.112:0/2184901227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a406fe50 0x7fc1a40adc40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.460+0000 7fc1abcda640 1 -- 172.21.15.112:0/2184901227 >> 172.21.15.112:0/2184901227 conn(0x7fc1a40b1f90 msgr2=0x7fc1a4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.460+0000 7fc1abcda640 1 -- 172.21.15.112:0/2184901227 shutdown_connections 2024-09-15T23:54:40.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.460+0000 7fc1abcda640 1 -- 172.21.15.112:0/2184901227 wait complete. 2024-09-15T23:54:40.478 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:54:40.478 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:54:40.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf5c19a640 1 Processor -- start 2024-09-15T23:54:40.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf5c19a640 1 -- start start 2024-09-15T23:54:40.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf5c19a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf541520a0 0x7fbf5406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:40.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf5c19a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbf5415f3a0 0x7fbf540adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:40.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf5c19a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf54070250 con 0x7fbf5406fe50 2024-09-15T23:54:40.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf5c19a640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbf54152480 con 0x7fbf541520a0 2024-09-15T23:54:40.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf5c19a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fbf540aede0 con 0x7fbf5415f3a0 2024-09-15T23:54:40.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf59f36640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf541520a0 0x7fbf5406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:40.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf59f36640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf541520a0 0x7fbf5406f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50242/0 (socket says 172.21.15.112:50242) 2024-09-15T23:54:40.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf59f36640 1 -- 172.21.15.112:0/1952072479 learned_addr learned my addr 172.21.15.112:0/1952072479 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:40.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf5a737640 1 --2- 172.21.15.112:0/1952072479 >> v2:172.21.15.169:3300/0 conn(0x7fbf5415f3a0 0x7fbf540adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:40.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf59f36640 1 -- 172.21.15.112:0/1952072479 >> v2:172.21.15.169:3300/0 conn(0x7fbf5415f3a0 msgr2=0x7fbf540adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:40.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf59f36640 1 --2- 172.21.15.112:0/1952072479 >> v2:172.21.15.169:3300/0 conn(0x7fbf5415f3a0 0x7fbf540adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf59f36640 1 -- 172.21.15.112:0/1952072479 >> v1:172.21.15.169:6789/0 conn(0x7fbf5406fe50 legacy=0x7fbf5415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:40.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.592+0000 7fbf59f36640 1 -- 172.21.15.112:0/1952072479 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5415fa10 con 0x7fbf541520a0 2024-09-15T23:54:40.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf59f36640 1 --2- 172.21.15.112:0/1952072479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf541520a0 0x7fbf5406f910 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbf54155b40 tx=0x7fbf5001ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43432873cf1e177a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:40.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf58f34640 1 -- 172.21.15.112:0/1952072479 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf500b4070 con 0x7fbf541520a0 2024-09-15T23:54:40.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf58f34640 1 -- 172.21.15.112:0/1952072479 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf500a7b70 con 0x7fbf541520a0 2024-09-15T23:54:40.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf58f34640 1 -- 172.21.15.112:0/1952072479 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf500af440 con 0x7fbf541520a0 2024-09-15T23:54:40.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 -- 172.21.15.112:0/1952072479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf541520a0 msgr2=0x7fbf5406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:40.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 --2- 172.21.15.112:0/1952072479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf541520a0 0x7fbf5406f910 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbf54155b40 tx=0x7fbf5001ebb0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 -- 172.21.15.112:0/1952072479 shutdown_connections 2024-09-15T23:54:40.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 --2- 172.21.15.112:0/1952072479 >> v2:172.21.15.169:3300/0 conn(0x7fbf5415f3a0 0x7fbf540adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 --2- 172.21.15.112:0/1952072479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf541520a0 0x7fbf5406f910 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 -- 172.21.15.112:0/1952072479 >> 172.21.15.112:0/1952072479 conn(0x7fbf540b1f90 msgr2=0x7fbf540b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:40.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 -- 172.21.15.112:0/1952072479 shutdown_connections 2024-09-15T23:54:40.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 -- 172.21.15.112:0/1952072479 wait complete. 2024-09-15T23:54:40.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 Processor -- start 2024-09-15T23:54:40.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 -- start start 2024-09-15T23:54:40.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf5406fe50 0x7fbf5414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:40.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf541520a0 0x7fbf5415b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:40.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf5415f3a0 0x7fbf54149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:40.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbf54073d30 con 0x7fbf5406fe50 2024-09-15T23:54:40.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbf54073a50 con 0x7fbf541520a0 2024-09-15T23:54:40.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbf5406e800 con 0x7fbf5415f3a0 2024-09-15T23:54:40.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf59f36640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf5406fe50 0x7fbf5414dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:40.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf59f36640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf5406fe50 0x7fbf5414dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50248/0 (socket says 172.21.15.112:50248) 2024-09-15T23:54:40.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf59f36640 1 -- 172.21.15.112:0/4100019377 learned_addr learned my addr 172.21.15.112:0/4100019377 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:40.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf59f36640 1 -- 172.21.15.112:0/4100019377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf5415f3a0 msgr2=0x7fbf54149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:40.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf59f36640 1 --2- 172.21.15.112:0/4100019377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf5415f3a0 0x7fbf54149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf59f36640 1 -- 172.21.15.112:0/4100019377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf541520a0 msgr2=0x7fbf5415b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:40.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf59f36640 1 --2- 172.21.15.112:0/4100019377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf541520a0 0x7fbf5415b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:40.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf59f36640 1 -- 172.21.15.112:0/4100019377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf540cff60 con 0x7fbf5406fe50 2024-09-15T23:54:40.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf59f36640 1 --2- 172.21.15.112:0/4100019377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf5406fe50 0x7fbf5414dd80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000b2c0 tx=0x7fbf5001b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:40.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf4a7fc640 1 -- 172.21.15.112:0/4100019377 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf500b4040 con 0x7fbf5406fe50 2024-09-15T23:54:40.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf4a7fc640 1 -- 172.21.15.112:0/4100019377 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf500c0070 con 0x7fbf5406fe50 2024-09-15T23:54:40.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 -- 172.21.15.112:0/4100019377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf540ce920 con 0x7fbf5406fe50 2024-09-15T23:54:40.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf4a7fc640 1 -- 172.21.15.112:0/4100019377 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf500ba420 con 0x7fbf5406fe50 2024-09-15T23:54:40.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.596+0000 7fbf5c19a640 1 -- 172.21.15.112:0/4100019377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf540ccf00 con 0x7fbf5406fe50 2024-09-15T23:54:40.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.600+0000 7fbf5c19a640 1 -- 172.21.15.112:0/4100019377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf540adc80 con 0x7fbf5406fe50 2024-09-15T23:54:40.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.600+0000 7fbf4a7fc640 1 -- 172.21.15.112:0/4100019377 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbf500ba5c0 con 0x7fbf5406fe50 2024-09-15T23:54:40.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.600+0000 7fbf4a7fc640 1 --2- 172.21.15.112:0/4100019377 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbf380678c0 0x7fbf38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:40.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.600+0000 7fbf4a7fc640 1 -- 172.21.15.112:0/4100019377 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fbf50122ee0 con 0x7fbf5406fe50 2024-09-15T23:54:40.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.600+0000 7fbf59735640 1 --2- 172.21.15.112:0/4100019377 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbf380678c0 0x7fbf38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:40.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.600+0000 7fbf59735640 1 --2- 172.21.15.112:0/4100019377 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbf380678c0 0x7fbf38069d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf5415c500 tx=0x7fbf44006bb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:40.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.604+0000 7fbf4a7fc640 1 -- 172.21.15.112:0/4100019377 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbf500187a0 con 0x7fbf5406fe50 2024-09-15T23:54:40.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:40.756+0000 7fbf5c19a640 1 -- 172.21.15.112:0/4100019377 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbf5406e540 con 0x7fbf5406fe50 2024-09-15T23:54:41.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.568+0000 7fbf4a7fc640 1 -- 172.21.15.112:0/4100019377 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) ==== 138+0+0 (secure 0 0 0) 0x7fbf500f3be0 con 0x7fbf5406fe50 2024-09-15T23:54:41.571 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-15T23:54:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.572+0000 7fbf5c19a640 1 -- 172.21.15.112:0/4100019377 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbf380678c0 msgr2=0x7fbf38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.572+0000 7fbf5c19a640 1 --2- 172.21.15.112:0/4100019377 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbf380678c0 0x7fbf38069d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf5415c500 tx=0x7fbf44006bb0 comp rx=0 tx=0).stop 2024-09-15T23:54:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.572+0000 7fbf5c19a640 1 -- 172.21.15.112:0/4100019377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf5406fe50 msgr2=0x7fbf5414dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.572+0000 7fbf5c19a640 1 --2- 172.21.15.112:0/4100019377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf5406fe50 0x7fbf5414dd80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000b2c0 tx=0x7fbf5001b950 comp rx=0 tx=0).stop 2024-09-15T23:54:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.572+0000 7fbf5c19a640 1 -- 172.21.15.112:0/4100019377 shutdown_connections 2024-09-15T23:54:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.572+0000 7fbf5c19a640 1 --2- 172.21.15.112:0/4100019377 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbf380678c0 0x7fbf38069d80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.572+0000 7fbf5c19a640 1 --2- 172.21.15.112:0/4100019377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf5415f3a0 0x7fbf54149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.572+0000 7fbf5c19a640 1 --2- 172.21.15.112:0/4100019377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf541520a0 0x7fbf5415b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.572+0000 7fbf5c19a640 1 --2- 172.21.15.112:0/4100019377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf5406fe50 0x7fbf5414dd80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.572+0000 7fbf5c19a640 1 -- 172.21.15.112:0/4100019377 >> 172.21.15.112:0/4100019377 conn(0x7fbf540b1f90 msgr2=0x7fbf540b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.572+0000 7fbf5c19a640 1 -- 172.21.15.112:0/4100019377 shutdown_connections 2024-09-15T23:54:41.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.572+0000 7fbf5c19a640 1 -- 172.21.15.112:0/4100019377 wait complete. 2024-09-15T23:54:41.603 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:54:41.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509c8a4640 1 Processor -- start 2024-09-15T23:54:41.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509c8a4640 1 -- start start 2024-09-15T23:54:41.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509c8a4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5098073100 0x7f50980cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:41.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509c8a4640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50980ce8d0 con 0x7f50980cc870 2024-09-15T23:54:41.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509c8a4640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50980cebb0 con 0x7f50980cdfd0 2024-09-15T23:54:41.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509c8a4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f50980cee90 con 0x7f5098073100 2024-09-15T23:54:41.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509659c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f50980cc870 0x7f50980ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59708/0 (socket says 172.21.15.112:59708) 2024-09-15T23:54:41.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509659c640 1 -- 172.21.15.112:0/940507314 learned_addr learned my addr 172.21.15.112:0/940507314 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:41.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 -- 172.21.15.112:0/940507314 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1829779225 0 0) 0x7f50980ce8d0 con 0x7f50980cc870 2024-09-15T23:54:41.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 -- 172.21.15.112:0/940507314 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5080003530 con 0x7f50980cc870 2024-09-15T23:54:41.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f5095d9b640 1 --2- 172.21.15.112:0/940507314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5098073100 0x7f50980cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:41.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 -- 172.21.15.112:0/940507314 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2064361964 0 0) 0x7f5080003530 con 0x7f50980cc870 2024-09-15T23:54:41.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 -- 172.21.15.112:0/940507314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5098073100 msgr2=0x7f50980cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:41.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 --2- 172.21.15.112:0/940507314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5098073100 0x7f50980cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:41.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 -- 172.21.15.112:0/940507314 >> v1:172.21.15.169:6789/0 conn(0x7f50980cdfd0 legacy=0x7f509806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 -- 172.21.15.112:0/940507314 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50980cf170 con 0x7f50980cc870 2024-09-15T23:54:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 -- 172.21.15.112:0/940507314 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f508c001680 con 0x7f50980cc870 2024-09-15T23:54:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 -- 172.21.15.112:0/940507314 >> v1:172.21.15.112:6789/0 conn(0x7f50980cc870 legacy=0x7f50980ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 --2- 172.21.15.112:0/940507314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50800039f0 0x7f5080003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 --2- 172.21.15.112:0/940507314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5098073100 0x7f5080004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 --2- 172.21.15.112:0/940507314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5080004d50 0x7f50800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 -- 172.21.15.112:0/940507314 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f50980cee90 con 0x7f5080004d50 2024-09-15T23:54:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 -- 172.21.15.112:0/940507314 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f508000ba80 con 0x7f50800039f0 2024-09-15T23:54:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509559a640 1 -- 172.21.15.112:0/940507314 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f508000bc80 con 0x7f5098073100 2024-09-15T23:54:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f5096d9d640 1 --2- 172.21.15.112:0/940507314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5080004d50 0x7f50800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:41.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f509659c640 1 --2- 172.21.15.112:0/940507314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50800039f0 0x7f5080003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:41.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f5095d9b640 1 --2- 172.21.15.112:0/940507314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5098073100 0x7f5080004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:41.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f5096d9d640 1 -- 172.21.15.112:0/940507314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5098073100 msgr2=0x7f5080004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:41.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f5096d9d640 1 --2- 172.21.15.112:0/940507314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5098073100 0x7f5080004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:41.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f5096d9d640 1 -- 172.21.15.112:0/940507314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50800039f0 msgr2=0x7f5080003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:41.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f5096d9d640 1 --2- 172.21.15.112:0/940507314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50800039f0 0x7f5080003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:41.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.728+0000 7f5096d9d640 1 -- 172.21.15.112:0/940507314 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5080003530 con 0x7f5080004d50 2024-09-15T23:54:41.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.732+0000 7f5096d9d640 1 --2- 172.21.15.112:0/940507314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5080004d50 0x7f50800051d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5090001e40 tx=0x7f509001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3763ba3e0c599e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:41.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.732+0000 7f509559a640 1 -- 172.21.15.112:0/940507314 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090001a90 con 0x7f5080004d50 2024-09-15T23:54:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.732+0000 7f509559a640 1 -- 172.21.15.112:0/940507314 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5090003b80 con 0x7f5080004d50 2024-09-15T23:54:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.732+0000 7f509559a640 1 -- 172.21.15.112:0/940507314 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090005080 con 0x7f5080004d50 2024-09-15T23:54:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.732+0000 7f509c8a4640 1 -- 172.21.15.112:0/940507314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5080004d50 msgr2=0x7f50800051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.732+0000 7f509c8a4640 1 --2- 172.21.15.112:0/940507314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5080004d50 0x7f50800051d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5090001e40 tx=0x7f509001c760 comp rx=0 tx=0).stop 2024-09-15T23:54:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.732+0000 7f5096d9d640 1 -- 172.21.15.112:0/940507314 reap_dead start 2024-09-15T23:54:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.732+0000 7f509c8a4640 1 -- 172.21.15.112:0/940507314 shutdown_connections 2024-09-15T23:54:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.732+0000 7f509c8a4640 1 -- 172.21.15.112:0/940507314 >> 172.21.15.112:0/940507314 conn(0x7f50980b1c80 msgr2=0x7f50980b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.732+0000 7f509c8a4640 1 -- 172.21.15.112:0/940507314 shutdown_connections 2024-09-15T23:54:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.732+0000 7f509c8a4640 1 -- 172.21.15.112:0/940507314 wait complete. 2024-09-15T23:54:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.732+0000 7f509c8a4640 1 Processor -- start 2024-09-15T23:54:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.732+0000 7f509c8a4640 1 -- start start 2024-09-15T23:54:41.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f509c8a4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5098141d80 0x7f509809d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f509c8a4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f509815dfd0 0x7f50980ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f509c8a4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f509809dc50 0x7f50980adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f509c8a4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5098145fd0 con 0x7f509809dc50 2024-09-15T23:54:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f509c8a4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5098145e50 con 0x7f5098141d80 2024-09-15T23:54:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f509c8a4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f50980ce430 con 0x7f509815dfd0 2024-09-15T23:54:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5096d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f509809dc50 0x7f50980adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5096d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f509809dc50 0x7f50980adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50278/0 (socket says 172.21.15.112:50278) 2024-09-15T23:54:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5096d9d640 1 -- 172.21.15.112:0/2719036350 learned_addr learned my addr 172.21.15.112:0/2719036350 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f509659c640 1 --2- 172.21.15.112:0/2719036350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5098141d80 0x7f509809d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5095d9b640 1 --2- 172.21.15.112:0/2719036350 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f509815dfd0 0x7f50980ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5096d9d640 1 -- 172.21.15.112:0/2719036350 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f509815dfd0 msgr2=0x7f50980ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:41.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5096d9d640 1 --2- 172.21.15.112:0/2719036350 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f509815dfd0 0x7f50980ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5096d9d640 1 -- 172.21.15.112:0/2719036350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5098141d80 msgr2=0x7f509809d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5096d9d640 1 --2- 172.21.15.112:0/2719036350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5098141d80 0x7f509809d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5096d9d640 1 -- 172.21.15.112:0/2719036350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509809b760 con 0x7f509809dc50 2024-09-15T23:54:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5096d9d640 1 --2- 172.21.15.112:0/2719036350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f509809dc50 0x7f50980adb30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f509001cc40 tx=0x7f5080005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5086ffd640 1 -- 172.21.15.112:0/2719036350 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090001a90 con 0x7f509809dc50 2024-09-15T23:54:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5086ffd640 1 -- 172.21.15.112:0/2719036350 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5090005820 con 0x7f509809dc50 2024-09-15T23:54:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f509c8a4640 1 -- 172.21.15.112:0/2719036350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509809ba00 con 0x7f509809dc50 2024-09-15T23:54:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5086ffd640 1 -- 172.21.15.112:0/2719036350 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090007dc0 con 0x7f509809dc50 2024-09-15T23:54:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f509c8a4640 1 -- 172.21.15.112:0/2719036350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509815e600 con 0x7f509809dc50 2024-09-15T23:54:41.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f509c8a4640 1 -- 172.21.15.112:0/2719036350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50980ce7b0 con 0x7f509809dc50 2024-09-15T23:54:41.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5086ffd640 1 -- 172.21.15.112:0/2719036350 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f50900ba060 con 0x7f509809dc50 2024-09-15T23:54:41.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5086ffd640 1 --2- 172.21.15.112:0/2719036350 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50780678c0 0x7f5078069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:41.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f5086ffd640 1 -- 172.21.15.112:0/2719036350 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5619+0+0 (secure 0 0 0) 0x7f509011efa0 con 0x7f509809dc50 2024-09-15T23:54:41.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f509659c640 1 --2- 172.21.15.112:0/2719036350 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50780678c0 0x7f5078069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:41.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.736+0000 7f509659c640 1 --2- 172.21.15.112:0/2719036350 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50780678c0 0x7f5078069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f50981f5e60 tx=0x7f508c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:41.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.740+0000 7f5086ffd640 1 -- 172.21.15.112:0/2719036350 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f50900ac020 con 0x7f509809dc50 2024-09-15T23:54:41.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:41.904+0000 7f509c8a4640 1 -- 172.21.15.112:0/2719036350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f509815e3e0 con 0x7f509809dc50 2024-09-15T23:54:42.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.572+0000 7f5086ffd640 1 -- 172.21.15.112:0/2719036350 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) ==== 170+0+0 (secure 0 0 0) 0x7f5090016470 con 0x7f509809dc50 2024-09-15T23:54:42.575 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-15T23:54:42.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.576+0000 7f509c8a4640 1 -- 172.21.15.112:0/2719036350 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50780678c0 msgr2=0x7f5078069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:42.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.576+0000 7f509c8a4640 1 --2- 172.21.15.112:0/2719036350 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50780678c0 0x7f5078069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f50981f5e60 tx=0x7f508c009040 comp rx=0 tx=0).stop 2024-09-15T23:54:42.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.576+0000 7f509c8a4640 1 -- 172.21.15.112:0/2719036350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f509809dc50 msgr2=0x7f50980adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:42.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.576+0000 7f509c8a4640 1 --2- 172.21.15.112:0/2719036350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f509809dc50 0x7f50980adb30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f509001cc40 tx=0x7f5080005840 comp rx=0 tx=0).stop 2024-09-15T23:54:42.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.576+0000 7f509c8a4640 1 -- 172.21.15.112:0/2719036350 shutdown_connections 2024-09-15T23:54:42.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.576+0000 7f509c8a4640 1 --2- 172.21.15.112:0/2719036350 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50780678c0 0x7f5078069d80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:42.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.576+0000 7f509c8a4640 1 --2- 172.21.15.112:0/2719036350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f509809dc50 0x7f50980adb30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:42.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.576+0000 7f509c8a4640 1 --2- 172.21.15.112:0/2719036350 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f509815dfd0 0x7f50980ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:42.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.576+0000 7f509c8a4640 1 --2- 172.21.15.112:0/2719036350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5098141d80 0x7f509809d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:42.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.576+0000 7f509c8a4640 1 -- 172.21.15.112:0/2719036350 >> 172.21.15.112:0/2719036350 conn(0x7f50980b1c80 msgr2=0x7f509806f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:42.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.576+0000 7f509c8a4640 1 -- 172.21.15.112:0/2719036350 shutdown_connections 2024-09-15T23:54:42.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.576+0000 7f509c8a4640 1 -- 172.21.15.112:0/2719036350 wait complete. 2024-09-15T23:54:42.612 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:54:42.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcf65a6640 1 Processor -- start 2024-09-15T23:54:42.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcf65a6640 1 -- start start 2024-09-15T23:54:42.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcf65a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcf00adad0 0x7fbcf015f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:42.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcf65a6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbcf00aee70 0x7fbcf0154d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:42.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcf65a6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf00af300 con 0x7fbcf00adeb0 2024-09-15T23:54:42.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcf65a6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf00af5e0 con 0x7fbcf00aee70 2024-09-15T23:54:42.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcf65a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf00af8c0 con 0x7fbcf00adad0 2024-09-15T23:54:42.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcef7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbcf00aee70 0x7fbcf0154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:42.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbceffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcf00adad0 0x7fbcf015f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:42.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcef7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbcf00aee70 0x7fbcf0154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:50872/0 (socket says 172.21.15.112:50872) 2024-09-15T23:54:42.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcf4b43640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fbcf00adeb0 0x7fbcf00cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:51954/0 (socket says 172.21.15.112:51954) 2024-09-15T23:54:42.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbceffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcf00adad0 0x7fbcf015f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:51904/0 (socket says 172.21.15.112:51904) 2024-09-15T23:54:42.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcf4b43640 1 -- 172.21.15.112:0/1182687244 learned_addr learned my addr 172.21.15.112:0/1182687244 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:42.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcef7fe640 1 -- 172.21.15.112:0/1182687244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcf00adad0 msgr2=0x7fbcf015f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:42.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcef7fe640 1 --2- 172.21.15.112:0/1182687244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcf00adad0 0x7fbcf015f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:42.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcef7fe640 1 -- 172.21.15.112:0/1182687244 >> v1:172.21.15.169:6789/0 conn(0x7fbcf00adeb0 legacy=0x7fbcf00cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:42.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbcef7fe640 1 -- 172.21.15.112:0/1182687244 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf00afba0 con 0x7fbcf00aee70 2024-09-15T23:54:42.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.736+0000 7fbceffff640 1 --2- 172.21.15.112:0/1182687244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcf00adad0 0x7fbcf015f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:54:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcef7fe640 1 --2- 172.21.15.112:0/1182687244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf00aee70 0x7fbcf0154d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbce40097c0 tx=0x7fbce401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a5d331a30186664 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbceeffd640 1 -- 172.21.15.112:0/1182687244 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce40b0070 con 0x7fbcf00aee70 2024-09-15T23:54:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbceeffd640 1 -- 172.21.15.112:0/1182687244 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce40ab600 con 0x7fbcf00aee70 2024-09-15T23:54:42.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbceeffd640 1 -- 172.21.15.112:0/1182687244 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce40ab9d0 con 0x7fbcf00aee70 2024-09-15T23:54:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 -- 172.21.15.112:0/1182687244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf00aee70 msgr2=0x7fbcf0154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 --2- 172.21.15.112:0/1182687244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf00aee70 0x7fbcf0154d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbce40097c0 tx=0x7fbce401c4a0 comp rx=0 tx=0).stop 2024-09-15T23:54:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 -- 172.21.15.112:0/1182687244 shutdown_connections 2024-09-15T23:54:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 --2- 172.21.15.112:0/1182687244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf00aee70 0x7fbcf0154d40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 --2- 172.21.15.112:0/1182687244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcf00adad0 0x7fbcf015f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 -- 172.21.15.112:0/1182687244 >> 172.21.15.112:0/1182687244 conn(0x7fbcf00736d0 msgr2=0x7fbcf006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 -- 172.21.15.112:0/1182687244 shutdown_connections 2024-09-15T23:54:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 -- 172.21.15.112:0/1182687244 wait complete. 2024-09-15T23:54:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 Processor -- start 2024-09-15T23:54:42.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 -- start start 2024-09-15T23:54:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcf00adad0 0x7fbcf0149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcf00adeb0 0x7fbcf00b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf0152770 0x7fbcf00b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf00b03a0 con 0x7fbcf00adad0 2024-09-15T23:54:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf00b0520 con 0x7fbcf0152770 2024-09-15T23:54:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcf65a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf006f070 con 0x7fbcf00adeb0 2024-09-15T23:54:42.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbceffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcf00adad0 0x7fbcf0149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbceffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcf00adad0 0x7fbcf0149430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50284/0 (socket says 172.21.15.112:50284) 2024-09-15T23:54:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbceffff640 1 -- 172.21.15.112:0/3274792200 learned_addr learned my addr 172.21.15.112:0/3274792200 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.740+0000 7fbcef7fe640 1 --2- 172.21.15.112:0/3274792200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcf00adeb0 0x7fbcf00b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbcf4b43640 1 --2- 172.21.15.112:0/3274792200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf0152770 0x7fbcf00b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbceffff640 1 -- 172.21.15.112:0/3274792200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcf00adeb0 msgr2=0x7fbcf00b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbceffff640 1 --2- 172.21.15.112:0/3274792200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcf00adeb0 0x7fbcf00b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:42.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbceffff640 1 -- 172.21.15.112:0/3274792200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf0152770 msgr2=0x7fbcf00b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:42.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbceffff640 1 --2- 172.21.15.112:0/3274792200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf0152770 0x7fbcf00b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:42.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbceffff640 1 -- 172.21.15.112:0/3274792200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf015f9d0 con 0x7fbcf00adad0 2024-09-15T23:54:42.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbceffff640 1 --2- 172.21.15.112:0/3274792200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcf00adad0 0x7fbcf0149430 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbce000efc0 tx=0x7fbce000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:42.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbcecff9640 1 -- 172.21.15.112:0/3274792200 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0018020 con 0x7fbcf00adad0 2024-09-15T23:54:42.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbcecff9640 1 -- 172.21.15.112:0/3274792200 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce0014680 con 0x7fbcf00adad0 2024-09-15T23:54:42.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbcf65a6640 1 -- 172.21.15.112:0/3274792200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf014e220 con 0x7fbcf00adad0 2024-09-15T23:54:42.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbcecff9640 1 -- 172.21.15.112:0/3274792200 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0014a50 con 0x7fbcf00adad0 2024-09-15T23:54:42.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbcf65a6640 1 -- 172.21.15.112:0/3274792200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf014e7e0 con 0x7fbcf00adad0 2024-09-15T23:54:42.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbcf65a6640 1 -- 172.21.15.112:0/3274792200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf006f3a0 con 0x7fbcf00adad0 2024-09-15T23:54:42.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbcecff9640 1 -- 172.21.15.112:0/3274792200 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbce001b020 con 0x7fbcf00adad0 2024-09-15T23:54:42.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbcecff9640 1 --2- 172.21.15.112:0/3274792200 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbcdc0678c0 0x7fbcdc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:42.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbcecff9640 1 -- 172.21.15.112:0/3274792200 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6001+0+0 (secure 0 0 0) 0x7fbce0086bb0 con 0x7fbcf00adad0 2024-09-15T23:54:42.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbcef7fe640 1 --2- 172.21.15.112:0/3274792200 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbcdc0678c0 0x7fbcdc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:42.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.744+0000 7fbcef7fe640 1 --2- 172.21.15.112:0/3274792200 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbcdc0678c0 0x7fbcdc069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbce40ad000 tx=0x7fbce4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:42.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.748+0000 7fbcecff9640 1 -- 172.21.15.112:0/3274792200 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbce0022030 con 0x7fbcf00adad0 2024-09-15T23:54:42.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:42.944+0000 7fbcf65a6640 1 -- 172.21.15.112:0/3274792200 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbcf006d800 con 0x7fbcf00adad0 2024-09-15T23:54:43.244 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:54:43.247 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:54:43.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.608+0000 7fbcecff9640 1 -- 172.21.15.112:0/3274792200 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7fbce0010040 con 0x7fbcf00adad0 2024-09-15T23:54:43.613 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 5 and data pool 6 2024-09-15T23:54:43.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.616+0000 7fbcf65a6640 1 -- 172.21.15.112:0/3274792200 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbcdc0678c0 msgr2=0x7fbcdc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:43.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.616+0000 7fbcf65a6640 1 --2- 172.21.15.112:0/3274792200 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbcdc0678c0 0x7fbcdc069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbce40ad000 tx=0x7fbce4008040 comp rx=0 tx=0).stop 2024-09-15T23:54:43.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.616+0000 7fbcf65a6640 1 -- 172.21.15.112:0/3274792200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcf00adad0 msgr2=0x7fbcf0149430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:43.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.616+0000 7fbcf65a6640 1 --2- 172.21.15.112:0/3274792200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcf00adad0 0x7fbcf0149430 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbce000efc0 tx=0x7fbce000c490 comp rx=0 tx=0).stop 2024-09-15T23:54:43.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.616+0000 7fbcf65a6640 1 -- 172.21.15.112:0/3274792200 shutdown_connections 2024-09-15T23:54:43.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.616+0000 7fbcf65a6640 1 --2- 172.21.15.112:0/3274792200 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbcdc0678c0 0x7fbcdc069d80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:43.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.616+0000 7fbcf65a6640 1 --2- 172.21.15.112:0/3274792200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf0152770 0x7fbcf00b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:43.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.616+0000 7fbcf65a6640 1 --2- 172.21.15.112:0/3274792200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbcf00adeb0 0x7fbcf00b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:43.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.616+0000 7fbcf65a6640 1 --2- 172.21.15.112:0/3274792200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbcf00adad0 0x7fbcf0149430 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:43.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.616+0000 7fbcf65a6640 1 -- 172.21.15.112:0/3274792200 >> 172.21.15.112:0/3274792200 conn(0x7fbcf00736d0 msgr2=0x7fbcf015fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:43.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.616+0000 7fbcf65a6640 1 -- 172.21.15.112:0/3274792200 shutdown_connections 2024-09-15T23:54:43.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.616+0000 7fbcf65a6640 1 -- 172.21.15.112:0/3274792200 wait complete. 2024-09-15T23:54:43.655 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:43.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.768+0000 7ff5c038a640 1 Processor -- start 2024-09-15T23:54:43.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.768+0000 7ff5c038a640 1 -- start start 2024-09-15T23:54:43.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5c038a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff5b8070020 0x7ff5b815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:43.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5c038a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff5b815f1d0 0x7ff5b80adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:43.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5c038a640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5b80aede0 con 0x7ff5b81520a0 2024-09-15T23:54:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5c038a640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff5b8152480 con 0x7ff5b815f1d0 2024-09-15T23:54:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5c038a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff5b815fa10 con 0x7ff5b8070020 2024-09-15T23:54:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5be126640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff5b81520a0 0x7ff5b806f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59710/0 (socket says 172.21.15.112:59710) 2024-09-15T23:54:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5be126640 1 -- 172.21.15.112:0/209023111 learned_addr learned my addr 172.21.15.112:0/209023111 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5be927640 1 --2- 172.21.15.112:0/209023111 >> v2:172.21.15.112:3300/0 conn(0x7ff5b815f1d0 0x7ff5b80adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5bd124640 1 -- 172.21.15.112:0/209023111 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 519605342 0 0) 0x7ff5b80aede0 con 0x7ff5b81520a0 2024-09-15T23:54:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5bd124640 1 -- 172.21.15.112:0/209023111 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5a4003530 con 0x7ff5b81520a0 2024-09-15T23:54:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5bd925640 1 --2- 172.21.15.112:0/209023111 >> v2:172.21.15.169:3300/0 conn(0x7ff5b8070020 0x7ff5b815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5be927640 1 -- 172.21.15.112:0/209023111 >> v2:172.21.15.169:3300/0 conn(0x7ff5b8070020 msgr2=0x7ff5b815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5be927640 1 --2- 172.21.15.112:0/209023111 >> v2:172.21.15.169:3300/0 conn(0x7ff5b8070020 0x7ff5b815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5be927640 1 -- 172.21.15.112:0/209023111 >> v1:172.21.15.112:6789/0 conn(0x7ff5b81520a0 legacy=0x7ff5b806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5be927640 1 -- 172.21.15.112:0/209023111 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b8074250 con 0x7ff5b815f1d0 2024-09-15T23:54:43.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5bd925640 1 --2- 172.21.15.112:0/209023111 >> v2:172.21.15.169:3300/0 conn(0x7ff5b8070020 0x7ff5b815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:43.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5be927640 1 --2- 172.21.15.112:0/209023111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b815f1d0 0x7ff5b80adc80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff5b806e510 tx=0x7ff5b001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0de57f2e786903 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:43.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5bd124640 1 -- 172.21.15.112:0/209023111 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b00b2070 con 0x7ff5b815f1d0 2024-09-15T23:54:43.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5bd124640 1 -- 172.21.15.112:0/209023111 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b00a59c0 con 0x7ff5b815f1d0 2024-09-15T23:54:43.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5bd124640 1 -- 172.21.15.112:0/209023111 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b00a5d70 con 0x7ff5b815f1d0 2024-09-15T23:54:43.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5c038a640 1 -- 172.21.15.112:0/209023111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b815f1d0 msgr2=0x7ff5b80adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:43.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5c038a640 1 --2- 172.21.15.112:0/209023111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b815f1d0 0x7ff5b80adc80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff5b806e510 tx=0x7ff5b001c900 comp rx=0 tx=0).stop 2024-09-15T23:54:43.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5c038a640 1 -- 172.21.15.112:0/209023111 shutdown_connections 2024-09-15T23:54:43.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5c038a640 1 --2- 172.21.15.112:0/209023111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b815f1d0 0x7ff5b80adc80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:43.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5c038a640 1 --2- 172.21.15.112:0/209023111 >> v2:172.21.15.169:3300/0 conn(0x7ff5b8070020 0x7ff5b815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:43.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5c038a640 1 -- 172.21.15.112:0/209023111 >> 172.21.15.112:0/209023111 conn(0x7ff5b80b1f90 msgr2=0x7ff5b80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:43.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5c038a640 1 -- 172.21.15.112:0/209023111 shutdown_connections 2024-09-15T23:54:43.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.772+0000 7ff5c038a640 1 -- 172.21.15.112:0/209023111 wait complete. 2024-09-15T23:54:43.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5c038a640 1 Processor -- start 2024-09-15T23:54:43.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5c038a640 1 -- start start 2024-09-15T23:54:43.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5c038a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5b8070020 0x7ff5b814eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:43.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5c038a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b81520a0 0x7ff5b814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:43.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5c038a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5b815f1d0 0x7ff5b814e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:43.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5c038a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b815f680 con 0x7ff5b81520a0 2024-09-15T23:54:43.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5c038a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b8073d30 con 0x7ff5b815f1d0 2024-09-15T23:54:43.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5c038a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b806e800 con 0x7ff5b8070020 2024-09-15T23:54:43.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5bd925640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b81520a0 0x7ff5b814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:43.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5bd925640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b81520a0 0x7ff5b814c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50298/0 (socket says 172.21.15.112:50298) 2024-09-15T23:54:43.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5bd925640 1 -- 172.21.15.112:0/3387247381 learned_addr learned my addr 172.21.15.112:0/3387247381 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:43.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5be126640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5b8070020 0x7ff5b814eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:43.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5be927640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5b815f1d0 0x7ff5b814e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:43.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5bd925640 1 -- 172.21.15.112:0/3387247381 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5b8070020 msgr2=0x7ff5b814eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:43.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5bd925640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5b8070020 0x7ff5b814eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:43.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5bd925640 1 -- 172.21.15.112:0/3387247381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5b815f1d0 msgr2=0x7ff5b814e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:43.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5bd925640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5b815f1d0 0x7ff5b814e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:43.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5bd925640 1 -- 172.21.15.112:0/3387247381 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b814bd20 con 0x7ff5b81520a0 2024-09-15T23:54:43.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5be126640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5b8070020 0x7ff5b814eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:43.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5bd925640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b81520a0 0x7ff5b814c6b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800c7f0 tx=0x7ff5a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:43.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5aeffd640 1 -- 172.21.15.112:0/3387247381 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8015070 con 0x7ff5b81520a0 2024-09-15T23:54:43.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5aeffd640 1 -- 172.21.15.112:0/3387247381 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a8007820 con 0x7ff5b81520a0 2024-09-15T23:54:43.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5c038a640 1 -- 172.21.15.112:0/3387247381 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b81482c0 con 0x7ff5b81520a0 2024-09-15T23:54:43.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5aeffd640 1 -- 172.21.15.112:0/3387247381 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8007bd0 con 0x7ff5b81520a0 2024-09-15T23:54:43.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5c038a640 1 -- 172.21.15.112:0/3387247381 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b81466a0 con 0x7ff5b81520a0 2024-09-15T23:54:43.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.776+0000 7ff5c038a640 1 -- 172.21.15.112:0/3387247381 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b8148770 con 0x7ff5b81520a0 2024-09-15T23:54:43.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.780+0000 7ff5aeffd640 1 -- 172.21.15.112:0/3387247381 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff5a8018070 con 0x7ff5b81520a0 2024-09-15T23:54:43.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.780+0000 7ff5aeffd640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff59c0678c0 0x7ff59c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:43.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.780+0000 7ff5aeffd640 1 -- 172.21.15.112:0/3387247381 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff5a8085f30 con 0x7ff5b81520a0 2024-09-15T23:54:43.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.780+0000 7ff5be126640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff59c0678c0 0x7ff59c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:43.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.780+0000 7ff5be126640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff59c0678c0 0x7ff59c069d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4005890 tx=0x7ff5b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:43.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.784+0000 7ff5aeffd640 1 -- 172.21.15.112:0/3387247381 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff5a80568e0 con 0x7ff5b81520a0 2024-09-15T23:54:43.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.944+0000 7ff5c038a640 1 -- 172.21.15.112:0/3387247381 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5b815ec90 con 0x7ff5b81520a0 2024-09-15T23:54:43.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.948+0000 7ff5aeffd640 1 -- 172.21.15.112:0/3387247381 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17027 (secure 0 0 0) 0x7ff5a80561e0 con 0x7ff5b81520a0 2024-09-15T23:54:43.952 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:43.952 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":39,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:54:42.950805+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:54:40.796426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-15T23:54:41.944394+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:43.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.948+0000 7ff5c038a640 1 -- 172.21.15.112:0/3387247381 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff59c0678c0 msgr2=0x7ff59c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:43.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.948+0000 7ff5c038a640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff59c0678c0 0x7ff59c069d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4005890 tx=0x7ff5b4009040 comp rx=0 tx=0).stop 2024-09-15T23:54:43.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.948+0000 7ff5c038a640 1 -- 172.21.15.112:0/3387247381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b81520a0 msgr2=0x7ff5b814c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:43.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.948+0000 7ff5c038a640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b81520a0 0x7ff5b814c6b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800c7f0 tx=0x7ff5a800ccb0 comp rx=0 tx=0).stop 2024-09-15T23:54:43.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.948+0000 7ff5c038a640 1 -- 172.21.15.112:0/3387247381 shutdown_connections 2024-09-15T23:54:43.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.948+0000 7ff5c038a640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff59c0678c0 0x7ff59c069d80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:43.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.948+0000 7ff5c038a640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5b815f1d0 0x7ff5b814e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:43.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.948+0000 7ff5c038a640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5b81520a0 0x7ff5b814c6b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:43.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.948+0000 7ff5c038a640 1 --2- 172.21.15.112:0/3387247381 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5b8070020 0x7ff5b814eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:43.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.948+0000 7ff5c038a640 1 -- 172.21.15.112:0/3387247381 >> 172.21.15.112:0/3387247381 conn(0x7ff5b80b1f90 msgr2=0x7ff5b806f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:43.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.948+0000 7ff5c038a640 1 -- 172.21.15.112:0/3387247381 shutdown_connections 2024-09-15T23:54:43.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:43.948+0000 7ff5c038a640 1 -- 172.21.15.112:0/3387247381 wait complete. 2024-09-15T23:54:43.970 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:44.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15bac73640 1 Processor -- start 2024-09-15T23:54:44.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15bac73640 1 -- start start 2024-09-15T23:54:44.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15bac73640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f15b415c2a0 0x7f15b40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15bac73640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15b40af2a0 0x7f15b406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15bac73640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b40b3290 con 0x7f15b415bec0 2024-09-15T23:54:44.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15bac73640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f15b40b3570 con 0x7f15b415c2a0 2024-09-15T23:54:44.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15bac73640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f15b40b3850 con 0x7f15b40af2a0 2024-09-15T23:54:44.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15b3fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f15b415c2a0 0x7f15b40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15b8a0f640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f15b415bec0 0x7f15b40ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59724/0 (socket says 172.21.15.112:59724) 2024-09-15T23:54:44.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15b8a0f640 1 -- 172.21.15.112:0/3929133926 learned_addr learned my addr 172.21.15.112:0/3929133926 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:44.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15b9210640 1 --2- 172.21.15.112:0/3929133926 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15b40af2a0 0x7f15b406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15b3fff640 1 -- 172.21.15.112:0/3929133926 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15b40af2a0 msgr2=0x7f15b406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:44.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15b3fff640 1 --2- 172.21.15.112:0/3929133926 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15b40af2a0 0x7f15b406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15b3fff640 1 -- 172.21.15.112:0/3929133926 >> v1:172.21.15.112:6789/0 conn(0x7f15b415bec0 legacy=0x7f15b40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15b37fe640 1 -- 172.21.15.112:0/3929133926 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565388668 0 0) 0x7f15b40b3290 con 0x7f15b415bec0 2024-09-15T23:54:44.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15b3fff640 1 -- 172.21.15.112:0/3929133926 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b40b3b30 con 0x7f15b415c2a0 2024-09-15T23:54:44.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.088+0000 7f15b9210640 1 --2- 172.21.15.112:0/3929133926 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15b40af2a0 0x7f15b406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:44.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.092+0000 7f15b3fff640 1 --2- 172.21.15.112:0/3929133926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b415c2a0 0x7f15b40aed60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f159c0097c0 tx=0x7f159c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966dc225a61531f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:44.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.092+0000 7f15b37fe640 1 -- 172.21.15.112:0/3929133926 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c0a7070 con 0x7f15b415c2a0 2024-09-15T23:54:44.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.092+0000 7f15b37fe640 1 -- 172.21.15.112:0/3929133926 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f159c0b0070 con 0x7f15b415c2a0 2024-09-15T23:54:44.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.092+0000 7f15b37fe640 1 -- 172.21.15.112:0/3929133926 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c0ab890 con 0x7f15b415c2a0 2024-09-15T23:54:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.092+0000 7f15bac73640 1 -- 172.21.15.112:0/3929133926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b415c2a0 msgr2=0x7f15b40aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.092+0000 7f15bac73640 1 --2- 172.21.15.112:0/3929133926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b415c2a0 0x7f15b40aed60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f159c0097c0 tx=0x7f159c01c470 comp rx=0 tx=0).stop 2024-09-15T23:54:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.092+0000 7f15bac73640 1 -- 172.21.15.112:0/3929133926 shutdown_connections 2024-09-15T23:54:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.092+0000 7f15bac73640 1 --2- 172.21.15.112:0/3929133926 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15b40af2a0 0x7f15b406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.092+0000 7f15bac73640 1 --2- 172.21.15.112:0/3929133926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b415c2a0 0x7f15b40aed60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.092+0000 7f15bac73640 1 -- 172.21.15.112:0/3929133926 >> 172.21.15.112:0/3929133926 conn(0x7f15b40b1f90 msgr2=0x7f15b40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.092+0000 7f15bac73640 1 -- 172.21.15.112:0/3929133926 shutdown_connections 2024-09-15T23:54:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.092+0000 7f15bac73640 1 -- 172.21.15.112:0/3929133926 wait complete. 2024-09-15T23:54:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.092+0000 7f15bac73640 1 Processor -- start 2024-09-15T23:54:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15bac73640 1 -- start start 2024-09-15T23:54:44.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15bac73640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b40af2a0 0x7f15b4149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15bac73640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15b415bec0 0x7f15b414a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15bac73640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b415c2a0 0x7f15b414a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15bac73640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f15b406ed50 con 0x7f15b40af2a0 2024-09-15T23:54:44.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15bac73640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15b40af6b0 con 0x7f15b415c2a0 2024-09-15T23:54:44.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15bac73640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f15b406eed0 con 0x7f15b415bec0 2024-09-15T23:54:44.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b8a0f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b40af2a0 0x7f15b4149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b8a0f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b40af2a0 0x7f15b4149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50324/0 (socket says 172.21.15.112:50324) 2024-09-15T23:54:44.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b8a0f640 1 -- 172.21.15.112:0/3942457599 learned_addr learned my addr 172.21.15.112:0/3942457599 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:44.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b3fff640 1 --2- 172.21.15.112:0/3942457599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15b415bec0 0x7f15b414a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b8a0f640 1 -- 172.21.15.112:0/3942457599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15b415bec0 msgr2=0x7f15b414a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b8a0f640 1 --2- 172.21.15.112:0/3942457599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15b415bec0 0x7f15b414a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b8a0f640 1 -- 172.21.15.112:0/3942457599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b415c2a0 msgr2=0x7f15b414a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b8a0f640 1 --2- 172.21.15.112:0/3942457599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b415c2a0 0x7f15b414a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b8a0f640 1 -- 172.21.15.112:0/3942457599 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b415c6b0 con 0x7f15b40af2a0 2024-09-15T23:54:44.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b8a0f640 1 --2- 172.21.15.112:0/3942457599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b40af2a0 0x7f15b4149ca0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f15a4001570 tx=0x7f15a400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:44.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b17fa640 1 -- 172.21.15.112:0/3942457599 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4018070 con 0x7f15b40af2a0 2024-09-15T23:54:44.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b17fa640 1 -- 172.21.15.112:0/3942457599 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a400a640 con 0x7f15b40af2a0 2024-09-15T23:54:44.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15bac73640 1 -- 172.21.15.112:0/3942457599 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b41523c0 con 0x7f15b40af2a0 2024-09-15T23:54:44.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b17fa640 1 -- 172.21.15.112:0/3942457599 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a400aa30 con 0x7f15b40af2a0 2024-09-15T23:54:44.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15bac73640 1 -- 172.21.15.112:0/3942457599 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b415cc30 con 0x7f15b40af2a0 2024-09-15T23:54:44.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15bac73640 1 -- 172.21.15.112:0/3942457599 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b406e000 con 0x7f15b40af2a0 2024-09-15T23:54:44.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b17fa640 1 -- 172.21.15.112:0/3942457599 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f15a400abd0 con 0x7f15b40af2a0 2024-09-15T23:54:44.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b17fa640 1 --2- 172.21.15.112:0/3942457599 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15940678c0 0x7f1594069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b17fa640 1 -- 172.21.15.112:0/3942457599 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f15a4085600 con 0x7f15b40af2a0 2024-09-15T23:54:44.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b3fff640 1 --2- 172.21.15.112:0/3942457599 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15940678c0 0x7f1594069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.096+0000 7f15b3fff640 1 --2- 172.21.15.112:0/3942457599 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15940678c0 0x7f1594069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f159c0af000 tx=0x7f159c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:44.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.100+0000 7f15b17fa640 1 -- 172.21.15.112:0/3942457599 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f15a4055f30 con 0x7f15b40af2a0 2024-09-15T23:54:44.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.264+0000 7f15bac73640 1 -- 172.21.15.112:0/3942457599 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15b40cf760 con 0x7f15b40af2a0 2024-09-15T23:54:44.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.268+0000 7f15b17fa640 1 -- 172.21.15.112:0/3942457599 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17027 (secure 0 0 0) 0x7f15a4055830 con 0x7f15b40af2a0 2024-09-15T23:54:44.272 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:44.272 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":39,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:54:42.950805+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:54:40.796426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-15T23:54:41.944394+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:44.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.268+0000 7f15bac73640 1 -- 172.21.15.112:0/3942457599 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15940678c0 msgr2=0x7f1594069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.268+0000 7f15bac73640 1 --2- 172.21.15.112:0/3942457599 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15940678c0 0x7f1594069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f159c0af000 tx=0x7f159c0a7000 comp rx=0 tx=0).stop 2024-09-15T23:54:44.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.268+0000 7f15bac73640 1 -- 172.21.15.112:0/3942457599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b40af2a0 msgr2=0x7f15b4149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.268+0000 7f15bac73640 1 --2- 172.21.15.112:0/3942457599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b40af2a0 0x7f15b4149ca0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f15a4001570 tx=0x7f15a400cd20 comp rx=0 tx=0).stop 2024-09-15T23:54:44.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.268+0000 7f15bac73640 1 -- 172.21.15.112:0/3942457599 shutdown_connections 2024-09-15T23:54:44.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.268+0000 7f15bac73640 1 --2- 172.21.15.112:0/3942457599 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15940678c0 0x7f1594069d80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.268+0000 7f15bac73640 1 --2- 172.21.15.112:0/3942457599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b415c2a0 0x7f15b414a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.268+0000 7f15bac73640 1 --2- 172.21.15.112:0/3942457599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15b415bec0 0x7f15b414a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.268+0000 7f15bac73640 1 --2- 172.21.15.112:0/3942457599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b40af2a0 0x7f15b4149ca0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.268+0000 7f15bac73640 1 -- 172.21.15.112:0/3942457599 >> 172.21.15.112:0/3942457599 conn(0x7f15b40b1f90 msgr2=0x7f15b40b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:44.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.268+0000 7f15bac73640 1 -- 172.21.15.112:0/3942457599 shutdown_connections 2024-09-15T23:54:44.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.268+0000 7f15bac73640 1 -- 172.21.15.112:0/3942457599 wait complete. 2024-09-15T23:54:44.291 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:54:44.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f7126640 1 Processor -- start 2024-09-15T23:54:44.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f7126640 1 -- start start 2024-09-15T23:54:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f7126640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe8f00b39a0 0x7fe8f006df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f7126640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f006ec60 con 0x7fe8f01587a0 2024-09-15T23:54:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f7126640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f006ef40 con 0x7fe8f006e4b0 2024-09-15T23:54:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f7126640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f006f870 con 0x7fe8f00b39a0 2024-09-15T23:54:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f4ec2640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe8f01587a0 0x7fe8f00b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59728/0 (socket says 172.21.15.112:59728) 2024-09-15T23:54:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f4ec2640 1 -- 172.21.15.112:0/4216221206 learned_addr learned my addr 172.21.15.112:0/4216221206 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8effff640 1 --2- 172.21.15.112:0/4216221206 >> v2:172.21.15.169:3300/0 conn(0x7fe8f00b39a0 0x7fe8f006df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 -- 172.21.15.112:0/4216221206 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 492969112 0 0) 0x7fe8f006ec60 con 0x7fe8f01587a0 2024-09-15T23:54:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 -- 172.21.15.112:0/4216221206 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8d8003530 con 0x7fe8f01587a0 2024-09-15T23:54:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 -- 172.21.15.112:0/4216221206 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3596139352 0 0) 0x7fe8d8003530 con 0x7fe8f01587a0 2024-09-15T23:54:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 -- 172.21.15.112:0/4216221206 >> v2:172.21.15.169:3300/0 conn(0x7fe8f00b39a0 msgr2=0x7fe8f006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 --2- 172.21.15.112:0/4216221206 >> v2:172.21.15.169:3300/0 conn(0x7fe8f00b39a0 0x7fe8f006df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 -- 172.21.15.112:0/4216221206 >> v1:172.21.15.169:6789/0 conn(0x7fe8f006e4b0 legacy=0x7fe8f0072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 -- 172.21.15.112:0/4216221206 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f006f220 con 0x7fe8f01587a0 2024-09-15T23:54:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 -- 172.21.15.112:0/4216221206 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fe8e0001680 con 0x7fe8f01587a0 2024-09-15T23:54:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 -- 172.21.15.112:0/4216221206 >> v1:172.21.15.112:6789/0 conn(0x7fe8f01587a0 legacy=0x7fe8f00b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 --2- 172.21.15.112:0/4216221206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d80039c0 0x7fe8d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 --2- 172.21.15.112:0/4216221206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8d8004810 0x7fe8d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 --2- 172.21.15.112:0/4216221206 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8d80051d0 0x7fe8d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 -- 172.21.15.112:0/4216221206 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f006f870 con 0x7fe8d80039c0 2024-09-15T23:54:44.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 -- 172.21.15.112:0/4216221206 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d800c0a0 con 0x7fe8d8004810 2024-09-15T23:54:44.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8ef7fe640 1 -- 172.21.15.112:0/4216221206 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d800c2a0 con 0x7fe8d80051d0 2024-09-15T23:54:44.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f4ec2640 1 --2- 172.21.15.112:0/4216221206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d80039c0 0x7fe8d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8effff640 1 --2- 172.21.15.112:0/4216221206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8d8004810 0x7fe8d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f56c3640 1 --2- 172.21.15.112:0/4216221206 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8d80051d0 0x7fe8d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f4ec2640 1 -- 172.21.15.112:0/4216221206 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8d80051d0 msgr2=0x7fe8d800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:44.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f4ec2640 1 --2- 172.21.15.112:0/4216221206 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8d80051d0 0x7fe8d800b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f4ec2640 1 -- 172.21.15.112:0/4216221206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8d8004810 msgr2=0x7fe8d8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:44.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f4ec2640 1 --2- 172.21.15.112:0/4216221206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8d8004810 0x7fe8d8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f4ec2640 1 -- 172.21.15.112:0/4216221206 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d8003530 con 0x7fe8d80039c0 2024-09-15T23:54:44.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.408+0000 7fe8f56c3640 1 -- 172.21.15.112:0/4216221206 reap_dead start 2024-09-15T23:54:44.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.412+0000 7fe8f4ec2640 1 --2- 172.21.15.112:0/4216221206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d80039c0 0x7fe8d8003e00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000c1c0 tx=0x7fe8e001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4d39d73cedc791 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:44.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.412+0000 7fe8ef7fe640 1 -- 172.21.15.112:0/4216221206 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0007d00 con 0x7fe8d80039c0 2024-09-15T23:54:44.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.412+0000 7fe8ef7fe640 1 -- 172.21.15.112:0/4216221206 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e00a9020 con 0x7fe8d80039c0 2024-09-15T23:54:44.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.412+0000 7fe8ef7fe640 1 -- 172.21.15.112:0/4216221206 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0005ae0 con 0x7fe8d80039c0 2024-09-15T23:54:44.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.412+0000 7fe8f7126640 1 -- 172.21.15.112:0/4216221206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d80039c0 msgr2=0x7fe8d8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.412+0000 7fe8f7126640 1 --2- 172.21.15.112:0/4216221206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d80039c0 0x7fe8d8003e00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000c1c0 tx=0x7fe8e001cc30 comp rx=0 tx=0).stop 2024-09-15T23:54:44.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.412+0000 7fe8f7126640 1 -- 172.21.15.112:0/4216221206 shutdown_connections 2024-09-15T23:54:44.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.412+0000 7fe8f7126640 1 --2- 172.21.15.112:0/4216221206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d80039c0 0x7fe8d8003e00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.412+0000 7fe8f7126640 1 -- 172.21.15.112:0/4216221206 >> 172.21.15.112:0/4216221206 conn(0x7fe8f00b1f90 msgr2=0x7fe8f00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:44.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.412+0000 7fe8f7126640 1 -- 172.21.15.112:0/4216221206 shutdown_connections 2024-09-15T23:54:44.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.412+0000 7fe8f7126640 1 -- 172.21.15.112:0/4216221206 wait complete. 2024-09-15T23:54:44.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.412+0000 7fe8f7126640 1 Processor -- start 2024-09-15T23:54:44.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.412+0000 7fe8f7126640 1 -- start start 2024-09-15T23:54:44.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8f7126640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8d80039c0 0x7fe8f0146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8f7126640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8f014ffa0 0x7fe8f0150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8f7126640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8f00ad200 0x7fe8f00ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8f7126640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f006ea10 con 0x7fe8f014ffa0 2024-09-15T23:54:44.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8f7126640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f006e890 con 0x7fe8f00ad200 2024-09-15T23:54:44.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8f7126640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f0162660 con 0x7fe8d80039c0 2024-09-15T23:54:44.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8effff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8f014ffa0 0x7fe8f0150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8effff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8f014ffa0 0x7fe8f0150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50340/0 (socket says 172.21.15.112:50340) 2024-09-15T23:54:44.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8effff640 1 -- 172.21.15.112:0/3159123960 learned_addr learned my addr 172.21.15.112:0/3159123960 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:44.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8f4ec2640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8d80039c0 0x7fe8f0146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8f56c3640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8f00ad200 0x7fe8f00ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8effff640 1 -- 172.21.15.112:0/3159123960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8d80039c0 msgr2=0x7fe8f0146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8effff640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8d80039c0 0x7fe8f0146240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8effff640 1 -- 172.21.15.112:0/3159123960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8f00ad200 msgr2=0x7fe8f00ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8effff640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8f00ad200 0x7fe8f00ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8effff640 1 -- 172.21.15.112:0/3159123960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f0153960 con 0x7fe8f014ffa0 2024-09-15T23:54:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8f56c3640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8f00ad200 0x7fe8f00ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8effff640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8f014ffa0 0x7fe8f0150420 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4011660 tx=0x7fe8e4011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8ed7fa640 1 -- 172.21.15.112:0/3159123960 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e400f9c0 con 0x7fe8f014ffa0 2024-09-15T23:54:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8ed7fa640 1 -- 172.21.15.112:0/3159123960 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e400fb60 con 0x7fe8f014ffa0 2024-09-15T23:54:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8f7126640 1 -- 172.21.15.112:0/3159123960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f0154160 con 0x7fe8f014ffa0 2024-09-15T23:54:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8ed7fa640 1 -- 172.21.15.112:0/3159123960 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4015460 con 0x7fe8f014ffa0 2024-09-15T23:54:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8f7126640 1 -- 172.21.15.112:0/3159123960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f0146780 con 0x7fe8f014ffa0 2024-09-15T23:54:44.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8f7126640 1 -- 172.21.15.112:0/3159123960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f00adbc0 con 0x7fe8f014ffa0 2024-09-15T23:54:44.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8ed7fa640 1 -- 172.21.15.112:0/3159123960 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe8e4015600 con 0x7fe8f014ffa0 2024-09-15T23:54:44.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8ed7fa640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8dc0678c0 0x7fe8dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8ed7fa640 1 -- 172.21.15.112:0/3159123960 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fe8e40867e0 con 0x7fe8f014ffa0 2024-09-15T23:54:44.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.416+0000 7fe8f4ec2640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8dc0678c0 0x7fe8dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.420+0000 7fe8f4ec2640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8dc0678c0 0x7fe8dc069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000c1c0 tx=0x7fe8f006ee30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:44.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.420+0000 7fe8ed7fa640 1 -- 172.21.15.112:0/3159123960 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe8e4019030 con 0x7fe8f014ffa0 2024-09-15T23:54:44.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.620+0000 7fe8f7126640 1 -- 172.21.15.112:0/3159123960 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe8f01629f0 con 0x7fe8f014ffa0 2024-09-15T23:54:44.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.644+0000 7fe8ed7fa640 1 -- 172.21.15.112:0/3159123960 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7fe8e4057190 con 0x7fe8f014ffa0 2024-09-15T23:54:44.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.644+0000 7fe8f7126640 1 -- 172.21.15.112:0/3159123960 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8dc0678c0 msgr2=0x7fe8dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.644+0000 7fe8f7126640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8dc0678c0 0x7fe8dc069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000c1c0 tx=0x7fe8f006ee30 comp rx=0 tx=0).stop 2024-09-15T23:54:44.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.644+0000 7fe8f7126640 1 -- 172.21.15.112:0/3159123960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8f014ffa0 msgr2=0x7fe8f0150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.644+0000 7fe8f7126640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8f014ffa0 0x7fe8f0150420 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4011660 tx=0x7fe8e4011b20 comp rx=0 tx=0).stop 2024-09-15T23:54:44.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.644+0000 7fe8f7126640 1 -- 172.21.15.112:0/3159123960 shutdown_connections 2024-09-15T23:54:44.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.644+0000 7fe8f7126640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8dc0678c0 0x7fe8dc069d80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.644+0000 7fe8f7126640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8f00ad200 0x7fe8f00ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.644+0000 7fe8f7126640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8f014ffa0 0x7fe8f0150420 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.644+0000 7fe8f7126640 1 --2- 172.21.15.112:0/3159123960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8d80039c0 0x7fe8f0146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.644+0000 7fe8f7126640 1 -- 172.21.15.112:0/3159123960 >> 172.21.15.112:0/3159123960 conn(0x7fe8f00b1f90 msgr2=0x7fe8f0072120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:44.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.644+0000 7fe8f7126640 1 -- 172.21.15.112:0/3159123960 shutdown_connections 2024-09-15T23:54:44.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.644+0000 7fe8f7126640 1 -- 172.21.15.112:0/3159123960 wait complete. 2024-09-15T23:54:44.665 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:54:44.665 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:54:44.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f7205021640 1 Processor -- start 2024-09-15T23:54:44.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f7205021640 1 -- start start 2024-09-15T23:54:44.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f7205021640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7200073e60 0x7f720006e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f7205021640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f720006fef0 0x7f720015b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f7205021640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72000b3d50 0x7f72000b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f7205021640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f72000b46a0 con 0x7f72000b3d50 2024-09-15T23:54:44.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f7205021640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f720015bda0 con 0x7f7200073e60 2024-09-15T23:54:44.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f7205021640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f720006ee50 con 0x7f720006fef0 2024-09-15T23:54:44.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f71ff59e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72000b3d50 0x7f72000b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f71ff59e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72000b3d50 0x7f72000b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50344/0 (socket says 172.21.15.112:50344) 2024-09-15T23:54:44.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f71ff59e640 1 -- 172.21.15.112:0/2574799942 learned_addr learned my addr 172.21.15.112:0/2574799942 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:44.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f71fe59c640 1 --2- 172.21.15.112:0/2574799942 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f720006fef0 0x7f720015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f71fed9d640 1 --2- 172.21.15.112:0/2574799942 >> v2:172.21.15.169:3300/0 conn(0x7f7200073e60 0x7f720006e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f71ff59e640 1 -- 172.21.15.112:0/2574799942 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f720006fef0 msgr2=0x7f720015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:44.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f71ff59e640 1 --2- 172.21.15.112:0/2574799942 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f720006fef0 0x7f720015b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f71ff59e640 1 -- 172.21.15.112:0/2574799942 >> v2:172.21.15.169:3300/0 conn(0x7f7200073e60 msgr2=0x7f720006e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:44.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f71ff59e640 1 --2- 172.21.15.112:0/2574799942 >> v2:172.21.15.169:3300/0 conn(0x7f7200073e60 0x7f720006e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.780+0000 7f71ff59e640 1 -- 172.21.15.112:0/2574799942 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720006f130 con 0x7f72000b3d50 2024-09-15T23:54:44.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f71ff59e640 1 --2- 172.21.15.112:0/2574799942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72000b3d50 0x7f72000b4160 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7200070340 tx=0x7f71f801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be47b9afb4c38d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:44.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f71fdd9b640 1 -- 172.21.15.112:0/2574799942 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f800b2d0 con 0x7f72000b3d50 2024-09-15T23:54:44.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f71fdd9b640 1 -- 172.21.15.112:0/2574799942 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f800b470 con 0x7f72000b3d50 2024-09-15T23:54:44.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f71fdd9b640 1 -- 172.21.15.112:0/2574799942 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f80a7a80 con 0x7f72000b3d50 2024-09-15T23:54:44.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 -- 172.21.15.112:0/2574799942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72000b3d50 msgr2=0x7f72000b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 --2- 172.21.15.112:0/2574799942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72000b3d50 0x7f72000b4160 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7200070340 tx=0x7f71f801eb60 comp rx=0 tx=0).stop 2024-09-15T23:54:44.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 -- 172.21.15.112:0/2574799942 shutdown_connections 2024-09-15T23:54:44.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 --2- 172.21.15.112:0/2574799942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72000b3d50 0x7f72000b4160 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 --2- 172.21.15.112:0/2574799942 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f720006fef0 0x7f720015b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 --2- 172.21.15.112:0/2574799942 >> v2:172.21.15.169:3300/0 conn(0x7f7200073e60 0x7f720006e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 -- 172.21.15.112:0/2574799942 >> 172.21.15.112:0/2574799942 conn(0x7f72000b1f90 msgr2=0x7f72000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:44.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 -- 172.21.15.112:0/2574799942 shutdown_connections 2024-09-15T23:54:44.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 -- 172.21.15.112:0/2574799942 wait complete. 2024-09-15T23:54:44.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 Processor -- start 2024-09-15T23:54:44.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 -- start start 2024-09-15T23:54:44.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f720006fef0 0x7f720014c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7200073e60 0x7f72001578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72000b3d50 0x7f72000b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f720015e580 con 0x7f7200073e60 2024-09-15T23:54:44.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f720015e400 con 0x7f720006fef0 2024-09-15T23:54:44.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f7205021640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f720015e700 con 0x7f72000b3d50 2024-09-15T23:54:44.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f71fe59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7200073e60 0x7f72001578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f71fe59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7200073e60 0x7f72001578a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50358/0 (socket says 172.21.15.112:50358) 2024-09-15T23:54:44.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f71fe59c640 1 -- 172.21.15.112:0/3116008064 learned_addr learned my addr 172.21.15.112:0/3116008064 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:44.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f71ff59e640 1 --2- 172.21.15.112:0/3116008064 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72000b3d50 0x7f72000b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f71fed9d640 1 --2- 172.21.15.112:0/3116008064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f720006fef0 0x7f720014c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f71fe59c640 1 -- 172.21.15.112:0/3116008064 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72000b3d50 msgr2=0x7f72000b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f71fe59c640 1 --2- 172.21.15.112:0/3116008064 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72000b3d50 0x7f72000b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f71fe59c640 1 -- 172.21.15.112:0/3116008064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f720006fef0 msgr2=0x7f720014c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:44.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f71fe59c640 1 --2- 172.21.15.112:0/3116008064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f720006fef0 0x7f720014c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:44.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.784+0000 7f71fe59c640 1 -- 172.21.15.112:0/3116008064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720014c9d0 con 0x7f7200073e60 2024-09-15T23:54:44.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.788+0000 7f71fe59c640 1 --2- 172.21.15.112:0/3116008064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7200073e60 0x7f72001578a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f71f400d830 tx=0x7f71f400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:44.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.788+0000 7f71e77fe640 1 -- 172.21.15.112:0/3116008064 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f4018030 con 0x7f7200073e60 2024-09-15T23:54:44.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.788+0000 7f71e77fe640 1 -- 172.21.15.112:0/3116008064 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f400be10 con 0x7f7200073e60 2024-09-15T23:54:44.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.788+0000 7f71e77fe640 1 -- 172.21.15.112:0/3116008064 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f40098b0 con 0x7f7200073e60 2024-09-15T23:54:44.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.788+0000 7f7205021640 1 -- 172.21.15.112:0/3116008064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7200158180 con 0x7f7200073e60 2024-09-15T23:54:44.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.788+0000 7f7205021640 1 -- 172.21.15.112:0/3116008064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f720014bc90 con 0x7f7200073e60 2024-09-15T23:54:44.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.788+0000 7f7205021640 1 -- 172.21.15.112:0/3116008064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f720006e800 con 0x7f7200073e60 2024-09-15T23:54:44.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.788+0000 7f71e77fe640 1 -- 172.21.15.112:0/3116008064 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f71f401b070 con 0x7f7200073e60 2024-09-15T23:54:44.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.788+0000 7f71e77fe640 1 --2- 172.21.15.112:0/3116008064 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f71ec0678c0 0x7f71ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:44.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.788+0000 7f71e77fe640 1 -- 172.21.15.112:0/3116008064 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f71f4085f10 con 0x7f7200073e60 2024-09-15T23:54:44.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.788+0000 7f71fed9d640 1 --2- 172.21.15.112:0/3116008064 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f71ec0678c0 0x7f71ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:44.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.788+0000 7f71fed9d640 1 --2- 172.21.15.112:0/3116008064 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f71ec0678c0 0x7f71ec069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009790 tx=0x7f71f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:44.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.792+0000 7f71e77fe640 1 -- 172.21.15.112:0/3116008064 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f71f4056950 con 0x7f7200073e60 2024-09-15T23:54:44.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:44.984+0000 7f7205021640 1 -- 172.21.15.112:0/3116008064 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f72000723f0 con 0x7f7200073e60 2024-09-15T23:54:45.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.652+0000 7f71e77fe640 1 -- 172.21.15.112:0/3116008064 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f71f4056250 con 0x7f7200073e60 2024-09-15T23:54:45.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.652+0000 7f7205021640 1 -- 172.21.15.112:0/3116008064 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f71ec0678c0 msgr2=0x7f71ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:45.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.652+0000 7f7205021640 1 --2- 172.21.15.112:0/3116008064 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f71ec0678c0 0x7f71ec069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009790 tx=0x7f71f0008040 comp rx=0 tx=0).stop 2024-09-15T23:54:45.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.652+0000 7f7205021640 1 -- 172.21.15.112:0/3116008064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7200073e60 msgr2=0x7f72001578a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:45.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.656+0000 7f7205021640 1 --2- 172.21.15.112:0/3116008064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7200073e60 0x7f72001578a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f71f400d830 tx=0x7f71f400dcf0 comp rx=0 tx=0).stop 2024-09-15T23:54:45.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.656+0000 7f7205021640 1 -- 172.21.15.112:0/3116008064 shutdown_connections 2024-09-15T23:54:45.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.656+0000 7f7205021640 1 --2- 172.21.15.112:0/3116008064 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f71ec0678c0 0x7f71ec069d80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:45.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.656+0000 7f7205021640 1 --2- 172.21.15.112:0/3116008064 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72000b3d50 0x7f72000b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:45.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.656+0000 7f7205021640 1 --2- 172.21.15.112:0/3116008064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7200073e60 0x7f72001578a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:45.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.656+0000 7f7205021640 1 --2- 172.21.15.112:0/3116008064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f720006fef0 0x7f720014c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:45.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.656+0000 7f7205021640 1 -- 172.21.15.112:0/3116008064 >> 172.21.15.112:0/3116008064 conn(0x7f72000b1f90 msgr2=0x7f720015a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:45.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.656+0000 7f7205021640 1 -- 172.21.15.112:0/3116008064 shutdown_connections 2024-09-15T23:54:45.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.656+0000 7f7205021640 1 -- 172.21.15.112:0/3116008064 wait complete. 2024-09-15T23:54:45.680 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:54:45.680 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:54:45.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.796+0000 7f0388218640 1 Processor -- start 2024-09-15T23:54:45.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.796+0000 7f0388218640 1 -- start start 2024-09-15T23:54:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.796+0000 7f0388218640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0380141230 0x7f03800717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.796+0000 7f0388218640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0380141d20 0x7f03800d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.796+0000 7f0388218640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0380142300 con 0x7f0380071d20 2024-09-15T23:54:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.796+0000 7f0388218640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f03801425e0 con 0x7f0380141230 2024-09-15T23:54:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.796+0000 7f0388218640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f03800d1160 con 0x7f0380141d20 2024-09-15T23:54:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.796+0000 7f0385fb4640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0380141230 0x7f03800717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.796+0000 7f0385fb4640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0380141230 0x7f03800717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50362/0 (socket says 172.21.15.112:50362) 2024-09-15T23:54:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.796+0000 7f0385fb4640 1 -- 172.21.15.112:0/718577743 learned_addr learned my addr 172.21.15.112:0/718577743 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.796+0000 7f0385fb4640 1 -- 172.21.15.112:0/718577743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0380141d20 msgr2=0x7f03800d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.796+0000 7f0385fb4640 1 --2- 172.21.15.112:0/718577743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0380141d20 0x7f03800d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.796+0000 7f0385fb4640 1 -- 172.21.15.112:0/718577743 >> v1:172.21.15.169:6789/0 conn(0x7f0380071d20 legacy=0x7f0380141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:45.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.796+0000 7f0385fb4640 1 -- 172.21.15.112:0/718577743 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03800d1440 con 0x7f0380141230 2024-09-15T23:54:45.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0385fb4640 1 --2- 172.21.15.112:0/718577743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0380141230 0x7f03800717e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f037c009870 tx=0x7f037c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ebb2fab2bbfbf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:45.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0384fb2640 1 -- 172.21.15.112:0/718577743 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c0b0070 con 0x7f0380141230 2024-09-15T23:54:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0384fb2640 1 -- 172.21.15.112:0/718577743 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f037c0ab600 con 0x7f0380141230 2024-09-15T23:54:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0384fb2640 1 -- 172.21.15.112:0/718577743 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c0ab9d0 con 0x7f0380141230 2024-09-15T23:54:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 -- 172.21.15.112:0/718577743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0380141230 msgr2=0x7f03800717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 --2- 172.21.15.112:0/718577743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0380141230 0x7f03800717e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f037c009870 tx=0x7f037c01c520 comp rx=0 tx=0).stop 2024-09-15T23:54:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 -- 172.21.15.112:0/718577743 shutdown_connections 2024-09-15T23:54:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 --2- 172.21.15.112:0/718577743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0380141d20 0x7f03800d1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 --2- 172.21.15.112:0/718577743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0380141230 0x7f03800717e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 -- 172.21.15.112:0/718577743 >> 172.21.15.112:0/718577743 conn(0x7f038006c0c0 msgr2=0x7f038006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 -- 172.21.15.112:0/718577743 shutdown_connections 2024-09-15T23:54:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 -- 172.21.15.112:0/718577743 wait complete. 2024-09-15T23:54:45.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 Processor -- start 2024-09-15T23:54:45.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 -- start start 2024-09-15T23:54:45.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0380071d20 0x7f038013ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:45.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0380141230 0x7f038013e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:45.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0380141d20 0x7f0380144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:45.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f03800d2a40 con 0x7f0380141230 2024-09-15T23:54:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f03800d28c0 con 0x7f0380071d20 2024-09-15T23:54:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0388218640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0380168cd0 con 0x7f0380141d20 2024-09-15T23:54:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f03857b3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0380141230 0x7f038013e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f03857b3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0380141230 0x7f038013e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50364/0 (socket says 172.21.15.112:50364) 2024-09-15T23:54:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f03857b3640 1 -- 172.21.15.112:0/3147441297 learned_addr learned my addr 172.21.15.112:0/3147441297 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f0385fb4640 1 --2- 172.21.15.112:0/3147441297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0380071d20 0x7f038013ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f03867b5640 1 --2- 172.21.15.112:0/3147441297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0380141d20 0x7f0380144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f03857b3640 1 -- 172.21.15.112:0/3147441297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0380141d20 msgr2=0x7f0380144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f03857b3640 1 --2- 172.21.15.112:0/3147441297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0380141d20 0x7f0380144dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f03857b3640 1 -- 172.21.15.112:0/3147441297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0380071d20 msgr2=0x7f038013ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:45.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f03857b3640 1 --2- 172.21.15.112:0/3147441297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0380071d20 0x7f038013ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:45.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.800+0000 7f03857b3640 1 -- 172.21.15.112:0/3147441297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0380156c10 con 0x7f0380141230 2024-09-15T23:54:45.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.804+0000 7f03857b3640 1 --2- 172.21.15.112:0/3147441297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0380141230 0x7f038013e5f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f037000c450 tx=0x7f037000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:45.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.804+0000 7f03767fc640 1 -- 172.21.15.112:0/3147441297 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370012830 con 0x7f0380141230 2024-09-15T23:54:45.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.804+0000 7f03767fc640 1 -- 172.21.15.112:0/3147441297 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0370017070 con 0x7f0380141230 2024-09-15T23:54:45.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.804+0000 7f0388218640 1 -- 172.21.15.112:0/3147441297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038013d580 con 0x7f0380141230 2024-09-15T23:54:45.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.804+0000 7f03767fc640 1 -- 172.21.15.112:0/3147441297 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370012c30 con 0x7f0380141230 2024-09-15T23:54:45.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.804+0000 7f0388218640 1 -- 172.21.15.112:0/3147441297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038013db40 con 0x7f0380141230 2024-09-15T23:54:45.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.804+0000 7f0388218640 1 -- 172.21.15.112:0/3147441297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03800717e0 con 0x7f0380141230 2024-09-15T23:54:45.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.804+0000 7f03767fc640 1 -- 172.21.15.112:0/3147441297 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f037001c460 con 0x7f0380141230 2024-09-15T23:54:45.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.804+0000 7f03767fc640 1 --2- 172.21.15.112:0/3147441297 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f03640678c0 0x7f0364069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:45.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.804+0000 7f03767fc640 1 -- 172.21.15.112:0/3147441297 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f0370085b80 con 0x7f0380141230 2024-09-15T23:54:45.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.804+0000 7f0385fb4640 1 --2- 172.21.15.112:0/3147441297 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f03640678c0 0x7f0364069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:45.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.804+0000 7f0385fb4640 1 --2- 172.21.15.112:0/3147441297 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f03640678c0 0x7f0364069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f037c0ad000 tx=0x7f037c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:45.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.808+0000 7f03767fc640 1 -- 172.21.15.112:0/3147441297 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0370056530 con 0x7f0380141230 2024-09-15T23:54:45.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.988+0000 7f0388218640 1 -- 172.21.15.112:0/3147441297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03800d0660 con 0x7f0380141230 2024-09-15T23:54:45.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.988+0000 7f03767fc640 1 -- 172.21.15.112:0/3147441297 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f0370055e30 con 0x7f0380141230 2024-09-15T23:54:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:45.994 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"btime":"2024-09-15T23:54:45:647611+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1357012609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1357012609},{"type":"v1","addr":"172.21.15.169:6835","nonce":1357012609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2931559222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2931559222},{"type":"v1","addr":"172.21.15.112:6837","nonce":2931559222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1936572340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1936572340},{"type":"v1","addr":"172.21.15.169:6833","nonce":1936572340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:54:42.951140+0000","modified":"2024-09-15T23:54:44.991346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4869":{"gid":4869,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/40913641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":40913641},{"type":"v1","addr":"172.21.15.112:6835","nonce":40913641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4869,"qdb_cluster":[4869]},"id":2}]} 2024-09-15T23:54:45.994 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-15T23:54:45.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.992+0000 7f0388218640 1 -- 172.21.15.112:0/3147441297 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f03640678c0 msgr2=0x7f0364069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:45.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.992+0000 7f0388218640 1 --2- 172.21.15.112:0/3147441297 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f03640678c0 0x7f0364069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f037c0ad000 tx=0x7f037c0a6000 comp rx=0 tx=0).stop 2024-09-15T23:54:45.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.992+0000 7f0388218640 1 -- 172.21.15.112:0/3147441297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0380141230 msgr2=0x7f038013e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:45.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.992+0000 7f0388218640 1 --2- 172.21.15.112:0/3147441297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0380141230 0x7f038013e5f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f037000c450 tx=0x7f037000c910 comp rx=0 tx=0).stop 2024-09-15T23:54:45.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.992+0000 7f0388218640 1 -- 172.21.15.112:0/3147441297 shutdown_connections 2024-09-15T23:54:45.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.992+0000 7f0388218640 1 --2- 172.21.15.112:0/3147441297 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f03640678c0 0x7f0364069d80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:45.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.992+0000 7f0388218640 1 --2- 172.21.15.112:0/3147441297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0380141d20 0x7f0380144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:45.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.992+0000 7f0388218640 1 --2- 172.21.15.112:0/3147441297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0380141230 0x7f038013e5f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:45.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.992+0000 7f0388218640 1 --2- 172.21.15.112:0/3147441297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0380071d20 0x7f038013ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:45.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.992+0000 7f0388218640 1 -- 172.21.15.112:0/3147441297 >> 172.21.15.112:0/3147441297 conn(0x7f038006c0c0 msgr2=0x7f038015c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:45.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.992+0000 7f0388218640 1 -- 172.21.15.112:0/3147441297 shutdown_connections 2024-09-15T23:54:45.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:45.992+0000 7f0388218640 1 -- 172.21.15.112:0/3147441297 wait complete. 2024-09-15T23:54:46.011 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:46.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.124+0000 7f1f6b470640 1 Processor -- start 2024-09-15T23:54:46.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.124+0000 7f1f6b470640 1 -- start start 2024-09-15T23:54:46.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f6b470640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1f641457a0 0x7f1f640d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f6b470640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1f640b4510 0x7f1f640d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f6b470640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f640d27a0 con 0x7f1f640cf800 2024-09-15T23:54:46.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f6b470640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1f640d2a80 con 0x7f1f640b4510 2024-09-15T23:54:46.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f6b470640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1f640d2d60 con 0x7f1f641457a0 2024-09-15T23:54:46.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f68a0b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1f640cf800 0x7f1f640b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59742/0 (socket says 172.21.15.112:59742) 2024-09-15T23:54:46.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f68a0b640 1 -- 172.21.15.112:0/1002422728 learned_addr learned my addr 172.21.15.112:0/1002422728 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:46.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f69a0d640 1 --2- 172.21.15.112:0/1002422728 >> v2:172.21.15.112:3300/0 conn(0x7f1f640b4510 0x7f1f640d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f6920c640 1 --2- 172.21.15.112:0/1002422728 >> v2:172.21.15.169:3300/0 conn(0x7f1f641457a0 0x7f1f640d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f69a0d640 1 -- 172.21.15.112:0/1002422728 >> v2:172.21.15.169:3300/0 conn(0x7f1f641457a0 msgr2=0x7f1f640d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:46.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f69a0d640 1 --2- 172.21.15.112:0/1002422728 >> v2:172.21.15.169:3300/0 conn(0x7f1f641457a0 0x7f1f640d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f69a0d640 1 -- 172.21.15.112:0/1002422728 >> v1:172.21.15.112:6789/0 conn(0x7f1f640cf800 legacy=0x7f1f640b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f69a0d640 1 -- 172.21.15.112:0/1002422728 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f640d01f0 con 0x7f1f640b4510 2024-09-15T23:54:46.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f5bfff640 1 -- 172.21.15.112:0/1002422728 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4105670098 0 0) 0x7f1f640d27a0 con 0x7f1f640cf800 2024-09-15T23:54:46.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.128+0000 7f1f6920c640 1 --2- 172.21.15.112:0/1002422728 >> v2:172.21.15.169:3300/0 conn(0x7f1f641457a0 0x7f1f640d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:46.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f69a0d640 1 --2- 172.21.15.112:0/1002422728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f640b4510 0x7f1f640d0710 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1f600097c0 tx=0x7f1f6001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d753999409e9c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:46.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f5bfff640 1 -- 172.21.15.112:0/1002422728 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f600b0070 con 0x7f1f640b4510 2024-09-15T23:54:46.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f5bfff640 1 -- 172.21.15.112:0/1002422728 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f600ab600 con 0x7f1f640b4510 2024-09-15T23:54:46.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f5bfff640 1 -- 172.21.15.112:0/1002422728 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f600a4e60 con 0x7f1f640b4510 2024-09-15T23:54:46.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 -- 172.21.15.112:0/1002422728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f640b4510 msgr2=0x7f1f640d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 --2- 172.21.15.112:0/1002422728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f640b4510 0x7f1f640d0710 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1f600097c0 tx=0x7f1f6001c3d0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 -- 172.21.15.112:0/1002422728 shutdown_connections 2024-09-15T23:54:46.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 --2- 172.21.15.112:0/1002422728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f640b4510 0x7f1f640d0710 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 --2- 172.21.15.112:0/1002422728 >> v2:172.21.15.169:3300/0 conn(0x7f1f641457a0 0x7f1f640d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 -- 172.21.15.112:0/1002422728 >> 172.21.15.112:0/1002422728 conn(0x7f1f6406bcc0 msgr2=0x7f1f6406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:46.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 -- 172.21.15.112:0/1002422728 shutdown_connections 2024-09-15T23:54:46.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 -- 172.21.15.112:0/1002422728 wait complete. 2024-09-15T23:54:46.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 Processor -- start 2024-09-15T23:54:46.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 -- start start 2024-09-15T23:54:46.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f640b4510 0x7f1f6415bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f640cf800 0x7f1f6415b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f641457a0 0x7f1f64165420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1f641690b0 con 0x7f1f640cf800 2024-09-15T23:54:46.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1f640d1670 con 0x7f1f641457a0 2024-09-15T23:54:46.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6b470640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1f64169230 con 0x7f1f640b4510 2024-09-15T23:54:46.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f68a0b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f640cf800 0x7f1f6415b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f68a0b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f640cf800 0x7f1f6415b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50382/0 (socket says 172.21.15.112:50382) 2024-09-15T23:54:46.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f68a0b640 1 -- 172.21.15.112:0/403851392 learned_addr learned my addr 172.21.15.112:0/403851392 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:46.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f69a0d640 1 --2- 172.21.15.112:0/403851392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f641457a0 0x7f1f64165420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f6920c640 1 --2- 172.21.15.112:0/403851392 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f640b4510 0x7f1f6415bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f68a0b640 1 -- 172.21.15.112:0/403851392 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f640b4510 msgr2=0x7f1f6415bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f68a0b640 1 --2- 172.21.15.112:0/403851392 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f640b4510 0x7f1f6415bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f68a0b640 1 -- 172.21.15.112:0/403851392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f641457a0 msgr2=0x7f1f64165420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f68a0b640 1 --2- 172.21.15.112:0/403851392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f641457a0 0x7f1f64165420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.132+0000 7f1f68a0b640 1 -- 172.21.15.112:0/403851392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6415c460 con 0x7f1f640cf800 2024-09-15T23:54:46.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.136+0000 7f1f68a0b640 1 --2- 172.21.15.112:0/403851392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f640cf800 0x7f1f6415b690 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1f540011f0 tx=0x7f1f5400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:46.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.136+0000 7f1f59ffb640 1 -- 172.21.15.112:0/403851392 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54018070 con 0x7f1f640cf800 2024-09-15T23:54:46.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.136+0000 7f1f6b470640 1 -- 172.21.15.112:0/403851392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f64142920 con 0x7f1f640cf800 2024-09-15T23:54:46.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.136+0000 7f1f59ffb640 1 -- 172.21.15.112:0/403851392 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f540074e0 con 0x7f1f640cf800 2024-09-15T23:54:46.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.136+0000 7f1f59ffb640 1 -- 172.21.15.112:0/403851392 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54004a10 con 0x7f1f640cf800 2024-09-15T23:54:46.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.136+0000 7f1f6b470640 1 -- 172.21.15.112:0/403851392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f64140ad0 con 0x7f1f640cf800 2024-09-15T23:54:46.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.136+0000 7f1f6b470640 1 -- 172.21.15.112:0/403851392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f640d0710 con 0x7f1f640cf800 2024-09-15T23:54:46.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.136+0000 7f1f59ffb640 1 -- 172.21.15.112:0/403851392 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f54004bb0 con 0x7f1f640cf800 2024-09-15T23:54:46.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.136+0000 7f1f59ffb640 1 --2- 172.21.15.112:0/403851392 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1f480678c0 0x7f1f48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.136+0000 7f1f59ffb640 1 -- 172.21.15.112:0/403851392 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f1f540855b0 con 0x7f1f640cf800 2024-09-15T23:54:46.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.136+0000 7f1f6920c640 1 --2- 172.21.15.112:0/403851392 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1f480678c0 0x7f1f48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.136+0000 7f1f6920c640 1 --2- 172.21.15.112:0/403851392 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1f480678c0 0x7f1f48069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00f500 tx=0x7f1f5c007770 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:46.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.140+0000 7f1f59ffb640 1 -- 172.21.15.112:0/403851392 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1f54021020 con 0x7f1f640cf800 2024-09-15T23:54:46.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.300+0000 7f1f6b470640 1 -- 172.21.15.112:0/403851392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f640b6110 con 0x7f1f640cf800 2024-09-15T23:54:46.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.304+0000 7f1f59ffb640 1 -- 172.21.15.112:0/403851392 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17014 (secure 0 0 0) 0x7f1f540559a0 con 0x7f1f640cf800 2024-09-15T23:54:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:46.308 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":40,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:54:44.612925+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:54:40.796426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-15T23:54:41.944394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:46.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.304+0000 7f1f6b470640 1 -- 172.21.15.112:0/403851392 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1f480678c0 msgr2=0x7f1f48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.304+0000 7f1f6b470640 1 --2- 172.21.15.112:0/403851392 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1f480678c0 0x7f1f48069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00f500 tx=0x7f1f5c007770 comp rx=0 tx=0).stop 2024-09-15T23:54:46.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.304+0000 7f1f6b470640 1 -- 172.21.15.112:0/403851392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f640cf800 msgr2=0x7f1f6415b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.304+0000 7f1f6b470640 1 --2- 172.21.15.112:0/403851392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f640cf800 0x7f1f6415b690 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1f540011f0 tx=0x7f1f5400c9b0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.304+0000 7f1f6b470640 1 -- 172.21.15.112:0/403851392 shutdown_connections 2024-09-15T23:54:46.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.304+0000 7f1f6b470640 1 --2- 172.21.15.112:0/403851392 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1f480678c0 0x7f1f48069d80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.304+0000 7f1f6b470640 1 --2- 172.21.15.112:0/403851392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f641457a0 0x7f1f64165420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.304+0000 7f1f6b470640 1 --2- 172.21.15.112:0/403851392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f640cf800 0x7f1f6415b690 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.304+0000 7f1f6b470640 1 --2- 172.21.15.112:0/403851392 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f640b4510 0x7f1f6415bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.304+0000 7f1f6b470640 1 -- 172.21.15.112:0/403851392 >> 172.21.15.112:0/403851392 conn(0x7f1f6406bcc0 msgr2=0x7f1f640b6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:46.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.304+0000 7f1f6b470640 1 -- 172.21.15.112:0/403851392 shutdown_connections 2024-09-15T23:54:46.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.304+0000 7f1f6b470640 1 -- 172.21.15.112:0/403851392 wait complete. 2024-09-15T23:54:46.325 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:54:46.325 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:54:46.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95d020640 1 Processor -- start 2024-09-15T23:54:46.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95d020640 1 -- start start 2024-09-15T23:54:46.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95d020640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd95815e260 0x7fd9580afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95d020640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd958067e30 0x7fd958161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95d020640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9581623e0 0x7fd95815e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95d020640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd958162830 con 0x7fd958067e30 2024-09-15T23:54:46.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95d020640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd9580afbb0 con 0x7fd95815e260 2024-09-15T23:54:46.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95d020640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd9580af310 con 0x7fd9581623e0 2024-09-15T23:54:46.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95659c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd958067e30 0x7fd958161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95659c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd958067e30 0x7fd958161ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50386/0 (socket says 172.21.15.112:50386) 2024-09-15T23:54:46.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95659c640 1 -- 172.21.15.112:0/1237665689 learned_addr learned my addr 172.21.15.112:0/1237665689 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:46.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95759e640 1 --2- 172.21.15.112:0/1237665689 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9581623e0 0x7fd95815e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd956d9d640 1 --2- 172.21.15.112:0/1237665689 >> v2:172.21.15.169:3300/0 conn(0x7fd95815e260 0x7fd9580afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95659c640 1 -- 172.21.15.112:0/1237665689 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9581623e0 msgr2=0x7fd95815e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:46.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95659c640 1 --2- 172.21.15.112:0/1237665689 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9581623e0 0x7fd95815e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95659c640 1 -- 172.21.15.112:0/1237665689 >> v2:172.21.15.169:3300/0 conn(0x7fd95815e260 msgr2=0x7fd9580afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:46.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95659c640 1 --2- 172.21.15.112:0/1237665689 >> v2:172.21.15.169:3300/0 conn(0x7fd95815e260 0x7fd9580afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95659c640 1 -- 172.21.15.112:0/1237665689 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9580af5f0 con 0x7fd958067e30 2024-09-15T23:54:46.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd95759e640 1 --2- 172.21.15.112:0/1237665689 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9581623e0 0x7fd95815e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:46.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.444+0000 7fd956d9d640 1 --2- 172.21.15.112:0/1237665689 >> v2:172.21.15.169:3300/0 conn(0x7fd95815e260 0x7fd9580afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:46.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95659c640 1 --2- 172.21.15.112:0/1237665689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd958067e30 0x7fd958161ea0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd958072270 tx=0x7fd94c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf76c9f3c1dd3a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:46.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd955d9b640 1 -- 172.21.15.112:0/1237665689 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c0aa660 con 0x7fd958067e30 2024-09-15T23:54:46.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd955d9b640 1 -- 172.21.15.112:0/1237665689 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd94c0af070 con 0x7fd958067e30 2024-09-15T23:54:46.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd955d9b640 1 -- 172.21.15.112:0/1237665689 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c0aaa20 con 0x7fd958067e30 2024-09-15T23:54:46.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 -- 172.21.15.112:0/1237665689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd958067e30 msgr2=0x7fd958161ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 --2- 172.21.15.112:0/1237665689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd958067e30 0x7fd958161ea0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd958072270 tx=0x7fd94c01c520 comp rx=0 tx=0).stop 2024-09-15T23:54:46.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 -- 172.21.15.112:0/1237665689 shutdown_connections 2024-09-15T23:54:46.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 --2- 172.21.15.112:0/1237665689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd958067e30 0x7fd958161ea0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 --2- 172.21.15.112:0/1237665689 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9581623e0 0x7fd95815e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 --2- 172.21.15.112:0/1237665689 >> v2:172.21.15.169:3300/0 conn(0x7fd95815e260 0x7fd9580afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 -- 172.21.15.112:0/1237665689 >> 172.21.15.112:0/1237665689 conn(0x7fd958073580 msgr2=0x7fd95806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:46.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 -- 172.21.15.112:0/1237665689 shutdown_connections 2024-09-15T23:54:46.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 -- 172.21.15.112:0/1237665689 wait complete. 2024-09-15T23:54:46.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 Processor -- start 2024-09-15T23:54:46.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 -- start start 2024-09-15T23:54:46.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd958067e30 0x7fd958153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd95815e260 0x7fd958154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9581623e0 0x7fd9580cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd95815f720 con 0x7fd958067e30 2024-09-15T23:54:46.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd95815f5a0 con 0x7fd95815e260 2024-09-15T23:54:46.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95d020640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd9580b41a0 con 0x7fd9581623e0 2024-09-15T23:54:46.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd956d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd958067e30 0x7fd958153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd956d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd958067e30 0x7fd958153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50390/0 (socket says 172.21.15.112:50390) 2024-09-15T23:54:46.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd956d9d640 1 -- 172.21.15.112:0/275110447 learned_addr learned my addr 172.21.15.112:0/275110447 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:46.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95659c640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd95815e260 0x7fd958154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95759e640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9581623e0 0x7fd9580cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd956d9d640 1 -- 172.21.15.112:0/275110447 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9581623e0 msgr2=0x7fd9580cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd956d9d640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9581623e0 0x7fd9580cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd956d9d640 1 -- 172.21.15.112:0/275110447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd95815e260 msgr2=0x7fd958154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd956d9d640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd95815e260 0x7fd958154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd956d9d640 1 -- 172.21.15.112:0/275110447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95815be90 con 0x7fd958067e30 2024-09-15T23:54:46.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd95759e640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9581623e0 0x7fd9580cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:46.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.448+0000 7fd956d9d640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd958067e30 0x7fd958153570 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd94800cf10 tx=0x7fd94800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:46.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.452+0000 7fd93f7fe640 1 -- 172.21.15.112:0/275110447 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94801a070 con 0x7fd958067e30 2024-09-15T23:54:46.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.452+0000 7fd93f7fe640 1 -- 172.21.15.112:0/275110447 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd94800d840 con 0x7fd958067e30 2024-09-15T23:54:46.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.452+0000 7fd93f7fe640 1 -- 172.21.15.112:0/275110447 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94800dc10 con 0x7fd958067e30 2024-09-15T23:54:46.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.452+0000 7fd95d020640 1 -- 172.21.15.112:0/275110447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95815c170 con 0x7fd958067e30 2024-09-15T23:54:46.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.452+0000 7fd95d020640 1 -- 172.21.15.112:0/275110447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95815c730 con 0x7fd958067e30 2024-09-15T23:54:46.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.452+0000 7fd95d020640 1 -- 172.21.15.112:0/275110447 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9580afff0 con 0x7fd958067e30 2024-09-15T23:54:46.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.452+0000 7fd93f7fe640 1 -- 172.21.15.112:0/275110447 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd94801d070 con 0x7fd958067e30 2024-09-15T23:54:46.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.452+0000 7fd93f7fe640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd9440678c0 0x7fd944069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.452+0000 7fd93f7fe640 1 -- 172.21.15.112:0/275110447 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fd9480865a0 con 0x7fd958067e30 2024-09-15T23:54:46.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.452+0000 7fd95659c640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd9440678c0 0x7fd944069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.452+0000 7fd95659c640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd9440678c0 0x7fd944069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0ae000 tx=0x7fd94c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:46.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.456+0000 7fd93f7fe640 1 -- 172.21.15.112:0/275110447 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd9480569c0 con 0x7fd958067e30 2024-09-15T23:54:46.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.612+0000 7fd95d020640 1 -- 172.21.15.112:0/275110447 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd95815b600 con 0x7fd9440678c0 2024-09-15T23:54:46.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.632+0000 7fd93f7fe640 1 -- 172.21.15.112:0/275110447 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251161 (secure 0 0 0) 0x7fd95815b600 con 0x7fd9440678c0 2024-09-15T23:54:46.639 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:46.641 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:54:46.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.636+0000 7fd95d020640 1 -- 172.21.15.112:0/275110447 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd9440678c0 msgr2=0x7fd944069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.636+0000 7fd95d020640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd9440678c0 0x7fd944069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0ae000 tx=0x7fd94c0a7000 comp rx=0 tx=0).stop 2024-09-15T23:54:46.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.636+0000 7fd95d020640 1 -- 172.21.15.112:0/275110447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd958067e30 msgr2=0x7fd958153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.636+0000 7fd95d020640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd958067e30 0x7fd958153570 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd94800cf10 tx=0x7fd94800a710 comp rx=0 tx=0).stop 2024-09-15T23:54:46.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.636+0000 7fd95d020640 1 -- 172.21.15.112:0/275110447 shutdown_connections 2024-09-15T23:54:46.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.636+0000 7fd95d020640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd9440678c0 0x7fd944069d80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.636+0000 7fd95d020640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9581623e0 0x7fd9580cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.636+0000 7fd95d020640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd95815e260 0x7fd958154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.636+0000 7fd95d020640 1 --2- 172.21.15.112:0/275110447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd958067e30 0x7fd958153570 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.636+0000 7fd95d020640 1 -- 172.21.15.112:0/275110447 >> 172.21.15.112:0/275110447 conn(0x7fd958073580 msgr2=0x7fd95806fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:46.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.636+0000 7fd95d020640 1 -- 172.21.15.112:0/275110447 shutdown_connections 2024-09-15T23:54:46.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.636+0000 7fd95d020640 1 -- 172.21.15.112:0/275110447 wait complete. 2024-09-15T23:54:46.656 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-15T23:54:45.249779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":188,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225004,"kb_used_data":4600,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749716,"statfs":{"total":773094113280,"available":772863709184,"internally_reserved":0,"allocated":4710400,"data_stored":2661187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001326"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.679984+0000","last_change":"2024-09-15T23:54:43.666774+0000","last_active":"2024-09-15T23:54:43.679984+0000","last_peered":"2024-09-15T23:54:43.679984+0000","last_clean":"2024-09-15T23:54:43.679984+0000","last_became_active":"2024-09-15T23:54:43.665876+0000","last_became_peered":"2024-09-15T23:54:43.665876+0000","last_unstale":"2024-09-15T23:54:43.679984+0000","last_undegraded":"2024-09-15T23:54:43.679984+0000","last_fullsized":"2024-09-15T23:54:43.679984+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:32.987095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682636+0000","last_change":"2024-09-15T23:54:43.669791+0000","last_active":"2024-09-15T23:54:43.682636+0000","last_peered":"2024-09-15T23:54:43.682636+0000","last_clean":"2024-09-15T23:54:43.682636+0000","last_became_active":"2024-09-15T23:54:43.669151+0000","last_became_peered":"2024-09-15T23:54:43.669151+0000","last_unstale":"2024-09-15T23:54:43.682636+0000","last_undegraded":"2024-09-15T23:54:43.682636+0000","last_fullsized":"2024-09-15T23:54:43.682636+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.809746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.673395+0000","last_change":"2024-09-15T23:54:43.658229+0000","last_active":"2024-09-15T23:54:43.673395+0000","last_peered":"2024-09-15T23:54:43.673395+0000","last_clean":"2024-09-15T23:54:43.673395+0000","last_became_active":"2024-09-15T23:54:43.657551+0000","last_became_peered":"2024-09-15T23:54:43.657551+0000","last_unstale":"2024-09-15T23:54:43.673395+0000","last_undegraded":"2024-09-15T23:54:43.673395+0000","last_fullsized":"2024-09-15T23:54:43.673395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:31.936628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.680196+0000","last_change":"2024-09-15T23:54:43.672536+0000","last_active":"2024-09-15T23:54:43.680196+0000","last_peered":"2024-09-15T23:54:43.680196+0000","last_clean":"2024-09-15T23:54:43.680196+0000","last_became_active":"2024-09-15T23:54:43.671956+0000","last_became_peered":"2024-09-15T23:54:43.671956+0000","last_unstale":"2024-09-15T23:54:43.680196+0000","last_undegraded":"2024-09-15T23:54:43.680196+0000","last_fullsized":"2024-09-15T23:54:43.680196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:59.226661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.655402+0000","last_change":"2024-09-15T23:54:43.651070+0000","last_active":"2024-09-15T23:54:43.655402+0000","last_peered":"2024-09-15T23:54:43.655402+0000","last_clean":"2024-09-15T23:54:43.655402+0000","last_became_active":"2024-09-15T23:54:43.650351+0000","last_became_peered":"2024-09-15T23:54:43.650351+0000","last_unstale":"2024-09-15T23:54:43.655402+0000","last_undegraded":"2024-09-15T23:54:43.655402+0000","last_fullsized":"2024-09-15T23:54:43.655402+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:48.693662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675542+0000","last_change":"2024-09-15T23:54:43.658663+0000","last_active":"2024-09-15T23:54:43.675542+0000","last_peered":"2024-09-15T23:54:43.675542+0000","last_clean":"2024-09-15T23:54:43.675542+0000","last_became_active":"2024-09-15T23:54:43.657995+0000","last_became_peered":"2024-09-15T23:54:43.657995+0000","last_unstale":"2024-09-15T23:54:43.675542+0000","last_undegraded":"2024-09-15T23:54:43.675542+0000","last_fullsized":"2024-09-15T23:54:43.675542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:32.953360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.641190+0000","last_change":"2024-09-15T23:54:43.637868+0000","last_active":"2024-09-15T23:54:43.641190+0000","last_peered":"2024-09-15T23:54:43.641190+0000","last_clean":"2024-09-15T23:54:43.641190+0000","last_became_active":"2024-09-15T23:54:43.637468+0000","last_became_peered":"2024-09-15T23:54:43.637468+0000","last_unstale":"2024-09-15T23:54:43.641190+0000","last_undegraded":"2024-09-15T23:54:43.641190+0000","last_fullsized":"2024-09-15T23:54:43.641190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:19.391528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684490+0000","last_change":"2024-09-15T23:54:43.672587+0000","last_active":"2024-09-15T23:54:43.684490+0000","last_peered":"2024-09-15T23:54:43.684490+0000","last_clean":"2024-09-15T23:54:43.684490+0000","last_became_active":"2024-09-15T23:54:43.671772+0000","last_became_peered":"2024-09-15T23:54:43.671772+0000","last_unstale":"2024-09-15T23:54:43.684490+0000","last_undegraded":"2024-09-15T23:54:43.684490+0000","last_fullsized":"2024-09-15T23:54:43.684490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:54.838047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.655363+0000","last_change":"2024-09-15T23:54:43.650837+0000","last_active":"2024-09-15T23:54:43.655363+0000","last_peered":"2024-09-15T23:54:43.655363+0000","last_clean":"2024-09-15T23:54:43.655363+0000","last_became_active":"2024-09-15T23:54:43.650113+0000","last_became_peered":"2024-09-15T23:54:43.650113+0000","last_unstale":"2024-09-15T23:54:43.655363+0000","last_undegraded":"2024-09-15T23:54:43.655363+0000","last_fullsized":"2024-09-15T23:54:43.655363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:19.391528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648359+0000","last_change":"2024-09-15T23:54:43.641037+0000","last_active":"2024-09-15T23:54:43.648359+0000","last_peered":"2024-09-15T23:54:43.648359+0000","last_clean":"2024-09-15T23:54:43.648359+0000","last_became_active":"2024-09-15T23:54:43.640738+0000","last_became_peered":"2024-09-15T23:54:43.640738+0000","last_unstale":"2024-09-15T23:54:43.648359+0000","last_undegraded":"2024-09-15T23:54:43.648359+0000","last_fullsized":"2024-09-15T23:54:43.648359+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:48.693662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648419+0000","last_change":"2024-09-15T23:54:43.639536+0000","last_active":"2024-09-15T23:54:43.648419+0000","last_peered":"2024-09-15T23:54:43.648419+0000","last_clean":"2024-09-15T23:54:43.648419+0000","last_became_active":"2024-09-15T23:54:43.636784+0000","last_became_peered":"2024-09-15T23:54:43.636784+0000","last_unstale":"2024-09-15T23:54:43.648419+0000","last_undegraded":"2024-09-15T23:54:43.648419+0000","last_fullsized":"2024-09-15T23:54:43.648419+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:44.483323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682433+0000","last_change":"2024-09-15T23:54:43.677035+0000","last_active":"2024-09-15T23:54:43.682433+0000","last_peered":"2024-09-15T23:54:43.682433+0000","last_clean":"2024-09-15T23:54:43.682433+0000","last_became_active":"2024-09-15T23:54:43.676463+0000","last_became_peered":"2024-09-15T23:54:43.676463+0000","last_unstale":"2024-09-15T23:54:43.682433+0000","last_undegraded":"2024-09-15T23:54:43.682433+0000","last_fullsized":"2024-09-15T23:54:43.682433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:37.184096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.661715+0000","last_change":"2024-09-15T23:54:43.658337+0000","last_active":"2024-09-15T23:54:43.661715+0000","last_peered":"2024-09-15T23:54:43.661715+0000","last_clean":"2024-09-15T23:54:43.661715+0000","last_became_active":"2024-09-15T23:54:43.658020+0000","last_became_peered":"2024-09-15T23:54:43.658020+0000","last_unstale":"2024-09-15T23:54:43.661715+0000","last_undegraded":"2024-09-15T23:54:43.661715+0000","last_fullsized":"2024-09-15T23:54:43.661715+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:08.810523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.645276+0000","last_change":"2024-09-15T23:54:43.640668+0000","last_active":"2024-09-15T23:54:43.645276+0000","last_peered":"2024-09-15T23:54:43.645276+0000","last_clean":"2024-09-15T23:54:43.645276+0000","last_became_active":"2024-09-15T23:54:43.640362+0000","last_became_peered":"2024-09-15T23:54:43.640362+0000","last_unstale":"2024-09-15T23:54:43.645276+0000","last_undegraded":"2024-09-15T23:54:43.645276+0000","last_fullsized":"2024-09-15T23:54:43.645276+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:57.007396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.672495+0000","last_change":"2024-09-15T23:54:43.669305+0000","last_active":"2024-09-15T23:54:43.672495+0000","last_peered":"2024-09-15T23:54:43.672495+0000","last_clean":"2024-09-15T23:54:43.672495+0000","last_became_active":"2024-09-15T23:54:43.669057+0000","last_became_peered":"2024-09-15T23:54:43.669057+0000","last_unstale":"2024-09-15T23:54:43.672495+0000","last_undegraded":"2024-09-15T23:54:43.672495+0000","last_fullsized":"2024-09-15T23:54:43.672495+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:10.708992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678697+0000","last_change":"2024-09-15T23:54:43.678254+0000","last_active":"2024-09-15T23:54:43.678697+0000","last_peered":"2024-09-15T23:54:43.678697+0000","last_clean":"2024-09-15T23:54:43.678697+0000","last_became_active":"2024-09-15T23:54:43.678013+0000","last_became_peered":"2024-09-15T23:54:43.678013+0000","last_unstale":"2024-09-15T23:54:43.678697+0000","last_undegraded":"2024-09-15T23:54:43.678697+0000","last_fullsized":"2024-09-15T23:54:43.678697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:13.211799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642716+0000","last_change":"2024-09-15T23:54:43.631179+0000","last_active":"2024-09-15T23:54:43.642716+0000","last_peered":"2024-09-15T23:54:43.642716+0000","last_clean":"2024-09-15T23:54:43.642716+0000","last_became_active":"2024-09-15T23:54:43.630496+0000","last_became_peered":"2024-09-15T23:54:43.630496+0000","last_unstale":"2024-09-15T23:54:43.642716+0000","last_undegraded":"2024-09-15T23:54:43.642716+0000","last_fullsized":"2024-09-15T23:54:43.642716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:38:00.554695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.643873+0000","last_change":"2024-09-15T23:54:43.628988+0000","last_active":"2024-09-15T23:54:43.643873+0000","last_peered":"2024-09-15T23:54:43.643873+0000","last_clean":"2024-09-15T23:54:43.643873+0000","last_became_active":"2024-09-15T23:54:43.628667+0000","last_became_peered":"2024-09-15T23:54:43.628667+0000","last_unstale":"2024-09-15T23:54:43.643873+0000","last_undegraded":"2024-09-15T23:54:43.643873+0000","last_fullsized":"2024-09-15T23:54:43.643873+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:22.709716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:54:42.570937+0000","last_change":"2024-09-15T23:54:42.570937+0000","last_active":"2024-09-15T23:54:42.570937+0000","last_peered":"2024-09-15T23:54:42.570937+0000","last_clean":"2024-09-15T23:54:42.570937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:42.570937+0000","last_undegraded":"2024-09-15T23:54:42.570937+0000","last_fullsized":"2024-09-15T23:54:42.570937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648372+0000","last_change":"2024-09-15T23:54:43.640856+0000","last_active":"2024-09-15T23:54:43.648372+0000","last_peered":"2024-09-15T23:54:43.648372+0000","last_clean":"2024-09-15T23:54:43.648372+0000","last_became_active":"2024-09-15T23:54:43.640593+0000","last_became_peered":"2024-09-15T23:54:43.640593+0000","last_unstale":"2024-09-15T23:54:43.648372+0000","last_undegraded":"2024-09-15T23:54:43.648372+0000","last_fullsized":"2024-09-15T23:54:43.648372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.809746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.681429+0000","last_change":"2024-09-15T23:54:43.680914+0000","last_active":"2024-09-15T23:54:43.681429+0000","last_peered":"2024-09-15T23:54:43.681429+0000","last_clean":"2024-09-15T23:54:43.681429+0000","last_became_active":"2024-09-15T23:54:43.680603+0000","last_became_peered":"2024-09-15T23:54:43.680603+0000","last_unstale":"2024-09-15T23:54:43.681429+0000","last_undegraded":"2024-09-15T23:54:43.681429+0000","last_fullsized":"2024-09-15T23:54:43.681429+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:05.527477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676646+0000","last_change":"2024-09-15T23:54:43.668953+0000","last_active":"2024-09-15T23:54:43.676646+0000","last_peered":"2024-09-15T23:54:43.676646+0000","last_clean":"2024-09-15T23:54:43.676646+0000","last_became_active":"2024-09-15T23:54:43.668662+0000","last_became_peered":"2024-09-15T23:54:43.668662+0000","last_unstale":"2024-09-15T23:54:43.676646+0000","last_undegraded":"2024-09-15T23:54:43.676646+0000","last_fullsized":"2024-09-15T23:54:43.676646+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:00.991165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648608+0000","last_change":"2024-09-15T23:54:43.647006+0000","last_active":"2024-09-15T23:54:43.648608+0000","last_peered":"2024-09-15T23:54:43.648608+0000","last_clean":"2024-09-15T23:54:43.648608+0000","last_became_active":"2024-09-15T23:54:43.646809+0000","last_became_peered":"2024-09-15T23:54:43.646809+0000","last_unstale":"2024-09-15T23:54:43.648608+0000","last_undegraded":"2024-09-15T23:54:43.648608+0000","last_fullsized":"2024-09-15T23:54:43.648608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:29.699749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684440+0000","last_change":"2024-09-15T23:54:43.665724+0000","last_active":"2024-09-15T23:54:43.684440+0000","last_peered":"2024-09-15T23:54:43.684440+0000","last_clean":"2024-09-15T23:54:43.684440+0000","last_became_active":"2024-09-15T23:54:43.665067+0000","last_became_peered":"2024-09-15T23:54:43.665067+0000","last_unstale":"2024-09-15T23:54:43.684440+0000","last_undegraded":"2024-09-15T23:54:43.684440+0000","last_fullsized":"2024-09-15T23:54:43.684440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:02:27.335899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676603+0000","last_change":"2024-09-15T23:54:43.668148+0000","last_active":"2024-09-15T23:54:43.676603+0000","last_peered":"2024-09-15T23:54:43.676603+0000","last_clean":"2024-09-15T23:54:43.676603+0000","last_became_active":"2024-09-15T23:54:43.667833+0000","last_became_peered":"2024-09-15T23:54:43.667833+0000","last_unstale":"2024-09-15T23:54:43.676603+0000","last_undegraded":"2024-09-15T23:54:43.676603+0000","last_fullsized":"2024-09-15T23:54:43.676603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:32.953360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684477+0000","last_change":"2024-09-15T23:54:43.671918+0000","last_active":"2024-09-15T23:54:43.684477+0000","last_peered":"2024-09-15T23:54:43.684477+0000","last_clean":"2024-09-15T23:54:43.684477+0000","last_became_active":"2024-09-15T23:54:43.666846+0000","last_became_peered":"2024-09-15T23:54:43.666846+0000","last_unstale":"2024-09-15T23:54:43.684477+0000","last_undegraded":"2024-09-15T23:54:43.684477+0000","last_fullsized":"2024-09-15T23:54:43.684477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:21.949038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.656728+0000","last_change":"2024-09-15T23:54:43.651577+0000","last_active":"2024-09-15T23:54:43.656728+0000","last_peered":"2024-09-15T23:54:43.656728+0000","last_clean":"2024-09-15T23:54:43.656728+0000","last_became_active":"2024-09-15T23:54:43.651254+0000","last_became_peered":"2024-09-15T23:54:43.651254+0000","last_unstale":"2024-09-15T23:54:43.656728+0000","last_undegraded":"2024-09-15T23:54:43.656728+0000","last_fullsized":"2024-09-15T23:54:43.656728+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:26.589213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677107+0000","last_change":"2024-09-15T23:54:43.672947+0000","last_active":"2024-09-15T23:54:43.677107+0000","last_peered":"2024-09-15T23:54:43.677107+0000","last_clean":"2024-09-15T23:54:43.677107+0000","last_became_active":"2024-09-15T23:54:43.672703+0000","last_became_peered":"2024-09-15T23:54:43.672703+0000","last_unstale":"2024-09-15T23:54:43.677107+0000","last_undegraded":"2024-09-15T23:54:43.677107+0000","last_fullsized":"2024-09-15T23:54:43.677107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:25.006535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.658793+0000","last_change":"2024-09-15T23:54:43.652965+0000","last_active":"2024-09-15T23:54:43.658793+0000","last_peered":"2024-09-15T23:54:43.658793+0000","last_clean":"2024-09-15T23:54:43.658793+0000","last_became_active":"2024-09-15T23:54:43.652697+0000","last_became_peered":"2024-09-15T23:54:43.652697+0000","last_unstale":"2024-09-15T23:54:43.658793+0000","last_undegraded":"2024-09-15T23:54:43.658793+0000","last_fullsized":"2024-09-15T23:54:43.658793+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:25.903632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648610+0000","last_change":"2024-09-15T23:54:43.646314+0000","last_active":"2024-09-15T23:54:43.648610+0000","last_peered":"2024-09-15T23:54:43.648610+0000","last_clean":"2024-09-15T23:54:43.648610+0000","last_became_active":"2024-09-15T23:54:43.646050+0000","last_became_peered":"2024-09-15T23:54:43.646050+0000","last_unstale":"2024-09-15T23:54:43.648610+0000","last_undegraded":"2024-09-15T23:54:43.648610+0000","last_fullsized":"2024-09-15T23:54:43.648610+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.127820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677124+0000","last_change":"2024-09-15T23:54:43.674939+0000","last_active":"2024-09-15T23:54:43.677124+0000","last_peered":"2024-09-15T23:54:43.677124+0000","last_clean":"2024-09-15T23:54:43.677124+0000","last_became_active":"2024-09-15T23:54:43.674692+0000","last_became_peered":"2024-09-15T23:54:43.674692+0000","last_unstale":"2024-09-15T23:54:43.677124+0000","last_undegraded":"2024-09-15T23:54:43.677124+0000","last_fullsized":"2024-09-15T23:54:43.677124+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:55.655404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677205+0000","last_change":"2024-09-15T23:54:43.657536+0000","last_active":"2024-09-15T23:54:43.677205+0000","last_peered":"2024-09-15T23:54:43.677205+0000","last_clean":"2024-09-15T23:54:43.677205+0000","last_became_active":"2024-09-15T23:54:43.650847+0000","last_became_peered":"2024-09-15T23:54:43.650847+0000","last_unstale":"2024-09-15T23:54:43.677205+0000","last_undegraded":"2024-09-15T23:54:43.677205+0000","last_fullsized":"2024-09-15T23:54:43.677205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:00.991165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642992+0000","last_change":"2024-09-15T23:54:43.635951+0000","last_active":"2024-09-15T23:54:43.642992+0000","last_peered":"2024-09-15T23:54:43.642992+0000","last_clean":"2024-09-15T23:54:43.642992+0000","last_became_active":"2024-09-15T23:54:43.635781+0000","last_became_peered":"2024-09-15T23:54:43.635781+0000","last_unstale":"2024-09-15T23:54:43.642992+0000","last_undegraded":"2024-09-15T23:54:43.642992+0000","last_fullsized":"2024-09-15T23:54:43.642992+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:02.199351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.660519+0000","last_change":"2024-09-15T23:54:42.603087+0000","last_active":"2024-09-15T23:54:43.660519+0000","last_peered":"2024-09-15T23:54:43.660519+0000","last_clean":"2024-09-15T23:54:43.660519+0000","last_became_active":"2024-09-15T23:54:42.602691+0000","last_became_peered":"2024-09-15T23:54:42.602691+0000","last_unstale":"2024-09-15T23:54:43.660519+0000","last_undegraded":"2024-09-15T23:54:43.660519+0000","last_fullsized":"2024-09-15T23:54:43.660519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:14.792784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675033+0000","last_change":"2024-09-15T23:54:43.643378+0000","last_active":"2024-09-15T23:54:43.675033+0000","last_peered":"2024-09-15T23:54:43.675033+0000","last_clean":"2024-09-15T23:54:43.675033+0000","last_became_active":"2024-09-15T23:54:43.642541+0000","last_became_peered":"2024-09-15T23:54:43.642541+0000","last_unstale":"2024-09-15T23:54:43.675033+0000","last_undegraded":"2024-09-15T23:54:43.675033+0000","last_fullsized":"2024-09-15T23:54:43.675033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:03.360218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678279+0000","last_change":"2024-09-15T23:54:42.603652+0000","last_active":"2024-09-15T23:54:43.678279+0000","last_peered":"2024-09-15T23:54:43.678279+0000","last_clean":"2024-09-15T23:54:43.678279+0000","last_became_active":"2024-09-15T23:54:42.603047+0000","last_became_peered":"2024-09-15T23:54:42.603047+0000","last_unstale":"2024-09-15T23:54:43.678279+0000","last_undegraded":"2024-09-15T23:54:43.678279+0000","last_fullsized":"2024-09-15T23:54:43.678279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:14.792784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.643928+0000","last_change":"2024-09-15T23:54:43.637123+0000","last_active":"2024-09-15T23:54:43.643928+0000","last_peered":"2024-09-15T23:54:43.643928+0000","last_clean":"2024-09-15T23:54:43.643928+0000","last_became_active":"2024-09-15T23:54:43.636836+0000","last_became_peered":"2024-09-15T23:54:43.636836+0000","last_unstale":"2024-09-15T23:54:43.643928+0000","last_undegraded":"2024-09-15T23:54:43.643928+0000","last_fullsized":"2024-09-15T23:54:43.643928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:38.608267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684964+0000","last_change":"2024-09-15T23:54:42.625060+0000","last_active":"2024-09-15T23:54:43.684964+0000","last_peered":"2024-09-15T23:54:43.684964+0000","last_clean":"2024-09-15T23:54:43.684964+0000","last_became_active":"2024-09-15T23:54:42.624313+0000","last_became_peered":"2024-09-15T23:54:42.624313+0000","last_unstale":"2024-09-15T23:54:43.684964+0000","last_undegraded":"2024-09-15T23:54:43.684964+0000","last_fullsized":"2024-09-15T23:54:43.684964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:38.798300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675091+0000","last_change":"2024-09-15T23:54:43.643735+0000","last_active":"2024-09-15T23:54:43.675091+0000","last_peered":"2024-09-15T23:54:43.675091+0000","last_clean":"2024-09-15T23:54:43.675091+0000","last_became_active":"2024-09-15T23:54:43.642717+0000","last_became_peered":"2024-09-15T23:54:43.642717+0000","last_unstale":"2024-09-15T23:54:43.675091+0000","last_undegraded":"2024-09-15T23:54:43.675091+0000","last_fullsized":"2024-09-15T23:54:43.675091+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:31.056987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.680652+0000","last_change":"2024-09-15T23:54:42.621654+0000","last_active":"2024-09-15T23:54:43.680652+0000","last_peered":"2024-09-15T23:54:43.680652+0000","last_clean":"2024-09-15T23:54:43.680652+0000","last_became_active":"2024-09-15T23:54:42.621285+0000","last_became_peered":"2024-09-15T23:54:42.621285+0000","last_unstale":"2024-09-15T23:54:43.680652+0000","last_undegraded":"2024-09-15T23:54:43.680652+0000","last_fullsized":"2024-09-15T23:54:43.680652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:34.417323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684558+0000","last_change":"2024-09-15T23:54:43.678051+0000","last_active":"2024-09-15T23:54:43.684558+0000","last_peered":"2024-09-15T23:54:43.684558+0000","last_clean":"2024-09-15T23:54:43.684558+0000","last_became_active":"2024-09-15T23:54:43.677319+0000","last_became_peered":"2024-09-15T23:54:43.677319+0000","last_unstale":"2024-09-15T23:54:43.684558+0000","last_undegraded":"2024-09-15T23:54:43.684558+0000","last_fullsized":"2024-09-15T23:54:43.684558+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:26.378086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.639962+0000","last_change":"2024-09-15T23:54:42.601838+0000","last_active":"2024-09-15T23:54:43.639962+0000","last_peered":"2024-09-15T23:54:43.639962+0000","last_clean":"2024-09-15T23:54:43.639962+0000","last_became_active":"2024-09-15T23:54:42.601580+0000","last_became_peered":"2024-09-15T23:54:42.601580+0000","last_unstale":"2024-09-15T23:54:43.639962+0000","last_undegraded":"2024-09-15T23:54:43.639962+0000","last_fullsized":"2024-09-15T23:54:43.639962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:16.673465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.650838+0000","last_change":"2024-09-15T23:54:43.647396+0000","last_active":"2024-09-15T23:54:43.650838+0000","last_peered":"2024-09-15T23:54:43.650838+0000","last_clean":"2024-09-15T23:54:43.650838+0000","last_became_active":"2024-09-15T23:54:43.647101+0000","last_became_peered":"2024-09-15T23:54:43.647101+0000","last_unstale":"2024-09-15T23:54:43.650838+0000","last_undegraded":"2024-09-15T23:54:43.650838+0000","last_fullsized":"2024-09-15T23:54:43.650838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:49.567963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.664488+0000","last_change":"2024-09-15T23:54:42.627071+0000","last_active":"2024-09-15T23:54:43.664488+0000","last_peered":"2024-09-15T23:54:43.664488+0000","last_clean":"2024-09-15T23:54:43.664488+0000","last_became_active":"2024-09-15T23:54:42.626584+0000","last_became_peered":"2024-09-15T23:54:42.626584+0000","last_unstale":"2024-09-15T23:54:43.664488+0000","last_undegraded":"2024-09-15T23:54:43.664488+0000","last_fullsized":"2024-09-15T23:54:43.664488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:11.254409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642808+0000","last_change":"2024-09-15T23:54:43.631269+0000","last_active":"2024-09-15T23:54:43.642808+0000","last_peered":"2024-09-15T23:54:43.642808+0000","last_clean":"2024-09-15T23:54:43.642808+0000","last_became_active":"2024-09-15T23:54:43.630993+0000","last_became_peered":"2024-09-15T23:54:43.630993+0000","last_unstale":"2024-09-15T23:54:43.642808+0000","last_undegraded":"2024-09-15T23:54:43.642808+0000","last_fullsized":"2024-09-15T23:54:43.642808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:24.435909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625586+0000","last_change":"2024-09-15T23:54:42.611939+0000","last_active":"2024-09-15T23:54:43.625586+0000","last_peered":"2024-09-15T23:54:43.625586+0000","last_clean":"2024-09-15T23:54:43.625586+0000","last_became_active":"2024-09-15T23:54:42.611180+0000","last_became_peered":"2024-09-15T23:54:42.611180+0000","last_unstale":"2024-09-15T23:54:43.625586+0000","last_undegraded":"2024-09-15T23:54:43.625586+0000","last_fullsized":"2024-09-15T23:54:43.625586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:07.254369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675683+0000","last_change":"2024-09-15T23:54:43.658082+0000","last_active":"2024-09-15T23:54:43.675683+0000","last_peered":"2024-09-15T23:54:43.675683+0000","last_clean":"2024-09-15T23:54:43.675683+0000","last_became_active":"2024-09-15T23:54:43.656463+0000","last_became_peered":"2024-09-15T23:54:43.656463+0000","last_unstale":"2024-09-15T23:54:43.675683+0000","last_undegraded":"2024-09-15T23:54:43.675683+0000","last_fullsized":"2024-09-15T23:54:43.675683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:57.007396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625925+0000","last_change":"2024-09-15T23:54:42.597005+0000","last_active":"2024-09-15T23:54:43.625925+0000","last_peered":"2024-09-15T23:54:43.625925+0000","last_clean":"2024-09-15T23:54:43.625925+0000","last_became_active":"2024-09-15T23:54:42.596627+0000","last_became_peered":"2024-09-15T23:54:42.596627+0000","last_unstale":"2024-09-15T23:54:43.625925+0000","last_undegraded":"2024-09-15T23:54:43.625925+0000","last_fullsized":"2024-09-15T23:54:43.625925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:26.732611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677039+0000","last_change":"2024-09-15T23:54:43.658368+0000","last_active":"2024-09-15T23:54:43.677039+0000","last_peered":"2024-09-15T23:54:43.677039+0000","last_clean":"2024-09-15T23:54:43.677039+0000","last_became_active":"2024-09-15T23:54:43.650724+0000","last_became_peered":"2024-09-15T23:54:43.650724+0000","last_unstale":"2024-09-15T23:54:43.677039+0000","last_undegraded":"2024-09-15T23:54:43.677039+0000","last_fullsized":"2024-09-15T23:54:43.677039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:56.166523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.635501+0000","last_change":"2024-09-15T23:54:42.624959+0000","last_active":"2024-09-15T23:54:43.635501+0000","last_peered":"2024-09-15T23:54:43.635501+0000","last_clean":"2024-09-15T23:54:43.635501+0000","last_became_active":"2024-09-15T23:54:42.624107+0000","last_became_peered":"2024-09-15T23:54:42.624107+0000","last_unstale":"2024-09-15T23:54:43.635501+0000","last_undegraded":"2024-09-15T23:54:43.635501+0000","last_fullsized":"2024-09-15T23:54:43.635501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:28.523942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.638066+0000","last_change":"2024-09-15T23:54:43.634620+0000","last_active":"2024-09-15T23:54:43.638066+0000","last_peered":"2024-09-15T23:54:43.638066+0000","last_clean":"2024-09-15T23:54:43.638066+0000","last_became_active":"2024-09-15T23:54:43.634284+0000","last_became_peered":"2024-09-15T23:54:43.634284+0000","last_unstale":"2024-09-15T23:54:43.638066+0000","last_undegraded":"2024-09-15T23:54:43.638066+0000","last_fullsized":"2024-09-15T23:54:43.638066+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:03.360218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.617515+0000","last_change":"2024-09-15T23:54:42.605069+0000","last_active":"2024-09-15T23:54:43.617515+0000","last_peered":"2024-09-15T23:54:43.617515+0000","last_clean":"2024-09-15T23:54:43.617515+0000","last_became_active":"2024-09-15T23:54:42.604503+0000","last_became_peered":"2024-09-15T23:54:42.604503+0000","last_unstale":"2024-09-15T23:54:43.617515+0000","last_undegraded":"2024-09-15T23:54:43.617515+0000","last_fullsized":"2024-09-15T23:54:43.617515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.769934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684422+0000","last_change":"2024-09-15T23:54:43.671661+0000","last_active":"2024-09-15T23:54:43.684422+0000","last_peered":"2024-09-15T23:54:43.684422+0000","last_clean":"2024-09-15T23:54:43.684422+0000","last_became_active":"2024-09-15T23:54:43.666649+0000","last_became_peered":"2024-09-15T23:54:43.666649+0000","last_unstale":"2024-09-15T23:54:43.684422+0000","last_undegraded":"2024-09-15T23:54:43.684422+0000","last_fullsized":"2024-09-15T23:54:43.684422+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:56.823302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.665839+0000","last_change":"2024-09-15T23:54:42.626955+0000","last_active":"2024-09-15T23:54:43.665839+0000","last_peered":"2024-09-15T23:54:43.665839+0000","last_clean":"2024-09-15T23:54:43.665839+0000","last_became_active":"2024-09-15T23:54:42.626378+0000","last_became_peered":"2024-09-15T23:54:42.626378+0000","last_unstale":"2024-09-15T23:54:43.665839+0000","last_undegraded":"2024-09-15T23:54:43.665839+0000","last_fullsized":"2024-09-15T23:54:43.665839+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:41.491603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.651600+0000","last_change":"2024-09-15T23:54:43.647810+0000","last_active":"2024-09-15T23:54:43.651600+0000","last_peered":"2024-09-15T23:54:43.651600+0000","last_clean":"2024-09-15T23:54:43.651600+0000","last_became_active":"2024-09-15T23:54:43.647559+0000","last_became_peered":"2024-09-15T23:54:43.647559+0000","last_unstale":"2024-09-15T23:54:43.651600+0000","last_undegraded":"2024-09-15T23:54:43.651600+0000","last_fullsized":"2024-09-15T23:54:43.651600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:37.184096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.687213+0000","last_change":"2024-09-15T23:54:42.621794+0000","last_active":"2024-09-15T23:54:43.687213+0000","last_peered":"2024-09-15T23:54:43.687213+0000","last_clean":"2024-09-15T23:54:43.687213+0000","last_became_active":"2024-09-15T23:54:42.621085+0000","last_became_peered":"2024-09-15T23:54:42.621085+0000","last_unstale":"2024-09-15T23:54:43.687213+0000","last_undegraded":"2024-09-15T23:54:43.687213+0000","last_fullsized":"2024-09-15T23:54:43.687213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:25.577766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677306+0000","last_change":"2024-09-15T23:54:43.657690+0000","last_active":"2024-09-15T23:54:43.677306+0000","last_peered":"2024-09-15T23:54:43.677306+0000","last_clean":"2024-09-15T23:54:43.677306+0000","last_became_active":"2024-09-15T23:54:43.650910+0000","last_became_peered":"2024-09-15T23:54:43.650910+0000","last_unstale":"2024-09-15T23:54:43.677306+0000","last_undegraded":"2024-09-15T23:54:43.677306+0000","last_fullsized":"2024-09-15T23:54:43.677306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:05.527477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.685074+0000","last_change":"2024-09-15T23:54:42.616261+0000","last_active":"2024-09-15T23:54:43.685074+0000","last_peered":"2024-09-15T23:54:43.685074+0000","last_clean":"2024-09-15T23:54:43.685074+0000","last_became_active":"2024-09-15T23:54:42.615529+0000","last_became_peered":"2024-09-15T23:54:42.615529+0000","last_unstale":"2024-09-15T23:54:43.685074+0000","last_undegraded":"2024-09-15T23:54:43.685074+0000","last_fullsized":"2024-09-15T23:54:43.685074+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:03.874014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682543+0000","last_change":"2024-09-15T23:54:43.669009+0000","last_active":"2024-09-15T23:54:43.682543+0000","last_peered":"2024-09-15T23:54:43.682543+0000","last_clean":"2024-09-15T23:54:43.682543+0000","last_became_active":"2024-09-15T23:54:43.667776+0000","last_became_peered":"2024-09-15T23:54:43.667776+0000","last_unstale":"2024-09-15T23:54:43.682543+0000","last_undegraded":"2024-09-15T23:54:43.682543+0000","last_fullsized":"2024-09-15T23:54:43.682543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:44.483323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.640823+0000","last_change":"2024-09-15T23:54:42.601025+0000","last_active":"2024-09-15T23:54:43.640823+0000","last_peered":"2024-09-15T23:54:43.640823+0000","last_clean":"2024-09-15T23:54:43.640823+0000","last_became_active":"2024-09-15T23:54:42.599974+0000","last_became_peered":"2024-09-15T23:54:42.599974+0000","last_unstale":"2024-09-15T23:54:43.640823+0000","last_undegraded":"2024-09-15T23:54:43.640823+0000","last_fullsized":"2024-09-15T23:54:43.640823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:34.417323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648500+0000","last_change":"2024-09-15T23:54:43.642124+0000","last_active":"2024-09-15T23:54:43.648500+0000","last_peered":"2024-09-15T23:54:43.648500+0000","last_clean":"2024-09-15T23:54:43.648500+0000","last_became_active":"2024-09-15T23:54:43.641863+0000","last_became_peered":"2024-09-15T23:54:43.641863+0000","last_unstale":"2024-09-15T23:54:43.648500+0000","last_undegraded":"2024-09-15T23:54:43.648500+0000","last_fullsized":"2024-09-15T23:54:43.648500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:29.535388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.617251+0000","last_change":"2024-09-15T23:54:42.597340+0000","last_active":"2024-09-15T23:54:43.617251+0000","last_peered":"2024-09-15T23:54:43.617251+0000","last_clean":"2024-09-15T23:54:43.617251+0000","last_became_active":"2024-09-15T23:54:42.596908+0000","last_became_peered":"2024-09-15T23:54:42.596908+0000","last_unstale":"2024-09-15T23:54:43.617251+0000","last_undegraded":"2024-09-15T23:54:43.617251+0000","last_fullsized":"2024-09-15T23:54:43.617251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:40.885229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682452+0000","last_change":"2024-09-15T23:54:43.677377+0000","last_active":"2024-09-15T23:54:43.682452+0000","last_peered":"2024-09-15T23:54:43.682452+0000","last_clean":"2024-09-15T23:54:43.682452+0000","last_became_active":"2024-09-15T23:54:43.676667+0000","last_became_peered":"2024-09-15T23:54:43.676667+0000","last_unstale":"2024-09-15T23:54:43.682452+0000","last_undegraded":"2024-09-15T23:54:43.682452+0000","last_fullsized":"2024-09-15T23:54:43.682452+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:08.810523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642008+0000","last_change":"2024-09-15T23:54:42.591210+0000","last_active":"2024-09-15T23:54:43.642008+0000","last_peered":"2024-09-15T23:54:43.642008+0000","last_clean":"2024-09-15T23:54:43.642008+0000","last_became_active":"2024-09-15T23:54:42.590512+0000","last_became_peered":"2024-09-15T23:54:42.590512+0000","last_unstale":"2024-09-15T23:54:43.642008+0000","last_undegraded":"2024-09-15T23:54:43.642008+0000","last_fullsized":"2024-09-15T23:54:43.642008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:30.045540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678242+0000","last_change":"2024-09-15T23:54:43.667252+0000","last_active":"2024-09-15T23:54:43.678242+0000","last_peered":"2024-09-15T23:54:43.678242+0000","last_clean":"2024-09-15T23:54:43.678242+0000","last_became_active":"2024-09-15T23:54:43.659011+0000","last_became_peered":"2024-09-15T23:54:43.659011+0000","last_unstale":"2024-09-15T23:54:43.678242+0000","last_undegraded":"2024-09-15T23:54:43.678242+0000","last_fullsized":"2024-09-15T23:54:43.678242+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:04.885460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.640799+0000","last_change":"2024-09-15T23:54:42.602026+0000","last_active":"2024-09-15T23:54:43.640799+0000","last_peered":"2024-09-15T23:54:43.640799+0000","last_clean":"2024-09-15T23:54:43.640799+0000","last_became_active":"2024-09-15T23:54:42.601654+0000","last_became_peered":"2024-09-15T23:54:42.601654+0000","last_unstale":"2024-09-15T23:54:43.640799+0000","last_undegraded":"2024-09-15T23:54:43.640799+0000","last_fullsized":"2024-09-15T23:54:43.640799+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:36.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.671218+0000","last_change":"2024-09-15T23:54:43.665585+0000","last_active":"2024-09-15T23:54:43.671218+0000","last_peered":"2024-09-15T23:54:43.671218+0000","last_clean":"2024-09-15T23:54:43.671218+0000","last_became_active":"2024-09-15T23:54:43.665240+0000","last_became_peered":"2024-09-15T23:54:43.665240+0000","last_unstale":"2024-09-15T23:54:43.671218+0000","last_undegraded":"2024-09-15T23:54:43.671218+0000","last_fullsized":"2024-09-15T23:54:43.671218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:40.585681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.666572+0000","last_change":"2024-09-15T23:54:42.627305+0000","last_active":"2024-09-15T23:54:43.666572+0000","last_peered":"2024-09-15T23:54:43.666572+0000","last_clean":"2024-09-15T23:54:43.666572+0000","last_became_active":"2024-09-15T23:54:42.627061+0000","last_became_peered":"2024-09-15T23:54:42.627061+0000","last_unstale":"2024-09-15T23:54:43.666572+0000","last_undegraded":"2024-09-15T23:54:43.666572+0000","last_fullsized":"2024-09-15T23:54:43.666572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:47.285819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676607+0000","last_change":"2024-09-15T23:54:43.668779+0000","last_active":"2024-09-15T23:54:43.676607+0000","last_peered":"2024-09-15T23:54:43.676607+0000","last_clean":"2024-09-15T23:54:43.676607+0000","last_became_active":"2024-09-15T23:54:43.668438+0000","last_became_peered":"2024-09-15T23:54:43.668438+0000","last_unstale":"2024-09-15T23:54:43.676607+0000","last_undegraded":"2024-09-15T23:54:43.676607+0000","last_fullsized":"2024-09-15T23:54:43.676607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:46.999984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.650161+0000","last_change":"2024-09-15T23:54:42.607764+0000","last_active":"2024-09-15T23:54:43.650161+0000","last_peered":"2024-09-15T23:54:43.650161+0000","last_clean":"2024-09-15T23:54:43.650161+0000","last_became_active":"2024-09-15T23:54:42.607054+0000","last_became_peered":"2024-09-15T23:54:42.607054+0000","last_unstale":"2024-09-15T23:54:43.650161+0000","last_undegraded":"2024-09-15T23:54:43.650161+0000","last_fullsized":"2024-09-15T23:54:43.650161+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:11.254409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:54:42.570937+0000","last_change":"2024-09-15T23:54:42.570937+0000","last_active":"2024-09-15T23:54:42.570937+0000","last_peered":"2024-09-15T23:54:42.570937+0000","last_clean":"2024-09-15T23:54:42.570937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:42.570937+0000","last_undegraded":"2024-09-15T23:54:42.570937+0000","last_fullsized":"2024-09-15T23:54:42.570937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T23:54:41.585064+0000","last_change":"2024-09-15T23:54:41.585064+0000","last_active":"2024-09-15T23:54:41.559490+0000","last_peered":"2024-09-15T23:54:41.559490+0000","last_clean":"2024-09-15T23:54:41.559490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:41.585064+0000","last_undegraded":"2024-09-15T23:54:41.585064+0000","last_fullsized":"2024-09-15T23:54:41.585064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648485+0000","last_change":"2024-09-15T23:54:43.643428+0000","last_active":"2024-09-15T23:54:43.648485+0000","last_peered":"2024-09-15T23:54:43.648485+0000","last_clean":"2024-09-15T23:54:43.648485+0000","last_became_active":"2024-09-15T23:54:43.643158+0000","last_became_peered":"2024-09-15T23:54:43.643158+0000","last_unstale":"2024-09-15T23:54:43.648485+0000","last_undegraded":"2024-09-15T23:54:43.648485+0000","last_fullsized":"2024-09-15T23:54:43.648485+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:02.150007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T23:54:41.584264+0000","last_change":"2024-09-15T23:54:41.584264+0000","last_active":"2024-09-15T23:54:41.559490+0000","last_peered":"2024-09-15T23:54:41.559490+0000","last_clean":"2024-09-15T23:54:41.559490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:41.584264+0000","last_undegraded":"2024-09-15T23:54:41.584264+0000","last_fullsized":"2024-09-15T23:54:41.584264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676955+0000","last_change":"2024-09-15T23:54:43.657288+0000","last_active":"2024-09-15T23:54:43.676955+0000","last_peered":"2024-09-15T23:54:43.676955+0000","last_clean":"2024-09-15T23:54:43.676955+0000","last_became_active":"2024-09-15T23:54:43.656050+0000","last_became_peered":"2024-09-15T23:54:43.656050+0000","last_unstale":"2024-09-15T23:54:43.676955+0000","last_undegraded":"2024-09-15T23:54:43.676955+0000","last_fullsized":"2024-09-15T23:54:43.676955+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:02.241689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625925+0000","last_change":"2024-09-15T23:54:42.598953+0000","last_active":"2024-09-15T23:54:43.625925+0000","last_peered":"2024-09-15T23:54:43.625925+0000","last_clean":"2024-09-15T23:54:43.625925+0000","last_became_active":"2024-09-15T23:54:42.597704+0000","last_became_peered":"2024-09-15T23:54:42.597704+0000","last_unstale":"2024-09-15T23:54:43.625925+0000","last_undegraded":"2024-09-15T23:54:43.625925+0000","last_fullsized":"2024-09-15T23:54:43.625925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:16.673465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.645191+0000","last_change":"2024-09-15T23:54:43.636074+0000","last_active":"2024-09-15T23:54:43.645191+0000","last_peered":"2024-09-15T23:54:43.645191+0000","last_clean":"2024-09-15T23:54:43.645191+0000","last_became_active":"2024-09-15T23:54:43.635810+0000","last_became_peered":"2024-09-15T23:54:43.635810+0000","last_unstale":"2024-09-15T23:54:43.645191+0000","last_undegraded":"2024-09-15T23:54:43.645191+0000","last_fullsized":"2024-09-15T23:54:43.645191+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:08.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625947+0000","last_change":"2024-09-15T23:54:42.596955+0000","last_active":"2024-09-15T23:54:43.625947+0000","last_peered":"2024-09-15T23:54:43.625947+0000","last_clean":"2024-09-15T23:54:43.625947+0000","last_became_active":"2024-09-15T23:54:42.596647+0000","last_became_peered":"2024-09-15T23:54:42.596647+0000","last_unstale":"2024-09-15T23:54:43.625947+0000","last_undegraded":"2024-09-15T23:54:43.625947+0000","last_fullsized":"2024-09-15T23:54:43.625947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:36.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677202+0000","last_change":"2024-09-15T23:54:43.659071+0000","last_active":"2024-09-15T23:54:43.677202+0000","last_peered":"2024-09-15T23:54:43.677202+0000","last_clean":"2024-09-15T23:54:43.677202+0000","last_became_active":"2024-09-15T23:54:43.656622+0000","last_became_peered":"2024-09-15T23:54:43.656622+0000","last_unstale":"2024-09-15T23:54:43.677202+0000","last_undegraded":"2024-09-15T23:54:43.677202+0000","last_fullsized":"2024-09-15T23:54:43.677202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:50.700577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625588+0000","last_change":"2024-09-15T23:54:42.628542+0000","last_active":"2024-09-15T23:54:43.625588+0000","last_peered":"2024-09-15T23:54:43.625588+0000","last_clean":"2024-09-15T23:54:43.625588+0000","last_became_active":"2024-09-15T23:54:42.627924+0000","last_became_peered":"2024-09-15T23:54:42.627924+0000","last_unstale":"2024-09-15T23:54:43.625588+0000","last_undegraded":"2024-09-15T23:54:43.625588+0000","last_fullsized":"2024-09-15T23:54:43.625588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:15.134895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648042+0000","last_change":"2024-09-15T23:54:43.643031+0000","last_active":"2024-09-15T23:54:43.648042+0000","last_peered":"2024-09-15T23:54:43.648042+0000","last_clean":"2024-09-15T23:54:43.648042+0000","last_became_active":"2024-09-15T23:54:43.642329+0000","last_became_peered":"2024-09-15T23:54:43.642329+0000","last_unstale":"2024-09-15T23:54:43.648042+0000","last_undegraded":"2024-09-15T23:54:43.648042+0000","last_fullsized":"2024-09-15T23:54:43.648042+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:37.970228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.647722+0000","last_change":"2024-09-15T23:54:42.603521+0000","last_active":"2024-09-15T23:54:43.647722+0000","last_peered":"2024-09-15T23:54:43.647722+0000","last_clean":"2024-09-15T23:54:43.647722+0000","last_became_active":"2024-09-15T23:54:42.602670+0000","last_became_peered":"2024-09-15T23:54:42.602670+0000","last_unstale":"2024-09-15T23:54:43.647722+0000","last_undegraded":"2024-09-15T23:54:43.647722+0000","last_fullsized":"2024-09-15T23:54:43.647722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.132376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.645389+0000","last_change":"2024-09-15T23:54:43.637124+0000","last_active":"2024-09-15T23:54:43.645389+0000","last_peered":"2024-09-15T23:54:43.645389+0000","last_clean":"2024-09-15T23:54:43.645389+0000","last_became_active":"2024-09-15T23:54:43.636448+0000","last_became_peered":"2024-09-15T23:54:43.636448+0000","last_unstale":"2024-09-15T23:54:43.645389+0000","last_undegraded":"2024-09-15T23:54:43.645389+0000","last_fullsized":"2024-09-15T23:54:43.645389+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:04.885460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.633484+0000","last_change":"2024-09-15T23:54:42.611389+0000","last_active":"2024-09-15T23:54:43.633484+0000","last_peered":"2024-09-15T23:54:43.633484+0000","last_clean":"2024-09-15T23:54:43.633484+0000","last_became_active":"2024-09-15T23:54:42.610734+0000","last_became_peered":"2024-09-15T23:54:42.610734+0000","last_unstale":"2024-09-15T23:54:43.633484+0000","last_undegraded":"2024-09-15T23:54:43.633484+0000","last_fullsized":"2024-09-15T23:54:43.633484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:36.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:54:42.570937+0000","last_change":"2024-09-15T23:54:42.570937+0000","last_active":"2024-09-15T23:54:42.570937+0000","last_peered":"2024-09-15T23:54:42.570937+0000","last_clean":"2024-09-15T23:54:42.570937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:42.570937+0000","last_undegraded":"2024-09-15T23:54:42.570937+0000","last_fullsized":"2024-09-15T23:54:42.570937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.633517+0000","last_change":"2024-09-15T23:54:42.629795+0000","last_active":"2024-09-15T23:54:43.633517+0000","last_peered":"2024-09-15T23:54:43.633517+0000","last_clean":"2024-09-15T23:54:43.633517+0000","last_became_active":"2024-09-15T23:54:42.628974+0000","last_became_peered":"2024-09-15T23:54:42.628974+0000","last_unstale":"2024-09-15T23:54:43.633517+0000","last_undegraded":"2024-09-15T23:54:43.633517+0000","last_fullsized":"2024-09-15T23:54:43.633517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:26.732611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.683271+0000","last_change":"2024-09-15T23:54:43.679983+0000","last_active":"2024-09-15T23:54:43.683271+0000","last_peered":"2024-09-15T23:54:43.683271+0000","last_clean":"2024-09-15T23:54:43.683271+0000","last_became_active":"2024-09-15T23:54:43.679346+0000","last_became_peered":"2024-09-15T23:54:43.679346+0000","last_unstale":"2024-09-15T23:54:43.683271+0000","last_undegraded":"2024-09-15T23:54:43.683271+0000","last_fullsized":"2024-09-15T23:54:43.683271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:40.585681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.626104+0000","last_change":"2024-09-15T23:54:42.619643+0000","last_active":"2024-09-15T23:54:43.626104+0000","last_peered":"2024-09-15T23:54:43.626104+0000","last_clean":"2024-09-15T23:54:43.626104+0000","last_became_active":"2024-09-15T23:54:42.615833+0000","last_became_peered":"2024-09-15T23:54:42.615833+0000","last_unstale":"2024-09-15T23:54:43.626104+0000","last_undegraded":"2024-09-15T23:54:43.626104+0000","last_fullsized":"2024-09-15T23:54:43.626104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:43.471876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678205+0000","last_change":"2024-09-15T23:54:43.666718+0000","last_active":"2024-09-15T23:54:43.678205+0000","last_peered":"2024-09-15T23:54:43.678205+0000","last_clean":"2024-09-15T23:54:43.678205+0000","last_became_active":"2024-09-15T23:54:43.666042+0000","last_became_peered":"2024-09-15T23:54:43.666042+0000","last_unstale":"2024-09-15T23:54:43.678205+0000","last_undegraded":"2024-09-15T23:54:43.678205+0000","last_fullsized":"2024-09-15T23:54:43.678205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:08.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.624671+0000","last_change":"2024-09-15T23:54:42.605386+0000","last_active":"2024-09-15T23:54:43.624671+0000","last_peered":"2024-09-15T23:54:43.624671+0000","last_clean":"2024-09-15T23:54:43.624671+0000","last_became_active":"2024-09-15T23:54:42.605053+0000","last_became_peered":"2024-09-15T23:54:42.605053+0000","last_unstale":"2024-09-15T23:54:43.624671+0000","last_undegraded":"2024-09-15T23:54:43.624671+0000","last_fullsized":"2024-09-15T23:54:43.624671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:31.941914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.664273+0000","last_change":"2024-09-15T23:54:43.659325+0000","last_active":"2024-09-15T23:54:43.664273+0000","last_peered":"2024-09-15T23:54:43.664273+0000","last_clean":"2024-09-15T23:54:43.664273+0000","last_became_active":"2024-09-15T23:54:43.658989+0000","last_became_peered":"2024-09-15T23:54:43.658989+0000","last_unstale":"2024-09-15T23:54:43.664273+0000","last_undegraded":"2024-09-15T23:54:43.664273+0000","last_fullsized":"2024-09-15T23:54:43.664273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:59.753339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.617582+0000","last_change":"2024-09-15T23:54:42.602928+0000","last_active":"2024-09-15T23:54:43.617582+0000","last_peered":"2024-09-15T23:54:43.617582+0000","last_clean":"2024-09-15T23:54:43.617582+0000","last_became_active":"2024-09-15T23:54:42.602534+0000","last_became_peered":"2024-09-15T23:54:42.602534+0000","last_unstale":"2024-09-15T23:54:43.617582+0000","last_undegraded":"2024-09-15T23:54:43.617582+0000","last_fullsized":"2024-09-15T23:54:43.617582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:51.351267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.656757+0000","last_change":"2024-09-15T23:54:43.652409+0000","last_active":"2024-09-15T23:54:43.656757+0000","last_peered":"2024-09-15T23:54:43.656757+0000","last_clean":"2024-09-15T23:54:43.656757+0000","last_became_active":"2024-09-15T23:54:43.652155+0000","last_became_peered":"2024-09-15T23:54:43.652155+0000","last_unstale":"2024-09-15T23:54:43.656757+0000","last_undegraded":"2024-09-15T23:54:43.656757+0000","last_fullsized":"2024-09-15T23:54:43.656757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:02.241689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.636039+0000","last_change":"2024-09-15T23:54:42.621609+0000","last_active":"2024-09-15T23:54:43.636039+0000","last_peered":"2024-09-15T23:54:43.636039+0000","last_clean":"2024-09-15T23:54:43.636039+0000","last_became_active":"2024-09-15T23:54:42.620946+0000","last_became_peered":"2024-09-15T23:54:42.620946+0000","last_unstale":"2024-09-15T23:54:43.636039+0000","last_undegraded":"2024-09-15T23:54:43.636039+0000","last_fullsized":"2024-09-15T23:54:43.636039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:48.556516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.651261+0000","last_change":"2024-09-15T23:54:43.648081+0000","last_active":"2024-09-15T23:54:43.651261+0000","last_peered":"2024-09-15T23:54:43.651261+0000","last_clean":"2024-09-15T23:54:43.651261+0000","last_became_active":"2024-09-15T23:54:43.647717+0000","last_became_peered":"2024-09-15T23:54:43.647717+0000","last_unstale":"2024-09-15T23:54:43.651261+0000","last_undegraded":"2024-09-15T23:54:43.651261+0000","last_fullsized":"2024-09-15T23:54:43.651261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:44.258165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.624280+0000","last_change":"2024-09-15T23:54:42.604211+0000","last_active":"2024-09-15T23:54:43.624280+0000","last_peered":"2024-09-15T23:54:43.624280+0000","last_clean":"2024-09-15T23:54:43.624280+0000","last_became_active":"2024-09-15T23:54:42.603770+0000","last_became_peered":"2024-09-15T23:54:42.603770+0000","last_unstale":"2024-09-15T23:54:43.624280+0000","last_undegraded":"2024-09-15T23:54:43.624280+0000","last_fullsized":"2024-09-15T23:54:43.624280+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:55.995950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625877+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:54:43.625877+0000","last_peered":"2024-09-15T23:54:43.625877+0000","last_clean":"2024-09-15T23:54:43.625877+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:54:43.625877+0000","last_undegraded":"2024-09-15T23:54:43.625877+0000","last_fullsized":"2024-09-15T23:54:43.625877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":122,"acting":122,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":181795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":190698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":446464,"data_stored":189052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":191156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1024000,"data_stored":772163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":181795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1011712,"data_stored":765496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:54:46.661 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:54:46.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.804+0000 7f1e12c68640 1 Processor -- start 2024-09-15T23:54:46.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.804+0000 7f1e12c68640 1 -- start start 2024-09-15T23:54:46.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.804+0000 7f1e12c68640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1e0c0d3060 0x7f1e0c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.804+0000 7f1e12c68640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1e0c0cf450 0x7f1e0c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.804+0000 7f1e12c68640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e0c0d0300 con 0x7f1e0c161a60 2024-09-15T23:54:46.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.804+0000 7f1e12c68640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1e0c0b0f60 con 0x7f1e0c0d3060 2024-09-15T23:54:46.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.804+0000 7f1e12c68640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1e0c0cfd40 con 0x7f1e0c0cf450 2024-09-15T23:54:46.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.804+0000 7f1e0bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1e0c0d3060 0x7f1e0c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.804+0000 7f1e0bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1e0c0d3060 0x7f1e0c0cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50396/0 (socket says 172.21.15.112:50396) 2024-09-15T23:54:46.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.804+0000 7f1e0bfff640 1 -- 172.21.15.112:0/3903600684 learned_addr learned my addr 172.21.15.112:0/3903600684 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:46.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.804+0000 7f1e0bfff640 1 -- 172.21.15.112:0/3903600684 >> v2:172.21.15.169:3300/0 conn(0x7f1e0c0cf450 msgr2=0x7f1e0c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:46.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.804+0000 7f1e0bfff640 1 --2- 172.21.15.112:0/3903600684 >> v2:172.21.15.169:3300/0 conn(0x7f1e0c0cf450 0x7f1e0c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.804+0000 7f1e0bfff640 1 -- 172.21.15.112:0/3903600684 >> v1:172.21.15.169:6789/0 conn(0x7f1e0c161a60 legacy=0x7f1e0c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:46.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.804+0000 7f1e0bfff640 1 -- 172.21.15.112:0/3903600684 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0c0d0020 con 0x7f1e0c0d3060 2024-09-15T23:54:46.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e0bfff640 1 --2- 172.21.15.112:0/3903600684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e0c0d3060 0x7f1e0c0cef10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0ce950 tx=0x7f1df401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4101b8f02c238ea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:46.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e0b7fe640 1 -- 172.21.15.112:0/3903600684 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df40b0070 con 0x7f1e0c0d3060 2024-09-15T23:54:46.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e0b7fe640 1 -- 172.21.15.112:0/3903600684 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df40ab600 con 0x7f1e0c0d3060 2024-09-15T23:54:46.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e0b7fe640 1 -- 172.21.15.112:0/3903600684 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df40ab9d0 con 0x7f1e0c0d3060 2024-09-15T23:54:46.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 -- 172.21.15.112:0/3903600684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e0c0d3060 msgr2=0x7f1e0c0cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 --2- 172.21.15.112:0/3903600684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e0c0d3060 0x7f1e0c0cef10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0ce950 tx=0x7f1df401c240 comp rx=0 tx=0).stop 2024-09-15T23:54:46.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 -- 172.21.15.112:0/3903600684 shutdown_connections 2024-09-15T23:54:46.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 --2- 172.21.15.112:0/3903600684 >> v2:172.21.15.169:3300/0 conn(0x7f1e0c0cf450 0x7f1e0c06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 --2- 172.21.15.112:0/3903600684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e0c0d3060 0x7f1e0c0cef10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 -- 172.21.15.112:0/3903600684 >> 172.21.15.112:0/3903600684 conn(0x7f1e0c08bf90 msgr2=0x7f1e0c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:46.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 -- 172.21.15.112:0/3903600684 shutdown_connections 2024-09-15T23:54:46.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 -- 172.21.15.112:0/3903600684 wait complete. 2024-09-15T23:54:46.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 Processor -- start 2024-09-15T23:54:46.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 -- start start 2024-09-15T23:54:46.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e0c0cf450 0x7f1e0c158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e0c0d3060 0x7f1e0c1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e0c161a60 0x7f1e0c1fa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c06e400 con 0x7f1e0c161a60 2024-09-15T23:54:46.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c0cfab0 con 0x7f1e0c0cf450 2024-09-15T23:54:46.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.808+0000 7f1e12c68640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1e0c06e580 con 0x7f1e0c0d3060 2024-09-15T23:54:46.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e11205640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e0c161a60 0x7f1e0c1fa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e11205640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e0c161a60 0x7f1e0c1fa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50408/0 (socket says 172.21.15.112:50408) 2024-09-15T23:54:46.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e11205640 1 -- 172.21.15.112:0/2717285874 learned_addr learned my addr 172.21.15.112:0/2717285874 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:46.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e10a04640 1 --2- 172.21.15.112:0/2717285874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e0c0cf450 0x7f1e0c158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e0bfff640 1 --2- 172.21.15.112:0/2717285874 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e0c0d3060 0x7f1e0c1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e11205640 1 -- 172.21.15.112:0/2717285874 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e0c0d3060 msgr2=0x7f1e0c1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e11205640 1 --2- 172.21.15.112:0/2717285874 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e0c0d3060 0x7f1e0c1589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e11205640 1 -- 172.21.15.112:0/2717285874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e0c0cf450 msgr2=0x7f1e0c158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e11205640 1 --2- 172.21.15.112:0/2717285874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e0c0cf450 0x7f1e0c158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e11205640 1 -- 172.21.15.112:0/2717285874 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0c155680 con 0x7f1e0c161a60 2024-09-15T23:54:46.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e11205640 1 --2- 172.21.15.112:0/2717285874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e0c161a60 0x7f1e0c1fa6e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400b390 tx=0x7f1e0400b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:46.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e097fa640 1 -- 172.21.15.112:0/2717285874 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04015020 con 0x7f1e0c161a60 2024-09-15T23:54:46.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e097fa640 1 -- 172.21.15.112:0/2717285874 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e04011830 con 0x7f1e0c161a60 2024-09-15T23:54:46.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e097fa640 1 -- 172.21.15.112:0/2717285874 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04011c20 con 0x7f1e0c161a60 2024-09-15T23:54:46.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e12c68640 1 -- 172.21.15.112:0/2717285874 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0c155960 con 0x7f1e0c161a60 2024-09-15T23:54:46.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e12c68640 1 -- 172.21.15.112:0/2717285874 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e0c155f20 con 0x7f1e0c161a60 2024-09-15T23:54:46.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e12c68640 1 -- 172.21.15.112:0/2717285874 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e0c06d6b0 con 0x7f1e0c161a60 2024-09-15T23:54:46.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e097fa640 1 -- 172.21.15.112:0/2717285874 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1e04018020 con 0x7f1e0c161a60 2024-09-15T23:54:46.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e097fa640 1 --2- 172.21.15.112:0/2717285874 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1dec0678c0 0x7f1dec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:46.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e097fa640 1 -- 172.21.15.112:0/2717285874 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f1e04085d20 con 0x7f1e0c161a60 2024-09-15T23:54:46.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e10a04640 1 --2- 172.21.15.112:0/2717285874 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1dec0678c0 0x7f1dec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:46.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.812+0000 7f1e10a04640 1 --2- 172.21.15.112:0/2717285874 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1dec0678c0 0x7f1dec069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc001dc0 tx=0x7f1dfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:46.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.816+0000 7f1e097fa640 1 -- 172.21.15.112:0/2717285874 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1e0401f020 con 0x7f1e0c161a60 2024-09-15T23:54:46.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.960+0000 7f1e12c68640 1 -- 172.21.15.112:0/2717285874 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e0c0d2d40 con 0x7f1dec0678c0 2024-09-15T23:54:46.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.968+0000 7f1e097fa640 1 -- 172.21.15.112:0/2717285874 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251161 (secure 0 0 0) 0x7f1e0c0d2d40 con 0x7f1dec0678c0 2024-09-15T23:54:46.974 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:46.976 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:54:46.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.972+0000 7f1e12c68640 1 -- 172.21.15.112:0/2717285874 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1dec0678c0 msgr2=0x7f1dec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.972+0000 7f1e12c68640 1 --2- 172.21.15.112:0/2717285874 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1dec0678c0 0x7f1dec069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc001dc0 tx=0x7f1dfc009040 comp rx=0 tx=0).stop 2024-09-15T23:54:46.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.972+0000 7f1e12c68640 1 -- 172.21.15.112:0/2717285874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e0c161a60 msgr2=0x7f1e0c1fa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:46.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.972+0000 7f1e12c68640 1 --2- 172.21.15.112:0/2717285874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e0c161a60 0x7f1e0c1fa6e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400b390 tx=0x7f1e0400b850 comp rx=0 tx=0).stop 2024-09-15T23:54:46.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.972+0000 7f1e12c68640 1 -- 172.21.15.112:0/2717285874 shutdown_connections 2024-09-15T23:54:46.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.972+0000 7f1e12c68640 1 --2- 172.21.15.112:0/2717285874 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1dec0678c0 0x7f1dec069d80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.972+0000 7f1e12c68640 1 --2- 172.21.15.112:0/2717285874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e0c161a60 0x7f1e0c1fa6e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.972+0000 7f1e12c68640 1 --2- 172.21.15.112:0/2717285874 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e0c0d3060 0x7f1e0c1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.972+0000 7f1e12c68640 1 --2- 172.21.15.112:0/2717285874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e0c0cf450 0x7f1e0c158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:46.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.972+0000 7f1e12c68640 1 -- 172.21.15.112:0/2717285874 >> 172.21.15.112:0/2717285874 conn(0x7f1e0c08bf90 msgr2=0x7f1e0c0b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:46.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.972+0000 7f1e12c68640 1 -- 172.21.15.112:0/2717285874 shutdown_connections 2024-09-15T23:54:46.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:46.972+0000 7f1e12c68640 1 -- 172.21.15.112:0/2717285874 wait complete. 2024-09-15T23:54:46.991 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-15T23:54:45.249779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":188,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225004,"kb_used_data":4600,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749716,"statfs":{"total":773094113280,"available":772863709184,"internally_reserved":0,"allocated":4710400,"data_stored":2661187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001326"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.679984+0000","last_change":"2024-09-15T23:54:43.666774+0000","last_active":"2024-09-15T23:54:43.679984+0000","last_peered":"2024-09-15T23:54:43.679984+0000","last_clean":"2024-09-15T23:54:43.679984+0000","last_became_active":"2024-09-15T23:54:43.665876+0000","last_became_peered":"2024-09-15T23:54:43.665876+0000","last_unstale":"2024-09-15T23:54:43.679984+0000","last_undegraded":"2024-09-15T23:54:43.679984+0000","last_fullsized":"2024-09-15T23:54:43.679984+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:32.987095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682636+0000","last_change":"2024-09-15T23:54:43.669791+0000","last_active":"2024-09-15T23:54:43.682636+0000","last_peered":"2024-09-15T23:54:43.682636+0000","last_clean":"2024-09-15T23:54:43.682636+0000","last_became_active":"2024-09-15T23:54:43.669151+0000","last_became_peered":"2024-09-15T23:54:43.669151+0000","last_unstale":"2024-09-15T23:54:43.682636+0000","last_undegraded":"2024-09-15T23:54:43.682636+0000","last_fullsized":"2024-09-15T23:54:43.682636+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.809746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.673395+0000","last_change":"2024-09-15T23:54:43.658229+0000","last_active":"2024-09-15T23:54:43.673395+0000","last_peered":"2024-09-15T23:54:43.673395+0000","last_clean":"2024-09-15T23:54:43.673395+0000","last_became_active":"2024-09-15T23:54:43.657551+0000","last_became_peered":"2024-09-15T23:54:43.657551+0000","last_unstale":"2024-09-15T23:54:43.673395+0000","last_undegraded":"2024-09-15T23:54:43.673395+0000","last_fullsized":"2024-09-15T23:54:43.673395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:31.936628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.680196+0000","last_change":"2024-09-15T23:54:43.672536+0000","last_active":"2024-09-15T23:54:43.680196+0000","last_peered":"2024-09-15T23:54:43.680196+0000","last_clean":"2024-09-15T23:54:43.680196+0000","last_became_active":"2024-09-15T23:54:43.671956+0000","last_became_peered":"2024-09-15T23:54:43.671956+0000","last_unstale":"2024-09-15T23:54:43.680196+0000","last_undegraded":"2024-09-15T23:54:43.680196+0000","last_fullsized":"2024-09-15T23:54:43.680196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:59.226661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.655402+0000","last_change":"2024-09-15T23:54:43.651070+0000","last_active":"2024-09-15T23:54:43.655402+0000","last_peered":"2024-09-15T23:54:43.655402+0000","last_clean":"2024-09-15T23:54:43.655402+0000","last_became_active":"2024-09-15T23:54:43.650351+0000","last_became_peered":"2024-09-15T23:54:43.650351+0000","last_unstale":"2024-09-15T23:54:43.655402+0000","last_undegraded":"2024-09-15T23:54:43.655402+0000","last_fullsized":"2024-09-15T23:54:43.655402+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:48.693662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675542+0000","last_change":"2024-09-15T23:54:43.658663+0000","last_active":"2024-09-15T23:54:43.675542+0000","last_peered":"2024-09-15T23:54:43.675542+0000","last_clean":"2024-09-15T23:54:43.675542+0000","last_became_active":"2024-09-15T23:54:43.657995+0000","last_became_peered":"2024-09-15T23:54:43.657995+0000","last_unstale":"2024-09-15T23:54:43.675542+0000","last_undegraded":"2024-09-15T23:54:43.675542+0000","last_fullsized":"2024-09-15T23:54:43.675542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:32.953360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.641190+0000","last_change":"2024-09-15T23:54:43.637868+0000","last_active":"2024-09-15T23:54:43.641190+0000","last_peered":"2024-09-15T23:54:43.641190+0000","last_clean":"2024-09-15T23:54:43.641190+0000","last_became_active":"2024-09-15T23:54:43.637468+0000","last_became_peered":"2024-09-15T23:54:43.637468+0000","last_unstale":"2024-09-15T23:54:43.641190+0000","last_undegraded":"2024-09-15T23:54:43.641190+0000","last_fullsized":"2024-09-15T23:54:43.641190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:19.391528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684490+0000","last_change":"2024-09-15T23:54:43.672587+0000","last_active":"2024-09-15T23:54:43.684490+0000","last_peered":"2024-09-15T23:54:43.684490+0000","last_clean":"2024-09-15T23:54:43.684490+0000","last_became_active":"2024-09-15T23:54:43.671772+0000","last_became_peered":"2024-09-15T23:54:43.671772+0000","last_unstale":"2024-09-15T23:54:43.684490+0000","last_undegraded":"2024-09-15T23:54:43.684490+0000","last_fullsized":"2024-09-15T23:54:43.684490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:54.838047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.655363+0000","last_change":"2024-09-15T23:54:43.650837+0000","last_active":"2024-09-15T23:54:43.655363+0000","last_peered":"2024-09-15T23:54:43.655363+0000","last_clean":"2024-09-15T23:54:43.655363+0000","last_became_active":"2024-09-15T23:54:43.650113+0000","last_became_peered":"2024-09-15T23:54:43.650113+0000","last_unstale":"2024-09-15T23:54:43.655363+0000","last_undegraded":"2024-09-15T23:54:43.655363+0000","last_fullsized":"2024-09-15T23:54:43.655363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:19.391528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648359+0000","last_change":"2024-09-15T23:54:43.641037+0000","last_active":"2024-09-15T23:54:43.648359+0000","last_peered":"2024-09-15T23:54:43.648359+0000","last_clean":"2024-09-15T23:54:43.648359+0000","last_became_active":"2024-09-15T23:54:43.640738+0000","last_became_peered":"2024-09-15T23:54:43.640738+0000","last_unstale":"2024-09-15T23:54:43.648359+0000","last_undegraded":"2024-09-15T23:54:43.648359+0000","last_fullsized":"2024-09-15T23:54:43.648359+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:48.693662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648419+0000","last_change":"2024-09-15T23:54:43.639536+0000","last_active":"2024-09-15T23:54:43.648419+0000","last_peered":"2024-09-15T23:54:43.648419+0000","last_clean":"2024-09-15T23:54:43.648419+0000","last_became_active":"2024-09-15T23:54:43.636784+0000","last_became_peered":"2024-09-15T23:54:43.636784+0000","last_unstale":"2024-09-15T23:54:43.648419+0000","last_undegraded":"2024-09-15T23:54:43.648419+0000","last_fullsized":"2024-09-15T23:54:43.648419+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:44.483323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682433+0000","last_change":"2024-09-15T23:54:43.677035+0000","last_active":"2024-09-15T23:54:43.682433+0000","last_peered":"2024-09-15T23:54:43.682433+0000","last_clean":"2024-09-15T23:54:43.682433+0000","last_became_active":"2024-09-15T23:54:43.676463+0000","last_became_peered":"2024-09-15T23:54:43.676463+0000","last_unstale":"2024-09-15T23:54:43.682433+0000","last_undegraded":"2024-09-15T23:54:43.682433+0000","last_fullsized":"2024-09-15T23:54:43.682433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:37.184096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.661715+0000","last_change":"2024-09-15T23:54:43.658337+0000","last_active":"2024-09-15T23:54:43.661715+0000","last_peered":"2024-09-15T23:54:43.661715+0000","last_clean":"2024-09-15T23:54:43.661715+0000","last_became_active":"2024-09-15T23:54:43.658020+0000","last_became_peered":"2024-09-15T23:54:43.658020+0000","last_unstale":"2024-09-15T23:54:43.661715+0000","last_undegraded":"2024-09-15T23:54:43.661715+0000","last_fullsized":"2024-09-15T23:54:43.661715+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:08.810523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.645276+0000","last_change":"2024-09-15T23:54:43.640668+0000","last_active":"2024-09-15T23:54:43.645276+0000","last_peered":"2024-09-15T23:54:43.645276+0000","last_clean":"2024-09-15T23:54:43.645276+0000","last_became_active":"2024-09-15T23:54:43.640362+0000","last_became_peered":"2024-09-15T23:54:43.640362+0000","last_unstale":"2024-09-15T23:54:43.645276+0000","last_undegraded":"2024-09-15T23:54:43.645276+0000","last_fullsized":"2024-09-15T23:54:43.645276+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:57.007396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.672495+0000","last_change":"2024-09-15T23:54:43.669305+0000","last_active":"2024-09-15T23:54:43.672495+0000","last_peered":"2024-09-15T23:54:43.672495+0000","last_clean":"2024-09-15T23:54:43.672495+0000","last_became_active":"2024-09-15T23:54:43.669057+0000","last_became_peered":"2024-09-15T23:54:43.669057+0000","last_unstale":"2024-09-15T23:54:43.672495+0000","last_undegraded":"2024-09-15T23:54:43.672495+0000","last_fullsized":"2024-09-15T23:54:43.672495+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:10.708992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678697+0000","last_change":"2024-09-15T23:54:43.678254+0000","last_active":"2024-09-15T23:54:43.678697+0000","last_peered":"2024-09-15T23:54:43.678697+0000","last_clean":"2024-09-15T23:54:43.678697+0000","last_became_active":"2024-09-15T23:54:43.678013+0000","last_became_peered":"2024-09-15T23:54:43.678013+0000","last_unstale":"2024-09-15T23:54:43.678697+0000","last_undegraded":"2024-09-15T23:54:43.678697+0000","last_fullsized":"2024-09-15T23:54:43.678697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:13.211799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642716+0000","last_change":"2024-09-15T23:54:43.631179+0000","last_active":"2024-09-15T23:54:43.642716+0000","last_peered":"2024-09-15T23:54:43.642716+0000","last_clean":"2024-09-15T23:54:43.642716+0000","last_became_active":"2024-09-15T23:54:43.630496+0000","last_became_peered":"2024-09-15T23:54:43.630496+0000","last_unstale":"2024-09-15T23:54:43.642716+0000","last_undegraded":"2024-09-15T23:54:43.642716+0000","last_fullsized":"2024-09-15T23:54:43.642716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:38:00.554695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.643873+0000","last_change":"2024-09-15T23:54:43.628988+0000","last_active":"2024-09-15T23:54:43.643873+0000","last_peered":"2024-09-15T23:54:43.643873+0000","last_clean":"2024-09-15T23:54:43.643873+0000","last_became_active":"2024-09-15T23:54:43.628667+0000","last_became_peered":"2024-09-15T23:54:43.628667+0000","last_unstale":"2024-09-15T23:54:43.643873+0000","last_undegraded":"2024-09-15T23:54:43.643873+0000","last_fullsized":"2024-09-15T23:54:43.643873+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:22.709716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:54:42.570937+0000","last_change":"2024-09-15T23:54:42.570937+0000","last_active":"2024-09-15T23:54:42.570937+0000","last_peered":"2024-09-15T23:54:42.570937+0000","last_clean":"2024-09-15T23:54:42.570937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:42.570937+0000","last_undegraded":"2024-09-15T23:54:42.570937+0000","last_fullsized":"2024-09-15T23:54:42.570937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648372+0000","last_change":"2024-09-15T23:54:43.640856+0000","last_active":"2024-09-15T23:54:43.648372+0000","last_peered":"2024-09-15T23:54:43.648372+0000","last_clean":"2024-09-15T23:54:43.648372+0000","last_became_active":"2024-09-15T23:54:43.640593+0000","last_became_peered":"2024-09-15T23:54:43.640593+0000","last_unstale":"2024-09-15T23:54:43.648372+0000","last_undegraded":"2024-09-15T23:54:43.648372+0000","last_fullsized":"2024-09-15T23:54:43.648372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.809746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.681429+0000","last_change":"2024-09-15T23:54:43.680914+0000","last_active":"2024-09-15T23:54:43.681429+0000","last_peered":"2024-09-15T23:54:43.681429+0000","last_clean":"2024-09-15T23:54:43.681429+0000","last_became_active":"2024-09-15T23:54:43.680603+0000","last_became_peered":"2024-09-15T23:54:43.680603+0000","last_unstale":"2024-09-15T23:54:43.681429+0000","last_undegraded":"2024-09-15T23:54:43.681429+0000","last_fullsized":"2024-09-15T23:54:43.681429+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:05.527477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676646+0000","last_change":"2024-09-15T23:54:43.668953+0000","last_active":"2024-09-15T23:54:43.676646+0000","last_peered":"2024-09-15T23:54:43.676646+0000","last_clean":"2024-09-15T23:54:43.676646+0000","last_became_active":"2024-09-15T23:54:43.668662+0000","last_became_peered":"2024-09-15T23:54:43.668662+0000","last_unstale":"2024-09-15T23:54:43.676646+0000","last_undegraded":"2024-09-15T23:54:43.676646+0000","last_fullsized":"2024-09-15T23:54:43.676646+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:00.991165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648608+0000","last_change":"2024-09-15T23:54:43.647006+0000","last_active":"2024-09-15T23:54:43.648608+0000","last_peered":"2024-09-15T23:54:43.648608+0000","last_clean":"2024-09-15T23:54:43.648608+0000","last_became_active":"2024-09-15T23:54:43.646809+0000","last_became_peered":"2024-09-15T23:54:43.646809+0000","last_unstale":"2024-09-15T23:54:43.648608+0000","last_undegraded":"2024-09-15T23:54:43.648608+0000","last_fullsized":"2024-09-15T23:54:43.648608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:29.699749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684440+0000","last_change":"2024-09-15T23:54:43.665724+0000","last_active":"2024-09-15T23:54:43.684440+0000","last_peered":"2024-09-15T23:54:43.684440+0000","last_clean":"2024-09-15T23:54:43.684440+0000","last_became_active":"2024-09-15T23:54:43.665067+0000","last_became_peered":"2024-09-15T23:54:43.665067+0000","last_unstale":"2024-09-15T23:54:43.684440+0000","last_undegraded":"2024-09-15T23:54:43.684440+0000","last_fullsized":"2024-09-15T23:54:43.684440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:02:27.335899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676603+0000","last_change":"2024-09-15T23:54:43.668148+0000","last_active":"2024-09-15T23:54:43.676603+0000","last_peered":"2024-09-15T23:54:43.676603+0000","last_clean":"2024-09-15T23:54:43.676603+0000","last_became_active":"2024-09-15T23:54:43.667833+0000","last_became_peered":"2024-09-15T23:54:43.667833+0000","last_unstale":"2024-09-15T23:54:43.676603+0000","last_undegraded":"2024-09-15T23:54:43.676603+0000","last_fullsized":"2024-09-15T23:54:43.676603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:32.953360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684477+0000","last_change":"2024-09-15T23:54:43.671918+0000","last_active":"2024-09-15T23:54:43.684477+0000","last_peered":"2024-09-15T23:54:43.684477+0000","last_clean":"2024-09-15T23:54:43.684477+0000","last_became_active":"2024-09-15T23:54:43.666846+0000","last_became_peered":"2024-09-15T23:54:43.666846+0000","last_unstale":"2024-09-15T23:54:43.684477+0000","last_undegraded":"2024-09-15T23:54:43.684477+0000","last_fullsized":"2024-09-15T23:54:43.684477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:21.949038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.656728+0000","last_change":"2024-09-15T23:54:43.651577+0000","last_active":"2024-09-15T23:54:43.656728+0000","last_peered":"2024-09-15T23:54:43.656728+0000","last_clean":"2024-09-15T23:54:43.656728+0000","last_became_active":"2024-09-15T23:54:43.651254+0000","last_became_peered":"2024-09-15T23:54:43.651254+0000","last_unstale":"2024-09-15T23:54:43.656728+0000","last_undegraded":"2024-09-15T23:54:43.656728+0000","last_fullsized":"2024-09-15T23:54:43.656728+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:26.589213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677107+0000","last_change":"2024-09-15T23:54:43.672947+0000","last_active":"2024-09-15T23:54:43.677107+0000","last_peered":"2024-09-15T23:54:43.677107+0000","last_clean":"2024-09-15T23:54:43.677107+0000","last_became_active":"2024-09-15T23:54:43.672703+0000","last_became_peered":"2024-09-15T23:54:43.672703+0000","last_unstale":"2024-09-15T23:54:43.677107+0000","last_undegraded":"2024-09-15T23:54:43.677107+0000","last_fullsized":"2024-09-15T23:54:43.677107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:25.006535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.658793+0000","last_change":"2024-09-15T23:54:43.652965+0000","last_active":"2024-09-15T23:54:43.658793+0000","last_peered":"2024-09-15T23:54:43.658793+0000","last_clean":"2024-09-15T23:54:43.658793+0000","last_became_active":"2024-09-15T23:54:43.652697+0000","last_became_peered":"2024-09-15T23:54:43.652697+0000","last_unstale":"2024-09-15T23:54:43.658793+0000","last_undegraded":"2024-09-15T23:54:43.658793+0000","last_fullsized":"2024-09-15T23:54:43.658793+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:25.903632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648610+0000","last_change":"2024-09-15T23:54:43.646314+0000","last_active":"2024-09-15T23:54:43.648610+0000","last_peered":"2024-09-15T23:54:43.648610+0000","last_clean":"2024-09-15T23:54:43.648610+0000","last_became_active":"2024-09-15T23:54:43.646050+0000","last_became_peered":"2024-09-15T23:54:43.646050+0000","last_unstale":"2024-09-15T23:54:43.648610+0000","last_undegraded":"2024-09-15T23:54:43.648610+0000","last_fullsized":"2024-09-15T23:54:43.648610+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.127820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677124+0000","last_change":"2024-09-15T23:54:43.674939+0000","last_active":"2024-09-15T23:54:43.677124+0000","last_peered":"2024-09-15T23:54:43.677124+0000","last_clean":"2024-09-15T23:54:43.677124+0000","last_became_active":"2024-09-15T23:54:43.674692+0000","last_became_peered":"2024-09-15T23:54:43.674692+0000","last_unstale":"2024-09-15T23:54:43.677124+0000","last_undegraded":"2024-09-15T23:54:43.677124+0000","last_fullsized":"2024-09-15T23:54:43.677124+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:55.655404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677205+0000","last_change":"2024-09-15T23:54:43.657536+0000","last_active":"2024-09-15T23:54:43.677205+0000","last_peered":"2024-09-15T23:54:43.677205+0000","last_clean":"2024-09-15T23:54:43.677205+0000","last_became_active":"2024-09-15T23:54:43.650847+0000","last_became_peered":"2024-09-15T23:54:43.650847+0000","last_unstale":"2024-09-15T23:54:43.677205+0000","last_undegraded":"2024-09-15T23:54:43.677205+0000","last_fullsized":"2024-09-15T23:54:43.677205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:00.991165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642992+0000","last_change":"2024-09-15T23:54:43.635951+0000","last_active":"2024-09-15T23:54:43.642992+0000","last_peered":"2024-09-15T23:54:43.642992+0000","last_clean":"2024-09-15T23:54:43.642992+0000","last_became_active":"2024-09-15T23:54:43.635781+0000","last_became_peered":"2024-09-15T23:54:43.635781+0000","last_unstale":"2024-09-15T23:54:43.642992+0000","last_undegraded":"2024-09-15T23:54:43.642992+0000","last_fullsized":"2024-09-15T23:54:43.642992+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:02.199351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.660519+0000","last_change":"2024-09-15T23:54:42.603087+0000","last_active":"2024-09-15T23:54:43.660519+0000","last_peered":"2024-09-15T23:54:43.660519+0000","last_clean":"2024-09-15T23:54:43.660519+0000","last_became_active":"2024-09-15T23:54:42.602691+0000","last_became_peered":"2024-09-15T23:54:42.602691+0000","last_unstale":"2024-09-15T23:54:43.660519+0000","last_undegraded":"2024-09-15T23:54:43.660519+0000","last_fullsized":"2024-09-15T23:54:43.660519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:14.792784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675033+0000","last_change":"2024-09-15T23:54:43.643378+0000","last_active":"2024-09-15T23:54:43.675033+0000","last_peered":"2024-09-15T23:54:43.675033+0000","last_clean":"2024-09-15T23:54:43.675033+0000","last_became_active":"2024-09-15T23:54:43.642541+0000","last_became_peered":"2024-09-15T23:54:43.642541+0000","last_unstale":"2024-09-15T23:54:43.675033+0000","last_undegraded":"2024-09-15T23:54:43.675033+0000","last_fullsized":"2024-09-15T23:54:43.675033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:03.360218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678279+0000","last_change":"2024-09-15T23:54:42.603652+0000","last_active":"2024-09-15T23:54:43.678279+0000","last_peered":"2024-09-15T23:54:43.678279+0000","last_clean":"2024-09-15T23:54:43.678279+0000","last_became_active":"2024-09-15T23:54:42.603047+0000","last_became_peered":"2024-09-15T23:54:42.603047+0000","last_unstale":"2024-09-15T23:54:43.678279+0000","last_undegraded":"2024-09-15T23:54:43.678279+0000","last_fullsized":"2024-09-15T23:54:43.678279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:14.792784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.643928+0000","last_change":"2024-09-15T23:54:43.637123+0000","last_active":"2024-09-15T23:54:43.643928+0000","last_peered":"2024-09-15T23:54:43.643928+0000","last_clean":"2024-09-15T23:54:43.643928+0000","last_became_active":"2024-09-15T23:54:43.636836+0000","last_became_peered":"2024-09-15T23:54:43.636836+0000","last_unstale":"2024-09-15T23:54:43.643928+0000","last_undegraded":"2024-09-15T23:54:43.643928+0000","last_fullsized":"2024-09-15T23:54:43.643928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:38.608267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684964+0000","last_change":"2024-09-15T23:54:42.625060+0000","last_active":"2024-09-15T23:54:43.684964+0000","last_peered":"2024-09-15T23:54:43.684964+0000","last_clean":"2024-09-15T23:54:43.684964+0000","last_became_active":"2024-09-15T23:54:42.624313+0000","last_became_peered":"2024-09-15T23:54:42.624313+0000","last_unstale":"2024-09-15T23:54:43.684964+0000","last_undegraded":"2024-09-15T23:54:43.684964+0000","last_fullsized":"2024-09-15T23:54:43.684964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:38.798300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675091+0000","last_change":"2024-09-15T23:54:43.643735+0000","last_active":"2024-09-15T23:54:43.675091+0000","last_peered":"2024-09-15T23:54:43.675091+0000","last_clean":"2024-09-15T23:54:43.675091+0000","last_became_active":"2024-09-15T23:54:43.642717+0000","last_became_peered":"2024-09-15T23:54:43.642717+0000","last_unstale":"2024-09-15T23:54:43.675091+0000","last_undegraded":"2024-09-15T23:54:43.675091+0000","last_fullsized":"2024-09-15T23:54:43.675091+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:31.056987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.680652+0000","last_change":"2024-09-15T23:54:42.621654+0000","last_active":"2024-09-15T23:54:43.680652+0000","last_peered":"2024-09-15T23:54:43.680652+0000","last_clean":"2024-09-15T23:54:43.680652+0000","last_became_active":"2024-09-15T23:54:42.621285+0000","last_became_peered":"2024-09-15T23:54:42.621285+0000","last_unstale":"2024-09-15T23:54:43.680652+0000","last_undegraded":"2024-09-15T23:54:43.680652+0000","last_fullsized":"2024-09-15T23:54:43.680652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:34.417323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684558+0000","last_change":"2024-09-15T23:54:43.678051+0000","last_active":"2024-09-15T23:54:43.684558+0000","last_peered":"2024-09-15T23:54:43.684558+0000","last_clean":"2024-09-15T23:54:43.684558+0000","last_became_active":"2024-09-15T23:54:43.677319+0000","last_became_peered":"2024-09-15T23:54:43.677319+0000","last_unstale":"2024-09-15T23:54:43.684558+0000","last_undegraded":"2024-09-15T23:54:43.684558+0000","last_fullsized":"2024-09-15T23:54:43.684558+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:26.378086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.639962+0000","last_change":"2024-09-15T23:54:42.601838+0000","last_active":"2024-09-15T23:54:43.639962+0000","last_peered":"2024-09-15T23:54:43.639962+0000","last_clean":"2024-09-15T23:54:43.639962+0000","last_became_active":"2024-09-15T23:54:42.601580+0000","last_became_peered":"2024-09-15T23:54:42.601580+0000","last_unstale":"2024-09-15T23:54:43.639962+0000","last_undegraded":"2024-09-15T23:54:43.639962+0000","last_fullsized":"2024-09-15T23:54:43.639962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:16.673465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.650838+0000","last_change":"2024-09-15T23:54:43.647396+0000","last_active":"2024-09-15T23:54:43.650838+0000","last_peered":"2024-09-15T23:54:43.650838+0000","last_clean":"2024-09-15T23:54:43.650838+0000","last_became_active":"2024-09-15T23:54:43.647101+0000","last_became_peered":"2024-09-15T23:54:43.647101+0000","last_unstale":"2024-09-15T23:54:43.650838+0000","last_undegraded":"2024-09-15T23:54:43.650838+0000","last_fullsized":"2024-09-15T23:54:43.650838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:49.567963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.664488+0000","last_change":"2024-09-15T23:54:42.627071+0000","last_active":"2024-09-15T23:54:43.664488+0000","last_peered":"2024-09-15T23:54:43.664488+0000","last_clean":"2024-09-15T23:54:43.664488+0000","last_became_active":"2024-09-15T23:54:42.626584+0000","last_became_peered":"2024-09-15T23:54:42.626584+0000","last_unstale":"2024-09-15T23:54:43.664488+0000","last_undegraded":"2024-09-15T23:54:43.664488+0000","last_fullsized":"2024-09-15T23:54:43.664488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:11.254409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642808+0000","last_change":"2024-09-15T23:54:43.631269+0000","last_active":"2024-09-15T23:54:43.642808+0000","last_peered":"2024-09-15T23:54:43.642808+0000","last_clean":"2024-09-15T23:54:43.642808+0000","last_became_active":"2024-09-15T23:54:43.630993+0000","last_became_peered":"2024-09-15T23:54:43.630993+0000","last_unstale":"2024-09-15T23:54:43.642808+0000","last_undegraded":"2024-09-15T23:54:43.642808+0000","last_fullsized":"2024-09-15T23:54:43.642808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:24.435909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625586+0000","last_change":"2024-09-15T23:54:42.611939+0000","last_active":"2024-09-15T23:54:43.625586+0000","last_peered":"2024-09-15T23:54:43.625586+0000","last_clean":"2024-09-15T23:54:43.625586+0000","last_became_active":"2024-09-15T23:54:42.611180+0000","last_became_peered":"2024-09-15T23:54:42.611180+0000","last_unstale":"2024-09-15T23:54:43.625586+0000","last_undegraded":"2024-09-15T23:54:43.625586+0000","last_fullsized":"2024-09-15T23:54:43.625586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:07.254369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675683+0000","last_change":"2024-09-15T23:54:43.658082+0000","last_active":"2024-09-15T23:54:43.675683+0000","last_peered":"2024-09-15T23:54:43.675683+0000","last_clean":"2024-09-15T23:54:43.675683+0000","last_became_active":"2024-09-15T23:54:43.656463+0000","last_became_peered":"2024-09-15T23:54:43.656463+0000","last_unstale":"2024-09-15T23:54:43.675683+0000","last_undegraded":"2024-09-15T23:54:43.675683+0000","last_fullsized":"2024-09-15T23:54:43.675683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:57.007396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625925+0000","last_change":"2024-09-15T23:54:42.597005+0000","last_active":"2024-09-15T23:54:43.625925+0000","last_peered":"2024-09-15T23:54:43.625925+0000","last_clean":"2024-09-15T23:54:43.625925+0000","last_became_active":"2024-09-15T23:54:42.596627+0000","last_became_peered":"2024-09-15T23:54:42.596627+0000","last_unstale":"2024-09-15T23:54:43.625925+0000","last_undegraded":"2024-09-15T23:54:43.625925+0000","last_fullsized":"2024-09-15T23:54:43.625925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:26.732611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677039+0000","last_change":"2024-09-15T23:54:43.658368+0000","last_active":"2024-09-15T23:54:43.677039+0000","last_peered":"2024-09-15T23:54:43.677039+0000","last_clean":"2024-09-15T23:54:43.677039+0000","last_became_active":"2024-09-15T23:54:43.650724+0000","last_became_peered":"2024-09-15T23:54:43.650724+0000","last_unstale":"2024-09-15T23:54:43.677039+0000","last_undegraded":"2024-09-15T23:54:43.677039+0000","last_fullsized":"2024-09-15T23:54:43.677039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:56.166523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.635501+0000","last_change":"2024-09-15T23:54:42.624959+0000","last_active":"2024-09-15T23:54:43.635501+0000","last_peered":"2024-09-15T23:54:43.635501+0000","last_clean":"2024-09-15T23:54:43.635501+0000","last_became_active":"2024-09-15T23:54:42.624107+0000","last_became_peered":"2024-09-15T23:54:42.624107+0000","last_unstale":"2024-09-15T23:54:43.635501+0000","last_undegraded":"2024-09-15T23:54:43.635501+0000","last_fullsized":"2024-09-15T23:54:43.635501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:28.523942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.638066+0000","last_change":"2024-09-15T23:54:43.634620+0000","last_active":"2024-09-15T23:54:43.638066+0000","last_peered":"2024-09-15T23:54:43.638066+0000","last_clean":"2024-09-15T23:54:43.638066+0000","last_became_active":"2024-09-15T23:54:43.634284+0000","last_became_peered":"2024-09-15T23:54:43.634284+0000","last_unstale":"2024-09-15T23:54:43.638066+0000","last_undegraded":"2024-09-15T23:54:43.638066+0000","last_fullsized":"2024-09-15T23:54:43.638066+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:03.360218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.617515+0000","last_change":"2024-09-15T23:54:42.605069+0000","last_active":"2024-09-15T23:54:43.617515+0000","last_peered":"2024-09-15T23:54:43.617515+0000","last_clean":"2024-09-15T23:54:43.617515+0000","last_became_active":"2024-09-15T23:54:42.604503+0000","last_became_peered":"2024-09-15T23:54:42.604503+0000","last_unstale":"2024-09-15T23:54:43.617515+0000","last_undegraded":"2024-09-15T23:54:43.617515+0000","last_fullsized":"2024-09-15T23:54:43.617515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.769934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684422+0000","last_change":"2024-09-15T23:54:43.671661+0000","last_active":"2024-09-15T23:54:43.684422+0000","last_peered":"2024-09-15T23:54:43.684422+0000","last_clean":"2024-09-15T23:54:43.684422+0000","last_became_active":"2024-09-15T23:54:43.666649+0000","last_became_peered":"2024-09-15T23:54:43.666649+0000","last_unstale":"2024-09-15T23:54:43.684422+0000","last_undegraded":"2024-09-15T23:54:43.684422+0000","last_fullsized":"2024-09-15T23:54:43.684422+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:56.823302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.665839+0000","last_change":"2024-09-15T23:54:42.626955+0000","last_active":"2024-09-15T23:54:43.665839+0000","last_peered":"2024-09-15T23:54:43.665839+0000","last_clean":"2024-09-15T23:54:43.665839+0000","last_became_active":"2024-09-15T23:54:42.626378+0000","last_became_peered":"2024-09-15T23:54:42.626378+0000","last_unstale":"2024-09-15T23:54:43.665839+0000","last_undegraded":"2024-09-15T23:54:43.665839+0000","last_fullsized":"2024-09-15T23:54:43.665839+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:41.491603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.651600+0000","last_change":"2024-09-15T23:54:43.647810+0000","last_active":"2024-09-15T23:54:43.651600+0000","last_peered":"2024-09-15T23:54:43.651600+0000","last_clean":"2024-09-15T23:54:43.651600+0000","last_became_active":"2024-09-15T23:54:43.647559+0000","last_became_peered":"2024-09-15T23:54:43.647559+0000","last_unstale":"2024-09-15T23:54:43.651600+0000","last_undegraded":"2024-09-15T23:54:43.651600+0000","last_fullsized":"2024-09-15T23:54:43.651600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:37.184096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.687213+0000","last_change":"2024-09-15T23:54:42.621794+0000","last_active":"2024-09-15T23:54:43.687213+0000","last_peered":"2024-09-15T23:54:43.687213+0000","last_clean":"2024-09-15T23:54:43.687213+0000","last_became_active":"2024-09-15T23:54:42.621085+0000","last_became_peered":"2024-09-15T23:54:42.621085+0000","last_unstale":"2024-09-15T23:54:43.687213+0000","last_undegraded":"2024-09-15T23:54:43.687213+0000","last_fullsized":"2024-09-15T23:54:43.687213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:25.577766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677306+0000","last_change":"2024-09-15T23:54:43.657690+0000","last_active":"2024-09-15T23:54:43.677306+0000","last_peered":"2024-09-15T23:54:43.677306+0000","last_clean":"2024-09-15T23:54:43.677306+0000","last_became_active":"2024-09-15T23:54:43.650910+0000","last_became_peered":"2024-09-15T23:54:43.650910+0000","last_unstale":"2024-09-15T23:54:43.677306+0000","last_undegraded":"2024-09-15T23:54:43.677306+0000","last_fullsized":"2024-09-15T23:54:43.677306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:05.527477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.685074+0000","last_change":"2024-09-15T23:54:42.616261+0000","last_active":"2024-09-15T23:54:43.685074+0000","last_peered":"2024-09-15T23:54:43.685074+0000","last_clean":"2024-09-15T23:54:43.685074+0000","last_became_active":"2024-09-15T23:54:42.615529+0000","last_became_peered":"2024-09-15T23:54:42.615529+0000","last_unstale":"2024-09-15T23:54:43.685074+0000","last_undegraded":"2024-09-15T23:54:43.685074+0000","last_fullsized":"2024-09-15T23:54:43.685074+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:03.874014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682543+0000","last_change":"2024-09-15T23:54:43.669009+0000","last_active":"2024-09-15T23:54:43.682543+0000","last_peered":"2024-09-15T23:54:43.682543+0000","last_clean":"2024-09-15T23:54:43.682543+0000","last_became_active":"2024-09-15T23:54:43.667776+0000","last_became_peered":"2024-09-15T23:54:43.667776+0000","last_unstale":"2024-09-15T23:54:43.682543+0000","last_undegraded":"2024-09-15T23:54:43.682543+0000","last_fullsized":"2024-09-15T23:54:43.682543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:44.483323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.640823+0000","last_change":"2024-09-15T23:54:42.601025+0000","last_active":"2024-09-15T23:54:43.640823+0000","last_peered":"2024-09-15T23:54:43.640823+0000","last_clean":"2024-09-15T23:54:43.640823+0000","last_became_active":"2024-09-15T23:54:42.599974+0000","last_became_peered":"2024-09-15T23:54:42.599974+0000","last_unstale":"2024-09-15T23:54:43.640823+0000","last_undegraded":"2024-09-15T23:54:43.640823+0000","last_fullsized":"2024-09-15T23:54:43.640823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:34.417323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648500+0000","last_change":"2024-09-15T23:54:43.642124+0000","last_active":"2024-09-15T23:54:43.648500+0000","last_peered":"2024-09-15T23:54:43.648500+0000","last_clean":"2024-09-15T23:54:43.648500+0000","last_became_active":"2024-09-15T23:54:43.641863+0000","last_became_peered":"2024-09-15T23:54:43.641863+0000","last_unstale":"2024-09-15T23:54:43.648500+0000","last_undegraded":"2024-09-15T23:54:43.648500+0000","last_fullsized":"2024-09-15T23:54:43.648500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:29.535388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.617251+0000","last_change":"2024-09-15T23:54:42.597340+0000","last_active":"2024-09-15T23:54:43.617251+0000","last_peered":"2024-09-15T23:54:43.617251+0000","last_clean":"2024-09-15T23:54:43.617251+0000","last_became_active":"2024-09-15T23:54:42.596908+0000","last_became_peered":"2024-09-15T23:54:42.596908+0000","last_unstale":"2024-09-15T23:54:43.617251+0000","last_undegraded":"2024-09-15T23:54:43.617251+0000","last_fullsized":"2024-09-15T23:54:43.617251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:40.885229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682452+0000","last_change":"2024-09-15T23:54:43.677377+0000","last_active":"2024-09-15T23:54:43.682452+0000","last_peered":"2024-09-15T23:54:43.682452+0000","last_clean":"2024-09-15T23:54:43.682452+0000","last_became_active":"2024-09-15T23:54:43.676667+0000","last_became_peered":"2024-09-15T23:54:43.676667+0000","last_unstale":"2024-09-15T23:54:43.682452+0000","last_undegraded":"2024-09-15T23:54:43.682452+0000","last_fullsized":"2024-09-15T23:54:43.682452+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:08.810523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642008+0000","last_change":"2024-09-15T23:54:42.591210+0000","last_active":"2024-09-15T23:54:43.642008+0000","last_peered":"2024-09-15T23:54:43.642008+0000","last_clean":"2024-09-15T23:54:43.642008+0000","last_became_active":"2024-09-15T23:54:42.590512+0000","last_became_peered":"2024-09-15T23:54:42.590512+0000","last_unstale":"2024-09-15T23:54:43.642008+0000","last_undegraded":"2024-09-15T23:54:43.642008+0000","last_fullsized":"2024-09-15T23:54:43.642008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:30.045540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678242+0000","last_change":"2024-09-15T23:54:43.667252+0000","last_active":"2024-09-15T23:54:43.678242+0000","last_peered":"2024-09-15T23:54:43.678242+0000","last_clean":"2024-09-15T23:54:43.678242+0000","last_became_active":"2024-09-15T23:54:43.659011+0000","last_became_peered":"2024-09-15T23:54:43.659011+0000","last_unstale":"2024-09-15T23:54:43.678242+0000","last_undegraded":"2024-09-15T23:54:43.678242+0000","last_fullsized":"2024-09-15T23:54:43.678242+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:04.885460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.640799+0000","last_change":"2024-09-15T23:54:42.602026+0000","last_active":"2024-09-15T23:54:43.640799+0000","last_peered":"2024-09-15T23:54:43.640799+0000","last_clean":"2024-09-15T23:54:43.640799+0000","last_became_active":"2024-09-15T23:54:42.601654+0000","last_became_peered":"2024-09-15T23:54:42.601654+0000","last_unstale":"2024-09-15T23:54:43.640799+0000","last_undegraded":"2024-09-15T23:54:43.640799+0000","last_fullsized":"2024-09-15T23:54:43.640799+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:36.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.671218+0000","last_change":"2024-09-15T23:54:43.665585+0000","last_active":"2024-09-15T23:54:43.671218+0000","last_peered":"2024-09-15T23:54:43.671218+0000","last_clean":"2024-09-15T23:54:43.671218+0000","last_became_active":"2024-09-15T23:54:43.665240+0000","last_became_peered":"2024-09-15T23:54:43.665240+0000","last_unstale":"2024-09-15T23:54:43.671218+0000","last_undegraded":"2024-09-15T23:54:43.671218+0000","last_fullsized":"2024-09-15T23:54:43.671218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:40.585681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.666572+0000","last_change":"2024-09-15T23:54:42.627305+0000","last_active":"2024-09-15T23:54:43.666572+0000","last_peered":"2024-09-15T23:54:43.666572+0000","last_clean":"2024-09-15T23:54:43.666572+0000","last_became_active":"2024-09-15T23:54:42.627061+0000","last_became_peered":"2024-09-15T23:54:42.627061+0000","last_unstale":"2024-09-15T23:54:43.666572+0000","last_undegraded":"2024-09-15T23:54:43.666572+0000","last_fullsized":"2024-09-15T23:54:43.666572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:47.285819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676607+0000","last_change":"2024-09-15T23:54:43.668779+0000","last_active":"2024-09-15T23:54:43.676607+0000","last_peered":"2024-09-15T23:54:43.676607+0000","last_clean":"2024-09-15T23:54:43.676607+0000","last_became_active":"2024-09-15T23:54:43.668438+0000","last_became_peered":"2024-09-15T23:54:43.668438+0000","last_unstale":"2024-09-15T23:54:43.676607+0000","last_undegraded":"2024-09-15T23:54:43.676607+0000","last_fullsized":"2024-09-15T23:54:43.676607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:46.999984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.650161+0000","last_change":"2024-09-15T23:54:42.607764+0000","last_active":"2024-09-15T23:54:43.650161+0000","last_peered":"2024-09-15T23:54:43.650161+0000","last_clean":"2024-09-15T23:54:43.650161+0000","last_became_active":"2024-09-15T23:54:42.607054+0000","last_became_peered":"2024-09-15T23:54:42.607054+0000","last_unstale":"2024-09-15T23:54:43.650161+0000","last_undegraded":"2024-09-15T23:54:43.650161+0000","last_fullsized":"2024-09-15T23:54:43.650161+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:11.254409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:54:42.570937+0000","last_change":"2024-09-15T23:54:42.570937+0000","last_active":"2024-09-15T23:54:42.570937+0000","last_peered":"2024-09-15T23:54:42.570937+0000","last_clean":"2024-09-15T23:54:42.570937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:42.570937+0000","last_undegraded":"2024-09-15T23:54:42.570937+0000","last_fullsized":"2024-09-15T23:54:42.570937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T23:54:41.585064+0000","last_change":"2024-09-15T23:54:41.585064+0000","last_active":"2024-09-15T23:54:41.559490+0000","last_peered":"2024-09-15T23:54:41.559490+0000","last_clean":"2024-09-15T23:54:41.559490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:41.585064+0000","last_undegraded":"2024-09-15T23:54:41.585064+0000","last_fullsized":"2024-09-15T23:54:41.585064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648485+0000","last_change":"2024-09-15T23:54:43.643428+0000","last_active":"2024-09-15T23:54:43.648485+0000","last_peered":"2024-09-15T23:54:43.648485+0000","last_clean":"2024-09-15T23:54:43.648485+0000","last_became_active":"2024-09-15T23:54:43.643158+0000","last_became_peered":"2024-09-15T23:54:43.643158+0000","last_unstale":"2024-09-15T23:54:43.648485+0000","last_undegraded":"2024-09-15T23:54:43.648485+0000","last_fullsized":"2024-09-15T23:54:43.648485+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:02.150007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T23:54:41.584264+0000","last_change":"2024-09-15T23:54:41.584264+0000","last_active":"2024-09-15T23:54:41.559490+0000","last_peered":"2024-09-15T23:54:41.559490+0000","last_clean":"2024-09-15T23:54:41.559490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:41.584264+0000","last_undegraded":"2024-09-15T23:54:41.584264+0000","last_fullsized":"2024-09-15T23:54:41.584264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676955+0000","last_change":"2024-09-15T23:54:43.657288+0000","last_active":"2024-09-15T23:54:43.676955+0000","last_peered":"2024-09-15T23:54:43.676955+0000","last_clean":"2024-09-15T23:54:43.676955+0000","last_became_active":"2024-09-15T23:54:43.656050+0000","last_became_peered":"2024-09-15T23:54:43.656050+0000","last_unstale":"2024-09-15T23:54:43.676955+0000","last_undegraded":"2024-09-15T23:54:43.676955+0000","last_fullsized":"2024-09-15T23:54:43.676955+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:02.241689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625925+0000","last_change":"2024-09-15T23:54:42.598953+0000","last_active":"2024-09-15T23:54:43.625925+0000","last_peered":"2024-09-15T23:54:43.625925+0000","last_clean":"2024-09-15T23:54:43.625925+0000","last_became_active":"2024-09-15T23:54:42.597704+0000","last_became_peered":"2024-09-15T23:54:42.597704+0000","last_unstale":"2024-09-15T23:54:43.625925+0000","last_undegraded":"2024-09-15T23:54:43.625925+0000","last_fullsized":"2024-09-15T23:54:43.625925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:16.673465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.645191+0000","last_change":"2024-09-15T23:54:43.636074+0000","last_active":"2024-09-15T23:54:43.645191+0000","last_peered":"2024-09-15T23:54:43.645191+0000","last_clean":"2024-09-15T23:54:43.645191+0000","last_became_active":"2024-09-15T23:54:43.635810+0000","last_became_peered":"2024-09-15T23:54:43.635810+0000","last_unstale":"2024-09-15T23:54:43.645191+0000","last_undegraded":"2024-09-15T23:54:43.645191+0000","last_fullsized":"2024-09-15T23:54:43.645191+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:08.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625947+0000","last_change":"2024-09-15T23:54:42.596955+0000","last_active":"2024-09-15T23:54:43.625947+0000","last_peered":"2024-09-15T23:54:43.625947+0000","last_clean":"2024-09-15T23:54:43.625947+0000","last_became_active":"2024-09-15T23:54:42.596647+0000","last_became_peered":"2024-09-15T23:54:42.596647+0000","last_unstale":"2024-09-15T23:54:43.625947+0000","last_undegraded":"2024-09-15T23:54:43.625947+0000","last_fullsized":"2024-09-15T23:54:43.625947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:36.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677202+0000","last_change":"2024-09-15T23:54:43.659071+0000","last_active":"2024-09-15T23:54:43.677202+0000","last_peered":"2024-09-15T23:54:43.677202+0000","last_clean":"2024-09-15T23:54:43.677202+0000","last_became_active":"2024-09-15T23:54:43.656622+0000","last_became_peered":"2024-09-15T23:54:43.656622+0000","last_unstale":"2024-09-15T23:54:43.677202+0000","last_undegraded":"2024-09-15T23:54:43.677202+0000","last_fullsized":"2024-09-15T23:54:43.677202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:50.700577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625588+0000","last_change":"2024-09-15T23:54:42.628542+0000","last_active":"2024-09-15T23:54:43.625588+0000","last_peered":"2024-09-15T23:54:43.625588+0000","last_clean":"2024-09-15T23:54:43.625588+0000","last_became_active":"2024-09-15T23:54:42.627924+0000","last_became_peered":"2024-09-15T23:54:42.627924+0000","last_unstale":"2024-09-15T23:54:43.625588+0000","last_undegraded":"2024-09-15T23:54:43.625588+0000","last_fullsized":"2024-09-15T23:54:43.625588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:15.134895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648042+0000","last_change":"2024-09-15T23:54:43.643031+0000","last_active":"2024-09-15T23:54:43.648042+0000","last_peered":"2024-09-15T23:54:43.648042+0000","last_clean":"2024-09-15T23:54:43.648042+0000","last_became_active":"2024-09-15T23:54:43.642329+0000","last_became_peered":"2024-09-15T23:54:43.642329+0000","last_unstale":"2024-09-15T23:54:43.648042+0000","last_undegraded":"2024-09-15T23:54:43.648042+0000","last_fullsized":"2024-09-15T23:54:43.648042+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:37.970228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.647722+0000","last_change":"2024-09-15T23:54:42.603521+0000","last_active":"2024-09-15T23:54:43.647722+0000","last_peered":"2024-09-15T23:54:43.647722+0000","last_clean":"2024-09-15T23:54:43.647722+0000","last_became_active":"2024-09-15T23:54:42.602670+0000","last_became_peered":"2024-09-15T23:54:42.602670+0000","last_unstale":"2024-09-15T23:54:43.647722+0000","last_undegraded":"2024-09-15T23:54:43.647722+0000","last_fullsized":"2024-09-15T23:54:43.647722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.132376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.645389+0000","last_change":"2024-09-15T23:54:43.637124+0000","last_active":"2024-09-15T23:54:43.645389+0000","last_peered":"2024-09-15T23:54:43.645389+0000","last_clean":"2024-09-15T23:54:43.645389+0000","last_became_active":"2024-09-15T23:54:43.636448+0000","last_became_peered":"2024-09-15T23:54:43.636448+0000","last_unstale":"2024-09-15T23:54:43.645389+0000","last_undegraded":"2024-09-15T23:54:43.645389+0000","last_fullsized":"2024-09-15T23:54:43.645389+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:04.885460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.633484+0000","last_change":"2024-09-15T23:54:42.611389+0000","last_active":"2024-09-15T23:54:43.633484+0000","last_peered":"2024-09-15T23:54:43.633484+0000","last_clean":"2024-09-15T23:54:43.633484+0000","last_became_active":"2024-09-15T23:54:42.610734+0000","last_became_peered":"2024-09-15T23:54:42.610734+0000","last_unstale":"2024-09-15T23:54:43.633484+0000","last_undegraded":"2024-09-15T23:54:43.633484+0000","last_fullsized":"2024-09-15T23:54:43.633484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:36.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:54:42.570937+0000","last_change":"2024-09-15T23:54:42.570937+0000","last_active":"2024-09-15T23:54:42.570937+0000","last_peered":"2024-09-15T23:54:42.570937+0000","last_clean":"2024-09-15T23:54:42.570937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:42.570937+0000","last_undegraded":"2024-09-15T23:54:42.570937+0000","last_fullsized":"2024-09-15T23:54:42.570937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.633517+0000","last_change":"2024-09-15T23:54:42.629795+0000","last_active":"2024-09-15T23:54:43.633517+0000","last_peered":"2024-09-15T23:54:43.633517+0000","last_clean":"2024-09-15T23:54:43.633517+0000","last_became_active":"2024-09-15T23:54:42.628974+0000","last_became_peered":"2024-09-15T23:54:42.628974+0000","last_unstale":"2024-09-15T23:54:43.633517+0000","last_undegraded":"2024-09-15T23:54:43.633517+0000","last_fullsized":"2024-09-15T23:54:43.633517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:26.732611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.683271+0000","last_change":"2024-09-15T23:54:43.679983+0000","last_active":"2024-09-15T23:54:43.683271+0000","last_peered":"2024-09-15T23:54:43.683271+0000","last_clean":"2024-09-15T23:54:43.683271+0000","last_became_active":"2024-09-15T23:54:43.679346+0000","last_became_peered":"2024-09-15T23:54:43.679346+0000","last_unstale":"2024-09-15T23:54:43.683271+0000","last_undegraded":"2024-09-15T23:54:43.683271+0000","last_fullsized":"2024-09-15T23:54:43.683271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:40.585681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.626104+0000","last_change":"2024-09-15T23:54:42.619643+0000","last_active":"2024-09-15T23:54:43.626104+0000","last_peered":"2024-09-15T23:54:43.626104+0000","last_clean":"2024-09-15T23:54:43.626104+0000","last_became_active":"2024-09-15T23:54:42.615833+0000","last_became_peered":"2024-09-15T23:54:42.615833+0000","last_unstale":"2024-09-15T23:54:43.626104+0000","last_undegraded":"2024-09-15T23:54:43.626104+0000","last_fullsized":"2024-09-15T23:54:43.626104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:43.471876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678205+0000","last_change":"2024-09-15T23:54:43.666718+0000","last_active":"2024-09-15T23:54:43.678205+0000","last_peered":"2024-09-15T23:54:43.678205+0000","last_clean":"2024-09-15T23:54:43.678205+0000","last_became_active":"2024-09-15T23:54:43.666042+0000","last_became_peered":"2024-09-15T23:54:43.666042+0000","last_unstale":"2024-09-15T23:54:43.678205+0000","last_undegraded":"2024-09-15T23:54:43.678205+0000","last_fullsized":"2024-09-15T23:54:43.678205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:08.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.624671+0000","last_change":"2024-09-15T23:54:42.605386+0000","last_active":"2024-09-15T23:54:43.624671+0000","last_peered":"2024-09-15T23:54:43.624671+0000","last_clean":"2024-09-15T23:54:43.624671+0000","last_became_active":"2024-09-15T23:54:42.605053+0000","last_became_peered":"2024-09-15T23:54:42.605053+0000","last_unstale":"2024-09-15T23:54:43.624671+0000","last_undegraded":"2024-09-15T23:54:43.624671+0000","last_fullsized":"2024-09-15T23:54:43.624671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:31.941914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.664273+0000","last_change":"2024-09-15T23:54:43.659325+0000","last_active":"2024-09-15T23:54:43.664273+0000","last_peered":"2024-09-15T23:54:43.664273+0000","last_clean":"2024-09-15T23:54:43.664273+0000","last_became_active":"2024-09-15T23:54:43.658989+0000","last_became_peered":"2024-09-15T23:54:43.658989+0000","last_unstale":"2024-09-15T23:54:43.664273+0000","last_undegraded":"2024-09-15T23:54:43.664273+0000","last_fullsized":"2024-09-15T23:54:43.664273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:59.753339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.617582+0000","last_change":"2024-09-15T23:54:42.602928+0000","last_active":"2024-09-15T23:54:43.617582+0000","last_peered":"2024-09-15T23:54:43.617582+0000","last_clean":"2024-09-15T23:54:43.617582+0000","last_became_active":"2024-09-15T23:54:42.602534+0000","last_became_peered":"2024-09-15T23:54:42.602534+0000","last_unstale":"2024-09-15T23:54:43.617582+0000","last_undegraded":"2024-09-15T23:54:43.617582+0000","last_fullsized":"2024-09-15T23:54:43.617582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:51.351267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.656757+0000","last_change":"2024-09-15T23:54:43.652409+0000","last_active":"2024-09-15T23:54:43.656757+0000","last_peered":"2024-09-15T23:54:43.656757+0000","last_clean":"2024-09-15T23:54:43.656757+0000","last_became_active":"2024-09-15T23:54:43.652155+0000","last_became_peered":"2024-09-15T23:54:43.652155+0000","last_unstale":"2024-09-15T23:54:43.656757+0000","last_undegraded":"2024-09-15T23:54:43.656757+0000","last_fullsized":"2024-09-15T23:54:43.656757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:02.241689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.636039+0000","last_change":"2024-09-15T23:54:42.621609+0000","last_active":"2024-09-15T23:54:43.636039+0000","last_peered":"2024-09-15T23:54:43.636039+0000","last_clean":"2024-09-15T23:54:43.636039+0000","last_became_active":"2024-09-15T23:54:42.620946+0000","last_became_peered":"2024-09-15T23:54:42.620946+0000","last_unstale":"2024-09-15T23:54:43.636039+0000","last_undegraded":"2024-09-15T23:54:43.636039+0000","last_fullsized":"2024-09-15T23:54:43.636039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:48.556516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.651261+0000","last_change":"2024-09-15T23:54:43.648081+0000","last_active":"2024-09-15T23:54:43.651261+0000","last_peered":"2024-09-15T23:54:43.651261+0000","last_clean":"2024-09-15T23:54:43.651261+0000","last_became_active":"2024-09-15T23:54:43.647717+0000","last_became_peered":"2024-09-15T23:54:43.647717+0000","last_unstale":"2024-09-15T23:54:43.651261+0000","last_undegraded":"2024-09-15T23:54:43.651261+0000","last_fullsized":"2024-09-15T23:54:43.651261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:44.258165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.624280+0000","last_change":"2024-09-15T23:54:42.604211+0000","last_active":"2024-09-15T23:54:43.624280+0000","last_peered":"2024-09-15T23:54:43.624280+0000","last_clean":"2024-09-15T23:54:43.624280+0000","last_became_active":"2024-09-15T23:54:42.603770+0000","last_became_peered":"2024-09-15T23:54:42.603770+0000","last_unstale":"2024-09-15T23:54:43.624280+0000","last_undegraded":"2024-09-15T23:54:43.624280+0000","last_fullsized":"2024-09-15T23:54:43.624280+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:55.995950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625877+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:54:43.625877+0000","last_peered":"2024-09-15T23:54:43.625877+0000","last_clean":"2024-09-15T23:54:43.625877+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:54:43.625877+0000","last_undegraded":"2024-09-15T23:54:43.625877+0000","last_fullsized":"2024-09-15T23:54:43.625877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":122,"acting":122,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":181795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":190698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":446464,"data_stored":189052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":191156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1024000,"data_stored":772163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":181795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1011712,"data_stored":765496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:54:46.995 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:54:47.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.140+0000 7f8c32f99640 1 Processor -- start 2024-09-15T23:54:47.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c32f99640 1 -- start start 2024-09-15T23:54:47.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c32f99640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c161a60 0x7f8c2c0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c32f99640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8c2c0cf620 0x7f8c2c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c32f99640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2c0d32b0 con 0x7f8c2c0d2e90 2024-09-15T23:54:47.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c32f99640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8c2c0d0300 con 0x7f8c2c0cf620 2024-09-15T23:54:47.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c32f99640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c0b0f60 con 0x7f8c2c161a60 2024-09-15T23:54:47.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2bfff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8c2c0d2e90 0x7f8c2c0cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59752/0 (socket says 172.21.15.112:59752) 2024-09-15T23:54:47.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2bfff640 1 -- 172.21.15.112:0/1049993318 learned_addr learned my addr 172.21.15.112:0/1049993318 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:47.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 -- 172.21.15.112:0/1049993318 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3188822529 0 0) 0x7f8c2c0d32b0 con 0x7f8c2c0d2e90 2024-09-15T23:54:47.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c30d35640 1 --2- 172.21.15.112:0/1049993318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c161a60 0x7f8c2c0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 -- 172.21.15.112:0/1049993318 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c14003530 con 0x7f8c2c0d2e90 2024-09-15T23:54:47.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c31536640 1 --2- 172.21.15.112:0/1049993318 >> v2:172.21.15.169:3300/0 conn(0x7f8c2c0cf620 0x7f8c2c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 -- 172.21.15.112:0/1049993318 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 206166905 0 0) 0x7f8c14003530 con 0x7f8c2c0d2e90 2024-09-15T23:54:47.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 -- 172.21.15.112:0/1049993318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c161a60 msgr2=0x7f8c2c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:47.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 --2- 172.21.15.112:0/1049993318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c161a60 0x7f8c2c0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 -- 172.21.15.112:0/1049993318 >> v2:172.21.15.169:3300/0 conn(0x7f8c2c0cf620 msgr2=0x7f8c2c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:47.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 --2- 172.21.15.112:0/1049993318 >> v2:172.21.15.169:3300/0 conn(0x7f8c2c0cf620 0x7f8c2c06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 -- 172.21.15.112:0/1049993318 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c0cfad0 con 0x7f8c2c0d2e90 2024-09-15T23:54:47.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c31536640 1 --2- 172.21.15.112:0/1049993318 >> v2:172.21.15.169:3300/0 conn(0x7f8c2c0cf620 0x7f8c2c06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:54:47.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 -- 172.21.15.112:0/1049993318 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f8c20001680 con 0x7f8c2c0d2e90 2024-09-15T23:54:47.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 -- 172.21.15.112:0/1049993318 >> v1:172.21.15.112:6789/0 conn(0x7f8c2c0d2e90 legacy=0x7f8c2c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 --2- 172.21.15.112:0/1049993318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c140039c0 0x7f8c14003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 --2- 172.21.15.112:0/1049993318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c161a60 0x7f8c14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 --2- 172.21.15.112:0/1049993318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c14004d50 0x7f8c140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 -- 172.21.15.112:0/1049993318 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c0d0300 con 0x7f8c140039c0 2024-09-15T23:54:47.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 -- 172.21.15.112:0/1049993318 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c0b0f60 con 0x7f8c14004d50 2024-09-15T23:54:47.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c2b7fe640 1 -- 172.21.15.112:0/1049993318 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1400ba80 con 0x7f8c2c161a60 2024-09-15T23:54:47.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c30d35640 1 --2- 172.21.15.112:0/1049993318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c140039c0 0x7f8c14003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c30d35640 1 -- 172.21.15.112:0/1049993318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c161a60 msgr2=0x7f8c14004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:47.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c30d35640 1 --2- 172.21.15.112:0/1049993318 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c161a60 0x7f8c14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c30d35640 1 -- 172.21.15.112:0/1049993318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c14004d50 msgr2=0x7f8c140051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:47.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c30d35640 1 --2- 172.21.15.112:0/1049993318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c14004d50 0x7f8c140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.144+0000 7f8c30d35640 1 -- 172.21.15.112:0/1049993318 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c14003530 con 0x7f8c140039c0 2024-09-15T23:54:47.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c30d35640 1 --2- 172.21.15.112:0/1049993318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c140039c0 0x7f8c14003de0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009ac0 tx=0x7f8c1c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ce16f18b53f845 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:47.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c2b7fe640 1 -- 172.21.15.112:0/1049993318 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c0b2070 con 0x7f8c140039c0 2024-09-15T23:54:47.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c2b7fe640 1 -- 172.21.15.112:0/1049993318 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1c0a5540 con 0x7f8c140039c0 2024-09-15T23:54:47.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c2b7fe640 1 -- 172.21.15.112:0/1049993318 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c009690 con 0x7f8c140039c0 2024-09-15T23:54:47.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 -- 172.21.15.112:0/1049993318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c140039c0 msgr2=0x7f8c14003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 --2- 172.21.15.112:0/1049993318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c140039c0 0x7f8c14003de0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009ac0 tx=0x7f8c1c01ca60 comp rx=0 tx=0).stop 2024-09-15T23:54:47.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c31536640 1 -- 172.21.15.112:0/1049993318 reap_dead start 2024-09-15T23:54:47.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 -- 172.21.15.112:0/1049993318 shutdown_connections 2024-09-15T23:54:47.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 -- 172.21.15.112:0/1049993318 >> 172.21.15.112:0/1049993318 conn(0x7f8c2c08bf90 msgr2=0x7f8c2c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:47.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 -- 172.21.15.112:0/1049993318 shutdown_connections 2024-09-15T23:54:47.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 -- 172.21.15.112:0/1049993318 wait complete. 2024-09-15T23:54:47.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 Processor -- start 2024-09-15T23:54:47.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 -- start start 2024-09-15T23:54:47.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c140039c0 0x7f8c2c1f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c1593c0 0x7f8c2c159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c2c15c040 0x7f8c2c15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c06e400 con 0x7f8c140039c0 2024-09-15T23:54:47.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c06d190 con 0x7f8c2c15c040 2024-09-15T23:54:47.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c06e580 con 0x7f8c2c1593c0 2024-09-15T23:54:47.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c30d35640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c140039c0 0x7f8c2c1f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c30d35640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c140039c0 0x7f8c2c1f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50436/0 (socket says 172.21.15.112:50436) 2024-09-15T23:54:47.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c30d35640 1 -- 172.21.15.112:0/1656885590 learned_addr learned my addr 172.21.15.112:0/1656885590 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:47.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c2bfff640 1 --2- 172.21.15.112:0/1656885590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c1593c0 0x7f8c2c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c30d35640 1 -- 172.21.15.112:0/1656885590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c1593c0 msgr2=0x7f8c2c159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c30d35640 1 --2- 172.21.15.112:0/1656885590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c1593c0 0x7f8c2c159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c30d35640 1 -- 172.21.15.112:0/1656885590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c2c15c040 msgr2=0x7f8c2c15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c30d35640 1 --2- 172.21.15.112:0/1656885590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c2c15c040 0x7f8c2c15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c30d35640 1 -- 172.21.15.112:0/1656885590 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c15cd70 con 0x7f8c140039c0 2024-09-15T23:54:47.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c2bfff640 1 --2- 172.21.15.112:0/1656885590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c1593c0 0x7f8c2c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:47.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c30d35640 1 --2- 172.21.15.112:0/1656885590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c140039c0 0x7f8c2c1f4610 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0b0040 tx=0x7f8c14005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:47.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c297fa640 1 -- 172.21.15.112:0/1656885590 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c0b2040 con 0x7f8c140039c0 2024-09-15T23:54:47.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c297fa640 1 -- 172.21.15.112:0/1656885590 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1c0a5d70 con 0x7f8c140039c0 2024-09-15T23:54:47.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 -- 172.21.15.112:0/1656885590 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2c1f8440 con 0x7f8c140039c0 2024-09-15T23:54:47.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c297fa640 1 -- 172.21.15.112:0/1656885590 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c0ad640 con 0x7f8c140039c0 2024-09-15T23:54:47.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.148+0000 7f8c32f99640 1 -- 172.21.15.112:0/1656885590 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c2c15ca00 con 0x7f8c140039c0 2024-09-15T23:54:47.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.152+0000 7f8c32f99640 1 -- 172.21.15.112:0/1656885590 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c2c06d6b0 con 0x7f8c140039c0 2024-09-15T23:54:47.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.152+0000 7f8c297fa640 1 -- 172.21.15.112:0/1656885590 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c1c0b5070 con 0x7f8c140039c0 2024-09-15T23:54:47.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.152+0000 7f8c297fa640 1 --2- 172.21.15.112:0/1656885590 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c180678c0 0x7f8c18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.152+0000 7f8c297fa640 1 -- 172.21.15.112:0/1656885590 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f8c1c1203a0 con 0x7f8c140039c0 2024-09-15T23:54:47.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.152+0000 7f8c2bfff640 1 --2- 172.21.15.112:0/1656885590 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c180678c0 0x7f8c18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.152+0000 7f8c2bfff640 1 --2- 172.21.15.112:0/1656885590 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c180678c0 0x7f8c18069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c15b1d0 tx=0x7f8c20009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:47.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.156+0000 7f8c297fa640 1 -- 172.21.15.112:0/1656885590 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8c1c0bc020 con 0x7f8c140039c0 2024-09-15T23:54:47.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.300+0000 7f8c32f99640 1 -- 172.21.15.112:0/1656885590 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8c2c0d1a60 con 0x7f8c180678c0 2024-09-15T23:54:47.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.320+0000 7f8c297fa640 1 -- 172.21.15.112:0/1656885590 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251161 (secure 0 0 0) 0x7f8c2c0d1a60 con 0x7f8c180678c0 2024-09-15T23:54:47.326 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:47.327 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:54:47.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.324+0000 7f8c32f99640 1 -- 172.21.15.112:0/1656885590 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c180678c0 msgr2=0x7f8c18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.324+0000 7f8c32f99640 1 --2- 172.21.15.112:0/1656885590 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c180678c0 0x7f8c18069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c15b1d0 tx=0x7f8c20009040 comp rx=0 tx=0).stop 2024-09-15T23:54:47.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.324+0000 7f8c32f99640 1 -- 172.21.15.112:0/1656885590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c140039c0 msgr2=0x7f8c2c1f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.324+0000 7f8c32f99640 1 --2- 172.21.15.112:0/1656885590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c140039c0 0x7f8c2c1f4610 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0b0040 tx=0x7f8c14005840 comp rx=0 tx=0).stop 2024-09-15T23:54:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.324+0000 7f8c32f99640 1 -- 172.21.15.112:0/1656885590 shutdown_connections 2024-09-15T23:54:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.324+0000 7f8c32f99640 1 --2- 172.21.15.112:0/1656885590 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c180678c0 0x7f8c18069d80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.324+0000 7f8c32f99640 1 --2- 172.21.15.112:0/1656885590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c2c15c040 0x7f8c2c15c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.324+0000 7f8c32f99640 1 --2- 172.21.15.112:0/1656885590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c2c1593c0 0x7f8c2c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.324+0000 7f8c32f99640 1 --2- 172.21.15.112:0/1656885590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c140039c0 0x7f8c2c1f4610 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.324+0000 7f8c32f99640 1 -- 172.21.15.112:0/1656885590 >> 172.21.15.112:0/1656885590 conn(0x7f8c2c08bf90 msgr2=0x7f8c2c0b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.324+0000 7f8c32f99640 1 -- 172.21.15.112:0/1656885590 shutdown_connections 2024-09-15T23:54:47.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.324+0000 7f8c32f99640 1 -- 172.21.15.112:0/1656885590 wait complete. 2024-09-15T23:54:47.342 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-15T23:54:47.250324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":188,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225004,"kb_used_data":4600,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749716,"statfs":{"total":773094113280,"available":772863709184,"internally_reserved":0,"allocated":4710400,"data_stored":2661187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.678298"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.679984+0000","last_change":"2024-09-15T23:54:43.666774+0000","last_active":"2024-09-15T23:54:43.679984+0000","last_peered":"2024-09-15T23:54:43.679984+0000","last_clean":"2024-09-15T23:54:43.679984+0000","last_became_active":"2024-09-15T23:54:43.665876+0000","last_became_peered":"2024-09-15T23:54:43.665876+0000","last_unstale":"2024-09-15T23:54:43.679984+0000","last_undegraded":"2024-09-15T23:54:43.679984+0000","last_fullsized":"2024-09-15T23:54:43.679984+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:32.987095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682636+0000","last_change":"2024-09-15T23:54:43.669791+0000","last_active":"2024-09-15T23:54:43.682636+0000","last_peered":"2024-09-15T23:54:43.682636+0000","last_clean":"2024-09-15T23:54:43.682636+0000","last_became_active":"2024-09-15T23:54:43.669151+0000","last_became_peered":"2024-09-15T23:54:43.669151+0000","last_unstale":"2024-09-15T23:54:43.682636+0000","last_undegraded":"2024-09-15T23:54:43.682636+0000","last_fullsized":"2024-09-15T23:54:43.682636+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.809746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.673395+0000","last_change":"2024-09-15T23:54:43.658229+0000","last_active":"2024-09-15T23:54:43.673395+0000","last_peered":"2024-09-15T23:54:43.673395+0000","last_clean":"2024-09-15T23:54:43.673395+0000","last_became_active":"2024-09-15T23:54:43.657551+0000","last_became_peered":"2024-09-15T23:54:43.657551+0000","last_unstale":"2024-09-15T23:54:43.673395+0000","last_undegraded":"2024-09-15T23:54:43.673395+0000","last_fullsized":"2024-09-15T23:54:43.673395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:31.936628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.680196+0000","last_change":"2024-09-15T23:54:43.672536+0000","last_active":"2024-09-15T23:54:43.680196+0000","last_peered":"2024-09-15T23:54:43.680196+0000","last_clean":"2024-09-15T23:54:43.680196+0000","last_became_active":"2024-09-15T23:54:43.671956+0000","last_became_peered":"2024-09-15T23:54:43.671956+0000","last_unstale":"2024-09-15T23:54:43.680196+0000","last_undegraded":"2024-09-15T23:54:43.680196+0000","last_fullsized":"2024-09-15T23:54:43.680196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:59.226661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.655402+0000","last_change":"2024-09-15T23:54:43.651070+0000","last_active":"2024-09-15T23:54:43.655402+0000","last_peered":"2024-09-15T23:54:43.655402+0000","last_clean":"2024-09-15T23:54:43.655402+0000","last_became_active":"2024-09-15T23:54:43.650351+0000","last_became_peered":"2024-09-15T23:54:43.650351+0000","last_unstale":"2024-09-15T23:54:43.655402+0000","last_undegraded":"2024-09-15T23:54:43.655402+0000","last_fullsized":"2024-09-15T23:54:43.655402+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:48.693662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675542+0000","last_change":"2024-09-15T23:54:43.658663+0000","last_active":"2024-09-15T23:54:43.675542+0000","last_peered":"2024-09-15T23:54:43.675542+0000","last_clean":"2024-09-15T23:54:43.675542+0000","last_became_active":"2024-09-15T23:54:43.657995+0000","last_became_peered":"2024-09-15T23:54:43.657995+0000","last_unstale":"2024-09-15T23:54:43.675542+0000","last_undegraded":"2024-09-15T23:54:43.675542+0000","last_fullsized":"2024-09-15T23:54:43.675542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:32.953360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.641190+0000","last_change":"2024-09-15T23:54:43.637868+0000","last_active":"2024-09-15T23:54:43.641190+0000","last_peered":"2024-09-15T23:54:43.641190+0000","last_clean":"2024-09-15T23:54:43.641190+0000","last_became_active":"2024-09-15T23:54:43.637468+0000","last_became_peered":"2024-09-15T23:54:43.637468+0000","last_unstale":"2024-09-15T23:54:43.641190+0000","last_undegraded":"2024-09-15T23:54:43.641190+0000","last_fullsized":"2024-09-15T23:54:43.641190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:19.391528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684490+0000","last_change":"2024-09-15T23:54:43.672587+0000","last_active":"2024-09-15T23:54:43.684490+0000","last_peered":"2024-09-15T23:54:43.684490+0000","last_clean":"2024-09-15T23:54:43.684490+0000","last_became_active":"2024-09-15T23:54:43.671772+0000","last_became_peered":"2024-09-15T23:54:43.671772+0000","last_unstale":"2024-09-15T23:54:43.684490+0000","last_undegraded":"2024-09-15T23:54:43.684490+0000","last_fullsized":"2024-09-15T23:54:43.684490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:54.838047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.655363+0000","last_change":"2024-09-15T23:54:43.650837+0000","last_active":"2024-09-15T23:54:43.655363+0000","last_peered":"2024-09-15T23:54:43.655363+0000","last_clean":"2024-09-15T23:54:43.655363+0000","last_became_active":"2024-09-15T23:54:43.650113+0000","last_became_peered":"2024-09-15T23:54:43.650113+0000","last_unstale":"2024-09-15T23:54:43.655363+0000","last_undegraded":"2024-09-15T23:54:43.655363+0000","last_fullsized":"2024-09-15T23:54:43.655363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:19.391528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648359+0000","last_change":"2024-09-15T23:54:43.641037+0000","last_active":"2024-09-15T23:54:43.648359+0000","last_peered":"2024-09-15T23:54:43.648359+0000","last_clean":"2024-09-15T23:54:43.648359+0000","last_became_active":"2024-09-15T23:54:43.640738+0000","last_became_peered":"2024-09-15T23:54:43.640738+0000","last_unstale":"2024-09-15T23:54:43.648359+0000","last_undegraded":"2024-09-15T23:54:43.648359+0000","last_fullsized":"2024-09-15T23:54:43.648359+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:48.693662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648419+0000","last_change":"2024-09-15T23:54:43.639536+0000","last_active":"2024-09-15T23:54:43.648419+0000","last_peered":"2024-09-15T23:54:43.648419+0000","last_clean":"2024-09-15T23:54:43.648419+0000","last_became_active":"2024-09-15T23:54:43.636784+0000","last_became_peered":"2024-09-15T23:54:43.636784+0000","last_unstale":"2024-09-15T23:54:43.648419+0000","last_undegraded":"2024-09-15T23:54:43.648419+0000","last_fullsized":"2024-09-15T23:54:43.648419+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:44.483323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682433+0000","last_change":"2024-09-15T23:54:43.677035+0000","last_active":"2024-09-15T23:54:43.682433+0000","last_peered":"2024-09-15T23:54:43.682433+0000","last_clean":"2024-09-15T23:54:43.682433+0000","last_became_active":"2024-09-15T23:54:43.676463+0000","last_became_peered":"2024-09-15T23:54:43.676463+0000","last_unstale":"2024-09-15T23:54:43.682433+0000","last_undegraded":"2024-09-15T23:54:43.682433+0000","last_fullsized":"2024-09-15T23:54:43.682433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:37.184096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.661715+0000","last_change":"2024-09-15T23:54:43.658337+0000","last_active":"2024-09-15T23:54:43.661715+0000","last_peered":"2024-09-15T23:54:43.661715+0000","last_clean":"2024-09-15T23:54:43.661715+0000","last_became_active":"2024-09-15T23:54:43.658020+0000","last_became_peered":"2024-09-15T23:54:43.658020+0000","last_unstale":"2024-09-15T23:54:43.661715+0000","last_undegraded":"2024-09-15T23:54:43.661715+0000","last_fullsized":"2024-09-15T23:54:43.661715+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:08.810523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.645276+0000","last_change":"2024-09-15T23:54:43.640668+0000","last_active":"2024-09-15T23:54:43.645276+0000","last_peered":"2024-09-15T23:54:43.645276+0000","last_clean":"2024-09-15T23:54:43.645276+0000","last_became_active":"2024-09-15T23:54:43.640362+0000","last_became_peered":"2024-09-15T23:54:43.640362+0000","last_unstale":"2024-09-15T23:54:43.645276+0000","last_undegraded":"2024-09-15T23:54:43.645276+0000","last_fullsized":"2024-09-15T23:54:43.645276+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:57.007396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.672495+0000","last_change":"2024-09-15T23:54:43.669305+0000","last_active":"2024-09-15T23:54:43.672495+0000","last_peered":"2024-09-15T23:54:43.672495+0000","last_clean":"2024-09-15T23:54:43.672495+0000","last_became_active":"2024-09-15T23:54:43.669057+0000","last_became_peered":"2024-09-15T23:54:43.669057+0000","last_unstale":"2024-09-15T23:54:43.672495+0000","last_undegraded":"2024-09-15T23:54:43.672495+0000","last_fullsized":"2024-09-15T23:54:43.672495+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:10.708992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678697+0000","last_change":"2024-09-15T23:54:43.678254+0000","last_active":"2024-09-15T23:54:43.678697+0000","last_peered":"2024-09-15T23:54:43.678697+0000","last_clean":"2024-09-15T23:54:43.678697+0000","last_became_active":"2024-09-15T23:54:43.678013+0000","last_became_peered":"2024-09-15T23:54:43.678013+0000","last_unstale":"2024-09-15T23:54:43.678697+0000","last_undegraded":"2024-09-15T23:54:43.678697+0000","last_fullsized":"2024-09-15T23:54:43.678697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:13.211799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642716+0000","last_change":"2024-09-15T23:54:43.631179+0000","last_active":"2024-09-15T23:54:43.642716+0000","last_peered":"2024-09-15T23:54:43.642716+0000","last_clean":"2024-09-15T23:54:43.642716+0000","last_became_active":"2024-09-15T23:54:43.630496+0000","last_became_peered":"2024-09-15T23:54:43.630496+0000","last_unstale":"2024-09-15T23:54:43.642716+0000","last_undegraded":"2024-09-15T23:54:43.642716+0000","last_fullsized":"2024-09-15T23:54:43.642716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:38:00.554695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.643873+0000","last_change":"2024-09-15T23:54:43.628988+0000","last_active":"2024-09-15T23:54:43.643873+0000","last_peered":"2024-09-15T23:54:43.643873+0000","last_clean":"2024-09-15T23:54:43.643873+0000","last_became_active":"2024-09-15T23:54:43.628667+0000","last_became_peered":"2024-09-15T23:54:43.628667+0000","last_unstale":"2024-09-15T23:54:43.643873+0000","last_undegraded":"2024-09-15T23:54:43.643873+0000","last_fullsized":"2024-09-15T23:54:43.643873+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:22.709716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:54:42.570937+0000","last_change":"2024-09-15T23:54:42.570937+0000","last_active":"2024-09-15T23:54:42.570937+0000","last_peered":"2024-09-15T23:54:42.570937+0000","last_clean":"2024-09-15T23:54:42.570937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:42.570937+0000","last_undegraded":"2024-09-15T23:54:42.570937+0000","last_fullsized":"2024-09-15T23:54:42.570937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648372+0000","last_change":"2024-09-15T23:54:43.640856+0000","last_active":"2024-09-15T23:54:43.648372+0000","last_peered":"2024-09-15T23:54:43.648372+0000","last_clean":"2024-09-15T23:54:43.648372+0000","last_became_active":"2024-09-15T23:54:43.640593+0000","last_became_peered":"2024-09-15T23:54:43.640593+0000","last_unstale":"2024-09-15T23:54:43.648372+0000","last_undegraded":"2024-09-15T23:54:43.648372+0000","last_fullsized":"2024-09-15T23:54:43.648372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.809746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.681429+0000","last_change":"2024-09-15T23:54:43.680914+0000","last_active":"2024-09-15T23:54:43.681429+0000","last_peered":"2024-09-15T23:54:43.681429+0000","last_clean":"2024-09-15T23:54:43.681429+0000","last_became_active":"2024-09-15T23:54:43.680603+0000","last_became_peered":"2024-09-15T23:54:43.680603+0000","last_unstale":"2024-09-15T23:54:43.681429+0000","last_undegraded":"2024-09-15T23:54:43.681429+0000","last_fullsized":"2024-09-15T23:54:43.681429+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:05.527477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676646+0000","last_change":"2024-09-15T23:54:43.668953+0000","last_active":"2024-09-15T23:54:43.676646+0000","last_peered":"2024-09-15T23:54:43.676646+0000","last_clean":"2024-09-15T23:54:43.676646+0000","last_became_active":"2024-09-15T23:54:43.668662+0000","last_became_peered":"2024-09-15T23:54:43.668662+0000","last_unstale":"2024-09-15T23:54:43.676646+0000","last_undegraded":"2024-09-15T23:54:43.676646+0000","last_fullsized":"2024-09-15T23:54:43.676646+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:00.991165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648608+0000","last_change":"2024-09-15T23:54:43.647006+0000","last_active":"2024-09-15T23:54:43.648608+0000","last_peered":"2024-09-15T23:54:43.648608+0000","last_clean":"2024-09-15T23:54:43.648608+0000","last_became_active":"2024-09-15T23:54:43.646809+0000","last_became_peered":"2024-09-15T23:54:43.646809+0000","last_unstale":"2024-09-15T23:54:43.648608+0000","last_undegraded":"2024-09-15T23:54:43.648608+0000","last_fullsized":"2024-09-15T23:54:43.648608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:29.699749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684440+0000","last_change":"2024-09-15T23:54:43.665724+0000","last_active":"2024-09-15T23:54:43.684440+0000","last_peered":"2024-09-15T23:54:43.684440+0000","last_clean":"2024-09-15T23:54:43.684440+0000","last_became_active":"2024-09-15T23:54:43.665067+0000","last_became_peered":"2024-09-15T23:54:43.665067+0000","last_unstale":"2024-09-15T23:54:43.684440+0000","last_undegraded":"2024-09-15T23:54:43.684440+0000","last_fullsized":"2024-09-15T23:54:43.684440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:02:27.335899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676603+0000","last_change":"2024-09-15T23:54:43.668148+0000","last_active":"2024-09-15T23:54:43.676603+0000","last_peered":"2024-09-15T23:54:43.676603+0000","last_clean":"2024-09-15T23:54:43.676603+0000","last_became_active":"2024-09-15T23:54:43.667833+0000","last_became_peered":"2024-09-15T23:54:43.667833+0000","last_unstale":"2024-09-15T23:54:43.676603+0000","last_undegraded":"2024-09-15T23:54:43.676603+0000","last_fullsized":"2024-09-15T23:54:43.676603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:32.953360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684477+0000","last_change":"2024-09-15T23:54:43.671918+0000","last_active":"2024-09-15T23:54:43.684477+0000","last_peered":"2024-09-15T23:54:43.684477+0000","last_clean":"2024-09-15T23:54:43.684477+0000","last_became_active":"2024-09-15T23:54:43.666846+0000","last_became_peered":"2024-09-15T23:54:43.666846+0000","last_unstale":"2024-09-15T23:54:43.684477+0000","last_undegraded":"2024-09-15T23:54:43.684477+0000","last_fullsized":"2024-09-15T23:54:43.684477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:21.949038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.656728+0000","last_change":"2024-09-15T23:54:43.651577+0000","last_active":"2024-09-15T23:54:43.656728+0000","last_peered":"2024-09-15T23:54:43.656728+0000","last_clean":"2024-09-15T23:54:43.656728+0000","last_became_active":"2024-09-15T23:54:43.651254+0000","last_became_peered":"2024-09-15T23:54:43.651254+0000","last_unstale":"2024-09-15T23:54:43.656728+0000","last_undegraded":"2024-09-15T23:54:43.656728+0000","last_fullsized":"2024-09-15T23:54:43.656728+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:26.589213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677107+0000","last_change":"2024-09-15T23:54:43.672947+0000","last_active":"2024-09-15T23:54:43.677107+0000","last_peered":"2024-09-15T23:54:43.677107+0000","last_clean":"2024-09-15T23:54:43.677107+0000","last_became_active":"2024-09-15T23:54:43.672703+0000","last_became_peered":"2024-09-15T23:54:43.672703+0000","last_unstale":"2024-09-15T23:54:43.677107+0000","last_undegraded":"2024-09-15T23:54:43.677107+0000","last_fullsized":"2024-09-15T23:54:43.677107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:25.006535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.658793+0000","last_change":"2024-09-15T23:54:43.652965+0000","last_active":"2024-09-15T23:54:43.658793+0000","last_peered":"2024-09-15T23:54:43.658793+0000","last_clean":"2024-09-15T23:54:43.658793+0000","last_became_active":"2024-09-15T23:54:43.652697+0000","last_became_peered":"2024-09-15T23:54:43.652697+0000","last_unstale":"2024-09-15T23:54:43.658793+0000","last_undegraded":"2024-09-15T23:54:43.658793+0000","last_fullsized":"2024-09-15T23:54:43.658793+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:25.903632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648610+0000","last_change":"2024-09-15T23:54:43.646314+0000","last_active":"2024-09-15T23:54:43.648610+0000","last_peered":"2024-09-15T23:54:43.648610+0000","last_clean":"2024-09-15T23:54:43.648610+0000","last_became_active":"2024-09-15T23:54:43.646050+0000","last_became_peered":"2024-09-15T23:54:43.646050+0000","last_unstale":"2024-09-15T23:54:43.648610+0000","last_undegraded":"2024-09-15T23:54:43.648610+0000","last_fullsized":"2024-09-15T23:54:43.648610+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.127820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677124+0000","last_change":"2024-09-15T23:54:43.674939+0000","last_active":"2024-09-15T23:54:43.677124+0000","last_peered":"2024-09-15T23:54:43.677124+0000","last_clean":"2024-09-15T23:54:43.677124+0000","last_became_active":"2024-09-15T23:54:43.674692+0000","last_became_peered":"2024-09-15T23:54:43.674692+0000","last_unstale":"2024-09-15T23:54:43.677124+0000","last_undegraded":"2024-09-15T23:54:43.677124+0000","last_fullsized":"2024-09-15T23:54:43.677124+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:55.655404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677205+0000","last_change":"2024-09-15T23:54:43.657536+0000","last_active":"2024-09-15T23:54:43.677205+0000","last_peered":"2024-09-15T23:54:43.677205+0000","last_clean":"2024-09-15T23:54:43.677205+0000","last_became_active":"2024-09-15T23:54:43.650847+0000","last_became_peered":"2024-09-15T23:54:43.650847+0000","last_unstale":"2024-09-15T23:54:43.677205+0000","last_undegraded":"2024-09-15T23:54:43.677205+0000","last_fullsized":"2024-09-15T23:54:43.677205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:00.991165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642992+0000","last_change":"2024-09-15T23:54:43.635951+0000","last_active":"2024-09-15T23:54:43.642992+0000","last_peered":"2024-09-15T23:54:43.642992+0000","last_clean":"2024-09-15T23:54:43.642992+0000","last_became_active":"2024-09-15T23:54:43.635781+0000","last_became_peered":"2024-09-15T23:54:43.635781+0000","last_unstale":"2024-09-15T23:54:43.642992+0000","last_undegraded":"2024-09-15T23:54:43.642992+0000","last_fullsized":"2024-09-15T23:54:43.642992+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:02.199351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.660519+0000","last_change":"2024-09-15T23:54:42.603087+0000","last_active":"2024-09-15T23:54:43.660519+0000","last_peered":"2024-09-15T23:54:43.660519+0000","last_clean":"2024-09-15T23:54:43.660519+0000","last_became_active":"2024-09-15T23:54:42.602691+0000","last_became_peered":"2024-09-15T23:54:42.602691+0000","last_unstale":"2024-09-15T23:54:43.660519+0000","last_undegraded":"2024-09-15T23:54:43.660519+0000","last_fullsized":"2024-09-15T23:54:43.660519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:14.792784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675033+0000","last_change":"2024-09-15T23:54:43.643378+0000","last_active":"2024-09-15T23:54:43.675033+0000","last_peered":"2024-09-15T23:54:43.675033+0000","last_clean":"2024-09-15T23:54:43.675033+0000","last_became_active":"2024-09-15T23:54:43.642541+0000","last_became_peered":"2024-09-15T23:54:43.642541+0000","last_unstale":"2024-09-15T23:54:43.675033+0000","last_undegraded":"2024-09-15T23:54:43.675033+0000","last_fullsized":"2024-09-15T23:54:43.675033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:03.360218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678279+0000","last_change":"2024-09-15T23:54:42.603652+0000","last_active":"2024-09-15T23:54:43.678279+0000","last_peered":"2024-09-15T23:54:43.678279+0000","last_clean":"2024-09-15T23:54:43.678279+0000","last_became_active":"2024-09-15T23:54:42.603047+0000","last_became_peered":"2024-09-15T23:54:42.603047+0000","last_unstale":"2024-09-15T23:54:43.678279+0000","last_undegraded":"2024-09-15T23:54:43.678279+0000","last_fullsized":"2024-09-15T23:54:43.678279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:14.792784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.643928+0000","last_change":"2024-09-15T23:54:43.637123+0000","last_active":"2024-09-15T23:54:43.643928+0000","last_peered":"2024-09-15T23:54:43.643928+0000","last_clean":"2024-09-15T23:54:43.643928+0000","last_became_active":"2024-09-15T23:54:43.636836+0000","last_became_peered":"2024-09-15T23:54:43.636836+0000","last_unstale":"2024-09-15T23:54:43.643928+0000","last_undegraded":"2024-09-15T23:54:43.643928+0000","last_fullsized":"2024-09-15T23:54:43.643928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:38.608267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684964+0000","last_change":"2024-09-15T23:54:42.625060+0000","last_active":"2024-09-15T23:54:43.684964+0000","last_peered":"2024-09-15T23:54:43.684964+0000","last_clean":"2024-09-15T23:54:43.684964+0000","last_became_active":"2024-09-15T23:54:42.624313+0000","last_became_peered":"2024-09-15T23:54:42.624313+0000","last_unstale":"2024-09-15T23:54:43.684964+0000","last_undegraded":"2024-09-15T23:54:43.684964+0000","last_fullsized":"2024-09-15T23:54:43.684964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:38.798300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675091+0000","last_change":"2024-09-15T23:54:43.643735+0000","last_active":"2024-09-15T23:54:43.675091+0000","last_peered":"2024-09-15T23:54:43.675091+0000","last_clean":"2024-09-15T23:54:43.675091+0000","last_became_active":"2024-09-15T23:54:43.642717+0000","last_became_peered":"2024-09-15T23:54:43.642717+0000","last_unstale":"2024-09-15T23:54:43.675091+0000","last_undegraded":"2024-09-15T23:54:43.675091+0000","last_fullsized":"2024-09-15T23:54:43.675091+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:31.056987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.680652+0000","last_change":"2024-09-15T23:54:42.621654+0000","last_active":"2024-09-15T23:54:43.680652+0000","last_peered":"2024-09-15T23:54:43.680652+0000","last_clean":"2024-09-15T23:54:43.680652+0000","last_became_active":"2024-09-15T23:54:42.621285+0000","last_became_peered":"2024-09-15T23:54:42.621285+0000","last_unstale":"2024-09-15T23:54:43.680652+0000","last_undegraded":"2024-09-15T23:54:43.680652+0000","last_fullsized":"2024-09-15T23:54:43.680652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:34.417323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684558+0000","last_change":"2024-09-15T23:54:43.678051+0000","last_active":"2024-09-15T23:54:43.684558+0000","last_peered":"2024-09-15T23:54:43.684558+0000","last_clean":"2024-09-15T23:54:43.684558+0000","last_became_active":"2024-09-15T23:54:43.677319+0000","last_became_peered":"2024-09-15T23:54:43.677319+0000","last_unstale":"2024-09-15T23:54:43.684558+0000","last_undegraded":"2024-09-15T23:54:43.684558+0000","last_fullsized":"2024-09-15T23:54:43.684558+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:26.378086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.639962+0000","last_change":"2024-09-15T23:54:42.601838+0000","last_active":"2024-09-15T23:54:43.639962+0000","last_peered":"2024-09-15T23:54:43.639962+0000","last_clean":"2024-09-15T23:54:43.639962+0000","last_became_active":"2024-09-15T23:54:42.601580+0000","last_became_peered":"2024-09-15T23:54:42.601580+0000","last_unstale":"2024-09-15T23:54:43.639962+0000","last_undegraded":"2024-09-15T23:54:43.639962+0000","last_fullsized":"2024-09-15T23:54:43.639962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:16.673465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.650838+0000","last_change":"2024-09-15T23:54:43.647396+0000","last_active":"2024-09-15T23:54:43.650838+0000","last_peered":"2024-09-15T23:54:43.650838+0000","last_clean":"2024-09-15T23:54:43.650838+0000","last_became_active":"2024-09-15T23:54:43.647101+0000","last_became_peered":"2024-09-15T23:54:43.647101+0000","last_unstale":"2024-09-15T23:54:43.650838+0000","last_undegraded":"2024-09-15T23:54:43.650838+0000","last_fullsized":"2024-09-15T23:54:43.650838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:49.567963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.664488+0000","last_change":"2024-09-15T23:54:42.627071+0000","last_active":"2024-09-15T23:54:43.664488+0000","last_peered":"2024-09-15T23:54:43.664488+0000","last_clean":"2024-09-15T23:54:43.664488+0000","last_became_active":"2024-09-15T23:54:42.626584+0000","last_became_peered":"2024-09-15T23:54:42.626584+0000","last_unstale":"2024-09-15T23:54:43.664488+0000","last_undegraded":"2024-09-15T23:54:43.664488+0000","last_fullsized":"2024-09-15T23:54:43.664488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:11.254409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642808+0000","last_change":"2024-09-15T23:54:43.631269+0000","last_active":"2024-09-15T23:54:43.642808+0000","last_peered":"2024-09-15T23:54:43.642808+0000","last_clean":"2024-09-15T23:54:43.642808+0000","last_became_active":"2024-09-15T23:54:43.630993+0000","last_became_peered":"2024-09-15T23:54:43.630993+0000","last_unstale":"2024-09-15T23:54:43.642808+0000","last_undegraded":"2024-09-15T23:54:43.642808+0000","last_fullsized":"2024-09-15T23:54:43.642808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:24.435909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625586+0000","last_change":"2024-09-15T23:54:42.611939+0000","last_active":"2024-09-15T23:54:43.625586+0000","last_peered":"2024-09-15T23:54:43.625586+0000","last_clean":"2024-09-15T23:54:43.625586+0000","last_became_active":"2024-09-15T23:54:42.611180+0000","last_became_peered":"2024-09-15T23:54:42.611180+0000","last_unstale":"2024-09-15T23:54:43.625586+0000","last_undegraded":"2024-09-15T23:54:43.625586+0000","last_fullsized":"2024-09-15T23:54:43.625586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:07.254369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675683+0000","last_change":"2024-09-15T23:54:43.658082+0000","last_active":"2024-09-15T23:54:43.675683+0000","last_peered":"2024-09-15T23:54:43.675683+0000","last_clean":"2024-09-15T23:54:43.675683+0000","last_became_active":"2024-09-15T23:54:43.656463+0000","last_became_peered":"2024-09-15T23:54:43.656463+0000","last_unstale":"2024-09-15T23:54:43.675683+0000","last_undegraded":"2024-09-15T23:54:43.675683+0000","last_fullsized":"2024-09-15T23:54:43.675683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:57.007396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625925+0000","last_change":"2024-09-15T23:54:42.597005+0000","last_active":"2024-09-15T23:54:43.625925+0000","last_peered":"2024-09-15T23:54:43.625925+0000","last_clean":"2024-09-15T23:54:43.625925+0000","last_became_active":"2024-09-15T23:54:42.596627+0000","last_became_peered":"2024-09-15T23:54:42.596627+0000","last_unstale":"2024-09-15T23:54:43.625925+0000","last_undegraded":"2024-09-15T23:54:43.625925+0000","last_fullsized":"2024-09-15T23:54:43.625925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:26.732611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677039+0000","last_change":"2024-09-15T23:54:43.658368+0000","last_active":"2024-09-15T23:54:43.677039+0000","last_peered":"2024-09-15T23:54:43.677039+0000","last_clean":"2024-09-15T23:54:43.677039+0000","last_became_active":"2024-09-15T23:54:43.650724+0000","last_became_peered":"2024-09-15T23:54:43.650724+0000","last_unstale":"2024-09-15T23:54:43.677039+0000","last_undegraded":"2024-09-15T23:54:43.677039+0000","last_fullsized":"2024-09-15T23:54:43.677039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:56.166523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.635501+0000","last_change":"2024-09-15T23:54:42.624959+0000","last_active":"2024-09-15T23:54:43.635501+0000","last_peered":"2024-09-15T23:54:43.635501+0000","last_clean":"2024-09-15T23:54:43.635501+0000","last_became_active":"2024-09-15T23:54:42.624107+0000","last_became_peered":"2024-09-15T23:54:42.624107+0000","last_unstale":"2024-09-15T23:54:43.635501+0000","last_undegraded":"2024-09-15T23:54:43.635501+0000","last_fullsized":"2024-09-15T23:54:43.635501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:28.523942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.638066+0000","last_change":"2024-09-15T23:54:43.634620+0000","last_active":"2024-09-15T23:54:43.638066+0000","last_peered":"2024-09-15T23:54:43.638066+0000","last_clean":"2024-09-15T23:54:43.638066+0000","last_became_active":"2024-09-15T23:54:43.634284+0000","last_became_peered":"2024-09-15T23:54:43.634284+0000","last_unstale":"2024-09-15T23:54:43.638066+0000","last_undegraded":"2024-09-15T23:54:43.638066+0000","last_fullsized":"2024-09-15T23:54:43.638066+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:03.360218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.617515+0000","last_change":"2024-09-15T23:54:42.605069+0000","last_active":"2024-09-15T23:54:43.617515+0000","last_peered":"2024-09-15T23:54:43.617515+0000","last_clean":"2024-09-15T23:54:43.617515+0000","last_became_active":"2024-09-15T23:54:42.604503+0000","last_became_peered":"2024-09-15T23:54:42.604503+0000","last_unstale":"2024-09-15T23:54:43.617515+0000","last_undegraded":"2024-09-15T23:54:43.617515+0000","last_fullsized":"2024-09-15T23:54:43.617515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.769934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684422+0000","last_change":"2024-09-15T23:54:43.671661+0000","last_active":"2024-09-15T23:54:43.684422+0000","last_peered":"2024-09-15T23:54:43.684422+0000","last_clean":"2024-09-15T23:54:43.684422+0000","last_became_active":"2024-09-15T23:54:43.666649+0000","last_became_peered":"2024-09-15T23:54:43.666649+0000","last_unstale":"2024-09-15T23:54:43.684422+0000","last_undegraded":"2024-09-15T23:54:43.684422+0000","last_fullsized":"2024-09-15T23:54:43.684422+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:56.823302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.665839+0000","last_change":"2024-09-15T23:54:42.626955+0000","last_active":"2024-09-15T23:54:43.665839+0000","last_peered":"2024-09-15T23:54:43.665839+0000","last_clean":"2024-09-15T23:54:43.665839+0000","last_became_active":"2024-09-15T23:54:42.626378+0000","last_became_peered":"2024-09-15T23:54:42.626378+0000","last_unstale":"2024-09-15T23:54:43.665839+0000","last_undegraded":"2024-09-15T23:54:43.665839+0000","last_fullsized":"2024-09-15T23:54:43.665839+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:41.491603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.651600+0000","last_change":"2024-09-15T23:54:43.647810+0000","last_active":"2024-09-15T23:54:43.651600+0000","last_peered":"2024-09-15T23:54:43.651600+0000","last_clean":"2024-09-15T23:54:43.651600+0000","last_became_active":"2024-09-15T23:54:43.647559+0000","last_became_peered":"2024-09-15T23:54:43.647559+0000","last_unstale":"2024-09-15T23:54:43.651600+0000","last_undegraded":"2024-09-15T23:54:43.651600+0000","last_fullsized":"2024-09-15T23:54:43.651600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:37.184096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.687213+0000","last_change":"2024-09-15T23:54:42.621794+0000","last_active":"2024-09-15T23:54:43.687213+0000","last_peered":"2024-09-15T23:54:43.687213+0000","last_clean":"2024-09-15T23:54:43.687213+0000","last_became_active":"2024-09-15T23:54:42.621085+0000","last_became_peered":"2024-09-15T23:54:42.621085+0000","last_unstale":"2024-09-15T23:54:43.687213+0000","last_undegraded":"2024-09-15T23:54:43.687213+0000","last_fullsized":"2024-09-15T23:54:43.687213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:25.577766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677306+0000","last_change":"2024-09-15T23:54:43.657690+0000","last_active":"2024-09-15T23:54:43.677306+0000","last_peered":"2024-09-15T23:54:43.677306+0000","last_clean":"2024-09-15T23:54:43.677306+0000","last_became_active":"2024-09-15T23:54:43.650910+0000","last_became_peered":"2024-09-15T23:54:43.650910+0000","last_unstale":"2024-09-15T23:54:43.677306+0000","last_undegraded":"2024-09-15T23:54:43.677306+0000","last_fullsized":"2024-09-15T23:54:43.677306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:05.527477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.685074+0000","last_change":"2024-09-15T23:54:42.616261+0000","last_active":"2024-09-15T23:54:43.685074+0000","last_peered":"2024-09-15T23:54:43.685074+0000","last_clean":"2024-09-15T23:54:43.685074+0000","last_became_active":"2024-09-15T23:54:42.615529+0000","last_became_peered":"2024-09-15T23:54:42.615529+0000","last_unstale":"2024-09-15T23:54:43.685074+0000","last_undegraded":"2024-09-15T23:54:43.685074+0000","last_fullsized":"2024-09-15T23:54:43.685074+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:03.874014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682543+0000","last_change":"2024-09-15T23:54:43.669009+0000","last_active":"2024-09-15T23:54:43.682543+0000","last_peered":"2024-09-15T23:54:43.682543+0000","last_clean":"2024-09-15T23:54:43.682543+0000","last_became_active":"2024-09-15T23:54:43.667776+0000","last_became_peered":"2024-09-15T23:54:43.667776+0000","last_unstale":"2024-09-15T23:54:43.682543+0000","last_undegraded":"2024-09-15T23:54:43.682543+0000","last_fullsized":"2024-09-15T23:54:43.682543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:44.483323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.640823+0000","last_change":"2024-09-15T23:54:42.601025+0000","last_active":"2024-09-15T23:54:43.640823+0000","last_peered":"2024-09-15T23:54:43.640823+0000","last_clean":"2024-09-15T23:54:43.640823+0000","last_became_active":"2024-09-15T23:54:42.599974+0000","last_became_peered":"2024-09-15T23:54:42.599974+0000","last_unstale":"2024-09-15T23:54:43.640823+0000","last_undegraded":"2024-09-15T23:54:43.640823+0000","last_fullsized":"2024-09-15T23:54:43.640823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:34.417323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648500+0000","last_change":"2024-09-15T23:54:43.642124+0000","last_active":"2024-09-15T23:54:43.648500+0000","last_peered":"2024-09-15T23:54:43.648500+0000","last_clean":"2024-09-15T23:54:43.648500+0000","last_became_active":"2024-09-15T23:54:43.641863+0000","last_became_peered":"2024-09-15T23:54:43.641863+0000","last_unstale":"2024-09-15T23:54:43.648500+0000","last_undegraded":"2024-09-15T23:54:43.648500+0000","last_fullsized":"2024-09-15T23:54:43.648500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:29.535388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.617251+0000","last_change":"2024-09-15T23:54:42.597340+0000","last_active":"2024-09-15T23:54:43.617251+0000","last_peered":"2024-09-15T23:54:43.617251+0000","last_clean":"2024-09-15T23:54:43.617251+0000","last_became_active":"2024-09-15T23:54:42.596908+0000","last_became_peered":"2024-09-15T23:54:42.596908+0000","last_unstale":"2024-09-15T23:54:43.617251+0000","last_undegraded":"2024-09-15T23:54:43.617251+0000","last_fullsized":"2024-09-15T23:54:43.617251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:40.885229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682452+0000","last_change":"2024-09-15T23:54:43.677377+0000","last_active":"2024-09-15T23:54:43.682452+0000","last_peered":"2024-09-15T23:54:43.682452+0000","last_clean":"2024-09-15T23:54:43.682452+0000","last_became_active":"2024-09-15T23:54:43.676667+0000","last_became_peered":"2024-09-15T23:54:43.676667+0000","last_unstale":"2024-09-15T23:54:43.682452+0000","last_undegraded":"2024-09-15T23:54:43.682452+0000","last_fullsized":"2024-09-15T23:54:43.682452+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:08.810523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642008+0000","last_change":"2024-09-15T23:54:42.591210+0000","last_active":"2024-09-15T23:54:43.642008+0000","last_peered":"2024-09-15T23:54:43.642008+0000","last_clean":"2024-09-15T23:54:43.642008+0000","last_became_active":"2024-09-15T23:54:42.590512+0000","last_became_peered":"2024-09-15T23:54:42.590512+0000","last_unstale":"2024-09-15T23:54:43.642008+0000","last_undegraded":"2024-09-15T23:54:43.642008+0000","last_fullsized":"2024-09-15T23:54:43.642008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:30.045540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678242+0000","last_change":"2024-09-15T23:54:43.667252+0000","last_active":"2024-09-15T23:54:43.678242+0000","last_peered":"2024-09-15T23:54:43.678242+0000","last_clean":"2024-09-15T23:54:43.678242+0000","last_became_active":"2024-09-15T23:54:43.659011+0000","last_became_peered":"2024-09-15T23:54:43.659011+0000","last_unstale":"2024-09-15T23:54:43.678242+0000","last_undegraded":"2024-09-15T23:54:43.678242+0000","last_fullsized":"2024-09-15T23:54:43.678242+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:04.885460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.640799+0000","last_change":"2024-09-15T23:54:42.602026+0000","last_active":"2024-09-15T23:54:43.640799+0000","last_peered":"2024-09-15T23:54:43.640799+0000","last_clean":"2024-09-15T23:54:43.640799+0000","last_became_active":"2024-09-15T23:54:42.601654+0000","last_became_peered":"2024-09-15T23:54:42.601654+0000","last_unstale":"2024-09-15T23:54:43.640799+0000","last_undegraded":"2024-09-15T23:54:43.640799+0000","last_fullsized":"2024-09-15T23:54:43.640799+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:36.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.671218+0000","last_change":"2024-09-15T23:54:43.665585+0000","last_active":"2024-09-15T23:54:43.671218+0000","last_peered":"2024-09-15T23:54:43.671218+0000","last_clean":"2024-09-15T23:54:43.671218+0000","last_became_active":"2024-09-15T23:54:43.665240+0000","last_became_peered":"2024-09-15T23:54:43.665240+0000","last_unstale":"2024-09-15T23:54:43.671218+0000","last_undegraded":"2024-09-15T23:54:43.671218+0000","last_fullsized":"2024-09-15T23:54:43.671218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:40.585681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.666572+0000","last_change":"2024-09-15T23:54:42.627305+0000","last_active":"2024-09-15T23:54:43.666572+0000","last_peered":"2024-09-15T23:54:43.666572+0000","last_clean":"2024-09-15T23:54:43.666572+0000","last_became_active":"2024-09-15T23:54:42.627061+0000","last_became_peered":"2024-09-15T23:54:42.627061+0000","last_unstale":"2024-09-15T23:54:43.666572+0000","last_undegraded":"2024-09-15T23:54:43.666572+0000","last_fullsized":"2024-09-15T23:54:43.666572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:47.285819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676607+0000","last_change":"2024-09-15T23:54:43.668779+0000","last_active":"2024-09-15T23:54:43.676607+0000","last_peered":"2024-09-15T23:54:43.676607+0000","last_clean":"2024-09-15T23:54:43.676607+0000","last_became_active":"2024-09-15T23:54:43.668438+0000","last_became_peered":"2024-09-15T23:54:43.668438+0000","last_unstale":"2024-09-15T23:54:43.676607+0000","last_undegraded":"2024-09-15T23:54:43.676607+0000","last_fullsized":"2024-09-15T23:54:43.676607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:46.999984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.650161+0000","last_change":"2024-09-15T23:54:42.607764+0000","last_active":"2024-09-15T23:54:43.650161+0000","last_peered":"2024-09-15T23:54:43.650161+0000","last_clean":"2024-09-15T23:54:43.650161+0000","last_became_active":"2024-09-15T23:54:42.607054+0000","last_became_peered":"2024-09-15T23:54:42.607054+0000","last_unstale":"2024-09-15T23:54:43.650161+0000","last_undegraded":"2024-09-15T23:54:43.650161+0000","last_fullsized":"2024-09-15T23:54:43.650161+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:11.254409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:54:42.570937+0000","last_change":"2024-09-15T23:54:42.570937+0000","last_active":"2024-09-15T23:54:42.570937+0000","last_peered":"2024-09-15T23:54:42.570937+0000","last_clean":"2024-09-15T23:54:42.570937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:42.570937+0000","last_undegraded":"2024-09-15T23:54:42.570937+0000","last_fullsized":"2024-09-15T23:54:42.570937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T23:54:41.585064+0000","last_change":"2024-09-15T23:54:41.585064+0000","last_active":"2024-09-15T23:54:41.559490+0000","last_peered":"2024-09-15T23:54:41.559490+0000","last_clean":"2024-09-15T23:54:41.559490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:41.585064+0000","last_undegraded":"2024-09-15T23:54:41.585064+0000","last_fullsized":"2024-09-15T23:54:41.585064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648485+0000","last_change":"2024-09-15T23:54:43.643428+0000","last_active":"2024-09-15T23:54:43.648485+0000","last_peered":"2024-09-15T23:54:43.648485+0000","last_clean":"2024-09-15T23:54:43.648485+0000","last_became_active":"2024-09-15T23:54:43.643158+0000","last_became_peered":"2024-09-15T23:54:43.643158+0000","last_unstale":"2024-09-15T23:54:43.648485+0000","last_undegraded":"2024-09-15T23:54:43.648485+0000","last_fullsized":"2024-09-15T23:54:43.648485+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:02.150007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T23:54:41.584264+0000","last_change":"2024-09-15T23:54:41.584264+0000","last_active":"2024-09-15T23:54:41.559490+0000","last_peered":"2024-09-15T23:54:41.559490+0000","last_clean":"2024-09-15T23:54:41.559490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:41.584264+0000","last_undegraded":"2024-09-15T23:54:41.584264+0000","last_fullsized":"2024-09-15T23:54:41.584264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676955+0000","last_change":"2024-09-15T23:54:43.657288+0000","last_active":"2024-09-15T23:54:43.676955+0000","last_peered":"2024-09-15T23:54:43.676955+0000","last_clean":"2024-09-15T23:54:43.676955+0000","last_became_active":"2024-09-15T23:54:43.656050+0000","last_became_peered":"2024-09-15T23:54:43.656050+0000","last_unstale":"2024-09-15T23:54:43.676955+0000","last_undegraded":"2024-09-15T23:54:43.676955+0000","last_fullsized":"2024-09-15T23:54:43.676955+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:02.241689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625925+0000","last_change":"2024-09-15T23:54:42.598953+0000","last_active":"2024-09-15T23:54:43.625925+0000","last_peered":"2024-09-15T23:54:43.625925+0000","last_clean":"2024-09-15T23:54:43.625925+0000","last_became_active":"2024-09-15T23:54:42.597704+0000","last_became_peered":"2024-09-15T23:54:42.597704+0000","last_unstale":"2024-09-15T23:54:43.625925+0000","last_undegraded":"2024-09-15T23:54:43.625925+0000","last_fullsized":"2024-09-15T23:54:43.625925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:16.673465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.645191+0000","last_change":"2024-09-15T23:54:43.636074+0000","last_active":"2024-09-15T23:54:43.645191+0000","last_peered":"2024-09-15T23:54:43.645191+0000","last_clean":"2024-09-15T23:54:43.645191+0000","last_became_active":"2024-09-15T23:54:43.635810+0000","last_became_peered":"2024-09-15T23:54:43.635810+0000","last_unstale":"2024-09-15T23:54:43.645191+0000","last_undegraded":"2024-09-15T23:54:43.645191+0000","last_fullsized":"2024-09-15T23:54:43.645191+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:08.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625947+0000","last_change":"2024-09-15T23:54:42.596955+0000","last_active":"2024-09-15T23:54:43.625947+0000","last_peered":"2024-09-15T23:54:43.625947+0000","last_clean":"2024-09-15T23:54:43.625947+0000","last_became_active":"2024-09-15T23:54:42.596647+0000","last_became_peered":"2024-09-15T23:54:42.596647+0000","last_unstale":"2024-09-15T23:54:43.625947+0000","last_undegraded":"2024-09-15T23:54:43.625947+0000","last_fullsized":"2024-09-15T23:54:43.625947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:36.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677202+0000","last_change":"2024-09-15T23:54:43.659071+0000","last_active":"2024-09-15T23:54:43.677202+0000","last_peered":"2024-09-15T23:54:43.677202+0000","last_clean":"2024-09-15T23:54:43.677202+0000","last_became_active":"2024-09-15T23:54:43.656622+0000","last_became_peered":"2024-09-15T23:54:43.656622+0000","last_unstale":"2024-09-15T23:54:43.677202+0000","last_undegraded":"2024-09-15T23:54:43.677202+0000","last_fullsized":"2024-09-15T23:54:43.677202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:50.700577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625588+0000","last_change":"2024-09-15T23:54:42.628542+0000","last_active":"2024-09-15T23:54:43.625588+0000","last_peered":"2024-09-15T23:54:43.625588+0000","last_clean":"2024-09-15T23:54:43.625588+0000","last_became_active":"2024-09-15T23:54:42.627924+0000","last_became_peered":"2024-09-15T23:54:42.627924+0000","last_unstale":"2024-09-15T23:54:43.625588+0000","last_undegraded":"2024-09-15T23:54:43.625588+0000","last_fullsized":"2024-09-15T23:54:43.625588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:15.134895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648042+0000","last_change":"2024-09-15T23:54:43.643031+0000","last_active":"2024-09-15T23:54:43.648042+0000","last_peered":"2024-09-15T23:54:43.648042+0000","last_clean":"2024-09-15T23:54:43.648042+0000","last_became_active":"2024-09-15T23:54:43.642329+0000","last_became_peered":"2024-09-15T23:54:43.642329+0000","last_unstale":"2024-09-15T23:54:43.648042+0000","last_undegraded":"2024-09-15T23:54:43.648042+0000","last_fullsized":"2024-09-15T23:54:43.648042+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:37.970228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.647722+0000","last_change":"2024-09-15T23:54:42.603521+0000","last_active":"2024-09-15T23:54:43.647722+0000","last_peered":"2024-09-15T23:54:43.647722+0000","last_clean":"2024-09-15T23:54:43.647722+0000","last_became_active":"2024-09-15T23:54:42.602670+0000","last_became_peered":"2024-09-15T23:54:42.602670+0000","last_unstale":"2024-09-15T23:54:43.647722+0000","last_undegraded":"2024-09-15T23:54:43.647722+0000","last_fullsized":"2024-09-15T23:54:43.647722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.132376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.645389+0000","last_change":"2024-09-15T23:54:43.637124+0000","last_active":"2024-09-15T23:54:43.645389+0000","last_peered":"2024-09-15T23:54:43.645389+0000","last_clean":"2024-09-15T23:54:43.645389+0000","last_became_active":"2024-09-15T23:54:43.636448+0000","last_became_peered":"2024-09-15T23:54:43.636448+0000","last_unstale":"2024-09-15T23:54:43.645389+0000","last_undegraded":"2024-09-15T23:54:43.645389+0000","last_fullsized":"2024-09-15T23:54:43.645389+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:04.885460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.633484+0000","last_change":"2024-09-15T23:54:42.611389+0000","last_active":"2024-09-15T23:54:43.633484+0000","last_peered":"2024-09-15T23:54:43.633484+0000","last_clean":"2024-09-15T23:54:43.633484+0000","last_became_active":"2024-09-15T23:54:42.610734+0000","last_became_peered":"2024-09-15T23:54:42.610734+0000","last_unstale":"2024-09-15T23:54:43.633484+0000","last_undegraded":"2024-09-15T23:54:43.633484+0000","last_fullsized":"2024-09-15T23:54:43.633484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:36.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:54:42.570937+0000","last_change":"2024-09-15T23:54:42.570937+0000","last_active":"2024-09-15T23:54:42.570937+0000","last_peered":"2024-09-15T23:54:42.570937+0000","last_clean":"2024-09-15T23:54:42.570937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:42.570937+0000","last_undegraded":"2024-09-15T23:54:42.570937+0000","last_fullsized":"2024-09-15T23:54:42.570937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.633517+0000","last_change":"2024-09-15T23:54:42.629795+0000","last_active":"2024-09-15T23:54:43.633517+0000","last_peered":"2024-09-15T23:54:43.633517+0000","last_clean":"2024-09-15T23:54:43.633517+0000","last_became_active":"2024-09-15T23:54:42.628974+0000","last_became_peered":"2024-09-15T23:54:42.628974+0000","last_unstale":"2024-09-15T23:54:43.633517+0000","last_undegraded":"2024-09-15T23:54:43.633517+0000","last_fullsized":"2024-09-15T23:54:43.633517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:26.732611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.683271+0000","last_change":"2024-09-15T23:54:43.679983+0000","last_active":"2024-09-15T23:54:43.683271+0000","last_peered":"2024-09-15T23:54:43.683271+0000","last_clean":"2024-09-15T23:54:43.683271+0000","last_became_active":"2024-09-15T23:54:43.679346+0000","last_became_peered":"2024-09-15T23:54:43.679346+0000","last_unstale":"2024-09-15T23:54:43.683271+0000","last_undegraded":"2024-09-15T23:54:43.683271+0000","last_fullsized":"2024-09-15T23:54:43.683271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:40.585681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.626104+0000","last_change":"2024-09-15T23:54:42.619643+0000","last_active":"2024-09-15T23:54:43.626104+0000","last_peered":"2024-09-15T23:54:43.626104+0000","last_clean":"2024-09-15T23:54:43.626104+0000","last_became_active":"2024-09-15T23:54:42.615833+0000","last_became_peered":"2024-09-15T23:54:42.615833+0000","last_unstale":"2024-09-15T23:54:43.626104+0000","last_undegraded":"2024-09-15T23:54:43.626104+0000","last_fullsized":"2024-09-15T23:54:43.626104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:43.471876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678205+0000","last_change":"2024-09-15T23:54:43.666718+0000","last_active":"2024-09-15T23:54:43.678205+0000","last_peered":"2024-09-15T23:54:43.678205+0000","last_clean":"2024-09-15T23:54:43.678205+0000","last_became_active":"2024-09-15T23:54:43.666042+0000","last_became_peered":"2024-09-15T23:54:43.666042+0000","last_unstale":"2024-09-15T23:54:43.678205+0000","last_undegraded":"2024-09-15T23:54:43.678205+0000","last_fullsized":"2024-09-15T23:54:43.678205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:08.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.624671+0000","last_change":"2024-09-15T23:54:42.605386+0000","last_active":"2024-09-15T23:54:43.624671+0000","last_peered":"2024-09-15T23:54:43.624671+0000","last_clean":"2024-09-15T23:54:43.624671+0000","last_became_active":"2024-09-15T23:54:42.605053+0000","last_became_peered":"2024-09-15T23:54:42.605053+0000","last_unstale":"2024-09-15T23:54:43.624671+0000","last_undegraded":"2024-09-15T23:54:43.624671+0000","last_fullsized":"2024-09-15T23:54:43.624671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:31.941914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.664273+0000","last_change":"2024-09-15T23:54:43.659325+0000","last_active":"2024-09-15T23:54:43.664273+0000","last_peered":"2024-09-15T23:54:43.664273+0000","last_clean":"2024-09-15T23:54:43.664273+0000","last_became_active":"2024-09-15T23:54:43.658989+0000","last_became_peered":"2024-09-15T23:54:43.658989+0000","last_unstale":"2024-09-15T23:54:43.664273+0000","last_undegraded":"2024-09-15T23:54:43.664273+0000","last_fullsized":"2024-09-15T23:54:43.664273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:59.753339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.617582+0000","last_change":"2024-09-15T23:54:42.602928+0000","last_active":"2024-09-15T23:54:43.617582+0000","last_peered":"2024-09-15T23:54:43.617582+0000","last_clean":"2024-09-15T23:54:43.617582+0000","last_became_active":"2024-09-15T23:54:42.602534+0000","last_became_peered":"2024-09-15T23:54:42.602534+0000","last_unstale":"2024-09-15T23:54:43.617582+0000","last_undegraded":"2024-09-15T23:54:43.617582+0000","last_fullsized":"2024-09-15T23:54:43.617582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:51.351267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.656757+0000","last_change":"2024-09-15T23:54:43.652409+0000","last_active":"2024-09-15T23:54:43.656757+0000","last_peered":"2024-09-15T23:54:43.656757+0000","last_clean":"2024-09-15T23:54:43.656757+0000","last_became_active":"2024-09-15T23:54:43.652155+0000","last_became_peered":"2024-09-15T23:54:43.652155+0000","last_unstale":"2024-09-15T23:54:43.656757+0000","last_undegraded":"2024-09-15T23:54:43.656757+0000","last_fullsized":"2024-09-15T23:54:43.656757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:02.241689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.636039+0000","last_change":"2024-09-15T23:54:42.621609+0000","last_active":"2024-09-15T23:54:43.636039+0000","last_peered":"2024-09-15T23:54:43.636039+0000","last_clean":"2024-09-15T23:54:43.636039+0000","last_became_active":"2024-09-15T23:54:42.620946+0000","last_became_peered":"2024-09-15T23:54:42.620946+0000","last_unstale":"2024-09-15T23:54:43.636039+0000","last_undegraded":"2024-09-15T23:54:43.636039+0000","last_fullsized":"2024-09-15T23:54:43.636039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:48.556516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.651261+0000","last_change":"2024-09-15T23:54:43.648081+0000","last_active":"2024-09-15T23:54:43.651261+0000","last_peered":"2024-09-15T23:54:43.651261+0000","last_clean":"2024-09-15T23:54:43.651261+0000","last_became_active":"2024-09-15T23:54:43.647717+0000","last_became_peered":"2024-09-15T23:54:43.647717+0000","last_unstale":"2024-09-15T23:54:43.651261+0000","last_undegraded":"2024-09-15T23:54:43.651261+0000","last_fullsized":"2024-09-15T23:54:43.651261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:44.258165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.624280+0000","last_change":"2024-09-15T23:54:42.604211+0000","last_active":"2024-09-15T23:54:43.624280+0000","last_peered":"2024-09-15T23:54:43.624280+0000","last_clean":"2024-09-15T23:54:43.624280+0000","last_became_active":"2024-09-15T23:54:42.603770+0000","last_became_peered":"2024-09-15T23:54:42.603770+0000","last_unstale":"2024-09-15T23:54:43.624280+0000","last_undegraded":"2024-09-15T23:54:43.624280+0000","last_fullsized":"2024-09-15T23:54:43.624280+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:55.995950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625877+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:54:43.625877+0000","last_peered":"2024-09-15T23:54:43.625877+0000","last_clean":"2024-09-15T23:54:43.625877+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:54:43.625877+0000","last_undegraded":"2024-09-15T23:54:43.625877+0000","last_fullsized":"2024-09-15T23:54:43.625877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":122,"acting":122,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":181795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":190698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":446464,"data_stored":189052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":191156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1024000,"data_stored":772163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":181795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1011712,"data_stored":765496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:54:47.346 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-09-15T23:54:47.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:54:42.570937+0000', 'last_change': '2024-09-15T23:54:42.570937+0000', 'last_active': '2024-09-15T23:54:42.570937+0000', 'last_peered': '2024-09-15T23:54:42.570937+0000', 'last_clean': '2024-09-15T23:54:42.570937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:54:42.570937+0000', 'last_undegraded': '2024-09-15T23:54:42.570937+0000', 'last_fullsized': '2024-09-15T23:54:42.570937+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:54:42.570937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:54:42.570937+0000', 'last_clean_scrub_stamp': '2024-09-15T23:54:42.570937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:54:47.347 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-09-15T23:54:47.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:54:42.570937+0000', 'last_change': '2024-09-15T23:54:42.570937+0000', 'last_active': '2024-09-15T23:54:42.570937+0000', 'last_peered': '2024-09-15T23:54:42.570937+0000', 'last_clean': '2024-09-15T23:54:42.570937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:54:42.570937+0000', 'last_undegraded': '2024-09-15T23:54:42.570937+0000', 'last_fullsized': '2024-09-15T23:54:42.570937+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:54:42.570937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:54:42.570937+0000', 'last_clean_scrub_stamp': '2024-09-15T23:54:42.570937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:54:47.347 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-15T23:54:47.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:54:41.585064+0000', 'last_change': '2024-09-15T23:54:41.585064+0000', 'last_active': '2024-09-15T23:54:41.559490+0000', 'last_peered': '2024-09-15T23:54:41.559490+0000', 'last_clean': '2024-09-15T23:54:41.559490+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:54:41.585064+0000', 'last_undegraded': '2024-09-15T23:54:41.585064+0000', 'last_fullsized': '2024-09-15T23:54:41.585064+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:54:41.559490+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:54:41.559490+0000', 'last_clean_scrub_stamp': '2024-09-15T23:54:41.559490+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:54:47.347 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-15T23:54:47.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:54:41.584264+0000', 'last_change': '2024-09-15T23:54:41.584264+0000', 'last_active': '2024-09-15T23:54:41.559490+0000', 'last_peered': '2024-09-15T23:54:41.559490+0000', 'last_clean': '2024-09-15T23:54:41.559490+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:54:41.584264+0000', 'last_undegraded': '2024-09-15T23:54:41.584264+0000', 'last_fullsized': '2024-09-15T23:54:41.584264+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:54:41.559490+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:54:41.559490+0000', 'last_clean_scrub_stamp': '2024-09-15T23:54:41.559490+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:54:47.347 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-09-15T23:54:47.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:54:42.570937+0000', 'last_change': '2024-09-15T23:54:42.570937+0000', 'last_active': '2024-09-15T23:54:42.570937+0000', 'last_peered': '2024-09-15T23:54:42.570937+0000', 'last_clean': '2024-09-15T23:54:42.570937+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:54:42.570937+0000', 'last_undegraded': '2024-09-15T23:54:42.570937+0000', 'last_fullsized': '2024-09-15T23:54:42.570937+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:54:42.570937+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:54:42.570937+0000', 'last_clean_scrub_stamp': '2024-09-15T23:54:42.570937+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:54:47.348 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:54:47.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5e76c2640 1 Processor -- start 2024-09-15T23:54:47.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5e76c2640 1 -- start start 2024-09-15T23:54:47.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5e76c2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa5e0070020 0x7fa5e015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5e76c2640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5e00aede0 con 0x7fa5e015f1d0 2024-09-15T23:54:47.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5e76c2640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5e015fa10 con 0x7fa5e01520a0 2024-09-15T23:54:47.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5e76c2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa5e0152480 con 0x7fa5e0070020 2024-09-15T23:54:47.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5e5c5f640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa5e015f1d0 0x7fa5e00adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59762/0 (socket says 172.21.15.112:59762) 2024-09-15T23:54:47.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5e5c5f640 1 -- 172.21.15.112:0/3143193106 learned_addr learned my addr 172.21.15.112:0/3143193106 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:47.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5e4c5d640 1 --2- 172.21.15.112:0/3143193106 >> v2:172.21.15.169:3300/0 conn(0x7fa5e0070020 0x7fa5e015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 -- 172.21.15.112:0/3143193106 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739370073 0 0) 0x7fa5e00aede0 con 0x7fa5e015f1d0 2024-09-15T23:54:47.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 -- 172.21.15.112:0/3143193106 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5c8003530 con 0x7fa5e015f1d0 2024-09-15T23:54:47.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 -- 172.21.15.112:0/3143193106 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2086637600 0 0) 0x7fa5c8003530 con 0x7fa5e015f1d0 2024-09-15T23:54:47.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 -- 172.21.15.112:0/3143193106 >> v2:172.21.15.169:3300/0 conn(0x7fa5e0070020 msgr2=0x7fa5e015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:47.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 --2- 172.21.15.112:0/3143193106 >> v2:172.21.15.169:3300/0 conn(0x7fa5e0070020 0x7fa5e015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 -- 172.21.15.112:0/3143193106 >> v1:172.21.15.169:6789/0 conn(0x7fa5e01520a0 legacy=0x7fa5e006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 -- 172.21.15.112:0/3143193106 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e0074250 con 0x7fa5e015f1d0 2024-09-15T23:54:47.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 -- 172.21.15.112:0/3143193106 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fa5d8001680 con 0x7fa5e015f1d0 2024-09-15T23:54:47.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 -- 172.21.15.112:0/3143193106 >> v1:172.21.15.112:6789/0 conn(0x7fa5e015f1d0 legacy=0x7fa5e00adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 --2- 172.21.15.112:0/3143193106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80039c0 0x7fa5c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 --2- 172.21.15.112:0/3143193106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5c8004810 0x7fa5c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 --2- 172.21.15.112:0/3143193106 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5c80051d0 0x7fa5c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 -- 172.21.15.112:0/3143193106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c800c040 con 0x7fa5c80039c0 2024-09-15T23:54:47.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 -- 172.21.15.112:0/3143193106 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c800c1f0 con 0x7fa5c8004810 2024-09-15T23:54:47.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5dffff640 1 -- 172.21.15.112:0/3143193106 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c800c3f0 con 0x7fa5c80051d0 2024-09-15T23:54:47.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.488+0000 7fa5e545e640 1 --2- 172.21.15.112:0/3143193106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80039c0 0x7fa5c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e545e640 1 -- 172.21.15.112:0/3143193106 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5c80051d0 msgr2=0x7fa5c800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:47.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e545e640 1 --2- 172.21.15.112:0/3143193106 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5c80051d0 0x7fa5c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e545e640 1 -- 172.21.15.112:0/3143193106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5c8004810 msgr2=0x7fa5c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:47.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e545e640 1 --2- 172.21.15.112:0/3143193106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5c8004810 0x7fa5c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e545e640 1 -- 172.21.15.112:0/3143193106 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c8003530 con 0x7fa5c80039c0 2024-09-15T23:54:47.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e5c5f640 1 -- 172.21.15.112:0/3143193106 reap_dead start 2024-09-15T23:54:47.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e545e640 1 --2- 172.21.15.112:0/3143193106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80039c0 0x7fa5c8003de0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0001e70 tx=0x7fa5d001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188e221bd48a8aef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:47.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5dffff640 1 -- 172.21.15.112:0/3143193106 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0001a90 con 0x7fa5c80039c0 2024-09-15T23:54:47.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5dffff640 1 -- 172.21.15.112:0/3143193106 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d0003b80 con 0x7fa5c80039c0 2024-09-15T23:54:47.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5dffff640 1 -- 172.21.15.112:0/3143193106 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00050d0 con 0x7fa5c80039c0 2024-09-15T23:54:47.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e76c2640 1 -- 172.21.15.112:0/3143193106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80039c0 msgr2=0x7fa5c8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e76c2640 1 --2- 172.21.15.112:0/3143193106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80039c0 0x7fa5c8003de0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0001e70 tx=0x7fa5d001c730 comp rx=0 tx=0).stop 2024-09-15T23:54:47.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e76c2640 1 -- 172.21.15.112:0/3143193106 shutdown_connections 2024-09-15T23:54:47.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e76c2640 1 --2- 172.21.15.112:0/3143193106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80039c0 0x7fa5c8003de0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e76c2640 1 -- 172.21.15.112:0/3143193106 >> 172.21.15.112:0/3143193106 conn(0x7fa5e00b1f90 msgr2=0x7fa5e00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:47.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e76c2640 1 -- 172.21.15.112:0/3143193106 shutdown_connections 2024-09-15T23:54:47.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e76c2640 1 -- 172.21.15.112:0/3143193106 wait complete. 2024-09-15T23:54:47.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.492+0000 7fa5e76c2640 1 Processor -- start 2024-09-15T23:54:47.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e76c2640 1 -- start start 2024-09-15T23:54:47.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e76c2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80039c0 0x7fa5e009b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e76c2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5e009dee0 0x7fa5e014c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e76c2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5e014daf0 0x7fa5e00cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e76c2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e0073d30 con 0x7fa5c80039c0 2024-09-15T23:54:47.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e76c2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e0073a50 con 0x7fa5e014daf0 2024-09-15T23:54:47.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e76c2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e015f5e0 con 0x7fa5e009dee0 2024-09-15T23:54:47.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e545e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80039c0 0x7fa5e009b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e545e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80039c0 0x7fa5e009b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50466/0 (socket says 172.21.15.112:50466) 2024-09-15T23:54:47.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e545e640 1 -- 172.21.15.112:0/2199633157 learned_addr learned my addr 172.21.15.112:0/2199633157 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:47.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e4c5d640 1 --2- 172.21.15.112:0/2199633157 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5e009dee0 0x7fa5e014c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e5c5f640 1 --2- 172.21.15.112:0/2199633157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5e014daf0 0x7fa5e00cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e545e640 1 -- 172.21.15.112:0/2199633157 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5e009dee0 msgr2=0x7fa5e014c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e545e640 1 --2- 172.21.15.112:0/2199633157 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5e009dee0 0x7fa5e014c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e545e640 1 -- 172.21.15.112:0/2199633157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5e014daf0 msgr2=0x7fa5e00cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e545e640 1 --2- 172.21.15.112:0/2199633157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5e014daf0 0x7fa5e00cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e545e640 1 -- 172.21.15.112:0/2199633157 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e009ce40 con 0x7fa5c80039c0 2024-09-15T23:54:47.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e545e640 1 --2- 172.21.15.112:0/2199633157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80039c0 0x7fa5e009b4d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa5d001c560 tx=0x7fa5d00194d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:47.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5ddffb640 1 -- 172.21.15.112:0/2199633157 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0006d60 con 0x7fa5c80039c0 2024-09-15T23:54:47.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5ddffb640 1 -- 172.21.15.112:0/2199633157 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d00050d0 con 0x7fa5c80039c0 2024-09-15T23:54:47.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e76c2640 1 -- 172.21.15.112:0/2199633157 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e009d120 con 0x7fa5c80039c0 2024-09-15T23:54:47.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5ddffb640 1 -- 172.21.15.112:0/2199633157 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00054a0 con 0x7fa5c80039c0 2024-09-15T23:54:47.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e76c2640 1 -- 172.21.15.112:0/2199633157 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e009d6e0 con 0x7fa5c80039c0 2024-09-15T23:54:47.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e76c2640 1 -- 172.21.15.112:0/2199633157 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5e009e2c0 con 0x7fa5c80039c0 2024-09-15T23:54:47.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5ddffb640 1 -- 172.21.15.112:0/2199633157 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5d0005640 con 0x7fa5c80039c0 2024-09-15T23:54:47.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5ddffb640 1 --2- 172.21.15.112:0/2199633157 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa5cc0678c0 0x7fa5cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5ddffb640 1 -- 172.21.15.112:0/2199633157 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fa5d01204a0 con 0x7fa5c80039c0 2024-09-15T23:54:47.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.496+0000 7fa5e4c5d640 1 --2- 172.21.15.112:0/2199633157 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa5cc0678c0 0x7fa5cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.500+0000 7fa5e4c5d640 1 --2- 172.21.15.112:0/2199633157 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa5cc0678c0 0x7fa5cc069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa5e01503a0 tx=0x7fa5d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:47.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.500+0000 7fa5ddffb640 1 -- 172.21.15.112:0/2199633157 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa5d0016470 con 0x7fa5c80039c0 2024-09-15T23:54:47.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.720+0000 7fa5e76c2640 1 -- 172.21.15.112:0/2199633157 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa5e00aede0 con 0x7fa5c80039c0 2024-09-15T23:54:47.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.720+0000 7fa5ddffb640 1 -- 172.21.15.112:0/2199633157 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1764 (secure 0 0 0) 0x7fa5d00f0fc0 con 0x7fa5c80039c0 2024-09-15T23:54:47.723 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:47.723 INFO:teuthology.orchestra.run.smithi112.stdout:{"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":81,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1726444419,"num_in_osds":8,"osd_in_since":1726444408,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"unknown","count":3},{"state_name":"creating+peering","count":2}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592778,"bytes_used":230404096,"bytes_avail":772863709184,"bytes_total":773094113280,"unknown_pgs_ratio":0.030927835032343864,"inactive_pgs_ratio":0.020618556067347527,"write_bytes_sec":2524,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":15,"btime":"2024-09-15T23:54:45:647611+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4869}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-15T23:54:41.248616+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:54:47.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.720+0000 7fa5e76c2640 1 -- 172.21.15.112:0/2199633157 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa5cc0678c0 msgr2=0x7fa5cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.720+0000 7fa5e76c2640 1 --2- 172.21.15.112:0/2199633157 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa5cc0678c0 0x7fa5cc069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa5e01503a0 tx=0x7fa5d4008040 comp rx=0 tx=0).stop 2024-09-15T23:54:47.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.720+0000 7fa5e76c2640 1 -- 172.21.15.112:0/2199633157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80039c0 msgr2=0x7fa5e009b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.720+0000 7fa5e76c2640 1 --2- 172.21.15.112:0/2199633157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80039c0 0x7fa5e009b4d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa5d001c560 tx=0x7fa5d00194d0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.720+0000 7fa5e76c2640 1 -- 172.21.15.112:0/2199633157 shutdown_connections 2024-09-15T23:54:47.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.720+0000 7fa5e76c2640 1 --2- 172.21.15.112:0/2199633157 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa5cc0678c0 0x7fa5cc069d80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.720+0000 7fa5e76c2640 1 --2- 172.21.15.112:0/2199633157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5e014daf0 0x7fa5e00cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.720+0000 7fa5e76c2640 1 --2- 172.21.15.112:0/2199633157 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5e009dee0 0x7fa5e014c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.720+0000 7fa5e76c2640 1 --2- 172.21.15.112:0/2199633157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c80039c0 0x7fa5e009b4d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.720+0000 7fa5e76c2640 1 -- 172.21.15.112:0/2199633157 >> 172.21.15.112:0/2199633157 conn(0x7fa5e00b1f90 msgr2=0x7fa5e006f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:47.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.720+0000 7fa5e76c2640 1 -- 172.21.15.112:0/2199633157 shutdown_connections 2024-09-15T23:54:47.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.720+0000 7fa5e76c2640 1 -- 172.21.15.112:0/2199633157 wait complete. 2024-09-15T23:54:47.741 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:54:47.741 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:54:47.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.840+0000 7f4d217a0640 1 Processor -- start 2024-09-15T23:54:47.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.840+0000 7f4d217a0640 1 -- start start 2024-09-15T23:54:47.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d1c15bec0 0x7f4d1c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4d1c15c2a0 0x7f4d1c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4d1c0af2a0 0x7f4d1c15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4d1c0b3290 con 0x7f4d1c15c2a0 2024-09-15T23:54:47.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f4d1c0b3570 con 0x7f4d1c0af2a0 2024-09-15T23:54:47.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4d1c0b3850 con 0x7f4d1c15bec0 2024-09-15T23:54:47.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d1a7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4d1c15c2a0 0x7f4d1c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d1a7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4d1c15c2a0 0x7f4d1c0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50482/0 (socket says 172.21.15.112:50482) 2024-09-15T23:54:47.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d1a7fc640 1 -- 172.21.15.112:0/4208065517 learned_addr learned my addr 172.21.15.112:0/4208065517 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:47.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d1b7fe640 1 --2- 172.21.15.112:0/4208065517 >> v2:172.21.15.169:3300/0 conn(0x7f4d1c0af2a0 0x7f4d1c15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d1a7fc640 1 -- 172.21.15.112:0/4208065517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d1c15bec0 msgr2=0x7f4d1c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:47.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d1affd640 1 --2- 172.21.15.112:0/4208065517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d1c15bec0 0x7f4d1c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d1a7fc640 1 --2- 172.21.15.112:0/4208065517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d1c15bec0 0x7f4d1c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d1a7fc640 1 -- 172.21.15.112:0/4208065517 >> v2:172.21.15.169:3300/0 conn(0x7f4d1c0af2a0 msgr2=0x7f4d1c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:47.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d1a7fc640 1 --2- 172.21.15.112:0/4208065517 >> v2:172.21.15.169:3300/0 conn(0x7f4d1c0af2a0 0x7f4d1c15fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d1a7fc640 1 -- 172.21.15.112:0/4208065517 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c0b3b30 con 0x7f4d1c15c2a0 2024-09-15T23:54:47.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d1b7fe640 1 --2- 172.21.15.112:0/4208065517 >> v2:172.21.15.169:3300/0 conn(0x7f4d1c0af2a0 0x7f4d1c15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:47.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d1a7fc640 1 --2- 172.21.15.112:0/4208065517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c15c2a0 0x7f4d1c0aed60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0ada40 tx=0x7f4d0401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e5572d57e9e50e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:47.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d19ffb640 1 -- 172.21.15.112:0/4208065517 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d040b0070 con 0x7f4d1c15c2a0 2024-09-15T23:54:47.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d19ffb640 1 -- 172.21.15.112:0/4208065517 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d040ab600 con 0x7f4d1c15c2a0 2024-09-15T23:54:47.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d19ffb640 1 -- 172.21.15.112:0/4208065517 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d040ab9d0 con 0x7f4d1c15c2a0 2024-09-15T23:54:47.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 -- 172.21.15.112:0/4208065517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c15c2a0 msgr2=0x7f4d1c0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 --2- 172.21.15.112:0/4208065517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c15c2a0 0x7f4d1c0aed60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0ada40 tx=0x7f4d0401c230 comp rx=0 tx=0).stop 2024-09-15T23:54:47.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 -- 172.21.15.112:0/4208065517 shutdown_connections 2024-09-15T23:54:47.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 --2- 172.21.15.112:0/4208065517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c15c2a0 0x7f4d1c0aed60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 --2- 172.21.15.112:0/4208065517 >> v2:172.21.15.169:3300/0 conn(0x7f4d1c0af2a0 0x7f4d1c15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 --2- 172.21.15.112:0/4208065517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d1c15bec0 0x7f4d1c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 -- 172.21.15.112:0/4208065517 >> 172.21.15.112:0/4208065517 conn(0x7f4d1c0b1f90 msgr2=0x7f4d1c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:47.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 -- 172.21.15.112:0/4208065517 shutdown_connections 2024-09-15T23:54:47.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.844+0000 7f4d217a0640 1 -- 172.21.15.112:0/4208065517 wait complete. 2024-09-15T23:54:47.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d217a0640 1 Processor -- start 2024-09-15T23:54:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d217a0640 1 -- start start 2024-09-15T23:54:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d217a0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d1c0af2a0 0x7f4d1c152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d217a0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c15bec0 0x7f4d1c15a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d217a0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d1c15c2a0 0x7f4d1c155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d217a0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c0af6b0 con 0x7f4d1c15bec0 2024-09-15T23:54:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d217a0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c0ad740 con 0x7f4d1c0af2a0 2024-09-15T23:54:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d217a0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4d1c06e000 con 0x7f4d1c15c2a0 2024-09-15T23:54:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d1a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c15bec0 0x7f4d1c15a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d1a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c15bec0 0x7f4d1c15a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50498/0 (socket says 172.21.15.112:50498) 2024-09-15T23:54:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d1a7fc640 1 -- 172.21.15.112:0/1028506228 learned_addr learned my addr 172.21.15.112:0/1028506228 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d1affd640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d1c0af2a0 0x7f4d1c152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d1b7fe640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d1c15c2a0 0x7f4d1c155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d1a7fc640 1 -- 172.21.15.112:0/1028506228 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d1c15c2a0 msgr2=0x7f4d1c155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d1a7fc640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d1c15c2a0 0x7f4d1c155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d1a7fc640 1 -- 172.21.15.112:0/1028506228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d1c0af2a0 msgr2=0x7f4d1c152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:47.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d1a7fc640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d1c0af2a0 0x7f4d1c152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:47.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d1a7fc640 1 -- 172.21.15.112:0/1028506228 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c15e770 con 0x7f4d1c15bec0 2024-09-15T23:54:47.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d1affd640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d1c0af2a0 0x7f4d1c152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:47.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d1a7fc640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c15bec0 0x7f4d1c15a190 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4d040ae040 tx=0x7f4d04018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:47.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d137fe640 1 -- 172.21.15.112:0/1028506228 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d040b0050 con 0x7f4d1c15bec0 2024-09-15T23:54:47.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d137fe640 1 -- 172.21.15.112:0/1028506228 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d040bc070 con 0x7f4d1c15bec0 2024-09-15T23:54:47.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d217a0640 1 -- 172.21.15.112:0/1028506228 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1c15ea50 con 0x7f4d1c15bec0 2024-09-15T23:54:47.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d137fe640 1 -- 172.21.15.112:0/1028506228 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d040b5a50 con 0x7f4d1c15bec0 2024-09-15T23:54:47.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d217a0640 1 -- 172.21.15.112:0/1028506228 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d1c15f010 con 0x7f4d1c15bec0 2024-09-15T23:54:47.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.848+0000 7f4d217a0640 1 -- 172.21.15.112:0/1028506228 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d1c0ad200 con 0x7f4d1c15bec0 2024-09-15T23:54:47.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.852+0000 7f4d137fe640 1 -- 172.21.15.112:0/1028506228 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4d040b5bf0 con 0x7f4d1c15bec0 2024-09-15T23:54:47.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.852+0000 7f4d137fe640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4cfc0678f0 0x7f4cfc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:47.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.852+0000 7f4d137fe640 1 -- 172.21.15.112:0/1028506228 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f4d04120690 con 0x7f4d1c15bec0 2024-09-15T23:54:47.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.852+0000 7f4d1affd640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4cfc0678f0 0x7f4cfc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:47.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.852+0000 7f4d1affd640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4cfc0678f0 0x7f4cfc069db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c007ed0 tx=0x7f4d0c007420 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:47.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.856+0000 7f4d137fe640 1 -- 172.21.15.112:0/1028506228 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4d04016110 con 0x7f4d1c15bec0 2024-09-15T23:54:48.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:47.999+0000 7f4d217a0640 1 -- 172.21.15.112:0/1028506228 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d1c06fcd0 con 0x7f4cfc0678f0 2024-09-15T23:54:48.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:48.011+0000 7f4d137fe640 1 -- 172.21.15.112:0/1028506228 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251161 (secure 0 0 0) 0x7f4d1c06fcd0 con 0x7f4cfc0678f0 2024-09-15T23:54:48.017 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:48.020 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:54:48.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:48.015+0000 7f4d217a0640 1 -- 172.21.15.112:0/1028506228 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4cfc0678f0 msgr2=0x7f4cfc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:48.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:48.015+0000 7f4d217a0640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4cfc0678f0 0x7f4cfc069db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c007ed0 tx=0x7f4d0c007420 comp rx=0 tx=0).stop 2024-09-15T23:54:48.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:48.015+0000 7f4d217a0640 1 -- 172.21.15.112:0/1028506228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c15bec0 msgr2=0x7f4d1c15a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:48.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:48.015+0000 7f4d217a0640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c15bec0 0x7f4d1c15a190 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4d040ae040 tx=0x7f4d04018fd0 comp rx=0 tx=0).stop 2024-09-15T23:54:48.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:48.015+0000 7f4d217a0640 1 -- 172.21.15.112:0/1028506228 shutdown_connections 2024-09-15T23:54:48.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:48.015+0000 7f4d217a0640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4cfc0678f0 0x7f4cfc069db0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:48.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:48.015+0000 7f4d217a0640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d1c15c2a0 0x7f4d1c155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:48.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:48.015+0000 7f4d217a0640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c15bec0 0x7f4d1c15a190 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:48.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:48.015+0000 7f4d217a0640 1 --2- 172.21.15.112:0/1028506228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d1c0af2a0 0x7f4d1c152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:48.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:48.015+0000 7f4d217a0640 1 -- 172.21.15.112:0/1028506228 >> 172.21.15.112:0/1028506228 conn(0x7f4d1c0b1f90 msgr2=0x7f4d1c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:48.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:48.015+0000 7f4d217a0640 1 -- 172.21.15.112:0/1028506228 shutdown_connections 2024-09-15T23:54:48.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:48.015+0000 7f4d217a0640 1 -- 172.21.15.112:0/1028506228 wait complete. 2024-09-15T23:54:48.034 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-15T23:54:47.250324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":188,"acting":188,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225004,"kb_used_data":4600,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749716,"statfs":{"total":773094113280,"available":772863709184,"internally_reserved":0,"allocated":4710400,"data_stored":2661187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.678298"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.679984+0000","last_change":"2024-09-15T23:54:43.666774+0000","last_active":"2024-09-15T23:54:43.679984+0000","last_peered":"2024-09-15T23:54:43.679984+0000","last_clean":"2024-09-15T23:54:43.679984+0000","last_became_active":"2024-09-15T23:54:43.665876+0000","last_became_peered":"2024-09-15T23:54:43.665876+0000","last_unstale":"2024-09-15T23:54:43.679984+0000","last_undegraded":"2024-09-15T23:54:43.679984+0000","last_fullsized":"2024-09-15T23:54:43.679984+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:32.987095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682636+0000","last_change":"2024-09-15T23:54:43.669791+0000","last_active":"2024-09-15T23:54:43.682636+0000","last_peered":"2024-09-15T23:54:43.682636+0000","last_clean":"2024-09-15T23:54:43.682636+0000","last_became_active":"2024-09-15T23:54:43.669151+0000","last_became_peered":"2024-09-15T23:54:43.669151+0000","last_unstale":"2024-09-15T23:54:43.682636+0000","last_undegraded":"2024-09-15T23:54:43.682636+0000","last_fullsized":"2024-09-15T23:54:43.682636+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.809746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.673395+0000","last_change":"2024-09-15T23:54:43.658229+0000","last_active":"2024-09-15T23:54:43.673395+0000","last_peered":"2024-09-15T23:54:43.673395+0000","last_clean":"2024-09-15T23:54:43.673395+0000","last_became_active":"2024-09-15T23:54:43.657551+0000","last_became_peered":"2024-09-15T23:54:43.657551+0000","last_unstale":"2024-09-15T23:54:43.673395+0000","last_undegraded":"2024-09-15T23:54:43.673395+0000","last_fullsized":"2024-09-15T23:54:43.673395+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:31.936628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.680196+0000","last_change":"2024-09-15T23:54:43.672536+0000","last_active":"2024-09-15T23:54:43.680196+0000","last_peered":"2024-09-15T23:54:43.680196+0000","last_clean":"2024-09-15T23:54:43.680196+0000","last_became_active":"2024-09-15T23:54:43.671956+0000","last_became_peered":"2024-09-15T23:54:43.671956+0000","last_unstale":"2024-09-15T23:54:43.680196+0000","last_undegraded":"2024-09-15T23:54:43.680196+0000","last_fullsized":"2024-09-15T23:54:43.680196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:59.226661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.655402+0000","last_change":"2024-09-15T23:54:43.651070+0000","last_active":"2024-09-15T23:54:43.655402+0000","last_peered":"2024-09-15T23:54:43.655402+0000","last_clean":"2024-09-15T23:54:43.655402+0000","last_became_active":"2024-09-15T23:54:43.650351+0000","last_became_peered":"2024-09-15T23:54:43.650351+0000","last_unstale":"2024-09-15T23:54:43.655402+0000","last_undegraded":"2024-09-15T23:54:43.655402+0000","last_fullsized":"2024-09-15T23:54:43.655402+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:48.693662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675542+0000","last_change":"2024-09-15T23:54:43.658663+0000","last_active":"2024-09-15T23:54:43.675542+0000","last_peered":"2024-09-15T23:54:43.675542+0000","last_clean":"2024-09-15T23:54:43.675542+0000","last_became_active":"2024-09-15T23:54:43.657995+0000","last_became_peered":"2024-09-15T23:54:43.657995+0000","last_unstale":"2024-09-15T23:54:43.675542+0000","last_undegraded":"2024-09-15T23:54:43.675542+0000","last_fullsized":"2024-09-15T23:54:43.675542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:32.953360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.641190+0000","last_change":"2024-09-15T23:54:43.637868+0000","last_active":"2024-09-15T23:54:43.641190+0000","last_peered":"2024-09-15T23:54:43.641190+0000","last_clean":"2024-09-15T23:54:43.641190+0000","last_became_active":"2024-09-15T23:54:43.637468+0000","last_became_peered":"2024-09-15T23:54:43.637468+0000","last_unstale":"2024-09-15T23:54:43.641190+0000","last_undegraded":"2024-09-15T23:54:43.641190+0000","last_fullsized":"2024-09-15T23:54:43.641190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:19.391528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684490+0000","last_change":"2024-09-15T23:54:43.672587+0000","last_active":"2024-09-15T23:54:43.684490+0000","last_peered":"2024-09-15T23:54:43.684490+0000","last_clean":"2024-09-15T23:54:43.684490+0000","last_became_active":"2024-09-15T23:54:43.671772+0000","last_became_peered":"2024-09-15T23:54:43.671772+0000","last_unstale":"2024-09-15T23:54:43.684490+0000","last_undegraded":"2024-09-15T23:54:43.684490+0000","last_fullsized":"2024-09-15T23:54:43.684490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:54.838047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.655363+0000","last_change":"2024-09-15T23:54:43.650837+0000","last_active":"2024-09-15T23:54:43.655363+0000","last_peered":"2024-09-15T23:54:43.655363+0000","last_clean":"2024-09-15T23:54:43.655363+0000","last_became_active":"2024-09-15T23:54:43.650113+0000","last_became_peered":"2024-09-15T23:54:43.650113+0000","last_unstale":"2024-09-15T23:54:43.655363+0000","last_undegraded":"2024-09-15T23:54:43.655363+0000","last_fullsized":"2024-09-15T23:54:43.655363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:19.391528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648359+0000","last_change":"2024-09-15T23:54:43.641037+0000","last_active":"2024-09-15T23:54:43.648359+0000","last_peered":"2024-09-15T23:54:43.648359+0000","last_clean":"2024-09-15T23:54:43.648359+0000","last_became_active":"2024-09-15T23:54:43.640738+0000","last_became_peered":"2024-09-15T23:54:43.640738+0000","last_unstale":"2024-09-15T23:54:43.648359+0000","last_undegraded":"2024-09-15T23:54:43.648359+0000","last_fullsized":"2024-09-15T23:54:43.648359+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:48.693662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648419+0000","last_change":"2024-09-15T23:54:43.639536+0000","last_active":"2024-09-15T23:54:43.648419+0000","last_peered":"2024-09-15T23:54:43.648419+0000","last_clean":"2024-09-15T23:54:43.648419+0000","last_became_active":"2024-09-15T23:54:43.636784+0000","last_became_peered":"2024-09-15T23:54:43.636784+0000","last_unstale":"2024-09-15T23:54:43.648419+0000","last_undegraded":"2024-09-15T23:54:43.648419+0000","last_fullsized":"2024-09-15T23:54:43.648419+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:44.483323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682433+0000","last_change":"2024-09-15T23:54:43.677035+0000","last_active":"2024-09-15T23:54:43.682433+0000","last_peered":"2024-09-15T23:54:43.682433+0000","last_clean":"2024-09-15T23:54:43.682433+0000","last_became_active":"2024-09-15T23:54:43.676463+0000","last_became_peered":"2024-09-15T23:54:43.676463+0000","last_unstale":"2024-09-15T23:54:43.682433+0000","last_undegraded":"2024-09-15T23:54:43.682433+0000","last_fullsized":"2024-09-15T23:54:43.682433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:37.184096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.661715+0000","last_change":"2024-09-15T23:54:43.658337+0000","last_active":"2024-09-15T23:54:43.661715+0000","last_peered":"2024-09-15T23:54:43.661715+0000","last_clean":"2024-09-15T23:54:43.661715+0000","last_became_active":"2024-09-15T23:54:43.658020+0000","last_became_peered":"2024-09-15T23:54:43.658020+0000","last_unstale":"2024-09-15T23:54:43.661715+0000","last_undegraded":"2024-09-15T23:54:43.661715+0000","last_fullsized":"2024-09-15T23:54:43.661715+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:08.810523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.645276+0000","last_change":"2024-09-15T23:54:43.640668+0000","last_active":"2024-09-15T23:54:43.645276+0000","last_peered":"2024-09-15T23:54:43.645276+0000","last_clean":"2024-09-15T23:54:43.645276+0000","last_became_active":"2024-09-15T23:54:43.640362+0000","last_became_peered":"2024-09-15T23:54:43.640362+0000","last_unstale":"2024-09-15T23:54:43.645276+0000","last_undegraded":"2024-09-15T23:54:43.645276+0000","last_fullsized":"2024-09-15T23:54:43.645276+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:57.007396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.672495+0000","last_change":"2024-09-15T23:54:43.669305+0000","last_active":"2024-09-15T23:54:43.672495+0000","last_peered":"2024-09-15T23:54:43.672495+0000","last_clean":"2024-09-15T23:54:43.672495+0000","last_became_active":"2024-09-15T23:54:43.669057+0000","last_became_peered":"2024-09-15T23:54:43.669057+0000","last_unstale":"2024-09-15T23:54:43.672495+0000","last_undegraded":"2024-09-15T23:54:43.672495+0000","last_fullsized":"2024-09-15T23:54:43.672495+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:10.708992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678697+0000","last_change":"2024-09-15T23:54:43.678254+0000","last_active":"2024-09-15T23:54:43.678697+0000","last_peered":"2024-09-15T23:54:43.678697+0000","last_clean":"2024-09-15T23:54:43.678697+0000","last_became_active":"2024-09-15T23:54:43.678013+0000","last_became_peered":"2024-09-15T23:54:43.678013+0000","last_unstale":"2024-09-15T23:54:43.678697+0000","last_undegraded":"2024-09-15T23:54:43.678697+0000","last_fullsized":"2024-09-15T23:54:43.678697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:13.211799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642716+0000","last_change":"2024-09-15T23:54:43.631179+0000","last_active":"2024-09-15T23:54:43.642716+0000","last_peered":"2024-09-15T23:54:43.642716+0000","last_clean":"2024-09-15T23:54:43.642716+0000","last_became_active":"2024-09-15T23:54:43.630496+0000","last_became_peered":"2024-09-15T23:54:43.630496+0000","last_unstale":"2024-09-15T23:54:43.642716+0000","last_undegraded":"2024-09-15T23:54:43.642716+0000","last_fullsized":"2024-09-15T23:54:43.642716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:38:00.554695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.643873+0000","last_change":"2024-09-15T23:54:43.628988+0000","last_active":"2024-09-15T23:54:43.643873+0000","last_peered":"2024-09-15T23:54:43.643873+0000","last_clean":"2024-09-15T23:54:43.643873+0000","last_became_active":"2024-09-15T23:54:43.628667+0000","last_became_peered":"2024-09-15T23:54:43.628667+0000","last_unstale":"2024-09-15T23:54:43.643873+0000","last_undegraded":"2024-09-15T23:54:43.643873+0000","last_fullsized":"2024-09-15T23:54:43.643873+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:22.709716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:54:42.570937+0000","last_change":"2024-09-15T23:54:42.570937+0000","last_active":"2024-09-15T23:54:42.570937+0000","last_peered":"2024-09-15T23:54:42.570937+0000","last_clean":"2024-09-15T23:54:42.570937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:42.570937+0000","last_undegraded":"2024-09-15T23:54:42.570937+0000","last_fullsized":"2024-09-15T23:54:42.570937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648372+0000","last_change":"2024-09-15T23:54:43.640856+0000","last_active":"2024-09-15T23:54:43.648372+0000","last_peered":"2024-09-15T23:54:43.648372+0000","last_clean":"2024-09-15T23:54:43.648372+0000","last_became_active":"2024-09-15T23:54:43.640593+0000","last_became_peered":"2024-09-15T23:54:43.640593+0000","last_unstale":"2024-09-15T23:54:43.648372+0000","last_undegraded":"2024-09-15T23:54:43.648372+0000","last_fullsized":"2024-09-15T23:54:43.648372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.809746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.681429+0000","last_change":"2024-09-15T23:54:43.680914+0000","last_active":"2024-09-15T23:54:43.681429+0000","last_peered":"2024-09-15T23:54:43.681429+0000","last_clean":"2024-09-15T23:54:43.681429+0000","last_became_active":"2024-09-15T23:54:43.680603+0000","last_became_peered":"2024-09-15T23:54:43.680603+0000","last_unstale":"2024-09-15T23:54:43.681429+0000","last_undegraded":"2024-09-15T23:54:43.681429+0000","last_fullsized":"2024-09-15T23:54:43.681429+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:05.527477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676646+0000","last_change":"2024-09-15T23:54:43.668953+0000","last_active":"2024-09-15T23:54:43.676646+0000","last_peered":"2024-09-15T23:54:43.676646+0000","last_clean":"2024-09-15T23:54:43.676646+0000","last_became_active":"2024-09-15T23:54:43.668662+0000","last_became_peered":"2024-09-15T23:54:43.668662+0000","last_unstale":"2024-09-15T23:54:43.676646+0000","last_undegraded":"2024-09-15T23:54:43.676646+0000","last_fullsized":"2024-09-15T23:54:43.676646+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:00.991165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648608+0000","last_change":"2024-09-15T23:54:43.647006+0000","last_active":"2024-09-15T23:54:43.648608+0000","last_peered":"2024-09-15T23:54:43.648608+0000","last_clean":"2024-09-15T23:54:43.648608+0000","last_became_active":"2024-09-15T23:54:43.646809+0000","last_became_peered":"2024-09-15T23:54:43.646809+0000","last_unstale":"2024-09-15T23:54:43.648608+0000","last_undegraded":"2024-09-15T23:54:43.648608+0000","last_fullsized":"2024-09-15T23:54:43.648608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:29.699749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684440+0000","last_change":"2024-09-15T23:54:43.665724+0000","last_active":"2024-09-15T23:54:43.684440+0000","last_peered":"2024-09-15T23:54:43.684440+0000","last_clean":"2024-09-15T23:54:43.684440+0000","last_became_active":"2024-09-15T23:54:43.665067+0000","last_became_peered":"2024-09-15T23:54:43.665067+0000","last_unstale":"2024-09-15T23:54:43.684440+0000","last_undegraded":"2024-09-15T23:54:43.684440+0000","last_fullsized":"2024-09-15T23:54:43.684440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:02:27.335899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676603+0000","last_change":"2024-09-15T23:54:43.668148+0000","last_active":"2024-09-15T23:54:43.676603+0000","last_peered":"2024-09-15T23:54:43.676603+0000","last_clean":"2024-09-15T23:54:43.676603+0000","last_became_active":"2024-09-15T23:54:43.667833+0000","last_became_peered":"2024-09-15T23:54:43.667833+0000","last_unstale":"2024-09-15T23:54:43.676603+0000","last_undegraded":"2024-09-15T23:54:43.676603+0000","last_fullsized":"2024-09-15T23:54:43.676603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:32.953360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684477+0000","last_change":"2024-09-15T23:54:43.671918+0000","last_active":"2024-09-15T23:54:43.684477+0000","last_peered":"2024-09-15T23:54:43.684477+0000","last_clean":"2024-09-15T23:54:43.684477+0000","last_became_active":"2024-09-15T23:54:43.666846+0000","last_became_peered":"2024-09-15T23:54:43.666846+0000","last_unstale":"2024-09-15T23:54:43.684477+0000","last_undegraded":"2024-09-15T23:54:43.684477+0000","last_fullsized":"2024-09-15T23:54:43.684477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:21.949038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.656728+0000","last_change":"2024-09-15T23:54:43.651577+0000","last_active":"2024-09-15T23:54:43.656728+0000","last_peered":"2024-09-15T23:54:43.656728+0000","last_clean":"2024-09-15T23:54:43.656728+0000","last_became_active":"2024-09-15T23:54:43.651254+0000","last_became_peered":"2024-09-15T23:54:43.651254+0000","last_unstale":"2024-09-15T23:54:43.656728+0000","last_undegraded":"2024-09-15T23:54:43.656728+0000","last_fullsized":"2024-09-15T23:54:43.656728+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:26.589213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677107+0000","last_change":"2024-09-15T23:54:43.672947+0000","last_active":"2024-09-15T23:54:43.677107+0000","last_peered":"2024-09-15T23:54:43.677107+0000","last_clean":"2024-09-15T23:54:43.677107+0000","last_became_active":"2024-09-15T23:54:43.672703+0000","last_became_peered":"2024-09-15T23:54:43.672703+0000","last_unstale":"2024-09-15T23:54:43.677107+0000","last_undegraded":"2024-09-15T23:54:43.677107+0000","last_fullsized":"2024-09-15T23:54:43.677107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:25.006535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.658793+0000","last_change":"2024-09-15T23:54:43.652965+0000","last_active":"2024-09-15T23:54:43.658793+0000","last_peered":"2024-09-15T23:54:43.658793+0000","last_clean":"2024-09-15T23:54:43.658793+0000","last_became_active":"2024-09-15T23:54:43.652697+0000","last_became_peered":"2024-09-15T23:54:43.652697+0000","last_unstale":"2024-09-15T23:54:43.658793+0000","last_undegraded":"2024-09-15T23:54:43.658793+0000","last_fullsized":"2024-09-15T23:54:43.658793+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:25.903632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648610+0000","last_change":"2024-09-15T23:54:43.646314+0000","last_active":"2024-09-15T23:54:43.648610+0000","last_peered":"2024-09-15T23:54:43.648610+0000","last_clean":"2024-09-15T23:54:43.648610+0000","last_became_active":"2024-09-15T23:54:43.646050+0000","last_became_peered":"2024-09-15T23:54:43.646050+0000","last_unstale":"2024-09-15T23:54:43.648610+0000","last_undegraded":"2024-09-15T23:54:43.648610+0000","last_fullsized":"2024-09-15T23:54:43.648610+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.127820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677124+0000","last_change":"2024-09-15T23:54:43.674939+0000","last_active":"2024-09-15T23:54:43.677124+0000","last_peered":"2024-09-15T23:54:43.677124+0000","last_clean":"2024-09-15T23:54:43.677124+0000","last_became_active":"2024-09-15T23:54:43.674692+0000","last_became_peered":"2024-09-15T23:54:43.674692+0000","last_unstale":"2024-09-15T23:54:43.677124+0000","last_undegraded":"2024-09-15T23:54:43.677124+0000","last_fullsized":"2024-09-15T23:54:43.677124+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:55.655404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677205+0000","last_change":"2024-09-15T23:54:43.657536+0000","last_active":"2024-09-15T23:54:43.677205+0000","last_peered":"2024-09-15T23:54:43.677205+0000","last_clean":"2024-09-15T23:54:43.677205+0000","last_became_active":"2024-09-15T23:54:43.650847+0000","last_became_peered":"2024-09-15T23:54:43.650847+0000","last_unstale":"2024-09-15T23:54:43.677205+0000","last_undegraded":"2024-09-15T23:54:43.677205+0000","last_fullsized":"2024-09-15T23:54:43.677205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:00.991165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642992+0000","last_change":"2024-09-15T23:54:43.635951+0000","last_active":"2024-09-15T23:54:43.642992+0000","last_peered":"2024-09-15T23:54:43.642992+0000","last_clean":"2024-09-15T23:54:43.642992+0000","last_became_active":"2024-09-15T23:54:43.635781+0000","last_became_peered":"2024-09-15T23:54:43.635781+0000","last_unstale":"2024-09-15T23:54:43.642992+0000","last_undegraded":"2024-09-15T23:54:43.642992+0000","last_fullsized":"2024-09-15T23:54:43.642992+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:02.199351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.660519+0000","last_change":"2024-09-15T23:54:42.603087+0000","last_active":"2024-09-15T23:54:43.660519+0000","last_peered":"2024-09-15T23:54:43.660519+0000","last_clean":"2024-09-15T23:54:43.660519+0000","last_became_active":"2024-09-15T23:54:42.602691+0000","last_became_peered":"2024-09-15T23:54:42.602691+0000","last_unstale":"2024-09-15T23:54:43.660519+0000","last_undegraded":"2024-09-15T23:54:43.660519+0000","last_fullsized":"2024-09-15T23:54:43.660519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:14.792784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675033+0000","last_change":"2024-09-15T23:54:43.643378+0000","last_active":"2024-09-15T23:54:43.675033+0000","last_peered":"2024-09-15T23:54:43.675033+0000","last_clean":"2024-09-15T23:54:43.675033+0000","last_became_active":"2024-09-15T23:54:43.642541+0000","last_became_peered":"2024-09-15T23:54:43.642541+0000","last_unstale":"2024-09-15T23:54:43.675033+0000","last_undegraded":"2024-09-15T23:54:43.675033+0000","last_fullsized":"2024-09-15T23:54:43.675033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:03.360218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678279+0000","last_change":"2024-09-15T23:54:42.603652+0000","last_active":"2024-09-15T23:54:43.678279+0000","last_peered":"2024-09-15T23:54:43.678279+0000","last_clean":"2024-09-15T23:54:43.678279+0000","last_became_active":"2024-09-15T23:54:42.603047+0000","last_became_peered":"2024-09-15T23:54:42.603047+0000","last_unstale":"2024-09-15T23:54:43.678279+0000","last_undegraded":"2024-09-15T23:54:43.678279+0000","last_fullsized":"2024-09-15T23:54:43.678279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:14.792784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.643928+0000","last_change":"2024-09-15T23:54:43.637123+0000","last_active":"2024-09-15T23:54:43.643928+0000","last_peered":"2024-09-15T23:54:43.643928+0000","last_clean":"2024-09-15T23:54:43.643928+0000","last_became_active":"2024-09-15T23:54:43.636836+0000","last_became_peered":"2024-09-15T23:54:43.636836+0000","last_unstale":"2024-09-15T23:54:43.643928+0000","last_undegraded":"2024-09-15T23:54:43.643928+0000","last_fullsized":"2024-09-15T23:54:43.643928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:38.608267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684964+0000","last_change":"2024-09-15T23:54:42.625060+0000","last_active":"2024-09-15T23:54:43.684964+0000","last_peered":"2024-09-15T23:54:43.684964+0000","last_clean":"2024-09-15T23:54:43.684964+0000","last_became_active":"2024-09-15T23:54:42.624313+0000","last_became_peered":"2024-09-15T23:54:42.624313+0000","last_unstale":"2024-09-15T23:54:43.684964+0000","last_undegraded":"2024-09-15T23:54:43.684964+0000","last_fullsized":"2024-09-15T23:54:43.684964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:38.798300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675091+0000","last_change":"2024-09-15T23:54:43.643735+0000","last_active":"2024-09-15T23:54:43.675091+0000","last_peered":"2024-09-15T23:54:43.675091+0000","last_clean":"2024-09-15T23:54:43.675091+0000","last_became_active":"2024-09-15T23:54:43.642717+0000","last_became_peered":"2024-09-15T23:54:43.642717+0000","last_unstale":"2024-09-15T23:54:43.675091+0000","last_undegraded":"2024-09-15T23:54:43.675091+0000","last_fullsized":"2024-09-15T23:54:43.675091+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:31.056987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.680652+0000","last_change":"2024-09-15T23:54:42.621654+0000","last_active":"2024-09-15T23:54:43.680652+0000","last_peered":"2024-09-15T23:54:43.680652+0000","last_clean":"2024-09-15T23:54:43.680652+0000","last_became_active":"2024-09-15T23:54:42.621285+0000","last_became_peered":"2024-09-15T23:54:42.621285+0000","last_unstale":"2024-09-15T23:54:43.680652+0000","last_undegraded":"2024-09-15T23:54:43.680652+0000","last_fullsized":"2024-09-15T23:54:43.680652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:34.417323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684558+0000","last_change":"2024-09-15T23:54:43.678051+0000","last_active":"2024-09-15T23:54:43.684558+0000","last_peered":"2024-09-15T23:54:43.684558+0000","last_clean":"2024-09-15T23:54:43.684558+0000","last_became_active":"2024-09-15T23:54:43.677319+0000","last_became_peered":"2024-09-15T23:54:43.677319+0000","last_unstale":"2024-09-15T23:54:43.684558+0000","last_undegraded":"2024-09-15T23:54:43.684558+0000","last_fullsized":"2024-09-15T23:54:43.684558+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:26.378086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.639962+0000","last_change":"2024-09-15T23:54:42.601838+0000","last_active":"2024-09-15T23:54:43.639962+0000","last_peered":"2024-09-15T23:54:43.639962+0000","last_clean":"2024-09-15T23:54:43.639962+0000","last_became_active":"2024-09-15T23:54:42.601580+0000","last_became_peered":"2024-09-15T23:54:42.601580+0000","last_unstale":"2024-09-15T23:54:43.639962+0000","last_undegraded":"2024-09-15T23:54:43.639962+0000","last_fullsized":"2024-09-15T23:54:43.639962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:16.673465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.650838+0000","last_change":"2024-09-15T23:54:43.647396+0000","last_active":"2024-09-15T23:54:43.650838+0000","last_peered":"2024-09-15T23:54:43.650838+0000","last_clean":"2024-09-15T23:54:43.650838+0000","last_became_active":"2024-09-15T23:54:43.647101+0000","last_became_peered":"2024-09-15T23:54:43.647101+0000","last_unstale":"2024-09-15T23:54:43.650838+0000","last_undegraded":"2024-09-15T23:54:43.650838+0000","last_fullsized":"2024-09-15T23:54:43.650838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:49.567963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.664488+0000","last_change":"2024-09-15T23:54:42.627071+0000","last_active":"2024-09-15T23:54:43.664488+0000","last_peered":"2024-09-15T23:54:43.664488+0000","last_clean":"2024-09-15T23:54:43.664488+0000","last_became_active":"2024-09-15T23:54:42.626584+0000","last_became_peered":"2024-09-15T23:54:42.626584+0000","last_unstale":"2024-09-15T23:54:43.664488+0000","last_undegraded":"2024-09-15T23:54:43.664488+0000","last_fullsized":"2024-09-15T23:54:43.664488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:11.254409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642808+0000","last_change":"2024-09-15T23:54:43.631269+0000","last_active":"2024-09-15T23:54:43.642808+0000","last_peered":"2024-09-15T23:54:43.642808+0000","last_clean":"2024-09-15T23:54:43.642808+0000","last_became_active":"2024-09-15T23:54:43.630993+0000","last_became_peered":"2024-09-15T23:54:43.630993+0000","last_unstale":"2024-09-15T23:54:43.642808+0000","last_undegraded":"2024-09-15T23:54:43.642808+0000","last_fullsized":"2024-09-15T23:54:43.642808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:24.435909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625586+0000","last_change":"2024-09-15T23:54:42.611939+0000","last_active":"2024-09-15T23:54:43.625586+0000","last_peered":"2024-09-15T23:54:43.625586+0000","last_clean":"2024-09-15T23:54:43.625586+0000","last_became_active":"2024-09-15T23:54:42.611180+0000","last_became_peered":"2024-09-15T23:54:42.611180+0000","last_unstale":"2024-09-15T23:54:43.625586+0000","last_undegraded":"2024-09-15T23:54:43.625586+0000","last_fullsized":"2024-09-15T23:54:43.625586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:07.254369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.675683+0000","last_change":"2024-09-15T23:54:43.658082+0000","last_active":"2024-09-15T23:54:43.675683+0000","last_peered":"2024-09-15T23:54:43.675683+0000","last_clean":"2024-09-15T23:54:43.675683+0000","last_became_active":"2024-09-15T23:54:43.656463+0000","last_became_peered":"2024-09-15T23:54:43.656463+0000","last_unstale":"2024-09-15T23:54:43.675683+0000","last_undegraded":"2024-09-15T23:54:43.675683+0000","last_fullsized":"2024-09-15T23:54:43.675683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:57.007396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625925+0000","last_change":"2024-09-15T23:54:42.597005+0000","last_active":"2024-09-15T23:54:43.625925+0000","last_peered":"2024-09-15T23:54:43.625925+0000","last_clean":"2024-09-15T23:54:43.625925+0000","last_became_active":"2024-09-15T23:54:42.596627+0000","last_became_peered":"2024-09-15T23:54:42.596627+0000","last_unstale":"2024-09-15T23:54:43.625925+0000","last_undegraded":"2024-09-15T23:54:43.625925+0000","last_fullsized":"2024-09-15T23:54:43.625925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:26.732611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677039+0000","last_change":"2024-09-15T23:54:43.658368+0000","last_active":"2024-09-15T23:54:43.677039+0000","last_peered":"2024-09-15T23:54:43.677039+0000","last_clean":"2024-09-15T23:54:43.677039+0000","last_became_active":"2024-09-15T23:54:43.650724+0000","last_became_peered":"2024-09-15T23:54:43.650724+0000","last_unstale":"2024-09-15T23:54:43.677039+0000","last_undegraded":"2024-09-15T23:54:43.677039+0000","last_fullsized":"2024-09-15T23:54:43.677039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:56.166523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.635501+0000","last_change":"2024-09-15T23:54:42.624959+0000","last_active":"2024-09-15T23:54:43.635501+0000","last_peered":"2024-09-15T23:54:43.635501+0000","last_clean":"2024-09-15T23:54:43.635501+0000","last_became_active":"2024-09-15T23:54:42.624107+0000","last_became_peered":"2024-09-15T23:54:42.624107+0000","last_unstale":"2024-09-15T23:54:43.635501+0000","last_undegraded":"2024-09-15T23:54:43.635501+0000","last_fullsized":"2024-09-15T23:54:43.635501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:28.523942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.638066+0000","last_change":"2024-09-15T23:54:43.634620+0000","last_active":"2024-09-15T23:54:43.638066+0000","last_peered":"2024-09-15T23:54:43.638066+0000","last_clean":"2024-09-15T23:54:43.638066+0000","last_became_active":"2024-09-15T23:54:43.634284+0000","last_became_peered":"2024-09-15T23:54:43.634284+0000","last_unstale":"2024-09-15T23:54:43.638066+0000","last_undegraded":"2024-09-15T23:54:43.638066+0000","last_fullsized":"2024-09-15T23:54:43.638066+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:03.360218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.617515+0000","last_change":"2024-09-15T23:54:42.605069+0000","last_active":"2024-09-15T23:54:43.617515+0000","last_peered":"2024-09-15T23:54:43.617515+0000","last_clean":"2024-09-15T23:54:43.617515+0000","last_became_active":"2024-09-15T23:54:42.604503+0000","last_became_peered":"2024-09-15T23:54:42.604503+0000","last_unstale":"2024-09-15T23:54:43.617515+0000","last_undegraded":"2024-09-15T23:54:43.617515+0000","last_fullsized":"2024-09-15T23:54:43.617515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.769934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.684422+0000","last_change":"2024-09-15T23:54:43.671661+0000","last_active":"2024-09-15T23:54:43.684422+0000","last_peered":"2024-09-15T23:54:43.684422+0000","last_clean":"2024-09-15T23:54:43.684422+0000","last_became_active":"2024-09-15T23:54:43.666649+0000","last_became_peered":"2024-09-15T23:54:43.666649+0000","last_unstale":"2024-09-15T23:54:43.684422+0000","last_undegraded":"2024-09-15T23:54:43.684422+0000","last_fullsized":"2024-09-15T23:54:43.684422+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:56.823302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.665839+0000","last_change":"2024-09-15T23:54:42.626955+0000","last_active":"2024-09-15T23:54:43.665839+0000","last_peered":"2024-09-15T23:54:43.665839+0000","last_clean":"2024-09-15T23:54:43.665839+0000","last_became_active":"2024-09-15T23:54:42.626378+0000","last_became_peered":"2024-09-15T23:54:42.626378+0000","last_unstale":"2024-09-15T23:54:43.665839+0000","last_undegraded":"2024-09-15T23:54:43.665839+0000","last_fullsized":"2024-09-15T23:54:43.665839+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:41.491603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.651600+0000","last_change":"2024-09-15T23:54:43.647810+0000","last_active":"2024-09-15T23:54:43.651600+0000","last_peered":"2024-09-15T23:54:43.651600+0000","last_clean":"2024-09-15T23:54:43.651600+0000","last_became_active":"2024-09-15T23:54:43.647559+0000","last_became_peered":"2024-09-15T23:54:43.647559+0000","last_unstale":"2024-09-15T23:54:43.651600+0000","last_undegraded":"2024-09-15T23:54:43.651600+0000","last_fullsized":"2024-09-15T23:54:43.651600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:37.184096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.687213+0000","last_change":"2024-09-15T23:54:42.621794+0000","last_active":"2024-09-15T23:54:43.687213+0000","last_peered":"2024-09-15T23:54:43.687213+0000","last_clean":"2024-09-15T23:54:43.687213+0000","last_became_active":"2024-09-15T23:54:42.621085+0000","last_became_peered":"2024-09-15T23:54:42.621085+0000","last_unstale":"2024-09-15T23:54:43.687213+0000","last_undegraded":"2024-09-15T23:54:43.687213+0000","last_fullsized":"2024-09-15T23:54:43.687213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:25.577766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677306+0000","last_change":"2024-09-15T23:54:43.657690+0000","last_active":"2024-09-15T23:54:43.677306+0000","last_peered":"2024-09-15T23:54:43.677306+0000","last_clean":"2024-09-15T23:54:43.677306+0000","last_became_active":"2024-09-15T23:54:43.650910+0000","last_became_peered":"2024-09-15T23:54:43.650910+0000","last_unstale":"2024-09-15T23:54:43.677306+0000","last_undegraded":"2024-09-15T23:54:43.677306+0000","last_fullsized":"2024-09-15T23:54:43.677306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:05.527477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.685074+0000","last_change":"2024-09-15T23:54:42.616261+0000","last_active":"2024-09-15T23:54:43.685074+0000","last_peered":"2024-09-15T23:54:43.685074+0000","last_clean":"2024-09-15T23:54:43.685074+0000","last_became_active":"2024-09-15T23:54:42.615529+0000","last_became_peered":"2024-09-15T23:54:42.615529+0000","last_unstale":"2024-09-15T23:54:43.685074+0000","last_undegraded":"2024-09-15T23:54:43.685074+0000","last_fullsized":"2024-09-15T23:54:43.685074+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:03.874014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682543+0000","last_change":"2024-09-15T23:54:43.669009+0000","last_active":"2024-09-15T23:54:43.682543+0000","last_peered":"2024-09-15T23:54:43.682543+0000","last_clean":"2024-09-15T23:54:43.682543+0000","last_became_active":"2024-09-15T23:54:43.667776+0000","last_became_peered":"2024-09-15T23:54:43.667776+0000","last_unstale":"2024-09-15T23:54:43.682543+0000","last_undegraded":"2024-09-15T23:54:43.682543+0000","last_fullsized":"2024-09-15T23:54:43.682543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:44.483323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.640823+0000","last_change":"2024-09-15T23:54:42.601025+0000","last_active":"2024-09-15T23:54:43.640823+0000","last_peered":"2024-09-15T23:54:43.640823+0000","last_clean":"2024-09-15T23:54:43.640823+0000","last_became_active":"2024-09-15T23:54:42.599974+0000","last_became_peered":"2024-09-15T23:54:42.599974+0000","last_unstale":"2024-09-15T23:54:43.640823+0000","last_undegraded":"2024-09-15T23:54:43.640823+0000","last_fullsized":"2024-09-15T23:54:43.640823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:34.417323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648500+0000","last_change":"2024-09-15T23:54:43.642124+0000","last_active":"2024-09-15T23:54:43.648500+0000","last_peered":"2024-09-15T23:54:43.648500+0000","last_clean":"2024-09-15T23:54:43.648500+0000","last_became_active":"2024-09-15T23:54:43.641863+0000","last_became_peered":"2024-09-15T23:54:43.641863+0000","last_unstale":"2024-09-15T23:54:43.648500+0000","last_undegraded":"2024-09-15T23:54:43.648500+0000","last_fullsized":"2024-09-15T23:54:43.648500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:29.535388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.617251+0000","last_change":"2024-09-15T23:54:42.597340+0000","last_active":"2024-09-15T23:54:43.617251+0000","last_peered":"2024-09-15T23:54:43.617251+0000","last_clean":"2024-09-15T23:54:43.617251+0000","last_became_active":"2024-09-15T23:54:42.596908+0000","last_became_peered":"2024-09-15T23:54:42.596908+0000","last_unstale":"2024-09-15T23:54:43.617251+0000","last_undegraded":"2024-09-15T23:54:43.617251+0000","last_fullsized":"2024-09-15T23:54:43.617251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:40.885229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.682452+0000","last_change":"2024-09-15T23:54:43.677377+0000","last_active":"2024-09-15T23:54:43.682452+0000","last_peered":"2024-09-15T23:54:43.682452+0000","last_clean":"2024-09-15T23:54:43.682452+0000","last_became_active":"2024-09-15T23:54:43.676667+0000","last_became_peered":"2024-09-15T23:54:43.676667+0000","last_unstale":"2024-09-15T23:54:43.682452+0000","last_undegraded":"2024-09-15T23:54:43.682452+0000","last_fullsized":"2024-09-15T23:54:43.682452+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:08.810523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.642008+0000","last_change":"2024-09-15T23:54:42.591210+0000","last_active":"2024-09-15T23:54:43.642008+0000","last_peered":"2024-09-15T23:54:43.642008+0000","last_clean":"2024-09-15T23:54:43.642008+0000","last_became_active":"2024-09-15T23:54:42.590512+0000","last_became_peered":"2024-09-15T23:54:42.590512+0000","last_unstale":"2024-09-15T23:54:43.642008+0000","last_undegraded":"2024-09-15T23:54:43.642008+0000","last_fullsized":"2024-09-15T23:54:43.642008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:30.045540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678242+0000","last_change":"2024-09-15T23:54:43.667252+0000","last_active":"2024-09-15T23:54:43.678242+0000","last_peered":"2024-09-15T23:54:43.678242+0000","last_clean":"2024-09-15T23:54:43.678242+0000","last_became_active":"2024-09-15T23:54:43.659011+0000","last_became_peered":"2024-09-15T23:54:43.659011+0000","last_unstale":"2024-09-15T23:54:43.678242+0000","last_undegraded":"2024-09-15T23:54:43.678242+0000","last_fullsized":"2024-09-15T23:54:43.678242+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:04.885460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.640799+0000","last_change":"2024-09-15T23:54:42.602026+0000","last_active":"2024-09-15T23:54:43.640799+0000","last_peered":"2024-09-15T23:54:43.640799+0000","last_clean":"2024-09-15T23:54:43.640799+0000","last_became_active":"2024-09-15T23:54:42.601654+0000","last_became_peered":"2024-09-15T23:54:42.601654+0000","last_unstale":"2024-09-15T23:54:43.640799+0000","last_undegraded":"2024-09-15T23:54:43.640799+0000","last_fullsized":"2024-09-15T23:54:43.640799+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:36.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.671218+0000","last_change":"2024-09-15T23:54:43.665585+0000","last_active":"2024-09-15T23:54:43.671218+0000","last_peered":"2024-09-15T23:54:43.671218+0000","last_clean":"2024-09-15T23:54:43.671218+0000","last_became_active":"2024-09-15T23:54:43.665240+0000","last_became_peered":"2024-09-15T23:54:43.665240+0000","last_unstale":"2024-09-15T23:54:43.671218+0000","last_undegraded":"2024-09-15T23:54:43.671218+0000","last_fullsized":"2024-09-15T23:54:43.671218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:40.585681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.666572+0000","last_change":"2024-09-15T23:54:42.627305+0000","last_active":"2024-09-15T23:54:43.666572+0000","last_peered":"2024-09-15T23:54:43.666572+0000","last_clean":"2024-09-15T23:54:43.666572+0000","last_became_active":"2024-09-15T23:54:42.627061+0000","last_became_peered":"2024-09-15T23:54:42.627061+0000","last_unstale":"2024-09-15T23:54:43.666572+0000","last_undegraded":"2024-09-15T23:54:43.666572+0000","last_fullsized":"2024-09-15T23:54:43.666572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:47.285819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676607+0000","last_change":"2024-09-15T23:54:43.668779+0000","last_active":"2024-09-15T23:54:43.676607+0000","last_peered":"2024-09-15T23:54:43.676607+0000","last_clean":"2024-09-15T23:54:43.676607+0000","last_became_active":"2024-09-15T23:54:43.668438+0000","last_became_peered":"2024-09-15T23:54:43.668438+0000","last_unstale":"2024-09-15T23:54:43.676607+0000","last_undegraded":"2024-09-15T23:54:43.676607+0000","last_fullsized":"2024-09-15T23:54:43.676607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:46.999984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.650161+0000","last_change":"2024-09-15T23:54:42.607764+0000","last_active":"2024-09-15T23:54:43.650161+0000","last_peered":"2024-09-15T23:54:43.650161+0000","last_clean":"2024-09-15T23:54:43.650161+0000","last_became_active":"2024-09-15T23:54:42.607054+0000","last_became_peered":"2024-09-15T23:54:42.607054+0000","last_unstale":"2024-09-15T23:54:43.650161+0000","last_undegraded":"2024-09-15T23:54:43.650161+0000","last_fullsized":"2024-09-15T23:54:43.650161+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:11.254409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:54:42.570937+0000","last_change":"2024-09-15T23:54:42.570937+0000","last_active":"2024-09-15T23:54:42.570937+0000","last_peered":"2024-09-15T23:54:42.570937+0000","last_clean":"2024-09-15T23:54:42.570937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:42.570937+0000","last_undegraded":"2024-09-15T23:54:42.570937+0000","last_fullsized":"2024-09-15T23:54:42.570937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T23:54:41.585064+0000","last_change":"2024-09-15T23:54:41.585064+0000","last_active":"2024-09-15T23:54:41.559490+0000","last_peered":"2024-09-15T23:54:41.559490+0000","last_clean":"2024-09-15T23:54:41.559490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:41.585064+0000","last_undegraded":"2024-09-15T23:54:41.585064+0000","last_fullsized":"2024-09-15T23:54:41.585064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648485+0000","last_change":"2024-09-15T23:54:43.643428+0000","last_active":"2024-09-15T23:54:43.648485+0000","last_peered":"2024-09-15T23:54:43.648485+0000","last_clean":"2024-09-15T23:54:43.648485+0000","last_became_active":"2024-09-15T23:54:43.643158+0000","last_became_peered":"2024-09-15T23:54:43.643158+0000","last_unstale":"2024-09-15T23:54:43.648485+0000","last_undegraded":"2024-09-15T23:54:43.648485+0000","last_fullsized":"2024-09-15T23:54:43.648485+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:02.150007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T23:54:41.584264+0000","last_change":"2024-09-15T23:54:41.584264+0000","last_active":"2024-09-15T23:54:41.559490+0000","last_peered":"2024-09-15T23:54:41.559490+0000","last_clean":"2024-09-15T23:54:41.559490+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:41.584264+0000","last_undegraded":"2024-09-15T23:54:41.584264+0000","last_fullsized":"2024-09-15T23:54:41.584264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.676955+0000","last_change":"2024-09-15T23:54:43.657288+0000","last_active":"2024-09-15T23:54:43.676955+0000","last_peered":"2024-09-15T23:54:43.676955+0000","last_clean":"2024-09-15T23:54:43.676955+0000","last_became_active":"2024-09-15T23:54:43.656050+0000","last_became_peered":"2024-09-15T23:54:43.656050+0000","last_unstale":"2024-09-15T23:54:43.676955+0000","last_undegraded":"2024-09-15T23:54:43.676955+0000","last_fullsized":"2024-09-15T23:54:43.676955+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:02.241689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625925+0000","last_change":"2024-09-15T23:54:42.598953+0000","last_active":"2024-09-15T23:54:43.625925+0000","last_peered":"2024-09-15T23:54:43.625925+0000","last_clean":"2024-09-15T23:54:43.625925+0000","last_became_active":"2024-09-15T23:54:42.597704+0000","last_became_peered":"2024-09-15T23:54:42.597704+0000","last_unstale":"2024-09-15T23:54:43.625925+0000","last_undegraded":"2024-09-15T23:54:43.625925+0000","last_fullsized":"2024-09-15T23:54:43.625925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:16.673465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.645191+0000","last_change":"2024-09-15T23:54:43.636074+0000","last_active":"2024-09-15T23:54:43.645191+0000","last_peered":"2024-09-15T23:54:43.645191+0000","last_clean":"2024-09-15T23:54:43.645191+0000","last_became_active":"2024-09-15T23:54:43.635810+0000","last_became_peered":"2024-09-15T23:54:43.635810+0000","last_unstale":"2024-09-15T23:54:43.645191+0000","last_undegraded":"2024-09-15T23:54:43.645191+0000","last_fullsized":"2024-09-15T23:54:43.645191+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:08.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625947+0000","last_change":"2024-09-15T23:54:42.596955+0000","last_active":"2024-09-15T23:54:43.625947+0000","last_peered":"2024-09-15T23:54:43.625947+0000","last_clean":"2024-09-15T23:54:43.625947+0000","last_became_active":"2024-09-15T23:54:42.596647+0000","last_became_peered":"2024-09-15T23:54:42.596647+0000","last_unstale":"2024-09-15T23:54:43.625947+0000","last_undegraded":"2024-09-15T23:54:43.625947+0000","last_fullsized":"2024-09-15T23:54:43.625947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:36.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.677202+0000","last_change":"2024-09-15T23:54:43.659071+0000","last_active":"2024-09-15T23:54:43.677202+0000","last_peered":"2024-09-15T23:54:43.677202+0000","last_clean":"2024-09-15T23:54:43.677202+0000","last_became_active":"2024-09-15T23:54:43.656622+0000","last_became_peered":"2024-09-15T23:54:43.656622+0000","last_unstale":"2024-09-15T23:54:43.677202+0000","last_undegraded":"2024-09-15T23:54:43.677202+0000","last_fullsized":"2024-09-15T23:54:43.677202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:50.700577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625588+0000","last_change":"2024-09-15T23:54:42.628542+0000","last_active":"2024-09-15T23:54:43.625588+0000","last_peered":"2024-09-15T23:54:43.625588+0000","last_clean":"2024-09-15T23:54:43.625588+0000","last_became_active":"2024-09-15T23:54:42.627924+0000","last_became_peered":"2024-09-15T23:54:42.627924+0000","last_unstale":"2024-09-15T23:54:43.625588+0000","last_undegraded":"2024-09-15T23:54:43.625588+0000","last_fullsized":"2024-09-15T23:54:43.625588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:15.134895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.648042+0000","last_change":"2024-09-15T23:54:43.643031+0000","last_active":"2024-09-15T23:54:43.648042+0000","last_peered":"2024-09-15T23:54:43.648042+0000","last_clean":"2024-09-15T23:54:43.648042+0000","last_became_active":"2024-09-15T23:54:43.642329+0000","last_became_peered":"2024-09-15T23:54:43.642329+0000","last_unstale":"2024-09-15T23:54:43.648042+0000","last_undegraded":"2024-09-15T23:54:43.648042+0000","last_fullsized":"2024-09-15T23:54:43.648042+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:37.970228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.647722+0000","last_change":"2024-09-15T23:54:42.603521+0000","last_active":"2024-09-15T23:54:43.647722+0000","last_peered":"2024-09-15T23:54:43.647722+0000","last_clean":"2024-09-15T23:54:43.647722+0000","last_became_active":"2024-09-15T23:54:42.602670+0000","last_became_peered":"2024-09-15T23:54:42.602670+0000","last_unstale":"2024-09-15T23:54:43.647722+0000","last_undegraded":"2024-09-15T23:54:43.647722+0000","last_fullsized":"2024-09-15T23:54:43.647722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.132376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.645389+0000","last_change":"2024-09-15T23:54:43.637124+0000","last_active":"2024-09-15T23:54:43.645389+0000","last_peered":"2024-09-15T23:54:43.645389+0000","last_clean":"2024-09-15T23:54:43.645389+0000","last_became_active":"2024-09-15T23:54:43.636448+0000","last_became_peered":"2024-09-15T23:54:43.636448+0000","last_unstale":"2024-09-15T23:54:43.645389+0000","last_undegraded":"2024-09-15T23:54:43.645389+0000","last_fullsized":"2024-09-15T23:54:43.645389+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:04.885460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.633484+0000","last_change":"2024-09-15T23:54:42.611389+0000","last_active":"2024-09-15T23:54:43.633484+0000","last_peered":"2024-09-15T23:54:43.633484+0000","last_clean":"2024-09-15T23:54:43.633484+0000","last_became_active":"2024-09-15T23:54:42.610734+0000","last_became_peered":"2024-09-15T23:54:42.610734+0000","last_unstale":"2024-09-15T23:54:43.633484+0000","last_undegraded":"2024-09-15T23:54:43.633484+0000","last_fullsized":"2024-09-15T23:54:43.633484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:36.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:54:42.570937+0000","last_change":"2024-09-15T23:54:42.570937+0000","last_active":"2024-09-15T23:54:42.570937+0000","last_peered":"2024-09-15T23:54:42.570937+0000","last_clean":"2024-09-15T23:54:42.570937+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:54:42.570937+0000","last_undegraded":"2024-09-15T23:54:42.570937+0000","last_fullsized":"2024-09-15T23:54:42.570937+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.633517+0000","last_change":"2024-09-15T23:54:42.629795+0000","last_active":"2024-09-15T23:54:43.633517+0000","last_peered":"2024-09-15T23:54:43.633517+0000","last_clean":"2024-09-15T23:54:43.633517+0000","last_became_active":"2024-09-15T23:54:42.628974+0000","last_became_peered":"2024-09-15T23:54:42.628974+0000","last_unstale":"2024-09-15T23:54:43.633517+0000","last_undegraded":"2024-09-15T23:54:43.633517+0000","last_fullsized":"2024-09-15T23:54:43.633517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:26.732611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.683271+0000","last_change":"2024-09-15T23:54:43.679983+0000","last_active":"2024-09-15T23:54:43.683271+0000","last_peered":"2024-09-15T23:54:43.683271+0000","last_clean":"2024-09-15T23:54:43.683271+0000","last_became_active":"2024-09-15T23:54:43.679346+0000","last_became_peered":"2024-09-15T23:54:43.679346+0000","last_unstale":"2024-09-15T23:54:43.683271+0000","last_undegraded":"2024-09-15T23:54:43.683271+0000","last_fullsized":"2024-09-15T23:54:43.683271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:40.585681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.626104+0000","last_change":"2024-09-15T23:54:42.619643+0000","last_active":"2024-09-15T23:54:43.626104+0000","last_peered":"2024-09-15T23:54:43.626104+0000","last_clean":"2024-09-15T23:54:43.626104+0000","last_became_active":"2024-09-15T23:54:42.615833+0000","last_became_peered":"2024-09-15T23:54:42.615833+0000","last_unstale":"2024-09-15T23:54:43.626104+0000","last_undegraded":"2024-09-15T23:54:43.626104+0000","last_fullsized":"2024-09-15T23:54:43.626104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:43.471876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.678205+0000","last_change":"2024-09-15T23:54:43.666718+0000","last_active":"2024-09-15T23:54:43.678205+0000","last_peered":"2024-09-15T23:54:43.678205+0000","last_clean":"2024-09-15T23:54:43.678205+0000","last_became_active":"2024-09-15T23:54:43.666042+0000","last_became_peered":"2024-09-15T23:54:43.666042+0000","last_unstale":"2024-09-15T23:54:43.678205+0000","last_undegraded":"2024-09-15T23:54:43.678205+0000","last_fullsized":"2024-09-15T23:54:43.678205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:08.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.624671+0000","last_change":"2024-09-15T23:54:42.605386+0000","last_active":"2024-09-15T23:54:43.624671+0000","last_peered":"2024-09-15T23:54:43.624671+0000","last_clean":"2024-09-15T23:54:43.624671+0000","last_became_active":"2024-09-15T23:54:42.605053+0000","last_became_peered":"2024-09-15T23:54:42.605053+0000","last_unstale":"2024-09-15T23:54:43.624671+0000","last_undegraded":"2024-09-15T23:54:43.624671+0000","last_fullsized":"2024-09-15T23:54:43.624671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:31.941914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.664273+0000","last_change":"2024-09-15T23:54:43.659325+0000","last_active":"2024-09-15T23:54:43.664273+0000","last_peered":"2024-09-15T23:54:43.664273+0000","last_clean":"2024-09-15T23:54:43.664273+0000","last_became_active":"2024-09-15T23:54:43.658989+0000","last_became_peered":"2024-09-15T23:54:43.658989+0000","last_unstale":"2024-09-15T23:54:43.664273+0000","last_undegraded":"2024-09-15T23:54:43.664273+0000","last_fullsized":"2024-09-15T23:54:43.664273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:59.753339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.617582+0000","last_change":"2024-09-15T23:54:42.602928+0000","last_active":"2024-09-15T23:54:43.617582+0000","last_peered":"2024-09-15T23:54:43.617582+0000","last_clean":"2024-09-15T23:54:43.617582+0000","last_became_active":"2024-09-15T23:54:42.602534+0000","last_became_peered":"2024-09-15T23:54:42.602534+0000","last_unstale":"2024-09-15T23:54:43.617582+0000","last_undegraded":"2024-09-15T23:54:43.617582+0000","last_fullsized":"2024-09-15T23:54:43.617582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:51.351267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.656757+0000","last_change":"2024-09-15T23:54:43.652409+0000","last_active":"2024-09-15T23:54:43.656757+0000","last_peered":"2024-09-15T23:54:43.656757+0000","last_clean":"2024-09-15T23:54:43.656757+0000","last_became_active":"2024-09-15T23:54:43.652155+0000","last_became_peered":"2024-09-15T23:54:43.652155+0000","last_unstale":"2024-09-15T23:54:43.656757+0000","last_undegraded":"2024-09-15T23:54:43.656757+0000","last_fullsized":"2024-09-15T23:54:43.656757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:02.241689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.636039+0000","last_change":"2024-09-15T23:54:42.621609+0000","last_active":"2024-09-15T23:54:43.636039+0000","last_peered":"2024-09-15T23:54:43.636039+0000","last_clean":"2024-09-15T23:54:43.636039+0000","last_became_active":"2024-09-15T23:54:42.620946+0000","last_became_peered":"2024-09-15T23:54:42.620946+0000","last_unstale":"2024-09-15T23:54:43.636039+0000","last_undegraded":"2024-09-15T23:54:43.636039+0000","last_fullsized":"2024-09-15T23:54:43.636039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:48.556516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.651261+0000","last_change":"2024-09-15T23:54:43.648081+0000","last_active":"2024-09-15T23:54:43.651261+0000","last_peered":"2024-09-15T23:54:43.651261+0000","last_clean":"2024-09-15T23:54:43.651261+0000","last_became_active":"2024-09-15T23:54:43.647717+0000","last_became_peered":"2024-09-15T23:54:43.647717+0000","last_unstale":"2024-09-15T23:54:43.651261+0000","last_undegraded":"2024-09-15T23:54:43.651261+0000","last_fullsized":"2024-09-15T23:54:43.651261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:44.258165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.624280+0000","last_change":"2024-09-15T23:54:42.604211+0000","last_active":"2024-09-15T23:54:43.624280+0000","last_peered":"2024-09-15T23:54:43.624280+0000","last_clean":"2024-09-15T23:54:43.624280+0000","last_became_active":"2024-09-15T23:54:42.603770+0000","last_became_peered":"2024-09-15T23:54:42.603770+0000","last_unstale":"2024-09-15T23:54:43.624280+0000","last_undegraded":"2024-09-15T23:54:43.624280+0000","last_fullsized":"2024-09-15T23:54:43.624280+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:55.995950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T23:54:43.625877+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:54:43.625877+0000","last_peered":"2024-09-15T23:54:43.625877+0000","last_clean":"2024-09-15T23:54:43.625877+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:54:43.625877+0000","last_undegraded":"2024-09-15T23:54:43.625877+0000","last_fullsized":"2024-09-15T23:54:43.625877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":122,"acting":122,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":181795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":190698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":446464,"data_stored":189052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":191156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1024000,"data_stored":772163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":181795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1011712,"data_stored":765496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:54:48.557 INFO:tasks.ceph.mds.a.smithi112.stderr:2024-09-15T23:54:48.551+0000 7f3f97b7b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:54:51.039 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:54:51.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.163+0000 7fda42188640 1 Processor -- start 2024-09-15T23:54:51.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.167+0000 7fda42188640 1 -- start start 2024-09-15T23:54:51.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.167+0000 7fda42188640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fda3c0b39a0 0x7fda3c06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.167+0000 7fda42188640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda3c06ec60 con 0x7fda3c1587a0 2024-09-15T23:54:51.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.167+0000 7fda42188640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda3c06ef40 con 0x7fda3c06e4b0 2024-09-15T23:54:51.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.167+0000 7fda42188640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fda3c06f870 con 0x7fda3c0b39a0 2024-09-15T23:54:51.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.167+0000 7fda32ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fda3c0b39a0 0x7fda3c06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.167+0000 7fda3b7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fda3c1587a0 0x7fda3c0b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41742/0 (socket says 172.21.15.112:41742) 2024-09-15T23:54:51.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.167+0000 7fda3b7fe640 1 -- 172.21.15.112:0/862258154 learned_addr learned my addr 172.21.15.112:0/862258154 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:51.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.167+0000 7fda32ffd640 1 -- 172.21.15.112:0/862258154 >> v1:172.21.15.169:6789/0 conn(0x7fda3c06e4b0 legacy=0x7fda3c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:51.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.167+0000 7fda32ffd640 1 -- 172.21.15.112:0/862258154 >> v1:172.21.15.112:6789/0 conn(0x7fda3c1587a0 legacy=0x7fda3c0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.167+0000 7fda3affd640 1 -- 172.21.15.112:0/862258154 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2710651261 0 0) 0x7fda3c06ec60 con 0x7fda3c1587a0 2024-09-15T23:54:51.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.167+0000 7fda32ffd640 1 -- 172.21.15.112:0/862258154 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3c06f220 con 0x7fda3c0b39a0 2024-09-15T23:54:51.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.167+0000 7fda32ffd640 1 --2- 172.21.15.112:0/862258154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda3c0b39a0 0x7fda3c06df70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fda3c06f9f0 tx=0x7fda2401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b05211a0fa1629 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:51.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.167+0000 7fda3affd640 1 -- 172.21.15.112:0/862258154 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda240b1070 con 0x7fda3c0b39a0 2024-09-15T23:54:51.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda3affd640 1 -- 172.21.15.112:0/862258154 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda240ac620 con 0x7fda3c0b39a0 2024-09-15T23:54:51.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda3affd640 1 -- 172.21.15.112:0/862258154 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda240ac9f0 con 0x7fda3c0b39a0 2024-09-15T23:54:51.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 -- 172.21.15.112:0/862258154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda3c0b39a0 msgr2=0x7fda3c06df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 --2- 172.21.15.112:0/862258154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda3c0b39a0 0x7fda3c06df70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fda3c06f9f0 tx=0x7fda2401c430 comp rx=0 tx=0).stop 2024-09-15T23:54:51.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 -- 172.21.15.112:0/862258154 shutdown_connections 2024-09-15T23:54:51.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 --2- 172.21.15.112:0/862258154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda3c0b39a0 0x7fda3c06df70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 -- 172.21.15.112:0/862258154 >> 172.21.15.112:0/862258154 conn(0x7fda3c0b1f90 msgr2=0x7fda3c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:51.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 -- 172.21.15.112:0/862258154 shutdown_connections 2024-09-15T23:54:51.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 -- 172.21.15.112:0/862258154 wait complete. 2024-09-15T23:54:51.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 Processor -- start 2024-09-15T23:54:51.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 -- start start 2024-09-15T23:54:51.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda3c06e4b0 0x7fda3c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda3c0b39a0 0x7fda3c09bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda3c1587a0 0x7fda3c09c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c073200 con 0x7fda3c1587a0 2024-09-15T23:54:51.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c073080 con 0x7fda3c06e4b0 2024-09-15T23:54:51.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fda3c073380 con 0x7fda3c0b39a0 2024-09-15T23:54:51.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda3bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda3c1587a0 0x7fda3c09c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda3bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda3c1587a0 0x7fda3c09c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48644/0 (socket says 172.21.15.112:48644) 2024-09-15T23:54:51.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda3bfff640 1 -- 172.21.15.112:0/1053207520 learned_addr learned my addr 172.21.15.112:0/1053207520 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:51.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda3b7fe640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda3c06e4b0 0x7fda3c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda32ffd640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda3c0b39a0 0x7fda3c09bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda3bfff640 1 -- 172.21.15.112:0/1053207520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda3c0b39a0 msgr2=0x7fda3c09bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda3bfff640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda3c0b39a0 0x7fda3c09bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda3bfff640 1 -- 172.21.15.112:0/1053207520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda3c06e4b0 msgr2=0x7fda3c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda3bfff640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda3c06e4b0 0x7fda3c1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda3bfff640 1 -- 172.21.15.112:0/1053207520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3c09b7a0 con 0x7fda3c1587a0 2024-09-15T23:54:51.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda32ffd640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda3c0b39a0 0x7fda3c09bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:51.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda3bfff640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda3c1587a0 0x7fda3c09c020 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fda3400c780 tx=0x7fda3400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:51.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda38ff9640 1 -- 172.21.15.112:0/1053207520 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda34004b70 con 0x7fda3c1587a0 2024-09-15T23:54:51.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda38ff9640 1 -- 172.21.15.112:0/1053207520 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda34004d10 con 0x7fda3c1587a0 2024-09-15T23:54:51.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 -- 172.21.15.112:0/1053207520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3c09b4c0 con 0x7fda3c1587a0 2024-09-15T23:54:51.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda38ff9640 1 -- 172.21.15.112:0/1053207520 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3400aa90 con 0x7fda3c1587a0 2024-09-15T23:54:51.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.171+0000 7fda42188640 1 -- 172.21.15.112:0/1053207520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3c0997d0 con 0x7fda3c1587a0 2024-09-15T23:54:51.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.175+0000 7fda42188640 1 -- 172.21.15.112:0/1053207520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda3c09dcf0 con 0x7fda3c1587a0 2024-09-15T23:54:51.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.175+0000 7fda38ff9640 1 -- 172.21.15.112:0/1053207520 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fda3400ac30 con 0x7fda3c1587a0 2024-09-15T23:54:51.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.175+0000 7fda38ff9640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fda1c0678c0 0x7fda1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.175+0000 7fda3b7fe640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fda1c0678c0 0x7fda1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.175+0000 7fda38ff9640 1 -- 172.21.15.112:0/1053207520 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fda340861c0 con 0x7fda3c1587a0 2024-09-15T23:54:51.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.175+0000 7fda3b7fe640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fda1c0678c0 0x7fda1c069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fda2c000f70 tx=0x7fda2c007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:51.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.179+0000 7fda38ff9640 1 -- 172.21.15.112:0/1053207520 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fda34020070 con 0x7fda3c1587a0 2024-09-15T23:54:51.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.339+0000 7fda42188640 1 -- 172.21.15.112:0/1053207520 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda3c099b20 con 0x7fda1c0678c0 2024-09-15T23:54:51.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.343+0000 7fda38ff9640 1 -- 172.21.15.112:0/1053207520 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7fda2c007da0 con 0x7fda1c0678c0 2024-09-15T23:54:51.352 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:51.354 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:54:51.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.347+0000 7fda42188640 1 -- 172.21.15.112:0/1053207520 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fda1c0678c0 msgr2=0x7fda1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.347+0000 7fda42188640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fda1c0678c0 0x7fda1c069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fda2c000f70 tx=0x7fda2c007c10 comp rx=0 tx=0).stop 2024-09-15T23:54:51.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.347+0000 7fda42188640 1 -- 172.21.15.112:0/1053207520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda3c1587a0 msgr2=0x7fda3c09c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.347+0000 7fda42188640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda3c1587a0 0x7fda3c09c020 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fda3400c780 tx=0x7fda3400cc40 comp rx=0 tx=0).stop 2024-09-15T23:54:51.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.351+0000 7fda42188640 1 -- 172.21.15.112:0/1053207520 shutdown_connections 2024-09-15T23:54:51.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.351+0000 7fda42188640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fda1c0678c0 0x7fda1c069d80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.351+0000 7fda42188640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda3c1587a0 0x7fda3c09c020 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.351+0000 7fda42188640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda3c0b39a0 0x7fda3c09bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.351+0000 7fda42188640 1 --2- 172.21.15.112:0/1053207520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda3c06e4b0 0x7fda3c1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.351+0000 7fda42188640 1 -- 172.21.15.112:0/1053207520 >> 172.21.15.112:0/1053207520 conn(0x7fda3c0b1f90 msgr2=0x7fda3c0aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:51.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.351+0000 7fda42188640 1 -- 172.21.15.112:0/1053207520 shutdown_connections 2024-09-15T23:54:51.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.351+0000 7fda42188640 1 -- 172.21.15.112:0/1053207520 wait complete. 2024-09-15T23:54:51.372 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-15T23:54:51.251423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225180,"kb_used_data":4776,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749540,"statfs":{"total":773094113280,"available":772863528960,"internally_reserved":0,"allocated":4890624,"data_stored":2750788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002260"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.624142+0000","last_change":"2024-09-15T23:54:43.666774+0000","last_active":"2024-09-15T23:54:44.624142+0000","last_peered":"2024-09-15T23:54:44.624142+0000","last_clean":"2024-09-15T23:54:44.624142+0000","last_became_active":"2024-09-15T23:54:43.665876+0000","last_became_peered":"2024-09-15T23:54:43.665876+0000","last_unstale":"2024-09-15T23:54:44.624142+0000","last_undegraded":"2024-09-15T23:54:44.624142+0000","last_fullsized":"2024-09-15T23:54:44.624142+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:25.221922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.706817+0000","last_change":"2024-09-15T23:54:43.669791+0000","last_active":"2024-09-15T23:54:44.706817+0000","last_peered":"2024-09-15T23:54:44.706817+0000","last_clean":"2024-09-15T23:54:44.706817+0000","last_became_active":"2024-09-15T23:54:43.669151+0000","last_became_peered":"2024-09-15T23:54:43.669151+0000","last_unstale":"2024-09-15T23:54:44.706817+0000","last_undegraded":"2024-09-15T23:54:44.706817+0000","last_fullsized":"2024-09-15T23:54:44.706817+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:50.700577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.624049+0000","last_change":"2024-09-15T23:54:43.658229+0000","last_active":"2024-09-15T23:54:44.624049+0000","last_peered":"2024-09-15T23:54:44.624049+0000","last_clean":"2024-09-15T23:54:44.624049+0000","last_became_active":"2024-09-15T23:54:43.657551+0000","last_became_peered":"2024-09-15T23:54:43.657551+0000","last_unstale":"2024-09-15T23:54:44.624049+0000","last_undegraded":"2024-09-15T23:54:44.624049+0000","last_fullsized":"2024-09-15T23:54:44.624049+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:36.360942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.622714+0000","last_change":"2024-09-15T23:54:43.672536+0000","last_active":"2024-09-15T23:54:44.622714+0000","last_peered":"2024-09-15T23:54:44.622714+0000","last_clean":"2024-09-15T23:54:44.622714+0000","last_became_active":"2024-09-15T23:54:43.671956+0000","last_became_peered":"2024-09-15T23:54:43.671956+0000","last_unstale":"2024-09-15T23:54:44.622714+0000","last_undegraded":"2024-09-15T23:54:44.622714+0000","last_fullsized":"2024-09-15T23:54:44.622714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:43.036489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.621545+0000","last_change":"2024-09-15T23:54:43.651070+0000","last_active":"2024-09-15T23:54:44.621545+0000","last_peered":"2024-09-15T23:54:44.621545+0000","last_clean":"2024-09-15T23:54:44.621545+0000","last_became_active":"2024-09-15T23:54:43.650351+0000","last_became_peered":"2024-09-15T23:54:43.650351+0000","last_unstale":"2024-09-15T23:54:44.621545+0000","last_undegraded":"2024-09-15T23:54:44.621545+0000","last_fullsized":"2024-09-15T23:54:44.621545+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:16.146341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.706338+0000","last_change":"2024-09-15T23:54:43.658663+0000","last_active":"2024-09-15T23:54:44.706338+0000","last_peered":"2024-09-15T23:54:44.706338+0000","last_clean":"2024-09-15T23:54:44.706338+0000","last_became_active":"2024-09-15T23:54:43.657995+0000","last_became_peered":"2024-09-15T23:54:43.657995+0000","last_unstale":"2024-09-15T23:54:44.706338+0000","last_undegraded":"2024-09-15T23:54:44.706338+0000","last_fullsized":"2024-09-15T23:54:44.706338+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:31.936628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703874+0000","last_change":"2024-09-15T23:54:43.637868+0000","last_active":"2024-09-15T23:54:44.703874+0000","last_peered":"2024-09-15T23:54:44.703874+0000","last_clean":"2024-09-15T23:54:44.703874+0000","last_became_active":"2024-09-15T23:54:43.637468+0000","last_became_peered":"2024-09-15T23:54:43.637468+0000","last_unstale":"2024-09-15T23:54:44.703874+0000","last_undegraded":"2024-09-15T23:54:44.703874+0000","last_fullsized":"2024-09-15T23:54:44.703874+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:31.056987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.622233+0000","last_change":"2024-09-15T23:54:43.672587+0000","last_active":"2024-09-15T23:54:44.622233+0000","last_peered":"2024-09-15T23:54:44.622233+0000","last_clean":"2024-09-15T23:54:44.622233+0000","last_became_active":"2024-09-15T23:54:43.671772+0000","last_became_peered":"2024-09-15T23:54:43.671772+0000","last_unstale":"2024-09-15T23:54:44.622233+0000","last_undegraded":"2024-09-15T23:54:44.622233+0000","last_fullsized":"2024-09-15T23:54:44.622233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:57.018948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.621217+0000","last_change":"2024-09-15T23:54:43.650837+0000","last_active":"2024-09-15T23:54:44.621217+0000","last_peered":"2024-09-15T23:54:44.621217+0000","last_clean":"2024-09-15T23:54:44.621217+0000","last_became_active":"2024-09-15T23:54:43.650113+0000","last_became_peered":"2024-09-15T23:54:43.650113+0000","last_unstale":"2024-09-15T23:54:44.621217+0000","last_undegraded":"2024-09-15T23:54:44.621217+0000","last_fullsized":"2024-09-15T23:54:44.621217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:55.655404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.704116+0000","last_change":"2024-09-15T23:54:43.641037+0000","last_active":"2024-09-15T23:54:44.704116+0000","last_peered":"2024-09-15T23:54:44.704116+0000","last_clean":"2024-09-15T23:54:44.704116+0000","last_became_active":"2024-09-15T23:54:43.640738+0000","last_became_peered":"2024-09-15T23:54:43.640738+0000","last_unstale":"2024-09-15T23:54:44.704116+0000","last_undegraded":"2024-09-15T23:54:44.704116+0000","last_fullsized":"2024-09-15T23:54:44.704116+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:57.007396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.704060+0000","last_change":"2024-09-15T23:54:43.639536+0000","last_active":"2024-09-15T23:54:44.704060+0000","last_peered":"2024-09-15T23:54:44.704060+0000","last_clean":"2024-09-15T23:54:44.704060+0000","last_became_active":"2024-09-15T23:54:43.636784+0000","last_became_peered":"2024-09-15T23:54:43.636784+0000","last_unstale":"2024-09-15T23:54:44.704060+0000","last_undegraded":"2024-09-15T23:54:44.704060+0000","last_fullsized":"2024-09-15T23:54:44.704060+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:59.226661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.621074+0000","last_change":"2024-09-15T23:54:43.677035+0000","last_active":"2024-09-15T23:54:44.621074+0000","last_peered":"2024-09-15T23:54:44.621074+0000","last_clean":"2024-09-15T23:54:44.621074+0000","last_became_active":"2024-09-15T23:54:43.676463+0000","last_became_peered":"2024-09-15T23:54:43.676463+0000","last_unstale":"2024-09-15T23:54:44.621074+0000","last_undegraded":"2024-09-15T23:54:44.621074+0000","last_fullsized":"2024-09-15T23:54:44.621074+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:25.006535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.704533+0000","last_change":"2024-09-15T23:54:43.658337+0000","last_active":"2024-09-15T23:54:44.704533+0000","last_peered":"2024-09-15T23:54:44.704533+0000","last_clean":"2024-09-15T23:54:44.704533+0000","last_became_active":"2024-09-15T23:54:43.658020+0000","last_became_peered":"2024-09-15T23:54:43.658020+0000","last_unstale":"2024-09-15T23:54:44.704533+0000","last_undegraded":"2024-09-15T23:54:44.704533+0000","last_fullsized":"2024-09-15T23:54:44.704533+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:04.885460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703321+0000","last_change":"2024-09-15T23:54:43.640668+0000","last_active":"2024-09-15T23:54:44.703321+0000","last_peered":"2024-09-15T23:54:44.703321+0000","last_clean":"2024-09-15T23:54:44.703321+0000","last_became_active":"2024-09-15T23:54:43.640362+0000","last_became_peered":"2024-09-15T23:54:43.640362+0000","last_unstale":"2024-09-15T23:54:44.703321+0000","last_undegraded":"2024-09-15T23:54:44.703321+0000","last_fullsized":"2024-09-15T23:54:44.703321+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:08.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.618410+0000","last_change":"2024-09-15T23:54:43.669305+0000","last_active":"2024-09-15T23:54:44.618410+0000","last_peered":"2024-09-15T23:54:44.618410+0000","last_clean":"2024-09-15T23:54:44.618410+0000","last_became_active":"2024-09-15T23:54:43.669057+0000","last_became_peered":"2024-09-15T23:54:43.669057+0000","last_unstale":"2024-09-15T23:54:44.618410+0000","last_undegraded":"2024-09-15T23:54:44.618410+0000","last_fullsized":"2024-09-15T23:54:44.618410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:54.906772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703572+0000","last_change":"2024-09-15T23:54:43.678254+0000","last_active":"2024-09-15T23:54:44.703572+0000","last_peered":"2024-09-15T23:54:44.703572+0000","last_clean":"2024-09-15T23:54:44.703572+0000","last_became_active":"2024-09-15T23:54:43.678013+0000","last_became_peered":"2024-09-15T23:54:43.678013+0000","last_unstale":"2024-09-15T23:54:44.703572+0000","last_undegraded":"2024-09-15T23:54:44.703572+0000","last_fullsized":"2024-09-15T23:54:44.703572+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:17.684911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.619943+0000","last_change":"2024-09-15T23:54:43.631179+0000","last_active":"2024-09-15T23:54:44.619943+0000","last_peered":"2024-09-15T23:54:44.619943+0000","last_clean":"2024-09-15T23:54:44.619943+0000","last_became_active":"2024-09-15T23:54:43.630496+0000","last_became_peered":"2024-09-15T23:54:43.630496+0000","last_unstale":"2024-09-15T23:54:44.619943+0000","last_undegraded":"2024-09-15T23:54:44.619943+0000","last_fullsized":"2024-09-15T23:54:44.619943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:40.514935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.619418+0000","last_change":"2024-09-15T23:54:43.628988+0000","last_active":"2024-09-15T23:54:44.619418+0000","last_peered":"2024-09-15T23:54:44.619418+0000","last_clean":"2024-09-15T23:54:44.619418+0000","last_became_active":"2024-09-15T23:54:43.628667+0000","last_became_peered":"2024-09-15T23:54:43.628667+0000","last_unstale":"2024-09-15T23:54:44.619418+0000","last_undegraded":"2024-09-15T23:54:44.619418+0000","last_fullsized":"2024-09-15T23:54:44.619418+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:56.399872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.706371+0000","last_change":"2024-09-15T23:54:43.680139+0000","last_active":"2024-09-15T23:54:44.706371+0000","last_peered":"2024-09-15T23:54:44.706371+0000","last_clean":"2024-09-15T23:54:44.706371+0000","last_became_active":"2024-09-15T23:54:43.679571+0000","last_became_peered":"2024-09-15T23:54:43.679571+0000","last_unstale":"2024-09-15T23:54:44.706371+0000","last_undegraded":"2024-09-15T23:54:44.706371+0000","last_fullsized":"2024-09-15T23:54:44.706371+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:52:48.376037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703390+0000","last_change":"2024-09-15T23:54:43.640856+0000","last_active":"2024-09-15T23:54:44.703390+0000","last_peered":"2024-09-15T23:54:44.703390+0000","last_clean":"2024-09-15T23:54:44.703390+0000","last_became_active":"2024-09-15T23:54:43.640593+0000","last_became_peered":"2024-09-15T23:54:43.640593+0000","last_unstale":"2024-09-15T23:54:44.703390+0000","last_undegraded":"2024-09-15T23:54:44.703390+0000","last_fullsized":"2024-09-15T23:54:44.703390+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:21.949038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703020+0000","last_change":"2024-09-15T23:54:43.680914+0000","last_active":"2024-09-15T23:54:44.703020+0000","last_peered":"2024-09-15T23:54:44.703020+0000","last_clean":"2024-09-15T23:54:44.703020+0000","last_became_active":"2024-09-15T23:54:43.680603+0000","last_became_peered":"2024-09-15T23:54:43.680603+0000","last_unstale":"2024-09-15T23:54:44.703020+0000","last_undegraded":"2024-09-15T23:54:44.703020+0000","last_fullsized":"2024-09-15T23:54:44.703020+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:02:27.335899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.702766+0000","last_change":"2024-09-15T23:54:43.668953+0000","last_active":"2024-09-15T23:54:44.702766+0000","last_peered":"2024-09-15T23:54:44.702766+0000","last_clean":"2024-09-15T23:54:44.702766+0000","last_became_active":"2024-09-15T23:54:43.668662+0000","last_became_peered":"2024-09-15T23:54:43.668662+0000","last_unstale":"2024-09-15T23:54:44.702766+0000","last_undegraded":"2024-09-15T23:54:44.702766+0000","last_fullsized":"2024-09-15T23:54:44.702766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:31.936628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.618587+0000","last_change":"2024-09-15T23:54:43.647006+0000","last_active":"2024-09-15T23:54:44.618587+0000","last_peered":"2024-09-15T23:54:44.618587+0000","last_clean":"2024-09-15T23:54:44.618587+0000","last_became_active":"2024-09-15T23:54:43.646809+0000","last_became_peered":"2024-09-15T23:54:43.646809+0000","last_unstale":"2024-09-15T23:54:44.618587+0000","last_undegraded":"2024-09-15T23:54:44.618587+0000","last_fullsized":"2024-09-15T23:54:44.618587+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:18.408780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.622631+0000","last_change":"2024-09-15T23:54:43.665724+0000","last_active":"2024-09-15T23:54:44.622631+0000","last_peered":"2024-09-15T23:54:44.622631+0000","last_clean":"2024-09-15T23:54:44.622631+0000","last_became_active":"2024-09-15T23:54:43.665067+0000","last_became_peered":"2024-09-15T23:54:43.665067+0000","last_unstale":"2024-09-15T23:54:44.622631+0000","last_undegraded":"2024-09-15T23:54:44.622631+0000","last_fullsized":"2024-09-15T23:54:44.622631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:15.237664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703461+0000","last_change":"2024-09-15T23:54:43.668148+0000","last_active":"2024-09-15T23:54:44.703461+0000","last_peered":"2024-09-15T23:54:44.703461+0000","last_clean":"2024-09-15T23:54:44.703461+0000","last_became_active":"2024-09-15T23:54:43.667833+0000","last_became_peered":"2024-09-15T23:54:43.667833+0000","last_unstale":"2024-09-15T23:54:44.703461+0000","last_undegraded":"2024-09-15T23:54:44.703461+0000","last_fullsized":"2024-09-15T23:54:44.703461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:04.885460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.623828+0000","last_change":"2024-09-15T23:54:43.671918+0000","last_active":"2024-09-15T23:54:44.623828+0000","last_peered":"2024-09-15T23:54:44.623828+0000","last_clean":"2024-09-15T23:54:44.623828+0000","last_became_active":"2024-09-15T23:54:43.666846+0000","last_became_peered":"2024-09-15T23:54:43.666846+0000","last_unstale":"2024-09-15T23:54:44.623828+0000","last_undegraded":"2024-09-15T23:54:44.623828+0000","last_fullsized":"2024-09-15T23:54:44.623828+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:02.907418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.704270+0000","last_change":"2024-09-15T23:54:43.651577+0000","last_active":"2024-09-15T23:54:44.704270+0000","last_peered":"2024-09-15T23:54:44.704270+0000","last_clean":"2024-09-15T23:54:44.704270+0000","last_became_active":"2024-09-15T23:54:43.651254+0000","last_became_peered":"2024-09-15T23:54:43.651254+0000","last_unstale":"2024-09-15T23:54:44.704270+0000","last_undegraded":"2024-09-15T23:54:44.704270+0000","last_fullsized":"2024-09-15T23:54:44.704270+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:26.378086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.704501+0000","last_change":"2024-09-15T23:54:43.672947+0000","last_active":"2024-09-15T23:54:44.704501+0000","last_peered":"2024-09-15T23:54:44.704501+0000","last_clean":"2024-09-15T23:54:44.704501+0000","last_became_active":"2024-09-15T23:54:43.672703+0000","last_became_peered":"2024-09-15T23:54:43.672703+0000","last_unstale":"2024-09-15T23:54:44.704501+0000","last_undegraded":"2024-09-15T23:54:44.704501+0000","last_fullsized":"2024-09-15T23:54:44.704501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:08.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.619081+0000","last_change":"2024-09-15T23:54:43.652965+0000","last_active":"2024-09-15T23:54:44.619081+0000","last_peered":"2024-09-15T23:54:44.619081+0000","last_clean":"2024-09-15T23:54:44.619081+0000","last_became_active":"2024-09-15T23:54:43.652697+0000","last_became_peered":"2024-09-15T23:54:43.652697+0000","last_unstale":"2024-09-15T23:54:44.619081+0000","last_undegraded":"2024-09-15T23:54:44.619081+0000","last_fullsized":"2024-09-15T23:54:44.619081+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:00.189281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.619852+0000","last_change":"2024-09-15T23:54:43.646314+0000","last_active":"2024-09-15T23:54:44.619852+0000","last_peered":"2024-09-15T23:54:44.619852+0000","last_clean":"2024-09-15T23:54:44.619852+0000","last_became_active":"2024-09-15T23:54:43.646050+0000","last_became_peered":"2024-09-15T23:54:43.646050+0000","last_unstale":"2024-09-15T23:54:44.619852+0000","last_undegraded":"2024-09-15T23:54:44.619852+0000","last_fullsized":"2024-09-15T23:54:44.619852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:32.180703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703916+0000","last_change":"2024-09-15T23:54:43.674939+0000","last_active":"2024-09-15T23:54:44.703916+0000","last_peered":"2024-09-15T23:54:44.703916+0000","last_clean":"2024-09-15T23:54:44.703916+0000","last_became_active":"2024-09-15T23:54:43.674692+0000","last_became_peered":"2024-09-15T23:54:43.674692+0000","last_unstale":"2024-09-15T23:54:44.703916+0000","last_undegraded":"2024-09-15T23:54:44.703916+0000","last_fullsized":"2024-09-15T23:54:44.703916+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:03.360218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.623022+0000","last_change":"2024-09-15T23:54:43.657536+0000","last_active":"2024-09-15T23:54:44.623022+0000","last_peered":"2024-09-15T23:54:44.623022+0000","last_clean":"2024-09-15T23:54:44.623022+0000","last_became_active":"2024-09-15T23:54:43.650847+0000","last_became_peered":"2024-09-15T23:54:43.650847+0000","last_unstale":"2024-09-15T23:54:44.623022+0000","last_undegraded":"2024-09-15T23:54:44.623022+0000","last_fullsized":"2024-09-15T23:54:44.623022+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:48.470959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.619232+0000","last_change":"2024-09-15T23:54:43.635951+0000","last_active":"2024-09-15T23:54:44.619232+0000","last_peered":"2024-09-15T23:54:44.619232+0000","last_clean":"2024-09-15T23:54:44.619232+0000","last_became_active":"2024-09-15T23:54:43.635781+0000","last_became_peered":"2024-09-15T23:54:43.635781+0000","last_unstale":"2024-09-15T23:54:44.619232+0000","last_undegraded":"2024-09-15T23:54:44.619232+0000","last_fullsized":"2024-09-15T23:54:44.619232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:03.680670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703512+0000","last_change":"2024-09-15T23:54:42.603087+0000","last_active":"2024-09-15T23:54:44.703512+0000","last_peered":"2024-09-15T23:54:44.703512+0000","last_clean":"2024-09-15T23:54:44.703512+0000","last_became_active":"2024-09-15T23:54:42.602691+0000","last_became_peered":"2024-09-15T23:54:42.602691+0000","last_unstale":"2024-09-15T23:54:44.703512+0000","last_undegraded":"2024-09-15T23:54:44.703512+0000","last_fullsized":"2024-09-15T23:54:44.703512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:14.792784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.706149+0000","last_change":"2024-09-15T23:54:43.643378+0000","last_active":"2024-09-15T23:54:44.706149+0000","last_peered":"2024-09-15T23:54:44.706149+0000","last_clean":"2024-09-15T23:54:44.706149+0000","last_became_active":"2024-09-15T23:54:43.642541+0000","last_became_peered":"2024-09-15T23:54:43.642541+0000","last_unstale":"2024-09-15T23:54:44.706149+0000","last_undegraded":"2024-09-15T23:54:44.706149+0000","last_fullsized":"2024-09-15T23:54:44.706149+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:00.991165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.706948+0000","last_change":"2024-09-15T23:54:42.603652+0000","last_active":"2024-09-15T23:54:44.706948+0000","last_peered":"2024-09-15T23:54:44.706948+0000","last_clean":"2024-09-15T23:54:44.706948+0000","last_became_active":"2024-09-15T23:54:42.603047+0000","last_became_peered":"2024-09-15T23:54:42.603047+0000","last_unstale":"2024-09-15T23:54:44.706948+0000","last_undegraded":"2024-09-15T23:54:44.706948+0000","last_fullsized":"2024-09-15T23:54:44.706948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:14.792784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.619643+0000","last_change":"2024-09-15T23:54:43.637123+0000","last_active":"2024-09-15T23:54:44.619643+0000","last_peered":"2024-09-15T23:54:44.619643+0000","last_clean":"2024-09-15T23:54:44.619643+0000","last_became_active":"2024-09-15T23:54:43.636836+0000","last_became_peered":"2024-09-15T23:54:43.636836+0000","last_unstale":"2024-09-15T23:54:44.619643+0000","last_undegraded":"2024-09-15T23:54:44.619643+0000","last_fullsized":"2024-09-15T23:54:44.619643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:41.068343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.624293+0000","last_change":"2024-09-15T23:54:42.625060+0000","last_active":"2024-09-15T23:54:44.624293+0000","last_peered":"2024-09-15T23:54:44.624293+0000","last_clean":"2024-09-15T23:54:44.624293+0000","last_became_active":"2024-09-15T23:54:42.624313+0000","last_became_peered":"2024-09-15T23:54:42.624313+0000","last_unstale":"2024-09-15T23:54:44.624293+0000","last_undegraded":"2024-09-15T23:54:44.624293+0000","last_fullsized":"2024-09-15T23:54:44.624293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:38.798300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.706410+0000","last_change":"2024-09-15T23:54:43.643735+0000","last_active":"2024-09-15T23:54:44.706410+0000","last_peered":"2024-09-15T23:54:44.706410+0000","last_clean":"2024-09-15T23:54:44.706410+0000","last_became_active":"2024-09-15T23:54:43.642717+0000","last_became_peered":"2024-09-15T23:54:43.642717+0000","last_unstale":"2024-09-15T23:54:44.706410+0000","last_undegraded":"2024-09-15T23:54:44.706410+0000","last_fullsized":"2024-09-15T23:54:44.706410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:56.166523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703367+0000","last_change":"2024-09-15T23:54:42.621654+0000","last_active":"2024-09-15T23:54:44.703367+0000","last_peered":"2024-09-15T23:54:44.703367+0000","last_clean":"2024-09-15T23:54:44.703367+0000","last_became_active":"2024-09-15T23:54:42.621285+0000","last_became_peered":"2024-09-15T23:54:42.621285+0000","last_unstale":"2024-09-15T23:54:44.703367+0000","last_undegraded":"2024-09-15T23:54:44.703367+0000","last_fullsized":"2024-09-15T23:54:44.703367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:34.417323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.623392+0000","last_change":"2024-09-15T23:54:43.678051+0000","last_active":"2024-09-15T23:54:44.623392+0000","last_peered":"2024-09-15T23:54:44.623392+0000","last_clean":"2024-09-15T23:54:44.623392+0000","last_became_active":"2024-09-15T23:54:43.677319+0000","last_became_peered":"2024-09-15T23:54:43.677319+0000","last_unstale":"2024-09-15T23:54:44.623392+0000","last_undegraded":"2024-09-15T23:54:44.623392+0000","last_fullsized":"2024-09-15T23:54:44.623392+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:31.522539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703126+0000","last_change":"2024-09-15T23:54:42.601838+0000","last_active":"2024-09-15T23:54:44.703126+0000","last_peered":"2024-09-15T23:54:44.703126+0000","last_clean":"2024-09-15T23:54:44.703126+0000","last_became_active":"2024-09-15T23:54:42.601580+0000","last_became_peered":"2024-09-15T23:54:42.601580+0000","last_unstale":"2024-09-15T23:54:44.703126+0000","last_undegraded":"2024-09-15T23:54:44.703126+0000","last_fullsized":"2024-09-15T23:54:44.703126+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:16.673465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.702805+0000","last_change":"2024-09-15T23:54:43.647396+0000","last_active":"2024-09-15T23:54:44.702805+0000","last_peered":"2024-09-15T23:54:44.702805+0000","last_clean":"2024-09-15T23:54:44.702805+0000","last_became_active":"2024-09-15T23:54:43.647101+0000","last_became_peered":"2024-09-15T23:54:43.647101+0000","last_unstale":"2024-09-15T23:54:44.702805+0000","last_undegraded":"2024-09-15T23:54:44.702805+0000","last_fullsized":"2024-09-15T23:54:44.702805+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:56.166523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.704215+0000","last_change":"2024-09-15T23:54:42.627071+0000","last_active":"2024-09-15T23:54:44.704215+0000","last_peered":"2024-09-15T23:54:44.704215+0000","last_clean":"2024-09-15T23:54:44.704215+0000","last_became_active":"2024-09-15T23:54:42.626584+0000","last_became_peered":"2024-09-15T23:54:42.626584+0000","last_unstale":"2024-09-15T23:54:44.704215+0000","last_undegraded":"2024-09-15T23:54:44.704215+0000","last_fullsized":"2024-09-15T23:54:44.704215+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:11.254409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.619495+0000","last_change":"2024-09-15T23:54:43.631269+0000","last_active":"2024-09-15T23:54:44.619495+0000","last_peered":"2024-09-15T23:54:44.619495+0000","last_clean":"2024-09-15T23:54:44.619495+0000","last_became_active":"2024-09-15T23:54:43.630993+0000","last_became_peered":"2024-09-15T23:54:43.630993+0000","last_unstale":"2024-09-15T23:54:44.619495+0000","last_undegraded":"2024-09-15T23:54:44.619495+0000","last_fullsized":"2024-09-15T23:54:44.619495+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:22.091647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.621814+0000","last_change":"2024-09-15T23:54:42.611939+0000","last_active":"2024-09-15T23:54:44.621814+0000","last_peered":"2024-09-15T23:54:44.621814+0000","last_clean":"2024-09-15T23:54:44.621814+0000","last_became_active":"2024-09-15T23:54:42.611180+0000","last_became_peered":"2024-09-15T23:54:42.611180+0000","last_unstale":"2024-09-15T23:54:44.621814+0000","last_undegraded":"2024-09-15T23:54:44.621814+0000","last_fullsized":"2024-09-15T23:54:44.621814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:07.254369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.705620+0000","last_change":"2024-09-15T23:54:43.658082+0000","last_active":"2024-09-15T23:54:44.705620+0000","last_peered":"2024-09-15T23:54:44.705620+0000","last_clean":"2024-09-15T23:54:44.705620+0000","last_became_active":"2024-09-15T23:54:43.656463+0000","last_became_peered":"2024-09-15T23:54:43.656463+0000","last_unstale":"2024-09-15T23:54:44.705620+0000","last_undegraded":"2024-09-15T23:54:44.705620+0000","last_fullsized":"2024-09-15T23:54:44.705620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:02.241689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703579+0000","last_change":"2024-09-15T23:54:42.597005+0000","last_active":"2024-09-15T23:54:44.703579+0000","last_peered":"2024-09-15T23:54:44.703579+0000","last_clean":"2024-09-15T23:54:44.703579+0000","last_became_active":"2024-09-15T23:54:42.596627+0000","last_became_peered":"2024-09-15T23:54:42.596627+0000","last_unstale":"2024-09-15T23:54:44.703579+0000","last_undegraded":"2024-09-15T23:54:44.703579+0000","last_fullsized":"2024-09-15T23:54:44.703579+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:26.732611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.622721+0000","last_change":"2024-09-15T23:54:43.658368+0000","last_active":"2024-09-15T23:54:44.622721+0000","last_peered":"2024-09-15T23:54:44.622721+0000","last_clean":"2024-09-15T23:54:44.622721+0000","last_became_active":"2024-09-15T23:54:43.650724+0000","last_became_peered":"2024-09-15T23:54:43.650724+0000","last_unstale":"2024-09-15T23:54:44.622721+0000","last_undegraded":"2024-09-15T23:54:44.622721+0000","last_fullsized":"2024-09-15T23:54:44.622721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:49.876781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.623957+0000","last_change":"2024-09-15T23:54:42.624959+0000","last_active":"2024-09-15T23:54:44.623957+0000","last_peered":"2024-09-15T23:54:44.623957+0000","last_clean":"2024-09-15T23:54:44.623957+0000","last_became_active":"2024-09-15T23:54:42.624107+0000","last_became_peered":"2024-09-15T23:54:42.624107+0000","last_unstale":"2024-09-15T23:54:44.623957+0000","last_undegraded":"2024-09-15T23:54:44.623957+0000","last_fullsized":"2024-09-15T23:54:44.623957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:28.523942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.704610+0000","last_change":"2024-09-15T23:54:43.634620+0000","last_active":"2024-09-15T23:54:44.704610+0000","last_peered":"2024-09-15T23:54:44.704610+0000","last_clean":"2024-09-15T23:54:44.704610+0000","last_became_active":"2024-09-15T23:54:43.634284+0000","last_became_peered":"2024-09-15T23:54:43.634284+0000","last_unstale":"2024-09-15T23:54:44.704610+0000","last_undegraded":"2024-09-15T23:54:44.704610+0000","last_fullsized":"2024-09-15T23:54:44.704610+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:44.483323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.619409+0000","last_change":"2024-09-15T23:54:42.605069+0000","last_active":"2024-09-15T23:54:44.619409+0000","last_peered":"2024-09-15T23:54:44.619409+0000","last_clean":"2024-09-15T23:54:44.619409+0000","last_became_active":"2024-09-15T23:54:42.604503+0000","last_became_peered":"2024-09-15T23:54:42.604503+0000","last_unstale":"2024-09-15T23:54:44.619409+0000","last_undegraded":"2024-09-15T23:54:44.619409+0000","last_fullsized":"2024-09-15T23:54:44.619409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:50.769934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.623794+0000","last_change":"2024-09-15T23:54:43.671661+0000","last_active":"2024-09-15T23:54:44.623794+0000","last_peered":"2024-09-15T23:54:44.623794+0000","last_clean":"2024-09-15T23:54:44.623794+0000","last_became_active":"2024-09-15T23:54:43.666649+0000","last_became_peered":"2024-09-15T23:54:43.666649+0000","last_unstale":"2024-09-15T23:54:44.623794+0000","last_undegraded":"2024-09-15T23:54:44.623794+0000","last_fullsized":"2024-09-15T23:54:44.623794+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:10.666062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.618796+0000","last_change":"2024-09-15T23:54:42.626955+0000","last_active":"2024-09-15T23:54:44.618796+0000","last_peered":"2024-09-15T23:54:44.618796+0000","last_clean":"2024-09-15T23:54:44.618796+0000","last_became_active":"2024-09-15T23:54:42.626378+0000","last_became_peered":"2024-09-15T23:54:42.626378+0000","last_unstale":"2024-09-15T23:54:44.618796+0000","last_undegraded":"2024-09-15T23:54:44.618796+0000","last_fullsized":"2024-09-15T23:54:44.618796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:41.491603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703869+0000","last_change":"2024-09-15T23:54:43.647810+0000","last_active":"2024-09-15T23:54:44.703869+0000","last_peered":"2024-09-15T23:54:44.703869+0000","last_clean":"2024-09-15T23:54:44.703869+0000","last_became_active":"2024-09-15T23:54:43.647559+0000","last_became_peered":"2024-09-15T23:54:43.647559+0000","last_unstale":"2024-09-15T23:54:44.703869+0000","last_undegraded":"2024-09-15T23:54:44.703869+0000","last_fullsized":"2024-09-15T23:54:44.703869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:35.428769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.623169+0000","last_change":"2024-09-15T23:54:42.621794+0000","last_active":"2024-09-15T23:54:44.623169+0000","last_peered":"2024-09-15T23:54:44.623169+0000","last_clean":"2024-09-15T23:54:44.623169+0000","last_became_active":"2024-09-15T23:54:42.621085+0000","last_became_peered":"2024-09-15T23:54:42.621085+0000","last_unstale":"2024-09-15T23:54:44.623169+0000","last_undegraded":"2024-09-15T23:54:44.623169+0000","last_fullsized":"2024-09-15T23:54:44.623169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:25.577766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.623996+0000","last_change":"2024-09-15T23:54:43.657690+0000","last_active":"2024-09-15T23:54:44.623996+0000","last_peered":"2024-09-15T23:54:44.623996+0000","last_clean":"2024-09-15T23:54:44.623996+0000","last_became_active":"2024-09-15T23:54:43.650910+0000","last_became_peered":"2024-09-15T23:54:43.650910+0000","last_unstale":"2024-09-15T23:54:44.623996+0000","last_undegraded":"2024-09-15T23:54:44.623996+0000","last_fullsized":"2024-09-15T23:54:44.623996+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:21.904942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.622139+0000","last_change":"2024-09-15T23:54:42.616261+0000","last_active":"2024-09-15T23:54:44.622139+0000","last_peered":"2024-09-15T23:54:44.622139+0000","last_clean":"2024-09-15T23:54:44.622139+0000","last_became_active":"2024-09-15T23:54:42.615529+0000","last_became_peered":"2024-09-15T23:54:42.615529+0000","last_unstale":"2024-09-15T23:54:44.622139+0000","last_undegraded":"2024-09-15T23:54:44.622139+0000","last_fullsized":"2024-09-15T23:54:44.622139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:03.874014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.705192+0000","last_change":"2024-09-15T23:54:43.669009+0000","last_active":"2024-09-15T23:54:44.705192+0000","last_peered":"2024-09-15T23:54:44.705192+0000","last_clean":"2024-09-15T23:54:44.705192+0000","last_became_active":"2024-09-15T23:54:43.667776+0000","last_became_peered":"2024-09-15T23:54:43.667776+0000","last_unstale":"2024-09-15T23:54:44.705192+0000","last_undegraded":"2024-09-15T23:54:44.705192+0000","last_fullsized":"2024-09-15T23:54:44.705192+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:49.567963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.705819+0000","last_change":"2024-09-15T23:54:42.601025+0000","last_active":"2024-09-15T23:54:44.705819+0000","last_peered":"2024-09-15T23:54:44.705819+0000","last_clean":"2024-09-15T23:54:44.705819+0000","last_became_active":"2024-09-15T23:54:42.599974+0000","last_became_peered":"2024-09-15T23:54:42.599974+0000","last_unstale":"2024-09-15T23:54:44.705819+0000","last_undegraded":"2024-09-15T23:54:44.705819+0000","last_fullsized":"2024-09-15T23:54:44.705819+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:34.417323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703099+0000","last_change":"2024-09-15T23:54:43.642124+0000","last_active":"2024-09-15T23:54:44.703099+0000","last_peered":"2024-09-15T23:54:44.703099+0000","last_clean":"2024-09-15T23:54:44.703099+0000","last_became_active":"2024-09-15T23:54:43.641863+0000","last_became_peered":"2024-09-15T23:54:43.641863+0000","last_unstale":"2024-09-15T23:54:44.703099+0000","last_undegraded":"2024-09-15T23:54:44.703099+0000","last_fullsized":"2024-09-15T23:54:44.703099+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:32.987095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.618676+0000","last_change":"2024-09-15T23:54:42.597340+0000","last_active":"2024-09-15T23:54:44.618676+0000","last_peered":"2024-09-15T23:54:44.618676+0000","last_clean":"2024-09-15T23:54:44.618676+0000","last_became_active":"2024-09-15T23:54:42.596908+0000","last_became_peered":"2024-09-15T23:54:42.596908+0000","last_unstale":"2024-09-15T23:54:44.618676+0000","last_undegraded":"2024-09-15T23:54:44.618676+0000","last_fullsized":"2024-09-15T23:54:44.618676+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:40.885229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.621362+0000","last_change":"2024-09-15T23:54:43.677377+0000","last_active":"2024-09-15T23:54:44.621362+0000","last_peered":"2024-09-15T23:54:44.621362+0000","last_clean":"2024-09-15T23:54:44.621362+0000","last_became_active":"2024-09-15T23:54:43.676667+0000","last_became_peered":"2024-09-15T23:54:43.676667+0000","last_unstale":"2024-09-15T23:54:44.621362+0000","last_undegraded":"2024-09-15T23:54:44.621362+0000","last_fullsized":"2024-09-15T23:54:44.621362+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:13.211799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.704629+0000","last_change":"2024-09-15T23:54:42.591210+0000","last_active":"2024-09-15T23:54:44.704629+0000","last_peered":"2024-09-15T23:54:44.704629+0000","last_clean":"2024-09-15T23:54:44.704629+0000","last_became_active":"2024-09-15T23:54:42.590512+0000","last_became_peered":"2024-09-15T23:54:42.590512+0000","last_unstale":"2024-09-15T23:54:44.704629+0000","last_undegraded":"2024-09-15T23:54:44.704629+0000","last_fullsized":"2024-09-15T23:54:44.704629+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:30.045540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.706208+0000","last_change":"2024-09-15T23:54:43.667252+0000","last_active":"2024-09-15T23:54:44.706208+0000","last_peered":"2024-09-15T23:54:44.706208+0000","last_clean":"2024-09-15T23:54:44.706208+0000","last_became_active":"2024-09-15T23:54:43.659011+0000","last_became_peered":"2024-09-15T23:54:43.659011+0000","last_unstale":"2024-09-15T23:54:44.706208+0000","last_undegraded":"2024-09-15T23:54:44.706208+0000","last_fullsized":"2024-09-15T23:54:44.706208+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:05.527477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703974+0000","last_change":"2024-09-15T23:54:42.602026+0000","last_active":"2024-09-15T23:54:44.703974+0000","last_peered":"2024-09-15T23:54:44.703974+0000","last_clean":"2024-09-15T23:54:44.703974+0000","last_became_active":"2024-09-15T23:54:42.601654+0000","last_became_peered":"2024-09-15T23:54:42.601654+0000","last_unstale":"2024-09-15T23:54:44.703974+0000","last_undegraded":"2024-09-15T23:54:44.703974+0000","last_fullsized":"2024-09-15T23:54:44.703974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:36.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703882+0000","last_change":"2024-09-15T23:54:43.665585+0000","last_active":"2024-09-15T23:54:44.703882+0000","last_peered":"2024-09-15T23:54:44.703882+0000","last_clean":"2024-09-15T23:54:44.703882+0000","last_became_active":"2024-09-15T23:54:43.665240+0000","last_became_peered":"2024-09-15T23:54:43.665240+0000","last_unstale":"2024-09-15T23:54:44.703882+0000","last_undegraded":"2024-09-15T23:54:44.703882+0000","last_fullsized":"2024-09-15T23:54:44.703882+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:15.804231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.619653+0000","last_change":"2024-09-15T23:54:42.627305+0000","last_active":"2024-09-15T23:54:44.619653+0000","last_peered":"2024-09-15T23:54:44.619653+0000","last_clean":"2024-09-15T23:54:44.619653+0000","last_became_active":"2024-09-15T23:54:42.627061+0000","last_became_peered":"2024-09-15T23:54:42.627061+0000","last_unstale":"2024-09-15T23:54:44.619653+0000","last_undegraded":"2024-09-15T23:54:44.619653+0000","last_fullsized":"2024-09-15T23:54:44.619653+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:47.285819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.704309+0000","last_change":"2024-09-15T23:54:43.668779+0000","last_active":"2024-09-15T23:54:44.704309+0000","last_peered":"2024-09-15T23:54:44.704309+0000","last_clean":"2024-09-15T23:54:44.704309+0000","last_became_active":"2024-09-15T23:54:43.668438+0000","last_became_peered":"2024-09-15T23:54:43.668438+0000","last_unstale":"2024-09-15T23:54:44.704309+0000","last_undegraded":"2024-09-15T23:54:44.704309+0000","last_fullsized":"2024-09-15T23:54:44.704309+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:32.953360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.620824+0000","last_change":"2024-09-15T23:54:42.607764+0000","last_active":"2024-09-15T23:54:44.620824+0000","last_peered":"2024-09-15T23:54:44.620824+0000","last_clean":"2024-09-15T23:54:44.620824+0000","last_became_active":"2024-09-15T23:54:42.607054+0000","last_became_peered":"2024-09-15T23:54:42.607054+0000","last_unstale":"2024-09-15T23:54:44.620824+0000","last_undegraded":"2024-09-15T23:54:44.620824+0000","last_fullsized":"2024-09-15T23:54:44.620824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:11.254409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.705704+0000","last_change":"2024-09-15T23:54:43.670168+0000","last_active":"2024-09-15T23:54:44.705704+0000","last_peered":"2024-09-15T23:54:44.705704+0000","last_clean":"2024-09-15T23:54:44.705704+0000","last_became_active":"2024-09-15T23:54:43.669153+0000","last_became_peered":"2024-09-15T23:54:43.669153+0000","last_unstale":"2024-09-15T23:54:44.705704+0000","last_undegraded":"2024-09-15T23:54:44.705704+0000","last_fullsized":"2024-09-15T23:54:44.705704+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:11.346103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.704827+0000","last_change":"2024-09-15T23:54:42.607654+0000","last_active":"2024-09-15T23:54:44.704827+0000","last_peered":"2024-09-15T23:54:44.704827+0000","last_clean":"2024-09-15T23:54:44.704827+0000","last_became_active":"2024-09-15T23:54:42.606368+0000","last_became_peered":"2024-09-15T23:54:42.606368+0000","last_unstale":"2024-09-15T23:54:44.704827+0000","last_undegraded":"2024-09-15T23:54:44.704827+0000","last_fullsized":"2024-09-15T23:54:44.704827+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:08.906793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.618549+0000","last_change":"2024-09-15T23:54:43.643428+0000","last_active":"2024-09-15T23:54:44.618549+0000","last_peered":"2024-09-15T23:54:44.618549+0000","last_clean":"2024-09-15T23:54:44.618549+0000","last_became_active":"2024-09-15T23:54:43.643158+0000","last_became_peered":"2024-09-15T23:54:43.643158+0000","last_unstale":"2024-09-15T23:54:44.618549+0000","last_undegraded":"2024-09-15T23:54:44.618549+0000","last_fullsized":"2024-09-15T23:54:44.618549+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:48.309417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.705513+0000","last_change":"2024-09-15T23:54:42.613195+0000","last_active":"2024-09-15T23:54:44.705513+0000","last_peered":"2024-09-15T23:54:44.705513+0000","last_clean":"2024-09-15T23:54:44.705513+0000","last_became_active":"2024-09-15T23:54:42.612493+0000","last_became_peered":"2024-09-15T23:54:42.612493+0000","last_unstale":"2024-09-15T23:54:44.705513+0000","last_undegraded":"2024-09-15T23:54:44.705513+0000","last_fullsized":"2024-09-15T23:54:44.705513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:02.394355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.621566+0000","last_change":"2024-09-15T23:54:43.657288+0000","last_active":"2024-09-15T23:54:44.621566+0000","last_peered":"2024-09-15T23:54:44.621566+0000","last_clean":"2024-09-15T23:54:44.621566+0000","last_became_active":"2024-09-15T23:54:43.656050+0000","last_became_peered":"2024-09-15T23:54:43.656050+0000","last_unstale":"2024-09-15T23:54:44.621566+0000","last_undegraded":"2024-09-15T23:54:44.621566+0000","last_fullsized":"2024-09-15T23:54:44.621566+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:41.662260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.705560+0000","last_change":"2024-09-15T23:54:42.598953+0000","last_active":"2024-09-15T23:54:44.705560+0000","last_peered":"2024-09-15T23:54:44.705560+0000","last_clean":"2024-09-15T23:54:44.705560+0000","last_became_active":"2024-09-15T23:54:42.597704+0000","last_became_peered":"2024-09-15T23:54:42.597704+0000","last_unstale":"2024-09-15T23:54:44.705560+0000","last_undegraded":"2024-09-15T23:54:44.705560+0000","last_fullsized":"2024-09-15T23:54:44.705560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:16.673465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.702902+0000","last_change":"2024-09-15T23:54:43.636074+0000","last_active":"2024-09-15T23:54:44.702902+0000","last_peered":"2024-09-15T23:54:44.702902+0000","last_clean":"2024-09-15T23:54:44.702902+0000","last_became_active":"2024-09-15T23:54:43.635810+0000","last_became_peered":"2024-09-15T23:54:43.635810+0000","last_unstale":"2024-09-15T23:54:44.702902+0000","last_undegraded":"2024-09-15T23:54:44.702902+0000","last_fullsized":"2024-09-15T23:54:44.702902+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:50.700577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.704032+0000","last_change":"2024-09-15T23:54:42.596955+0000","last_active":"2024-09-15T23:54:44.704032+0000","last_peered":"2024-09-15T23:54:44.704032+0000","last_clean":"2024-09-15T23:54:44.704032+0000","last_became_active":"2024-09-15T23:54:42.596647+0000","last_became_peered":"2024-09-15T23:54:42.596647+0000","last_unstale":"2024-09-15T23:54:44.704032+0000","last_undegraded":"2024-09-15T23:54:44.704032+0000","last_fullsized":"2024-09-15T23:54:44.704032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:36.958781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.621977+0000","last_change":"2024-09-15T23:54:43.659071+0000","last_active":"2024-09-15T23:54:44.621977+0000","last_peered":"2024-09-15T23:54:44.621977+0000","last_clean":"2024-09-15T23:54:44.621977+0000","last_became_active":"2024-09-15T23:54:43.656622+0000","last_became_peered":"2024-09-15T23:54:43.656622+0000","last_unstale":"2024-09-15T23:54:44.621977+0000","last_undegraded":"2024-09-15T23:54:44.621977+0000","last_fullsized":"2024-09-15T23:54:44.621977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:07.922494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.704861+0000","last_change":"2024-09-15T23:54:42.628542+0000","last_active":"2024-09-15T23:54:44.704861+0000","last_peered":"2024-09-15T23:54:44.704861+0000","last_clean":"2024-09-15T23:54:44.704861+0000","last_became_active":"2024-09-15T23:54:42.627924+0000","last_became_peered":"2024-09-15T23:54:42.627924+0000","last_unstale":"2024-09-15T23:54:44.704861+0000","last_undegraded":"2024-09-15T23:54:44.704861+0000","last_fullsized":"2024-09-15T23:54:44.704861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:15.134895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.621522+0000","last_change":"2024-09-15T23:54:43.643031+0000","last_active":"2024-09-15T23:54:44.621522+0000","last_peered":"2024-09-15T23:54:44.621522+0000","last_clean":"2024-09-15T23:54:44.621522+0000","last_became_active":"2024-09-15T23:54:43.642329+0000","last_became_peered":"2024-09-15T23:54:43.642329+0000","last_unstale":"2024-09-15T23:54:44.621522+0000","last_undegraded":"2024-09-15T23:54:44.621522+0000","last_fullsized":"2024-09-15T23:54:44.621522+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:17.684911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.620071+0000","last_change":"2024-09-15T23:54:42.603521+0000","last_active":"2024-09-15T23:54:44.620071+0000","last_peered":"2024-09-15T23:54:44.620071+0000","last_clean":"2024-09-15T23:54:44.620071+0000","last_became_active":"2024-09-15T23:54:42.602670+0000","last_became_peered":"2024-09-15T23:54:42.602670+0000","last_unstale":"2024-09-15T23:54:44.620071+0000","last_undegraded":"2024-09-15T23:54:44.620071+0000","last_fullsized":"2024-09-15T23:54:44.620071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.132376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.704271+0000","last_change":"2024-09-15T23:54:43.637124+0000","last_active":"2024-09-15T23:54:44.704271+0000","last_peered":"2024-09-15T23:54:44.704271+0000","last_clean":"2024-09-15T23:54:44.704271+0000","last_became_active":"2024-09-15T23:54:43.636448+0000","last_became_peered":"2024-09-15T23:54:43.636448+0000","last_unstale":"2024-09-15T23:54:44.704271+0000","last_undegraded":"2024-09-15T23:54:44.704271+0000","last_fullsized":"2024-09-15T23:54:44.704271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:54.838047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.622046+0000","last_change":"2024-09-15T23:54:42.611389+0000","last_active":"2024-09-15T23:54:44.622046+0000","last_peered":"2024-09-15T23:54:44.622046+0000","last_clean":"2024-09-15T23:54:44.622046+0000","last_became_active":"2024-09-15T23:54:42.610734+0000","last_became_peered":"2024-09-15T23:54:42.610734+0000","last_unstale":"2024-09-15T23:54:44.622046+0000","last_undegraded":"2024-09-15T23:54:44.622046+0000","last_fullsized":"2024-09-15T23:54:44.622046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:36.734848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.705878+0000","last_change":"2024-09-15T23:54:43.647470+0000","last_active":"2024-09-15T23:54:44.705878+0000","last_peered":"2024-09-15T23:54:44.705878+0000","last_clean":"2024-09-15T23:54:44.705878+0000","last_became_active":"2024-09-15T23:54:43.645865+0000","last_became_peered":"2024-09-15T23:54:43.645865+0000","last_unstale":"2024-09-15T23:54:44.705878+0000","last_undegraded":"2024-09-15T23:54:44.705878+0000","last_fullsized":"2024-09-15T23:54:44.705878+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:24.704679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.621139+0000","last_change":"2024-09-15T23:54:42.629795+0000","last_active":"2024-09-15T23:54:44.621139+0000","last_peered":"2024-09-15T23:54:44.621139+0000","last_clean":"2024-09-15T23:54:44.621139+0000","last_became_active":"2024-09-15T23:54:42.628974+0000","last_became_peered":"2024-09-15T23:54:42.628974+0000","last_unstale":"2024-09-15T23:54:44.621139+0000","last_undegraded":"2024-09-15T23:54:44.621139+0000","last_fullsized":"2024-09-15T23:54:44.621139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:26.732611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.620709+0000","last_change":"2024-09-15T23:54:43.679983+0000","last_active":"2024-09-15T23:54:44.620709+0000","last_peered":"2024-09-15T23:54:44.620709+0000","last_clean":"2024-09-15T23:54:44.620709+0000","last_became_active":"2024-09-15T23:54:43.679346+0000","last_became_peered":"2024-09-15T23:54:43.679346+0000","last_unstale":"2024-09-15T23:54:44.620709+0000","last_undegraded":"2024-09-15T23:54:44.620709+0000","last_fullsized":"2024-09-15T23:54:44.620709+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:46.999984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.622292+0000","last_change":"2024-09-15T23:54:42.619643+0000","last_active":"2024-09-15T23:54:44.622292+0000","last_peered":"2024-09-15T23:54:44.622292+0000","last_clean":"2024-09-15T23:54:44.622292+0000","last_became_active":"2024-09-15T23:54:42.615833+0000","last_became_peered":"2024-09-15T23:54:42.615833+0000","last_unstale":"2024-09-15T23:54:44.622292+0000","last_undegraded":"2024-09-15T23:54:44.622292+0000","last_fullsized":"2024-09-15T23:54:44.622292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:43.471876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.705615+0000","last_change":"2024-09-15T23:54:43.666718+0000","last_active":"2024-09-15T23:54:44.705615+0000","last_peered":"2024-09-15T23:54:44.705615+0000","last_clean":"2024-09-15T23:54:44.705615+0000","last_became_active":"2024-09-15T23:54:43.666042+0000","last_became_peered":"2024-09-15T23:54:43.666042+0000","last_unstale":"2024-09-15T23:54:44.705615+0000","last_undegraded":"2024-09-15T23:54:44.705615+0000","last_fullsized":"2024-09-15T23:54:44.705615+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:26.589213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703053+0000","last_change":"2024-09-15T23:54:42.605386+0000","last_active":"2024-09-15T23:54:44.703053+0000","last_peered":"2024-09-15T23:54:44.703053+0000","last_clean":"2024-09-15T23:54:44.703053+0000","last_became_active":"2024-09-15T23:54:42.605053+0000","last_became_peered":"2024-09-15T23:54:42.605053+0000","last_unstale":"2024-09-15T23:54:44.703053+0000","last_undegraded":"2024-09-15T23:54:44.703053+0000","last_fullsized":"2024-09-15T23:54:44.703053+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:31.941914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.619886+0000","last_change":"2024-09-15T23:54:43.659325+0000","last_active":"2024-09-15T23:54:44.619886+0000","last_peered":"2024-09-15T23:54:44.619886+0000","last_clean":"2024-09-15T23:54:44.619886+0000","last_became_active":"2024-09-15T23:54:43.658989+0000","last_became_peered":"2024-09-15T23:54:43.658989+0000","last_unstale":"2024-09-15T23:54:44.619886+0000","last_undegraded":"2024-09-15T23:54:44.619886+0000","last_fullsized":"2024-09-15T23:54:44.619886+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:16.860866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.618792+0000","last_change":"2024-09-15T23:54:42.602928+0000","last_active":"2024-09-15T23:54:44.618792+0000","last_peered":"2024-09-15T23:54:44.618792+0000","last_clean":"2024-09-15T23:54:44.618792+0000","last_became_active":"2024-09-15T23:54:42.602534+0000","last_became_peered":"2024-09-15T23:54:42.602534+0000","last_unstale":"2024-09-15T23:54:44.618792+0000","last_undegraded":"2024-09-15T23:54:44.618792+0000","last_fullsized":"2024-09-15T23:54:44.618792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:51.351267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703198+0000","last_change":"2024-09-15T23:54:43.652409+0000","last_active":"2024-09-15T23:54:44.703198+0000","last_peered":"2024-09-15T23:54:44.703198+0000","last_clean":"2024-09-15T23:54:44.703198+0000","last_became_active":"2024-09-15T23:54:43.652155+0000","last_became_peered":"2024-09-15T23:54:43.652155+0000","last_unstale":"2024-09-15T23:54:44.703198+0000","last_undegraded":"2024-09-15T23:54:44.703198+0000","last_fullsized":"2024-09-15T23:54:44.703198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:56.823302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.623720+0000","last_change":"2024-09-15T23:54:42.621609+0000","last_active":"2024-09-15T23:54:44.623720+0000","last_peered":"2024-09-15T23:54:44.623720+0000","last_clean":"2024-09-15T23:54:44.623720+0000","last_became_active":"2024-09-15T23:54:42.620946+0000","last_became_peered":"2024-09-15T23:54:42.620946+0000","last_unstale":"2024-09-15T23:54:44.623720+0000","last_undegraded":"2024-09-15T23:54:44.623720+0000","last_fullsized":"2024-09-15T23:54:44.623720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:48.556516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.619632+0000","last_change":"2024-09-15T23:54:43.648081+0000","last_active":"2024-09-15T23:54:44.619632+0000","last_peered":"2024-09-15T23:54:44.619632+0000","last_clean":"2024-09-15T23:54:44.619632+0000","last_became_active":"2024-09-15T23:54:43.647717+0000","last_became_peered":"2024-09-15T23:54:43.647717+0000","last_unstale":"2024-09-15T23:54:44.619632+0000","last_undegraded":"2024-09-15T23:54:44.619632+0000","last_fullsized":"2024-09-15T23:54:44.619632+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:42.570937+0000","last_clean_scrub_stamp":"2024-09-15T23:54:42.570937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:59.427613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703495+0000","last_change":"2024-09-15T23:54:42.604211+0000","last_active":"2024-09-15T23:54:44.703495+0000","last_peered":"2024-09-15T23:54:44.703495+0000","last_clean":"2024-09-15T23:54:44.703495+0000","last_became_active":"2024-09-15T23:54:42.603770+0000","last_became_peered":"2024-09-15T23:54:42.603770+0000","last_unstale":"2024-09-15T23:54:44.703495+0000","last_undegraded":"2024-09-15T23:54:44.703495+0000","last_fullsized":"2024-09-15T23:54:44.703495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:54:41.559490+0000","last_clean_scrub_stamp":"2024-09-15T23:54:41.559490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:55.995950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-15T23:54:44.703701+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:54:44.703701+0000","last_peered":"2024-09-15T23:54:44.703701+0000","last_clean":"2024-09-15T23:54:44.703701+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:54:44.703701+0000","last_undegraded":"2024-09-15T23:54:44.703701+0000","last_fullsized":"2024-09-15T23:54:44.703701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":195724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":195688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":475136,"data_stored":197390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":195744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":197848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1052672,"data_stored":786044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":195746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1052672,"data_stored":786604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:54:51.381 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:54:51.381 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:54:51.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.535+0000 7fe0383fd640 1 Processor -- start 2024-09-15T23:54:51.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.535+0000 7fe0383fd640 1 -- start start 2024-09-15T23:54:51.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.535+0000 7fe0383fd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe03015e4f0 0x7fe0300d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.535+0000 7fe0383fd640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0300cf070 con 0x7fe0300d4e20 2024-09-15T23:54:51.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.535+0000 7fe0383fd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0300d1c20 con 0x7fe030162070 2024-09-15T23:54:51.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.535+0000 7fe0383fd640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe0300cf330 con 0x7fe03015e4f0 2024-09-15T23:54:51.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.535+0000 7fe036199640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe03015e4f0 0x7fe0300d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.535+0000 7fe035998640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe0300d4e20 0x7fe0300cfe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41752/0 (socket says 172.21.15.112:41752) 2024-09-15T23:54:51.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.535+0000 7fe035998640 1 -- 172.21.15.112:0/3692370073 learned_addr learned my addr 172.21.15.112:0/3692370073 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:51.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.535+0000 7fe036199640 1 -- 172.21.15.112:0/3692370073 >> v1:172.21.15.169:6789/0 conn(0x7fe030162070 legacy=0x7fe0300b7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:51.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.535+0000 7fe036199640 1 -- 172.21.15.112:0/3692370073 >> v1:172.21.15.112:6789/0 conn(0x7fe0300d4e20 legacy=0x7fe0300cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.535+0000 7fe036199640 1 -- 172.21.15.112:0/3692370073 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0300cf610 con 0x7fe03015e4f0 2024-09-15T23:54:51.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.535+0000 7fe035197640 1 -- 172.21.15.112:0/3692370073 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2762668016 0 0) 0x7fe0300cf070 con 0x7fe0300d4e20 2024-09-15T23:54:51.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.539+0000 7fe036199640 1 --2- 172.21.15.112:0/3692370073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe03015e4f0 0x7fe0300d15d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0097f0 tx=0x7fe02c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13218045ac52f9dd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:51.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.539+0000 7fe035197640 1 -- 172.21.15.112:0/3692370073 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c0b5070 con 0x7fe03015e4f0 2024-09-15T23:54:51.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.539+0000 7fe035197640 1 -- 172.21.15.112:0/3692370073 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02c0a8950 con 0x7fe03015e4f0 2024-09-15T23:54:51.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.539+0000 7fe035197640 1 -- 172.21.15.112:0/3692370073 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c0a8d20 con 0x7fe03015e4f0 2024-09-15T23:54:51.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.539+0000 7fe0383fd640 1 -- 172.21.15.112:0/3692370073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe03015e4f0 msgr2=0x7fe0300d15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.539+0000 7fe0383fd640 1 --2- 172.21.15.112:0/3692370073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe03015e4f0 0x7fe0300d15d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0097f0 tx=0x7fe02c01ec50 comp rx=0 tx=0).stop 2024-09-15T23:54:51.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.539+0000 7fe0383fd640 1 -- 172.21.15.112:0/3692370073 shutdown_connections 2024-09-15T23:54:51.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.539+0000 7fe0383fd640 1 --2- 172.21.15.112:0/3692370073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe03015e4f0 0x7fe0300d15d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.539+0000 7fe0383fd640 1 -- 172.21.15.112:0/3692370073 >> 172.21.15.112:0/3692370073 conn(0x7fe03008bf90 msgr2=0x7fe0300d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:51.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.539+0000 7fe0383fd640 1 -- 172.21.15.112:0/3692370073 shutdown_connections 2024-09-15T23:54:51.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.539+0000 7fe0383fd640 1 -- 172.21.15.112:0/3692370073 wait complete. 2024-09-15T23:54:51.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.539+0000 7fe0383fd640 1 Processor -- start 2024-09-15T23:54:51.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.539+0000 7fe0383fd640 1 -- start start 2024-09-15T23:54:51.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe0383fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300d4e20 0x7fe0301518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe0383fd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe03015e4f0 0x7fe0300cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe0383fd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe030162070 0x7fe0300b9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe0383fd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe0300d5270 con 0x7fe0300d4e20 2024-09-15T23:54:51.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe0383fd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe03015e8d0 con 0x7fe03015e4f0 2024-09-15T23:54:51.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe0383fd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe0300b7970 con 0x7fe030162070 2024-09-15T23:54:51.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe036199640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300d4e20 0x7fe0301518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe036199640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300d4e20 0x7fe0301518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48676/0 (socket says 172.21.15.112:48676) 2024-09-15T23:54:51.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe036199640 1 -- 172.21.15.112:0/3543438366 learned_addr learned my addr 172.21.15.112:0/3543438366 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:51.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe036199640 1 -- 172.21.15.112:0/3543438366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe030162070 msgr2=0x7fe0300b9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe036199640 1 --2- 172.21.15.112:0/3543438366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe030162070 0x7fe0300b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe036199640 1 -- 172.21.15.112:0/3543438366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe03015e4f0 msgr2=0x7fe0300cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe036199640 1 --2- 172.21.15.112:0/3543438366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe03015e4f0 0x7fe0300cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe036199640 1 -- 172.21.15.112:0/3543438366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0300ccf30 con 0x7fe0300d4e20 2024-09-15T23:54:51.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe036199640 1 --2- 172.21.15.112:0/3543438366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300d4e20 0x7fe0301518c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0097f0 tx=0x7fe02c01d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:51.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe026ffd640 1 -- 172.21.15.112:0/3543438366 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c0b5050 con 0x7fe0300d4e20 2024-09-15T23:54:51.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe026ffd640 1 -- 172.21.15.112:0/3543438366 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02c0b6040 con 0x7fe0300d4e20 2024-09-15T23:54:51.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe026ffd640 1 -- 172.21.15.112:0/3543438366 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c004440 con 0x7fe0300d4e20 2024-09-15T23:54:51.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe0383fd640 1 -- 172.21.15.112:0/3543438366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0300cd210 con 0x7fe0300d4e20 2024-09-15T23:54:51.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe0383fd640 1 -- 172.21.15.112:0/3543438366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0300cd7d0 con 0x7fe0300d4e20 2024-09-15T23:54:51.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe0383fd640 1 -- 172.21.15.112:0/3543438366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0300b7d30 con 0x7fe0300d4e20 2024-09-15T23:54:51.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe026ffd640 1 -- 172.21.15.112:0/3543438366 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe02c0c3060 con 0x7fe0300d4e20 2024-09-15T23:54:51.551 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe026ffd640 1 --2- 172.21.15.112:0/3543438366 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe0140678f0 0x7fe014069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe035998640 1 --2- 172.21.15.112:0/3543438366 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe0140678f0 0x7fe014069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe026ffd640 1 -- 172.21.15.112:0/3543438366 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fe02c123170 con 0x7fe0300d4e20 2024-09-15T23:54:51.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.543+0000 7fe035998640 1 --2- 172.21.15.112:0/3543438366 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe0140678f0 0x7fe014069db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe0200011f0 tx=0x7fe020007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:51.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.547+0000 7fe026ffd640 1 -- 172.21.15.112:0/3543438366 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe02c0187b0 con 0x7fe0300d4e20 2024-09-15T23:54:51.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.775+0000 7fe0383fd640 1 -- 172.21.15.112:0/3543438366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe0300cb1a0 con 0x7fe0300d4e20 2024-09-15T23:54:51.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.779+0000 7fe026ffd640 1 -- 172.21.15.112:0/3543438366 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fe02c0f3a90 con 0x7fe0300d4e20 2024-09-15T23:54:51.786 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-15T23:54:51.786 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw== 2024-09-15T23:54:51.786 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-15T23:54:51.786 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-15T23:54:51.786 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:54:51.787 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-15T23:54:51.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.783+0000 7fe0383fd640 1 -- 172.21.15.112:0/3543438366 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe0140678f0 msgr2=0x7fe014069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.783+0000 7fe0383fd640 1 --2- 172.21.15.112:0/3543438366 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe0140678f0 0x7fe014069db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe0200011f0 tx=0x7fe020007930 comp rx=0 tx=0).stop 2024-09-15T23:54:51.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.783+0000 7fe0383fd640 1 -- 172.21.15.112:0/3543438366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300d4e20 msgr2=0x7fe0301518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.783+0000 7fe0383fd640 1 --2- 172.21.15.112:0/3543438366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300d4e20 0x7fe0301518c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0097f0 tx=0x7fe02c01d490 comp rx=0 tx=0).stop 2024-09-15T23:54:51.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.783+0000 7fe0383fd640 1 -- 172.21.15.112:0/3543438366 shutdown_connections 2024-09-15T23:54:51.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.783+0000 7fe0383fd640 1 --2- 172.21.15.112:0/3543438366 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe0140678f0 0x7fe014069db0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.783+0000 7fe0383fd640 1 --2- 172.21.15.112:0/3543438366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe030162070 0x7fe0300b9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.783+0000 7fe0383fd640 1 --2- 172.21.15.112:0/3543438366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe03015e4f0 0x7fe0300cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.783+0000 7fe0383fd640 1 --2- 172.21.15.112:0/3543438366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0300d4e20 0x7fe0301518c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.783+0000 7fe0383fd640 1 -- 172.21.15.112:0/3543438366 >> 172.21.15.112:0/3543438366 conn(0x7fe03008bf90 msgr2=0x7fe0300b87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:51.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.783+0000 7fe0383fd640 1 -- 172.21.15.112:0/3543438366 shutdown_connections 2024-09-15T23:54:51.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.783+0000 7fe0383fd640 1 -- 172.21.15.112:0/3543438366 wait complete. 2024-09-15T23:54:51.803 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:54:51.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.915+0000 7f261f66a640 1 Processor -- start 2024-09-15T23:54:51.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.915+0000 7f261f66a640 1 -- start start 2024-09-15T23:54:51.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.919+0000 7f261f66a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f26181587a0 0x7f26180b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.919+0000 7f261f66a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f26180b37d0 0x7f261806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.919+0000 7f261f66a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f261806ec60 con 0x7f261806e4b0 2024-09-15T23:54:51.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.919+0000 7f261f66a640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f26180b3c40 con 0x7f26181587a0 2024-09-15T23:54:51.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.919+0000 7f261f66a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f261806f870 con 0x7f26180b37d0 2024-09-15T23:54:51.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.919+0000 7f261d406640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f26181587a0 0x7f26180b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.919+0000 7f261d406640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f26181587a0 0x7f26180b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48688/0 (socket says 172.21.15.112:48688) 2024-09-15T23:54:51.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.919+0000 7f261d406640 1 -- 172.21.15.112:0/2160920566 learned_addr learned my addr 172.21.15.112:0/2160920566 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:51.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.919+0000 7f261cc05640 1 --2- 172.21.15.112:0/2160920566 >> v2:172.21.15.169:3300/0 conn(0x7f26180b37d0 0x7f261806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.919+0000 7f261d406640 1 -- 172.21.15.112:0/2160920566 >> v2:172.21.15.169:3300/0 conn(0x7f26180b37d0 msgr2=0x7f261806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:51.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.919+0000 7f261d406640 1 --2- 172.21.15.112:0/2160920566 >> v2:172.21.15.169:3300/0 conn(0x7f26180b37d0 0x7f261806df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.919+0000 7f261d406640 1 -- 172.21.15.112:0/2160920566 >> v1:172.21.15.169:6789/0 conn(0x7f261806e4b0 legacy=0x7f2618161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:51.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.919+0000 7f261d406640 1 -- 172.21.15.112:0/2160920566 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f261806ef40 con 0x7f26181587a0 2024-09-15T23:54:51.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.919+0000 7f261cc05640 1 --2- 172.21.15.112:0/2160920566 >> v2:172.21.15.169:3300/0 conn(0x7f26180b37d0 0x7f261806df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:51.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261d406640 1 --2- 172.21.15.112:0/2160920566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26181587a0 0x7f26180b3290 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2618161d90 tx=0x7f261401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2721c8c519818362 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:51.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f260bfff640 1 -- 172.21.15.112:0/2160920566 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26140b1070 con 0x7f26181587a0 2024-09-15T23:54:51.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f260bfff640 1 -- 172.21.15.112:0/2160920566 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26140ac630 con 0x7f26181587a0 2024-09-15T23:54:51.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f260bfff640 1 -- 172.21.15.112:0/2160920566 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26140a8050 con 0x7f26181587a0 2024-09-15T23:54:51.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 -- 172.21.15.112:0/2160920566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26181587a0 msgr2=0x7f26180b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 --2- 172.21.15.112:0/2160920566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26181587a0 0x7f26180b3290 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2618161d90 tx=0x7f261401c4b0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 -- 172.21.15.112:0/2160920566 shutdown_connections 2024-09-15T23:54:51.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 --2- 172.21.15.112:0/2160920566 >> v2:172.21.15.169:3300/0 conn(0x7f26180b37d0 0x7f261806df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 --2- 172.21.15.112:0/2160920566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26181587a0 0x7f26180b3290 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 -- 172.21.15.112:0/2160920566 >> 172.21.15.112:0/2160920566 conn(0x7f26180b1f90 msgr2=0x7f26180b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:51.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 -- 172.21.15.112:0/2160920566 shutdown_connections 2024-09-15T23:54:51.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 -- 172.21.15.112:0/2160920566 wait complete. 2024-09-15T23:54:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 Processor -- start 2024-09-15T23:54:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 -- start start 2024-09-15T23:54:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f261806e4b0 0x7f2618147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26180b37d0 0x7f26181f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26181587a0 0x7f261809da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2618158b80 con 0x7f26181587a0 2024-09-15T23:54:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2618073170 con 0x7f26180b37d0 2024-09-15T23:54:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2618153a80 con 0x7f261806e4b0 2024-09-15T23:54:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261dc07640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26181587a0 0x7f261809da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261dc07640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26181587a0 0x7f261809da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48692/0 (socket says 172.21.15.112:48692) 2024-09-15T23:54:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261dc07640 1 -- 172.21.15.112:0/4052921660 learned_addr learned my addr 172.21.15.112:0/4052921660 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261cc05640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26180b37d0 0x7f26181f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261d406640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f261806e4b0 0x7f2618147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261dc07640 1 -- 172.21.15.112:0/4052921660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f261806e4b0 msgr2=0x7f2618147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261dc07640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f261806e4b0 0x7f2618147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261dc07640 1 -- 172.21.15.112:0/4052921660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26180b37d0 msgr2=0x7f26181f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261dc07640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26180b37d0 0x7f26181f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261dc07640 1 -- 172.21.15.112:0/4052921660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2618073a50 con 0x7f26181587a0 2024-09-15T23:54:51.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261cc05640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26180b37d0 0x7f26181f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:51.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261dc07640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26181587a0 0x7f261809da50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f261000c780 tx=0x7f261000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:51.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f2609ffb640 1 -- 172.21.15.112:0/4052921660 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610004b70 con 0x7f26181587a0 2024-09-15T23:54:51.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f2609ffb640 1 -- 172.21.15.112:0/4052921660 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2610004d10 con 0x7f26181587a0 2024-09-15T23:54:51.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f261f66a640 1 -- 172.21.15.112:0/4052921660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2618153cd0 con 0x7f26181587a0 2024-09-15T23:54:51.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.923+0000 7f2609ffb640 1 -- 172.21.15.112:0/4052921660 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261000aa90 con 0x7f26181587a0 2024-09-15T23:54:51.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.927+0000 7f261f66a640 1 -- 172.21.15.112:0/4052921660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f261809a4b0 con 0x7f26181587a0 2024-09-15T23:54:51.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.927+0000 7f261f66a640 1 -- 172.21.15.112:0/4052921660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f261815f750 con 0x7f26181587a0 2024-09-15T23:54:51.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.927+0000 7f2609ffb640 1 -- 172.21.15.112:0/4052921660 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f261000ac30 con 0x7f26181587a0 2024-09-15T23:54:51.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.927+0000 7f2609ffb640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f25fc0678c0 0x7f25fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.927+0000 7f2609ffb640 1 -- 172.21.15.112:0/4052921660 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f2610086000 con 0x7f26181587a0 2024-09-15T23:54:51.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.927+0000 7f261d406640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f25fc0678c0 0x7f25fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.927+0000 7f261d406640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f25fc0678c0 0x7f25fc069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f26140ae000 tx=0x7f26140a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:51.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:51.931+0000 7f2609ffb640 1 -- 172.21.15.112:0/4052921660 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2610020070 con 0x7f26181587a0 2024-09-15T23:54:52.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.111+0000 7f261f66a640 1 -- 172.21.15.112:0/4052921660 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2618070080 con 0x7f26181587a0 2024-09-15T23:54:52.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.111+0000 7f2609ffb640 1 -- 172.21.15.112:0/4052921660 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f2610056a40 con 0x7f26181587a0 2024-09-15T23:54:52.118 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:52.118 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"btime":"2024-09-15T23:54:45:647611+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1357012609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1357012609},{"type":"v1","addr":"172.21.15.169:6835","nonce":1357012609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2931559222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2931559222},{"type":"v1","addr":"172.21.15.112:6837","nonce":2931559222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1936572340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1936572340},{"type":"v1","addr":"172.21.15.169:6833","nonce":1936572340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:54:42.951140+0000","modified":"2024-09-15T23:54:44.991346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4869":{"gid":4869,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/40913641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":40913641},{"type":"v1","addr":"172.21.15.112:6835","nonce":40913641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4869,"qdb_cluster":[4869]},"id":2}]} 2024-09-15T23:54:52.118 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-15T23:54:52.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.115+0000 7f261f66a640 1 -- 172.21.15.112:0/4052921660 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f25fc0678c0 msgr2=0x7f25fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.115+0000 7f261f66a640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f25fc0678c0 0x7f25fc069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f26140ae000 tx=0x7f26140a7000 comp rx=0 tx=0).stop 2024-09-15T23:54:52.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.115+0000 7f261f66a640 1 -- 172.21.15.112:0/4052921660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26181587a0 msgr2=0x7f261809da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.115+0000 7f261f66a640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26181587a0 0x7f261809da50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f261000c780 tx=0x7f261000cc40 comp rx=0 tx=0).stop 2024-09-15T23:54:52.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.115+0000 7f261f66a640 1 -- 172.21.15.112:0/4052921660 shutdown_connections 2024-09-15T23:54:52.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.115+0000 7f261f66a640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f25fc0678c0 0x7f25fc069d80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.115+0000 7f261f66a640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26181587a0 0x7f261809da50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.115+0000 7f261f66a640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26180b37d0 0x7f26181f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.115+0000 7f261f66a640 1 --2- 172.21.15.112:0/4052921660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f261806e4b0 0x7f2618147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.115+0000 7f261f66a640 1 -- 172.21.15.112:0/4052921660 >> 172.21.15.112:0/4052921660 conn(0x7f26180b1f90 msgr2=0x7f26180afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.115+0000 7f261f66a640 1 -- 172.21.15.112:0/4052921660 shutdown_connections 2024-09-15T23:54:52.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.115+0000 7f261f66a640 1 -- 172.21.15.112:0/4052921660 wait complete. 2024-09-15T23:54:52.538 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:54:42.951140+0000', 'modified': '2024-09-15T23:54:44.991346+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4869}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4869': {'gid': 4869, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6835/40913641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 40913641}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 40913641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4869, 'qdb_cluster': [4869]} 2024-09-15T23:54:52.538 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:54:52.539 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T23:54:52.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcfff052640 1 Processor -- start 2024-09-15T23:54:52.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcfff052640 1 -- start start 2024-09-15T23:54:52.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcfff052640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcff81520a0 0x7fcff806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcfff052640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcff806fe50 0x7fcff815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcfff052640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcff815f1d0 0x7fcff8071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcfff052640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcff8152480 con 0x7fcff81520a0 2024-09-15T23:54:52.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcfff052640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fcff8070250 con 0x7fcff806fe50 2024-09-15T23:54:52.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcfff052640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcff80aede0 con 0x7fcff815f1d0 2024-09-15T23:54:52.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcffcdee640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcff81520a0 0x7fcff806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcffcdee640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcff81520a0 0x7fcff806f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48708/0 (socket says 172.21.15.112:48708) 2024-09-15T23:54:52.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcffcdee640 1 -- 172.21.15.112:0/2512476007 learned_addr learned my addr 172.21.15.112:0/2512476007 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:52.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcff7fff640 1 --2- 172.21.15.112:0/2512476007 >> v2:172.21.15.169:3300/0 conn(0x7fcff806fe50 0x7fcff815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcffd5ef640 1 --2- 172.21.15.112:0/2512476007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcff815f1d0 0x7fcff8071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcffcdee640 1 -- 172.21.15.112:0/2512476007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcff815f1d0 msgr2=0x7fcff8071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:52.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcffcdee640 1 --2- 172.21.15.112:0/2512476007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcff815f1d0 0x7fcff8071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcffcdee640 1 -- 172.21.15.112:0/2512476007 >> v2:172.21.15.169:3300/0 conn(0x7fcff806fe50 msgr2=0x7fcff815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:52.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcffcdee640 1 --2- 172.21.15.112:0/2512476007 >> v2:172.21.15.169:3300/0 conn(0x7fcff806fe50 0x7fcff815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.667+0000 7fcffcdee640 1 -- 172.21.15.112:0/2512476007 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff815fa10 con 0x7fcff81520a0 2024-09-15T23:54:52.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcffcdee640 1 --2- 172.21.15.112:0/2512476007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff81520a0 0x7fcff806f910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcff806e510 tx=0x7fcfe801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5f80ea8c367 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcff77fe640 1 -- 172.21.15.112:0/2512476007 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80b0070 con 0x7fcff81520a0 2024-09-15T23:54:52.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcff77fe640 1 -- 172.21.15.112:0/2512476007 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe80ab600 con 0x7fcff81520a0 2024-09-15T23:54:52.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcff77fe640 1 -- 172.21.15.112:0/2512476007 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80ab9d0 con 0x7fcff81520a0 2024-09-15T23:54:52.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcfff052640 1 -- 172.21.15.112:0/2512476007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff81520a0 msgr2=0x7fcff806f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcfff052640 1 --2- 172.21.15.112:0/2512476007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff81520a0 0x7fcff806f910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcff806e510 tx=0x7fcfe801c240 comp rx=0 tx=0).stop 2024-09-15T23:54:52.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcfff052640 1 -- 172.21.15.112:0/2512476007 shutdown_connections 2024-09-15T23:54:52.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcfff052640 1 --2- 172.21.15.112:0/2512476007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcff815f1d0 0x7fcff8071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcfff052640 1 --2- 172.21.15.112:0/2512476007 >> v2:172.21.15.169:3300/0 conn(0x7fcff806fe50 0x7fcff815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcfff052640 1 --2- 172.21.15.112:0/2512476007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff81520a0 0x7fcff806f910 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcfff052640 1 -- 172.21.15.112:0/2512476007 >> 172.21.15.112:0/2512476007 conn(0x7fcff80b1f90 msgr2=0x7fcff80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcfff052640 1 -- 172.21.15.112:0/2512476007 shutdown_connections 2024-09-15T23:54:52.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcfff052640 1 -- 172.21.15.112:0/2512476007 wait complete. 2024-09-15T23:54:52.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcfff052640 1 Processor -- start 2024-09-15T23:54:52.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.671+0000 7fcfff052640 1 -- start start 2024-09-15T23:54:52.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcfff052640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcff806fe50 0x7fcff8148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcfff052640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff81520a0 0x7fcff80cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcfff052640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcff815f1d0 0x7fcff81640d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcfff052640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcff8073d30 con 0x7fcff81520a0 2024-09-15T23:54:52.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcfff052640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcff8073a50 con 0x7fcff815f1d0 2024-09-15T23:54:52.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcfff052640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcff815f5e0 con 0x7fcff806fe50 2024-09-15T23:54:52.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff81520a0 0x7fcff80cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff81520a0 0x7fcff80cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48718/0 (socket says 172.21.15.112:48718) 2024-09-15T23:54:52.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff7fff640 1 -- 172.21.15.112:0/3145777967 learned_addr learned my addr 172.21.15.112:0/3145777967 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:52.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcffd5ef640 1 --2- 172.21.15.112:0/3145777967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcff815f1d0 0x7fcff81640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcffcdee640 1 --2- 172.21.15.112:0/3145777967 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcff806fe50 0x7fcff8148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff7fff640 1 -- 172.21.15.112:0/3145777967 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcff806fe50 msgr2=0x7fcff8148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff7fff640 1 --2- 172.21.15.112:0/3145777967 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcff806fe50 0x7fcff8148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff7fff640 1 -- 172.21.15.112:0/3145777967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcff815f1d0 msgr2=0x7fcff81640d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff7fff640 1 --2- 172.21.15.112:0/3145777967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcff815f1d0 0x7fcff81640d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff7fff640 1 -- 172.21.15.112:0/3145777967 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff814db20 con 0x7fcff81520a0 2024-09-15T23:54:52.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff7fff640 1 --2- 172.21.15.112:0/3145777967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff81520a0 0x7fcff80cf6c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000d800 tx=0x7fcfe000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff57fa640 1 -- 172.21.15.112:0/3145777967 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0018030 con 0x7fcff81520a0 2024-09-15T23:54:52.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff57fa640 1 -- 172.21.15.112:0/3145777967 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe00096a0 con 0x7fcff81520a0 2024-09-15T23:54:52.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcfff052640 1 -- 172.21.15.112:0/3145777967 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff814de00 con 0x7fcff81520a0 2024-09-15T23:54:52.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff57fa640 1 -- 172.21.15.112:0/3145777967 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0009870 con 0x7fcff81520a0 2024-09-15T23:54:52.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcfff052640 1 -- 172.21.15.112:0/3145777967 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff81498a0 con 0x7fcff81520a0 2024-09-15T23:54:52.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff57fa640 1 -- 172.21.15.112:0/3145777967 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcfe001b070 con 0x7fcff81520a0 2024-09-15T23:54:52.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff57fa640 1 --2- 172.21.15.112:0/3145777967 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcfd80678c0 0x7fcfd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcff57fa640 1 -- 172.21.15.112:0/3145777967 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fcfe00861a0 con 0x7fcff81520a0 2024-09-15T23:54:52.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.675+0000 7fcffcdee640 1 --2- 172.21.15.112:0/3145777967 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcfd80678c0 0x7fcfd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fcffcdee640 1 --2- 172.21.15.112:0/3145777967 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcfd80678c0 0x7fcfd8069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80ad000 tx=0x7fcfe8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 Processor -- start 2024-09-15T23:54:52.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 -- start start 2024-09-15T23:54:52.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949c212c0 0x555949c216a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949c21be0 0x555949bd72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949bd7830 0x555949bd7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555949abe920 con 0x555949c21be0 2024-09-15T23:54:52.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555949a04c70 con 0x555949bd7830 2024-09-15T23:54:52.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5559499aaed0 con 0x555949c212c0 2024-09-15T23:54:52.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fcff7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949c21be0 0x555949bd72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fcff7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949c21be0 0x555949bd72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48732/0 (socket says 172.21.15.112:48732) 2024-09-15T23:54:52.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fcff7fff640 1 -- 172.21.15.112:0/2891335068 learned_addr learned my addr 172.21.15.112:0/2891335068 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:52.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fcff7fff640 1 -- 172.21.15.112:0/2891335068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949c212c0 msgr2=0x555949c216a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:52.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fcffd5ef640 1 --2- 172.21.15.112:0/2891335068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949bd7830 0x555949bd7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fcff7fff640 1 --2- 172.21.15.112:0/2891335068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949c212c0 0x555949c216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fcff7fff640 1 -- 172.21.15.112:0/2891335068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949bd7830 msgr2=0x555949bd7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:52.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fcff7fff640 1 --2- 172.21.15.112:0/2891335068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949bd7830 0x555949bd7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fcff7fff640 1 -- 172.21.15.112:0/2891335068 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559499ab120 con 0x555949c21be0 2024-09-15T23:54:52.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fcff7fff640 1 --2- 172.21.15.112:0/2891335068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949c21be0 0x555949bd72f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcfe005eb00 tx=0x7fcfe0056030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179ddbee1b2cb6ac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fcfee7fc640 1 -- 172.21.15.112:0/2891335068 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe005f030 con 0x555949c21be0 2024-09-15T23:54:52.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fcfee7fc640 1 -- 172.21.15.112:0/2891335068 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe001bdd0 con 0x555949c21be0 2024-09-15T23:54:52.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fcfee7fc640 1 -- 172.21.15.112:0/2891335068 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0052a30 con 0x555949c21be0 2024-09-15T23:54:52.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 -- 172.21.15.112:0/2891335068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949c21be0 msgr2=0x555949bd72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 --2- 172.21.15.112:0/2891335068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949c21be0 0x555949bd72f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcfe005eb00 tx=0x7fcfe0056030 comp rx=0 tx=0).stop 2024-09-15T23:54:52.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 -- 172.21.15.112:0/2891335068 shutdown_connections 2024-09-15T23:54:52.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 --2- 172.21.15.112:0/2891335068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949bd7830 0x555949bd7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 --2- 172.21.15.112:0/2891335068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949c21be0 0x555949bd72f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 --2- 172.21.15.112:0/2891335068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949c212c0 0x555949c216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 -- 172.21.15.112:0/2891335068 >> 172.21.15.112:0/2891335068 conn(0x555949bdddb0 msgr2=0x555949bd5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 -- 172.21.15.112:0/2891335068 shutdown_connections 2024-09-15T23:54:52.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 -- 172.21.15.112:0/2891335068 wait complete. 2024-09-15T23:54:52.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 -- start start 2024-09-15T23:54:52.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.679+0000 7fd00210e000 1 Processor -- start 2024-09-15T23:54:52.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 0x555949be2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949c212c0 0x555949be29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c21be0 0x555949be2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555949ae2080 con 0x555949c212c0 2024-09-15T23:54:52.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5559499df360 con 0x555949c21be0 2024-09-15T23:54:52.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5559499dc2d0 con 0x555949bd7830 2024-09-15T23:54:52.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 10 client.0 _ll_register_callbacks cb 0x555949a211f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:54:52.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcff7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949c212c0 0x555949be29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcff7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949c212c0 0x555949be29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48736/0 (socket says 172.21.15.112:48736) 2024-09-15T23:54:52.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcff7fff640 1 -- 172.21.15.112:0/158667017 learned_addr learned my addr 172.21.15.112:0/158667017 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:52.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcffd5ef640 1 --2- 172.21.15.112:0/158667017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c21be0 0x555949be2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcff7fff640 1 -- 172.21.15.112:0/158667017 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 msgr2=0x555949be2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:52.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcff7fff640 1 --2- 172.21.15.112:0/158667017 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 0x555949be2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcff7fff640 1 -- 172.21.15.112:0/158667017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c21be0 msgr2=0x555949be2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:52.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcff7fff640 1 --2- 172.21.15.112:0/158667017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c21be0 0x555949be2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcff7fff640 1 -- 172.21.15.112:0/158667017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559499a4450 con 0x555949c212c0 2024-09-15T23:54:52.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcff7fff640 1 --2- 172.21.15.112:0/158667017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949c212c0 0x555949be29d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0084510 tx=0x7fcfe0059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635fb731346ab557 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcfd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:54:52.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcfd77fe640 1 -- 172.21.15.112:0/158667017 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe005f030 con 0x555949c212c0 2024-09-15T23:54:52.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcfd77fe640 1 -- 172.21.15.112:0/158667017 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fcfe0052a30 con 0x555949c212c0 2024-09-15T23:54:52.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 -- 172.21.15.112:0/158667017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfe001bdd0 con 0x555949c212c0 2024-09-15T23:54:52.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcfd77fe640 1 -- 172.21.15.112:0/158667017 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fcfe006e200 con 0x555949c212c0 2024-09-15T23:54:52.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 10 client.5070 fetch_fsmap learned FSMap version 15 2024-09-15T23:54:52.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 -- 172.21.15.112:0/158667017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55594998bfd0 con 0x555949c212c0 2024-09-15T23:54:52.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcfd77fe640 1 -- 172.21.15.112:0/158667017 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe001bdd0 con 0x555949c212c0 2024-09-15T23:54:52.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcfd77fe640 1 -- 172.21.15.112:0/158667017 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7fcfe0025060 con 0x555949c212c0 2024-09-15T23:54:52.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 10 client.5070 fetch_fsmap finished waiting for FSMap version 15 2024-09-15T23:54:52.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 10 client.5070 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:54:52.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 20 client.5070 populate_metadata read hostname 'smithi112' 2024-09-15T23:54:52.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 --2- 172.21.15.112:0/158667017 >> [v2:172.21.15.112:6834/40913641,v1:172.21.15.112:6835/40913641] conn(0x555949be3920 0x555949c32360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 4 client.5070 mds_command: new command op to 4869 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:54:52.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 -- 172.21.15.112:0/158667017 --> [v2:172.21.15.112:6834/40913641,v1:172.21.15.112:6835/40913641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55594999ec00 con 0x555949be3920 2024-09-15T23:54:52.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcffcdee640 1 --2- 172.21.15.112:0/158667017 >> [v2:172.21.15.112:6834/40913641,v1:172.21.15.112:6835/40913641] conn(0x555949be3920 0x555949c32360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcffcdee640 1 --2- 172.21.15.112:0/158667017 >> [v2:172.21.15.112:6834/40913641,v1:172.21.15.112:6835/40913641] conn(0x555949be3920 0x555949c32360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=204394a9689c183e server_cookie=ef88addd2e7e20b8 in_seq=0 out_seq=0 2024-09-15T23:54:52.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcfd77fe640 10 client.5070 ms_handle_connect on v2:172.21.15.112:6834/40913641 2024-09-15T23:54:52.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcfd77fe640 1 -- 172.21.15.112:0/158667017 <== mds.0 v2:172.21.15.112:6834/40913641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55594999ec00 con 0x555949be3920 2024-09-15T23:54:52.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcfd77fe640 10 client.5070 handle_command_reply: tid=0 2024-09-15T23:54:52.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 client.5070 shutdown 2024-09-15T23:54:52.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 -- 172.21.15.112:0/158667017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949c212c0 msgr2=0x555949be29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 --2- 172.21.15.112:0/158667017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949c212c0 0x555949be29d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0084510 tx=0x7fcfe0059040 comp rx=0 tx=0).stop 2024-09-15T23:54:52.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 -- 172.21.15.112:0/158667017 shutdown_connections 2024-09-15T23:54:52.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 --2- 172.21.15.112:0/158667017 >> [v2:172.21.15.112:6834/40913641,v1:172.21.15.112:6835/40913641] conn(0x555949be3920 0x555949c32360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 --2- 172.21.15.112:0/158667017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c21be0 0x555949be2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 --2- 172.21.15.112:0/158667017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949c212c0 0x555949be29d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fcfd77fe640 0 client.5070 ms_handle_reset on v2:172.21.15.112:6834/40913641 2024-09-15T23:54:52.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 --2- 172.21.15.112:0/158667017 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 0x555949be2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 -- 172.21.15.112:0/158667017 >> 172.21.15.112:0/158667017 conn(0x555949bdddb0 msgr2=0x555949bd62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 -- 172.21.15.112:0/158667017 shutdown_connections 2024-09-15T23:54:52.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 1 -- 172.21.15.112:0/158667017 wait complete. 2024-09-15T23:54:52.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.683+0000 7fd00210e000 20 client.5070 trim_cache size 0 max 16384 2024-09-15T23:54:52.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.703+0000 7fd00210e000 1 Processor -- start 2024-09-15T23:54:52.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.703+0000 7fd00210e000 1 -- start start 2024-09-15T23:54:52.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.703+0000 7fd00210e000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949bdddb0 0x555949c90290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.703+0000 7fd00210e000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 0x555949c907d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c212c0 0x555949c90d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcff8202fd0 con 0x555949bdddb0 2024-09-15T23:54:52.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcff806f4f0 con 0x555949c212c0 2024-09-15T23:54:52.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcff80b4040 con 0x555949bd7830 2024-09-15T23:54:52.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcffcdee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949bdddb0 0x555949c90290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcffcdee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949bdddb0 0x555949c90290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48752/0 (socket says 172.21.15.112:48752) 2024-09-15T23:54:52.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcffcdee640 1 -- 172.21.15.112:0/3654076389 learned_addr learned my addr 172.21.15.112:0/3654076389 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:52.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcff7fff640 1 --2- 172.21.15.112:0/3654076389 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 0x555949c907d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcffd5ef640 1 --2- 172.21.15.112:0/3654076389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c212c0 0x555949c90d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcffcdee640 1 -- 172.21.15.112:0/3654076389 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 msgr2=0x555949c907d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:52.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcffcdee640 1 --2- 172.21.15.112:0/3654076389 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 0x555949c907d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcffcdee640 1 -- 172.21.15.112:0/3654076389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c212c0 msgr2=0x555949c90d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:52.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcffcdee640 1 --2- 172.21.15.112:0/3654076389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c212c0 0x555949c90d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcffcdee640 1 -- 172.21.15.112:0/3654076389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555949aa7ed0 con 0x555949bdddb0 2024-09-15T23:54:52.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcff7fff640 1 --2- 172.21.15.112:0/3654076389 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 0x555949c907d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:52.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcffd5ef640 1 --2- 172.21.15.112:0/3654076389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c212c0 0x555949c90d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:52.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcffcdee640 1 --2- 172.21.15.112:0/3654076389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949bdddb0 0x555949c90290 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80ae040 tx=0x7fcfe80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c716ba0c2deeb8e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcfedffb640 1 -- 172.21.15.112:0/3654076389 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80b0040 con 0x555949bdddb0 2024-09-15T23:54:52.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcfedffb640 1 -- 172.21.15.112:0/3654076389 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe80abdf0 con 0x555949bdddb0 2024-09-15T23:54:52.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcfedffb640 1 -- 172.21.15.112:0/3654076389 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80cc630 con 0x555949bdddb0 2024-09-15T23:54:52.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 -- 172.21.15.112:0/3654076389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949bdddb0 msgr2=0x555949c90290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 --2- 172.21.15.112:0/3654076389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949bdddb0 0x555949c90290 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80ae040 tx=0x7fcfe80046d0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 -- 172.21.15.112:0/3654076389 shutdown_connections 2024-09-15T23:54:52.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 --2- 172.21.15.112:0/3654076389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c212c0 0x555949c90d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 --2- 172.21.15.112:0/3654076389 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 0x555949c907d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 --2- 172.21.15.112:0/3654076389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949bdddb0 0x555949c90290 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 -- 172.21.15.112:0/3654076389 >> 172.21.15.112:0/3654076389 conn(0x555949c20c10 msgr2=0x555949bdcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 -- 172.21.15.112:0/3654076389 shutdown_connections 2024-09-15T23:54:52.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 -- 172.21.15.112:0/3654076389 wait complete. 2024-09-15T23:54:52.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 -- start start 2024-09-15T23:54:52.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 Processor -- start 2024-09-15T23:54:52.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 0x555949c94040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949bdddb0 0x555949c94580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c212c0 0x555949c94ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555949a03f80 con 0x555949bdddb0 2024-09-15T23:54:52.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5559499bcca0 con 0x555949c212c0 2024-09-15T23:54:52.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x555949a092a0 con 0x555949bd7830 2024-09-15T23:54:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 10 client.0 _ll_register_callbacks cb 0x7fcfe0055d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:54:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcff7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949bdddb0 0x555949c94580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcff7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949bdddb0 0x555949c94580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48754/0 (socket says 172.21.15.112:48754) 2024-09-15T23:54:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcff7fff640 1 -- 172.21.15.112:0/2080466276 learned_addr learned my addr 172.21.15.112:0/2080466276 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcffcdee640 1 --2- 172.21.15.112:0/2080466276 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 0x555949c94040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcffd5ef640 1 --2- 172.21.15.112:0/2080466276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c212c0 0x555949c94ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcff7fff640 1 -- 172.21.15.112:0/2080466276 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 msgr2=0x555949c94040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcff7fff640 1 --2- 172.21.15.112:0/2080466276 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 0x555949c94040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcff7fff640 1 -- 172.21.15.112:0/2080466276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c212c0 msgr2=0x555949c94ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcff7fff640 1 --2- 172.21.15.112:0/2080466276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c212c0 0x555949c94ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcff7fff640 1 -- 172.21.15.112:0/2080466276 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555949a7e6a0 con 0x555949bdddb0 2024-09-15T23:54:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcff7fff640 1 --2- 172.21.15.112:0/2080466276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949bdddb0 0x555949c94580 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0055f20 tx=0x7fcfe0052790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c03da35d1decc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcfd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:54:52.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcfd77fe640 1 -- 172.21.15.112:0/2080466276 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe005f030 con 0x555949bdddb0 2024-09-15T23:54:52.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fcfd77fe640 1 -- 172.21.15.112:0/2080466276 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fcfe001bdd0 con 0x555949bdddb0 2024-09-15T23:54:52.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.707+0000 7fd00210e000 1 -- 172.21.15.112:0/2080466276 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfe80abdf0 con 0x555949bdddb0 2024-09-15T23:54:52.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfd77fe640 1 -- 172.21.15.112:0/2080466276 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fcfe0078050 con 0x555949bdddb0 2024-09-15T23:54:52.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 10 client.5076 fetch_fsmap learned FSMap version 15 2024-09-15T23:54:52.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 1 -- 172.21.15.112:0/2080466276 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x555949992a30 con 0x555949bdddb0 2024-09-15T23:54:52.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfd77fe640 1 -- 172.21.15.112:0/2080466276 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe80abdf0 con 0x555949bdddb0 2024-09-15T23:54:52.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfd77fe640 1 -- 172.21.15.112:0/2080466276 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7fcfe007b020 con 0x555949bdddb0 2024-09-15T23:54:52.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 10 client.5076 fetch_fsmap finished waiting for FSMap version 15 2024-09-15T23:54:52.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 10 client.5076 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:54:52.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 20 client.5076 populate_metadata read hostname 'smithi112' 2024-09-15T23:54:52.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 1 --2- 172.21.15.112:0/2080466276 >> [v2:172.21.15.112:6834/40913641,v1:172.21.15.112:6835/40913641] conn(0x555949c21be0 0x555949c4fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 4 client.5076 mds_command: new command op to 4869 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:54:52.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 1 -- 172.21.15.112:0/2080466276 --> [v2:172.21.15.112:6834/40913641,v1:172.21.15.112:6835/40913641] -- command(tid 0: {"prefix": "status"}) -- 0x555949a123a0 con 0x555949c21be0 2024-09-15T23:54:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcffcdee640 1 --2- 172.21.15.112:0/2080466276 >> [v2:172.21.15.112:6834/40913641,v1:172.21.15.112:6835/40913641] conn(0x555949c21be0 0x555949c4fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfd77fe640 10 client.5076 ms_handle_connect on v2:172.21.15.112:6834/40913641 2024-09-15T23:54:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcffcdee640 1 --2- 172.21.15.112:0/2080466276 >> [v2:172.21.15.112:6834/40913641,v1:172.21.15.112:6835/40913641] conn(0x555949c21be0 0x555949c4fb10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6943d293225dcbb6 server_cookie=91974e4382cb8ae5 in_seq=0 out_seq=0 2024-09-15T23:54:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfd77fe640 1 -- 172.21.15.112:0/2080466276 <== mds.0 v2:172.21.15.112:6834/40913641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x555949a123a0 con 0x555949c21be0 2024-09-15T23:54:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfd77fe640 10 client.5076 handle_command_reply: tid=0 2024-09-15T23:54:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 1 client.5076 shutdown 2024-09-15T23:54:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 1 -- 172.21.15.112:0/2080466276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949bdddb0 msgr2=0x555949c94580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 1 --2- 172.21.15.112:0/2080466276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949bdddb0 0x555949c94580 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0055f20 tx=0x7fcfe0052790 comp rx=0 tx=0).stop 2024-09-15T23:54:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 1 -- 172.21.15.112:0/2080466276 shutdown_connections 2024-09-15T23:54:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 1 --2- 172.21.15.112:0/2080466276 >> [v2:172.21.15.112:6834/40913641,v1:172.21.15.112:6835/40913641] conn(0x555949c21be0 0x555949c4fb10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 1 --2- 172.21.15.112:0/2080466276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555949c212c0 0x555949c94ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 1 --2- 172.21.15.112:0/2080466276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555949bdddb0 0x555949c94580 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfd77fe640 0 client.5076 ms_handle_reset on v2:172.21.15.112:6834/40913641 2024-09-15T23:54:52.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 1 --2- 172.21.15.112:0/2080466276 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x555949bd7830 0x555949c94040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 1 -- 172.21.15.112:0/2080466276 >> 172.21.15.112:0/2080466276 conn(0x555949c20c10 msgr2=0x555949bdd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 1 -- 172.21.15.112:0/2080466276 shutdown_connections 2024-09-15T23:54:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 1 -- 172.21.15.112:0/2080466276 wait complete. 2024-09-15T23:54:52.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fd00210e000 20 client.5076 trim_cache size 0 max 16384 2024-09-15T23:54:52.722 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:54:52.722 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "1af6b673-4d40-4109-af4e-78662faa7df8", 2024-09-15T23:54:52.722 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-15T23:54:52.722 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 4869, 2024-09-15T23:54:52.722 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-15T23:54:52.722 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-15T23:54:52.723 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-15T23:54:52.723 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 9.1014747580000002, 2024-09-15T23:54:52.723 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 15, 2024-09-15T23:54:52.723 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 40, 2024-09-15T23:54:52.723 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 40, 2024-09-15T23:54:52.723 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 16.043467221 2024-09-15T23:54:52.723 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:54:52.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfff052640 1 -- 172.21.15.112:0/3145777967 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcfd80678c0 msgr2=0x7fcfd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfff052640 1 --2- 172.21.15.112:0/3145777967 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcfd80678c0 0x7fcfd8069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80ad000 tx=0x7fcfe8008040 comp rx=0 tx=0).stop 2024-09-15T23:54:52.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfff052640 1 -- 172.21.15.112:0/3145777967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff81520a0 msgr2=0x7fcff80cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfff052640 1 --2- 172.21.15.112:0/3145777967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff81520a0 0x7fcff80cf6c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000d800 tx=0x7fcfe000dcc0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfff052640 1 -- 172.21.15.112:0/3145777967 shutdown_connections 2024-09-15T23:54:52.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfff052640 1 --2- 172.21.15.112:0/3145777967 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcfd80678c0 0x7fcfd8069d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfff052640 1 --2- 172.21.15.112:0/3145777967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcff815f1d0 0x7fcff81640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfff052640 1 --2- 172.21.15.112:0/3145777967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcff81520a0 0x7fcff80cf6c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfff052640 1 --2- 172.21.15.112:0/3145777967 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcff806fe50 0x7fcff8148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfff052640 1 -- 172.21.15.112:0/3145777967 >> 172.21.15.112:0/3145777967 conn(0x7fcff80b1f90 msgr2=0x7fcff815cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfff052640 1 -- 172.21.15.112:0/3145777967 shutdown_connections 2024-09-15T23:54:52.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.711+0000 7fcfff052640 1 -- 172.21.15.112:0/3145777967 wait complete. 2024-09-15T23:54:52.732 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:54:52.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.839+0000 7f4c0530c640 1 Processor -- start 2024-09-15T23:54:52.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.839+0000 7f4c0530c640 1 -- start start 2024-09-15T23:54:52.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.839+0000 7f4c0530c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c000b07e0 0x7f4c00070790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.839+0000 7f4c0530c640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c000b0bc0 con 0x7f4c00070cd0 2024-09-15T23:54:52.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.839+0000 7f4c0530c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c0006f0a0 con 0x7f4c0006f860 2024-09-15T23:54:52.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.839+0000 7f4c0530c640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4c000b64b0 con 0x7f4c000b07e0 2024-09-15T23:54:52.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.839+0000 7f4bfeffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c000b07e0 0x7f4c00070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.839+0000 7f4bf7fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4c00070cd0 0x7f4c00145310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41766/0 (socket says 172.21.15.112:41766) 2024-09-15T23:54:52.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.839+0000 7f4bf7fff640 1 -- 172.21.15.112:0/2040911518 learned_addr learned my addr 172.21.15.112:0/2040911518 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.839+0000 7f4bfeffd640 1 -- 172.21.15.112:0/2040911518 >> v1:172.21.15.169:6789/0 conn(0x7f4c0006f860 legacy=0x7f4c0006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.839+0000 7f4bfe7fc640 1 -- 172.21.15.112:0/2040911518 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 926302283 0 0) 0x7f4be8001120 con 0x7f4c00070cd0 2024-09-15T23:54:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.839+0000 7f4bfeffd640 1 -- 172.21.15.112:0/2040911518 >> v1:172.21.15.112:6789/0 conn(0x7f4c00070cd0 legacy=0x7f4c00145310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.839+0000 7f4bfeffd640 1 -- 172.21.15.112:0/2040911518 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c000b5ef0 con 0x7f4c000b07e0 2024-09-15T23:54:52.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bfeffd640 1 --2- 172.21.15.112:0/2040911518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c000b07e0 0x7f4c00070790 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00097c0 tx=0x7f4bf001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692499e39f559a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bfe7fc640 1 -- 172.21.15.112:0/2040911518 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf00b0070 con 0x7f4c000b07e0 2024-09-15T23:54:52.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bfe7fc640 1 -- 172.21.15.112:0/2040911518 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf00ab600 con 0x7f4c000b07e0 2024-09-15T23:54:52.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bfe7fc640 1 -- 172.21.15.112:0/2040911518 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf00ab9d0 con 0x7f4c000b07e0 2024-09-15T23:54:52.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 -- 172.21.15.112:0/2040911518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c000b07e0 msgr2=0x7f4c00070790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 --2- 172.21.15.112:0/2040911518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c000b07e0 0x7f4c00070790 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00097c0 tx=0x7f4bf001c410 comp rx=0 tx=0).stop 2024-09-15T23:54:52.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 -- 172.21.15.112:0/2040911518 shutdown_connections 2024-09-15T23:54:52.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 --2- 172.21.15.112:0/2040911518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c000b07e0 0x7f4c00070790 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 -- 172.21.15.112:0/2040911518 >> 172.21.15.112:0/2040911518 conn(0x7f4c000b6650 msgr2=0x7f4c000b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 -- 172.21.15.112:0/2040911518 shutdown_connections 2024-09-15T23:54:52.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 -- 172.21.15.112:0/2040911518 wait complete. 2024-09-15T23:54:52.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 Processor -- start 2024-09-15T23:54:52.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 -- start start 2024-09-15T23:54:52.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0006f860 0x7f4c00143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c00070cd0 0x7f4c0015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c000b07e0 0x7f4c0013fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0006c3d0 con 0x7f4c0006f860 2024-09-15T23:54:52.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4c000b5cd0 con 0x7f4c00070cd0 2024-09-15T23:54:52.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4c0530c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0006c550 con 0x7f4c000b07e0 2024-09-15T23:54:52.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bfeffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0006f860 0x7f4c00143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bfeffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0006f860 0x7f4c00143950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48766/0 (socket says 172.21.15.112:48766) 2024-09-15T23:54:52.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bfeffd640 1 -- 172.21.15.112:0/1709106057 learned_addr learned my addr 172.21.15.112:0/1709106057 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:52.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bff7fe640 1 --2- 172.21.15.112:0/1709106057 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c000b07e0 0x7f4c0013fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bf7fff640 1 --2- 172.21.15.112:0/1709106057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c00070cd0 0x7f4c0015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bfeffd640 1 -- 172.21.15.112:0/1709106057 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c000b07e0 msgr2=0x7f4c0013fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bfeffd640 1 --2- 172.21.15.112:0/1709106057 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c000b07e0 0x7f4c0013fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bfeffd640 1 -- 172.21.15.112:0/1709106057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c00070cd0 msgr2=0x7f4c0015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bfeffd640 1 --2- 172.21.15.112:0/1709106057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c00070cd0 0x7f4c0015b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bfeffd640 1 -- 172.21.15.112:0/1709106057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c00144030 con 0x7f4c0006f860 2024-09-15T23:54:52.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.843+0000 7f4bfeffd640 1 --2- 172.21.15.112:0/1709106057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0006f860 0x7f4c00143950 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00ae040 tx=0x7f4bf001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.847+0000 7f4bf77fe640 1 -- 172.21.15.112:0/1709106057 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf00bb070 con 0x7f4c0006f860 2024-09-15T23:54:52.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.847+0000 7f4bf77fe640 1 -- 172.21.15.112:0/1709106057 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf0004020 con 0x7f4c0006f860 2024-09-15T23:54:52.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.847+0000 7f4c0530c640 1 -- 172.21.15.112:0/1709106057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c00144310 con 0x7f4c0006f860 2024-09-15T23:54:52.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.847+0000 7f4bf77fe640 1 -- 172.21.15.112:0/1709106057 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf00b0040 con 0x7f4c0006f860 2024-09-15T23:54:52.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.847+0000 7f4c0530c640 1 -- 172.21.15.112:0/1709106057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c00142210 con 0x7f4c0006f860 2024-09-15T23:54:52.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.847+0000 7f4c0530c640 1 -- 172.21.15.112:0/1709106057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c00070790 con 0x7f4c0006f860 2024-09-15T23:54:52.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.847+0000 7f4bf77fe640 1 -- 172.21.15.112:0/1709106057 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4bf0003620 con 0x7f4c0006f860 2024-09-15T23:54:52.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.847+0000 7f4bf77fe640 1 --2- 172.21.15.112:0/1709106057 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4be00678c0 0x7f4be0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.847+0000 7f4bf7fff640 1 --2- 172.21.15.112:0/1709106057 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4be00678c0 0x7f4be0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.847+0000 7f4bf77fe640 1 -- 172.21.15.112:0/1709106057 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f4bf0120d90 con 0x7f4c0006f860 2024-09-15T23:54:52.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.847+0000 7f4bf7fff640 1 --2- 172.21.15.112:0/1709106057 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4be00678c0 0x7f4be0069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4be8007fd0 tx=0x7f4be8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:52.851+0000 7f4bf77fe640 1 -- 172.21.15.112:0/1709106057 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4bf0016090 con 0x7f4c0006f860 2024-09-15T23:54:53.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53.035+0000 7f4c0530c640 1 -- 172.21.15.112:0/1709106057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4c0015fd00 con 0x7f4c0006f860 2024-09-15T23:54:53.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53.035+0000 7f4bf77fe640 1 -- 172.21.15.112:0/1709106057 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7f4bf00b53d0 con 0x7f4c0006f860 2024-09-15T23:54:53.042 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:54:53.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53.039+0000 7f4c0530c640 1 -- 172.21.15.112:0/1709106057 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4be00678c0 msgr2=0x7f4be0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:53.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53.039+0000 7f4c0530c640 1 --2- 172.21.15.112:0/1709106057 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4be00678c0 0x7f4be0069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4be8007fd0 tx=0x7f4be8009040 comp rx=0 tx=0).stop 2024-09-15T23:54:53.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53.039+0000 7f4c0530c640 1 -- 172.21.15.112:0/1709106057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0006f860 msgr2=0x7f4c00143950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:53.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53.039+0000 7f4c0530c640 1 --2- 172.21.15.112:0/1709106057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0006f860 0x7f4c00143950 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00ae040 tx=0x7f4bf001ac50 comp rx=0 tx=0).stop 2024-09-15T23:54:53.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53.039+0000 7f4c0530c640 1 -- 172.21.15.112:0/1709106057 shutdown_connections 2024-09-15T23:54:53.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53.039+0000 7f4c0530c640 1 --2- 172.21.15.112:0/1709106057 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4be00678c0 0x7f4be0069d80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:53.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53.039+0000 7f4c0530c640 1 --2- 172.21.15.112:0/1709106057 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c000b07e0 0x7f4c0013fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:53.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53.039+0000 7f4c0530c640 1 --2- 172.21.15.112:0/1709106057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c00070cd0 0x7f4c0015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:53.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53.039+0000 7f4c0530c640 1 --2- 172.21.15.112:0/1709106057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c0006f860 0x7f4c00143950 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:53.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53.039+0000 7f4c0530c640 1 -- 172.21.15.112:0/1709106057 >> 172.21.15.112:0/1709106057 conn(0x7f4c000b6650 msgr2=0x7f4c0013d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:53.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53.039+0000 7f4c0530c640 1 -- 172.21.15.112:0/1709106057 shutdown_connections 2024-09-15T23:54:53.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53.039+0000 7f4c0530c640 1 -- 172.21.15.112:0/1709106057 wait complete. 2024-09-15T23:54:53.059 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:54:53.059 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:54:53.059 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-15T23:54:53.059 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:54:53.059 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:53.059 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:54:53.060 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:54:53.060 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:54:53.060 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:54:53.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:53.060 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-15T23:54:53.066 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:54:53.066 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:54:53.066 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:54:53.066 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:53.066 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-15T23:54:53.066 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:53.066 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:53.066 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:53.067 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-15T23:54:53.067 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:53.067 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:53.067 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-15T23:54:53.067 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:54:53.067 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:53.067 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:54:53.067 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:53.067 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T23:54:53.067 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42404sec preferred_lft 42404sec 2024-09-15T23:54:53.067 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2024-09-15T23:54:53.067 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:53.068 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T23:54:53.068 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:5c:cd:1e:d6 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:53.068 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T23:54:53.068 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:53.068 INFO:teuthology.orchestra.run.smithi112.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:54:53.068 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T23:54:53.068 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:54:53.068 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:53.068 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T23:54:53.068 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:53.068 INFO:teuthology.orchestra.run.smithi112.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:54:53.068 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:53.068 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T23:54:53.069 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:53.069 INFO:teuthology.orchestra.run.smithi112.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:54:53.069 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:54:53.069 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T23:54:53.069 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:54:53.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:53.069 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:54:53.119 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-15T23:54:53.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:53.120 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-15T23:54:53.169 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-15T23:54:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:54:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T23:54:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:54:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T23:54:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T23:54:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:54:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:54:53.170 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:54:53.170 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:54:53.171 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:54:53.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:54:53.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:54:53.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:54:53.171 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:54:53.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:54:53.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:53.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:53.290 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-15T23:54:53.339 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:54:53.339 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:54:53.340 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:54:53.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:53.340 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-15T23:54:53.395 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T23:54:53.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:54:53.396 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:53.443 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:54:53.444 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:54:53.444 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:53.491 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:54:53.549 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:53.596 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:54:53.596 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:54:53.597 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:54:53.597 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:54:53.597 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:54:53.597 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:54:53.597 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:54:53.597 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:54:53.597 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:54:53.597 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:54:53.597 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:54:53.597 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:54:53.597 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:53.597 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:54:53.598 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:54:53.598 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:54:53.598 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:54:53.598 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:54:53.598 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:53.598 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:54:53.598 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:53.598 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:54:53.598 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:54:53.598 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:54:53.598 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:54:53.598 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:54:53.598 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:54:53.598 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:54:53.599 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:54:53.599 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:53.599 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:53.599 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:54:53.599 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:54:53.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:53.600 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:54:53.651 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:54:53.651 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T23:54:53.696 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:54:53.711 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:53.759 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:54:53.759 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:54:53.760 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:54:53.760 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:54:53.760 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:54:53.760 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:54:53.760 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:54:53.760 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:54:53.760 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:54:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:54:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:54:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:54:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:54:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:54:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:54:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:54:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:54:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:54:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:53.761 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:54:53.762 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:54:53.762 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:54:53.762 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:54:53.762 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:54:53.762 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:54:53.762 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:54:53.762 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:54:53.762 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:53.762 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:53.762 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:54:53.762 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:54:53.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:53.763 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:54:53.777 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:2024-09-15T23:54:53.771+0000 7f3fe162d580 -1 init, newargv = 0x55fc565ad100 newargc=15 2024-09-15T23:54:53.777 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[37712]: starting ceph client 2024-09-15T23:54:53.783 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[37712]: starting fuse 2024-09-15T23:54:54.883 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:54:54.900 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:54:54.948 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:54:54.948 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:54:54.949 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:54:54.949 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:54:54.949 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:54:54.949 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:54:54.949 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:54:54.949 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:54:54.949 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:54:54.949 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:54:54.949 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:54:54.949 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:54:54.949 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:54:54.949 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:54:54.949 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:54:54.949 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:54:54.950 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:54:54.950 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:54:54.950 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:54:54.950 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:54:54.950 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:54:54.950 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:54:54.950 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:54:54.950 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:54:54.950 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:54:54.950 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:54:54.950 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:54:54.950 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:54:54.950 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:54:54.950 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:54.951 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:54:54.951 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:54:54.951 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:54:54.951 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:54.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:54.952 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:54:54.999 INFO:teuthology.orchestra.run.smithi112.stdout:45 2024-09-15T23:54:54.999 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T23:54:54.999 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:54:54.999 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2024-09-15T23:54:54.999 DEBUG:teuthology.orchestra.run.smithi112:> import re 2024-09-15T23:54:55.000 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:54:55.000 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-15T23:54:55.000 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:55.000 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2024-09-15T23:54:55.000 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:54:55.000 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2024-09-15T23:54:55.000 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:54:55.000 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:55.000 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2024-09-15T23:54:55.000 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2024-09-15T23:54:55.000 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2024-09-15T23:54:55.000 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2024-09-15T23:54:55.000 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:55.000 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2024-09-15T23:54:55.001 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:54:55.001 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:54:55.001 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:54:55.001 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2024-09-15T23:54:55.001 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2024-09-15T23:54:55.001 DEBUG:teuthology.orchestra.run.smithi112:> return f 2024-09-15T23:54:55.001 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:54:55.001 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:55.001 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.0")) 2024-09-15T23:54:55.001 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:54:55.121 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.0.37712.asok 2024-09-15T23:54:55.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:55.133 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37712.asok 2024-09-15T23:54:55.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:55.133 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37712.asok status 2024-09-15T23:54:55.282 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:54:55.282 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2024-09-15T23:54:55.282 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:54:55.282 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:54:55.282 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "0", 2024-09-15T23:54:55.282 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2024-09-15T23:54:55.282 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:54:55.282 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "37712", 2024-09-15T23:54:55.283 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2024-09-15T23:54:55.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:55.283 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2024-09-15T23:54:55.283 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2024-09-15T23:54:55.283 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5091, 2024-09-15T23:54:55.283 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2024-09-15T23:54:55.283 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2024-09-15T23:54:55.283 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2024-09-15T23:54:55.283 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 5091 2024-09-15T23:54:55.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:55.283 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:54:55.283 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:54:55.284 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:54:55.284 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3951846550 2024-09-15T23:54:55.284 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:54:55.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:55.284 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:54:55.284 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:54:55.284 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:54:55.284 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 3951846550 2024-09-15T23:54:55.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:54:55.284 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.5091 192.168.0.1:0/3951846550", 2024-09-15T23:54:55.284 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.1:0/3951846550", 2024-09-15T23:54:55.284 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2024-09-15T23:54:55.285 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 15, 2024-09-15T23:54:55.285 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 40, 2024-09-15T23:54:55.285 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:54:55.285 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2024-09-15T23:54:55.285 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2024-09-15T23:54:55.285 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:54:55.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:55.296 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2024-09-15T23:54:55.296 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:55.302 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2024-09-15T23:54:55.302 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:55.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:55.302 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:54:55.358 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-15T23:54:55.358 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:54:55.358 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:55.358 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:54:55.358 DEBUG:teuthology.orchestra.run.smithi112:> subdir = "delete_me" 2024-09-15T23:54:55.358 DEBUG:teuthology.orchestra.run.smithi112:> size = 1024 2024-09-15T23:54:55.358 DEBUG:teuthology.orchestra.run.smithi112:> file_count = 1000 2024-09-15T23:54:55.358 DEBUG:teuthology.orchestra.run.smithi112:> os.mkdir(os.path.join(mountpoint, subdir)) 2024-09-15T23:54:55.358 DEBUG:teuthology.orchestra.run.smithi112:> for i in range(0, file_count): 2024-09-15T23:54:55.358 DEBUG:teuthology.orchestra.run.smithi112:> filename = "{0}_{1}.bin".format(i, size) 2024-09-15T23:54:55.358 DEBUG:teuthology.orchestra.run.smithi112:> with open(os.path.join(mountpoint, subdir, filename), '"'"'w'"'"') as f: 2024-09-15T23:54:55.358 DEBUG:teuthology.orchestra.run.smithi112:> f.write(size * '"'"'x'"'"') 2024-09-15T23:54:55.358 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:54:57.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:57.354 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:54:57.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9ddbac6640 1 Processor -- start 2024-09-15T23:54:57.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9ddbac6640 1 -- start start 2024-09-15T23:54:57.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9ddbac6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9dd406f010 0x7f9dd4166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:57.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9ddbac6640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd40b3290 con 0x7f9dd415bec0 2024-09-15T23:54:57.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9ddbac6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd40b3570 con 0x7f9dd415c2a0 2024-09-15T23:54:57.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9ddbac6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd40b3850 con 0x7f9dd406f010 2024-09-15T23:54:57.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd9862640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9dd415bec0 0x7f9dd40ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41772/0 (socket says 172.21.15.112:41772) 2024-09-15T23:54:57.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd9862640 1 -- 172.21.15.112:0/4139235562 learned_addr learned my addr 172.21.15.112:0/4139235562 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:54:57.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 -- 172.21.15.112:0/4139235562 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566953734 0 0) 0x7f9dd40b3290 con 0x7f9dd415bec0 2024-09-15T23:54:57.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 -- 172.21.15.112:0/4139235562 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dc0003530 con 0x7f9dd415bec0 2024-09-15T23:54:57.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dda063640 1 --2- 172.21.15.112:0/4139235562 >> v2:172.21.15.169:3300/0 conn(0x7f9dd406f010 0x7f9dd4166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:57.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 -- 172.21.15.112:0/4139235562 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3066986346 0 0) 0x7f9dc0003530 con 0x7f9dd415bec0 2024-09-15T23:54:57.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 -- 172.21.15.112:0/4139235562 >> v2:172.21.15.169:3300/0 conn(0x7f9dd406f010 msgr2=0x7f9dd4166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 --2- 172.21.15.112:0/4139235562 >> v2:172.21.15.169:3300/0 conn(0x7f9dd406f010 0x7f9dd4166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:57.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 -- 172.21.15.112:0/4139235562 >> v1:172.21.15.169:6789/0 conn(0x7f9dd415c2a0 legacy=0x7f9dd40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:57.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 -- 172.21.15.112:0/4139235562 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd40b3b30 con 0x7f9dd415bec0 2024-09-15T23:54:57.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 -- 172.21.15.112:0/4139235562 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f9dd0001680 con 0x7f9dd415bec0 2024-09-15T23:54:57.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 -- 172.21.15.112:0/4139235562 >> v1:172.21.15.112:6789/0 conn(0x7f9dd415bec0 legacy=0x7f9dd40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:57.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 --2- 172.21.15.112:0/4139235562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9dc00039c0 0x7f9dc0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:57.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 --2- 172.21.15.112:0/4139235562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dc0004810 0x7f9dc0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:57.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 --2- 172.21.15.112:0/4139235562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9dc00051d0 0x7f9dc000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:57.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 -- 172.21.15.112:0/4139235562 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd40b3850 con 0x7f9dc0004810 2024-09-15T23:54:57.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 -- 172.21.15.112:0/4139235562 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc000c120 con 0x7f9dc00039c0 2024-09-15T23:54:57.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd8860640 1 -- 172.21.15.112:0/4139235562 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc000c320 con 0x7f9dc00051d0 2024-09-15T23:54:57.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd9061640 1 --2- 172.21.15.112:0/4139235562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dc0004810 0x7f9dc0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd9862640 1 --2- 172.21.15.112:0/4139235562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9dc00039c0 0x7f9dc0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd9061640 1 -- 172.21.15.112:0/4139235562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9dc00051d0 msgr2=0x7f9dc000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd9061640 1 --2- 172.21.15.112:0/4139235562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9dc00051d0 0x7f9dc000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd9061640 1 -- 172.21.15.112:0/4139235562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9dc00039c0 msgr2=0x7f9dc0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd9061640 1 --2- 172.21.15.112:0/4139235562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9dc00039c0 0x7f9dc0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dd9061640 1 -- 172.21.15.112:0/4139235562 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc0003530 con 0x7f9dc0004810 2024-09-15T23:54:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.507+0000 7f9dda063640 1 -- 172.21.15.112:0/4139235562 reap_dead start 2024-09-15T23:54:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9dd9061640 1 --2- 172.21.15.112:0/4139235562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dc0004810 0x7f9dc0004c90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4001750 tx=0x7f9dc401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d9c1a91f0dcab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9dd8860640 1 -- 172.21.15.112:0/4139235562 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40013a0 con 0x7f9dc0004810 2024-09-15T23:54:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9dd8860640 1 -- 172.21.15.112:0/4139235562 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc40052f0 con 0x7f9dc0004810 2024-09-15T23:54:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9dd8860640 1 -- 172.21.15.112:0/4139235562 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4003840 con 0x7f9dc0004810 2024-09-15T23:54:57.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 -- 172.21.15.112:0/4139235562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dc0004810 msgr2=0x7f9dc0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:57.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 --2- 172.21.15.112:0/4139235562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dc0004810 0x7f9dc0004c90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4001750 tx=0x7f9dc401c3e0 comp rx=0 tx=0).stop 2024-09-15T23:54:57.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 -- 172.21.15.112:0/4139235562 shutdown_connections 2024-09-15T23:54:57.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 --2- 172.21.15.112:0/4139235562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dc0004810 0x7f9dc0004c90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:57.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 -- 172.21.15.112:0/4139235562 >> 172.21.15.112:0/4139235562 conn(0x7f9dd40b1f90 msgr2=0x7f9dd40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:57.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 -- 172.21.15.112:0/4139235562 shutdown_connections 2024-09-15T23:54:57.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 -- 172.21.15.112:0/4139235562 wait complete. 2024-09-15T23:54:57.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 Processor -- start 2024-09-15T23:54:57.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 -- start start 2024-09-15T23:54:57.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9dc0004810 0x7f9dd415d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:57.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd414b650 0x7f9dd40b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9dd40b0c80 0x7f9dd415e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd40afc90 con 0x7f9dd414b650 2024-09-15T23:54:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd40b40f0 con 0x7f9dd40b0c80 2024-09-15T23:54:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9ddbac6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd40ad200 con 0x7f9dc0004810 2024-09-15T23:54:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9dd9061640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd414b650 0x7f9dd40b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9dd9061640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd414b650 0x7f9dd40b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48790/0 (socket says 172.21.15.112:48790) 2024-09-15T23:54:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9dd9061640 1 -- 172.21.15.112:0/952898944 learned_addr learned my addr 172.21.15.112:0/952898944 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9dd9061640 1 -- 172.21.15.112:0/952898944 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9dc0004810 msgr2=0x7f9dd415d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9dd9061640 1 --2- 172.21.15.112:0/952898944 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9dc0004810 0x7f9dd415d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9dd9061640 1 -- 172.21.15.112:0/952898944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9dd40b0c80 msgr2=0x7f9dd415e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9dd9061640 1 --2- 172.21.15.112:0/952898944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9dd40b0c80 0x7f9dd415e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9dd9061640 1 -- 172.21.15.112:0/952898944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd415b450 con 0x7f9dd414b650 2024-09-15T23:54:57.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9dd9061640 1 --2- 172.21.15.112:0/952898944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd414b650 0x7f9dd40b0740 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4005040 tx=0x7f9dc0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.511+0000 7f9dca7fc640 1 -- 172.21.15.112:0/952898944 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40b8070 con 0x7f9dd414b650 2024-09-15T23:54:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.515+0000 7f9dca7fc640 1 -- 172.21.15.112:0/952898944 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc4000ee0 con 0x7f9dd414b650 2024-09-15T23:54:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.515+0000 7f9ddbac6640 1 -- 172.21.15.112:0/952898944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd40cf9c0 con 0x7f9dd414b650 2024-09-15T23:54:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.515+0000 7f9dca7fc640 1 -- 172.21.15.112:0/952898944 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4007a40 con 0x7f9dd414b650 2024-09-15T23:54:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.515+0000 7f9ddbac6640 1 -- 172.21.15.112:0/952898944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd415ca60 con 0x7f9dd414b650 2024-09-15T23:54:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.515+0000 7f9ddbac6640 1 -- 172.21.15.112:0/952898944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd40b10a0 con 0x7f9dd414b650 2024-09-15T23:54:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.515+0000 7f9dca7fc640 1 -- 172.21.15.112:0/952898944 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9dc4007460 con 0x7f9dd414b650 2024-09-15T23:54:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.515+0000 7f9dca7fc640 1 --2- 172.21.15.112:0/952898944 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9db80678c0 0x7f9db8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.515+0000 7f9dd9862640 1 --2- 172.21.15.112:0/952898944 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9db80678c0 0x7f9db8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.515+0000 7f9dca7fc640 1 -- 172.21.15.112:0/952898944 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f9dc41200c0 con 0x7f9dd414b650 2024-09-15T23:54:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.515+0000 7f9dd9862640 1 --2- 172.21.15.112:0/952898944 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9db80678c0 0x7f9db8069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0004880 tx=0x7f9dd00047f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:57.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.519+0000 7f9dca7fc640 1 -- 172.21.15.112:0/952898944 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9dc40160f0 con 0x7f9dd414b650 2024-09-15T23:54:57.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.703+0000 7f9ddbac6640 1 -- 172.21.15.112:0/952898944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9dd40ad530 con 0x7f9dd414b650 2024-09-15T23:54:57.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.703+0000 7f9dca7fc640 1 -- 172.21.15.112:0/952898944 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f9dc40f0b00 con 0x7f9dd414b650 2024-09-15T23:54:57.708 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:54:57.708 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"btime":"2024-09-15T23:54:45:647611+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1357012609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1357012609},{"type":"v1","addr":"172.21.15.169:6835","nonce":1357012609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2931559222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2931559222},{"type":"v1","addr":"172.21.15.112:6837","nonce":2931559222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1936572340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1936572340},{"type":"v1","addr":"172.21.15.169:6833","nonce":1936572340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:54:42.951140+0000","modified":"2024-09-15T23:54:44.991346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4869":{"gid":4869,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/40913641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":40913641},{"type":"v1","addr":"172.21.15.112:6835","nonce":40913641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4869,"qdb_cluster":[4869]},"id":2}]} 2024-09-15T23:54:57.708 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-15T23:54:57.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.703+0000 7f9ddbac6640 1 -- 172.21.15.112:0/952898944 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9db80678c0 msgr2=0x7f9db8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:57.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.703+0000 7f9ddbac6640 1 --2- 172.21.15.112:0/952898944 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9db80678c0 0x7f9db8069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0004880 tx=0x7f9dd00047f0 comp rx=0 tx=0).stop 2024-09-15T23:54:57.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.703+0000 7f9ddbac6640 1 -- 172.21.15.112:0/952898944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd414b650 msgr2=0x7f9dd40b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:57.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.703+0000 7f9ddbac6640 1 --2- 172.21.15.112:0/952898944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd414b650 0x7f9dd40b0740 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4005040 tx=0x7f9dc0005840 comp rx=0 tx=0).stop 2024-09-15T23:54:57.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.703+0000 7f9ddbac6640 1 -- 172.21.15.112:0/952898944 shutdown_connections 2024-09-15T23:54:57.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.703+0000 7f9ddbac6640 1 --2- 172.21.15.112:0/952898944 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9db80678c0 0x7f9db8069d80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:57.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.703+0000 7f9ddbac6640 1 --2- 172.21.15.112:0/952898944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9dd40b0c80 0x7f9dd415e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:57.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.703+0000 7f9ddbac6640 1 --2- 172.21.15.112:0/952898944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dd414b650 0x7f9dd40b0740 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:57.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.703+0000 7f9ddbac6640 1 --2- 172.21.15.112:0/952898944 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9dc0004810 0x7f9dd415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:57.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.703+0000 7f9ddbac6640 1 -- 172.21.15.112:0/952898944 >> 172.21.15.112:0/952898944 conn(0x7f9dd40b1f90 msgr2=0x7f9dd415a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:57.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.703+0000 7f9ddbac6640 1 -- 172.21.15.112:0/952898944 shutdown_connections 2024-09-15T23:54:57.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:57.703+0000 7f9ddbac6640 1 -- 172.21.15.112:0/952898944 wait complete. 2024-09-15T23:54:57.725 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-15T23:54:58.229 INFO:teuthology.orchestra.run.smithi112.stdout:{"message":"","return_code":0} 2024-09-15T23:54:58.229 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-15T23:54:58.229 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-15T23:54:58.230 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:54:58.230 DEBUG:teuthology.orchestra.run.smithi112:> import stat 2024-09-15T23:54:58.230 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:54:58.230 DEBUG:teuthology.orchestra.run.smithi112:> print(os.stat("/home/ubuntu/cephtest/mnt.0/delete_me").st_ino) 2024-09-15T23:54:58.230 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:54:58.287 INFO:teuthology.orchestra.run.smithi112.stdout:1099511627776 2024-09-15T23:54:58.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:54:58.297 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 10000000000.00000000 2024-09-15T23:54:58.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.367+0000 7f5815055080 1 Processor -- start 2024-09-15T23:54:58.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.367+0000 7f5815055080 1 -- start start 2024-09-15T23:54:58.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc81f5ebb0 0x55bc82004360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55bc81f75230 0x55bc81f2fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bc820031b0 0x55bc81fff570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55bc81f76ee0 con 0x55bc820031b0 2024-09-15T23:54:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bc81e7f1b0 con 0x55bc81f5ebb0 2024-09-15T23:54:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55bc81f76260 con 0x55bc81f75230 2024-09-15T23:54:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bc820031b0 0x55bc81fff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bc820031b0 0x55bc81fff570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55272/0 (socket says 172.21.15.112:55272) 2024-09-15T23:54:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 -- 172.21.15.112:0/4171117787 learned_addr learned my addr 172.21.15.112:0/4171117787 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 -- 172.21.15.112:0/4171117787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55bc81f75230 msgr2=0x55bc81f2fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5812b68640 1 --2- 172.21.15.112:0/4171117787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc81f5ebb0 0x55bc82004360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5812367640 1 --2- 172.21.15.112:0/4171117787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55bc81f75230 0x55bc81f2fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 --2- 172.21.15.112:0/4171117787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55bc81f75230 0x55bc81f2fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:58.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 -- 172.21.15.112:0/4171117787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc81f5ebb0 msgr2=0x55bc82004360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:54:58.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 --2- 172.21.15.112:0/4171117787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc81f5ebb0 0x55bc82004360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:58.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 -- 172.21.15.112:0/4171117787 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc820048a0 con 0x55bc820031b0 2024-09-15T23:54:58.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5812b68640 1 --2- 172.21.15.112:0/4171117787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc81f5ebb0 0x55bc82004360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:58.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 --2- 172.21.15.112:0/4171117787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bc820031b0 0x55bc81fff570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f580c01b450 tx=0x7f580c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef45aa61d07e6a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:58.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5811365640 1 -- 172.21.15.112:0/4171117787 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c0b9070 con 0x55bc820031b0 2024-09-15T23:54:58.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5811365640 1 -- 172.21.15.112:0/4171117787 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c0ab7f0 con 0x55bc820031b0 2024-09-15T23:54:58.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5811365640 1 -- 172.21.15.112:0/4171117787 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c0b0040 con 0x55bc820031b0 2024-09-15T23:54:58.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 -- 172.21.15.112:0/4171117787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bc820031b0 msgr2=0x55bc81fff570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:58.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 --2- 172.21.15.112:0/4171117787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bc820031b0 0x55bc81fff570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f580c01b450 tx=0x7f580c0033b0 comp rx=0 tx=0).stop 2024-09-15T23:54:58.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 -- 172.21.15.112:0/4171117787 shutdown_connections 2024-09-15T23:54:58.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 --2- 172.21.15.112:0/4171117787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bc820031b0 0x55bc81fff570 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:58.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 --2- 172.21.15.112:0/4171117787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55bc81f75230 0x55bc81f2fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:58.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 --2- 172.21.15.112:0/4171117787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc81f5ebb0 0x55bc82004360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:58.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 -- 172.21.15.112:0/4171117787 >> 172.21.15.112:0/4171117787 conn(0x55bc81f59220 msgr2=0x55bc81f59600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:58.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 -- 172.21.15.112:0/4171117787 shutdown_connections 2024-09-15T23:54:58.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 -- 172.21.15.112:0/4171117787 wait complete. 2024-09-15T23:54:58.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 Processor -- start 2024-09-15T23:54:58.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 -- start start 2024-09-15T23:54:58.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc81f5ebb0 0x55bc81f564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:58.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55bc81f75230 0x55bc81f57fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:58.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bc820031b0 0x55bc81ffb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:58.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55bc81f31130 con 0x55bc820031b0 2024-09-15T23:54:58.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bc81f30e90 con 0x55bc81f5ebb0 2024-09-15T23:54:58.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55bc81f313d0 con 0x55bc81f75230 2024-09-15T23:54:58.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bc820031b0 0x55bc81ffb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:58.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bc820031b0 0x55bc81ffb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55286/0 (socket says 172.21.15.112:55286) 2024-09-15T23:54:58.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 -- 172.21.15.112:0/151036223 learned_addr learned my addr 172.21.15.112:0/151036223 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:54:58.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5812367640 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55bc81f75230 0x55bc81f57fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:58.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5812b68640 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc81f5ebb0 0x55bc81f564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:58.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 -- 172.21.15.112:0/151036223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55bc81f75230 msgr2=0x55bc81f57fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:58.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55bc81f75230 0x55bc81f57fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:58.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 -- 172.21.15.112:0/151036223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc81f5ebb0 msgr2=0x55bc81f564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:58.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc81f5ebb0 0x55bc81f564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:58.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 -- 172.21.15.112:0/151036223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc81f555d0 con 0x55bc820031b0 2024-09-15T23:54:58.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5812367640 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55bc81f75230 0x55bc81f57fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:54:58.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5813369640 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bc820031b0 0x55bc81ffb570 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f580c018ba0 tx=0x7f580c017d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:58.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f580bfff640 1 -- 172.21.15.112:0/151036223 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c0c2070 con 0x55bc820031b0 2024-09-15T23:54:58.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f580bfff640 1 -- 172.21.15.112:0/151036223 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c0b47e0 con 0x55bc820031b0 2024-09-15T23:54:58.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 -- 172.21.15.112:0/151036223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc81f55870 con 0x55bc820031b0 2024-09-15T23:54:58.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f580bfff640 1 -- 172.21.15.112:0/151036223 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c0b9040 con 0x55bc820031b0 2024-09-15T23:54:58.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.371+0000 7f5815055080 1 -- 172.21.15.112:0/151036223 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc81f55db0 con 0x55bc820031b0 2024-09-15T23:54:58.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f580bfff640 1 -- 172.21.15.112:0/151036223 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f580c0c5070 con 0x55bc820031b0 2024-09-15T23:54:58.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f580bfff640 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f57f40662a0 0x7f57f4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:58.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f580bfff640 1 -- 172.21.15.112:0/151036223 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f580c11f5c0 con 0x55bc820031b0 2024-09-15T23:54:58.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5812b68640 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f57f40662a0 0x7f57f4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:58.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5815055080 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x55bc81f55100 0x55bc81ffbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:58.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5815055080 1 -- 172.21.15.112:0/151036223 --> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x55bc81ffc500 con 0x55bc81f55100 2024-09-15T23:54:58.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5812367640 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x55bc81f55100 0x55bc81ffbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:58.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5812b68640 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f57f40662a0 0x7f57f4068760 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5804005620 tx=0x7f5804005530 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:58.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5812367640 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x55bc81f55100 0x55bc81ffbfc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:58.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5812367640 1 -- 172.21.15.112:0/151036223 <== osd.2 v2:172.21.15.112:6816/4134332386 1 ==== osd_op_reply(1 10000000000.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x7f57fc00f3f0 con 0x55bc81f55100 2024-09-15T23:54:58.384 INFO:teuthology.orchestra.run.smithi112.stdout:cephfs_metadata/10000000000.00000000 mtime 2024-09-15T23:54:58.000000+0000, size 0 2024-09-15T23:54:58.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5815055080 1 -- 172.21.15.112:0/151036223 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x55bc81f55100 msgr2=0x55bc81ffbfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:58.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5815055080 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x55bc81f55100 0x55bc81ffbfc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:58.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5815055080 1 -- 172.21.15.112:0/151036223 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f57f40662a0 msgr2=0x7f57f4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:58.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5815055080 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f57f40662a0 0x7f57f4068760 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5804005620 tx=0x7f5804005530 comp rx=0 tx=0).stop 2024-09-15T23:54:58.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5815055080 1 -- 172.21.15.112:0/151036223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bc820031b0 msgr2=0x55bc81ffb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:58.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5815055080 1 --2- 172.21.15.112:0/151036223 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55bc820031b0 0x55bc81ffb570 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f580c018ba0 tx=0x7f580c017d10 comp rx=0 tx=0).stop 2024-09-15T23:54:58.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5813369640 1 -- 172.21.15.112:0/151036223 reap_dead start 2024-09-15T23:54:58.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5815055080 1 -- 172.21.15.112:0/151036223 shutdown_connections 2024-09-15T23:54:58.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5815055080 1 -- 172.21.15.112:0/151036223 >> 172.21.15.112:0/151036223 conn(0x55bc81f59220 msgr2=0x55bc81f2fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:58.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5815055080 1 -- 172.21.15.112:0/151036223 shutdown_connections 2024-09-15T23:54:58.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:54:58.375+0000 7f5815055080 1 -- 172.21.15.112:0/151036223 wait complete. 2024-09-15T23:54:58.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:54:58.387 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -rf delete_me) 2024-09-15T23:55:01.145 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:01.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f8354dea640 1 Processor -- start 2024-09-15T23:55:01.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f8354dea640 1 -- start start 2024-09-15T23:55:01.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f8354dea640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f83500b3c40 0x7f835015fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f8354dea640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83500b4620 con 0x7f83501567e0 2024-09-15T23:55:01.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f8354dea640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83500b4900 con 0x7f83500b40d0 2024-09-15T23:55:01.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f8354dea640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f83500b4be0 con 0x7f83500b3c40 2024-09-15T23:55:01.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834e59c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f83501567e0 0x7f83500b56c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47290/0 (socket says 172.21.15.112:47290) 2024-09-15T23:55:01.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834e59c640 1 -- 172.21.15.112:0/2199414448 learned_addr learned my addr 172.21.15.112:0/2199414448 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:01.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834dd9b640 1 --2- 172.21.15.112:0/2199414448 >> v2:172.21.15.169:3300/0 conn(0x7f83500b3c40 0x7f835015fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 -- 172.21.15.112:0/2199414448 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1316499322 0 0) 0x7f83500b4620 con 0x7f83501567e0 2024-09-15T23:55:01.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 -- 172.21.15.112:0/2199414448 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f833c003530 con 0x7f83501567e0 2024-09-15T23:55:01.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 -- 172.21.15.112:0/2199414448 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1856144853 0 0) 0x7f833c003530 con 0x7f83501567e0 2024-09-15T23:55:01.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 -- 172.21.15.112:0/2199414448 >> v2:172.21.15.169:3300/0 conn(0x7f83500b3c40 msgr2=0x7f835015fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:01.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 --2- 172.21.15.112:0/2199414448 >> v2:172.21.15.169:3300/0 conn(0x7f83500b3c40 0x7f835015fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 -- 172.21.15.112:0/2199414448 >> v1:172.21.15.169:6789/0 conn(0x7f83500b40d0 legacy=0x7f835015d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:01.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 -- 172.21.15.112:0/2199414448 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83500b4ec0 con 0x7f83501567e0 2024-09-15T23:55:01.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 -- 172.21.15.112:0/2199414448 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f8348001a00 con 0x7f83501567e0 2024-09-15T23:55:01.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 -- 172.21.15.112:0/2199414448 >> v1:172.21.15.112:6789/0 conn(0x7f83501567e0 legacy=0x7f83500b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:01.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 --2- 172.21.15.112:0/2199414448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f833c0039f0 0x7f833c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 --2- 172.21.15.112:0/2199414448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f833c004810 0x7f833c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 --2- 172.21.15.112:0/2199414448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f833c0052f0 0x7f833c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 -- 172.21.15.112:0/2199414448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f83500b4be0 con 0x7f833c0052f0 2024-09-15T23:55:01.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 -- 172.21.15.112:0/2199414448 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f833c00c1f0 con 0x7f833c004810 2024-09-15T23:55:01.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834d59a640 1 -- 172.21.15.112:0/2199414448 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f833c00c3f0 con 0x7f833c0039f0 2024-09-15T23:55:01.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834ed9d640 1 --2- 172.21.15.112:0/2199414448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f833c0052f0 0x7f833c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834e59c640 1 --2- 172.21.15.112:0/2199414448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f833c0039f0 0x7f833c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834dd9b640 1 --2- 172.21.15.112:0/2199414448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f833c004810 0x7f833c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834ed9d640 1 -- 172.21.15.112:0/2199414448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f833c0039f0 msgr2=0x7f833c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:01.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834ed9d640 1 --2- 172.21.15.112:0/2199414448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f833c0039f0 0x7f833c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834ed9d640 1 -- 172.21.15.112:0/2199414448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f833c004810 msgr2=0x7f833c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:01.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834ed9d640 1 --2- 172.21.15.112:0/2199414448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f833c004810 0x7f833c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834ed9d640 1 -- 172.21.15.112:0/2199414448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833c003530 con 0x7f833c0052f0 2024-09-15T23:55:01.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.247+0000 7f834dd9b640 1 --2- 172.21.15.112:0/2199414448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f833c004810 0x7f833c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:55:01.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.251+0000 7f834ed9d640 1 -- 172.21.15.112:0/2199414448 reap_dead start 2024-09-15T23:55:01.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.251+0000 7f834ed9d640 1 --2- 172.21.15.112:0/2199414448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f833c0052f0 0x7f833c00b9d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8340001750 tx=0x7f834001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814de33a3bccacf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:01.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.251+0000 7f834d59a640 1 -- 172.21.15.112:0/2199414448 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83400013a0 con 0x7f833c0052f0 2024-09-15T23:55:01.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.251+0000 7f834d59a640 1 -- 172.21.15.112:0/2199414448 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83400052d0 con 0x7f833c0052f0 2024-09-15T23:55:01.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.251+0000 7f834d59a640 1 -- 172.21.15.112:0/2199414448 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340003840 con 0x7f833c0052f0 2024-09-15T23:55:01.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.251+0000 7f8354dea640 1 -- 172.21.15.112:0/2199414448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f833c0052f0 msgr2=0x7f833c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:01.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.251+0000 7f8354dea640 1 --2- 172.21.15.112:0/2199414448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f833c0052f0 0x7f833c00b9d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8340001750 tx=0x7f834001c3b0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.251+0000 7f8354dea640 1 -- 172.21.15.112:0/2199414448 shutdown_connections 2024-09-15T23:55:01.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.251+0000 7f8354dea640 1 --2- 172.21.15.112:0/2199414448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f833c0052f0 0x7f833c00b9d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.251+0000 7f8354dea640 1 -- 172.21.15.112:0/2199414448 >> 172.21.15.112:0/2199414448 conn(0x7f8350073580 msgr2=0x7f835006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:01.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.251+0000 7f8354dea640 1 -- 172.21.15.112:0/2199414448 shutdown_connections 2024-09-15T23:55:01.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.251+0000 7f8354dea640 1 -- 172.21.15.112:0/2199414448 wait complete. 2024-09-15T23:55:01.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8354dea640 1 Processor -- start 2024-09-15T23:55:01.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8354dea640 1 -- start start 2024-09-15T23:55:01.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8354dea640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f833c0052f0 0x7f83500703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8354dea640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8350139de0 0x7f835014e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8354dea640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83501f8220 0x7f83501391d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8354dea640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8350160b50 con 0x7f83501f8220 2024-09-15T23:55:01.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8354dea640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f83501609d0 con 0x7f833c0052f0 2024-09-15T23:55:01.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8354dea640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f835015fd50 con 0x7f8350139de0 2024-09-15T23:55:01.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f834ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83501f8220 0x7f83501391d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f834ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83501f8220 0x7f83501391d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55292/0 (socket says 172.21.15.112:55292) 2024-09-15T23:55:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f834ed9d640 1 -- 172.21.15.112:0/140440995 learned_addr learned my addr 172.21.15.112:0/140440995 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f834ed9d640 1 -- 172.21.15.112:0/140440995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8350139de0 msgr2=0x7f835014e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f834dd9b640 1 --2- 172.21.15.112:0/140440995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8350139de0 0x7f835014e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f834e59c640 1 --2- 172.21.15.112:0/140440995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f833c0052f0 0x7f83500703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f834ed9d640 1 --2- 172.21.15.112:0/140440995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8350139de0 0x7f835014e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f834ed9d640 1 -- 172.21.15.112:0/140440995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f833c0052f0 msgr2=0x7f83500703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f834ed9d640 1 --2- 172.21.15.112:0/140440995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f833c0052f0 0x7f83500703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f834ed9d640 1 -- 172.21.15.112:0/140440995 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835006f340 con 0x7f83501f8220 2024-09-15T23:55:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f834ed9d640 1 --2- 172.21.15.112:0/140440995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83501f8220 0x7f83501391d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f834000a030 tx=0x7f833c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8346ffd640 1 -- 172.21.15.112:0/140440995 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340007a40 con 0x7f83501f8220 2024-09-15T23:55:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8346ffd640 1 -- 172.21.15.112:0/140440995 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8340005480 con 0x7f83501f8220 2024-09-15T23:55:01.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8346ffd640 1 -- 172.21.15.112:0/140440995 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340003bc0 con 0x7f83501f8220 2024-09-15T23:55:01.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8354dea640 1 -- 172.21.15.112:0/140440995 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835006f620 con 0x7f83501f8220 2024-09-15T23:55:01.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8354dea640 1 -- 172.21.15.112:0/140440995 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f835006fbe0 con 0x7f83501f8220 2024-09-15T23:55:01.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8354dea640 1 -- 172.21.15.112:0/140440995 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8350160050 con 0x7f83501f8220 2024-09-15T23:55:01.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8346ffd640 1 -- 172.21.15.112:0/140440995 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8340007030 con 0x7f83501f8220 2024-09-15T23:55:01.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8346ffd640 1 --2- 172.21.15.112:0/140440995 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83300678c0 0x7f8330069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f8346ffd640 1 -- 172.21.15.112:0/140440995 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f834011ece0 con 0x7f83501f8220 2024-09-15T23:55:01.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.255+0000 7f834e59c640 1 --2- 172.21.15.112:0/140440995 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83300678c0 0x7f8330069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.259+0000 7f834e59c640 1 --2- 172.21.15.112:0/140440995 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83300678c0 0x7f8330069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8348002240 tx=0x7f8348001280 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:01.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.263+0000 7f8346ffd640 1 -- 172.21.15.112:0/140440995 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f83400160f0 con 0x7f83501f8220 2024-09-15T23:55:01.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.443+0000 7f8354dea640 1 -- 172.21.15.112:0/140440995 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8350070e20 con 0x7f83501f8220 2024-09-15T23:55:01.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.443+0000 7f8346ffd640 1 -- 172.21.15.112:0/140440995 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f83400ef670 con 0x7f83501f8220 2024-09-15T23:55:01.450 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:01.450 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"btime":"2024-09-15T23:54:45:647611+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1357012609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1357012609},{"type":"v1","addr":"172.21.15.169:6835","nonce":1357012609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2931559222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2931559222},{"type":"v1","addr":"172.21.15.112:6837","nonce":2931559222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1936572340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1936572340},{"type":"v1","addr":"172.21.15.169:6833","nonce":1936572340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:54:42.951140+0000","modified":"2024-09-15T23:54:44.991346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4869":{"gid":4869,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/40913641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":40913641},{"type":"v1","addr":"172.21.15.112:6835","nonce":40913641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4869,"qdb_cluster":[4869]},"id":2}]} 2024-09-15T23:55:01.450 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-15T23:55:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.447+0000 7f8354dea640 1 -- 172.21.15.112:0/140440995 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83300678c0 msgr2=0x7f8330069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.447+0000 7f8354dea640 1 --2- 172.21.15.112:0/140440995 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83300678c0 0x7f8330069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8348002240 tx=0x7f8348001280 comp rx=0 tx=0).stop 2024-09-15T23:55:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.447+0000 7f8354dea640 1 -- 172.21.15.112:0/140440995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83501f8220 msgr2=0x7f83501391d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.447+0000 7f8354dea640 1 --2- 172.21.15.112:0/140440995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83501f8220 0x7f83501391d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f834000a030 tx=0x7f833c005840 comp rx=0 tx=0).stop 2024-09-15T23:55:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.447+0000 7f8354dea640 1 -- 172.21.15.112:0/140440995 shutdown_connections 2024-09-15T23:55:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.447+0000 7f8354dea640 1 --2- 172.21.15.112:0/140440995 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83300678c0 0x7f8330069d80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.447+0000 7f8354dea640 1 --2- 172.21.15.112:0/140440995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83501f8220 0x7f83501391d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.447+0000 7f8354dea640 1 --2- 172.21.15.112:0/140440995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8350139de0 0x7f835014e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.447+0000 7f8354dea640 1 --2- 172.21.15.112:0/140440995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f833c0052f0 0x7f83500703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.447+0000 7f8354dea640 1 -- 172.21.15.112:0/140440995 >> 172.21.15.112:0/140440995 conn(0x7f8350073580 msgr2=0x7f83500b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.447+0000 7f8354dea640 1 -- 172.21.15.112:0/140440995 shutdown_connections 2024-09-15T23:55:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.447+0000 7f8354dea640 1 -- 172.21.15.112:0/140440995 wait complete. 2024-09-15T23:55:01.467 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-15T23:55:01.767 INFO:teuthology.orchestra.run.smithi112.stdout:{"message":"","return_code":0} 2024-09-15T23:55:01.768 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-15T23:55:01.768 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:01.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44de3e3640 1 Processor -- start 2024-09-15T23:55:01.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44de3e3640 1 -- start start 2024-09-15T23:55:01.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44de3e3640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44d80d3060 0x7f44d80cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44de3e3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44d80cf450 0x7f44d806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44de3e3640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d80d0300 con 0x7f44d8161a60 2024-09-15T23:55:01.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44de3e3640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44d80b0f60 con 0x7f44d80d3060 2024-09-15T23:55:01.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44de3e3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44d80cfd40 con 0x7f44d80cf450 2024-09-15T23:55:01.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d7fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f44d8161a60 0x7f44d80d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47304/0 (socket says 172.21.15.112:47304) 2024-09-15T23:55:01.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d7fff640 1 -- 172.21.15.112:0/2321857204 learned_addr learned my addr 172.21.15.112:0/2321857204 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:01.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 -- 172.21.15.112:0/2321857204 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3995101403 0 0) 0x7f44c8001120 con 0x7f44d8161a60 2024-09-15T23:55:01.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 -- 172.21.15.112:0/2321857204 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44c0003530 con 0x7f44d8161a60 2024-09-15T23:55:01.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d77fe640 1 --2- 172.21.15.112:0/2321857204 >> v2:172.21.15.169:3300/0 conn(0x7f44d80d3060 0x7f44d80cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44dc980640 1 --2- 172.21.15.112:0/2321857204 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44d80cf450 0x7f44d806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 -- 172.21.15.112:0/2321857204 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2861857416 0 0) 0x7f44c0003530 con 0x7f44d8161a60 2024-09-15T23:55:01.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 -- 172.21.15.112:0/2321857204 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44d80cf450 msgr2=0x7f44d806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:01.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 --2- 172.21.15.112:0/2321857204 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44d80cf450 0x7f44d806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 -- 172.21.15.112:0/2321857204 >> v2:172.21.15.169:3300/0 conn(0x7f44d80d3060 msgr2=0x7f44d80cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:01.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 --2- 172.21.15.112:0/2321857204 >> v2:172.21.15.169:3300/0 conn(0x7f44d80d3060 0x7f44d80cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 -- 172.21.15.112:0/2321857204 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d80d0020 con 0x7f44d8161a60 2024-09-15T23:55:01.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 -- 172.21.15.112:0/2321857204 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f44c8001850 con 0x7f44d8161a60 2024-09-15T23:55:01.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 -- 172.21.15.112:0/2321857204 >> v1:172.21.15.112:6789/0 conn(0x7f44d8161a60 legacy=0x7f44d80d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:01.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 --2- 172.21.15.112:0/2321857204 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44d80cf450 0x7f44c00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 --2- 172.21.15.112:0/2321857204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c0003ff0 0x7f44c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 --2- 172.21.15.112:0/2321857204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44c0004d50 0x7f44c00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 -- 172.21.15.112:0/2321857204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f44d80b0f60 con 0x7f44c0004d50 2024-09-15T23:55:01.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 -- 172.21.15.112:0/2321857204 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44d80cfd40 con 0x7f44c0003ff0 2024-09-15T23:55:01.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d6ffd640 1 -- 172.21.15.112:0/2321857204 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c000bb90 con 0x7f44d80cf450 2024-09-15T23:55:01.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d77fe640 1 --2- 172.21.15.112:0/2321857204 >> v2:172.21.15.169:3300/0 conn(0x7f44d80d3060 0x7f44d80cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:55:01.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44dc980640 1 --2- 172.21.15.112:0/2321857204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44c0004d50 0x7f44c00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d7fff640 1 --2- 172.21.15.112:0/2321857204 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44d80cf450 0x7f44c00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d77fe640 1 --2- 172.21.15.112:0/2321857204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c0003ff0 0x7f44c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44dc980640 1 -- 172.21.15.112:0/2321857204 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44d80cf450 msgr2=0x7f44c00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:01.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44dc980640 1 --2- 172.21.15.112:0/2321857204 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44d80cf450 0x7f44c00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44dc980640 1 -- 172.21.15.112:0/2321857204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c0003ff0 msgr2=0x7f44c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:01.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44dc980640 1 --2- 172.21.15.112:0/2321857204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c0003ff0 0x7f44c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44dc980640 1 -- 172.21.15.112:0/2321857204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c0003530 con 0x7f44c0004d50 2024-09-15T23:55:01.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.871+0000 7f44d77fe640 1 --2- 172.21.15.112:0/2321857204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c0003ff0 0x7f44c0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:01.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44dc980640 1 --2- 172.21.15.112:0/2321857204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44c0004d50 0x7f44c00051d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f44d0007360 tx=0x7f44d001ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74568287e5f9e63 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:01.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d6ffd640 1 -- 172.21.15.112:0/2321857204 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d00b2070 con 0x7f44c0004d50 2024-09-15T23:55:01.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d6ffd640 1 -- 172.21.15.112:0/2321857204 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d00a5d40 con 0x7f44c0004d50 2024-09-15T23:55:01.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d6ffd640 1 -- 172.21.15.112:0/2321857204 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d0009be0 con 0x7f44c0004d50 2024-09-15T23:55:01.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 -- 172.21.15.112:0/2321857204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44c0004d50 msgr2=0x7f44c00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:01.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 --2- 172.21.15.112:0/2321857204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44c0004d50 0x7f44c00051d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f44d0007360 tx=0x7f44d001ce40 comp rx=0 tx=0).stop 2024-09-15T23:55:01.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44dc980640 1 -- 172.21.15.112:0/2321857204 reap_dead start 2024-09-15T23:55:01.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 -- 172.21.15.112:0/2321857204 shutdown_connections 2024-09-15T23:55:01.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 -- 172.21.15.112:0/2321857204 >> 172.21.15.112:0/2321857204 conn(0x7f44d808bf90 msgr2=0x7f44d809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:01.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 -- 172.21.15.112:0/2321857204 shutdown_connections 2024-09-15T23:55:01.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 -- 172.21.15.112:0/2321857204 wait complete. 2024-09-15T23:55:01.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 Processor -- start 2024-09-15T23:55:01.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 -- start start 2024-09-15T23:55:01.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44d8159690 0x7f44d80b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d815b350 0x7f44d815c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44d80cd860 0x7f44d80cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f44d80cf8e0 con 0x7f44d815b350 2024-09-15T23:55:01.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44d806d190 con 0x7f44d80cd860 2024-09-15T23:55:01.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44d80cfa60 con 0x7f44d8159690 2024-09-15T23:55:01.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d815b350 0x7f44d815c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d815b350 0x7f44d815c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55300/0 (socket says 172.21.15.112:55300) 2024-09-15T23:55:01.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d77fe640 1 -- 172.21.15.112:0/3022841903 learned_addr learned my addr 172.21.15.112:0/3022841903 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:01.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d7fff640 1 --2- 172.21.15.112:0/3022841903 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44d8159690 0x7f44d80b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44dc980640 1 --2- 172.21.15.112:0/3022841903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44d80cd860 0x7f44d80cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d77fe640 1 -- 172.21.15.112:0/3022841903 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44d8159690 msgr2=0x7f44d80b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:01.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d77fe640 1 --2- 172.21.15.112:0/3022841903 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44d8159690 0x7f44d80b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d77fe640 1 -- 172.21.15.112:0/3022841903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44d80cd860 msgr2=0x7f44d80cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:01.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d77fe640 1 --2- 172.21.15.112:0/3022841903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44d80cd860 0x7f44d80cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:01.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d77fe640 1 -- 172.21.15.112:0/3022841903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d815b810 con 0x7f44d815b350 2024-09-15T23:55:01.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d77fe640 1 --2- 172.21.15.112:0/3022841903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d815b350 0x7f44d815c8b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00f650 tx=0x7f44cc00fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:01.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d4ff9640 1 -- 172.21.15.112:0/3022841903 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc018070 con 0x7f44d815b350 2024-09-15T23:55:01.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d4ff9640 1 -- 172.21.15.112:0/3022841903 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc00d940 con 0x7f44d815b350 2024-09-15T23:55:01.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 -- 172.21.15.112:0/3022841903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d815baf0 con 0x7f44d815b350 2024-09-15T23:55:01.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44d4ff9640 1 -- 172.21.15.112:0/3022841903 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc00dcf0 con 0x7f44d815b350 2024-09-15T23:55:01.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.875+0000 7f44de3e3640 1 -- 172.21.15.112:0/3022841903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d815c0b0 con 0x7f44d815b350 2024-09-15T23:55:01.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.879+0000 7f44de3e3640 1 -- 172.21.15.112:0/3022841903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44d80cef10 con 0x7f44d815b350 2024-09-15T23:55:01.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.879+0000 7f44d4ff9640 1 -- 172.21.15.112:0/3022841903 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f44cc01b070 con 0x7f44d815b350 2024-09-15T23:55:01.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.879+0000 7f44d4ff9640 1 --2- 172.21.15.112:0/3022841903 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44c40678f0 0x7f44c4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:01.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.879+0000 7f44d4ff9640 1 -- 172.21.15.112:0/3022841903 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f44cc086660 con 0x7f44d815b350 2024-09-15T23:55:01.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.879+0000 7f44d7fff640 1 --2- 172.21.15.112:0/3022841903 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44c40678f0 0x7f44c4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:01.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.879+0000 7f44d7fff640 1 --2- 172.21.15.112:0/3022841903 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44c40678f0 0x7f44c4069db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f44c80012c0 tx=0x7f44c8000ff0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:01.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:01.883+0000 7f44d4ff9640 1 -- 172.21.15.112:0/3022841903 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f44cc0570f0 con 0x7f44d815b350 2024-09-15T23:55:02.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.063+0000 7f44de3e3640 1 -- 172.21.15.112:0/3022841903 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44d80d1420 con 0x7f44d815b350 2024-09-15T23:55:02.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.063+0000 7f44d4ff9640 1 -- 172.21.15.112:0/3022841903 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f44cc0569f0 con 0x7f44d815b350 2024-09-15T23:55:02.069 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:02.069 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"btime":"2024-09-15T23:54:45:647611+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1357012609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1357012609},{"type":"v1","addr":"172.21.15.169:6835","nonce":1357012609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2931559222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2931559222},{"type":"v1","addr":"172.21.15.112:6837","nonce":2931559222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1936572340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1936572340},{"type":"v1","addr":"172.21.15.169:6833","nonce":1936572340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:54:42.951140+0000","modified":"2024-09-15T23:54:44.991346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4869":{"gid":4869,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/40913641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":40913641},{"type":"v1","addr":"172.21.15.112:6835","nonce":40913641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4869,"qdb_cluster":[4869]},"id":2}]} 2024-09-15T23:55:02.070 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-15T23:55:02.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.067+0000 7f44de3e3640 1 -- 172.21.15.112:0/3022841903 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44c40678f0 msgr2=0x7f44c4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:02.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.067+0000 7f44de3e3640 1 --2- 172.21.15.112:0/3022841903 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44c40678f0 0x7f44c4069db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f44c80012c0 tx=0x7f44c8000ff0 comp rx=0 tx=0).stop 2024-09-15T23:55:02.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.067+0000 7f44de3e3640 1 -- 172.21.15.112:0/3022841903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d815b350 msgr2=0x7f44d815c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:02.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.067+0000 7f44de3e3640 1 --2- 172.21.15.112:0/3022841903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d815b350 0x7f44d815c8b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00f650 tx=0x7f44cc00fb10 comp rx=0 tx=0).stop 2024-09-15T23:55:02.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.067+0000 7f44de3e3640 1 -- 172.21.15.112:0/3022841903 shutdown_connections 2024-09-15T23:55:02.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.067+0000 7f44de3e3640 1 --2- 172.21.15.112:0/3022841903 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44c40678f0 0x7f44c4069db0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:02.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.067+0000 7f44de3e3640 1 --2- 172.21.15.112:0/3022841903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44d80cd860 0x7f44d80cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:02.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.067+0000 7f44de3e3640 1 --2- 172.21.15.112:0/3022841903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44d815b350 0x7f44d815c8b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:02.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.067+0000 7f44de3e3640 1 --2- 172.21.15.112:0/3022841903 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44d8159690 0x7f44d80b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:02.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.067+0000 7f44de3e3640 1 -- 172.21.15.112:0/3022841903 >> 172.21.15.112:0/3022841903 conn(0x7f44d808bf90 msgr2=0x7f44d806d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:02.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.067+0000 7f44de3e3640 1 -- 172.21.15.112:0/3022841903 shutdown_connections 2024-09-15T23:55:02.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.067+0000 7f44de3e3640 1 -- 172.21.15.112:0/3022841903 wait complete. 2024-09-15T23:55:02.086 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump mds_cache strays_created 2024-09-15T23:55:02.214 INFO:teuthology.orchestra.run.smithi112.stdout:{"mds_cache":{"strays_created":1001}} 2024-09-15T23:55:02.214 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_created": 1001 } } 2024-09-15T23:55:02.215 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:02.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.327+0000 7f83a3a61640 1 Processor -- start 2024-09-15T23:55:02.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.327+0000 7f83a3a61640 1 -- start start 2024-09-15T23:55:02.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.327+0000 7f83a3a61640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f839c070020 0x7f839c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:02.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.327+0000 7f83a3a61640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839c0aede0 con 0x7f839c1520a0 2024-09-15T23:55:02.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.327+0000 7f83a3a61640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839c15fa10 con 0x7f839c15f1d0 2024-09-15T23:55:02.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.327+0000 7f83a3a61640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f839c152480 con 0x7f839c070020 2024-09-15T23:55:02.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.327+0000 7f83a17fd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f839c1520a0 0x7f839c06f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47308/0 (socket says 172.21.15.112:47308) 2024-09-15T23:55:02.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.327+0000 7f83a17fd640 1 -- 172.21.15.112:0/115676237 learned_addr learned my addr 172.21.15.112:0/115676237 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:02.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.327+0000 7f83a0ffc640 1 --2- 172.21.15.112:0/115676237 >> v2:172.21.15.112:3300/0 conn(0x7f839c070020 0x7f839c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:02.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.327+0000 7f83a0ffc640 1 -- 172.21.15.112:0/115676237 >> v1:172.21.15.169:6789/0 conn(0x7f839c15f1d0 legacy=0x7f839c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:02.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.327+0000 7f83a0ffc640 1 -- 172.21.15.112:0/115676237 >> v1:172.21.15.112:6789/0 conn(0x7f839c1520a0 legacy=0x7f839c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:02.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.327+0000 7f83a0ffc640 1 -- 172.21.15.112:0/115676237 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c074250 con 0x7f839c070020 2024-09-15T23:55:02.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.327+0000 7f8393fff640 1 -- 172.21.15.112:0/115676237 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4194450169 0 0) 0x7f839c0aede0 con 0x7f839c1520a0 2024-09-15T23:55:02.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a0ffc640 1 --2- 172.21.15.112:0/115676237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c070020 0x7f839c15ec90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f838c0097c0 tx=0x7f838c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4d628587cb996e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:02.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f8393fff640 1 -- 172.21.15.112:0/115676237 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c0aeba0 con 0x7f839c070020 2024-09-15T23:55:02.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f8393fff640 1 -- 172.21.15.112:0/115676237 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838c0b0070 con 0x7f839c070020 2024-09-15T23:55:02.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f8393fff640 1 -- 172.21.15.112:0/115676237 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c0ab650 con 0x7f839c070020 2024-09-15T23:55:02.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 -- 172.21.15.112:0/115676237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c070020 msgr2=0x7f839c15ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:02.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 --2- 172.21.15.112:0/115676237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c070020 0x7f839c15ec90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f838c0097c0 tx=0x7f838c01c430 comp rx=0 tx=0).stop 2024-09-15T23:55:02.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 -- 172.21.15.112:0/115676237 shutdown_connections 2024-09-15T23:55:02.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 --2- 172.21.15.112:0/115676237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c070020 0x7f839c15ec90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:02.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 -- 172.21.15.112:0/115676237 >> 172.21.15.112:0/115676237 conn(0x7f839c0b1f90 msgr2=0x7f839c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:02.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 -- 172.21.15.112:0/115676237 shutdown_connections 2024-09-15T23:55:02.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 -- 172.21.15.112:0/115676237 wait complete. 2024-09-15T23:55:02.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 Processor -- start 2024-09-15T23:55:02.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 -- start start 2024-09-15T23:55:02.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f839c070020 0x7f839c14c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:02.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f839c1520a0 0x7f839c1478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:02.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c15f1d0 0x7f839c14cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:02.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f839c15f680 con 0x7f839c15f1d0 2024-09-15T23:55:02.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f839c073d30 con 0x7f839c1520a0 2024-09-15T23:55:02.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f839c168f20 con 0x7f839c070020 2024-09-15T23:55:02.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a1ffe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c15f1d0 0x7f839c14cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:02.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a1ffe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c15f1d0 0x7f839c14cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55304/0 (socket says 172.21.15.112:55304) 2024-09-15T23:55:02.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a1ffe640 1 -- 172.21.15.112:0/1636348254 learned_addr learned my addr 172.21.15.112:0/1636348254 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:02.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a1ffe640 1 -- 172.21.15.112:0/1636348254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f839c070020 msgr2=0x7f839c14c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:02.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a1ffe640 1 --2- 172.21.15.112:0/1636348254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f839c070020 0x7f839c14c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:02.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a1ffe640 1 -- 172.21.15.112:0/1636348254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f839c1520a0 msgr2=0x7f839c1478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:02.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a1ffe640 1 --2- 172.21.15.112:0/1636348254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f839c1520a0 0x7f839c1478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:02.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a1ffe640 1 -- 172.21.15.112:0/1636348254 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c151d80 con 0x7f839c15f1d0 2024-09-15T23:55:02.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a1ffe640 1 --2- 172.21.15.112:0/1636348254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c15f1d0 0x7f839c14cb90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f839400c780 tx=0x7f839400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:02.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f8391ffb640 1 -- 172.21.15.112:0/1636348254 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394004b70 con 0x7f839c15f1d0 2024-09-15T23:55:02.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f8391ffb640 1 -- 172.21.15.112:0/1636348254 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8394004d10 con 0x7f839c15f1d0 2024-09-15T23:55:02.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 -- 172.21.15.112:0/1636348254 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c14d500 con 0x7f839c15f1d0 2024-09-15T23:55:02.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f8391ffb640 1 -- 172.21.15.112:0/1636348254 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839400aa90 con 0x7f839c15f1d0 2024-09-15T23:55:02.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.331+0000 7f83a3a61640 1 -- 172.21.15.112:0/1636348254 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c14bb90 con 0x7f839c15f1d0 2024-09-15T23:55:02.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.335+0000 7f83a3a61640 1 -- 172.21.15.112:0/1636348254 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c15ec90 con 0x7f839c15f1d0 2024-09-15T23:55:02.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.335+0000 7f8391ffb640 1 -- 172.21.15.112:0/1636348254 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f839400ac30 con 0x7f839c15f1d0 2024-09-15T23:55:02.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.335+0000 7f8391ffb640 1 --2- 172.21.15.112:0/1636348254 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83800678f0 0x7f8380069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:02.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.335+0000 7f8391ffb640 1 -- 172.21.15.112:0/1636348254 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f83940860c0 con 0x7f839c15f1d0 2024-09-15T23:55:02.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.335+0000 7f83a17fd640 1 --2- 172.21.15.112:0/1636348254 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83800678f0 0x7f8380069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:02.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.335+0000 7f83a17fd640 1 --2- 172.21.15.112:0/1636348254 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83800678f0 0x7f8380069db0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f83980011f0 tx=0x7f8398007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:02.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.339+0000 7f8391ffb640 1 -- 172.21.15.112:0/1636348254 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8394020070 con 0x7f839c15f1d0 2024-09-15T23:55:02.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.519+0000 7f83a3a61640 1 -- 172.21.15.112:0/1636348254 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f839c06e540 con 0x7f839c15f1d0 2024-09-15T23:55:02.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.519+0000 7f8391ffb640 1 -- 172.21.15.112:0/1636348254 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f8394056a70 con 0x7f839c15f1d0 2024-09-15T23:55:02.524 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:02.524 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"btime":"2024-09-15T23:54:45:647611+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1357012609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1357012609},{"type":"v1","addr":"172.21.15.169:6835","nonce":1357012609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2931559222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2931559222},{"type":"v1","addr":"172.21.15.112:6837","nonce":2931559222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1936572340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1936572340},{"type":"v1","addr":"172.21.15.169:6833","nonce":1936572340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:54:42.951140+0000","modified":"2024-09-15T23:54:44.991346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4869":{"gid":4869,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/40913641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":40913641},{"type":"v1","addr":"172.21.15.112:6835","nonce":40913641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4869,"qdb_cluster":[4869]},"id":2}]} 2024-09-15T23:55:02.524 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-15T23:55:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.519+0000 7f83a3a61640 1 -- 172.21.15.112:0/1636348254 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83800678f0 msgr2=0x7f8380069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.519+0000 7f83a3a61640 1 --2- 172.21.15.112:0/1636348254 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83800678f0 0x7f8380069db0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f83980011f0 tx=0x7f8398007930 comp rx=0 tx=0).stop 2024-09-15T23:55:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.519+0000 7f83a3a61640 1 -- 172.21.15.112:0/1636348254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c15f1d0 msgr2=0x7f839c14cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.519+0000 7f83a3a61640 1 --2- 172.21.15.112:0/1636348254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c15f1d0 0x7f839c14cb90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f839400c780 tx=0x7f839400cc40 comp rx=0 tx=0).stop 2024-09-15T23:55:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.519+0000 7f83a3a61640 1 -- 172.21.15.112:0/1636348254 shutdown_connections 2024-09-15T23:55:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.519+0000 7f83a3a61640 1 --2- 172.21.15.112:0/1636348254 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83800678f0 0x7f8380069db0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.519+0000 7f83a3a61640 1 --2- 172.21.15.112:0/1636348254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c15f1d0 0x7f839c14cb90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.519+0000 7f83a3a61640 1 --2- 172.21.15.112:0/1636348254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f839c1520a0 0x7f839c1478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.519+0000 7f83a3a61640 1 --2- 172.21.15.112:0/1636348254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f839c070020 0x7f839c14c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:02.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.519+0000 7f83a3a61640 1 -- 172.21.15.112:0/1636348254 >> 172.21.15.112:0/1636348254 conn(0x7f839c0b1f90 msgr2=0x7f839c0af000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:02.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.519+0000 7f83a3a61640 1 -- 172.21.15.112:0/1636348254 shutdown_connections 2024-09-15T23:55:02.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:02.519+0000 7f83a3a61640 1 -- 172.21.15.112:0/1636348254 wait complete. 2024-09-15T23:55:02.541 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump mds_cache strays_enqueued 2024-09-15T23:55:02.694 INFO:teuthology.orchestra.run.smithi112.stdout:{"mds_cache":{"strays_enqueued":211}} 2024-09-15T23:55:02.694 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_enqueued": 211 } } 2024-09-15T23:55:02.694 DEBUG:tasks.ceph_test_case:wait_until_equal: 211 != 1001, waiting (timeout=600)... 2024-09-15T23:55:07.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:07.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.819+0000 7f29920b2640 1 Processor -- start 2024-09-15T23:55:07.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f29920b2640 1 -- start start 2024-09-15T23:55:07.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f29920b2640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f298c15bec0 0x7f298c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:07.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f29920b2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f298c15c2a0 0x7f298c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:07.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f29920b2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f298c0af2a0 0x7f298c15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f29920b2640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f298c0b3290 con 0x7f298c15bec0 2024-09-15T23:55:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f29920b2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f298c0b3570 con 0x7f298c0af2a0 2024-09-15T23:55:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f29920b2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f298c0b3850 con 0x7f298c15c2a0 2024-09-15T23:55:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f298b7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f298c15bec0 0x7f298c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f298b7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f298c15bec0 0x7f298c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55308/0 (socket says 172.21.15.112:55308) 2024-09-15T23:55:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f298b7fe640 1 -- 172.21.15.112:0/3890188159 learned_addr learned my addr 172.21.15.112:0/3890188159 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f2982ffd640 1 --2- 172.21.15.112:0/3890188159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f298c15c2a0 0x7f298c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f298bfff640 1 --2- 172.21.15.112:0/3890188159 >> v2:172.21.15.169:3300/0 conn(0x7f298c0af2a0 0x7f298c15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f298b7fe640 1 -- 172.21.15.112:0/3890188159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f298c15c2a0 msgr2=0x7f298c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f298b7fe640 1 --2- 172.21.15.112:0/3890188159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f298c15c2a0 0x7f298c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:07.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f298b7fe640 1 -- 172.21.15.112:0/3890188159 >> v2:172.21.15.169:3300/0 conn(0x7f298c0af2a0 msgr2=0x7f298c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f298b7fe640 1 --2- 172.21.15.112:0/3890188159 >> v2:172.21.15.169:3300/0 conn(0x7f298c0af2a0 0x7f298c15fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f298b7fe640 1 -- 172.21.15.112:0/3890188159 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c0b3b30 con 0x7f298c15bec0 2024-09-15T23:55:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.823+0000 7f298b7fe640 1 --2- 172.21.15.112:0/3890188159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298c15bec0 0x7f298c0ad200 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f298c06dc90 tx=0x7f297c01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339651c9554e78f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:07.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f298affd640 1 -- 172.21.15.112:0/3890188159 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c0b0070 con 0x7f298c15bec0 2024-09-15T23:55:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f298affd640 1 -- 172.21.15.112:0/3890188159 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c0ab600 con 0x7f298c15bec0 2024-09-15T23:55:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f298affd640 1 -- 172.21.15.112:0/3890188159 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c0ab9d0 con 0x7f298c15bec0 2024-09-15T23:55:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 -- 172.21.15.112:0/3890188159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298c15bec0 msgr2=0x7f298c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:07.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 --2- 172.21.15.112:0/3890188159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298c15bec0 0x7f298c0ad200 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f298c06dc90 tx=0x7f297c01c230 comp rx=0 tx=0).stop 2024-09-15T23:55:07.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 -- 172.21.15.112:0/3890188159 shutdown_connections 2024-09-15T23:55:07.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 --2- 172.21.15.112:0/3890188159 >> v2:172.21.15.169:3300/0 conn(0x7f298c0af2a0 0x7f298c15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:07.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 --2- 172.21.15.112:0/3890188159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f298c15c2a0 0x7f298c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:07.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 --2- 172.21.15.112:0/3890188159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298c15bec0 0x7f298c0ad200 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:07.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 -- 172.21.15.112:0/3890188159 >> 172.21.15.112:0/3890188159 conn(0x7f298c0b1f90 msgr2=0x7f298c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:07.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 -- 172.21.15.112:0/3890188159 shutdown_connections 2024-09-15T23:55:07.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 -- 172.21.15.112:0/3890188159 wait complete. 2024-09-15T23:55:07.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 Processor -- start 2024-09-15T23:55:07.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 -- start start 2024-09-15T23:55:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f298c0af2a0 0x7f298c152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298c15bec0 0x7f298c150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f298c15c2a0 0x7f298c149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f298c0af6b0 con 0x7f298c15bec0 2024-09-15T23:55:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f298c0ad740 con 0x7f298c15c2a0 2024-09-15T23:55:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f298c06e000 con 0x7f298c0af2a0 2024-09-15T23:55:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f2982ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298c15bec0 0x7f298c150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:07.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f2982ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298c15bec0 0x7f298c150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55312/0 (socket says 172.21.15.112:55312) 2024-09-15T23:55:07.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f2982ffd640 1 -- 172.21.15.112:0/2060911517 learned_addr learned my addr 172.21.15.112:0/2060911517 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:07.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f298b7fe640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f298c0af2a0 0x7f298c152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:07.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f298bfff640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f298c15c2a0 0x7f298c149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:07.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f2982ffd640 1 -- 172.21.15.112:0/2060911517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f298c0af2a0 msgr2=0x7f298c152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:07.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f2982ffd640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f298c0af2a0 0x7f298c152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:07.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f2982ffd640 1 -- 172.21.15.112:0/2060911517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f298c15c2a0 msgr2=0x7f298c149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:07.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f2982ffd640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f298c15c2a0 0x7f298c149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:07.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f2982ffd640 1 -- 172.21.15.112:0/2060911517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c152eb0 con 0x7f298c15bec0 2024-09-15T23:55:07.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f298b7fe640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f298c0af2a0 0x7f298c152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:55:07.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f2982ffd640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298c15bec0 0x7f298c150d20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f297400d5f0 tx=0x7f297400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:07.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f2988ff9640 1 -- 172.21.15.112:0/2060911517 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29740125f0 con 0x7f298c15bec0 2024-09-15T23:55:07.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f2988ff9640 1 -- 172.21.15.112:0/2060911517 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2974019070 con 0x7f298c15bec0 2024-09-15T23:55:07.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 -- 172.21.15.112:0/2060911517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298c073380 con 0x7f298c15bec0 2024-09-15T23:55:07.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f2988ff9640 1 -- 172.21.15.112:0/2060911517 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29740129b0 con 0x7f298c15bec0 2024-09-15T23:55:07.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.827+0000 7f29920b2640 1 -- 172.21.15.112:0/2060911517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f298c073c20 con 0x7f298c15bec0 2024-09-15T23:55:07.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.831+0000 7f29920b2640 1 -- 172.21.15.112:0/2060911517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f298c073770 con 0x7f298c15bec0 2024-09-15T23:55:07.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.831+0000 7f2988ff9640 1 -- 172.21.15.112:0/2060911517 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2974012b50 con 0x7f298c15bec0 2024-09-15T23:55:07.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.831+0000 7f2988ff9640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f296c0678c0 0x7f296c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:07.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.831+0000 7f2988ff9640 1 -- 172.21.15.112:0/2060911517 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f2974086b60 con 0x7f298c15bec0 2024-09-15T23:55:07.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.831+0000 7f298b7fe640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f296c0678c0 0x7f296c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:07.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.831+0000 7f298b7fe640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f296c0678c0 0x7f296c069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f297c0ad000 tx=0x7f297c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:07.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:07.835+0000 7f2988ff9640 1 -- 172.21.15.112:0/2060911517 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2974013390 con 0x7f298c15bec0 2024-09-15T23:55:08.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.035+0000 7f29920b2640 1 -- 172.21.15.112:0/2060911517 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f298c0ad200 con 0x7f298c15bec0 2024-09-15T23:55:08.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.035+0000 7f2988ff9640 1 -- 172.21.15.112:0/2060911517 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f2974057680 con 0x7f298c15bec0 2024-09-15T23:55:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:08.041 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"btime":"2024-09-15T23:54:45:647611+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1357012609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1357012609},{"type":"v1","addr":"172.21.15.169:6835","nonce":1357012609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2931559222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2931559222},{"type":"v1","addr":"172.21.15.112:6837","nonce":2931559222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1936572340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1936572340},{"type":"v1","addr":"172.21.15.169:6833","nonce":1936572340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:54:42.951140+0000","modified":"2024-09-15T23:54:44.991346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4869":{"gid":4869,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/40913641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":40913641},{"type":"v1","addr":"172.21.15.112:6835","nonce":40913641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4869,"qdb_cluster":[4869]},"id":2}]} 2024-09-15T23:55:08.041 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-15T23:55:08.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.039+0000 7f29920b2640 1 -- 172.21.15.112:0/2060911517 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f296c0678c0 msgr2=0x7f296c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.039+0000 7f29920b2640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f296c0678c0 0x7f296c069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f297c0ad000 tx=0x7f297c0a6000 comp rx=0 tx=0).stop 2024-09-15T23:55:08.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.039+0000 7f29920b2640 1 -- 172.21.15.112:0/2060911517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298c15bec0 msgr2=0x7f298c150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.039+0000 7f29920b2640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298c15bec0 0x7f298c150d20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f297400d5f0 tx=0x7f297400dab0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.039+0000 7f29920b2640 1 -- 172.21.15.112:0/2060911517 shutdown_connections 2024-09-15T23:55:08.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.039+0000 7f29920b2640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f296c0678c0 0x7f296c069d80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.039+0000 7f29920b2640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f298c15c2a0 0x7f298c149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.039+0000 7f29920b2640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298c15bec0 0x7f298c150d20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.039+0000 7f29920b2640 1 --2- 172.21.15.112:0/2060911517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f298c0af2a0 0x7f298c152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.039+0000 7f29920b2640 1 -- 172.21.15.112:0/2060911517 >> 172.21.15.112:0/2060911517 conn(0x7f298c0b1f90 msgr2=0x7f298c0b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:08.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.039+0000 7f29920b2640 1 -- 172.21.15.112:0/2060911517 shutdown_connections 2024-09-15T23:55:08.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.039+0000 7f29920b2640 1 -- 172.21.15.112:0/2060911517 wait complete. 2024-09-15T23:55:08.060 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump mds_cache strays_enqueued 2024-09-15T23:55:08.198 INFO:teuthology.orchestra.run.smithi112.stdout:{"mds_cache":{"strays_enqueued":1001}} 2024-09-15T23:55:08.199 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_enqueued": 1001 } } 2024-09-15T23:55:08.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:08.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff605555640 1 Processor -- start 2024-09-15T23:55:08.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff605555640 1 -- start start 2024-09-15T23:55:08.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff605555640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6001520a0 0x7ff60006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff605555640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff60015f3a0 0x7ff6000adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff605555640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff600070250 con 0x7ff60006fe50 2024-09-15T23:55:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff605555640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff600152480 con 0x7ff60015f3a0 2024-09-15T23:55:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff605555640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff6000aede0 con 0x7ff6001520a0 2024-09-15T23:55:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fe7fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff60006fe50 0x7ff60015ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47318/0 (socket says 172.21.15.112:47318) 2024-09-15T23:55:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fe7fc640 1 -- 172.21.15.112:0/3586825268 learned_addr learned my addr 172.21.15.112:0/3586825268 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5feffd640 1 --2- 172.21.15.112:0/3586825268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6001520a0 0x7ff60006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5ff7fe640 1 --2- 172.21.15.112:0/3586825268 >> v2:172.21.15.169:3300/0 conn(0x7ff60015f3a0 0x7ff6000adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 -- 172.21.15.112:0/3586825268 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 447809731 0 0) 0x7ff600070250 con 0x7ff60006fe50 2024-09-15T23:55:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 -- 172.21.15.112:0/3586825268 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5e8003530 con 0x7ff60006fe50 2024-09-15T23:55:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 -- 172.21.15.112:0/3586825268 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2326540405 0 0) 0x7ff5e8003530 con 0x7ff60006fe50 2024-09-15T23:55:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 -- 172.21.15.112:0/3586825268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6001520a0 msgr2=0x7ff60006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:08.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 --2- 172.21.15.112:0/3586825268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6001520a0 0x7ff60006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 -- 172.21.15.112:0/3586825268 >> v2:172.21.15.169:3300/0 conn(0x7ff60015f3a0 msgr2=0x7ff6000adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 --2- 172.21.15.112:0/3586825268 >> v2:172.21.15.169:3300/0 conn(0x7ff60015f3a0 0x7ff6000adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 -- 172.21.15.112:0/3586825268 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60015fa10 con 0x7ff60006fe50 2024-09-15T23:55:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 -- 172.21.15.112:0/3586825268 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7ff5f4001680 con 0x7ff60006fe50 2024-09-15T23:55:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 -- 172.21.15.112:0/3586825268 >> v1:172.21.15.112:6789/0 conn(0x7ff60006fe50 legacy=0x7ff60015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 --2- 172.21.15.112:0/3586825268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5e80039c0 0x7ff5e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 --2- 172.21.15.112:0/3586825268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5e8004810 0x7ff5e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 --2- 172.21.15.112:0/3586825268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6001520a0 0x7ff5e80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 -- 172.21.15.112:0/3586825268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff6000aede0 con 0x7ff5e80039c0 2024-09-15T23:55:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 -- 172.21.15.112:0/3586825268 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e800b9d0 con 0x7ff5e8004810 2024-09-15T23:55:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fdffb640 1 -- 172.21.15.112:0/3586825268 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e800bb50 con 0x7ff6001520a0 2024-09-15T23:55:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5feffd640 1 --2- 172.21.15.112:0/3586825268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5e80039c0 0x7ff5e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5fe7fc640 1 --2- 172.21.15.112:0/3586825268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5e8004810 0x7ff5e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.315+0000 7ff5ff7fe640 1 --2- 172.21.15.112:0/3586825268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6001520a0 0x7ff5e80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff5feffd640 1 -- 172.21.15.112:0/3586825268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6001520a0 msgr2=0x7ff5e80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:08.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff5feffd640 1 --2- 172.21.15.112:0/3586825268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6001520a0 0x7ff5e80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff5feffd640 1 -- 172.21.15.112:0/3586825268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5e8004810 msgr2=0x7ff5e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:08.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff5feffd640 1 --2- 172.21.15.112:0/3586825268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5e8004810 0x7ff5e8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff5feffd640 1 -- 172.21.15.112:0/3586825268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e8003530 con 0x7ff5e80039c0 2024-09-15T23:55:08.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff5feffd640 1 --2- 172.21.15.112:0/3586825268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5e80039c0 0x7ff5e8003de0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009ac0 tx=0x7ff5f001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a894df46ee3be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:08.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff5fdffb640 1 -- 172.21.15.112:0/3586825268 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0009690 con 0x7ff5e80039c0 2024-09-15T23:55:08.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff5fdffb640 1 -- 172.21.15.112:0/3586825268 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f00a6460 con 0x7ff5e80039c0 2024-09-15T23:55:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff5fdffb640 1 -- 172.21.15.112:0/3586825268 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f00a6830 con 0x7ff5e80039c0 2024-09-15T23:55:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff605555640 1 -- 172.21.15.112:0/3586825268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5e80039c0 msgr2=0x7ff5e8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff605555640 1 --2- 172.21.15.112:0/3586825268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5e80039c0 0x7ff5e8003de0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009ac0 tx=0x7ff5f001ca50 comp rx=0 tx=0).stop 2024-09-15T23:55:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff5ff7fe640 1 -- 172.21.15.112:0/3586825268 reap_dead start 2024-09-15T23:55:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff605555640 1 -- 172.21.15.112:0/3586825268 shutdown_connections 2024-09-15T23:55:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff605555640 1 -- 172.21.15.112:0/3586825268 >> 172.21.15.112:0/3586825268 conn(0x7ff6000b1f90 msgr2=0x7ff6000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff605555640 1 -- 172.21.15.112:0/3586825268 shutdown_connections 2024-09-15T23:55:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.319+0000 7ff605555640 1 -- 172.21.15.112:0/3586825268 wait complete. 2024-09-15T23:55:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff605555640 1 Processor -- start 2024-09-15T23:55:08.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff605555640 1 -- start start 2024-09-15T23:55:08.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff605555640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5e80039c0 0x7ff600147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff605555640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff600147800 0x7ff6000cee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff605555640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6000cd790 0x7ff6000cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff605555640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff600073d30 con 0x7ff6000cd790 2024-09-15T23:55:08.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff605555640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff600073a50 con 0x7ff600147800 2024-09-15T23:55:08.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff605555640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff600165f00 con 0x7ff5e80039c0 2024-09-15T23:55:08.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5ff7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6000cd790 0x7ff6000cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5ff7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6000cd790 0x7ff6000cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:55342/0 (socket says 172.21.15.112:55342) 2024-09-15T23:55:08.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5ff7fe640 1 -- 172.21.15.112:0/541346016 learned_addr learned my addr 172.21.15.112:0/541346016 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:08.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5fe7fc640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff600147800 0x7ff6000cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5feffd640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5e80039c0 0x7ff600147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5ff7fe640 1 -- 172.21.15.112:0/541346016 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5e80039c0 msgr2=0x7ff600147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5ff7fe640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5e80039c0 0x7ff600147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5ff7fe640 1 -- 172.21.15.112:0/541346016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff600147800 msgr2=0x7ff6000cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5ff7fe640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff600147800 0x7ff6000cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5ff7fe640 1 -- 172.21.15.112:0/541346016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6000cf5c0 con 0x7ff6000cd790 2024-09-15T23:55:08.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5feffd640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5e80039c0 0x7ff600147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:08.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5fe7fc640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff600147800 0x7ff6000cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:08.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5ff7fe640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6000cd790 0x7ff6000cdc10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8007d10 tx=0x7ff5f80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:08.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5e77fe640 1 -- 172.21.15.112:0/541346016 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8011de0 con 0x7ff6000cd790 2024-09-15T23:55:08.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5e77fe640 1 -- 172.21.15.112:0/541346016 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f801b070 con 0x7ff6000cd790 2024-09-15T23:55:08.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff605555640 1 -- 172.21.15.112:0/541346016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6000cccb0 con 0x7ff6000cd790 2024-09-15T23:55:08.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5e77fe640 1 -- 172.21.15.112:0/541346016 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f80039a0 con 0x7ff6000cd790 2024-09-15T23:55:08.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff605555640 1 -- 172.21.15.112:0/541346016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6000cd270 con 0x7ff6000cd790 2024-09-15T23:55:08.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff605555640 1 -- 172.21.15.112:0/541346016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6000adc80 con 0x7ff6000cd790 2024-09-15T23:55:08.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5e77fe640 1 -- 172.21.15.112:0/541346016 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff5f8003b40 con 0x7ff6000cd790 2024-09-15T23:55:08.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5e77fe640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff5ec0678f0 0x7ff5ec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5e77fe640 1 -- 172.21.15.112:0/541346016 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7ff5f8086450 con 0x7ff6000cd790 2024-09-15T23:55:08.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.323+0000 7ff5feffd640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff5ec0678f0 0x7ff5ec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.327+0000 7ff5feffd640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff5ec0678f0 0x7ff5ec069db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00ad000 tx=0x7ff5f00046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:08.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.331+0000 7ff5e77fe640 1 -- 172.21.15.112:0/541346016 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff5f8056e90 con 0x7ff6000cd790 2024-09-15T23:55:08.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.519+0000 7ff605555640 1 -- 172.21.15.112:0/541346016 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff60006e540 con 0x7ff6000cd790 2024-09-15T23:55:08.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.523+0000 7ff5e77fe640 1 -- 172.21.15.112:0/541346016 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7ff5f8056790 con 0x7ff6000cd790 2024-09-15T23:55:08.527 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:08.527 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"btime":"2024-09-15T23:54:45:647611+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1357012609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1357012609},{"type":"v1","addr":"172.21.15.169:6835","nonce":1357012609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2931559222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2931559222},{"type":"v1","addr":"172.21.15.112:6837","nonce":2931559222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1936572340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1936572340},{"type":"v1","addr":"172.21.15.169:6833","nonce":1936572340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:54:42.951140+0000","modified":"2024-09-15T23:54:44.991346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4869":{"gid":4869,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/40913641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":40913641},{"type":"v1","addr":"172.21.15.112:6835","nonce":40913641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4869,"qdb_cluster":[4869]},"id":2}]} 2024-09-15T23:55:08.527 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-15T23:55:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.523+0000 7ff605555640 1 -- 172.21.15.112:0/541346016 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff5ec0678f0 msgr2=0x7ff5ec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.523+0000 7ff605555640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff5ec0678f0 0x7ff5ec069db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00ad000 tx=0x7ff5f00046d0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.523+0000 7ff605555640 1 -- 172.21.15.112:0/541346016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6000cd790 msgr2=0x7ff6000cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.523+0000 7ff605555640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6000cd790 0x7ff6000cdc10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8007d10 tx=0x7ff5f80115a0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.523+0000 7ff605555640 1 -- 172.21.15.112:0/541346016 shutdown_connections 2024-09-15T23:55:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.523+0000 7ff605555640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff5ec0678f0 0x7ff5ec069db0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.523+0000 7ff605555640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6000cd790 0x7ff6000cdc10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.523+0000 7ff605555640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff600147800 0x7ff6000cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.523+0000 7ff605555640 1 --2- 172.21.15.112:0/541346016 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5e80039c0 0x7ff600147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.523+0000 7ff605555640 1 -- 172.21.15.112:0/541346016 >> 172.21.15.112:0/541346016 conn(0x7ff6000b1f90 msgr2=0x7ff6000b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.527+0000 7ff605555640 1 -- 172.21.15.112:0/541346016 shutdown_connections 2024-09-15T23:55:08.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.527+0000 7ff605555640 1 -- 172.21.15.112:0/541346016 wait complete. 2024-09-15T23:55:08.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump purge_queue pq_executed 2024-09-15T23:55:08.669 INFO:teuthology.orchestra.run.smithi112.stdout:{"purge_queue":{"pq_executed":1001}} 2024-09-15T23:55:08.670 DEBUG:tasks.cephfs.filesystem:_json_asok output { "purge_queue": { "pq_executed": 1001 } } 2024-09-15T23:55:08.670 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat 10000000000.00000000 2024-09-15T23:55:08.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2be32c080 1 Processor -- start 2024-09-15T23:55:08.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2be32c080 1 -- start start 2024-09-15T23:55:08.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2be32c080 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff13ce2ef0 0x55ff13d91840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2be32c080 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ff13cfd2d0 0x55ff13d8f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2be32c080 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff13d870c0 0x55ff13e1f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2be32c080 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ff13ce27b0 con 0x55ff13ce2ef0 2024-09-15T23:55:08.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2be32c080 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ff13c041b0 con 0x55ff13d870c0 2024-09-15T23:55:08.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2be32c080 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55ff13ce2a50 con 0x55ff13cfd2d0 2024-09-15T23:55:08.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2bbe3f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff13ce2ef0 0x55ff13d91840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2bbe3f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff13ce2ef0 0x55ff13d91840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41394/0 (socket says 172.21.15.112:41394) 2024-09-15T23:55:08.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2bbe3f640 1 -- 172.21.15.112:0/129400411 learned_addr learned my addr 172.21.15.112:0/129400411 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:08.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2bbe3f640 1 -- 172.21.15.112:0/129400411 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ff13cfd2d0 msgr2=0x55ff13d8f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:08.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2bbe3f640 1 --2- 172.21.15.112:0/129400411 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ff13cfd2d0 0x55ff13d8f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2bbe3f640 1 -- 172.21.15.112:0/129400411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff13d870c0 msgr2=0x55ff13e1f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:08.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2bbe3f640 1 --2- 172.21.15.112:0/129400411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff13d870c0 0x55ff13e1f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2bbe3f640 1 -- 172.21.15.112:0/129400411 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff13d88390 con 0x55ff13ce2ef0 2024-09-15T23:55:08.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2bbe3f640 1 --2- 172.21.15.112:0/129400411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff13ce2ef0 0x55ff13d91840 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac001e00 tx=0x7fa2ac00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8f74ddfe472c3c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:08.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2ba63c640 1 -- 172.21.15.112:0/129400411 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac012020 con 0x55ff13ce2ef0 2024-09-15T23:55:08.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.699+0000 7fa2ba63c640 1 -- 172.21.15.112:0/129400411 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ac00e690 con 0x55ff13ce2ef0 2024-09-15T23:55:08.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2ba63c640 1 -- 172.21.15.112:0/129400411 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac00ea60 con 0x55ff13ce2ef0 2024-09-15T23:55:08.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 -- 172.21.15.112:0/129400411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff13ce2ef0 msgr2=0x55ff13d91840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 --2- 172.21.15.112:0/129400411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff13ce2ef0 0x55ff13d91840 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac001e00 tx=0x7fa2ac00b6d0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 -- 172.21.15.112:0/129400411 shutdown_connections 2024-09-15T23:55:08.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 --2- 172.21.15.112:0/129400411 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff13d870c0 0x55ff13e1f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 --2- 172.21.15.112:0/129400411 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ff13cfd2d0 0x55ff13d8f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 --2- 172.21.15.112:0/129400411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff13ce2ef0 0x55ff13d91840 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 -- 172.21.15.112:0/129400411 >> 172.21.15.112:0/129400411 conn(0x55ff13cde220 msgr2=0x55ff13cb5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:08.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 -- 172.21.15.112:0/129400411 shutdown_connections 2024-09-15T23:55:08.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 -- 172.21.15.112:0/129400411 wait complete. 2024-09-15T23:55:08.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 Processor -- start 2024-09-15T23:55:08.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 -- start start 2024-09-15T23:55:08.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff13ce2ef0 0x55ff13d7a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff13cfd2d0 0x55ff13d7e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ff13d870c0 0x55ff13d7ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ff13d88130 con 0x55ff13cfd2d0 2024-09-15T23:55:08.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ff13d88b70 con 0x55ff13ce2ef0 2024-09-15T23:55:08.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55ff13d88630 con 0x55ff13d870c0 2024-09-15T23:55:08.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2bb63e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff13cfd2d0 0x55ff13d7e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2bb63e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff13cfd2d0 0x55ff13d7e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41408/0 (socket says 172.21.15.112:41408) 2024-09-15T23:55:08.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2bb63e640 1 -- 172.21.15.112:0/3200221807 learned_addr learned my addr 172.21.15.112:0/3200221807 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:08.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2bc640640 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ff13d870c0 0x55ff13d7ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2bbe3f640 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff13ce2ef0 0x55ff13d7a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2bb63e640 1 -- 172.21.15.112:0/3200221807 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ff13d870c0 msgr2=0x55ff13d7ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2bb63e640 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ff13d870c0 0x55ff13d7ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2bb63e640 1 -- 172.21.15.112:0/3200221807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff13ce2ef0 msgr2=0x55ff13d7a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2bb63e640 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff13ce2ef0 0x55ff13d7a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2bb63e640 1 -- 172.21.15.112:0/3200221807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff13d7bb00 con 0x55ff13cfd2d0 2024-09-15T23:55:08.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2bc640640 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ff13d870c0 0x55ff13d7ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:08.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2bbe3f640 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff13ce2ef0 0x55ff13d7a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:08.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2bb63e640 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff13cfd2d0 0x55ff13d7e0d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa2b001b7e0 tx=0x7fa2b00aad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:08.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2b963a640 1 -- 172.21.15.112:0/3200221807 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00b9020 con 0x55ff13cfd2d0 2024-09-15T23:55:08.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2b963a640 1 -- 172.21.15.112:0/3200221807 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b00b5470 con 0x55ff13cfd2d0 2024-09-15T23:55:08.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 -- 172.21.15.112:0/3200221807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff13d7bda0 con 0x55ff13cfd2d0 2024-09-15T23:55:08.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2b963a640 1 -- 172.21.15.112:0/3200221807 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b00af040 con 0x55ff13cfd2d0 2024-09-15T23:55:08.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.703+0000 7fa2be32c080 1 -- 172.21.15.112:0/3200221807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff13d7c2e0 con 0x55ff13cfd2d0 2024-09-15T23:55:08.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2b963a640 1 -- 172.21.15.112:0/3200221807 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa2b00bc020 con 0x55ff13cfd2d0 2024-09-15T23:55:08.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2b963a640 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2a80662d0 0x7fa2a8068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2b963a640 1 -- 172.21.15.112:0/3200221807 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fa2b011f5d0 con 0x55ff13cfd2d0 2024-09-15T23:55:08.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2bbe3f640 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2a80662d0 0x7fa2a8068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2be32c080 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x55ff13d7b660 0x55ff13d676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2be32c080 1 -- 172.21.15.112:0/3200221807 --> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x55ff13d7e610 con 0x55ff13d7b660 2024-09-15T23:55:08.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2bc640640 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x55ff13d7b660 0x55ff13d676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2bbe3f640 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2a80662d0 0x7fa2a8068790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac000f70 tx=0x7fa2ac009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:08.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2bc640640 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x55ff13d7b660 0x55ff13d676e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:08.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2bc640640 1 -- 172.21.15.112:0/3200221807 <== osd.2 v2:172.21.15.112:6816/4134332386 1 ==== osd_op_reply(1 10000000000.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7fa2b400a6b0 con 0x55ff13d7b660 2024-09-15T23:55:08.716 INFO:teuthology.orchestra.run.smithi112.stderr: error stat-ing cephfs_metadata/10000000000.00000000: (2) No such file or directory 2024-09-15T23:55:08.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2be32c080 1 -- 172.21.15.112:0/3200221807 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x55ff13d7b660 msgr2=0x55ff13d676e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2be32c080 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x55ff13d7b660 0x55ff13d676e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2be32c080 1 -- 172.21.15.112:0/3200221807 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2a80662d0 msgr2=0x7fa2a8068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2be32c080 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2a80662d0 0x7fa2a8068790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac000f70 tx=0x7fa2ac009000 comp rx=0 tx=0).stop 2024-09-15T23:55:08.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2be32c080 1 -- 172.21.15.112:0/3200221807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff13cfd2d0 msgr2=0x55ff13d7e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2be32c080 1 --2- 172.21.15.112:0/3200221807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff13cfd2d0 0x55ff13d7e0d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa2b001b7e0 tx=0x7fa2b00aad60 comp rx=0 tx=0).stop 2024-09-15T23:55:08.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2bc640640 1 -- 172.21.15.112:0/3200221807 reap_dead start 2024-09-15T23:55:08.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2be32c080 1 -- 172.21.15.112:0/3200221807 shutdown_connections 2024-09-15T23:55:08.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2be32c080 1 -- 172.21.15.112:0/3200221807 >> 172.21.15.112:0/3200221807 conn(0x55ff13cde220 msgr2=0x55ff13d8f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:08.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2be32c080 1 -- 172.21.15.112:0/3200221807 shutdown_connections 2024-09-15T23:55:08.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.707+0000 7fa2be32c080 1 -- 172.21.15.112:0/3200221807 wait complete. 2024-09-15T23:55:08.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:55:08.718 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2024-09-15T23:55:08.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.867+0000 7f72e34a6640 1 Processor -- start 2024-09-15T23:55:08.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.867+0000 7f72e34a6640 1 -- start start 2024-09-15T23:55:08.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.867+0000 7f72e34a6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72dc15bec0 0x7f72dc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.867+0000 7f72e34a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72dc15c2a0 0x7f72dc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.867+0000 7f72e34a6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f72dc0af2a0 0x7f72dc15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.867+0000 7f72e34a6640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc0b3290 con 0x7f72dc15bec0 2024-09-15T23:55:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.867+0000 7f72e34a6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc0b3570 con 0x7f72dc0af2a0 2024-09-15T23:55:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.867+0000 7f72e34a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc0b3850 con 0x7f72dc15c2a0 2024-09-15T23:55:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.867+0000 7f72e1242640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72dc15bec0 0x7f72dc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.867+0000 7f72e1242640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f72dc15bec0 0x7f72dc0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41412/0 (socket says 172.21.15.112:41412) 2024-09-15T23:55:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.867+0000 7f72e1242640 1 -- 172.21.15.112:0/2313269511 learned_addr learned my addr 172.21.15.112:0/2313269511 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e1a43640 1 --2- 172.21.15.112:0/2313269511 >> v2:172.21.15.169:3300/0 conn(0x7f72dc0af2a0 0x7f72dc15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e0a41640 1 --2- 172.21.15.112:0/2313269511 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72dc15c2a0 0x7f72dc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e1242640 1 -- 172.21.15.112:0/2313269511 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72dc15c2a0 msgr2=0x7f72dc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e1242640 1 --2- 172.21.15.112:0/2313269511 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72dc15c2a0 0x7f72dc0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e1242640 1 -- 172.21.15.112:0/2313269511 >> v2:172.21.15.169:3300/0 conn(0x7f72dc0af2a0 msgr2=0x7f72dc15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:08.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e1242640 1 --2- 172.21.15.112:0/2313269511 >> v2:172.21.15.169:3300/0 conn(0x7f72dc0af2a0 0x7f72dc15fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e1242640 1 -- 172.21.15.112:0/2313269511 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc0b3b30 con 0x7f72dc15bec0 2024-09-15T23:55:08.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e1242640 1 --2- 172.21.15.112:0/2313269511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc15bec0 0x7f72dc0ad200 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f72dc06dc90 tx=0x7f72d801c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb7f7eb7b0dfc5e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:08.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72d3fff640 1 -- 172.21.15.112:0/2313269511 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d80b0070 con 0x7f72dc15bec0 2024-09-15T23:55:08.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72d3fff640 1 -- 172.21.15.112:0/2313269511 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d80ab600 con 0x7f72dc15bec0 2024-09-15T23:55:08.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72d3fff640 1 -- 172.21.15.112:0/2313269511 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d80ab9d0 con 0x7f72dc15bec0 2024-09-15T23:55:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e34a6640 1 -- 172.21.15.112:0/2313269511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc15bec0 msgr2=0x7f72dc0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e34a6640 1 --2- 172.21.15.112:0/2313269511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc15bec0 0x7f72dc0ad200 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f72dc06dc90 tx=0x7f72d801c230 comp rx=0 tx=0).stop 2024-09-15T23:55:08.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e34a6640 1 -- 172.21.15.112:0/2313269511 shutdown_connections 2024-09-15T23:55:08.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e34a6640 1 --2- 172.21.15.112:0/2313269511 >> v2:172.21.15.169:3300/0 conn(0x7f72dc0af2a0 0x7f72dc15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e34a6640 1 --2- 172.21.15.112:0/2313269511 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72dc15c2a0 0x7f72dc0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e34a6640 1 --2- 172.21.15.112:0/2313269511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc15bec0 0x7f72dc0ad200 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e34a6640 1 -- 172.21.15.112:0/2313269511 >> 172.21.15.112:0/2313269511 conn(0x7f72dc0b1f90 msgr2=0x7f72dc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:08.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e34a6640 1 -- 172.21.15.112:0/2313269511 shutdown_connections 2024-09-15T23:55:08.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.871+0000 7f72e34a6640 1 -- 172.21.15.112:0/2313269511 wait complete. 2024-09-15T23:55:08.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e34a6640 1 Processor -- start 2024-09-15T23:55:08.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e34a6640 1 -- start start 2024-09-15T23:55:08.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e34a6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc0af2a0 0x7f72dc146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e34a6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72dc15bec0 0x7f72dc151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e34a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72dc15c2a0 0x7f72dc1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e34a6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc0af6b0 con 0x7f72dc0af2a0 2024-09-15T23:55:08.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e34a6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc0ad740 con 0x7f72dc15bec0 2024-09-15T23:55:08.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e34a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc06e000 con 0x7f72dc15c2a0 2024-09-15T23:55:08.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e1242640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc0af2a0 0x7f72dc146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e1242640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc0af2a0 0x7f72dc146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41426/0 (socket says 172.21.15.112:41426) 2024-09-15T23:55:08.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e1242640 1 -- 172.21.15.112:0/3590359263 learned_addr learned my addr 172.21.15.112:0/3590359263 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:08.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e1a43640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72dc15c2a0 0x7f72dc1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e0a41640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72dc15bec0 0x7f72dc151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e1242640 1 -- 172.21.15.112:0/3590359263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72dc15c2a0 msgr2=0x7f72dc1555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e1242640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72dc15c2a0 0x7f72dc1555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e1242640 1 -- 172.21.15.112:0/3590359263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72dc15bec0 msgr2=0x7f72dc151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e1242640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72dc15bec0 0x7f72dc151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e1242640 1 -- 172.21.15.112:0/3590359263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc074980 con 0x7f72dc0af2a0 2024-09-15T23:55:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e1a43640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72dc15c2a0 0x7f72dc1555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:55:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e1242640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc0af2a0 0x7f72dc146820 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f72d80ae040 tx=0x7f72d801aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72d1ffb640 1 -- 172.21.15.112:0/3590359263 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d80b0040 con 0x7f72dc0af2a0 2024-09-15T23:55:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72d1ffb640 1 -- 172.21.15.112:0/3590359263 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d80bc070 con 0x7f72dc0af2a0 2024-09-15T23:55:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72d1ffb640 1 -- 172.21.15.112:0/3590359263 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d80b6880 con 0x7f72dc0af2a0 2024-09-15T23:55:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e34a6640 1 -- 172.21.15.112:0/3590359263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72dc146d60 con 0x7f72dc0af2a0 2024-09-15T23:55:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e34a6640 1 -- 172.21.15.112:0/3590359263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72dc152aa0 con 0x7f72dc0af2a0 2024-09-15T23:55:08.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.875+0000 7f72e34a6640 1 -- 172.21.15.112:0/3590359263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72dc0ad200 con 0x7f72dc0af2a0 2024-09-15T23:55:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.879+0000 7f72d1ffb640 1 -- 172.21.15.112:0/3590359263 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f72d80b6a20 con 0x7f72dc0af2a0 2024-09-15T23:55:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.879+0000 7f72d1ffb640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f72c00678c0 0x7f72c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.879+0000 7f72d1ffb640 1 -- 172.21.15.112:0/3590359263 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f72d8120310 con 0x7f72dc0af2a0 2024-09-15T23:55:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.879+0000 7f72e0a41640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f72c00678c0 0x7f72c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:08.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.879+0000 7f72e0a41640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f72c00678c0 0x7f72c0069d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0740f0 tx=0x7f72cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:08.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:08.883+0000 7f72d1ffb640 1 -- 172.21.15.112:0/3590359263 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f72d8016110 con 0x7f72dc0af2a0 2024-09-15T23:55:09.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:09.087+0000 7f72e34a6640 1 -- 172.21.15.112:0/3590359263 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) -- 0x7f72dc06fcd0 con 0x7f72dc0af2a0 2024-09-15T23:55:09.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:09.087+0000 7f72d1ffb640 1 -- 172.21.15.112:0/3590359263 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) ==== 75+0+1692 (secure 0 0 0) 0x7f72d80f0d50 con 0x7f72dc0af2a0 2024-09-15T23:55:09.092 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:09.092 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:55:09.092 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-15T23:55:09.093 INFO:teuthology.orchestra.run.smithi112.stdout: "total_bytes": 773094113280, 2024-09-15T23:55:09.093 INFO:teuthology.orchestra.run.smithi112.stdout: "total_avail_bytes": 772820434944, 2024-09-15T23:55:09.093 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_bytes": 273678336, 2024-09-15T23:55:09.093 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_bytes": 273678336, 2024-09-15T23:55:09.093 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_ratio": 0.00035400391789153218, 2024-09-15T23:55:09.093 INFO:teuthology.orchestra.run.smithi112.stdout: "num_osds": 8, 2024-09-15T23:55:09.093 INFO:teuthology.orchestra.run.smithi112.stdout: "num_per_pool_osds": 8, 2024-09-15T23:55:09.093 INFO:teuthology.orchestra.run.smithi112.stdout: "num_per_pool_omap_osds": 8 2024-09-15T23:55:09.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:09.093 INFO:teuthology.orchestra.run.smithi112.stdout: "stats_by_class": { 2024-09-15T23:55:09.093 INFO:teuthology.orchestra.run.smithi112.stdout: "ssd": { 2024-09-15T23:55:09.093 INFO:teuthology.orchestra.run.smithi112.stdout: "total_bytes": 773094113280, 2024-09-15T23:55:09.093 INFO:teuthology.orchestra.run.smithi112.stdout: "total_avail_bytes": 772820434944, 2024-09-15T23:55:09.094 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_bytes": 273678336, 2024-09-15T23:55:09.094 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_bytes": 273678336, 2024-09-15T23:55:09.094 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_ratio": 0.00035400391789153218 2024-09-15T23:55:09.094 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:09.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:09.094 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-15T23:55:09.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:09.094 INFO:teuthology.orchestra.run.smithi112.stdout: "name": ".mgr", 2024-09-15T23:55:09.094 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 1, 2024-09-15T23:55:09.094 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-15T23:55:09.094 INFO:teuthology.orchestra.run.smithi112.stdout: "stored": 590368, 2024-09-15T23:55:09.094 INFO:teuthology.orchestra.run.smithi112.stdout: "objects": 2, 2024-09-15T23:55:09.094 INFO:teuthology.orchestra.run.smithi112.stdout: "kb_used": 1160, 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: "bytes_used": 1187840, 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: "percent_used": 1.6179940303118201e-06, 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: "max_avail": 367071232000 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cephfs_metadata", 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5, 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: "stored": 3078160, 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: "objects": 23, 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: "kb_used": 6072, 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: "bytes_used": 6217728, 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: "percent_used": 8.4693037933902815e-06, 2024-09-15T23:55:09.095 INFO:teuthology.orchestra.run.smithi112.stdout: "max_avail": 367071232000 2024-09-15T23:55:09.096 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:09.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:09.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:09.096 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cephfs_data", 2024-09-15T23:55:09.096 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 6, 2024-09-15T23:55:09.096 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-15T23:55:09.096 INFO:teuthology.orchestra.run.smithi112.stdout: "stored": 105472, 2024-09-15T23:55:09.096 INFO:teuthology.orchestra.run.smithi112.stdout: "objects": 54, 2024-09-15T23:55:09.096 INFO:teuthology.orchestra.run.smithi112.stdout: "kb_used": 824, 2024-09-15T23:55:09.096 INFO:teuthology.orchestra.run.smithi112.stdout: "bytes_used": 843776, 2024-09-15T23:55:09.096 INFO:teuthology.orchestra.run.smithi112.stdout: "percent_used": 1.1493341389723355e-06, 2024-09-15T23:55:09.096 INFO:teuthology.orchestra.run.smithi112.stdout: "max_avail": 367071232000 2024-09-15T23:55:09.097 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:09.097 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:09.097 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-15T23:55:09.097 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:55:09.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:09.087+0000 7f72e34a6640 1 -- 172.21.15.112:0/3590359263 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f72c00678c0 msgr2=0x7f72c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:09.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:09.087+0000 7f72e34a6640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f72c00678c0 0x7f72c0069d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0740f0 tx=0x7f72cc008040 comp rx=0 tx=0).stop 2024-09-15T23:55:09.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:09.087+0000 7f72e34a6640 1 -- 172.21.15.112:0/3590359263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc0af2a0 msgr2=0x7f72dc146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:09.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:09.087+0000 7f72e34a6640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc0af2a0 0x7f72dc146820 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f72d80ae040 tx=0x7f72d801aa70 comp rx=0 tx=0).stop 2024-09-15T23:55:09.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:09.087+0000 7f72e34a6640 1 -- 172.21.15.112:0/3590359263 shutdown_connections 2024-09-15T23:55:09.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:09.087+0000 7f72e34a6640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f72c00678c0 0x7f72c0069d80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:09.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:09.087+0000 7f72e34a6640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72dc15c2a0 0x7f72dc1555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:09.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:09.087+0000 7f72e34a6640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72dc15bec0 0x7f72dc151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:09.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:09.087+0000 7f72e34a6640 1 --2- 172.21.15.112:0/3590359263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc0af2a0 0x7f72dc146820 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:09.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:09.087+0000 7f72e34a6640 1 -- 172.21.15.112:0/3590359263 >> 172.21.15.112:0/3590359263 conn(0x7f72dc0b1f90 msgr2=0x7f72dc06e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:09.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:09.087+0000 7f72e34a6640 1 -- 172.21.15.112:0/3590359263 shutdown_connections 2024-09-15T23:55:09.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:09.087+0000 7f72e34a6640 1 -- 172.21.15.112:0/3590359263 wait complete. 2024-09-15T23:55:09.110 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-15T23:55:13.295 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:55:13.299 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:55:14.111 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2024-09-15T23:55:14.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.231+0000 7f35b3f9b640 1 Processor -- start 2024-09-15T23:55:14.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.231+0000 7f35b3f9b640 1 -- start start 2024-09-15T23:55:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b3f9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35ac06fef0 0x7f35ac06e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b3f9b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35ac06ee50 con 0x7f35ac0b3d50 2024-09-15T23:55:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b3f9b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35ac06f130 con 0x7f35ac073e60 2024-09-15T23:55:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b3f9b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f35ac06f410 con 0x7f35ac06fef0 2024-09-15T23:55:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b2538640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f35ac0b3d50 0x7f35ac072610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48896/0 (socket says 172.21.15.112:48896) 2024-09-15T23:55:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b2538640 1 -- 172.21.15.112:0/1470492997 learned_addr learned my addr 172.21.15.112:0/1470492997 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 -- 172.21.15.112:0/1470492997 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2905207096 0 0) 0x7f35ac06ee50 con 0x7f35ac0b3d50 2024-09-15T23:55:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b1536640 1 --2- 172.21.15.112:0/1470492997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35ac06fef0 0x7f35ac06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 -- 172.21.15.112:0/1470492997 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3598003450 con 0x7f35ac0b3d50 2024-09-15T23:55:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 -- 172.21.15.112:0/1470492997 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3354901221 0 0) 0x7f3598003450 con 0x7f35ac0b3d50 2024-09-15T23:55:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 -- 172.21.15.112:0/1470492997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35ac06fef0 msgr2=0x7f35ac06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 --2- 172.21.15.112:0/1470492997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35ac06fef0 0x7f35ac06e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 -- 172.21.15.112:0/1470492997 >> v1:172.21.15.169:6789/0 conn(0x7f35ac073e60 legacy=0x7f35ac15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 -- 172.21.15.112:0/1470492997 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac06f6f0 con 0x7f35ac0b3d50 2024-09-15T23:55:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 -- 172.21.15.112:0/1470492997 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f35a4001a00 con 0x7f35ac0b3d50 2024-09-15T23:55:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 -- 172.21.15.112:0/1470492997 >> v1:172.21.15.112:6789/0 conn(0x7f35ac0b3d50 legacy=0x7f35ac072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 --2- 172.21.15.112:0/1470492997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35ac06fef0 0x7f3598003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 --2- 172.21.15.112:0/1470492997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3598004060 0x7f359800a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 --2- 172.21.15.112:0/1470492997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f359800b000 0x7f359800d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 -- 172.21.15.112:0/1470492997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac06f410 con 0x7f359800b000 2024-09-15T23:55:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 -- 172.21.15.112:0/1470492997 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f359800dd70 con 0x7f3598004060 2024-09-15T23:55:14.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b0d35640 1 -- 172.21.15.112:0/1470492997 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f359800df70 con 0x7f35ac06fef0 2024-09-15T23:55:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b2538640 1 --2- 172.21.15.112:0/1470492997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f359800b000 0x7f359800d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b1536640 1 --2- 172.21.15.112:0/1470492997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3598004060 0x7f359800a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b1d37640 1 --2- 172.21.15.112:0/1470492997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35ac06fef0 0x7f3598003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b2538640 1 -- 172.21.15.112:0/1470492997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35ac06fef0 msgr2=0x7f3598003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b2538640 1 --2- 172.21.15.112:0/1470492997 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35ac06fef0 0x7f3598003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b2538640 1 -- 172.21.15.112:0/1470492997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3598004060 msgr2=0x7f359800a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b2538640 1 --2- 172.21.15.112:0/1470492997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3598004060 0x7f359800a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b2538640 1 -- 172.21.15.112:0/1470492997 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3598003450 con 0x7f359800b000 2024-09-15T23:55:14.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.235+0000 7f35b2538640 1 --2- 172.21.15.112:0/1470492997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f359800b000 0x7f359800d490 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f35a400a860 tx=0x7f35a401fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a71c37bdbf345c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:14.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b0d35640 1 -- 172.21.15.112:0/1470492997 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a400a480 con 0x7f359800b000 2024-09-15T23:55:14.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b0d35640 1 -- 172.21.15.112:0/1470492997 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a40aa710 con 0x7f359800b000 2024-09-15T23:55:14.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b0d35640 1 -- 172.21.15.112:0/1470492997 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a40aab80 con 0x7f359800b000 2024-09-15T23:55:14.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 -- 172.21.15.112:0/1470492997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f359800b000 msgr2=0x7f359800d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 --2- 172.21.15.112:0/1470492997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f359800b000 0x7f359800d490 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f35a400a860 tx=0x7f35a401fae0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b2538640 1 -- 172.21.15.112:0/1470492997 reap_dead start 2024-09-15T23:55:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 -- 172.21.15.112:0/1470492997 shutdown_connections 2024-09-15T23:55:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 -- 172.21.15.112:0/1470492997 >> 172.21.15.112:0/1470492997 conn(0x7f35ac0b1f90 msgr2=0x7f35ac0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 -- 172.21.15.112:0/1470492997 shutdown_connections 2024-09-15T23:55:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 -- 172.21.15.112:0/1470492997 wait complete. 2024-09-15T23:55:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 Processor -- start 2024-09-15T23:55:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 -- start start 2024-09-15T23:55:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35ac1546e0 0x7f35ac09ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac154ac0 0x7f35ac1f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35ac0b0f00 0x7f35ac0b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac0b4300 con 0x7f35ac0b0f00 2024-09-15T23:55:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac0b4180 con 0x7f35ac154ac0 2024-09-15T23:55:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f35ac0b4480 con 0x7f35ac1546e0 2024-09-15T23:55:14.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b2538640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35ac0b0f00 0x7f35ac0b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b2538640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35ac0b0f00 0x7f35ac0b13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41446/0 (socket says 172.21.15.112:41446) 2024-09-15T23:55:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b2538640 1 -- 172.21.15.112:0/2830295126 learned_addr learned my addr 172.21.15.112:0/2830295126 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b1d37640 1 --2- 172.21.15.112:0/2830295126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35ac1546e0 0x7f35ac09ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b1536640 1 --2- 172.21.15.112:0/2830295126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac154ac0 0x7f35ac1f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b2538640 1 -- 172.21.15.112:0/2830295126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35ac1546e0 msgr2=0x7f35ac09ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b2538640 1 --2- 172.21.15.112:0/2830295126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35ac1546e0 0x7f35ac09ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b2538640 1 -- 172.21.15.112:0/2830295126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac154ac0 msgr2=0x7f35ac1f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b2538640 1 --2- 172.21.15.112:0/2830295126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac154ac0 0x7f35ac1f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b2538640 1 -- 172.21.15.112:0/2830295126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac1f4b70 con 0x7f35ac0b0f00 2024-09-15T23:55:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b2538640 1 --2- 172.21.15.112:0/2830295126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35ac0b0f00 0x7f35ac0b13b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f35a4001d00 tx=0x7f3598003740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35a27fc640 1 -- 172.21.15.112:0/2830295126 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a400a480 con 0x7f35ac0b0f00 2024-09-15T23:55:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35a27fc640 1 -- 172.21.15.112:0/2830295126 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a40aa510 con 0x7f35ac0b0f00 2024-09-15T23:55:14.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35a27fc640 1 -- 172.21.15.112:0/2830295126 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4001800 con 0x7f35ac0b0f00 2024-09-15T23:55:14.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 -- 172.21.15.112:0/2830295126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ac1f4e50 con 0x7f35ac0b0f00 2024-09-15T23:55:14.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.239+0000 7f35b3f9b640 1 -- 172.21.15.112:0/2830295126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ac09c530 con 0x7f35ac0b0f00 2024-09-15T23:55:14.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.243+0000 7f35b3f9b640 1 -- 172.21.15.112:0/2830295126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35ac06edb0 con 0x7f35ac0b0f00 2024-09-15T23:55:14.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.243+0000 7f35a27fc640 1 -- 172.21.15.112:0/2830295126 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35a40b2400 con 0x7f35ac0b0f00 2024-09-15T23:55:14.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.243+0000 7f35a27fc640 1 --2- 172.21.15.112:0/2830295126 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f35900678c0 0x7f3590069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.243+0000 7f35a27fc640 1 -- 172.21.15.112:0/2830295126 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f35a4123400 con 0x7f35ac0b0f00 2024-09-15T23:55:14.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.243+0000 7f35b1d37640 1 --2- 172.21.15.112:0/2830295126 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f35900678c0 0x7f3590069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.243+0000 7f35b1d37640 1 --2- 172.21.15.112:0/2830295126 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f35900678c0 0x7f3590069d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f35a8005510 tx=0x7f35a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:14.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.247+0000 7f35a27fc640 1 -- 172.21.15.112:0/2830295126 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f35a40ae030 con 0x7f35ac0b0f00 2024-09-15T23:55:14.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.471+0000 7f35b3f9b640 1 -- 172.21.15.112:0/2830295126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) -- 0x7f35ac0b4c00 con 0x7f35ac0b0f00 2024-09-15T23:55:14.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.471+0000 7f35a27fc640 1 -- 172.21.15.112:0/2830295126 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) ==== 75+0+1658 (secure 0 0 0) 0x7f35a40197f0 con 0x7f35ac0b0f00 2024-09-15T23:55:14.479 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:14.479 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:55:14.479 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-15T23:55:14.479 INFO:teuthology.orchestra.run.smithi112.stdout: "total_bytes": 773094113280, 2024-09-15T23:55:14.479 INFO:teuthology.orchestra.run.smithi112.stdout: "total_avail_bytes": 772826480640, 2024-09-15T23:55:14.479 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_bytes": 267632640, 2024-09-15T23:55:14.479 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_bytes": 267632640, 2024-09-15T23:55:14.479 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_ratio": 0.00034618377685546875, 2024-09-15T23:55:14.479 INFO:teuthology.orchestra.run.smithi112.stdout: "num_osds": 8, 2024-09-15T23:55:14.479 INFO:teuthology.orchestra.run.smithi112.stdout: "num_per_pool_osds": 8, 2024-09-15T23:55:14.479 INFO:teuthology.orchestra.run.smithi112.stdout: "num_per_pool_omap_osds": 8 2024-09-15T23:55:14.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:14.480 INFO:teuthology.orchestra.run.smithi112.stdout: "stats_by_class": { 2024-09-15T23:55:14.480 INFO:teuthology.orchestra.run.smithi112.stdout: "ssd": { 2024-09-15T23:55:14.480 INFO:teuthology.orchestra.run.smithi112.stdout: "total_bytes": 773094113280, 2024-09-15T23:55:14.480 INFO:teuthology.orchestra.run.smithi112.stdout: "total_avail_bytes": 772826480640, 2024-09-15T23:55:14.480 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_bytes": 267632640, 2024-09-15T23:55:14.480 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_bytes": 267632640, 2024-09-15T23:55:14.480 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_ratio": 0.00034618377685546875 2024-09-15T23:55:14.480 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:14.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:14.480 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-15T23:55:14.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:14.480 INFO:teuthology.orchestra.run.smithi112.stdout: "name": ".mgr", 2024-09-15T23:55:14.480 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 1, 2024-09-15T23:55:14.480 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-15T23:55:14.481 INFO:teuthology.orchestra.run.smithi112.stdout: "stored": 590368, 2024-09-15T23:55:14.481 INFO:teuthology.orchestra.run.smithi112.stdout: "objects": 2, 2024-09-15T23:55:14.481 INFO:teuthology.orchestra.run.smithi112.stdout: "kb_used": 1160, 2024-09-15T23:55:14.481 INFO:teuthology.orchestra.run.smithi112.stdout: "bytes_used": 1187840, 2024-09-15T23:55:14.481 INFO:teuthology.orchestra.run.smithi112.stdout: "percent_used": 1.6179849353648024e-06, 2024-09-15T23:55:14.481 INFO:teuthology.orchestra.run.smithi112.stdout: "max_avail": 367073296384 2024-09-15T23:55:14.481 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:14.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:14.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:14.481 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cephfs_metadata", 2024-09-15T23:55:14.481 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5, 2024-09-15T23:55:14.482 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-15T23:55:14.482 INFO:teuthology.orchestra.run.smithi112.stdout: "stored": 3677759, 2024-09-15T23:55:14.482 INFO:teuthology.orchestra.run.smithi112.stdout: "objects": 23, 2024-09-15T23:55:14.482 INFO:teuthology.orchestra.run.smithi112.stdout: "kb_used": 7240, 2024-09-15T23:55:14.482 INFO:teuthology.orchestra.run.smithi112.stdout: "bytes_used": 7413760, 2024-09-15T23:55:14.482 INFO:teuthology.orchestra.run.smithi112.stdout: "percent_used": 1.0098371603817213e-05, 2024-09-15T23:55:14.483 INFO:teuthology.orchestra.run.smithi112.stdout: "max_avail": 367073296384 2024-09-15T23:55:14.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:14.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:14.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:14.483 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cephfs_data", 2024-09-15T23:55:14.483 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 6, 2024-09-15T23:55:14.483 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-15T23:55:14.483 INFO:teuthology.orchestra.run.smithi112.stdout: "stored": 0, 2024-09-15T23:55:14.483 INFO:teuthology.orchestra.run.smithi112.stdout: "objects": 0, 2024-09-15T23:55:14.483 INFO:teuthology.orchestra.run.smithi112.stdout: "kb_used": 0, 2024-09-15T23:55:14.483 INFO:teuthology.orchestra.run.smithi112.stdout: "bytes_used": 0, 2024-09-15T23:55:14.483 INFO:teuthology.orchestra.run.smithi112.stdout: "percent_used": 0, 2024-09-15T23:55:14.483 INFO:teuthology.orchestra.run.smithi112.stdout: "max_avail": 367073296384 2024-09-15T23:55:14.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:14.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:14.484 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-15T23:55:14.484 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:55:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.475+0000 7f35b3f9b640 1 -- 172.21.15.112:0/2830295126 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f35900678c0 msgr2=0x7f3590069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.475+0000 7f35b3f9b640 1 --2- 172.21.15.112:0/2830295126 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f35900678c0 0x7f3590069d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f35a8005510 tx=0x7f35a8009040 comp rx=0 tx=0).stop 2024-09-15T23:55:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.475+0000 7f35b3f9b640 1 -- 172.21.15.112:0/2830295126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35ac0b0f00 msgr2=0x7f35ac0b13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.475+0000 7f35b3f9b640 1 --2- 172.21.15.112:0/2830295126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35ac0b0f00 0x7f35ac0b13b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f35a4001d00 tx=0x7f3598003740 comp rx=0 tx=0).stop 2024-09-15T23:55:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.475+0000 7f35b3f9b640 1 -- 172.21.15.112:0/2830295126 shutdown_connections 2024-09-15T23:55:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.475+0000 7f35b3f9b640 1 --2- 172.21.15.112:0/2830295126 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f35900678c0 0x7f3590069d80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.475+0000 7f35b3f9b640 1 --2- 172.21.15.112:0/2830295126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35ac0b0f00 0x7f35ac0b13b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.475+0000 7f35b3f9b640 1 --2- 172.21.15.112:0/2830295126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35ac154ac0 0x7f35ac1f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.475+0000 7f35b3f9b640 1 --2- 172.21.15.112:0/2830295126 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35ac1546e0 0x7f35ac09ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.475+0000 7f35b3f9b640 1 -- 172.21.15.112:0/2830295126 >> 172.21.15.112:0/2830295126 conn(0x7f35ac0b1f90 msgr2=0x7f35ac06df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.475+0000 7f35b3f9b640 1 -- 172.21.15.112:0/2830295126 shutdown_connections 2024-09-15T23:55:14.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.475+0000 7f35b3f9b640 1 -- 172.21.15.112:0/2830295126 wait complete. 2024-09-15T23:55:14.501 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-15T23:55:14.501 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:55:14.501 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:55:14.584 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:55:14.681 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:55:14.681 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:55:14.681 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:55:14.681 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:14.689 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:55:14.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.855+0000 7f84d96d2640 1 Processor -- start 2024-09-15T23:55:14.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.855+0000 7f84d96d2640 1 -- start start 2024-09-15T23:55:14.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d96d2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d4161a60 0x7f84d40d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d96d2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f84d40cf620 0x7f84d406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d96d2640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d40d32b0 con 0x7f84d40d2e90 2024-09-15T23:55:14.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d96d2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f84d40d0300 con 0x7f84d40cf620 2024-09-15T23:55:14.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d96d2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f84d40b0f60 con 0x7f84d4161a60 2024-09-15T23:55:14.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d27fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f84d40d2e90 0x7f84d40cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48900/0 (socket says 172.21.15.112:48900) 2024-09-15T23:55:14.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d27fc640 1 -- 172.21.15.112:0/3651957675 learned_addr learned my addr 172.21.15.112:0/3651957675 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:14.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d2ffd640 1 --2- 172.21.15.112:0/3651957675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d4161a60 0x7f84d40d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d37fe640 1 --2- 172.21.15.112:0/3651957675 >> v2:172.21.15.169:3300/0 conn(0x7f84d40cf620 0x7f84d406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 -- 172.21.15.112:0/3651957675 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2137771975 0 0) 0x7f84d40d32b0 con 0x7f84d40d2e90 2024-09-15T23:55:14.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 -- 172.21.15.112:0/3651957675 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84c0003530 con 0x7f84d40d2e90 2024-09-15T23:55:14.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 -- 172.21.15.112:0/3651957675 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3227736998 0 0) 0x7f84c0003530 con 0x7f84d40d2e90 2024-09-15T23:55:14.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 -- 172.21.15.112:0/3651957675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d4161a60 msgr2=0x7f84d40d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:14.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 --2- 172.21.15.112:0/3651957675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d4161a60 0x7f84d40d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 -- 172.21.15.112:0/3651957675 >> v2:172.21.15.169:3300/0 conn(0x7f84d40cf620 msgr2=0x7f84d406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:14.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 --2- 172.21.15.112:0/3651957675 >> v2:172.21.15.169:3300/0 conn(0x7f84d40cf620 0x7f84d406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 -- 172.21.15.112:0/3651957675 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d40cfad0 con 0x7f84d40d2e90 2024-09-15T23:55:14.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 -- 172.21.15.112:0/3651957675 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f84bc001680 con 0x7f84d40d2e90 2024-09-15T23:55:14.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 -- 172.21.15.112:0/3651957675 >> v1:172.21.15.112:6789/0 conn(0x7f84d40d2e90 legacy=0x7f84d40cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 --2- 172.21.15.112:0/3651957675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d4161a60 0x7f84c00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 --2- 172.21.15.112:0/3651957675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84c0003f90 0x7f84c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 --2- 172.21.15.112:0/3651957675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c0004d50 0x7f84c00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 -- 172.21.15.112:0/3651957675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f84d40d0300 con 0x7f84c0004d50 2024-09-15T23:55:14.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 -- 172.21.15.112:0/3651957675 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f84d40b0f60 con 0x7f84c0003f90 2024-09-15T23:55:14.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 -- 172.21.15.112:0/3651957675 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f84c000ba80 con 0x7f84d4161a60 2024-09-15T23:55:14.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d37fe640 1 --2- 172.21.15.112:0/3651957675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c0004d50 0x7f84c00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d2ffd640 1 --2- 172.21.15.112:0/3651957675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d4161a60 0x7f84c00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d27fc640 1 --2- 172.21.15.112:0/3651957675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84c0003f90 0x7f84c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d37fe640 1 -- 172.21.15.112:0/3651957675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d4161a60 msgr2=0x7f84c00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:14.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d37fe640 1 --2- 172.21.15.112:0/3651957675 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d4161a60 0x7f84c00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d37fe640 1 -- 172.21.15.112:0/3651957675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84c0003f90 msgr2=0x7f84c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:14.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d37fe640 1 --2- 172.21.15.112:0/3651957675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84c0003f90 0x7f84c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d37fe640 1 -- 172.21.15.112:0/3651957675 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c0003530 con 0x7f84c0004d50 2024-09-15T23:55:14.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d37fe640 1 --2- 172.21.15.112:0/3651957675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c0004d50 0x7f84c00051d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f84cc009ae0 tx=0x7f84cc01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9717ceebdbc6fabf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:14.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 -- 172.21.15.112:0/3651957675 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc0b2070 con 0x7f84c0004d50 2024-09-15T23:55:14.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.859+0000 7f84d1ffb640 1 -- 172.21.15.112:0/3651957675 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84cc0a56a0 con 0x7f84c0004d50 2024-09-15T23:55:14.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d1ffb640 1 -- 172.21.15.112:0/3651957675 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc0096b0 con 0x7f84c0004d50 2024-09-15T23:55:14.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 -- 172.21.15.112:0/3651957675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c0004d50 msgr2=0x7f84c00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 --2- 172.21.15.112:0/3651957675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84c0004d50 0x7f84c00051d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f84cc009ae0 tx=0x7f84cc01cab0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d37fe640 1 -- 172.21.15.112:0/3651957675 reap_dead start 2024-09-15T23:55:14.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 -- 172.21.15.112:0/3651957675 shutdown_connections 2024-09-15T23:55:14.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 -- 172.21.15.112:0/3651957675 >> 172.21.15.112:0/3651957675 conn(0x7f84d408bf90 msgr2=0x7f84d409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:14.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 -- 172.21.15.112:0/3651957675 shutdown_connections 2024-09-15T23:55:14.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 -- 172.21.15.112:0/3651957675 wait complete. 2024-09-15T23:55:14.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 Processor -- start 2024-09-15T23:55:14.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 -- start start 2024-09-15T23:55:14.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d41527c0 0x7f84d40b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d40c9530 0x7f84d415ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84d41604e0 0x7f84d40b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f84d406ceb0 con 0x7f84d41604e0 2024-09-15T23:55:14.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f84d40d0020 con 0x7f84d40c9530 2024-09-15T23:55:14.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f84d406d190 con 0x7f84d41527c0 2024-09-15T23:55:14.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84d41604e0 0x7f84d40b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84d41604e0 0x7f84d40b71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41462/0 (socket says 172.21.15.112:41462) 2024-09-15T23:55:14.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d37fe640 1 -- 172.21.15.112:0/846502580 learned_addr learned my addr 172.21.15.112:0/846502580 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:14.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d2ffd640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d41527c0 0x7f84d40b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d27fc640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d40c9530 0x7f84d415ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d37fe640 1 -- 172.21.15.112:0/846502580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d41527c0 msgr2=0x7f84d40b86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d37fe640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d41527c0 0x7f84d40b86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d37fe640 1 -- 172.21.15.112:0/846502580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d40c9530 msgr2=0x7f84d415ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d37fe640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d40c9530 0x7f84d415ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d37fe640 1 -- 172.21.15.112:0/846502580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d40b9010 con 0x7f84d41604e0 2024-09-15T23:55:14.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d27fc640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d40c9530 0x7f84d415ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:14.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d37fe640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84d41604e0 0x7f84d40b71a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0b0040 tx=0x7f84c0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:14.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84cb7fe640 1 -- 172.21.15.112:0/846502580 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc0b2040 con 0x7f84d41604e0 2024-09-15T23:55:14.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84cb7fe640 1 -- 172.21.15.112:0/846502580 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84cc000e50 con 0x7f84d41604e0 2024-09-15T23:55:14.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 -- 172.21.15.112:0/846502580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d40b92f0 con 0x7f84d41604e0 2024-09-15T23:55:14.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84cb7fe640 1 -- 172.21.15.112:0/846502580 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc0096b0 con 0x7f84d41604e0 2024-09-15T23:55:14.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.863+0000 7f84d96d2640 1 -- 172.21.15.112:0/846502580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d40b98b0 con 0x7f84d41604e0 2024-09-15T23:55:14.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.867+0000 7f84d96d2640 1 -- 172.21.15.112:0/846502580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84d40d10b0 con 0x7f84d41604e0 2024-09-15T23:55:14.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.867+0000 7f84cb7fe640 1 -- 172.21.15.112:0/846502580 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f84cc0bd030 con 0x7f84d41604e0 2024-09-15T23:55:14.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.867+0000 7f84cb7fe640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f84b40678c0 0x7f84b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.867+0000 7f84cb7fe640 1 -- 172.21.15.112:0/846502580 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f84cc11ece0 con 0x7f84d41604e0 2024-09-15T23:55:14.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.867+0000 7f84d2ffd640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f84b40678c0 0x7f84b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.867+0000 7f84d2ffd640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f84b40678c0 0x7f84b4069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f84c4007520 tx=0x7f84c400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:14.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:14.871+0000 7f84cb7fe640 1 -- 172.21.15.112:0/846502580 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f84cc0167c0 con 0x7f84d41604e0 2024-09-15T23:55:15.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.047+0000 7f84d96d2640 1 -- 172.21.15.112:0/846502580 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f84d406bcc0 con 0x7f84d41604e0 2024-09-15T23:55:15.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.047+0000 7f84cb7fe640 1 -- 172.21.15.112:0/846502580 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7f84cc0ef720 con 0x7f84d41604e0 2024-09-15T23:55:15.053 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:55:15.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.047+0000 7f84d96d2640 1 -- 172.21.15.112:0/846502580 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f84b40678c0 msgr2=0x7f84b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.047+0000 7f84d96d2640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f84b40678c0 0x7f84b4069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f84c4007520 tx=0x7f84c400b040 comp rx=0 tx=0).stop 2024-09-15T23:55:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.047+0000 7f84d96d2640 1 -- 172.21.15.112:0/846502580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84d41604e0 msgr2=0x7f84d40b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.047+0000 7f84d96d2640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84d41604e0 0x7f84d40b71a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0b0040 tx=0x7f84c0005840 comp rx=0 tx=0).stop 2024-09-15T23:55:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.051+0000 7f84d96d2640 1 -- 172.21.15.112:0/846502580 shutdown_connections 2024-09-15T23:55:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.051+0000 7f84d96d2640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f84b40678c0 0x7f84b4069d80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.051+0000 7f84d96d2640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84d41604e0 0x7f84d40b71a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.051+0000 7f84d96d2640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84d40c9530 0x7f84d415ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.051+0000 7f84d96d2640 1 --2- 172.21.15.112:0/846502580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84d41527c0 0x7f84d40b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.051+0000 7f84d96d2640 1 -- 172.21.15.112:0/846502580 >> 172.21.15.112:0/846502580 conn(0x7f84d408bf90 msgr2=0x7f84d409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.051+0000 7f84d96d2640 1 -- 172.21.15.112:0/846502580 shutdown_connections 2024-09-15T23:55:15.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.051+0000 7f84d96d2640 1 -- 172.21.15.112:0/846502580 wait complete. 2024-09-15T23:55:15.073 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2024-09-15T23:55:15.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:15.074 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:15.084 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[37712]: fuse finished with error 0 and tester_r 0 2024-09-15T23:55:15.086 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:55:15.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:15.086 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:55:15.189 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:55:15.189 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:55:15.189 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:15.195 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:55:15.195 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:55:15.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:15.195 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:55:15.243 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-15T23:55:15.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:55:15.244 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:55:15.244 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:55:15.244 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:15.250 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:55:15.250 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:55:15.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:15.250 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-15T23:55:15.303 INFO:teuthology.orchestra.run.smithi112.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-15T23:55:15.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:55:15.304 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:55:15.304 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:55:15.304 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:15.310 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:55:15.310 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:55:15.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:15.310 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-15T23:55:15.360 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-15T23:55:15.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:55:15.361 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:15.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.483+0000 7f8130d6f640 1 Processor -- start 2024-09-15T23:55:15.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f8130d6f640 1 -- start start 2024-09-15T23:55:15.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f8130d6f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f812c1587a0 0x7f812c0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f8130d6f640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c06ec60 con 0x7f812c06e680 2024-09-15T23:55:15.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f8130d6f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c06ef40 con 0x7f812c0b37d0 2024-09-15T23:55:15.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f8130d6f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f812c0b3c40 con 0x7f812c1587a0 2024-09-15T23:55:15.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812ad9d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f812c06e680 0x7f812c072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48906/0 (socket says 172.21.15.112:48906) 2024-09-15T23:55:15.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812ad9d640 1 -- 172.21.15.112:0/2330371209 learned_addr learned my addr 172.21.15.112:0/2330371209 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:15.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 -- 172.21.15.112:0/2330371209 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 515536203 0 0) 0x7f812c06ec60 con 0x7f812c06e680 2024-09-15T23:55:15.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 -- 172.21.15.112:0/2330371209 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8118003530 con 0x7f812c06e680 2024-09-15T23:55:15.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812a59c640 1 --2- 172.21.15.112:0/2330371209 >> v2:172.21.15.169:3300/0 conn(0x7f812c1587a0 0x7f812c0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 -- 172.21.15.112:0/2330371209 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1509335755 0 0) 0x7f8118003530 con 0x7f812c06e680 2024-09-15T23:55:15.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 -- 172.21.15.112:0/2330371209 >> v2:172.21.15.169:3300/0 conn(0x7f812c1587a0 msgr2=0x7f812c0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:15.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 --2- 172.21.15.112:0/2330371209 >> v2:172.21.15.169:3300/0 conn(0x7f812c1587a0 0x7f812c0b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 -- 172.21.15.112:0/2330371209 >> v1:172.21.15.169:6789/0 conn(0x7f812c0b37d0 legacy=0x7f812c06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 -- 172.21.15.112:0/2330371209 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c06f220 con 0x7f812c06e680 2024-09-15T23:55:15.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 -- 172.21.15.112:0/2330371209 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f811c001a00 con 0x7f812c06e680 2024-09-15T23:55:15.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 -- 172.21.15.112:0/2330371209 >> v1:172.21.15.112:6789/0 conn(0x7f812c06e680 legacy=0x7f812c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 --2- 172.21.15.112:0/2330371209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81180039c0 0x7f8118003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 --2- 172.21.15.112:0/2330371209 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8118004810 0x7f8118004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 --2- 172.21.15.112:0/2330371209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81180051d0 0x7f811800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 -- 172.21.15.112:0/2330371209 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f812c0b3c40 con 0x7f81180051d0 2024-09-15T23:55:15.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 -- 172.21.15.112:0/2330371209 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f811800c070 con 0x7f81180039c0 2024-09-15T23:55:15.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812959a640 1 -- 172.21.15.112:0/2330371209 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f811800c270 con 0x7f8118004810 2024-09-15T23:55:15.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812ad9d640 1 --2- 172.21.15.112:0/2330371209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81180051d0 0x7f811800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812a59c640 1 --2- 172.21.15.112:0/2330371209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81180039c0 0x7f8118003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f8129d9b640 1 --2- 172.21.15.112:0/2330371209 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8118004810 0x7f8118004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812ad9d640 1 -- 172.21.15.112:0/2330371209 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8118004810 msgr2=0x7f8118004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:15.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812ad9d640 1 --2- 172.21.15.112:0/2330371209 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8118004810 0x7f8118004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812ad9d640 1 -- 172.21.15.112:0/2330371209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81180039c0 msgr2=0x7f8118003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:15.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812ad9d640 1 --2- 172.21.15.112:0/2330371209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81180039c0 0x7f8118003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812ad9d640 1 -- 172.21.15.112:0/2330371209 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8118003530 con 0x7f81180051d0 2024-09-15T23:55:15.496 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.487+0000 7f812a59c640 1 --2- 172.21.15.112:0/2330371209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81180039c0 0x7f8118003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:15.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.491+0000 7f812ad9d640 1 -- 172.21.15.112:0/2330371209 reap_dead start 2024-09-15T23:55:15.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.491+0000 7f812ad9d640 1 --2- 172.21.15.112:0/2330371209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81180051d0 0x7f811800b9d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f811c00a840 tx=0x7f811c01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb51e040eb96924 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.491+0000 7f812959a640 1 -- 172.21.15.112:0/2330371209 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c00a460 con 0x7f81180051d0 2024-09-15T23:55:15.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.491+0000 7f812959a640 1 -- 172.21.15.112:0/2330371209 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f811c0ac640 con 0x7f81180051d0 2024-09-15T23:55:15.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.491+0000 7f812959a640 1 -- 172.21.15.112:0/2330371209 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c0aca30 con 0x7f81180051d0 2024-09-15T23:55:15.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.491+0000 7f8130d6f640 1 -- 172.21.15.112:0/2330371209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81180051d0 msgr2=0x7f811800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.491+0000 7f8130d6f640 1 --2- 172.21.15.112:0/2330371209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81180051d0 0x7f811800b9d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f811c00a840 tx=0x7f811c01d360 comp rx=0 tx=0).stop 2024-09-15T23:55:15.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.491+0000 7f8130d6f640 1 -- 172.21.15.112:0/2330371209 shutdown_connections 2024-09-15T23:55:15.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.491+0000 7f8130d6f640 1 --2- 172.21.15.112:0/2330371209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81180051d0 0x7f811800b9d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.491+0000 7f8130d6f640 1 -- 172.21.15.112:0/2330371209 >> 172.21.15.112:0/2330371209 conn(0x7f812c0b1f90 msgr2=0x7f812c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:15.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.491+0000 7f8130d6f640 1 -- 172.21.15.112:0/2330371209 shutdown_connections 2024-09-15T23:55:15.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.491+0000 7f8130d6f640 1 -- 172.21.15.112:0/2330371209 wait complete. 2024-09-15T23:55:15.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.491+0000 7f8130d6f640 1 Processor -- start 2024-09-15T23:55:15.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.491+0000 7f8130d6f640 1 -- start start 2024-09-15T23:55:15.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8130d6f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81180051d0 0x7f812c155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8130d6f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f812c1e7150 0x7f812c1e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8130d6f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f812c137cd0 0x7f812c138150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8130d6f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f812c06f870 con 0x7f81180051d0 2024-09-15T23:55:15.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8130d6f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f812c158b80 con 0x7f812c137cd0 2024-09-15T23:55:15.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8130d6f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f812c156110 con 0x7f812c1e7150 2024-09-15T23:55:15.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f812a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81180051d0 0x7f812c155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f812a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81180051d0 0x7f812c155bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41470/0 (socket says 172.21.15.112:41470) 2024-09-15T23:55:15.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f812a59c640 1 -- 172.21.15.112:0/1882042395 learned_addr learned my addr 172.21.15.112:0/1882042395 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:15.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8129d9b640 1 --2- 172.21.15.112:0/1882042395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f812c1e7150 0x7f812c1e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f812ad9d640 1 --2- 172.21.15.112:0/1882042395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f812c137cd0 0x7f812c138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f812a59c640 1 -- 172.21.15.112:0/1882042395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f812c1e7150 msgr2=0x7f812c1e75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f812a59c640 1 --2- 172.21.15.112:0/1882042395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f812c1e7150 0x7f812c1e75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f812a59c640 1 -- 172.21.15.112:0/1882042395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f812c137cd0 msgr2=0x7f812c138150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f812a59c640 1 --2- 172.21.15.112:0/1882042395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f812c137cd0 0x7f812c138150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f812a59c640 1 -- 172.21.15.112:0/1882042395 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c1e7c10 con 0x7f81180051d0 2024-09-15T23:55:15.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f812a59c640 1 --2- 172.21.15.112:0/1882042395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81180051d0 0x7f812c155bd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f81240108d0 tx=0x7f8124010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8122ffd640 1 -- 172.21.15.112:0/1882042395 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812400f040 con 0x7f81180051d0 2024-09-15T23:55:15.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8122ffd640 1 -- 172.21.15.112:0/1882042395 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8124004220 con 0x7f81180051d0 2024-09-15T23:55:15.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8122ffd640 1 -- 172.21.15.112:0/1882042395 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812400e960 con 0x7f81180051d0 2024-09-15T23:55:15.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8130d6f640 1 -- 172.21.15.112:0/1882042395 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812c1e7ef0 con 0x7f81180051d0 2024-09-15T23:55:15.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8130d6f640 1 -- 172.21.15.112:0/1882042395 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f812c1e84b0 con 0x7f81180051d0 2024-09-15T23:55:15.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8130d6f640 1 -- 172.21.15.112:0/1882042395 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f812c0b3290 con 0x7f81180051d0 2024-09-15T23:55:15.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8122ffd640 1 -- 172.21.15.112:0/1882042395 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f812400eb00 con 0x7f81180051d0 2024-09-15T23:55:15.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8122ffd640 1 --2- 172.21.15.112:0/1882042395 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f810c0678f0 0x7f810c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8129d9b640 1 --2- 172.21.15.112:0/1882042395 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f810c0678f0 0x7f810c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.495+0000 7f8122ffd640 1 -- 172.21.15.112:0/1882042395 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f8124086230 con 0x7f81180051d0 2024-09-15T23:55:15.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.499+0000 7f8129d9b640 1 --2- 172.21.15.112:0/1882042395 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f810c0678f0 0x7f810c069db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8114000c10 tx=0x7f8114009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.503+0000 7f8122ffd640 1 -- 172.21.15.112:0/1882042395 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8124018030 con 0x7f81180051d0 2024-09-15T23:55:15.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.703+0000 7f8130d6f640 1 -- 172.21.15.112:0/1882042395 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f812c070080 con 0x7f81180051d0 2024-09-15T23:55:15.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.703+0000 7f8122ffd640 1 -- 172.21.15.112:0/1882042395 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f8124056be0 con 0x7f81180051d0 2024-09-15T23:55:15.710 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:15.710 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"btime":"2024-09-15T23:54:45:647611+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1357012609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1357012609},{"type":"v1","addr":"172.21.15.169:6835","nonce":1357012609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2931559222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2931559222},{"type":"v1","addr":"172.21.15.112:6837","nonce":2931559222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1936572340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1936572340},{"type":"v1","addr":"172.21.15.169:6833","nonce":1936572340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:54:42.951140+0000","modified":"2024-09-15T23:54:44.991346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4869":{"gid":4869,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/40913641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":40913641},{"type":"v1","addr":"172.21.15.112:6835","nonce":40913641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4869,"qdb_cluster":[4869]},"id":2}]} 2024-09-15T23:55:15.711 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-15T23:55:15.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.707+0000 7f8130d6f640 1 -- 172.21.15.112:0/1882042395 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f810c0678f0 msgr2=0x7f810c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.707+0000 7f8130d6f640 1 --2- 172.21.15.112:0/1882042395 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f810c0678f0 0x7f810c069db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8114000c10 tx=0x7f8114009040 comp rx=0 tx=0).stop 2024-09-15T23:55:15.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.707+0000 7f8130d6f640 1 -- 172.21.15.112:0/1882042395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81180051d0 msgr2=0x7f812c155bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.707+0000 7f8130d6f640 1 --2- 172.21.15.112:0/1882042395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81180051d0 0x7f812c155bd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f81240108d0 tx=0x7f8124010d90 comp rx=0 tx=0).stop 2024-09-15T23:55:15.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.707+0000 7f8130d6f640 1 -- 172.21.15.112:0/1882042395 shutdown_connections 2024-09-15T23:55:15.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.707+0000 7f8130d6f640 1 --2- 172.21.15.112:0/1882042395 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f810c0678f0 0x7f810c069db0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.707+0000 7f8130d6f640 1 --2- 172.21.15.112:0/1882042395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f812c137cd0 0x7f812c138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.707+0000 7f8130d6f640 1 --2- 172.21.15.112:0/1882042395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f812c1e7150 0x7f812c1e75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.707+0000 7f8130d6f640 1 --2- 172.21.15.112:0/1882042395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81180051d0 0x7f812c155bd0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.707+0000 7f8130d6f640 1 -- 172.21.15.112:0/1882042395 >> 172.21.15.112:0/1882042395 conn(0x7f812c0b1f90 msgr2=0x7f812c1579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:15.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.707+0000 7f8130d6f640 1 -- 172.21.15.112:0/1882042395 shutdown_connections 2024-09-15T23:55:15.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.707+0000 7f8130d6f640 1 -- 172.21.15.112:0/1882042395 wait complete. 2024-09-15T23:55:15.729 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:15.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.831+0000 7fddaa7d3640 1 Processor -- start 2024-09-15T23:55:15.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.831+0000 7fddaa7d3640 1 -- start start 2024-09-15T23:55:15.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fddaa7d3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdda415bec0 0x7fdda40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fddaa7d3640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdda415c2a0 0x7fdda40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fddaa7d3640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda40b3290 con 0x7fdda40af2a0 2024-09-15T23:55:15.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fddaa7d3640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdda40b3570 con 0x7fdda415bec0 2024-09-15T23:55:15.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fddaa7d3640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fdda40b3850 con 0x7fdda415c2a0 2024-09-15T23:55:15.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fdda3fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdda415bec0 0x7fdda40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fdda8d70640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fdda40af2a0 0x7fdda415fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48920/0 (socket says 172.21.15.112:48920) 2024-09-15T23:55:15.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fdda8d70640 1 -- 172.21.15.112:0/171648453 learned_addr learned my addr 172.21.15.112:0/171648453 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:15.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fdd9bfff640 1 --2- 172.21.15.112:0/171648453 >> v2:172.21.15.169:3300/0 conn(0x7fdda415c2a0 0x7fdda40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fdda3fff640 1 -- 172.21.15.112:0/171648453 >> v2:172.21.15.169:3300/0 conn(0x7fdda415c2a0 msgr2=0x7fdda40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:15.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fdda3fff640 1 --2- 172.21.15.112:0/171648453 >> v2:172.21.15.169:3300/0 conn(0x7fdda415c2a0 0x7fdda40aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fdda3fff640 1 -- 172.21.15.112:0/171648453 >> v1:172.21.15.112:6789/0 conn(0x7fdda40af2a0 legacy=0x7fdda415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fdda3fff640 1 -- 172.21.15.112:0/171648453 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda40b3b30 con 0x7fdda415bec0 2024-09-15T23:55:15.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fdda3fff640 1 --2- 172.21.15.112:0/171648453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdda415bec0 0x7fdda40ad200 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdda40ae510 tx=0x7fdd9401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fd41bbfbda8d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fdda37fe640 1 -- 172.21.15.112:0/171648453 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd940ab650 con 0x7fdda415bec0 2024-09-15T23:55:15.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fdda37fe640 1 -- 172.21.15.112:0/171648453 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd940b0070 con 0x7fdda415bec0 2024-09-15T23:55:15.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.835+0000 7fdda37fe640 1 -- 172.21.15.112:0/171648453 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd940aba10 con 0x7fdda415bec0 2024-09-15T23:55:15.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 -- 172.21.15.112:0/171648453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdda415bec0 msgr2=0x7fdda40ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 --2- 172.21.15.112:0/171648453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdda415bec0 0x7fdda40ad200 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdda40ae510 tx=0x7fdd9401c450 comp rx=0 tx=0).stop 2024-09-15T23:55:15.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 -- 172.21.15.112:0/171648453 shutdown_connections 2024-09-15T23:55:15.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 --2- 172.21.15.112:0/171648453 >> v2:172.21.15.169:3300/0 conn(0x7fdda415c2a0 0x7fdda40aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 --2- 172.21.15.112:0/171648453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdda415bec0 0x7fdda40ad200 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 -- 172.21.15.112:0/171648453 >> 172.21.15.112:0/171648453 conn(0x7fdda40b1f90 msgr2=0x7fdda40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:15.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 -- 172.21.15.112:0/171648453 shutdown_connections 2024-09-15T23:55:15.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 -- 172.21.15.112:0/171648453 wait complete. 2024-09-15T23:55:15.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 Processor -- start 2024-09-15T23:55:15.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 -- start start 2024-09-15T23:55:15.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdda40af2a0 0x7fdda4156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdda415bec0 0x7fdda414f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdda415c2a0 0x7fdda4159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdda40af6b0 con 0x7fdda40af2a0 2024-09-15T23:55:15.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdda40ad740 con 0x7fdda415c2a0 2024-09-15T23:55:15.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdda4169000 con 0x7fdda415bec0 2024-09-15T23:55:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdda3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdda40af2a0 0x7fdda4156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdda3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdda40af2a0 0x7fdda4156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41474/0 (socket says 172.21.15.112:41474) 2024-09-15T23:55:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdda3fff640 1 -- 172.21.15.112:0/3887965104 learned_addr learned my addr 172.21.15.112:0/3887965104 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdd9bfff640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdda415bec0 0x7fdda414f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdda8d70640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdda415c2a0 0x7fdda4159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdda3fff640 1 -- 172.21.15.112:0/3887965104 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdda415bec0 msgr2=0x7fdda414f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdda3fff640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdda415bec0 0x7fdda414f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdda3fff640 1 -- 172.21.15.112:0/3887965104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdda415c2a0 msgr2=0x7fdda4159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdda3fff640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdda415c2a0 0x7fdda4159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdda3fff640 1 -- 172.21.15.112:0/3887965104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda4157650 con 0x7fdda40af2a0 2024-09-15T23:55:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdda8d70640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdda415c2a0 0x7fdda4159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:15.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdda3fff640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdda40af2a0 0x7fdda4156d50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdd940ad040 tx=0x7fdd9401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdda17fa640 1 -- 172.21.15.112:0/3887965104 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd940bf610 con 0x7fdda40af2a0 2024-09-15T23:55:15.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdda17fa640 1 -- 172.21.15.112:0/3887965104 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd940bf7b0 con 0x7fdda40af2a0 2024-09-15T23:55:15.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 -- 172.21.15.112:0/3887965104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda4157930 con 0x7fdda40af2a0 2024-09-15T23:55:15.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fdda17fa640 1 -- 172.21.15.112:0/3887965104 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd940bfb60 con 0x7fdda40af2a0 2024-09-15T23:55:15.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.839+0000 7fddaa7d3640 1 -- 172.21.15.112:0/3887965104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda4157ef0 con 0x7fdda40af2a0 2024-09-15T23:55:15.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.843+0000 7fddaa7d3640 1 -- 172.21.15.112:0/3887965104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda40ad200 con 0x7fdda40af2a0 2024-09-15T23:55:15.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.843+0000 7fdda17fa640 1 -- 172.21.15.112:0/3887965104 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdd940bd020 con 0x7fdda40af2a0 2024-09-15T23:55:15.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.843+0000 7fdda17fa640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdd840678f0 0x7fdd84069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.843+0000 7fdda17fa640 1 -- 172.21.15.112:0/3887965104 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fdd94120b80 con 0x7fdda40af2a0 2024-09-15T23:55:15.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.843+0000 7fdd9bfff640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdd840678f0 0x7fdd84069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.843+0000 7fdd9bfff640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdd840678f0 0x7fdd84069db0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdda4155d40 tx=0x7fdd8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:15.847+0000 7fdda17fa640 1 -- 172.21.15.112:0/3887965104 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdd94016070 con 0x7fdda40af2a0 2024-09-15T23:55:16.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.043+0000 7fddaa7d3640 1 -- 172.21.15.112:0/3887965104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdda406fcd0 con 0x7fdda40af2a0 2024-09-15T23:55:16.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.043+0000 7fdda17fa640 1 -- 172.21.15.112:0/3887965104 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7fdd940f15f0 con 0x7fdda40af2a0 2024-09-15T23:55:16.048 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:16.048 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"btime":"2024-09-15T23:54:45:647611+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1357012609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1357012609},{"type":"v1","addr":"172.21.15.169:6835","nonce":1357012609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2931559222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2931559222},{"type":"v1","addr":"172.21.15.112:6837","nonce":2931559222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1936572340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1936572340},{"type":"v1","addr":"172.21.15.169:6833","nonce":1936572340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:54:42.951140+0000","modified":"2024-09-15T23:54:44.991346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4869":{"gid":4869,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/40913641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":40913641},{"type":"v1","addr":"172.21.15.112:6835","nonce":40913641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4869,"qdb_cluster":[4869]},"id":2}]} 2024-09-15T23:55:16.048 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-15T23:55:16.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.043+0000 7fddaa7d3640 1 -- 172.21.15.112:0/3887965104 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdd840678f0 msgr2=0x7fdd84069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.043+0000 7fddaa7d3640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdd840678f0 0x7fdd84069db0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdda4155d40 tx=0x7fdd8c008040 comp rx=0 tx=0).stop 2024-09-15T23:55:16.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.043+0000 7fddaa7d3640 1 -- 172.21.15.112:0/3887965104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdda40af2a0 msgr2=0x7fdda4156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.043+0000 7fddaa7d3640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdda40af2a0 0x7fdda4156d50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdd940ad040 tx=0x7fdd9401ac90 comp rx=0 tx=0).stop 2024-09-15T23:55:16.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.043+0000 7fddaa7d3640 1 -- 172.21.15.112:0/3887965104 shutdown_connections 2024-09-15T23:55:16.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.043+0000 7fddaa7d3640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdd840678f0 0x7fdd84069db0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.043+0000 7fddaa7d3640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdda415c2a0 0x7fdda4159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.043+0000 7fddaa7d3640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdda415bec0 0x7fdda414f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.043+0000 7fddaa7d3640 1 --2- 172.21.15.112:0/3887965104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdda40af2a0 0x7fdda4156d50 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.043+0000 7fddaa7d3640 1 -- 172.21.15.112:0/3887965104 >> 172.21.15.112:0/3887965104 conn(0x7fdda40b1f90 msgr2=0x7fdda40b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:16.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.043+0000 7fddaa7d3640 1 -- 172.21.15.112:0/3887965104 shutdown_connections 2024-09-15T23:55:16.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.043+0000 7fddaa7d3640 1 -- 172.21.15.112:0/3887965104 wait complete. 2024-09-15T23:55:16.066 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:16.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.175+0000 7f2091a60640 1 Processor -- start 2024-09-15T23:55:16.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f2091a60640 1 -- start start 2024-09-15T23:55:16.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f2091a60640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f208c15bec0 0x7f208c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f2091a60640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f208c0af470 0x7f208c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f2091a60640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f208c0b3290 con 0x7f208c15c2a0 2024-09-15T23:55:16.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f2091a60640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f208c0b3570 con 0x7f208c15bec0 2024-09-15T23:55:16.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f2091a60640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f208c0b3850 con 0x7f208c0af470 2024-09-15T23:55:16.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f208a7fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f208c15c2a0 0x7f208c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48934/0 (socket says 172.21.15.112:48934) 2024-09-15T23:55:16.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f208a7fc640 1 -- 172.21.15.112:0/1146374083 learned_addr learned my addr 172.21.15.112:0/1146374083 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:16.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f208affd640 1 --2- 172.21.15.112:0/1146374083 >> v2:172.21.15.112:3300/0 conn(0x7f208c15bec0 0x7f208c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f2089ffb640 1 -- 172.21.15.112:0/1146374083 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773733380 0 0) 0x7f208c0b3290 con 0x7f208c15c2a0 2024-09-15T23:55:16.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f2089ffb640 1 -- 172.21.15.112:0/1146374083 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2078003530 con 0x7f208c15c2a0 2024-09-15T23:55:16.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f208b7fe640 1 --2- 172.21.15.112:0/1146374083 >> v2:172.21.15.169:3300/0 conn(0x7f208c0af470 0x7f208c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f208affd640 1 -- 172.21.15.112:0/1146374083 >> v2:172.21.15.169:3300/0 conn(0x7f208c0af470 msgr2=0x7f208c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:16.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f208affd640 1 --2- 172.21.15.112:0/1146374083 >> v2:172.21.15.169:3300/0 conn(0x7f208c0af470 0x7f208c06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f208affd640 1 -- 172.21.15.112:0/1146374083 >> v1:172.21.15.112:6789/0 conn(0x7f208c15c2a0 legacy=0x7f208c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f208affd640 1 -- 172.21.15.112:0/1146374083 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208c0b3b30 con 0x7f208c15bec0 2024-09-15T23:55:16.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f208affd640 1 --2- 172.21.15.112:0/1146374083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208c15bec0 0x7f208c0ad200 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f208c0b2fb0 tx=0x7f207c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19648aca4a1619bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f2089ffb640 1 -- 172.21.15.112:0/1146374083 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c0b2070 con 0x7f208c15bec0 2024-09-15T23:55:16.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f2089ffb640 1 -- 172.21.15.112:0/1146374083 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f207c0a9070 con 0x7f208c15bec0 2024-09-15T23:55:16.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.179+0000 7f2089ffb640 1 -- 172.21.15.112:0/1146374083 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c0ad880 con 0x7f208c15bec0 2024-09-15T23:55:16.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 -- 172.21.15.112:0/1146374083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208c15bec0 msgr2=0x7f208c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 --2- 172.21.15.112:0/1146374083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208c15bec0 0x7f208c0ad200 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f208c0b2fb0 tx=0x7f207c01c450 comp rx=0 tx=0).stop 2024-09-15T23:55:16.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 -- 172.21.15.112:0/1146374083 shutdown_connections 2024-09-15T23:55:16.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 --2- 172.21.15.112:0/1146374083 >> v2:172.21.15.169:3300/0 conn(0x7f208c0af470 0x7f208c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 --2- 172.21.15.112:0/1146374083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208c15bec0 0x7f208c0ad200 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 -- 172.21.15.112:0/1146374083 >> 172.21.15.112:0/1146374083 conn(0x7f208c0b1f90 msgr2=0x7f208c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:16.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 -- 172.21.15.112:0/1146374083 shutdown_connections 2024-09-15T23:55:16.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 -- 172.21.15.112:0/1146374083 wait complete. 2024-09-15T23:55:16.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 Processor -- start 2024-09-15T23:55:16.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 -- start start 2024-09-15T23:55:16.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f208c0af470 0x7f208c0b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f208c15bec0 0x7f208c150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208c15c2a0 0x7f208c1506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f208c06ed50 con 0x7f208c15c2a0 2024-09-15T23:55:16.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f208c0ad740 con 0x7f208c0af470 2024-09-15T23:55:16.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f208c06eed0 con 0x7f208c15bec0 2024-09-15T23:55:16.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f208b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208c15c2a0 0x7f208c1506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f208b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208c15c2a0 0x7f208c1506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41490/0 (socket says 172.21.15.112:41490) 2024-09-15T23:55:16.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f208b7fe640 1 -- 172.21.15.112:0/1257664021 learned_addr learned my addr 172.21.15.112:0/1257664021 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:16.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f208affd640 1 --2- 172.21.15.112:0/1257664021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f208c0af470 0x7f208c0b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f208b7fe640 1 -- 172.21.15.112:0/1257664021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f208c15bec0 msgr2=0x7f208c150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f208b7fe640 1 --2- 172.21.15.112:0/1257664021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f208c15bec0 0x7f208c150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f208b7fe640 1 -- 172.21.15.112:0/1257664021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f208c0af470 msgr2=0x7f208c0b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f208b7fe640 1 --2- 172.21.15.112:0/1257664021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f208c0af470 0x7f208c0b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f208b7fe640 1 -- 172.21.15.112:0/1257664021 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208c14f570 con 0x7f208c15c2a0 2024-09-15T23:55:16.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f208affd640 1 --2- 172.21.15.112:0/1257664021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f208c0af470 0x7f208c0b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:16.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f208b7fe640 1 --2- 172.21.15.112:0/1257664021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208c15c2a0 0x7f208c1506c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f208400cd70 tx=0x7f208400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2083fff640 1 -- 172.21.15.112:0/1257664021 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2084003ba0 con 0x7f208c15c2a0 2024-09-15T23:55:16.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2083fff640 1 -- 172.21.15.112:0/1257664021 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2084003d40 con 0x7f208c15c2a0 2024-09-15T23:55:16.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 -- 172.21.15.112:0/1257664021 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f208c150d20 con 0x7f208c15c2a0 2024-09-15T23:55:16.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2083fff640 1 -- 172.21.15.112:0/1257664021 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2084004240 con 0x7f208c15c2a0 2024-09-15T23:55:16.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.183+0000 7f2091a60640 1 -- 172.21.15.112:0/1257664021 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f208c15db00 con 0x7f208c15c2a0 2024-09-15T23:55:16.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.187+0000 7f2091a60640 1 -- 172.21.15.112:0/1257664021 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f208c158170 con 0x7f208c15c2a0 2024-09-15T23:55:16.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.187+0000 7f2083fff640 1 -- 172.21.15.112:0/1257664021 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f20840043e0 con 0x7f208c15c2a0 2024-09-15T23:55:16.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.187+0000 7f2083fff640 1 --2- 172.21.15.112:0/1257664021 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f206c0678c0 0x7f206c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.187+0000 7f2083fff640 1 -- 172.21.15.112:0/1257664021 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f2084086cd0 con 0x7f208c15c2a0 2024-09-15T23:55:16.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.187+0000 7f208affd640 1 --2- 172.21.15.112:0/1257664021 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f206c0678c0 0x7f206c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.187+0000 7f208affd640 1 --2- 172.21.15.112:0/1257664021 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f206c0678c0 0x7f206c069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f207c0af000 tx=0x7f207c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.191+0000 7f2083fff640 1 -- 172.21.15.112:0/1257664021 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f20840577f0 con 0x7f208c15c2a0 2024-09-15T23:55:16.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.351+0000 7f2091a60640 1 -- 172.21.15.112:0/1257664021 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f208c0ad520 con 0x7f208c15c2a0 2024-09-15T23:55:16.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.355+0000 7f2083fff640 1 -- 172.21.15.112:0/1257664021 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17014 (secure 0 0 0) 0x7f20840570f0 con 0x7f208c15c2a0 2024-09-15T23:55:16.359 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:16.359 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":40,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:54:44.612925+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:54:40.796426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-15T23:54:41.944394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:16.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.355+0000 7f2091a60640 1 -- 172.21.15.112:0/1257664021 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f206c0678c0 msgr2=0x7f206c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.355+0000 7f2091a60640 1 --2- 172.21.15.112:0/1257664021 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f206c0678c0 0x7f206c069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f207c0af000 tx=0x7f207c008040 comp rx=0 tx=0).stop 2024-09-15T23:55:16.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.355+0000 7f2091a60640 1 -- 172.21.15.112:0/1257664021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208c15c2a0 msgr2=0x7f208c1506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.355+0000 7f2091a60640 1 --2- 172.21.15.112:0/1257664021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208c15c2a0 0x7f208c1506c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f208400cd70 tx=0x7f208400a660 comp rx=0 tx=0).stop 2024-09-15T23:55:16.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.355+0000 7f2091a60640 1 -- 172.21.15.112:0/1257664021 shutdown_connections 2024-09-15T23:55:16.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.355+0000 7f2091a60640 1 --2- 172.21.15.112:0/1257664021 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f206c0678c0 0x7f206c069d80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.355+0000 7f2091a60640 1 --2- 172.21.15.112:0/1257664021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f208c15c2a0 0x7f208c1506c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.355+0000 7f2091a60640 1 --2- 172.21.15.112:0/1257664021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f208c15bec0 0x7f208c150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.355+0000 7f2091a60640 1 --2- 172.21.15.112:0/1257664021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f208c0af470 0x7f208c0b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.355+0000 7f2091a60640 1 -- 172.21.15.112:0/1257664021 >> 172.21.15.112:0/1257664021 conn(0x7f208c0b1f90 msgr2=0x7f208c151f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:16.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.355+0000 7f2091a60640 1 -- 172.21.15.112:0/1257664021 shutdown_connections 2024-09-15T23:55:16.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.355+0000 7f2091a60640 1 -- 172.21.15.112:0/1257664021 wait complete. 2024-09-15T23:55:16.379 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:55:16.379 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:16.497 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.491+0000 7f1410edd640 1 Processor -- start 2024-09-15T23:55:16.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.491+0000 7f1410edd640 1 -- start start 2024-09-15T23:55:16.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.491+0000 7f1410edd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f140c0b3280 0x7f140c0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.491+0000 7f1410edd640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f140c0ce140 con 0x7f140c15d0d0 2024-09-15T23:55:16.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.491+0000 7f1410edd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f140c0ce420 con 0x7f140c0cf1e0 2024-09-15T23:55:16.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.491+0000 7f1410edd640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f140c0ce700 con 0x7f140c0b3280 2024-09-15T23:55:16.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.491+0000 7f1403fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f140c15d0d0 0x7f140c0b3660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48940/0 (socket says 172.21.15.112:48940) 2024-09-15T23:55:16.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.491+0000 7f1403fff640 1 -- 172.21.15.112:0/1261247794 learned_addr learned my addr 172.21.15.112:0/1261247794 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:16.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f140a59c640 1 --2- 172.21.15.112:0/1261247794 >> v2:172.21.15.169:3300/0 conn(0x7f140c0b3280 0x7f140c0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 -- 172.21.15.112:0/1261247794 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 695455014 0 0) 0x7f140c0ce140 con 0x7f140c15d0d0 2024-09-15T23:55:16.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 -- 172.21.15.112:0/1261247794 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13f8003530 con 0x7f140c15d0d0 2024-09-15T23:55:16.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 -- 172.21.15.112:0/1261247794 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1119472441 0 0) 0x7f13f8003530 con 0x7f140c15d0d0 2024-09-15T23:55:16.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 -- 172.21.15.112:0/1261247794 >> v2:172.21.15.169:3300/0 conn(0x7f140c0b3280 msgr2=0x7f140c0cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 --2- 172.21.15.112:0/1261247794 >> v2:172.21.15.169:3300/0 conn(0x7f140c0b3280 0x7f140c0cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 -- 172.21.15.112:0/1261247794 >> v1:172.21.15.169:6789/0 conn(0x7f140c0cf1e0 legacy=0x7f140c15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 -- 172.21.15.112:0/1261247794 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140c0ce9e0 con 0x7f140c15d0d0 2024-09-15T23:55:16.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 -- 172.21.15.112:0/1261247794 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f13f4001680 con 0x7f140c15d0d0 2024-09-15T23:55:16.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 -- 172.21.15.112:0/1261247794 >> v1:172.21.15.112:6789/0 conn(0x7f140c15d0d0 legacy=0x7f140c0b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 --2- 172.21.15.112:0/1261247794 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13f80039c0 0x7f13f8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 --2- 172.21.15.112:0/1261247794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13f8004810 0x7f13f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 --2- 172.21.15.112:0/1261247794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13f80051d0 0x7f13f800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 -- 172.21.15.112:0/1261247794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f140c0ce700 con 0x7f13f80051d0 2024-09-15T23:55:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 -- 172.21.15.112:0/1261247794 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f13f800c170 con 0x7f13f8004810 2024-09-15T23:55:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 -- 172.21.15.112:0/1261247794 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f13f800c370 con 0x7f13f80039c0 2024-09-15T23:55:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f140ad9d640 1 --2- 172.21.15.112:0/1261247794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13f80051d0 0x7f13f800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f140a59c640 1 --2- 172.21.15.112:0/1261247794 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13f80039c0 0x7f13f8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1403fff640 1 --2- 172.21.15.112:0/1261247794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13f8004810 0x7f13f8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f140ad9d640 1 -- 172.21.15.112:0/1261247794 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13f80039c0 msgr2=0x7f13f8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f140ad9d640 1 --2- 172.21.15.112:0/1261247794 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13f80039c0 0x7f13f8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f140ad9d640 1 -- 172.21.15.112:0/1261247794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13f8004810 msgr2=0x7f13f8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f140ad9d640 1 --2- 172.21.15.112:0/1261247794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13f8004810 0x7f13f8004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f140ad9d640 1 -- 172.21.15.112:0/1261247794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f8003530 con 0x7f13f80051d0 2024-09-15T23:55:16.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f140a59c640 1 --2- 172.21.15.112:0/1261247794 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13f80039c0 0x7f13f8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:16.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f140ad9d640 1 -- 172.21.15.112:0/1261247794 reap_dead start 2024-09-15T23:55:16.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f140ad9d640 1 --2- 172.21.15.112:0/1261247794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13f80051d0 0x7f13f800b9d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1404001e70 tx=0x7f140401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a706923a24bcab48 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 -- 172.21.15.112:0/1261247794 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404001a90 con 0x7f13f80051d0 2024-09-15T23:55:16.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 -- 172.21.15.112:0/1261247794 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1404003bc0 con 0x7f13f80051d0 2024-09-15T23:55:16.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1409d9b640 1 -- 172.21.15.112:0/1261247794 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404005020 con 0x7f13f80051d0 2024-09-15T23:55:16.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1410edd640 1 -- 172.21.15.112:0/1261247794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13f80051d0 msgr2=0x7f13f800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1410edd640 1 --2- 172.21.15.112:0/1261247794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13f80051d0 0x7f13f800b9d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1404001e70 tx=0x7f140401c780 comp rx=0 tx=0).stop 2024-09-15T23:55:16.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1410edd640 1 -- 172.21.15.112:0/1261247794 shutdown_connections 2024-09-15T23:55:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1410edd640 1 --2- 172.21.15.112:0/1261247794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13f80051d0 0x7f13f800b9d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1410edd640 1 -- 172.21.15.112:0/1261247794 >> 172.21.15.112:0/1261247794 conn(0x7f140c0b6870 msgr2=0x7f140c0b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1410edd640 1 -- 172.21.15.112:0/1261247794 shutdown_connections 2024-09-15T23:55:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.495+0000 7f1410edd640 1 -- 172.21.15.112:0/1261247794 wait complete. 2024-09-15T23:55:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1410edd640 1 Processor -- start 2024-09-15T23:55:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1410edd640 1 -- start start 2024-09-15T23:55:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1410edd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13f80051d0 0x7f140c0cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1410edd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f140c0b1e00 0x7f140c0b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1410edd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f140c1f1160 0x7f140c1f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1410edd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f140c159ee0 con 0x7f140c0b1e00 2024-09-15T23:55:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1410edd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f140c15d560 con 0x7f13f80051d0 2024-09-15T23:55:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1410edd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f140c15a060 con 0x7f140c1f1160 2024-09-15T23:55:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1403fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f140c0b1e00 0x7f140c0b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1403fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f140c0b1e00 0x7f140c0b2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41504/0 (socket says 172.21.15.112:41504) 2024-09-15T23:55:16.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1403fff640 1 -- 172.21.15.112:0/2618884159 learned_addr learned my addr 172.21.15.112:0/2618884159 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:16.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f140a59c640 1 --2- 172.21.15.112:0/2618884159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13f80051d0 0x7f140c0cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f140ad9d640 1 --2- 172.21.15.112:0/2618884159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f140c1f1160 0x7f140c1f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1403fff640 1 -- 172.21.15.112:0/2618884159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f140c1f1160 msgr2=0x7f140c1f15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1403fff640 1 --2- 172.21.15.112:0/2618884159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f140c1f1160 0x7f140c1f15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1403fff640 1 -- 172.21.15.112:0/2618884159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13f80051d0 msgr2=0x7f140c0cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1403fff640 1 --2- 172.21.15.112:0/2618884159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13f80051d0 0x7f140c0cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1403fff640 1 -- 172.21.15.112:0/2618884159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140c1f2a00 con 0x7f140c0b1e00 2024-09-15T23:55:16.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1403fff640 1 --2- 172.21.15.112:0/2618884159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f140c0b1e00 0x7f140c0b2280 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f13f4010b80 tx=0x7f13f400e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1402ffd640 1 -- 172.21.15.112:0/2618884159 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f401b070 con 0x7f140c0b1e00 2024-09-15T23:55:16.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1402ffd640 1 -- 172.21.15.112:0/2618884159 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f4011040 con 0x7f140c0b1e00 2024-09-15T23:55:16.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1410edd640 1 -- 172.21.15.112:0/2618884159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140c1f2cc0 con 0x7f140c0b1e00 2024-09-15T23:55:16.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1402ffd640 1 -- 172.21.15.112:0/2618884159 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f40143a0 con 0x7f140c0b1e00 2024-09-15T23:55:16.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1410edd640 1 -- 172.21.15.112:0/2618884159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f140c1f2440 con 0x7f140c0b1e00 2024-09-15T23:55:16.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.499+0000 7f1410edd640 1 -- 172.21.15.112:0/2618884159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f140c0cf650 con 0x7f140c0b1e00 2024-09-15T23:55:16.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.503+0000 7f1402ffd640 1 -- 172.21.15.112:0/2618884159 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f13f401e070 con 0x7f140c0b1e00 2024-09-15T23:55:16.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.503+0000 7f1402ffd640 1 --2- 172.21.15.112:0/2618884159 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13ec0678c0 0x7f13ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.503+0000 7f1402ffd640 1 -- 172.21.15.112:0/2618884159 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f13f40889e0 con 0x7f140c0b1e00 2024-09-15T23:55:16.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.503+0000 7f140a59c640 1 --2- 172.21.15.112:0/2618884159 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13ec0678c0 0x7f13ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.503+0000 7f140a59c640 1 --2- 172.21.15.112:0/2618884159 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13ec0678c0 0x7f13ec069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f140c0b0ce0 tx=0x7f13fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.507+0000 7f1402ffd640 1 -- 172.21.15.112:0/2618884159 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f13f4059390 con 0x7f140c0b1e00 2024-09-15T23:55:16.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.687+0000 7f1410edd640 1 -- 172.21.15.112:0/2618884159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f140c0cfce0 con 0x7f140c0b1e00 2024-09-15T23:55:16.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.691+0000 7f1402ffd640 1 -- 172.21.15.112:0/2618884159 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f13f4058c90 con 0x7f140c0b1e00 2024-09-15T23:55:16.869 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:16.869 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"btime":"2024-09-15T23:54:45:647611+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1357012609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1357012609},{"type":"v1","addr":"172.21.15.169:6835","nonce":1357012609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2931559222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2931559222},{"type":"v1","addr":"172.21.15.112:6837","nonce":2931559222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1936572340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1936572340},{"type":"v1","addr":"172.21.15.169:6833","nonce":1936572340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:54:42.951140+0000","modified":"2024-09-15T23:54:44.991346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4869":{"gid":4869,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/40913641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":40913641},{"type":"v1","addr":"172.21.15.112:6835","nonce":40913641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4869,"qdb_cluster":[4869]},"id":2}]} 2024-09-15T23:55:16.871 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-15T23:55:16.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.691+0000 7f1410edd640 1 -- 172.21.15.112:0/2618884159 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13ec0678c0 msgr2=0x7f13ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.691+0000 7f1410edd640 1 --2- 172.21.15.112:0/2618884159 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13ec0678c0 0x7f13ec069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f140c0b0ce0 tx=0x7f13fc008040 comp rx=0 tx=0).stop 2024-09-15T23:55:16.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.691+0000 7f1410edd640 1 -- 172.21.15.112:0/2618884159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f140c0b1e00 msgr2=0x7f140c0b2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.691+0000 7f1410edd640 1 --2- 172.21.15.112:0/2618884159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f140c0b1e00 0x7f140c0b2280 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f13f4010b80 tx=0x7f13f400e4d0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.691+0000 7f1410edd640 1 -- 172.21.15.112:0/2618884159 shutdown_connections 2024-09-15T23:55:16.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.691+0000 7f1410edd640 1 --2- 172.21.15.112:0/2618884159 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13ec0678c0 0x7f13ec069d80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.691+0000 7f1410edd640 1 --2- 172.21.15.112:0/2618884159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f140c1f1160 0x7f140c1f15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.691+0000 7f1410edd640 1 --2- 172.21.15.112:0/2618884159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f140c0b1e00 0x7f140c0b2280 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.691+0000 7f1410edd640 1 --2- 172.21.15.112:0/2618884159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13f80051d0 0x7f140c0cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.691+0000 7f1410edd640 1 -- 172.21.15.112:0/2618884159 >> 172.21.15.112:0/2618884159 conn(0x7f140c0b6870 msgr2=0x7f140c159220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:16.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.691+0000 7f1410edd640 1 -- 172.21.15.112:0/2618884159 shutdown_connections 2024-09-15T23:55:16.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.691+0000 7f1410edd640 1 -- 172.21.15.112:0/2618884159 wait complete. 2024-09-15T23:55:16.873 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:16.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.991+0000 7f8c51de6640 1 Processor -- start 2024-09-15T23:55:16.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.991+0000 7f8c51de6640 1 -- start start 2024-09-15T23:55:16.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.995+0000 7f8c51de6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8c4c1520a0 0x7f8c4c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.995+0000 7f8c51de6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8c4c06fe50 0x7f8c4c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.995+0000 7f8c51de6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c4c070250 con 0x7f8c4c15f1d0 2024-09-15T23:55:17.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.995+0000 7f8c51de6640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8c4c152480 con 0x7f8c4c06fe50 2024-09-15T23:55:17.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.995+0000 7f8c51de6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8c4c0aede0 con 0x7f8c4c1520a0 2024-09-15T23:55:17.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.995+0000 7f8c4affd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8c4c06fe50 0x7f8c4c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.995+0000 7f8c4affd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8c4c06fe50 0x7f8c4c15ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41506/0 (socket says 172.21.15.112:41506) 2024-09-15T23:55:17.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.995+0000 7f8c4affd640 1 -- 172.21.15.112:0/2515479076 learned_addr learned my addr 172.21.15.112:0/2515479076 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:17.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.995+0000 7f8c4b7fe640 1 --2- 172.21.15.112:0/2515479076 >> v2:172.21.15.169:3300/0 conn(0x7f8c4c1520a0 0x7f8c4c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.995+0000 7f8c4affd640 1 -- 172.21.15.112:0/2515479076 >> v2:172.21.15.169:3300/0 conn(0x7f8c4c1520a0 msgr2=0x7f8c4c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:17.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.995+0000 7f8c4affd640 1 --2- 172.21.15.112:0/2515479076 >> v2:172.21.15.169:3300/0 conn(0x7f8c4c1520a0 0x7f8c4c06f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.995+0000 7f8c4affd640 1 -- 172.21.15.112:0/2515479076 >> v1:172.21.15.169:6789/0 conn(0x7f8c4c15f1d0 legacy=0x7f8c4c071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.995+0000 7f8c4affd640 1 -- 172.21.15.112:0/2515479076 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4c15fa10 con 0x7f8c4c06fe50 2024-09-15T23:55:17.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c4affd640 1 --2- 172.21.15.112:0/2515479076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c4c06fe50 0x7f8c4c15ec90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c071710 tx=0x7f8c4001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f4914fe10ea8b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c4a7fc640 1 -- 172.21.15.112:0/2515479076 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c400ab620 con 0x7f8c4c06fe50 2024-09-15T23:55:17.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c4a7fc640 1 -- 172.21.15.112:0/2515479076 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c400b0070 con 0x7f8c4c06fe50 2024-09-15T23:55:17.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c4a7fc640 1 -- 172.21.15.112:0/2515479076 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c400ab9e0 con 0x7f8c4c06fe50 2024-09-15T23:55:17.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 -- 172.21.15.112:0/2515479076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c4c06fe50 msgr2=0x7f8c4c15ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 --2- 172.21.15.112:0/2515479076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c4c06fe50 0x7f8c4c15ec90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c071710 tx=0x7f8c4001c500 comp rx=0 tx=0).stop 2024-09-15T23:55:17.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 -- 172.21.15.112:0/2515479076 shutdown_connections 2024-09-15T23:55:17.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 --2- 172.21.15.112:0/2515479076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c4c06fe50 0x7f8c4c15ec90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 --2- 172.21.15.112:0/2515479076 >> v2:172.21.15.169:3300/0 conn(0x7f8c4c1520a0 0x7f8c4c06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 -- 172.21.15.112:0/2515479076 >> 172.21.15.112:0/2515479076 conn(0x7f8c4c0b1f90 msgr2=0x7f8c4c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 -- 172.21.15.112:0/2515479076 shutdown_connections 2024-09-15T23:55:17.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 -- 172.21.15.112:0/2515479076 wait complete. 2024-09-15T23:55:17.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 Processor -- start 2024-09-15T23:55:17.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 -- start start 2024-09-15T23:55:17.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c4c06fe50 0x7f8c4c143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c4c1520a0 0x7f8c4c1543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c4c15f1d0 0x7f8c4c14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c073d30 con 0x7f8c4c06fe50 2024-09-15T23:55:17.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c073a50 con 0x7f8c4c1520a0 2024-09-15T23:55:17.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c51de6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4c15f5e0 con 0x7f8c4c15f1d0 2024-09-15T23:55:17.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c4b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c4c06fe50 0x7f8c4c143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c4b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c4c06fe50 0x7f8c4c143660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41512/0 (socket says 172.21.15.112:41512) 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:16.999+0000 7f8c4b7fe640 1 -- 172.21.15.112:0/2495832436 learned_addr learned my addr 172.21.15.112:0/2495832436 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c4bfff640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c4c15f1d0 0x7f8c4c14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c4affd640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c4c1520a0 0x7f8c4c1543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c4b7fe640 1 -- 172.21.15.112:0/2495832436 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c4c15f1d0 msgr2=0x7f8c4c14fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c4b7fe640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c4c15f1d0 0x7f8c4c14fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c4b7fe640 1 -- 172.21.15.112:0/2495832436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c4c1520a0 msgr2=0x7f8c4c1543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c4b7fe640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c4c1520a0 0x7f8c4c1543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c4b7fe640 1 -- 172.21.15.112:0/2495832436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4c0cfc30 con 0x7f8c4c06fe50 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c4bfff640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c4c15f1d0 0x7f8c4c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c4b7fe640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c4c06fe50 0x7f8c4c143660 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00d800 tx=0x7f8c3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c33fff640 1 -- 172.21.15.112:0/2495832436 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c00b6c0 con 0x7f8c4c06fe50 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c33fff640 1 -- 172.21.15.112:0/2495832436 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c3c019070 con 0x7f8c4c06fe50 2024-09-15T23:55:17.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c51de6640 1 -- 172.21.15.112:0/2495832436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4c0cff10 con 0x7f8c4c06fe50 2024-09-15T23:55:17.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c33fff640 1 -- 172.21.15.112:0/2495832436 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c00bae0 con 0x7f8c4c06fe50 2024-09-15T23:55:17.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c51de6640 1 -- 172.21.15.112:0/2495832436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c4c152990 con 0x7f8c4c06fe50 2024-09-15T23:55:17.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c51de6640 1 -- 172.21.15.112:0/2495832436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c4c15ec90 con 0x7f8c4c06fe50 2024-09-15T23:55:17.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c33fff640 1 -- 172.21.15.112:0/2495832436 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c3c00bc80 con 0x7f8c4c06fe50 2024-09-15T23:55:17.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c33fff640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c380678f0 0x7f8c38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c33fff640 1 -- 172.21.15.112:0/2495832436 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f8c3c086310 con 0x7f8c4c06fe50 2024-09-15T23:55:17.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c4affd640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c380678f0 0x7f8c38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.003+0000 7f8c4affd640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c380678f0 0x7f8c38069db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c400af000 tx=0x7f8c40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.007+0000 7f8c33fff640 1 -- 172.21.15.112:0/2495832436 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8c3c056cc0 con 0x7f8c4c06fe50 2024-09-15T23:55:17.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.207+0000 7f8c51de6640 1 -- 172.21.15.112:0/2495832436 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c4c0af540 con 0x7f8c4c06fe50 2024-09-15T23:55:17.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.207+0000 7f8c33fff640 1 -- 172.21.15.112:0/2495832436 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f8c3c0565c0 con 0x7f8c4c06fe50 2024-09-15T23:55:17.212 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:17.212 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":15,"btime":"2024-09-15T23:54:45:647611+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1357012609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1357012609},{"type":"v1","addr":"172.21.15.169:6835","nonce":1357012609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2931559222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2931559222},{"type":"v1","addr":"172.21.15.112:6837","nonce":2931559222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1936572340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1936572340},{"type":"v1","addr":"172.21.15.169:6833","nonce":1936572340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:54:42.951140+0000","modified":"2024-09-15T23:54:44.991346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4869},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4869":{"gid":4869,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6835/40913641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":40913641},{"type":"v1","addr":"172.21.15.112:6835","nonce":40913641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4869,"qdb_cluster":[4869]},"id":2}]} 2024-09-15T23:55:17.212 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 15 2024-09-15T23:55:17.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.207+0000 7f8c51de6640 1 -- 172.21.15.112:0/2495832436 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c380678f0 msgr2=0x7f8c38069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.207+0000 7f8c51de6640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c380678f0 0x7f8c38069db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c400af000 tx=0x7f8c40008040 comp rx=0 tx=0).stop 2024-09-15T23:55:17.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.207+0000 7f8c51de6640 1 -- 172.21.15.112:0/2495832436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c4c06fe50 msgr2=0x7f8c4c143660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.207+0000 7f8c51de6640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c4c06fe50 0x7f8c4c143660 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00d800 tx=0x7f8c3c00dcc0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.207+0000 7f8c51de6640 1 -- 172.21.15.112:0/2495832436 shutdown_connections 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.207+0000 7f8c51de6640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c380678f0 0x7f8c38069db0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.207+0000 7f8c51de6640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c4c15f1d0 0x7f8c4c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.207+0000 7f8c51de6640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c4c1520a0 0x7f8c4c1543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.207+0000 7f8c51de6640 1 --2- 172.21.15.112:0/2495832436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c4c06fe50 0x7f8c4c143660 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.207+0000 7f8c51de6640 1 -- 172.21.15.112:0/2495832436 >> 172.21.15.112:0/2495832436 conn(0x7f8c4c0b1f90 msgr2=0x7f8c4c151660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.211+0000 7f8c51de6640 1 -- 172.21.15.112:0/2495832436 shutdown_connections 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.211+0000 7f8c51de6640 1 -- 172.21.15.112:0/2495832436 wait complete. 2024-09-15T23:55:17.231 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:17.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f4177640 1 Processor -- start 2024-09-15T23:55:17.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f4177640 1 -- start start 2024-09-15T23:55:17.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f4177640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f26ec161a60 0x7f26ec0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f4177640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26ec0d32b0 con 0x7f26ec0d2e90 2024-09-15T23:55:17.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f4177640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26ec0d0300 con 0x7f26ec0cf620 2024-09-15T23:55:17.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f4177640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f26ec0cfa90 con 0x7f26ec161a60 2024-09-15T23:55:17.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f1712640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f26ec0d2e90 0x7f26ec0cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48944/0 (socket says 172.21.15.112:48944) 2024-09-15T23:55:17.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f1712640 1 -- 172.21.15.112:0/1372429268 learned_addr learned my addr 172.21.15.112:0/1372429268 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:17.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 -- 172.21.15.112:0/1372429268 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 39286176 0 0) 0x7f26ec0d32b0 con 0x7f26ec0d2e90 2024-09-15T23:55:17.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f1f13640 1 --2- 172.21.15.112:0/1372429268 >> v2:172.21.15.169:3300/0 conn(0x7f26ec161a60 0x7f26ec0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 -- 172.21.15.112:0/1372429268 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26d8003530 con 0x7f26ec0d2e90 2024-09-15T23:55:17.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 -- 172.21.15.112:0/1372429268 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 240546692 0 0) 0x7f26d8003530 con 0x7f26ec0d2e90 2024-09-15T23:55:17.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 -- 172.21.15.112:0/1372429268 >> v2:172.21.15.169:3300/0 conn(0x7f26ec161a60 msgr2=0x7f26ec0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:17.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 --2- 172.21.15.112:0/1372429268 >> v2:172.21.15.169:3300/0 conn(0x7f26ec161a60 0x7f26ec0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 -- 172.21.15.112:0/1372429268 >> v1:172.21.15.169:6789/0 conn(0x7f26ec0cf620 legacy=0x7f26ec06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 -- 172.21.15.112:0/1372429268 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ec0b0f60 con 0x7f26ec0d2e90 2024-09-15T23:55:17.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 -- 172.21.15.112:0/1372429268 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f26dc001680 con 0x7f26ec0d2e90 2024-09-15T23:55:17.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 -- 172.21.15.112:0/1372429268 >> v1:172.21.15.112:6789/0 conn(0x7f26ec0d2e90 legacy=0x7f26ec0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 --2- 172.21.15.112:0/1372429268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26d80039c0 0x7f26d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 --2- 172.21.15.112:0/1372429268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26d8004810 0x7f26d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 --2- 172.21.15.112:0/1372429268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26d80052f0 0x7f26d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 -- 172.21.15.112:0/1372429268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec0cfa90 con 0x7f26d80039c0 2024-09-15T23:55:17.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 -- 172.21.15.112:0/1372429268 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26d800c1c0 con 0x7f26d8004810 2024-09-15T23:55:17.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f0f11640 1 -- 172.21.15.112:0/1372429268 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f26d800c3c0 con 0x7f26d80052f0 2024-09-15T23:55:17.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f1f13640 1 --2- 172.21.15.112:0/1372429268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26d80039c0 0x7f26d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f1712640 1 --2- 172.21.15.112:0/1372429268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26d8004810 0x7f26d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f1f13640 1 -- 172.21.15.112:0/1372429268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26d80052f0 msgr2=0x7f26d800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:17.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f1f13640 1 --2- 172.21.15.112:0/1372429268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26d80052f0 0x7f26d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f1f13640 1 -- 172.21.15.112:0/1372429268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26d8004810 msgr2=0x7f26d8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:17.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f1f13640 1 --2- 172.21.15.112:0/1372429268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26d8004810 0x7f26d8004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f1f13640 1 -- 172.21.15.112:0/1372429268 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d8003530 con 0x7f26d80039c0 2024-09-15T23:55:17.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.343+0000 7f26f2714640 1 -- 172.21.15.112:0/1372429268 reap_dead start 2024-09-15T23:55:17.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f1f13640 1 --2- 172.21.15.112:0/1372429268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26d80039c0 0x7f26d8003de0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f26e800b9e0 tx=0x7f26e801c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80cf0bc52ee1859d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f0f11640 1 -- 172.21.15.112:0/1372429268 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e80b2070 con 0x7f26d80039c0 2024-09-15T23:55:17.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f0f11640 1 -- 172.21.15.112:0/1372429268 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e80ad630 con 0x7f26d80039c0 2024-09-15T23:55:17.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f0f11640 1 -- 172.21.15.112:0/1372429268 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e800b5e0 con 0x7f26d80039c0 2024-09-15T23:55:17.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 -- 172.21.15.112:0/1372429268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26d80039c0 msgr2=0x7f26d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 --2- 172.21.15.112:0/1372429268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26d80039c0 0x7f26d8003de0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f26e800b9e0 tx=0x7f26e801c630 comp rx=0 tx=0).stop 2024-09-15T23:55:17.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 -- 172.21.15.112:0/1372429268 shutdown_connections 2024-09-15T23:55:17.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 --2- 172.21.15.112:0/1372429268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26d80039c0 0x7f26d8003de0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 -- 172.21.15.112:0/1372429268 >> 172.21.15.112:0/1372429268 conn(0x7f26ec08bf90 msgr2=0x7f26ec09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 -- 172.21.15.112:0/1372429268 shutdown_connections 2024-09-15T23:55:17.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 -- 172.21.15.112:0/1372429268 wait complete. 2024-09-15T23:55:17.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 Processor -- start 2024-09-15T23:55:17.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 -- start start 2024-09-15T23:55:17.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26d80039c0 0x7f26ec0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26ec0cbc20 0x7f26ec0b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ec0b48d0 0x7f26ec14f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec0cf320 con 0x7f26d80039c0 2024-09-15T23:55:17.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec06d190 con 0x7f26ec0b48d0 2024-09-15T23:55:17.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f4177640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f26ec0cf4a0 con 0x7f26ec0cbc20 2024-09-15T23:55:17.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f1f13640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26d80039c0 0x7f26ec0cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f1f13640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26d80039c0 0x7f26ec0cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41534/0 (socket says 172.21.15.112:41534) 2024-09-15T23:55:17.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.347+0000 7f26f1f13640 1 -- 172.21.15.112:0/1414244888 learned_addr learned my addr 172.21.15.112:0/1414244888 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:17.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26f1f13640 1 -- 172.21.15.112:0/1414244888 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26ec0cbc20 msgr2=0x7f26ec0b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26f1f13640 1 --2- 172.21.15.112:0/1414244888 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26ec0cbc20 0x7f26ec0b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26f1f13640 1 -- 172.21.15.112:0/1414244888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ec0b48d0 msgr2=0x7f26ec14f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26f1f13640 1 --2- 172.21.15.112:0/1414244888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ec0b48d0 0x7f26ec14f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26f1f13640 1 -- 172.21.15.112:0/1414244888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ec0cc1a0 con 0x7f26d80039c0 2024-09-15T23:55:17.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26f1f13640 1 --2- 172.21.15.112:0/1414244888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26d80039c0 0x7f26ec0cb6e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f26e801c460 tx=0x7f26d8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26e27fc640 1 -- 172.21.15.112:0/1414244888 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e80b2040 con 0x7f26d80039c0 2024-09-15T23:55:17.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26e27fc640 1 -- 172.21.15.112:0/1414244888 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e80b7460 con 0x7f26d80039c0 2024-09-15T23:55:17.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26f4177640 1 -- 172.21.15.112:0/1414244888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ec0c9f30 con 0x7f26d80039c0 2024-09-15T23:55:17.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26e27fc640 1 -- 172.21.15.112:0/1414244888 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e80b7850 con 0x7f26d80039c0 2024-09-15T23:55:17.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26f4177640 1 -- 172.21.15.112:0/1414244888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ec0ca4f0 con 0x7f26d80039c0 2024-09-15T23:55:17.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26f4177640 1 -- 172.21.15.112:0/1414244888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26ec0b4d20 con 0x7f26d80039c0 2024-09-15T23:55:17.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26e27fc640 1 -- 172.21.15.112:0/1414244888 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f26e80b5070 con 0x7f26d80039c0 2024-09-15T23:55:17.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26e27fc640 1 --2- 172.21.15.112:0/1414244888 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26d00678f0 0x7f26d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26e27fc640 1 -- 172.21.15.112:0/1414244888 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f26e8120810 con 0x7f26d80039c0 2024-09-15T23:55:17.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26f1712640 1 --2- 172.21.15.112:0/1414244888 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26d00678f0 0x7f26d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.351+0000 7f26f1712640 1 --2- 172.21.15.112:0/1414244888 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26d00678f0 0x7f26d0069db0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0b4f50 tx=0x7f26dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.355+0000 7f26e27fc640 1 -- 172.21.15.112:0/1414244888 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f26e80bc020 con 0x7f26d80039c0 2024-09-15T23:55:17.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.507+0000 7f26f4177640 1 -- 172.21.15.112:0/1414244888 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26ec15fca0 con 0x7f26d80039c0 2024-09-15T23:55:17.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.507+0000 7f26e27fc640 1 -- 172.21.15.112:0/1414244888 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17014 (secure 0 0 0) 0x7f26e8016370 con 0x7f26d80039c0 2024-09-15T23:55:17.515 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:17.515 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":40,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:54:44.612925+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:54:40.796426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-15T23:54:41.944394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:17.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.511+0000 7f26f4177640 1 -- 172.21.15.112:0/1414244888 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26d00678f0 msgr2=0x7f26d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.511+0000 7f26f4177640 1 --2- 172.21.15.112:0/1414244888 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26d00678f0 0x7f26d0069db0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0b4f50 tx=0x7f26dc009040 comp rx=0 tx=0).stop 2024-09-15T23:55:17.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.511+0000 7f26f4177640 1 -- 172.21.15.112:0/1414244888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26d80039c0 msgr2=0x7f26ec0cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.511+0000 7f26f4177640 1 --2- 172.21.15.112:0/1414244888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26d80039c0 0x7f26ec0cb6e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f26e801c460 tx=0x7f26d8005840 comp rx=0 tx=0).stop 2024-09-15T23:55:17.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.511+0000 7f26f4177640 1 -- 172.21.15.112:0/1414244888 shutdown_connections 2024-09-15T23:55:17.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.511+0000 7f26f4177640 1 --2- 172.21.15.112:0/1414244888 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26d00678f0 0x7f26d0069db0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.511+0000 7f26f4177640 1 --2- 172.21.15.112:0/1414244888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ec0b48d0 0x7f26ec14f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.511+0000 7f26f4177640 1 --2- 172.21.15.112:0/1414244888 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26ec0cbc20 0x7f26ec0b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.511+0000 7f26f4177640 1 --2- 172.21.15.112:0/1414244888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26d80039c0 0x7f26ec0cb6e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.511+0000 7f26f4177640 1 -- 172.21.15.112:0/1414244888 >> 172.21.15.112:0/1414244888 conn(0x7f26ec08bf90 msgr2=0x7f26ec15e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.511+0000 7f26f4177640 1 -- 172.21.15.112:0/1414244888 shutdown_connections 2024-09-15T23:55:17.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.511+0000 7f26f4177640 1 -- 172.21.15.112:0/1414244888 wait complete. 2024-09-15T23:55:17.532 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:55:17.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.647+0000 7f4325158640 1 Processor -- start 2024-09-15T23:55:17.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.647+0000 7f4325158640 1 -- start start 2024-09-15T23:55:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.647+0000 7f4325158640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f432006f010 0x7f4320166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.647+0000 7f4325158640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43200b3290 con 0x7f432015c2a0 2024-09-15T23:55:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.647+0000 7f4325158640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43200b3570 con 0x7f432015bec0 2024-09-15T23:55:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.647+0000 7f4325158640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f43200b3850 con 0x7f432006f010 2024-09-15T23:55:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.647+0000 7f431659c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f432015c2a0 0x7f43200aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48958/0 (socket says 172.21.15.112:48958) 2024-09-15T23:55:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.647+0000 7f431659c640 1 -- 172.21.15.112:0/2639481708 learned_addr learned my addr 172.21.15.112:0/2639481708 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.647+0000 7f431e59c640 1 -- 172.21.15.112:0/2639481708 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8303725 0 0) 0x7f43200b3290 con 0x7f432015c2a0 2024-09-15T23:55:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.647+0000 7f431f59e640 1 --2- 172.21.15.112:0/2639481708 >> v2:172.21.15.169:3300/0 conn(0x7f432006f010 0x7f4320166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.647+0000 7f431e59c640 1 -- 172.21.15.112:0/2639481708 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f430c003530 con 0x7f432015c2a0 2024-09-15T23:55:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.647+0000 7f431e59c640 1 -- 172.21.15.112:0/2639481708 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4220056069 0 0) 0x7f430c003530 con 0x7f432015c2a0 2024-09-15T23:55:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 -- 172.21.15.112:0/2639481708 >> v2:172.21.15.169:3300/0 conn(0x7f432006f010 msgr2=0x7f4320166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 --2- 172.21.15.112:0/2639481708 >> v2:172.21.15.169:3300/0 conn(0x7f432006f010 0x7f4320166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 -- 172.21.15.112:0/2639481708 >> v1:172.21.15.169:6789/0 conn(0x7f432015bec0 legacy=0x7f43200ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 -- 172.21.15.112:0/2639481708 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43200b3b30 con 0x7f432015c2a0 2024-09-15T23:55:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 -- 172.21.15.112:0/2639481708 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f4308001680 con 0x7f432015c2a0 2024-09-15T23:55:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 -- 172.21.15.112:0/2639481708 >> v1:172.21.15.112:6789/0 conn(0x7f432015c2a0 legacy=0x7f43200aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 --2- 172.21.15.112:0/2639481708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f430c0039c0 0x7f430c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 --2- 172.21.15.112:0/2639481708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c004810 0x7f430c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 --2- 172.21.15.112:0/2639481708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c0051d0 0x7f430c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 -- 172.21.15.112:0/2639481708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f43200b3850 con 0x7f430c0051d0 2024-09-15T23:55:17.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 -- 172.21.15.112:0/2639481708 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f430c00c070 con 0x7f430c0039c0 2024-09-15T23:55:17.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 -- 172.21.15.112:0/2639481708 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f430c00c270 con 0x7f430c004810 2024-09-15T23:55:17.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431f59e640 1 --2- 172.21.15.112:0/2639481708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c0051d0 0x7f430c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431ed9d640 1 --2- 172.21.15.112:0/2639481708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f430c0039c0 0x7f430c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.659 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431f59e640 1 -- 172.21.15.112:0/2639481708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c004810 msgr2=0x7f430c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:17.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431659c640 1 --2- 172.21.15.112:0/2639481708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c004810 0x7f430c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431f59e640 1 --2- 172.21.15.112:0/2639481708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c004810 0x7f430c004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431f59e640 1 -- 172.21.15.112:0/2639481708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f430c0039c0 msgr2=0x7f430c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:17.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431f59e640 1 --2- 172.21.15.112:0/2639481708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f430c0039c0 0x7f430c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431f59e640 1 -- 172.21.15.112:0/2639481708 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430c003530 con 0x7f430c0051d0 2024-09-15T23:55:17.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431f59e640 1 -- 172.21.15.112:0/2639481708 reap_dead start 2024-09-15T23:55:17.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431f59e640 1 --2- 172.21.15.112:0/2639481708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c0051d0 0x7f430c00b9d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4318009f70 tx=0x7f431801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a0f178681780a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 -- 172.21.15.112:0/2639481708 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43180b2070 con 0x7f430c0051d0 2024-09-15T23:55:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 -- 172.21.15.112:0/2639481708 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43180a5d30 con 0x7f430c0051d0 2024-09-15T23:55:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f431e59c640 1 -- 172.21.15.112:0/2639481708 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318009bf0 con 0x7f430c0051d0 2024-09-15T23:55:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f4325158640 1 -- 172.21.15.112:0/2639481708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c0051d0 msgr2=0x7f430c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f4325158640 1 --2- 172.21.15.112:0/2639481708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c0051d0 0x7f430c00b9d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4318009f70 tx=0x7f431801cc60 comp rx=0 tx=0).stop 2024-09-15T23:55:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f4325158640 1 -- 172.21.15.112:0/2639481708 shutdown_connections 2024-09-15T23:55:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f4325158640 1 --2- 172.21.15.112:0/2639481708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c0051d0 0x7f430c00b9d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f4325158640 1 -- 172.21.15.112:0/2639481708 >> 172.21.15.112:0/2639481708 conn(0x7f43200b1f90 msgr2=0x7f43200b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f4325158640 1 -- 172.21.15.112:0/2639481708 shutdown_connections 2024-09-15T23:55:17.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.651+0000 7f4325158640 1 -- 172.21.15.112:0/2639481708 wait complete. 2024-09-15T23:55:17.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f4325158640 1 Processor -- start 2024-09-15T23:55:17.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f4325158640 1 -- start start 2024-09-15T23:55:17.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f4325158640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c0051d0 0x7f43201e5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f4325158640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43200734f0 0x7f43201e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f4325158640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43201574e0 0x7f43201e7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f4325158640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f43200afc90 con 0x7f43200734f0 2024-09-15T23:55:17.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f4325158640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43200b40f0 con 0x7f43201574e0 2024-09-15T23:55:17.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f4325158640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f43200ad200 con 0x7f430c0051d0 2024-09-15T23:55:17.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f431659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43200734f0 0x7f43201e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f431659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43200734f0 0x7f43201e6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41552/0 (socket says 172.21.15.112:41552) 2024-09-15T23:55:17.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f431659c640 1 -- 172.21.15.112:0/1863166866 learned_addr learned my addr 172.21.15.112:0/1863166866 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:17.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f431f59e640 1 --2- 172.21.15.112:0/1863166866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43201574e0 0x7f43201e7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f431ed9d640 1 --2- 172.21.15.112:0/1863166866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c0051d0 0x7f43201e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f431659c640 1 -- 172.21.15.112:0/1863166866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c0051d0 msgr2=0x7f43201e5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f431659c640 1 --2- 172.21.15.112:0/1863166866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c0051d0 0x7f43201e5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f431659c640 1 -- 172.21.15.112:0/1863166866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43201574e0 msgr2=0x7f43201e7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f431659c640 1 --2- 172.21.15.112:0/1863166866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43201574e0 0x7f43201e7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f431659c640 1 -- 172.21.15.112:0/1863166866 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43201e7500 con 0x7f43200734f0 2024-09-15T23:55:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f431659c640 1 --2- 172.21.15.112:0/1863166866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43200734f0 0x7f43201e6fc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f430800d7d0 tx=0x7f430800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f4317fff640 1 -- 172.21.15.112:0/1863166866 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308019070 con 0x7f43200734f0 2024-09-15T23:55:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f4317fff640 1 -- 172.21.15.112:0/1863166866 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43080074e0 con 0x7f43200734f0 2024-09-15T23:55:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f4317fff640 1 -- 172.21.15.112:0/1863166866 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308004a10 con 0x7f43200734f0 2024-09-15T23:55:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f4325158640 1 -- 172.21.15.112:0/1863166866 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43201e5f20 con 0x7f43200734f0 2024-09-15T23:55:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f4325158640 1 -- 172.21.15.112:0/1863166866 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43201e64e0 con 0x7f43200734f0 2024-09-15T23:55:17.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.655+0000 7f4325158640 1 -- 172.21.15.112:0/1863166866 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43200ad590 con 0x7f43200734f0 2024-09-15T23:55:17.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.659+0000 7f4317fff640 1 -- 172.21.15.112:0/1863166866 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4308004bb0 con 0x7f43200734f0 2024-09-15T23:55:17.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.659+0000 7f4317fff640 1 --2- 172.21.15.112:0/1863166866 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f43000678f0 0x7f4300069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.659+0000 7f4317fff640 1 -- 172.21.15.112:0/1863166866 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f43080857c0 con 0x7f43200734f0 2024-09-15T23:55:17.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.659+0000 7f431ed9d640 1 --2- 172.21.15.112:0/1863166866 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f43000678f0 0x7f4300069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.659+0000 7f431ed9d640 1 --2- 172.21.15.112:0/1863166866 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f43000678f0 0x7f4300069db0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4310000c10 tx=0x7f4310009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.663+0000 7f4317fff640 1 -- 172.21.15.112:0/1863166866 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f43080560e0 con 0x7f43200734f0 2024-09-15T23:55:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.859+0000 7f4325158640 1 -- 172.21.15.112:0/1863166866 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f43200b1750 con 0x7f43200734f0 2024-09-15T23:55:17.865 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-15T23:55:17.859+0000 7fae14e39640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:55:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.863+0000 7f4317fff640 1 -- 172.21.15.112:0/1863166866 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7f43080559e0 con 0x7f43200734f0 2024-09-15T23:55:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:55:17.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.867+0000 7f4325158640 1 -- 172.21.15.112:0/1863166866 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f43000678f0 msgr2=0x7f4300069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.867+0000 7f4325158640 1 --2- 172.21.15.112:0/1863166866 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f43000678f0 0x7f4300069db0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4310000c10 tx=0x7f4310009040 comp rx=0 tx=0).stop 2024-09-15T23:55:17.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.867+0000 7f4325158640 1 -- 172.21.15.112:0/1863166866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43200734f0 msgr2=0x7f43201e6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.867+0000 7f4325158640 1 --2- 172.21.15.112:0/1863166866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43200734f0 0x7f43201e6fc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f430800d7d0 tx=0x7f430800dc90 comp rx=0 tx=0).stop 2024-09-15T23:55:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.867+0000 7f4325158640 1 -- 172.21.15.112:0/1863166866 shutdown_connections 2024-09-15T23:55:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.867+0000 7f4325158640 1 --2- 172.21.15.112:0/1863166866 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f43000678f0 0x7f4300069db0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.867+0000 7f4325158640 1 --2- 172.21.15.112:0/1863166866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43201574e0 0x7f43201e7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.867+0000 7f4325158640 1 --2- 172.21.15.112:0/1863166866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43200734f0 0x7f43201e6fc0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.867+0000 7f4325158640 1 --2- 172.21.15.112:0/1863166866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c0051d0 0x7f43201e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.867+0000 7f4325158640 1 -- 172.21.15.112:0/1863166866 >> 172.21.15.112:0/1863166866 conn(0x7f43200b1f90 msgr2=0x7f432015a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.867+0000 7f4325158640 1 -- 172.21.15.112:0/1863166866 shutdown_connections 2024-09-15T23:55:17.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.867+0000 7f4325158640 1 -- 172.21.15.112:0/1863166866 wait complete. 2024-09-15T23:55:17.891 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:55:17.910 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-15T23:55:18.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.999+0000 7fe8cb7a8640 1 Processor -- start 2024-09-15T23:55:18.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.999+0000 7fe8cb7a8640 1 -- start start 2024-09-15T23:55:18.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.999+0000 7fe8cb7a8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8c415bec0 0x7fe8c40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.999+0000 7fe8cb7a8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe8c415c2a0 0x7fe8c40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.999+0000 7fe8cb7a8640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c40b3290 con 0x7fe8c40af2a0 2024-09-15T23:55:18.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.999+0000 7fe8cb7a8640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c40b3570 con 0x7fe8c415c2a0 2024-09-15T23:55:18.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.999+0000 7fe8cb7a8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c40b3850 con 0x7fe8c415bec0 2024-09-15T23:55:18.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.999+0000 7fe8c8d43640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe8c415c2a0 0x7fe8c40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.999+0000 7fe8c9d45640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe8c40af2a0 0x7fe8c415fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48974/0 (socket says 172.21.15.112:48974) 2024-09-15T23:55:18.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:17.999+0000 7fe8c9d45640 1 -- 172.21.15.112:0/1049038600 learned_addr learned my addr 172.21.15.112:0/1049038600 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:18.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8c9544640 1 --2- 172.21.15.112:0/1049038600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8c415bec0 0x7fe8c40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8c8d43640 1 -- 172.21.15.112:0/1049038600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8c415bec0 msgr2=0x7fe8c40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:18.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8c8d43640 1 --2- 172.21.15.112:0/1049038600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8c415bec0 0x7fe8c40ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8bbfff640 1 -- 172.21.15.112:0/1049038600 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1957672495 0 0) 0x7fe8c40b3290 con 0x7fe8c40af2a0 2024-09-15T23:55:18.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8c8d43640 1 -- 172.21.15.112:0/1049038600 >> v1:172.21.15.112:6789/0 conn(0x7fe8c40af2a0 legacy=0x7fe8c415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8c8d43640 1 -- 172.21.15.112:0/1049038600 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c40b3b30 con 0x7fe8c415c2a0 2024-09-15T23:55:18.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8c9544640 1 --2- 172.21.15.112:0/1049038600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8c415bec0 0x7fe8c40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:18.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8c8d43640 1 --2- 172.21.15.112:0/1049038600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c415c2a0 0x7fe8c40aed60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40097c0 tx=0x7fe8b401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b7d7580e5900aa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8bbfff640 1 -- 172.21.15.112:0/1049038600 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40a7070 con 0x7fe8c415c2a0 2024-09-15T23:55:18.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8bbfff640 1 -- 172.21.15.112:0/1049038600 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b40b0070 con 0x7fe8c415c2a0 2024-09-15T23:55:18.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8bbfff640 1 -- 172.21.15.112:0/1049038600 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40ab890 con 0x7fe8c415c2a0 2024-09-15T23:55:18.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/1049038600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c415c2a0 msgr2=0x7fe8c40aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8cb7a8640 1 --2- 172.21.15.112:0/1049038600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c415c2a0 0x7fe8c40aed60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40097c0 tx=0x7fe8b401c470 comp rx=0 tx=0).stop 2024-09-15T23:55:18.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/1049038600 shutdown_connections 2024-09-15T23:55:18.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8cb7a8640 1 --2- 172.21.15.112:0/1049038600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c415c2a0 0x7fe8c40aed60 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8cb7a8640 1 --2- 172.21.15.112:0/1049038600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8c415bec0 0x7fe8c40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/1049038600 >> 172.21.15.112:0/1049038600 conn(0x7fe8c40b1f90 msgr2=0x7fe8c40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:18.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/1049038600 shutdown_connections 2024-09-15T23:55:18.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.003+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/1049038600 wait complete. 2024-09-15T23:55:18.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8cb7a8640 1 Processor -- start 2024-09-15T23:55:18.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8cb7a8640 1 -- start start 2024-09-15T23:55:18.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8cb7a8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c40af2a0 0x7fe8c4071f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8cb7a8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8c415bec0 0x7fe8c4150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8cb7a8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8c415c2a0 0x7fe8c40735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8cb7a8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c40af6f0 con 0x7fe8c40af2a0 2024-09-15T23:55:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8cb7a8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c40ad740 con 0x7fe8c415c2a0 2024-09-15T23:55:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8cb7a8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c4169000 con 0x7fe8c415bec0 2024-09-15T23:55:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8c9544640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c40af2a0 0x7fe8c4071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8c9544640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c40af2a0 0x7fe8c4071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41602/0 (socket says 172.21.15.112:41602) 2024-09-15T23:55:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8c9544640 1 -- 172.21.15.112:0/78099775 learned_addr learned my addr 172.21.15.112:0/78099775 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8c9544640 1 -- 172.21.15.112:0/78099775 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8c415bec0 msgr2=0x7fe8c4150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8c8d43640 1 --2- 172.21.15.112:0/78099775 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8c415bec0 0x7fe8c4150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8c9544640 1 --2- 172.21.15.112:0/78099775 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8c415bec0 0x7fe8c4150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8c9544640 1 -- 172.21.15.112:0/78099775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8c415c2a0 msgr2=0x7fe8c40735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8c9d45640 1 --2- 172.21.15.112:0/78099775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8c415c2a0 0x7fe8c40735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8c9544640 1 --2- 172.21.15.112:0/78099775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8c415c2a0 0x7fe8c40735e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8c9544640 1 -- 172.21.15.112:0/78099775 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c40cf910 con 0x7fe8c40af2a0 2024-09-15T23:55:18.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8c9544640 1 --2- 172.21.15.112:0/78099775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c40af2a0 0x7fe8c4071f10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00cf60 tx=0x7fe8bc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8b9ffb640 1 -- 172.21.15.112:0/78099775 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc01a070 con 0x7fe8c40af2a0 2024-09-15T23:55:18.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8b9ffb640 1 -- 172.21.15.112:0/78099775 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8bc00d840 con 0x7fe8c40af2a0 2024-09-15T23:55:18.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/78099775 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c40725a0 con 0x7fe8c40af2a0 2024-09-15T23:55:18.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8b9ffb640 1 -- 172.21.15.112:0/78099775 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc00dc10 con 0x7fe8c40af2a0 2024-09-15T23:55:18.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/78099775 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c4072b60 con 0x7fe8c40af2a0 2024-09-15T23:55:18.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/78099775 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c40ad200 con 0x7fe8c40af2a0 2024-09-15T23:55:18.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.007+0000 7fe8b9ffb640 1 -- 172.21.15.112:0/78099775 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe8bc01d070 con 0x7fe8c40af2a0 2024-09-15T23:55:18.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.011+0000 7fe8b9ffb640 1 --2- 172.21.15.112:0/78099775 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8a80678c0 0x7fe8a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.011+0000 7fe8c8d43640 1 --2- 172.21.15.112:0/78099775 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8a80678c0 0x7fe8a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.011+0000 7fe8b9ffb640 1 -- 172.21.15.112:0/78099775 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fe8bc086640 con 0x7fe8c40af2a0 2024-09-15T23:55:18.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.011+0000 7fe8c8d43640 1 --2- 172.21.15.112:0/78099775 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8a80678c0 0x7fe8a8069d80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40af000 tx=0x7fe8b40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.015+0000 7fe8b9ffb640 1 -- 172.21.15.112:0/78099775 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe8bc056950 con 0x7fe8c40af2a0 2024-09-15T23:55:18.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.199+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/78099775 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe8c406fcd0 con 0x7fe8c40af2a0 2024-09-15T23:55:18.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.863+0000 7fe8b9ffb640 1 -- 172.21.15.112:0/78099775 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7fe8bc05ac50 con 0x7fe8c40af2a0 2024-09-15T23:55:18.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.867+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/78099775 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8a80678c0 msgr2=0x7fe8a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.867+0000 7fe8cb7a8640 1 --2- 172.21.15.112:0/78099775 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8a80678c0 0x7fe8a8069d80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40af000 tx=0x7fe8b40a7000 comp rx=0 tx=0).stop 2024-09-15T23:55:18.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.867+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/78099775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c40af2a0 msgr2=0x7fe8c4071f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.867+0000 7fe8cb7a8640 1 --2- 172.21.15.112:0/78099775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c40af2a0 0x7fe8c4071f10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00cf60 tx=0x7fe8bc00cf90 comp rx=0 tx=0).stop 2024-09-15T23:55:18.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.867+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/78099775 shutdown_connections 2024-09-15T23:55:18.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.867+0000 7fe8cb7a8640 1 --2- 172.21.15.112:0/78099775 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8a80678c0 0x7fe8a8069d80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.867+0000 7fe8cb7a8640 1 --2- 172.21.15.112:0/78099775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8c415c2a0 0x7fe8c40735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.867+0000 7fe8cb7a8640 1 --2- 172.21.15.112:0/78099775 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe8c415bec0 0x7fe8c4150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.867+0000 7fe8cb7a8640 1 --2- 172.21.15.112:0/78099775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8c40af2a0 0x7fe8c4071f10 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.867+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/78099775 >> 172.21.15.112:0/78099775 conn(0x7fe8c40b1f90 msgr2=0x7fe8c40b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:18.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.867+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/78099775 shutdown_connections 2024-09-15T23:55:18.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:18.867+0000 7fe8cb7a8640 1 -- 172.21.15.112:0/78099775 wait complete. 2024-09-15T23:55:18.896 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:55:19.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f6914dc5640 1 Processor -- start 2024-09-15T23:55:19.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f6914dc5640 1 -- start start 2024-09-15T23:55:19.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f6914dc5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f691006df70 0x7f69101634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f6914dc5640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f69100b3290 0x7f69100b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f6914dc5640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f691006e470 con 0x7f69101630c0 2024-09-15T23:55:19.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f6914dc5640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f691006fc20 con 0x7f691006df70 2024-09-15T23:55:19.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f6914dc5640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f691006e750 con 0x7f69100b3290 2024-09-15T23:55:19.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f690dd9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f691006df70 0x7f69101634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:19.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f690e59c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f69101630c0 0x7f691006f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58006/0 (socket says 172.21.15.112:58006) 2024-09-15T23:55:19.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f690e59c640 1 -- 172.21.15.112:0/3246855680 learned_addr learned my addr 172.21.15.112:0/3246855680 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:19.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f690dd9b640 1 -- 172.21.15.112:0/3246855680 >> v2:172.21.15.169:3300/0 conn(0x7f69100b3290 msgr2=0x7f69100b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:19.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f690dd9b640 1 --2- 172.21.15.112:0/3246855680 >> v2:172.21.15.169:3300/0 conn(0x7f69100b3290 0x7f69100b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f690dd9b640 1 -- 172.21.15.112:0/3246855680 >> v1:172.21.15.112:6789/0 conn(0x7f69101630c0 legacy=0x7f691006f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f690dd9b640 1 -- 172.21.15.112:0/3246855680 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691006ea30 con 0x7f691006df70 2024-09-15T23:55:19.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.063+0000 7f690d59a640 1 -- 172.21.15.112:0/3246855680 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2499400865 0 0) 0x7f691006e470 con 0x7f69101630c0 2024-09-15T23:55:19.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.067+0000 7f690dd9b640 1 --2- 172.21.15.112:0/3246855680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f691006df70 0x7f69101634a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f69100af090 tx=0x7f68f801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd93986f53aef4f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:19.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.067+0000 7f690d59a640 1 -- 172.21.15.112:0/3246855680 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f80b0070 con 0x7f691006df70 2024-09-15T23:55:19.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.067+0000 7f690d59a640 1 -- 172.21.15.112:0/3246855680 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f80ab600 con 0x7f691006df70 2024-09-15T23:55:19.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.067+0000 7f690d59a640 1 -- 172.21.15.112:0/3246855680 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f80ab9d0 con 0x7f691006df70 2024-09-15T23:55:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.067+0000 7f6914dc5640 1 -- 172.21.15.112:0/3246855680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f691006df70 msgr2=0x7f69101634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.067+0000 7f6914dc5640 1 --2- 172.21.15.112:0/3246855680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f691006df70 0x7f69101634a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f69100af090 tx=0x7f68f801c480 comp rx=0 tx=0).stop 2024-09-15T23:55:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.067+0000 7f6914dc5640 1 -- 172.21.15.112:0/3246855680 shutdown_connections 2024-09-15T23:55:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.067+0000 7f6914dc5640 1 --2- 172.21.15.112:0/3246855680 >> v2:172.21.15.169:3300/0 conn(0x7f69100b3290 0x7f69100b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.067+0000 7f6914dc5640 1 --2- 172.21.15.112:0/3246855680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f691006df70 0x7f69101634a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.067+0000 7f6914dc5640 1 -- 172.21.15.112:0/3246855680 >> 172.21.15.112:0/3246855680 conn(0x7f69100b1f90 msgr2=0x7f69100b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:19.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.067+0000 7f6914dc5640 1 -- 172.21.15.112:0/3246855680 shutdown_connections 2024-09-15T23:55:19.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.067+0000 7f6914dc5640 1 -- 172.21.15.112:0/3246855680 wait complete. 2024-09-15T23:55:19.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.067+0000 7f6914dc5640 1 Processor -- start 2024-09-15T23:55:19.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.067+0000 7f6914dc5640 1 -- start start 2024-09-15T23:55:19.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6914dc5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f691006df70 0x7f691014c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6914dc5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69100b3290 0x7f691015c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6914dc5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69101630c0 0x7f691015c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6914dc5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f691016f5f0 con 0x7f69101630c0 2024-09-15T23:55:19.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6914dc5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f691016f770 con 0x7f691006df70 2024-09-15T23:55:19.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6914dc5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f691016f8f0 con 0x7f69100b3290 2024-09-15T23:55:19.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f690ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69101630c0 0x7f691015c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:19.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f690ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69101630c0 0x7f691015c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53040/0 (socket says 172.21.15.112:53040) 2024-09-15T23:55:19.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f690ed9d640 1 -- 172.21.15.112:0/1874954818 learned_addr learned my addr 172.21.15.112:0/1874954818 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:19.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f690ed9d640 1 -- 172.21.15.112:0/1874954818 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69100b3290 msgr2=0x7f691015c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f690ed9d640 1 --2- 172.21.15.112:0/1874954818 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69100b3290 0x7f691015c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f690ed9d640 1 -- 172.21.15.112:0/1874954818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f691006df70 msgr2=0x7f691014c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f690e59c640 1 --2- 172.21.15.112:0/1874954818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f691006df70 0x7f691014c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:19.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f690ed9d640 1 --2- 172.21.15.112:0/1874954818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f691006df70 0x7f691014c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f690ed9d640 1 -- 172.21.15.112:0/1874954818 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6910152b10 con 0x7f69101630c0 2024-09-15T23:55:19.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f690ed9d640 1 --2- 172.21.15.112:0/1874954818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69101630c0 0x7f691015c840 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f690800b9a0 tx=0x7f690800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:19.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6906ffd640 1 -- 172.21.15.112:0/1874954818 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908019070 con 0x7f69101630c0 2024-09-15T23:55:19.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6906ffd640 1 -- 172.21.15.112:0/1874954818 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f690800cbc0 con 0x7f69101630c0 2024-09-15T23:55:19.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6914dc5640 1 -- 172.21.15.112:0/1874954818 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6910152df0 con 0x7f69101630c0 2024-09-15T23:55:19.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6906ffd640 1 -- 172.21.15.112:0/1874954818 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908014440 con 0x7f69101630c0 2024-09-15T23:55:19.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6914dc5640 1 -- 172.21.15.112:0/1874954818 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69101533b0 con 0x7f69101630c0 2024-09-15T23:55:19.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6914dc5640 1 -- 172.21.15.112:0/1874954818 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69101634a0 con 0x7f69101630c0 2024-09-15T23:55:19.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6906ffd640 1 -- 172.21.15.112:0/1874954818 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f690801c070 con 0x7f69101630c0 2024-09-15T23:55:19.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6906ffd640 1 --2- 172.21.15.112:0/1874954818 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68f00678c0 0x7f68f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f6906ffd640 1 -- 172.21.15.112:0/1874954818 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7f6908085bd0 con 0x7f69101630c0 2024-09-15T23:55:19.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.071+0000 7f690e59c640 1 --2- 172.21.15.112:0/1874954818 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68f00678c0 0x7f68f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:19.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.075+0000 7f690e59c640 1 --2- 172.21.15.112:0/1874954818 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68f00678c0 0x7f68f0069d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6900000f70 tx=0x7f6900009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:19.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.079+0000 7f6906ffd640 1 -- 172.21.15.112:0/1874954818 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f69080565c0 con 0x7f69101630c0 2024-09-15T23:55:19.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.239+0000 7f6914dc5640 1 -- 172.21.15.112:0/1874954818 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f691016ce70 con 0x7f69101630c0 2024-09-15T23:55:19.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.875+0000 7f6906ffd640 1 -- 172.21.15.112:0/1874954818 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) ==== 181+0+0 (secure 0 0 0) 0x7f6908055ec0 con 0x7f69101630c0 2024-09-15T23:55:19.880 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:55:19.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.875+0000 7f6914dc5640 1 -- 172.21.15.112:0/1874954818 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68f00678c0 msgr2=0x7f68f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.875+0000 7f6914dc5640 1 --2- 172.21.15.112:0/1874954818 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68f00678c0 0x7f68f0069d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6900000f70 tx=0x7f6900009040 comp rx=0 tx=0).stop 2024-09-15T23:55:19.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.875+0000 7f6914dc5640 1 -- 172.21.15.112:0/1874954818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69101630c0 msgr2=0x7f691015c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.875+0000 7f6914dc5640 1 --2- 172.21.15.112:0/1874954818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69101630c0 0x7f691015c840 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f690800b9a0 tx=0x7f690800be60 comp rx=0 tx=0).stop 2024-09-15T23:55:19.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.875+0000 7f6914dc5640 1 -- 172.21.15.112:0/1874954818 shutdown_connections 2024-09-15T23:55:19.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.875+0000 7f6914dc5640 1 --2- 172.21.15.112:0/1874954818 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68f00678c0 0x7f68f0069d80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.875+0000 7f6914dc5640 1 --2- 172.21.15.112:0/1874954818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69101630c0 0x7f691015c840 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.875+0000 7f6914dc5640 1 --2- 172.21.15.112:0/1874954818 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69100b3290 0x7f691015c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.875+0000 7f6914dc5640 1 --2- 172.21.15.112:0/1874954818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f691006df70 0x7f691014c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.875+0000 7f6914dc5640 1 -- 172.21.15.112:0/1874954818 >> 172.21.15.112:0/1874954818 conn(0x7f69100b1f90 msgr2=0x7f691014cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:19.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.883+0000 7f6914dc5640 1 -- 172.21.15.112:0/1874954818 shutdown_connections 2024-09-15T23:55:19.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:19.883+0000 7f6914dc5640 1 -- 172.21.15.112:0/1874954818 wait complete. 2024-09-15T23:55:19.909 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:55:20.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe348cca640 1 Processor -- start 2024-09-15T23:55:20.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe348cca640 1 -- start start 2024-09-15T23:55:20.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe348cca640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3440b3790 0x7fe34406d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe348cca640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe34406d890 0x7fe34409aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe348cca640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34406dd30 con 0x7fe34415f660 2024-09-15T23:55:20.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe348cca640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe34406e5d0 con 0x7fe34406d890 2024-09-15T23:55:20.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe348cca640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe3440b5ca0 con 0x7fe3440b3790 2024-09-15T23:55:20.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe341d9b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe34406d890 0x7fe34409aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe34259c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3440b3790 0x7fe34406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe342d9d640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fe34415f660 0x7fe344161f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:52298/0 (socket says 172.21.15.112:52298) 2024-09-15T23:55:20.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe342d9d640 1 -- 172.21.15.112:0/2180393708 learned_addr learned my addr 172.21.15.112:0/2180393708 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:20.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe34259c640 1 -- 172.21.15.112:0/2180393708 >> v2:172.21.15.169:3300/0 conn(0x7fe34406d890 msgr2=0x7fe34409aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:20.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe34259c640 1 --2- 172.21.15.112:0/2180393708 >> v2:172.21.15.169:3300/0 conn(0x7fe34406d890 0x7fe34409aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe34259c640 1 -- 172.21.15.112:0/2180393708 >> v1:172.21.15.169:6789/0 conn(0x7fe34415f660 legacy=0x7fe344161f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.035+0000 7fe34259c640 1 -- 172.21.15.112:0/2180393708 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34406e010 con 0x7fe3440b3790 2024-09-15T23:55:20.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.039+0000 7fe34259c640 1 --2- 172.21.15.112:0/2180393708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3440b3790 0x7fe34406d350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0097c0 tx=0x7fe32c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5005b2710bf6c058 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:20.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.039+0000 7fe34159a640 1 -- 172.21.15.112:0/2180393708 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0b2070 con 0x7fe3440b3790 2024-09-15T23:55:20.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.039+0000 7fe34159a640 1 -- 172.21.15.112:0/2180393708 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe32c0ad680 con 0x7fe3440b3790 2024-09-15T23:55:20.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.039+0000 7fe34159a640 1 -- 172.21.15.112:0/2180393708 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0ada50 con 0x7fe3440b3790 2024-09-15T23:55:20.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.039+0000 7fe348cca640 1 -- 172.21.15.112:0/2180393708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3440b3790 msgr2=0x7fe34406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.039+0000 7fe348cca640 1 --2- 172.21.15.112:0/2180393708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3440b3790 0x7fe34406d350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0097c0 tx=0x7fe32c01c470 comp rx=0 tx=0).stop 2024-09-15T23:55:20.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.039+0000 7fe348cca640 1 -- 172.21.15.112:0/2180393708 shutdown_connections 2024-09-15T23:55:20.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.039+0000 7fe348cca640 1 --2- 172.21.15.112:0/2180393708 >> v2:172.21.15.169:3300/0 conn(0x7fe34406d890 0x7fe34409aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.039+0000 7fe348cca640 1 --2- 172.21.15.112:0/2180393708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3440b3790 0x7fe34406d350 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.039+0000 7fe348cca640 1 -- 172.21.15.112:0/2180393708 >> 172.21.15.112:0/2180393708 conn(0x7fe3440b78d0 msgr2=0x7fe3440b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:20.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.039+0000 7fe348cca640 1 -- 172.21.15.112:0/2180393708 shutdown_connections 2024-09-15T23:55:20.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.039+0000 7fe348cca640 1 -- 172.21.15.112:0/2180393708 wait complete. 2024-09-15T23:55:20.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe348cca640 1 Processor -- start 2024-09-15T23:55:20.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe348cca640 1 -- start start 2024-09-15T23:55:20.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe348cca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe34406d890 0x7fe344158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe348cca640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3440b3790 0x7fe344152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe348cca640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe34415f660 0x7fe34415d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe348cca640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe3440b75b0 con 0x7fe34406d890 2024-09-15T23:55:20.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe348cca640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3440b7430 con 0x7fe3440b3790 2024-09-15T23:55:20.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe348cca640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe34416b0f0 con 0x7fe34415f660 2024-09-15T23:55:20.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe34259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe34406d890 0x7fe344158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe34259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe34406d890 0x7fe344158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53054/0 (socket says 172.21.15.112:53054) 2024-09-15T23:55:20.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe34259c640 1 -- 172.21.15.112:0/4248897834 learned_addr learned my addr 172.21.15.112:0/4248897834 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:20.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe341d9b640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3440b3790 0x7fe344152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe342d9d640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe34415f660 0x7fe34415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe34259c640 1 -- 172.21.15.112:0/4248897834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe34415f660 msgr2=0x7fe34415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe34259c640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe34415f660 0x7fe34415d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe34259c640 1 -- 172.21.15.112:0/4248897834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3440b3790 msgr2=0x7fe344152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe34259c640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3440b3790 0x7fe344152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe34259c640 1 -- 172.21.15.112:0/4248897834 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34409c280 con 0x7fe34406d890 2024-09-15T23:55:20.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe342d9d640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe34415f660 0x7fe34415d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:20.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe34259c640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe34406d890 0x7fe344158fc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe32c01ab20 tx=0x7fe32c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:20.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe33affd640 1 -- 172.21.15.112:0/4248897834 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0b2040 con 0x7fe34406d890 2024-09-15T23:55:20.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe33affd640 1 -- 172.21.15.112:0/4248897834 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe32c0ad930 con 0x7fe34406d890 2024-09-15T23:55:20.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe348cca640 1 -- 172.21.15.112:0/4248897834 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3441596c0 con 0x7fe34406d890 2024-09-15T23:55:20.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe33affd640 1 -- 172.21.15.112:0/4248897834 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0add20 con 0x7fe34406d890 2024-09-15T23:55:20.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe348cca640 1 -- 172.21.15.112:0/4248897834 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe344159c80 con 0x7fe34406d890 2024-09-15T23:55:20.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.043+0000 7fe348cca640 1 -- 172.21.15.112:0/4248897834 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe34409aa00 con 0x7fe34406d890 2024-09-15T23:55:20.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.047+0000 7fe33affd640 1 -- 172.21.15.112:0/4248897834 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe32c0bf030 con 0x7fe34406d890 2024-09-15T23:55:20.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.047+0000 7fe33affd640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe3240678c0 0x7fe324069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.047+0000 7fe33affd640 1 -- 172.21.15.112:0/4248897834 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5749+0+0 (secure 0 0 0) 0x7fe32c11f520 con 0x7fe34406d890 2024-09-15T23:55:20.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.047+0000 7fe341d9b640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe3240678c0 0x7fe324069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.047+0000 7fe341d9b640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe3240678c0 0x7fe324069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe344156aa0 tx=0x7fe33c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:20.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.051+0000 7fe33affd640 1 -- 172.21.15.112:0/4248897834 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe32c0c6060 con 0x7fe34406d890 2024-09-15T23:55:20.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.219+0000 7fe348cca640 1 -- 172.21.15.112:0/4248897834 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe34415f1b0 con 0x7fe34406d890 2024-09-15T23:55:20.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.879+0000 7fe33affd640 1 -- 172.21.15.112:0/4248897834 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) ==== 169+0+0 (secure 0 0 0) 0x7fe32c016090 con 0x7fe34406d890 2024-09-15T23:55:20.882 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-15T23:55:20.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.879+0000 7fe348cca640 1 -- 172.21.15.112:0/4248897834 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe3240678c0 msgr2=0x7fe324069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.879+0000 7fe348cca640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe3240678c0 0x7fe324069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe344156aa0 tx=0x7fe33c00b040 comp rx=0 tx=0).stop 2024-09-15T23:55:20.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.879+0000 7fe348cca640 1 -- 172.21.15.112:0/4248897834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe34406d890 msgr2=0x7fe344158fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.879+0000 7fe348cca640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe34406d890 0x7fe344158fc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe32c01ab20 tx=0x7fe32c01acb0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.879+0000 7fe348cca640 1 -- 172.21.15.112:0/4248897834 shutdown_connections 2024-09-15T23:55:20.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.879+0000 7fe348cca640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe3240678c0 0x7fe324069d80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.879+0000 7fe348cca640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe34415f660 0x7fe34415d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.879+0000 7fe348cca640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3440b3790 0x7fe344152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.879+0000 7fe348cca640 1 --2- 172.21.15.112:0/4248897834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe34406d890 0x7fe344158fc0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.879+0000 7fe348cca640 1 -- 172.21.15.112:0/4248897834 >> 172.21.15.112:0/4248897834 conn(0x7fe3440b78d0 msgr2=0x7fe3440711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:20.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.879+0000 7fe348cca640 1 -- 172.21.15.112:0/4248897834 shutdown_connections 2024-09-15T23:55:20.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:20.879+0000 7fe348cca640 1 -- 172.21.15.112:0/4248897834 wait complete. 2024-09-15T23:55:20.910 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:55:21.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a0772f640 1 Processor -- start 2024-09-15T23:55:21.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a0772f640 1 -- start start 2024-09-15T23:55:21.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a0772f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0a0015e650 0x7f0a0006dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a0772f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0a0006e170 0x7f0a000b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a0772f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a0006e7a0 con 0x7f0a000b4340 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a0772f640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0a000b4790 con 0x7f0a0006e170 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a0772f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f0a000d1550 con 0x7f0a0015e650 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a04cca640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0a0006e170 0x7f0a000b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a04cca640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0a0006e170 0x7f0a000b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53060/0 (socket says 172.21.15.112:53060) 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a04cca640 1 -- 172.21.15.112:0/2750716475 learned_addr learned my addr 172.21.15.112:0/2750716475 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a054cb640 1 --2- 172.21.15.112:0/2750716475 >> v2:172.21.15.169:3300/0 conn(0x7f0a0015e650 0x7f0a0006dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a04cca640 1 -- 172.21.15.112:0/2750716475 >> v2:172.21.15.169:3300/0 conn(0x7f0a0015e650 msgr2=0x7f0a0006dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a04cca640 1 --2- 172.21.15.112:0/2750716475 >> v2:172.21.15.169:3300/0 conn(0x7f0a0015e650 0x7f0a0006dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a04cca640 1 -- 172.21.15.112:0/2750716475 >> v1:172.21.15.169:6789/0 conn(0x7f0a000b4340 legacy=0x7f0a00162110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a04cca640 1 -- 172.21.15.112:0/2750716475 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a000d0f00 con 0x7f0a0006e170 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.039+0000 7f0a054cb640 1 --2- 172.21.15.112:0/2750716475 >> v2:172.21.15.169:3300/0 conn(0x7f0a0015e650 0x7f0a0006dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:21.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.043+0000 7f0a04cca640 1 --2- 172.21.15.112:0/2750716475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a0006e170 0x7f0a000b3e00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0a000d3270 tx=0x7f09f001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7e37fedd2575ae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:21.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.043+0000 7f09f7fff640 1 -- 172.21.15.112:0/2750716475 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f00b0070 con 0x7f0a0006e170 2024-09-15T23:55:21.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.043+0000 7f09f7fff640 1 -- 172.21.15.112:0/2750716475 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f00ab600 con 0x7f0a0006e170 2024-09-15T23:55:21.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.043+0000 7f09f7fff640 1 -- 172.21.15.112:0/2750716475 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f00ab9d0 con 0x7f0a0006e170 2024-09-15T23:55:21.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.043+0000 7f0a0772f640 1 -- 172.21.15.112:0/2750716475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a0006e170 msgr2=0x7f0a000b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.043+0000 7f0a0772f640 1 --2- 172.21.15.112:0/2750716475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a0006e170 0x7f0a000b3e00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0a000d3270 tx=0x7f09f001c4e0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.043+0000 7f0a0772f640 1 -- 172.21.15.112:0/2750716475 shutdown_connections 2024-09-15T23:55:21.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.043+0000 7f0a0772f640 1 --2- 172.21.15.112:0/2750716475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a0006e170 0x7f0a000b3e00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.043+0000 7f0a0772f640 1 --2- 172.21.15.112:0/2750716475 >> v2:172.21.15.169:3300/0 conn(0x7f0a0015e650 0x7f0a0006dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.043+0000 7f0a0772f640 1 -- 172.21.15.112:0/2750716475 >> 172.21.15.112:0/2750716475 conn(0x7f0a0006bcc0 msgr2=0x7f0a0006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:21.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.043+0000 7f0a0772f640 1 -- 172.21.15.112:0/2750716475 shutdown_connections 2024-09-15T23:55:21.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.043+0000 7f0a0772f640 1 -- 172.21.15.112:0/2750716475 wait complete. 2024-09-15T23:55:21.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.043+0000 7f0a0772f640 1 Processor -- start 2024-09-15T23:55:21.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.043+0000 7f0a0772f640 1 -- start start 2024-09-15T23:55:21.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a0772f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a0006e170 0x7f0a001579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a0772f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a000b4340 0x7f0a0014a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a0772f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a0015e650 0x7f0a000b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a0772f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0016b400 con 0x7f0a000b4340 2024-09-15T23:55:21.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a0772f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0016b280 con 0x7f0a0015e650 2024-09-15T23:55:21.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a0772f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0a0016b580 con 0x7f0a0006e170 2024-09-15T23:55:21.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a04cca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a000b4340 0x7f0a0014a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a04cca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a000b4340 0x7f0a0014a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53072/0 (socket says 172.21.15.112:53072) 2024-09-15T23:55:21.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a04cca640 1 -- 172.21.15.112:0/151019236 learned_addr learned my addr 172.21.15.112:0/151019236 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a054cb640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a0006e170 0x7f0a001579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a05ccc640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a0015e650 0x7f0a000b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a04cca640 1 -- 172.21.15.112:0/151019236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a0006e170 msgr2=0x7f0a001579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a04cca640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a0006e170 0x7f0a001579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a04cca640 1 -- 172.21.15.112:0/151019236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a0015e650 msgr2=0x7f0a000b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a04cca640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a0015e650 0x7f0a000b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a04cca640 1 -- 172.21.15.112:0/151019236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a00160090 con 0x7f0a000b4340 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a054cb640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a0006e170 0x7f0a001579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a05ccc640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a0015e650 0x7f0a000b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a04cca640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a000b4340 0x7f0a0014a910 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f09f001a110 tx=0x7f09f0019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f09f5ffb640 1 -- 172.21.15.112:0/151019236 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f00ba070 con 0x7f0a000b4340 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f09f5ffb640 1 -- 172.21.15.112:0/151019236 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f00b4620 con 0x7f0a000b4340 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a0772f640 1 -- 172.21.15.112:0/151019236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a0015f010 con 0x7f0a000b4340 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f09f5ffb640 1 -- 172.21.15.112:0/151019236 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f00b0040 con 0x7f0a000b4340 2024-09-15T23:55:21.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a0772f640 1 -- 172.21.15.112:0/151019236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a0015f5b0 con 0x7f0a000b4340 2024-09-15T23:55:21.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a0772f640 1 -- 172.21.15.112:0/151019236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a000b3e00 con 0x7f0a000b4340 2024-09-15T23:55:21.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f09f5ffb640 1 -- 172.21.15.112:0/151019236 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f09f00bd070 con 0x7f0a000b4340 2024-09-15T23:55:21.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f09f5ffb640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f09e40678f0 0x7f09e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f09f5ffb640 1 -- 172.21.15.112:0/151019236 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f09f011ecc0 con 0x7f0a000b4340 2024-09-15T23:55:21.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a054cb640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f09e40678f0 0x7f09e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.047+0000 7f0a054cb640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f09e40678f0 0x7f09e4069db0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f09fc008890 tx=0x7f09fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:21.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.051+0000 7f09f5ffb640 1 -- 172.21.15.112:0/151019236 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f09f00160d0 con 0x7f0a000b4340 2024-09-15T23:55:21.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.215+0000 7f0a0772f640 1 -- 172.21.15.112:0/151019236 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f0a000cdde0 con 0x7f0a000b4340 2024-09-15T23:55:21.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.219+0000 7f09f5ffb640 1 -- 172.21.15.112:0/151019236 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f09f00ef970 con 0x7f0a000b4340 2024-09-15T23:55:21.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.223+0000 7f0a0772f640 1 -- 172.21.15.112:0/151019236 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f09e40678f0 msgr2=0x7f09e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.223+0000 7f0a0772f640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f09e40678f0 0x7f09e4069db0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f09fc008890 tx=0x7f09fc008040 comp rx=0 tx=0).stop 2024-09-15T23:55:21.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.223+0000 7f0a0772f640 1 -- 172.21.15.112:0/151019236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a000b4340 msgr2=0x7f0a0014a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.223+0000 7f0a0772f640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a000b4340 0x7f0a0014a910 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f09f001a110 tx=0x7f09f0019280 comp rx=0 tx=0).stop 2024-09-15T23:55:21.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.223+0000 7f0a0772f640 1 -- 172.21.15.112:0/151019236 shutdown_connections 2024-09-15T23:55:21.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.223+0000 7f0a0772f640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f09e40678f0 0x7f09e4069db0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.223+0000 7f0a0772f640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a0015e650 0x7f0a000b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.223+0000 7f0a0772f640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a000b4340 0x7f0a0014a910 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.223+0000 7f0a0772f640 1 --2- 172.21.15.112:0/151019236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a0006e170 0x7f0a001579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.223+0000 7f0a0772f640 1 -- 172.21.15.112:0/151019236 >> 172.21.15.112:0/151019236 conn(0x7f0a0006bcc0 msgr2=0x7f0a000cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:21.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.223+0000 7f0a0772f640 1 -- 172.21.15.112:0/151019236 shutdown_connections 2024-09-15T23:55:21.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.223+0000 7f0a0772f640 1 -- 172.21.15.112:0/151019236 wait complete. 2024-09-15T23:55:21.245 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_dir_deletion' 2024-09-15T23:55:21.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f8557314640 1 Processor -- start 2024-09-15T23:55:21.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f8557314640 1 -- start start 2024-09-15T23:55:21.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f8557314640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f855015bec0 0x7f85500ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f8557314640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85500af470 0x7f855006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f8557314640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85500b3290 con 0x7f855015c2a0 2024-09-15T23:55:21.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f8557314640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f85500b3570 con 0x7f855015bec0 2024-09-15T23:55:21.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f8557314640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f85500b3850 con 0x7f85500af470 2024-09-15T23:55:21.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f85550b0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f855015bec0 0x7f85500ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f85548af640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f855015c2a0 0x7f85500aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58012/0 (socket says 172.21.15.112:58012) 2024-09-15T23:55:21.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f85548af640 1 -- 172.21.15.112:0/1663565623 learned_addr learned my addr 172.21.15.112:0/1663565623 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:21.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f85558b1640 1 --2- 172.21.15.112:0/1663565623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85500af470 0x7f855006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f85550b0640 1 -- 172.21.15.112:0/1663565623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85500af470 msgr2=0x7f855006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:21.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f85550b0640 1 --2- 172.21.15.112:0/1663565623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85500af470 0x7f855006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f85550b0640 1 -- 172.21.15.112:0/1663565623 >> v1:172.21.15.112:6789/0 conn(0x7f855015c2a0 legacy=0x7f85500aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f8547fff640 1 -- 172.21.15.112:0/1663565623 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080292517 0 0) 0x7f85500b3290 con 0x7f855015c2a0 2024-09-15T23:55:21.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.363+0000 7f85550b0640 1 -- 172.21.15.112:0/1663565623 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85500b3b30 con 0x7f855015bec0 2024-09-15T23:55:21.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.367+0000 7f85550b0640 1 --2- 172.21.15.112:0/1663565623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f855015bec0 0x7f85500ad200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f854c0097c0 tx=0x7f854c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c793bd0e4a8f4ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:21.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.367+0000 7f8547fff640 1 -- 172.21.15.112:0/1663565623 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c0b1070 con 0x7f855015bec0 2024-09-15T23:55:21.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.367+0000 7f8547fff640 1 -- 172.21.15.112:0/1663565623 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c0a8050 con 0x7f855015bec0 2024-09-15T23:55:21.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.367+0000 7f8547fff640 1 -- 172.21.15.112:0/1663565623 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c0ac860 con 0x7f855015bec0 2024-09-15T23:55:21.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.367+0000 7f8557314640 1 -- 172.21.15.112:0/1663565623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f855015bec0 msgr2=0x7f85500ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.367+0000 7f8557314640 1 --2- 172.21.15.112:0/1663565623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f855015bec0 0x7f85500ad200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f854c0097c0 tx=0x7f854c01c3e0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.367+0000 7f8557314640 1 -- 172.21.15.112:0/1663565623 shutdown_connections 2024-09-15T23:55:21.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.367+0000 7f8557314640 1 --2- 172.21.15.112:0/1663565623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85500af470 0x7f855006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.367+0000 7f8557314640 1 --2- 172.21.15.112:0/1663565623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f855015bec0 0x7f85500ad200 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.367+0000 7f8557314640 1 -- 172.21.15.112:0/1663565623 >> 172.21.15.112:0/1663565623 conn(0x7f85500b1f90 msgr2=0x7f85500b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:21.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.367+0000 7f8557314640 1 -- 172.21.15.112:0/1663565623 shutdown_connections 2024-09-15T23:55:21.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.367+0000 7f8557314640 1 -- 172.21.15.112:0/1663565623 wait complete. 2024-09-15T23:55:21.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8557314640 1 Processor -- start 2024-09-15T23:55:21.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8557314640 1 -- start start 2024-09-15T23:55:21.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8557314640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85500af470 0x7f855014b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8557314640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f855015bec0 0x7f8550155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8557314640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f855015c2a0 0x7f85501571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8557314640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f855006ed50 con 0x7f855015bec0 2024-09-15T23:55:21.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8557314640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85500ad740 con 0x7f85500af470 2024-09-15T23:55:21.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8557314640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f855006eed0 con 0x7f855015c2a0 2024-09-15T23:55:21.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f85548af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f855015bec0 0x7f8550155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f85548af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f855015bec0 0x7f8550155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53094/0 (socket says 172.21.15.112:53094) 2024-09-15T23:55:21.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f85548af640 1 -- 172.21.15.112:0/7393701 learned_addr learned my addr 172.21.15.112:0/7393701 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:21.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f85558b1640 1 --2- 172.21.15.112:0/7393701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f855015c2a0 0x7f85501571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f85550b0640 1 --2- 172.21.15.112:0/7393701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85500af470 0x7f855014b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f85548af640 1 -- 172.21.15.112:0/7393701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f855015c2a0 msgr2=0x7f85501571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f85548af640 1 --2- 172.21.15.112:0/7393701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f855015c2a0 0x7f85501571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f85548af640 1 -- 172.21.15.112:0/7393701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85500af470 msgr2=0x7f855014b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f85548af640 1 --2- 172.21.15.112:0/7393701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85500af470 0x7f855014b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f85548af640 1 -- 172.21.15.112:0/7393701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85501558a0 con 0x7f855015bec0 2024-09-15T23:55:21.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f85548af640 1 --2- 172.21.15.112:0/7393701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f855015bec0 0x7f8550155360 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f854000c450 tx=0x7f854000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:21.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8545ffb640 1 -- 172.21.15.112:0/7393701 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8540018070 con 0x7f855015bec0 2024-09-15T23:55:21.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8545ffb640 1 -- 172.21.15.112:0/7393701 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85400074e0 con 0x7f855015bec0 2024-09-15T23:55:21.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8557314640 1 -- 172.21.15.112:0/7393701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8550155b60 con 0x7f855015bec0 2024-09-15T23:55:21.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8545ffb640 1 -- 172.21.15.112:0/7393701 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85400049f0 con 0x7f855015bec0 2024-09-15T23:55:21.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8557314640 1 -- 172.21.15.112:0/7393701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f855014cf10 con 0x7f855015bec0 2024-09-15T23:55:21.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8557314640 1 -- 172.21.15.112:0/7393701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855006e000 con 0x7f855015bec0 2024-09-15T23:55:21.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.371+0000 7f8545ffb640 1 -- 172.21.15.112:0/7393701 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f854001b070 con 0x7f855015bec0 2024-09-15T23:55:21.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.375+0000 7f8545ffb640 1 --2- 172.21.15.112:0/7393701 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f85340678c0 0x7f8534069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.375+0000 7f8545ffb640 1 -- 172.21.15.112:0/7393701 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f8540084ec0 con 0x7f855015bec0 2024-09-15T23:55:21.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.375+0000 7f85550b0640 1 --2- 172.21.15.112:0/7393701 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f85340678c0 0x7f8534069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.375+0000 7f85550b0640 1 --2- 172.21.15.112:0/7393701 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f85340678c0 0x7f8534069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f854c0ae000 tx=0x7f854c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:21.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.379+0000 7f8545ffb640 1 -- 172.21.15.112:0/7393701 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8540055b70 con 0x7f855015bec0 2024-09-15T23:55:21.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.599+0000 7f8557314640 1 -- 172.21.15.112:0/7393701 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]} v 0) -- 0x7f855006fcd0 con 0x7f855015bec0 2024-09-15T23:55:21.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.879+0000 7f8545ffb640 1 -- 172.21.15.112:0/7393701 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dir_deletion"]}]=0 v99) ==== 132+0+0 (secure 0 0 0) 0x7f8540055470 con 0x7f855015bec0 2024-09-15T23:55:21.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.883+0000 7f8557314640 1 -- 172.21.15.112:0/7393701 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f85340678c0 msgr2=0x7f8534069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.883+0000 7f8557314640 1 --2- 172.21.15.112:0/7393701 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f85340678c0 0x7f8534069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f854c0ae000 tx=0x7f854c0a7000 comp rx=0 tx=0).stop 2024-09-15T23:55:21.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.883+0000 7f8557314640 1 -- 172.21.15.112:0/7393701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f855015bec0 msgr2=0x7f8550155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.883+0000 7f8557314640 1 --2- 172.21.15.112:0/7393701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f855015bec0 0x7f8550155360 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f854000c450 tx=0x7f854000c910 comp rx=0 tx=0).stop 2024-09-15T23:55:21.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.883+0000 7f8557314640 1 -- 172.21.15.112:0/7393701 shutdown_connections 2024-09-15T23:55:21.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.883+0000 7f8557314640 1 --2- 172.21.15.112:0/7393701 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f85340678c0 0x7f8534069d80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.883+0000 7f8557314640 1 --2- 172.21.15.112:0/7393701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f855015c2a0 0x7f85501571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.883+0000 7f8557314640 1 --2- 172.21.15.112:0/7393701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f855015bec0 0x7f8550155360 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.883+0000 7f8557314640 1 --2- 172.21.15.112:0/7393701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85500af470 0x7f855014b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.883+0000 7f8557314640 1 -- 172.21.15.112:0/7393701 >> 172.21.15.112:0/7393701 conn(0x7f85500b1f90 msgr2=0x7f8550159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:21.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.883+0000 7f8557314640 1 -- 172.21.15.112:0/7393701 shutdown_connections 2024-09-15T23:55:21.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:21.883+0000 7f8557314640 1 -- 172.21.15.112:0/7393701 wait complete. 2024-09-15T23:55:21.909 INFO:tasks.cephfs_test_runner:That when deleting a bunch of dentries and the containing ... ok 2024-09-15T23:55:21.909 INFO:tasks.cephfs_test_runner:Starting test: test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) That the directory fragment size cannot exceed mds_bal_fragment_size_max (using a limit of 50 in all configurations). 2024-09-15T23:55:21.909 INFO:tasks.cephfs_test_runner:test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) 2024-09-15T23:55:21.910 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:22.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.027+0000 7fa18f184640 1 Processor -- start 2024-09-15T23:55:22.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.027+0000 7fa18f184640 1 -- start start 2024-09-15T23:55:22.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.031+0000 7fa18f184640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa188161a60 0x7fa1880d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.031+0000 7fa18f184640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa1880cf620 0x7fa18806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.031+0000 7fa18f184640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1880d32b0 con 0x7fa1880d2e90 2024-09-15T23:55:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.031+0000 7fa18f184640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa1880d0300 con 0x7fa1880cf620 2024-09-15T23:55:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.031+0000 7fa18f184640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa1880b0f60 con 0x7fa188161a60 2024-09-15T23:55:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.031+0000 7fa18cf20640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa188161a60 0x7fa1880d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.031+0000 7fa18d721640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa1880cf620 0x7fa18806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.031+0000 7fa18cf20640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa188161a60 0x7fa1880d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:52392/0 (socket says 172.21.15.112:52392) 2024-09-15T23:55:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.031+0000 7fa18cf20640 1 -- 172.21.15.112:0/3651234336 learned_addr learned my addr 172.21.15.112:0/3651234336 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.031+0000 7fa18cf20640 1 -- 172.21.15.112:0/3651234336 >> v2:172.21.15.169:3300/0 conn(0x7fa1880cf620 msgr2=0x7fa18806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:22.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.031+0000 7fa18cf20640 1 --2- 172.21.15.112:0/3651234336 >> v2:172.21.15.169:3300/0 conn(0x7fa1880cf620 0x7fa18806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.031+0000 7fa18cf20640 1 -- 172.21.15.112:0/3651234336 >> v1:172.21.15.169:6789/0 conn(0x7fa1880d2e90 legacy=0x7fa1880cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.031+0000 7fa18cf20640 1 -- 172.21.15.112:0/3651234336 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1880cfad0 con 0x7fa188161a60 2024-09-15T23:55:22.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.031+0000 7fa18d721640 1 --2- 172.21.15.112:0/3651234336 >> v2:172.21.15.169:3300/0 conn(0x7fa1880cf620 0x7fa18806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:55:22.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18cf20640 1 --2- 172.21.15.112:0/3651234336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa188161a60 0x7fa1880d2950 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa170009870 tx=0x7fa17001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9483fdfdf922c94e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:22.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa1877fe640 1 -- 172.21.15.112:0/3651234336 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1700aa600 con 0x7fa188161a60 2024-09-15T23:55:22.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa1877fe640 1 -- 172.21.15.112:0/3651234336 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1700af070 con 0x7fa188161a60 2024-09-15T23:55:22.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa1877fe640 1 -- 172.21.15.112:0/3651234336 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1700aa9c0 con 0x7fa188161a60 2024-09-15T23:55:22.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 -- 172.21.15.112:0/3651234336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa188161a60 msgr2=0x7fa1880d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 --2- 172.21.15.112:0/3651234336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa188161a60 0x7fa1880d2950 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa170009870 tx=0x7fa17001c4a0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 -- 172.21.15.112:0/3651234336 shutdown_connections 2024-09-15T23:55:22.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 --2- 172.21.15.112:0/3651234336 >> v2:172.21.15.169:3300/0 conn(0x7fa1880cf620 0x7fa18806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 --2- 172.21.15.112:0/3651234336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa188161a60 0x7fa1880d2950 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 -- 172.21.15.112:0/3651234336 >> 172.21.15.112:0/3651234336 conn(0x7fa18808bf90 msgr2=0x7fa18809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:22.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 -- 172.21.15.112:0/3651234336 shutdown_connections 2024-09-15T23:55:22.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 -- 172.21.15.112:0/3651234336 wait complete. 2024-09-15T23:55:22.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 Processor -- start 2024-09-15T23:55:22.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 -- start start 2024-09-15T23:55:22.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1880cf620 0x7fa188151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1880d2e90 0x7fa188154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa188161a60 0x7fa1880cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa18806e400 con 0x7fa1880cf620 2024-09-15T23:55:22.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa18806d190 con 0x7fa188161a60 2024-09-15T23:55:22.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18f184640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa18806e580 con 0x7fa1880d2e90 2024-09-15T23:55:22.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18cf20640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1880cf620 0x7fa188151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18cf20640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1880cf620 0x7fa188151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53104/0 (socket says 172.21.15.112:53104) 2024-09-15T23:55:22.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18cf20640 1 -- 172.21.15.112:0/1135521448 learned_addr learned my addr 172.21.15.112:0/1135521448 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:22.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa187fff640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1880d2e90 0x7fa188154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18d721640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa188161a60 0x7fa1880cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18cf20640 1 -- 172.21.15.112:0/1135521448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1880d2e90 msgr2=0x7fa188154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18cf20640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1880d2e90 0x7fa188154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18cf20640 1 -- 172.21.15.112:0/1135521448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa188161a60 msgr2=0x7fa1880cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18cf20640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa188161a60 0x7fa1880cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18cf20640 1 -- 172.21.15.112:0/1135521448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1881612e0 con 0x7fa1880cf620 2024-09-15T23:55:22.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18d721640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa188161a60 0x7fa1880cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:22.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa18cf20640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1880cf620 0x7fa188151740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa17001ab50 tx=0x7fa170019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:22.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.035+0000 7fa1857fa640 1 -- 172.21.15.112:0/1135521448 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1700be610 con 0x7fa1880cf620 2024-09-15T23:55:22.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.039+0000 7fa1857fa640 1 -- 172.21.15.112:0/1135521448 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1700be7d0 con 0x7fa1880cf620 2024-09-15T23:55:22.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.039+0000 7fa18f184640 1 -- 172.21.15.112:0/1135521448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa188154c10 con 0x7fa1880cf620 2024-09-15T23:55:22.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.039+0000 7fa1857fa640 1 -- 172.21.15.112:0/1135521448 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1700bebc0 con 0x7fa1880cf620 2024-09-15T23:55:22.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.039+0000 7fa18f184640 1 -- 172.21.15.112:0/1135521448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1881551d0 con 0x7fa1880cf620 2024-09-15T23:55:22.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.039+0000 7fa18f184640 1 -- 172.21.15.112:0/1135521448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa18806d6b0 con 0x7fa1880cf620 2024-09-15T23:55:22.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.039+0000 7fa1857fa640 1 -- 172.21.15.112:0/1135521448 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1700bc020 con 0x7fa1880cf620 2024-09-15T23:55:22.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.039+0000 7fa1857fa640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa1680678f0 0x7fa168069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.039+0000 7fa187fff640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa1680678f0 0x7fa168069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.039+0000 7fa1857fa640 1 -- 172.21.15.112:0/1135521448 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fa170120500 con 0x7fa1880cf620 2024-09-15T23:55:22.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.039+0000 7fa187fff640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa1680678f0 0x7fa168069db0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa1880cb320 tx=0x7fa178009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:22.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.043+0000 7fa1857fa640 1 -- 172.21.15.112:0/1135521448 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa170016150 con 0x7fa1880cf620 2024-09-15T23:55:22.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.203+0000 7fa18f184640 1 -- 172.21.15.112:0/1135521448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1880b37a0 con 0x7fa1880cf620 2024-09-15T23:55:22.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.207+0000 7fa1857fa640 1 -- 172.21.15.112:0/1135521448 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+13315 (secure 0 0 0) 0x7fa1700f1120 con 0x7fa1880cf620 2024-09-15T23:55:22.212 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:22.212 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":43,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:55:20.879381+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6835/40913641":"2024-09-16T23:55:17.865234+0000","172.21.15.112:6834/40913641":"2024-09-16T23:55:17.865234+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:22.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.207+0000 7fa18f184640 1 -- 172.21.15.112:0/1135521448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa1680678f0 msgr2=0x7fa168069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.207+0000 7fa18f184640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa1680678f0 0x7fa168069db0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa1880cb320 tx=0x7fa178009040 comp rx=0 tx=0).stop 2024-09-15T23:55:22.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.207+0000 7fa18f184640 1 -- 172.21.15.112:0/1135521448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1880cf620 msgr2=0x7fa188151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.207+0000 7fa18f184640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1880cf620 0x7fa188151740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa17001ab50 tx=0x7fa170019240 comp rx=0 tx=0).stop 2024-09-15T23:55:22.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.207+0000 7fa18f184640 1 -- 172.21.15.112:0/1135521448 shutdown_connections 2024-09-15T23:55:22.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.207+0000 7fa18f184640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa1680678f0 0x7fa168069db0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.207+0000 7fa18f184640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa188161a60 0x7fa1880cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.207+0000 7fa18f184640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1880d2e90 0x7fa188154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.207+0000 7fa18f184640 1 --2- 172.21.15.112:0/1135521448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1880cf620 0x7fa188151740 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.207+0000 7fa18f184640 1 -- 172.21.15.112:0/1135521448 >> 172.21.15.112:0/1135521448 conn(0x7fa18808bf90 msgr2=0x7fa1880b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:22.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.207+0000 7fa18f184640 1 -- 172.21.15.112:0/1135521448 shutdown_connections 2024-09-15T23:55:22.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.207+0000 7fa18f184640 1 -- 172.21.15.112:0/1135521448 wait complete. 2024-09-15T23:55:22.235 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:53:39.301069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:55:22.235 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:55:22.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f79def640 1 Processor -- start 2024-09-15T23:55:22.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f79def640 1 -- start start 2024-09-15T23:55:22.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f79def640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8f741520a0 0x7f8f7406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f79def640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8f7415f3a0 0x7f8f740adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f79def640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f74070250 con 0x7f8f7406fe50 2024-09-15T23:55:22.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f79def640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8f74152480 con 0x7f8f741520a0 2024-09-15T23:55:22.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f79def640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8f740aede0 con 0x7f8f7415f3a0 2024-09-15T23:55:22.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f737fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8f741520a0 0x7f8f7406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f737fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8f741520a0 0x7f8f7406f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53112/0 (socket says 172.21.15.112:53112) 2024-09-15T23:55:22.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f737fe640 1 -- 172.21.15.112:0/3955200358 learned_addr learned my addr 172.21.15.112:0/3955200358 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:22.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f72ffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8f7406fe50 0x7f8f7415ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58020/0 (socket says 172.21.15.112:58020) 2024-09-15T23:55:22.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f73fff640 1 --2- 172.21.15.112:0/3955200358 >> v2:172.21.15.169:3300/0 conn(0x7f8f7415f3a0 0x7f8f740adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f737fe640 1 -- 172.21.15.112:0/3955200358 >> v2:172.21.15.169:3300/0 conn(0x7f8f7415f3a0 msgr2=0x7f8f740adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:22.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f737fe640 1 --2- 172.21.15.112:0/3955200358 >> v2:172.21.15.169:3300/0 conn(0x7f8f7415f3a0 0x7f8f740adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f737fe640 1 -- 172.21.15.112:0/3955200358 >> v1:172.21.15.112:6789/0 conn(0x7f8f7406fe50 legacy=0x7f8f7415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f737fe640 1 -- 172.21.15.112:0/3955200358 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7415fa10 con 0x7f8f741520a0 2024-09-15T23:55:22.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.355+0000 7f8f73fff640 1 --2- 172.21.15.112:0/3955200358 >> v2:172.21.15.169:3300/0 conn(0x7f8f7415f3a0 0x7f8f740adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:22.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f737fe640 1 --2- 172.21.15.112:0/3955200358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f741520a0 0x7f8f7406f910 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8f74155b40 tx=0x7f8f6401ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e372df8b87a7818 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:22.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f727fc640 1 -- 172.21.15.112:0/3955200358 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f640a79c0 con 0x7f8f741520a0 2024-09-15T23:55:22.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f727fc640 1 -- 172.21.15.112:0/3955200358 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f640a7b60 con 0x7f8f741520a0 2024-09-15T23:55:22.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f727fc640 1 -- 172.21.15.112:0/3955200358 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f640af3f0 con 0x7f8f741520a0 2024-09-15T23:55:22.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 -- 172.21.15.112:0/3955200358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f741520a0 msgr2=0x7f8f7406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 --2- 172.21.15.112:0/3955200358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f741520a0 0x7f8f7406f910 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8f74155b40 tx=0x7f8f6401ec00 comp rx=0 tx=0).stop 2024-09-15T23:55:22.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 -- 172.21.15.112:0/3955200358 shutdown_connections 2024-09-15T23:55:22.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 --2- 172.21.15.112:0/3955200358 >> v2:172.21.15.169:3300/0 conn(0x7f8f7415f3a0 0x7f8f740adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 --2- 172.21.15.112:0/3955200358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f741520a0 0x7f8f7406f910 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 -- 172.21.15.112:0/3955200358 >> 172.21.15.112:0/3955200358 conn(0x7f8f740b1f90 msgr2=0x7f8f740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:22.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 -- 172.21.15.112:0/3955200358 shutdown_connections 2024-09-15T23:55:22.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 -- 172.21.15.112:0/3955200358 wait complete. 2024-09-15T23:55:22.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 Processor -- start 2024-09-15T23:55:22.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 -- start start 2024-09-15T23:55:22.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f7406fe50 0x7f8f74099340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f741520a0 0x7f8f7414f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7415f3a0 0x7f8f7414f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8f74073d30 con 0x7f8f741520a0 2024-09-15T23:55:22.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8f74073a50 con 0x7f8f7415f3a0 2024-09-15T23:55:22.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f79def640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8f7406e800 con 0x7f8f7406fe50 2024-09-15T23:55:22.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f72ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f741520a0 0x7f8f7414f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f72ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f741520a0 0x7f8f7414f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53118/0 (socket says 172.21.15.112:53118) 2024-09-15T23:55:22.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f72ffd640 1 -- 172.21.15.112:0/3930065758 learned_addr learned my addr 172.21.15.112:0/3930065758 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:22.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f72ffd640 1 -- 172.21.15.112:0/3930065758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f7406fe50 msgr2=0x7f8f74099340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f72ffd640 1 --2- 172.21.15.112:0/3930065758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f7406fe50 0x7f8f74099340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f72ffd640 1 -- 172.21.15.112:0/3930065758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7415f3a0 msgr2=0x7f8f7414f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f72ffd640 1 --2- 172.21.15.112:0/3930065758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7415f3a0 0x7f8f7414f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f72ffd640 1 -- 172.21.15.112:0/3930065758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f74151e60 con 0x7f8f741520a0 2024-09-15T23:55:22.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f72ffd640 1 --2- 172.21.15.112:0/3930065758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f741520a0 0x7f8f7414f290 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800c370 tx=0x7f8f6800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:22.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.359+0000 7f8f5bfff640 1 -- 172.21.15.112:0/3930065758 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f680074e0 con 0x7f8f741520a0 2024-09-15T23:55:22.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.363+0000 7f8f5bfff640 1 -- 172.21.15.112:0/3930065758 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f68007680 con 0x7f8f741520a0 2024-09-15T23:55:22.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.363+0000 7f8f79def640 1 -- 172.21.15.112:0/3930065758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f7414bf10 con 0x7f8f741520a0 2024-09-15T23:55:22.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.363+0000 7f8f5bfff640 1 -- 172.21.15.112:0/3930065758 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f68004a30 con 0x7f8f741520a0 2024-09-15T23:55:22.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.363+0000 7f8f79def640 1 -- 172.21.15.112:0/3930065758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f7414c4d0 con 0x7f8f741520a0 2024-09-15T23:55:22.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.363+0000 7f8f79def640 1 -- 172.21.15.112:0/3930065758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f7406e540 con 0x7f8f741520a0 2024-09-15T23:55:22.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.363+0000 7f8f5bfff640 1 -- 172.21.15.112:0/3930065758 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f6801a020 con 0x7f8f741520a0 2024-09-15T23:55:22.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.363+0000 7f8f5bfff640 1 --2- 172.21.15.112:0/3930065758 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f600678c0 0x7f8f60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.363+0000 7f8f5bfff640 1 -- 172.21.15.112:0/3930065758 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f8f68085210 con 0x7f8f741520a0 2024-09-15T23:55:22.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.363+0000 7f8f737fe640 1 --2- 172.21.15.112:0/3930065758 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f600678c0 0x7f8f60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.363+0000 7f8f737fe640 1 --2- 172.21.15.112:0/3930065758 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f600678c0 0x7f8f60069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8f640b0000 tx=0x7f8f64004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:22.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.367+0000 7f8f5bfff640 1 -- 172.21.15.112:0/3930065758 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8f68055f50 con 0x7f8f741520a0 2024-09-15T23:55:22.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.527+0000 7f8f79def640 1 -- 172.21.15.112:0/3930065758 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8f740adc40 con 0x7f8f741520a0 2024-09-15T23:55:22.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.527+0000 7f8f5bfff640 1 -- 172.21.15.112:0/3930065758 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) ==== 93+0+10 (secure 0 0 0) 0x7f8f68055850 con 0x7f8f741520a0 2024-09-15T23:55:22.534 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-15T23:55:22.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.531+0000 7f8f79def640 1 -- 172.21.15.112:0/3930065758 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f600678c0 msgr2=0x7f8f60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.531+0000 7f8f79def640 1 --2- 172.21.15.112:0/3930065758 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f600678c0 0x7f8f60069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8f640b0000 tx=0x7f8f64004ac0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.531+0000 7f8f79def640 1 -- 172.21.15.112:0/3930065758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f741520a0 msgr2=0x7f8f7414f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.531+0000 7f8f79def640 1 --2- 172.21.15.112:0/3930065758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f741520a0 0x7f8f7414f290 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800c370 tx=0x7f8f6800c830 comp rx=0 tx=0).stop 2024-09-15T23:55:22.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.531+0000 7f8f79def640 1 -- 172.21.15.112:0/3930065758 shutdown_connections 2024-09-15T23:55:22.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.531+0000 7f8f79def640 1 --2- 172.21.15.112:0/3930065758 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f600678c0 0x7f8f60069d80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.531+0000 7f8f79def640 1 --2- 172.21.15.112:0/3930065758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7415f3a0 0x7f8f7414f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.531+0000 7f8f79def640 1 --2- 172.21.15.112:0/3930065758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f741520a0 0x7f8f7414f290 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.531+0000 7f8f79def640 1 --2- 172.21.15.112:0/3930065758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f7406fe50 0x7f8f74099340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.531+0000 7f8f79def640 1 -- 172.21.15.112:0/3930065758 >> 172.21.15.112:0/3930065758 conn(0x7f8f740b1f90 msgr2=0x7f8f7415cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:22.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.531+0000 7f8f79def640 1 -- 172.21.15.112:0/3930065758 shutdown_connections 2024-09-15T23:55:22.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.531+0000 7f8f79def640 1 -- 172.21.15.112:0/3930065758 wait complete. 2024-09-15T23:55:22.554 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit' 2024-09-15T23:55:22.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.671+0000 7f493acfe640 1 Processor -- start 2024-09-15T23:55:22.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.671+0000 7f493acfe640 1 -- start start 2024-09-15T23:55:22.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f493acfe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f49340b3e00 0x7f49340b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f493acfe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49340d19e0 0x7f49340d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f493acfe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f493406e7a0 con 0x7f493415e650 2024-09-15T23:55:22.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f493acfe640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f49340d1550 con 0x7f49340b3e00 2024-09-15T23:55:22.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f493acfe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f49340b4780 con 0x7f49340d19e0 2024-09-15T23:55:22.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f4933fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f49340b3e00 0x7f49340b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f4933fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f49340b3e00 0x7f49340b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53128/0 (socket says 172.21.15.112:53128) 2024-09-15T23:55:22.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f4933fff640 1 -- 172.21.15.112:0/3386466859 learned_addr learned my addr 172.21.15.112:0/3386466859 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:22.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f493929b640 1 --2- 172.21.15.112:0/3386466859 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49340d19e0 0x7f49340d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f4933fff640 1 -- 172.21.15.112:0/3386466859 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49340d19e0 msgr2=0x7f49340d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:22.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f4933fff640 1 --2- 172.21.15.112:0/3386466859 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49340d19e0 0x7f49340d1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f4933fff640 1 -- 172.21.15.112:0/3386466859 >> v1:172.21.15.169:6789/0 conn(0x7f493415e650 legacy=0x7f493406dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:22.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f4933fff640 1 -- 172.21.15.112:0/3386466859 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49340d0f00 con 0x7f49340b3e00 2024-09-15T23:55:22.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f4933fff640 1 --2- 172.21.15.112:0/3386466859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340b3e00 0x7f49340b4240 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4928009870 tx=0x7f492801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d7b8629fb71092 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:22.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f49337fe640 1 -- 172.21.15.112:0/3386466859 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49280b1070 con 0x7f49340b3e00 2024-09-15T23:55:22.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f49337fe640 1 -- 172.21.15.112:0/3386466859 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49280ac410 con 0x7f49340b3e00 2024-09-15T23:55:22.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f49337fe640 1 -- 172.21.15.112:0/3386466859 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49280ac7e0 con 0x7f49340b3e00 2024-09-15T23:55:22.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f493acfe640 1 -- 172.21.15.112:0/3386466859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340b3e00 msgr2=0x7f49340b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f493acfe640 1 --2- 172.21.15.112:0/3386466859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340b3e00 0x7f49340b4240 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4928009870 tx=0x7f492801c520 comp rx=0 tx=0).stop 2024-09-15T23:55:22.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f493acfe640 1 -- 172.21.15.112:0/3386466859 shutdown_connections 2024-09-15T23:55:22.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f493acfe640 1 --2- 172.21.15.112:0/3386466859 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49340d19e0 0x7f49340d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f493acfe640 1 --2- 172.21.15.112:0/3386466859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340b3e00 0x7f49340b4240 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.675+0000 7f493acfe640 1 -- 172.21.15.112:0/3386466859 >> 172.21.15.112:0/3386466859 conn(0x7f493406bcc0 msgr2=0x7f493406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:22.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f493acfe640 1 -- 172.21.15.112:0/3386466859 shutdown_connections 2024-09-15T23:55:22.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f493acfe640 1 -- 172.21.15.112:0/3386466859 wait complete. 2024-09-15T23:55:22.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f493acfe640 1 Processor -- start 2024-09-15T23:55:22.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f493acfe640 1 -- start start 2024-09-15T23:55:22.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f493acfe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49340b3e00 0x7f4934168720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f493acfe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340d19e0 0x7f49340b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f493acfe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f493415e650 0x7f4934153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f493acfe640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f493406e4c0 con 0x7f49340d19e0 2024-09-15T23:55:22.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f493acfe640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f493406e340 con 0x7f493415e650 2024-09-15T23:55:22.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f493acfe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f493416b280 con 0x7f49340b3e00 2024-09-15T23:55:22.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f4933fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340d19e0 0x7f49340b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f4933fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340d19e0 0x7f49340b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53132/0 (socket says 172.21.15.112:53132) 2024-09-15T23:55:22.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f4933fff640 1 -- 172.21.15.112:0/3931357934 learned_addr learned my addr 172.21.15.112:0/3931357934 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:22.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f4938a9a640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49340b3e00 0x7f4934168720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f4933fff640 1 -- 172.21.15.112:0/3931357934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49340b3e00 msgr2=0x7f4934168720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f4933fff640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49340b3e00 0x7f4934168720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f4933fff640 1 -- 172.21.15.112:0/3931357934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f493415e650 msgr2=0x7f4934153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f493929b640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f493415e650 0x7f4934153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f4933fff640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f493415e650 0x7f4934153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f4933fff640 1 -- 172.21.15.112:0/3931357934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493414bb60 con 0x7f49340d19e0 2024-09-15T23:55:22.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f4938a9a640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49340b3e00 0x7f4934168720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:22.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f4933fff640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340d19e0 0x7f49340b5b80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f492801abd0 tx=0x7f49280192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:22.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f49317fa640 1 -- 172.21.15.112:0/3931357934 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49280b1040 con 0x7f49340d19e0 2024-09-15T23:55:22.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f49317fa640 1 -- 172.21.15.112:0/3931357934 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49280ba070 con 0x7f49340d19e0 2024-09-15T23:55:22.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f493acfe640 1 -- 172.21.15.112:0/3931357934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493414be40 con 0x7f49340d19e0 2024-09-15T23:55:22.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f49317fa640 1 -- 172.21.15.112:0/3931357934 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49280b5440 con 0x7f49340d19e0 2024-09-15T23:55:22.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f493acfe640 1 -- 172.21.15.112:0/3931357934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493414c400 con 0x7f49340d19e0 2024-09-15T23:55:22.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.679+0000 7f493acfe640 1 -- 172.21.15.112:0/3931357934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49340b4240 con 0x7f49340d19e0 2024-09-15T23:55:22.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.683+0000 7f49317fa640 1 -- 172.21.15.112:0/3931357934 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f49340d2bc0 con 0x7f49340d19e0 2024-09-15T23:55:22.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.683+0000 7f49317fa640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f49200678c0 0x7f4920069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.683+0000 7f4938a9a640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f49200678c0 0x7f4920069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.683+0000 7f49317fa640 1 -- 172.21.15.112:0/3931357934 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f492811f4c0 con 0x7f49340d19e0 2024-09-15T23:55:22.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.683+0000 7f4938a9a640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f49200678c0 0x7f4920069d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f492400a850 tx=0x7f4924008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:22.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.687+0000 7f49317fa640 1 -- 172.21.15.112:0/3931357934 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4928016110 con 0x7f49340d19e0 2024-09-15T23:55:22.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:22.895+0000 7f493acfe640 1 -- 172.21.15.112:0/3931357934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]} v 0) -- 0x7f49340ce410 con 0x7f49340d19e0 2024-09-15T23:55:23.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:23.891+0000 7f49317fa640 1 -- 172.21.15.112:0/3931357934 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]}]=0 v101) ==== 136+0+0 (secure 0 0 0) 0x7f49280f0170 con 0x7f49340d19e0 2024-09-15T23:55:23.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:23.891+0000 7f493acfe640 1 -- 172.21.15.112:0/3931357934 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f49200678c0 msgr2=0x7f4920069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:23.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:23.891+0000 7f493acfe640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f49200678c0 0x7f4920069d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f492400a850 tx=0x7f4924008040 comp rx=0 tx=0).stop 2024-09-15T23:55:23.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:23.891+0000 7f493acfe640 1 -- 172.21.15.112:0/3931357934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340d19e0 msgr2=0x7f49340b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:23.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:23.891+0000 7f493acfe640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340d19e0 0x7f49340b5b80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f492801abd0 tx=0x7f49280192c0 comp rx=0 tx=0).stop 2024-09-15T23:55:23.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:23.895+0000 7f493acfe640 1 -- 172.21.15.112:0/3931357934 shutdown_connections 2024-09-15T23:55:23.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:23.895+0000 7f493acfe640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f49200678c0 0x7f4920069d80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:23.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:23.895+0000 7f493acfe640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f493415e650 0x7f4934153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:23.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:23.895+0000 7f493acfe640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49340d19e0 0x7f49340b5b80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:23.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:23.895+0000 7f493acfe640 1 --2- 172.21.15.112:0/3931357934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f49340b3e00 0x7f4934168720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:23.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:23.895+0000 7f493acfe640 1 -- 172.21.15.112:0/3931357934 >> 172.21.15.112:0/3931357934 conn(0x7f493406bcc0 msgr2=0x7f4934154d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:23.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:23.895+0000 7f493acfe640 1 -- 172.21.15.112:0/3931357934 shutdown_connections 2024-09-15T23:55:23.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:23.895+0000 7f493acfe640 1 -- 172.21.15.112:0/3931357934 wait complete. 2024-09-15T23:55:23.920 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:55:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f163a788640 1 Processor -- start 2024-09-15T23:55:24.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f163a788640 1 -- start start 2024-09-15T23:55:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f163a788640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1634070020 0x7f163415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f163a788640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f163415f1d0 0x7f16340adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f163a788640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16340aede0 con 0x7f16341520a0 2024-09-15T23:55:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f163a788640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1634152480 con 0x7f163415f1d0 2024-09-15T23:55:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f163a788640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f163415fa10 con 0x7f1634070020 2024-09-15T23:55:24.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f1633fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f16341520a0 0x7f163406f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58024/0 (socket says 172.21.15.112:58024) 2024-09-15T23:55:24.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f1633fff640 1 -- 172.21.15.112:0/3716163272 learned_addr learned my addr 172.21.15.112:0/3716163272 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:24.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 -- 172.21.15.112:0/3716163272 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2760787189 0 0) 0x7f16340aede0 con 0x7f16341520a0 2024-09-15T23:55:24.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 -- 172.21.15.112:0/3716163272 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1620003530 con 0x7f16341520a0 2024-09-15T23:55:24.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f162b7fe640 1 --2- 172.21.15.112:0/3716163272 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1634070020 0x7f163415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f1638d25640 1 --2- 172.21.15.112:0/3716163272 >> v2:172.21.15.169:3300/0 conn(0x7f163415f1d0 0x7f16340adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 -- 172.21.15.112:0/3716163272 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1795722666 0 0) 0x7f1620003530 con 0x7f16341520a0 2024-09-15T23:55:24.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 -- 172.21.15.112:0/3716163272 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1634070020 msgr2=0x7f163415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:24.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 --2- 172.21.15.112:0/3716163272 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1634070020 0x7f163415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 -- 172.21.15.112:0/3716163272 >> v2:172.21.15.169:3300/0 conn(0x7f163415f1d0 msgr2=0x7f16340adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:24.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 --2- 172.21.15.112:0/3716163272 >> v2:172.21.15.169:3300/0 conn(0x7f163415f1d0 0x7f16340adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 -- 172.21.15.112:0/3716163272 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1634074250 con 0x7f16341520a0 2024-09-15T23:55:24.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 -- 172.21.15.112:0/3716163272 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f1624001680 con 0x7f16341520a0 2024-09-15T23:55:24.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 -- 172.21.15.112:0/3716163272 >> v1:172.21.15.112:6789/0 conn(0x7f16341520a0 legacy=0x7f163406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 --2- 172.21.15.112:0/3716163272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16200039c0 0x7f1620003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 --2- 172.21.15.112:0/3716163272 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1634070020 0x7f1620004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 --2- 172.21.15.112:0/3716163272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1620004d50 0x7f16200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 -- 172.21.15.112:0/3716163272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f163415fa10 con 0x7f16200039c0 2024-09-15T23:55:24.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 -- 172.21.15.112:0/3716163272 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f162000ba80 con 0x7f1620004d50 2024-09-15T23:55:24.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f16337fe640 1 -- 172.21.15.112:0/3716163272 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f162000bc00 con 0x7f1634070020 2024-09-15T23:55:24.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.039+0000 7f1633fff640 1 --2- 172.21.15.112:0/3716163272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16200039c0 0x7f1620003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f1638d25640 1 --2- 172.21.15.112:0/3716163272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1620004d50 0x7f16200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f162b7fe640 1 --2- 172.21.15.112:0/3716163272 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1634070020 0x7f1620004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f1633fff640 1 -- 172.21.15.112:0/3716163272 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1634070020 msgr2=0x7f1620004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:24.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f1633fff640 1 --2- 172.21.15.112:0/3716163272 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1634070020 0x7f1620004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f1633fff640 1 -- 172.21.15.112:0/3716163272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1620004d50 msgr2=0x7f16200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:24.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f1633fff640 1 --2- 172.21.15.112:0/3716163272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1620004d50 0x7f16200051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f1633fff640 1 -- 172.21.15.112:0/3716163272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1620003530 con 0x7f16200039c0 2024-09-15T23:55:24.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f1633fff640 1 --2- 172.21.15.112:0/3716163272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16200039c0 0x7f1620003de0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f162400c270 tx=0x7f162401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56f9be7ef0d7ff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:24.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f16337fe640 1 -- 172.21.15.112:0/3716163272 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1624007d20 con 0x7f16200039c0 2024-09-15T23:55:24.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f16337fe640 1 -- 172.21.15.112:0/3716163272 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16240a9070 con 0x7f16200039c0 2024-09-15T23:55:24.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f16337fe640 1 -- 172.21.15.112:0/3716163272 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1624005d60 con 0x7f16200039c0 2024-09-15T23:55:24.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f163a788640 1 -- 172.21.15.112:0/3716163272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16200039c0 msgr2=0x7f1620003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f163a788640 1 --2- 172.21.15.112:0/3716163272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16200039c0 0x7f1620003de0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f162400c270 tx=0x7f162401cc50 comp rx=0 tx=0).stop 2024-09-15T23:55:24.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f1638d25640 1 -- 172.21.15.112:0/3716163272 reap_dead start 2024-09-15T23:55:24.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f163a788640 1 -- 172.21.15.112:0/3716163272 shutdown_connections 2024-09-15T23:55:24.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f163a788640 1 -- 172.21.15.112:0/3716163272 >> 172.21.15.112:0/3716163272 conn(0x7f16340b1f90 msgr2=0x7f16340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:24.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f163a788640 1 -- 172.21.15.112:0/3716163272 shutdown_connections 2024-09-15T23:55:24.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.043+0000 7f163a788640 1 -- 172.21.15.112:0/3716163272 wait complete. 2024-09-15T23:55:24.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f163a788640 1 Processor -- start 2024-09-15T23:55:24.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f163a788640 1 -- start start 2024-09-15T23:55:24.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f163a788640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16200039c0 0x7f1634151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f163a788640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16340cccb0 0x7f16340ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f163a788640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f163415a220 0x7f16341f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f163a788640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f163415f5e0 con 0x7f16200039c0 2024-09-15T23:55:24.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f163a788640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1634073d30 con 0x7f163415a220 2024-09-15T23:55:24.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f163a788640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f163415f760 con 0x7f16340cccb0 2024-09-15T23:55:24.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f1633fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16200039c0 0x7f1634151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f1633fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16200039c0 0x7f1634151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53156/0 (socket says 172.21.15.112:53156) 2024-09-15T23:55:24.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f1633fff640 1 -- 172.21.15.112:0/1002095171 learned_addr learned my addr 172.21.15.112:0/1002095171 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:24.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f1638d25640 1 --2- 172.21.15.112:0/1002095171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f163415a220 0x7f16341f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f162b7fe640 1 --2- 172.21.15.112:0/1002095171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16340cccb0 0x7f16340ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f1633fff640 1 -- 172.21.15.112:0/1002095171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16340cccb0 msgr2=0x7f16340ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f1633fff640 1 --2- 172.21.15.112:0/1002095171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16340cccb0 0x7f16340ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f1633fff640 1 -- 172.21.15.112:0/1002095171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f163415a220 msgr2=0x7f16341f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f1633fff640 1 --2- 172.21.15.112:0/1002095171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f163415a220 0x7f16341f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f1633fff640 1 -- 172.21.15.112:0/1002095171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16340ce9c0 con 0x7f16200039c0 2024-09-15T23:55:24.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f1633fff640 1 --2- 172.21.15.112:0/1002095171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16200039c0 0x7f1634151a90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f162400c210 tx=0x7f1620005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:24.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f16317fa640 1 -- 172.21.15.112:0/1002095171 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1624005d40 con 0x7f16200039c0 2024-09-15T23:55:24.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f16317fa640 1 -- 172.21.15.112:0/1002095171 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16240a5840 con 0x7f16200039c0 2024-09-15T23:55:24.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f163a788640 1 -- 172.21.15.112:0/1002095171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16340cd130 con 0x7f16200039c0 2024-09-15T23:55:24.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f16317fa640 1 -- 172.21.15.112:0/1002095171 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16240a5c30 con 0x7f16200039c0 2024-09-15T23:55:24.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f163a788640 1 -- 172.21.15.112:0/1002095171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16340cd6c0 con 0x7f16200039c0 2024-09-15T23:55:24.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f163a788640 1 -- 172.21.15.112:0/1002095171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16340adc80 con 0x7f16200039c0 2024-09-15T23:55:24.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.047+0000 7f16317fa640 1 -- 172.21.15.112:0/1002095171 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16240047f0 con 0x7f16200039c0 2024-09-15T23:55:24.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.051+0000 7f16317fa640 1 --2- 172.21.15.112:0/1002095171 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f16140678f0 0x7f1614069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.051+0000 7f162b7fe640 1 --2- 172.21.15.112:0/1002095171 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f16140678f0 0x7f1614069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.051+0000 7f16317fa640 1 -- 172.21.15.112:0/1002095171 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f162411f200 con 0x7f16200039c0 2024-09-15T23:55:24.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.051+0000 7f162b7fe640 1 --2- 172.21.15.112:0/1002095171 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f16140678f0 0x7f1614069db0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1634072da0 tx=0x7f161c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:24.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.055+0000 7f16317fa640 1 -- 172.21.15.112:0/1002095171 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1624016990 con 0x7f16200039c0 2024-09-15T23:55:24.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.207+0000 7f163a788640 1 -- 172.21.15.112:0/1002095171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f16340b46c0 con 0x7f16200039c0 2024-09-15T23:55:24.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.215+0000 7f16317fa640 1 -- 172.21.15.112:0/1002095171 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f16240eff40 con 0x7f16200039c0 2024-09-15T23:55:24.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.215+0000 7f163a788640 1 -- 172.21.15.112:0/1002095171 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f16140678f0 msgr2=0x7f1614069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.215+0000 7f163a788640 1 --2- 172.21.15.112:0/1002095171 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f16140678f0 0x7f1614069db0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1634072da0 tx=0x7f161c008040 comp rx=0 tx=0).stop 2024-09-15T23:55:24.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.215+0000 7f163a788640 1 -- 172.21.15.112:0/1002095171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16200039c0 msgr2=0x7f1634151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.215+0000 7f163a788640 1 --2- 172.21.15.112:0/1002095171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16200039c0 0x7f1634151a90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f162400c210 tx=0x7f1620005840 comp rx=0 tx=0).stop 2024-09-15T23:55:24.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.215+0000 7f163a788640 1 -- 172.21.15.112:0/1002095171 shutdown_connections 2024-09-15T23:55:24.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.215+0000 7f163a788640 1 --2- 172.21.15.112:0/1002095171 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f16140678f0 0x7f1614069db0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.215+0000 7f163a788640 1 --2- 172.21.15.112:0/1002095171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f163415a220 0x7f16341f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.215+0000 7f163a788640 1 --2- 172.21.15.112:0/1002095171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16340cccb0 0x7f16340ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.215+0000 7f163a788640 1 --2- 172.21.15.112:0/1002095171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16200039c0 0x7f1634151a90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.215+0000 7f163a788640 1 -- 172.21.15.112:0/1002095171 >> 172.21.15.112:0/1002095171 conn(0x7f16340b1f90 msgr2=0x7f1634160770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:24.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.215+0000 7f163a788640 1 -- 172.21.15.112:0/1002095171 shutdown_connections 2024-09-15T23:55:24.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.215+0000 7f163a788640 1 -- 172.21.15.112:0/1002095171 wait complete. 2024-09-15T23:55:24.237 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:55:24.237 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:55:24.328 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:55:24.396 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:55:24.396 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:55:24.396 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:24.402 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:55:24.402 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:55:24.402 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:24.408 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:55:24.409 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:55:24.409 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:24.451 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:55:24.451 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:55:24.452 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:24.457 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:55:24.457 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:55:24.457 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:24.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.615+0000 7f7c631fe640 1 Processor -- start 2024-09-15T23:55:24.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.615+0000 7f7c631fe640 1 -- start start 2024-09-15T23:55:24.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.615+0000 7f7c631fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7c5c0ce9d0 0x7f7c5c0cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.615+0000 7f7c631fe640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c5c06d9c0 con 0x7f7c5c0cf920 2024-09-15T23:55:24.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.615+0000 7f7c631fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c5c06dca0 con 0x7f7c5c15e5f0 2024-09-15T23:55:24.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.615+0000 7f7c631fe640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7c5c06d7a0 con 0x7f7c5c0ce9d0 2024-09-15T23:55:24.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.615+0000 7f7c5bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7c5c0ce9d0 0x7f7c5c0cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.615+0000 7f7c5bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7c5c0ce9d0 0x7f7c5c0cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53168/0 (socket says 172.21.15.112:53168) 2024-09-15T23:55:24.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.615+0000 7f7c5bfff640 1 -- 172.21.15.112:0/1889427446 learned_addr learned my addr 172.21.15.112:0/1889427446 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:24.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.615+0000 7f7c5bfff640 1 -- 172.21.15.112:0/1889427446 >> v1:172.21.15.169:6789/0 conn(0x7f7c5c15e5f0 legacy=0x7f7c5c06d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:24.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.615+0000 7f7c5bfff640 1 -- 172.21.15.112:0/1889427446 >> v1:172.21.15.112:6789/0 conn(0x7f7c5c0cf920 legacy=0x7f7c5c0d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.615+0000 7f7c5bfff640 1 -- 172.21.15.112:0/1889427446 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5c06df80 con 0x7f7c5c0ce9d0 2024-09-15T23:55:24.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.615+0000 7f7c5b7fe640 1 -- 172.21.15.112:0/1889427446 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 324992679 0 0) 0x7f7c5c06d9c0 con 0x7f7c5c0cf920 2024-09-15T23:55:24.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c5bfff640 1 --2- 172.21.15.112:0/1889427446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c5c0ce9d0 0x7f7c5c0cf3e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009870 tx=0x7f7c5001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c467c7a2e12b366c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:24.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c5b7fe640 1 -- 172.21.15.112:0/1889427446 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c500ab430 con 0x7f7c5c0ce9d0 2024-09-15T23:55:24.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c5b7fe640 1 -- 172.21.15.112:0/1889427446 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c500b0070 con 0x7f7c5c0ce9d0 2024-09-15T23:55:24.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c5b7fe640 1 -- 172.21.15.112:0/1889427446 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c500ab7f0 con 0x7f7c5c0ce9d0 2024-09-15T23:55:24.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 -- 172.21.15.112:0/1889427446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c5c0ce9d0 msgr2=0x7f7c5c0cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 --2- 172.21.15.112:0/1889427446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c5c0ce9d0 0x7f7c5c0cf3e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009870 tx=0x7f7c5001c520 comp rx=0 tx=0).stop 2024-09-15T23:55:24.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 -- 172.21.15.112:0/1889427446 shutdown_connections 2024-09-15T23:55:24.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 --2- 172.21.15.112:0/1889427446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c5c0ce9d0 0x7f7c5c0cf3e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 -- 172.21.15.112:0/1889427446 >> 172.21.15.112:0/1889427446 conn(0x7f7c5c074030 msgr2=0x7f7c5c09d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:24.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 -- 172.21.15.112:0/1889427446 shutdown_connections 2024-09-15T23:55:24.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 -- 172.21.15.112:0/1889427446 wait complete. 2024-09-15T23:55:24.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 Processor -- start 2024-09-15T23:55:24.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 -- start start 2024-09-15T23:55:24.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c5c0cf920 0x7f7c5c15dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c5c0b9380 0x7f7c5c150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c5c0b7360 0x7f7c5c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c0d3c90 con 0x7f7c5c0b9380 2024-09-15T23:55:24.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c0cfd90 con 0x7f7c5c0cf920 2024-09-15T23:55:24.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c631fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7c5c16bfb0 con 0x7f7c5c0b7360 2024-09-15T23:55:24.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c5bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c5c0b9380 0x7f7c5c150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c5bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c5c0b9380 0x7f7c5c150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53174/0 (socket says 172.21.15.112:53174) 2024-09-15T23:55:24.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c5bfff640 1 -- 172.21.15.112:0/2078973503 learned_addr learned my addr 172.21.15.112:0/2078973503 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:24.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c5bfff640 1 -- 172.21.15.112:0/2078973503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c5c0b7360 msgr2=0x7f7c5c0b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c5bfff640 1 --2- 172.21.15.112:0/2078973503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c5c0b7360 0x7f7c5c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c5bfff640 1 -- 172.21.15.112:0/2078973503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c5c0cf920 msgr2=0x7f7c5c15dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c5bfff640 1 --2- 172.21.15.112:0/2078973503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c5c0cf920 0x7f7c5c15dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c5bfff640 1 -- 172.21.15.112:0/2078973503 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5c150aa0 con 0x7f7c5c0b9380 2024-09-15T23:55:24.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.619+0000 7f7c5bfff640 1 --2- 172.21.15.112:0/2078973503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c5c0b9380 0x7f7c5c150150 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7c50019130 tx=0x7f7c5001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:24.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.623+0000 7f7c597fa640 1 -- 172.21.15.112:0/2078973503 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c500b48c0 con 0x7f7c5c0b9380 2024-09-15T23:55:24.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.623+0000 7f7c597fa640 1 -- 172.21.15.112:0/2078973503 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c500b4a60 con 0x7f7c5c0b9380 2024-09-15T23:55:24.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.623+0000 7f7c631fe640 1 -- 172.21.15.112:0/2078973503 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c5c0b9a60 con 0x7f7c5c0b9380 2024-09-15T23:55:24.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.623+0000 7f7c597fa640 1 -- 172.21.15.112:0/2078973503 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c500b4e30 con 0x7f7c5c0b9380 2024-09-15T23:55:24.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.623+0000 7f7c631fe640 1 -- 172.21.15.112:0/2078973503 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c5c0ba020 con 0x7f7c5c0b9380 2024-09-15T23:55:24.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.623+0000 7f7c631fe640 1 -- 172.21.15.112:0/2078973503 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c5c0d1c10 con 0x7f7c5c0b9380 2024-09-15T23:55:24.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.623+0000 7f7c597fa640 1 -- 172.21.15.112:0/2078973503 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7c500bd390 con 0x7f7c5c0b9380 2024-09-15T23:55:24.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.623+0000 7f7c597fa640 1 --2- 172.21.15.112:0/2078973503 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7c480678c0 0x7f7c48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.623+0000 7f7c597fa640 1 -- 172.21.15.112:0/2078973503 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f7c500a8070 con 0x7f7c5c0b9380 2024-09-15T23:55:24.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.623+0000 7f7c60f9a640 1 --2- 172.21.15.112:0/2078973503 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7c480678c0 0x7f7c48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.623+0000 7f7c60f9a640 1 --2- 172.21.15.112:0/2078973503 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7c480678c0 0x7f7c48069d80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c156600 tx=0x7f7c4c0079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:24.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.627+0000 7f7c597fa640 1 -- 172.21.15.112:0/2078973503 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7c50124070 con 0x7f7c5c0b9380 2024-09-15T23:55:24.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.811+0000 7f7c631fe640 1 -- 172.21.15.112:0/2078973503 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c5c0d4180 con 0x7f7c5c0b9380 2024-09-15T23:55:24.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.811+0000 7f7c597fa640 1 -- 172.21.15.112:0/2078973503 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3923 (secure 0 0 0) 0x7f7c50016110 con 0x7f7c5c0b9380 2024-09-15T23:55:24.817 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:24.817 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":17,"btime":"2024-09-15T23:55:18:868148+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1357012609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1357012609},{"type":"v1","addr":"172.21.15.169:6835","nonce":1357012609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4618,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2931559222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2931559222},{"type":"v1","addr":"172.21.15.112:6837","nonce":2931559222}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1936572340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1936572340},{"type":"v1","addr":"172.21.15.169:6833","nonce":1936572340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2298263126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2298263126},{"type":"v1","addr":"172.21.15.112:6835","nonce":2298263126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[]} 2024-09-15T23:55:24.817 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 17 2024-09-15T23:55:24.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.815+0000 7f7c631fe640 1 -- 172.21.15.112:0/2078973503 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7c480678c0 msgr2=0x7f7c48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.815+0000 7f7c631fe640 1 --2- 172.21.15.112:0/2078973503 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7c480678c0 0x7f7c48069d80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c156600 tx=0x7f7c4c0079c0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.815+0000 7f7c631fe640 1 -- 172.21.15.112:0/2078973503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c5c0b9380 msgr2=0x7f7c5c150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.815+0000 7f7c631fe640 1 --2- 172.21.15.112:0/2078973503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c5c0b9380 0x7f7c5c150150 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7c50019130 tx=0x7f7c5001ad60 comp rx=0 tx=0).stop 2024-09-15T23:55:24.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.815+0000 7f7c631fe640 1 -- 172.21.15.112:0/2078973503 shutdown_connections 2024-09-15T23:55:24.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.815+0000 7f7c631fe640 1 --2- 172.21.15.112:0/2078973503 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7c480678c0 0x7f7c48069d80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.815+0000 7f7c631fe640 1 --2- 172.21.15.112:0/2078973503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c5c0b7360 0x7f7c5c0b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.815+0000 7f7c631fe640 1 --2- 172.21.15.112:0/2078973503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c5c0b9380 0x7f7c5c150150 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.815+0000 7f7c631fe640 1 --2- 172.21.15.112:0/2078973503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c5c0cf920 0x7f7c5c15dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.815+0000 7f7c631fe640 1 -- 172.21.15.112:0/2078973503 >> 172.21.15.112:0/2078973503 conn(0x7f7c5c0ce9d0 msgr2=0x7f7c5c074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:24.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.815+0000 7f7c631fe640 1 -- 172.21.15.112:0/2078973503 shutdown_connections 2024-09-15T23:55:24.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:24.815+0000 7f7c631fe640 1 -- 172.21.15.112:0/2078973503 wait complete. 2024-09-15T23:55:24.835 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:55:24.835 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:55:24.835 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:55:24.835 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:55:24.835 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:55:24.835 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:55:24.836 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:55:24.836 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:55:24.836 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:55:24.836 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:55:24.836 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:55:24.836 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:55:24.836 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:55:24.837 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:55:24.837 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:55:24.837 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:55:24.845 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:55:24.845 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:55:24.846 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:55:24.846 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:55:24.851 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:55:24.851 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:55:24.852 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:55:24.852 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:55:24.898 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:55:24.898 DEBUG:teuthology.parallel:result is None 2024-09-15T23:55:24.899 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:55:24.899 DEBUG:teuthology.parallel:result is None 2024-09-15T23:55:24.900 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:55:24.900 DEBUG:teuthology.parallel:result is None 2024-09-15T23:55:24.900 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:55:24.901 DEBUG:teuthology.parallel:result is None 2024-09-15T23:55:24.901 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:55:24.954 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-15T23:55:24.960 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-15T23:55:24.970 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-15T23:55:24.970 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-09-15T23:55:25.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.003+0000 7fa65f27c640 1 Processor -- start 2024-09-15T23:55:25.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.003+0000 7fa65f27c640 1 -- start start 2024-09-15T23:55:25.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.003+0000 7fa65f27c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa65815e450 0x7fa65809aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:25.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.003+0000 7fa65f27c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa6580b40c0 0x7fa65815fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:25.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.003+0000 7fa65f27c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6580b5c90 con 0x7fa65806bcc0 2024-09-15T23:55:25.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.003+0000 7fa65f27c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa6580b4860 con 0x7fa6580b40c0 2024-09-15T23:55:25.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.003+0000 7fa65f27c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa6580b4580 con 0x7fa65815e450 2024-09-15T23:55:25.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.003+0000 7fa65c817640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa6580b40c0 0x7fa65815fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:25.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.003+0000 7fa65d018640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa65815e450 0x7fa65809aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:25.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.003+0000 7fa65d819640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fa65806bcc0 0x7fa658162370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:52348/0 (socket says 172.21.15.112:52348) 2024-09-15T23:55:25.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.003+0000 7fa65d819640 1 -- 172.21.15.112:0/3547361730 learned_addr learned my addr 172.21.15.112:0/3547361730 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:25.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa65c817640 1 -- 172.21.15.112:0/3547361730 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa65815e450 msgr2=0x7fa65809aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:25.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa65c817640 1 --2- 172.21.15.112:0/3547361730 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa65815e450 0x7fa65809aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:25.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa65c817640 1 -- 172.21.15.112:0/3547361730 >> v1:172.21.15.169:6789/0 conn(0x7fa65806bcc0 legacy=0x7fa658162370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:25.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa65c817640 1 -- 172.21.15.112:0/3547361730 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6580b5f10 con 0x7fa6580b40c0 2024-09-15T23:55:25.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa64ffff640 1 -- 172.21.15.112:0/3547361730 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3556130247 0 0) 0x7fa6540014a0 con 0x7fa65806bcc0 2024-09-15T23:55:25.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa65d018640 1 --2- 172.21.15.112:0/3547361730 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa65815e450 0x7fa65809aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:55:25.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa65c817640 1 --2- 172.21.15.112:0/3547361730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6580b40c0 0x7fa65815fc60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa6480097c0 tx=0x7fa64801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3eb7e3a83ad3227 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:25.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa64ffff640 1 -- 172.21.15.112:0/3547361730 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480b0070 con 0x7fa6580b40c0 2024-09-15T23:55:25.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa64ffff640 1 -- 172.21.15.112:0/3547361730 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6480ab600 con 0x7fa6580b40c0 2024-09-15T23:55:25.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa64ffff640 1 -- 172.21.15.112:0/3547361730 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480ab9d0 con 0x7fa6580b40c0 2024-09-15T23:55:25.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa65f27c640 1 -- 172.21.15.112:0/3547361730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6580b40c0 msgr2=0x7fa65815fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:25.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa65f27c640 1 --2- 172.21.15.112:0/3547361730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6580b40c0 0x7fa65815fc60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa6480097c0 tx=0x7fa64801c410 comp rx=0 tx=0).stop 2024-09-15T23:55:25.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa65f27c640 1 -- 172.21.15.112:0/3547361730 shutdown_connections 2024-09-15T23:55:25.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa65f27c640 1 --2- 172.21.15.112:0/3547361730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6580b40c0 0x7fa65815fc60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:25.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa65f27c640 1 --2- 172.21.15.112:0/3547361730 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa65815e450 0x7fa65809aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:25.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa65f27c640 1 -- 172.21.15.112:0/3547361730 >> 172.21.15.112:0/3547361730 conn(0x7fa6580b6800 msgr2=0x7fa6580b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:25.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa65f27c640 1 -- 172.21.15.112:0/3547361730 shutdown_connections 2024-09-15T23:55:25.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.007+0000 7fa65f27c640 1 -- 172.21.15.112:0/3547361730 wait complete. 2024-09-15T23:55:25.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65f27c640 1 Processor -- start 2024-09-15T23:55:25.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65f27c640 1 -- start start 2024-09-15T23:55:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65f27c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa65806bcc0 0x7fa65815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65f27c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6580b40c0 0x7fa6581511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65f27c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa65815e450 0x7fa6581f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65f27c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa65815f9c0 con 0x7fa6580b40c0 2024-09-15T23:55:25.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65f27c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa65815f840 con 0x7fa65815e450 2024-09-15T23:55:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65f27c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa658162e90 con 0x7fa65806bcc0 2024-09-15T23:55:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65c817640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6580b40c0 0x7fa6581511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65c817640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6580b40c0 0x7fa6581511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53212/0 (socket says 172.21.15.112:53212) 2024-09-15T23:55:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65c817640 1 -- 172.21.15.112:0/1920146505 learned_addr learned my addr 172.21.15.112:0/1920146505 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65d018640 1 --2- 172.21.15.112:0/1920146505 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa65806bcc0 0x7fa65815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65d819640 1 --2- 172.21.15.112:0/1920146505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa65815e450 0x7fa6581f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65c817640 1 -- 172.21.15.112:0/1920146505 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa65806bcc0 msgr2=0x7fa65815aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65c817640 1 --2- 172.21.15.112:0/1920146505 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa65806bcc0 0x7fa65815aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65c817640 1 -- 172.21.15.112:0/1920146505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa65815e450 msgr2=0x7fa6581f87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65c817640 1 --2- 172.21.15.112:0/1920146505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa65815e450 0x7fa6581f87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65c817640 1 -- 172.21.15.112:0/1920146505 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6581f9080 con 0x7fa6580b40c0 2024-09-15T23:55:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65c817640 1 --2- 172.21.15.112:0/1920146505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6580b40c0 0x7fa6581511f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa6480ae040 tx=0x7fa6480191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa64dffb640 1 -- 172.21.15.112:0/1920146505 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480b8020 con 0x7fa6580b40c0 2024-09-15T23:55:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa64dffb640 1 -- 172.21.15.112:0/1920146505 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6480b4410 con 0x7fa6580b40c0 2024-09-15T23:55:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65f27c640 1 -- 172.21.15.112:0/1920146505 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6581f9360 con 0x7fa6580b40c0 2024-09-15T23:55:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa64dffb640 1 -- 172.21.15.112:0/1920146505 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480b0040 con 0x7fa6580b40c0 2024-09-15T23:55:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65f27c640 1 -- 172.21.15.112:0/1920146505 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6581f9c00 con 0x7fa6580b40c0 2024-09-15T23:55:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65f27c640 1 -- 172.21.15.112:0/1920146505 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6581f9530 con 0x7fa6580b40c0 2024-09-15T23:55:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa64dffb640 1 -- 172.21.15.112:0/1920146505 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa6480bb020 con 0x7fa6580b40c0 2024-09-15T23:55:25.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa64dffb640 1 --2- 172.21.15.112:0/1920146505 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa63c0678c0 0x7fa63c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:25.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa65d018640 1 --2- 172.21.15.112:0/1920146505 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa63c0678c0 0x7fa63c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:25.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.011+0000 7fa64dffb640 1 -- 172.21.15.112:0/1920146505 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fa64811f380 con 0x7fa6580b40c0 2024-09-15T23:55:25.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.015+0000 7fa65d018640 1 --2- 172.21.15.112:0/1920146505 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa63c0678c0 0x7fa63c069d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa650009580 tx=0x7fa650009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:25.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.019+0000 7fa64dffb640 1 -- 172.21.15.112:0/1920146505 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa6480c2030 con 0x7fa6580b40c0 2024-09-15T23:55:25.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.187+0000 7fa65f27c640 1 -- 172.21.15.112:0/1920146505 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa65815fc60 con 0x7fa6580b40c0 2024-09-15T23:55:25.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.907+0000 7fa64dffb640 1 -- 172.21.15.112:0/1920146505 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v45) ==== 97+0+0 (secure 0 0 0) 0x7fa648016090 con 0x7fa6580b40c0 2024-09-15T23:55:25.912 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-15T23:55:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.911+0000 7fa65f27c640 1 -- 172.21.15.112:0/1920146505 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa63c0678c0 msgr2=0x7fa63c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.911+0000 7fa65f27c640 1 --2- 172.21.15.112:0/1920146505 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa63c0678c0 0x7fa63c069d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa650009580 tx=0x7fa650009190 comp rx=0 tx=0).stop 2024-09-15T23:55:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.911+0000 7fa65f27c640 1 -- 172.21.15.112:0/1920146505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6580b40c0 msgr2=0x7fa6581511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.911+0000 7fa65f27c640 1 --2- 172.21.15.112:0/1920146505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6580b40c0 0x7fa6581511f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa6480ae040 tx=0x7fa6480191b0 comp rx=0 tx=0).stop 2024-09-15T23:55:25.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.911+0000 7fa65f27c640 1 -- 172.21.15.112:0/1920146505 shutdown_connections 2024-09-15T23:55:25.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.911+0000 7fa65f27c640 1 --2- 172.21.15.112:0/1920146505 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa63c0678c0 0x7fa63c069d80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:25.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.911+0000 7fa65f27c640 1 --2- 172.21.15.112:0/1920146505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa65815e450 0x7fa6581f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:25.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.911+0000 7fa65f27c640 1 --2- 172.21.15.112:0/1920146505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6580b40c0 0x7fa6581511f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:25.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.911+0000 7fa65f27c640 1 --2- 172.21.15.112:0/1920146505 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa65806bcc0 0x7fa65815aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:25.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.911+0000 7fa65f27c640 1 -- 172.21.15.112:0/1920146505 >> 172.21.15.112:0/1920146505 conn(0x7fa6580b6800 msgr2=0x7fa6580b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:25.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.911+0000 7fa65f27c640 1 -- 172.21.15.112:0/1920146505 shutdown_connections 2024-09-15T23:55:25.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:25.911+0000 7fa65f27c640 1 -- 172.21.15.112:0/1920146505 wait complete. 2024-09-15T23:55:25.937 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:55:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b84082640 1 Processor -- start 2024-09-15T23:55:26.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b84082640 1 -- start start 2024-09-15T23:55:26.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b84082640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4b7c1520a0 0x7f4b7c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b84082640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4b7c06fe50 0x7f4b7c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b84082640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b7c15f1d0 0x7f4b7c071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b84082640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4b7c152480 con 0x7f4b7c1520a0 2024-09-15T23:55:26.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b84082640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f4b7c070250 con 0x7f4b7c06fe50 2024-09-15T23:55:26.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b84082640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7c0aede0 con 0x7f4b7c15f1d0 2024-09-15T23:55:26.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b81e1e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4b7c1520a0 0x7f4b7c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b81e1e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4b7c1520a0 0x7f4b7c06f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53224/0 (socket says 172.21.15.112:53224) 2024-09-15T23:55:26.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b81e1e640 1 -- 172.21.15.112:0/1805405969 learned_addr learned my addr 172.21.15.112:0/1805405969 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:26.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b81e1e640 1 -- 172.21.15.112:0/1805405969 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b7c15f1d0 msgr2=0x7f4b7c071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:26.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b81e1e640 1 --2- 172.21.15.112:0/1805405969 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b7c15f1d0 0x7f4b7c071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b81e1e640 1 -- 172.21.15.112:0/1805405969 >> v2:172.21.15.169:3300/0 conn(0x7f4b7c06fe50 msgr2=0x7f4b7c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:26.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b8161d640 1 --2- 172.21.15.112:0/1805405969 >> v2:172.21.15.169:3300/0 conn(0x7f4b7c06fe50 0x7f4b7c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b81e1e640 1 --2- 172.21.15.112:0/1805405969 >> v2:172.21.15.169:3300/0 conn(0x7f4b7c06fe50 0x7f4b7c15ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.063+0000 7f4b81e1e640 1 -- 172.21.15.112:0/1805405969 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7c15fa10 con 0x7f4b7c1520a0 2024-09-15T23:55:26.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b81e1e640 1 --2- 172.21.15.112:0/1805405969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b7c1520a0 0x7f4b7c06f910 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c06e510 tx=0x7f4b7801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13860001b6bd5c42 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:26.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b80e1c640 1 -- 172.21.15.112:0/1805405969 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b780b0070 con 0x7f4b7c1520a0 2024-09-15T23:55:26.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b80e1c640 1 -- 172.21.15.112:0/1805405969 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b780ab600 con 0x7f4b7c1520a0 2024-09-15T23:55:26.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b80e1c640 1 -- 172.21.15.112:0/1805405969 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b780ab9d0 con 0x7f4b7c1520a0 2024-09-15T23:55:26.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 -- 172.21.15.112:0/1805405969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b7c1520a0 msgr2=0x7f4b7c06f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 --2- 172.21.15.112:0/1805405969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b7c1520a0 0x7f4b7c06f910 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c06e510 tx=0x7f4b7801c240 comp rx=0 tx=0).stop 2024-09-15T23:55:26.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 -- 172.21.15.112:0/1805405969 shutdown_connections 2024-09-15T23:55:26.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 --2- 172.21.15.112:0/1805405969 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b7c15f1d0 0x7f4b7c071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 --2- 172.21.15.112:0/1805405969 >> v2:172.21.15.169:3300/0 conn(0x7f4b7c06fe50 0x7f4b7c15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 --2- 172.21.15.112:0/1805405969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b7c1520a0 0x7f4b7c06f910 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 -- 172.21.15.112:0/1805405969 >> 172.21.15.112:0/1805405969 conn(0x7f4b7c0b1f90 msgr2=0x7f4b7c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:26.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 -- 172.21.15.112:0/1805405969 shutdown_connections 2024-09-15T23:55:26.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 -- 172.21.15.112:0/1805405969 wait complete. 2024-09-15T23:55:26.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 Processor -- start 2024-09-15T23:55:26.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 -- start start 2024-09-15T23:55:26.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b7c06fe50 0x7f4b7c0997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b7c1520a0 0x7f4b7c14e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b7c15f1d0 0x7f4b7c14ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c073d30 con 0x7f4b7c06fe50 2024-09-15T23:55:26.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c073a50 con 0x7f4b7c1520a0 2024-09-15T23:55:26.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b84082640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7c15f640 con 0x7f4b7c15f1d0 2024-09-15T23:55:26.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b81e1e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b7c06fe50 0x7f4b7c0997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b81e1e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b7c06fe50 0x7f4b7c0997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53232/0 (socket says 172.21.15.112:53232) 2024-09-15T23:55:26.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b81e1e640 1 -- 172.21.15.112:0/3408964135 learned_addr learned my addr 172.21.15.112:0/3408964135 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:26.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b8161d640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b7c1520a0 0x7f4b7c14e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b8261f640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b7c15f1d0 0x7f4b7c14ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b81e1e640 1 -- 172.21.15.112:0/3408964135 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b7c15f1d0 msgr2=0x7f4b7c14ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b81e1e640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b7c15f1d0 0x7f4b7c14ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b81e1e640 1 -- 172.21.15.112:0/3408964135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b7c1520a0 msgr2=0x7f4b7c14e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b81e1e640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b7c1520a0 0x7f4b7c14e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b81e1e640 1 -- 172.21.15.112:0/3408964135 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7c0b0ca0 con 0x7f4b7c06fe50 2024-09-15T23:55:26.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b8261f640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b7c15f1d0 0x7f4b7c14ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:26.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b81e1e640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b7c06fe50 0x7f4b7c0997f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4b780ae040 tx=0x7f4b78018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:26.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.067+0000 7f4b727fc640 1 -- 172.21.15.112:0/3408964135 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b780b0040 con 0x7f4b7c06fe50 2024-09-15T23:55:26.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.071+0000 7f4b727fc640 1 -- 172.21.15.112:0/3408964135 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b780b9070 con 0x7f4b7c06fe50 2024-09-15T23:55:26.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.071+0000 7f4b84082640 1 -- 172.21.15.112:0/3408964135 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b7c0b0f80 con 0x7f4b7c06fe50 2024-09-15T23:55:26.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.071+0000 7f4b727fc640 1 -- 172.21.15.112:0/3408964135 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b780b48a0 con 0x7f4b7c06fe50 2024-09-15T23:55:26.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.071+0000 7f4b84082640 1 -- 172.21.15.112:0/3408964135 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b7c0b1540 con 0x7f4b7c06fe50 2024-09-15T23:55:26.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.071+0000 7f4b84082640 1 -- 172.21.15.112:0/3408964135 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b7c06f910 con 0x7f4b7c06fe50 2024-09-15T23:55:26.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.071+0000 7f4b727fc640 1 -- 172.21.15.112:0/3408964135 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b780ab4c0 con 0x7f4b7c06fe50 2024-09-15T23:55:26.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.071+0000 7f4b727fc640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b600678c0 0x7f4b60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.071+0000 7f4b8161d640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b600678c0 0x7f4b60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.071+0000 7f4b727fc640 1 -- 172.21.15.112:0/3408964135 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7f4b7811f980 con 0x7f4b7c06fe50 2024-09-15T23:55:26.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.071+0000 7f4b8161d640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b600678c0 0x7f4b60069d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0cf4a0 tx=0x7f4b6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:26.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.075+0000 7f4b727fc640 1 -- 172.21.15.112:0/3408964135 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4b780160f0 con 0x7f4b7c06fe50 2024-09-15T23:55:26.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.295+0000 7f4b84082640 1 -- 172.21.15.112:0/3408964135 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4b7c06e540 con 0x7f4b7c06fe50 2024-09-15T23:55:26.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.295+0000 7f4b727fc640 1 -- 172.21.15.112:0/3408964135 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f4b780f0710 con 0x7f4b7c06fe50 2024-09-15T23:55:26.302 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:26.303 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:55:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-15T23:55:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-15T23:55:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmPvLEFBAA/WS7KNQ60+LzhOcQyCVWoQ==", 2024-09-15T23:55:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:55:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:55:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:55:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-15T23:55:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmN/+jIxAAiXM9onNC3twhiZrqCdWtUQ==", 2024-09-15T23:55:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:55:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:55:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:55:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-15T23:55:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmEbNbHRAAjP+2Z2XYc0tarO48R/ocIQ==", 2024-09-15T23:55:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:55:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:55:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:55:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-15T23:55:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmg6AqLBAAZ3PKcarPcPfvIWSTnE5uLA==", 2024-09-15T23:55:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:55:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:55:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:55:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-15T23:55:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBRc+dmnOKMBxAAdaIaYmXKAFGIPTxfYt2apQ==", 2024-09-15T23:55:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:55:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:55:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-15T23:55:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBUc+dmnowGFhAAa3jXrvZ0An+9IwM9988mvQ==", 2024-09-15T23:55:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:55:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:55:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-15T23:55:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBXc+dmnj9kJRAAZbpx5TM2ukiLKqi+iZAE5g==", 2024-09-15T23:55:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:55:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:55:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-15T23:55:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBac+dmAdXtNxAA8g+Nxz1RyVf+P8KOtkw5qw==", 2024-09-15T23:55:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:55:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:55:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-15T23:55:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBhc+dmyOApAhAA9Cv9nW1b5JvO9cH9emao4A==", 2024-09-15T23:55:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:55:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:55:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-15T23:55:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBkc+dmFIDwDxAAR/59kfrjiLU4emIqtthfRg==", 2024-09-15T23:55:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:55:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:55:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-15T23:55:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBnc+dmZVB/IRAAFbvodnxisklCL/yuD+F5ew==", 2024-09-15T23:55:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:55:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:55:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-15T23:55:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBqc+dmuty6LxAAHWB/GByU/hXOL/+dnRpcVA==", 2024-09-15T23:55:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:55:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:55:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-15T23:55:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw==", 2024-09-15T23:55:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:55:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-15T23:55:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:55:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-15T23:55:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmmP6vORAAqxzX3OjoHnionZo1koIqRQ==", 2024-09-15T23:55:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:55:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:55:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:55:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:55:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-15T23:55:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmj2XtNhAAB5620fN0Kr8Cqgd2+1cebg==", 2024-09-15T23:55:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:55:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:55:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:55:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:55:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-15T23:55:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBOc+dmt+I7AxAA+eyV3eaThbjRNo0zJT9OQg==", 2024-09-15T23:55:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:55:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:55:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:55:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:55:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-15T23:55:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBMc+dmDuzBORAAzpiXmO3QO+1RKRvPGQLViQ==", 2024-09-15T23:55:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:55:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:55:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:55:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-15T23:55:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dm4JK5ERAA3d3OABWXchejCqjJRrhTfQ==", 2024-09-15T23:55:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:55:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-15T23:55:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-15T23:55:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dm5nULDxAAi9UvgPZ7sU/Zz2jLKsu4ng==", 2024-09-15T23:55:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:55:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:55:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-15T23:55:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:55:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-15T23:55:26.317 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:55:26.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.299+0000 7f4b84082640 1 -- 172.21.15.112:0/3408964135 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b600678c0 msgr2=0x7f4b60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.299+0000 7f4b84082640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b600678c0 0x7f4b60069d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0cf4a0 tx=0x7f4b6c008040 comp rx=0 tx=0).stop 2024-09-15T23:55:26.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.299+0000 7f4b84082640 1 -- 172.21.15.112:0/3408964135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b7c06fe50 msgr2=0x7f4b7c0997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.299+0000 7f4b84082640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b7c06fe50 0x7f4b7c0997f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4b780ae040 tx=0x7f4b78018fe0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.299+0000 7f4b84082640 1 -- 172.21.15.112:0/3408964135 shutdown_connections 2024-09-15T23:55:26.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.299+0000 7f4b84082640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b600678c0 0x7f4b60069d80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.299+0000 7f4b84082640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b7c15f1d0 0x7f4b7c14ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.299+0000 7f4b84082640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b7c1520a0 0x7f4b7c14e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.299+0000 7f4b84082640 1 --2- 172.21.15.112:0/3408964135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b7c06fe50 0x7f4b7c0997f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.299+0000 7f4b84082640 1 -- 172.21.15.112:0/3408964135 >> 172.21.15.112:0/3408964135 conn(0x7f4b7c0b1f90 msgr2=0x7f4b7c14f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:26.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.299+0000 7f4b84082640 1 -- 172.21.15.112:0/3408964135 shutdown_connections 2024-09-15T23:55:26.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.299+0000 7f4b84082640 1 -- 172.21.15.112:0/3408964135 wait complete. 2024-09-15T23:55:26.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:55:26.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.439+0000 7f854e707640 1 Processor -- start 2024-09-15T23:55:26.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.439+0000 7f854e707640 1 -- start start 2024-09-15T23:55:26.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f854e707640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f85480b39a0 0x7f854806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f854e707640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854806ec60 con 0x7f854806e4b0 2024-09-15T23:55:26.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f854e707640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854806ef40 con 0x7f85481587a0 2024-09-15T23:55:26.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f854e707640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f854806f870 con 0x7f85480b39a0 2024-09-15T23:55:26.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f85477fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f85480b39a0 0x7f854806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f85477fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f85480b39a0 0x7f854806df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53238/0 (socket says 172.21.15.112:53238) 2024-09-15T23:55:26.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f85477fe640 1 -- 172.21.15.112:0/1011470895 learned_addr learned my addr 172.21.15.112:0/1011470895 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:26.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f854cca4640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f854806e4b0 0x7f8548072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58052/0 (socket says 172.21.15.112:58052) 2024-09-15T23:55:26.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f85477fe640 1 -- 172.21.15.112:0/1011470895 >> v1:172.21.15.169:6789/0 conn(0x7f85481587a0 legacy=0x7f85480b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:26.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f8546ffd640 1 -- 172.21.15.112:0/1011470895 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1445561925 0 0) 0x7f854806ec60 con 0x7f854806e4b0 2024-09-15T23:55:26.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f85477fe640 1 -- 172.21.15.112:0/1011470895 >> v1:172.21.15.112:6789/0 conn(0x7f854806e4b0 legacy=0x7f8548072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f85477fe640 1 -- 172.21.15.112:0/1011470895 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854806f220 con 0x7f85480b39a0 2024-09-15T23:55:26.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f85477fe640 1 --2- 172.21.15.112:0/1011470895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85480b39a0 0x7f854806df70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f854806f9f0 tx=0x7f853001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e29c33bf7289c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:26.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f8546ffd640 1 -- 172.21.15.112:0/1011470895 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85300a58d0 con 0x7f85480b39a0 2024-09-15T23:55:26.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f8546ffd640 1 -- 172.21.15.112:0/1011470895 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85300a5a70 con 0x7f85480b39a0 2024-09-15T23:55:26.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.443+0000 7f8546ffd640 1 -- 172.21.15.112:0/1011470895 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85300a5e40 con 0x7f85480b39a0 2024-09-15T23:55:26.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 -- 172.21.15.112:0/1011470895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85480b39a0 msgr2=0x7f854806df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 --2- 172.21.15.112:0/1011470895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85480b39a0 0x7f854806df70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f854806f9f0 tx=0x7f853001c9e0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 -- 172.21.15.112:0/1011470895 shutdown_connections 2024-09-15T23:55:26.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 --2- 172.21.15.112:0/1011470895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85480b39a0 0x7f854806df70 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 -- 172.21.15.112:0/1011470895 >> 172.21.15.112:0/1011470895 conn(0x7f85480b1f90 msgr2=0x7f85480b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:26.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 -- 172.21.15.112:0/1011470895 shutdown_connections 2024-09-15T23:55:26.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 -- 172.21.15.112:0/1011470895 wait complete. 2024-09-15T23:55:26.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 Processor -- start 2024-09-15T23:55:26.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 -- start start 2024-09-15T23:55:26.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f854806e4b0 0x7f8548154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85480b39a0 0x7f8548157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85481587a0 0x7f8548147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8548073200 con 0x7f85480b39a0 2024-09-15T23:55:26.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8548073080 con 0x7f854806e4b0 2024-09-15T23:55:26.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8548073380 con 0x7f85481587a0 2024-09-15T23:55:26.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f85477fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85480b39a0 0x7f8548157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f85477fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85480b39a0 0x7f8548157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53246/0 (socket says 172.21.15.112:53246) 2024-09-15T23:55:26.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f85477fe640 1 -- 172.21.15.112:0/3713744444 learned_addr learned my addr 172.21.15.112:0/3713744444 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:26.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f85477fe640 1 -- 172.21.15.112:0/3713744444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85481587a0 msgr2=0x7f8548147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f85477fe640 1 --2- 172.21.15.112:0/3713744444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85481587a0 0x7f8548147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f85477fe640 1 -- 172.21.15.112:0/3713744444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f854806e4b0 msgr2=0x7f8548154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f8547fff640 1 --2- 172.21.15.112:0/3713744444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f854806e4b0 0x7f8548154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f85477fe640 1 --2- 172.21.15.112:0/3713744444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f854806e4b0 0x7f8548154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f85477fe640 1 -- 172.21.15.112:0/3713744444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8548156350 con 0x7f85480b39a0 2024-09-15T23:55:26.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f85477fe640 1 --2- 172.21.15.112:0/3713744444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85480b39a0 0x7f8548157140 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f853001b090 tx=0x7f8530019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:26.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f8544ff9640 1 -- 172.21.15.112:0/3713744444 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85300bc030 con 0x7f85480b39a0 2024-09-15T23:55:26.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f8544ff9640 1 -- 172.21.15.112:0/3713744444 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85300090d0 con 0x7f85480b39a0 2024-09-15T23:55:26.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 -- 172.21.15.112:0/3713744444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8548154e40 con 0x7f85480b39a0 2024-09-15T23:55:26.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f8544ff9640 1 -- 172.21.15.112:0/3713744444 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85300a58d0 con 0x7f85480b39a0 2024-09-15T23:55:26.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.447+0000 7f854e707640 1 -- 172.21.15.112:0/3713744444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8548152c80 con 0x7f85480b39a0 2024-09-15T23:55:26.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.451+0000 7f854e707640 1 -- 172.21.15.112:0/3713744444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8548070080 con 0x7f85480b39a0 2024-09-15T23:55:26.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.451+0000 7f8544ff9640 1 -- 172.21.15.112:0/3713744444 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f85300bf070 con 0x7f85480b39a0 2024-09-15T23:55:26.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.451+0000 7f8544ff9640 1 --2- 172.21.15.112:0/3713744444 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f85280678c0 0x7f8528069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.451+0000 7f8544ff9640 1 -- 172.21.15.112:0/3713744444 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7f8530121620 con 0x7f85480b39a0 2024-09-15T23:55:26.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.451+0000 7f8547fff640 1 --2- 172.21.15.112:0/3713744444 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f85280678c0 0x7f8528069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.451+0000 7f8547fff640 1 --2- 172.21.15.112:0/3713744444 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f85280678c0 0x7f8528069d80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8540000f70 tx=0x7f8540009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:26.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.455+0000 7f8544ff9640 1 -- 172.21.15.112:0/3713744444 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8548154e40 con 0x7f85480b39a0 2024-09-15T23:55:26.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.615+0000 7f854e707640 1 -- 172.21.15.112:0/3713744444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f85481602d0 con 0x7f85480b39a0 2024-09-15T23:55:26.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.619+0000 7f8544ff9640 1 -- 172.21.15.112:0/3713744444 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) ==== 84+0+65 (secure 0 0 0) 0x7f8548156350 con 0x7f85480b39a0 2024-09-15T23:55:26.623 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:26.623 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-15T23:55:26.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:55:26.623 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-15T23:55:26.623 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-15T23:55:26.623 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:26.623 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-15T23:55:26.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.619+0000 7f854e707640 1 -- 172.21.15.112:0/3713744444 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f85280678c0 msgr2=0x7f8528069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.619+0000 7f854e707640 1 --2- 172.21.15.112:0/3713744444 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f85280678c0 0x7f8528069d80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8540000f70 tx=0x7f8540009040 comp rx=0 tx=0).stop 2024-09-15T23:55:26.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.619+0000 7f854e707640 1 -- 172.21.15.112:0/3713744444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85480b39a0 msgr2=0x7f8548157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.619+0000 7f854e707640 1 --2- 172.21.15.112:0/3713744444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85480b39a0 0x7f8548157140 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f853001b090 tx=0x7f8530019780 comp rx=0 tx=0).stop 2024-09-15T23:55:26.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.619+0000 7f854e707640 1 -- 172.21.15.112:0/3713744444 shutdown_connections 2024-09-15T23:55:26.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.619+0000 7f854e707640 1 --2- 172.21.15.112:0/3713744444 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f85280678c0 0x7f8528069d80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.619+0000 7f854e707640 1 --2- 172.21.15.112:0/3713744444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85481587a0 0x7f8548147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.619+0000 7f854e707640 1 --2- 172.21.15.112:0/3713744444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85480b39a0 0x7f8548157140 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.619+0000 7f854e707640 1 --2- 172.21.15.112:0/3713744444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f854806e4b0 0x7f8548154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.619+0000 7f854e707640 1 -- 172.21.15.112:0/3713744444 >> 172.21.15.112:0/3713744444 conn(0x7f85480b1f90 msgr2=0x7f85481607f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:26.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.619+0000 7f854e707640 1 -- 172.21.15.112:0/3713744444 shutdown_connections 2024-09-15T23:55:26.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.619+0000 7f854e707640 1 -- 172.21.15.112:0/3713744444 wait complete. 2024-09-15T23:55:26.641 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:55:26.641 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:55:26.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c4719640 1 Processor -- start 2024-09-15T23:55:26.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c4719640 1 -- start start 2024-09-15T23:55:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c4719640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53bc147570 0x7f53bc06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c4719640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53bc06d310 0x7f53bc0b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c4719640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f53bc0b4820 0x7f53bc161dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c4719640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f53bc0b4c70 con 0x7f53bc147570 2024-09-15T23:55:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c4719640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f53bc06e330 con 0x7f53bc0b4820 2024-09-15T23:55:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c4719640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f53bc06d7b0 con 0x7f53bc06d310 2024-09-15T23:55:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c24b5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53bc147570 0x7f53bc06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c24b5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53bc147570 0x7f53bc06cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53258/0 (socket says 172.21.15.112:53258) 2024-09-15T23:55:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c24b5640 1 -- 172.21.15.112:0/2553155580 learned_addr learned my addr 172.21.15.112:0/2553155580 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:26.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c2cb6640 1 --2- 172.21.15.112:0/2553155580 >> v2:172.21.15.169:3300/0 conn(0x7f53bc0b4820 0x7f53bc161dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c1cb4640 1 --2- 172.21.15.112:0/2553155580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53bc06d310 0x7f53bc0b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c24b5640 1 -- 172.21.15.112:0/2553155580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53bc06d310 msgr2=0x7f53bc0b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:26.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c24b5640 1 --2- 172.21.15.112:0/2553155580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53bc06d310 0x7f53bc0b42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c24b5640 1 -- 172.21.15.112:0/2553155580 >> v2:172.21.15.169:3300/0 conn(0x7f53bc0b4820 msgr2=0x7f53bc161dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:26.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c24b5640 1 --2- 172.21.15.112:0/2553155580 >> v2:172.21.15.169:3300/0 conn(0x7f53bc0b4820 0x7f53bc161dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.763+0000 7f53c24b5640 1 -- 172.21.15.112:0/2553155580 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53bc06da90 con 0x7f53bc147570 2024-09-15T23:55:26.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c24b5640 1 --2- 172.21.15.112:0/2553155580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53bc147570 0x7f53bc06cdd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f53bc0b4ee0 tx=0x7f53b801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8016a6fb1e01047c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:26.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c14b3640 1 -- 172.21.15.112:0/2553155580 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b80b0070 con 0x7f53bc147570 2024-09-15T23:55:26.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c14b3640 1 -- 172.21.15.112:0/2553155580 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b80ab600 con 0x7f53bc147570 2024-09-15T23:55:26.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c14b3640 1 -- 172.21.15.112:0/2553155580 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b80ab9d0 con 0x7f53bc147570 2024-09-15T23:55:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 -- 172.21.15.112:0/2553155580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53bc147570 msgr2=0x7f53bc06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 --2- 172.21.15.112:0/2553155580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53bc147570 0x7f53bc06cdd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f53bc0b4ee0 tx=0x7f53b801c260 comp rx=0 tx=0).stop 2024-09-15T23:55:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 -- 172.21.15.112:0/2553155580 shutdown_connections 2024-09-15T23:55:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 --2- 172.21.15.112:0/2553155580 >> v2:172.21.15.169:3300/0 conn(0x7f53bc0b4820 0x7f53bc161dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 --2- 172.21.15.112:0/2553155580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53bc06d310 0x7f53bc0b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 --2- 172.21.15.112:0/2553155580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53bc147570 0x7f53bc06cdd0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 -- 172.21.15.112:0/2553155580 >> 172.21.15.112:0/2553155580 conn(0x7f53bc06c0c0 msgr2=0x7f53bc06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:26.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 -- 172.21.15.112:0/2553155580 shutdown_connections 2024-09-15T23:55:26.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 -- 172.21.15.112:0/2553155580 wait complete. 2024-09-15T23:55:26.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 Processor -- start 2024-09-15T23:55:26.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 -- start start 2024-09-15T23:55:26.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53bc06d310 0x7f53bc13d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53bc0b4820 0x7f53bc15bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53bc147570 0x7f53bc15c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f53bc072930 con 0x7f53bc06d310 2024-09-15T23:55:26.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f53bc0727b0 con 0x7f53bc147570 2024-09-15T23:55:26.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c4719640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f53bc15eb70 con 0x7f53bc0b4820 2024-09-15T23:55:26.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c24b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53bc06d310 0x7f53bc13d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c24b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53bc06d310 0x7f53bc13d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53264/0 (socket says 172.21.15.112:53264) 2024-09-15T23:55:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.767+0000 7f53c24b5640 1 -- 172.21.15.112:0/753143305 learned_addr learned my addr 172.21.15.112:0/753143305 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53c1cb4640 1 --2- 172.21.15.112:0/753143305 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53bc0b4820 0x7f53bc15bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53c24b5640 1 -- 172.21.15.112:0/753143305 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53bc0b4820 msgr2=0x7f53bc15bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53c24b5640 1 --2- 172.21.15.112:0/753143305 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53bc0b4820 0x7f53bc15bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53c24b5640 1 -- 172.21.15.112:0/753143305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53bc147570 msgr2=0x7f53bc15c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53c24b5640 1 --2- 172.21.15.112:0/753143305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53bc147570 0x7f53bc15c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53c24b5640 1 -- 172.21.15.112:0/753143305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53bc1453d0 con 0x7f53bc06d310 2024-09-15T23:55:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53c24b5640 1 --2- 172.21.15.112:0/753143305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53bc06d310 0x7f53bc13d7b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f53b80ae040 tx=0x7f53b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53b2ffd640 1 -- 172.21.15.112:0/753143305 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b80b8020 con 0x7f53bc06d310 2024-09-15T23:55:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53b2ffd640 1 -- 172.21.15.112:0/753143305 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b80b4630 con 0x7f53bc06d310 2024-09-15T23:55:26.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53c4719640 1 -- 172.21.15.112:0/753143305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53bc15d2f0 con 0x7f53bc06d310 2024-09-15T23:55:26.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53b2ffd640 1 -- 172.21.15.112:0/753143305 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b80b0040 con 0x7f53bc06d310 2024-09-15T23:55:26.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53c4719640 1 -- 172.21.15.112:0/753143305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53bc15d8b0 con 0x7f53bc06d310 2024-09-15T23:55:26.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53c4719640 1 -- 172.21.15.112:0/753143305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53bc161dc0 con 0x7f53bc06d310 2024-09-15T23:55:26.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53b2ffd640 1 -- 172.21.15.112:0/753143305 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53b80bb020 con 0x7f53bc06d310 2024-09-15T23:55:26.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53b2ffd640 1 --2- 172.21.15.112:0/753143305 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f53a00678c0 0x7f53a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53b2ffd640 1 -- 172.21.15.112:0/753143305 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7f53b811f370 con 0x7f53bc06d310 2024-09-15T23:55:26.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53c1cb4640 1 --2- 172.21.15.112:0/753143305 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f53a00678c0 0x7f53a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.771+0000 7f53c1cb4640 1 --2- 172.21.15.112:0/753143305 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f53a00678c0 0x7f53a0069d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f53bc15e260 tx=0x7f53ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:26.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.775+0000 7f53b2ffd640 1 -- 172.21.15.112:0/753143305 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f53b80c2070 con 0x7f53bc06d310 2024-09-15T23:55:26.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:26.947+0000 7f53c4719640 1 -- 172.21.15.112:0/753143305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f53bc06c690 con 0x7f53bc06d310 2024-09-15T23:55:27.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:27.919+0000 7f53b2ffd640 1 -- 172.21.15.112:0/753143305 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) ==== 138+0+0 (secure 0 0 0) 0x7f53b8016110 con 0x7f53bc06d310 2024-09-15T23:55:27.924 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-15T23:55:27.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:27.923+0000 7f53c4719640 1 -- 172.21.15.112:0/753143305 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f53a00678c0 msgr2=0x7f53a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:27.923+0000 7f53c4719640 1 --2- 172.21.15.112:0/753143305 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f53a00678c0 0x7f53a0069d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f53bc15e260 tx=0x7f53ac008040 comp rx=0 tx=0).stop 2024-09-15T23:55:27.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:27.923+0000 7f53c4719640 1 -- 172.21.15.112:0/753143305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53bc06d310 msgr2=0x7f53bc13d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:27.923+0000 7f53c4719640 1 --2- 172.21.15.112:0/753143305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53bc06d310 0x7f53bc13d7b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f53b80ae040 tx=0x7f53b8019000 comp rx=0 tx=0).stop 2024-09-15T23:55:27.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:27.923+0000 7f53c4719640 1 -- 172.21.15.112:0/753143305 shutdown_connections 2024-09-15T23:55:27.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:27.923+0000 7f53c4719640 1 --2- 172.21.15.112:0/753143305 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f53a00678c0 0x7f53a0069d80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:27.923+0000 7f53c4719640 1 --2- 172.21.15.112:0/753143305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53bc147570 0x7f53bc15c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:27.923+0000 7f53c4719640 1 --2- 172.21.15.112:0/753143305 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53bc0b4820 0x7f53bc15bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:27.923+0000 7f53c4719640 1 --2- 172.21.15.112:0/753143305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53bc06d310 0x7f53bc13d7b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:27.923+0000 7f53c4719640 1 -- 172.21.15.112:0/753143305 >> 172.21.15.112:0/753143305 conn(0x7f53bc06c0c0 msgr2=0x7f53bc15f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:27.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:27.923+0000 7f53c4719640 1 -- 172.21.15.112:0/753143305 shutdown_connections 2024-09-15T23:55:27.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:27.923+0000 7f53c4719640 1 -- 172.21.15.112:0/753143305 wait complete. 2024-09-15T23:55:27.956 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:55:28.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1adc8d7640 1 Processor -- start 2024-09-15T23:55:28.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1adc8d7640 1 -- start start 2024-09-15T23:55:28.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1adc8d7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ad80cc870 0x7f1ad80cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:28.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1adc8d7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1ad8073100 0x7f1ad80ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:28.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1adc8d7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ad80cd190 con 0x7f1ad80cdfd0 2024-09-15T23:55:28.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1adc8d7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1ad80ce8d0 con 0x7f1ad8073100 2024-09-15T23:55:28.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1adc8d7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1ad80cebb0 con 0x7f1ad80cc870 2024-09-15T23:55:28.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1ad659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ad80cc870 0x7f1ad80cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:28.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1ad5d9b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1ad8073100 0x7f1ad80ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:28.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1ad659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ad80cc870 0x7f1ad80cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:52536/0 (socket says 172.21.15.112:52536) 2024-09-15T23:55:28.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1ad659c640 1 -- 172.21.15.112:0/1519333868 learned_addr learned my addr 172.21.15.112:0/1519333868 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:28.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1ad6d9d640 1 --1- 172.21.15.112:0/1519333868 >> v1:172.21.15.169:6789/0 conn(0x7f1ad80cdfd0 0x7f1ad806de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:52366/0 (socket says 172.21.15.112:52366) 2024-09-15T23:55:28.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1ad659c640 1 -- 172.21.15.112:0/1519333868 >> v2:172.21.15.169:3300/0 conn(0x7f1ad8073100 msgr2=0x7f1ad80ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:28.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1ad659c640 1 --2- 172.21.15.112:0/1519333868 >> v2:172.21.15.169:3300/0 conn(0x7f1ad8073100 0x7f1ad80ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1ad659c640 1 -- 172.21.15.112:0/1519333868 >> v1:172.21.15.169:6789/0 conn(0x7f1ad80cdfd0 legacy=0x7f1ad806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:28.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.079+0000 7f1ad659c640 1 -- 172.21.15.112:0/1519333868 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad80cee90 con 0x7f1ad80cc870 2024-09-15T23:55:28.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.083+0000 7f1ad659c640 1 --2- 172.21.15.112:0/1519333868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ad80cc870 0x7f1ad80cf970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009e50 tx=0x7f1ad806ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=380192097e2fcffe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:28.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.083+0000 7f1ad559a640 1 -- 172.21.15.112:0/1519333868 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad00a58d0 con 0x7f1ad80cc870 2024-09-15T23:55:28.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.083+0000 7f1ad559a640 1 -- 172.21.15.112:0/1519333868 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad00a5a70 con 0x7f1ad80cc870 2024-09-15T23:55:28.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.083+0000 7f1ad559a640 1 -- 172.21.15.112:0/1519333868 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad00a5e40 con 0x7f1ad80cc870 2024-09-15T23:55:28.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.083+0000 7f1adc8d7640 1 -- 172.21.15.112:0/1519333868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ad80cc870 msgr2=0x7f1ad80cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:28.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.083+0000 7f1adc8d7640 1 --2- 172.21.15.112:0/1519333868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ad80cc870 0x7f1ad80cf970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009e50 tx=0x7f1ad806ed20 comp rx=0 tx=0).stop 2024-09-15T23:55:28.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.083+0000 7f1adc8d7640 1 -- 172.21.15.112:0/1519333868 shutdown_connections 2024-09-15T23:55:28.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.083+0000 7f1adc8d7640 1 --2- 172.21.15.112:0/1519333868 >> v2:172.21.15.169:3300/0 conn(0x7f1ad8073100 0x7f1ad80ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.083+0000 7f1adc8d7640 1 --2- 172.21.15.112:0/1519333868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ad80cc870 0x7f1ad80cf970 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.083+0000 7f1adc8d7640 1 -- 172.21.15.112:0/1519333868 >> 172.21.15.112:0/1519333868 conn(0x7f1ad80b1c80 msgr2=0x7f1ad80b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:28.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.083+0000 7f1adc8d7640 1 -- 172.21.15.112:0/1519333868 shutdown_connections 2024-09-15T23:55:28.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.083+0000 7f1adc8d7640 1 -- 172.21.15.112:0/1519333868 wait complete. 2024-09-15T23:55:28.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.083+0000 7f1adc8d7640 1 Processor -- start 2024-09-15T23:55:28.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1adc8d7640 1 -- start start 2024-09-15T23:55:28.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1adc8d7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ad8073100 0x7f1ad815bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:28.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1adc8d7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ad80cc870 0x7f1ad815ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:28.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1adc8d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad80cdfd0 0x7f1ad815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:28.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1adc8d7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad8169310 con 0x7f1ad80cdfd0 2024-09-15T23:55:28.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1adc8d7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad8169190 con 0x7f1ad80cc870 2024-09-15T23:55:28.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1adc8d7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1ad8169490 con 0x7f1ad8073100 2024-09-15T23:55:28.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ad6d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad80cdfd0 0x7f1ad815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:28.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ad6d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad80cdfd0 0x7f1ad815eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53270/0 (socket says 172.21.15.112:53270) 2024-09-15T23:55:28.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ad6d9d640 1 -- 172.21.15.112:0/587318685 learned_addr learned my addr 172.21.15.112:0/587318685 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ad5d9b640 1 --2- 172.21.15.112:0/587318685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ad80cc870 0x7f1ad815ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ad659c640 1 --2- 172.21.15.112:0/587318685 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ad8073100 0x7f1ad815bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ad6d9d640 1 -- 172.21.15.112:0/587318685 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ad8073100 msgr2=0x7f1ad815bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ad6d9d640 1 --2- 172.21.15.112:0/587318685 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ad8073100 0x7f1ad815bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ad6d9d640 1 -- 172.21.15.112:0/587318685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ad80cc870 msgr2=0x7f1ad815ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ad6d9d640 1 --2- 172.21.15.112:0/587318685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ad80cc870 0x7f1ad815ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ad6d9d640 1 -- 172.21.15.112:0/587318685 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad81f8050 con 0x7f1ad80cdfd0 2024-09-15T23:55:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ad6d9d640 1 --2- 172.21.15.112:0/587318685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad80cdfd0 0x7f1ad815eaf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800c3c0 tx=0x7f1ac800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ac6ffd640 1 -- 172.21.15.112:0/587318685 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac80074e0 con 0x7f1ad80cdfd0 2024-09-15T23:55:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ac6ffd640 1 -- 172.21.15.112:0/587318685 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac8007680 con 0x7f1ad80cdfd0 2024-09-15T23:55:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1adc8d7640 1 -- 172.21.15.112:0/587318685 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad81f8330 con 0x7f1ad80cdfd0 2024-09-15T23:55:28.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ac6ffd640 1 -- 172.21.15.112:0/587318685 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8004a10 con 0x7f1ad80cdfd0 2024-09-15T23:55:28.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1adc8d7640 1 -- 172.21.15.112:0/587318685 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad81f88f0 con 0x7f1ad80cdfd0 2024-09-15T23:55:28.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1adc8d7640 1 -- 172.21.15.112:0/587318685 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ad809cd40 con 0x7f1ad80cdfd0 2024-09-15T23:55:28.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ac6ffd640 1 -- 172.21.15.112:0/587318685 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ac801a020 con 0x7f1ad80cdfd0 2024-09-15T23:55:28.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.087+0000 7f1ac6ffd640 1 --2- 172.21.15.112:0/587318685 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ab80678c0 0x7f1ab8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:28.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.091+0000 7f1ac6ffd640 1 -- 172.21.15.112:0/587318685 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5619+0+0 (secure 0 0 0) 0x7f1ac8085af0 con 0x7f1ad80cdfd0 2024-09-15T23:55:28.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.091+0000 7f1ad659c640 1 --2- 172.21.15.112:0/587318685 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ab80678c0 0x7f1ab8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:28.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.091+0000 7f1ad659c640 1 --2- 172.21.15.112:0/587318685 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ab80678c0 0x7f1ab8069d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1ad00ae000 tx=0x7f1ad0004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:28.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.095+0000 7f1ac6ffd640 1 -- 172.21.15.112:0/587318685 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1ac8021070 con 0x7f1ad80cdfd0 2024-09-15T23:55:28.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.255+0000 7f1adc8d7640 1 -- 172.21.15.112:0/587318685 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1ad80ccc50 con 0x7f1ad80cdfd0 2024-09-15T23:55:28.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.927+0000 7f1ac6ffd640 1 -- 172.21.15.112:0/587318685 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) ==== 170+0+0 (secure 0 0 0) 0x7f1ac8056760 con 0x7f1ad80cdfd0 2024-09-15T23:55:28.934 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-15T23:55:28.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.931+0000 7f1adc8d7640 1 -- 172.21.15.112:0/587318685 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ab80678c0 msgr2=0x7f1ab8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:28.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.931+0000 7f1adc8d7640 1 --2- 172.21.15.112:0/587318685 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ab80678c0 0x7f1ab8069d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1ad00ae000 tx=0x7f1ad0004ac0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.931+0000 7f1adc8d7640 1 -- 172.21.15.112:0/587318685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad80cdfd0 msgr2=0x7f1ad815eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:28.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.931+0000 7f1adc8d7640 1 --2- 172.21.15.112:0/587318685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad80cdfd0 0x7f1ad815eaf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800c3c0 tx=0x7f1ac800c880 comp rx=0 tx=0).stop 2024-09-15T23:55:28.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.931+0000 7f1adc8d7640 1 -- 172.21.15.112:0/587318685 shutdown_connections 2024-09-15T23:55:28.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.931+0000 7f1adc8d7640 1 --2- 172.21.15.112:0/587318685 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ab80678c0 0x7f1ab8069d80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.931+0000 7f1adc8d7640 1 --2- 172.21.15.112:0/587318685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ad80cdfd0 0x7f1ad815eaf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.931+0000 7f1adc8d7640 1 --2- 172.21.15.112:0/587318685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ad80cc870 0x7f1ad815ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.931+0000 7f1adc8d7640 1 --2- 172.21.15.112:0/587318685 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ad8073100 0x7f1ad815bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.931+0000 7f1adc8d7640 1 -- 172.21.15.112:0/587318685 >> 172.21.15.112:0/587318685 conn(0x7f1ad80b1c80 msgr2=0x7f1ad80afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:28.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.931+0000 7f1adc8d7640 1 -- 172.21.15.112:0/587318685 shutdown_connections 2024-09-15T23:55:28.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:28.931+0000 7f1adc8d7640 1 -- 172.21.15.112:0/587318685 wait complete. 2024-09-15T23:55:28.972 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:55:29.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f696d953640 1 Processor -- start 2024-09-15T23:55:29.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f696d953640 1 -- start start 2024-09-15T23:55:29.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f696d953640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6968070020 0x7f696815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:29.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f696d953640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f696815f1d0 0x7f69680adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:29.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f696d953640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69680aede0 con 0x7f69681520a0 2024-09-15T23:55:29.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f696d953640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6968152480 con 0x7f6968070020 2024-09-15T23:55:29.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f696d953640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f696815fa10 con 0x7f696815f1d0 2024-09-15T23:55:29.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f69667fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6968070020 0x7f696815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:29.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f69667fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6968070020 0x7f696815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41090/0 (socket says 172.21.15.112:41090) 2024-09-15T23:55:29.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f69667fc640 1 -- 172.21.15.112:0/2038021399 learned_addr learned my addr 172.21.15.112:0/2038021399 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:29.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f6966ffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f69681520a0 0x7f696806f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41818/0 (socket says 172.21.15.112:41818) 2024-09-15T23:55:29.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f69677fe640 1 --2- 172.21.15.112:0/2038021399 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f696815f1d0 0x7f69680adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:29.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f69667fc640 1 -- 172.21.15.112:0/2038021399 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f696815f1d0 msgr2=0x7f69680adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:29.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f69667fc640 1 --2- 172.21.15.112:0/2038021399 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f696815f1d0 0x7f69680adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f69667fc640 1 -- 172.21.15.112:0/2038021399 >> v1:172.21.15.112:6789/0 conn(0x7f69681520a0 legacy=0x7f696806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:29.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f69667fc640 1 -- 172.21.15.112:0/2038021399 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6968074250 con 0x7f6968070020 2024-09-15T23:55:29.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f6965ffb640 1 -- 172.21.15.112:0/2038021399 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 50906505 0 0) 0x7f69680aede0 con 0x7f69681520a0 2024-09-15T23:55:29.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.091+0000 7f69677fe640 1 --2- 172.21.15.112:0/2038021399 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f696815f1d0 0x7f69680adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:29.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f69667fc640 1 --2- 172.21.15.112:0/2038021399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070020 0x7f696815ec90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f695c009870 tx=0x7f695c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51cd36fc28763359 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:29.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f6965ffb640 1 -- 172.21.15.112:0/2038021399 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c0a95f0 con 0x7f6968070020 2024-09-15T23:55:29.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f6965ffb640 1 -- 172.21.15.112:0/2038021399 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f695c0a9790 con 0x7f6968070020 2024-09-15T23:55:29.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f6965ffb640 1 -- 172.21.15.112:0/2038021399 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c0a9b60 con 0x7f6968070020 2024-09-15T23:55:29.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 -- 172.21.15.112:0/2038021399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070020 msgr2=0x7f696815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:29.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 --2- 172.21.15.112:0/2038021399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070020 0x7f696815ec90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f695c009870 tx=0x7f695c01c530 comp rx=0 tx=0).stop 2024-09-15T23:55:29.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 -- 172.21.15.112:0/2038021399 shutdown_connections 2024-09-15T23:55:29.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 --2- 172.21.15.112:0/2038021399 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f696815f1d0 0x7f69680adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 --2- 172.21.15.112:0/2038021399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070020 0x7f696815ec90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 -- 172.21.15.112:0/2038021399 >> 172.21.15.112:0/2038021399 conn(0x7f69680b1f90 msgr2=0x7f69680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:29.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 -- 172.21.15.112:0/2038021399 shutdown_connections 2024-09-15T23:55:29.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 -- 172.21.15.112:0/2038021399 wait complete. 2024-09-15T23:55:29.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 Processor -- start 2024-09-15T23:55:29.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 -- start start 2024-09-15T23:55:29.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070020 0x7f69681f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:29.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69681520a0 0x7f69681465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:29.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f696815f1d0 0x7f696815d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:29.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f696815f5e0 con 0x7f6968070020 2024-09-15T23:55:29.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6968073d30 con 0x7f696815f1d0 2024-09-15T23:55:29.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f696815f760 con 0x7f69681520a0 2024-09-15T23:55:29.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f6966ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070020 0x7f69681f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:29.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f6966ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070020 0x7f69681f5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41094/0 (socket says 172.21.15.112:41094) 2024-09-15T23:55:29.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f6966ffd640 1 -- 172.21.15.112:0/2739575275 learned_addr learned my addr 172.21.15.112:0/2739575275 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:29.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f69677fe640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f696815f1d0 0x7f696815d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:29.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f69667fc640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69681520a0 0x7f69681465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:29.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f6966ffd640 1 -- 172.21.15.112:0/2739575275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69681520a0 msgr2=0x7f69681465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:29.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f6966ffd640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69681520a0 0x7f69681465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f6966ffd640 1 -- 172.21.15.112:0/2739575275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f696815f1d0 msgr2=0x7f696815d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:29.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f6966ffd640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f696815f1d0 0x7f696815d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f6966ffd640 1 -- 172.21.15.112:0/2739575275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696814ab90 con 0x7f6968070020 2024-09-15T23:55:29.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f69677fe640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f696815f1d0 0x7f696815d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:29.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f6966ffd640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070020 0x7f69681f5390 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f695800c480 tx=0x7f695800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:29.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f694ffff640 1 -- 172.21.15.112:0/2739575275 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958018070 con 0x7f6968070020 2024-09-15T23:55:29.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f694ffff640 1 -- 172.21.15.112:0/2739575275 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6958007500 con 0x7f6968070020 2024-09-15T23:55:29.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f696d953640 1 -- 172.21.15.112:0/2739575275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696814ae70 con 0x7f6968070020 2024-09-15T23:55:29.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.095+0000 7f694ffff640 1 -- 172.21.15.112:0/2739575275 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958004a30 con 0x7f6968070020 2024-09-15T23:55:29.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.099+0000 7f696d953640 1 -- 172.21.15.112:0/2739575275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f696814b430 con 0x7f6968070020 2024-09-15T23:55:29.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.099+0000 7f696d953640 1 -- 172.21.15.112:0/2739575275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f696815ec90 con 0x7f6968070020 2024-09-15T23:55:29.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.099+0000 7f694ffff640 1 -- 172.21.15.112:0/2739575275 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f695801b070 con 0x7f6968070020 2024-09-15T23:55:29.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.099+0000 7f694ffff640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f69540678c0 0x7f6954069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:29.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.099+0000 7f694ffff640 1 -- 172.21.15.112:0/2739575275 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6001+0+0 (secure 0 0 0) 0x7f6958085130 con 0x7f6968070020 2024-09-15T23:55:29.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.099+0000 7f69667fc640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f69540678c0 0x7f6954069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:29.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.099+0000 7f69667fc640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f69540678c0 0x7f6954069d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f695c0ae000 tx=0x7f695c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:29.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.103+0000 7f694ffff640 1 -- 172.21.15.112:0/2739575275 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6958055b40 con 0x7f6968070020 2024-09-15T23:55:29.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.303+0000 7f696d953640 1 -- 172.21.15.112:0/2739575275 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f696806e540 con 0x7f6968070020 2024-09-15T23:55:29.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.931+0000 7f694ffff640 1 -- 172.21.15.112:0/2739575275 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) ==== 172+0+0 (secure 0 0 0) 0x7f6958055440 con 0x7f6968070020 2024-09-15T23:55:29.937 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 7 and data pool 8 2024-09-15T23:55:29.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.935+0000 7f696d953640 1 -- 172.21.15.112:0/2739575275 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f69540678c0 msgr2=0x7f6954069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:29.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.935+0000 7f696d953640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f69540678c0 0x7f6954069d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f695c0ae000 tx=0x7f695c0a7000 comp rx=0 tx=0).stop 2024-09-15T23:55:29.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.935+0000 7f696d953640 1 -- 172.21.15.112:0/2739575275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070020 msgr2=0x7f69681f5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:29.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.935+0000 7f696d953640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070020 0x7f69681f5390 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f695800c480 tx=0x7f695800c940 comp rx=0 tx=0).stop 2024-09-15T23:55:29.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.935+0000 7f696d953640 1 -- 172.21.15.112:0/2739575275 shutdown_connections 2024-09-15T23:55:29.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.935+0000 7f696d953640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f69540678c0 0x7f6954069d80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.935+0000 7f696d953640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f696815f1d0 0x7f696815d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.935+0000 7f696d953640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69681520a0 0x7f69681465e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.935+0000 7f696d953640 1 --2- 172.21.15.112:0/2739575275 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6968070020 0x7f69681f5390 secure :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f695800c480 tx=0x7f695800c940 comp rx=0 tx=0).stop 2024-09-15T23:55:29.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.935+0000 7f696d953640 1 -- 172.21.15.112:0/2739575275 >> 172.21.15.112:0/2739575275 conn(0x7f69680b1f90 msgr2=0x7f6968151370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:29.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.935+0000 7f696d953640 1 -- 172.21.15.112:0/2739575275 shutdown_connections 2024-09-15T23:55:29.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:29.935+0000 7f696d953640 1 -- 172.21.15.112:0/2739575275 wait complete. 2024-09-15T23:55:29.983 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:30.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.098+0000 7fc63d815640 1 Processor -- start 2024-09-15T23:55:30.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.098+0000 7fc63d815640 1 -- start start 2024-09-15T23:55:30.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.102+0000 7fc63d815640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc638070020 0x7fc63815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.102+0000 7fc63d815640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc63815f1d0 0x7fc6380adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.102+0000 7fc63d815640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6380aede0 con 0x7fc6381520a0 2024-09-15T23:55:30.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.102+0000 7fc63d815640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc638152480 con 0x7fc638070020 2024-09-15T23:55:30.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.102+0000 7fc63d815640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc63815fa10 con 0x7fc63815f1d0 2024-09-15T23:55:30.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.102+0000 7fc62ffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc638070020 0x7fc63815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.102+0000 7fc62ffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc638070020 0x7fc63815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41100/0 (socket says 172.21.15.112:41100) 2024-09-15T23:55:30.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.102+0000 7fc62ffff640 1 -- 172.21.15.112:0/1519813852 learned_addr learned my addr 172.21.15.112:0/1519813852 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:30.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.102+0000 7fc6377fe640 1 --2- 172.21.15.112:0/1519813852 >> v2:172.21.15.169:3300/0 conn(0x7fc63815f1d0 0x7fc6380adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.102+0000 7fc62ffff640 1 -- 172.21.15.112:0/1519813852 >> v2:172.21.15.169:3300/0 conn(0x7fc63815f1d0 msgr2=0x7fc6380adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:30.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.102+0000 7fc62ffff640 1 --2- 172.21.15.112:0/1519813852 >> v2:172.21.15.169:3300/0 conn(0x7fc63815f1d0 0x7fc6380adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.102+0000 7fc62ffff640 1 -- 172.21.15.112:0/1519813852 >> v1:172.21.15.169:6789/0 conn(0x7fc6381520a0 legacy=0x7fc63806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:30.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.102+0000 7fc62ffff640 1 -- 172.21.15.112:0/1519813852 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc638074250 con 0x7fc638070020 2024-09-15T23:55:30.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.102+0000 7fc6377fe640 1 --2- 172.21.15.112:0/1519813852 >> v2:172.21.15.169:3300/0 conn(0x7fc63815f1d0 0x7fc6380adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.106+0000 7fc62ffff640 1 --2- 172.21.15.112:0/1519813852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc638070020 0x7fc63815ec90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc6380d0250 tx=0x7fc62001eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22b643af4d89220 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.106+0000 7fc6367fc640 1 -- 172.21.15.112:0/1519813852 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6200b4070 con 0x7fc638070020 2024-09-15T23:55:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.106+0000 7fc6367fc640 1 -- 172.21.15.112:0/1519813852 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6200a7c50 con 0x7fc638070020 2024-09-15T23:55:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.106+0000 7fc6367fc640 1 -- 172.21.15.112:0/1519813852 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6200af440 con 0x7fc638070020 2024-09-15T23:55:30.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.106+0000 7fc63d815640 1 -- 172.21.15.112:0/1519813852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc638070020 msgr2=0x7fc63815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.106+0000 7fc63d815640 1 --2- 172.21.15.112:0/1519813852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc638070020 0x7fc63815ec90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc6380d0250 tx=0x7fc62001eb80 comp rx=0 tx=0).stop 2024-09-15T23:55:30.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.106+0000 7fc63d815640 1 -- 172.21.15.112:0/1519813852 shutdown_connections 2024-09-15T23:55:30.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.106+0000 7fc63d815640 1 --2- 172.21.15.112:0/1519813852 >> v2:172.21.15.169:3300/0 conn(0x7fc63815f1d0 0x7fc6380adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.106+0000 7fc63d815640 1 --2- 172.21.15.112:0/1519813852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc638070020 0x7fc63815ec90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.106+0000 7fc63d815640 1 -- 172.21.15.112:0/1519813852 >> 172.21.15.112:0/1519813852 conn(0x7fc6380b1f90 msgr2=0x7fc6380b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:30.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.106+0000 7fc63d815640 1 -- 172.21.15.112:0/1519813852 shutdown_connections 2024-09-15T23:55:30.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.106+0000 7fc63d815640 1 -- 172.21.15.112:0/1519813852 wait complete. 2024-09-15T23:55:30.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.106+0000 7fc63d815640 1 Processor -- start 2024-09-15T23:55:30.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.106+0000 7fc63d815640 1 -- start start 2024-09-15T23:55:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc63d815640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc638070020 0x7fc63815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc63d815640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6381520a0 0x7fc6380994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc63d815640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc63815f1d0 0x7fc638099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc63d815640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc63815f5e0 con 0x7fc63815f1d0 2024-09-15T23:55:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc63d815640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc638073d30 con 0x7fc638070020 2024-09-15T23:55:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc63d815640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc63815f760 con 0x7fc6381520a0 2024-09-15T23:55:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc6377fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc63815f1d0 0x7fc638099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc6377fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc63815f1d0 0x7fc638099a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41102/0 (socket says 172.21.15.112:41102) 2024-09-15T23:55:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc6377fe640 1 -- 172.21.15.112:0/3781463847 learned_addr learned my addr 172.21.15.112:0/3781463847 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:30.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc636ffd640 1 --2- 172.21.15.112:0/3781463847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc638070020 0x7fc63815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc62ffff640 1 --2- 172.21.15.112:0/3781463847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6381520a0 0x7fc6380994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc6377fe640 1 -- 172.21.15.112:0/3781463847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6381520a0 msgr2=0x7fc6380994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc6377fe640 1 --2- 172.21.15.112:0/3781463847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6381520a0 0x7fc6380994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc6377fe640 1 -- 172.21.15.112:0/3781463847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc638070020 msgr2=0x7fc63815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc6377fe640 1 --2- 172.21.15.112:0/3781463847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc638070020 0x7fc63815a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc6377fe640 1 -- 172.21.15.112:0/3781463847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6380b4180 con 0x7fc63815f1d0 2024-09-15T23:55:30.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc6377fe640 1 --2- 172.21.15.112:0/3781463847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc63815f1d0 0x7fc638099a30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc63000cef0 tx=0x7fc63000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc634ff9640 1 -- 172.21.15.112:0/3781463847 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63001a070 con 0x7fc63815f1d0 2024-09-15T23:55:30.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc634ff9640 1 -- 172.21.15.112:0/3781463847 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63000d860 con 0x7fc63815f1d0 2024-09-15T23:55:30.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc63d815640 1 -- 172.21.15.112:0/3781463847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc63815aad0 con 0x7fc63815f1d0 2024-09-15T23:55:30.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc634ff9640 1 -- 172.21.15.112:0/3781463847 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63000dc50 con 0x7fc63815f1d0 2024-09-15T23:55:30.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc63d815640 1 -- 172.21.15.112:0/3781463847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc63814faa0 con 0x7fc63815f1d0 2024-09-15T23:55:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc63d815640 1 -- 172.21.15.112:0/3781463847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc63815ec90 con 0x7fc63815f1d0 2024-09-15T23:55:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc634ff9640 1 -- 172.21.15.112:0/3781463847 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc63001d070 con 0x7fc63815f1d0 2024-09-15T23:55:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc634ff9640 1 --2- 172.21.15.112:0/3781463847 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc6180678c0 0x7fc618069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc634ff9640 1 -- 172.21.15.112:0/3781463847 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fc630086690 con 0x7fc63815f1d0 2024-09-15T23:55:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc636ffd640 1 --2- 172.21.15.112:0/3781463847 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc6180678c0 0x7fc618069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.110+0000 7fc636ffd640 1 --2- 172.21.15.112:0/3781463847 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc6180678c0 0x7fc618069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc628004e30 tx=0x7fc628009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.114+0000 7fc634ff9640 1 -- 172.21.15.112:0/3781463847 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc6300570f0 con 0x7fc63815f1d0 2024-09-15T23:55:30.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.278+0000 7fc63d815640 1 -- 172.21.15.112:0/3781463847 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc63814f570 con 0x7fc63815f1d0 2024-09-15T23:55:30.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.282+0000 7fc634ff9640 1 -- 172.21.15.112:0/3781463847 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16967 (secure 0 0 0) 0x7fc6300569f0 con 0x7fc63815f1d0 2024-09-15T23:55:30.289 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:30.289 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":50,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:55:29.309858+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:26.989002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:28.298793+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:30.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.282+0000 7fc63d815640 1 -- 172.21.15.112:0/3781463847 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc6180678c0 msgr2=0x7fc618069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.282+0000 7fc63d815640 1 --2- 172.21.15.112:0/3781463847 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc6180678c0 0x7fc618069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc628004e30 tx=0x7fc628009040 comp rx=0 tx=0).stop 2024-09-15T23:55:30.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.282+0000 7fc63d815640 1 -- 172.21.15.112:0/3781463847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc63815f1d0 msgr2=0x7fc638099a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.282+0000 7fc63d815640 1 --2- 172.21.15.112:0/3781463847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc63815f1d0 0x7fc638099a30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc63000cef0 tx=0x7fc63000a710 comp rx=0 tx=0).stop 2024-09-15T23:55:30.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.282+0000 7fc63d815640 1 -- 172.21.15.112:0/3781463847 shutdown_connections 2024-09-15T23:55:30.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.286+0000 7fc63d815640 1 --2- 172.21.15.112:0/3781463847 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc6180678c0 0x7fc618069d80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.286+0000 7fc63d815640 1 --2- 172.21.15.112:0/3781463847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc63815f1d0 0x7fc638099a30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.286+0000 7fc63d815640 1 --2- 172.21.15.112:0/3781463847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6381520a0 0x7fc6380994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.286+0000 7fc63d815640 1 --2- 172.21.15.112:0/3781463847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc638070020 0x7fc63815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.286+0000 7fc63d815640 1 -- 172.21.15.112:0/3781463847 >> 172.21.15.112:0/3781463847 conn(0x7fc6380b1f90 msgr2=0x7fc63806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:30.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.286+0000 7fc63d815640 1 -- 172.21.15.112:0/3781463847 shutdown_connections 2024-09-15T23:55:30.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.286+0000 7fc63d815640 1 -- 172.21.15.112:0/3781463847 wait complete. 2024-09-15T23:55:30.308 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:30.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.418+0000 7f1404190640 1 Processor -- start 2024-09-15T23:55:30.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.418+0000 7f1404190640 1 -- start start 2024-09-15T23:55:30.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.418+0000 7f1404190640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f13fc073e60 0x7f13fc06e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.418+0000 7f1404190640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f13fc0b3d50 0x7f13fc0b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.418+0000 7f1404190640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13fc0b4670 con 0x7f13fc06fef0 2024-09-15T23:55:30.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.418+0000 7f1404190640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f13fc06ee50 con 0x7f13fc073e60 2024-09-15T23:55:30.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.418+0000 7f1404190640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f13fc06f130 con 0x7f13fc0b3d50 2024-09-15T23:55:30.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1401f2c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f13fc073e60 0x7f13fc06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1401f2c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f13fc073e60 0x7f13fc06e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41108/0 (socket says 172.21.15.112:41108) 2024-09-15T23:55:30.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1401f2c640 1 -- 172.21.15.112:0/1623071544 learned_addr learned my addr 172.21.15.112:0/1623071544 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:30.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f140172b640 1 --1- 172.21.15.112:0/1623071544 >> v1:172.21.15.112:6789/0 conn(0x7f13fc06fef0 0x7f13fc15b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41834/0 (socket says 172.21.15.112:41834) 2024-09-15T23:55:30.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f140272d640 1 --2- 172.21.15.112:0/1623071544 >> v2:172.21.15.169:3300/0 conn(0x7f13fc0b3d50 0x7f13fc0b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1401f2c640 1 -- 172.21.15.112:0/1623071544 >> v2:172.21.15.169:3300/0 conn(0x7f13fc0b3d50 msgr2=0x7f13fc0b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:30.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1401f2c640 1 --2- 172.21.15.112:0/1623071544 >> v2:172.21.15.169:3300/0 conn(0x7f13fc0b3d50 0x7f13fc0b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1401f2c640 1 -- 172.21.15.112:0/1623071544 >> v1:172.21.15.112:6789/0 conn(0x7f13fc06fef0 legacy=0x7f13fc15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1401f2c640 1 -- 172.21.15.112:0/1623071544 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc06f410 con 0x7f13fc073e60 2024-09-15T23:55:30.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1400f2a640 1 -- 172.21.15.112:0/1623071544 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3865527245 0 0) 0x7f13fc0b4670 con 0x7f13fc06fef0 2024-09-15T23:55:30.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f140272d640 1 --2- 172.21.15.112:0/1623071544 >> v2:172.21.15.169:3300/0 conn(0x7f13fc0b3d50 0x7f13fc0b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:30.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1401f2c640 1 --2- 172.21.15.112:0/1623071544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13fc073e60 0x7f13fc06e800 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0b2d50 tx=0x7f13f801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323584e9667c9ecc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1400f2a640 1 -- 172.21.15.112:0/1623071544 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f80b0070 con 0x7f13fc073e60 2024-09-15T23:55:30.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1400f2a640 1 -- 172.21.15.112:0/1623071544 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f80ab600 con 0x7f13fc073e60 2024-09-15T23:55:30.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1400f2a640 1 -- 172.21.15.112:0/1623071544 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f80ab9d0 con 0x7f13fc073e60 2024-09-15T23:55:30.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1404190640 1 -- 172.21.15.112:0/1623071544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13fc073e60 msgr2=0x7f13fc06e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1404190640 1 --2- 172.21.15.112:0/1623071544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13fc073e60 0x7f13fc06e800 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0b2d50 tx=0x7f13f801c490 comp rx=0 tx=0).stop 2024-09-15T23:55:30.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1404190640 1 -- 172.21.15.112:0/1623071544 shutdown_connections 2024-09-15T23:55:30.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1404190640 1 --2- 172.21.15.112:0/1623071544 >> v2:172.21.15.169:3300/0 conn(0x7f13fc0b3d50 0x7f13fc0b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1404190640 1 --2- 172.21.15.112:0/1623071544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13fc073e60 0x7f13fc06e800 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1404190640 1 -- 172.21.15.112:0/1623071544 >> 172.21.15.112:0/1623071544 conn(0x7f13fc0b1f90 msgr2=0x7f13fc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:30.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1404190640 1 -- 172.21.15.112:0/1623071544 shutdown_connections 2024-09-15T23:55:30.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.422+0000 7f1404190640 1 -- 172.21.15.112:0/1623071544 wait complete. 2024-09-15T23:55:30.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f1404190640 1 Processor -- start 2024-09-15T23:55:30.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f1404190640 1 -- start start 2024-09-15T23:55:30.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f1404190640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13fc06fef0 0x7f13fc152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f1404190640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13fc073e60 0x7f13fc1f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f1404190640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13fc0b3d50 0x7f13fc0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f1404190640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc0729a0 con 0x7f13fc0b3d50 2024-09-15T23:55:30.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f1404190640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc072820 con 0x7f13fc073e60 2024-09-15T23:55:30.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f1404190640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f13fc072b20 con 0x7f13fc06fef0 2024-09-15T23:55:30.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f140272d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13fc0b3d50 0x7f13fc0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f140272d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13fc0b3d50 0x7f13fc0b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41120/0 (socket says 172.21.15.112:41120) 2024-09-15T23:55:30.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f140272d640 1 -- 172.21.15.112:0/3089153959 learned_addr learned my addr 172.21.15.112:0/3089153959 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:30.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f1401f2c640 1 --2- 172.21.15.112:0/3089153959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13fc06fef0 0x7f13fc152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f140172b640 1 --2- 172.21.15.112:0/3089153959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13fc073e60 0x7f13fc1f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f140272d640 1 -- 172.21.15.112:0/3089153959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13fc06fef0 msgr2=0x7f13fc152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f140272d640 1 --2- 172.21.15.112:0/3089153959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13fc06fef0 0x7f13fc152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f140272d640 1 -- 172.21.15.112:0/3089153959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13fc073e60 msgr2=0x7f13fc1f8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f140272d640 1 --2- 172.21.15.112:0/3089153959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13fc073e60 0x7f13fc1f8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f140272d640 1 -- 172.21.15.112:0/3089153959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc1f9430 con 0x7f13fc0b3d50 2024-09-15T23:55:30.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f140272d640 1 --2- 172.21.15.112:0/3089153959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13fc0b3d50 0x7f13fc0b0ab0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f13f400cef0 tx=0x7f13f400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f13f27fc640 1 -- 172.21.15.112:0/3089153959 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f401a070 con 0x7f13fc0b3d50 2024-09-15T23:55:30.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f13f27fc640 1 -- 172.21.15.112:0/3089153959 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f400d860 con 0x7f13fc0b3d50 2024-09-15T23:55:30.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f1404190640 1 -- 172.21.15.112:0/3089153959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13fc14f040 con 0x7f13fc0b3d50 2024-09-15T23:55:30.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f13f27fc640 1 -- 172.21.15.112:0/3089153959 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f400dc50 con 0x7f13fc0b3d50 2024-09-15T23:55:30.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f1404190640 1 -- 172.21.15.112:0/3089153959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13fc14f600 con 0x7f13fc0b3d50 2024-09-15T23:55:30.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.426+0000 7f1404190640 1 -- 172.21.15.112:0/3089153959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13fc06e800 con 0x7f13fc0b3d50 2024-09-15T23:55:30.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.430+0000 7f13f27fc640 1 -- 172.21.15.112:0/3089153959 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f13f401d070 con 0x7f13fc0b3d50 2024-09-15T23:55:30.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.430+0000 7f13f27fc640 1 --2- 172.21.15.112:0/3089153959 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13e00678c0 0x7f13e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.430+0000 7f13f27fc640 1 -- 172.21.15.112:0/3089153959 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f13f40866b0 con 0x7f13fc0b3d50 2024-09-15T23:55:30.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.430+0000 7f1401f2c640 1 --2- 172.21.15.112:0/3089153959 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13e00678c0 0x7f13e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.430+0000 7f1401f2c640 1 --2- 172.21.15.112:0/3089153959 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13e00678c0 0x7f13e0069d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f13f80ad000 tx=0x7f13f80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.434+0000 7f13f27fc640 1 -- 172.21.15.112:0/3089153959 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f13f4057120 con 0x7f13fc0b3d50 2024-09-15T23:55:30.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.590+0000 7f1404190640 1 -- 172.21.15.112:0/3089153959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13fc0723f0 con 0x7f13fc0b3d50 2024-09-15T23:55:30.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.594+0000 7f13f27fc640 1 -- 172.21.15.112:0/3089153959 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16967 (secure 0 0 0) 0x7f13f4056a20 con 0x7f13fc0b3d50 2024-09-15T23:55:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:30.601 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":50,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:55:29.309858+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:26.989002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:28.298793+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:30.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.594+0000 7f1404190640 1 -- 172.21.15.112:0/3089153959 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13e00678c0 msgr2=0x7f13e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.594+0000 7f1404190640 1 --2- 172.21.15.112:0/3089153959 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13e00678c0 0x7f13e0069d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f13f80ad000 tx=0x7f13f80a6000 comp rx=0 tx=0).stop 2024-09-15T23:55:30.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.594+0000 7f1404190640 1 -- 172.21.15.112:0/3089153959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13fc0b3d50 msgr2=0x7f13fc0b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.594+0000 7f1404190640 1 --2- 172.21.15.112:0/3089153959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13fc0b3d50 0x7f13fc0b0ab0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f13f400cef0 tx=0x7f13f400a710 comp rx=0 tx=0).stop 2024-09-15T23:55:30.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.598+0000 7f1404190640 1 -- 172.21.15.112:0/3089153959 shutdown_connections 2024-09-15T23:55:30.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.598+0000 7f1404190640 1 --2- 172.21.15.112:0/3089153959 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13e00678c0 0x7f13e0069d80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.598+0000 7f1404190640 1 --2- 172.21.15.112:0/3089153959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13fc0b3d50 0x7f13fc0b0ab0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.598+0000 7f1404190640 1 --2- 172.21.15.112:0/3089153959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13fc073e60 0x7f13fc1f8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.598+0000 7f1404190640 1 --2- 172.21.15.112:0/3089153959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13fc06fef0 0x7f13fc152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.598+0000 7f1404190640 1 -- 172.21.15.112:0/3089153959 >> 172.21.15.112:0/3089153959 conn(0x7f13fc0b1f90 msgr2=0x7f13fc15d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:30.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.598+0000 7f1404190640 1 -- 172.21.15.112:0/3089153959 shutdown_connections 2024-09-15T23:55:30.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.598+0000 7f1404190640 1 -- 172.21.15.112:0/3089153959 wait complete. 2024-09-15T23:55:30.618 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:55:30.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8adebfe640 1 Processor -- start 2024-09-15T23:55:30.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8adebfe640 1 -- start start 2024-09-15T23:55:30.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8adebfe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8ad81457a0 0x7f8ad80d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8adebfe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ad80b4510 0x7f8ad80d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8adebfe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad80d27a0 con 0x7f8ad80cf800 2024-09-15T23:55:30.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8adebfe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8ad80d2a80 con 0x7f8ad81457a0 2024-09-15T23:55:30.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8adebfe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad80d2d60 con 0x7f8ad80b4510 2024-09-15T23:55:30.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8add19b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ad80b4510 0x7f8ad80d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8adc99a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8ad81457a0 0x7f8ad80d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8ad7fff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f8ad80cf800 0x7f8ad80b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:49366/0 (socket says 172.21.15.112:49366) 2024-09-15T23:55:30.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8ad7fff640 1 -- 172.21.15.112:0/2149739513 learned_addr learned my addr 172.21.15.112:0/2149739513 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:30.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8ad77fe640 1 -- 172.21.15.112:0/2149739513 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3550595944 0 0) 0x7f8ad80d27a0 con 0x7f8ad80cf800 2024-09-15T23:55:30.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8ad77fe640 1 -- 172.21.15.112:0/2149739513 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ac4003530 con 0x7f8ad80cf800 2024-09-15T23:55:30.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8add19b640 1 -- 172.21.15.112:0/2149739513 >> v2:172.21.15.169:3300/0 conn(0x7f8ad81457a0 msgr2=0x7f8ad80d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:30.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8add19b640 1 --2- 172.21.15.112:0/2149739513 >> v2:172.21.15.169:3300/0 conn(0x7f8ad81457a0 0x7f8ad80d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8add19b640 1 -- 172.21.15.112:0/2149739513 >> v1:172.21.15.169:6789/0 conn(0x7f8ad80cf800 legacy=0x7f8ad80b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.734+0000 7f8add19b640 1 -- 172.21.15.112:0/2149739513 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad80d01f0 con 0x7f8ad80b4510 2024-09-15T23:55:30.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.738+0000 7f8add19b640 1 --2- 172.21.15.112:0/2149739513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ad80b4510 0x7f8ad80d0710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009d90 tx=0x7f8ac801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91b56c3ef4d7e837 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.738+0000 7f8ad77fe640 1 -- 172.21.15.112:0/2149739513 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80b2070 con 0x7f8ad80b4510 2024-09-15T23:55:30.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.738+0000 7f8ad77fe640 1 -- 172.21.15.112:0/2149739513 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac80a57a0 con 0x7f8ad80b4510 2024-09-15T23:55:30.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.738+0000 7f8ad77fe640 1 -- 172.21.15.112:0/2149739513 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80a5b50 con 0x7f8ad80b4510 2024-09-15T23:55:30.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.738+0000 7f8adebfe640 1 -- 172.21.15.112:0/2149739513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ad80b4510 msgr2=0x7f8ad80d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.738+0000 7f8adebfe640 1 --2- 172.21.15.112:0/2149739513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ad80b4510 0x7f8ad80d0710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009d90 tx=0x7f8ac801c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.738+0000 7f8adebfe640 1 -- 172.21.15.112:0/2149739513 shutdown_connections 2024-09-15T23:55:30.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.738+0000 7f8adebfe640 1 --2- 172.21.15.112:0/2149739513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ad80b4510 0x7f8ad80d0710 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.738+0000 7f8adebfe640 1 --2- 172.21.15.112:0/2149739513 >> v2:172.21.15.169:3300/0 conn(0x7f8ad81457a0 0x7f8ad80d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.738+0000 7f8adebfe640 1 -- 172.21.15.112:0/2149739513 >> 172.21.15.112:0/2149739513 conn(0x7f8ad806bcc0 msgr2=0x7f8ad806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:30.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.738+0000 7f8adebfe640 1 -- 172.21.15.112:0/2149739513 shutdown_connections 2024-09-15T23:55:30.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.738+0000 7f8adebfe640 1 -- 172.21.15.112:0/2149739513 wait complete. 2024-09-15T23:55:30.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.738+0000 7f8adebfe640 1 Processor -- start 2024-09-15T23:55:30.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.738+0000 7f8adebfe640 1 -- start start 2024-09-15T23:55:30.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8adebfe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ad80b4510 0x7f8ad813dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8adebfe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ad80cf800 0x7f8ad815abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8adebfe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ad81457a0 0x7f8ad815b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8adebfe640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad81690b0 con 0x7f8ad80cf800 2024-09-15T23:55:30.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8adebfe640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad80d1670 con 0x7f8ad81457a0 2024-09-15T23:55:30.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8adebfe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad8169230 con 0x7f8ad80b4510 2024-09-15T23:55:30.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ad80cf800 0x7f8ad815abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ad80cf800 0x7f8ad815abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41124/0 (socket says 172.21.15.112:41124) 2024-09-15T23:55:30.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad7fff640 1 -- 172.21.15.112:0/1765504061 learned_addr learned my addr 172.21.15.112:0/1765504061 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:30.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8adc99a640 1 --2- 172.21.15.112:0/1765504061 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ad80b4510 0x7f8ad813dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8add19b640 1 --2- 172.21.15.112:0/1765504061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ad81457a0 0x7f8ad815b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad7fff640 1 -- 172.21.15.112:0/1765504061 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ad80b4510 msgr2=0x7f8ad813dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad7fff640 1 --2- 172.21.15.112:0/1765504061 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ad80b4510 0x7f8ad813dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad7fff640 1 -- 172.21.15.112:0/1765504061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ad81457a0 msgr2=0x7f8ad815b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad7fff640 1 --2- 172.21.15.112:0/1765504061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ad81457a0 0x7f8ad815b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad7fff640 1 -- 172.21.15.112:0/1765504061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad815d220 con 0x7f8ad80cf800 2024-09-15T23:55:30.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad7fff640 1 --2- 172.21.15.112:0/1765504061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ad80cf800 0x7f8ad815abb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000c480 tx=0x7f8ac000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad57fa640 1 -- 172.21.15.112:0/1765504061 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0017070 con 0x7f8ad80cf800 2024-09-15T23:55:30.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad57fa640 1 -- 172.21.15.112:0/1765504061 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac0005cf0 con 0x7f8ad80cf800 2024-09-15T23:55:30.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8adebfe640 1 -- 172.21.15.112:0/1765504061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad815d500 con 0x7f8ad80cf800 2024-09-15T23:55:30.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad57fa640 1 -- 172.21.15.112:0/1765504061 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0007290 con 0x7f8ad80cf800 2024-09-15T23:55:30.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8adebfe640 1 -- 172.21.15.112:0/1765504061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad815dac0 con 0x7f8ad80cf800 2024-09-15T23:55:30.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8adebfe640 1 -- 172.21.15.112:0/1765504061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad80d0710 con 0x7f8ad80cf800 2024-09-15T23:55:30.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad57fa640 1 -- 172.21.15.112:0/1765504061 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ac001a070 con 0x7f8ad80cf800 2024-09-15T23:55:30.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad57fa640 1 --2- 172.21.15.112:0/1765504061 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8ab80678c0 0x7f8ab8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8ad57fa640 1 -- 172.21.15.112:0/1765504061 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f8ac0085200 con 0x7f8ad80cf800 2024-09-15T23:55:30.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.742+0000 7f8adc99a640 1 --2- 172.21.15.112:0/1765504061 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8ab80678c0 0x7f8ab8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.746+0000 7f8adc99a640 1 --2- 172.21.15.112:0/1765504061 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8ab80678c0 0x7f8ab8069d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009a50 tx=0x7f8ad0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.746+0000 7f8ad57fa640 1 -- 172.21.15.112:0/1765504061 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8ac0055c40 con 0x7f8ad80cf800 2024-09-15T23:55:30.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.930+0000 7f8adebfe640 1 -- 172.21.15.112:0/1765504061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8ad8160420 con 0x7f8ad80cf800 2024-09-15T23:55:30.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.942+0000 7f8ad57fa640 1 -- 172.21.15.112:0/1765504061 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) ==== 118+0+0 (secure 0 0 0) 0x7f8ac0055540 con 0x7f8ad80cf800 2024-09-15T23:55:30.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.946+0000 7f8adebfe640 1 -- 172.21.15.112:0/1765504061 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8ab80678c0 msgr2=0x7f8ab8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.946+0000 7f8adebfe640 1 --2- 172.21.15.112:0/1765504061 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8ab80678c0 0x7f8ab8069d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009a50 tx=0x7f8ad0008040 comp rx=0 tx=0).stop 2024-09-15T23:55:30.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.946+0000 7f8adebfe640 1 -- 172.21.15.112:0/1765504061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ad80cf800 msgr2=0x7f8ad815abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.946+0000 7f8adebfe640 1 --2- 172.21.15.112:0/1765504061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ad80cf800 0x7f8ad815abb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000c480 tx=0x7f8ac000c940 comp rx=0 tx=0).stop 2024-09-15T23:55:30.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.946+0000 7f8adebfe640 1 -- 172.21.15.112:0/1765504061 shutdown_connections 2024-09-15T23:55:30.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.946+0000 7f8adebfe640 1 --2- 172.21.15.112:0/1765504061 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8ab80678c0 0x7f8ab8069d80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.946+0000 7f8adebfe640 1 --2- 172.21.15.112:0/1765504061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ad81457a0 0x7f8ad815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.946+0000 7f8adebfe640 1 --2- 172.21.15.112:0/1765504061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ad80cf800 0x7f8ad815abb0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.946+0000 7f8adebfe640 1 --2- 172.21.15.112:0/1765504061 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8ad80b4510 0x7f8ad813dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.946+0000 7f8adebfe640 1 -- 172.21.15.112:0/1765504061 >> 172.21.15.112:0/1765504061 conn(0x7f8ad806bcc0 msgr2=0x7f8ad813ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:30.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.946+0000 7f8adebfe640 1 -- 172.21.15.112:0/1765504061 shutdown_connections 2024-09-15T23:55:30.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:30.946+0000 7f8adebfe640 1 -- 172.21.15.112:0/1765504061 wait complete. 2024-09-15T23:55:30.971 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:55:30.971 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:55:31.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feecad1e640 1 Processor -- start 2024-09-15T23:55:31.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feecad1e640 1 -- start start 2024-09-15T23:55:31.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feecad1e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7feec4161a60 0x7feec40d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feecad1e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feec40d2e90 0x7feec40cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feecad1e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec40d32b0 con 0x7feec40cf450 2024-09-15T23:55:31.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feecad1e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7feec40d0300 con 0x7feec4161a60 2024-09-15T23:55:31.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feecad1e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feec406e6c0 con 0x7feec40d2e90 2024-09-15T23:55:31.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feec3fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feec40d2e90 0x7feec40cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feec8aba640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7feec4161a60 0x7feec40d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feec92bb640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7feec40cf450 0x7feec40d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:49378/0 (socket says 172.21.15.112:49378) 2024-09-15T23:55:31.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feec92bb640 1 -- 172.21.15.112:0/2011168882 learned_addr learned my addr 172.21.15.112:0/2011168882 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:31.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feec3fff640 1 -- 172.21.15.112:0/2011168882 >> v2:172.21.15.169:3300/0 conn(0x7feec4161a60 msgr2=0x7feec40d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:31.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feec3fff640 1 --2- 172.21.15.112:0/2011168882 >> v2:172.21.15.169:3300/0 conn(0x7feec4161a60 0x7feec40d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feec3fff640 1 -- 172.21.15.112:0/2011168882 >> v1:172.21.15.169:6789/0 conn(0x7feec40cf450 legacy=0x7feec40d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feec3fff640 1 -- 172.21.15.112:0/2011168882 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec40b0f60 con 0x7feec40d2e90 2024-09-15T23:55:31.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.082+0000 7feec8aba640 1 --2- 172.21.15.112:0/2011168882 >> v2:172.21.15.169:3300/0 conn(0x7feec4161a60 0x7feec40d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:55:31.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.086+0000 7feec3fff640 1 --2- 172.21.15.112:0/2011168882 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feec40d2e90 0x7feec40cef10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feeac0097c0 tx=0x7feeac01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90169401b445ec46 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:31.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.086+0000 7feec37fe640 1 -- 172.21.15.112:0/2011168882 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac0b1070 con 0x7feec40d2e90 2024-09-15T23:55:31.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.086+0000 7feec37fe640 1 -- 172.21.15.112:0/2011168882 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeac0a8050 con 0x7feec40d2e90 2024-09-15T23:55:31.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.086+0000 7feec37fe640 1 -- 172.21.15.112:0/2011168882 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec40d1930 con 0x7feec40d2e90 2024-09-15T23:55:31.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.086+0000 7feecad1e640 1 -- 172.21.15.112:0/2011168882 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feec40d2e90 msgr2=0x7feec40cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.086+0000 7feecad1e640 1 --2- 172.21.15.112:0/2011168882 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feec40d2e90 0x7feec40cef10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feeac0097c0 tx=0x7feeac01c3e0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.086+0000 7feecad1e640 1 -- 172.21.15.112:0/2011168882 shutdown_connections 2024-09-15T23:55:31.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.086+0000 7feecad1e640 1 --2- 172.21.15.112:0/2011168882 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feec40d2e90 0x7feec40cef10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.086+0000 7feecad1e640 1 --2- 172.21.15.112:0/2011168882 >> v2:172.21.15.169:3300/0 conn(0x7feec4161a60 0x7feec40d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.086+0000 7feecad1e640 1 -- 172.21.15.112:0/2011168882 >> 172.21.15.112:0/2011168882 conn(0x7feec408bf90 msgr2=0x7feec409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:31.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.086+0000 7feecad1e640 1 -- 172.21.15.112:0/2011168882 shutdown_connections 2024-09-15T23:55:31.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.086+0000 7feecad1e640 1 -- 172.21.15.112:0/2011168882 wait complete. 2024-09-15T23:55:31.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.086+0000 7feecad1e640 1 Processor -- start 2024-09-15T23:55:31.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.086+0000 7feecad1e640 1 -- start start 2024-09-15T23:55:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feecad1e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feec40cf450 0x7feec40b9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feecad1e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feec40d2e90 0x7feec415b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feecad1e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec4161a60 0x7feec4152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feecad1e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feec416af20 con 0x7feec4161a60 2024-09-15T23:55:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feecad1e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feec406d190 con 0x7feec40d2e90 2024-09-15T23:55:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feecad1e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feec416b0a0 con 0x7feec40cf450 2024-09-15T23:55:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec92bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec4161a60 0x7feec4152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec92bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec4161a60 0x7feec4152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41130/0 (socket says 172.21.15.112:41130) 2024-09-15T23:55:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec92bb640 1 -- 172.21.15.112:0/3732659301 learned_addr learned my addr 172.21.15.112:0/3732659301 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec3fff640 1 --2- 172.21.15.112:0/3732659301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feec40d2e90 0x7feec415b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec8aba640 1 --2- 172.21.15.112:0/3732659301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feec40cf450 0x7feec40b9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec92bb640 1 -- 172.21.15.112:0/3732659301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feec40cf450 msgr2=0x7feec40b9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec92bb640 1 --2- 172.21.15.112:0/3732659301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feec40cf450 0x7feec40b9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec92bb640 1 -- 172.21.15.112:0/3732659301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feec40d2e90 msgr2=0x7feec415b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec92bb640 1 --2- 172.21.15.112:0/3732659301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feec40d2e90 0x7feec415b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec92bb640 1 -- 172.21.15.112:0/3732659301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec41f77b0 con 0x7feec4161a60 2024-09-15T23:55:31.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec92bb640 1 --2- 172.21.15.112:0/3732659301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec4161a60 0x7feec4152b50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7feebc00cbc0 tx=0x7feebc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:31.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec17fa640 1 -- 172.21.15.112:0/3732659301 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc017070 con 0x7feec4161a60 2024-09-15T23:55:31.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec17fa640 1 -- 172.21.15.112:0/3732659301 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feebc00ad40 con 0x7feec4161a60 2024-09-15T23:55:31.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feecad1e640 1 -- 172.21.15.112:0/3732659301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec415bd40 con 0x7feec4161a60 2024-09-15T23:55:31.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec17fa640 1 -- 172.21.15.112:0/3732659301 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc012600 con 0x7feec4161a60 2024-09-15T23:55:31.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feecad1e640 1 -- 172.21.15.112:0/3732659301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec415c300 con 0x7feec4161a60 2024-09-15T23:55:31.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feecad1e640 1 -- 172.21.15.112:0/3732659301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec40cef10 con 0x7feec4161a60 2024-09-15T23:55:31.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec17fa640 1 -- 172.21.15.112:0/3732659301 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feebc01a070 con 0x7feec4161a60 2024-09-15T23:55:31.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec17fa640 1 --2- 172.21.15.112:0/3732659301 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feea40678c0 0x7feea4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec17fa640 1 -- 172.21.15.112:0/3732659301 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7feebc085a70 con 0x7feec4161a60 2024-09-15T23:55:31.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec8aba640 1 --2- 172.21.15.112:0/3732659301 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feea40678c0 0x7feea4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.090+0000 7feec8aba640 1 --2- 172.21.15.112:0/3732659301 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feea40678c0 0x7feea4069d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009a50 tx=0x7feeb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:31.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.094+0000 7feec17fa640 1 -- 172.21.15.112:0/3732659301 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feebc055dd0 con 0x7feec4161a60 2024-09-15T23:55:31.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.298+0000 7feecad1e640 1 -- 172.21.15.112:0/3732659301 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7feec4160d90 con 0x7feec4161a60 2024-09-15T23:55:31.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.962+0000 7feec17fa640 1 -- 172.21.15.112:0/3732659301 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7feebc05a0d0 con 0x7feec4161a60 2024-09-15T23:55:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.966+0000 7feecad1e640 1 -- 172.21.15.112:0/3732659301 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feea40678c0 msgr2=0x7feea4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.966+0000 7feecad1e640 1 --2- 172.21.15.112:0/3732659301 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feea40678c0 0x7feea4069d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009a50 tx=0x7feeb4008040 comp rx=0 tx=0).stop 2024-09-15T23:55:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.966+0000 7feecad1e640 1 -- 172.21.15.112:0/3732659301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec4161a60 msgr2=0x7feec4152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.966+0000 7feecad1e640 1 --2- 172.21.15.112:0/3732659301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec4161a60 0x7feec4152b50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7feebc00cbc0 tx=0x7feebc00a430 comp rx=0 tx=0).stop 2024-09-15T23:55:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.966+0000 7feecad1e640 1 -- 172.21.15.112:0/3732659301 shutdown_connections 2024-09-15T23:55:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.966+0000 7feecad1e640 1 --2- 172.21.15.112:0/3732659301 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feea40678c0 0x7feea4069d80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.966+0000 7feecad1e640 1 --2- 172.21.15.112:0/3732659301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feec4161a60 0x7feec4152b50 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.966+0000 7feecad1e640 1 --2- 172.21.15.112:0/3732659301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feec40d2e90 0x7feec415b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.966+0000 7feecad1e640 1 --2- 172.21.15.112:0/3732659301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feec40cf450 0x7feec40b9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.966+0000 7feecad1e640 1 -- 172.21.15.112:0/3732659301 >> 172.21.15.112:0/3732659301 conn(0x7feec408bf90 msgr2=0x7feec415d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:31.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.966+0000 7feecad1e640 1 -- 172.21.15.112:0/3732659301 shutdown_connections 2024-09-15T23:55:31.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:31.966+0000 7feecad1e640 1 -- 172.21.15.112:0/3732659301 wait complete. 2024-09-15T23:55:31.994 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:55:31.994 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:32.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24dcf71640 1 Processor -- start 2024-09-15T23:55:32.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24dcf71640 1 -- start start 2024-09-15T23:55:32.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24dcf71640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f24d8161a60 0x7f24d80d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24dcf71640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24d80cf620 0x7f24d806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24dcf71640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d80d32b0 con 0x7f24d80d2e90 2024-09-15T23:55:32.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24dcf71640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f24d80d0300 con 0x7f24d8161a60 2024-09-15T23:55:32.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24dcf71640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f24d80cfab0 con 0x7f24d80cf620 2024-09-15T23:55:32.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24d659c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f24d8161a60 0x7f24d80d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24d659c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f24d8161a60 0x7f24d80d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41144/0 (socket says 172.21.15.112:41144) 2024-09-15T23:55:32.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24d659c640 1 -- 172.21.15.112:0/1604857833 learned_addr learned my addr 172.21.15.112:0/1604857833 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:32.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24d6d9d640 1 --2- 172.21.15.112:0/1604857833 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24d80cf620 0x7f24d806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24d659c640 1 -- 172.21.15.112:0/1604857833 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24d80cf620 msgr2=0x7f24d806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:32.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24d659c640 1 --2- 172.21.15.112:0/1604857833 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24d80cf620 0x7f24d806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24d659c640 1 -- 172.21.15.112:0/1604857833 >> v1:172.21.15.169:6789/0 conn(0x7f24d80d2e90 legacy=0x7f24d80cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:32.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.110+0000 7f24d659c640 1 -- 172.21.15.112:0/1604857833 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d80b0f60 con 0x7f24d8161a60 2024-09-15T23:55:32.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d659c640 1 --2- 172.21.15.112:0/1604857833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24d8161a60 0x7f24d80d2950 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009e50 tx=0x7f24c801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12385f5f1d1982cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d559a640 1 -- 172.21.15.112:0/1604857833 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c80a57b0 con 0x7f24d8161a60 2024-09-15T23:55:32.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d559a640 1 -- 172.21.15.112:0/1604857833 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c80a5950 con 0x7f24d8161a60 2024-09-15T23:55:32.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d559a640 1 -- 172.21.15.112:0/1604857833 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c80a5d20 con 0x7f24d8161a60 2024-09-15T23:55:32.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 -- 172.21.15.112:0/1604857833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24d8161a60 msgr2=0x7f24d80d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 --2- 172.21.15.112:0/1604857833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24d8161a60 0x7f24d80d2950 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009e50 tx=0x7f24c801c930 comp rx=0 tx=0).stop 2024-09-15T23:55:32.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 -- 172.21.15.112:0/1604857833 shutdown_connections 2024-09-15T23:55:32.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 --2- 172.21.15.112:0/1604857833 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24d80cf620 0x7f24d806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 --2- 172.21.15.112:0/1604857833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24d8161a60 0x7f24d80d2950 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 -- 172.21.15.112:0/1604857833 >> 172.21.15.112:0/1604857833 conn(0x7f24d808bf90 msgr2=0x7f24d809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:32.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 -- 172.21.15.112:0/1604857833 shutdown_connections 2024-09-15T23:55:32.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 -- 172.21.15.112:0/1604857833 wait complete. 2024-09-15T23:55:32.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 Processor -- start 2024-09-15T23:55:32.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 -- start start 2024-09-15T23:55:32.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24d80cf620 0x7f24d814c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24d80d2e90 0x7f24d80cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24d8161a60 0x7f24d815df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f24d806e400 con 0x7f24d8161a60 2024-09-15T23:55:32.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f24d806d190 con 0x7f24d80cf620 2024-09-15T23:55:32.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f24d806e580 con 0x7f24d80d2e90 2024-09-15T23:55:32.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d6d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24d8161a60 0x7f24d815df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d6d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24d8161a60 0x7f24d815df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41150/0 (socket says 172.21.15.112:41150) 2024-09-15T23:55:32.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d6d9d640 1 -- 172.21.15.112:0/961118972 learned_addr learned my addr 172.21.15.112:0/961118972 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:32.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d659c640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24d80cf620 0x7f24d814c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d5d9b640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24d80d2e90 0x7f24d80cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d6d9d640 1 -- 172.21.15.112:0/961118972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24d80d2e90 msgr2=0x7f24d80cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d6d9d640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24d80d2e90 0x7f24d80cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d6d9d640 1 -- 172.21.15.112:0/961118972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24d80cf620 msgr2=0x7f24d814c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d6d9d640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24d80cf620 0x7f24d814c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d6d9d640 1 -- 172.21.15.112:0/961118972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d815af10 con 0x7f24d8161a60 2024-09-15T23:55:32.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d659c640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24d80cf620 0x7f24d814c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:32.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24d6d9d640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24d8161a60 0x7f24d815df40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f24d000afd0 tx=0x7f24d000ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24c6ffd640 1 -- 172.21.15.112:0/961118972 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0015070 con 0x7f24d8161a60 2024-09-15T23:55:32.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24c6ffd640 1 -- 172.21.15.112:0/961118972 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d0004220 con 0x7f24d8161a60 2024-09-15T23:55:32.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 -- 172.21.15.112:0/961118972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d815b1f0 con 0x7f24d8161a60 2024-09-15T23:55:32.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24c6ffd640 1 -- 172.21.15.112:0/961118972 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0003620 con 0x7f24d8161a60 2024-09-15T23:55:32.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.114+0000 7f24dcf71640 1 -- 172.21.15.112:0/961118972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d815b7b0 con 0x7f24d8161a60 2024-09-15T23:55:32.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.118+0000 7f24dcf71640 1 -- 172.21.15.112:0/961118972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d806d6b0 con 0x7f24d8161a60 2024-09-15T23:55:32.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.118+0000 7f24c6ffd640 1 -- 172.21.15.112:0/961118972 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f24d00037c0 con 0x7f24d8161a60 2024-09-15T23:55:32.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.118+0000 7f24c6ffd640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f24b80678f0 0x7f24b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.118+0000 7f24c6ffd640 1 -- 172.21.15.112:0/961118972 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f24d0085bb0 con 0x7f24d8161a60 2024-09-15T23:55:32.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.118+0000 7f24d659c640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f24b80678f0 0x7f24b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.118+0000 7f24d659c640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f24b80678f0 0x7f24b8069db0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f24c80ae000 tx=0x7f24c80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.122+0000 7f24c6ffd640 1 -- 172.21.15.112:0/961118972 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f24d0056560 con 0x7f24d8161a60 2024-09-15T23:55:32.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.310+0000 7f24dcf71640 1 -- 172.21.15.112:0/961118972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24d80d1300 con 0x7f24d8161a60 2024-09-15T23:55:32.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.310+0000 7f24c6ffd640 1 -- 172.21.15.112:0/961118972 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5232 (secure 0 0 0) 0x7f24d0055e60 con 0x7f24d8161a60 2024-09-15T23:55:32.316 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:32.316 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":22,"btime":"2024-09-15T23:55:31:957534+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1762952607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1762952607},{"type":"v1","addr":"172.21.15.169:6834","nonce":1762952607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1383551321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1383551321},{"type":"v1","addr":"172.21.15.169:6835","nonce":1383551321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/235120639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":235120639},{"type":"v1","addr":"172.21.15.112:6835","nonce":235120639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:29.310328+0000","modified":"2024-09-15T23:55:31.304308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1037773891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1037773891},{"type":"v1","addr":"172.21.15.112:6837","nonce":1037773891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-15T23:55:32.316 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 22 2024-09-15T23:55:32.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.310+0000 7f24dcf71640 1 -- 172.21.15.112:0/961118972 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f24b80678f0 msgr2=0x7f24b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.310+0000 7f24dcf71640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f24b80678f0 0x7f24b8069db0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f24c80ae000 tx=0x7f24c80a7070 comp rx=0 tx=0).stop 2024-09-15T23:55:32.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.310+0000 7f24dcf71640 1 -- 172.21.15.112:0/961118972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24d8161a60 msgr2=0x7f24d815df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.310+0000 7f24dcf71640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24d8161a60 0x7f24d815df40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f24d000afd0 tx=0x7f24d000ca20 comp rx=0 tx=0).stop 2024-09-15T23:55:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.310+0000 7f24dcf71640 1 -- 172.21.15.112:0/961118972 shutdown_connections 2024-09-15T23:55:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.310+0000 7f24dcf71640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f24b80678f0 0x7f24b8069db0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.310+0000 7f24dcf71640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24d8161a60 0x7f24d815df40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.310+0000 7f24dcf71640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24d80d2e90 0x7f24d80cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.310+0000 7f24dcf71640 1 --2- 172.21.15.112:0/961118972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24d80cf620 0x7f24d814c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.310+0000 7f24dcf71640 1 -- 172.21.15.112:0/961118972 >> 172.21.15.112:0/961118972 conn(0x7f24d808bf90 msgr2=0x7f24d80b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.314+0000 7f24dcf71640 1 -- 172.21.15.112:0/961118972 shutdown_connections 2024-09-15T23:55:32.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.314+0000 7f24dcf71640 1 -- 172.21.15.112:0/961118972 wait complete. 2024-09-15T23:55:32.334 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:32.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.446+0000 7f667c1bf640 1 Processor -- start 2024-09-15T23:55:32.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.446+0000 7f667c1bf640 1 -- start start 2024-09-15T23:55:32.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.446+0000 7f667c1bf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6674067e30 0x7f6674161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.446+0000 7f667c1bf640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f66741623e0 0x7f66740b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.446+0000 7f667c1bf640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66740afbb0 con 0x7f667415e260 2024-09-15T23:55:32.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.446+0000 7f667c1bf640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f6674162830 con 0x7f66741623e0 2024-09-15T23:55:32.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.446+0000 7f667c1bf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f66740b0700 con 0x7f6674067e30 2024-09-15T23:55:32.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.446+0000 7f667a75c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f66741623e0 0x7f66740b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.446+0000 7f667975a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6674067e30 0x7f6674161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.446+0000 7f667a75c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f66741623e0 0x7f66740b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:35224/0 (socket says 172.21.15.112:35224) 2024-09-15T23:55:32.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.446+0000 7f667a75c640 1 -- 172.21.15.112:0/2783768892 learned_addr learned my addr 172.21.15.112:0/2783768892 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:32.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.446+0000 7f6679f5b640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f667415e260 0x7f66740afff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:49394/0 (socket says 172.21.15.112:49394) 2024-09-15T23:55:32.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f667a75c640 1 -- 172.21.15.112:0/2783768892 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6674067e30 msgr2=0x7f6674161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:32.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f667a75c640 1 --2- 172.21.15.112:0/2783768892 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6674067e30 0x7f6674161ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f667a75c640 1 -- 172.21.15.112:0/2783768892 >> v1:172.21.15.169:6789/0 conn(0x7f667415e260 legacy=0x7f66740afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f667a75c640 1 -- 172.21.15.112:0/2783768892 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66740af310 con 0x7f66741623e0 2024-09-15T23:55:32.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f667975a640 1 --2- 172.21.15.112:0/2783768892 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6674067e30 0x7f6674161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:55:32.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f667a75c640 1 --2- 172.21.15.112:0/2783768892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66741623e0 0x7f66740b41c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f666c009870 tx=0x7f666c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4579c45f64b0ae52 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f6678f59640 1 -- 172.21.15.112:0/2783768892 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c0a9620 con 0x7f66741623e0 2024-09-15T23:55:32.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f6678f59640 1 -- 172.21.15.112:0/2783768892 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f666c0a97c0 con 0x7f66741623e0 2024-09-15T23:55:32.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f6678f59640 1 -- 172.21.15.112:0/2783768892 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c0a9b90 con 0x7f66741623e0 2024-09-15T23:55:32.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f667c1bf640 1 -- 172.21.15.112:0/2783768892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66741623e0 msgr2=0x7f66740b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f667c1bf640 1 --2- 172.21.15.112:0/2783768892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66741623e0 0x7f66740b41c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f666c009870 tx=0x7f666c01c560 comp rx=0 tx=0).stop 2024-09-15T23:55:32.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f667c1bf640 1 -- 172.21.15.112:0/2783768892 shutdown_connections 2024-09-15T23:55:32.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f667c1bf640 1 --2- 172.21.15.112:0/2783768892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66741623e0 0x7f66740b41c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f667c1bf640 1 --2- 172.21.15.112:0/2783768892 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6674067e30 0x7f6674161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f667c1bf640 1 -- 172.21.15.112:0/2783768892 >> 172.21.15.112:0/2783768892 conn(0x7f6674073580 msgr2=0x7f667406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:32.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f667c1bf640 1 -- 172.21.15.112:0/2783768892 shutdown_connections 2024-09-15T23:55:32.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.450+0000 7f667c1bf640 1 -- 172.21.15.112:0/2783768892 wait complete. 2024-09-15T23:55:32.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f667c1bf640 1 Processor -- start 2024-09-15T23:55:32.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f667c1bf640 1 -- start start 2024-09-15T23:55:32.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f667c1bf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6674067e30 0x7f6674152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f667c1bf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f667415e260 0x7f66740cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f667c1bf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66741623e0 0x7f6674156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f667c1bf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f66740b5090 con 0x7f6674067e30 2024-09-15T23:55:32.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f667c1bf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66740b4f10 con 0x7f66741623e0 2024-09-15T23:55:32.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f667c1bf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f66740b5210 con 0x7f667415e260 2024-09-15T23:55:32.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f6679f5b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6674067e30 0x7f6674152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f6679f5b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6674067e30 0x7f6674152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41154/0 (socket says 172.21.15.112:41154) 2024-09-15T23:55:32.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f6679f5b640 1 -- 172.21.15.112:0/2244034545 learned_addr learned my addr 172.21.15.112:0/2244034545 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:32.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f667a75c640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66741623e0 0x7f6674156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f667975a640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f667415e260 0x7f66740cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f6679f5b640 1 -- 172.21.15.112:0/2244034545 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f667415e260 msgr2=0x7f66740cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f6679f5b640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f667415e260 0x7f66740cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f6679f5b640 1 -- 172.21.15.112:0/2244034545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66741623e0 msgr2=0x7f6674156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f6679f5b640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66741623e0 0x7f6674156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f6679f5b640 1 -- 172.21.15.112:0/2244034545 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66740cf340 con 0x7f6674067e30 2024-09-15T23:55:32.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f667a75c640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66741623e0 0x7f6674156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:32.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f6679f5b640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6674067e30 0x7f6674152810 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f667000c870 tx=0x7f667000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f666a7fc640 1 -- 172.21.15.112:0/2244034545 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6670017070 con 0x7f6674067e30 2024-09-15T23:55:32.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f666a7fc640 1 -- 172.21.15.112:0/2244034545 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f667000a640 con 0x7f6674067e30 2024-09-15T23:55:32.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f667c1bf640 1 -- 172.21.15.112:0/2244034545 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66740cf620 con 0x7f6674067e30 2024-09-15T23:55:32.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f666a7fc640 1 -- 172.21.15.112:0/2244034545 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667000a9f0 con 0x7f6674067e30 2024-09-15T23:55:32.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f667c1bf640 1 -- 172.21.15.112:0/2244034545 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6674153050 con 0x7f6674067e30 2024-09-15T23:55:32.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f667c1bf640 1 -- 172.21.15.112:0/2244034545 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6674161ea0 con 0x7f6674067e30 2024-09-15T23:55:32.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.454+0000 7f666a7fc640 1 -- 172.21.15.112:0/2244034545 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f667001a070 con 0x7f6674067e30 2024-09-15T23:55:32.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.458+0000 7f666a7fc640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66580678c0 0x7f6658069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.458+0000 7f667975a640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66580678c0 0x7f6658069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.458+0000 7f666a7fc640 1 -- 172.21.15.112:0/2244034545 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f66700853c0 con 0x7f6674067e30 2024-09-15T23:55:32.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.458+0000 7f667975a640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66580678c0 0x7f6658069d80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f66740ccdf0 tx=0x7f6664008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.462+0000 7f666a7fc640 1 -- 172.21.15.112:0/2244034545 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f66700557b0 con 0x7f6674067e30 2024-09-15T23:55:32.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.622+0000 7f667c1bf640 1 -- 172.21.15.112:0/2244034545 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6674160600 con 0x7f6674067e30 2024-09-15T23:55:32.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.622+0000 7f666a7fc640 1 -- 172.21.15.112:0/2244034545 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16954 (secure 0 0 0) 0x7f6670059ab0 con 0x7f6674067e30 2024-09-15T23:55:32.629 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:32.630 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":51,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:55:30.949208+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:26.989002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:28.298793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.626+0000 7f667c1bf640 1 -- 172.21.15.112:0/2244034545 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66580678c0 msgr2=0x7f6658069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.626+0000 7f667c1bf640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66580678c0 0x7f6658069d80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f66740ccdf0 tx=0x7f6664008040 comp rx=0 tx=0).stop 2024-09-15T23:55:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.626+0000 7f667c1bf640 1 -- 172.21.15.112:0/2244034545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6674067e30 msgr2=0x7f6674152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.626+0000 7f667c1bf640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6674067e30 0x7f6674152810 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f667000c870 tx=0x7f667000cd30 comp rx=0 tx=0).stop 2024-09-15T23:55:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.626+0000 7f667c1bf640 1 -- 172.21.15.112:0/2244034545 shutdown_connections 2024-09-15T23:55:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.626+0000 7f667c1bf640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f66580678c0 0x7f6658069d80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.626+0000 7f667c1bf640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66741623e0 0x7f6674156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.626+0000 7f667c1bf640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f667415e260 0x7f66740cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.626+0000 7f667c1bf640 1 --2- 172.21.15.112:0/2244034545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6674067e30 0x7f6674152810 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.626+0000 7f667c1bf640 1 -- 172.21.15.112:0/2244034545 >> 172.21.15.112:0/2244034545 conn(0x7f6674073580 msgr2=0x7f667415f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.626+0000 7f667c1bf640 1 -- 172.21.15.112:0/2244034545 shutdown_connections 2024-09-15T23:55:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.626+0000 7f667c1bf640 1 -- 172.21.15.112:0/2244034545 wait complete. 2024-09-15T23:55:32.648 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:55:32.649 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:55:32.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe170ba9640 1 Processor -- start 2024-09-15T23:55:32.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe170ba9640 1 -- start start 2024-09-15T23:55:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe170ba9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe16c15e5f0 0x7fe16c06d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe170ba9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0ce9d0 0x7fe16c0cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe170ba9640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16c06d9c0 con 0x7fe16c0cf920 2024-09-15T23:55:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe170ba9640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe16c06dca0 con 0x7fe16c15e5f0 2024-09-15T23:55:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe170ba9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe16c06df80 con 0x7fe16c0ce9d0 2024-09-15T23:55:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe16a59c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe16c15e5f0 0x7fe16c06d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe16a59c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe16c15e5f0 0x7fe16c06d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41166/0 (socket says 172.21.15.112:41166) 2024-09-15T23:55:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe16a59c640 1 -- 172.21.15.112:0/1039274979 learned_addr learned my addr 172.21.15.112:0/1039274979 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe16ad9d640 1 --1- 172.21.15.112:0/1039274979 >> v1:172.21.15.112:6789/0 conn(0x7fe16c0cf920 0x7fe16c0d0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41842/0 (socket says 172.21.15.112:41842) 2024-09-15T23:55:32.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe169d9b640 1 --2- 172.21.15.112:0/1039274979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0ce9d0 0x7fe16c0cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe16a59c640 1 -- 172.21.15.112:0/1039274979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0ce9d0 msgr2=0x7fe16c0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:32.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe16a59c640 1 --2- 172.21.15.112:0/1039274979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0ce9d0 0x7fe16c0cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe16a59c640 1 -- 172.21.15.112:0/1039274979 >> v1:172.21.15.112:6789/0 conn(0x7fe16c0cf920 legacy=0x7fe16c0d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe16a59c640 1 -- 172.21.15.112:0/1039274979 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c06e260 con 0x7fe16c15e5f0 2024-09-15T23:55:32.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe16959a640 1 -- 172.21.15.112:0/1039274979 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 664149581 0 0) 0x7fe16c06d9c0 con 0x7fe16c0cf920 2024-09-15T23:55:32.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.766+0000 7fe16a59c640 1 --2- 172.21.15.112:0/1039274979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe16c15e5f0 0x7fe16c06d090 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe164009870 tx=0x7fe16401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54319b7bb9264e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe16959a640 1 -- 172.21.15.112:0/1039274979 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1640b2070 con 0x7fe16c15e5f0 2024-09-15T23:55:32.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe16959a640 1 -- 172.21.15.112:0/1039274979 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1640ad640 con 0x7fe16c15e5f0 2024-09-15T23:55:32.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe16959a640 1 -- 172.21.15.112:0/1039274979 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1640ada10 con 0x7fe16c15e5f0 2024-09-15T23:55:32.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 -- 172.21.15.112:0/1039274979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe16c15e5f0 msgr2=0x7fe16c06d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 --2- 172.21.15.112:0/1039274979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe16c15e5f0 0x7fe16c06d090 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe164009870 tx=0x7fe16401c560 comp rx=0 tx=0).stop 2024-09-15T23:55:32.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 -- 172.21.15.112:0/1039274979 shutdown_connections 2024-09-15T23:55:32.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 --2- 172.21.15.112:0/1039274979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0ce9d0 0x7fe16c0cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 --2- 172.21.15.112:0/1039274979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe16c15e5f0 0x7fe16c06d090 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 -- 172.21.15.112:0/1039274979 >> 172.21.15.112:0/1039274979 conn(0x7fe16c074030 msgr2=0x7fe16c09d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:32.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 -- 172.21.15.112:0/1039274979 shutdown_connections 2024-09-15T23:55:32.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 -- 172.21.15.112:0/1039274979 wait complete. 2024-09-15T23:55:32.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 Processor -- start 2024-09-15T23:55:32.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 -- start start 2024-09-15T23:55:32.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0cf920 0x7fe16c0b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe16c0b8180 0x7fe16c15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe16c14da80 0x7fe16c0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c16b1b0 con 0x7fe16c0b8180 2024-09-15T23:55:32.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c0cfd90 con 0x7fe16c14da80 2024-09-15T23:55:32.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe16c16b330 con 0x7fe16c0cf920 2024-09-15T23:55:32.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe169d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe16c0b8180 0x7fe16c15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe169d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe16c0b8180 0x7fe16c15d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41176/0 (socket says 172.21.15.112:41176) 2024-09-15T23:55:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe169d9b640 1 -- 172.21.15.112:0/3604583624 learned_addr learned my addr 172.21.15.112:0/3604583624 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe16a59c640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0cf920 0x7fe16c0b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe16ad9d640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe16c14da80 0x7fe16c0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe169d9b640 1 -- 172.21.15.112:0/3604583624 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0cf920 msgr2=0x7fe16c0b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe169d9b640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0cf920 0x7fe16c0b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe169d9b640 1 -- 172.21.15.112:0/3604583624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe16c14da80 msgr2=0x7fe16c0ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe169d9b640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe16c14da80 0x7fe16c0ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe169d9b640 1 -- 172.21.15.112:0/3604583624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c0b73c0 con 0x7fe16c0b8180 2024-09-15T23:55:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe16ad9d640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe16c14da80 0x7fe16c0ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe169d9b640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe16c0b8180 0x7fe16c15d3f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe15400d830 tx=0x7fe15400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe162ffd640 1 -- 172.21.15.112:0/3604583624 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154004020 con 0x7fe16c0b8180 2024-09-15T23:55:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe162ffd640 1 -- 172.21.15.112:0/3604583624 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1540041c0 con 0x7fe16c0b8180 2024-09-15T23:55:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe162ffd640 1 -- 172.21.15.112:0/3604583624 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1540043b0 con 0x7fe16c0b8180 2024-09-15T23:55:32.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.770+0000 7fe170ba9640 1 -- 172.21.15.112:0/3604583624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16c0b76a0 con 0x7fe16c0b8180 2024-09-15T23:55:32.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.774+0000 7fe170ba9640 1 -- 172.21.15.112:0/3604583624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16c0b7c60 con 0x7fe16c0b8180 2024-09-15T23:55:32.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.774+0000 7fe170ba9640 1 -- 172.21.15.112:0/3604583624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe16c0c7c50 con 0x7fe16c0b8180 2024-09-15T23:55:32.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.774+0000 7fe162ffd640 1 -- 172.21.15.112:0/3604583624 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe15401b020 con 0x7fe16c0b8180 2024-09-15T23:55:32.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.774+0000 7fe162ffd640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe14c0678c0 0x7fe14c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.774+0000 7fe16a59c640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe14c0678c0 0x7fe14c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.774+0000 7fe162ffd640 1 -- 172.21.15.112:0/3604583624 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fe154085d10 con 0x7fe16c0b8180 2024-09-15T23:55:32.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.774+0000 7fe16a59c640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe14c0678c0 0x7fe14c069d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe1640af000 tx=0x7fe164008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.778+0000 7fe162ffd640 1 -- 172.21.15.112:0/3604583624 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe154056750 con 0x7fe16c0b8180 2024-09-15T23:55:32.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.938+0000 7fe170ba9640 1 -- 172.21.15.112:0/3604583624 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe16c158190 con 0x7fe14c0678c0 2024-09-15T23:55:32.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.942+0000 7fe162ffd640 1 -- 172.21.15.112:0/3604583624 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245233 (secure 0 0 0) 0x7fe16c158190 con 0x7fe14c0678c0 2024-09-15T23:55:32.952 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:55:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.946+0000 7fe170ba9640 1 -- 172.21.15.112:0/3604583624 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe14c0678c0 msgr2=0x7fe14c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.946+0000 7fe170ba9640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe14c0678c0 0x7fe14c069d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe1640af000 tx=0x7fe164008040 comp rx=0 tx=0).stop 2024-09-15T23:55:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.946+0000 7fe170ba9640 1 -- 172.21.15.112:0/3604583624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe16c0b8180 msgr2=0x7fe16c15d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.946+0000 7fe170ba9640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe16c0b8180 0x7fe16c15d3f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe15400d830 tx=0x7fe15400dcf0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.946+0000 7fe170ba9640 1 -- 172.21.15.112:0/3604583624 shutdown_connections 2024-09-15T23:55:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.946+0000 7fe170ba9640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe14c0678c0 0x7fe14c069d80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.946+0000 7fe170ba9640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe16c14da80 0x7fe16c0ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.946+0000 7fe170ba9640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe16c0b8180 0x7fe16c15d3f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.946+0000 7fe170ba9640 1 --2- 172.21.15.112:0/3604583624 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0cf920 0x7fe16c0b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.946+0000 7fe170ba9640 1 -- 172.21.15.112:0/3604583624 >> 172.21.15.112:0/3604583624 conn(0x7fe16c0ce9d0 msgr2=0x7fe16c0b5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.946+0000 7fe170ba9640 1 -- 172.21.15.112:0/3604583624 shutdown_connections 2024-09-15T23:55:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:32.946+0000 7fe170ba9640 1 -- 172.21.15.112:0/3604583624 wait complete. 2024-09-15T23:55:32.971 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-09-15T23:55:31.263619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255100,"kb_used_data":5556,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719620,"statfs":{"total":773094113280,"available":772832890880,"internally_reserved":0,"allocated":5689344,"data_stored":3128981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001037"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.951163+0000","last_change":"2024-09-15T23:55:28.951163+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.951163+0000","last_undegraded":"2024-09-15T23:55:28.951163+0000","last_fullsized":"2024-09-15T23:55:28.951163+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945077+0000","last_change":"2024-09-15T23:55:28.945077+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945077+0000","last_undegraded":"2024-09-15T23:55:28.945077+0000","last_fullsized":"2024-09-15T23:55:28.945077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.963825+0000","last_change":"2024-09-15T23:55:28.963825+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.963825+0000","last_undegraded":"2024-09-15T23:55:28.963825+0000","last_fullsized":"2024-09-15T23:55:28.963825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941093+0000","last_change":"2024-09-15T23:55:28.941093+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941093+0000","last_undegraded":"2024-09-15T23:55:28.941093+0000","last_fullsized":"2024-09-15T23:55:28.941093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945973+0000","last_change":"2024-09-15T23:55:28.945973+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945973+0000","last_undegraded":"2024-09-15T23:55:28.945973+0000","last_fullsized":"2024-09-15T23:55:28.945973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947588+0000","last_change":"2024-09-15T23:55:28.947588+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947588+0000","last_undegraded":"2024-09-15T23:55:28.947588+0000","last_fullsized":"2024-09-15T23:55:28.947588+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:55:28.924235+0000","last_change":"2024-09-15T23:55:28.924235+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.924235+0000","last_undegraded":"2024-09-15T23:55:28.924235+0000","last_fullsized":"2024-09-15T23:55:28.924235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.948541+0000","last_change":"2024-09-15T23:55:28.948541+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.948541+0000","last_undegraded":"2024-09-15T23:55:28.948541+0000","last_fullsized":"2024-09-15T23:55:28.948541+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.963117+0000","last_change":"2024-09-15T23:55:28.963117+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.963117+0000","last_undegraded":"2024-09-15T23:55:28.963117+0000","last_fullsized":"2024-09-15T23:55:28.963117+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:55:28.924235+0000","last_change":"2024-09-15T23:55:28.924235+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.924235+0000","last_undegraded":"2024-09-15T23:55:28.924235+0000","last_fullsized":"2024-09-15T23:55:28.924235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.955280+0000","last_change":"2024-09-15T23:55:28.955280+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.955280+0000","last_undegraded":"2024-09-15T23:55:28.955280+0000","last_fullsized":"2024-09-15T23:55:28.955280+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.948981+0000","last_change":"2024-09-15T23:55:28.948981+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.948981+0000","last_undegraded":"2024-09-15T23:55:28.948981+0000","last_fullsized":"2024-09-15T23:55:28.948981+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.954510+0000","last_change":"2024-09-15T23:55:28.954510+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.954510+0000","last_undegraded":"2024-09-15T23:55:28.954510+0000","last_fullsized":"2024-09-15T23:55:28.954510+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941785+0000","last_change":"2024-09-15T23:55:28.941785+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941785+0000","last_undegraded":"2024-09-15T23:55:28.941785+0000","last_fullsized":"2024-09-15T23:55:28.941785+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947263+0000","last_change":"2024-09-15T23:55:28.947263+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947263+0000","last_undegraded":"2024-09-15T23:55:28.947263+0000","last_fullsized":"2024-09-15T23:55:28.947263+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947219+0000","last_change":"2024-09-15T23:55:28.947219+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947219+0000","last_undegraded":"2024-09-15T23:55:28.947219+0000","last_fullsized":"2024-09-15T23:55:28.947219+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947453+0000","last_change":"2024-09-15T23:55:28.947453+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947453+0000","last_undegraded":"2024-09-15T23:55:28.947453+0000","last_fullsized":"2024-09-15T23:55:28.947453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944839+0000","last_change":"2024-09-15T23:55:28.944839+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944839+0000","last_undegraded":"2024-09-15T23:55:28.944839+0000","last_fullsized":"2024-09-15T23:55:28.944839+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.960658+0000","last_change":"2024-09-15T23:55:28.960658+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.960658+0000","last_undegraded":"2024-09-15T23:55:28.960658+0000","last_fullsized":"2024-09-15T23:55:28.960658+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.949787+0000","last_change":"2024-09-15T23:55:28.949787+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.949787+0000","last_undegraded":"2024-09-15T23:55:28.949787+0000","last_fullsized":"2024-09-15T23:55:28.949787+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945497+0000","last_change":"2024-09-15T23:55:28.945497+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945497+0000","last_undegraded":"2024-09-15T23:55:28.945497+0000","last_fullsized":"2024-09-15T23:55:28.945497+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.963741+0000","last_change":"2024-09-15T23:55:28.963741+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.963741+0000","last_undegraded":"2024-09-15T23:55:28.963741+0000","last_fullsized":"2024-09-15T23:55:28.963741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.961521+0000","last_change":"2024-09-15T23:55:28.961521+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.961521+0000","last_undegraded":"2024-09-15T23:55:28.961521+0000","last_fullsized":"2024-09-15T23:55:28.961521+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944916+0000","last_change":"2024-09-15T23:55:28.944916+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944916+0000","last_undegraded":"2024-09-15T23:55:28.944916+0000","last_fullsized":"2024-09-15T23:55:28.944916+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.950123+0000","last_change":"2024-09-15T23:55:28.950123+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.950123+0000","last_undegraded":"2024-09-15T23:55:28.950123+0000","last_fullsized":"2024-09-15T23:55:28.950123+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944169+0000","last_change":"2024-09-15T23:55:28.944169+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944169+0000","last_undegraded":"2024-09-15T23:55:28.944169+0000","last_fullsized":"2024-09-15T23:55:28.944169+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.949998+0000","last_change":"2024-09-15T23:55:28.949998+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.949998+0000","last_undegraded":"2024-09-15T23:55:28.949998+0000","last_fullsized":"2024-09-15T23:55:28.949998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.949258+0000","last_change":"2024-09-15T23:55:28.949258+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.949258+0000","last_undegraded":"2024-09-15T23:55:28.949258+0000","last_fullsized":"2024-09-15T23:55:28.949258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941664+0000","last_change":"2024-09-15T23:55:28.941664+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941664+0000","last_undegraded":"2024-09-15T23:55:28.941664+0000","last_fullsized":"2024-09-15T23:55:28.941664+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944537+0000","last_change":"2024-09-15T23:55:28.944537+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944537+0000","last_undegraded":"2024-09-15T23:55:28.944537+0000","last_fullsized":"2024-09-15T23:55:28.944537+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944365+0000","last_change":"2024-09-15T23:55:28.944365+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944365+0000","last_undegraded":"2024-09-15T23:55:28.944365+0000","last_fullsized":"2024-09-15T23:55:28.944365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944033+0000","last_change":"2024-09-15T23:55:28.944033+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944033+0000","last_undegraded":"2024-09-15T23:55:28.944033+0000","last_fullsized":"2024-09-15T23:55:28.944033+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941535+0000","last_change":"2024-09-15T23:55:28.941535+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941535+0000","last_undegraded":"2024-09-15T23:55:28.941535+0000","last_fullsized":"2024-09-15T23:55:28.941535+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.958904+0000","last_change":"2024-09-15T23:55:28.957377+0000","last_active":"2024-09-15T23:55:28.958904+0000","last_peered":"2024-09-15T23:55:28.958904+0000","last_clean":"2024-09-15T23:55:28.958904+0000","last_became_active":"2024-09-15T23:55:28.957003+0000","last_became_peered":"2024-09-15T23:55:28.957003+0000","last_unstale":"2024-09-15T23:55:28.958904+0000","last_undegraded":"2024-09-15T23:55:28.958904+0000","last_fullsized":"2024-09-15T23:55:28.958904+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:09.157194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.942430+0000","last_change":"2024-09-15T23:55:28.942430+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.942430+0000","last_undegraded":"2024-09-15T23:55:28.942430+0000","last_fullsized":"2024-09-15T23:55:28.942430+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.989408+0000","last_change":"2024-09-15T23:55:28.986205+0000","last_active":"2024-09-15T23:55:28.989408+0000","last_peered":"2024-09-15T23:55:28.989408+0000","last_clean":"2024-09-15T23:55:28.989408+0000","last_became_active":"2024-09-15T23:55:28.985668+0000","last_became_peered":"2024-09-15T23:55:28.985668+0000","last_unstale":"2024-09-15T23:55:28.989408+0000","last_undegraded":"2024-09-15T23:55:28.989408+0000","last_fullsized":"2024-09-15T23:55:28.989408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:41.506389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941837+0000","last_change":"2024-09-15T23:55:28.941837+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941837+0000","last_undegraded":"2024-09-15T23:55:28.941837+0000","last_fullsized":"2024-09-15T23:55:28.941837+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:55:27.910802+0000","last_change":"2024-09-15T23:55:27.910802+0000","last_active":"2024-09-15T23:55:27.910802+0000","last_peered":"2024-09-15T23:55:27.910802+0000","last_clean":"2024-09-15T23:55:27.910802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:27.910802+0000","last_undegraded":"2024-09-15T23:55:27.910802+0000","last_fullsized":"2024-09-15T23:55:27.910802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:55:28.924235+0000","last_change":"2024-09-15T23:55:28.924235+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.924235+0000","last_undegraded":"2024-09-15T23:55:28.924235+0000","last_fullsized":"2024-09-15T23:55:28.924235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.982157+0000","last_change":"2024-09-15T23:55:28.981225+0000","last_active":"2024-09-15T23:55:28.982157+0000","last_peered":"2024-09-15T23:55:28.982157+0000","last_clean":"2024-09-15T23:55:28.982157+0000","last_became_active":"2024-09-15T23:55:28.980753+0000","last_became_peered":"2024-09-15T23:55:28.980753+0000","last_unstale":"2024-09-15T23:55:28.982157+0000","last_undegraded":"2024-09-15T23:55:28.982157+0000","last_fullsized":"2024-09-15T23:55:28.982157+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:11.717951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.942742+0000","last_change":"2024-09-15T23:55:28.942742+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.942742+0000","last_undegraded":"2024-09-15T23:55:28.942742+0000","last_fullsized":"2024-09-15T23:55:28.942742+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.984354+0000","last_change":"2024-09-15T23:55:28.979920+0000","last_active":"2024-09-15T23:55:28.984354+0000","last_peered":"2024-09-15T23:55:28.984354+0000","last_clean":"2024-09-15T23:55:28.984354+0000","last_became_active":"2024-09-15T23:55:28.979269+0000","last_became_peered":"2024-09-15T23:55:28.979269+0000","last_unstale":"2024-09-15T23:55:28.984354+0000","last_undegraded":"2024-09-15T23:55:28.984354+0000","last_fullsized":"2024-09-15T23:55:28.984354+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:50:55.241898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943536+0000","last_change":"2024-09-15T23:55:28.943536+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943536+0000","last_undegraded":"2024-09-15T23:55:28.943536+0000","last_fullsized":"2024-09-15T23:55:28.943536+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.954499+0000","last_change":"2024-09-15T23:55:28.952417+0000","last_active":"2024-09-15T23:55:28.954499+0000","last_peered":"2024-09-15T23:55:28.954499+0000","last_clean":"2024-09-15T23:55:28.954499+0000","last_became_active":"2024-09-15T23:55:28.952107+0000","last_became_peered":"2024-09-15T23:55:28.952107+0000","last_unstale":"2024-09-15T23:55:28.954499+0000","last_undegraded":"2024-09-15T23:55:28.954499+0000","last_fullsized":"2024-09-15T23:55:28.954499+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:30.373849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:55:28.924235+0000","last_change":"2024-09-15T23:55:28.924235+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.924235+0000","last_undegraded":"2024-09-15T23:55:28.924235+0000","last_fullsized":"2024-09-15T23:55:28.924235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.959010+0000","last_change":"2024-09-15T23:55:28.958153+0000","last_active":"2024-09-15T23:55:28.959010+0000","last_peered":"2024-09-15T23:55:28.959010+0000","last_clean":"2024-09-15T23:55:28.959010+0000","last_became_active":"2024-09-15T23:55:28.957814+0000","last_became_peered":"2024-09-15T23:55:28.957814+0000","last_unstale":"2024-09-15T23:55:28.959010+0000","last_undegraded":"2024-09-15T23:55:28.959010+0000","last_fullsized":"2024-09-15T23:55:28.959010+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:17.799300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941602+0000","last_change":"2024-09-15T23:55:28.941602+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941602+0000","last_undegraded":"2024-09-15T23:55:28.941602+0000","last_fullsized":"2024-09-15T23:55:28.941602+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.980671+0000","last_change":"2024-09-15T23:55:28.969352+0000","last_active":"2024-09-15T23:55:28.980671+0000","last_peered":"2024-09-15T23:55:28.980671+0000","last_clean":"2024-09-15T23:55:28.980671+0000","last_became_active":"2024-09-15T23:55:28.968629+0000","last_became_peered":"2024-09-15T23:55:28.968629+0000","last_unstale":"2024-09-15T23:55:28.980671+0000","last_undegraded":"2024-09-15T23:55:28.980671+0000","last_fullsized":"2024-09-15T23:55:28.980671+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:30.705727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943160+0000","last_change":"2024-09-15T23:55:28.943160+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943160+0000","last_undegraded":"2024-09-15T23:55:28.943160+0000","last_fullsized":"2024-09-15T23:55:28.943160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.951237+0000","last_change":"2024-09-15T23:55:28.950095+0000","last_active":"2024-09-15T23:55:28.951237+0000","last_peered":"2024-09-15T23:55:28.951237+0000","last_clean":"2024-09-15T23:55:28.951237+0000","last_became_active":"2024-09-15T23:55:28.949824+0000","last_became_peered":"2024-09-15T23:55:28.949824+0000","last_unstale":"2024-09-15T23:55:28.951237+0000","last_undegraded":"2024-09-15T23:55:28.951237+0000","last_fullsized":"2024-09-15T23:55:28.951237+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:42.163168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941913+0000","last_change":"2024-09-15T23:55:28.941913+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941913+0000","last_undegraded":"2024-09-15T23:55:28.941913+0000","last_fullsized":"2024-09-15T23:55:28.941913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.979067+0000","last_change":"2024-09-15T23:55:28.978340+0000","last_active":"2024-09-15T23:55:28.979067+0000","last_peered":"2024-09-15T23:55:28.979067+0000","last_clean":"2024-09-15T23:55:28.979067+0000","last_became_active":"2024-09-15T23:55:28.978016+0000","last_became_peered":"2024-09-15T23:55:28.978016+0000","last_unstale":"2024-09-15T23:55:28.979067+0000","last_undegraded":"2024-09-15T23:55:28.979067+0000","last_fullsized":"2024-09-15T23:55:28.979067+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:40.177912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.940712+0000","last_change":"2024-09-15T23:55:28.940712+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.940712+0000","last_undegraded":"2024-09-15T23:55:28.940712+0000","last_fullsized":"2024-09-15T23:55:28.940712+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.961607+0000","last_change":"2024-09-15T23:55:28.960875+0000","last_active":"2024-09-15T23:55:28.961607+0000","last_peered":"2024-09-15T23:55:28.961607+0000","last_clean":"2024-09-15T23:55:28.961607+0000","last_became_active":"2024-09-15T23:55:28.960593+0000","last_became_peered":"2024-09-15T23:55:28.960593+0000","last_unstale":"2024-09-15T23:55:28.961607+0000","last_undegraded":"2024-09-15T23:55:28.961607+0000","last_fullsized":"2024-09-15T23:55:28.961607+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:47.992194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.946361+0000","last_change":"2024-09-15T23:55:28.946361+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.946361+0000","last_undegraded":"2024-09-15T23:55:28.946361+0000","last_fullsized":"2024-09-15T23:55:28.946361+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:55:27.910802+0000","last_change":"2024-09-15T23:55:27.910802+0000","last_active":"2024-09-15T23:55:27.910802+0000","last_peered":"2024-09-15T23:55:27.910802+0000","last_clean":"2024-09-15T23:55:27.910802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:27.910802+0000","last_undegraded":"2024-09-15T23:55:27.910802+0000","last_fullsized":"2024-09-15T23:55:27.910802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944290+0000","last_change":"2024-09-15T23:55:28.944290+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944290+0000","last_undegraded":"2024-09-15T23:55:28.944290+0000","last_fullsized":"2024-09-15T23:55:28.944290+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.985001+0000","last_change":"2024-09-15T23:55:28.977045+0000","last_active":"2024-09-15T23:55:28.985001+0000","last_peered":"2024-09-15T23:55:28.985001+0000","last_clean":"2024-09-15T23:55:28.985001+0000","last_became_active":"2024-09-15T23:55:28.976372+0000","last_became_peered":"2024-09-15T23:55:28.976372+0000","last_unstale":"2024-09-15T23:55:28.985001+0000","last_undegraded":"2024-09-15T23:55:28.985001+0000","last_fullsized":"2024-09-15T23:55:28.985001+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:46.331031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943480+0000","last_change":"2024-09-15T23:55:28.943480+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943480+0000","last_undegraded":"2024-09-15T23:55:28.943480+0000","last_fullsized":"2024-09-15T23:55:28.943480+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.960937+0000","last_change":"2024-09-15T23:55:28.960226+0000","last_active":"2024-09-15T23:55:28.960937+0000","last_peered":"2024-09-15T23:55:28.960937+0000","last_clean":"2024-09-15T23:55:28.960937+0000","last_became_active":"2024-09-15T23:55:28.960000+0000","last_became_peered":"2024-09-15T23:55:28.960000+0000","last_unstale":"2024-09-15T23:55:28.960937+0000","last_undegraded":"2024-09-15T23:55:28.960937+0000","last_fullsized":"2024-09-15T23:55:28.960937+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:07.288904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.958518+0000","last_change":"2024-09-15T23:55:28.958518+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.958518+0000","last_undegraded":"2024-09-15T23:55:28.958518+0000","last_fullsized":"2024-09-15T23:55:28.958518+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.955458+0000","last_change":"2024-09-15T23:55:28.953752+0000","last_active":"2024-09-15T23:55:28.955458+0000","last_peered":"2024-09-15T23:55:28.955458+0000","last_clean":"2024-09-15T23:55:28.955458+0000","last_became_active":"2024-09-15T23:55:28.953477+0000","last_became_peered":"2024-09-15T23:55:28.953477+0000","last_unstale":"2024-09-15T23:55:28.955458+0000","last_undegraded":"2024-09-15T23:55:28.955458+0000","last_fullsized":"2024-09-15T23:55:28.955458+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:07.288904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.961961+0000","last_change":"2024-09-15T23:55:28.961961+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.961961+0000","last_undegraded":"2024-09-15T23:55:28.961961+0000","last_fullsized":"2024-09-15T23:55:28.961961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.984490+0000","last_change":"2024-09-15T23:55:28.982518+0000","last_active":"2024-09-15T23:55:28.984490+0000","last_peered":"2024-09-15T23:55:28.984490+0000","last_clean":"2024-09-15T23:55:28.984490+0000","last_became_active":"2024-09-15T23:55:28.981852+0000","last_became_peered":"2024-09-15T23:55:28.981852+0000","last_unstale":"2024-09-15T23:55:28.984490+0000","last_undegraded":"2024-09-15T23:55:28.984490+0000","last_fullsized":"2024-09-15T23:55:28.984490+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:17.276493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:55:28.924235+0000","last_change":"2024-09-15T23:55:28.924235+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.924235+0000","last_undegraded":"2024-09-15T23:55:28.924235+0000","last_fullsized":"2024-09-15T23:55:28.924235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.990271+0000","last_change":"2024-09-15T23:55:28.987736+0000","last_active":"2024-09-15T23:55:28.990271+0000","last_peered":"2024-09-15T23:55:28.990271+0000","last_clean":"2024-09-15T23:55:28.990271+0000","last_became_active":"2024-09-15T23:55:28.986972+0000","last_became_peered":"2024-09-15T23:55:28.986972+0000","last_unstale":"2024-09-15T23:55:28.990271+0000","last_undegraded":"2024-09-15T23:55:28.990271+0000","last_fullsized":"2024-09-15T23:55:28.990271+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:36.040443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945025+0000","last_change":"2024-09-15T23:55:28.945025+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945025+0000","last_undegraded":"2024-09-15T23:55:28.945025+0000","last_fullsized":"2024-09-15T23:55:28.945025+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.986691+0000","last_change":"2024-09-15T23:55:28.978148+0000","last_active":"2024-09-15T23:55:28.986691+0000","last_peered":"2024-09-15T23:55:28.986691+0000","last_clean":"2024-09-15T23:55:28.986691+0000","last_became_active":"2024-09-15T23:55:28.977563+0000","last_became_peered":"2024-09-15T23:55:28.977563+0000","last_unstale":"2024-09-15T23:55:28.986691+0000","last_undegraded":"2024-09-15T23:55:28.986691+0000","last_fullsized":"2024-09-15T23:55:28.986691+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:50.867342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.950442+0000","last_change":"2024-09-15T23:55:28.950442+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.950442+0000","last_undegraded":"2024-09-15T23:55:28.950442+0000","last_fullsized":"2024-09-15T23:55:28.950442+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.981932+0000","last_change":"2024-09-15T23:55:28.981019+0000","last_active":"2024-09-15T23:55:28.981932+0000","last_peered":"2024-09-15T23:55:28.981932+0000","last_clean":"2024-09-15T23:55:28.981932+0000","last_became_active":"2024-09-15T23:55:28.980736+0000","last_became_peered":"2024-09-15T23:55:28.980736+0000","last_unstale":"2024-09-15T23:55:28.981932+0000","last_undegraded":"2024-09-15T23:55:28.981932+0000","last_fullsized":"2024-09-15T23:55:28.981932+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:11.717951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.955567+0000","last_change":"2024-09-15T23:55:28.955567+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.955567+0000","last_undegraded":"2024-09-15T23:55:28.955567+0000","last_fullsized":"2024-09-15T23:55:28.955567+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.966572+0000","last_change":"2024-09-15T23:55:28.965885+0000","last_active":"2024-09-15T23:55:28.966572+0000","last_peered":"2024-09-15T23:55:28.966572+0000","last_clean":"2024-09-15T23:55:28.966572+0000","last_became_active":"2024-09-15T23:55:28.965531+0000","last_became_peered":"2024-09-15T23:55:28.965531+0000","last_unstale":"2024-09-15T23:55:28.966572+0000","last_undegraded":"2024-09-15T23:55:28.966572+0000","last_fullsized":"2024-09-15T23:55:28.966572+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:40.177912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.948793+0000","last_change":"2024-09-15T23:55:28.948793+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.948793+0000","last_undegraded":"2024-09-15T23:55:28.948793+0000","last_fullsized":"2024-09-15T23:55:28.948793+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.965793+0000","last_change":"2024-09-15T23:55:28.960054+0000","last_active":"2024-09-15T23:55:28.965793+0000","last_peered":"2024-09-15T23:55:28.965793+0000","last_clean":"2024-09-15T23:55:28.965793+0000","last_became_active":"2024-09-15T23:55:28.959315+0000","last_became_peered":"2024-09-15T23:55:28.959315+0000","last_unstale":"2024-09-15T23:55:28.965793+0000","last_undegraded":"2024-09-15T23:55:28.965793+0000","last_fullsized":"2024-09-15T23:55:28.965793+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:35.216646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945269+0000","last_change":"2024-09-15T23:55:28.945269+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945269+0000","last_undegraded":"2024-09-15T23:55:28.945269+0000","last_fullsized":"2024-09-15T23:55:28.945269+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.989629+0000","last_change":"2024-09-15T23:55:28.983747+0000","last_active":"2024-09-15T23:55:28.989629+0000","last_peered":"2024-09-15T23:55:28.989629+0000","last_clean":"2024-09-15T23:55:28.989629+0000","last_became_active":"2024-09-15T23:55:28.982268+0000","last_became_peered":"2024-09-15T23:55:28.982268+0000","last_unstale":"2024-09-15T23:55:28.989629+0000","last_undegraded":"2024-09-15T23:55:28.989629+0000","last_fullsized":"2024-09-15T23:55:28.989629+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:54.333221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.953256+0000","last_change":"2024-09-15T23:55:28.953256+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.953256+0000","last_undegraded":"2024-09-15T23:55:28.953256+0000","last_fullsized":"2024-09-15T23:55:28.953256+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:55:27.910802+0000","last_change":"2024-09-15T23:55:27.910802+0000","last_active":"2024-09-15T23:55:27.910802+0000","last_peered":"2024-09-15T23:55:27.910802+0000","last_clean":"2024-09-15T23:55:27.910802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:27.910802+0000","last_undegraded":"2024-09-15T23:55:27.910802+0000","last_fullsized":"2024-09-15T23:55:27.910802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.950986+0000","last_change":"2024-09-15T23:55:28.950986+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.950986+0000","last_undegraded":"2024-09-15T23:55:28.950986+0000","last_fullsized":"2024-09-15T23:55:28.950986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:55:27.910802+0000","last_change":"2024-09-15T23:55:27.910802+0000","last_active":"2024-09-15T23:55:27.910802+0000","last_peered":"2024-09-15T23:55:27.910802+0000","last_clean":"2024-09-15T23:55:27.910802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:27.910802+0000","last_undegraded":"2024-09-15T23:55:27.910802+0000","last_fullsized":"2024-09-15T23:55:27.910802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941231+0000","last_change":"2024-09-15T23:55:28.941231+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941231+0000","last_undegraded":"2024-09-15T23:55:28.941231+0000","last_fullsized":"2024-09-15T23:55:28.941231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.959212+0000","last_change":"2024-09-15T23:55:28.958308+0000","last_active":"2024-09-15T23:55:28.959212+0000","last_peered":"2024-09-15T23:55:28.959212+0000","last_clean":"2024-09-15T23:55:28.959212+0000","last_became_active":"2024-09-15T23:55:28.957929+0000","last_became_peered":"2024-09-15T23:55:28.957929+0000","last_unstale":"2024-09-15T23:55:28.959212+0000","last_undegraded":"2024-09-15T23:55:28.959212+0000","last_fullsized":"2024-09-15T23:55:28.959212+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:35.158272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:55:28.924235+0000","last_change":"2024-09-15T23:55:28.924235+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.924235+0000","last_undegraded":"2024-09-15T23:55:28.924235+0000","last_fullsized":"2024-09-15T23:55:28.924235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.961631+0000","last_change":"2024-09-15T23:55:28.960962+0000","last_active":"2024-09-15T23:55:28.961631+0000","last_peered":"2024-09-15T23:55:28.961631+0000","last_clean":"2024-09-15T23:55:28.961631+0000","last_became_active":"2024-09-15T23:55:28.960579+0000","last_became_peered":"2024-09-15T23:55:28.960579+0000","last_unstale":"2024-09-15T23:55:28.961631+0000","last_undegraded":"2024-09-15T23:55:28.961631+0000","last_fullsized":"2024-09-15T23:55:28.961631+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:38.909033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945032+0000","last_change":"2024-09-15T23:55:28.945032+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945032+0000","last_undegraded":"2024-09-15T23:55:28.945032+0000","last_fullsized":"2024-09-15T23:55:28.945032+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.985249+0000","last_change":"2024-09-15T23:55:28.980090+0000","last_active":"2024-09-15T23:55:28.985249+0000","last_peered":"2024-09-15T23:55:28.985249+0000","last_clean":"2024-09-15T23:55:28.985249+0000","last_became_active":"2024-09-15T23:55:28.978880+0000","last_became_peered":"2024-09-15T23:55:28.978880+0000","last_unstale":"2024-09-15T23:55:28.985249+0000","last_undegraded":"2024-09-15T23:55:28.985249+0000","last_fullsized":"2024-09-15T23:55:28.985249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:00.563529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:55:28.924235+0000","last_change":"2024-09-15T23:55:28.924235+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.924235+0000","last_undegraded":"2024-09-15T23:55:28.924235+0000","last_fullsized":"2024-09-15T23:55:28.924235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:55:27.910802+0000","last_change":"2024-09-15T23:55:27.910802+0000","last_active":"2024-09-15T23:55:27.910802+0000","last_peered":"2024-09-15T23:55:27.910802+0000","last_clean":"2024-09-15T23:55:27.910802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:27.910802+0000","last_undegraded":"2024-09-15T23:55:27.910802+0000","last_fullsized":"2024-09-15T23:55:27.910802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944543+0000","last_change":"2024-09-15T23:55:28.944543+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944543+0000","last_undegraded":"2024-09-15T23:55:28.944543+0000","last_fullsized":"2024-09-15T23:55:28.944543+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.989573+0000","last_change":"2024-09-15T23:55:28.983121+0000","last_active":"2024-09-15T23:55:28.989573+0000","last_peered":"2024-09-15T23:55:28.989573+0000","last_clean":"2024-09-15T23:55:28.989573+0000","last_became_active":"2024-09-15T23:55:28.981404+0000","last_became_peered":"2024-09-15T23:55:28.981404+0000","last_unstale":"2024-09-15T23:55:28.989573+0000","last_undegraded":"2024-09-15T23:55:28.989573+0000","last_fullsized":"2024-09-15T23:55:28.989573+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:14.512897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:55:28.924235+0000","last_change":"2024-09-15T23:55:28.924235+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.924235+0000","last_undegraded":"2024-09-15T23:55:28.924235+0000","last_fullsized":"2024-09-15T23:55:28.924235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.958521+0000","last_change":"2024-09-15T23:55:28.956432+0000","last_active":"2024-09-15T23:55:28.958521+0000","last_peered":"2024-09-15T23:55:28.958521+0000","last_clean":"2024-09-15T23:55:28.958521+0000","last_became_active":"2024-09-15T23:55:28.956054+0000","last_became_peered":"2024-09-15T23:55:28.956054+0000","last_unstale":"2024-09-15T23:55:28.958521+0000","last_undegraded":"2024-09-15T23:55:28.958521+0000","last_fullsized":"2024-09-15T23:55:28.958521+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:44.566526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.952040+0000","last_change":"2024-09-15T23:55:28.952040+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.952040+0000","last_undegraded":"2024-09-15T23:55:28.952040+0000","last_fullsized":"2024-09-15T23:55:28.952040+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.961166+0000","last_change":"2024-09-15T23:55:28.960457+0000","last_active":"2024-09-15T23:55:28.961166+0000","last_peered":"2024-09-15T23:55:28.961166+0000","last_clean":"2024-09-15T23:55:28.961166+0000","last_became_active":"2024-09-15T23:55:28.960080+0000","last_became_peered":"2024-09-15T23:55:28.960080+0000","last_unstale":"2024-09-15T23:55:28.961166+0000","last_undegraded":"2024-09-15T23:55:28.961166+0000","last_fullsized":"2024-09-15T23:55:28.961166+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:44.566526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943015+0000","last_change":"2024-09-15T23:55:28.943015+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943015+0000","last_undegraded":"2024-09-15T23:55:28.943015+0000","last_fullsized":"2024-09-15T23:55:28.943015+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:55:27.910802+0000","last_change":"2024-09-15T23:55:27.910802+0000","last_active":"2024-09-15T23:55:27.910802+0000","last_peered":"2024-09-15T23:55:27.910802+0000","last_clean":"2024-09-15T23:55:27.910802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:27.910802+0000","last_undegraded":"2024-09-15T23:55:27.910802+0000","last_fullsized":"2024-09-15T23:55:27.910802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.941473+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:55:28.941473+0000","last_peered":"2024-09-15T23:55:28.941473+0000","last_clean":"2024-09-15T23:55:28.941473+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:55:28.941473+0000","last_undegraded":"2024-09-15T23:55:28.941473+0000","last_fullsized":"2024-09-15T23:55:28.941473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":573440,"data_stored":249307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":573440,"data_stored":249307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1155072,"data_stored":833008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1142784,"data_stored":826799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:55:32.975 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:55:33.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.126+0000 7fac6c408640 1 Processor -- start 2024-09-15T23:55:33.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.126+0000 7fac6c408640 1 -- start start 2024-09-15T23:55:33.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac6c408640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fac6415bec0 0x7fac640ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac6c408640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac640af470 0x7fac6406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac6c408640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac640b3290 con 0x7fac6415c2a0 2024-09-15T23:55:33.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac6c408640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fac640b3570 con 0x7fac6415bec0 2024-09-15T23:55:33.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac6c408640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fac640b3850 con 0x7fac640af470 2024-09-15T23:55:33.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac6a9a5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac640af470 0x7fac6406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac6a1a4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fac6415bec0 0x7fac640ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac699a3640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fac6415c2a0 0x7fac640aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:49402/0 (socket says 172.21.15.112:49402) 2024-09-15T23:55:33.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac6a9a5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac640af470 0x7fac6406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:45170/0 (socket says 172.21.15.112:45170) 2024-09-15T23:55:33.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac699a3640 1 -- 172.21.15.112:0/610733303 learned_addr learned my addr 172.21.15.112:0/610733303 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:33.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac691a2640 1 -- 172.21.15.112:0/610733303 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627382057 0 0) 0x7fac640b3290 con 0x7fac6415c2a0 2024-09-15T23:55:33.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac691a2640 1 -- 172.21.15.112:0/610733303 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac4c003530 con 0x7fac6415c2a0 2024-09-15T23:55:33.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac6a9a5640 1 -- 172.21.15.112:0/610733303 >> v2:172.21.15.169:3300/0 conn(0x7fac6415bec0 msgr2=0x7fac640ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:33.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac6a9a5640 1 --2- 172.21.15.112:0/610733303 >> v2:172.21.15.169:3300/0 conn(0x7fac6415bec0 0x7fac640ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac6a9a5640 1 -- 172.21.15.112:0/610733303 >> v1:172.21.15.169:6789/0 conn(0x7fac6415c2a0 legacy=0x7fac640aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac6a9a5640 1 -- 172.21.15.112:0/610733303 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac640b3b30 con 0x7fac640af470 2024-09-15T23:55:33.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.130+0000 7fac6a9a5640 1 --2- 172.21.15.112:0/610733303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac640af470 0x7fac6406e000 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0097c0 tx=0x7fac5c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da28172713731689 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:33.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac691a2640 1 -- 172.21.15.112:0/610733303 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0b1070 con 0x7fac640af470 2024-09-15T23:55:33.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac691a2640 1 -- 172.21.15.112:0/610733303 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac5c0a8050 con 0x7fac640af470 2024-09-15T23:55:33.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac691a2640 1 -- 172.21.15.112:0/610733303 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0ac840 con 0x7fac640af470 2024-09-15T23:55:33.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 -- 172.21.15.112:0/610733303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac640af470 msgr2=0x7fac6406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 --2- 172.21.15.112:0/610733303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac640af470 0x7fac6406e000 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0097c0 tx=0x7fac5c01c3e0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 -- 172.21.15.112:0/610733303 shutdown_connections 2024-09-15T23:55:33.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 --2- 172.21.15.112:0/610733303 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac640af470 0x7fac6406e000 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 --2- 172.21.15.112:0/610733303 >> v2:172.21.15.169:3300/0 conn(0x7fac6415bec0 0x7fac640ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 -- 172.21.15.112:0/610733303 >> 172.21.15.112:0/610733303 conn(0x7fac640b1f90 msgr2=0x7fac640b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 -- 172.21.15.112:0/610733303 shutdown_connections 2024-09-15T23:55:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 -- 172.21.15.112:0/610733303 wait complete. 2024-09-15T23:55:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 Processor -- start 2024-09-15T23:55:33.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 -- start start 2024-09-15T23:55:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac640af470 0x7fac64157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac6415bec0 0x7fac641540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac6415c2a0 0x7fac640cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fac6406ed50 con 0x7fac6415bec0 2024-09-15T23:55:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fac640ad740 con 0x7fac6415c2a0 2024-09-15T23:55:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6c408640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fac6406eed0 con 0x7fac640af470 2024-09-15T23:55:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac699a3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac6415bec0 0x7fac641540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac699a3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac6415bec0 0x7fac641540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41186/0 (socket says 172.21.15.112:41186) 2024-09-15T23:55:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac699a3640 1 -- 172.21.15.112:0/3553913473 learned_addr learned my addr 172.21.15.112:0/3553913473 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6a1a4640 1 --2- 172.21.15.112:0/3553913473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac640af470 0x7fac64157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac6a9a5640 1 --2- 172.21.15.112:0/3553913473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac6415c2a0 0x7fac640cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac699a3640 1 -- 172.21.15.112:0/3553913473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac640af470 msgr2=0x7fac64157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac699a3640 1 --2- 172.21.15.112:0/3553913473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac640af470 0x7fac64157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac699a3640 1 -- 172.21.15.112:0/3553913473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac6415c2a0 msgr2=0x7fac640cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac699a3640 1 --2- 172.21.15.112:0/3553913473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac6415c2a0 0x7fac640cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac699a3640 1 -- 172.21.15.112:0/3553913473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac64154cb0 con 0x7fac6415bec0 2024-09-15T23:55:33.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.134+0000 7fac699a3640 1 --2- 172.21.15.112:0/3553913473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac6415bec0 0x7fac641540d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fac5800c400 tx=0x7fac5800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:33.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.138+0000 7fac62ffd640 1 -- 172.21.15.112:0/3553913473 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58017070 con 0x7fac6415bec0 2024-09-15T23:55:33.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.138+0000 7fac62ffd640 1 -- 172.21.15.112:0/3553913473 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac58005cf0 con 0x7fac6415bec0 2024-09-15T23:55:33.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.138+0000 7fac6c408640 1 -- 172.21.15.112:0/3553913473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac64156b20 con 0x7fac6415bec0 2024-09-15T23:55:33.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.138+0000 7fac62ffd640 1 -- 172.21.15.112:0/3553913473 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac580072d0 con 0x7fac6415bec0 2024-09-15T23:55:33.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.138+0000 7fac6c408640 1 -- 172.21.15.112:0/3553913473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac641575c0 con 0x7fac6415bec0 2024-09-15T23:55:33.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.138+0000 7fac6c408640 1 -- 172.21.15.112:0/3553913473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac6406e000 con 0x7fac6415bec0 2024-09-15T23:55:33.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.138+0000 7fac62ffd640 1 -- 172.21.15.112:0/3553913473 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac5801a070 con 0x7fac6415bec0 2024-09-15T23:55:33.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.138+0000 7fac62ffd640 1 --2- 172.21.15.112:0/3553913473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fac500678c0 0x7fac50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.138+0000 7fac62ffd640 1 -- 172.21.15.112:0/3553913473 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fac58085080 con 0x7fac6415bec0 2024-09-15T23:55:33.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.138+0000 7fac6a1a4640 1 --2- 172.21.15.112:0/3553913473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fac500678c0 0x7fac50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.138+0000 7fac6a1a4640 1 --2- 172.21.15.112:0/3553913473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fac500678c0 0x7fac50069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fac540113e0 tx=0x7fac5400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:33.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.142+0000 7fac62ffd640 1 -- 172.21.15.112:0/3553913473 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fac64154cb0 con 0x7fac6415bec0 2024-09-15T23:55:33.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.302+0000 7fac6c408640 1 -- 172.21.15.112:0/3553913473 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac64166dd0 con 0x7fac500678c0 2024-09-15T23:55:33.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.306+0000 7fac62ffd640 1 -- 172.21.15.112:0/3553913473 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247327 (secure 0 0 0) 0x7fac64166dd0 con 0x7fac500678c0 2024-09-15T23:55:33.316 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:33.317 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:55:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.310+0000 7fac6c408640 1 -- 172.21.15.112:0/3553913473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fac500678c0 msgr2=0x7fac50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.310+0000 7fac6c408640 1 --2- 172.21.15.112:0/3553913473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fac500678c0 0x7fac50069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fac540113e0 tx=0x7fac5400b040 comp rx=0 tx=0).stop 2024-09-15T23:55:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.310+0000 7fac6c408640 1 -- 172.21.15.112:0/3553913473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac6415bec0 msgr2=0x7fac641540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.310+0000 7fac6c408640 1 --2- 172.21.15.112:0/3553913473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac6415bec0 0x7fac641540d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fac5800c400 tx=0x7fac5800c8c0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.310+0000 7fac6c408640 1 -- 172.21.15.112:0/3553913473 shutdown_connections 2024-09-15T23:55:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.310+0000 7fac6c408640 1 --2- 172.21.15.112:0/3553913473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fac500678c0 0x7fac50069d80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.310+0000 7fac6c408640 1 --2- 172.21.15.112:0/3553913473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac6415c2a0 0x7fac640cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.310+0000 7fac6c408640 1 --2- 172.21.15.112:0/3553913473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac6415bec0 0x7fac641540d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.310+0000 7fac6c408640 1 --2- 172.21.15.112:0/3553913473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac640af470 0x7fac64157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.310+0000 7fac6c408640 1 -- 172.21.15.112:0/3553913473 >> 172.21.15.112:0/3553913473 conn(0x7fac640b1f90 msgr2=0x7fac640b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.310+0000 7fac6c408640 1 -- 172.21.15.112:0/3553913473 shutdown_connections 2024-09-15T23:55:33.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.310+0000 7fac6c408640 1 -- 172.21.15.112:0/3553913473 wait complete. 2024-09-15T23:55:33.334 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-15T23:55:33.264151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":169,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255168,"kb_used_data":5620,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719552,"statfs":{"total":773094113280,"available":772832821248,"internally_reserved":0,"allocated":5754880,"data_stored":3157418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.337882"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.951163+0000","last_change":"2024-09-15T23:55:28.951163+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.951163+0000","last_undegraded":"2024-09-15T23:55:28.951163+0000","last_fullsized":"2024-09-15T23:55:28.951163+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945077+0000","last_change":"2024-09-15T23:55:28.945077+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945077+0000","last_undegraded":"2024-09-15T23:55:28.945077+0000","last_fullsized":"2024-09-15T23:55:28.945077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.963825+0000","last_change":"2024-09-15T23:55:28.963825+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.963825+0000","last_undegraded":"2024-09-15T23:55:28.963825+0000","last_fullsized":"2024-09-15T23:55:28.963825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941093+0000","last_change":"2024-09-15T23:55:28.941093+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941093+0000","last_undegraded":"2024-09-15T23:55:28.941093+0000","last_fullsized":"2024-09-15T23:55:28.941093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945973+0000","last_change":"2024-09-15T23:55:28.945973+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945973+0000","last_undegraded":"2024-09-15T23:55:28.945973+0000","last_fullsized":"2024-09-15T23:55:28.945973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947588+0000","last_change":"2024-09-15T23:55:28.947588+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947588+0000","last_undegraded":"2024-09-15T23:55:28.947588+0000","last_fullsized":"2024-09-15T23:55:28.947588+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202852+0000","last_change":"2024-09-15T23:55:29.996060+0000","last_active":"2024-09-15T23:55:31.202852+0000","last_peered":"2024-09-15T23:55:31.202852+0000","last_clean":"2024-09-15T23:55:31.202852+0000","last_became_active":"2024-09-15T23:55:29.994668+0000","last_became_peered":"2024-09-15T23:55:29.994668+0000","last_unstale":"2024-09-15T23:55:31.202852+0000","last_undegraded":"2024-09-15T23:55:31.202852+0000","last_fullsized":"2024-09-15T23:55:31.202852+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:51.540608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.948541+0000","last_change":"2024-09-15T23:55:28.948541+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.948541+0000","last_undegraded":"2024-09-15T23:55:28.948541+0000","last_fullsized":"2024-09-15T23:55:28.948541+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.963117+0000","last_change":"2024-09-15T23:55:28.963117+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.963117+0000","last_undegraded":"2024-09-15T23:55:28.963117+0000","last_fullsized":"2024-09-15T23:55:28.963117+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204180+0000","last_change":"2024-09-15T23:55:29.995362+0000","last_active":"2024-09-15T23:55:31.204180+0000","last_peered":"2024-09-15T23:55:31.204180+0000","last_clean":"2024-09-15T23:55:31.204180+0000","last_became_active":"2024-09-15T23:55:29.994531+0000","last_became_peered":"2024-09-15T23:55:29.994531+0000","last_unstale":"2024-09-15T23:55:31.204180+0000","last_undegraded":"2024-09-15T23:55:31.204180+0000","last_fullsized":"2024-09-15T23:55:31.204180+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:49.797209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.955280+0000","last_change":"2024-09-15T23:55:28.955280+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.955280+0000","last_undegraded":"2024-09-15T23:55:28.955280+0000","last_fullsized":"2024-09-15T23:55:28.955280+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.948981+0000","last_change":"2024-09-15T23:55:28.948981+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.948981+0000","last_undegraded":"2024-09-15T23:55:28.948981+0000","last_fullsized":"2024-09-15T23:55:28.948981+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.954510+0000","last_change":"2024-09-15T23:55:28.954510+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.954510+0000","last_undegraded":"2024-09-15T23:55:28.954510+0000","last_fullsized":"2024-09-15T23:55:28.954510+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941785+0000","last_change":"2024-09-15T23:55:28.941785+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941785+0000","last_undegraded":"2024-09-15T23:55:28.941785+0000","last_fullsized":"2024-09-15T23:55:28.941785+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947263+0000","last_change":"2024-09-15T23:55:28.947263+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947263+0000","last_undegraded":"2024-09-15T23:55:28.947263+0000","last_fullsized":"2024-09-15T23:55:28.947263+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947219+0000","last_change":"2024-09-15T23:55:28.947219+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947219+0000","last_undegraded":"2024-09-15T23:55:28.947219+0000","last_fullsized":"2024-09-15T23:55:28.947219+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947453+0000","last_change":"2024-09-15T23:55:28.947453+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947453+0000","last_undegraded":"2024-09-15T23:55:28.947453+0000","last_fullsized":"2024-09-15T23:55:28.947453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944839+0000","last_change":"2024-09-15T23:55:28.944839+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944839+0000","last_undegraded":"2024-09-15T23:55:28.944839+0000","last_fullsized":"2024-09-15T23:55:28.944839+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.960658+0000","last_change":"2024-09-15T23:55:28.960658+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.960658+0000","last_undegraded":"2024-09-15T23:55:28.960658+0000","last_fullsized":"2024-09-15T23:55:28.960658+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.949787+0000","last_change":"2024-09-15T23:55:28.949787+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.949787+0000","last_undegraded":"2024-09-15T23:55:28.949787+0000","last_fullsized":"2024-09-15T23:55:28.949787+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945497+0000","last_change":"2024-09-15T23:55:28.945497+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945497+0000","last_undegraded":"2024-09-15T23:55:28.945497+0000","last_fullsized":"2024-09-15T23:55:28.945497+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.963741+0000","last_change":"2024-09-15T23:55:28.963741+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.963741+0000","last_undegraded":"2024-09-15T23:55:28.963741+0000","last_fullsized":"2024-09-15T23:55:28.963741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.961521+0000","last_change":"2024-09-15T23:55:28.961521+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.961521+0000","last_undegraded":"2024-09-15T23:55:28.961521+0000","last_fullsized":"2024-09-15T23:55:28.961521+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944916+0000","last_change":"2024-09-15T23:55:28.944916+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944916+0000","last_undegraded":"2024-09-15T23:55:28.944916+0000","last_fullsized":"2024-09-15T23:55:28.944916+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.950123+0000","last_change":"2024-09-15T23:55:28.950123+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.950123+0000","last_undegraded":"2024-09-15T23:55:28.950123+0000","last_fullsized":"2024-09-15T23:55:28.950123+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944169+0000","last_change":"2024-09-15T23:55:28.944169+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944169+0000","last_undegraded":"2024-09-15T23:55:28.944169+0000","last_fullsized":"2024-09-15T23:55:28.944169+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.949998+0000","last_change":"2024-09-15T23:55:28.949998+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.949998+0000","last_undegraded":"2024-09-15T23:55:28.949998+0000","last_fullsized":"2024-09-15T23:55:28.949998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.949258+0000","last_change":"2024-09-15T23:55:28.949258+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.949258+0000","last_undegraded":"2024-09-15T23:55:28.949258+0000","last_fullsized":"2024-09-15T23:55:28.949258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941664+0000","last_change":"2024-09-15T23:55:28.941664+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941664+0000","last_undegraded":"2024-09-15T23:55:28.941664+0000","last_fullsized":"2024-09-15T23:55:28.941664+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944537+0000","last_change":"2024-09-15T23:55:28.944537+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944537+0000","last_undegraded":"2024-09-15T23:55:28.944537+0000","last_fullsized":"2024-09-15T23:55:28.944537+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944365+0000","last_change":"2024-09-15T23:55:28.944365+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944365+0000","last_undegraded":"2024-09-15T23:55:28.944365+0000","last_fullsized":"2024-09-15T23:55:28.944365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944033+0000","last_change":"2024-09-15T23:55:28.944033+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944033+0000","last_undegraded":"2024-09-15T23:55:28.944033+0000","last_fullsized":"2024-09-15T23:55:28.944033+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941535+0000","last_change":"2024-09-15T23:55:28.941535+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941535+0000","last_undegraded":"2024-09-15T23:55:28.941535+0000","last_fullsized":"2024-09-15T23:55:28.941535+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.958904+0000","last_change":"2024-09-15T23:55:28.957377+0000","last_active":"2024-09-15T23:55:28.958904+0000","last_peered":"2024-09-15T23:55:28.958904+0000","last_clean":"2024-09-15T23:55:28.958904+0000","last_became_active":"2024-09-15T23:55:28.957003+0000","last_became_peered":"2024-09-15T23:55:28.957003+0000","last_unstale":"2024-09-15T23:55:28.958904+0000","last_undegraded":"2024-09-15T23:55:28.958904+0000","last_fullsized":"2024-09-15T23:55:28.958904+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:09.157194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.942430+0000","last_change":"2024-09-15T23:55:28.942430+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.942430+0000","last_undegraded":"2024-09-15T23:55:28.942430+0000","last_fullsized":"2024-09-15T23:55:28.942430+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.989408+0000","last_change":"2024-09-15T23:55:28.986205+0000","last_active":"2024-09-15T23:55:28.989408+0000","last_peered":"2024-09-15T23:55:28.989408+0000","last_clean":"2024-09-15T23:55:28.989408+0000","last_became_active":"2024-09-15T23:55:28.985668+0000","last_became_peered":"2024-09-15T23:55:28.985668+0000","last_unstale":"2024-09-15T23:55:28.989408+0000","last_undegraded":"2024-09-15T23:55:28.989408+0000","last_fullsized":"2024-09-15T23:55:28.989408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:41.506389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941837+0000","last_change":"2024-09-15T23:55:28.941837+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941837+0000","last_undegraded":"2024-09-15T23:55:28.941837+0000","last_fullsized":"2024-09-15T23:55:28.941837+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204016+0000","last_change":"2024-09-15T23:55:28.959282+0000","last_active":"2024-09-15T23:55:31.204016+0000","last_peered":"2024-09-15T23:55:31.204016+0000","last_clean":"2024-09-15T23:55:31.204016+0000","last_became_active":"2024-09-15T23:55:28.958275+0000","last_became_peered":"2024-09-15T23:55:28.958275+0000","last_unstale":"2024-09-15T23:55:31.204016+0000","last_undegraded":"2024-09-15T23:55:31.204016+0000","last_fullsized":"2024-09-15T23:55:31.204016+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:23.055214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203485+0000","last_change":"2024-09-15T23:55:30.003835+0000","last_active":"2024-09-15T23:55:31.203485+0000","last_peered":"2024-09-15T23:55:31.203485+0000","last_clean":"2024-09-15T23:55:31.203485+0000","last_became_active":"2024-09-15T23:55:29.996004+0000","last_became_peered":"2024-09-15T23:55:29.996004+0000","last_unstale":"2024-09-15T23:55:31.203485+0000","last_undegraded":"2024-09-15T23:55:31.203485+0000","last_fullsized":"2024-09-15T23:55:31.203485+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:41.875576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.982157+0000","last_change":"2024-09-15T23:55:28.981225+0000","last_active":"2024-09-15T23:55:28.982157+0000","last_peered":"2024-09-15T23:55:28.982157+0000","last_clean":"2024-09-15T23:55:28.982157+0000","last_became_active":"2024-09-15T23:55:28.980753+0000","last_became_peered":"2024-09-15T23:55:28.980753+0000","last_unstale":"2024-09-15T23:55:28.982157+0000","last_undegraded":"2024-09-15T23:55:28.982157+0000","last_fullsized":"2024-09-15T23:55:28.982157+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:11.717951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.942742+0000","last_change":"2024-09-15T23:55:28.942742+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.942742+0000","last_undegraded":"2024-09-15T23:55:28.942742+0000","last_fullsized":"2024-09-15T23:55:28.942742+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.984354+0000","last_change":"2024-09-15T23:55:28.979920+0000","last_active":"2024-09-15T23:55:28.984354+0000","last_peered":"2024-09-15T23:55:28.984354+0000","last_clean":"2024-09-15T23:55:28.984354+0000","last_became_active":"2024-09-15T23:55:28.979269+0000","last_became_peered":"2024-09-15T23:55:28.979269+0000","last_unstale":"2024-09-15T23:55:28.984354+0000","last_undegraded":"2024-09-15T23:55:28.984354+0000","last_fullsized":"2024-09-15T23:55:28.984354+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:50:55.241898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943536+0000","last_change":"2024-09-15T23:55:28.943536+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943536+0000","last_undegraded":"2024-09-15T23:55:28.943536+0000","last_fullsized":"2024-09-15T23:55:28.943536+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.954499+0000","last_change":"2024-09-15T23:55:28.952417+0000","last_active":"2024-09-15T23:55:28.954499+0000","last_peered":"2024-09-15T23:55:28.954499+0000","last_clean":"2024-09-15T23:55:28.954499+0000","last_became_active":"2024-09-15T23:55:28.952107+0000","last_became_peered":"2024-09-15T23:55:28.952107+0000","last_unstale":"2024-09-15T23:55:28.954499+0000","last_undegraded":"2024-09-15T23:55:28.954499+0000","last_fullsized":"2024-09-15T23:55:28.954499+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:30.373849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204307+0000","last_change":"2024-09-15T23:55:30.002606+0000","last_active":"2024-09-15T23:55:31.204307+0000","last_peered":"2024-09-15T23:55:31.204307+0000","last_clean":"2024-09-15T23:55:31.204307+0000","last_became_active":"2024-09-15T23:55:29.996213+0000","last_became_peered":"2024-09-15T23:55:29.996213+0000","last_unstale":"2024-09-15T23:55:31.204307+0000","last_undegraded":"2024-09-15T23:55:31.204307+0000","last_fullsized":"2024-09-15T23:55:31.204307+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:08.573598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.959010+0000","last_change":"2024-09-15T23:55:28.958153+0000","last_active":"2024-09-15T23:55:28.959010+0000","last_peered":"2024-09-15T23:55:28.959010+0000","last_clean":"2024-09-15T23:55:28.959010+0000","last_became_active":"2024-09-15T23:55:28.957814+0000","last_became_peered":"2024-09-15T23:55:28.957814+0000","last_unstale":"2024-09-15T23:55:28.959010+0000","last_undegraded":"2024-09-15T23:55:28.959010+0000","last_fullsized":"2024-09-15T23:55:28.959010+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:17.799300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941602+0000","last_change":"2024-09-15T23:55:28.941602+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941602+0000","last_undegraded":"2024-09-15T23:55:28.941602+0000","last_fullsized":"2024-09-15T23:55:28.941602+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.980671+0000","last_change":"2024-09-15T23:55:28.969352+0000","last_active":"2024-09-15T23:55:28.980671+0000","last_peered":"2024-09-15T23:55:28.980671+0000","last_clean":"2024-09-15T23:55:28.980671+0000","last_became_active":"2024-09-15T23:55:28.968629+0000","last_became_peered":"2024-09-15T23:55:28.968629+0000","last_unstale":"2024-09-15T23:55:28.980671+0000","last_undegraded":"2024-09-15T23:55:28.980671+0000","last_fullsized":"2024-09-15T23:55:28.980671+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:30.705727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943160+0000","last_change":"2024-09-15T23:55:28.943160+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943160+0000","last_undegraded":"2024-09-15T23:55:28.943160+0000","last_fullsized":"2024-09-15T23:55:28.943160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.951237+0000","last_change":"2024-09-15T23:55:28.950095+0000","last_active":"2024-09-15T23:55:28.951237+0000","last_peered":"2024-09-15T23:55:28.951237+0000","last_clean":"2024-09-15T23:55:28.951237+0000","last_became_active":"2024-09-15T23:55:28.949824+0000","last_became_peered":"2024-09-15T23:55:28.949824+0000","last_unstale":"2024-09-15T23:55:28.951237+0000","last_undegraded":"2024-09-15T23:55:28.951237+0000","last_fullsized":"2024-09-15T23:55:28.951237+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:42.163168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941913+0000","last_change":"2024-09-15T23:55:28.941913+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941913+0000","last_undegraded":"2024-09-15T23:55:28.941913+0000","last_fullsized":"2024-09-15T23:55:28.941913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.979067+0000","last_change":"2024-09-15T23:55:28.978340+0000","last_active":"2024-09-15T23:55:28.979067+0000","last_peered":"2024-09-15T23:55:28.979067+0000","last_clean":"2024-09-15T23:55:28.979067+0000","last_became_active":"2024-09-15T23:55:28.978016+0000","last_became_peered":"2024-09-15T23:55:28.978016+0000","last_unstale":"2024-09-15T23:55:28.979067+0000","last_undegraded":"2024-09-15T23:55:28.979067+0000","last_fullsized":"2024-09-15T23:55:28.979067+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:40.177912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.940712+0000","last_change":"2024-09-15T23:55:28.940712+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.940712+0000","last_undegraded":"2024-09-15T23:55:28.940712+0000","last_fullsized":"2024-09-15T23:55:28.940712+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.961607+0000","last_change":"2024-09-15T23:55:28.960875+0000","last_active":"2024-09-15T23:55:28.961607+0000","last_peered":"2024-09-15T23:55:28.961607+0000","last_clean":"2024-09-15T23:55:28.961607+0000","last_became_active":"2024-09-15T23:55:28.960593+0000","last_became_peered":"2024-09-15T23:55:28.960593+0000","last_unstale":"2024-09-15T23:55:28.961607+0000","last_undegraded":"2024-09-15T23:55:28.961607+0000","last_fullsized":"2024-09-15T23:55:28.961607+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:47.992194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.946361+0000","last_change":"2024-09-15T23:55:28.946361+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.946361+0000","last_undegraded":"2024-09-15T23:55:28.946361+0000","last_fullsized":"2024-09-15T23:55:28.946361+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203755+0000","last_change":"2024-09-15T23:55:28.984808+0000","last_active":"2024-09-15T23:55:31.203755+0000","last_peered":"2024-09-15T23:55:31.203755+0000","last_clean":"2024-09-15T23:55:31.203755+0000","last_became_active":"2024-09-15T23:55:28.984131+0000","last_became_peered":"2024-09-15T23:55:28.984131+0000","last_unstale":"2024-09-15T23:55:31.203755+0000","last_undegraded":"2024-09-15T23:55:31.203755+0000","last_fullsized":"2024-09-15T23:55:31.203755+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:56.457774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944290+0000","last_change":"2024-09-15T23:55:28.944290+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944290+0000","last_undegraded":"2024-09-15T23:55:28.944290+0000","last_fullsized":"2024-09-15T23:55:28.944290+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.985001+0000","last_change":"2024-09-15T23:55:28.977045+0000","last_active":"2024-09-15T23:55:28.985001+0000","last_peered":"2024-09-15T23:55:28.985001+0000","last_clean":"2024-09-15T23:55:28.985001+0000","last_became_active":"2024-09-15T23:55:28.976372+0000","last_became_peered":"2024-09-15T23:55:28.976372+0000","last_unstale":"2024-09-15T23:55:28.985001+0000","last_undegraded":"2024-09-15T23:55:28.985001+0000","last_fullsized":"2024-09-15T23:55:28.985001+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:46.331031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943480+0000","last_change":"2024-09-15T23:55:28.943480+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943480+0000","last_undegraded":"2024-09-15T23:55:28.943480+0000","last_fullsized":"2024-09-15T23:55:28.943480+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.960937+0000","last_change":"2024-09-15T23:55:28.960226+0000","last_active":"2024-09-15T23:55:28.960937+0000","last_peered":"2024-09-15T23:55:28.960937+0000","last_clean":"2024-09-15T23:55:28.960937+0000","last_became_active":"2024-09-15T23:55:28.960000+0000","last_became_peered":"2024-09-15T23:55:28.960000+0000","last_unstale":"2024-09-15T23:55:28.960937+0000","last_undegraded":"2024-09-15T23:55:28.960937+0000","last_fullsized":"2024-09-15T23:55:28.960937+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:07.288904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.958518+0000","last_change":"2024-09-15T23:55:28.958518+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.958518+0000","last_undegraded":"2024-09-15T23:55:28.958518+0000","last_fullsized":"2024-09-15T23:55:28.958518+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.955458+0000","last_change":"2024-09-15T23:55:28.953752+0000","last_active":"2024-09-15T23:55:28.955458+0000","last_peered":"2024-09-15T23:55:28.955458+0000","last_clean":"2024-09-15T23:55:28.955458+0000","last_became_active":"2024-09-15T23:55:28.953477+0000","last_became_peered":"2024-09-15T23:55:28.953477+0000","last_unstale":"2024-09-15T23:55:28.955458+0000","last_undegraded":"2024-09-15T23:55:28.955458+0000","last_fullsized":"2024-09-15T23:55:28.955458+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:07.288904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.961961+0000","last_change":"2024-09-15T23:55:28.961961+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.961961+0000","last_undegraded":"2024-09-15T23:55:28.961961+0000","last_fullsized":"2024-09-15T23:55:28.961961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.984490+0000","last_change":"2024-09-15T23:55:28.982518+0000","last_active":"2024-09-15T23:55:28.984490+0000","last_peered":"2024-09-15T23:55:28.984490+0000","last_clean":"2024-09-15T23:55:28.984490+0000","last_became_active":"2024-09-15T23:55:28.981852+0000","last_became_peered":"2024-09-15T23:55:28.981852+0000","last_unstale":"2024-09-15T23:55:28.984490+0000","last_undegraded":"2024-09-15T23:55:28.984490+0000","last_fullsized":"2024-09-15T23:55:28.984490+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:17.276493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202224+0000","last_change":"2024-09-15T23:55:29.970464+0000","last_active":"2024-09-15T23:55:31.202224+0000","last_peered":"2024-09-15T23:55:31.202224+0000","last_clean":"2024-09-15T23:55:31.202224+0000","last_became_active":"2024-09-15T23:55:29.969600+0000","last_became_peered":"2024-09-15T23:55:29.969600+0000","last_unstale":"2024-09-15T23:55:31.202224+0000","last_undegraded":"2024-09-15T23:55:31.202224+0000","last_fullsized":"2024-09-15T23:55:31.202224+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:26.661560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.990271+0000","last_change":"2024-09-15T23:55:28.987736+0000","last_active":"2024-09-15T23:55:28.990271+0000","last_peered":"2024-09-15T23:55:28.990271+0000","last_clean":"2024-09-15T23:55:28.990271+0000","last_became_active":"2024-09-15T23:55:28.986972+0000","last_became_peered":"2024-09-15T23:55:28.986972+0000","last_unstale":"2024-09-15T23:55:28.990271+0000","last_undegraded":"2024-09-15T23:55:28.990271+0000","last_fullsized":"2024-09-15T23:55:28.990271+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:36.040443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945025+0000","last_change":"2024-09-15T23:55:28.945025+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945025+0000","last_undegraded":"2024-09-15T23:55:28.945025+0000","last_fullsized":"2024-09-15T23:55:28.945025+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.986691+0000","last_change":"2024-09-15T23:55:28.978148+0000","last_active":"2024-09-15T23:55:28.986691+0000","last_peered":"2024-09-15T23:55:28.986691+0000","last_clean":"2024-09-15T23:55:28.986691+0000","last_became_active":"2024-09-15T23:55:28.977563+0000","last_became_peered":"2024-09-15T23:55:28.977563+0000","last_unstale":"2024-09-15T23:55:28.986691+0000","last_undegraded":"2024-09-15T23:55:28.986691+0000","last_fullsized":"2024-09-15T23:55:28.986691+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:50.867342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.950442+0000","last_change":"2024-09-15T23:55:28.950442+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.950442+0000","last_undegraded":"2024-09-15T23:55:28.950442+0000","last_fullsized":"2024-09-15T23:55:28.950442+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.981932+0000","last_change":"2024-09-15T23:55:28.981019+0000","last_active":"2024-09-15T23:55:28.981932+0000","last_peered":"2024-09-15T23:55:28.981932+0000","last_clean":"2024-09-15T23:55:28.981932+0000","last_became_active":"2024-09-15T23:55:28.980736+0000","last_became_peered":"2024-09-15T23:55:28.980736+0000","last_unstale":"2024-09-15T23:55:28.981932+0000","last_undegraded":"2024-09-15T23:55:28.981932+0000","last_fullsized":"2024-09-15T23:55:28.981932+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:11.717951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.955567+0000","last_change":"2024-09-15T23:55:28.955567+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.955567+0000","last_undegraded":"2024-09-15T23:55:28.955567+0000","last_fullsized":"2024-09-15T23:55:28.955567+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.966572+0000","last_change":"2024-09-15T23:55:28.965885+0000","last_active":"2024-09-15T23:55:28.966572+0000","last_peered":"2024-09-15T23:55:28.966572+0000","last_clean":"2024-09-15T23:55:28.966572+0000","last_became_active":"2024-09-15T23:55:28.965531+0000","last_became_peered":"2024-09-15T23:55:28.965531+0000","last_unstale":"2024-09-15T23:55:28.966572+0000","last_undegraded":"2024-09-15T23:55:28.966572+0000","last_fullsized":"2024-09-15T23:55:28.966572+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:40.177912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.948793+0000","last_change":"2024-09-15T23:55:28.948793+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.948793+0000","last_undegraded":"2024-09-15T23:55:28.948793+0000","last_fullsized":"2024-09-15T23:55:28.948793+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.965793+0000","last_change":"2024-09-15T23:55:28.960054+0000","last_active":"2024-09-15T23:55:28.965793+0000","last_peered":"2024-09-15T23:55:28.965793+0000","last_clean":"2024-09-15T23:55:28.965793+0000","last_became_active":"2024-09-15T23:55:28.959315+0000","last_became_peered":"2024-09-15T23:55:28.959315+0000","last_unstale":"2024-09-15T23:55:28.965793+0000","last_undegraded":"2024-09-15T23:55:28.965793+0000","last_fullsized":"2024-09-15T23:55:28.965793+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:35.216646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945269+0000","last_change":"2024-09-15T23:55:28.945269+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945269+0000","last_undegraded":"2024-09-15T23:55:28.945269+0000","last_fullsized":"2024-09-15T23:55:28.945269+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.989629+0000","last_change":"2024-09-15T23:55:28.983747+0000","last_active":"2024-09-15T23:55:28.989629+0000","last_peered":"2024-09-15T23:55:28.989629+0000","last_clean":"2024-09-15T23:55:28.989629+0000","last_became_active":"2024-09-15T23:55:28.982268+0000","last_became_peered":"2024-09-15T23:55:28.982268+0000","last_unstale":"2024-09-15T23:55:28.989629+0000","last_undegraded":"2024-09-15T23:55:28.989629+0000","last_fullsized":"2024-09-15T23:55:28.989629+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:54.333221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.953256+0000","last_change":"2024-09-15T23:55:28.953256+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.953256+0000","last_undegraded":"2024-09-15T23:55:28.953256+0000","last_fullsized":"2024-09-15T23:55:28.953256+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203129+0000","last_change":"2024-09-15T23:55:28.984174+0000","last_active":"2024-09-15T23:55:31.203129+0000","last_peered":"2024-09-15T23:55:31.203129+0000","last_clean":"2024-09-15T23:55:31.203129+0000","last_became_active":"2024-09-15T23:55:28.983467+0000","last_became_peered":"2024-09-15T23:55:28.983467+0000","last_unstale":"2024-09-15T23:55:31.203129+0000","last_undegraded":"2024-09-15T23:55:31.203129+0000","last_fullsized":"2024-09-15T23:55:31.203129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:24.174820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.950986+0000","last_change":"2024-09-15T23:55:28.950986+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.950986+0000","last_undegraded":"2024-09-15T23:55:28.950986+0000","last_fullsized":"2024-09-15T23:55:28.950986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202605+0000","last_change":"2024-09-15T23:55:28.966139+0000","last_active":"2024-09-15T23:55:31.202605+0000","last_peered":"2024-09-15T23:55:31.202605+0000","last_clean":"2024-09-15T23:55:31.202605+0000","last_became_active":"2024-09-15T23:55:28.965422+0000","last_became_peered":"2024-09-15T23:55:28.965422+0000","last_unstale":"2024-09-15T23:55:31.202605+0000","last_undegraded":"2024-09-15T23:55:31.202605+0000","last_fullsized":"2024-09-15T23:55:31.202605+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:41.328089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941231+0000","last_change":"2024-09-15T23:55:28.941231+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941231+0000","last_undegraded":"2024-09-15T23:55:28.941231+0000","last_fullsized":"2024-09-15T23:55:28.941231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.959212+0000","last_change":"2024-09-15T23:55:28.958308+0000","last_active":"2024-09-15T23:55:28.959212+0000","last_peered":"2024-09-15T23:55:28.959212+0000","last_clean":"2024-09-15T23:55:28.959212+0000","last_became_active":"2024-09-15T23:55:28.957929+0000","last_became_peered":"2024-09-15T23:55:28.957929+0000","last_unstale":"2024-09-15T23:55:28.959212+0000","last_undegraded":"2024-09-15T23:55:28.959212+0000","last_fullsized":"2024-09-15T23:55:28.959212+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:35.158272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203329+0000","last_change":"2024-09-15T23:55:30.003355+0000","last_active":"2024-09-15T23:55:31.203329+0000","last_peered":"2024-09-15T23:55:31.203329+0000","last_clean":"2024-09-15T23:55:31.203329+0000","last_became_active":"2024-09-15T23:55:30.002742+0000","last_became_peered":"2024-09-15T23:55:30.002742+0000","last_unstale":"2024-09-15T23:55:31.203329+0000","last_undegraded":"2024-09-15T23:55:31.203329+0000","last_fullsized":"2024-09-15T23:55:31.203329+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:15.549461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.961631+0000","last_change":"2024-09-15T23:55:28.960962+0000","last_active":"2024-09-15T23:55:28.961631+0000","last_peered":"2024-09-15T23:55:28.961631+0000","last_clean":"2024-09-15T23:55:28.961631+0000","last_became_active":"2024-09-15T23:55:28.960579+0000","last_became_peered":"2024-09-15T23:55:28.960579+0000","last_unstale":"2024-09-15T23:55:28.961631+0000","last_undegraded":"2024-09-15T23:55:28.961631+0000","last_fullsized":"2024-09-15T23:55:28.961631+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:38.909033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945032+0000","last_change":"2024-09-15T23:55:28.945032+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945032+0000","last_undegraded":"2024-09-15T23:55:28.945032+0000","last_fullsized":"2024-09-15T23:55:28.945032+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.985249+0000","last_change":"2024-09-15T23:55:28.980090+0000","last_active":"2024-09-15T23:55:28.985249+0000","last_peered":"2024-09-15T23:55:28.985249+0000","last_clean":"2024-09-15T23:55:28.985249+0000","last_became_active":"2024-09-15T23:55:28.978880+0000","last_became_peered":"2024-09-15T23:55:28.978880+0000","last_unstale":"2024-09-15T23:55:28.985249+0000","last_undegraded":"2024-09-15T23:55:28.985249+0000","last_fullsized":"2024-09-15T23:55:28.985249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:00.563529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203872+0000","last_change":"2024-09-15T23:55:30.002867+0000","last_active":"2024-09-15T23:55:31.203872+0000","last_peered":"2024-09-15T23:55:31.203872+0000","last_clean":"2024-09-15T23:55:31.203872+0000","last_became_active":"2024-09-15T23:55:29.993861+0000","last_became_peered":"2024-09-15T23:55:29.993861+0000","last_unstale":"2024-09-15T23:55:31.203872+0000","last_undegraded":"2024-09-15T23:55:31.203872+0000","last_fullsized":"2024-09-15T23:55:31.203872+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:37.828534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203711+0000","last_change":"2024-09-15T23:55:28.959925+0000","last_active":"2024-09-15T23:55:31.203711+0000","last_peered":"2024-09-15T23:55:31.203711+0000","last_clean":"2024-09-15T23:55:31.203711+0000","last_became_active":"2024-09-15T23:55:28.958452+0000","last_became_peered":"2024-09-15T23:55:28.958452+0000","last_unstale":"2024-09-15T23:55:31.203711+0000","last_undegraded":"2024-09-15T23:55:31.203711+0000","last_fullsized":"2024-09-15T23:55:31.203711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:50.451580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944543+0000","last_change":"2024-09-15T23:55:28.944543+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944543+0000","last_undegraded":"2024-09-15T23:55:28.944543+0000","last_fullsized":"2024-09-15T23:55:28.944543+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.989573+0000","last_change":"2024-09-15T23:55:28.983121+0000","last_active":"2024-09-15T23:55:28.989573+0000","last_peered":"2024-09-15T23:55:28.989573+0000","last_clean":"2024-09-15T23:55:28.989573+0000","last_became_active":"2024-09-15T23:55:28.981404+0000","last_became_peered":"2024-09-15T23:55:28.981404+0000","last_unstale":"2024-09-15T23:55:28.989573+0000","last_undegraded":"2024-09-15T23:55:28.989573+0000","last_fullsized":"2024-09-15T23:55:28.989573+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:14.512897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204388+0000","last_change":"2024-09-15T23:55:29.994344+0000","last_active":"2024-09-15T23:55:31.204388+0000","last_peered":"2024-09-15T23:55:31.204388+0000","last_clean":"2024-09-15T23:55:31.204388+0000","last_became_active":"2024-09-15T23:55:29.989134+0000","last_became_peered":"2024-09-15T23:55:29.989134+0000","last_unstale":"2024-09-15T23:55:31.204388+0000","last_undegraded":"2024-09-15T23:55:31.204388+0000","last_fullsized":"2024-09-15T23:55:31.204388+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:08.439772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.958521+0000","last_change":"2024-09-15T23:55:28.956432+0000","last_active":"2024-09-15T23:55:28.958521+0000","last_peered":"2024-09-15T23:55:28.958521+0000","last_clean":"2024-09-15T23:55:28.958521+0000","last_became_active":"2024-09-15T23:55:28.956054+0000","last_became_peered":"2024-09-15T23:55:28.956054+0000","last_unstale":"2024-09-15T23:55:28.958521+0000","last_undegraded":"2024-09-15T23:55:28.958521+0000","last_fullsized":"2024-09-15T23:55:28.958521+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:44.566526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.952040+0000","last_change":"2024-09-15T23:55:28.952040+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.952040+0000","last_undegraded":"2024-09-15T23:55:28.952040+0000","last_fullsized":"2024-09-15T23:55:28.952040+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.961166+0000","last_change":"2024-09-15T23:55:28.960457+0000","last_active":"2024-09-15T23:55:28.961166+0000","last_peered":"2024-09-15T23:55:28.961166+0000","last_clean":"2024-09-15T23:55:28.961166+0000","last_became_active":"2024-09-15T23:55:28.960080+0000","last_became_peered":"2024-09-15T23:55:28.960080+0000","last_unstale":"2024-09-15T23:55:28.961166+0000","last_undegraded":"2024-09-15T23:55:28.961166+0000","last_fullsized":"2024-09-15T23:55:28.961166+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:44.566526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943015+0000","last_change":"2024-09-15T23:55:28.943015+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943015+0000","last_undegraded":"2024-09-15T23:55:28.943015+0000","last_fullsized":"2024-09-15T23:55:28.943015+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204582+0000","last_change":"2024-09-15T23:55:28.977178+0000","last_active":"2024-09-15T23:55:31.204582+0000","last_peered":"2024-09-15T23:55:31.204582+0000","last_clean":"2024-09-15T23:55:31.204582+0000","last_became_active":"2024-09-15T23:55:28.975684+0000","last_became_peered":"2024-09-15T23:55:28.975684+0000","last_unstale":"2024-09-15T23:55:31.204582+0000","last_undegraded":"2024-09-15T23:55:31.204582+0000","last_fullsized":"2024-09-15T23:55:31.204582+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:51.522143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.941473+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:55:28.941473+0000","last_peered":"2024-09-15T23:55:28.941473+0000","last_clean":"2024-09-15T23:55:28.941473+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:55:28.941473+0000","last_undegraded":"2024-09-15T23:55:28.941473+0000","last_fullsized":"2024-09-15T23:55:28.941473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":573440,"data_stored":249307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":573440,"data_stored":249307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1155072,"data_stored":833008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1208320,"data_stored":855236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:55:33.338 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:55:33.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.490+0000 7fac20187640 1 Processor -- start 2024-09-15T23:55:33.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac20187640 1 -- start start 2024-09-15T23:55:33.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac20187640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fac18144d60 0x7fac18070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac20187640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fac180b52b0 0x7fac180b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac20187640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac18071030 con 0x7fac180b4090 2024-09-15T23:55:33.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac20187640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fac18070660 con 0x7fac180b52b0 2024-09-15T23:55:33.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac20187640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fac1806fa50 con 0x7fac18144d60 2024-09-15T23:55:33.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac1e724640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fac180b52b0 0x7fac180b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac1d722640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fac180b4090 0x7fac180b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41848/0 (socket says 172.21.15.112:41848) 2024-09-15T23:55:33.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac1d722640 1 -- 172.21.15.112:0/2914440219 learned_addr learned my addr 172.21.15.112:0/2914440219 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:33.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac1df23640 1 --2- 172.21.15.112:0/2914440219 >> v2:172.21.15.169:3300/0 conn(0x7fac18144d60 0x7fac18070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac1e724640 1 -- 172.21.15.112:0/2914440219 >> v2:172.21.15.169:3300/0 conn(0x7fac18144d60 msgr2=0x7fac18070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:33.500 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac1e724640 1 --2- 172.21.15.112:0/2914440219 >> v2:172.21.15.169:3300/0 conn(0x7fac18144d60 0x7fac18070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac1e724640 1 -- 172.21.15.112:0/2914440219 >> v1:172.21.15.112:6789/0 conn(0x7fac180b4090 legacy=0x7fac180b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac1cf21640 1 -- 172.21.15.112:0/2914440219 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1569890484 0 0) 0x7fac18071030 con 0x7fac180b4090 2024-09-15T23:55:33.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac1e724640 1 -- 172.21.15.112:0/2914440219 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1806fd30 con 0x7fac180b52b0 2024-09-15T23:55:33.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.494+0000 7fac1df23640 1 --2- 172.21.15.112:0/2914440219 >> v2:172.21.15.169:3300/0 conn(0x7fac18144d60 0x7fac18070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:33.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1e724640 1 --2- 172.21.15.112:0/2914440219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180b52b0 0x7fac180b4500 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fac180718a0 tx=0x7fac1401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadf2a14170d223e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:33.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1cf21640 1 -- 172.21.15.112:0/2914440219 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac140b0070 con 0x7fac180b52b0 2024-09-15T23:55:33.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1cf21640 1 -- 172.21.15.112:0/2914440219 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac140ab600 con 0x7fac180b52b0 2024-09-15T23:55:33.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1cf21640 1 -- 172.21.15.112:0/2914440219 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac140ab9d0 con 0x7fac180b52b0 2024-09-15T23:55:33.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 -- 172.21.15.112:0/2914440219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180b52b0 msgr2=0x7fac180b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 --2- 172.21.15.112:0/2914440219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180b52b0 0x7fac180b4500 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fac180718a0 tx=0x7fac1401c480 comp rx=0 tx=0).stop 2024-09-15T23:55:33.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 -- 172.21.15.112:0/2914440219 shutdown_connections 2024-09-15T23:55:33.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 --2- 172.21.15.112:0/2914440219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180b52b0 0x7fac180b4500 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 --2- 172.21.15.112:0/2914440219 >> v2:172.21.15.169:3300/0 conn(0x7fac18144d60 0x7fac18070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 -- 172.21.15.112:0/2914440219 >> 172.21.15.112:0/2914440219 conn(0x7fac1809aa00 msgr2=0x7fac180b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:33.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 -- 172.21.15.112:0/2914440219 shutdown_connections 2024-09-15T23:55:33.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 -- 172.21.15.112:0/2914440219 wait complete. 2024-09-15T23:55:33.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 Processor -- start 2024-09-15T23:55:33.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 -- start start 2024-09-15T23:55:33.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac180b4090 0x7fac181654e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180b52b0 0x7fac1815aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac18144d60 0x7fac1815b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fac180aefa0 con 0x7fac180b52b0 2024-09-15T23:55:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fac180aee20 con 0x7fac180b4090 2024-09-15T23:55:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac20187640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fac180af120 con 0x7fac18144d60 2024-09-15T23:55:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1d722640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180b52b0 0x7fac1815aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1d722640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180b52b0 0x7fac1815aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41206/0 (socket says 172.21.15.112:41206) 2024-09-15T23:55:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1d722640 1 -- 172.21.15.112:0/872782345 learned_addr learned my addr 172.21.15.112:0/872782345 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1df23640 1 --2- 172.21.15.112:0/872782345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac180b4090 0x7fac181654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1d722640 1 -- 172.21.15.112:0/872782345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac18144d60 msgr2=0x7fac1815b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1d722640 1 --2- 172.21.15.112:0/872782345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac18144d60 0x7fac1815b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1d722640 1 -- 172.21.15.112:0/872782345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac180b4090 msgr2=0x7fac181654e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1d722640 1 --2- 172.21.15.112:0/872782345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac180b4090 0x7fac181654e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1d722640 1 -- 172.21.15.112:0/872782345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1813e310 con 0x7fac180b52b0 2024-09-15T23:55:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1df23640 1 --2- 172.21.15.112:0/872782345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac180b4090 0x7fac181654e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:33.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac1d722640 1 --2- 172.21.15.112:0/872782345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180b52b0 0x7fac1815aa90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fac080011f0 tx=0x7fac0800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.498+0000 7fac0e7fc640 1 -- 172.21.15.112:0/872782345 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac08018070 con 0x7fac180b52b0 2024-09-15T23:55:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.502+0000 7fac0e7fc640 1 -- 172.21.15.112:0/872782345 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac080074e0 con 0x7fac180b52b0 2024-09-15T23:55:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.502+0000 7fac20187640 1 -- 172.21.15.112:0/872782345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac1813e8f0 con 0x7fac180b52b0 2024-09-15T23:55:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.502+0000 7fac0e7fc640 1 -- 172.21.15.112:0/872782345 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac08004a10 con 0x7fac180b52b0 2024-09-15T23:55:33.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.502+0000 7fac20187640 1 -- 172.21.15.112:0/872782345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac1813e580 con 0x7fac180b52b0 2024-09-15T23:55:33.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.502+0000 7fac20187640 1 -- 172.21.15.112:0/872782345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac180b4500 con 0x7fac180b52b0 2024-09-15T23:55:33.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.502+0000 7fac0e7fc640 1 -- 172.21.15.112:0/872782345 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac0801b070 con 0x7fac180b52b0 2024-09-15T23:55:33.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.502+0000 7fac0e7fc640 1 --2- 172.21.15.112:0/872782345 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fabfc0678c0 0x7fabfc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.502+0000 7fac0e7fc640 1 -- 172.21.15.112:0/872782345 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fac08085380 con 0x7fac180b52b0 2024-09-15T23:55:33.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.502+0000 7fac1df23640 1 --2- 172.21.15.112:0/872782345 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fabfc0678c0 0x7fabfc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.502+0000 7fac1df23640 1 --2- 172.21.15.112:0/872782345 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fabfc0678c0 0x7fabfc069d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac10007f40 tx=0x7fac10007490 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:33.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.506+0000 7fac0e7fc640 1 -- 172.21.15.112:0/872782345 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fac08055ea0 con 0x7fac180b52b0 2024-09-15T23:55:33.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.662+0000 7fac20187640 1 -- 172.21.15.112:0/872782345 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac1806f430 con 0x7fabfc0678c0 2024-09-15T23:55:33.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.666+0000 7fac0e7fc640 1 -- 172.21.15.112:0/872782345 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247327 (secure 0 0 0) 0x7fac1806f430 con 0x7fabfc0678c0 2024-09-15T23:55:33.676 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:33.678 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:55:33.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.670+0000 7fac20187640 1 -- 172.21.15.112:0/872782345 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fabfc0678c0 msgr2=0x7fabfc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.670+0000 7fac20187640 1 --2- 172.21.15.112:0/872782345 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fabfc0678c0 0x7fabfc069d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac10007f40 tx=0x7fac10007490 comp rx=0 tx=0).stop 2024-09-15T23:55:33.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.670+0000 7fac20187640 1 -- 172.21.15.112:0/872782345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180b52b0 msgr2=0x7fac1815aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.670+0000 7fac20187640 1 --2- 172.21.15.112:0/872782345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180b52b0 0x7fac1815aa90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fac080011f0 tx=0x7fac0800c9b0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.670+0000 7fac20187640 1 -- 172.21.15.112:0/872782345 shutdown_connections 2024-09-15T23:55:33.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.670+0000 7fac20187640 1 --2- 172.21.15.112:0/872782345 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fabfc0678c0 0x7fabfc069d80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.670+0000 7fac20187640 1 --2- 172.21.15.112:0/872782345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac18144d60 0x7fac1815b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.670+0000 7fac20187640 1 --2- 172.21.15.112:0/872782345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180b52b0 0x7fac1815aa90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.670+0000 7fac20187640 1 --2- 172.21.15.112:0/872782345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac180b4090 0x7fac181654e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.670+0000 7fac20187640 1 -- 172.21.15.112:0/872782345 >> 172.21.15.112:0/872782345 conn(0x7fac1809aa00 msgr2=0x7fac18141d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:33.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.670+0000 7fac20187640 1 -- 172.21.15.112:0/872782345 shutdown_connections 2024-09-15T23:55:33.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.670+0000 7fac20187640 1 -- 172.21.15.112:0/872782345 wait complete. 2024-09-15T23:55:33.694 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-15T23:55:33.264151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":169,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255168,"kb_used_data":5620,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719552,"statfs":{"total":773094113280,"available":772832821248,"internally_reserved":0,"allocated":5754880,"data_stored":3157418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.337882"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.951163+0000","last_change":"2024-09-15T23:55:28.951163+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.951163+0000","last_undegraded":"2024-09-15T23:55:28.951163+0000","last_fullsized":"2024-09-15T23:55:28.951163+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945077+0000","last_change":"2024-09-15T23:55:28.945077+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945077+0000","last_undegraded":"2024-09-15T23:55:28.945077+0000","last_fullsized":"2024-09-15T23:55:28.945077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.963825+0000","last_change":"2024-09-15T23:55:28.963825+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.963825+0000","last_undegraded":"2024-09-15T23:55:28.963825+0000","last_fullsized":"2024-09-15T23:55:28.963825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941093+0000","last_change":"2024-09-15T23:55:28.941093+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941093+0000","last_undegraded":"2024-09-15T23:55:28.941093+0000","last_fullsized":"2024-09-15T23:55:28.941093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945973+0000","last_change":"2024-09-15T23:55:28.945973+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945973+0000","last_undegraded":"2024-09-15T23:55:28.945973+0000","last_fullsized":"2024-09-15T23:55:28.945973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947588+0000","last_change":"2024-09-15T23:55:28.947588+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947588+0000","last_undegraded":"2024-09-15T23:55:28.947588+0000","last_fullsized":"2024-09-15T23:55:28.947588+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202852+0000","last_change":"2024-09-15T23:55:29.996060+0000","last_active":"2024-09-15T23:55:31.202852+0000","last_peered":"2024-09-15T23:55:31.202852+0000","last_clean":"2024-09-15T23:55:31.202852+0000","last_became_active":"2024-09-15T23:55:29.994668+0000","last_became_peered":"2024-09-15T23:55:29.994668+0000","last_unstale":"2024-09-15T23:55:31.202852+0000","last_undegraded":"2024-09-15T23:55:31.202852+0000","last_fullsized":"2024-09-15T23:55:31.202852+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:51.540608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.948541+0000","last_change":"2024-09-15T23:55:28.948541+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.948541+0000","last_undegraded":"2024-09-15T23:55:28.948541+0000","last_fullsized":"2024-09-15T23:55:28.948541+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.963117+0000","last_change":"2024-09-15T23:55:28.963117+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.963117+0000","last_undegraded":"2024-09-15T23:55:28.963117+0000","last_fullsized":"2024-09-15T23:55:28.963117+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204180+0000","last_change":"2024-09-15T23:55:29.995362+0000","last_active":"2024-09-15T23:55:31.204180+0000","last_peered":"2024-09-15T23:55:31.204180+0000","last_clean":"2024-09-15T23:55:31.204180+0000","last_became_active":"2024-09-15T23:55:29.994531+0000","last_became_peered":"2024-09-15T23:55:29.994531+0000","last_unstale":"2024-09-15T23:55:31.204180+0000","last_undegraded":"2024-09-15T23:55:31.204180+0000","last_fullsized":"2024-09-15T23:55:31.204180+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:49.797209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.955280+0000","last_change":"2024-09-15T23:55:28.955280+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.955280+0000","last_undegraded":"2024-09-15T23:55:28.955280+0000","last_fullsized":"2024-09-15T23:55:28.955280+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.948981+0000","last_change":"2024-09-15T23:55:28.948981+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.948981+0000","last_undegraded":"2024-09-15T23:55:28.948981+0000","last_fullsized":"2024-09-15T23:55:28.948981+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.954510+0000","last_change":"2024-09-15T23:55:28.954510+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.954510+0000","last_undegraded":"2024-09-15T23:55:28.954510+0000","last_fullsized":"2024-09-15T23:55:28.954510+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941785+0000","last_change":"2024-09-15T23:55:28.941785+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941785+0000","last_undegraded":"2024-09-15T23:55:28.941785+0000","last_fullsized":"2024-09-15T23:55:28.941785+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947263+0000","last_change":"2024-09-15T23:55:28.947263+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947263+0000","last_undegraded":"2024-09-15T23:55:28.947263+0000","last_fullsized":"2024-09-15T23:55:28.947263+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947219+0000","last_change":"2024-09-15T23:55:28.947219+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947219+0000","last_undegraded":"2024-09-15T23:55:28.947219+0000","last_fullsized":"2024-09-15T23:55:28.947219+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947453+0000","last_change":"2024-09-15T23:55:28.947453+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947453+0000","last_undegraded":"2024-09-15T23:55:28.947453+0000","last_fullsized":"2024-09-15T23:55:28.947453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944839+0000","last_change":"2024-09-15T23:55:28.944839+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944839+0000","last_undegraded":"2024-09-15T23:55:28.944839+0000","last_fullsized":"2024-09-15T23:55:28.944839+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.960658+0000","last_change":"2024-09-15T23:55:28.960658+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.960658+0000","last_undegraded":"2024-09-15T23:55:28.960658+0000","last_fullsized":"2024-09-15T23:55:28.960658+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.949787+0000","last_change":"2024-09-15T23:55:28.949787+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.949787+0000","last_undegraded":"2024-09-15T23:55:28.949787+0000","last_fullsized":"2024-09-15T23:55:28.949787+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945497+0000","last_change":"2024-09-15T23:55:28.945497+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945497+0000","last_undegraded":"2024-09-15T23:55:28.945497+0000","last_fullsized":"2024-09-15T23:55:28.945497+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.963741+0000","last_change":"2024-09-15T23:55:28.963741+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.963741+0000","last_undegraded":"2024-09-15T23:55:28.963741+0000","last_fullsized":"2024-09-15T23:55:28.963741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.961521+0000","last_change":"2024-09-15T23:55:28.961521+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.961521+0000","last_undegraded":"2024-09-15T23:55:28.961521+0000","last_fullsized":"2024-09-15T23:55:28.961521+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944916+0000","last_change":"2024-09-15T23:55:28.944916+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944916+0000","last_undegraded":"2024-09-15T23:55:28.944916+0000","last_fullsized":"2024-09-15T23:55:28.944916+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.950123+0000","last_change":"2024-09-15T23:55:28.950123+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.950123+0000","last_undegraded":"2024-09-15T23:55:28.950123+0000","last_fullsized":"2024-09-15T23:55:28.950123+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944169+0000","last_change":"2024-09-15T23:55:28.944169+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944169+0000","last_undegraded":"2024-09-15T23:55:28.944169+0000","last_fullsized":"2024-09-15T23:55:28.944169+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.949998+0000","last_change":"2024-09-15T23:55:28.949998+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.949998+0000","last_undegraded":"2024-09-15T23:55:28.949998+0000","last_fullsized":"2024-09-15T23:55:28.949998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.949258+0000","last_change":"2024-09-15T23:55:28.949258+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.949258+0000","last_undegraded":"2024-09-15T23:55:28.949258+0000","last_fullsized":"2024-09-15T23:55:28.949258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941664+0000","last_change":"2024-09-15T23:55:28.941664+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941664+0000","last_undegraded":"2024-09-15T23:55:28.941664+0000","last_fullsized":"2024-09-15T23:55:28.941664+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944537+0000","last_change":"2024-09-15T23:55:28.944537+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944537+0000","last_undegraded":"2024-09-15T23:55:28.944537+0000","last_fullsized":"2024-09-15T23:55:28.944537+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944365+0000","last_change":"2024-09-15T23:55:28.944365+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944365+0000","last_undegraded":"2024-09-15T23:55:28.944365+0000","last_fullsized":"2024-09-15T23:55:28.944365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944033+0000","last_change":"2024-09-15T23:55:28.944033+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944033+0000","last_undegraded":"2024-09-15T23:55:28.944033+0000","last_fullsized":"2024-09-15T23:55:28.944033+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941535+0000","last_change":"2024-09-15T23:55:28.941535+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941535+0000","last_undegraded":"2024-09-15T23:55:28.941535+0000","last_fullsized":"2024-09-15T23:55:28.941535+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.958904+0000","last_change":"2024-09-15T23:55:28.957377+0000","last_active":"2024-09-15T23:55:28.958904+0000","last_peered":"2024-09-15T23:55:28.958904+0000","last_clean":"2024-09-15T23:55:28.958904+0000","last_became_active":"2024-09-15T23:55:28.957003+0000","last_became_peered":"2024-09-15T23:55:28.957003+0000","last_unstale":"2024-09-15T23:55:28.958904+0000","last_undegraded":"2024-09-15T23:55:28.958904+0000","last_fullsized":"2024-09-15T23:55:28.958904+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:09.157194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.942430+0000","last_change":"2024-09-15T23:55:28.942430+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.942430+0000","last_undegraded":"2024-09-15T23:55:28.942430+0000","last_fullsized":"2024-09-15T23:55:28.942430+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.989408+0000","last_change":"2024-09-15T23:55:28.986205+0000","last_active":"2024-09-15T23:55:28.989408+0000","last_peered":"2024-09-15T23:55:28.989408+0000","last_clean":"2024-09-15T23:55:28.989408+0000","last_became_active":"2024-09-15T23:55:28.985668+0000","last_became_peered":"2024-09-15T23:55:28.985668+0000","last_unstale":"2024-09-15T23:55:28.989408+0000","last_undegraded":"2024-09-15T23:55:28.989408+0000","last_fullsized":"2024-09-15T23:55:28.989408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:41.506389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941837+0000","last_change":"2024-09-15T23:55:28.941837+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941837+0000","last_undegraded":"2024-09-15T23:55:28.941837+0000","last_fullsized":"2024-09-15T23:55:28.941837+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204016+0000","last_change":"2024-09-15T23:55:28.959282+0000","last_active":"2024-09-15T23:55:31.204016+0000","last_peered":"2024-09-15T23:55:31.204016+0000","last_clean":"2024-09-15T23:55:31.204016+0000","last_became_active":"2024-09-15T23:55:28.958275+0000","last_became_peered":"2024-09-15T23:55:28.958275+0000","last_unstale":"2024-09-15T23:55:31.204016+0000","last_undegraded":"2024-09-15T23:55:31.204016+0000","last_fullsized":"2024-09-15T23:55:31.204016+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:23.055214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203485+0000","last_change":"2024-09-15T23:55:30.003835+0000","last_active":"2024-09-15T23:55:31.203485+0000","last_peered":"2024-09-15T23:55:31.203485+0000","last_clean":"2024-09-15T23:55:31.203485+0000","last_became_active":"2024-09-15T23:55:29.996004+0000","last_became_peered":"2024-09-15T23:55:29.996004+0000","last_unstale":"2024-09-15T23:55:31.203485+0000","last_undegraded":"2024-09-15T23:55:31.203485+0000","last_fullsized":"2024-09-15T23:55:31.203485+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:41.875576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.982157+0000","last_change":"2024-09-15T23:55:28.981225+0000","last_active":"2024-09-15T23:55:28.982157+0000","last_peered":"2024-09-15T23:55:28.982157+0000","last_clean":"2024-09-15T23:55:28.982157+0000","last_became_active":"2024-09-15T23:55:28.980753+0000","last_became_peered":"2024-09-15T23:55:28.980753+0000","last_unstale":"2024-09-15T23:55:28.982157+0000","last_undegraded":"2024-09-15T23:55:28.982157+0000","last_fullsized":"2024-09-15T23:55:28.982157+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:11.717951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.942742+0000","last_change":"2024-09-15T23:55:28.942742+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.942742+0000","last_undegraded":"2024-09-15T23:55:28.942742+0000","last_fullsized":"2024-09-15T23:55:28.942742+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.984354+0000","last_change":"2024-09-15T23:55:28.979920+0000","last_active":"2024-09-15T23:55:28.984354+0000","last_peered":"2024-09-15T23:55:28.984354+0000","last_clean":"2024-09-15T23:55:28.984354+0000","last_became_active":"2024-09-15T23:55:28.979269+0000","last_became_peered":"2024-09-15T23:55:28.979269+0000","last_unstale":"2024-09-15T23:55:28.984354+0000","last_undegraded":"2024-09-15T23:55:28.984354+0000","last_fullsized":"2024-09-15T23:55:28.984354+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:50:55.241898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943536+0000","last_change":"2024-09-15T23:55:28.943536+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943536+0000","last_undegraded":"2024-09-15T23:55:28.943536+0000","last_fullsized":"2024-09-15T23:55:28.943536+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.954499+0000","last_change":"2024-09-15T23:55:28.952417+0000","last_active":"2024-09-15T23:55:28.954499+0000","last_peered":"2024-09-15T23:55:28.954499+0000","last_clean":"2024-09-15T23:55:28.954499+0000","last_became_active":"2024-09-15T23:55:28.952107+0000","last_became_peered":"2024-09-15T23:55:28.952107+0000","last_unstale":"2024-09-15T23:55:28.954499+0000","last_undegraded":"2024-09-15T23:55:28.954499+0000","last_fullsized":"2024-09-15T23:55:28.954499+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:30.373849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204307+0000","last_change":"2024-09-15T23:55:30.002606+0000","last_active":"2024-09-15T23:55:31.204307+0000","last_peered":"2024-09-15T23:55:31.204307+0000","last_clean":"2024-09-15T23:55:31.204307+0000","last_became_active":"2024-09-15T23:55:29.996213+0000","last_became_peered":"2024-09-15T23:55:29.996213+0000","last_unstale":"2024-09-15T23:55:31.204307+0000","last_undegraded":"2024-09-15T23:55:31.204307+0000","last_fullsized":"2024-09-15T23:55:31.204307+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:08.573598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.959010+0000","last_change":"2024-09-15T23:55:28.958153+0000","last_active":"2024-09-15T23:55:28.959010+0000","last_peered":"2024-09-15T23:55:28.959010+0000","last_clean":"2024-09-15T23:55:28.959010+0000","last_became_active":"2024-09-15T23:55:28.957814+0000","last_became_peered":"2024-09-15T23:55:28.957814+0000","last_unstale":"2024-09-15T23:55:28.959010+0000","last_undegraded":"2024-09-15T23:55:28.959010+0000","last_fullsized":"2024-09-15T23:55:28.959010+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:17.799300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941602+0000","last_change":"2024-09-15T23:55:28.941602+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941602+0000","last_undegraded":"2024-09-15T23:55:28.941602+0000","last_fullsized":"2024-09-15T23:55:28.941602+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.980671+0000","last_change":"2024-09-15T23:55:28.969352+0000","last_active":"2024-09-15T23:55:28.980671+0000","last_peered":"2024-09-15T23:55:28.980671+0000","last_clean":"2024-09-15T23:55:28.980671+0000","last_became_active":"2024-09-15T23:55:28.968629+0000","last_became_peered":"2024-09-15T23:55:28.968629+0000","last_unstale":"2024-09-15T23:55:28.980671+0000","last_undegraded":"2024-09-15T23:55:28.980671+0000","last_fullsized":"2024-09-15T23:55:28.980671+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:30.705727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943160+0000","last_change":"2024-09-15T23:55:28.943160+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943160+0000","last_undegraded":"2024-09-15T23:55:28.943160+0000","last_fullsized":"2024-09-15T23:55:28.943160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.951237+0000","last_change":"2024-09-15T23:55:28.950095+0000","last_active":"2024-09-15T23:55:28.951237+0000","last_peered":"2024-09-15T23:55:28.951237+0000","last_clean":"2024-09-15T23:55:28.951237+0000","last_became_active":"2024-09-15T23:55:28.949824+0000","last_became_peered":"2024-09-15T23:55:28.949824+0000","last_unstale":"2024-09-15T23:55:28.951237+0000","last_undegraded":"2024-09-15T23:55:28.951237+0000","last_fullsized":"2024-09-15T23:55:28.951237+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:42.163168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941913+0000","last_change":"2024-09-15T23:55:28.941913+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941913+0000","last_undegraded":"2024-09-15T23:55:28.941913+0000","last_fullsized":"2024-09-15T23:55:28.941913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.979067+0000","last_change":"2024-09-15T23:55:28.978340+0000","last_active":"2024-09-15T23:55:28.979067+0000","last_peered":"2024-09-15T23:55:28.979067+0000","last_clean":"2024-09-15T23:55:28.979067+0000","last_became_active":"2024-09-15T23:55:28.978016+0000","last_became_peered":"2024-09-15T23:55:28.978016+0000","last_unstale":"2024-09-15T23:55:28.979067+0000","last_undegraded":"2024-09-15T23:55:28.979067+0000","last_fullsized":"2024-09-15T23:55:28.979067+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:40.177912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.940712+0000","last_change":"2024-09-15T23:55:28.940712+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.940712+0000","last_undegraded":"2024-09-15T23:55:28.940712+0000","last_fullsized":"2024-09-15T23:55:28.940712+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.961607+0000","last_change":"2024-09-15T23:55:28.960875+0000","last_active":"2024-09-15T23:55:28.961607+0000","last_peered":"2024-09-15T23:55:28.961607+0000","last_clean":"2024-09-15T23:55:28.961607+0000","last_became_active":"2024-09-15T23:55:28.960593+0000","last_became_peered":"2024-09-15T23:55:28.960593+0000","last_unstale":"2024-09-15T23:55:28.961607+0000","last_undegraded":"2024-09-15T23:55:28.961607+0000","last_fullsized":"2024-09-15T23:55:28.961607+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:47.992194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.946361+0000","last_change":"2024-09-15T23:55:28.946361+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.946361+0000","last_undegraded":"2024-09-15T23:55:28.946361+0000","last_fullsized":"2024-09-15T23:55:28.946361+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203755+0000","last_change":"2024-09-15T23:55:28.984808+0000","last_active":"2024-09-15T23:55:31.203755+0000","last_peered":"2024-09-15T23:55:31.203755+0000","last_clean":"2024-09-15T23:55:31.203755+0000","last_became_active":"2024-09-15T23:55:28.984131+0000","last_became_peered":"2024-09-15T23:55:28.984131+0000","last_unstale":"2024-09-15T23:55:31.203755+0000","last_undegraded":"2024-09-15T23:55:31.203755+0000","last_fullsized":"2024-09-15T23:55:31.203755+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:56.457774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944290+0000","last_change":"2024-09-15T23:55:28.944290+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944290+0000","last_undegraded":"2024-09-15T23:55:28.944290+0000","last_fullsized":"2024-09-15T23:55:28.944290+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.985001+0000","last_change":"2024-09-15T23:55:28.977045+0000","last_active":"2024-09-15T23:55:28.985001+0000","last_peered":"2024-09-15T23:55:28.985001+0000","last_clean":"2024-09-15T23:55:28.985001+0000","last_became_active":"2024-09-15T23:55:28.976372+0000","last_became_peered":"2024-09-15T23:55:28.976372+0000","last_unstale":"2024-09-15T23:55:28.985001+0000","last_undegraded":"2024-09-15T23:55:28.985001+0000","last_fullsized":"2024-09-15T23:55:28.985001+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:46.331031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943480+0000","last_change":"2024-09-15T23:55:28.943480+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943480+0000","last_undegraded":"2024-09-15T23:55:28.943480+0000","last_fullsized":"2024-09-15T23:55:28.943480+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.960937+0000","last_change":"2024-09-15T23:55:28.960226+0000","last_active":"2024-09-15T23:55:28.960937+0000","last_peered":"2024-09-15T23:55:28.960937+0000","last_clean":"2024-09-15T23:55:28.960937+0000","last_became_active":"2024-09-15T23:55:28.960000+0000","last_became_peered":"2024-09-15T23:55:28.960000+0000","last_unstale":"2024-09-15T23:55:28.960937+0000","last_undegraded":"2024-09-15T23:55:28.960937+0000","last_fullsized":"2024-09-15T23:55:28.960937+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:07.288904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.958518+0000","last_change":"2024-09-15T23:55:28.958518+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.958518+0000","last_undegraded":"2024-09-15T23:55:28.958518+0000","last_fullsized":"2024-09-15T23:55:28.958518+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.955458+0000","last_change":"2024-09-15T23:55:28.953752+0000","last_active":"2024-09-15T23:55:28.955458+0000","last_peered":"2024-09-15T23:55:28.955458+0000","last_clean":"2024-09-15T23:55:28.955458+0000","last_became_active":"2024-09-15T23:55:28.953477+0000","last_became_peered":"2024-09-15T23:55:28.953477+0000","last_unstale":"2024-09-15T23:55:28.955458+0000","last_undegraded":"2024-09-15T23:55:28.955458+0000","last_fullsized":"2024-09-15T23:55:28.955458+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:07.288904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.961961+0000","last_change":"2024-09-15T23:55:28.961961+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.961961+0000","last_undegraded":"2024-09-15T23:55:28.961961+0000","last_fullsized":"2024-09-15T23:55:28.961961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.984490+0000","last_change":"2024-09-15T23:55:28.982518+0000","last_active":"2024-09-15T23:55:28.984490+0000","last_peered":"2024-09-15T23:55:28.984490+0000","last_clean":"2024-09-15T23:55:28.984490+0000","last_became_active":"2024-09-15T23:55:28.981852+0000","last_became_peered":"2024-09-15T23:55:28.981852+0000","last_unstale":"2024-09-15T23:55:28.984490+0000","last_undegraded":"2024-09-15T23:55:28.984490+0000","last_fullsized":"2024-09-15T23:55:28.984490+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:17.276493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202224+0000","last_change":"2024-09-15T23:55:29.970464+0000","last_active":"2024-09-15T23:55:31.202224+0000","last_peered":"2024-09-15T23:55:31.202224+0000","last_clean":"2024-09-15T23:55:31.202224+0000","last_became_active":"2024-09-15T23:55:29.969600+0000","last_became_peered":"2024-09-15T23:55:29.969600+0000","last_unstale":"2024-09-15T23:55:31.202224+0000","last_undegraded":"2024-09-15T23:55:31.202224+0000","last_fullsized":"2024-09-15T23:55:31.202224+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:26.661560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.990271+0000","last_change":"2024-09-15T23:55:28.987736+0000","last_active":"2024-09-15T23:55:28.990271+0000","last_peered":"2024-09-15T23:55:28.990271+0000","last_clean":"2024-09-15T23:55:28.990271+0000","last_became_active":"2024-09-15T23:55:28.986972+0000","last_became_peered":"2024-09-15T23:55:28.986972+0000","last_unstale":"2024-09-15T23:55:28.990271+0000","last_undegraded":"2024-09-15T23:55:28.990271+0000","last_fullsized":"2024-09-15T23:55:28.990271+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:36.040443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945025+0000","last_change":"2024-09-15T23:55:28.945025+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945025+0000","last_undegraded":"2024-09-15T23:55:28.945025+0000","last_fullsized":"2024-09-15T23:55:28.945025+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.986691+0000","last_change":"2024-09-15T23:55:28.978148+0000","last_active":"2024-09-15T23:55:28.986691+0000","last_peered":"2024-09-15T23:55:28.986691+0000","last_clean":"2024-09-15T23:55:28.986691+0000","last_became_active":"2024-09-15T23:55:28.977563+0000","last_became_peered":"2024-09-15T23:55:28.977563+0000","last_unstale":"2024-09-15T23:55:28.986691+0000","last_undegraded":"2024-09-15T23:55:28.986691+0000","last_fullsized":"2024-09-15T23:55:28.986691+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:50.867342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.950442+0000","last_change":"2024-09-15T23:55:28.950442+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.950442+0000","last_undegraded":"2024-09-15T23:55:28.950442+0000","last_fullsized":"2024-09-15T23:55:28.950442+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.981932+0000","last_change":"2024-09-15T23:55:28.981019+0000","last_active":"2024-09-15T23:55:28.981932+0000","last_peered":"2024-09-15T23:55:28.981932+0000","last_clean":"2024-09-15T23:55:28.981932+0000","last_became_active":"2024-09-15T23:55:28.980736+0000","last_became_peered":"2024-09-15T23:55:28.980736+0000","last_unstale":"2024-09-15T23:55:28.981932+0000","last_undegraded":"2024-09-15T23:55:28.981932+0000","last_fullsized":"2024-09-15T23:55:28.981932+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:11.717951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.955567+0000","last_change":"2024-09-15T23:55:28.955567+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.955567+0000","last_undegraded":"2024-09-15T23:55:28.955567+0000","last_fullsized":"2024-09-15T23:55:28.955567+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.966572+0000","last_change":"2024-09-15T23:55:28.965885+0000","last_active":"2024-09-15T23:55:28.966572+0000","last_peered":"2024-09-15T23:55:28.966572+0000","last_clean":"2024-09-15T23:55:28.966572+0000","last_became_active":"2024-09-15T23:55:28.965531+0000","last_became_peered":"2024-09-15T23:55:28.965531+0000","last_unstale":"2024-09-15T23:55:28.966572+0000","last_undegraded":"2024-09-15T23:55:28.966572+0000","last_fullsized":"2024-09-15T23:55:28.966572+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:40.177912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.948793+0000","last_change":"2024-09-15T23:55:28.948793+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.948793+0000","last_undegraded":"2024-09-15T23:55:28.948793+0000","last_fullsized":"2024-09-15T23:55:28.948793+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.965793+0000","last_change":"2024-09-15T23:55:28.960054+0000","last_active":"2024-09-15T23:55:28.965793+0000","last_peered":"2024-09-15T23:55:28.965793+0000","last_clean":"2024-09-15T23:55:28.965793+0000","last_became_active":"2024-09-15T23:55:28.959315+0000","last_became_peered":"2024-09-15T23:55:28.959315+0000","last_unstale":"2024-09-15T23:55:28.965793+0000","last_undegraded":"2024-09-15T23:55:28.965793+0000","last_fullsized":"2024-09-15T23:55:28.965793+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:35.216646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945269+0000","last_change":"2024-09-15T23:55:28.945269+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945269+0000","last_undegraded":"2024-09-15T23:55:28.945269+0000","last_fullsized":"2024-09-15T23:55:28.945269+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.989629+0000","last_change":"2024-09-15T23:55:28.983747+0000","last_active":"2024-09-15T23:55:28.989629+0000","last_peered":"2024-09-15T23:55:28.989629+0000","last_clean":"2024-09-15T23:55:28.989629+0000","last_became_active":"2024-09-15T23:55:28.982268+0000","last_became_peered":"2024-09-15T23:55:28.982268+0000","last_unstale":"2024-09-15T23:55:28.989629+0000","last_undegraded":"2024-09-15T23:55:28.989629+0000","last_fullsized":"2024-09-15T23:55:28.989629+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:54.333221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.953256+0000","last_change":"2024-09-15T23:55:28.953256+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.953256+0000","last_undegraded":"2024-09-15T23:55:28.953256+0000","last_fullsized":"2024-09-15T23:55:28.953256+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203129+0000","last_change":"2024-09-15T23:55:28.984174+0000","last_active":"2024-09-15T23:55:31.203129+0000","last_peered":"2024-09-15T23:55:31.203129+0000","last_clean":"2024-09-15T23:55:31.203129+0000","last_became_active":"2024-09-15T23:55:28.983467+0000","last_became_peered":"2024-09-15T23:55:28.983467+0000","last_unstale":"2024-09-15T23:55:31.203129+0000","last_undegraded":"2024-09-15T23:55:31.203129+0000","last_fullsized":"2024-09-15T23:55:31.203129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:24.174820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.950986+0000","last_change":"2024-09-15T23:55:28.950986+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.950986+0000","last_undegraded":"2024-09-15T23:55:28.950986+0000","last_fullsized":"2024-09-15T23:55:28.950986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202605+0000","last_change":"2024-09-15T23:55:28.966139+0000","last_active":"2024-09-15T23:55:31.202605+0000","last_peered":"2024-09-15T23:55:31.202605+0000","last_clean":"2024-09-15T23:55:31.202605+0000","last_became_active":"2024-09-15T23:55:28.965422+0000","last_became_peered":"2024-09-15T23:55:28.965422+0000","last_unstale":"2024-09-15T23:55:31.202605+0000","last_undegraded":"2024-09-15T23:55:31.202605+0000","last_fullsized":"2024-09-15T23:55:31.202605+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:41.328089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941231+0000","last_change":"2024-09-15T23:55:28.941231+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941231+0000","last_undegraded":"2024-09-15T23:55:28.941231+0000","last_fullsized":"2024-09-15T23:55:28.941231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.959212+0000","last_change":"2024-09-15T23:55:28.958308+0000","last_active":"2024-09-15T23:55:28.959212+0000","last_peered":"2024-09-15T23:55:28.959212+0000","last_clean":"2024-09-15T23:55:28.959212+0000","last_became_active":"2024-09-15T23:55:28.957929+0000","last_became_peered":"2024-09-15T23:55:28.957929+0000","last_unstale":"2024-09-15T23:55:28.959212+0000","last_undegraded":"2024-09-15T23:55:28.959212+0000","last_fullsized":"2024-09-15T23:55:28.959212+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:35.158272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203329+0000","last_change":"2024-09-15T23:55:30.003355+0000","last_active":"2024-09-15T23:55:31.203329+0000","last_peered":"2024-09-15T23:55:31.203329+0000","last_clean":"2024-09-15T23:55:31.203329+0000","last_became_active":"2024-09-15T23:55:30.002742+0000","last_became_peered":"2024-09-15T23:55:30.002742+0000","last_unstale":"2024-09-15T23:55:31.203329+0000","last_undegraded":"2024-09-15T23:55:31.203329+0000","last_fullsized":"2024-09-15T23:55:31.203329+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:15.549461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.961631+0000","last_change":"2024-09-15T23:55:28.960962+0000","last_active":"2024-09-15T23:55:28.961631+0000","last_peered":"2024-09-15T23:55:28.961631+0000","last_clean":"2024-09-15T23:55:28.961631+0000","last_became_active":"2024-09-15T23:55:28.960579+0000","last_became_peered":"2024-09-15T23:55:28.960579+0000","last_unstale":"2024-09-15T23:55:28.961631+0000","last_undegraded":"2024-09-15T23:55:28.961631+0000","last_fullsized":"2024-09-15T23:55:28.961631+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:38.909033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945032+0000","last_change":"2024-09-15T23:55:28.945032+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945032+0000","last_undegraded":"2024-09-15T23:55:28.945032+0000","last_fullsized":"2024-09-15T23:55:28.945032+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.985249+0000","last_change":"2024-09-15T23:55:28.980090+0000","last_active":"2024-09-15T23:55:28.985249+0000","last_peered":"2024-09-15T23:55:28.985249+0000","last_clean":"2024-09-15T23:55:28.985249+0000","last_became_active":"2024-09-15T23:55:28.978880+0000","last_became_peered":"2024-09-15T23:55:28.978880+0000","last_unstale":"2024-09-15T23:55:28.985249+0000","last_undegraded":"2024-09-15T23:55:28.985249+0000","last_fullsized":"2024-09-15T23:55:28.985249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:00.563529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203872+0000","last_change":"2024-09-15T23:55:30.002867+0000","last_active":"2024-09-15T23:55:31.203872+0000","last_peered":"2024-09-15T23:55:31.203872+0000","last_clean":"2024-09-15T23:55:31.203872+0000","last_became_active":"2024-09-15T23:55:29.993861+0000","last_became_peered":"2024-09-15T23:55:29.993861+0000","last_unstale":"2024-09-15T23:55:31.203872+0000","last_undegraded":"2024-09-15T23:55:31.203872+0000","last_fullsized":"2024-09-15T23:55:31.203872+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:37.828534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203711+0000","last_change":"2024-09-15T23:55:28.959925+0000","last_active":"2024-09-15T23:55:31.203711+0000","last_peered":"2024-09-15T23:55:31.203711+0000","last_clean":"2024-09-15T23:55:31.203711+0000","last_became_active":"2024-09-15T23:55:28.958452+0000","last_became_peered":"2024-09-15T23:55:28.958452+0000","last_unstale":"2024-09-15T23:55:31.203711+0000","last_undegraded":"2024-09-15T23:55:31.203711+0000","last_fullsized":"2024-09-15T23:55:31.203711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:50.451580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944543+0000","last_change":"2024-09-15T23:55:28.944543+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944543+0000","last_undegraded":"2024-09-15T23:55:28.944543+0000","last_fullsized":"2024-09-15T23:55:28.944543+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.989573+0000","last_change":"2024-09-15T23:55:28.983121+0000","last_active":"2024-09-15T23:55:28.989573+0000","last_peered":"2024-09-15T23:55:28.989573+0000","last_clean":"2024-09-15T23:55:28.989573+0000","last_became_active":"2024-09-15T23:55:28.981404+0000","last_became_peered":"2024-09-15T23:55:28.981404+0000","last_unstale":"2024-09-15T23:55:28.989573+0000","last_undegraded":"2024-09-15T23:55:28.989573+0000","last_fullsized":"2024-09-15T23:55:28.989573+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:14.512897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204388+0000","last_change":"2024-09-15T23:55:29.994344+0000","last_active":"2024-09-15T23:55:31.204388+0000","last_peered":"2024-09-15T23:55:31.204388+0000","last_clean":"2024-09-15T23:55:31.204388+0000","last_became_active":"2024-09-15T23:55:29.989134+0000","last_became_peered":"2024-09-15T23:55:29.989134+0000","last_unstale":"2024-09-15T23:55:31.204388+0000","last_undegraded":"2024-09-15T23:55:31.204388+0000","last_fullsized":"2024-09-15T23:55:31.204388+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:08.439772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.958521+0000","last_change":"2024-09-15T23:55:28.956432+0000","last_active":"2024-09-15T23:55:28.958521+0000","last_peered":"2024-09-15T23:55:28.958521+0000","last_clean":"2024-09-15T23:55:28.958521+0000","last_became_active":"2024-09-15T23:55:28.956054+0000","last_became_peered":"2024-09-15T23:55:28.956054+0000","last_unstale":"2024-09-15T23:55:28.958521+0000","last_undegraded":"2024-09-15T23:55:28.958521+0000","last_fullsized":"2024-09-15T23:55:28.958521+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:44.566526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.952040+0000","last_change":"2024-09-15T23:55:28.952040+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.952040+0000","last_undegraded":"2024-09-15T23:55:28.952040+0000","last_fullsized":"2024-09-15T23:55:28.952040+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.961166+0000","last_change":"2024-09-15T23:55:28.960457+0000","last_active":"2024-09-15T23:55:28.961166+0000","last_peered":"2024-09-15T23:55:28.961166+0000","last_clean":"2024-09-15T23:55:28.961166+0000","last_became_active":"2024-09-15T23:55:28.960080+0000","last_became_peered":"2024-09-15T23:55:28.960080+0000","last_unstale":"2024-09-15T23:55:28.961166+0000","last_undegraded":"2024-09-15T23:55:28.961166+0000","last_fullsized":"2024-09-15T23:55:28.961166+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:44.566526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943015+0000","last_change":"2024-09-15T23:55:28.943015+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943015+0000","last_undegraded":"2024-09-15T23:55:28.943015+0000","last_fullsized":"2024-09-15T23:55:28.943015+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204582+0000","last_change":"2024-09-15T23:55:28.977178+0000","last_active":"2024-09-15T23:55:31.204582+0000","last_peered":"2024-09-15T23:55:31.204582+0000","last_clean":"2024-09-15T23:55:31.204582+0000","last_became_active":"2024-09-15T23:55:28.975684+0000","last_became_peered":"2024-09-15T23:55:28.975684+0000","last_unstale":"2024-09-15T23:55:31.204582+0000","last_undegraded":"2024-09-15T23:55:31.204582+0000","last_fullsized":"2024-09-15T23:55:31.204582+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:51.522143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.941473+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:55:28.941473+0000","last_peered":"2024-09-15T23:55:28.941473+0000","last_clean":"2024-09-15T23:55:28.941473+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:55:28.941473+0000","last_undegraded":"2024-09-15T23:55:28.941473+0000","last_fullsized":"2024-09-15T23:55:28.941473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":573440,"data_stored":249307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":573440,"data_stored":249307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1155072,"data_stored":833008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1208320,"data_stored":855236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:55:33.702 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3f is not active+clean 2024-09-15T23:55:33.702 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.951163+0000', 'last_change': '2024-09-15T23:55:28.951163+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.951163+0000', 'last_undegraded': '2024-09-15T23:55:28.951163+0000', 'last_fullsized': '2024-09-15T23:55:28.951163+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:55:33.702 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3e is not active+clean 2024-09-15T23:55:33.702 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.945077+0000', 'last_change': '2024-09-15T23:55:28.945077+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.945077+0000', 'last_undegraded': '2024-09-15T23:55:28.945077+0000', 'last_fullsized': '2024-09-15T23:55:28.945077+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:33.702 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3d is not active+clean 2024-09-15T23:55:33.702 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.963825+0000', 'last_change': '2024-09-15T23:55:28.963825+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.963825+0000', 'last_undegraded': '2024-09-15T23:55:28.963825+0000', 'last_fullsized': '2024-09-15T23:55:28.963825+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:55:33.702 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3c is not active+clean 2024-09-15T23:55:33.702 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.941093+0000', 'last_change': '2024-09-15T23:55:28.941093+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.941093+0000', 'last_undegraded': '2024-09-15T23:55:28.941093+0000', 'last_fullsized': '2024-09-15T23:55:28.941093+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:33.703 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3b is not active+clean 2024-09-15T23:55:33.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.945973+0000', 'last_change': '2024-09-15T23:55:28.945973+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.945973+0000', 'last_undegraded': '2024-09-15T23:55:28.945973+0000', 'last_fullsized': '2024-09-15T23:55:28.945973+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:33.703 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3a is not active+clean 2024-09-15T23:55:33.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.947588+0000', 'last_change': '2024-09-15T23:55:28.947588+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.947588+0000', 'last_undegraded': '2024-09-15T23:55:28.947588+0000', 'last_fullsized': '2024-09-15T23:55:28.947588+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:55:33.703 INFO:tasks.ceph.ceph_manager.ceph:PG 8.38 is not active+clean 2024-09-15T23:55:33.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.948541+0000', 'last_change': '2024-09-15T23:55:28.948541+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.948541+0000', 'last_undegraded': '2024-09-15T23:55:28.948541+0000', 'last_fullsized': '2024-09-15T23:55:28.948541+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:55:33.703 INFO:tasks.ceph.ceph_manager.ceph:PG 8.37 is not active+clean 2024-09-15T23:55:33.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.963117+0000', 'last_change': '2024-09-15T23:55:28.963117+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.963117+0000', 'last_undegraded': '2024-09-15T23:55:28.963117+0000', 'last_fullsized': '2024-09-15T23:55:28.963117+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:55:33.703 INFO:tasks.ceph.ceph_manager.ceph:PG 8.35 is not active+clean 2024-09-15T23:55:33.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.955280+0000', 'last_change': '2024-09-15T23:55:28.955280+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.955280+0000', 'last_undegraded': '2024-09-15T23:55:28.955280+0000', 'last_fullsized': '2024-09-15T23:55:28.955280+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:55:33.703 INFO:tasks.ceph.ceph_manager.ceph:PG 8.34 is not active+clean 2024-09-15T23:55:33.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.948981+0000', 'last_change': '2024-09-15T23:55:28.948981+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.948981+0000', 'last_undegraded': '2024-09-15T23:55:28.948981+0000', 'last_fullsized': '2024-09-15T23:55:28.948981+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:55:33.704 INFO:tasks.ceph.ceph_manager.ceph:PG 8.33 is not active+clean 2024-09-15T23:55:33.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.954510+0000', 'last_change': '2024-09-15T23:55:28.954510+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.954510+0000', 'last_undegraded': '2024-09-15T23:55:28.954510+0000', 'last_fullsized': '2024-09-15T23:55:28.954510+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:55:33.704 INFO:tasks.ceph.ceph_manager.ceph:PG 8.32 is not active+clean 2024-09-15T23:55:33.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.941785+0000', 'last_change': '2024-09-15T23:55:28.941785+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.941785+0000', 'last_undegraded': '2024-09-15T23:55:28.941785+0000', 'last_fullsized': '2024-09-15T23:55:28.941785+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:55:33.704 INFO:tasks.ceph.ceph_manager.ceph:PG 8.31 is not active+clean 2024-09-15T23:55:33.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.947263+0000', 'last_change': '2024-09-15T23:55:28.947263+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.947263+0000', 'last_undegraded': '2024-09-15T23:55:28.947263+0000', 'last_fullsized': '2024-09-15T23:55:28.947263+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:33.704 INFO:tasks.ceph.ceph_manager.ceph:PG 8.30 is not active+clean 2024-09-15T23:55:33.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.947219+0000', 'last_change': '2024-09-15T23:55:28.947219+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.947219+0000', 'last_undegraded': '2024-09-15T23:55:28.947219+0000', 'last_fullsized': '2024-09-15T23:55:28.947219+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:55:33.704 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2f is not active+clean 2024-09-15T23:55:33.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.947453+0000', 'last_change': '2024-09-15T23:55:28.947453+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.947453+0000', 'last_undegraded': '2024-09-15T23:55:28.947453+0000', 'last_fullsized': '2024-09-15T23:55:28.947453+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:55:33.704 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2e is not active+clean 2024-09-15T23:55:33.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.944839+0000', 'last_change': '2024-09-15T23:55:28.944839+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.944839+0000', 'last_undegraded': '2024-09-15T23:55:28.944839+0000', 'last_fullsized': '2024-09-15T23:55:28.944839+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:33.705 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2d is not active+clean 2024-09-15T23:55:33.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.960658+0000', 'last_change': '2024-09-15T23:55:28.960658+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.960658+0000', 'last_undegraded': '2024-09-15T23:55:28.960658+0000', 'last_fullsized': '2024-09-15T23:55:28.960658+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:55:33.705 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2c is not active+clean 2024-09-15T23:55:33.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.949787+0000', 'last_change': '2024-09-15T23:55:28.949787+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.949787+0000', 'last_undegraded': '2024-09-15T23:55:28.949787+0000', 'last_fullsized': '2024-09-15T23:55:28.949787+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:33.705 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2b is not active+clean 2024-09-15T23:55:33.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.945497+0000', 'last_change': '2024-09-15T23:55:28.945497+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.945497+0000', 'last_undegraded': '2024-09-15T23:55:28.945497+0000', 'last_fullsized': '2024-09-15T23:55:28.945497+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:33.705 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2a is not active+clean 2024-09-15T23:55:33.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.963741+0000', 'last_change': '2024-09-15T23:55:28.963741+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.963741+0000', 'last_undegraded': '2024-09-15T23:55:28.963741+0000', 'last_fullsized': '2024-09-15T23:55:28.963741+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:55:33.705 INFO:tasks.ceph.ceph_manager.ceph:PG 8.29 is not active+clean 2024-09-15T23:55:33.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.961521+0000', 'last_change': '2024-09-15T23:55:28.961521+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.961521+0000', 'last_undegraded': '2024-09-15T23:55:28.961521+0000', 'last_fullsized': '2024-09-15T23:55:28.961521+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:55:33.705 INFO:tasks.ceph.ceph_manager.ceph:PG 8.28 is not active+clean 2024-09-15T23:55:33.706 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.944916+0000', 'last_change': '2024-09-15T23:55:28.944916+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.944916+0000', 'last_undegraded': '2024-09-15T23:55:28.944916+0000', 'last_fullsized': '2024-09-15T23:55:28.944916+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:55:33.706 INFO:tasks.ceph.ceph_manager.ceph:PG 8.27 is not active+clean 2024-09-15T23:55:33.706 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.950123+0000', 'last_change': '2024-09-15T23:55:28.950123+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.950123+0000', 'last_undegraded': '2024-09-15T23:55:28.950123+0000', 'last_fullsized': '2024-09-15T23:55:28.950123+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:55:33.706 INFO:tasks.ceph.ceph_manager.ceph:PG 8.26 is not active+clean 2024-09-15T23:55:33.706 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.944169+0000', 'last_change': '2024-09-15T23:55:28.944169+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.944169+0000', 'last_undegraded': '2024-09-15T23:55:28.944169+0000', 'last_fullsized': '2024-09-15T23:55:28.944169+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:55:33.706 INFO:tasks.ceph.ceph_manager.ceph:PG 8.25 is not active+clean 2024-09-15T23:55:33.706 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.949998+0000', 'last_change': '2024-09-15T23:55:28.949998+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.949998+0000', 'last_undegraded': '2024-09-15T23:55:28.949998+0000', 'last_fullsized': '2024-09-15T23:55:28.949998+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:55:33.706 INFO:tasks.ceph.ceph_manager.ceph:PG 8.24 is not active+clean 2024-09-15T23:55:33.706 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.949258+0000', 'last_change': '2024-09-15T23:55:28.949258+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.949258+0000', 'last_undegraded': '2024-09-15T23:55:28.949258+0000', 'last_fullsized': '2024-09-15T23:55:28.949258+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:33.707 INFO:tasks.ceph.ceph_manager.ceph:PG 8.23 is not active+clean 2024-09-15T23:55:33.707 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.941664+0000', 'last_change': '2024-09-15T23:55:28.941664+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.941664+0000', 'last_undegraded': '2024-09-15T23:55:28.941664+0000', 'last_fullsized': '2024-09-15T23:55:28.941664+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:55:33.707 INFO:tasks.ceph.ceph_manager.ceph:PG 8.22 is not active+clean 2024-09-15T23:55:33.707 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.944537+0000', 'last_change': '2024-09-15T23:55:28.944537+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.944537+0000', 'last_undegraded': '2024-09-15T23:55:28.944537+0000', 'last_fullsized': '2024-09-15T23:55:28.944537+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:55:33.707 INFO:tasks.ceph.ceph_manager.ceph:PG 8.21 is not active+clean 2024-09-15T23:55:33.707 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.944365+0000', 'last_change': '2024-09-15T23:55:28.944365+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.944365+0000', 'last_undegraded': '2024-09-15T23:55:28.944365+0000', 'last_fullsized': '2024-09-15T23:55:28.944365+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:55:33.707 INFO:tasks.ceph.ceph_manager.ceph:PG 8.20 is not active+clean 2024-09-15T23:55:33.707 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.944033+0000', 'last_change': '2024-09-15T23:55:28.944033+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.944033+0000', 'last_undegraded': '2024-09-15T23:55:28.944033+0000', 'last_fullsized': '2024-09-15T23:55:28.944033+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:33.707 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-09-15T23:55:33.707 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.941535+0000', 'last_change': '2024-09-15T23:55:28.941535+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.941535+0000', 'last_undegraded': '2024-09-15T23:55:28.941535+0000', 'last_fullsized': '2024-09-15T23:55:28.941535+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:55:33.707 INFO:tasks.ceph.ceph_manager.ceph:PG 8.11 is not active+clean 2024-09-15T23:55:33.708 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.942430+0000', 'last_change': '2024-09-15T23:55:28.942430+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.942430+0000', 'last_undegraded': '2024-09-15T23:55:28.942430+0000', 'last_fullsized': '2024-09-15T23:55:28.942430+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:55:33.708 INFO:tasks.ceph.ceph_manager.ceph:PG 8.12 is not active+clean 2024-09-15T23:55:33.708 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.941837+0000', 'last_change': '2024-09-15T23:55:28.941837+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.941837+0000', 'last_undegraded': '2024-09-15T23:55:28.941837+0000', 'last_fullsized': '2024-09-15T23:55:28.941837+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:55:33.708 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-09-15T23:55:33.708 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.942742+0000', 'last_change': '2024-09-15T23:55:28.942742+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.942742+0000', 'last_undegraded': '2024-09-15T23:55:28.942742+0000', 'last_fullsized': '2024-09-15T23:55:28.942742+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:33.708 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-09-15T23:55:33.708 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.943536+0000', 'last_change': '2024-09-15T23:55:28.943536+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.943536+0000', 'last_undegraded': '2024-09-15T23:55:28.943536+0000', 'last_fullsized': '2024-09-15T23:55:28.943536+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:55:33.708 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-09-15T23:55:33.708 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.941602+0000', 'last_change': '2024-09-15T23:55:28.941602+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.941602+0000', 'last_undegraded': '2024-09-15T23:55:28.941602+0000', 'last_fullsized': '2024-09-15T23:55:28.941602+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:33.708 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-09-15T23:55:33.708 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.943160+0000', 'last_change': '2024-09-15T23:55:28.943160+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.943160+0000', 'last_undegraded': '2024-09-15T23:55:28.943160+0000', 'last_fullsized': '2024-09-15T23:55:28.943160+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:33.709 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-09-15T23:55:33.709 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.941913+0000', 'last_change': '2024-09-15T23:55:28.941913+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.941913+0000', 'last_undegraded': '2024-09-15T23:55:28.941913+0000', 'last_fullsized': '2024-09-15T23:55:28.941913+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:33.709 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1a is not active+clean 2024-09-15T23:55:33.709 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.940712+0000', 'last_change': '2024-09-15T23:55:28.940712+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.940712+0000', 'last_undegraded': '2024-09-15T23:55:28.940712+0000', 'last_fullsized': '2024-09-15T23:55:28.940712+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:55:33.709 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-09-15T23:55:33.709 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.946361+0000', 'last_change': '2024-09-15T23:55:28.946361+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.946361+0000', 'last_undegraded': '2024-09-15T23:55:28.946361+0000', 'last_fullsized': '2024-09-15T23:55:28.946361+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:33.709 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1c is not active+clean 2024-09-15T23:55:33.709 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.944290+0000', 'last_change': '2024-09-15T23:55:28.944290+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.944290+0000', 'last_undegraded': '2024-09-15T23:55:28.944290+0000', 'last_fullsized': '2024-09-15T23:55:28.944290+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:55:33.709 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1d is not active+clean 2024-09-15T23:55:33.709 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.943480+0000', 'last_change': '2024-09-15T23:55:28.943480+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.943480+0000', 'last_undegraded': '2024-09-15T23:55:28.943480+0000', 'last_fullsized': '2024-09-15T23:55:28.943480+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:55:33.709 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1e is not active+clean 2024-09-15T23:55:33.709 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.958518+0000', 'last_change': '2024-09-15T23:55:28.958518+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.958518+0000', 'last_undegraded': '2024-09-15T23:55:28.958518+0000', 'last_fullsized': '2024-09-15T23:55:28.958518+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:55:33.710 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1f is not active+clean 2024-09-15T23:55:33.710 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.961961+0000', 'last_change': '2024-09-15T23:55:28.961961+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.961961+0000', 'last_undegraded': '2024-09-15T23:55:28.961961+0000', 'last_fullsized': '2024-09-15T23:55:28.961961+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:55:33.710 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1 is not active+clean 2024-09-15T23:55:33.710 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.945025+0000', 'last_change': '2024-09-15T23:55:28.945025+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.945025+0000', 'last_undegraded': '2024-09-15T23:55:28.945025+0000', 'last_fullsized': '2024-09-15T23:55:28.945025+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:55:33.710 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-09-15T23:55:33.710 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.950442+0000', 'last_change': '2024-09-15T23:55:28.950442+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.950442+0000', 'last_undegraded': '2024-09-15T23:55:28.950442+0000', 'last_fullsized': '2024-09-15T23:55:28.950442+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:33.710 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3 is not active+clean 2024-09-15T23:55:33.710 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.955567+0000', 'last_change': '2024-09-15T23:55:28.955567+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.955567+0000', 'last_undegraded': '2024-09-15T23:55:28.955567+0000', 'last_fullsized': '2024-09-15T23:55:28.955567+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:55:33.710 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-09-15T23:55:33.710 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.948793+0000', 'last_change': '2024-09-15T23:55:28.948793+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.948793+0000', 'last_undegraded': '2024-09-15T23:55:28.948793+0000', 'last_fullsized': '2024-09-15T23:55:28.948793+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:33.710 INFO:tasks.ceph.ceph_manager.ceph:PG 8.5 is not active+clean 2024-09-15T23:55:33.710 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.945269+0000', 'last_change': '2024-09-15T23:55:28.945269+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.945269+0000', 'last_undegraded': '2024-09-15T23:55:28.945269+0000', 'last_fullsized': '2024-09-15T23:55:28.945269+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:33.711 INFO:tasks.ceph.ceph_manager.ceph:PG 8.6 is not active+clean 2024-09-15T23:55:33.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.953256+0000', 'last_change': '2024-09-15T23:55:28.953256+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.953256+0000', 'last_undegraded': '2024-09-15T23:55:28.953256+0000', 'last_fullsized': '2024-09-15T23:55:28.953256+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:55:33.711 INFO:tasks.ceph.ceph_manager.ceph:PG 8.7 is not active+clean 2024-09-15T23:55:33.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.950986+0000', 'last_change': '2024-09-15T23:55:28.950986+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.950986+0000', 'last_undegraded': '2024-09-15T23:55:28.950986+0000', 'last_fullsized': '2024-09-15T23:55:28.950986+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:55:33.711 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-09-15T23:55:33.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.941231+0000', 'last_change': '2024-09-15T23:55:28.941231+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.941231+0000', 'last_undegraded': '2024-09-15T23:55:28.941231+0000', 'last_fullsized': '2024-09-15T23:55:28.941231+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:33.711 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-09-15T23:55:33.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.945032+0000', 'last_change': '2024-09-15T23:55:28.945032+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.945032+0000', 'last_undegraded': '2024-09-15T23:55:28.945032+0000', 'last_fullsized': '2024-09-15T23:55:28.945032+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:55:33.711 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-09-15T23:55:33.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.944543+0000', 'last_change': '2024-09-15T23:55:28.944543+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.944543+0000', 'last_undegraded': '2024-09-15T23:55:28.944543+0000', 'last_fullsized': '2024-09-15T23:55:28.944543+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:33.711 INFO:tasks.ceph.ceph_manager.ceph:PG 8.f is not active+clean 2024-09-15T23:55:33.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.952040+0000', 'last_change': '2024-09-15T23:55:28.952040+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.952040+0000', 'last_undegraded': '2024-09-15T23:55:28.952040+0000', 'last_fullsized': '2024-09-15T23:55:28.952040+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:55:33.712 INFO:tasks.ceph.ceph_manager.ceph:PG 8.9 is not active+clean 2024-09-15T23:55:33.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:28.943015+0000', 'last_change': '2024-09-15T23:55:28.943015+0000', 'last_active': '2024-09-15T23:55:28.924235+0000', 'last_peered': '2024-09-15T23:55:28.924235+0000', 'last_clean': '2024-09-15T23:55:28.924235+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:28.943015+0000', 'last_undegraded': '2024-09-15T23:55:28.943015+0000', 'last_fullsized': '2024-09-15T23:55:28.943015+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:28.924235+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:33.713 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:55:33.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.846+0000 7f3a9114c640 1 Processor -- start 2024-09-15T23:55:33.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.846+0000 7f3a9114c640 1 -- start start 2024-09-15T23:55:33.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.846+0000 7f3a9114c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8c070020 0x7f3a8c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.846+0000 7f3a9114c640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8c0aede0 con 0x7f3a8c1520a0 2024-09-15T23:55:33.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.846+0000 7f3a9114c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8c15fa10 con 0x7f3a8c15f1d0 2024-09-15T23:55:33.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.846+0000 7f3a9114c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3a8c152480 con 0x7f3a8c070020 2024-09-15T23:55:33.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.846+0000 7f3a8ad9d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3a8c1520a0 0x7f3a8c06f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41860/0 (socket says 172.21.15.112:41860) 2024-09-15T23:55:33.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.846+0000 7f3a8ad9d640 1 -- 172.21.15.112:0/3242644743 learned_addr learned my addr 172.21.15.112:0/3242644743 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:33.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a83fff640 1 --2- 172.21.15.112:0/3242644743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8c070020 0x7f3a8c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 -- 172.21.15.112:0/3242644743 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1392560509 0 0) 0x7f3a8c0aede0 con 0x7f3a8c1520a0 2024-09-15T23:55:33.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 -- 172.21.15.112:0/3242644743 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a78003530 con 0x7f3a8c1520a0 2024-09-15T23:55:33.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 -- 172.21.15.112:0/3242644743 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3845626633 0 0) 0x7f3a78003530 con 0x7f3a8c1520a0 2024-09-15T23:55:33.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 -- 172.21.15.112:0/3242644743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8c070020 msgr2=0x7f3a8c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:33.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 --2- 172.21.15.112:0/3242644743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8c070020 0x7f3a8c15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 -- 172.21.15.112:0/3242644743 >> v1:172.21.15.169:6789/0 conn(0x7f3a8c15f1d0 legacy=0x7f3a8c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 -- 172.21.15.112:0/3242644743 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8c074250 con 0x7f3a8c1520a0 2024-09-15T23:55:33.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 -- 172.21.15.112:0/3242644743 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f3a7c001680 con 0x7f3a8c1520a0 2024-09-15T23:55:33.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 -- 172.21.15.112:0/3242644743 >> v1:172.21.15.112:6789/0 conn(0x7f3a8c1520a0 legacy=0x7f3a8c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 --2- 172.21.15.112:0/3242644743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a780039f0 0x7f3a78003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 --2- 172.21.15.112:0/3242644743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8c070020 0x7f3a78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 --2- 172.21.15.112:0/3242644743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a78004d50 0x7f3a780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 -- 172.21.15.112:0/3242644743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7800ba80 con 0x7f3a78004d50 2024-09-15T23:55:33.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 -- 172.21.15.112:0/3242644743 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7800bc00 con 0x7f3a780039f0 2024-09-15T23:55:33.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 -- 172.21.15.112:0/3242644743 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7800be00 con 0x7f3a8c070020 2024-09-15T23:55:33.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8b59e640 1 --2- 172.21.15.112:0/3242644743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a78004d50 0x7f3a780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8ad9d640 1 --2- 172.21.15.112:0/3242644743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a780039f0 0x7f3a78003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a83fff640 1 --2- 172.21.15.112:0/3242644743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8c070020 0x7f3a78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8b59e640 1 -- 172.21.15.112:0/3242644743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8c070020 msgr2=0x7f3a78004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:33.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8b59e640 1 --2- 172.21.15.112:0/3242644743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8c070020 0x7f3a78004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8b59e640 1 -- 172.21.15.112:0/3242644743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a780039f0 msgr2=0x7f3a78003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:33.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8b59e640 1 --2- 172.21.15.112:0/3242644743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a780039f0 0x7f3a78003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8b59e640 1 -- 172.21.15.112:0/3242644743 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a78003530 con 0x7f3a78004d50 2024-09-15T23:55:33.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8b59e640 1 --2- 172.21.15.112:0/3242644743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a78004d50 0x7f3a780051d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3a84001e40 tx=0x7f3a8401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e851bbb6fb2c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:33.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 -- 172.21.15.112:0/3242644743 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84001a90 con 0x7f3a78004d50 2024-09-15T23:55:33.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 -- 172.21.15.112:0/3242644743 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a84003b80 con 0x7f3a78004d50 2024-09-15T23:55:33.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8a59c640 1 -- 172.21.15.112:0/3242644743 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84005080 con 0x7f3a78004d50 2024-09-15T23:55:33.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a9114c640 1 -- 172.21.15.112:0/3242644743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a78004d50 msgr2=0x7f3a780051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a9114c640 1 --2- 172.21.15.112:0/3242644743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a78004d50 0x7f3a780051d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3a84001e40 tx=0x7f3a8401c760 comp rx=0 tx=0).stop 2024-09-15T23:55:33.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.850+0000 7f3a8b59e640 1 -- 172.21.15.112:0/3242644743 reap_dead start 2024-09-15T23:55:33.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 -- 172.21.15.112:0/3242644743 shutdown_connections 2024-09-15T23:55:33.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 -- 172.21.15.112:0/3242644743 >> 172.21.15.112:0/3242644743 conn(0x7f3a8c0b1f90 msgr2=0x7f3a8c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:33.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 -- 172.21.15.112:0/3242644743 shutdown_connections 2024-09-15T23:55:33.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 -- 172.21.15.112:0/3242644743 wait complete. 2024-09-15T23:55:33.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 Processor -- start 2024-09-15T23:55:33.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 -- start start 2024-09-15T23:55:33.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8c15e0a0 0x7f3a8c1f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a8c1f7ee0 0x7f3a8c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a8c0ce140 0x7f3a8c159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c073a50 con 0x7f3a8c0ce140 2024-09-15T23:55:33.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c073770 con 0x7f3a8c1f7ee0 2024-09-15T23:55:33.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3a8c073d30 con 0x7f3a8c15e0a0 2024-09-15T23:55:33.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a8b59e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a8c0ce140 0x7f3a8c159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a8b59e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a8c0ce140 0x7f3a8c159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41228/0 (socket says 172.21.15.112:41228) 2024-09-15T23:55:33.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a8b59e640 1 -- 172.21.15.112:0/2668232324 learned_addr learned my addr 172.21.15.112:0/2668232324 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:33.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a8ad9d640 1 --2- 172.21.15.112:0/2668232324 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8c15e0a0 0x7f3a8c1f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a83fff640 1 --2- 172.21.15.112:0/2668232324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a8c1f7ee0 0x7f3a8c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a8b59e640 1 -- 172.21.15.112:0/2668232324 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8c15e0a0 msgr2=0x7f3a8c1f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a8b59e640 1 --2- 172.21.15.112:0/2668232324 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8c15e0a0 0x7f3a8c1f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a8b59e640 1 -- 172.21.15.112:0/2668232324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a8c1f7ee0 msgr2=0x7f3a8c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a8b59e640 1 --2- 172.21.15.112:0/2668232324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a8c1f7ee0 0x7f3a8c0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a8b59e640 1 -- 172.21.15.112:0/2668232324 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8c0cd420 con 0x7f3a8c0ce140 2024-09-15T23:55:33.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a8b59e640 1 --2- 172.21.15.112:0/2668232324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a8c0ce140 0x7f3a8c159fc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3a8401cc40 tx=0x7f3a78005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:33.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a837fe640 1 -- 172.21.15.112:0/2668232324 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a840b8070 con 0x7f3a8c0ce140 2024-09-15T23:55:33.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a837fe640 1 -- 172.21.15.112:0/2668232324 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a84006b60 con 0x7f3a8c0ce140 2024-09-15T23:55:33.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 -- 172.21.15.112:0/2668232324 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8c1f86c0 con 0x7f3a8c0ce140 2024-09-15T23:55:33.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a837fe640 1 -- 172.21.15.112:0/2668232324 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84001a90 con 0x7f3a8c0ce140 2024-09-15T23:55:33.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 -- 172.21.15.112:0/2668232324 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8c1f8c80 con 0x7f3a8c0ce140 2024-09-15T23:55:33.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.854+0000 7f3a9114c640 1 -- 172.21.15.112:0/2668232324 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a8c15f680 con 0x7f3a8c0ce140 2024-09-15T23:55:33.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.858+0000 7f3a837fe640 1 -- 172.21.15.112:0/2668232324 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3a840bb070 con 0x7f3a8c0ce140 2024-09-15T23:55:33.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.858+0000 7f3a837fe640 1 --2- 172.21.15.112:0/2668232324 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3a6c0678f0 0x7f3a6c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.858+0000 7f3a8ad9d640 1 --2- 172.21.15.112:0/2668232324 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3a6c0678f0 0x7f3a6c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.858+0000 7f3a837fe640 1 -- 172.21.15.112:0/2668232324 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f3a8411f660 con 0x7f3a8c0ce140 2024-09-15T23:55:33.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.858+0000 7f3a8ad9d640 1 --2- 172.21.15.112:0/2668232324 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3a6c0678f0 0x7f3a6c069db0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c001ec0 tx=0x7f3a7c007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:33.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:33.862+0000 7f3a837fe640 1 -- 172.21.15.112:0/2668232324 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3a840c2070 con 0x7f3a8c0ce140 2024-09-15T23:55:34.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.082+0000 7f3a9114c640 1 -- 172.21.15.112:0/2668232324 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3a8c06e540 con 0x7f3a8c0ce140 2024-09-15T23:55:34.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.086+0000 7f3a837fe640 1 -- 172.21.15.112:0/2668232324 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1687 (secure 0 0 0) 0x7f3a840ac020 con 0x7f3a8c0ce140 2024-09-15T23:55:34.091 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:34.091 INFO:teuthology.orchestra.run.smithi112.stdout:{"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":127,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1726444419,"num_in_osds":8,"osd_in_since":1726444408,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":56},{"state_name":"active+clean","count":41}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":591980,"bytes_used":261292032,"bytes_avail":772832821248,"bytes_total":773094113280,"inactive_pgs_ratio":0.57731956243515015,"write_bytes_sec":575,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":22,"btime":"2024-09-15T23:55:31:957534+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5307}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-15T23:54:41.248616+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:55:34.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.086+0000 7f3a9114c640 1 -- 172.21.15.112:0/2668232324 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3a6c0678f0 msgr2=0x7f3a6c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:34.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.086+0000 7f3a9114c640 1 --2- 172.21.15.112:0/2668232324 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3a6c0678f0 0x7f3a6c069db0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c001ec0 tx=0x7f3a7c007040 comp rx=0 tx=0).stop 2024-09-15T23:55:34.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.086+0000 7f3a9114c640 1 -- 172.21.15.112:0/2668232324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a8c0ce140 msgr2=0x7f3a8c159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:34.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.086+0000 7f3a9114c640 1 --2- 172.21.15.112:0/2668232324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a8c0ce140 0x7f3a8c159fc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3a8401cc40 tx=0x7f3a78005840 comp rx=0 tx=0).stop 2024-09-15T23:55:34.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.086+0000 7f3a9114c640 1 -- 172.21.15.112:0/2668232324 shutdown_connections 2024-09-15T23:55:34.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.086+0000 7f3a9114c640 1 --2- 172.21.15.112:0/2668232324 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3a6c0678f0 0x7f3a6c069db0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.086+0000 7f3a9114c640 1 --2- 172.21.15.112:0/2668232324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a8c0ce140 0x7f3a8c159fc0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.086+0000 7f3a9114c640 1 --2- 172.21.15.112:0/2668232324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a8c1f7ee0 0x7f3a8c0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.086+0000 7f3a9114c640 1 --2- 172.21.15.112:0/2668232324 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8c15e0a0 0x7f3a8c1f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.086+0000 7f3a9114c640 1 -- 172.21.15.112:0/2668232324 >> 172.21.15.112:0/2668232324 conn(0x7f3a8c0b1f90 msgr2=0x7f3a8c0b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:34.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.086+0000 7f3a9114c640 1 -- 172.21.15.112:0/2668232324 shutdown_connections 2024-09-15T23:55:34.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.086+0000 7f3a9114c640 1 -- 172.21.15.112:0/2668232324 wait complete. 2024-09-15T23:55:34.110 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:55:34.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:55:34.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.222+0000 7fd2cbf1d640 1 Processor -- start 2024-09-15T23:55:34.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.222+0000 7fd2cbf1d640 1 -- start start 2024-09-15T23:55:34.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2cbf1d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd2c415bec0 0x7fd2c40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:34.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2cbf1d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2c40b3290 con 0x7fd2c415c2a0 2024-09-15T23:55:34.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2cbf1d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2c40b3570 con 0x7fd2c40af470 2024-09-15T23:55:34.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2cbf1d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd2c40b3850 con 0x7fd2c415bec0 2024-09-15T23:55:34.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c94b8640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd2c415c2a0 0x7fd2c40aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41864/0 (socket says 172.21.15.112:41864) 2024-09-15T23:55:34.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c94b8640 1 -- 172.21.15.112:0/2776218026 learned_addr learned my addr 172.21.15.112:0/2776218026 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c9cb9640 1 --2- 172.21.15.112:0/2776218026 >> v2:172.21.15.169:3300/0 conn(0x7fd2c415bec0 0x7fd2c40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 -- 172.21.15.112:0/2776218026 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2256765857 0 0) 0x7fd2c40b3290 con 0x7fd2c415c2a0 2024-09-15T23:55:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 -- 172.21.15.112:0/2776218026 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2b0003530 con 0x7fd2c415c2a0 2024-09-15T23:55:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 -- 172.21.15.112:0/2776218026 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2663396572 0 0) 0x7fd2b0003530 con 0x7fd2c415c2a0 2024-09-15T23:55:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 -- 172.21.15.112:0/2776218026 >> v2:172.21.15.169:3300/0 conn(0x7fd2c415bec0 msgr2=0x7fd2c40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 --2- 172.21.15.112:0/2776218026 >> v2:172.21.15.169:3300/0 conn(0x7fd2c415bec0 0x7fd2c40ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 -- 172.21.15.112:0/2776218026 >> v1:172.21.15.169:6789/0 conn(0x7fd2c40af470 legacy=0x7fd2c406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 -- 172.21.15.112:0/2776218026 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c40b3b30 con 0x7fd2c415c2a0 2024-09-15T23:55:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 -- 172.21.15.112:0/2776218026 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fd2c0001680 con 0x7fd2c415c2a0 2024-09-15T23:55:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 -- 172.21.15.112:0/2776218026 >> v1:172.21.15.112:6789/0 conn(0x7fd2c415c2a0 legacy=0x7fd2c40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 --2- 172.21.15.112:0/2776218026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2b00039c0 0x7fd2b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:34.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 --2- 172.21.15.112:0/2776218026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b0004810 0x7fd2b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:34.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 --2- 172.21.15.112:0/2776218026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2b00051d0 0x7fd2b000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:34.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 -- 172.21.15.112:0/2776218026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c40b3850 con 0x7fd2b0004810 2024-09-15T23:55:34.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 -- 172.21.15.112:0/2776218026 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b000c070 con 0x7fd2b00039c0 2024-09-15T23:55:34.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c8cb7640 1 -- 172.21.15.112:0/2776218026 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b000c270 con 0x7fd2b00051d0 2024-09-15T23:55:34.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c94b8640 1 --2- 172.21.15.112:0/2776218026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b0004810 0x7fd2b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:34.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2ca4ba640 1 --2- 172.21.15.112:0/2776218026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2b00051d0 0x7fd2b000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:34.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c94b8640 1 -- 172.21.15.112:0/2776218026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2b00051d0 msgr2=0x7fd2b000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:34.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c94b8640 1 --2- 172.21.15.112:0/2776218026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2b00051d0 0x7fd2b000b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c94b8640 1 -- 172.21.15.112:0/2776218026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2b00039c0 msgr2=0x7fd2b0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:34.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c9cb9640 1 --2- 172.21.15.112:0/2776218026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2b00039c0 0x7fd2b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:34.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c94b8640 1 --2- 172.21.15.112:0/2776218026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2b00039c0 0x7fd2b0003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2ca4ba640 1 -- 172.21.15.112:0/2776218026 reap_dead start 2024-09-15T23:55:34.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c94b8640 1 -- 172.21.15.112:0/2776218026 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b0003530 con 0x7fd2b0004810 2024-09-15T23:55:34.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.226+0000 7fd2c94b8640 1 --2- 172.21.15.112:0/2776218026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b0004810 0x7fd2b0004c90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000c190 tx=0x7fd2c001f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fc2399791b9409 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:34.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2c8cb7640 1 -- 172.21.15.112:0/2776218026 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0007d00 con 0x7fd2b0004810 2024-09-15T23:55:34.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2c8cb7640 1 -- 172.21.15.112:0/2776218026 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c0005b00 con 0x7fd2b0004810 2024-09-15T23:55:34.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2c8cb7640 1 -- 172.21.15.112:0/2776218026 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0007070 con 0x7fd2b0004810 2024-09-15T23:55:34.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2776218026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b0004810 msgr2=0x7fd2b0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:34.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 --2- 172.21.15.112:0/2776218026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b0004810 0x7fd2b0004c90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000c190 tx=0x7fd2c001f390 comp rx=0 tx=0).stop 2024-09-15T23:55:34.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2776218026 shutdown_connections 2024-09-15T23:55:34.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 --2- 172.21.15.112:0/2776218026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b0004810 0x7fd2b0004c90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2776218026 >> 172.21.15.112:0/2776218026 conn(0x7fd2c40b1f90 msgr2=0x7fd2c40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:34.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2776218026 shutdown_connections 2024-09-15T23:55:34.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2776218026 wait complete. 2024-09-15T23:55:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 Processor -- start 2024-09-15T23:55:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 -- start start 2024-09-15T23:55:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2b0004810 0x7fd2c41f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2c414a980 0x7fd2c4155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2c414a050 0x7fd2c41e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c40afc90 con 0x7fd2c414a980 2024-09-15T23:55:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c40b40f0 con 0x7fd2c414a050 2024-09-15T23:55:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c40aed60 con 0x7fd2b0004810 2024-09-15T23:55:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2c94b8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2c414a980 0x7fd2c4155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:34.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2c94b8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2c414a980 0x7fd2c4155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41244/0 (socket says 172.21.15.112:41244) 2024-09-15T23:55:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2c94b8640 1 -- 172.21.15.112:0/2092822794 learned_addr learned my addr 172.21.15.112:0/2092822794 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2c9cb9640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2b0004810 0x7fd2c41f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2ca4ba640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2c414a050 0x7fd2c41e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2c94b8640 1 -- 172.21.15.112:0/2092822794 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2b0004810 msgr2=0x7fd2c41f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2c94b8640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2b0004810 0x7fd2c41f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2c94b8640 1 -- 172.21.15.112:0/2092822794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2c414a050 msgr2=0x7fd2c41e7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2c94b8640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2c414a050 0x7fd2c41e7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2c94b8640 1 -- 172.21.15.112:0/2092822794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c415ca60 con 0x7fd2c414a980 2024-09-15T23:55:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2c9cb9640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2b0004810 0x7fd2c41f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2ca4ba640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2c414a050 0x7fd2c41e7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2c94b8640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2c414a980 0x7fd2c4155950 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd2c001f1c0 tx=0x7fd2b0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2ba7fc640 1 -- 172.21.15.112:0/2092822794 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0007d00 con 0x7fd2c414a980 2024-09-15T23:55:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2ba7fc640 1 -- 172.21.15.112:0/2092822794 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c0000ee0 con 0x7fd2c414a980 2024-09-15T23:55:34.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2092822794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c41f7ac0 con 0x7fd2c414a980 2024-09-15T23:55:34.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2ba7fc640 1 -- 172.21.15.112:0/2092822794 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0001440 con 0x7fd2c414a980 2024-09-15T23:55:34.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.230+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2092822794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c41f8080 con 0x7fd2c414a980 2024-09-15T23:55:34.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.234+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2092822794 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c40af0f0 con 0x7fd2c414a980 2024-09-15T23:55:34.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.234+0000 7fd2ba7fc640 1 -- 172.21.15.112:0/2092822794 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2c00047f0 con 0x7fd2c414a980 2024-09-15T23:55:34.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.234+0000 7fd2ba7fc640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2a80678c0 0x7fd2a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:34.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.234+0000 7fd2c9cb9640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2a80678c0 0x7fd2a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:34.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.234+0000 7fd2ba7fc640 1 -- 172.21.15.112:0/2092822794 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fd2c0123310 con 0x7fd2c414a980 2024-09-15T23:55:34.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.234+0000 7fd2c9cb9640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2a80678c0 0x7fd2a8069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40512d0 tx=0x7fd2b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:34.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.238+0000 7fd2ba7fc640 1 -- 172.21.15.112:0/2092822794 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd2c00c1060 con 0x7fd2c414a980 2024-09-15T23:55:34.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.386+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2092822794 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2c406fcd0 con 0x7fd2a80678c0 2024-09-15T23:55:34.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.394+0000 7fd2ba7fc640 1 -- 172.21.15.112:0/2092822794 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247327 (secure 0 0 0) 0x7fd2c406fcd0 con 0x7fd2a80678c0 2024-09-15T23:55:34.403 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:34.405 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:55:34.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.398+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2092822794 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2a80678c0 msgr2=0x7fd2a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:34.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.398+0000 7fd2cbf1d640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2a80678c0 0x7fd2a8069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40512d0 tx=0x7fd2b4008040 comp rx=0 tx=0).stop 2024-09-15T23:55:34.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.398+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2092822794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2c414a980 msgr2=0x7fd2c4155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:34.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.398+0000 7fd2cbf1d640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2c414a980 0x7fd2c4155950 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd2c001f1c0 tx=0x7fd2b0005840 comp rx=0 tx=0).stop 2024-09-15T23:55:34.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.398+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2092822794 shutdown_connections 2024-09-15T23:55:34.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.398+0000 7fd2cbf1d640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2a80678c0 0x7fd2a8069d80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.398+0000 7fd2cbf1d640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2c414a050 0x7fd2c41e7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.398+0000 7fd2cbf1d640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2c414a980 0x7fd2c4155950 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.398+0000 7fd2cbf1d640 1 --2- 172.21.15.112:0/2092822794 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2b0004810 0x7fd2c41f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.398+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2092822794 >> 172.21.15.112:0/2092822794 conn(0x7fd2c40b1f90 msgr2=0x7fd2c415aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:34.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.398+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2092822794 shutdown_connections 2024-09-15T23:55:34.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:34.398+0000 7fd2cbf1d640 1 -- 172.21.15.112:0/2092822794 wait complete. 2024-09-15T23:55:34.420 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-15T23:55:33.264151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":169,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255168,"kb_used_data":5620,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719552,"statfs":{"total":773094113280,"available":772832821248,"internally_reserved":0,"allocated":5754880,"data_stored":3157418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.337882"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.951163+0000","last_change":"2024-09-15T23:55:28.951163+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.951163+0000","last_undegraded":"2024-09-15T23:55:28.951163+0000","last_fullsized":"2024-09-15T23:55:28.951163+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945077+0000","last_change":"2024-09-15T23:55:28.945077+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945077+0000","last_undegraded":"2024-09-15T23:55:28.945077+0000","last_fullsized":"2024-09-15T23:55:28.945077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.963825+0000","last_change":"2024-09-15T23:55:28.963825+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.963825+0000","last_undegraded":"2024-09-15T23:55:28.963825+0000","last_fullsized":"2024-09-15T23:55:28.963825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941093+0000","last_change":"2024-09-15T23:55:28.941093+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941093+0000","last_undegraded":"2024-09-15T23:55:28.941093+0000","last_fullsized":"2024-09-15T23:55:28.941093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945973+0000","last_change":"2024-09-15T23:55:28.945973+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945973+0000","last_undegraded":"2024-09-15T23:55:28.945973+0000","last_fullsized":"2024-09-15T23:55:28.945973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947588+0000","last_change":"2024-09-15T23:55:28.947588+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947588+0000","last_undegraded":"2024-09-15T23:55:28.947588+0000","last_fullsized":"2024-09-15T23:55:28.947588+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202852+0000","last_change":"2024-09-15T23:55:29.996060+0000","last_active":"2024-09-15T23:55:31.202852+0000","last_peered":"2024-09-15T23:55:31.202852+0000","last_clean":"2024-09-15T23:55:31.202852+0000","last_became_active":"2024-09-15T23:55:29.994668+0000","last_became_peered":"2024-09-15T23:55:29.994668+0000","last_unstale":"2024-09-15T23:55:31.202852+0000","last_undegraded":"2024-09-15T23:55:31.202852+0000","last_fullsized":"2024-09-15T23:55:31.202852+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:51.540608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.948541+0000","last_change":"2024-09-15T23:55:28.948541+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.948541+0000","last_undegraded":"2024-09-15T23:55:28.948541+0000","last_fullsized":"2024-09-15T23:55:28.948541+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.963117+0000","last_change":"2024-09-15T23:55:28.963117+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.963117+0000","last_undegraded":"2024-09-15T23:55:28.963117+0000","last_fullsized":"2024-09-15T23:55:28.963117+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204180+0000","last_change":"2024-09-15T23:55:29.995362+0000","last_active":"2024-09-15T23:55:31.204180+0000","last_peered":"2024-09-15T23:55:31.204180+0000","last_clean":"2024-09-15T23:55:31.204180+0000","last_became_active":"2024-09-15T23:55:29.994531+0000","last_became_peered":"2024-09-15T23:55:29.994531+0000","last_unstale":"2024-09-15T23:55:31.204180+0000","last_undegraded":"2024-09-15T23:55:31.204180+0000","last_fullsized":"2024-09-15T23:55:31.204180+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:49.797209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.955280+0000","last_change":"2024-09-15T23:55:28.955280+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.955280+0000","last_undegraded":"2024-09-15T23:55:28.955280+0000","last_fullsized":"2024-09-15T23:55:28.955280+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.948981+0000","last_change":"2024-09-15T23:55:28.948981+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.948981+0000","last_undegraded":"2024-09-15T23:55:28.948981+0000","last_fullsized":"2024-09-15T23:55:28.948981+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.954510+0000","last_change":"2024-09-15T23:55:28.954510+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.954510+0000","last_undegraded":"2024-09-15T23:55:28.954510+0000","last_fullsized":"2024-09-15T23:55:28.954510+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941785+0000","last_change":"2024-09-15T23:55:28.941785+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941785+0000","last_undegraded":"2024-09-15T23:55:28.941785+0000","last_fullsized":"2024-09-15T23:55:28.941785+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947263+0000","last_change":"2024-09-15T23:55:28.947263+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947263+0000","last_undegraded":"2024-09-15T23:55:28.947263+0000","last_fullsized":"2024-09-15T23:55:28.947263+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947219+0000","last_change":"2024-09-15T23:55:28.947219+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947219+0000","last_undegraded":"2024-09-15T23:55:28.947219+0000","last_fullsized":"2024-09-15T23:55:28.947219+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.947453+0000","last_change":"2024-09-15T23:55:28.947453+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.947453+0000","last_undegraded":"2024-09-15T23:55:28.947453+0000","last_fullsized":"2024-09-15T23:55:28.947453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944839+0000","last_change":"2024-09-15T23:55:28.944839+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944839+0000","last_undegraded":"2024-09-15T23:55:28.944839+0000","last_fullsized":"2024-09-15T23:55:28.944839+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.960658+0000","last_change":"2024-09-15T23:55:28.960658+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.960658+0000","last_undegraded":"2024-09-15T23:55:28.960658+0000","last_fullsized":"2024-09-15T23:55:28.960658+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.949787+0000","last_change":"2024-09-15T23:55:28.949787+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.949787+0000","last_undegraded":"2024-09-15T23:55:28.949787+0000","last_fullsized":"2024-09-15T23:55:28.949787+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945497+0000","last_change":"2024-09-15T23:55:28.945497+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945497+0000","last_undegraded":"2024-09-15T23:55:28.945497+0000","last_fullsized":"2024-09-15T23:55:28.945497+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.963741+0000","last_change":"2024-09-15T23:55:28.963741+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.963741+0000","last_undegraded":"2024-09-15T23:55:28.963741+0000","last_fullsized":"2024-09-15T23:55:28.963741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.961521+0000","last_change":"2024-09-15T23:55:28.961521+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.961521+0000","last_undegraded":"2024-09-15T23:55:28.961521+0000","last_fullsized":"2024-09-15T23:55:28.961521+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944916+0000","last_change":"2024-09-15T23:55:28.944916+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944916+0000","last_undegraded":"2024-09-15T23:55:28.944916+0000","last_fullsized":"2024-09-15T23:55:28.944916+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.950123+0000","last_change":"2024-09-15T23:55:28.950123+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.950123+0000","last_undegraded":"2024-09-15T23:55:28.950123+0000","last_fullsized":"2024-09-15T23:55:28.950123+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944169+0000","last_change":"2024-09-15T23:55:28.944169+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944169+0000","last_undegraded":"2024-09-15T23:55:28.944169+0000","last_fullsized":"2024-09-15T23:55:28.944169+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.949998+0000","last_change":"2024-09-15T23:55:28.949998+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.949998+0000","last_undegraded":"2024-09-15T23:55:28.949998+0000","last_fullsized":"2024-09-15T23:55:28.949998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.949258+0000","last_change":"2024-09-15T23:55:28.949258+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.949258+0000","last_undegraded":"2024-09-15T23:55:28.949258+0000","last_fullsized":"2024-09-15T23:55:28.949258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941664+0000","last_change":"2024-09-15T23:55:28.941664+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941664+0000","last_undegraded":"2024-09-15T23:55:28.941664+0000","last_fullsized":"2024-09-15T23:55:28.941664+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944537+0000","last_change":"2024-09-15T23:55:28.944537+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944537+0000","last_undegraded":"2024-09-15T23:55:28.944537+0000","last_fullsized":"2024-09-15T23:55:28.944537+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944365+0000","last_change":"2024-09-15T23:55:28.944365+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944365+0000","last_undegraded":"2024-09-15T23:55:28.944365+0000","last_fullsized":"2024-09-15T23:55:28.944365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944033+0000","last_change":"2024-09-15T23:55:28.944033+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944033+0000","last_undegraded":"2024-09-15T23:55:28.944033+0000","last_fullsized":"2024-09-15T23:55:28.944033+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941535+0000","last_change":"2024-09-15T23:55:28.941535+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941535+0000","last_undegraded":"2024-09-15T23:55:28.941535+0000","last_fullsized":"2024-09-15T23:55:28.941535+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.958904+0000","last_change":"2024-09-15T23:55:28.957377+0000","last_active":"2024-09-15T23:55:28.958904+0000","last_peered":"2024-09-15T23:55:28.958904+0000","last_clean":"2024-09-15T23:55:28.958904+0000","last_became_active":"2024-09-15T23:55:28.957003+0000","last_became_peered":"2024-09-15T23:55:28.957003+0000","last_unstale":"2024-09-15T23:55:28.958904+0000","last_undegraded":"2024-09-15T23:55:28.958904+0000","last_fullsized":"2024-09-15T23:55:28.958904+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:09.157194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.942430+0000","last_change":"2024-09-15T23:55:28.942430+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.942430+0000","last_undegraded":"2024-09-15T23:55:28.942430+0000","last_fullsized":"2024-09-15T23:55:28.942430+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.989408+0000","last_change":"2024-09-15T23:55:28.986205+0000","last_active":"2024-09-15T23:55:28.989408+0000","last_peered":"2024-09-15T23:55:28.989408+0000","last_clean":"2024-09-15T23:55:28.989408+0000","last_became_active":"2024-09-15T23:55:28.985668+0000","last_became_peered":"2024-09-15T23:55:28.985668+0000","last_unstale":"2024-09-15T23:55:28.989408+0000","last_undegraded":"2024-09-15T23:55:28.989408+0000","last_fullsized":"2024-09-15T23:55:28.989408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:41.506389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941837+0000","last_change":"2024-09-15T23:55:28.941837+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941837+0000","last_undegraded":"2024-09-15T23:55:28.941837+0000","last_fullsized":"2024-09-15T23:55:28.941837+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204016+0000","last_change":"2024-09-15T23:55:28.959282+0000","last_active":"2024-09-15T23:55:31.204016+0000","last_peered":"2024-09-15T23:55:31.204016+0000","last_clean":"2024-09-15T23:55:31.204016+0000","last_became_active":"2024-09-15T23:55:28.958275+0000","last_became_peered":"2024-09-15T23:55:28.958275+0000","last_unstale":"2024-09-15T23:55:31.204016+0000","last_undegraded":"2024-09-15T23:55:31.204016+0000","last_fullsized":"2024-09-15T23:55:31.204016+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:23.055214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203485+0000","last_change":"2024-09-15T23:55:30.003835+0000","last_active":"2024-09-15T23:55:31.203485+0000","last_peered":"2024-09-15T23:55:31.203485+0000","last_clean":"2024-09-15T23:55:31.203485+0000","last_became_active":"2024-09-15T23:55:29.996004+0000","last_became_peered":"2024-09-15T23:55:29.996004+0000","last_unstale":"2024-09-15T23:55:31.203485+0000","last_undegraded":"2024-09-15T23:55:31.203485+0000","last_fullsized":"2024-09-15T23:55:31.203485+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:41.875576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.982157+0000","last_change":"2024-09-15T23:55:28.981225+0000","last_active":"2024-09-15T23:55:28.982157+0000","last_peered":"2024-09-15T23:55:28.982157+0000","last_clean":"2024-09-15T23:55:28.982157+0000","last_became_active":"2024-09-15T23:55:28.980753+0000","last_became_peered":"2024-09-15T23:55:28.980753+0000","last_unstale":"2024-09-15T23:55:28.982157+0000","last_undegraded":"2024-09-15T23:55:28.982157+0000","last_fullsized":"2024-09-15T23:55:28.982157+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:11.717951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.942742+0000","last_change":"2024-09-15T23:55:28.942742+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.942742+0000","last_undegraded":"2024-09-15T23:55:28.942742+0000","last_fullsized":"2024-09-15T23:55:28.942742+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.984354+0000","last_change":"2024-09-15T23:55:28.979920+0000","last_active":"2024-09-15T23:55:28.984354+0000","last_peered":"2024-09-15T23:55:28.984354+0000","last_clean":"2024-09-15T23:55:28.984354+0000","last_became_active":"2024-09-15T23:55:28.979269+0000","last_became_peered":"2024-09-15T23:55:28.979269+0000","last_unstale":"2024-09-15T23:55:28.984354+0000","last_undegraded":"2024-09-15T23:55:28.984354+0000","last_fullsized":"2024-09-15T23:55:28.984354+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:50:55.241898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943536+0000","last_change":"2024-09-15T23:55:28.943536+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943536+0000","last_undegraded":"2024-09-15T23:55:28.943536+0000","last_fullsized":"2024-09-15T23:55:28.943536+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.954499+0000","last_change":"2024-09-15T23:55:28.952417+0000","last_active":"2024-09-15T23:55:28.954499+0000","last_peered":"2024-09-15T23:55:28.954499+0000","last_clean":"2024-09-15T23:55:28.954499+0000","last_became_active":"2024-09-15T23:55:28.952107+0000","last_became_peered":"2024-09-15T23:55:28.952107+0000","last_unstale":"2024-09-15T23:55:28.954499+0000","last_undegraded":"2024-09-15T23:55:28.954499+0000","last_fullsized":"2024-09-15T23:55:28.954499+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:30.373849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204307+0000","last_change":"2024-09-15T23:55:30.002606+0000","last_active":"2024-09-15T23:55:31.204307+0000","last_peered":"2024-09-15T23:55:31.204307+0000","last_clean":"2024-09-15T23:55:31.204307+0000","last_became_active":"2024-09-15T23:55:29.996213+0000","last_became_peered":"2024-09-15T23:55:29.996213+0000","last_unstale":"2024-09-15T23:55:31.204307+0000","last_undegraded":"2024-09-15T23:55:31.204307+0000","last_fullsized":"2024-09-15T23:55:31.204307+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:08.573598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.959010+0000","last_change":"2024-09-15T23:55:28.958153+0000","last_active":"2024-09-15T23:55:28.959010+0000","last_peered":"2024-09-15T23:55:28.959010+0000","last_clean":"2024-09-15T23:55:28.959010+0000","last_became_active":"2024-09-15T23:55:28.957814+0000","last_became_peered":"2024-09-15T23:55:28.957814+0000","last_unstale":"2024-09-15T23:55:28.959010+0000","last_undegraded":"2024-09-15T23:55:28.959010+0000","last_fullsized":"2024-09-15T23:55:28.959010+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:17.799300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941602+0000","last_change":"2024-09-15T23:55:28.941602+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941602+0000","last_undegraded":"2024-09-15T23:55:28.941602+0000","last_fullsized":"2024-09-15T23:55:28.941602+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.980671+0000","last_change":"2024-09-15T23:55:28.969352+0000","last_active":"2024-09-15T23:55:28.980671+0000","last_peered":"2024-09-15T23:55:28.980671+0000","last_clean":"2024-09-15T23:55:28.980671+0000","last_became_active":"2024-09-15T23:55:28.968629+0000","last_became_peered":"2024-09-15T23:55:28.968629+0000","last_unstale":"2024-09-15T23:55:28.980671+0000","last_undegraded":"2024-09-15T23:55:28.980671+0000","last_fullsized":"2024-09-15T23:55:28.980671+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:30.705727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943160+0000","last_change":"2024-09-15T23:55:28.943160+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943160+0000","last_undegraded":"2024-09-15T23:55:28.943160+0000","last_fullsized":"2024-09-15T23:55:28.943160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.951237+0000","last_change":"2024-09-15T23:55:28.950095+0000","last_active":"2024-09-15T23:55:28.951237+0000","last_peered":"2024-09-15T23:55:28.951237+0000","last_clean":"2024-09-15T23:55:28.951237+0000","last_became_active":"2024-09-15T23:55:28.949824+0000","last_became_peered":"2024-09-15T23:55:28.949824+0000","last_unstale":"2024-09-15T23:55:28.951237+0000","last_undegraded":"2024-09-15T23:55:28.951237+0000","last_fullsized":"2024-09-15T23:55:28.951237+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:42.163168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941913+0000","last_change":"2024-09-15T23:55:28.941913+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941913+0000","last_undegraded":"2024-09-15T23:55:28.941913+0000","last_fullsized":"2024-09-15T23:55:28.941913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.979067+0000","last_change":"2024-09-15T23:55:28.978340+0000","last_active":"2024-09-15T23:55:28.979067+0000","last_peered":"2024-09-15T23:55:28.979067+0000","last_clean":"2024-09-15T23:55:28.979067+0000","last_became_active":"2024-09-15T23:55:28.978016+0000","last_became_peered":"2024-09-15T23:55:28.978016+0000","last_unstale":"2024-09-15T23:55:28.979067+0000","last_undegraded":"2024-09-15T23:55:28.979067+0000","last_fullsized":"2024-09-15T23:55:28.979067+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:40.177912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.940712+0000","last_change":"2024-09-15T23:55:28.940712+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.940712+0000","last_undegraded":"2024-09-15T23:55:28.940712+0000","last_fullsized":"2024-09-15T23:55:28.940712+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.961607+0000","last_change":"2024-09-15T23:55:28.960875+0000","last_active":"2024-09-15T23:55:28.961607+0000","last_peered":"2024-09-15T23:55:28.961607+0000","last_clean":"2024-09-15T23:55:28.961607+0000","last_became_active":"2024-09-15T23:55:28.960593+0000","last_became_peered":"2024-09-15T23:55:28.960593+0000","last_unstale":"2024-09-15T23:55:28.961607+0000","last_undegraded":"2024-09-15T23:55:28.961607+0000","last_fullsized":"2024-09-15T23:55:28.961607+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:47.992194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.946361+0000","last_change":"2024-09-15T23:55:28.946361+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.946361+0000","last_undegraded":"2024-09-15T23:55:28.946361+0000","last_fullsized":"2024-09-15T23:55:28.946361+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203755+0000","last_change":"2024-09-15T23:55:28.984808+0000","last_active":"2024-09-15T23:55:31.203755+0000","last_peered":"2024-09-15T23:55:31.203755+0000","last_clean":"2024-09-15T23:55:31.203755+0000","last_became_active":"2024-09-15T23:55:28.984131+0000","last_became_peered":"2024-09-15T23:55:28.984131+0000","last_unstale":"2024-09-15T23:55:31.203755+0000","last_undegraded":"2024-09-15T23:55:31.203755+0000","last_fullsized":"2024-09-15T23:55:31.203755+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:56.457774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944290+0000","last_change":"2024-09-15T23:55:28.944290+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944290+0000","last_undegraded":"2024-09-15T23:55:28.944290+0000","last_fullsized":"2024-09-15T23:55:28.944290+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.985001+0000","last_change":"2024-09-15T23:55:28.977045+0000","last_active":"2024-09-15T23:55:28.985001+0000","last_peered":"2024-09-15T23:55:28.985001+0000","last_clean":"2024-09-15T23:55:28.985001+0000","last_became_active":"2024-09-15T23:55:28.976372+0000","last_became_peered":"2024-09-15T23:55:28.976372+0000","last_unstale":"2024-09-15T23:55:28.985001+0000","last_undegraded":"2024-09-15T23:55:28.985001+0000","last_fullsized":"2024-09-15T23:55:28.985001+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:46.331031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943480+0000","last_change":"2024-09-15T23:55:28.943480+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943480+0000","last_undegraded":"2024-09-15T23:55:28.943480+0000","last_fullsized":"2024-09-15T23:55:28.943480+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.960937+0000","last_change":"2024-09-15T23:55:28.960226+0000","last_active":"2024-09-15T23:55:28.960937+0000","last_peered":"2024-09-15T23:55:28.960937+0000","last_clean":"2024-09-15T23:55:28.960937+0000","last_became_active":"2024-09-15T23:55:28.960000+0000","last_became_peered":"2024-09-15T23:55:28.960000+0000","last_unstale":"2024-09-15T23:55:28.960937+0000","last_undegraded":"2024-09-15T23:55:28.960937+0000","last_fullsized":"2024-09-15T23:55:28.960937+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:07.288904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.958518+0000","last_change":"2024-09-15T23:55:28.958518+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.958518+0000","last_undegraded":"2024-09-15T23:55:28.958518+0000","last_fullsized":"2024-09-15T23:55:28.958518+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.955458+0000","last_change":"2024-09-15T23:55:28.953752+0000","last_active":"2024-09-15T23:55:28.955458+0000","last_peered":"2024-09-15T23:55:28.955458+0000","last_clean":"2024-09-15T23:55:28.955458+0000","last_became_active":"2024-09-15T23:55:28.953477+0000","last_became_peered":"2024-09-15T23:55:28.953477+0000","last_unstale":"2024-09-15T23:55:28.955458+0000","last_undegraded":"2024-09-15T23:55:28.955458+0000","last_fullsized":"2024-09-15T23:55:28.955458+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:07.288904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.961961+0000","last_change":"2024-09-15T23:55:28.961961+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.961961+0000","last_undegraded":"2024-09-15T23:55:28.961961+0000","last_fullsized":"2024-09-15T23:55:28.961961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.984490+0000","last_change":"2024-09-15T23:55:28.982518+0000","last_active":"2024-09-15T23:55:28.984490+0000","last_peered":"2024-09-15T23:55:28.984490+0000","last_clean":"2024-09-15T23:55:28.984490+0000","last_became_active":"2024-09-15T23:55:28.981852+0000","last_became_peered":"2024-09-15T23:55:28.981852+0000","last_unstale":"2024-09-15T23:55:28.984490+0000","last_undegraded":"2024-09-15T23:55:28.984490+0000","last_fullsized":"2024-09-15T23:55:28.984490+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:17.276493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202224+0000","last_change":"2024-09-15T23:55:29.970464+0000","last_active":"2024-09-15T23:55:31.202224+0000","last_peered":"2024-09-15T23:55:31.202224+0000","last_clean":"2024-09-15T23:55:31.202224+0000","last_became_active":"2024-09-15T23:55:29.969600+0000","last_became_peered":"2024-09-15T23:55:29.969600+0000","last_unstale":"2024-09-15T23:55:31.202224+0000","last_undegraded":"2024-09-15T23:55:31.202224+0000","last_fullsized":"2024-09-15T23:55:31.202224+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:26.661560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.990271+0000","last_change":"2024-09-15T23:55:28.987736+0000","last_active":"2024-09-15T23:55:28.990271+0000","last_peered":"2024-09-15T23:55:28.990271+0000","last_clean":"2024-09-15T23:55:28.990271+0000","last_became_active":"2024-09-15T23:55:28.986972+0000","last_became_peered":"2024-09-15T23:55:28.986972+0000","last_unstale":"2024-09-15T23:55:28.990271+0000","last_undegraded":"2024-09-15T23:55:28.990271+0000","last_fullsized":"2024-09-15T23:55:28.990271+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:36.040443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945025+0000","last_change":"2024-09-15T23:55:28.945025+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945025+0000","last_undegraded":"2024-09-15T23:55:28.945025+0000","last_fullsized":"2024-09-15T23:55:28.945025+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.986691+0000","last_change":"2024-09-15T23:55:28.978148+0000","last_active":"2024-09-15T23:55:28.986691+0000","last_peered":"2024-09-15T23:55:28.986691+0000","last_clean":"2024-09-15T23:55:28.986691+0000","last_became_active":"2024-09-15T23:55:28.977563+0000","last_became_peered":"2024-09-15T23:55:28.977563+0000","last_unstale":"2024-09-15T23:55:28.986691+0000","last_undegraded":"2024-09-15T23:55:28.986691+0000","last_fullsized":"2024-09-15T23:55:28.986691+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:50.867342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.950442+0000","last_change":"2024-09-15T23:55:28.950442+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.950442+0000","last_undegraded":"2024-09-15T23:55:28.950442+0000","last_fullsized":"2024-09-15T23:55:28.950442+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.981932+0000","last_change":"2024-09-15T23:55:28.981019+0000","last_active":"2024-09-15T23:55:28.981932+0000","last_peered":"2024-09-15T23:55:28.981932+0000","last_clean":"2024-09-15T23:55:28.981932+0000","last_became_active":"2024-09-15T23:55:28.980736+0000","last_became_peered":"2024-09-15T23:55:28.980736+0000","last_unstale":"2024-09-15T23:55:28.981932+0000","last_undegraded":"2024-09-15T23:55:28.981932+0000","last_fullsized":"2024-09-15T23:55:28.981932+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:11.717951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.955567+0000","last_change":"2024-09-15T23:55:28.955567+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.955567+0000","last_undegraded":"2024-09-15T23:55:28.955567+0000","last_fullsized":"2024-09-15T23:55:28.955567+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.966572+0000","last_change":"2024-09-15T23:55:28.965885+0000","last_active":"2024-09-15T23:55:28.966572+0000","last_peered":"2024-09-15T23:55:28.966572+0000","last_clean":"2024-09-15T23:55:28.966572+0000","last_became_active":"2024-09-15T23:55:28.965531+0000","last_became_peered":"2024-09-15T23:55:28.965531+0000","last_unstale":"2024-09-15T23:55:28.966572+0000","last_undegraded":"2024-09-15T23:55:28.966572+0000","last_fullsized":"2024-09-15T23:55:28.966572+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:40.177912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.948793+0000","last_change":"2024-09-15T23:55:28.948793+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.948793+0000","last_undegraded":"2024-09-15T23:55:28.948793+0000","last_fullsized":"2024-09-15T23:55:28.948793+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.965793+0000","last_change":"2024-09-15T23:55:28.960054+0000","last_active":"2024-09-15T23:55:28.965793+0000","last_peered":"2024-09-15T23:55:28.965793+0000","last_clean":"2024-09-15T23:55:28.965793+0000","last_became_active":"2024-09-15T23:55:28.959315+0000","last_became_peered":"2024-09-15T23:55:28.959315+0000","last_unstale":"2024-09-15T23:55:28.965793+0000","last_undegraded":"2024-09-15T23:55:28.965793+0000","last_fullsized":"2024-09-15T23:55:28.965793+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:35.216646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945269+0000","last_change":"2024-09-15T23:55:28.945269+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945269+0000","last_undegraded":"2024-09-15T23:55:28.945269+0000","last_fullsized":"2024-09-15T23:55:28.945269+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.989629+0000","last_change":"2024-09-15T23:55:28.983747+0000","last_active":"2024-09-15T23:55:28.989629+0000","last_peered":"2024-09-15T23:55:28.989629+0000","last_clean":"2024-09-15T23:55:28.989629+0000","last_became_active":"2024-09-15T23:55:28.982268+0000","last_became_peered":"2024-09-15T23:55:28.982268+0000","last_unstale":"2024-09-15T23:55:28.989629+0000","last_undegraded":"2024-09-15T23:55:28.989629+0000","last_fullsized":"2024-09-15T23:55:28.989629+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:54.333221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.953256+0000","last_change":"2024-09-15T23:55:28.953256+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.953256+0000","last_undegraded":"2024-09-15T23:55:28.953256+0000","last_fullsized":"2024-09-15T23:55:28.953256+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203129+0000","last_change":"2024-09-15T23:55:28.984174+0000","last_active":"2024-09-15T23:55:31.203129+0000","last_peered":"2024-09-15T23:55:31.203129+0000","last_clean":"2024-09-15T23:55:31.203129+0000","last_became_active":"2024-09-15T23:55:28.983467+0000","last_became_peered":"2024-09-15T23:55:28.983467+0000","last_unstale":"2024-09-15T23:55:31.203129+0000","last_undegraded":"2024-09-15T23:55:31.203129+0000","last_fullsized":"2024-09-15T23:55:31.203129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:24.174820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.950986+0000","last_change":"2024-09-15T23:55:28.950986+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.950986+0000","last_undegraded":"2024-09-15T23:55:28.950986+0000","last_fullsized":"2024-09-15T23:55:28.950986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202605+0000","last_change":"2024-09-15T23:55:28.966139+0000","last_active":"2024-09-15T23:55:31.202605+0000","last_peered":"2024-09-15T23:55:31.202605+0000","last_clean":"2024-09-15T23:55:31.202605+0000","last_became_active":"2024-09-15T23:55:28.965422+0000","last_became_peered":"2024-09-15T23:55:28.965422+0000","last_unstale":"2024-09-15T23:55:31.202605+0000","last_undegraded":"2024-09-15T23:55:31.202605+0000","last_fullsized":"2024-09-15T23:55:31.202605+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:41.328089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.941231+0000","last_change":"2024-09-15T23:55:28.941231+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.941231+0000","last_undegraded":"2024-09-15T23:55:28.941231+0000","last_fullsized":"2024-09-15T23:55:28.941231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.959212+0000","last_change":"2024-09-15T23:55:28.958308+0000","last_active":"2024-09-15T23:55:28.959212+0000","last_peered":"2024-09-15T23:55:28.959212+0000","last_clean":"2024-09-15T23:55:28.959212+0000","last_became_active":"2024-09-15T23:55:28.957929+0000","last_became_peered":"2024-09-15T23:55:28.957929+0000","last_unstale":"2024-09-15T23:55:28.959212+0000","last_undegraded":"2024-09-15T23:55:28.959212+0000","last_fullsized":"2024-09-15T23:55:28.959212+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:35.158272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203329+0000","last_change":"2024-09-15T23:55:30.003355+0000","last_active":"2024-09-15T23:55:31.203329+0000","last_peered":"2024-09-15T23:55:31.203329+0000","last_clean":"2024-09-15T23:55:31.203329+0000","last_became_active":"2024-09-15T23:55:30.002742+0000","last_became_peered":"2024-09-15T23:55:30.002742+0000","last_unstale":"2024-09-15T23:55:31.203329+0000","last_undegraded":"2024-09-15T23:55:31.203329+0000","last_fullsized":"2024-09-15T23:55:31.203329+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:15.549461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.961631+0000","last_change":"2024-09-15T23:55:28.960962+0000","last_active":"2024-09-15T23:55:28.961631+0000","last_peered":"2024-09-15T23:55:28.961631+0000","last_clean":"2024-09-15T23:55:28.961631+0000","last_became_active":"2024-09-15T23:55:28.960579+0000","last_became_peered":"2024-09-15T23:55:28.960579+0000","last_unstale":"2024-09-15T23:55:28.961631+0000","last_undegraded":"2024-09-15T23:55:28.961631+0000","last_fullsized":"2024-09-15T23:55:28.961631+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:38.909033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.945032+0000","last_change":"2024-09-15T23:55:28.945032+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.945032+0000","last_undegraded":"2024-09-15T23:55:28.945032+0000","last_fullsized":"2024-09-15T23:55:28.945032+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.985249+0000","last_change":"2024-09-15T23:55:28.980090+0000","last_active":"2024-09-15T23:55:28.985249+0000","last_peered":"2024-09-15T23:55:28.985249+0000","last_clean":"2024-09-15T23:55:28.985249+0000","last_became_active":"2024-09-15T23:55:28.978880+0000","last_became_peered":"2024-09-15T23:55:28.978880+0000","last_unstale":"2024-09-15T23:55:28.985249+0000","last_undegraded":"2024-09-15T23:55:28.985249+0000","last_fullsized":"2024-09-15T23:55:28.985249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:00.563529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203872+0000","last_change":"2024-09-15T23:55:30.002867+0000","last_active":"2024-09-15T23:55:31.203872+0000","last_peered":"2024-09-15T23:55:31.203872+0000","last_clean":"2024-09-15T23:55:31.203872+0000","last_became_active":"2024-09-15T23:55:29.993861+0000","last_became_peered":"2024-09-15T23:55:29.993861+0000","last_unstale":"2024-09-15T23:55:31.203872+0000","last_undegraded":"2024-09-15T23:55:31.203872+0000","last_fullsized":"2024-09-15T23:55:31.203872+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:37.828534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203711+0000","last_change":"2024-09-15T23:55:28.959925+0000","last_active":"2024-09-15T23:55:31.203711+0000","last_peered":"2024-09-15T23:55:31.203711+0000","last_clean":"2024-09-15T23:55:31.203711+0000","last_became_active":"2024-09-15T23:55:28.958452+0000","last_became_peered":"2024-09-15T23:55:28.958452+0000","last_unstale":"2024-09-15T23:55:31.203711+0000","last_undegraded":"2024-09-15T23:55:31.203711+0000","last_fullsized":"2024-09-15T23:55:31.203711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:50.451580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.944543+0000","last_change":"2024-09-15T23:55:28.944543+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.944543+0000","last_undegraded":"2024-09-15T23:55:28.944543+0000","last_fullsized":"2024-09-15T23:55:28.944543+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.989573+0000","last_change":"2024-09-15T23:55:28.983121+0000","last_active":"2024-09-15T23:55:28.989573+0000","last_peered":"2024-09-15T23:55:28.989573+0000","last_clean":"2024-09-15T23:55:28.989573+0000","last_became_active":"2024-09-15T23:55:28.981404+0000","last_became_peered":"2024-09-15T23:55:28.981404+0000","last_unstale":"2024-09-15T23:55:28.989573+0000","last_undegraded":"2024-09-15T23:55:28.989573+0000","last_fullsized":"2024-09-15T23:55:28.989573+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:14.512897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204388+0000","last_change":"2024-09-15T23:55:29.994344+0000","last_active":"2024-09-15T23:55:31.204388+0000","last_peered":"2024-09-15T23:55:31.204388+0000","last_clean":"2024-09-15T23:55:31.204388+0000","last_became_active":"2024-09-15T23:55:29.989134+0000","last_became_peered":"2024-09-15T23:55:29.989134+0000","last_unstale":"2024-09-15T23:55:31.204388+0000","last_undegraded":"2024-09-15T23:55:31.204388+0000","last_fullsized":"2024-09-15T23:55:31.204388+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:08.439772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.958521+0000","last_change":"2024-09-15T23:55:28.956432+0000","last_active":"2024-09-15T23:55:28.958521+0000","last_peered":"2024-09-15T23:55:28.958521+0000","last_clean":"2024-09-15T23:55:28.958521+0000","last_became_active":"2024-09-15T23:55:28.956054+0000","last_became_peered":"2024-09-15T23:55:28.956054+0000","last_unstale":"2024-09-15T23:55:28.958521+0000","last_undegraded":"2024-09-15T23:55:28.958521+0000","last_fullsized":"2024-09-15T23:55:28.958521+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:44.566526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.952040+0000","last_change":"2024-09-15T23:55:28.952040+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.952040+0000","last_undegraded":"2024-09-15T23:55:28.952040+0000","last_fullsized":"2024-09-15T23:55:28.952040+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.961166+0000","last_change":"2024-09-15T23:55:28.960457+0000","last_active":"2024-09-15T23:55:28.961166+0000","last_peered":"2024-09-15T23:55:28.961166+0000","last_clean":"2024-09-15T23:55:28.961166+0000","last_became_active":"2024-09-15T23:55:28.960080+0000","last_became_peered":"2024-09-15T23:55:28.960080+0000","last_unstale":"2024-09-15T23:55:28.961166+0000","last_undegraded":"2024-09-15T23:55:28.961166+0000","last_fullsized":"2024-09-15T23:55:28.961166+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:44.566526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-15T23:55:28.943015+0000","last_change":"2024-09-15T23:55:28.943015+0000","last_active":"2024-09-15T23:55:28.924235+0000","last_peered":"2024-09-15T23:55:28.924235+0000","last_clean":"2024-09-15T23:55:28.924235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:28.943015+0000","last_undegraded":"2024-09-15T23:55:28.943015+0000","last_fullsized":"2024-09-15T23:55:28.943015+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204582+0000","last_change":"2024-09-15T23:55:28.977178+0000","last_active":"2024-09-15T23:55:31.204582+0000","last_peered":"2024-09-15T23:55:31.204582+0000","last_clean":"2024-09-15T23:55:31.204582+0000","last_became_active":"2024-09-15T23:55:28.975684+0000","last_became_peered":"2024-09-15T23:55:28.975684+0000","last_unstale":"2024-09-15T23:55:31.204582+0000","last_undegraded":"2024-09-15T23:55:31.204582+0000","last_fullsized":"2024-09-15T23:55:31.204582+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:51.522143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-15T23:55:28.941473+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:55:28.941473+0000","last_peered":"2024-09-15T23:55:28.941473+0000","last_clean":"2024-09-15T23:55:28.941473+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:55:28.941473+0000","last_undegraded":"2024-09-15T23:55:28.941473+0000","last_fullsized":"2024-09-15T23:55:28.941473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":573440,"data_stored":249307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":573440,"data_stored":249307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1155072,"data_stored":833008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":561152,"data_stored":242640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1208320,"data_stored":855236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:55:35.918 INFO:tasks.ceph.mds.c.smithi112.stderr:2024-09-15T23:55:35.910+0000 7f169d4c9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:55:37.425 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:55:37.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f12722f0640 1 Processor -- start 2024-09-15T23:55:37.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f12722f0640 1 -- start start 2024-09-15T23:55:37.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f12722f0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126c070020 0x7f126c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f12722f0640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126c0aede0 con 0x7f126c15f1d0 2024-09-15T23:55:37.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f12722f0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126c15fa10 con 0x7f126c1520a0 2024-09-15T23:55:37.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f12722f0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f126c152480 con 0x7f126c070020 2024-09-15T23:55:37.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f127088d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f126c15f1d0 0x7f126c0adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41872/0 (socket says 172.21.15.112:41872) 2024-09-15T23:55:37.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f127088d640 1 -- 172.21.15.112:0/4244431971 learned_addr learned my addr 172.21.15.112:0/4244431971 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:37.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126b7fe640 1 --2- 172.21.15.112:0/4244431971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126c070020 0x7f126c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2419713594 0 0) 0x7f126c0aede0 con 0x7f126c15f1d0 2024-09-15T23:55:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1258005740 con 0x7f126c15f1d0 2024-09-15T23:55:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2231459242 0 0) 0x7f126c15fa10 con 0x7f126c1520a0 2024-09-15T23:55:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f126c0aede0 con 0x7f126c1520a0 2024-09-15T23:55:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2141451981 0 0) 0x7f1258005740 con 0x7f126c15f1d0 2024-09-15T23:55:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126c070020 msgr2=0x7f126c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 --2- 172.21.15.112:0/4244431971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126c070020 0x7f126c15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 >> v1:172.21.15.169:6789/0 conn(0x7f126c1520a0 legacy=0x7f126c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c074250 con 0x7f126c15f1d0 2024-09-15T23:55:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f125c001a00 con 0x7f126c15f1d0 2024-09-15T23:55:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126b7fe640 1 --2- 172.21.15.112:0/4244431971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126c070020 0x7f126c15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:55:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 >> v1:172.21.15.112:6789/0 conn(0x7f126c15f1d0 legacy=0x7f126c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 --2- 172.21.15.112:0/4244431971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1258005d90 0x7f1258006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 --2- 172.21.15.112:0/4244431971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1258006a20 0x7f1258006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 --2- 172.21.15.112:0/4244431971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12580073e0 0x7f125800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f125800e1d0 con 0x7f1258006a20 2024-09-15T23:55:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f125800e350 con 0x7f12580073e0 2024-09-15T23:55:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f125800e550 con 0x7f1258005d90 2024-09-15T23:55:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126b7fe640 1 --2- 172.21.15.112:0/4244431971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1258006a20 0x7f1258006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126bfff640 1 --2- 172.21.15.112:0/4244431971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1258005d90 0x7f1258006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126b7fe640 1 -- 172.21.15.112:0/4244431971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1258005d90 msgr2=0x7f1258006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126b7fe640 1 --2- 172.21.15.112:0/4244431971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1258005d90 0x7f1258006190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126b7fe640 1 -- 172.21.15.112:0/4244431971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12580073e0 msgr2=0x7f125800dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f127088d640 1 --2- 172.21.15.112:0/4244431971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12580073e0 0x7f125800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126b7fe640 1 --2- 172.21.15.112:0/4244431971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12580073e0 0x7f125800dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126b7fe640 1 -- 172.21.15.112:0/4244431971 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1258005740 con 0x7f1258006a20 2024-09-15T23:55:37.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.550+0000 7f126bfff640 1 --2- 172.21.15.112:0/4244431971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1258005d90 0x7f1258006190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.554+0000 7f126b7fe640 1 --2- 172.21.15.112:0/4244431971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1258006a20 0x7f1258006ea0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f126c071880 tx=0x7f125401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3697adf4e5dd631e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.554+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1254009810 con 0x7f1258006a20 2024-09-15T23:55:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.554+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1254004030 con 0x7f1258006a20 2024-09-15T23:55:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.554+0000 7f126affd640 1 -- 172.21.15.112:0/4244431971 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540043e0 con 0x7f1258006a20 2024-09-15T23:55:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.554+0000 7f12722f0640 1 -- 172.21.15.112:0/4244431971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1258006a20 msgr2=0x7f1258006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.554+0000 7f12722f0640 1 --2- 172.21.15.112:0/4244431971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1258006a20 0x7f1258006ea0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f126c071880 tx=0x7f125401cab0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.554+0000 7f127088d640 1 -- 172.21.15.112:0/4244431971 reap_dead start 2024-09-15T23:55:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.554+0000 7f12722f0640 1 -- 172.21.15.112:0/4244431971 shutdown_connections 2024-09-15T23:55:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.554+0000 7f12722f0640 1 -- 172.21.15.112:0/4244431971 >> 172.21.15.112:0/4244431971 conn(0x7f126c0b1f90 msgr2=0x7f126c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.554+0000 7f12722f0640 1 -- 172.21.15.112:0/4244431971 shutdown_connections 2024-09-15T23:55:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.554+0000 7f12722f0640 1 -- 172.21.15.112:0/4244431971 wait complete. 2024-09-15T23:55:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.554+0000 7f12722f0640 1 Processor -- start 2024-09-15T23:55:37.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.554+0000 7f12722f0640 1 -- start start 2024-09-15T23:55:37.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f12722f0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1258006a20 0x7f126c148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f12722f0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126c14a2d0 0x7f126c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f12722f0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126c0cf4e0 0x7f126c0721a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f12722f0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f126c073a50 con 0x7f1258006a20 2024-09-15T23:55:37.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f12722f0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f126c073770 con 0x7f126c0cf4e0 2024-09-15T23:55:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f12722f0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f126c073d30 con 0x7f126c14a2d0 2024-09-15T23:55:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f126bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1258006a20 0x7f126c148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f126bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1258006a20 0x7f126c148e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41272/0 (socket says 172.21.15.112:41272) 2024-09-15T23:55:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f126bfff640 1 -- 172.21.15.112:0/3097722402 learned_addr learned my addr 172.21.15.112:0/3097722402 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f127088d640 1 --2- 172.21.15.112:0/3097722402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126c0cf4e0 0x7f126c0721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f126b7fe640 1 --2- 172.21.15.112:0/3097722402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126c14a2d0 0x7f126c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f126bfff640 1 -- 172.21.15.112:0/3097722402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126c14a2d0 msgr2=0x7f126c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f126bfff640 1 --2- 172.21.15.112:0/3097722402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126c14a2d0 0x7f126c0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f126bfff640 1 -- 172.21.15.112:0/3097722402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126c0cf4e0 msgr2=0x7f126c0721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f126bfff640 1 --2- 172.21.15.112:0/3097722402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126c0cf4e0 0x7f126c0721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f126bfff640 1 -- 172.21.15.112:0/3097722402 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c149360 con 0x7f1258006a20 2024-09-15T23:55:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f126bfff640 1 --2- 172.21.15.112:0/3097722402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1258006a20 0x7f126c148e20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f126400f970 tx=0x7f126400fe30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f1268ff9640 1 -- 172.21.15.112:0/3097722402 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126400d990 con 0x7f1258006a20 2024-09-15T23:55:37.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f1268ff9640 1 -- 172.21.15.112:0/3097722402 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126400db30 con 0x7f1258006a20 2024-09-15T23:55:37.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f12722f0640 1 -- 172.21.15.112:0/3097722402 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126c0cfb10 con 0x7f1258006a20 2024-09-15T23:55:37.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f1268ff9640 1 -- 172.21.15.112:0/3097722402 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12640067e0 con 0x7f1258006a20 2024-09-15T23:55:37.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f12722f0640 1 -- 172.21.15.112:0/3097722402 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f126c15b900 con 0x7f1258006a20 2024-09-15T23:55:37.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f12722f0640 1 -- 172.21.15.112:0/3097722402 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f126c15f680 con 0x7f1258006a20 2024-09-15T23:55:37.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f1268ff9640 1 -- 172.21.15.112:0/3097722402 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1264006980 con 0x7f1258006a20 2024-09-15T23:55:37.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f1268ff9640 1 --2- 172.21.15.112:0/3097722402 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f124c0678f0 0x7f124c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f1268ff9640 1 -- 172.21.15.112:0/3097722402 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f1264088fd0 con 0x7f1258006a20 2024-09-15T23:55:37.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f126b7fe640 1 --2- 172.21.15.112:0/3097722402 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f124c0678f0 0x7f124c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.558+0000 7f126b7fe640 1 --2- 172.21.15.112:0/3097722402 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f124c0678f0 0x7f124c069db0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f12540ad000 tx=0x7f12540046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:37.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.562+0000 7f1268ff9640 1 -- 172.21.15.112:0/3097722402 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1264018020 con 0x7f1258006a20 2024-09-15T23:55:37.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.718+0000 7f12722f0640 1 -- 172.21.15.112:0/3097722402 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f126c0af8c0 con 0x7f124c0678f0 2024-09-15T23:55:37.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.722+0000 7f1268ff9640 1 -- 172.21.15.112:0/3097722402 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251958 (secure 0 0 0) 0x7f126c0af8c0 con 0x7f124c0678f0 2024-09-15T23:55:37.733 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:37.734 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:55:37.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.730+0000 7f12722f0640 1 -- 172.21.15.112:0/3097722402 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f124c0678f0 msgr2=0x7f124c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.730+0000 7f12722f0640 1 --2- 172.21.15.112:0/3097722402 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f124c0678f0 0x7f124c069db0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f12540ad000 tx=0x7f12540046d0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.730+0000 7f12722f0640 1 -- 172.21.15.112:0/3097722402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1258006a20 msgr2=0x7f126c148e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.730+0000 7f12722f0640 1 --2- 172.21.15.112:0/3097722402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1258006a20 0x7f126c148e20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f126400f970 tx=0x7f126400fe30 comp rx=0 tx=0).stop 2024-09-15T23:55:37.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.730+0000 7f12722f0640 1 -- 172.21.15.112:0/3097722402 shutdown_connections 2024-09-15T23:55:37.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.730+0000 7f12722f0640 1 --2- 172.21.15.112:0/3097722402 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f124c0678f0 0x7f124c069db0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.730+0000 7f12722f0640 1 --2- 172.21.15.112:0/3097722402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126c0cf4e0 0x7f126c0721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.730+0000 7f12722f0640 1 --2- 172.21.15.112:0/3097722402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126c14a2d0 0x7f126c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.730+0000 7f12722f0640 1 --2- 172.21.15.112:0/3097722402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1258006a20 0x7f126c148e20 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.730+0000 7f12722f0640 1 -- 172.21.15.112:0/3097722402 >> 172.21.15.112:0/3097722402 conn(0x7f126c0b1f90 msgr2=0x7f126c150540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:37.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.730+0000 7f12722f0640 1 -- 172.21.15.112:0/3097722402 shutdown_connections 2024-09-15T23:55:37.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.730+0000 7f12722f0640 1 -- 172.21.15.112:0/3097722402 wait complete. 2024-09-15T23:55:37.750 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-09-15T23:55:37.265734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255456,"kb_used_data":5896,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719264,"statfs":{"total":773094113280,"available":772832526336,"internally_reserved":0,"allocated":6037504,"data_stored":3290884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002694"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.963764+0000","last_change":"2024-09-15T23:55:29.959025+0000","last_active":"2024-09-15T23:55:30.963764+0000","last_peered":"2024-09-15T23:55:30.963764+0000","last_clean":"2024-09-15T23:55:30.963764+0000","last_became_active":"2024-09-15T23:55:29.957733+0000","last_became_peered":"2024-09-15T23:55:29.957733+0000","last_unstale":"2024-09-15T23:55:30.963764+0000","last_undegraded":"2024-09-15T23:55:30.963764+0000","last_fullsized":"2024-09-15T23:55:30.963764+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:35.587861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.958937+0000","last_change":"2024-09-15T23:55:29.972635+0000","last_active":"2024-09-15T23:55:30.958937+0000","last_peered":"2024-09-15T23:55:30.958937+0000","last_clean":"2024-09-15T23:55:30.958937+0000","last_became_active":"2024-09-15T23:55:29.972105+0000","last_became_peered":"2024-09-15T23:55:29.972105+0000","last_unstale":"2024-09-15T23:55:30.958937+0000","last_undegraded":"2024-09-15T23:55:30.958937+0000","last_fullsized":"2024-09-15T23:55:30.958937+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:49.183448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.964663+0000","last_change":"2024-09-15T23:55:29.968698+0000","last_active":"2024-09-15T23:55:30.964663+0000","last_peered":"2024-09-15T23:55:30.964663+0000","last_clean":"2024-09-15T23:55:30.964663+0000","last_became_active":"2024-09-15T23:55:29.963397+0000","last_became_peered":"2024-09-15T23:55:29.963397+0000","last_unstale":"2024-09-15T23:55:30.964663+0000","last_undegraded":"2024-09-15T23:55:30.964663+0000","last_fullsized":"2024-09-15T23:55:30.964663+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:29.378102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.200882+0000","last_change":"2024-09-15T23:55:29.976890+0000","last_active":"2024-09-15T23:55:31.200882+0000","last_peered":"2024-09-15T23:55:31.200882+0000","last_clean":"2024-09-15T23:55:31.200882+0000","last_became_active":"2024-09-15T23:55:29.976531+0000","last_became_peered":"2024-09-15T23:55:29.976531+0000","last_unstale":"2024-09-15T23:55:31.200882+0000","last_undegraded":"2024-09-15T23:55:31.200882+0000","last_fullsized":"2024-09-15T23:55:31.200882+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:58.539672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.958636+0000","last_change":"2024-09-15T23:55:29.960465+0000","last_active":"2024-09-15T23:55:30.958636+0000","last_peered":"2024-09-15T23:55:30.958636+0000","last_clean":"2024-09-15T23:55:30.958636+0000","last_became_active":"2024-09-15T23:55:29.960165+0000","last_became_peered":"2024-09-15T23:55:29.960165+0000","last_unstale":"2024-09-15T23:55:30.958636+0000","last_undegraded":"2024-09-15T23:55:30.958636+0000","last_fullsized":"2024-09-15T23:55:30.958636+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:03.971325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201894+0000","last_change":"2024-09-15T23:55:29.976408+0000","last_active":"2024-09-15T23:55:31.201894+0000","last_peered":"2024-09-15T23:55:31.201894+0000","last_clean":"2024-09-15T23:55:31.201894+0000","last_became_active":"2024-09-15T23:55:29.975660+0000","last_became_peered":"2024-09-15T23:55:29.975660+0000","last_unstale":"2024-09-15T23:55:31.201894+0000","last_undegraded":"2024-09-15T23:55:31.201894+0000","last_fullsized":"2024-09-15T23:55:31.201894+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:32:22.714240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202852+0000","last_change":"2024-09-15T23:55:29.996060+0000","last_active":"2024-09-15T23:55:31.202852+0000","last_peered":"2024-09-15T23:55:31.202852+0000","last_clean":"2024-09-15T23:55:31.202852+0000","last_became_active":"2024-09-15T23:55:29.994668+0000","last_became_peered":"2024-09-15T23:55:29.994668+0000","last_unstale":"2024-09-15T23:55:31.202852+0000","last_undegraded":"2024-09-15T23:55:31.202852+0000","last_fullsized":"2024-09-15T23:55:31.202852+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:51.540608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201560+0000","last_change":"2024-09-15T23:55:29.983487+0000","last_active":"2024-09-15T23:55:31.201560+0000","last_peered":"2024-09-15T23:55:31.201560+0000","last_clean":"2024-09-15T23:55:31.201560+0000","last_became_active":"2024-09-15T23:55:29.977095+0000","last_became_peered":"2024-09-15T23:55:29.977095+0000","last_unstale":"2024-09-15T23:55:31.201560+0000","last_undegraded":"2024-09-15T23:55:31.201560+0000","last_fullsized":"2024-09-15T23:55:31.201560+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:49.260716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.964310+0000","last_change":"2024-09-15T23:55:29.965173+0000","last_active":"2024-09-15T23:55:30.964310+0000","last_peered":"2024-09-15T23:55:30.964310+0000","last_clean":"2024-09-15T23:55:30.964310+0000","last_became_active":"2024-09-15T23:55:29.964390+0000","last_became_peered":"2024-09-15T23:55:29.964390+0000","last_unstale":"2024-09-15T23:55:30.964310+0000","last_undegraded":"2024-09-15T23:55:30.964310+0000","last_fullsized":"2024-09-15T23:55:30.964310+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:34.454338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204180+0000","last_change":"2024-09-15T23:55:29.995362+0000","last_active":"2024-09-15T23:55:31.204180+0000","last_peered":"2024-09-15T23:55:31.204180+0000","last_clean":"2024-09-15T23:55:31.204180+0000","last_became_active":"2024-09-15T23:55:29.994531+0000","last_became_peered":"2024-09-15T23:55:29.994531+0000","last_unstale":"2024-09-15T23:55:31.204180+0000","last_undegraded":"2024-09-15T23:55:31.204180+0000","last_fullsized":"2024-09-15T23:55:31.204180+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:49.797209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.964217+0000","last_change":"2024-09-15T23:55:29.955886+0000","last_active":"2024-09-15T23:55:30.964217+0000","last_peered":"2024-09-15T23:55:30.964217+0000","last_clean":"2024-09-15T23:55:30.964217+0000","last_became_active":"2024-09-15T23:55:29.955017+0000","last_became_peered":"2024-09-15T23:55:29.955017+0000","last_unstale":"2024-09-15T23:55:30.964217+0000","last_undegraded":"2024-09-15T23:55:30.964217+0000","last_fullsized":"2024-09-15T23:55:30.964217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:07.576095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201990+0000","last_change":"2024-09-15T23:55:29.991921+0000","last_active":"2024-09-15T23:55:31.201990+0000","last_peered":"2024-09-15T23:55:31.201990+0000","last_clean":"2024-09-15T23:55:31.201990+0000","last_became_active":"2024-09-15T23:55:29.991397+0000","last_became_peered":"2024-09-15T23:55:29.991397+0000","last_unstale":"2024-09-15T23:55:31.201990+0000","last_undegraded":"2024-09-15T23:55:31.201990+0000","last_fullsized":"2024-09-15T23:55:31.201990+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:11.575220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202403+0000","last_change":"2024-09-15T23:55:29.975697+0000","last_active":"2024-09-15T23:55:31.202403+0000","last_peered":"2024-09-15T23:55:31.202403+0000","last_clean":"2024-09-15T23:55:31.202403+0000","last_became_active":"2024-09-15T23:55:29.974875+0000","last_became_peered":"2024-09-15T23:55:29.974875+0000","last_unstale":"2024-09-15T23:55:31.202403+0000","last_undegraded":"2024-09-15T23:55:31.202403+0000","last_fullsized":"2024-09-15T23:55:31.202403+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:19.953049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.963522+0000","last_change":"2024-09-15T23:55:29.978355+0000","last_active":"2024-09-15T23:55:30.963522+0000","last_peered":"2024-09-15T23:55:30.963522+0000","last_clean":"2024-09-15T23:55:30.963522+0000","last_became_active":"2024-09-15T23:55:29.977637+0000","last_became_peered":"2024-09-15T23:55:29.977637+0000","last_unstale":"2024-09-15T23:55:30.963522+0000","last_undegraded":"2024-09-15T23:55:30.963522+0000","last_fullsized":"2024-09-15T23:55:30.963522+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:18.210424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.200414+0000","last_change":"2024-09-15T23:55:29.967048+0000","last_active":"2024-09-15T23:55:31.200414+0000","last_peered":"2024-09-15T23:55:31.200414+0000","last_clean":"2024-09-15T23:55:31.200414+0000","last_became_active":"2024-09-15T23:55:29.965462+0000","last_became_peered":"2024-09-15T23:55:29.965462+0000","last_unstale":"2024-09-15T23:55:31.200414+0000","last_undegraded":"2024-09-15T23:55:31.200414+0000","last_fullsized":"2024-09-15T23:55:31.200414+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:10.170627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201586+0000","last_change":"2024-09-15T23:55:29.985385+0000","last_active":"2024-09-15T23:55:31.201586+0000","last_peered":"2024-09-15T23:55:31.201586+0000","last_clean":"2024-09-15T23:55:31.201586+0000","last_became_active":"2024-09-15T23:55:29.982845+0000","last_became_peered":"2024-09-15T23:55:29.982845+0000","last_unstale":"2024-09-15T23:55:31.201586+0000","last_undegraded":"2024-09-15T23:55:31.201586+0000","last_fullsized":"2024-09-15T23:55:31.201586+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:08.258240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.965018+0000","last_change":"2024-09-15T23:55:29.958432+0000","last_active":"2024-09-15T23:55:30.965018+0000","last_peered":"2024-09-15T23:55:30.965018+0000","last_clean":"2024-09-15T23:55:30.965018+0000","last_became_active":"2024-09-15T23:55:29.956853+0000","last_became_peered":"2024-09-15T23:55:29.956853+0000","last_unstale":"2024-09-15T23:55:30.965018+0000","last_undegraded":"2024-09-15T23:55:30.965018+0000","last_fullsized":"2024-09-15T23:55:30.965018+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:39.599586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201029+0000","last_change":"2024-09-15T23:55:29.976831+0000","last_active":"2024-09-15T23:55:31.201029+0000","last_peered":"2024-09-15T23:55:31.201029+0000","last_clean":"2024-09-15T23:55:31.201029+0000","last_became_active":"2024-09-15T23:55:29.976499+0000","last_became_peered":"2024-09-15T23:55:29.976499+0000","last_unstale":"2024-09-15T23:55:31.201029+0000","last_undegraded":"2024-09-15T23:55:31.201029+0000","last_fullsized":"2024-09-15T23:55:31.201029+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:17.167632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.964136+0000","last_change":"2024-09-15T23:55:29.979187+0000","last_active":"2024-09-15T23:55:30.964136+0000","last_peered":"2024-09-15T23:55:30.964136+0000","last_clean":"2024-09-15T23:55:30.964136+0000","last_became_active":"2024-09-15T23:55:29.978419+0000","last_became_peered":"2024-09-15T23:55:29.978419+0000","last_unstale":"2024-09-15T23:55:30.964136+0000","last_undegraded":"2024-09-15T23:55:30.964136+0000","last_fullsized":"2024-09-15T23:55:30.964136+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:02.767620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.958588+0000","last_change":"2024-09-15T23:55:29.973496+0000","last_active":"2024-09-15T23:55:30.958588+0000","last_peered":"2024-09-15T23:55:30.958588+0000","last_clean":"2024-09-15T23:55:30.958588+0000","last_became_active":"2024-09-15T23:55:29.973055+0000","last_became_peered":"2024-09-15T23:55:29.973055+0000","last_unstale":"2024-09-15T23:55:30.958588+0000","last_undegraded":"2024-09-15T23:55:30.958588+0000","last_fullsized":"2024-09-15T23:55:30.958588+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:17.167632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201076+0000","last_change":"2024-09-15T23:55:29.964834+0000","last_active":"2024-09-15T23:55:31.201076+0000","last_peered":"2024-09-15T23:55:31.201076+0000","last_clean":"2024-09-15T23:55:31.201076+0000","last_became_active":"2024-09-15T23:55:29.964177+0000","last_became_peered":"2024-09-15T23:55:29.964177+0000","last_unstale":"2024-09-15T23:55:31.201076+0000","last_undegraded":"2024-09-15T23:55:31.201076+0000","last_fullsized":"2024-09-15T23:55:31.201076+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:03.971325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.962932+0000","last_change":"2024-09-15T23:55:30.009750+0000","last_active":"2024-09-15T23:55:30.962932+0000","last_peered":"2024-09-15T23:55:30.962932+0000","last_clean":"2024-09-15T23:55:30.962932+0000","last_became_active":"2024-09-15T23:55:30.009078+0000","last_became_peered":"2024-09-15T23:55:30.009078+0000","last_unstale":"2024-09-15T23:55:30.962932+0000","last_undegraded":"2024-09-15T23:55:30.962932+0000","last_fullsized":"2024-09-15T23:55:30.962932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:55.802457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.962697+0000","last_change":"2024-09-15T23:55:29.967662+0000","last_active":"2024-09-15T23:55:30.962697+0000","last_peered":"2024-09-15T23:55:30.962697+0000","last_clean":"2024-09-15T23:55:30.962697+0000","last_became_active":"2024-09-15T23:55:29.966914+0000","last_became_peered":"2024-09-15T23:55:29.966914+0000","last_unstale":"2024-09-15T23:55:30.962697+0000","last_undegraded":"2024-09-15T23:55:30.962697+0000","last_fullsized":"2024-09-15T23:55:30.962697+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:25.241220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.962330+0000","last_change":"2024-09-15T23:55:29.979221+0000","last_active":"2024-09-15T23:55:30.962330+0000","last_peered":"2024-09-15T23:55:30.962330+0000","last_clean":"2024-09-15T23:55:30.962330+0000","last_became_active":"2024-09-15T23:55:29.978356+0000","last_became_peered":"2024-09-15T23:55:29.978356+0000","last_unstale":"2024-09-15T23:55:30.962330+0000","last_undegraded":"2024-09-15T23:55:30.962330+0000","last_fullsized":"2024-09-15T23:55:30.962330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:25.169429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.964150+0000","last_change":"2024-09-15T23:55:30.004406+0000","last_active":"2024-09-15T23:55:30.964150+0000","last_peered":"2024-09-15T23:55:30.964150+0000","last_clean":"2024-09-15T23:55:30.964150+0000","last_became_active":"2024-09-15T23:55:30.003876+0000","last_became_peered":"2024-09-15T23:55:30.003876+0000","last_unstale":"2024-09-15T23:55:30.964150+0000","last_undegraded":"2024-09-15T23:55:30.964150+0000","last_fullsized":"2024-09-15T23:55:30.964150+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:26.927845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.964643+0000","last_change":"2024-09-15T23:55:29.998799+0000","last_active":"2024-09-15T23:55:30.964643+0000","last_peered":"2024-09-15T23:55:30.964643+0000","last_clean":"2024-09-15T23:55:30.964643+0000","last_became_active":"2024-09-15T23:55:29.998197+0000","last_became_peered":"2024-09-15T23:55:29.998197+0000","last_unstale":"2024-09-15T23:55:30.964643+0000","last_undegraded":"2024-09-15T23:55:30.964643+0000","last_fullsized":"2024-09-15T23:55:30.964643+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:52.092269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202601+0000","last_change":"2024-09-15T23:55:30.000135+0000","last_active":"2024-09-15T23:55:31.202601+0000","last_peered":"2024-09-15T23:55:31.202601+0000","last_clean":"2024-09-15T23:55:31.202601+0000","last_became_active":"2024-09-15T23:55:29.998957+0000","last_became_peered":"2024-09-15T23:55:29.998957+0000","last_unstale":"2024-09-15T23:55:31.202601+0000","last_undegraded":"2024-09-15T23:55:31.202601+0000","last_fullsized":"2024-09-15T23:55:31.202601+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:17.167632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.958759+0000","last_change":"2024-09-15T23:55:30.008898+0000","last_active":"2024-09-15T23:55:30.958759+0000","last_peered":"2024-09-15T23:55:30.958759+0000","last_clean":"2024-09-15T23:55:30.958759+0000","last_became_active":"2024-09-15T23:55:30.008611+0000","last_became_peered":"2024-09-15T23:55:30.008611+0000","last_unstale":"2024-09-15T23:55:30.958759+0000","last_undegraded":"2024-09-15T23:55:30.958759+0000","last_fullsized":"2024-09-15T23:55:30.958759+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:35.587861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.964844+0000","last_change":"2024-09-15T23:55:29.967365+0000","last_active":"2024-09-15T23:55:30.964844+0000","last_peered":"2024-09-15T23:55:30.964844+0000","last_clean":"2024-09-15T23:55:30.964844+0000","last_became_active":"2024-09-15T23:55:29.966519+0000","last_became_peered":"2024-09-15T23:55:29.966519+0000","last_unstale":"2024-09-15T23:55:30.964844+0000","last_undegraded":"2024-09-15T23:55:30.964844+0000","last_fullsized":"2024-09-15T23:55:30.964844+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:52.341058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202571+0000","last_change":"2024-09-15T23:55:29.971826+0000","last_active":"2024-09-15T23:55:31.202571+0000","last_peered":"2024-09-15T23:55:31.202571+0000","last_clean":"2024-09-15T23:55:31.202571+0000","last_became_active":"2024-09-15T23:55:29.971576+0000","last_became_peered":"2024-09-15T23:55:29.971576+0000","last_unstale":"2024-09-15T23:55:31.202571+0000","last_undegraded":"2024-09-15T23:55:31.202571+0000","last_fullsized":"2024-09-15T23:55:31.202571+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:19.582190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.963122+0000","last_change":"2024-09-15T23:55:29.978182+0000","last_active":"2024-09-15T23:55:30.963122+0000","last_peered":"2024-09-15T23:55:30.963122+0000","last_clean":"2024-09-15T23:55:30.963122+0000","last_became_active":"2024-09-15T23:55:29.975384+0000","last_became_peered":"2024-09-15T23:55:29.975384+0000","last_unstale":"2024-09-15T23:55:30.963122+0000","last_undegraded":"2024-09-15T23:55:30.963122+0000","last_fullsized":"2024-09-15T23:55:30.963122+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:31.833055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.958331+0000","last_change":"2024-09-15T23:55:29.979723+0000","last_active":"2024-09-15T23:55:30.958331+0000","last_peered":"2024-09-15T23:55:30.958331+0000","last_clean":"2024-09-15T23:55:30.958331+0000","last_became_active":"2024-09-15T23:55:29.979466+0000","last_became_peered":"2024-09-15T23:55:29.979466+0000","last_unstale":"2024-09-15T23:55:30.958331+0000","last_undegraded":"2024-09-15T23:55:30.958331+0000","last_fullsized":"2024-09-15T23:55:30.958331+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:19.953049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.200755+0000","last_change":"2024-09-15T23:55:29.965825+0000","last_active":"2024-09-15T23:55:31.200755+0000","last_peered":"2024-09-15T23:55:31.200755+0000","last_clean":"2024-09-15T23:55:31.200755+0000","last_became_active":"2024-09-15T23:55:29.960562+0000","last_became_peered":"2024-09-15T23:55:29.960562+0000","last_unstale":"2024-09-15T23:55:31.200755+0000","last_undegraded":"2024-09-15T23:55:31.200755+0000","last_fullsized":"2024-09-15T23:55:31.200755+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:16.367584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201408+0000","last_change":"2024-09-15T23:55:28.957377+0000","last_active":"2024-09-15T23:55:31.201408+0000","last_peered":"2024-09-15T23:55:31.201408+0000","last_clean":"2024-09-15T23:55:31.201408+0000","last_became_active":"2024-09-15T23:55:28.957003+0000","last_became_peered":"2024-09-15T23:55:28.957003+0000","last_unstale":"2024-09-15T23:55:31.201408+0000","last_undegraded":"2024-09-15T23:55:31.201408+0000","last_fullsized":"2024-09-15T23:55:31.201408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:57.526239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201529+0000","last_change":"2024-09-15T23:55:29.960334+0000","last_active":"2024-09-15T23:55:31.201529+0000","last_peered":"2024-09-15T23:55:31.201529+0000","last_clean":"2024-09-15T23:55:31.201529+0000","last_became_active":"2024-09-15T23:55:29.959746+0000","last_became_peered":"2024-09-15T23:55:29.959746+0000","last_unstale":"2024-09-15T23:55:31.201529+0000","last_undegraded":"2024-09-15T23:55:31.201529+0000","last_fullsized":"2024-09-15T23:55:31.201529+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:24.836466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202391+0000","last_change":"2024-09-15T23:55:28.986205+0000","last_active":"2024-09-15T23:55:31.202391+0000","last_peered":"2024-09-15T23:55:31.202391+0000","last_clean":"2024-09-15T23:55:31.202391+0000","last_became_active":"2024-09-15T23:55:28.985668+0000","last_became_peered":"2024-09-15T23:55:28.985668+0000","last_unstale":"2024-09-15T23:55:31.202391+0000","last_undegraded":"2024-09-15T23:55:31.202391+0000","last_fullsized":"2024-09-15T23:55:31.202391+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:53.262360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202213+0000","last_change":"2024-09-15T23:55:29.968484+0000","last_active":"2024-09-15T23:55:31.202213+0000","last_peered":"2024-09-15T23:55:31.202213+0000","last_clean":"2024-09-15T23:55:31.202213+0000","last_became_active":"2024-09-15T23:55:29.968177+0000","last_became_peered":"2024-09-15T23:55:29.968177+0000","last_unstale":"2024-09-15T23:55:31.202213+0000","last_undegraded":"2024-09-15T23:55:31.202213+0000","last_fullsized":"2024-09-15T23:55:31.202213+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:06.146250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204016+0000","last_change":"2024-09-15T23:55:28.959282+0000","last_active":"2024-09-15T23:55:31.204016+0000","last_peered":"2024-09-15T23:55:31.204016+0000","last_clean":"2024-09-15T23:55:31.204016+0000","last_became_active":"2024-09-15T23:55:28.958275+0000","last_became_peered":"2024-09-15T23:55:28.958275+0000","last_unstale":"2024-09-15T23:55:31.204016+0000","last_undegraded":"2024-09-15T23:55:31.204016+0000","last_fullsized":"2024-09-15T23:55:31.204016+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:23.055214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203485+0000","last_change":"2024-09-15T23:55:30.003835+0000","last_active":"2024-09-15T23:55:31.203485+0000","last_peered":"2024-09-15T23:55:31.203485+0000","last_clean":"2024-09-15T23:55:31.203485+0000","last_became_active":"2024-09-15T23:55:29.996004+0000","last_became_peered":"2024-09-15T23:55:29.996004+0000","last_unstale":"2024-09-15T23:55:31.203485+0000","last_undegraded":"2024-09-15T23:55:31.203485+0000","last_fullsized":"2024-09-15T23:55:31.203485+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:41.875576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.958861+0000","last_change":"2024-09-15T23:55:28.981225+0000","last_active":"2024-09-15T23:55:30.958861+0000","last_peered":"2024-09-15T23:55:30.958861+0000","last_clean":"2024-09-15T23:55:30.958861+0000","last_became_active":"2024-09-15T23:55:28.980753+0000","last_became_peered":"2024-09-15T23:55:28.980753+0000","last_unstale":"2024-09-15T23:55:30.958861+0000","last_undegraded":"2024-09-15T23:55:30.958861+0000","last_fullsized":"2024-09-15T23:55:30.958861+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:42.358814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201607+0000","last_change":"2024-09-15T23:55:29.972547+0000","last_active":"2024-09-15T23:55:31.201607+0000","last_peered":"2024-09-15T23:55:31.201607+0000","last_clean":"2024-09-15T23:55:31.201607+0000","last_became_active":"2024-09-15T23:55:29.971934+0000","last_became_peered":"2024-09-15T23:55:29.971934+0000","last_unstale":"2024-09-15T23:55:31.201607+0000","last_undegraded":"2024-09-15T23:55:31.201607+0000","last_fullsized":"2024-09-15T23:55:31.201607+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:07.576095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.963760+0000","last_change":"2024-09-15T23:55:28.979920+0000","last_active":"2024-09-15T23:55:30.963760+0000","last_peered":"2024-09-15T23:55:30.963760+0000","last_clean":"2024-09-15T23:55:30.963760+0000","last_became_active":"2024-09-15T23:55:28.979269+0000","last_became_peered":"2024-09-15T23:55:28.979269+0000","last_unstale":"2024-09-15T23:55:30.963760+0000","last_undegraded":"2024-09-15T23:55:30.963760+0000","last_fullsized":"2024-09-15T23:55:30.963760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:26.999949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203478+0000","last_change":"2024-09-15T23:55:29.953440+0000","last_active":"2024-09-15T23:55:31.203478+0000","last_peered":"2024-09-15T23:55:31.203478+0000","last_clean":"2024-09-15T23:55:31.203478+0000","last_became_active":"2024-09-15T23:55:29.953171+0000","last_became_peered":"2024-09-15T23:55:29.953171+0000","last_unstale":"2024-09-15T23:55:31.203478+0000","last_undegraded":"2024-09-15T23:55:31.203478+0000","last_fullsized":"2024-09-15T23:55:31.203478+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:43.159386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202810+0000","last_change":"2024-09-15T23:55:28.952417+0000","last_active":"2024-09-15T23:55:31.202810+0000","last_peered":"2024-09-15T23:55:31.202810+0000","last_clean":"2024-09-15T23:55:31.202810+0000","last_became_active":"2024-09-15T23:55:28.952107+0000","last_became_peered":"2024-09-15T23:55:28.952107+0000","last_unstale":"2024-09-15T23:55:31.202810+0000","last_undegraded":"2024-09-15T23:55:31.202810+0000","last_fullsized":"2024-09-15T23:55:31.202810+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:56:27.512905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204307+0000","last_change":"2024-09-15T23:55:30.002606+0000","last_active":"2024-09-15T23:55:31.204307+0000","last_peered":"2024-09-15T23:55:31.204307+0000","last_clean":"2024-09-15T23:55:31.204307+0000","last_became_active":"2024-09-15T23:55:29.996213+0000","last_became_peered":"2024-09-15T23:55:29.996213+0000","last_unstale":"2024-09-15T23:55:31.204307+0000","last_undegraded":"2024-09-15T23:55:31.204307+0000","last_fullsized":"2024-09-15T23:55:31.204307+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:08.573598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201773+0000","last_change":"2024-09-15T23:55:28.958153+0000","last_active":"2024-09-15T23:55:31.201773+0000","last_peered":"2024-09-15T23:55:31.201773+0000","last_clean":"2024-09-15T23:55:31.201773+0000","last_became_active":"2024-09-15T23:55:28.957814+0000","last_became_peered":"2024-09-15T23:55:28.957814+0000","last_unstale":"2024-09-15T23:55:31.201773+0000","last_undegraded":"2024-09-15T23:55:31.201773+0000","last_fullsized":"2024-09-15T23:55:31.201773+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:48.987207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202712+0000","last_change":"2024-09-15T23:55:29.985725+0000","last_active":"2024-09-15T23:55:31.202712+0000","last_peered":"2024-09-15T23:55:31.202712+0000","last_clean":"2024-09-15T23:55:31.202712+0000","last_became_active":"2024-09-15T23:55:29.985437+0000","last_became_peered":"2024-09-15T23:55:29.985437+0000","last_unstale":"2024-09-15T23:55:31.202712+0000","last_undegraded":"2024-09-15T23:55:31.202712+0000","last_fullsized":"2024-09-15T23:55:31.202712+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:26.927845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.962205+0000","last_change":"2024-09-15T23:55:28.969352+0000","last_active":"2024-09-15T23:55:30.962205+0000","last_peered":"2024-09-15T23:55:30.962205+0000","last_clean":"2024-09-15T23:55:30.962205+0000","last_became_active":"2024-09-15T23:55:28.968629+0000","last_became_peered":"2024-09-15T23:55:28.968629+0000","last_unstale":"2024-09-15T23:55:30.962205+0000","last_undegraded":"2024-09-15T23:55:30.962205+0000","last_fullsized":"2024-09-15T23:55:30.962205+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:25.915087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.200954+0000","last_change":"2024-09-15T23:55:29.975250+0000","last_active":"2024-09-15T23:55:31.200954+0000","last_peered":"2024-09-15T23:55:31.200954+0000","last_clean":"2024-09-15T23:55:31.200954+0000","last_became_active":"2024-09-15T23:55:29.974944+0000","last_became_peered":"2024-09-15T23:55:29.974944+0000","last_unstale":"2024-09-15T23:55:31.200954+0000","last_undegraded":"2024-09-15T23:55:31.200954+0000","last_fullsized":"2024-09-15T23:55:31.200954+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:26.927845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203053+0000","last_change":"2024-09-15T23:55:28.950095+0000","last_active":"2024-09-15T23:55:31.203053+0000","last_peered":"2024-09-15T23:55:31.203053+0000","last_clean":"2024-09-15T23:55:31.203053+0000","last_became_active":"2024-09-15T23:55:28.949824+0000","last_became_peered":"2024-09-15T23:55:28.949824+0000","last_unstale":"2024-09-15T23:55:31.203053+0000","last_undegraded":"2024-09-15T23:55:31.203053+0000","last_fullsized":"2024-09-15T23:55:31.203053+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:28.376354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.200615+0000","last_change":"2024-09-15T23:55:29.967558+0000","last_active":"2024-09-15T23:55:31.200615+0000","last_peered":"2024-09-15T23:55:31.200615+0000","last_clean":"2024-09-15T23:55:31.200615+0000","last_became_active":"2024-09-15T23:55:29.966362+0000","last_became_peered":"2024-09-15T23:55:29.966362+0000","last_unstale":"2024-09-15T23:55:31.200615+0000","last_undegraded":"2024-09-15T23:55:31.200615+0000","last_fullsized":"2024-09-15T23:55:31.200615+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:19.953049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201123+0000","last_change":"2024-09-15T23:55:28.978340+0000","last_active":"2024-09-15T23:55:31.201123+0000","last_peered":"2024-09-15T23:55:31.201123+0000","last_clean":"2024-09-15T23:55:31.201123+0000","last_became_active":"2024-09-15T23:55:28.978016+0000","last_became_peered":"2024-09-15T23:55:28.978016+0000","last_unstale":"2024-09-15T23:55:31.201123+0000","last_undegraded":"2024-09-15T23:55:31.201123+0000","last_fullsized":"2024-09-15T23:55:31.201123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:53.262360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.963792+0000","last_change":"2024-09-15T23:55:29.961056+0000","last_active":"2024-09-15T23:55:30.963792+0000","last_peered":"2024-09-15T23:55:30.963792+0000","last_clean":"2024-09-15T23:55:30.963792+0000","last_became_active":"2024-09-15T23:55:29.960293+0000","last_became_peered":"2024-09-15T23:55:29.960293+0000","last_unstale":"2024-09-15T23:55:30.963792+0000","last_undegraded":"2024-09-15T23:55:30.963792+0000","last_fullsized":"2024-09-15T23:55:30.963792+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:49.309872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203573+0000","last_change":"2024-09-15T23:55:28.960875+0000","last_active":"2024-09-15T23:55:31.203573+0000","last_peered":"2024-09-15T23:55:31.203573+0000","last_clean":"2024-09-15T23:55:31.203573+0000","last_became_active":"2024-09-15T23:55:28.960593+0000","last_became_peered":"2024-09-15T23:55:28.960593+0000","last_unstale":"2024-09-15T23:55:31.203573+0000","last_undegraded":"2024-09-15T23:55:31.203573+0000","last_fullsized":"2024-09-15T23:55:31.203573+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:05.843883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.958683+0000","last_change":"2024-09-15T23:55:29.975598+0000","last_active":"2024-09-15T23:55:30.958683+0000","last_peered":"2024-09-15T23:55:30.958683+0000","last_clean":"2024-09-15T23:55:30.958683+0000","last_became_active":"2024-09-15T23:55:29.974542+0000","last_became_peered":"2024-09-15T23:55:29.974542+0000","last_unstale":"2024-09-15T23:55:30.958683+0000","last_undegraded":"2024-09-15T23:55:30.958683+0000","last_fullsized":"2024-09-15T23:55:30.958683+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:18.210424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203755+0000","last_change":"2024-09-15T23:55:28.984808+0000","last_active":"2024-09-15T23:55:31.203755+0000","last_peered":"2024-09-15T23:55:31.203755+0000","last_clean":"2024-09-15T23:55:31.203755+0000","last_became_active":"2024-09-15T23:55:28.984131+0000","last_became_peered":"2024-09-15T23:55:28.984131+0000","last_unstale":"2024-09-15T23:55:31.203755+0000","last_undegraded":"2024-09-15T23:55:31.203755+0000","last_fullsized":"2024-09-15T23:55:31.203755+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:56.457774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201645+0000","last_change":"2024-09-15T23:55:29.963376+0000","last_active":"2024-09-15T23:55:31.201645+0000","last_peered":"2024-09-15T23:55:31.201645+0000","last_clean":"2024-09-15T23:55:31.201645+0000","last_became_active":"2024-09-15T23:55:29.960149+0000","last_became_peered":"2024-09-15T23:55:29.960149+0000","last_unstale":"2024-09-15T23:55:31.201645+0000","last_undegraded":"2024-09-15T23:55:31.201645+0000","last_fullsized":"2024-09-15T23:55:31.201645+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:44.664911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202644+0000","last_change":"2024-09-15T23:55:28.977045+0000","last_active":"2024-09-15T23:55:31.202644+0000","last_peered":"2024-09-15T23:55:31.202644+0000","last_clean":"2024-09-15T23:55:31.202644+0000","last_became_active":"2024-09-15T23:55:28.976372+0000","last_became_peered":"2024-09-15T23:55:28.976372+0000","last_unstale":"2024-09-15T23:55:31.202644+0000","last_undegraded":"2024-09-15T23:55:31.202644+0000","last_fullsized":"2024-09-15T23:55:31.202644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:42.163168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.964575+0000","last_change":"2024-09-15T23:55:29.995077+0000","last_active":"2024-09-15T23:55:30.964575+0000","last_peered":"2024-09-15T23:55:30.964575+0000","last_clean":"2024-09-15T23:55:30.964575+0000","last_became_active":"2024-09-15T23:55:29.994585+0000","last_became_peered":"2024-09-15T23:55:29.994585+0000","last_unstale":"2024-09-15T23:55:30.964575+0000","last_undegraded":"2024-09-15T23:55:30.964575+0000","last_fullsized":"2024-09-15T23:55:30.964575+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:35.057506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.200465+0000","last_change":"2024-09-15T23:55:28.960226+0000","last_active":"2024-09-15T23:55:31.200465+0000","last_peered":"2024-09-15T23:55:31.200465+0000","last_clean":"2024-09-15T23:55:31.200465+0000","last_became_active":"2024-09-15T23:55:28.960000+0000","last_became_peered":"2024-09-15T23:55:28.960000+0000","last_unstale":"2024-09-15T23:55:31.200465+0000","last_undegraded":"2024-09-15T23:55:31.200465+0000","last_fullsized":"2024-09-15T23:55:31.200465+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:00.577530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202637+0000","last_change":"2024-09-15T23:55:29.998528+0000","last_active":"2024-09-15T23:55:31.202637+0000","last_peered":"2024-09-15T23:55:31.202637+0000","last_clean":"2024-09-15T23:55:31.202637+0000","last_became_active":"2024-09-15T23:55:29.997860+0000","last_became_peered":"2024-09-15T23:55:29.997860+0000","last_unstale":"2024-09-15T23:55:31.202637+0000","last_undegraded":"2024-09-15T23:55:31.202637+0000","last_fullsized":"2024-09-15T23:55:31.202637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:03.971325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.958384+0000","last_change":"2024-09-15T23:55:28.953752+0000","last_active":"2024-09-15T23:55:30.958384+0000","last_peered":"2024-09-15T23:55:30.958384+0000","last_clean":"2024-09-15T23:55:30.958384+0000","last_became_active":"2024-09-15T23:55:28.953477+0000","last_became_peered":"2024-09-15T23:55:28.953477+0000","last_unstale":"2024-09-15T23:55:30.958384+0000","last_undegraded":"2024-09-15T23:55:30.958384+0000","last_fullsized":"2024-09-15T23:55:30.958384+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:27.002125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.964705+0000","last_change":"2024-09-15T23:55:29.963696+0000","last_active":"2024-09-15T23:55:30.964705+0000","last_peered":"2024-09-15T23:55:30.964705+0000","last_clean":"2024-09-15T23:55:30.964705+0000","last_became_active":"2024-09-15T23:55:29.962888+0000","last_became_peered":"2024-09-15T23:55:29.962888+0000","last_unstale":"2024-09-15T23:55:30.964705+0000","last_undegraded":"2024-09-15T23:55:30.964705+0000","last_fullsized":"2024-09-15T23:55:30.964705+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:57.871161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201824+0000","last_change":"2024-09-15T23:55:28.982518+0000","last_active":"2024-09-15T23:55:31.201824+0000","last_peered":"2024-09-15T23:55:31.201824+0000","last_clean":"2024-09-15T23:55:31.201824+0000","last_became_active":"2024-09-15T23:55:28.981852+0000","last_became_peered":"2024-09-15T23:55:28.981852+0000","last_unstale":"2024-09-15T23:55:31.201824+0000","last_undegraded":"2024-09-15T23:55:31.201824+0000","last_fullsized":"2024-09-15T23:55:31.201824+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:18.326960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202224+0000","last_change":"2024-09-15T23:55:29.970464+0000","last_active":"2024-09-15T23:55:31.202224+0000","last_peered":"2024-09-15T23:55:31.202224+0000","last_clean":"2024-09-15T23:55:31.202224+0000","last_became_active":"2024-09-15T23:55:29.969600+0000","last_became_peered":"2024-09-15T23:55:29.969600+0000","last_unstale":"2024-09-15T23:55:31.202224+0000","last_undegraded":"2024-09-15T23:55:31.202224+0000","last_fullsized":"2024-09-15T23:55:31.202224+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:26.661560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202960+0000","last_change":"2024-09-15T23:55:28.987736+0000","last_active":"2024-09-15T23:55:31.202960+0000","last_peered":"2024-09-15T23:55:31.202960+0000","last_clean":"2024-09-15T23:55:31.202960+0000","last_became_active":"2024-09-15T23:55:28.986972+0000","last_became_peered":"2024-09-15T23:55:28.986972+0000","last_unstale":"2024-09-15T23:55:31.202960+0000","last_undegraded":"2024-09-15T23:55:31.202960+0000","last_fullsized":"2024-09-15T23:55:31.202960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:07.288904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.963113+0000","last_change":"2024-09-15T23:55:29.970697+0000","last_active":"2024-09-15T23:55:30.963113+0000","last_peered":"2024-09-15T23:55:30.963113+0000","last_clean":"2024-09-15T23:55:30.963113+0000","last_became_active":"2024-09-15T23:55:29.969939+0000","last_became_peered":"2024-09-15T23:55:29.969939+0000","last_unstale":"2024-09-15T23:55:30.963113+0000","last_undegraded":"2024-09-15T23:55:30.963113+0000","last_fullsized":"2024-09-15T23:55:30.963113+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:03.971325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202666+0000","last_change":"2024-09-15T23:55:28.978148+0000","last_active":"2024-09-15T23:55:31.202666+0000","last_peered":"2024-09-15T23:55:31.202666+0000","last_clean":"2024-09-15T23:55:31.202666+0000","last_became_active":"2024-09-15T23:55:28.977563+0000","last_became_peered":"2024-09-15T23:55:28.977563+0000","last_unstale":"2024-09-15T23:55:31.202666+0000","last_undegraded":"2024-09-15T23:55:31.202666+0000","last_fullsized":"2024-09-15T23:55:31.202666+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:42.358814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.958476+0000","last_change":"2024-09-15T23:55:29.976389+0000","last_active":"2024-09-15T23:55:30.958476+0000","last_peered":"2024-09-15T23:55:30.958476+0000","last_clean":"2024-09-15T23:55:30.958476+0000","last_became_active":"2024-09-15T23:55:29.976046+0000","last_became_peered":"2024-09-15T23:55:29.976046+0000","last_unstale":"2024-09-15T23:55:30.958476+0000","last_undegraded":"2024-09-15T23:55:30.958476+0000","last_fullsized":"2024-09-15T23:55:30.958476+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:58.539672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202279+0000","last_change":"2024-09-15T23:55:28.981019+0000","last_active":"2024-09-15T23:55:31.202279+0000","last_peered":"2024-09-15T23:55:31.202279+0000","last_clean":"2024-09-15T23:55:31.202279+0000","last_became_active":"2024-09-15T23:55:28.980736+0000","last_became_peered":"2024-09-15T23:55:28.980736+0000","last_unstale":"2024-09-15T23:55:31.202279+0000","last_undegraded":"2024-09-15T23:55:31.202279+0000","last_fullsized":"2024-09-15T23:55:31.202279+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:42.358814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202031+0000","last_change":"2024-09-15T23:55:29.983216+0000","last_active":"2024-09-15T23:55:31.202031+0000","last_peered":"2024-09-15T23:55:31.202031+0000","last_clean":"2024-09-15T23:55:31.202031+0000","last_became_active":"2024-09-15T23:55:29.977545+0000","last_became_peered":"2024-09-15T23:55:29.977545+0000","last_unstale":"2024-09-15T23:55:31.202031+0000","last_undegraded":"2024-09-15T23:55:31.202031+0000","last_fullsized":"2024-09-15T23:55:31.202031+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:10.170627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.958960+0000","last_change":"2024-09-15T23:55:28.965885+0000","last_active":"2024-09-15T23:55:30.958960+0000","last_peered":"2024-09-15T23:55:30.958960+0000","last_clean":"2024-09-15T23:55:30.958960+0000","last_became_active":"2024-09-15T23:55:28.965531+0000","last_became_peered":"2024-09-15T23:55:28.965531+0000","last_unstale":"2024-09-15T23:55:30.958960+0000","last_undegraded":"2024-09-15T23:55:30.958960+0000","last_fullsized":"2024-09-15T23:55:30.958960+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:28.376354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.958918+0000","last_change":"2024-09-15T23:55:29.966410+0000","last_active":"2024-09-15T23:55:30.958918+0000","last_peered":"2024-09-15T23:55:30.958918+0000","last_clean":"2024-09-15T23:55:30.958918+0000","last_became_active":"2024-09-15T23:55:29.965815+0000","last_became_peered":"2024-09-15T23:55:29.965815+0000","last_unstale":"2024-09-15T23:55:30.958918+0000","last_undegraded":"2024-09-15T23:55:30.958918+0000","last_fullsized":"2024-09-15T23:55:30.958918+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:07.576095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.963777+0000","last_change":"2024-09-15T23:55:28.960054+0000","last_active":"2024-09-15T23:55:30.963777+0000","last_peered":"2024-09-15T23:55:30.963777+0000","last_clean":"2024-09-15T23:55:30.963777+0000","last_became_active":"2024-09-15T23:55:28.959315+0000","last_became_peered":"2024-09-15T23:55:28.959315+0000","last_unstale":"2024-09-15T23:55:30.963777+0000","last_undegraded":"2024-09-15T23:55:30.963777+0000","last_fullsized":"2024-09-15T23:55:30.963777+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:33.810824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202147+0000","last_change":"2024-09-15T23:55:29.963187+0000","last_active":"2024-09-15T23:55:31.202147+0000","last_peered":"2024-09-15T23:55:31.202147+0000","last_clean":"2024-09-15T23:55:31.202147+0000","last_became_active":"2024-09-15T23:55:29.962912+0000","last_became_peered":"2024-09-15T23:55:29.962912+0000","last_unstale":"2024-09-15T23:55:31.202147+0000","last_undegraded":"2024-09-15T23:55:31.202147+0000","last_fullsized":"2024-09-15T23:55:31.202147+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:35.587861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.962821+0000","last_change":"2024-09-15T23:55:28.983747+0000","last_active":"2024-09-15T23:55:30.962821+0000","last_peered":"2024-09-15T23:55:30.962821+0000","last_clean":"2024-09-15T23:55:30.962821+0000","last_became_active":"2024-09-15T23:55:28.982268+0000","last_became_peered":"2024-09-15T23:55:28.982268+0000","last_unstale":"2024-09-15T23:55:30.962821+0000","last_undegraded":"2024-09-15T23:55:30.962821+0000","last_fullsized":"2024-09-15T23:55:30.962821+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:26.380639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.964498+0000","last_change":"2024-09-15T23:55:29.961350+0000","last_active":"2024-09-15T23:55:30.964498+0000","last_peered":"2024-09-15T23:55:30.964498+0000","last_clean":"2024-09-15T23:55:30.964498+0000","last_became_active":"2024-09-15T23:55:29.960597+0000","last_became_peered":"2024-09-15T23:55:29.960597+0000","last_unstale":"2024-09-15T23:55:30.964498+0000","last_undegraded":"2024-09-15T23:55:30.964498+0000","last_fullsized":"2024-09-15T23:55:30.964498+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:49.183448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203129+0000","last_change":"2024-09-15T23:55:28.984174+0000","last_active":"2024-09-15T23:55:31.203129+0000","last_peered":"2024-09-15T23:55:31.203129+0000","last_clean":"2024-09-15T23:55:31.203129+0000","last_became_active":"2024-09-15T23:55:28.983467+0000","last_became_peered":"2024-09-15T23:55:28.983467+0000","last_unstale":"2024-09-15T23:55:31.203129+0000","last_undegraded":"2024-09-15T23:55:31.203129+0000","last_fullsized":"2024-09-15T23:55:31.203129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:24.174820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202872+0000","last_change":"2024-09-15T23:55:30.010201+0000","last_active":"2024-09-15T23:55:31.202872+0000","last_peered":"2024-09-15T23:55:31.202872+0000","last_clean":"2024-09-15T23:55:31.202872+0000","last_became_active":"2024-09-15T23:55:30.009785+0000","last_became_peered":"2024-09-15T23:55:30.009785+0000","last_unstale":"2024-09-15T23:55:31.202872+0000","last_undegraded":"2024-09-15T23:55:31.202872+0000","last_fullsized":"2024-09-15T23:55:31.202872+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:18.210424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202605+0000","last_change":"2024-09-15T23:55:28.966139+0000","last_active":"2024-09-15T23:55:31.202605+0000","last_peered":"2024-09-15T23:55:31.202605+0000","last_clean":"2024-09-15T23:55:31.202605+0000","last_became_active":"2024-09-15T23:55:28.965422+0000","last_became_peered":"2024-09-15T23:55:28.965422+0000","last_unstale":"2024-09-15T23:55:31.202605+0000","last_undegraded":"2024-09-15T23:55:31.202605+0000","last_fullsized":"2024-09-15T23:55:31.202605+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:41.328089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201298+0000","last_change":"2024-09-15T23:55:29.956246+0000","last_active":"2024-09-15T23:55:31.201298+0000","last_peered":"2024-09-15T23:55:31.201298+0000","last_clean":"2024-09-15T23:55:31.201298+0000","last_became_active":"2024-09-15T23:55:29.955968+0000","last_became_peered":"2024-09-15T23:55:29.955968+0000","last_unstale":"2024-09-15T23:55:31.201298+0000","last_undegraded":"2024-09-15T23:55:31.201298+0000","last_fullsized":"2024-09-15T23:55:31.201298+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:18.210424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203039+0000","last_change":"2024-09-15T23:55:28.958308+0000","last_active":"2024-09-15T23:55:31.203039+0000","last_peered":"2024-09-15T23:55:31.203039+0000","last_clean":"2024-09-15T23:55:31.203039+0000","last_became_active":"2024-09-15T23:55:28.957929+0000","last_became_peered":"2024-09-15T23:55:28.957929+0000","last_unstale":"2024-09-15T23:55:31.203039+0000","last_undegraded":"2024-09-15T23:55:31.203039+0000","last_fullsized":"2024-09-15T23:55:31.203039+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:37.406439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203329+0000","last_change":"2024-09-15T23:55:30.003355+0000","last_active":"2024-09-15T23:55:31.203329+0000","last_peered":"2024-09-15T23:55:31.203329+0000","last_clean":"2024-09-15T23:55:31.203329+0000","last_became_active":"2024-09-15T23:55:30.002742+0000","last_became_peered":"2024-09-15T23:55:30.002742+0000","last_unstale":"2024-09-15T23:55:31.203329+0000","last_undegraded":"2024-09-15T23:55:31.203329+0000","last_fullsized":"2024-09-15T23:55:31.203329+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:15.549461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203615+0000","last_change":"2024-09-15T23:55:28.960962+0000","last_active":"2024-09-15T23:55:31.203615+0000","last_peered":"2024-09-15T23:55:31.203615+0000","last_clean":"2024-09-15T23:55:31.203615+0000","last_became_active":"2024-09-15T23:55:28.960579+0000","last_became_peered":"2024-09-15T23:55:28.960579+0000","last_unstale":"2024-09-15T23:55:31.203615+0000","last_undegraded":"2024-09-15T23:55:31.203615+0000","last_fullsized":"2024-09-15T23:55:31.203615+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:17.122651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.963453+0000","last_change":"2024-09-15T23:55:29.971940+0000","last_active":"2024-09-15T23:55:30.963453+0000","last_peered":"2024-09-15T23:55:30.963453+0000","last_clean":"2024-09-15T23:55:30.963453+0000","last_became_active":"2024-09-15T23:55:29.970772+0000","last_became_peered":"2024-09-15T23:55:29.970772+0000","last_unstale":"2024-09-15T23:55:30.963453+0000","last_undegraded":"2024-09-15T23:55:30.963453+0000","last_fullsized":"2024-09-15T23:55:30.963453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:23.244831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.963592+0000","last_change":"2024-09-15T23:55:28.980090+0000","last_active":"2024-09-15T23:55:30.963592+0000","last_peered":"2024-09-15T23:55:30.963592+0000","last_clean":"2024-09-15T23:55:30.963592+0000","last_became_active":"2024-09-15T23:55:28.978880+0000","last_became_peered":"2024-09-15T23:55:28.978880+0000","last_unstale":"2024-09-15T23:55:30.963592+0000","last_undegraded":"2024-09-15T23:55:30.963592+0000","last_fullsized":"2024-09-15T23:55:30.963592+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:58:28.960908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203872+0000","last_change":"2024-09-15T23:55:30.002867+0000","last_active":"2024-09-15T23:55:31.203872+0000","last_peered":"2024-09-15T23:55:31.203872+0000","last_clean":"2024-09-15T23:55:31.203872+0000","last_became_active":"2024-09-15T23:55:29.993861+0000","last_became_peered":"2024-09-15T23:55:29.993861+0000","last_unstale":"2024-09-15T23:55:31.203872+0000","last_undegraded":"2024-09-15T23:55:31.203872+0000","last_fullsized":"2024-09-15T23:55:31.203872+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:37.828534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203711+0000","last_change":"2024-09-15T23:55:28.959925+0000","last_active":"2024-09-15T23:55:31.203711+0000","last_peered":"2024-09-15T23:55:31.203711+0000","last_clean":"2024-09-15T23:55:31.203711+0000","last_became_active":"2024-09-15T23:55:28.958452+0000","last_became_peered":"2024-09-15T23:55:28.958452+0000","last_unstale":"2024-09-15T23:55:31.203711+0000","last_undegraded":"2024-09-15T23:55:31.203711+0000","last_fullsized":"2024-09-15T23:55:31.203711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:50.451580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.958845+0000","last_change":"2024-09-15T23:55:29.991587+0000","last_active":"2024-09-15T23:55:30.958845+0000","last_peered":"2024-09-15T23:55:30.958845+0000","last_clean":"2024-09-15T23:55:30.958845+0000","last_became_active":"2024-09-15T23:55:29.991368+0000","last_became_peered":"2024-09-15T23:55:29.991368+0000","last_unstale":"2024-09-15T23:55:30.958845+0000","last_undegraded":"2024-09-15T23:55:30.958845+0000","last_fullsized":"2024-09-15T23:55:30.958845+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:26.927845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.963065+0000","last_change":"2024-09-15T23:55:28.983121+0000","last_active":"2024-09-15T23:55:30.963065+0000","last_peered":"2024-09-15T23:55:30.963065+0000","last_clean":"2024-09-15T23:55:30.963065+0000","last_became_active":"2024-09-15T23:55:28.981404+0000","last_became_peered":"2024-09-15T23:55:28.981404+0000","last_unstale":"2024-09-15T23:55:30.963065+0000","last_undegraded":"2024-09-15T23:55:30.963065+0000","last_fullsized":"2024-09-15T23:55:30.963065+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:36.266752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204388+0000","last_change":"2024-09-15T23:55:29.994344+0000","last_active":"2024-09-15T23:55:31.204388+0000","last_peered":"2024-09-15T23:55:31.204388+0000","last_clean":"2024-09-15T23:55:31.204388+0000","last_became_active":"2024-09-15T23:55:29.989134+0000","last_became_peered":"2024-09-15T23:55:29.989134+0000","last_unstale":"2024-09-15T23:55:31.204388+0000","last_undegraded":"2024-09-15T23:55:31.204388+0000","last_fullsized":"2024-09-15T23:55:31.204388+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:08.439772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:30.958437+0000","last_change":"2024-09-15T23:55:28.956432+0000","last_active":"2024-09-15T23:55:30.958437+0000","last_peered":"2024-09-15T23:55:30.958437+0000","last_clean":"2024-09-15T23:55:30.958437+0000","last_became_active":"2024-09-15T23:55:28.956054+0000","last_became_peered":"2024-09-15T23:55:28.956054+0000","last_unstale":"2024-09-15T23:55:30.958437+0000","last_undegraded":"2024-09-15T23:55:30.958437+0000","last_fullsized":"2024-09-15T23:55:30.958437+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:53.262360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.202445+0000","last_change":"2024-09-15T23:55:29.995888+0000","last_active":"2024-09-15T23:55:31.202445+0000","last_peered":"2024-09-15T23:55:31.202445+0000","last_clean":"2024-09-15T23:55:31.202445+0000","last_became_active":"2024-09-15T23:55:29.993514+0000","last_became_peered":"2024-09-15T23:55:29.993514+0000","last_unstale":"2024-09-15T23:55:31.202445+0000","last_undegraded":"2024-09-15T23:55:31.202445+0000","last_fullsized":"2024-09-15T23:55:31.202445+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:58.539672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.200276+0000","last_change":"2024-09-15T23:55:28.960457+0000","last_active":"2024-09-15T23:55:31.200276+0000","last_peered":"2024-09-15T23:55:31.200276+0000","last_clean":"2024-09-15T23:55:31.200276+0000","last_became_active":"2024-09-15T23:55:28.960080+0000","last_became_peered":"2024-09-15T23:55:28.960080+0000","last_unstale":"2024-09-15T23:55:31.200276+0000","last_undegraded":"2024-09-15T23:55:31.200276+0000","last_fullsized":"2024-09-15T23:55:31.200276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:27.002125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.203117+0000","last_change":"2024-09-15T23:55:29.964396+0000","last_active":"2024-09-15T23:55:31.203117+0000","last_peered":"2024-09-15T23:55:31.203117+0000","last_clean":"2024-09-15T23:55:31.203117+0000","last_became_active":"2024-09-15T23:55:29.964083+0000","last_became_peered":"2024-09-15T23:55:29.964083+0000","last_unstale":"2024-09-15T23:55:31.203117+0000","last_undegraded":"2024-09-15T23:55:31.203117+0000","last_fullsized":"2024-09-15T23:55:31.203117+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:28.924235+0000","last_clean_scrub_stamp":"2024-09-15T23:55:28.924235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:49.183448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.204582+0000","last_change":"2024-09-15T23:55:28.977178+0000","last_active":"2024-09-15T23:55:31.204582+0000","last_peered":"2024-09-15T23:55:31.204582+0000","last_clean":"2024-09-15T23:55:31.204582+0000","last_became_active":"2024-09-15T23:55:28.975684+0000","last_became_peered":"2024-09-15T23:55:28.975684+0000","last_unstale":"2024-09-15T23:55:31.204582+0000","last_undegraded":"2024-09-15T23:55:31.204582+0000","last_fullsized":"2024-09-15T23:55:31.204582+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:27.910802+0000","last_clean_scrub_stamp":"2024-09-15T23:55:27.910802+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:51.522143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-15T23:55:31.201129+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:55:31.201129+0000","last_peered":"2024-09-15T23:55:31.201129+0000","last_clean":"2024-09-15T23:55:31.201129+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:55:31.201129+0000","last_undegraded":"2024-09-15T23:55:31.201129+0000","last_fullsized":"2024-09-15T23:55:31.201129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31788,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":606208,"data_stored":263222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":602112,"data_stored":263748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":618496,"data_stored":264870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":602112,"data_stored":263256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509468,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":602112,"data_stored":263200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1196032,"data_stored":853604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509466,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":602112,"data_stored":263748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1208320,"data_stored":855236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:55:37.754 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:55:37.754 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:55:37.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f5662bde640 1 Processor -- start 2024-09-15T23:55:37.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f5662bde640 1 -- start start 2024-09-15T23:55:37.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f5662bde640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f565c0af100 0x7f565c071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f5662bde640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f565c0acf60 0x7f565c06ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f5662bde640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f565c15b800 con 0x7f565c0ad3a0 2024-09-15T23:55:37.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f5662bde640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f565c0723a0 con 0x7f565c0acf60 2024-09-15T23:55:37.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f5662bde640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f565c072680 con 0x7f565c0af100 2024-09-15T23:55:37.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f565bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f565c0acf60 0x7f565c06ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f566117b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f565c0ad3a0 0x7f565c073440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41886/0 (socket says 172.21.15.112:41886) 2024-09-15T23:55:37.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f565bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f565c0acf60 0x7f565c06ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41286/0 (socket says 172.21.15.112:41286) 2024-09-15T23:55:37.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f566117b640 1 -- 172.21.15.112:0/3821199660 learned_addr learned my addr 172.21.15.112:0/3821199660 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:37.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f566097a640 1 --2- 172.21.15.112:0/3821199660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f565c0af100 0x7f565c071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f565bfff640 1 -- 172.21.15.112:0/3821199660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f565c0af100 msgr2=0x7f565c071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:37.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f565bfff640 1 --2- 172.21.15.112:0/3821199660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f565c0af100 0x7f565c071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f565bfff640 1 -- 172.21.15.112:0/3821199660 >> v1:172.21.15.112:6789/0 conn(0x7f565c0ad3a0 legacy=0x7f565c073440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f565bfff640 1 -- 172.21.15.112:0/3821199660 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565c072960 con 0x7f565c0acf60 2024-09-15T23:55:37.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.918+0000 7f565b7fe640 1 -- 172.21.15.112:0/3821199660 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 894969103 0 0) 0x7f565c15b800 con 0x7f565c0ad3a0 2024-09-15T23:55:37.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f565bfff640 1 --2- 172.21.15.112:0/3821199660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f565c0acf60 0x7f565c06ef10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f56500097c0 tx=0x7f565001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1ddea3d593b7a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:37.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f565b7fe640 1 -- 172.21.15.112:0/3821199660 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56500b0070 con 0x7f565c0acf60 2024-09-15T23:55:37.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f565b7fe640 1 -- 172.21.15.112:0/3821199660 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56500ab600 con 0x7f565c0acf60 2024-09-15T23:55:37.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f565b7fe640 1 -- 172.21.15.112:0/3821199660 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56500ab9d0 con 0x7f565c0acf60 2024-09-15T23:55:37.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 -- 172.21.15.112:0/3821199660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f565c0acf60 msgr2=0x7f565c06ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 --2- 172.21.15.112:0/3821199660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f565c0acf60 0x7f565c06ef10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f56500097c0 tx=0x7f565001c410 comp rx=0 tx=0).stop 2024-09-15T23:55:37.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 -- 172.21.15.112:0/3821199660 shutdown_connections 2024-09-15T23:55:37.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 --2- 172.21.15.112:0/3821199660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f565c0acf60 0x7f565c06ef10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 --2- 172.21.15.112:0/3821199660 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f565c0af100 0x7f565c071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 -- 172.21.15.112:0/3821199660 >> 172.21.15.112:0/3821199660 conn(0x7f565c0b1c80 msgr2=0x7f565c0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:37.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 -- 172.21.15.112:0/3821199660 shutdown_connections 2024-09-15T23:55:37.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 -- 172.21.15.112:0/3821199660 wait complete. 2024-09-15T23:55:37.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 Processor -- start 2024-09-15T23:55:37.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 -- start start 2024-09-15T23:55:37.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f565c0acf60 0x7f565c155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f565c0ad3a0 0x7f565c1511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f565c0af100 0x7f565c157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f565c06f5d0 con 0x7f565c0ad3a0 2024-09-15T23:55:37.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f565c06f450 con 0x7f565c0acf60 2024-09-15T23:55:37.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f5662bde640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f565c06f750 con 0x7f565c0af100 2024-09-15T23:55:37.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f565bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f565c0ad3a0 0x7f565c1511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f565bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f565c0ad3a0 0x7f565c1511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41288/0 (socket says 172.21.15.112:41288) 2024-09-15T23:55:37.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.922+0000 7f565bfff640 1 -- 172.21.15.112:0/4196597250 learned_addr learned my addr 172.21.15.112:0/4196597250 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:37.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f565bfff640 1 -- 172.21.15.112:0/4196597250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f565c0af100 msgr2=0x7f565c157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f565bfff640 1 --2- 172.21.15.112:0/4196597250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f565c0af100 0x7f565c157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f565bfff640 1 -- 172.21.15.112:0/4196597250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f565c0acf60 msgr2=0x7f565c155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f566097a640 1 --2- 172.21.15.112:0/4196597250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f565c0acf60 0x7f565c155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f565bfff640 1 --2- 172.21.15.112:0/4196597250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f565c0acf60 0x7f565c155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f565bfff640 1 -- 172.21.15.112:0/4196597250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565c156c70 con 0x7f565c0ad3a0 2024-09-15T23:55:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f565bfff640 1 --2- 172.21.15.112:0/4196597250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f565c0ad3a0 0x7f565c1511a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f565001a040 tx=0x7f56500191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f56597fa640 1 -- 172.21.15.112:0/4196597250 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56500b8070 con 0x7f565c0ad3a0 2024-09-15T23:55:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f56597fa640 1 -- 172.21.15.112:0/4196597250 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56500b4410 con 0x7f565c0ad3a0 2024-09-15T23:55:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f5662bde640 1 -- 172.21.15.112:0/4196597250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f565c1557b0 con 0x7f565c0ad3a0 2024-09-15T23:55:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f56597fa640 1 -- 172.21.15.112:0/4196597250 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56500b0040 con 0x7f565c0ad3a0 2024-09-15T23:55:37.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f5662bde640 1 -- 172.21.15.112:0/4196597250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f565c157210 con 0x7f565c0ad3a0 2024-09-15T23:55:37.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f5662bde640 1 -- 172.21.15.112:0/4196597250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f565c06ef10 con 0x7f565c0ad3a0 2024-09-15T23:55:37.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f56597fa640 1 -- 172.21.15.112:0/4196597250 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f56500bb070 con 0x7f565c0ad3a0 2024-09-15T23:55:37.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f56597fa640 1 --2- 172.21.15.112:0/4196597250 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f56480678c0 0x7f5648069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f566097a640 1 --2- 172.21.15.112:0/4196597250 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f56480678c0 0x7f5648069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f56597fa640 1 -- 172.21.15.112:0/4196597250 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f565011fd30 con 0x7f565c0ad3a0 2024-09-15T23:55:37.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.926+0000 7f566097a640 1 --2- 172.21.15.112:0/4196597250 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f56480678c0 0x7f5648069d80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f564c009790 tx=0x7f564c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:37.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:37.930+0000 7f56597fa640 1 -- 172.21.15.112:0/4196597250 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5650016090 con 0x7f565c0ad3a0 2024-09-15T23:55:38.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.154+0000 7f5662bde640 1 -- 172.21.15.112:0/4196597250 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f565c159ce0 con 0x7f565c0ad3a0 2024-09-15T23:55:38.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.158+0000 7f56597fa640 1 -- 172.21.15.112:0/4196597250 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f56500f06e0 con 0x7f565c0ad3a0 2024-09-15T23:55:38.164 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-15T23:55:38.165 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw== 2024-09-15T23:55:38.165 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-15T23:55:38.165 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-15T23:55:38.165 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:55:38.165 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-15T23:55:38.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.162+0000 7f5662bde640 1 -- 172.21.15.112:0/4196597250 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f56480678c0 msgr2=0x7f5648069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.162+0000 7f5662bde640 1 --2- 172.21.15.112:0/4196597250 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f56480678c0 0x7f5648069d80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f564c009790 tx=0x7f564c008040 comp rx=0 tx=0).stop 2024-09-15T23:55:38.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.162+0000 7f5662bde640 1 -- 172.21.15.112:0/4196597250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f565c0ad3a0 msgr2=0x7f565c1511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.162+0000 7f5662bde640 1 --2- 172.21.15.112:0/4196597250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f565c0ad3a0 0x7f565c1511a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f565001a040 tx=0x7f56500191b0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.162+0000 7f5662bde640 1 -- 172.21.15.112:0/4196597250 shutdown_connections 2024-09-15T23:55:38.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.162+0000 7f5662bde640 1 --2- 172.21.15.112:0/4196597250 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f56480678c0 0x7f5648069d80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.162+0000 7f5662bde640 1 --2- 172.21.15.112:0/4196597250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f565c0af100 0x7f565c157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.162+0000 7f5662bde640 1 --2- 172.21.15.112:0/4196597250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f565c0ad3a0 0x7f565c1511a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.162+0000 7f5662bde640 1 --2- 172.21.15.112:0/4196597250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f565c0acf60 0x7f565c155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.162+0000 7f5662bde640 1 -- 172.21.15.112:0/4196597250 >> 172.21.15.112:0/4196597250 conn(0x7f565c0b1c80 msgr2=0x7f565c15e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:38.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.162+0000 7f5662bde640 1 -- 172.21.15.112:0/4196597250 shutdown_connections 2024-09-15T23:55:38.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.162+0000 7f5662bde640 1 -- 172.21.15.112:0/4196597250 wait complete. 2024-09-15T23:55:38.185 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:38.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a0e3e9640 1 Processor -- start 2024-09-15T23:55:38.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a0e3e9640 1 -- start start 2024-09-15T23:55:38.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a0e3e9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a08070020 0x7f4a0815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a0e3e9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a0815f1d0 0x7f4a080adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a0e3e9640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a080aede0 con 0x7f4a081520a0 2024-09-15T23:55:38.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a0e3e9640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4a08152480 con 0x7f4a0815f1d0 2024-09-15T23:55:38.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a0e3e9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0815fa10 con 0x7f4a08070020 2024-09-15T23:55:38.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a0c986640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a0815f1d0 0x7f4a080adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a0c986640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a0815f1d0 0x7f4a080adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41298/0 (socket says 172.21.15.112:41298) 2024-09-15T23:55:38.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a0c986640 1 -- 172.21.15.112:0/1983876580 learned_addr learned my addr 172.21.15.112:0/1983876580 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:38.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a07fff640 1 --1- 172.21.15.112:0/1983876580 >> v1:172.21.15.112:6789/0 conn(0x7f4a081520a0 0x7f4a0806f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:41894/0 (socket says 172.21.15.112:41894) 2024-09-15T23:55:38.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f49ff7fe640 1 --2- 172.21.15.112:0/1983876580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a08070020 0x7f4a0815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a0c986640 1 -- 172.21.15.112:0/1983876580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a08070020 msgr2=0x7f4a0815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:38.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a0c986640 1 --2- 172.21.15.112:0/1983876580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a08070020 0x7f4a0815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a0c986640 1 -- 172.21.15.112:0/1983876580 >> v1:172.21.15.112:6789/0 conn(0x7f4a081520a0 legacy=0x7f4a0806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a0c986640 1 -- 172.21.15.112:0/1983876580 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a08074250 con 0x7f4a0815f1d0 2024-09-15T23:55:38.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f49ff7fe640 1 --2- 172.21.15.112:0/1983876580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a08070020 0x7f4a0815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:38.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.302+0000 7f4a077fe640 1 -- 172.21.15.112:0/1983876580 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2156262396 0 0) 0x7f4a080aede0 con 0x7f4a081520a0 2024-09-15T23:55:38.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0c986640 1 --2- 172.21.15.112:0/1983876580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a0815f1d0 0x7f4a080adc80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009e80 tx=0x7f4a0001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bf85837eaf8e95 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:38.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a077fe640 1 -- 172.21.15.112:0/1983876580 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a000a58a0 con 0x7f4a0815f1d0 2024-09-15T23:55:38.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a077fe640 1 -- 172.21.15.112:0/1983876580 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a000a5a40 con 0x7f4a0815f1d0 2024-09-15T23:55:38.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a077fe640 1 -- 172.21.15.112:0/1983876580 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a000a5e10 con 0x7f4a0815f1d0 2024-09-15T23:55:38.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/1983876580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a0815f1d0 msgr2=0x7f4a080adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 --2- 172.21.15.112:0/1983876580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a0815f1d0 0x7f4a080adc80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009e80 tx=0x7f4a0001c9e0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/1983876580 shutdown_connections 2024-09-15T23:55:38.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 --2- 172.21.15.112:0/1983876580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a0815f1d0 0x7f4a080adc80 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 --2- 172.21.15.112:0/1983876580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a08070020 0x7f4a0815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/1983876580 >> 172.21.15.112:0/1983876580 conn(0x7f4a080b1f90 msgr2=0x7f4a080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:38.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/1983876580 shutdown_connections 2024-09-15T23:55:38.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/1983876580 wait complete. 2024-09-15T23:55:38.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 Processor -- start 2024-09-15T23:55:38.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 -- start start 2024-09-15T23:55:38.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a08070020 0x7f4a0814e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a081520a0 0x7f4a0809a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a0815f1d0 0x7f4a0806e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0815f680 con 0x7f4a0815f1d0 2024-09-15T23:55:38.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4a08073d30 con 0x7f4a08070020 2024-09-15T23:55:38.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0e3e9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4a08167f10 con 0x7f4a081520a0 2024-09-15T23:55:38.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0c986640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a0815f1d0 0x7f4a0806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0c986640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a0815f1d0 0x7f4a0806e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:41302/0 (socket says 172.21.15.112:41302) 2024-09-15T23:55:38.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0c986640 1 -- 172.21.15.112:0/342018231 learned_addr learned my addr 172.21.15.112:0/342018231 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:38.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f49ff7fe640 1 --2- 172.21.15.112:0/342018231 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a081520a0 0x7f4a0809a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a07fff640 1 --2- 172.21.15.112:0/342018231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a08070020 0x7f4a0814e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0c986640 1 -- 172.21.15.112:0/342018231 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a081520a0 msgr2=0x7f4a0809a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0c986640 1 --2- 172.21.15.112:0/342018231 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a081520a0 0x7f4a0809a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0c986640 1 -- 172.21.15.112:0/342018231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a08070020 msgr2=0x7f4a0814e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0c986640 1 --2- 172.21.15.112:0/342018231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a08070020 0x7f4a0814e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.306+0000 7f4a0c986640 1 -- 172.21.15.112:0/342018231 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0809bee0 con 0x7f4a0815f1d0 2024-09-15T23:55:38.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.310+0000 7f4a0c986640 1 --2- 172.21.15.112:0/342018231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a0815f1d0 0x7f4a0806e800 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4a000af040 tx=0x7f4a00019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:38.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.310+0000 7f4a057fa640 1 -- 172.21.15.112:0/342018231 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a000a58a0 con 0x7f4a0815f1d0 2024-09-15T23:55:38.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.310+0000 7f4a057fa640 1 -- 172.21.15.112:0/342018231 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a000bf070 con 0x7f4a0815f1d0 2024-09-15T23:55:38.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.310+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/342018231 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0809ae40 con 0x7f4a0815f1d0 2024-09-15T23:55:38.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.310+0000 7f4a057fa640 1 -- 172.21.15.112:0/342018231 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00009510 con 0x7f4a0815f1d0 2024-09-15T23:55:38.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.310+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/342018231 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a0809b400 con 0x7f4a0815f1d0 2024-09-15T23:55:38.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.310+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/342018231 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a0815ec90 con 0x7f4a0815f1d0 2024-09-15T23:55:38.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.310+0000 7f4a057fa640 1 -- 172.21.15.112:0/342018231 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a000b8680 con 0x7f4a0815f1d0 2024-09-15T23:55:38.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.310+0000 7f4a057fa640 1 --2- 172.21.15.112:0/342018231 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f49e80678c0 0x7f49e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.310+0000 7f4a057fa640 1 -- 172.21.15.112:0/342018231 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f4a00121250 con 0x7f4a0815f1d0 2024-09-15T23:55:38.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.310+0000 7f4a07fff640 1 --2- 172.21.15.112:0/342018231 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f49e80678c0 0x7f49e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.310+0000 7f4a07fff640 1 --2- 172.21.15.112:0/342018231 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f49e80678c0 0x7f49e8069d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f49f8000f70 tx=0x7f49f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:38.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.314+0000 7f4a057fa640 1 -- 172.21.15.112:0/342018231 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4a00016600 con 0x7f4a0815f1d0 2024-09-15T23:55:38.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.506+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/342018231 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a080af520 con 0x7f4a0815f1d0 2024-09-15T23:55:38.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.506+0000 7f4a057fa640 1 -- 172.21.15.112:0/342018231 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5232 (secure 0 0 0) 0x7f4a000f1c00 con 0x7f4a0815f1d0 2024-09-15T23:55:38.512 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:38.512 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":22,"btime":"2024-09-15T23:55:31:957534+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1762952607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1762952607},{"type":"v1","addr":"172.21.15.169:6834","nonce":1762952607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1383551321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1383551321},{"type":"v1","addr":"172.21.15.169:6835","nonce":1383551321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/235120639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":235120639},{"type":"v1","addr":"172.21.15.112:6835","nonce":235120639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:29.310328+0000","modified":"2024-09-15T23:55:31.304308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1037773891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1037773891},{"type":"v1","addr":"172.21.15.112:6837","nonce":1037773891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-15T23:55:38.512 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 22 2024-09-15T23:55:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.506+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/342018231 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f49e80678c0 msgr2=0x7f49e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.506+0000 7f4a0e3e9640 1 --2- 172.21.15.112:0/342018231 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f49e80678c0 0x7f49e8069d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f49f8000f70 tx=0x7f49f8009040 comp rx=0 tx=0).stop 2024-09-15T23:55:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.506+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/342018231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a0815f1d0 msgr2=0x7f4a0806e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.506+0000 7f4a0e3e9640 1 --2- 172.21.15.112:0/342018231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a0815f1d0 0x7f4a0806e800 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4a000af040 tx=0x7f4a00019780 comp rx=0 tx=0).stop 2024-09-15T23:55:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.506+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/342018231 shutdown_connections 2024-09-15T23:55:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.506+0000 7f4a0e3e9640 1 --2- 172.21.15.112:0/342018231 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f49e80678c0 0x7f49e8069d80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.506+0000 7f4a0e3e9640 1 --2- 172.21.15.112:0/342018231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a0815f1d0 0x7f4a0806e800 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.506+0000 7f4a0e3e9640 1 --2- 172.21.15.112:0/342018231 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a081520a0 0x7f4a0809a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.506+0000 7f4a0e3e9640 1 --2- 172.21.15.112:0/342018231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a08070020 0x7f4a0814e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.506+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/342018231 >> 172.21.15.112:0/342018231 conn(0x7f4a080b1f90 msgr2=0x7f4a0815b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.506+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/342018231 shutdown_connections 2024-09-15T23:55:38.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:38.506+0000 7f4a0e3e9640 1 -- 172.21.15.112:0/342018231 wait complete. 2024-09-15T23:55:38.932 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:55:29.310328+0000', 'modified': '2024-09-15T23:55:31.304308+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5307}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5307': {'gid': 5307, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6837/1037773891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 1037773891}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 1037773891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5307, 'qdb_cluster': [5307]} 2024-09-15T23:55:38.932 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:55:38.932 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T23:55:39.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe9362f3640 1 Processor -- start 2024-09-15T23:55:39.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe9362f3640 1 -- start start 2024-09-15T23:55:39.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe9362f3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe93015e6f0 0x7fe93006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe9362f3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9300b3720 0x7fe9300cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe9362f3640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe9300cf780 0x7fe9300ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe9362f3640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe9300cfbe0 con 0x7fe93015e6f0 2024-09-15T23:55:39.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe9362f3640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe930162290 con 0x7fe9300cf780 2024-09-15T23:55:39.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe9362f3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe930162570 con 0x7fe9300b3720 2024-09-15T23:55:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe92ffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe93015e6f0 0x7fe93006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe92ffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe93015e6f0 0x7fe93006c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39820/0 (socket says 172.21.15.112:39820) 2024-09-15T23:55:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe92ffff640 1 -- 172.21.15.112:0/2216199954 learned_addr learned my addr 172.21.15.112:0/2216199954 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/2216199954 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9300b3720 0x7fe9300cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe934890640 1 --2- 172.21.15.112:0/2216199954 >> v2:172.21.15.169:3300/0 conn(0x7fe9300cf780 0x7fe9300ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe92ffff640 1 -- 172.21.15.112:0/2216199954 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9300b3720 msgr2=0x7fe9300cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe92ffff640 1 --2- 172.21.15.112:0/2216199954 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9300b3720 0x7fe9300cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe92ffff640 1 -- 172.21.15.112:0/2216199954 >> v2:172.21.15.169:3300/0 conn(0x7fe9300cf780 msgr2=0x7fe9300ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe92ffff640 1 --2- 172.21.15.112:0/2216199954 >> v2:172.21.15.169:3300/0 conn(0x7fe9300cf780 0x7fe9300ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe92ffff640 1 -- 172.21.15.112:0/2216199954 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe930162850 con 0x7fe93015e6f0 2024-09-15T23:55:39.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.058+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/2216199954 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9300b3720 0x7fe9300cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:39.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe92ffff640 1 --2- 172.21.15.112:0/2216199954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe93015e6f0 0x7fe93006c6d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe9300b75d0 tx=0x7fe92001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fea4d82bf986f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe92effd640 1 -- 172.21.15.112:0/2216199954 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9200b0070 con 0x7fe93015e6f0 2024-09-15T23:55:39.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe92effd640 1 -- 172.21.15.112:0/2216199954 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9200ab600 con 0x7fe93015e6f0 2024-09-15T23:55:39.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe92effd640 1 -- 172.21.15.112:0/2216199954 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9200ab9d0 con 0x7fe93015e6f0 2024-09-15T23:55:39.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 -- 172.21.15.112:0/2216199954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe93015e6f0 msgr2=0x7fe93006c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 --2- 172.21.15.112:0/2216199954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe93015e6f0 0x7fe93006c6d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe9300b75d0 tx=0x7fe92001c260 comp rx=0 tx=0).stop 2024-09-15T23:55:39.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 -- 172.21.15.112:0/2216199954 shutdown_connections 2024-09-15T23:55:39.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 --2- 172.21.15.112:0/2216199954 >> v2:172.21.15.169:3300/0 conn(0x7fe9300cf780 0x7fe9300ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 --2- 172.21.15.112:0/2216199954 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9300b3720 0x7fe9300cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 --2- 172.21.15.112:0/2216199954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe93015e6f0 0x7fe93006c6d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 -- 172.21.15.112:0/2216199954 >> 172.21.15.112:0/2216199954 conn(0x7fe93009aa00 msgr2=0x7fe9300b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:39.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 -- 172.21.15.112:0/2216199954 shutdown_connections 2024-09-15T23:55:39.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 -- 172.21.15.112:0/2216199954 wait complete. 2024-09-15T23:55:39.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 Processor -- start 2024-09-15T23:55:39.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 -- start start 2024-09-15T23:55:39.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9300b3720 0x7fe9301fb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9300cf780 0x7fe93014e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe93015e6f0 0x7fe930158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe9300ae680 con 0x7fe9300cf780 2024-09-15T23:55:39.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe9300ae500 con 0x7fe9300b3720 2024-09-15T23:55:39.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.062+0000 7fe9362f3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe9300ae800 con 0x7fe93015e6f0 2024-09-15T23:55:39.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9300cf780 0x7fe93014e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9300cf780 0x7fe93014e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39826/0 (socket says 172.21.15.112:39826) 2024-09-15T23:55:39.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92f7fe640 1 -- 172.21.15.112:0/2054514765 learned_addr learned my addr 172.21.15.112:0/2054514765 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:39.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92ffff640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9300b3720 0x7fe9301fb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe934890640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe93015e6f0 0x7fe930158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92f7fe640 1 -- 172.21.15.112:0/2054514765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe93015e6f0 msgr2=0x7fe930158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe93015e6f0 0x7fe930158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92f7fe640 1 -- 172.21.15.112:0/2054514765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9300b3720 msgr2=0x7fe9301fb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9300b3720 0x7fe9301fb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92f7fe640 1 -- 172.21.15.112:0/2054514765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93014ed70 con 0x7fe9300cf780 2024-09-15T23:55:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe934890640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe93015e6f0 0x7fe930158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9300cf780 0x7fe93014e5d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe91800c7c0 tx=0x7fe91800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92cff9640 1 -- 172.21.15.112:0/2054514765 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918015070 con 0x7fe9300cf780 2024-09-15T23:55:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92cff9640 1 -- 172.21.15.112:0/2054514765 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe918007a30 con 0x7fe9300cf780 2024-09-15T23:55:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe9362f3640 1 -- 172.21.15.112:0/2054514765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe93014f050 con 0x7fe9300cf780 2024-09-15T23:55:39.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92cff9640 1 -- 172.21.15.112:0/2054514765 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918007e00 con 0x7fe9300cf780 2024-09-15T23:55:39.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe9362f3640 1 -- 172.21.15.112:0/2054514765 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe93014f610 con 0x7fe9300cf780 2024-09-15T23:55:39.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92cff9640 1 -- 172.21.15.112:0/2054514765 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe918018070 con 0x7fe9300cf780 2024-09-15T23:55:39.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92cff9640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9100678c0 0x7fe910069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92cff9640 1 -- 172.21.15.112:0/2054514765 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fe918085d20 con 0x7fe9300cf780 2024-09-15T23:55:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92ffff640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9100678c0 0x7fe910069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe92ffff640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9100678c0 0x7fe910069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe9200ad000 tx=0x7fe920008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe9393af000 1 Processor -- start 2024-09-15T23:55:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.066+0000 7fe9393af000 1 -- start start 2024-09-15T23:55:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85111b20 0x556d85111f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d85112440 0x556d850c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d850c8290 0x556d850c8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556d84fafb60 con 0x556d85112440 2024-09-15T23:55:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556d84f16c70 con 0x556d85111b20 2024-09-15T23:55:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x556d84ebced0 con 0x556d850c8290 2024-09-15T23:55:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe92f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d85112440 0x556d850c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe92f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d85112440 0x556d850c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39842/0 (socket says 172.21.15.112:39842) 2024-09-15T23:55:39.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe92f7fe640 1 -- 172.21.15.112:0/1336865213 learned_addr learned my addr 172.21.15.112:0/1336865213 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe92ffff640 1 --2- 172.21.15.112:0/1336865213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85111b20 0x556d85111f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe934890640 1 --2- 172.21.15.112:0/1336865213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d850c8290 0x556d850c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe92f7fe640 1 -- 172.21.15.112:0/1336865213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d850c8290 msgr2=0x556d850c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/1336865213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d850c8290 0x556d850c8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe92f7fe640 1 -- 172.21.15.112:0/1336865213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85111b20 msgr2=0x556d85111f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/1336865213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85111b20 0x556d85111f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe92f7fe640 1 -- 172.21.15.112:0/1336865213 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d84ecee50 con 0x556d85112440 2024-09-15T23:55:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/1336865213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d85112440 0x556d850c7d50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe91805e680 tx=0x7fe918056810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ea0d74e68bcd6f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe925ffb640 1 -- 172.21.15.112:0/1336865213 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91801f070 con 0x556d85112440 2024-09-15T23:55:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe925ffb640 1 -- 172.21.15.112:0/1336865213 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91806e020 con 0x556d85112440 2024-09-15T23:55:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe925ffb640 1 -- 172.21.15.112:0/1336865213 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91805ebb0 con 0x556d85112440 2024-09-15T23:55:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 -- 172.21.15.112:0/1336865213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d85112440 msgr2=0x556d850c7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 --2- 172.21.15.112:0/1336865213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d85112440 0x556d850c7d50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe91805e680 tx=0x7fe918056810 comp rx=0 tx=0).stop 2024-09-15T23:55:39.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 -- 172.21.15.112:0/1336865213 shutdown_connections 2024-09-15T23:55:39.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 --2- 172.21.15.112:0/1336865213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d850c8290 0x556d850c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 --2- 172.21.15.112:0/1336865213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d85112440 0x556d850c7d50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 --2- 172.21.15.112:0/1336865213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85111b20 0x556d85111f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 -- 172.21.15.112:0/1336865213 >> 172.21.15.112:0/1336865213 conn(0x556d850ce600 msgr2=0x556d850c6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:39.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 -- 172.21.15.112:0/1336865213 shutdown_connections 2024-09-15T23:55:39.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 -- 172.21.15.112:0/1336865213 wait complete. 2024-09-15T23:55:39.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 -- start start 2024-09-15T23:55:39.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 Processor -- start 2024-09-15T23:55:39.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d85111b20 0x556d850ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 0x556d850d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d850cd330 0x556d850d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556d84f78b00 con 0x556d850cd330 2024-09-15T23:55:39.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556d84ef1360 con 0x556d85112440 2024-09-15T23:55:39.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x556d84eee2d0 con 0x556d85111b20 2024-09-15T23:55:39.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe9393af000 10 client.0 _ll_register_callbacks cb 0x556d850b3820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:55:39.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe934890640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d850cd330 0x556d850d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe934890640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d850cd330 0x556d850d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39858/0 (socket says 172.21.15.112:39858) 2024-09-15T23:55:39.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe934890640 1 -- 172.21.15.112:0/1001940270 learned_addr learned my addr 172.21.15.112:0/1001940270 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:39.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe92ffff640 1 --2- 172.21.15.112:0/1001940270 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d85111b20 0x556d850ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe934890640 1 -- 172.21.15.112:0/1001940270 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d85111b20 msgr2=0x556d850ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:39.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/1001940270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 0x556d850d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe934890640 1 --2- 172.21.15.112:0/1001940270 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d85111b20 0x556d850ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe934890640 1 -- 172.21.15.112:0/1001940270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 msgr2=0x556d850d2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:39.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe934890640 1 --2- 172.21.15.112:0/1001940270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 0x556d850d2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.070+0000 7fe934890640 1 -- 172.21.15.112:0/1001940270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d84ebd120 con 0x556d850cd330 2024-09-15T23:55:39.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe934890640 1 --2- 172.21.15.112:0/1001940270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d850cd330 0x556d850d3230 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe92800e790 tx=0x7fe92800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dea9b90f370019 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe90effd640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:55:39.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe90effd640 1 -- 172.21.15.112:0/1001940270 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92801b060 con 0x556d850cd330 2024-09-15T23:55:39.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe90effd640 1 -- 172.21.15.112:0/1001940270 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fe92800cd60 con 0x556d850cd330 2024-09-15T23:55:39.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 -- 172.21.15.112:0/1001940270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe91806e020 con 0x556d850cd330 2024-09-15T23:55:39.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe90effd640 1 -- 172.21.15.112:0/1001940270 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe928021050 con 0x556d850cd330 2024-09-15T23:55:39.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 10 client.5457 fetch_fsmap learned FSMap version 22 2024-09-15T23:55:39.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 -- 172.21.15.112:0/1001940270 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x556d84eb6450 con 0x556d850cd330 2024-09-15T23:55:39.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe90effd640 1 -- 172.21.15.112:0/1001940270 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91806e020 con 0x556d850cd330 2024-09-15T23:55:39.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe90effd640 1 -- 172.21.15.112:0/1001940270 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7fe928024020 con 0x556d850cd330 2024-09-15T23:55:39.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 10 client.5457 fetch_fsmap finished waiting for FSMap version 22 2024-09-15T23:55:39.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 10 client.5457 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:55:39.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 20 client.5457 populate_metadata read hostname 'smithi112' 2024-09-15T23:55:39.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 --2- 172.21.15.112:0/1001940270 >> [v2:172.21.15.112:6836/1037773891,v1:172.21.15.112:6837/1037773891] conn(0x556d85120280 0x556d85122670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 4 client.5457 mds_command: new command op to 5307 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:55:39.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 -- 172.21.15.112:0/1001940270 --> [v2:172.21.15.112:6836/1037773891,v1:172.21.15.112:6837/1037773891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d84eb0c00 con 0x556d85120280 2024-09-15T23:55:39.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe92ffff640 1 --2- 172.21.15.112:0/1001940270 >> [v2:172.21.15.112:6836/1037773891,v1:172.21.15.112:6837/1037773891] conn(0x556d85120280 0x556d85122670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe92ffff640 1 --2- 172.21.15.112:0/1001940270 >> [v2:172.21.15.112:6836/1037773891,v1:172.21.15.112:6837/1037773891] conn(0x556d85120280 0x556d85122670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f759b7d1e903688f server_cookie=ef4e635e4985dc6c in_seq=0 out_seq=0 2024-09-15T23:55:39.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe90effd640 10 client.5457 ms_handle_connect on v2:172.21.15.112:6836/1037773891 2024-09-15T23:55:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe90effd640 1 -- 172.21.15.112:0/1001940270 <== mds.0 v2:172.21.15.112:6836/1037773891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d84eb0c00 con 0x556d85120280 2024-09-15T23:55:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe90effd640 10 client.5457 handle_command_reply: tid=0 2024-09-15T23:55:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 client.5457 shutdown 2024-09-15T23:55:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 -- 172.21.15.112:0/1001940270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d850cd330 msgr2=0x556d850d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 --2- 172.21.15.112:0/1001940270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d850cd330 0x556d850d3230 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe92800e790 tx=0x7fe92800ec50 comp rx=0 tx=0).stop 2024-09-15T23:55:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 -- 172.21.15.112:0/1001940270 shutdown_connections 2024-09-15T23:55:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 --2- 172.21.15.112:0/1001940270 >> [v2:172.21.15.112:6836/1037773891,v1:172.21.15.112:6837/1037773891] conn(0x556d85120280 0x556d85122670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 --2- 172.21.15.112:0/1001940270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d850cd330 0x556d850d3230 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 --2- 172.21.15.112:0/1001940270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 0x556d850d2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe90effd640 0 client.5457 ms_handle_reset on v2:172.21.15.112:6836/1037773891 2024-09-15T23:55:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 --2- 172.21.15.112:0/1001940270 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d85111b20 0x556d850ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 -- 172.21.15.112:0/1001940270 >> 172.21.15.112:0/1001940270 conn(0x556d850c8290 msgr2=0x556d850c6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 -- 172.21.15.112:0/1001940270 shutdown_connections 2024-09-15T23:55:39.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 1 -- 172.21.15.112:0/1001940270 wait complete. 2024-09-15T23:55:39.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.074+0000 7fe9393af000 20 client.5457 trim_cache size 0 max 16384 2024-09-15T23:55:39.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 Processor -- start 2024-09-15T23:55:39.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 -- start start 2024-09-15T23:55:39.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d850cd330 0x556d85110c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d85111b20 0x556d851111d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 0x556d85122670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe9302041f0 con 0x556d85111b20 2024-09-15T23:55:39.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe9302031d0 con 0x556d85112440 2024-09-15T23:55:39.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe9301f8510 con 0x556d850cd330 2024-09-15T23:55:39.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe92f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d85111b20 0x556d851111d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe92f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d85111b20 0x556d851111d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39874/0 (socket says 172.21.15.112:39874) 2024-09-15T23:55:39.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe92f7fe640 1 -- 172.21.15.112:0/4198446668 learned_addr learned my addr 172.21.15.112:0/4198446668 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:39.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe92f7fe640 1 -- 172.21.15.112:0/4198446668 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d850cd330 msgr2=0x556d85110c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:39.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/4198446668 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d850cd330 0x556d85110c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe92f7fe640 1 -- 172.21.15.112:0/4198446668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 msgr2=0x556d85122670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:39.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/4198446668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 0x556d85122670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe92f7fe640 1 -- 172.21.15.112:0/4198446668 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d84e9dfd0 con 0x556d85111b20 2024-09-15T23:55:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/4198446668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d85111b20 0x556d851111d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe918084110 tx=0x7fe91801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cdcd20f378eb5f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9257fa640 1 -- 172.21.15.112:0/4198446668 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91806e030 con 0x556d85111b20 2024-09-15T23:55:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9257fa640 1 -- 172.21.15.112:0/4198446668 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91805ebb0 con 0x556d85111b20 2024-09-15T23:55:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9257fa640 1 -- 172.21.15.112:0/4198446668 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918052640 con 0x556d85111b20 2024-09-15T23:55:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 -- 172.21.15.112:0/4198446668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d85111b20 msgr2=0x556d851111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 --2- 172.21.15.112:0/4198446668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d85111b20 0x556d851111d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe918084110 tx=0x7fe91801f000 comp rx=0 tx=0).stop 2024-09-15T23:55:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 -- 172.21.15.112:0/4198446668 shutdown_connections 2024-09-15T23:55:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 --2- 172.21.15.112:0/4198446668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 0x556d85122670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 --2- 172.21.15.112:0/4198446668 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d85111b20 0x556d851111d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 --2- 172.21.15.112:0/4198446668 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d850cd330 0x556d85110c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 -- 172.21.15.112:0/4198446668 >> 172.21.15.112:0/4198446668 conn(0x556d850c8290 msgr2=0x556d850cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 -- 172.21.15.112:0/4198446668 shutdown_connections 2024-09-15T23:55:39.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 -- 172.21.15.112:0/4198446668 wait complete. 2024-09-15T23:55:39.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 -- start start 2024-09-15T23:55:39.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.094+0000 7fe9393af000 1 Processor -- start 2024-09-15T23:55:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d850cd330 0x556d85125590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d85111b20 0x556d85149170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 0x556d851496b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556d84f15f80 con 0x556d850cd330 2024-09-15T23:55:39.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556d84ececa0 con 0x556d85112440 2024-09-15T23:55:39.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x556d84f1b2a0 con 0x556d85111b20 2024-09-15T23:55:39.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 10 client.0 _ll_register_callbacks cb 0x7fe9280096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:55:39.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe92ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d850cd330 0x556d85125590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe92ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d850cd330 0x556d85125590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39884/0 (socket says 172.21.15.112:39884) 2024-09-15T23:55:39.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe92ffff640 1 -- 172.21.15.112:0/436193757 learned_addr learned my addr 172.21.15.112:0/436193757 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:39.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe934890640 1 --2- 172.21.15.112:0/436193757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 0x556d851496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/436193757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d85111b20 0x556d85149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe92ffff640 1 -- 172.21.15.112:0/436193757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d85111b20 msgr2=0x556d85149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:39.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe92ffff640 1 --2- 172.21.15.112:0/436193757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d85111b20 0x556d85149170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe92ffff640 1 -- 172.21.15.112:0/436193757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 msgr2=0x556d851496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:39.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe92ffff640 1 --2- 172.21.15.112:0/436193757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 0x556d851496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe92ffff640 1 -- 172.21.15.112:0/436193757 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d84f99750 con 0x556d850cd330 2024-09-15T23:55:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe934890640 1 --2- 172.21.15.112:0/436193757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 0x556d851496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe92ffff640 1 --2- 172.21.15.112:0/436193757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d850cd330 0x556d85125590 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe920000c10 tx=0x7fe920019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32b5ca23af35792 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe90effd640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:55:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe90effd640 1 -- 172.21.15.112:0/436193757 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9200cf060 con 0x556d850cd330 2024-09-15T23:55:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe90effd640 1 -- 172.21.15.112:0/436193757 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fe9200b5460 con 0x556d850cd330 2024-09-15T23:55:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 -- 172.21.15.112:0/436193757 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe91805ebb0 con 0x556d850cd330 2024-09-15T23:55:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe90effd640 1 -- 172.21.15.112:0/436193757 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe9200d5050 con 0x556d850cd330 2024-09-15T23:55:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 10 client.5463 fetch_fsmap learned FSMap version 22 2024-09-15T23:55:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 -- 172.21.15.112:0/436193757 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x556d84ea4a30 con 0x556d850cd330 2024-09-15T23:55:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe90effd640 1 -- 172.21.15.112:0/436193757 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91805ebb0 con 0x556d850cd330 2024-09-15T23:55:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe90effd640 1 -- 172.21.15.112:0/436193757 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7fe9200d8020 con 0x556d850cd330 2024-09-15T23:55:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 10 client.5463 fetch_fsmap finished waiting for FSMap version 22 2024-09-15T23:55:39.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 10 client.5463 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:55:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 20 client.5463 populate_metadata read hostname 'smithi112' 2024-09-15T23:55:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 --2- 172.21.15.112:0/436193757 >> [v2:172.21.15.112:6836/1037773891,v1:172.21.15.112:6837/1037773891] conn(0x556d85149bf0 0x556d8518d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 4 client.5463 mds_command: new command op to 5307 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:55:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 -- 172.21.15.112:0/436193757 --> [v2:172.21.15.112:6836/1037773891,v1:172.21.15.112:6837/1037773891] -- command(tid 0: {"prefix": "status"}) -- 0x556d84f243a0 con 0x556d85149bf0 2024-09-15T23:55:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/436193757 >> [v2:172.21.15.112:6836/1037773891,v1:172.21.15.112:6837/1037773891] conn(0x556d85149bf0 0x556d8518d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe92f7fe640 1 --2- 172.21.15.112:0/436193757 >> [v2:172.21.15.112:6836/1037773891,v1:172.21.15.112:6837/1037773891] conn(0x556d85149bf0 0x556d8518d870 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bb0f0b2cc51ed45 server_cookie=5879f88ffd77fed in_seq=0 out_seq=0 2024-09-15T23:55:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe90effd640 10 client.5463 ms_handle_connect on v2:172.21.15.112:6836/1037773891 2024-09-15T23:55:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe90effd640 1 -- 172.21.15.112:0/436193757 <== mds.0 v2:172.21.15.112:6836/1037773891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x556d84f243a0 con 0x556d85149bf0 2024-09-15T23:55:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe90effd640 10 client.5463 handle_command_reply: tid=0 2024-09-15T23:55:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 client.5463 shutdown 2024-09-15T23:55:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 -- 172.21.15.112:0/436193757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d850cd330 msgr2=0x556d85125590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 --2- 172.21.15.112:0/436193757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d850cd330 0x556d85125590 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe920000c10 tx=0x7fe920019000 comp rx=0 tx=0).stop 2024-09-15T23:55:39.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 -- 172.21.15.112:0/436193757 shutdown_connections 2024-09-15T23:55:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 --2- 172.21.15.112:0/436193757 >> [v2:172.21.15.112:6836/1037773891,v1:172.21.15.112:6837/1037773891] conn(0x556d85149bf0 0x556d8518d870 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 --2- 172.21.15.112:0/436193757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d85112440 0x556d851496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 --2- 172.21.15.112:0/436193757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x556d85111b20 0x556d85149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe90effd640 0 client.5463 ms_handle_reset on v2:172.21.15.112:6836/1037773891 2024-09-15T23:55:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 --2- 172.21.15.112:0/436193757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556d850cd330 0x556d85125590 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 -- 172.21.15.112:0/436193757 >> 172.21.15.112:0/436193757 conn(0x556d850c8290 msgr2=0x556d8510fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 -- 172.21.15.112:0/436193757 shutdown_connections 2024-09-15T23:55:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 1 -- 172.21.15.112:0/436193757 wait complete. 2024-09-15T23:55:39.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9393af000 20 client.5463 trim_cache size 0 max 16384 2024-09-15T23:55:39.112 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:55:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "1af6b673-4d40-4109-af4e-78662faa7df8", 2024-09-15T23:55:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-15T23:55:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5307, 2024-09-15T23:55:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-15T23:55:39.112 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-15T23:55:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-15T23:55:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 9.1670453199999997, 2024-09-15T23:55:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 22, 2024-09-15T23:55:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 51, 2024-09-15T23:55:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 51, 2024-09-15T23:55:39.113 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 14.143583032 2024-09-15T23:55:39.113 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:55:39.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9362f3640 1 -- 172.21.15.112:0/2054514765 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9100678c0 msgr2=0x7fe910069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9362f3640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9100678c0 0x7fe910069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe9200ad000 tx=0x7fe920008040 comp rx=0 tx=0).stop 2024-09-15T23:55:39.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9362f3640 1 -- 172.21.15.112:0/2054514765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9300cf780 msgr2=0x7fe93014e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9362f3640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9300cf780 0x7fe93014e5d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe91800c7c0 tx=0x7fe91800cc80 comp rx=0 tx=0).stop 2024-09-15T23:55:39.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9362f3640 1 -- 172.21.15.112:0/2054514765 shutdown_connections 2024-09-15T23:55:39.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9362f3640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9100678c0 0x7fe910069d80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9362f3640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe93015e6f0 0x7fe930158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9362f3640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9300cf780 0x7fe93014e5d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9362f3640 1 --2- 172.21.15.112:0/2054514765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9300b3720 0x7fe9301fb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9362f3640 1 -- 172.21.15.112:0/2054514765 >> 172.21.15.112:0/2054514765 conn(0x7fe93009aa00 msgr2=0x7fe9301550d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:39.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9362f3640 1 -- 172.21.15.112:0/2054514765 shutdown_connections 2024-09-15T23:55:39.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.098+0000 7fe9362f3640 1 -- 172.21.15.112:0/2054514765 wait complete. 2024-09-15T23:55:39.121 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:55:39.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.226+0000 7f7fba786640 1 Processor -- start 2024-09-15T23:55:39.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.226+0000 7f7fba786640 1 -- start start 2024-09-15T23:55:39.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.226+0000 7f7fba786640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fb41520a0 0x7f7fb406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fba786640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb4070250 con 0x7f7fb415f3a0 2024-09-15T23:55:39.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fba786640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb40aede0 con 0x7f7fb406fe50 2024-09-15T23:55:39.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fba786640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb4152480 con 0x7f7fb41520a0 2024-09-15T23:55:39.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb8d23640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7fb415f3a0 0x7f7fb40adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60896/0 (socket says 172.21.15.112:60896) 2024-09-15T23:55:39.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb8d23640 1 -- 172.21.15.112:0/3923863953 learned_addr learned my addr 172.21.15.112:0/3923863953 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:39.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb3fff640 1 --2- 172.21.15.112:0/3923863953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fb41520a0 0x7f7fb406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 -- 172.21.15.112:0/3923863953 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1319753809 0 0) 0x7f7fb4070250 con 0x7f7fb415f3a0 2024-09-15T23:55:39.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 -- 172.21.15.112:0/3923863953 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f9c003530 con 0x7f7fb415f3a0 2024-09-15T23:55:39.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 -- 172.21.15.112:0/3923863953 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2807620154 0 0) 0x7f7f9c003530 con 0x7f7fb415f3a0 2024-09-15T23:55:39.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 -- 172.21.15.112:0/3923863953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fb41520a0 msgr2=0x7f7fb406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:39.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 --2- 172.21.15.112:0/3923863953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fb41520a0 0x7f7fb406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 -- 172.21.15.112:0/3923863953 >> v1:172.21.15.169:6789/0 conn(0x7f7fb406fe50 legacy=0x7f7fb415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 -- 172.21.15.112:0/3923863953 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb415fa10 con 0x7f7fb415f3a0 2024-09-15T23:55:39.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 -- 172.21.15.112:0/3923863953 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f7fac001a00 con 0x7f7fb415f3a0 2024-09-15T23:55:39.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 -- 172.21.15.112:0/3923863953 >> v1:172.21.15.112:6789/0 conn(0x7f7fb415f3a0 legacy=0x7f7fb40adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 --2- 172.21.15.112:0/3923863953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f9c0039f0 0x7f7f9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 --2- 172.21.15.112:0/3923863953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fb41520a0 0x7f7f9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 --2- 172.21.15.112:0/3923863953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f9c004d50 0x7f7f9c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 -- 172.21.15.112:0/3923863953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c00ba80 con 0x7f7f9c0039f0 2024-09-15T23:55:39.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 -- 172.21.15.112:0/3923863953 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c00bc00 con 0x7f7f9c004d50 2024-09-15T23:55:39.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 -- 172.21.15.112:0/3923863953 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7f9c00e010 con 0x7f7fb41520a0 2024-09-15T23:55:39.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb3fff640 1 --2- 172.21.15.112:0/3923863953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f9c0039f0 0x7f7f9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb3fff640 1 -- 172.21.15.112:0/3923863953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fb41520a0 msgr2=0x7f7f9c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:39.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb3fff640 1 --2- 172.21.15.112:0/3923863953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fb41520a0 0x7f7f9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb8d23640 1 --2- 172.21.15.112:0/3923863953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f9c004d50 0x7f7f9c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb3fff640 1 -- 172.21.15.112:0/3923863953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f9c004d50 msgr2=0x7f7f9c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:39.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb3fff640 1 --2- 172.21.15.112:0/3923863953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f9c004d50 0x7f7f9c0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb3fff640 1 -- 172.21.15.112:0/3923863953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9c003530 con 0x7f7f9c0039f0 2024-09-15T23:55:39.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb3fff640 1 --2- 172.21.15.112:0/3923863953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f9c0039f0 0x7f7f9c003e10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009a90 tx=0x7f7fa401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b7bce1e0c59fe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 -- 172.21.15.112:0/3923863953 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40b2070 con 0x7f7f9c0039f0 2024-09-15T23:55:39.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 -- 172.21.15.112:0/3923863953 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa40a5640 con 0x7f7f9c0039f0 2024-09-15T23:55:39.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.230+0000 7f7fb2ffd640 1 -- 172.21.15.112:0/3923863953 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4009690 con 0x7f7f9c0039f0 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 -- 172.21.15.112:0/3923863953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f9c0039f0 msgr2=0x7f7f9c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 --2- 172.21.15.112:0/3923863953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f9c0039f0 0x7f7f9c003e10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009a90 tx=0x7f7fa401ca70 comp rx=0 tx=0).stop 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb8d23640 1 -- 172.21.15.112:0/3923863953 reap_dead start 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 -- 172.21.15.112:0/3923863953 shutdown_connections 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 -- 172.21.15.112:0/3923863953 >> 172.21.15.112:0/3923863953 conn(0x7f7fb40b1f90 msgr2=0x7f7fb40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 -- 172.21.15.112:0/3923863953 shutdown_connections 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 -- 172.21.15.112:0/3923863953 wait complete. 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 Processor -- start 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 -- start start 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f9c0039f0 0x7f7fb40cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fb40cf900 0x7f7fb414d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fb41f2350 0x7f7fb414b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb4073d30 con 0x7f7fb40cf900 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb4073a50 con 0x7f7f9c0039f0 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb406e800 con 0x7f7fb41f2350 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fb40cf900 0x7f7fb414d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fb40cf900 0x7f7fb414d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39900/0 (socket says 172.21.15.112:39900) 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb37fe640 1 -- 172.21.15.112:0/1496212009 learned_addr learned my addr 172.21.15.112:0/1496212009 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb3fff640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f9c0039f0 0x7f7fb40cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb8d23640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fb41f2350 0x7f7fb414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb37fe640 1 -- 172.21.15.112:0/1496212009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fb41f2350 msgr2=0x7f7fb414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb37fe640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fb41f2350 0x7f7fb414b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb37fe640 1 -- 172.21.15.112:0/1496212009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f9c0039f0 msgr2=0x7f7fb40cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb37fe640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f9c0039f0 0x7f7fb40cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb37fe640 1 -- 172.21.15.112:0/1496212009 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb40cd9d0 con 0x7f7fb40cf900 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb8d23640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fb41f2350 0x7f7fb414b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb37fe640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fb40cf900 0x7f7fb414d2b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800c4b0 tx=0x7f7fa800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb0ff9640 1 -- 172.21.15.112:0/1496212009 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80052d0 con 0x7f7fb40cf900 2024-09-15T23:55:39.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb0ff9640 1 -- 172.21.15.112:0/1496212009 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa8005490 con 0x7f7fb40cf900 2024-09-15T23:55:39.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 -- 172.21.15.112:0/1496212009 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb40cdcb0 con 0x7f7fb40cf900 2024-09-15T23:55:39.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fb0ff9640 1 -- 172.21.15.112:0/1496212009 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8012850 con 0x7f7fb40cf900 2024-09-15T23:55:39.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.234+0000 7f7fba786640 1 -- 172.21.15.112:0/1496212009 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb40ce270 con 0x7f7fb40cf900 2024-09-15T23:55:39.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.238+0000 7f7fba786640 1 -- 172.21.15.112:0/1496212009 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb415ec90 con 0x7f7fb40cf900 2024-09-15T23:55:39.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.238+0000 7f7fb0ff9640 1 -- 172.21.15.112:0/1496212009 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7fa80129f0 con 0x7f7fb40cf900 2024-09-15T23:55:39.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.238+0000 7f7fb0ff9640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7fa00678c0 0x7f7fa0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.238+0000 7f7fb0ff9640 1 -- 172.21.15.112:0/1496212009 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f7fa8085a60 con 0x7f7fb40cf900 2024-09-15T23:55:39.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.238+0000 7f7fb3fff640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7fa00678c0 0x7f7fa0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.238+0000 7f7fb3fff640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7fa00678c0 0x7f7fa0069d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40af000 tx=0x7f7fa40046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.242+0000 7f7fb0ff9640 1 -- 172.21.15.112:0/1496212009 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7fa8056410 con 0x7f7fb40cf900 2024-09-15T23:55:39.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.434+0000 7f7fba786640 1 -- 172.21.15.112:0/1496212009 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7fb40b4a00 con 0x7f7fb40cf900 2024-09-15T23:55:39.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.434+0000 7f7fb0ff9640 1 -- 172.21.15.112:0/1496212009 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) ==== 53+0+73 (secure 0 0 0) 0x7f7fa8055d10 con 0x7f7fb40cf900 2024-09-15T23:55:39.446 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:55:39.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.438+0000 7f7fba786640 1 -- 172.21.15.112:0/1496212009 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7fa00678c0 msgr2=0x7f7fa0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.438+0000 7f7fba786640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7fa00678c0 0x7f7fa0069d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40af000 tx=0x7f7fa40046d0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.438+0000 7f7fba786640 1 -- 172.21.15.112:0/1496212009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fb40cf900 msgr2=0x7f7fb414d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.438+0000 7f7fba786640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fb40cf900 0x7f7fb414d2b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800c4b0 tx=0x7f7fa800c970 comp rx=0 tx=0).stop 2024-09-15T23:55:39.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.438+0000 7f7fba786640 1 -- 172.21.15.112:0/1496212009 shutdown_connections 2024-09-15T23:55:39.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.438+0000 7f7fba786640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7fa00678c0 0x7f7fa0069d80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.438+0000 7f7fba786640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fb41f2350 0x7f7fb414b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.438+0000 7f7fba786640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fb40cf900 0x7f7fb414d2b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.438+0000 7f7fba786640 1 --2- 172.21.15.112:0/1496212009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f9c0039f0 0x7f7fb40cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.438+0000 7f7fba786640 1 -- 172.21.15.112:0/1496212009 >> 172.21.15.112:0/1496212009 conn(0x7f7fb40b1f90 msgr2=0x7f7fb406ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:39.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.438+0000 7f7fba786640 1 -- 172.21.15.112:0/1496212009 shutdown_connections 2024-09-15T23:55:39.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39.438+0000 7f7fba786640 1 -- 172.21.15.112:0/1496212009 wait complete. 2024-09-15T23:55:39.458 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:55:39.459 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:55:39.459 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-15T23:55:39.459 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:55:39.459 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:39.459 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:55:39.459 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:55:39.459 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:55:39.459 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:55:39.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:39.459 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-15T23:55:39.465 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:55:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:55:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:55:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-15T23:55:39.465 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:39.465 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:55:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-15T23:55:39.466 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:55:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-15T23:55:39.466 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:55:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:39.466 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:55:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T23:55:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42357sec preferred_lft 42357sec 2024-09-15T23:55:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2024-09-15T23:55:39.466 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:39.466 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T23:55:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:5c:cd:1e:d6 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T23:55:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:39.467 INFO:teuthology.orchestra.run.smithi112.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:55:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:55:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T23:55:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:39.467 INFO:teuthology.orchestra.run.smithi112.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:55:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T23:55:39.467 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:39.467 INFO:teuthology.orchestra.run.smithi112.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:55:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:55:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T23:55:39.468 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:39.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:39.468 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:55:39.514 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-15T23:55:39.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:39.516 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-15T23:55:39.570 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-15T23:55:39.570 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:55:39.571 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T23:55:39.571 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:55:39.571 INFO:teuthology.orchestra.run.smithi112.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T23:55:39.571 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T23:55:39.571 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:55:39.571 INFO:teuthology.orchestra.run.smithi112.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:55:39.571 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:55:39.571 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:55:39.571 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:55:39.572 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:55:39.572 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:55:39.572 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:55:39.572 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:55:39.572 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:55:39.572 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:55:39.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:55:39.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:39.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:39.692 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-15T23:55:39.738 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:55:39.739 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:55:39.739 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:55:39.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:39.739 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-15T23:55:39.794 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T23:55:39.794 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:55:39.794 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:39.843 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:55:39.843 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:55:39.843 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:39.890 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:55:39.948 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:55:40.000 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:55:40.000 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:55:40.000 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:55:40.000 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:55:40.000 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:55:40.000 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:55:40.001 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:55:40.001 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:55:40.001 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:55:40.002 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:55:40.002 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:55:40.002 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:55:40.002 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:55:40.002 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:55:40.002 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:55:40.002 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:55:40.002 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:55:40.002 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:55:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:55:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:55:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:55:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:55:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:55:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:55:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:55:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:55:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:55:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:55:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:55:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:40.003 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:55:40.004 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:55:40.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:40.005 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:55:40.051 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:55:40.051 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T23:55:40.100 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:55:40.115 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:55:40.167 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:55:40.167 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:55:40.167 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:55:40.167 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:55:40.167 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:55:40.167 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:55:40.167 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:55:40.168 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:55:40.168 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:55:40.168 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:55:40.168 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:55:40.168 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:55:40.168 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:55:40.168 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:55:40.168 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:55:40.168 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:55:40.168 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:55:40.168 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:55:40.168 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:55:40.168 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:55:40.168 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:55:40.169 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:55:40.169 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:55:40.169 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:55:40.169 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:55:40.169 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:55:40.169 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:55:40.169 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:55:40.169 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:55:40.169 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:40.169 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:40.169 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:55:40.169 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:55:40.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:40.170 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:55:40.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:2024-09-15T23:55:40.170+0000 7fbf27d90580 -1 init, newargv = 0x5591cd338040 newargc=15 2024-09-15T23:55:40.177 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[39253]: starting ceph client 2024-09-15T23:55:40.183 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[39253]: starting fuse 2024-09-15T23:55:41.281 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:55:41.298 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:55:41.349 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:55:41.350 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:55:41.350 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:55:41.350 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:55:41.350 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:55:41.350 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:55:41.350 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:55:41.350 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:55:41.350 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:55:41.350 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:55:41.350 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:55:41.351 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:55:41.351 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:55:41.351 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:55:41.351 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:55:41.351 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:55:41.351 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:55:41.351 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:55:41.351 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:55:41.351 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:55:41.351 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:55:41.351 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:55:41.352 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:55:41.352 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:55:41.352 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:55:41.352 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:55:41.352 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:55:41.352 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:55:41.352 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:55:41.352 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:41.352 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:41.352 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:55:41.352 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:55:41.353 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:41.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:41.354 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:55:41.403 INFO:teuthology.orchestra.run.smithi112.stdout:45 2024-09-15T23:55:41.404 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T23:55:41.404 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:55:41.404 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2024-09-15T23:55:41.404 DEBUG:teuthology.orchestra.run.smithi112:> import re 2024-09-15T23:55:41.404 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:55:41.404 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-15T23:55:41.404 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:55:41.404 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2024-09-15T23:55:41.404 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2024-09-15T23:55:41.405 DEBUG:teuthology.orchestra.run.smithi112:> return f 2024-09-15T23:55:41.406 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:55:41.406 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:55:41.406 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.0")) 2024-09-15T23:55:41.406 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:55:41.527 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.0.39253.asok 2024-09-15T23:55:41.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:41.539 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39253.asok 2024-09-15T23:55:41.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:41.539 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39253.asok status 2024-09-15T23:55:41.698 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:55:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2024-09-15T23:55:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:55:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:55:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "0", 2024-09-15T23:55:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2024-09-15T23:55:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:55:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "39253", 2024-09-15T23:55:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2024-09-15T23:55:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2024-09-15T23:55:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2024-09-15T23:55:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5475, 2024-09-15T23:55:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2024-09-15T23:55:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2024-09-15T23:55:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2024-09-15T23:55:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 5475 2024-09-15T23:55:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:55:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:55:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:55:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 4208135966 2024-09-15T23:55:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:55:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:55:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:55:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:55:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 4208135966 2024-09-15T23:55:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:55:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.5475 192.168.0.1:0/4208135966", 2024-09-15T23:55:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.1:0/4208135966", 2024-09-15T23:55:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2024-09-15T23:55:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 22, 2024-09-15T23:55:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 51, 2024-09-15T23:55:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:55:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2024-09-15T23:55:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2024-09-15T23:55:41.700 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:55:41.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:41.712 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2024-09-15T23:55:41.712 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:41.717 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2024-09-15T23:55:41.718 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:41.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:41.718 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:41.771 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_fragment_size_max 50 2024-09-15T23:55:41.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff3499640 1 Processor -- start 2024-09-15T23:55:41.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff3499640 1 -- start start 2024-09-15T23:55:41.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff3499640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1fec161a60 0x7f1fec0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:41.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff3499640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fec0cf620 0x7f1fec06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:41.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff3499640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fec0d32b0 con 0x7f1fec0d2e90 2024-09-15T23:55:41.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff3499640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1fec0d0300 con 0x7f1fec161a60 2024-09-15T23:55:41.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff3499640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec0cfab0 con 0x7f1fec0cf620 2024-09-15T23:55:41.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff0a34640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1fec0d2e90 0x7f1fec0cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:60906/0 (socket says 172.21.15.112:60906) 2024-09-15T23:55:41.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff0a34640 1 -- 172.21.15.112:0/1324577009 learned_addr learned my addr 172.21.15.112:0/1324577009 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:41.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff1235640 1 --2- 172.21.15.112:0/1324577009 >> v2:172.21.15.169:3300/0 conn(0x7f1fec161a60 0x7f1fec0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:41.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 -- 172.21.15.112:0/1324577009 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950475526 0 0) 0x7f1fec0d32b0 con 0x7f1fec0d2e90 2024-09-15T23:55:41.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff1a36640 1 --2- 172.21.15.112:0/1324577009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fec0cf620 0x7f1fec06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:41.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 -- 172.21.15.112:0/1324577009 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fd8003530 con 0x7f1fec0d2e90 2024-09-15T23:55:41.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 -- 172.21.15.112:0/1324577009 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2109141904 0 0) 0x7f1fd8003530 con 0x7f1fec0d2e90 2024-09-15T23:55:41.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 -- 172.21.15.112:0/1324577009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fec0cf620 msgr2=0x7f1fec06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:41.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 --2- 172.21.15.112:0/1324577009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fec0cf620 0x7f1fec06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:41.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 -- 172.21.15.112:0/1324577009 >> v2:172.21.15.169:3300/0 conn(0x7f1fec161a60 msgr2=0x7f1fec0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:41.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 --2- 172.21.15.112:0/1324577009 >> v2:172.21.15.169:3300/0 conn(0x7f1fec161a60 0x7f1fec0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:41.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 -- 172.21.15.112:0/1324577009 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec0b0f60 con 0x7f1fec0d2e90 2024-09-15T23:55:41.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 -- 172.21.15.112:0/1324577009 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f1fdc001680 con 0x7f1fec0d2e90 2024-09-15T23:55:41.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 -- 172.21.15.112:0/1324577009 >> v1:172.21.15.112:6789/0 conn(0x7f1fec0d2e90 legacy=0x7f1fec0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:41.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 --2- 172.21.15.112:0/1324577009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd80039c0 0x7f1fd8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:41.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 --2- 172.21.15.112:0/1324577009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fec0cf620 0x7f1fd8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:41.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 --2- 172.21.15.112:0/1324577009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fd8004d50 0x7f1fd80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:41.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 -- 172.21.15.112:0/1324577009 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0d0300 con 0x7f1fd80039c0 2024-09-15T23:55:41.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 -- 172.21.15.112:0/1324577009 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0cfab0 con 0x7f1fd8004d50 2024-09-15T23:55:41.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1fe3fff640 1 -- 172.21.15.112:0/1324577009 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd800ba00 con 0x7f1fec0cf620 2024-09-15T23:55:41.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff1235640 1 --2- 172.21.15.112:0/1324577009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd80039c0 0x7f1fd8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:41.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff0a34640 1 --2- 172.21.15.112:0/1324577009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fec0cf620 0x7f1fd8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:41.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff1a36640 1 --2- 172.21.15.112:0/1324577009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fd8004d50 0x7f1fd80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:41.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff0a34640 1 -- 172.21.15.112:0/1324577009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fd8004d50 msgr2=0x7f1fd80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:41.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff0a34640 1 --2- 172.21.15.112:0/1324577009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fd8004d50 0x7f1fd80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:41.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff0a34640 1 -- 172.21.15.112:0/1324577009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd80039c0 msgr2=0x7f1fd8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:41.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff0a34640 1 --2- 172.21.15.112:0/1324577009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd80039c0 0x7f1fd8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:41.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff0a34640 1 -- 172.21.15.112:0/1324577009 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd8003530 con 0x7f1fec0cf620 2024-09-15T23:55:41.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.938+0000 7f1ff1235640 1 --2- 172.21.15.112:0/1324577009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fd80039c0 0x7f1fd8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:55:41.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.942+0000 7f1ff0a34640 1 --2- 172.21.15.112:0/1324577009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fec0cf620 0x7f1fd8004810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc001060 tx=0x7f1fdc01cbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=236ea8075df8ceaa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:41.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.942+0000 7f1fe3fff640 1 -- 172.21.15.112:0/1324577009 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc007cb0 con 0x7f1fec0cf620 2024-09-15T23:55:41.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.942+0000 7f1fe3fff640 1 -- 172.21.15.112:0/1324577009 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fdc0a9020 con 0x7f1fec0cf620 2024-09-15T23:55:41.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.942+0000 7f1fe3fff640 1 -- 172.21.15.112:0/1324577009 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0058e0 con 0x7f1fec0cf620 2024-09-15T23:55:41.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.942+0000 7f1ff3499640 1 -- 172.21.15.112:0/1324577009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fec0cf620 msgr2=0x7f1fd8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:41.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.942+0000 7f1ff3499640 1 --2- 172.21.15.112:0/1324577009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fec0cf620 0x7f1fd8004810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc001060 tx=0x7f1fdc01cbb0 comp rx=0 tx=0).stop 2024-09-15T23:55:41.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.942+0000 7f1ff1a36640 1 -- 172.21.15.112:0/1324577009 reap_dead start 2024-09-15T23:55:41.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.942+0000 7f1ff3499640 1 -- 172.21.15.112:0/1324577009 shutdown_connections 2024-09-15T23:55:41.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.942+0000 7f1ff3499640 1 -- 172.21.15.112:0/1324577009 >> 172.21.15.112:0/1324577009 conn(0x7f1fec08bf90 msgr2=0x7f1fec09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:41.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.942+0000 7f1ff3499640 1 -- 172.21.15.112:0/1324577009 shutdown_connections 2024-09-15T23:55:41.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.942+0000 7f1ff3499640 1 -- 172.21.15.112:0/1324577009 wait complete. 2024-09-15T23:55:41.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.942+0000 7f1ff3499640 1 Processor -- start 2024-09-15T23:55:41.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.942+0000 7f1ff3499640 1 -- start start 2024-09-15T23:55:41.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff3499640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fec0c80e0 0x7f1fec15dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:41.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff3499640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fec0c84c0 0x7f1fec0ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:41.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff3499640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec0ca700 0x7f1fec0cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:41.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff3499640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec06dec0 con 0x7f1fec0ca700 2024-09-15T23:55:41.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff3499640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec06d190 con 0x7f1fec0c80e0 2024-09-15T23:55:41.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff3499640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec06e040 con 0x7f1fec0c84c0 2024-09-15T23:55:41.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff1a36640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec0ca700 0x7f1fec0cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:41.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff1a36640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec0ca700 0x7f1fec0cab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39924/0 (socket says 172.21.15.112:39924) 2024-09-15T23:55:41.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff1a36640 1 -- 172.21.15.112:0/4084456151 learned_addr learned my addr 172.21.15.112:0/4084456151 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:41.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff1235640 1 --2- 172.21.15.112:0/4084456151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fec0c80e0 0x7f1fec15dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:41.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff0a34640 1 --2- 172.21.15.112:0/4084456151 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fec0c84c0 0x7f1fec0ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:41.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff1a36640 1 -- 172.21.15.112:0/4084456151 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fec0c84c0 msgr2=0x7f1fec0ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:41.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff1a36640 1 --2- 172.21.15.112:0/4084456151 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fec0c84c0 0x7f1fec0ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:41.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff1a36640 1 -- 172.21.15.112:0/4084456151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fec0c80e0 msgr2=0x7f1fec15dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:41.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff1a36640 1 --2- 172.21.15.112:0/4084456151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fec0c80e0 0x7f1fec15dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:41.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff1a36640 1 -- 172.21.15.112:0/4084456151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec0c8d60 con 0x7f1fec0ca700 2024-09-15T23:55:41.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff1a36640 1 --2- 172.21.15.112:0/4084456151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec0ca700 0x7f1fec0cab80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1fec08dd40 tx=0x7f1fe400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:41.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1fe1ffb640 1 -- 172.21.15.112:0/4084456151 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80096b0 con 0x7f1fec0ca700 2024-09-15T23:55:41.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1fe1ffb640 1 -- 172.21.15.112:0/4084456151 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe401d070 con 0x7f1fec0ca700 2024-09-15T23:55:41.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff3499640 1 -- 172.21.15.112:0/4084456151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec0cb0c0 con 0x7f1fec0ca700 2024-09-15T23:55:41.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1fe1ffb640 1 -- 172.21.15.112:0/4084456151 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4015430 con 0x7f1fec0ca700 2024-09-15T23:55:41.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff3499640 1 -- 172.21.15.112:0/4084456151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec15e510 con 0x7f1fec0ca700 2024-09-15T23:55:41.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff3499640 1 -- 172.21.15.112:0/4084456151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fec06e400 con 0x7f1fec0ca700 2024-09-15T23:55:41.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1fe1ffb640 1 -- 172.21.15.112:0/4084456151 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1fe40155d0 con 0x7f1fec0ca700 2024-09-15T23:55:41.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1fe1ffb640 1 --2- 172.21.15.112:0/4084456151 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1fd00678f0 0x7f1fd0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:41.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1fe1ffb640 1 -- 172.21.15.112:0/4084456151 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f1fe4086420 con 0x7f1fec0ca700 2024-09-15T23:55:41.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.946+0000 7f1ff1235640 1 --2- 172.21.15.112:0/4084456151 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1fd00678f0 0x7f1fd0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:41.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.950+0000 7f1ff1235640 1 --2- 172.21.15.112:0/4084456151 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1fd00678f0 0x7f1fd0069db0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009cc0 tx=0x7f1fe8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:41.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:41.954+0000 7f1fe1ffb640 1 -- 172.21.15.112:0/4084456151 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1fec0c8d60 con 0x7f1fec0ca700 2024-09-15T23:55:42.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:42.106+0000 7f1ff3499640 1 -- 172.21.15.112:0/4084456151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f1fec0b1cc0 con 0x7f1fec0ca700 2024-09-15T23:55:42.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:42.114+0000 7f1fe1ffb640 1 -- 172.21.15.112:0/4084456151 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v13)=0 v13) ==== 124+0+0 (secure 0 0 0) 0x7f1fe4010040 con 0x7f1fec0ca700 2024-09-15T23:55:42.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:42.114+0000 7f1ff3499640 1 -- 172.21.15.112:0/4084456151 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1fd00678f0 msgr2=0x7f1fd0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:42.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:42.114+0000 7f1ff3499640 1 --2- 172.21.15.112:0/4084456151 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1fd00678f0 0x7f1fd0069db0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009cc0 tx=0x7f1fe8008040 comp rx=0 tx=0).stop 2024-09-15T23:55:42.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:42.114+0000 7f1ff3499640 1 -- 172.21.15.112:0/4084456151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec0ca700 msgr2=0x7f1fec0cab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:42.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:42.114+0000 7f1ff3499640 1 --2- 172.21.15.112:0/4084456151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec0ca700 0x7f1fec0cab80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1fec08dd40 tx=0x7f1fe400f1b0 comp rx=0 tx=0).stop 2024-09-15T23:55:42.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:42.114+0000 7f1ff3499640 1 -- 172.21.15.112:0/4084456151 shutdown_connections 2024-09-15T23:55:42.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:42.114+0000 7f1ff3499640 1 --2- 172.21.15.112:0/4084456151 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1fd00678f0 0x7f1fd0069db0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:42.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:42.114+0000 7f1ff3499640 1 --2- 172.21.15.112:0/4084456151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fec0ca700 0x7f1fec0cab80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:42.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:42.114+0000 7f1ff3499640 1 --2- 172.21.15.112:0/4084456151 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1fec0c84c0 0x7f1fec0ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:42.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:42.114+0000 7f1ff3499640 1 --2- 172.21.15.112:0/4084456151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fec0c80e0 0x7f1fec15dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:42.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:42.114+0000 7f1ff3499640 1 -- 172.21.15.112:0/4084456151 >> 172.21.15.112:0/4084456151 conn(0x7f1fec08bf90 msgr2=0x7f1fec0b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:42.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:42.114+0000 7f1ff3499640 1 -- 172.21.15.112:0/4084456151 shutdown_connections 2024-09-15T23:55:42.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:42.114+0000 7f1ff3499640 1 -- 172.21.15.112:0/4084456151 wait complete. 2024-09-15T23:55:43.343 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:55:43.345 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:55:52.137 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:55:52.137 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:52.145 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-15T23:55:52.145 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:55:52.145 DEBUG:teuthology.orchestra.run.smithi112:> import uuid 2024-09-15T23:55:52.145 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:55:52.145 DEBUG:teuthology.orchestra.run.smithi112:> n = 51 2024-09-15T23:55:52.145 DEBUG:teuthology.orchestra.run.smithi112:> create_hard_links = False 2024-09-15T23:55:52.145 DEBUG:teuthology.orchestra.run.smithi112:> if 0 > 0: 2024-09-15T23:55:52.145 DEBUG:teuthology.orchestra.run.smithi112:> create_hard_links = True 2024-09-15T23:55:52.145 DEBUG:teuthology.orchestra.run.smithi112:> path = "/home/ubuntu/cephtest/mnt.0/subdir/file" 2024-09-15T23:55:52.145 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:55:52.145 DEBUG:teuthology.orchestra.run.smithi112:> dpath = os.path.dirname(path) 2024-09-15T23:55:52.145 DEBUG:teuthology.orchestra.run.smithi112:> fnameprefix = os.path.basename(path) 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> os.makedirs(dpath, exist_ok=True) 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> try: 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> for i in range(n): 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> with open(fpath, '"'"'w'"'"') as f: 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> f.write(f"{i}") 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> f.flush() 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(f.fileno()) 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> os.unlink(fpath) 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-15T23:55:52.146 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(dirfd) 2024-09-15T23:55:52.147 DEBUG:teuthology.orchestra.run.smithi112:> if create_hard_links: 2024-09-15T23:55:52.147 DEBUG:teuthology.orchestra.run.smithi112:> for j in range(0): 2024-09-15T23:55:52.147 DEBUG:teuthology.orchestra.run.smithi112:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-15T23:55:52.147 DEBUG:teuthology.orchestra.run.smithi112:> if True: 2024-09-15T23:55:52.147 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(dirfd) 2024-09-15T23:55:52.147 DEBUG:teuthology.orchestra.run.smithi112:> finally: 2024-09-15T23:55:52.147 DEBUG:teuthology.orchestra.run.smithi112:> os.close(dirfd) 2024-09-15T23:55:52.147 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:55:52.391 INFO:teuthology.orchestra.run.smithi112.stderr:Traceback (most recent call last): 2024-09-15T23:55:52.392 INFO:teuthology.orchestra.run.smithi112.stderr: File "", line 20, in 2024-09-15T23:55:52.392 INFO:teuthology.orchestra.run.smithi112.stderr:OSError: [Errno 28] No space left on device: '/home/ubuntu/cephtest/mnt.0/subdir/file_50' 2024-09-15T23:55:52.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2024-09-15T23:55:52.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:55:52.404 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:55:52.404 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:55:52.544 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:55:52.616 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:55:52.616 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:55:52.616 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:55:52.616 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:52.622 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:55:52.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.794+0000 7ff340949640 1 Processor -- start 2024-09-15T23:55:52.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.794+0000 7ff340949640 1 -- start start 2024-09-15T23:55:52.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff340949640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff33c06fd70 0x7ff33c0ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:52.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff340949640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff33c0aeb10 0x7ff33c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:52.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff340949640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff33c06e920 con 0x7ff33c161890 2024-09-15T23:55:52.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff340949640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff33c0cef90 con 0x7ff33c0aeb10 2024-09-15T23:55:52.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff340949640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff33c06ec50 con 0x7ff33c06fd70 2024-09-15T23:55:52.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff33ad9d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff33c0aeb10 0x7ff33c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:52.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff33ad9d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff33c0aeb10 0x7ff33c06ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42802/0 (socket says 172.21.15.112:42802) 2024-09-15T23:55:52.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff33ad9d640 1 -- 172.21.15.112:0/354575153 learned_addr learned my addr 172.21.15.112:0/354575153 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:52.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff339d9b640 1 --2- 172.21.15.112:0/354575153 >> v2:172.21.15.169:3300/0 conn(0x7ff33c06fd70 0x7ff33c0ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:52.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff33ad9d640 1 -- 172.21.15.112:0/354575153 >> v2:172.21.15.169:3300/0 conn(0x7ff33c06fd70 msgr2=0x7ff33c0ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:52.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff33ad9d640 1 --2- 172.21.15.112:0/354575153 >> v2:172.21.15.169:3300/0 conn(0x7ff33c06fd70 0x7ff33c0ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:52.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff33ad9d640 1 -- 172.21.15.112:0/354575153 >> v1:172.21.15.169:6789/0 conn(0x7ff33c161890 legacy=0x7ff33c0ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:52.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff33ad9d640 1 -- 172.21.15.112:0/354575153 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c0cf1b0 con 0x7ff33c0aeb10 2024-09-15T23:55:52.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff33ad9d640 1 --2- 172.21.15.112:0/354575153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c0aeb10 0x7ff33c06ccd0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0ae060 tx=0x7ff33401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c26fe7677a9a20 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:52.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff33959a640 1 -- 172.21.15.112:0/354575153 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3340a5670 con 0x7ff33c0aeb10 2024-09-15T23:55:52.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff33959a640 1 -- 172.21.15.112:0/354575153 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3340a5810 con 0x7ff33c0aeb10 2024-09-15T23:55:52.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.798+0000 7ff33959a640 1 -- 172.21.15.112:0/354575153 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3340a5be0 con 0x7ff33c0aeb10 2024-09-15T23:55:52.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 -- 172.21.15.112:0/354575153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c0aeb10 msgr2=0x7ff33c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 --2- 172.21.15.112:0/354575153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c0aeb10 0x7ff33c06ccd0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0ae060 tx=0x7ff33401c9b0 comp rx=0 tx=0).stop 2024-09-15T23:55:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 -- 172.21.15.112:0/354575153 shutdown_connections 2024-09-15T23:55:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 --2- 172.21.15.112:0/354575153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c0aeb10 0x7ff33c06ccd0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 --2- 172.21.15.112:0/354575153 >> v2:172.21.15.169:3300/0 conn(0x7ff33c06fd70 0x7ff33c0ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 -- 172.21.15.112:0/354575153 >> 172.21.15.112:0/354575153 conn(0x7ff33c0725e0 msgr2=0x7ff33c0729f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 -- 172.21.15.112:0/354575153 shutdown_connections 2024-09-15T23:55:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 -- 172.21.15.112:0/354575153 wait complete. 2024-09-15T23:55:52.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 Processor -- start 2024-09-15T23:55:52.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 -- start start 2024-09-15T23:55:52.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c06fd70 0x7ff33c14a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:52.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33c0aeb10 0x7ff33c164570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:52.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c161890 0x7ff33c0b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c16b240 con 0x7ff33c161890 2024-09-15T23:55:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c06d620 con 0x7ff33c0aeb10 2024-09-15T23:55:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff33c16b3c0 con 0x7ff33c06fd70 2024-09-15T23:55:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff33ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c161890 0x7ff33c0b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff33ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c161890 0x7ff33c0b5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42806/0 (socket says 172.21.15.112:42806) 2024-09-15T23:55:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff33ad9d640 1 -- 172.21.15.112:0/399517834 learned_addr learned my addr 172.21.15.112:0/399517834 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff339d9b640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33c0aeb10 0x7ff33c164570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff33a59c640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c06fd70 0x7ff33c14a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff33ad9d640 1 -- 172.21.15.112:0/399517834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c06fd70 msgr2=0x7ff33c14a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff33ad9d640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c06fd70 0x7ff33c14a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff33ad9d640 1 -- 172.21.15.112:0/399517834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33c0aeb10 msgr2=0x7ff33c164570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff33ad9d640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33c0aeb10 0x7ff33c164570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:52.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff33ad9d640 1 -- 172.21.15.112:0/399517834 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c0b0570 con 0x7ff33c161890 2024-09-15T23:55:52.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff33a59c640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c06fd70 0x7ff33c14a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:52.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff33ad9d640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c161890 0x7ff33c0b5e30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff3340af040 tx=0x7ff334019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:52.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff32affd640 1 -- 172.21.15.112:0/399517834 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff334009510 con 0x7ff33c161890 2024-09-15T23:55:52.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff32affd640 1 -- 172.21.15.112:0/399517834 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3340be070 con 0x7ff33c161890 2024-09-15T23:55:52.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 -- 172.21.15.112:0/399517834 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33c0b0850 con 0x7ff33c161890 2024-09-15T23:55:52.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff32affd640 1 -- 172.21.15.112:0/399517834 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3340b88d0 con 0x7ff33c161890 2024-09-15T23:55:52.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.802+0000 7ff340949640 1 -- 172.21.15.112:0/399517834 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33c0b0e10 con 0x7ff33c161890 2024-09-15T23:55:52.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.806+0000 7ff340949640 1 -- 172.21.15.112:0/399517834 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33c0ae5d0 con 0x7ff33c161890 2024-09-15T23:55:52.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.806+0000 7ff32affd640 1 -- 172.21.15.112:0/399517834 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3340b8a70 con 0x7ff33c161890 2024-09-15T23:55:52.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.806+0000 7ff32affd640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff31c0678c0 0x7ff31c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:52.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.806+0000 7ff32affd640 1 -- 172.21.15.112:0/399517834 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7ff334120ec0 con 0x7ff33c161890 2024-09-15T23:55:52.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.806+0000 7ff33a59c640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff31c0678c0 0x7ff31c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:52.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.806+0000 7ff33a59c640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff31c0678c0 0x7ff31c069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff33000a850 tx=0x7ff330008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:52.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.810+0000 7ff32affd640 1 -- 172.21.15.112:0/399517834 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff3340165a0 con 0x7ff33c161890 2024-09-15T23:55:52.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.986+0000 7ff340949640 1 -- 172.21.15.112:0/399517834 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff33c0b48c0 con 0x7ff33c161890 2024-09-15T23:55:52.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.986+0000 7ff32affd640 1 -- 172.21.15.112:0/399517834 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) ==== 80+0+0 (secure 0 0 0) 0x7ff3340f1990 con 0x7ff33c161890 2024-09-15T23:55:52.989 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:55:52.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.990+0000 7ff340949640 1 -- 172.21.15.112:0/399517834 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff31c0678c0 msgr2=0x7ff31c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:52.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.990+0000 7ff340949640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff31c0678c0 0x7ff31c069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff33000a850 tx=0x7ff330008040 comp rx=0 tx=0).stop 2024-09-15T23:55:52.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.990+0000 7ff340949640 1 -- 172.21.15.112:0/399517834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c161890 msgr2=0x7ff33c0b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:52.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.990+0000 7ff340949640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c161890 0x7ff33c0b5e30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff3340af040 tx=0x7ff334019750 comp rx=0 tx=0).stop 2024-09-15T23:55:52.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.990+0000 7ff340949640 1 -- 172.21.15.112:0/399517834 shutdown_connections 2024-09-15T23:55:52.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.990+0000 7ff340949640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff31c0678c0 0x7ff31c069d80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:52.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.990+0000 7ff340949640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff33c161890 0x7ff33c0b5e30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:52.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.990+0000 7ff340949640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33c0aeb10 0x7ff33c164570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:52.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.990+0000 7ff340949640 1 --2- 172.21.15.112:0/399517834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c06fd70 0x7ff33c14a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:52.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.990+0000 7ff340949640 1 -- 172.21.15.112:0/399517834 >> 172.21.15.112:0/399517834 conn(0x7ff33c0725e0 msgr2=0x7ff33c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:52.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.990+0000 7ff340949640 1 -- 172.21.15.112:0/399517834 shutdown_connections 2024-09-15T23:55:52.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:52.990+0000 7ff340949640 1 -- 172.21.15.112:0/399517834 wait complete. 2024-09-15T23:55:53.008 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2024-09-15T23:55:53.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:53.009 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:53.018 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[39253]: fuse finished with error 0 and tester_r 0 2024-09-15T23:55:53.019 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:55:53.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:53.019 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:55:53.176 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:55:53.176 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:55:53.177 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:53.183 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:55:53.183 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:55:53.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:53.183 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:55:53.230 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-15T23:55:53.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:55:53.231 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:55:53.232 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:55:53.232 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:53.236 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:55:53.236 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:55:53.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:53.237 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-15T23:55:53.282 INFO:teuthology.orchestra.run.smithi112.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-15T23:55:53.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:55:53.283 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:55:53.283 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:55:53.283 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:53.289 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:55:53.289 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:55:53.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:53.289 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-15T23:55:53.335 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-15T23:55:53.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:55:53.336 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:53.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.458+0000 7f8f826c1640 1 Processor -- start 2024-09-15T23:55:53.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.458+0000 7f8f826c1640 1 -- start start 2024-09-15T23:55:53.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f826c1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8f7c06f010 0x7f8f7c166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:53.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f826c1640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f7c0b3290 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f826c1640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f7c0b3570 con 0x7f8f7c15bec0 2024-09-15T23:55:53.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f826c1640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8f7c0b3850 con 0x7f8f7c06f010 2024-09-15T23:55:53.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f80c5e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8f7c06f010 0x7f8f7c166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:53.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f7b7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8f7c15c2a0 0x7f8f7c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49590/0 (socket says 172.21.15.112:49590) 2024-09-15T23:55:53.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f7b7fe640 1 -- 172.21.15.112:0/983681048 learned_addr learned my addr 172.21.15.112:0/983681048 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:53.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f7affd640 1 -- 172.21.15.112:0/983681048 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 162161364 0 0) 0x7f8f7c0b3290 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f7affd640 1 -- 172.21.15.112:0/983681048 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f64003530 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f80c5e640 1 -- 172.21.15.112:0/983681048 >> v1:172.21.15.169:6789/0 conn(0x7f8f7c15bec0 legacy=0x7f8f7c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f80c5e640 1 -- 172.21.15.112:0/983681048 >> v1:172.21.15.112:6789/0 conn(0x7f8f7c15c2a0 legacy=0x7f8f7c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f80c5e640 1 -- 172.21.15.112:0/983681048 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7c0b3b30 con 0x7f8f7c06f010 2024-09-15T23:55:53.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f80c5e640 1 --2- 172.21.15.112:0/983681048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f7c06f010 0x7f8f7c166ff0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009d90 tx=0x7f8f7401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8c9c41be9dc0b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:53.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f7affd640 1 -- 172.21.15.112:0/983681048 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f740b2070 con 0x7f8f7c06f010 2024-09-15T23:55:53.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f7affd640 1 -- 172.21.15.112:0/983681048 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f740a5910 con 0x7f8f7c06f010 2024-09-15T23:55:53.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.462+0000 7f8f7affd640 1 -- 172.21.15.112:0/983681048 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f740a5ce0 con 0x7f8f7c06f010 2024-09-15T23:55:53.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 -- 172.21.15.112:0/983681048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f7c06f010 msgr2=0x7f8f7c166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 --2- 172.21.15.112:0/983681048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f7c06f010 0x7f8f7c166ff0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009d90 tx=0x7f8f7401c940 comp rx=0 tx=0).stop 2024-09-15T23:55:53.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 -- 172.21.15.112:0/983681048 shutdown_connections 2024-09-15T23:55:53.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 --2- 172.21.15.112:0/983681048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f7c06f010 0x7f8f7c166ff0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 -- 172.21.15.112:0/983681048 >> 172.21.15.112:0/983681048 conn(0x7f8f7c0b1f90 msgr2=0x7f8f7c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 -- 172.21.15.112:0/983681048 shutdown_connections 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 -- 172.21.15.112:0/983681048 wait complete. 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 Processor -- start 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 -- start start 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f7c06f010 0x7f8f7c142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7c15bec0 0x7f8f7c15dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f7c15c2a0 0x7f8f7c1546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c169ed0 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c169d50 con 0x7f8f7c15bec0 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8f7c16a050 con 0x7f8f7c06f010 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f80c5e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f7c15c2a0 0x7f8f7c1546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f80c5e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f7c15c2a0 0x7f8f7c1546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42836/0 (socket says 172.21.15.112:42836) 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f80c5e640 1 -- 172.21.15.112:0/3029541185 learned_addr learned my addr 172.21.15.112:0/3029541185 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f7b7fe640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7c15bec0 0x7f8f7c15dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f7bfff640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f7c06f010 0x7f8f7c142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f80c5e640 1 -- 172.21.15.112:0/3029541185 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f7c06f010 msgr2=0x7f8f7c142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f80c5e640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f7c06f010 0x7f8f7c142520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f80c5e640 1 -- 172.21.15.112:0/3029541185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7c15bec0 msgr2=0x7f8f7c15dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f80c5e640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7c15bec0 0x7f8f7c15dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f80c5e640 1 -- 172.21.15.112:0/3029541185 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7c15c880 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f7b7fe640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7c15bec0 0x7f8f7c15dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f80c5e640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f7c15c2a0 0x7f8f7c1546c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8f7401a570 tx=0x7f8f740196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:53.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f78ff9640 1 -- 172.21.15.112:0/3029541185 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f740b2050 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f78ff9640 1 -- 172.21.15.112:0/3029541185 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f740be070 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 -- 172.21.15.112:0/3029541185 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f7c15cb60 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f78ff9640 1 -- 172.21.15.112:0/3029541185 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f740ada50 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.466+0000 7f8f826c1640 1 -- 172.21.15.112:0/3029541185 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f7c15d120 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.470+0000 7f8f826c1640 1 -- 172.21.15.112:0/3029541185 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f7c0b3290 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.470+0000 7f8f78ff9640 1 -- 172.21.15.112:0/3029541185 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f740adbf0 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.470+0000 7f8f78ff9640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f680678c0 0x7f8f68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:53.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.470+0000 7f8f78ff9640 1 -- 172.21.15.112:0/3029541185 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f8f74120fc0 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.470+0000 7f8f7bfff640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f680678c0 0x7f8f68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:53.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.470+0000 7f8f7bfff640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f680678c0 0x7f8f68069d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c007fd0 tx=0x7f8f6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:53.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.474+0000 7f8f78ff9640 1 -- 172.21.15.112:0/3029541185 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8f74016560 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.670+0000 7f8f826c1640 1 -- 172.21.15.112:0/3029541185 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f7c142a60 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.670+0000 7f8f78ff9640 1 -- 172.21.15.112:0/3029541185 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5232 (secure 0 0 0) 0x7f8f740ab340 con 0x7f8f7c15c2a0 2024-09-15T23:55:53.673 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:53.673 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":22,"btime":"2024-09-15T23:55:31:957534+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1762952607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1762952607},{"type":"v1","addr":"172.21.15.169:6834","nonce":1762952607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1383551321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1383551321},{"type":"v1","addr":"172.21.15.169:6835","nonce":1383551321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/235120639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":235120639},{"type":"v1","addr":"172.21.15.112:6835","nonce":235120639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:29.310328+0000","modified":"2024-09-15T23:55:31.304308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1037773891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1037773891},{"type":"v1","addr":"172.21.15.112:6837","nonce":1037773891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-15T23:55:53.674 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 22 2024-09-15T23:55:53.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.674+0000 7f8f826c1640 1 -- 172.21.15.112:0/3029541185 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f680678c0 msgr2=0x7f8f68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.674+0000 7f8f826c1640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f680678c0 0x7f8f68069d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c007fd0 tx=0x7f8f6c009040 comp rx=0 tx=0).stop 2024-09-15T23:55:53.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.674+0000 7f8f826c1640 1 -- 172.21.15.112:0/3029541185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f7c15c2a0 msgr2=0x7f8f7c1546c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.674+0000 7f8f826c1640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f7c15c2a0 0x7f8f7c1546c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8f7401a570 tx=0x7f8f740196e0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.674+0000 7f8f826c1640 1 -- 172.21.15.112:0/3029541185 shutdown_connections 2024-09-15T23:55:53.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.674+0000 7f8f826c1640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f680678c0 0x7f8f68069d80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.674+0000 7f8f826c1640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f7c15c2a0 0x7f8f7c1546c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.674+0000 7f8f826c1640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7c15bec0 0x7f8f7c15dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.674+0000 7f8f826c1640 1 --2- 172.21.15.112:0/3029541185 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f7c06f010 0x7f8f7c142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.674+0000 7f8f826c1640 1 -- 172.21.15.112:0/3029541185 >> 172.21.15.112:0/3029541185 conn(0x7f8f7c0b1f90 msgr2=0x7f8f7c15a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:53.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.674+0000 7f8f826c1640 1 -- 172.21.15.112:0/3029541185 shutdown_connections 2024-09-15T23:55:53.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.674+0000 7f8f826c1640 1 -- 172.21.15.112:0/3029541185 wait complete. 2024-09-15T23:55:53.692 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:53.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d6121b640 1 Processor -- start 2024-09-15T23:55:53.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d6121b640 1 -- start start 2024-09-15T23:55:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d6121b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d5c15e5f0 0x7f0d5c06d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d6121b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0d5c0cfaf0 0x7f0d5c0d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d6121b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c06d9c0 con 0x7f0d5c0ce9d0 2024-09-15T23:55:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d6121b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0d5c06dca0 con 0x7f0d5c0cfaf0 2024-09-15T23:55:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d6121b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5c06df80 con 0x7f0d5c15e5f0 2024-09-15T23:55:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d5b59e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0d5c0cfaf0 0x7f0d5c0d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d5a59c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0d5c0ce9d0 0x7f0d5c0cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49604/0 (socket says 172.21.15.112:49604) 2024-09-15T23:55:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d5a59c640 1 -- 172.21.15.112:0/2333868920 learned_addr learned my addr 172.21.15.112:0/2333868920 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:53.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d5b59e640 1 -- 172.21.15.112:0/2333868920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d5c15e5f0 msgr2=0x7f0d5c06d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d5ad9d640 1 --2- 172.21.15.112:0/2333868920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d5c15e5f0 0x7f0d5c06d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d59d9b640 1 -- 172.21.15.112:0/2333868920 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1605836381 0 0) 0x7f0d5c06d9c0 con 0x7f0d5c0ce9d0 2024-09-15T23:55:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d5b59e640 1 --2- 172.21.15.112:0/2333868920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d5c15e5f0 0x7f0d5c06d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d5b59e640 1 -- 172.21.15.112:0/2333868920 >> v1:172.21.15.112:6789/0 conn(0x7f0d5c0ce9d0 legacy=0x7f0d5c0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d5b59e640 1 -- 172.21.15.112:0/2333868920 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c06e260 con 0x7f0d5c0cfaf0 2024-09-15T23:55:53.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d5ad9d640 1 --2- 172.21.15.112:0/2333868920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d5c15e5f0 0x7f0d5c06d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.810+0000 7f0d5b59e640 1 --2- 172.21.15.112:0/2333868920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c0cfaf0 0x7f0d5c0d2b60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009d90 tx=0x7f0d5401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf57ce953e24863 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d59d9b640 1 -- 172.21.15.112:0/2333868920 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d540b2070 con 0x7f0d5c0cfaf0 2024-09-15T23:55:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d59d9b640 1 -- 172.21.15.112:0/2333868920 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d540a5940 con 0x7f0d5c0cfaf0 2024-09-15T23:55:53.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d59d9b640 1 -- 172.21.15.112:0/2333868920 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d540a5d10 con 0x7f0d5c0cfaf0 2024-09-15T23:55:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 -- 172.21.15.112:0/2333868920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c0cfaf0 msgr2=0x7f0d5c0d2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 --2- 172.21.15.112:0/2333868920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c0cfaf0 0x7f0d5c0d2b60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009d90 tx=0x7f0d5401c970 comp rx=0 tx=0).stop 2024-09-15T23:55:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 -- 172.21.15.112:0/2333868920 shutdown_connections 2024-09-15T23:55:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 --2- 172.21.15.112:0/2333868920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c0cfaf0 0x7f0d5c0d2b60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 --2- 172.21.15.112:0/2333868920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d5c15e5f0 0x7f0d5c06d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 -- 172.21.15.112:0/2333868920 >> 172.21.15.112:0/2333868920 conn(0x7f0d5c074030 msgr2=0x7f0d5c09d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 -- 172.21.15.112:0/2333868920 shutdown_connections 2024-09-15T23:55:53.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 -- 172.21.15.112:0/2333868920 wait complete. 2024-09-15T23:55:53.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 Processor -- start 2024-09-15T23:55:53.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 -- start start 2024-09-15T23:55:53.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d5c0cfaf0 0x7f0d5c0b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:53.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c154560 0x7f0d5c14d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:53.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d5c0b12e0 0x7f0d5c0b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:53.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c0d3c40 con 0x7f0d5c154560 2024-09-15T23:55:53.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c0d3ac0 con 0x7f0d5c0b12e0 2024-09-15T23:55:53.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5c16afa0 con 0x7f0d5c0cfaf0 2024-09-15T23:55:53.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d5a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c154560 0x7f0d5c14d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:53.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d5a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c154560 0x7f0d5c14d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42854/0 (socket says 172.21.15.112:42854) 2024-09-15T23:55:53.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d5a59c640 1 -- 172.21.15.112:0/4178822118 learned_addr learned my addr 172.21.15.112:0/4178822118 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:53.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d5b59e640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d5c0b12e0 0x7f0d5c0b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:53.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d5ad9d640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d5c0cfaf0 0x7f0d5c0b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:53.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d5a59c640 1 -- 172.21.15.112:0/4178822118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d5c0cfaf0 msgr2=0x7f0d5c0b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d5a59c640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d5c0cfaf0 0x7f0d5c0b7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d5a59c640 1 -- 172.21.15.112:0/4178822118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d5c0b12e0 msgr2=0x7f0d5c0b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d5a59c640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d5c0b12e0 0x7f0d5c0b1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d5a59c640 1 -- 172.21.15.112:0/4178822118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c14df00 con 0x7f0d5c154560 2024-09-15T23:55:53.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d5b59e640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d5c0b12e0 0x7f0d5c0b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:53.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d5a59c640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c154560 0x7f0d5c14d9c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000c510 tx=0x7f0d5000c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:53.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d437fe640 1 -- 172.21.15.112:0/4178822118 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d50018070 con 0x7f0d5c154560 2024-09-15T23:55:53.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d437fe640 1 -- 172.21.15.112:0/4178822118 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d50007500 con 0x7f0d5c154560 2024-09-15T23:55:53.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d437fe640 1 -- 172.21.15.112:0/4178822118 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d50004a30 con 0x7f0d5c154560 2024-09-15T23:55:53.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 -- 172.21.15.112:0/4178822118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5c0b8340 con 0x7f0d5c154560 2024-09-15T23:55:53.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.814+0000 7f0d6121b640 1 -- 172.21.15.112:0/4178822118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5c0b7cf0 con 0x7f0d5c154560 2024-09-15T23:55:53.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.818+0000 7f0d6121b640 1 -- 172.21.15.112:0/4178822118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5c0d2b60 con 0x7f0d5c154560 2024-09-15T23:55:53.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.818+0000 7f0d437fe640 1 -- 172.21.15.112:0/4178822118 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d50004bd0 con 0x7f0d5c154560 2024-09-15T23:55:53.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.818+0000 7f0d437fe640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0d480678f0 0x7f0d48069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:53.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.818+0000 7f0d5ad9d640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0d480678f0 0x7f0d48069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:53.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.818+0000 7f0d437fe640 1 -- 172.21.15.112:0/4178822118 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f0d500850e0 con 0x7f0d5c154560 2024-09-15T23:55:53.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.818+0000 7f0d5ad9d640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0d480678f0 0x7f0d48069db0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c006fd0 tx=0x7f0d4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:53.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:53.822+0000 7f0d437fe640 1 -- 172.21.15.112:0/4178822118 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0d50055b40 con 0x7f0d5c154560 2024-09-15T23:55:54.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.010+0000 7f0d6121b640 1 -- 172.21.15.112:0/4178822118 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d5c0c7c50 con 0x7f0d5c154560 2024-09-15T23:55:54.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.010+0000 7f0d437fe640 1 -- 172.21.15.112:0/4178822118 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5232 (secure 0 0 0) 0x7f0d50055440 con 0x7f0d5c154560 2024-09-15T23:55:54.013 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:54.013 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":22,"btime":"2024-09-15T23:55:31:957534+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1762952607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1762952607},{"type":"v1","addr":"172.21.15.169:6834","nonce":1762952607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1383551321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1383551321},{"type":"v1","addr":"172.21.15.169:6835","nonce":1383551321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/235120639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":235120639},{"type":"v1","addr":"172.21.15.112:6835","nonce":235120639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:29.310328+0000","modified":"2024-09-15T23:55:31.304308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1037773891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1037773891},{"type":"v1","addr":"172.21.15.112:6837","nonce":1037773891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-15T23:55:54.014 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 22 2024-09-15T23:55:54.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.014+0000 7f0d6121b640 1 -- 172.21.15.112:0/4178822118 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0d480678f0 msgr2=0x7f0d48069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.014+0000 7f0d6121b640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0d480678f0 0x7f0d48069db0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c006fd0 tx=0x7f0d4c008040 comp rx=0 tx=0).stop 2024-09-15T23:55:54.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.014+0000 7f0d6121b640 1 -- 172.21.15.112:0/4178822118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c154560 msgr2=0x7f0d5c14d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.014+0000 7f0d6121b640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c154560 0x7f0d5c14d9c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000c510 tx=0x7f0d5000c9d0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.014+0000 7f0d6121b640 1 -- 172.21.15.112:0/4178822118 shutdown_connections 2024-09-15T23:55:54.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.014+0000 7f0d6121b640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0d480678f0 0x7f0d48069db0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.014+0000 7f0d6121b640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0d5c0b12e0 0x7f0d5c0b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.014+0000 7f0d6121b640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c154560 0x7f0d5c14d9c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.014+0000 7f0d6121b640 1 --2- 172.21.15.112:0/4178822118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0d5c0cfaf0 0x7f0d5c0b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.014+0000 7f0d6121b640 1 -- 172.21.15.112:0/4178822118 >> 172.21.15.112:0/4178822118 conn(0x7f0d5c0ce9d0 msgr2=0x7f0d5c0b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:54.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.014+0000 7f0d6121b640 1 -- 172.21.15.112:0/4178822118 shutdown_connections 2024-09-15T23:55:54.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.014+0000 7f0d6121b640 1 -- 172.21.15.112:0/4178822118 wait complete. 2024-09-15T23:55:54.031 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:54.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.146+0000 7f421e3f3640 1 Processor -- start 2024-09-15T23:55:54.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.146+0000 7f421e3f3640 1 -- start start 2024-09-15T23:55:54.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f421e3f3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f421815c2a0 0x7f42180aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f421e3f3640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42180b3290 con 0x7f421815bec0 2024-09-15T23:55:54.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f421e3f3640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42180b3570 con 0x7f42180af2a0 2024-09-15T23:55:54.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f421e3f3640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f42180b3850 con 0x7f421815c2a0 2024-09-15T23:55:54.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f42177fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f421815c2a0 0x7f42180aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f4217fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f421815bec0 0x7f42180ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49616/0 (socket says 172.21.15.112:49616) 2024-09-15T23:55:54.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f4217fff640 1 -- 172.21.15.112:0/1784958118 learned_addr learned my addr 172.21.15.112:0/1784958118 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:54.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f42177fe640 1 --2- 172.21.15.112:0/1784958118 >> v2:172.21.15.112:3300/0 conn(0x7f421815c2a0 0x7f42180aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42858/0 (socket says 172.21.15.112:42858) 2024-09-15T23:55:54.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f42177fe640 1 -- 172.21.15.112:0/1784958118 >> v1:172.21.15.169:6789/0 conn(0x7f42180af2a0 legacy=0x7f421806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:54.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f42177fe640 1 -- 172.21.15.112:0/1784958118 >> v1:172.21.15.112:6789/0 conn(0x7f421815bec0 legacy=0x7f42180ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f4216ffd640 1 -- 172.21.15.112:0/1784958118 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 158092154 0 0) 0x7f42180b3290 con 0x7f421815bec0 2024-09-15T23:55:54.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f42177fe640 1 -- 172.21.15.112:0/1784958118 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42180b3b30 con 0x7f421815c2a0 2024-09-15T23:55:54.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f42177fe640 1 --2- 172.21.15.112:0/1784958118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421815c2a0 0x7f42180aed60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4208009d90 tx=0x7f420801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4379be3ecdb2fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:54.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f4216ffd640 1 -- 172.21.15.112:0/1784958118 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42080b2070 con 0x7f421815c2a0 2024-09-15T23:55:54.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f4216ffd640 1 -- 172.21.15.112:0/1784958118 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42080a59c0 con 0x7f421815c2a0 2024-09-15T23:55:54.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.150+0000 7f4216ffd640 1 -- 172.21.15.112:0/1784958118 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42080a5d90 con 0x7f421815c2a0 2024-09-15T23:55:54.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 -- 172.21.15.112:0/1784958118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421815c2a0 msgr2=0x7f42180aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 --2- 172.21.15.112:0/1784958118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421815c2a0 0x7f42180aed60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4208009d90 tx=0x7f420801c900 comp rx=0 tx=0).stop 2024-09-15T23:55:54.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 -- 172.21.15.112:0/1784958118 shutdown_connections 2024-09-15T23:55:54.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 --2- 172.21.15.112:0/1784958118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f421815c2a0 0x7f42180aed60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 -- 172.21.15.112:0/1784958118 >> 172.21.15.112:0/1784958118 conn(0x7f42180b1f90 msgr2=0x7f42180b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:54.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 -- 172.21.15.112:0/1784958118 shutdown_connections 2024-09-15T23:55:54.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 -- 172.21.15.112:0/1784958118 wait complete. 2024-09-15T23:55:54.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 Processor -- start 2024-09-15T23:55:54.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 -- start start 2024-09-15T23:55:54.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42180af2a0 0x7f4218148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f421815bec0 0x7f42181491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f421815c2a0 0x7f4218153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f421806ef20 con 0x7f42180af2a0 2024-09-15T23:55:54.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42180af710 con 0x7f421815c2a0 2024-09-15T23:55:54.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f421806f0a0 con 0x7f421815bec0 2024-09-15T23:55:54.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f4217fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42180af2a0 0x7f4218148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f4217fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42180af2a0 0x7f4218148c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42866/0 (socket says 172.21.15.112:42866) 2024-09-15T23:55:54.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f4217fff640 1 -- 172.21.15.112:0/3364662098 learned_addr learned my addr 172.21.15.112:0/3364662098 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:54.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f4217fff640 1 -- 172.21.15.112:0/3364662098 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f421815bec0 msgr2=0x7f42181491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f4217fff640 1 --2- 172.21.15.112:0/3364662098 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f421815bec0 0x7f42181491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f4217fff640 1 -- 172.21.15.112:0/3364662098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f421815c2a0 msgr2=0x7f4218153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f4217fff640 1 --2- 172.21.15.112:0/3364662098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f421815c2a0 0x7f4218153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f4217fff640 1 -- 172.21.15.112:0/3364662098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4218155720 con 0x7f42180af2a0 2024-09-15T23:55:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f4217fff640 1 --2- 172.21.15.112:0/3364662098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42180af2a0 0x7f4218148c00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f420c0011f0 tx=0x7f420c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f4214ff9640 1 -- 172.21.15.112:0/3364662098 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c018070 con 0x7f42180af2a0 2024-09-15T23:55:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f4214ff9640 1 -- 172.21.15.112:0/3364662098 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f420c0074e0 con 0x7f42180af2a0 2024-09-15T23:55:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 -- 172.21.15.112:0/3364662098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4218155a00 con 0x7f42180af2a0 2024-09-15T23:55:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f4214ff9640 1 -- 172.21.15.112:0/3364662098 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c004a10 con 0x7f42180af2a0 2024-09-15T23:55:54.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.154+0000 7f421e3f3640 1 -- 172.21.15.112:0/3364662098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4218149720 con 0x7f42180af2a0 2024-09-15T23:55:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.158+0000 7f421e3f3640 1 -- 172.21.15.112:0/3364662098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42180aed60 con 0x7f42180af2a0 2024-09-15T23:55:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.158+0000 7f4214ff9640 1 -- 172.21.15.112:0/3364662098 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f420c01b070 con 0x7f42180af2a0 2024-09-15T23:55:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.158+0000 7f4214ff9640 1 --2- 172.21.15.112:0/3364662098 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f42040678c0 0x7f4204069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.158+0000 7f4214ff9640 1 -- 172.21.15.112:0/3364662098 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f420c0853e0 con 0x7f42180af2a0 2024-09-15T23:55:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.158+0000 7f42177fe640 1 --2- 172.21.15.112:0/3364662098 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f42040678c0 0x7f4204069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.158+0000 7f42177fe640 1 --2- 172.21.15.112:0/3364662098 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f42040678c0 0x7f4204069d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f42080af000 tx=0x7f4208004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:54.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.162+0000 7f4214ff9640 1 -- 172.21.15.112:0/3364662098 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f420c055f00 con 0x7f42180af2a0 2024-09-15T23:55:54.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.310+0000 7f421e3f3640 1 -- 172.21.15.112:0/3364662098 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f421806fcd0 con 0x7f42180af2a0 2024-09-15T23:55:54.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.314+0000 7f4214ff9640 1 -- 172.21.15.112:0/3364662098 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16954 (secure 0 0 0) 0x7f420c055800 con 0x7f42180af2a0 2024-09-15T23:55:54.315 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:54.316 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":51,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:55:30.949208+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:26.989002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:28.298793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:54.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.314+0000 7f421e3f3640 1 -- 172.21.15.112:0/3364662098 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f42040678c0 msgr2=0x7f4204069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.314+0000 7f421e3f3640 1 --2- 172.21.15.112:0/3364662098 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f42040678c0 0x7f4204069d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f42080af000 tx=0x7f4208004ac0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.314+0000 7f421e3f3640 1 -- 172.21.15.112:0/3364662098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42180af2a0 msgr2=0x7f4218148c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.314+0000 7f421e3f3640 1 --2- 172.21.15.112:0/3364662098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42180af2a0 0x7f4218148c00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f420c0011f0 tx=0x7f420c00c9b0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.314+0000 7f421e3f3640 1 -- 172.21.15.112:0/3364662098 shutdown_connections 2024-09-15T23:55:54.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.314+0000 7f421e3f3640 1 --2- 172.21.15.112:0/3364662098 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f42040678c0 0x7f4204069d80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.314+0000 7f421e3f3640 1 --2- 172.21.15.112:0/3364662098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f421815c2a0 0x7f4218153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.314+0000 7f421e3f3640 1 --2- 172.21.15.112:0/3364662098 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f421815bec0 0x7f42181491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.314+0000 7f421e3f3640 1 --2- 172.21.15.112:0/3364662098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42180af2a0 0x7f4218148c00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.314+0000 7f421e3f3640 1 -- 172.21.15.112:0/3364662098 >> 172.21.15.112:0/3364662098 conn(0x7f42180b1f90 msgr2=0x7f4218159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:54.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.314+0000 7f421e3f3640 1 -- 172.21.15.112:0/3364662098 shutdown_connections 2024-09-15T23:55:54.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.314+0000 7f421e3f3640 1 -- 172.21.15.112:0/3364662098 wait complete. 2024-09-15T23:55:54.333 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:55:54.334 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:54.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f888a5b4640 1 Processor -- start 2024-09-15T23:55:54.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f888a5b4640 1 -- start start 2024-09-15T23:55:54.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f888a5b4640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8884158c90 0x7f88840cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f888a5b4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f888415f840 0x7f888406e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f888a5b4640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8884159070 con 0x7f88840b3e00 2024-09-15T23:55:54.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f888a5b4640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f888406d070 con 0x7f8884158c90 2024-09-15T23:55:54.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f888a5b4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f888406d2c0 con 0x7f888415f840 2024-09-15T23:55:54.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f8883fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8884158c90 0x7f88840cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f8883fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8884158c90 0x7f88840cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42870/0 (socket says 172.21.15.112:42870) 2024-09-15T23:55:54.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f8883fff640 1 -- 172.21.15.112:0/502357743 learned_addr learned my addr 172.21.15.112:0/502357743 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:54.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f88837fe640 1 --2- 172.21.15.112:0/502357743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f888415f840 0x7f888406e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f8883fff640 1 -- 172.21.15.112:0/502357743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f888415f840 msgr2=0x7f888406e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:54.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f8883fff640 1 --2- 172.21.15.112:0/502357743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f888415f840 0x7f888406e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f8883fff640 1 -- 172.21.15.112:0/502357743 >> v1:172.21.15.169:6789/0 conn(0x7f88840b3e00 legacy=0x7f88840cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:54.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f8883fff640 1 -- 172.21.15.112:0/502357743 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888406d5a0 con 0x7f8884158c90 2024-09-15T23:55:54.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.438+0000 7f88837fe640 1 --2- 172.21.15.112:0/502357743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f888415f840 0x7f888406e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:54.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f8883fff640 1 --2- 172.21.15.112:0/502357743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884158c90 0x7f88840cb9c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8874009870 tx=0x7f887401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75e170f07021034 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f8882ffd640 1 -- 172.21.15.112:0/502357743 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88740b0070 con 0x7f8884158c90 2024-09-15T23:55:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f8882ffd640 1 -- 172.21.15.112:0/502357743 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88740ab600 con 0x7f8884158c90 2024-09-15T23:55:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f8882ffd640 1 -- 172.21.15.112:0/502357743 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88740ab9d0 con 0x7f8884158c90 2024-09-15T23:55:54.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 -- 172.21.15.112:0/502357743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884158c90 msgr2=0x7f88840cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 --2- 172.21.15.112:0/502357743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884158c90 0x7f88840cb9c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8874009870 tx=0x7f887401c520 comp rx=0 tx=0).stop 2024-09-15T23:55:54.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 -- 172.21.15.112:0/502357743 shutdown_connections 2024-09-15T23:55:54.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 --2- 172.21.15.112:0/502357743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f888415f840 0x7f888406e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 --2- 172.21.15.112:0/502357743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884158c90 0x7f88840cb9c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 -- 172.21.15.112:0/502357743 >> 172.21.15.112:0/502357743 conn(0x7f888406bcc0 msgr2=0x7f888406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:54.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 -- 172.21.15.112:0/502357743 shutdown_connections 2024-09-15T23:55:54.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 -- 172.21.15.112:0/502357743 wait complete. 2024-09-15T23:55:54.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 Processor -- start 2024-09-15T23:55:54.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 -- start start 2024-09-15T23:55:54.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88840b3e00 0x7f8884146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f888415f840 0x7f8884156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8884156360 0x7f8884157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f88840b46a0 con 0x7f888415f840 2024-09-15T23:55:54.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f888406de40 con 0x7f88840b3e00 2024-09-15T23:55:54.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f888406e8a0 con 0x7f8884156360 2024-09-15T23:55:54.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f88837fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f888415f840 0x7f8884156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f88837fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f888415f840 0x7f8884156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42874/0 (socket says 172.21.15.112:42874) 2024-09-15T23:55:54.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f88837fe640 1 -- 172.21.15.112:0/2016946556 learned_addr learned my addr 172.21.15.112:0/2016946556 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:54.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f8883fff640 1 --2- 172.21.15.112:0/2016946556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88840b3e00 0x7f8884146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f88837fe640 1 -- 172.21.15.112:0/2016946556 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8884156360 msgr2=0x7f8884157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f88837fe640 1 --2- 172.21.15.112:0/2016946556 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8884156360 0x7f8884157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f88837fe640 1 -- 172.21.15.112:0/2016946556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88840b3e00 msgr2=0x7f8884146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f88837fe640 1 --2- 172.21.15.112:0/2016946556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88840b3e00 0x7f8884146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f88837fe640 1 -- 172.21.15.112:0/2016946556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8884147140 con 0x7f888415f840 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f88837fe640 1 --2- 172.21.15.112:0/2016946556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f888415f840 0x7f8884156ab0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f887800c7f0 tx=0x7f887800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f8880ff9640 1 -- 172.21.15.112:0/2016946556 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8878015070 con 0x7f888415f840 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f8880ff9640 1 -- 172.21.15.112:0/2016946556 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8878007820 con 0x7f888415f840 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 -- 172.21.15.112:0/2016946556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88840b5310 con 0x7f888415f840 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f8880ff9640 1 -- 172.21.15.112:0/2016946556 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8878007c10 con 0x7f888415f840 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.442+0000 7f888a5b4640 1 -- 172.21.15.112:0/2016946556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88840b5890 con 0x7f888415f840 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.446+0000 7f888a5b4640 1 -- 172.21.15.112:0/2016946556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f888415afa0 con 0x7f888415f840 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.446+0000 7f8880ff9640 1 -- 172.21.15.112:0/2016946556 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8878018070 con 0x7f888415f840 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.446+0000 7f8880ff9640 1 --2- 172.21.15.112:0/2016946556 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f88700678c0 0x7f8870069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.446+0000 7f8880ff9640 1 -- 172.21.15.112:0/2016946556 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f8878085d80 con 0x7f888415f840 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.446+0000 7f8883fff640 1 --2- 172.21.15.112:0/2016946556 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f88700678c0 0x7f8870069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.446+0000 7f8883fff640 1 --2- 172.21.15.112:0/2016946556 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f88700678c0 0x7f8870069d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f88740ad000 tx=0x7f8874008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.450+0000 7f8880ff9640 1 -- 172.21.15.112:0/2016946556 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f888415afa0 con 0x7f888415f840 2024-09-15T23:55:54.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.642+0000 7f888a5b4640 1 -- 172.21.15.112:0/2016946556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f888406e470 con 0x7f888415f840 2024-09-15T23:55:54.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.646+0000 7f8880ff9640 1 -- 172.21.15.112:0/2016946556 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5232 (secure 0 0 0) 0x7f8878056730 con 0x7f888415f840 2024-09-15T23:55:54.646 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:54.646 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":22,"btime":"2024-09-15T23:55:31:957534+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1762952607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1762952607},{"type":"v1","addr":"172.21.15.169:6834","nonce":1762952607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1383551321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1383551321},{"type":"v1","addr":"172.21.15.169:6835","nonce":1383551321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/235120639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":235120639},{"type":"v1","addr":"172.21.15.112:6835","nonce":235120639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:29.310328+0000","modified":"2024-09-15T23:55:31.304308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1037773891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1037773891},{"type":"v1","addr":"172.21.15.112:6837","nonce":1037773891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-15T23:55:54.647 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 22 2024-09-15T23:55:54.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.646+0000 7f888a5b4640 1 -- 172.21.15.112:0/2016946556 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f88700678c0 msgr2=0x7f8870069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.646+0000 7f888a5b4640 1 --2- 172.21.15.112:0/2016946556 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f88700678c0 0x7f8870069d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f88740ad000 tx=0x7f8874008040 comp rx=0 tx=0).stop 2024-09-15T23:55:54.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.646+0000 7f888a5b4640 1 -- 172.21.15.112:0/2016946556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f888415f840 msgr2=0x7f8884156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.646+0000 7f888a5b4640 1 --2- 172.21.15.112:0/2016946556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f888415f840 0x7f8884156ab0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f887800c7f0 tx=0x7f887800ccb0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.646+0000 7f888a5b4640 1 -- 172.21.15.112:0/2016946556 shutdown_connections 2024-09-15T23:55:54.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.646+0000 7f888a5b4640 1 --2- 172.21.15.112:0/2016946556 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f88700678c0 0x7f8870069d80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.646+0000 7f888a5b4640 1 --2- 172.21.15.112:0/2016946556 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8884156360 0x7f8884157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.646+0000 7f888a5b4640 1 --2- 172.21.15.112:0/2016946556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f888415f840 0x7f8884156ab0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.646+0000 7f888a5b4640 1 --2- 172.21.15.112:0/2016946556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88840b3e00 0x7f8884146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.646+0000 7f888a5b4640 1 -- 172.21.15.112:0/2016946556 >> 172.21.15.112:0/2016946556 conn(0x7f888406bcc0 msgr2=0x7f888406c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:54.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.646+0000 7f888a5b4640 1 -- 172.21.15.112:0/2016946556 shutdown_connections 2024-09-15T23:55:54.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.646+0000 7f888a5b4640 1 -- 172.21.15.112:0/2016946556 wait complete. 2024-09-15T23:55:54.664 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:54.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42deb28640 1 Processor -- start 2024-09-15T23:55:54.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42deb28640 1 -- start start 2024-09-15T23:55:54.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42deb28640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f42d81520a0 0x7f42d806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42deb28640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d8070250 con 0x7f42d806fe50 2024-09-15T23:55:54.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42deb28640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d80aede0 con 0x7f42d815f3a0 2024-09-15T23:55:54.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42deb28640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f42d8152480 con 0x7f42d81520a0 2024-09-15T23:55:54.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d7fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f42d806fe50 0x7f42d815ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49624/0 (socket says 172.21.15.112:49624) 2024-09-15T23:55:54.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d7fff640 1 -- 172.21.15.112:0/4145351346 learned_addr learned my addr 172.21.15.112:0/4145351346 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:54.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42dc8c4640 1 --2- 172.21.15.112:0/4145351346 >> v2:172.21.15.169:3300/0 conn(0x7f42d81520a0 0x7f42d806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 -- 172.21.15.112:0/4145351346 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2557048919 0 0) 0x7f42d8070250 con 0x7f42d806fe50 2024-09-15T23:55:54.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 -- 172.21.15.112:0/4145351346 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c4005740 con 0x7f42d806fe50 2024-09-15T23:55:54.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 -- 172.21.15.112:0/4145351346 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3368590147 0 0) 0x7f42c4005740 con 0x7f42d806fe50 2024-09-15T23:55:54.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 -- 172.21.15.112:0/4145351346 >> v2:172.21.15.169:3300/0 conn(0x7f42d81520a0 msgr2=0x7f42d806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:54.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 --2- 172.21.15.112:0/4145351346 >> v2:172.21.15.169:3300/0 conn(0x7f42d81520a0 0x7f42d806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 -- 172.21.15.112:0/4145351346 >> v1:172.21.15.169:6789/0 conn(0x7f42d815f3a0 legacy=0x7f42d80adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 -- 172.21.15.112:0/4145351346 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d815fa10 con 0x7f42d806fe50 2024-09-15T23:55:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 -- 172.21.15.112:0/4145351346 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f42c0001680 con 0x7f42d806fe50 2024-09-15T23:55:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 -- 172.21.15.112:0/4145351346 >> v1:172.21.15.112:6789/0 conn(0x7f42d806fe50 legacy=0x7f42d815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 --2- 172.21.15.112:0/4145351346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42c4005bd0 0x7f42c4005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 --2- 172.21.15.112:0/4145351346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42c4006a20 0x7f42c4006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 --2- 172.21.15.112:0/4145351346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c40073e0 0x7f42c400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 -- 172.21.15.112:0/4145351346 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f42c400e250 con 0x7f42c40073e0 2024-09-15T23:55:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 -- 172.21.15.112:0/4145351346 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42c400e400 con 0x7f42c4005bd0 2024-09-15T23:55:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d77fe640 1 -- 172.21.15.112:0/4145351346 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f42c400e600 con 0x7f42c4006a20 2024-09-15T23:55:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42dd0c5640 1 --2- 172.21.15.112:0/4145351346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c40073e0 0x7f42c400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d7fff640 1 --2- 172.21.15.112:0/4145351346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42c4006a20 0x7f42c4006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42dd0c5640 1 -- 172.21.15.112:0/4145351346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42c4006a20 msgr2=0x7f42c4006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42dd0c5640 1 --2- 172.21.15.112:0/4145351346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42c4006a20 0x7f42c4006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42dd0c5640 1 -- 172.21.15.112:0/4145351346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42c4005bd0 msgr2=0x7f42c4005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:54.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42dd0c5640 1 --2- 172.21.15.112:0/4145351346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42c4005bd0 0x7f42c4005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42dd0c5640 1 -- 172.21.15.112:0/4145351346 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c4005740 con 0x7f42c40073e0 2024-09-15T23:55:54.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.782+0000 7f42d7fff640 1 --2- 172.21.15.112:0/4145351346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42c4006a20 0x7f42c4006ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42dd0c5640 1 -- 172.21.15.112:0/4145351346 reap_dead start 2024-09-15T23:55:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42dd0c5640 1 --2- 172.21.15.112:0/4145351346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c40073e0 0x7f42c400dbe0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f42d0001e70 tx=0x7f42d001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6378d75497202a34 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42d77fe640 1 -- 172.21.15.112:0/4145351346 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0001a90 con 0x7f42c40073e0 2024-09-15T23:55:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42d77fe640 1 -- 172.21.15.112:0/4145351346 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d0003ba0 con 0x7f42c40073e0 2024-09-15T23:55:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42d77fe640 1 -- 172.21.15.112:0/4145351346 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0005020 con 0x7f42c40073e0 2024-09-15T23:55:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 -- 172.21.15.112:0/4145351346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c40073e0 msgr2=0x7f42c400dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 --2- 172.21.15.112:0/4145351346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c40073e0 0x7f42c400dbe0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f42d0001e70 tx=0x7f42d001c780 comp rx=0 tx=0).stop 2024-09-15T23:55:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 -- 172.21.15.112:0/4145351346 shutdown_connections 2024-09-15T23:55:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 --2- 172.21.15.112:0/4145351346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c40073e0 0x7f42c400dbe0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 -- 172.21.15.112:0/4145351346 >> 172.21.15.112:0/4145351346 conn(0x7f42d80b1f90 msgr2=0x7f42d80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:54.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 -- 172.21.15.112:0/4145351346 shutdown_connections 2024-09-15T23:55:54.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 -- 172.21.15.112:0/4145351346 wait complete. 2024-09-15T23:55:54.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 Processor -- start 2024-09-15T23:55:54.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 -- start start 2024-09-15T23:55:54.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c40073e0 0x7f42d80cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42d80cec00 0x7f42d814fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42d8150d10 0x7f42d81511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f42d8073490 con 0x7f42c40073e0 2024-09-15T23:55:54.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42d815f830 con 0x7f42d8150d10 2024-09-15T23:55:54.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42deb28640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f42d8073770 con 0x7f42d80cec00 2024-09-15T23:55:54.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42dc8c4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c40073e0 0x7f42d80cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42dc8c4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c40073e0 0x7f42d80cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42892/0 (socket says 172.21.15.112:42892) 2024-09-15T23:55:54.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42dc8c4640 1 -- 172.21.15.112:0/154328553 learned_addr learned my addr 172.21.15.112:0/154328553 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:54.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42dc8c4640 1 -- 172.21.15.112:0/154328553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42d80cec00 msgr2=0x7f42d814fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42dc8c4640 1 --2- 172.21.15.112:0/154328553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42d80cec00 0x7f42d814fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42dc8c4640 1 -- 172.21.15.112:0/154328553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42d8150d10 msgr2=0x7f42d81511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42dc8c4640 1 --2- 172.21.15.112:0/154328553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42d8150d10 0x7f42d81511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42dc8c4640 1 -- 172.21.15.112:0/154328553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d8150580 con 0x7f42c40073e0 2024-09-15T23:55:54.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.786+0000 7f42dc8c4640 1 --2- 172.21.15.112:0/154328553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c40073e0 0x7f42d80cccb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f42c800e7c0 tx=0x7f42c800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:54.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.790+0000 7f42d57fa640 1 -- 172.21.15.112:0/154328553 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8017070 con 0x7f42c40073e0 2024-09-15T23:55:54.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.790+0000 7f42d57fa640 1 -- 172.21.15.112:0/154328553 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c800ee70 con 0x7f42c40073e0 2024-09-15T23:55:54.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.790+0000 7f42deb28640 1 -- 172.21.15.112:0/154328553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d80cd3b0 con 0x7f42c40073e0 2024-09-15T23:55:54.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.790+0000 7f42d57fa640 1 -- 172.21.15.112:0/154328553 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c800cae0 con 0x7f42c40073e0 2024-09-15T23:55:54.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.790+0000 7f42deb28640 1 -- 172.21.15.112:0/154328553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d80cd970 con 0x7f42c40073e0 2024-09-15T23:55:54.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.790+0000 7f42deb28640 1 -- 172.21.15.112:0/154328553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d8073a50 con 0x7f42c40073e0 2024-09-15T23:55:54.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.790+0000 7f42d57fa640 1 -- 172.21.15.112:0/154328553 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42c801a070 con 0x7f42c40073e0 2024-09-15T23:55:54.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.790+0000 7f42d57fa640 1 --2- 172.21.15.112:0/154328553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f42b80678f0 0x7f42b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.790+0000 7f42d57fa640 1 -- 172.21.15.112:0/154328553 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f42c8085f80 con 0x7f42c40073e0 2024-09-15T23:55:54.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.790+0000 7f42d7fff640 1 --2- 172.21.15.112:0/154328553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f42b80678f0 0x7f42b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.790+0000 7f42d7fff640 1 --2- 172.21.15.112:0/154328553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f42b80678f0 0x7f42b8069db0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f42c00017f0 tx=0x7f42c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:54.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.794+0000 7f42d57fa640 1 -- 172.21.15.112:0/154328553 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f42d8150580 con 0x7f42c40073e0 2024-09-15T23:55:54.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.974+0000 7f42deb28640 1 -- 172.21.15.112:0/154328553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42d806e540 con 0x7f42c40073e0 2024-09-15T23:55:54.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.978+0000 7f42d57fa640 1 -- 172.21.15.112:0/154328553 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5232 (secure 0 0 0) 0x7f42c8056930 con 0x7f42c40073e0 2024-09-15T23:55:54.979 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:54.979 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":22,"btime":"2024-09-15T23:55:31:957534+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1762952607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1762952607},{"type":"v1","addr":"172.21.15.169:6834","nonce":1762952607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1383551321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1383551321},{"type":"v1","addr":"172.21.15.169:6835","nonce":1383551321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/235120639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":235120639},{"type":"v1","addr":"172.21.15.112:6835","nonce":235120639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:29.310328+0000","modified":"2024-09-15T23:55:31.304308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/1037773891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1037773891},{"type":"v1","addr":"172.21.15.112:6837","nonce":1037773891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-15T23:55:54.979 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 22 2024-09-15T23:55:54.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.978+0000 7f42deb28640 1 -- 172.21.15.112:0/154328553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f42b80678f0 msgr2=0x7f42b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.978+0000 7f42deb28640 1 --2- 172.21.15.112:0/154328553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f42b80678f0 0x7f42b8069db0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f42c00017f0 tx=0x7f42c0009040 comp rx=0 tx=0).stop 2024-09-15T23:55:54.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.978+0000 7f42deb28640 1 -- 172.21.15.112:0/154328553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c40073e0 msgr2=0x7f42d80cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.978+0000 7f42deb28640 1 --2- 172.21.15.112:0/154328553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c40073e0 0x7f42d80cccb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f42c800e7c0 tx=0x7f42c800ec80 comp rx=0 tx=0).stop 2024-09-15T23:55:54.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.978+0000 7f42deb28640 1 -- 172.21.15.112:0/154328553 shutdown_connections 2024-09-15T23:55:54.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.978+0000 7f42deb28640 1 --2- 172.21.15.112:0/154328553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f42b80678f0 0x7f42b8069db0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.978+0000 7f42deb28640 1 --2- 172.21.15.112:0/154328553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42d8150d10 0x7f42d81511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.978+0000 7f42deb28640 1 --2- 172.21.15.112:0/154328553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42d80cec00 0x7f42d814fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.978+0000 7f42deb28640 1 --2- 172.21.15.112:0/154328553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42c40073e0 0x7f42d80cccb0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.978+0000 7f42deb28640 1 -- 172.21.15.112:0/154328553 >> 172.21.15.112:0/154328553 conn(0x7f42d80b1f90 msgr2=0x7f42d80cc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:54.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.978+0000 7f42deb28640 1 -- 172.21.15.112:0/154328553 shutdown_connections 2024-09-15T23:55:54.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:54.978+0000 7f42deb28640 1 -- 172.21.15.112:0/154328553 wait complete. 2024-09-15T23:55:54.997 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:55.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.106+0000 7f12702da640 1 Processor -- start 2024-09-15T23:55:55.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.106+0000 7f12702da640 1 -- start start 2024-09-15T23:55:55.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.110+0000 7f12702da640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f126815bec0 0x7f12680ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.110+0000 7f12702da640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f12680af470 0x7f126806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.110+0000 7f12702da640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12680b3290 con 0x7f126815c2a0 2024-09-15T23:55:55.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.110+0000 7f12702da640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f12680b3570 con 0x7f126815bec0 2024-09-15T23:55:55.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.110+0000 7f12702da640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f12680b3850 con 0x7f12680af470 2024-09-15T23:55:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.110+0000 7f126e076640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f126815bec0 0x7f12680ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.110+0000 7f126e877640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f12680af470 0x7f126806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.110+0000 7f126e877640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f12680af470 0x7f126806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:34958/0 (socket says 172.21.15.112:34958) 2024-09-15T23:55:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.110+0000 7f126e877640 1 -- 172.21.15.112:0/376977992 learned_addr learned my addr 172.21.15.112:0/376977992 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.110+0000 7f126e877640 1 -- 172.21.15.112:0/376977992 >> v2:172.21.15.169:3300/0 conn(0x7f126815bec0 msgr2=0x7f12680ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.110+0000 7f126e877640 1 --2- 172.21.15.112:0/376977992 >> v2:172.21.15.169:3300/0 conn(0x7f126815bec0 0x7f12680ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.110+0000 7f126e877640 1 -- 172.21.15.112:0/376977992 >> v1:172.21.15.169:6789/0 conn(0x7f126815c2a0 legacy=0x7f12680aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.110+0000 7f126e877640 1 -- 172.21.15.112:0/376977992 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12680b3b30 con 0x7f12680af470 2024-09-15T23:55:55.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126e877640 1 --2- 172.21.15.112:0/376977992 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f12680af470 0x7f126806e000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1260009e50 tx=0x7f126001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=635b4c99f0985f07 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:55.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126d074640 1 -- 172.21.15.112:0/376977992 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12600a5830 con 0x7f12680af470 2024-09-15T23:55:55.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126d074640 1 -- 172.21.15.112:0/376977992 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12600a59d0 con 0x7f12680af470 2024-09-15T23:55:55.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126d074640 1 -- 172.21.15.112:0/376977992 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12600a5da0 con 0x7f12680af470 2024-09-15T23:55:55.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 -- 172.21.15.112:0/376977992 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f12680af470 msgr2=0x7f126806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 --2- 172.21.15.112:0/376977992 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f12680af470 0x7f126806e000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1260009e50 tx=0x7f126001c970 comp rx=0 tx=0).stop 2024-09-15T23:55:55.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 -- 172.21.15.112:0/376977992 shutdown_connections 2024-09-15T23:55:55.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 --2- 172.21.15.112:0/376977992 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f12680af470 0x7f126806e000 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 --2- 172.21.15.112:0/376977992 >> v2:172.21.15.169:3300/0 conn(0x7f126815bec0 0x7f12680ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 -- 172.21.15.112:0/376977992 >> 172.21.15.112:0/376977992 conn(0x7f12680b1f90 msgr2=0x7f12680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 -- 172.21.15.112:0/376977992 shutdown_connections 2024-09-15T23:55:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 -- 172.21.15.112:0/376977992 wait complete. 2024-09-15T23:55:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 Processor -- start 2024-09-15T23:55:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 -- start start 2024-09-15T23:55:55.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12680af470 0x7f1268149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126815bec0 0x7f12680b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126815c2a0 0x7f12680b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f126806ed50 con 0x7f12680af470 2024-09-15T23:55:55.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f12680ad740 con 0x7f126815c2a0 2024-09-15T23:55:55.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f12702da640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f126806eed0 con 0x7f126815bec0 2024-09-15T23:55:55.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126e076640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12680af470 0x7f1268149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126e076640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12680af470 0x7f1268149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42906/0 (socket says 172.21.15.112:42906) 2024-09-15T23:55:55.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126e076640 1 -- 172.21.15.112:0/1501500473 learned_addr learned my addr 172.21.15.112:0/1501500473 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:55.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126e877640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126815c2a0 0x7f12680b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126d875640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126815bec0 0x7f12680b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126e076640 1 -- 172.21.15.112:0/1501500473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126815bec0 msgr2=0x7f12680b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126e076640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126815bec0 0x7f12680b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126e076640 1 -- 172.21.15.112:0/1501500473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126815c2a0 msgr2=0x7f12680b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126e076640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126815c2a0 0x7f12680b0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126e076640 1 -- 172.21.15.112:0/1501500473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1268073d70 con 0x7f12680af470 2024-09-15T23:55:55.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.114+0000 7f126e877640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126815c2a0 0x7f12680b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:55:55.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.118+0000 7f126e076640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12680af470 0x7f1268149df0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f126400e930 tx=0x7f126400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:55.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.118+0000 7f125effd640 1 -- 172.21.15.112:0/1501500473 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1264017070 con 0x7f12680af470 2024-09-15T23:55:55.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.118+0000 7f125effd640 1 -- 172.21.15.112:0/1501500473 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126400ca00 con 0x7f12680af470 2024-09-15T23:55:55.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.118+0000 7f12702da640 1 -- 172.21.15.112:0/1501500473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1268072120 con 0x7f12680af470 2024-09-15T23:55:55.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.118+0000 7f125effd640 1 -- 172.21.15.112:0/1501500473 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126400cdb0 con 0x7f12680af470 2024-09-15T23:55:55.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.118+0000 7f12702da640 1 -- 172.21.15.112:0/1501500473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1268073a40 con 0x7f12680af470 2024-09-15T23:55:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.118+0000 7f12702da640 1 -- 172.21.15.112:0/1501500473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1268071f10 con 0x7f12680af470 2024-09-15T23:55:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.118+0000 7f125effd640 1 -- 172.21.15.112:0/1501500473 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f126401a070 con 0x7f12680af470 2024-09-15T23:55:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.118+0000 7f125effd640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f124c0678c0 0x7f124c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.118+0000 7f126d875640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f124c0678c0 0x7f124c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.118+0000 7f125effd640 1 -- 172.21.15.112:0/1501500473 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f12640861a0 con 0x7f12680af470 2024-09-15T23:55:55.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.118+0000 7f126d875640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f124c0678c0 0x7f124c069d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f12680b0f70 tx=0x7f1258009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:55.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.122+0000 7f125effd640 1 -- 172.21.15.112:0/1501500473 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1264056ca0 con 0x7f12680af470 2024-09-15T23:55:55.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.298+0000 7f12702da640 1 -- 172.21.15.112:0/1501500473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f126806e000 con 0x7f12680af470 2024-09-15T23:55:55.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.302+0000 7f125effd640 1 -- 172.21.15.112:0/1501500473 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16954 (secure 0 0 0) 0x7f12640565a0 con 0x7f12680af470 2024-09-15T23:55:55.303 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:55:55.303 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":51,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:55:30.949208+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:26.989002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:28.298793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.302+0000 7f12702da640 1 -- 172.21.15.112:0/1501500473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f124c0678c0 msgr2=0x7f124c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.302+0000 7f12702da640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f124c0678c0 0x7f124c069d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f12680b0f70 tx=0x7f1258009040 comp rx=0 tx=0).stop 2024-09-15T23:55:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.302+0000 7f12702da640 1 -- 172.21.15.112:0/1501500473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12680af470 msgr2=0x7f1268149df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.302+0000 7f12702da640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12680af470 0x7f1268149df0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f126400e930 tx=0x7f126400edf0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.302+0000 7f12702da640 1 -- 172.21.15.112:0/1501500473 shutdown_connections 2024-09-15T23:55:55.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.302+0000 7f12702da640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f124c0678c0 0x7f124c069d80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.302+0000 7f12702da640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126815c2a0 0x7f12680b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.302+0000 7f12702da640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f126815bec0 0x7f12680b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.302+0000 7f12702da640 1 --2- 172.21.15.112:0/1501500473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12680af470 0x7f1268149df0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.302+0000 7f12702da640 1 -- 172.21.15.112:0/1501500473 >> 172.21.15.112:0/1501500473 conn(0x7f12680b1f90 msgr2=0x7f1268159930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:55.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.302+0000 7f12702da640 1 -- 172.21.15.112:0/1501500473 shutdown_connections 2024-09-15T23:55:55.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.302+0000 7f12702da640 1 -- 172.21.15.112:0/1501500473 wait complete. 2024-09-15T23:55:55.322 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:55:55.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f24164ae640 1 Processor -- start 2024-09-15T23:55:55.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f24164ae640 1 -- start start 2024-09-15T23:55:55.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f24164ae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24100d3060 0x7f24100cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f24164ae640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24100d0300 con 0x7f2410161a60 2024-09-15T23:55:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f24164ae640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24100b0f60 con 0x7f24100cf450 2024-09-15T23:55:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f24164ae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f24100cfd40 con 0x7f24100d3060 2024-09-15T23:55:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240ffff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2410161a60 0x7f24100d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49626/0 (socket says 172.21.15.112:49626) 2024-09-15T23:55:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240ffff640 1 -- 172.21.15.112:0/3563911688 learned_addr learned my addr 172.21.15.112:0/3563911688 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240f7fe640 1 --2- 172.21.15.112:0/3563911688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24100d3060 0x7f24100cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 -- 172.21.15.112:0/3563911688 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1524355601 0 0) 0x7f2404001120 con 0x7f2410161a60 2024-09-15T23:55:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 -- 172.21.15.112:0/3563911688 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23f8003530 con 0x7f2410161a60 2024-09-15T23:55:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 -- 172.21.15.112:0/3563911688 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 459383717 0 0) 0x7f23f8003530 con 0x7f2410161a60 2024-09-15T23:55:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 -- 172.21.15.112:0/3563911688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24100d3060 msgr2=0x7f24100cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 --2- 172.21.15.112:0/3563911688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24100d3060 0x7f24100cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 -- 172.21.15.112:0/3563911688 >> v1:172.21.15.169:6789/0 conn(0x7f24100cf450 legacy=0x7f241006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 -- 172.21.15.112:0/3563911688 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24100d0020 con 0x7f2410161a60 2024-09-15T23:55:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 -- 172.21.15.112:0/3563911688 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f2404001850 con 0x7f2410161a60 2024-09-15T23:55:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 -- 172.21.15.112:0/3563911688 >> v1:172.21.15.112:6789/0 conn(0x7f2410161a60 legacy=0x7f24100d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 --2- 172.21.15.112:0/3563911688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23f80039f0 0x7f23f8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 --2- 172.21.15.112:0/3563911688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f8004810 0x7f23f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 --2- 172.21.15.112:0/3563911688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24100d3060 0x7f23f8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 -- 172.21.15.112:0/3563911688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f24100cfd40 con 0x7f23f8004810 2024-09-15T23:55:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 -- 172.21.15.112:0/3563911688 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f23f800bb00 con 0x7f23f80039f0 2024-09-15T23:55:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240effd640 1 -- 172.21.15.112:0/3563911688 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f23f800bd00 con 0x7f24100d3060 2024-09-15T23:55:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240f7fe640 1 --2- 172.21.15.112:0/3563911688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f8004810 0x7f23f8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240ffff640 1 --2- 172.21.15.112:0/3563911688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23f80039f0 0x7f23f8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f2414a4b640 1 --2- 172.21.15.112:0/3563911688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24100d3060 0x7f23f8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240f7fe640 1 -- 172.21.15.112:0/3563911688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24100d3060 msgr2=0x7f23f8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:55.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240f7fe640 1 --2- 172.21.15.112:0/3563911688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24100d3060 0x7f23f8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240f7fe640 1 -- 172.21.15.112:0/3563911688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23f80039f0 msgr2=0x7f23f8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:55.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240f7fe640 1 --2- 172.21.15.112:0/3563911688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23f80039f0 0x7f23f8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240f7fe640 1 -- 172.21.15.112:0/3563911688 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f8003530 con 0x7f23f8004810 2024-09-15T23:55:55.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f240ffff640 1 --2- 172.21.15.112:0/3563911688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23f80039f0 0x7f23f8003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:55.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.446+0000 7f2414a4b640 1 --2- 172.21.15.112:0/3563911688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24100d3060 0x7f23f8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:55.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.450+0000 7f240f7fe640 1 --2- 172.21.15.112:0/3563911688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f8004810 0x7f23f8004c90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2400009ae0 tx=0x7f240001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6c849d6b3ec109 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:55.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.450+0000 7f240effd640 1 -- 172.21.15.112:0/3563911688 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24000b2070 con 0x7f23f8004810 2024-09-15T23:55:55.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.450+0000 7f240effd640 1 -- 172.21.15.112:0/3563911688 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24000a5610 con 0x7f23f8004810 2024-09-15T23:55:55.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.450+0000 7f240effd640 1 -- 172.21.15.112:0/3563911688 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24000096b0 con 0x7f23f8004810 2024-09-15T23:55:55.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.450+0000 7f24164ae640 1 -- 172.21.15.112:0/3563911688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f8004810 msgr2=0x7f23f8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.450+0000 7f24164ae640 1 --2- 172.21.15.112:0/3563911688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f8004810 0x7f23f8004c90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2400009ae0 tx=0x7f240001ca40 comp rx=0 tx=0).stop 2024-09-15T23:55:55.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.450+0000 7f2414a4b640 1 -- 172.21.15.112:0/3563911688 reap_dead start 2024-09-15T23:55:55.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.450+0000 7f24164ae640 1 -- 172.21.15.112:0/3563911688 shutdown_connections 2024-09-15T23:55:55.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.450+0000 7f24164ae640 1 -- 172.21.15.112:0/3563911688 >> 172.21.15.112:0/3563911688 conn(0x7f241008bf90 msgr2=0x7f241009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:55.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.450+0000 7f24164ae640 1 -- 172.21.15.112:0/3563911688 shutdown_connections 2024-09-15T23:55:55.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.450+0000 7f24164ae640 1 -- 172.21.15.112:0/3563911688 wait complete. 2024-09-15T23:55:55.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.450+0000 7f24164ae640 1 Processor -- start 2024-09-15T23:55:55.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.450+0000 7f24164ae640 1 -- start start 2024-09-15T23:55:55.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f24164ae640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f8004810 0x7f24101695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f24164ae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24100cc0c0 0x7f24100cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f24164ae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24100cdce0 0x7f241015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f24164ae640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f241016a0a0 con 0x7f23f8004810 2024-09-15T23:55:55.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f24164ae640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2410169f20 con 0x7f24100cdce0 2024-09-15T23:55:55.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f24164ae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f241016a220 con 0x7f24100cc0c0 2024-09-15T23:55:55.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f8004810 0x7f24101695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f8004810 0x7f24101695c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42926/0 (socket says 172.21.15.112:42926) 2024-09-15T23:55:55.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240ffff640 1 -- 172.21.15.112:0/4191469122 learned_addr learned my addr 172.21.15.112:0/4191469122 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:55.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240ffff640 1 -- 172.21.15.112:0/4191469122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24100cc0c0 msgr2=0x7f24100cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240ffff640 1 --2- 172.21.15.112:0/4191469122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24100cc0c0 0x7f24100cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240ffff640 1 -- 172.21.15.112:0/4191469122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24100cdce0 msgr2=0x7f241015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f2414a4b640 1 --2- 172.21.15.112:0/4191469122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24100cdce0 0x7f241015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240ffff640 1 --2- 172.21.15.112:0/4191469122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24100cdce0 0x7f241015b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240ffff640 1 -- 172.21.15.112:0/4191469122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24100ccc40 con 0x7f23f8004810 2024-09-15T23:55:55.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240ffff640 1 --2- 172.21.15.112:0/4191469122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f8004810 0x7f24101695c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2404007fd0 tx=0x7f240400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:55.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240cff9640 1 -- 172.21.15.112:0/4191469122 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404019070 con 0x7f23f8004810 2024-09-15T23:55:55.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240cff9640 1 -- 172.21.15.112:0/4191469122 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24040074e0 con 0x7f23f8004810 2024-09-15T23:55:55.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f24164ae640 1 -- 172.21.15.112:0/4191469122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24100ccf20 con 0x7f23f8004810 2024-09-15T23:55:55.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240cff9640 1 -- 172.21.15.112:0/4191469122 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24040049f0 con 0x7f23f8004810 2024-09-15T23:55:55.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f24164ae640 1 -- 172.21.15.112:0/4191469122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24100cd4e0 con 0x7f23f8004810 2024-09-15T23:55:55.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f24164ae640 1 -- 172.21.15.112:0/4191469122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f241006d6b0 con 0x7f23f8004810 2024-09-15T23:55:55.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240cff9640 1 -- 172.21.15.112:0/4191469122 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2404004b90 con 0x7f23f8004810 2024-09-15T23:55:55.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240cff9640 1 --2- 172.21.15.112:0/4191469122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23fc0678f0 0x7f23fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240cff9640 1 -- 172.21.15.112:0/4191469122 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f24040858e0 con 0x7f23f8004810 2024-09-15T23:55:55.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.454+0000 7f240f7fe640 1 --2- 172.21.15.112:0/4191469122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23fc0678f0 0x7f23fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.458+0000 7f240f7fe640 1 --2- 172.21.15.112:0/4191469122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23fc0678f0 0x7f23fc069db0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f24000af000 tx=0x7f2400004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:55.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.462+0000 7f240cff9640 1 -- 172.21.15.112:0/4191469122 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f24100d0300 con 0x7f23f8004810 2024-09-15T23:55:55.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.642+0000 7f24164ae640 1 -- 172.21.15.112:0/4191469122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f24100b1840 con 0x7f23f8004810 2024-09-15T23:55:55.644 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-15T23:55:55.642+0000 7fae14e39640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:55:55.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.646+0000 7f240cff9640 1 -- 172.21.15.112:0/4191469122 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) ==== 161+0+0 (secure 0 0 0) 0x7f2404056210 con 0x7f23f8004810 2024-09-15T23:55:55.647 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:55:55.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.646+0000 7f24164ae640 1 -- 172.21.15.112:0/4191469122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23fc0678f0 msgr2=0x7f23fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.646+0000 7f24164ae640 1 --2- 172.21.15.112:0/4191469122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23fc0678f0 0x7f23fc069db0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f24000af000 tx=0x7f2400004740 comp rx=0 tx=0).stop 2024-09-15T23:55:55.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.646+0000 7f24164ae640 1 -- 172.21.15.112:0/4191469122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f8004810 msgr2=0x7f24101695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.646+0000 7f24164ae640 1 --2- 172.21.15.112:0/4191469122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f8004810 0x7f24101695c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2404007fd0 tx=0x7f240400dcc0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.646+0000 7f24164ae640 1 -- 172.21.15.112:0/4191469122 shutdown_connections 2024-09-15T23:55:55.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.646+0000 7f24164ae640 1 --2- 172.21.15.112:0/4191469122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23fc0678f0 0x7f23fc069db0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.646+0000 7f24164ae640 1 --2- 172.21.15.112:0/4191469122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24100cdce0 0x7f241015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.646+0000 7f24164ae640 1 --2- 172.21.15.112:0/4191469122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24100cc0c0 0x7f24100cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.646+0000 7f24164ae640 1 --2- 172.21.15.112:0/4191469122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23f8004810 0x7f24101695c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.646+0000 7f24164ae640 1 -- 172.21.15.112:0/4191469122 >> 172.21.15.112:0/4191469122 conn(0x7f241008bf90 msgr2=0x7f241015f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:55.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.650+0000 7f24164ae640 1 -- 172.21.15.112:0/4191469122 shutdown_connections 2024-09-15T23:55:55.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.650+0000 7f24164ae640 1 -- 172.21.15.112:0/4191469122 wait complete. 2024-09-15T23:55:55.666 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:55:55.702 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-15T23:55:55.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f044801c640 1 Processor -- start 2024-09-15T23:55:55.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f044801c640 1 -- start start 2024-09-15T23:55:55.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f044801c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f044015c2a0 0x7f04400aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f044801c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f04400af2a0 0x7f044006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f044801c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04400b3290 con 0x7f044015bec0 2024-09-15T23:55:55.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f044801c640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f04400b3570 con 0x7f04400af2a0 2024-09-15T23:55:55.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f044801c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f04400b3850 con 0x7f044015c2a0 2024-09-15T23:55:55.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f04465b9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f04400af2a0 0x7f044006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f04465b9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f04400af2a0 0x7f044006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42960/0 (socket says 172.21.15.112:42960) 2024-09-15T23:55:55.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f04465b9640 1 -- 172.21.15.112:0/861161691 learned_addr learned my addr 172.21.15.112:0/861161691 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:55.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f04455b7640 1 --2- 172.21.15.112:0/861161691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f044015c2a0 0x7f04400aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f04465b9640 1 -- 172.21.15.112:0/861161691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f044015c2a0 msgr2=0x7f04400aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:55.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f04465b9640 1 --2- 172.21.15.112:0/861161691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f044015c2a0 0x7f04400aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f04465b9640 1 -- 172.21.15.112:0/861161691 >> v1:172.21.15.169:6789/0 conn(0x7f044015bec0 legacy=0x7f04400ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:55.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f04465b9640 1 -- 172.21.15.112:0/861161691 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04400b3b30 con 0x7f04400af2a0 2024-09-15T23:55:55.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.782+0000 7f04455b7640 1 --2- 172.21.15.112:0/861161691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f044015c2a0 0x7f04400aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:55.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f04465b9640 1 --2- 172.21.15.112:0/861161691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04400af2a0 0x7f044006e000 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0438009e50 tx=0x7f043801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d763b59fc8c6cdad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:55.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f0444db6640 1 -- 172.21.15.112:0/861161691 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04380a5840 con 0x7f04400af2a0 2024-09-15T23:55:55.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f0444db6640 1 -- 172.21.15.112:0/861161691 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04380a59e0 con 0x7f04400af2a0 2024-09-15T23:55:55.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f0444db6640 1 -- 172.21.15.112:0/861161691 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04380a5db0 con 0x7f04400af2a0 2024-09-15T23:55:55.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 -- 172.21.15.112:0/861161691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04400af2a0 msgr2=0x7f044006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 --2- 172.21.15.112:0/861161691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04400af2a0 0x7f044006e000 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0438009e50 tx=0x7f043801c9c0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 -- 172.21.15.112:0/861161691 shutdown_connections 2024-09-15T23:55:55.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 --2- 172.21.15.112:0/861161691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04400af2a0 0x7f044006e000 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 --2- 172.21.15.112:0/861161691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f044015c2a0 0x7f04400aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 -- 172.21.15.112:0/861161691 >> 172.21.15.112:0/861161691 conn(0x7f04400b1f90 msgr2=0x7f04400b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:55.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 -- 172.21.15.112:0/861161691 shutdown_connections 2024-09-15T23:55:55.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 -- 172.21.15.112:0/861161691 wait complete. 2024-09-15T23:55:55.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 Processor -- start 2024-09-15T23:55:55.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 -- start start 2024-09-15T23:55:55.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04400af2a0 0x7f044014c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f044015bec0 0x7f044013b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f044015c2a0 0x7f044013b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f044006ed50 con 0x7f044015c2a0 2024-09-15T23:55:55.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f04400afc90 con 0x7f044015bec0 2024-09-15T23:55:55.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f044801c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f044006eed0 con 0x7f04400af2a0 2024-09-15T23:55:55.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f04465b9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f044015c2a0 0x7f044013b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f04465b9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f044015c2a0 0x7f044013b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42968/0 (socket says 172.21.15.112:42968) 2024-09-15T23:55:55.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.786+0000 7f04465b9640 1 -- 172.21.15.112:0/455369697 learned_addr learned my addr 172.21.15.112:0/455369697 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:55.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f0445db8640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04400af2a0 0x7f044014c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f04455b7640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f044015bec0 0x7f044013b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f04465b9640 1 -- 172.21.15.112:0/455369697 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04400af2a0 msgr2=0x7f044014c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f04465b9640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04400af2a0 0x7f044014c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f04465b9640 1 -- 172.21.15.112:0/455369697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f044015bec0 msgr2=0x7f044013b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f04465b9640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f044015bec0 0x7f044013b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f04465b9640 1 -- 172.21.15.112:0/455369697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044014cef0 con 0x7f044015c2a0 2024-09-15T23:55:55.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f04455b7640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f044015bec0 0x7f044013b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:55.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f04465b9640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f044015c2a0 0x7f044013b620 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0438009e50 tx=0x7f0438019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:55.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f04367fc640 1 -- 172.21.15.112:0/455369697 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04380bc020 con 0x7f044015c2a0 2024-09-15T23:55:55.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f04367fc640 1 -- 172.21.15.112:0/455369697 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04380b8880 con 0x7f044015c2a0 2024-09-15T23:55:55.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f044801c640 1 -- 172.21.15.112:0/455369697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044014d1d0 con 0x7f044015c2a0 2024-09-15T23:55:55.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f04367fc640 1 -- 172.21.15.112:0/455369697 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04380b8c70 con 0x7f044015c2a0 2024-09-15T23:55:55.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f044801c640 1 -- 172.21.15.112:0/455369697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0440151e90 con 0x7f044015c2a0 2024-09-15T23:55:55.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f044801c640 1 -- 172.21.15.112:0/455369697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f044006e000 con 0x7f044015c2a0 2024-09-15T23:55:55.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f04367fc640 1 -- 172.21.15.112:0/455369697 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04380bf020 con 0x7f044015c2a0 2024-09-15T23:55:55.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f04367fc640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f04240678c0 0x7f0424069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:55.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f04367fc640 1 -- 172.21.15.112:0/455369697 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6187+0+0 (secure 0 0 0) 0x7f0438121090 con 0x7f044015c2a0 2024-09-15T23:55:55.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f0445db8640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f04240678c0 0x7f0424069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:55.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.790+0000 7f0445db8640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f04240678c0 0x7f0424069d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f043c004e30 tx=0x7f043c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:55.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.794+0000 7f04367fc640 1 -- 172.21.15.112:0/455369697 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f04380c6030 con 0x7f044015c2a0 2024-09-15T23:55:55.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:55.978+0000 7f044801c640 1 -- 172.21.15.112:0/455369697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f04400b1d70 con 0x7f044015c2a0 2024-09-15T23:55:56.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.646+0000 7f04367fc640 1 -- 172.21.15.112:0/455369697 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f04380165e0 con 0x7f044015c2a0 2024-09-15T23:55:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.650+0000 7f044801c640 1 -- 172.21.15.112:0/455369697 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f04240678c0 msgr2=0x7f0424069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.650+0000 7f044801c640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f04240678c0 0x7f0424069d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f043c004e30 tx=0x7f043c009040 comp rx=0 tx=0).stop 2024-09-15T23:55:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.650+0000 7f044801c640 1 -- 172.21.15.112:0/455369697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f044015c2a0 msgr2=0x7f044013b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.650+0000 7f044801c640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f044015c2a0 0x7f044013b620 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0438009e50 tx=0x7f0438019760 comp rx=0 tx=0).stop 2024-09-15T23:55:56.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.650+0000 7f044801c640 1 -- 172.21.15.112:0/455369697 shutdown_connections 2024-09-15T23:55:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.650+0000 7f044801c640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f04240678c0 0x7f0424069d80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.650+0000 7f044801c640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f044015c2a0 0x7f044013b620 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.650+0000 7f044801c640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f044015bec0 0x7f044013b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.650+0000 7f044801c640 1 --2- 172.21.15.112:0/455369697 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04400af2a0 0x7f044014c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.650+0000 7f044801c640 1 -- 172.21.15.112:0/455369697 >> 172.21.15.112:0/455369697 conn(0x7f04400b1f90 msgr2=0x7f04400afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.650+0000 7f044801c640 1 -- 172.21.15.112:0/455369697 shutdown_connections 2024-09-15T23:55:56.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.650+0000 7f044801c640 1 -- 172.21.15.112:0/455369697 wait complete. 2024-09-15T23:55:56.670 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:55:56.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.838+0000 7f1159b68640 1 Processor -- start 2024-09-15T23:55:56.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f1159b68640 1 -- start start 2024-09-15T23:55:56.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f1159b68640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1154073e60 0x7f115406e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:56.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f1159b68640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f115406fef0 0x7f115415b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:56.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f1159b68640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f115415bda0 con 0x7f11540b3d50 2024-09-15T23:55:56.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f1159b68640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f115406ee50 con 0x7f1154073e60 2024-09-15T23:55:56.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f1159b68640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f115406f130 con 0x7f115406fef0 2024-09-15T23:55:56.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f11537fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1154073e60 0x7f115406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:56.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f11537fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1154073e60 0x7f115406e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42972/0 (socket says 172.21.15.112:42972) 2024-09-15T23:55:56.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f11537fe640 1 -- 172.21.15.112:0/2831090543 learned_addr learned my addr 172.21.15.112:0/2831090543 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:56.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f114affd640 1 --2- 172.21.15.112:0/2831090543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f115406fef0 0x7f115415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:56.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f11537fe640 1 -- 172.21.15.112:0/2831090543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f115406fef0 msgr2=0x7f115415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:56.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f11537fe640 1 --2- 172.21.15.112:0/2831090543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f115406fef0 0x7f115415b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:56.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f11537fe640 1 -- 172.21.15.112:0/2831090543 >> v1:172.21.15.169:6789/0 conn(0x7f11540b3d50 legacy=0x7f11540b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:56.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f11537fe640 1 -- 172.21.15.112:0/2831090543 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115406f410 con 0x7f1154073e60 2024-09-15T23:55:56.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f114affd640 1 --2- 172.21.15.112:0/2831090543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f115406fef0 0x7f115415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:56.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f11537fe640 1 --2- 172.21.15.112:0/2831090543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1154073e60 0x7f115406e800 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f114400bb10 tx=0x7f114401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb7729b6aae0bd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:56.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f1152ffd640 1 -- 172.21.15.112:0/2831090543 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11440b4070 con 0x7f1154073e60 2024-09-15T23:55:56.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f1152ffd640 1 -- 172.21.15.112:0/2831090543 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11440a7a00 con 0x7f1154073e60 2024-09-15T23:55:56.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.842+0000 7f1152ffd640 1 -- 172.21.15.112:0/2831090543 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11440a7dd0 con 0x7f1154073e60 2024-09-15T23:55:56.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 -- 172.21.15.112:0/2831090543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1154073e60 msgr2=0x7f115406e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:56.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 --2- 172.21.15.112:0/2831090543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1154073e60 0x7f115406e800 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f114400bb10 tx=0x7f114401eb60 comp rx=0 tx=0).stop 2024-09-15T23:55:56.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 -- 172.21.15.112:0/2831090543 shutdown_connections 2024-09-15T23:55:56.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 --2- 172.21.15.112:0/2831090543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f115406fef0 0x7f115415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:56.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 --2- 172.21.15.112:0/2831090543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1154073e60 0x7f115406e800 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:56.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 -- 172.21.15.112:0/2831090543 >> 172.21.15.112:0/2831090543 conn(0x7f11540b1f90 msgr2=0x7f11540b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:56.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 -- 172.21.15.112:0/2831090543 shutdown_connections 2024-09-15T23:55:56.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 -- 172.21.15.112:0/2831090543 wait complete. 2024-09-15T23:55:56.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 Processor -- start 2024-09-15T23:55:56.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 -- start start 2024-09-15T23:55:56.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f115406fef0 0x7f11541650b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:56.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1154073e60 0x7f115414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:56.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11540b3d50 0x7f11540b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:56.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f11540729a0 con 0x7f11540b3d50 2024-09-15T23:55:56.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1154072820 con 0x7f1154073e60 2024-09-15T23:55:56.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1154072b20 con 0x7f115406fef0 2024-09-15T23:55:56.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1153fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11540b3d50 0x7f11540b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:56.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1153fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11540b3d50 0x7f11540b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42976/0 (socket says 172.21.15.112:42976) 2024-09-15T23:55:56.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1153fff640 1 -- 172.21.15.112:0/1229964256 learned_addr learned my addr 172.21.15.112:0/1229964256 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:56.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f11537fe640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f115406fef0 0x7f11541650b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:56.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f114affd640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1154073e60 0x7f115414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:56.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1153fff640 1 -- 172.21.15.112:0/1229964256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f115406fef0 msgr2=0x7f11541650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:56.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1153fff640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f115406fef0 0x7f11541650b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:56.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1153fff640 1 -- 172.21.15.112:0/1229964256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1154073e60 msgr2=0x7f115414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:56.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1153fff640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1154073e60 0x7f115414a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:56.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1153fff640 1 -- 172.21.15.112:0/1229964256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11541fa6a0 con 0x7f11540b3d50 2024-09-15T23:55:56.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f114affd640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1154073e60 0x7f115414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:56.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1153fff640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11540b3d50 0x7f11540b13c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f114c00c780 tx=0x7f114c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:56.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1150ff9640 1 -- 172.21.15.112:0/1229964256 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c004b70 con 0x7f11540b3d50 2024-09-15T23:55:56.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1150ff9640 1 -- 172.21.15.112:0/1229964256 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f114c004d10 con 0x7f11540b3d50 2024-09-15T23:55:56.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 -- 172.21.15.112:0/1229964256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11541fa980 con 0x7f11540b3d50 2024-09-15T23:55:56.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1150ff9640 1 -- 172.21.15.112:0/1229964256 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c00aa90 con 0x7f11540b3d50 2024-09-15T23:55:56.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.846+0000 7f1159b68640 1 -- 172.21.15.112:0/1229964256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11541faf40 con 0x7f11540b3d50 2024-09-15T23:55:56.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.850+0000 7f1159b68640 1 -- 172.21.15.112:0/1229964256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f115415b860 con 0x7f11540b3d50 2024-09-15T23:55:56.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.850+0000 7f1150ff9640 1 -- 172.21.15.112:0/1229964256 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f114c00ac30 con 0x7f11540b3d50 2024-09-15T23:55:56.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.850+0000 7f1150ff9640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11340678c0 0x7f1134069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:56.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.850+0000 7f11537fe640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11340678c0 0x7f1134069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:56.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.850+0000 7f1150ff9640 1 -- 172.21.15.112:0/1229964256 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6187+0+0 (secure 0 0 0) 0x7f114c086200 con 0x7f11540b3d50 2024-09-15T23:55:56.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.850+0000 7f11537fe640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11340678c0 0x7f1134069d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f11440b1000 tx=0x7f1144008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:56.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:56.854+0000 7f1150ff9640 1 -- 172.21.15.112:0/1229964256 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f114c020070 con 0x7f11540b3d50 2024-09-15T23:55:57.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.002+0000 7f1159b68640 1 -- 172.21.15.112:0/1229964256 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f11540723f0 con 0x7f11540b3d50 2024-09-15T23:55:57.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.650+0000 7f1150ff9640 1 -- 172.21.15.112:0/1229964256 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) ==== 181+0+0 (secure 0 0 0) 0x7f114c056ad0 con 0x7f11540b3d50 2024-09-15T23:55:57.651 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:55:57.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.654+0000 7f1159b68640 1 -- 172.21.15.112:0/1229964256 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11340678c0 msgr2=0x7f1134069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:57.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.654+0000 7f1159b68640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11340678c0 0x7f1134069d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f11440b1000 tx=0x7f1144008040 comp rx=0 tx=0).stop 2024-09-15T23:55:57.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.654+0000 7f1159b68640 1 -- 172.21.15.112:0/1229964256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11540b3d50 msgr2=0x7f11540b13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:57.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.654+0000 7f1159b68640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11540b3d50 0x7f11540b13c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f114c00c780 tx=0x7f114c00cc40 comp rx=0 tx=0).stop 2024-09-15T23:55:57.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.654+0000 7f1159b68640 1 -- 172.21.15.112:0/1229964256 shutdown_connections 2024-09-15T23:55:57.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.654+0000 7f1159b68640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11340678c0 0x7f1134069d80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:57.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.654+0000 7f1159b68640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11540b3d50 0x7f11540b13c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:57.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.654+0000 7f1159b68640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1154073e60 0x7f115414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:57.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.654+0000 7f1159b68640 1 --2- 172.21.15.112:0/1229964256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f115406fef0 0x7f11541650b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:57.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.654+0000 7f1159b68640 1 -- 172.21.15.112:0/1229964256 >> 172.21.15.112:0/1229964256 conn(0x7f11540b1f90 msgr2=0x7f11541591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:57.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.654+0000 7f1159b68640 1 -- 172.21.15.112:0/1229964256 shutdown_connections 2024-09-15T23:55:57.658 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.658+0000 7f1159b68640 1 -- 172.21.15.112:0/1229964256 wait complete. 2024-09-15T23:55:57.679 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:55:57.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.798+0000 7faf4ec5c640 1 Processor -- start 2024-09-15T23:55:57.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.798+0000 7faf4ec5c640 1 -- start start 2024-09-15T23:55:57.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf4ec5c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faf481520a0 0x7faf4806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:57.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf4ec5c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf4815f3a0 0x7faf480adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:57.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf4ec5c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf48070250 con 0x7faf4806fe50 2024-09-15T23:55:57.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf4ec5c640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7faf48152480 con 0x7faf481520a0 2024-09-15T23:55:57.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf4ec5c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faf480aede0 con 0x7faf4815f3a0 2024-09-15T23:55:57.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf4c9f8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faf481520a0 0x7faf4806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:57.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf4c9f8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faf481520a0 0x7faf4806f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42988/0 (socket says 172.21.15.112:42988) 2024-09-15T23:55:57.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf4c9f8640 1 -- 172.21.15.112:0/4129398026 learned_addr learned my addr 172.21.15.112:0/4129398026 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:57.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf4d1f9640 1 --2- 172.21.15.112:0/4129398026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf4815f3a0 0x7faf480adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:57.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf4c9f8640 1 -- 172.21.15.112:0/4129398026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf4815f3a0 msgr2=0x7faf480adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:57.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf4c9f8640 1 --2- 172.21.15.112:0/4129398026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf4815f3a0 0x7faf480adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:57.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf4c9f8640 1 -- 172.21.15.112:0/4129398026 >> v1:172.21.15.169:6789/0 conn(0x7faf4806fe50 legacy=0x7faf4815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:57.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf4c9f8640 1 -- 172.21.15.112:0/4129398026 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4815fa10 con 0x7faf481520a0 2024-09-15T23:55:57.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf4c9f8640 1 --2- 172.21.15.112:0/4129398026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf481520a0 0x7faf4806f910 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faf44009870 tx=0x7faf4401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7898e268980eafa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:57.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf3f7fe640 1 -- 172.21.15.112:0/4129398026 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf440ab650 con 0x7faf481520a0 2024-09-15T23:55:57.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf3f7fe640 1 -- 172.21.15.112:0/4129398026 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf440b0070 con 0x7faf481520a0 2024-09-15T23:55:57.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.802+0000 7faf3f7fe640 1 -- 172.21.15.112:0/4129398026 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf440aba10 con 0x7faf481520a0 2024-09-15T23:55:57.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 -- 172.21.15.112:0/4129398026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf481520a0 msgr2=0x7faf4806f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:57.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 --2- 172.21.15.112:0/4129398026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf481520a0 0x7faf4806f910 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faf44009870 tx=0x7faf4401c560 comp rx=0 tx=0).stop 2024-09-15T23:55:57.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 -- 172.21.15.112:0/4129398026 shutdown_connections 2024-09-15T23:55:57.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 --2- 172.21.15.112:0/4129398026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf4815f3a0 0x7faf480adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:57.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 --2- 172.21.15.112:0/4129398026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf481520a0 0x7faf4806f910 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:57.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 -- 172.21.15.112:0/4129398026 >> 172.21.15.112:0/4129398026 conn(0x7faf480b1f90 msgr2=0x7faf480b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:57.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 -- 172.21.15.112:0/4129398026 shutdown_connections 2024-09-15T23:55:57.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 -- 172.21.15.112:0/4129398026 wait complete. 2024-09-15T23:55:57.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 Processor -- start 2024-09-15T23:55:57.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 -- start start 2024-09-15T23:55:57.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf4806fe50 0x7faf48145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:57.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf481520a0 0x7faf48151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:57.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4815f3a0 0x7faf48151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:57.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faf48073d30 con 0x7faf4815f3a0 2024-09-15T23:55:57.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf48073a50 con 0x7faf4806fe50 2024-09-15T23:55:57.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faf48167f10 con 0x7faf481520a0 2024-09-15T23:55:57.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4d1f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4815f3a0 0x7faf48151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:57.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4d1f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4815f3a0 0x7faf48151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42998/0 (socket says 172.21.15.112:42998) 2024-09-15T23:55:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4d1f9640 1 -- 172.21.15.112:0/3999519980 learned_addr learned my addr 172.21.15.112:0/3999519980 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf3ffff640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf481520a0 0x7faf48151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4c9f8640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf4806fe50 0x7faf48145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4d1f9640 1 -- 172.21.15.112:0/3999519980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf481520a0 msgr2=0x7faf48151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4d1f9640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf481520a0 0x7faf48151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4d1f9640 1 -- 172.21.15.112:0/3999519980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf4806fe50 msgr2=0x7faf48145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4d1f9640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf4806fe50 0x7faf48145ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4d1f9640 1 -- 172.21.15.112:0/3999519980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf48146530 con 0x7faf4815f3a0 2024-09-15T23:55:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf3ffff640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf481520a0 0x7faf48151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4c9f8640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf4806fe50 0x7faf48145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:57.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4d1f9640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4815f3a0 0x7faf48151940 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7faf40007e70 tx=0x7faf4000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:57.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf3d7fa640 1 -- 172.21.15.112:0/3999519980 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf40014620 con 0x7faf4815f3a0 2024-09-15T23:55:57.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf3d7fa640 1 -- 172.21.15.112:0/3999519980 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf40019070 con 0x7faf4815f3a0 2024-09-15T23:55:57.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 -- 172.21.15.112:0/3999519980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf4815e2c0 con 0x7faf4815f3a0 2024-09-15T23:55:57.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf3d7fa640 1 -- 172.21.15.112:0/3999519980 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf40014a20 con 0x7faf4815f3a0 2024-09-15T23:55:57.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.806+0000 7faf4ec5c640 1 -- 172.21.15.112:0/3999519980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf480b0330 con 0x7faf4815f3a0 2024-09-15T23:55:57.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.810+0000 7faf4ec5c640 1 -- 172.21.15.112:0/3999519980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf4806e540 con 0x7faf4815f3a0 2024-09-15T23:55:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.810+0000 7faf3d7fa640 1 -- 172.21.15.112:0/3999519980 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf40014bc0 con 0x7faf4815f3a0 2024-09-15T23:55:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.810+0000 7faf3d7fa640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf340678c0 0x7faf34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.810+0000 7faf3d7fa640 1 -- 172.21.15.112:0/3999519980 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5749+0+0 (secure 0 0 0) 0x7faf40086680 con 0x7faf4815f3a0 2024-09-15T23:55:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.810+0000 7faf4c9f8640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf340678c0 0x7faf34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:57.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.810+0000 7faf4c9f8640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf340678c0 0x7faf34069d80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faf440af000 tx=0x7faf44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:57.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.814+0000 7faf3d7fa640 1 -- 172.21.15.112:0/3999519980 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faf40011260 con 0x7faf4815f3a0 2024-09-15T23:55:57.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:57.974+0000 7faf4ec5c640 1 -- 172.21.15.112:0/3999519980 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7faf48150300 con 0x7faf4815f3a0 2024-09-15T23:55:58.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.666+0000 7faf3d7fa640 1 -- 172.21.15.112:0/3999519980 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) ==== 169+0+0 (secure 0 0 0) 0x7faf400570f0 con 0x7faf4815f3a0 2024-09-15T23:55:58.668 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-15T23:55:58.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.670+0000 7faf4ec5c640 1 -- 172.21.15.112:0/3999519980 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf340678c0 msgr2=0x7faf34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:58.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.670+0000 7faf4ec5c640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf340678c0 0x7faf34069d80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faf440af000 tx=0x7faf44008040 comp rx=0 tx=0).stop 2024-09-15T23:55:58.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.670+0000 7faf4ec5c640 1 -- 172.21.15.112:0/3999519980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4815f3a0 msgr2=0x7faf48151940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:58.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.670+0000 7faf4ec5c640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4815f3a0 0x7faf48151940 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7faf40007e70 tx=0x7faf4000e4b0 comp rx=0 tx=0).stop 2024-09-15T23:55:58.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.670+0000 7faf4ec5c640 1 -- 172.21.15.112:0/3999519980 shutdown_connections 2024-09-15T23:55:58.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.670+0000 7faf4ec5c640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf340678c0 0x7faf34069d80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:58.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.670+0000 7faf4ec5c640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf4815f3a0 0x7faf48151940 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:58.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.670+0000 7faf4ec5c640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf481520a0 0x7faf48151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:58.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.670+0000 7faf4ec5c640 1 --2- 172.21.15.112:0/3999519980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf4806fe50 0x7faf48145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:58.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.670+0000 7faf4ec5c640 1 -- 172.21.15.112:0/3999519980 >> 172.21.15.112:0/3999519980 conn(0x7faf480b1f90 msgr2=0x7faf4815a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:58.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.670+0000 7faf4ec5c640 1 -- 172.21.15.112:0/3999519980 shutdown_connections 2024-09-15T23:55:58.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.670+0000 7faf4ec5c640 1 -- 172.21.15.112:0/3999519980 wait complete. 2024-09-15T23:55:58.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:55:58.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.826+0000 7f5e81894640 1 Processor -- start 2024-09-15T23:55:58.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.826+0000 7f5e81894640 1 -- start start 2024-09-15T23:55:58.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e81894640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5e7c15b170 0x7f5e7c09aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:58.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e81894640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5e7c0b0f00 0x7f5e7c15ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:58.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e81894640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e7c0ae8b0 con 0x7f5e7c0af950 2024-09-15T23:55:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e81894640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5e7c0aeb90 con 0x7f5e7c15b170 2024-09-15T23:55:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e81894640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f5e7c0aee70 con 0x7f5e7c0b0f00 2024-09-15T23:55:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e7affd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5e7c15b170 0x7f5e7c09aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e7a7fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5e7c0af950 0x7f5e7c0b07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58340/0 (socket says 172.21.15.112:58340) 2024-09-15T23:55:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e7a7fc640 1 -- 172.21.15.112:0/494303198 learned_addr learned my addr 172.21.15.112:0/494303198 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e7affd640 1 -- 172.21.15.112:0/494303198 >> v2:172.21.15.169:3300/0 conn(0x7f5e7c0b0f00 msgr2=0x7f5e7c15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e7affd640 1 --2- 172.21.15.112:0/494303198 >> v2:172.21.15.169:3300/0 conn(0x7f5e7c0b0f00 0x7f5e7c15ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e7affd640 1 -- 172.21.15.112:0/494303198 >> v1:172.21.15.112:6789/0 conn(0x7f5e7c0af950 legacy=0x7f5e7c0b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e7affd640 1 -- 172.21.15.112:0/494303198 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7c0af150 con 0x7f5e7c15b170 2024-09-15T23:55:58.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e79ffb640 1 -- 172.21.15.112:0/494303198 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2139877391 0 0) 0x7f5e7c0ae8b0 con 0x7f5e7c0af950 2024-09-15T23:55:58.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e7affd640 1 --2- 172.21.15.112:0/494303198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e7c15b170 0x7f5e7c09aa00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c072510 tx=0x7f5e6c01eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abac1be3b208378b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:58.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e79ffb640 1 -- 172.21.15.112:0/494303198 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0b4070 con 0x7f5e7c15b170 2024-09-15T23:55:58.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e79ffb640 1 -- 172.21.15.112:0/494303198 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e6c0a7b30 con 0x7f5e7c15b170 2024-09-15T23:55:58.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e79ffb640 1 -- 172.21.15.112:0/494303198 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0af440 con 0x7f5e7c15b170 2024-09-15T23:55:58.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e81894640 1 -- 172.21.15.112:0/494303198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e7c15b170 msgr2=0x7f5e7c09aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:58.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e81894640 1 --2- 172.21.15.112:0/494303198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e7c15b170 0x7f5e7c09aa00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c072510 tx=0x7f5e6c01eb50 comp rx=0 tx=0).stop 2024-09-15T23:55:58.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e81894640 1 -- 172.21.15.112:0/494303198 shutdown_connections 2024-09-15T23:55:58.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e81894640 1 --2- 172.21.15.112:0/494303198 >> v2:172.21.15.169:3300/0 conn(0x7f5e7c0b0f00 0x7f5e7c15ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:58.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e81894640 1 --2- 172.21.15.112:0/494303198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e7c15b170 0x7f5e7c09aa00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:58.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e81894640 1 -- 172.21.15.112:0/494303198 >> 172.21.15.112:0/494303198 conn(0x7f5e7c0b6800 msgr2=0x7f5e7c0b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:58.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e81894640 1 -- 172.21.15.112:0/494303198 shutdown_connections 2024-09-15T23:55:58.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.830+0000 7f5e81894640 1 -- 172.21.15.112:0/494303198 wait complete. 2024-09-15T23:55:58.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e81894640 1 Processor -- start 2024-09-15T23:55:58.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e81894640 1 -- start start 2024-09-15T23:55:58.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e81894640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e7c0af950 0x7f5e7c14df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:58.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e81894640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e7c0b0f00 0x7f5e7c159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:58.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e81894640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e7c15b170 0x7f5e7c0b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:58.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e81894640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c06c090 con 0x7f5e7c15b170 2024-09-15T23:55:58.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e81894640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c06bf10 con 0x7f5e7c0af950 2024-09-15T23:55:58.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e81894640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5e7c06c210 con 0x7f5e7c0b0f00 2024-09-15T23:55:58.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e7b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e7c15b170 0x7f5e7c0b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:58.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e7b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e7c15b170 0x7f5e7c0b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52174/0 (socket says 172.21.15.112:52174) 2024-09-15T23:55:58.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e7b7fe640 1 -- 172.21.15.112:0/781589807 learned_addr learned my addr 172.21.15.112:0/781589807 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:58.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e7affd640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e7c0af950 0x7f5e7c14df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:58.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e7a7fc640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e7c0b0f00 0x7f5e7c159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:58.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e7b7fe640 1 -- 172.21.15.112:0/781589807 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e7c0b0f00 msgr2=0x7f5e7c159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:58.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e7b7fe640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e7c0b0f00 0x7f5e7c159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:58.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e7b7fe640 1 -- 172.21.15.112:0/781589807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e7c0af950 msgr2=0x7f5e7c14df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:58.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e7b7fe640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e7c0af950 0x7f5e7c14df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:58.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e7b7fe640 1 -- 172.21.15.112:0/781589807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7c159cb0 con 0x7f5e7c15b170 2024-09-15T23:55:58.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e7a7fc640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e7c0b0f00 0x7f5e7c159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:58.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e7b7fe640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e7c15b170 0x7f5e7c0b4660 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400b970 tx=0x7f5e7400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:58.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e63fff640 1 -- 172.21.15.112:0/781589807 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74019070 con 0x7f5e7c15b170 2024-09-15T23:55:58.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e63fff640 1 -- 172.21.15.112:0/781589807 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e7400cb00 con 0x7f5e7c15b170 2024-09-15T23:55:58.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e81894640 1 -- 172.21.15.112:0/781589807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e7c15a1a0 con 0x7f5e7c15b170 2024-09-15T23:55:58.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e63fff640 1 -- 172.21.15.112:0/781589807 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74014440 con 0x7f5e7c15b170 2024-09-15T23:55:58.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e81894640 1 -- 172.21.15.112:0/781589807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e7c152c90 con 0x7f5e7c15b170 2024-09-15T23:55:58.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.834+0000 7f5e81894640 1 -- 172.21.15.112:0/781589807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e7c15ee20 con 0x7f5e7c15b170 2024-09-15T23:55:58.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.838+0000 7f5e63fff640 1 -- 172.21.15.112:0/781589807 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5e7401c070 con 0x7f5e7c15b170 2024-09-15T23:55:58.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.838+0000 7f5e63fff640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5e680678c0 0x7f5e68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:58.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.838+0000 7f5e63fff640 1 -- 172.21.15.112:0/781589807 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f5e74085770 con 0x7f5e7c15b170 2024-09-15T23:55:58.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.838+0000 7f5e7affd640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5e680678c0 0x7f5e68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:58.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.838+0000 7f5e7affd640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5e680678c0 0x7f5e68069d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0b1000 tx=0x7f5e6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:58.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.842+0000 7f5e63fff640 1 -- 172.21.15.112:0/781589807 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5e740564b0 con 0x7f5e7c15b170 2024-09-15T23:55:58.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.990+0000 7f5e81894640 1 -- 172.21.15.112:0/781589807 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f5e7c0d1ec0 con 0x7f5e7c15b170 2024-09-15T23:55:58.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.994+0000 7f5e63fff640 1 -- 172.21.15.112:0/781589807 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) ==== 104+0+0 (secure 0 0 0) 0x7f5e74055db0 con 0x7f5e7c15b170 2024-09-15T23:55:58.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.998+0000 7f5e81894640 1 -- 172.21.15.112:0/781589807 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5e680678c0 msgr2=0x7f5e68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:59.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.998+0000 7f5e81894640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5e680678c0 0x7f5e68069d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0b1000 tx=0x7f5e6c008040 comp rx=0 tx=0).stop 2024-09-15T23:55:59.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.998+0000 7f5e81894640 1 -- 172.21.15.112:0/781589807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e7c15b170 msgr2=0x7f5e7c0b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:59.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.998+0000 7f5e81894640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e7c15b170 0x7f5e7c0b4660 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400b970 tx=0x7f5e7400be30 comp rx=0 tx=0).stop 2024-09-15T23:55:59.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.998+0000 7f5e81894640 1 -- 172.21.15.112:0/781589807 shutdown_connections 2024-09-15T23:55:59.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.998+0000 7f5e81894640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5e680678c0 0x7f5e68069d80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.998+0000 7f5e81894640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e7c15b170 0x7f5e7c0b4660 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.998+0000 7f5e81894640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e7c0b0f00 0x7f5e7c159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.998+0000 7f5e81894640 1 --2- 172.21.15.112:0/781589807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e7c0af950 0x7f5e7c14df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.998+0000 7f5e81894640 1 -- 172.21.15.112:0/781589807 >> 172.21.15.112:0/781589807 conn(0x7f5e7c0b6800 msgr2=0x7f5e7c15d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:59.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.998+0000 7f5e81894640 1 -- 172.21.15.112:0/781589807 shutdown_connections 2024-09-15T23:55:59.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:58.998+0000 7f5e81894640 1 -- 172.21.15.112:0/781589807 wait complete. 2024-09-15T23:55:59.014 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_fragment_size_max 2024-09-15T23:55:59.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.134+0000 7fd4684a1640 1 Processor -- start 2024-09-15T23:55:59.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.134+0000 7fd4684a1640 1 -- start start 2024-09-15T23:55:59.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.134+0000 7fd4684a1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd46015c2a0 0x7fd4600aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:59.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.134+0000 7fd4684a1640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd4600af2a0 0x7fd46006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:59.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.134+0000 7fd4684a1640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4600b3290 con 0x7fd46015bec0 2024-09-15T23:55:59.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.134+0000 7fd4684a1640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd4600b3570 con 0x7fd4600af2a0 2024-09-15T23:55:59.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.134+0000 7fd4684a1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd4600b3850 con 0x7fd46015c2a0 2024-09-15T23:55:59.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd466a3e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd4600af2a0 0x7fd46006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:59.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd465a3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd46015c2a0 0x7fd4600aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:59.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd46623d640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fd46015bec0 0x7fd4600ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:35464/0 (socket says 172.21.15.112:35464) 2024-09-15T23:55:59.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd46623d640 1 -- 172.21.15.112:0/773343404 learned_addr learned my addr 172.21.15.112:0/773343404 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:59.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd466a3e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd4600af2a0 0x7fd46006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:39536/0 (socket says 172.21.15.112:39536) 2024-09-15T23:55:59.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd465a3c640 1 -- 172.21.15.112:0/773343404 >> v2:172.21.15.169:3300/0 conn(0x7fd4600af2a0 msgr2=0x7fd46006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:59.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd465a3c640 1 --2- 172.21.15.112:0/773343404 >> v2:172.21.15.169:3300/0 conn(0x7fd4600af2a0 0x7fd46006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd465a3c640 1 -- 172.21.15.112:0/773343404 >> v1:172.21.15.169:6789/0 conn(0x7fd46015bec0 legacy=0x7fd4600ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:59.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd465a3c640 1 -- 172.21.15.112:0/773343404 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4600b3b30 con 0x7fd46015c2a0 2024-09-15T23:55:59.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd465a3c640 1 --2- 172.21.15.112:0/773343404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd46015c2a0 0x7fd4600aed60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd4500097c0 tx=0x7fd45001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ab6128ce41fe0cf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:59.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd46523b640 1 -- 172.21.15.112:0/773343404 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4500a7070 con 0x7fd46015c2a0 2024-09-15T23:55:59.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd46523b640 1 -- 172.21.15.112:0/773343404 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4500b0070 con 0x7fd46015c2a0 2024-09-15T23:55:59.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd46523b640 1 -- 172.21.15.112:0/773343404 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4500ab890 con 0x7fd46015c2a0 2024-09-15T23:55:59.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd4684a1640 1 -- 172.21.15.112:0/773343404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd46015c2a0 msgr2=0x7fd4600aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:59.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd4684a1640 1 --2- 172.21.15.112:0/773343404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd46015c2a0 0x7fd4600aed60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd4500097c0 tx=0x7fd45001c470 comp rx=0 tx=0).stop 2024-09-15T23:55:59.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd4684a1640 1 -- 172.21.15.112:0/773343404 shutdown_connections 2024-09-15T23:55:59.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd4684a1640 1 --2- 172.21.15.112:0/773343404 >> v2:172.21.15.169:3300/0 conn(0x7fd4600af2a0 0x7fd46006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd4684a1640 1 --2- 172.21.15.112:0/773343404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd46015c2a0 0x7fd4600aed60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.138+0000 7fd4684a1640 1 -- 172.21.15.112:0/773343404 >> 172.21.15.112:0/773343404 conn(0x7fd4600b1f90 msgr2=0x7fd4600b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:59.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd4684a1640 1 -- 172.21.15.112:0/773343404 shutdown_connections 2024-09-15T23:55:59.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd4684a1640 1 -- 172.21.15.112:0/773343404 wait complete. 2024-09-15T23:55:59.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd4684a1640 1 Processor -- start 2024-09-15T23:55:59.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd4684a1640 1 -- start start 2024-09-15T23:55:59.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd4684a1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4600af2a0 0x7fd46009ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:59.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd4684a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd46015bec0 0x7fd4601568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:59.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd4684a1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd46015c2a0 0x7fd460156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:59.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd4684a1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd46006ed50 con 0x7fd46015bec0 2024-09-15T23:55:59.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd4684a1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd4600af6b0 con 0x7fd4600af2a0 2024-09-15T23:55:59.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd4684a1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd46006eed0 con 0x7fd46015c2a0 2024-09-15T23:55:59.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd465a3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd46015bec0 0x7fd4601568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:59.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd465a3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd46015bec0 0x7fd4601568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52188/0 (socket says 172.21.15.112:52188) 2024-09-15T23:55:59.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd465a3c640 1 -- 172.21.15.112:0/839173317 learned_addr learned my addr 172.21.15.112:0/839173317 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:59.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd46623d640 1 --2- 172.21.15.112:0/839173317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4600af2a0 0x7fd46009ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:59.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd466a3e640 1 --2- 172.21.15.112:0/839173317 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd46015c2a0 0x7fd460156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:59.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd465a3c640 1 -- 172.21.15.112:0/839173317 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd46015c2a0 msgr2=0x7fd460156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:59.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd465a3c640 1 --2- 172.21.15.112:0/839173317 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd46015c2a0 0x7fd460156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd465a3c640 1 -- 172.21.15.112:0/839173317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4600af2a0 msgr2=0x7fd46009ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:59.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd465a3c640 1 --2- 172.21.15.112:0/839173317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4600af2a0 0x7fd46009ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd465a3c640 1 -- 172.21.15.112:0/839173317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46009d740 con 0x7fd46015bec0 2024-09-15T23:55:59.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd465a3c640 1 --2- 172.21.15.112:0/839173317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd46015bec0 0x7fd4601568e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd4500ad040 tx=0x7fd45001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:59.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd456ffd640 1 -- 172.21.15.112:0/839173317 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450006e20 con 0x7fd46015bec0 2024-09-15T23:55:59.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd456ffd640 1 -- 172.21.15.112:0/839173317 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4500bf610 con 0x7fd46015bec0 2024-09-15T23:55:59.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd4684a1640 1 -- 172.21.15.112:0/839173317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd46009da20 con 0x7fd46015bec0 2024-09-15T23:55:59.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd456ffd640 1 -- 172.21.15.112:0/839173317 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4500bf9c0 con 0x7fd46015bec0 2024-09-15T23:55:59.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd4684a1640 1 -- 172.21.15.112:0/839173317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd46009dfe0 con 0x7fd46015bec0 2024-09-15T23:55:59.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.142+0000 7fd4684a1640 1 -- 172.21.15.112:0/839173317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd460068e50 con 0x7fd46015bec0 2024-09-15T23:55:59.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.146+0000 7fd456ffd640 1 -- 172.21.15.112:0/839173317 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd4500bd020 con 0x7fd46015bec0 2024-09-15T23:55:59.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.146+0000 7fd456ffd640 1 --2- 172.21.15.112:0/839173317 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd4440678c0 0x7fd444069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:59.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.146+0000 7fd456ffd640 1 -- 172.21.15.112:0/839173317 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7fd450120100 con 0x7fd46015bec0 2024-09-15T23:55:59.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.146+0000 7fd46623d640 1 --2- 172.21.15.112:0/839173317 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd4440678c0 0x7fd444069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:59.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.146+0000 7fd46623d640 1 --2- 172.21.15.112:0/839173317 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd4440678c0 0x7fd444069d80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd460156760 tx=0x7fd45c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:59.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.150+0000 7fd456ffd640 1 -- 172.21.15.112:0/839173317 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd450016090 con 0x7fd46015bec0 2024-09-15T23:55:59.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.314+0000 7fd4684a1640 1 -- 172.21.15.112:0/839173317 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_fragment_size_max"} v 0) -- 0x7fd46006f270 con 0x7fd46015bec0 2024-09-15T23:55:59.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.322+0000 7fd456ffd640 1 -- 172.21.15.112:0/839173317 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_fragment_size_max"}]=0 v15) ==== 108+0+0 (secure 0 0 0) 0x7fd4500f0db0 con 0x7fd46015bec0 2024-09-15T23:55:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.322+0000 7fd4684a1640 1 -- 172.21.15.112:0/839173317 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd4440678c0 msgr2=0x7fd444069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.322+0000 7fd4684a1640 1 --2- 172.21.15.112:0/839173317 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd4440678c0 0x7fd444069d80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd460156760 tx=0x7fd45c009040 comp rx=0 tx=0).stop 2024-09-15T23:55:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.322+0000 7fd4684a1640 1 -- 172.21.15.112:0/839173317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd46015bec0 msgr2=0x7fd4601568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.322+0000 7fd4684a1640 1 --2- 172.21.15.112:0/839173317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd46015bec0 0x7fd4601568e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd4500ad040 tx=0x7fd45001acb0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.322+0000 7fd4684a1640 1 -- 172.21.15.112:0/839173317 shutdown_connections 2024-09-15T23:55:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.322+0000 7fd4684a1640 1 --2- 172.21.15.112:0/839173317 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd4440678c0 0x7fd444069d80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.322+0000 7fd4684a1640 1 --2- 172.21.15.112:0/839173317 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd46015c2a0 0x7fd460156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.322+0000 7fd4684a1640 1 --2- 172.21.15.112:0/839173317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd46015bec0 0x7fd4601568e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.322+0000 7fd4684a1640 1 --2- 172.21.15.112:0/839173317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4600af2a0 0x7fd46009ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.322+0000 7fd4684a1640 1 -- 172.21.15.112:0/839173317 >> 172.21.15.112:0/839173317 conn(0x7fd4600b1f90 msgr2=0x7fd4600b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:59.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.322+0000 7fd4684a1640 1 -- 172.21.15.112:0/839173317 shutdown_connections 2024-09-15T23:55:59.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.322+0000 7fd4684a1640 1 -- 172.21.15.112:0/839173317 wait complete. 2024-09-15T23:55:59.342 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit' 2024-09-15T23:55:59.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdffcf7640 1 Processor -- start 2024-09-15T23:55:59.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdffcf7640 1 -- start start 2024-09-15T23:55:59.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdffcf7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf815f3a0 0x7efdf8165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:59.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdffcf7640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf80aede0 con 0x7efdf8070020 2024-09-15T23:55:59.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdffcf7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf815fa10 con 0x7efdf81520a0 2024-09-15T23:55:59.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdffcf7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efdf8152480 con 0x7efdf815f3a0 2024-09-15T23:55:59.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfd292640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efdf8070020 0x7efdf815ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58348/0 (socket says 172.21.15.112:58348) 2024-09-15T23:55:59.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfd292640 1 -- 172.21.15.112:0/374458188 learned_addr learned my addr 172.21.15.112:0/374458188 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:55:59.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfe294640 1 --2- 172.21.15.112:0/374458188 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf815f3a0 0x7efdf8165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:59.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 -- 172.21.15.112:0/374458188 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 77549618 0 0) 0x7efdf80aede0 con 0x7efdf8070020 2024-09-15T23:55:59.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 -- 172.21.15.112:0/374458188 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efde4003530 con 0x7efdf8070020 2024-09-15T23:55:59.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 -- 172.21.15.112:0/374458188 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3707824556 0 0) 0x7efde4003530 con 0x7efdf8070020 2024-09-15T23:55:59.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 -- 172.21.15.112:0/374458188 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf815f3a0 msgr2=0x7efdf8165f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:59.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 --2- 172.21.15.112:0/374458188 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf815f3a0 0x7efdf8165f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 -- 172.21.15.112:0/374458188 >> v1:172.21.15.169:6789/0 conn(0x7efdf81520a0 legacy=0x7efdf806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:59.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 -- 172.21.15.112:0/374458188 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf8074250 con 0x7efdf8070020 2024-09-15T23:55:59.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 -- 172.21.15.112:0/374458188 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7efdf4001680 con 0x7efdf8070020 2024-09-15T23:55:59.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 -- 172.21.15.112:0/374458188 >> v1:172.21.15.112:6789/0 conn(0x7efdf8070020 legacy=0x7efdf815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:59.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 --2- 172.21.15.112:0/374458188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde40039f0 0x7efde4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:59.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 --2- 172.21.15.112:0/374458188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efde4004810 0x7efde4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:59.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 --2- 172.21.15.112:0/374458188 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf815f3a0 0x7efde40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:59.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 -- 172.21.15.112:0/374458188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efde400ba80 con 0x7efde40039f0 2024-09-15T23:55:59.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 -- 172.21.15.112:0/374458188 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efde400bc30 con 0x7efde4004810 2024-09-15T23:55:59.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfca91640 1 -- 172.21.15.112:0/374458188 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efde400be30 con 0x7efdf815f3a0 2024-09-15T23:55:59.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfda93640 1 --2- 172.21.15.112:0/374458188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde40039f0 0x7efde4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:59.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfd292640 1 --2- 172.21.15.112:0/374458188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efde4004810 0x7efde4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:59.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfe294640 1 --2- 172.21.15.112:0/374458188 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf815f3a0 0x7efde40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:59.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfda93640 1 -- 172.21.15.112:0/374458188 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf815f3a0 msgr2=0x7efde40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:59.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfda93640 1 --2- 172.21.15.112:0/374458188 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf815f3a0 0x7efde40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfda93640 1 -- 172.21.15.112:0/374458188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efde4004810 msgr2=0x7efde4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:59.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfda93640 1 --2- 172.21.15.112:0/374458188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efde4004810 0x7efde4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.458+0000 7efdfda93640 1 -- 172.21.15.112:0/374458188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde4003530 con 0x7efde40039f0 2024-09-15T23:55:59.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdfda93640 1 --2- 172.21.15.112:0/374458188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde40039f0 0x7efde4003e10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efdec001750 tx=0x7efdec01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7b5aa89b0d7131 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:59.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdfca91640 1 -- 172.21.15.112:0/374458188 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec0013a0 con 0x7efde40039f0 2024-09-15T23:55:59.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdfca91640 1 -- 172.21.15.112:0/374458188 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdec0052f0 con 0x7efde40039f0 2024-09-15T23:55:59.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdfca91640 1 -- 172.21.15.112:0/374458188 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec003840 con 0x7efde40039f0 2024-09-15T23:55:59.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdffcf7640 1 -- 172.21.15.112:0/374458188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde40039f0 msgr2=0x7efde4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:59.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdffcf7640 1 --2- 172.21.15.112:0/374458188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde40039f0 0x7efde4003e10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efdec001750 tx=0x7efdec01c3c0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdfe294640 1 -- 172.21.15.112:0/374458188 reap_dead start 2024-09-15T23:55:59.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdffcf7640 1 -- 172.21.15.112:0/374458188 shutdown_connections 2024-09-15T23:55:59.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdffcf7640 1 -- 172.21.15.112:0/374458188 >> 172.21.15.112:0/374458188 conn(0x7efdf80b1f90 msgr2=0x7efdf80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:59.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdffcf7640 1 -- 172.21.15.112:0/374458188 shutdown_connections 2024-09-15T23:55:59.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdffcf7640 1 -- 172.21.15.112:0/374458188 wait complete. 2024-09-15T23:55:59.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdffcf7640 1 Processor -- start 2024-09-15T23:55:59.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdffcf7640 1 -- start start 2024-09-15T23:55:59.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdffcf7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde40039f0 0x7efdf8152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:59.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdffcf7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdf814c880 0x7efdf8154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:59.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdffcf7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf815dc10 0x7efdf815e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:59.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdffcf7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efdf806f010 con 0x7efde40039f0 2024-09-15T23:55:59.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdffcf7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efdf8073d30 con 0x7efdf814c880 2024-09-15T23:55:59.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdffcf7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efdf806f190 con 0x7efdf815dc10 2024-09-15T23:55:59.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdfda93640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde40039f0 0x7efdf8152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:59.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdfda93640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde40039f0 0x7efdf8152e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52204/0 (socket says 172.21.15.112:52204) 2024-09-15T23:55:59.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdfda93640 1 -- 172.21.15.112:0/281861287 learned_addr learned my addr 172.21.15.112:0/281861287 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:55:59.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdfd292640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdf814c880 0x7efdf8154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:59.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdfe294640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf815dc10 0x7efdf815e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:59.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdfda93640 1 -- 172.21.15.112:0/281861287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf815dc10 msgr2=0x7efdf815e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:59.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdfda93640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf815dc10 0x7efdf815e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdfda93640 1 -- 172.21.15.112:0/281861287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdf814c880 msgr2=0x7efdf8154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:59.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.462+0000 7efdfda93640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdf814c880 0x7efdf8154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:59.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.466+0000 7efdfda93640 1 -- 172.21.15.112:0/281861287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf8068e50 con 0x7efde40039f0 2024-09-15T23:55:59.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.466+0000 7efdfe294640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf815dc10 0x7efdf815e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:55:59.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.466+0000 7efdfda93640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde40039f0 0x7efdf8152e90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efdec005040 tx=0x7efde4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:59.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.466+0000 7efdea7fc640 1 -- 172.21.15.112:0/281861287 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec007a40 con 0x7efde40039f0 2024-09-15T23:55:59.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.466+0000 7efdea7fc640 1 -- 172.21.15.112:0/281861287 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdec0bb070 con 0x7efde40039f0 2024-09-15T23:55:59.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.466+0000 7efdffcf7640 1 -- 172.21.15.112:0/281861287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf8153470 con 0x7efde40039f0 2024-09-15T23:55:59.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.466+0000 7efdea7fc640 1 -- 172.21.15.112:0/281861287 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec000ee0 con 0x7efde40039f0 2024-09-15T23:55:59.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.466+0000 7efdffcf7640 1 -- 172.21.15.112:0/281861287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf814faa0 con 0x7efde40039f0 2024-09-15T23:55:59.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.466+0000 7efdffcf7640 1 -- 172.21.15.112:0/281861287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf806f590 con 0x7efde40039f0 2024-09-15T23:55:59.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.466+0000 7efdea7fc640 1 -- 172.21.15.112:0/281861287 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efdec0b4040 con 0x7efde40039f0 2024-09-15T23:55:59.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.466+0000 7efdea7fc640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efddc067a60 0x7efddc069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:59.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.466+0000 7efdea7fc640 1 -- 172.21.15.112:0/281861287 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7efdec11f950 con 0x7efde40039f0 2024-09-15T23:55:59.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.466+0000 7efdfd292640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efddc067a60 0x7efddc069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:59.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.466+0000 7efdfd292640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efddc067a60 0x7efddc069f20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efdf4001ec0 tx=0x7efdf4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:59.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.470+0000 7efdea7fc640 1 -- 172.21.15.112:0/281861287 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efdec0160d0 con 0x7efde40039f0 2024-09-15T23:55:59.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:55:59.694+0000 7efdffcf7640 1 -- 172.21.15.112:0/281861287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]} v 0) -- 0x7efdf806e540 con 0x7efde40039f0 2024-09-15T23:56:00.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.670+0000 7efdea7fc640 1 -- 172.21.15.112:0/281861287 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit"]}]=0 v130) ==== 133+0+0 (secure 0 0 0) 0x7efdec0f0600 con 0x7efde40039f0 2024-09-15T23:56:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.674+0000 7efdffcf7640 1 -- 172.21.15.112:0/281861287 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efddc067a60 msgr2=0x7efddc069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.674+0000 7efdffcf7640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efddc067a60 0x7efddc069f20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efdf4001ec0 tx=0x7efdf4009040 comp rx=0 tx=0).stop 2024-09-15T23:56:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.674+0000 7efdffcf7640 1 -- 172.21.15.112:0/281861287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde40039f0 msgr2=0x7efdf8152e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.674+0000 7efdffcf7640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde40039f0 0x7efdf8152e90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efdec005040 tx=0x7efde4005840 comp rx=0 tx=0).stop 2024-09-15T23:56:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.674+0000 7efdffcf7640 1 -- 172.21.15.112:0/281861287 shutdown_connections 2024-09-15T23:56:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.674+0000 7efdffcf7640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efddc067a60 0x7efddc069f20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.674+0000 7efdffcf7640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efdf815dc10 0x7efdf815e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.674+0000 7efdffcf7640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdf814c880 0x7efdf8154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.674+0000 7efdffcf7640 1 --2- 172.21.15.112:0/281861287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efde40039f0 0x7efdf8152e90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.674+0000 7efdffcf7640 1 -- 172.21.15.112:0/281861287 >> 172.21.15.112:0/281861287 conn(0x7efdf80b1f90 msgr2=0x7efdf8151900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.674+0000 7efdffcf7640 1 -- 172.21.15.112:0/281861287 shutdown_connections 2024-09-15T23:56:00.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.674+0000 7efdffcf7640 1 -- 172.21.15.112:0/281861287 wait complete. 2024-09-15T23:56:00.694 INFO:tasks.cephfs_test_runner:That the directory fragment size cannot exceed mds_bal_fragment_size_max (using a limit of 50 in all configurations). ... ok 2024-09-15T23:56:00.695 INFO:tasks.cephfs_test_runner:Starting test: test_dirfrag_limit_fragmented (tasks.cephfs.test_strays.TestStrays) That fragmentation (forced) will allow more entries to be created. 2024-09-15T23:56:00.695 INFO:tasks.cephfs_test_runner:test_dirfrag_limit_fragmented (tasks.cephfs.test_strays.TestStrays) 2024-09-15T23:56:00.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:00.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.814+0000 7fd9d7c44640 1 Processor -- start 2024-09-15T23:56:00.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.814+0000 7fd9d7c44640 1 -- start start 2024-09-15T23:56:00.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d7c44640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd9d0161a60 0x7fd9d00d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:00.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d7c44640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd9d00cf620 0x7fd9d006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:00.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d7c44640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9d00d32b0 con 0x7fd9d00d2e90 2024-09-15T23:56:00.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d7c44640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd9d00d0300 con 0x7fd9d0161a60 2024-09-15T23:56:00.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d7c44640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd9d00cfa90 con 0x7fd9d00cf620 2024-09-15T23:56:00.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d59e0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd9d0161a60 0x7fd9d00d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:00.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d59e0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd9d0161a60 0x7fd9d00d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52214/0 (socket says 172.21.15.112:52214) 2024-09-15T23:56:00.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d59e0640 1 -- 172.21.15.112:0/1281671443 learned_addr learned my addr 172.21.15.112:0/1281671443 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:00.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d51df640 1 --1- 172.21.15.112:0/1281671443 >> v1:172.21.15.112:6789/0 conn(0x7fd9d00d2e90 0x7fd9d00cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58352/0 (socket says 172.21.15.112:58352) 2024-09-15T23:56:00.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d61e1640 1 --2- 172.21.15.112:0/1281671443 >> v2:172.21.15.169:3300/0 conn(0x7fd9d00cf620 0x7fd9d006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:00.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d59e0640 1 -- 172.21.15.112:0/1281671443 >> v2:172.21.15.169:3300/0 conn(0x7fd9d00cf620 msgr2=0x7fd9d006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:00.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d59e0640 1 --2- 172.21.15.112:0/1281671443 >> v2:172.21.15.169:3300/0 conn(0x7fd9d00cf620 0x7fd9d006d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:00.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d59e0640 1 -- 172.21.15.112:0/1281671443 >> v1:172.21.15.112:6789/0 conn(0x7fd9d00d2e90 legacy=0x7fd9d00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:00.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d59e0640 1 -- 172.21.15.112:0/1281671443 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d00b0f60 con 0x7fd9d0161a60 2024-09-15T23:56:00.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d49de640 1 -- 172.21.15.112:0/1281671443 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188595542 0 0) 0x7fd9d00d32b0 con 0x7fd9d00d2e90 2024-09-15T23:56:00.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d59e0640 1 --2- 172.21.15.112:0/1281671443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d0161a60 0x7fd9d00d2950 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00ce950 tx=0x7fd9c001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3ae207d4b34433 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:00.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d49de640 1 -- 172.21.15.112:0/1281671443 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c00ab660 con 0x7fd9d0161a60 2024-09-15T23:56:00.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d49de640 1 -- 172.21.15.112:0/1281671443 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c00b0070 con 0x7fd9d0161a60 2024-09-15T23:56:00.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.818+0000 7fd9d49de640 1 -- 172.21.15.112:0/1281671443 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c00aba20 con 0x7fd9d0161a60 2024-09-15T23:56:00.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 -- 172.21.15.112:0/1281671443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d0161a60 msgr2=0x7fd9d00d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:00.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 --2- 172.21.15.112:0/1281671443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d0161a60 0x7fd9d00d2950 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00ce950 tx=0x7fd9c001c460 comp rx=0 tx=0).stop 2024-09-15T23:56:00.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 -- 172.21.15.112:0/1281671443 shutdown_connections 2024-09-15T23:56:00.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 --2- 172.21.15.112:0/1281671443 >> v2:172.21.15.169:3300/0 conn(0x7fd9d00cf620 0x7fd9d006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:00.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 --2- 172.21.15.112:0/1281671443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d0161a60 0x7fd9d00d2950 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:00.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 -- 172.21.15.112:0/1281671443 >> 172.21.15.112:0/1281671443 conn(0x7fd9d008bf90 msgr2=0x7fd9d009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:00.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 -- 172.21.15.112:0/1281671443 shutdown_connections 2024-09-15T23:56:00.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 -- 172.21.15.112:0/1281671443 wait complete. 2024-09-15T23:56:00.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 Processor -- start 2024-09-15T23:56:00.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 -- start start 2024-09-15T23:56:00.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9d00cf620 0x7fd9d0150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:00.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9d00d2e90 0x7fd9d00ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:00.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d0161a60 0x7fd9d0160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:00.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d006e400 con 0x7fd9d0161a60 2024-09-15T23:56:00.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d006d190 con 0x7fd9d00cf620 2024-09-15T23:56:00.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d006e580 con 0x7fd9d00d2e90 2024-09-15T23:56:00.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d61e1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d0161a60 0x7fd9d0160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:00.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d61e1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d0161a60 0x7fd9d0160370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52222/0 (socket says 172.21.15.112:52222) 2024-09-15T23:56:00.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d61e1640 1 -- 172.21.15.112:0/3499337793 learned_addr learned my addr 172.21.15.112:0/3499337793 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:00.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d59e0640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9d00cf620 0x7fd9d0150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:00.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d51df640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9d00d2e90 0x7fd9d00ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:00.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d61e1640 1 -- 172.21.15.112:0/3499337793 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9d00d2e90 msgr2=0x7fd9d00ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:00.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d61e1640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9d00d2e90 0x7fd9d00ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:00.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d61e1640 1 -- 172.21.15.112:0/3499337793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9d00cf620 msgr2=0x7fd9d0150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:00.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d61e1640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9d00cf620 0x7fd9d0150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:00.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d61e1640 1 -- 172.21.15.112:0/3499337793 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d0151120 con 0x7fd9d0161a60 2024-09-15T23:56:00.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d51df640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9d00d2e90 0x7fd9d00ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:00.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d59e0640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9d00cf620 0x7fd9d0150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:56:00.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d61e1640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d0161a60 0x7fd9d0160370 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800cc60 tx=0x7fd9c800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:00.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9c67fc640 1 -- 172.21.15.112:0/3499337793 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c80039a0 con 0x7fd9d0161a60 2024-09-15T23:56:00.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9c67fc640 1 -- 172.21.15.112:0/3499337793 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c8003b40 con 0x7fd9d0161a60 2024-09-15T23:56:00.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 -- 172.21.15.112:0/3499337793 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d00b9350 con 0x7fd9d0161a60 2024-09-15T23:56:00.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9c67fc640 1 -- 172.21.15.112:0/3499337793 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8004020 con 0x7fd9d0161a60 2024-09-15T23:56:00.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 -- 172.21.15.112:0/3499337793 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d00b9910 con 0x7fd9d0161a60 2024-09-15T23:56:00.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.822+0000 7fd9d7c44640 1 -- 172.21.15.112:0/3499337793 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d006d6b0 con 0x7fd9d0161a60 2024-09-15T23:56:00.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.826+0000 7fd9c67fc640 1 -- 172.21.15.112:0/3499337793 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd9c80041c0 con 0x7fd9d0161a60 2024-09-15T23:56:00.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.826+0000 7fd9c67fc640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd9b40678f0 0x7fd9b4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:00.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.826+0000 7fd9c67fc640 1 -- 172.21.15.112:0/3499337793 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7fd9c8085f20 con 0x7fd9d0161a60 2024-09-15T23:56:00.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.826+0000 7fd9d59e0640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd9b40678f0 0x7fd9b4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:00.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.826+0000 7fd9d59e0640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd9b40678f0 0x7fd9b4069db0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00af000 tx=0x7fd9c00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:00.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.830+0000 7fd9c67fc640 1 -- 172.21.15.112:0/3499337793 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd9c8014030 con 0x7fd9d0161a60 2024-09-15T23:56:00.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.994+0000 7fd9d7c44640 1 -- 172.21.15.112:0/3499337793 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9d00cb150 con 0x7fd9d0161a60 2024-09-15T23:56:00.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.994+0000 7fd9c67fc640 1 -- 172.21.15.112:0/3499337793 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+13319 (secure 0 0 0) 0x7fd9c8056bd0 con 0x7fd9d0161a60 2024-09-15T23:56:00.995 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:00.995 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":54,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:55:58.665409+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/1037773891":"2024-09-16T23:55:55.644430+0000","172.21.15.112:6836/1037773891":"2024-09-16T23:55:55.644430+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:00.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.994+0000 7fd9d7c44640 1 -- 172.21.15.112:0/3499337793 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd9b40678f0 msgr2=0x7fd9b4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:00.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.994+0000 7fd9d7c44640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd9b40678f0 0x7fd9b4069db0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00af000 tx=0x7fd9c00a7000 comp rx=0 tx=0).stop 2024-09-15T23:56:00.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.994+0000 7fd9d7c44640 1 -- 172.21.15.112:0/3499337793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d0161a60 msgr2=0x7fd9d0160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:00.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.994+0000 7fd9d7c44640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d0161a60 0x7fd9d0160370 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800cc60 tx=0x7fd9c800a5c0 comp rx=0 tx=0).stop 2024-09-15T23:56:00.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.994+0000 7fd9d7c44640 1 -- 172.21.15.112:0/3499337793 shutdown_connections 2024-09-15T23:56:00.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.994+0000 7fd9d7c44640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd9b40678f0 0x7fd9b4069db0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:00.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.994+0000 7fd9d7c44640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9d0161a60 0x7fd9d0160370 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:00.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.994+0000 7fd9d7c44640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9d00d2e90 0x7fd9d00ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:00.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.994+0000 7fd9d7c44640 1 --2- 172.21.15.112:0/3499337793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9d00cf620 0x7fd9d0150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:00.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.994+0000 7fd9d7c44640 1 -- 172.21.15.112:0/3499337793 >> 172.21.15.112:0/3499337793 conn(0x7fd9d008bf90 msgr2=0x7fd9d00d0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:00.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.994+0000 7fd9d7c44640 1 -- 172.21.15.112:0/3499337793 shutdown_connections 2024-09-15T23:56:00.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:00.994+0000 7fd9d7c44640 1 -- 172.21.15.112:0/3499337793 wait complete. 2024-09-15T23:56:01.015 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:53:39.301069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:56:01.015 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:56:01.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.130+0000 7f4c7bae7640 1 Processor -- start 2024-09-15T23:56:01.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.130+0000 7f4c7bae7640 1 -- start start 2024-09-15T23:56:01.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c7bae7640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c7415bec0 0x7f4c740ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c7bae7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4c7415c2a0 0x7f4c740aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c7bae7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c740af2a0 0x7f4c7415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c7bae7640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4c740b3290 con 0x7f4c7415bec0 2024-09-15T23:56:01.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c7bae7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f4c740b3570 con 0x7f4c7415c2a0 2024-09-15T23:56:01.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c7bae7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4c740b3850 con 0x7f4c740af2a0 2024-09-15T23:56:01.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c79883640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c7415bec0 0x7f4c740ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c79883640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4c7415bec0 0x7f4c740ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52228/0 (socket says 172.21.15.112:52228) 2024-09-15T23:56:01.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c79883640 1 -- 172.21.15.112:0/4270300722 learned_addr learned my addr 172.21.15.112:0/4270300722 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:01.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c79082640 1 --2- 172.21.15.112:0/4270300722 >> v2:172.21.15.169:3300/0 conn(0x7f4c7415c2a0 0x7f4c740aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c7a084640 1 --2- 172.21.15.112:0/4270300722 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c740af2a0 0x7f4c7415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c79883640 1 -- 172.21.15.112:0/4270300722 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c740af2a0 msgr2=0x7f4c7415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:01.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c79883640 1 --2- 172.21.15.112:0/4270300722 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c740af2a0 0x7f4c7415fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c79883640 1 -- 172.21.15.112:0/4270300722 >> v2:172.21.15.169:3300/0 conn(0x7f4c7415c2a0 msgr2=0x7f4c740aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:01.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c79883640 1 --2- 172.21.15.112:0/4270300722 >> v2:172.21.15.169:3300/0 conn(0x7f4c7415c2a0 0x7f4c740aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c79883640 1 -- 172.21.15.112:0/4270300722 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c740b3b30 con 0x7f4c7415bec0 2024-09-15T23:56:01.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.134+0000 7f4c79883640 1 --2- 172.21.15.112:0/4270300722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7415bec0 0x7f4c740ad200 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4c740ae510 tx=0x7f4c7001c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee698fb16f0f247f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c78881640 1 -- 172.21.15.112:0/4270300722 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c700b0070 con 0x7f4c7415bec0 2024-09-15T23:56:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c78881640 1 -- 172.21.15.112:0/4270300722 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c700ab600 con 0x7f4c7415bec0 2024-09-15T23:56:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c78881640 1 -- 172.21.15.112:0/4270300722 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c700ab9d0 con 0x7f4c7415bec0 2024-09-15T23:56:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 -- 172.21.15.112:0/4270300722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7415bec0 msgr2=0x7f4c740ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 --2- 172.21.15.112:0/4270300722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7415bec0 0x7f4c740ad200 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4c740ae510 tx=0x7f4c7001c230 comp rx=0 tx=0).stop 2024-09-15T23:56:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 -- 172.21.15.112:0/4270300722 shutdown_connections 2024-09-15T23:56:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 --2- 172.21.15.112:0/4270300722 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c740af2a0 0x7f4c7415fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 --2- 172.21.15.112:0/4270300722 >> v2:172.21.15.169:3300/0 conn(0x7f4c7415c2a0 0x7f4c740aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 --2- 172.21.15.112:0/4270300722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7415bec0 0x7f4c740ad200 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 -- 172.21.15.112:0/4270300722 >> 172.21.15.112:0/4270300722 conn(0x7f4c740b1f90 msgr2=0x7f4c740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 -- 172.21.15.112:0/4270300722 shutdown_connections 2024-09-15T23:56:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 -- 172.21.15.112:0/4270300722 wait complete. 2024-09-15T23:56:01.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 Processor -- start 2024-09-15T23:56:01.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 -- start start 2024-09-15T23:56:01.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c740af2a0 0x7f4c74151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c7415bec0 0x7f4c7415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7415c2a0 0x7f4c74153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4c740af6b0 con 0x7f4c7415c2a0 2024-09-15T23:56:01.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4c740ad740 con 0x7f4c7415bec0 2024-09-15T23:56:01.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7406e000 con 0x7f4c740af2a0 2024-09-15T23:56:01.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7a084640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7415c2a0 0x7f4c74153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7a084640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7415c2a0 0x7f4c74153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52244/0 (socket says 172.21.15.112:52244) 2024-09-15T23:56:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7a084640 1 -- 172.21.15.112:0/1871855071 learned_addr learned my addr 172.21.15.112:0/1871855071 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c79883640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c740af2a0 0x7f4c74151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c79082640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c7415bec0 0x7f4c7415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7a084640 1 -- 172.21.15.112:0/1871855071 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c740af2a0 msgr2=0x7f4c74151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7a084640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c740af2a0 0x7f4c74151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7a084640 1 -- 172.21.15.112:0/1871855071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c7415bec0 msgr2=0x7f4c7415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7a084640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c7415bec0 0x7f4c7415eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7a084640 1 -- 172.21.15.112:0/1871855071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7415f0d0 con 0x7f4c7415c2a0 2024-09-15T23:56:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c79082640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c7415bec0 0x7f4c7415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7a084640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7415c2a0 0x7f4c74153b50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c007e70 tx=0x7f4c6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c6a7fc640 1 -- 172.21.15.112:0/1871855071 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c014620 con 0x7f4c7415c2a0 2024-09-15T23:56:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c6a7fc640 1 -- 172.21.15.112:0/1871855071 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6c019070 con 0x7f4c7415c2a0 2024-09-15T23:56:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c6a7fc640 1 -- 172.21.15.112:0/1871855071 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c014a20 con 0x7f4c7415c2a0 2024-09-15T23:56:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 -- 172.21.15.112:0/1871855071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c741662a0 con 0x7f4c7415c2a0 2024-09-15T23:56:01.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.138+0000 7f4c7bae7640 1 -- 172.21.15.112:0/1871855071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c74071f10 con 0x7f4c7415c2a0 2024-09-15T23:56:01.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.142+0000 7f4c7bae7640 1 -- 172.21.15.112:0/1871855071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c740ad200 con 0x7f4c7415c2a0 2024-09-15T23:56:01.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.142+0000 7f4c6a7fc640 1 -- 172.21.15.112:0/1871855071 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4c6c014bc0 con 0x7f4c7415c2a0 2024-09-15T23:56:01.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.142+0000 7f4c6a7fc640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4c580678c0 0x7f4c58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.142+0000 7f4c6a7fc640 1 -- 172.21.15.112:0/1871855071 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f4c6c0863a0 con 0x7f4c7415c2a0 2024-09-15T23:56:01.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.142+0000 7f4c79883640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4c580678c0 0x7f4c58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.142+0000 7f4c79883640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4c580678c0 0x7f4c58069d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4c700ad000 tx=0x7f4c700a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:01.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.146+0000 7f4c6a7fc640 1 -- 172.21.15.112:0/1871855071 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4c6c057050 con 0x7f4c7415c2a0 2024-09-15T23:56:01.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.298+0000 7f4c7bae7640 1 -- 172.21.15.112:0/1871855071 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4c7409e330 con 0x7f4c7415c2a0 2024-09-15T23:56:01.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.298+0000 7f4c6a7fc640 1 -- 172.21.15.112:0/1871855071 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) ==== 93+0+10 (secure 0 0 0) 0x7f4c6c056950 con 0x7f4c7415c2a0 2024-09-15T23:56:01.300 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-15T23:56:01.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.302+0000 7f4c7bae7640 1 -- 172.21.15.112:0/1871855071 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4c580678c0 msgr2=0x7f4c58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.302+0000 7f4c7bae7640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4c580678c0 0x7f4c58069d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4c700ad000 tx=0x7f4c700a6000 comp rx=0 tx=0).stop 2024-09-15T23:56:01.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.302+0000 7f4c7bae7640 1 -- 172.21.15.112:0/1871855071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7415c2a0 msgr2=0x7f4c74153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.302+0000 7f4c7bae7640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7415c2a0 0x7f4c74153b50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c007e70 tx=0x7f4c6c00e4b0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.302+0000 7f4c7bae7640 1 -- 172.21.15.112:0/1871855071 shutdown_connections 2024-09-15T23:56:01.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.302+0000 7f4c7bae7640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4c580678c0 0x7f4c58069d80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.302+0000 7f4c7bae7640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c7415c2a0 0x7f4c74153b50 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.302+0000 7f4c7bae7640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c7415bec0 0x7f4c7415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.302+0000 7f4c7bae7640 1 --2- 172.21.15.112:0/1871855071 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4c740af2a0 0x7f4c74151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.302+0000 7f4c7bae7640 1 -- 172.21.15.112:0/1871855071 >> 172.21.15.112:0/1871855071 conn(0x7f4c740b1f90 msgr2=0x7f4c740aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:01.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.302+0000 7f4c7bae7640 1 -- 172.21.15.112:0/1871855071 shutdown_connections 2024-09-15T23:56:01.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.302+0000 7f4c7bae7640 1 -- 172.21.15.112:0/1871855071 wait complete. 2024-09-15T23:56:01.318 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_fragmented' 2024-09-15T23:56:01.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2bd7e2640 1 Processor -- start 2024-09-15T23:56:01.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2bd7e2640 1 -- start start 2024-09-15T23:56:01.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2bd7e2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b8153010 0x7fb2b815d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2bd7e2640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b81533f0 con 0x7fb2b8072dd0 2024-09-15T23:56:01.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2bd7e2640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b8073850 con 0x7fb2b80b3990 2024-09-15T23:56:01.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2bd7e2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b8073b30 con 0x7fb2b8153010 2024-09-15T23:56:01.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b67fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb2b8072dd0 0x7fb2b80b3280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58358/0 (socket says 172.21.15.112:58358) 2024-09-15T23:56:01.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b67fc640 1 -- 172.21.15.112:0/259703856 learned_addr learned my addr 172.21.15.112:0/259703856 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:01.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b6ffd640 1 --2- 172.21.15.112:0/259703856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b8153010 0x7fb2b815d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 -- 172.21.15.112:0/259703856 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4074285911 0 0) 0x7fb2a0001120 con 0x7fb2b8072dd0 2024-09-15T23:56:01.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 -- 172.21.15.112:0/259703856 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a4003530 con 0x7fb2b8072dd0 2024-09-15T23:56:01.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 -- 172.21.15.112:0/259703856 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2915292506 0 0) 0x7fb2a4003530 con 0x7fb2b8072dd0 2024-09-15T23:56:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 -- 172.21.15.112:0/259703856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b8153010 msgr2=0x7fb2b815d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 --2- 172.21.15.112:0/259703856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b8153010 0x7fb2b815d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 -- 172.21.15.112:0/259703856 >> v1:172.21.15.169:6789/0 conn(0x7fb2b80b3990 legacy=0x7fb2b815fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 -- 172.21.15.112:0/259703856 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b815c890 con 0x7fb2b8072dd0 2024-09-15T23:56:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 -- 172.21.15.112:0/259703856 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fb2a0001850 con 0x7fb2b8072dd0 2024-09-15T23:56:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 -- 172.21.15.112:0/259703856 >> v1:172.21.15.112:6789/0 conn(0x7fb2b8072dd0 legacy=0x7fb2b80b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 --2- 172.21.15.112:0/259703856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a40039f0 0x7fb2a4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 --2- 172.21.15.112:0/259703856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2a4004810 0x7fb2a4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 --2- 172.21.15.112:0/259703856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b8153010 0x7fb2a40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 -- 172.21.15.112:0/259703856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b8073b30 con 0x7fb2a40039f0 2024-09-15T23:56:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 -- 172.21.15.112:0/259703856 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a400ba80 con 0x7fb2a4004810 2024-09-15T23:56:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b5ffb640 1 -- 172.21.15.112:0/259703856 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a400bc80 con 0x7fb2b8153010 2024-09-15T23:56:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b6ffd640 1 --2- 172.21.15.112:0/259703856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a40039f0 0x7fb2a4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b67fc640 1 --2- 172.21.15.112:0/259703856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2a4004810 0x7fb2a4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b77fe640 1 --2- 172.21.15.112:0/259703856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b8153010 0x7fb2a40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b6ffd640 1 -- 172.21.15.112:0/259703856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b8153010 msgr2=0x7fb2a40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b6ffd640 1 --2- 172.21.15.112:0/259703856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b8153010 0x7fb2a40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b6ffd640 1 -- 172.21.15.112:0/259703856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2a4004810 msgr2=0x7fb2a4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b6ffd640 1 --2- 172.21.15.112:0/259703856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2a4004810 0x7fb2a4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b6ffd640 1 -- 172.21.15.112:0/259703856 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a4003530 con 0x7fb2a40039f0 2024-09-15T23:56:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b67fc640 1 --2- 172.21.15.112:0/259703856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2a4004810 0x7fb2a4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.426+0000 7fb2b77fe640 1 --2- 172.21.15.112:0/259703856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b8153010 0x7fb2a40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:01.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.430+0000 7fb2b6ffd640 1 --2- 172.21.15.112:0/259703856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a40039f0 0x7fb2a4003e10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0009ab0 tx=0x7fb2b001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f35f472e1c2bd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:01.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.430+0000 7fb2b5ffb640 1 -- 172.21.15.112:0/259703856 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00096b0 con 0x7fb2a40039f0 2024-09-15T23:56:01.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.430+0000 7fb2b5ffb640 1 -- 172.21.15.112:0/259703856 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b00a6410 con 0x7fb2a40039f0 2024-09-15T23:56:01.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.430+0000 7fb2b5ffb640 1 -- 172.21.15.112:0/259703856 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00a6800 con 0x7fb2a40039f0 2024-09-15T23:56:01.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.430+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/259703856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a40039f0 msgr2=0x7fb2a4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.430+0000 7fb2bd7e2640 1 --2- 172.21.15.112:0/259703856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a40039f0 0x7fb2a4003e10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0009ab0 tx=0x7fb2b001ca30 comp rx=0 tx=0).stop 2024-09-15T23:56:01.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.430+0000 7fb2b77fe640 1 -- 172.21.15.112:0/259703856 reap_dead start 2024-09-15T23:56:01.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.430+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/259703856 shutdown_connections 2024-09-15T23:56:01.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.430+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/259703856 >> 172.21.15.112:0/259703856 conn(0x7fb2b80b6870 msgr2=0x7fb2b80b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:01.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.430+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/259703856 shutdown_connections 2024-09-15T23:56:01.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.430+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/259703856 wait complete. 2024-09-15T23:56:01.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.430+0000 7fb2bd7e2640 1 Processor -- start 2024-09-15T23:56:01.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.430+0000 7fb2bd7e2640 1 -- start start 2024-09-15T23:56:01.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2bd7e2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a40039f0 0x7fb2b80b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2bd7e2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b8149a20 0x7fb2b81501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2bd7e2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2b81537b0 0x7fb2b8153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2bd7e2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b8167ca0 con 0x7fb2a40039f0 2024-09-15T23:56:01.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2bd7e2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b80735c0 con 0x7fb2b81537b0 2024-09-15T23:56:01.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2bd7e2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b8167e20 con 0x7fb2b8149a20 2024-09-15T23:56:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2b6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a40039f0 0x7fb2b80b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2b6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a40039f0 0x7fb2b80b4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52272/0 (socket says 172.21.15.112:52272) 2024-09-15T23:56:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2b6ffd640 1 -- 172.21.15.112:0/802387025 learned_addr learned my addr 172.21.15.112:0/802387025 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2b77fe640 1 --2- 172.21.15.112:0/802387025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2b81537b0 0x7fb2b8153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2b6ffd640 1 -- 172.21.15.112:0/802387025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b8149a20 msgr2=0x7fb2b81501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2b6ffd640 1 --2- 172.21.15.112:0/802387025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b8149a20 0x7fb2b81501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2b6ffd640 1 -- 172.21.15.112:0/802387025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2b81537b0 msgr2=0x7fb2b8153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2b6ffd640 1 --2- 172.21.15.112:0/802387025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2b81537b0 0x7fb2b8153c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2b6ffd640 1 -- 172.21.15.112:0/802387025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b81563f0 con 0x7fb2a40039f0 2024-09-15T23:56:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2b6ffd640 1 --2- 172.21.15.112:0/802387025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a40039f0 0x7fb2b80b4280 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb2b001c860 tx=0x7fb2a4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2af7fe640 1 -- 172.21.15.112:0/802387025 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00be070 con 0x7fb2a40039f0 2024-09-15T23:56:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2af7fe640 1 -- 172.21.15.112:0/802387025 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b000f000 con 0x7fb2a40039f0 2024-09-15T23:56:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/802387025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b80b4860 con 0x7fb2a40039f0 2024-09-15T23:56:01.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2af7fe640 1 -- 172.21.15.112:0/802387025 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00a6e60 con 0x7fb2a40039f0 2024-09-15T23:56:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/802387025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b80b4e20 con 0x7fb2a40039f0 2024-09-15T23:56:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/802387025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b80b3280 con 0x7fb2a40039f0 2024-09-15T23:56:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2af7fe640 1 -- 172.21.15.112:0/802387025 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb2b00c1070 con 0x7fb2a40039f0 2024-09-15T23:56:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2af7fe640 1 --2- 172.21.15.112:0/802387025 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb2980678f0 0x7fb298069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2af7fe640 1 -- 172.21.15.112:0/802387025 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7fb2b011f3b0 con 0x7fb2a40039f0 2024-09-15T23:56:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2b67fc640 1 --2- 172.21.15.112:0/802387025 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb2980678f0 0x7fb298069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.434+0000 7fb2b67fc640 1 --2- 172.21.15.112:0/802387025 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb2980678f0 0x7fb298069db0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0001ec0 tx=0x7fb2a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:01.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.438+0000 7fb2af7fe640 1 -- 172.21.15.112:0/802387025 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb2b81563f0 con 0x7fb2a40039f0 2024-09-15T23:56:01.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.650+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/802387025 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_fragmented"]} v 0) -- 0x7fb2b806db10 con 0x7fb2a40039f0 2024-09-15T23:56:01.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.670+0000 7fb2af7fe640 1 -- 172.21.15.112:0/802387025 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_fragmented"]}]=0 v131) ==== 147+0+0 (secure 0 0 0) 0x7fb2b00ac020 con 0x7fb2a40039f0 2024-09-15T23:56:01.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.674+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/802387025 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb2980678f0 msgr2=0x7fb298069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.674+0000 7fb2bd7e2640 1 --2- 172.21.15.112:0/802387025 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb2980678f0 0x7fb298069db0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0001ec0 tx=0x7fb2a0009040 comp rx=0 tx=0).stop 2024-09-15T23:56:01.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.674+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/802387025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a40039f0 msgr2=0x7fb2b80b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.674+0000 7fb2bd7e2640 1 --2- 172.21.15.112:0/802387025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a40039f0 0x7fb2b80b4280 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb2b001c860 tx=0x7fb2a4005840 comp rx=0 tx=0).stop 2024-09-15T23:56:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.674+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/802387025 shutdown_connections 2024-09-15T23:56:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.674+0000 7fb2bd7e2640 1 --2- 172.21.15.112:0/802387025 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb2980678f0 0x7fb298069db0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.674+0000 7fb2bd7e2640 1 --2- 172.21.15.112:0/802387025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2b81537b0 0x7fb2b8153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.674+0000 7fb2bd7e2640 1 --2- 172.21.15.112:0/802387025 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2b8149a20 0x7fb2b81501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.674+0000 7fb2bd7e2640 1 --2- 172.21.15.112:0/802387025 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2a40039f0 0x7fb2b80b4280 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.674+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/802387025 >> 172.21.15.112:0/802387025 conn(0x7fb2b80b6870 msgr2=0x7fb2b806cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.674+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/802387025 shutdown_connections 2024-09-15T23:56:01.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.674+0000 7fb2bd7e2640 1 -- 172.21.15.112:0/802387025 wait complete. 2024-09-15T23:56:01.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:56:01.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.802+0000 7f00bb174640 1 Processor -- start 2024-09-15T23:56:01.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.802+0000 7f00bb174640 1 -- start start 2024-09-15T23:56:01.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00bb174640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f00b4070020 0x7f00b415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00bb174640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b40aede0 con 0x7f00b41520a0 2024-09-15T23:56:01.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00bb174640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b415fa10 con 0x7f00b415f1d0 2024-09-15T23:56:01.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00bb174640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f00b4152480 con 0x7f00b4070020 2024-09-15T23:56:01.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b8f10640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f00b41520a0 0x7f00b406f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58370/0 (socket says 172.21.15.112:58370) 2024-09-15T23:56:01.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b8f10640 1 -- 172.21.15.112:0/281241803 learned_addr learned my addr 172.21.15.112:0/281241803 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:01.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 -- 172.21.15.112:0/281241803 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1101530303 0 0) 0x7f00b40aede0 con 0x7f00b41520a0 2024-09-15T23:56:01.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 -- 172.21.15.112:0/281241803 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f009c003530 con 0x7f00b41520a0 2024-09-15T23:56:01.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b3fff640 1 --2- 172.21.15.112:0/281241803 >> v2:172.21.15.169:3300/0 conn(0x7f00b4070020 0x7f00b415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 -- 172.21.15.112:0/281241803 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 904027954 0 0) 0x7f009c003530 con 0x7f00b41520a0 2024-09-15T23:56:01.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 -- 172.21.15.112:0/281241803 >> v2:172.21.15.169:3300/0 conn(0x7f00b4070020 msgr2=0x7f00b415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:01.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 --2- 172.21.15.112:0/281241803 >> v2:172.21.15.169:3300/0 conn(0x7f00b4070020 0x7f00b415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 -- 172.21.15.112:0/281241803 >> v1:172.21.15.169:6789/0 conn(0x7f00b415f1d0 legacy=0x7f00b40adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 -- 172.21.15.112:0/281241803 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b4074250 con 0x7f00b41520a0 2024-09-15T23:56:01.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 -- 172.21.15.112:0/281241803 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f00ac001680 con 0x7f00b41520a0 2024-09-15T23:56:01.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 -- 172.21.15.112:0/281241803 >> v1:172.21.15.112:6789/0 conn(0x7f00b41520a0 legacy=0x7f00b406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 --2- 172.21.15.112:0/281241803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f009c0039c0 0x7f009c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 --2- 172.21.15.112:0/281241803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f009c004810 0x7f009c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 --2- 172.21.15.112:0/281241803 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f009c0051d0 0x7f009c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 -- 172.21.15.112:0/281241803 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f009c00c0f0 con 0x7f009c0039c0 2024-09-15T23:56:01.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 -- 172.21.15.112:0/281241803 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f009c00c2a0 con 0x7f009c004810 2024-09-15T23:56:01.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b37fe640 1 -- 172.21.15.112:0/281241803 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f009c00c4a0 con 0x7f009c0051d0 2024-09-15T23:56:01.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b8f10640 1 --2- 172.21.15.112:0/281241803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f009c0039c0 0x7f009c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b3fff640 1 --2- 172.21.15.112:0/281241803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f009c004810 0x7f009c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b8f10640 1 -- 172.21.15.112:0/281241803 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f009c0051d0 msgr2=0x7f009c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:01.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b8f10640 1 --2- 172.21.15.112:0/281241803 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f009c0051d0 0x7f009c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b8f10640 1 -- 172.21.15.112:0/281241803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f009c004810 msgr2=0x7f009c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:01.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b8f10640 1 --2- 172.21.15.112:0/281241803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f009c004810 0x7f009c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b8f10640 1 -- 172.21.15.112:0/281241803 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009c003530 con 0x7f009c0039c0 2024-09-15T23:56:01.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b9711640 1 -- 172.21.15.112:0/281241803 reap_dead start 2024-09-15T23:56:01.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.806+0000 7f00b3fff640 1 --2- 172.21.15.112:0/281241803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f009c004810 0x7f009c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:01.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b8f10640 1 --2- 172.21.15.112:0/281241803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f009c0039c0 0x7f009c003de0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00c240 tx=0x7f00ac01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecdc484b30af0bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:01.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b37fe640 1 -- 172.21.15.112:0/281241803 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac007d20 con 0x7f009c0039c0 2024-09-15T23:56:01.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b37fe640 1 -- 172.21.15.112:0/281241803 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00ac0a9070 con 0x7f009c0039c0 2024-09-15T23:56:01.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b37fe640 1 -- 172.21.15.112:0/281241803 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0058e0 con 0x7f009c0039c0 2024-09-15T23:56:01.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 -- 172.21.15.112:0/281241803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f009c0039c0 msgr2=0x7f009c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 --2- 172.21.15.112:0/281241803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f009c0039c0 0x7f009c003de0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00c240 tx=0x7f00ac01cc50 comp rx=0 tx=0).stop 2024-09-15T23:56:01.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 -- 172.21.15.112:0/281241803 shutdown_connections 2024-09-15T23:56:01.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 --2- 172.21.15.112:0/281241803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f009c0039c0 0x7f009c003de0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 -- 172.21.15.112:0/281241803 >> 172.21.15.112:0/281241803 conn(0x7f00b40b1f90 msgr2=0x7f00b40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:01.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 -- 172.21.15.112:0/281241803 shutdown_connections 2024-09-15T23:56:01.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 -- 172.21.15.112:0/281241803 wait complete. 2024-09-15T23:56:01.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 Processor -- start 2024-09-15T23:56:01.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 -- start start 2024-09-15T23:56:01.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f009c0039c0 0x7f00b40cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b40cba80 0x7f00b4140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00b40cbf00 0x7f00b41408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4073d30 con 0x7f00b40cba80 2024-09-15T23:56:01.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4073a50 con 0x7f009c0039c0 2024-09-15T23:56:01.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f00b415f5e0 con 0x7f00b40cbf00 2024-09-15T23:56:01.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b40cba80 0x7f00b4140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b40cba80 0x7f00b4140380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52292/0 (socket says 172.21.15.112:52292) 2024-09-15T23:56:01.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b3fff640 1 -- 172.21.15.112:0/3418906835 learned_addr learned my addr 172.21.15.112:0/3418906835 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:01.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b8f10640 1 --2- 172.21.15.112:0/3418906835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f009c0039c0 0x7f00b40cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b9711640 1 --2- 172.21.15.112:0/3418906835 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00b40cbf00 0x7f00b41408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b3fff640 1 -- 172.21.15.112:0/3418906835 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00b40cbf00 msgr2=0x7f00b41408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b3fff640 1 --2- 172.21.15.112:0/3418906835 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00b40cbf00 0x7f00b41408c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b3fff640 1 -- 172.21.15.112:0/3418906835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f009c0039c0 msgr2=0x7f00b40cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b3fff640 1 --2- 172.21.15.112:0/3418906835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f009c0039c0 0x7f00b40cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b3fff640 1 -- 172.21.15.112:0/3418906835 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b40cfaf0 con 0x7f00b40cba80 2024-09-15T23:56:01.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b3fff640 1 --2- 172.21.15.112:0/3418906835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b40cba80 0x7f00b4140380 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f00a8007e60 tx=0x7f00a800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:01.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b17fa640 1 -- 172.21.15.112:0/3418906835 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8018020 con 0x7f00b40cba80 2024-09-15T23:56:01.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b17fa640 1 -- 172.21.15.112:0/3418906835 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a80145f0 con 0x7f00b40cba80 2024-09-15T23:56:01.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 -- 172.21.15.112:0/3418906835 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b40ccd50 con 0x7f00b40cba80 2024-09-15T23:56:01.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00b17fa640 1 -- 172.21.15.112:0/3418906835 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a800fea0 con 0x7f00b40cba80 2024-09-15T23:56:01.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.810+0000 7f00bb174640 1 -- 172.21.15.112:0/3418906835 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b40cd310 con 0x7f00b40cba80 2024-09-15T23:56:01.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.814+0000 7f00bb174640 1 -- 172.21.15.112:0/3418906835 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b4068e50 con 0x7f00b40cba80 2024-09-15T23:56:01.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.814+0000 7f00b17fa640 1 -- 172.21.15.112:0/3418906835 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00a801b020 con 0x7f00b40cba80 2024-09-15T23:56:01.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.814+0000 7f00b17fa640 1 --2- 172.21.15.112:0/3418906835 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f00a00678c0 0x7f00a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:01.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.814+0000 7f00b17fa640 1 -- 172.21.15.112:0/3418906835 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f00a8086380 con 0x7f00b40cba80 2024-09-15T23:56:01.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.814+0000 7f00b8f10640 1 --2- 172.21.15.112:0/3418906835 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f00a00678c0 0x7f00a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:01.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.814+0000 7f00b8f10640 1 --2- 172.21.15.112:0/3418906835 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f00a00678c0 0x7f00a0069d80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f00ac0ab000 tx=0x7f00ac0b1040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:01.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.818+0000 7f00b17fa640 1 -- 172.21.15.112:0/3418906835 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f00a8022020 con 0x7f00b40cba80 2024-09-15T23:56:01.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.966+0000 7f00bb174640 1 -- 172.21.15.112:0/3418906835 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f00b406e540 con 0x7f00b40cba80 2024-09-15T23:56:01.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.970+0000 7f00b17fa640 1 -- 172.21.15.112:0/3418906835 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f00a80569e0 con 0x7f00b40cba80 2024-09-15T23:56:01.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.974+0000 7f00bb174640 1 -- 172.21.15.112:0/3418906835 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f00a00678c0 msgr2=0x7f00a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.974+0000 7f00bb174640 1 --2- 172.21.15.112:0/3418906835 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f00a00678c0 0x7f00a0069d80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f00ac0ab000 tx=0x7f00ac0b1040 comp rx=0 tx=0).stop 2024-09-15T23:56:01.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.974+0000 7f00bb174640 1 -- 172.21.15.112:0/3418906835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b40cba80 msgr2=0x7f00b4140380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:01.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.974+0000 7f00bb174640 1 --2- 172.21.15.112:0/3418906835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b40cba80 0x7f00b4140380 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f00a8007e60 tx=0x7f00a800f520 comp rx=0 tx=0).stop 2024-09-15T23:56:01.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.974+0000 7f00bb174640 1 -- 172.21.15.112:0/3418906835 shutdown_connections 2024-09-15T23:56:01.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.974+0000 7f00bb174640 1 --2- 172.21.15.112:0/3418906835 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f00a00678c0 0x7f00a0069d80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.974+0000 7f00bb174640 1 --2- 172.21.15.112:0/3418906835 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00b40cbf00 0x7f00b41408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.974+0000 7f00bb174640 1 --2- 172.21.15.112:0/3418906835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b40cba80 0x7f00b4140380 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.974+0000 7f00bb174640 1 --2- 172.21.15.112:0/3418906835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f009c0039c0 0x7f00b40cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:01.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.974+0000 7f00bb174640 1 -- 172.21.15.112:0/3418906835 >> 172.21.15.112:0/3418906835 conn(0x7f00b40b1f90 msgr2=0x7f00b40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:01.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.974+0000 7f00bb174640 1 -- 172.21.15.112:0/3418906835 shutdown_connections 2024-09-15T23:56:01.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:01.974+0000 7f00bb174640 1 -- 172.21.15.112:0/3418906835 wait complete. 2024-09-15T23:56:01.991 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:56:01.991 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:56:02.063 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:56:02.141 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:56:02.141 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:56:02.141 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:02.147 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:56:02.148 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:56:02.148 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:02.154 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:56:02.154 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:56:02.154 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:02.195 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:56:02.195 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:56:02.195 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:02.203 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:56:02.203 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:56:02.203 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:02.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdf04be5640 1 Processor -- start 2024-09-15T23:56:02.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdf04be5640 1 -- start start 2024-09-15T23:56:02.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdf04be5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdf0015bec0 0x7fdf000ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:02.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdf04be5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf0015c2a0 0x7fdf000aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:02.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdf04be5640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf000b3290 con 0x7fdf000af2a0 2024-09-15T23:56:02.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdf04be5640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdf000b3570 con 0x7fdf0015bec0 2024-09-15T23:56:02.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdf04be5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdf000b3850 con 0x7fdf0015c2a0 2024-09-15T23:56:02.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdefe59c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdf0015bec0 0x7fdf000ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:02.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdefe59c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdf0015bec0 0x7fdf000ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52294/0 (socket says 172.21.15.112:52294) 2024-09-15T23:56:02.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdefe59c640 1 -- 172.21.15.112:0/4204482930 learned_addr learned my addr 172.21.15.112:0/4204482930 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:02.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdefe59c640 1 -- 172.21.15.112:0/4204482930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf0015c2a0 msgr2=0x7fdf000aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:02.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdefdd9b640 1 --2- 172.21.15.112:0/4204482930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf0015c2a0 0x7fdf000aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:02.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdefe59c640 1 --2- 172.21.15.112:0/4204482930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf0015c2a0 0x7fdf000aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdefe59c640 1 -- 172.21.15.112:0/4204482930 >> v1:172.21.15.169:6789/0 conn(0x7fdf000af2a0 legacy=0x7fdf0015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:02.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdefe59c640 1 -- 172.21.15.112:0/4204482930 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf000b3b30 con 0x7fdf0015bec0 2024-09-15T23:56:02.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdefe59c640 1 --2- 172.21.15.112:0/4204482930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0015bec0 0x7fdf000ad200 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009870 tx=0x7fdee801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9467f5e81a673 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:02.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdefd59a640 1 -- 172.21.15.112:0/4204482930 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee80aa610 con 0x7fdf0015bec0 2024-09-15T23:56:02.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdefd59a640 1 -- 172.21.15.112:0/4204482930 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee80af070 con 0x7fdf0015bec0 2024-09-15T23:56:02.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.362+0000 7fdefd59a640 1 -- 172.21.15.112:0/4204482930 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee80aa9d0 con 0x7fdf0015bec0 2024-09-15T23:56:02.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 -- 172.21.15.112:0/4204482930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0015bec0 msgr2=0x7fdf000ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:02.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 --2- 172.21.15.112:0/4204482930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0015bec0 0x7fdf000ad200 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009870 tx=0x7fdee801c4f0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 -- 172.21.15.112:0/4204482930 shutdown_connections 2024-09-15T23:56:02.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 --2- 172.21.15.112:0/4204482930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf0015c2a0 0x7fdf000aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 --2- 172.21.15.112:0/4204482930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0015bec0 0x7fdf000ad200 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 -- 172.21.15.112:0/4204482930 >> 172.21.15.112:0/4204482930 conn(0x7fdf000b1f90 msgr2=0x7fdf000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:02.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 -- 172.21.15.112:0/4204482930 shutdown_connections 2024-09-15T23:56:02.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 -- 172.21.15.112:0/4204482930 wait complete. 2024-09-15T23:56:02.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 Processor -- start 2024-09-15T23:56:02.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 -- start start 2024-09-15T23:56:02.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf000af2a0 0x7fdf0015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:02.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf0015bec0 0x7fdf000cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:02.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0015c2a0 0x7fdf000d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:02.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdf000ad740 con 0x7fdf0015c2a0 2024-09-15T23:56:02.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdf000afc90 con 0x7fdf0015bec0 2024-09-15T23:56:02.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdf00169000 con 0x7fdf000af2a0 2024-09-15T23:56:02.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdefed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0015c2a0 0x7fdf000d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:02.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdefed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0015c2a0 0x7fdf000d0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52306/0 (socket says 172.21.15.112:52306) 2024-09-15T23:56:02.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdefed9d640 1 -- 172.21.15.112:0/3595980255 learned_addr learned my addr 172.21.15.112:0/3595980255 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:02.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdefe59c640 1 --2- 172.21.15.112:0/3595980255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf000af2a0 0x7fdf0015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:02.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdefdd9b640 1 --2- 172.21.15.112:0/3595980255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf0015bec0 0x7fdf000cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:02.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdefed9d640 1 -- 172.21.15.112:0/3595980255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf000af2a0 msgr2=0x7fdf0015c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:02.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdefed9d640 1 --2- 172.21.15.112:0/3595980255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf000af2a0 0x7fdf0015c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdefed9d640 1 -- 172.21.15.112:0/3595980255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf0015bec0 msgr2=0x7fdf000cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:02.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdefed9d640 1 --2- 172.21.15.112:0/3595980255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf0015bec0 0x7fdf000cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdefed9d640 1 -- 172.21.15.112:0/3595980255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf00141c30 con 0x7fdf0015c2a0 2024-09-15T23:56:02.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdefed9d640 1 --2- 172.21.15.112:0/3595980255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0015c2a0 0x7fdf000d0150 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fdef800c3c0 tx=0x7fdef800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:02.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdef6ffd640 1 -- 172.21.15.112:0/3595980255 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8011790 con 0x7fdf0015c2a0 2024-09-15T23:56:02.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdef6ffd640 1 -- 172.21.15.112:0/3595980255 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef8017070 con 0x7fdf0015c2a0 2024-09-15T23:56:02.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 -- 172.21.15.112:0/3595980255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf00141f10 con 0x7fdf0015c2a0 2024-09-15T23:56:02.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdef6ffd640 1 -- 172.21.15.112:0/3595980255 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8011b70 con 0x7fdf0015c2a0 2024-09-15T23:56:02.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.366+0000 7fdf04be5640 1 -- 172.21.15.112:0/3595980255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf001424d0 con 0x7fdf0015c2a0 2024-09-15T23:56:02.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.370+0000 7fdf04be5640 1 -- 172.21.15.112:0/3595980255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf000ad200 con 0x7fdf0015c2a0 2024-09-15T23:56:02.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.370+0000 7fdef6ffd640 1 -- 172.21.15.112:0/3595980255 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdef8011d10 con 0x7fdf0015c2a0 2024-09-15T23:56:02.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.370+0000 7fdef6ffd640 1 --2- 172.21.15.112:0/3595980255 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdee00678c0 0x7fdee0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:02.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.370+0000 7fdef6ffd640 1 -- 172.21.15.112:0/3595980255 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7fdef80859a0 con 0x7fdf0015c2a0 2024-09-15T23:56:02.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.370+0000 7fdefe59c640 1 --2- 172.21.15.112:0/3595980255 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdee00678c0 0x7fdee0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:02.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.370+0000 7fdefe59c640 1 --2- 172.21.15.112:0/3595980255 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdee00678c0 0x7fdee0069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdee80ae000 tx=0x7fdee80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:02.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.374+0000 7fdef6ffd640 1 -- 172.21.15.112:0/3595980255 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdef8056650 con 0x7fdf0015c2a0 2024-09-15T23:56:02.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.570+0000 7fdf04be5640 1 -- 172.21.15.112:0/3595980255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf0006fcd0 con 0x7fdf0015c2a0 2024-09-15T23:56:02.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.570+0000 7fdef6ffd640 1 -- 172.21.15.112:0/3595980255 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+3920 (secure 0 0 0) 0x7fdef8055f50 con 0x7fdf0015c2a0 2024-09-15T23:56:02.574 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:02.574 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":24,"btime":"2024-09-15T23:55:56:647226+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4655,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/1762952607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1762952607},{"type":"v1","addr":"172.21.15.169:6834","nonce":1762952607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1383551321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1383551321},{"type":"v1","addr":"172.21.15.169:6835","nonce":1383551321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/235120639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":235120639},{"type":"v1","addr":"172.21.15.112:6835","nonce":235120639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3613516454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3613516454},{"type":"v1","addr":"172.21.15.112:6837","nonce":3613516454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[]} 2024-09-15T23:56:02.574 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 24 2024-09-15T23:56:02.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.574+0000 7fdf04be5640 1 -- 172.21.15.112:0/3595980255 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdee00678c0 msgr2=0x7fdee0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:02.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.574+0000 7fdf04be5640 1 --2- 172.21.15.112:0/3595980255 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdee00678c0 0x7fdee0069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdee80ae000 tx=0x7fdee80a7000 comp rx=0 tx=0).stop 2024-09-15T23:56:02.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.574+0000 7fdf04be5640 1 -- 172.21.15.112:0/3595980255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0015c2a0 msgr2=0x7fdf000d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:02.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.574+0000 7fdf04be5640 1 --2- 172.21.15.112:0/3595980255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0015c2a0 0x7fdf000d0150 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fdef800c3c0 tx=0x7fdef800c880 comp rx=0 tx=0).stop 2024-09-15T23:56:02.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.574+0000 7fdf04be5640 1 -- 172.21.15.112:0/3595980255 shutdown_connections 2024-09-15T23:56:02.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.574+0000 7fdf04be5640 1 --2- 172.21.15.112:0/3595980255 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdee00678c0 0x7fdee0069d80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.574+0000 7fdf04be5640 1 --2- 172.21.15.112:0/3595980255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf0015c2a0 0x7fdf000d0150 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.574+0000 7fdf04be5640 1 --2- 172.21.15.112:0/3595980255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf0015bec0 0x7fdf000cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.574+0000 7fdf04be5640 1 --2- 172.21.15.112:0/3595980255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf000af2a0 0x7fdf0015c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.574+0000 7fdf04be5640 1 -- 172.21.15.112:0/3595980255 >> 172.21.15.112:0/3595980255 conn(0x7fdf000b1f90 msgr2=0x7fdf00159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:02.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.574+0000 7fdf04be5640 1 -- 172.21.15.112:0/3595980255 shutdown_connections 2024-09-15T23:56:02.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.574+0000 7fdf04be5640 1 -- 172.21.15.112:0/3595980255 wait complete. 2024-09-15T23:56:02.593 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:56:02.593 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:56:02.593 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:56:02.593 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:56:02.594 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:56:02.595 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:56:02.595 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:56:02.595 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:56:02.595 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:56:02.596 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:56:02.596 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:56:02.596 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:56:02.596 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:56:02.596 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:56:02.596 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:56:02.597 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:56:02.605 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:56:02.605 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:56:02.606 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:56:02.607 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:56:02.613 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:56:02.614 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:56:02.616 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:56:02.616 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:56:02.648 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:56:02.648 DEBUG:teuthology.parallel:result is None 2024-09-15T23:56:02.649 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:56:02.649 DEBUG:teuthology.parallel:result is None 2024-09-15T23:56:02.663 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:56:02.664 DEBUG:teuthology.parallel:result is None 2024-09-15T23:56:02.665 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:56:02.665 DEBUG:teuthology.parallel:result is None 2024-09-15T23:56:02.666 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:56:02.711 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-15T23:56:02.718 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-15T23:56:02.734 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-09-15T23:56:02.737 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-15T23:56:02.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3d1d49640 1 Processor -- start 2024-09-15T23:56:02.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3d1d49640 1 -- start start 2024-09-15T23:56:02.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3d1d49640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3cc0d3060 0x7fe3cc0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:02.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3d1d49640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe3cc0cf450 0x7fe3cc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:02.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3d1d49640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3cc0d0300 con 0x7fe3cc161a60 2024-09-15T23:56:02.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3d1d49640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe3cc0b0f60 con 0x7fe3cc0cf450 2024-09-15T23:56:02.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3d1d49640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe3cc0cfd40 con 0x7fe3cc0d3060 2024-09-15T23:56:02.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3cbfff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe3cc0cf450 0x7fe3cc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:02.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3caffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3cc0d3060 0x7fe3cc0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:02.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3cb7fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fe3cc161a60 0x7fe3cc0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:35526/0 (socket says 172.21.15.112:35526) 2024-09-15T23:56:02.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3cb7fe640 1 -- 172.21.15.112:0/4224418342 learned_addr learned my addr 172.21.15.112:0/4224418342 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:02.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3caffd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3cc0d3060 0x7fe3cc0cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:52274/0 (socket says 172.21.15.112:52274) 2024-09-15T23:56:02.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3cbfff640 1 -- 172.21.15.112:0/4224418342 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3cc0d3060 msgr2=0x7fe3cc0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:02.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3cbfff640 1 --2- 172.21.15.112:0/4224418342 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3cc0d3060 0x7fe3cc0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3cbfff640 1 -- 172.21.15.112:0/4224418342 >> v1:172.21.15.169:6789/0 conn(0x7fe3cc161a60 legacy=0x7fe3cc0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:02.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.774+0000 7fe3ca7fc640 1 -- 172.21.15.112:0/4224418342 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 372748986 0 0) 0x7fe3bc001120 con 0x7fe3cc161a60 2024-09-15T23:56:02.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.778+0000 7fe3cbfff640 1 -- 172.21.15.112:0/4224418342 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3cc0d0020 con 0x7fe3cc0cf450 2024-09-15T23:56:02.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.778+0000 7fe3cbfff640 1 --2- 172.21.15.112:0/4224418342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3cc0cf450 0x7fe3cc06d6b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009d90 tx=0x7fe3c401c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e8f494347eb785 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:02.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.778+0000 7fe3ca7fc640 1 -- 172.21.15.112:0/4224418342 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40b2070 con 0x7fe3cc0cf450 2024-09-15T23:56:02.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.778+0000 7fe3ca7fc640 1 -- 172.21.15.112:0/4224418342 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c40a5970 con 0x7fe3cc0cf450 2024-09-15T23:56:02.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.778+0000 7fe3ca7fc640 1 -- 172.21.15.112:0/4224418342 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40a5d40 con 0x7fe3cc0cf450 2024-09-15T23:56:02.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.778+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4224418342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3cc0cf450 msgr2=0x7fe3cc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:02.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.778+0000 7fe3d1d49640 1 --2- 172.21.15.112:0/4224418342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3cc0cf450 0x7fe3cc06d6b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009d90 tx=0x7fe3c401c8b0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.778+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4224418342 shutdown_connections 2024-09-15T23:56:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.778+0000 7fe3d1d49640 1 --2- 172.21.15.112:0/4224418342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3cc0cf450 0x7fe3cc06d6b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.778+0000 7fe3d1d49640 1 --2- 172.21.15.112:0/4224418342 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3cc0d3060 0x7fe3cc0cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.778+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4224418342 >> 172.21.15.112:0/4224418342 conn(0x7fe3cc08bf90 msgr2=0x7fe3cc09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.778+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4224418342 shutdown_connections 2024-09-15T23:56:02.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.778+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4224418342 wait complete. 2024-09-15T23:56:02.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3d1d49640 1 Processor -- start 2024-09-15T23:56:02.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3d1d49640 1 -- start start 2024-09-15T23:56:02.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3d1d49640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3cc0cf450 0x7fe3cc154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:02.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3d1d49640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3cc0d3060 0x7fe3cc153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3d1d49640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3cc161a60 0x7fe3cc1586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3d1d49640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc06e400 con 0x7fe3cc161a60 2024-09-15T23:56:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3d1d49640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc0cfaf0 con 0x7fe3cc0d3060 2024-09-15T23:56:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3d1d49640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe3cc06e580 con 0x7fe3cc0cf450 2024-09-15T23:56:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3cbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3cc161a60 0x7fe3cc1586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3cbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3cc161a60 0x7fe3cc1586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52356/0 (socket says 172.21.15.112:52356) 2024-09-15T23:56:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3cbfff640 1 -- 172.21.15.112:0/4028919721 learned_addr learned my addr 172.21.15.112:0/4028919721 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3caffd640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3cc0d3060 0x7fe3cc153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3cb7fe640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3cc0cf450 0x7fe3cc154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3cbfff640 1 -- 172.21.15.112:0/4028919721 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3cc0cf450 msgr2=0x7fe3cc154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3cbfff640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3cc0cf450 0x7fe3cc154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3cbfff640 1 -- 172.21.15.112:0/4028919721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3cc0d3060 msgr2=0x7fe3cc153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3cbfff640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3cc0d3060 0x7fe3cc153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:02.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3cbfff640 1 -- 172.21.15.112:0/4028919721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3cc156da0 con 0x7fe3cc161a60 2024-09-15T23:56:02.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3caffd640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3cc0d3060 0x7fe3cc153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:56:02.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3cb7fe640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3cc0cf450 0x7fe3cc154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:56:02.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3cbfff640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3cc161a60 0x7fe3cc1586a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe3c401af60 tx=0x7fe3c4019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:02.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3b3fff640 1 -- 172.21.15.112:0/4028919721 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40b2050 con 0x7fe3cc161a60 2024-09-15T23:56:02.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3b3fff640 1 -- 172.21.15.112:0/4028919721 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c40be070 con 0x7fe3cc161a60 2024-09-15T23:56:02.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4028919721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3cc157080 con 0x7fe3cc161a60 2024-09-15T23:56:02.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3b3fff640 1 -- 172.21.15.112:0/4028919721 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40ada50 con 0x7fe3cc161a60 2024-09-15T23:56:02.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4028919721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3cc1f8910 con 0x7fe3cc161a60 2024-09-15T23:56:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4028919721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3cc06d6b0 con 0x7fe3cc161a60 2024-09-15T23:56:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3b3fff640 1 -- 172.21.15.112:0/4028919721 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe3c40a57f0 con 0x7fe3cc161a60 2024-09-15T23:56:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3b3fff640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe3b80678c0 0x7fe3b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3b3fff640 1 -- 172.21.15.112:0/4028919721 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7fe3c41216f0 con 0x7fe3cc161a60 2024-09-15T23:56:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.782+0000 7fe3cb7fe640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe3b80678c0 0x7fe3b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.786+0000 7fe3cb7fe640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe3b80678c0 0x7fe3b8069d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc000f70 tx=0x7fe3bc007cd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.786+0000 7fe3b3fff640 1 -- 172.21.15.112:0/4028919721 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe3c4016560 con 0x7fe3cc161a60 2024-09-15T23:56:02.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:02.962+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4028919721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe3cc157250 con 0x7fe3cc161a60 2024-09-15T23:56:03.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.694+0000 7fe3b3fff640 1 -- 172.21.15.112:0/4028919721 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) ==== 97+0+0 (secure 0 0 0) 0x7fe3c40f2410 con 0x7fe3cc161a60 2024-09-15T23:56:03.695 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-15T23:56:03.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.698+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4028919721 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe3b80678c0 msgr2=0x7fe3b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:03.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.698+0000 7fe3d1d49640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe3b80678c0 0x7fe3b8069d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc000f70 tx=0x7fe3bc007cd0 comp rx=0 tx=0).stop 2024-09-15T23:56:03.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.698+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4028919721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3cc161a60 msgr2=0x7fe3cc1586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:03.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.698+0000 7fe3d1d49640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3cc161a60 0x7fe3cc1586a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe3c401af60 tx=0x7fe3c4019650 comp rx=0 tx=0).stop 2024-09-15T23:56:03.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.698+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4028919721 shutdown_connections 2024-09-15T23:56:03.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.698+0000 7fe3d1d49640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe3b80678c0 0x7fe3b8069d80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:03.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.698+0000 7fe3d1d49640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3cc161a60 0x7fe3cc1586a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:03.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.698+0000 7fe3d1d49640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3cc0d3060 0x7fe3cc153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:03.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.698+0000 7fe3d1d49640 1 --2- 172.21.15.112:0/4028919721 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3cc0cf450 0x7fe3cc154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:03.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.698+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4028919721 >> 172.21.15.112:0/4028919721 conn(0x7fe3cc08bf90 msgr2=0x7fe3cc160070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:03.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.698+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4028919721 shutdown_connections 2024-09-15T23:56:03.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.698+0000 7fe3d1d49640 1 -- 172.21.15.112:0/4028919721 wait complete. 2024-09-15T23:56:03.721 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:56:03.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8eae89640 1 Processor -- start 2024-09-15T23:56:03.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8eae89640 1 -- start start 2024-09-15T23:56:03.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8eae89640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8e415bec0 0x7ff8e40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:03.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8eae89640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8e40af470 0x7ff8e406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:03.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8eae89640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e40b3290 con 0x7ff8e415c2a0 2024-09-15T23:56:03.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8eae89640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff8e40b3570 con 0x7ff8e415bec0 2024-09-15T23:56:03.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8eae89640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e40b3850 con 0x7ff8e40af470 2024-09-15T23:56:03.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8e8c25640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8e415bec0 0x7ff8e40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:03.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8e8c25640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8e415bec0 0x7ff8e40ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52368/0 (socket says 172.21.15.112:52368) 2024-09-15T23:56:03.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8e8c25640 1 -- 172.21.15.112:0/1103730783 learned_addr learned my addr 172.21.15.112:0/1103730783 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:03.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8e3fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff8e415c2a0 0x7ff8e40aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58386/0 (socket says 172.21.15.112:58386) 2024-09-15T23:56:03.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8e8c25640 1 -- 172.21.15.112:0/1103730783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8e40af470 msgr2=0x7ff8e406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:03.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8e8c25640 1 --2- 172.21.15.112:0/1103730783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8e40af470 0x7ff8e406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:03.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8e8c25640 1 -- 172.21.15.112:0/1103730783 >> v1:172.21.15.112:6789/0 conn(0x7ff8e415c2a0 legacy=0x7ff8e40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:03.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.842+0000 7ff8e8c25640 1 -- 172.21.15.112:0/1103730783 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e40b3b30 con 0x7ff8e415bec0 2024-09-15T23:56:03.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.846+0000 7ff8e8c25640 1 --2- 172.21.15.112:0/1103730783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8e415bec0 0x7ff8e40ad200 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009e50 tx=0x7ff8d401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29039c96342cb2ba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:03.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.846+0000 7ff8e37fe640 1 -- 172.21.15.112:0/1103730783 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40a5830 con 0x7ff8e415bec0 2024-09-15T23:56:03.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.846+0000 7ff8e37fe640 1 -- 172.21.15.112:0/1103730783 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d40a59d0 con 0x7ff8e415bec0 2024-09-15T23:56:03.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.846+0000 7ff8e37fe640 1 -- 172.21.15.112:0/1103730783 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40a5da0 con 0x7ff8e415bec0 2024-09-15T23:56:03.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.846+0000 7ff8eae89640 1 -- 172.21.15.112:0/1103730783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8e415bec0 msgr2=0x7ff8e40ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:03.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.846+0000 7ff8eae89640 1 --2- 172.21.15.112:0/1103730783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8e415bec0 0x7ff8e40ad200 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009e50 tx=0x7ff8d401c970 comp rx=0 tx=0).stop 2024-09-15T23:56:03.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.846+0000 7ff8eae89640 1 -- 172.21.15.112:0/1103730783 shutdown_connections 2024-09-15T23:56:03.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.846+0000 7ff8eae89640 1 --2- 172.21.15.112:0/1103730783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8e40af470 0x7ff8e406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:03.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.846+0000 7ff8eae89640 1 --2- 172.21.15.112:0/1103730783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8e415bec0 0x7ff8e40ad200 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:03.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.846+0000 7ff8eae89640 1 -- 172.21.15.112:0/1103730783 >> 172.21.15.112:0/1103730783 conn(0x7ff8e40b1f90 msgr2=0x7ff8e40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:03.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.846+0000 7ff8eae89640 1 -- 172.21.15.112:0/1103730783 shutdown_connections 2024-09-15T23:56:03.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.846+0000 7ff8eae89640 1 -- 172.21.15.112:0/1103730783 wait complete. 2024-09-15T23:56:03.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8eae89640 1 Processor -- start 2024-09-15T23:56:03.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8eae89640 1 -- start start 2024-09-15T23:56:03.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8eae89640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8e40af470 0x7ff8e414d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:03.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8eae89640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8e415bec0 0x7ff8e4153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:03.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8eae89640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8e415c2a0 0x7ff8e4153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:03.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8eae89640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e406ed50 con 0x7ff8e40af470 2024-09-15T23:56:03.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8eae89640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e40ad740 con 0x7ff8e415c2a0 2024-09-15T23:56:03.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8eae89640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e406eed0 con 0x7ff8e415bec0 2024-09-15T23:56:03.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e8c25640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8e40af470 0x7ff8e414d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:03.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e8c25640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8e40af470 0x7ff8e414d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52382/0 (socket says 172.21.15.112:52382) 2024-09-15T23:56:03.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e8c25640 1 -- 172.21.15.112:0/798132424 learned_addr learned my addr 172.21.15.112:0/798132424 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:03.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e8c25640 1 -- 172.21.15.112:0/798132424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8e415bec0 msgr2=0x7ff8e4153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:03.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e8c25640 1 --2- 172.21.15.112:0/798132424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8e415bec0 0x7ff8e4153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:03.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e8c25640 1 -- 172.21.15.112:0/798132424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8e415c2a0 msgr2=0x7ff8e4153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:03.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e9426640 1 --2- 172.21.15.112:0/798132424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8e415c2a0 0x7ff8e4153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e8c25640 1 --2- 172.21.15.112:0/798132424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8e415c2a0 0x7ff8e4153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e8c25640 1 -- 172.21.15.112:0/798132424 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e415f360 con 0x7ff8e40af470 2024-09-15T23:56:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e9426640 1 --2- 172.21.15.112:0/798132424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8e415c2a0 0x7ff8e4153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e8c25640 1 --2- 172.21.15.112:0/798132424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8e40af470 0x7ff8e414d250 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff8d401a5a0 tx=0x7ff8d4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e17fa640 1 -- 172.21.15.112:0/798132424 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40bc030 con 0x7ff8e40af470 2024-09-15T23:56:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e17fa640 1 -- 172.21.15.112:0/798132424 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d4009250 con 0x7ff8e40af470 2024-09-15T23:56:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8eae89640 1 -- 172.21.15.112:0/798132424 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e415f640 con 0x7ff8e40af470 2024-09-15T23:56:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e17fa640 1 -- 172.21.15.112:0/798132424 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40b88c0 con 0x7ff8e40af470 2024-09-15T23:56:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8eae89640 1 -- 172.21.15.112:0/798132424 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e414d790 con 0x7ff8e40af470 2024-09-15T23:56:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8eae89640 1 -- 172.21.15.112:0/798132424 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e4151a70 con 0x7ff8e40af470 2024-09-15T23:56:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e17fa640 1 -- 172.21.15.112:0/798132424 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8d40bf070 con 0x7ff8e40af470 2024-09-15T23:56:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e17fa640 1 --2- 172.21.15.112:0/798132424 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff8d00678c0 0x7ff8d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:03.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e17fa640 1 -- 172.21.15.112:0/798132424 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5249+0+0 (secure 0 0 0) 0x7ff8d4120ea0 con 0x7ff8e40af470 2024-09-15T23:56:03.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.850+0000 7ff8e3fff640 1 --2- 172.21.15.112:0/798132424 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff8d00678c0 0x7ff8d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:03.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.854+0000 7ff8e3fff640 1 --2- 172.21.15.112:0/798132424 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff8d00678c0 0x7ff8d0069d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff8e409d8a0 tx=0x7ff8d80079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:03.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:03.854+0000 7ff8e17fa640 1 -- 172.21.15.112:0/798132424 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff8d4016620 con 0x7ff8e40af470 2024-09-15T23:56:04.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.066+0000 7ff8eae89640 1 -- 172.21.15.112:0/798132424 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff8e406e000 con 0x7ff8e40af470 2024-09-15T23:56:04.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.066+0000 7ff8e17fa640 1 -- 172.21.15.112:0/798132424 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7ff8d40f1e10 con 0x7ff8e40af470 2024-09-15T23:56:04.069 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:04.069 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:56:04.069 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-15T23:56:04.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.069 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-15T23:56:04.069 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmPvLEFBAA/WS7KNQ60+LzhOcQyCVWoQ==", 2024-09-15T23:56:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:56:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:56:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-15T23:56:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmN/+jIxAAiXM9onNC3twhiZrqCdWtUQ==", 2024-09-15T23:56:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:56:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:56:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-15T23:56:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmEbNbHRAAjP+2Z2XYc0tarO48R/ocIQ==", 2024-09-15T23:56:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:56:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:56:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-15T23:56:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmg6AqLBAAZ3PKcarPcPfvIWSTnE5uLA==", 2024-09-15T23:56:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:56:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:56:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-15T23:56:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBRc+dmnOKMBxAAdaIaYmXKAFGIPTxfYt2apQ==", 2024-09-15T23:56:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-15T23:56:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBUc+dmnowGFhAAa3jXrvZ0An+9IwM9988mvQ==", 2024-09-15T23:56:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-15T23:56:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBXc+dmnj9kJRAAZbpx5TM2ukiLKqi+iZAE5g==", 2024-09-15T23:56:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-15T23:56:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBac+dmAdXtNxAA8g+Nxz1RyVf+P8KOtkw5qw==", 2024-09-15T23:56:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-15T23:56:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBhc+dmyOApAhAA9Cv9nW1b5JvO9cH9emao4A==", 2024-09-15T23:56:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-15T23:56:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBkc+dmFIDwDxAAR/59kfrjiLU4emIqtthfRg==", 2024-09-15T23:56:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-15T23:56:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBnc+dmZVB/IRAAFbvodnxisklCL/yuD+F5ew==", 2024-09-15T23:56:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-15T23:56:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBqc+dmuty6LxAAHWB/GByU/hXOL/+dnRpcVA==", 2024-09-15T23:56:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-15T23:56:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw==", 2024-09-15T23:56:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-15T23:56:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:56:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-15T23:56:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmmP6vORAAqxzX3OjoHnionZo1koIqRQ==", 2024-09-15T23:56:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:56:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:56:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:56:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-15T23:56:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmj2XtNhAAB5620fN0Kr8Cqgd2+1cebg==", 2024-09-15T23:56:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:56:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:56:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:56:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-15T23:56:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBOc+dmt+I7AxAA+eyV3eaThbjRNo0zJT9OQg==", 2024-09-15T23:56:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:56:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:56:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:56:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-15T23:56:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBMc+dmDuzBORAAzpiXmO3QO+1RKRvPGQLViQ==", 2024-09-15T23:56:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:56:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:56:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:56:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-15T23:56:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dm4JK5ERAA3d3OABWXchejCqjJRrhTfQ==", 2024-09-15T23:56:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:56:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-15T23:56:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-15T23:56:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dm5nULDxAAi9UvgPZ7sU/Zz2jLKsu4ng==", 2024-09-15T23:56:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:56:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-15T23:56:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-15T23:56:04.083 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:56:04.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.070+0000 7ff8eae89640 1 -- 172.21.15.112:0/798132424 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff8d00678c0 msgr2=0x7ff8d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.070+0000 7ff8eae89640 1 --2- 172.21.15.112:0/798132424 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff8d00678c0 0x7ff8d0069d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff8e409d8a0 tx=0x7ff8d80079d0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.070+0000 7ff8eae89640 1 -- 172.21.15.112:0/798132424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8e40af470 msgr2=0x7ff8e414d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.070+0000 7ff8eae89640 1 --2- 172.21.15.112:0/798132424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8e40af470 0x7ff8e414d250 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff8d401a5a0 tx=0x7ff8d4019710 comp rx=0 tx=0).stop 2024-09-15T23:56:04.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.070+0000 7ff8eae89640 1 -- 172.21.15.112:0/798132424 shutdown_connections 2024-09-15T23:56:04.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.070+0000 7ff8eae89640 1 --2- 172.21.15.112:0/798132424 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff8d00678c0 0x7ff8d0069d80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.070+0000 7ff8eae89640 1 --2- 172.21.15.112:0/798132424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8e415c2a0 0x7ff8e4153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.070+0000 7ff8eae89640 1 --2- 172.21.15.112:0/798132424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8e415bec0 0x7ff8e4153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.070+0000 7ff8eae89640 1 --2- 172.21.15.112:0/798132424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8e40af470 0x7ff8e414d250 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.070+0000 7ff8eae89640 1 -- 172.21.15.112:0/798132424 >> 172.21.15.112:0/798132424 conn(0x7ff8e40b1f90 msgr2=0x7ff8e4075270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:04.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.070+0000 7ff8eae89640 1 -- 172.21.15.112:0/798132424 shutdown_connections 2024-09-15T23:56:04.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.070+0000 7ff8eae89640 1 -- 172.21.15.112:0/798132424 wait complete. 2024-09-15T23:56:04.087 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:56:04.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f1614884640 1 Processor -- start 2024-09-15T23:56:04.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f1614884640 1 -- start start 2024-09-15T23:56:04.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f1614884640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f16101457a0 0x7f16100d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f1614884640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16100d27a0 con 0x7f16100cf800 2024-09-15T23:56:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f1614884640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16100d2a80 con 0x7f16100b4510 2024-09-15T23:56:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f1614884640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f16100d2d60 con 0x7f16101457a0 2024-09-15T23:56:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f1605d9b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f16100cf800 0x7f16100b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58394/0 (socket says 172.21.15.112:58394) 2024-09-15T23:56:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f1605d9b640 1 -- 172.21.15.112:0/3005062242 learned_addr learned my addr 172.21.15.112:0/3005062242 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160e59c640 1 --2- 172.21.15.112:0/3005062242 >> v2:172.21.15.169:3300/0 conn(0x7f16101457a0 0x7f16100d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 -- 172.21.15.112:0/3005062242 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1885011119 0 0) 0x7f16100d27a0 con 0x7f16100cf800 2024-09-15T23:56:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 -- 172.21.15.112:0/3005062242 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15fc003530 con 0x7f16100cf800 2024-09-15T23:56:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 -- 172.21.15.112:0/3005062242 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3120022007 0 0) 0x7f15fc003530 con 0x7f16100cf800 2024-09-15T23:56:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 -- 172.21.15.112:0/3005062242 >> v2:172.21.15.169:3300/0 conn(0x7f16101457a0 msgr2=0x7f16100d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 --2- 172.21.15.112:0/3005062242 >> v2:172.21.15.169:3300/0 conn(0x7f16101457a0 0x7f16100d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 -- 172.21.15.112:0/3005062242 >> v1:172.21.15.169:6789/0 conn(0x7f16100b4510 legacy=0x7f16100d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 -- 172.21.15.112:0/3005062242 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16100d01f0 con 0x7f16100cf800 2024-09-15T23:56:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 -- 172.21.15.112:0/3005062242 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f15f8001680 con 0x7f16100cf800 2024-09-15T23:56:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 -- 172.21.15.112:0/3005062242 >> v1:172.21.15.112:6789/0 conn(0x7f16100cf800 legacy=0x7f16100b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 --2- 172.21.15.112:0/3005062242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15fc0039c0 0x7f15fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 --2- 172.21.15.112:0/3005062242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15fc004810 0x7f15fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 --2- 172.21.15.112:0/3005062242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15fc0051d0 0x7f15fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 -- 172.21.15.112:0/3005062242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f16100d2d60 con 0x7f15fc0039c0 2024-09-15T23:56:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 -- 172.21.15.112:0/3005062242 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc00c170 con 0x7f15fc004810 2024-09-15T23:56:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160dd9b640 1 -- 172.21.15.112:0/3005062242 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f15fc00c370 con 0x7f15fc0051d0 2024-09-15T23:56:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160e59c640 1 --2- 172.21.15.112:0/3005062242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15fc0039c0 0x7f15fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f1605d9b640 1 --2- 172.21.15.112:0/3005062242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15fc004810 0x7f15fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160ed9d640 1 --2- 172.21.15.112:0/3005062242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15fc0051d0 0x7f15fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160e59c640 1 -- 172.21.15.112:0/3005062242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15fc0051d0 msgr2=0x7f15fc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160e59c640 1 --2- 172.21.15.112:0/3005062242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15fc0051d0 0x7f15fc00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160e59c640 1 -- 172.21.15.112:0/3005062242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15fc004810 msgr2=0x7f15fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160e59c640 1 --2- 172.21.15.112:0/3005062242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15fc004810 0x7f15fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160e59c640 1 -- 172.21.15.112:0/3005062242 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15fc003530 con 0x7f15fc0039c0 2024-09-15T23:56:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.202+0000 7f160ed9d640 1 -- 172.21.15.112:0/3005062242 reap_dead start 2024-09-15T23:56:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f160e59c640 1 --2- 172.21.15.112:0/3005062242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15fc0039c0 0x7f15fc003de0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1600009ac0 tx=0x7f160001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212704c38cb81051 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f160dd9b640 1 -- 172.21.15.112:0/3005062242 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16000b2070 con 0x7f15fc0039c0 2024-09-15T23:56:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f160dd9b640 1 -- 172.21.15.112:0/3005062242 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16000a5550 con 0x7f15fc0039c0 2024-09-15T23:56:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f160dd9b640 1 -- 172.21.15.112:0/3005062242 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600009690 con 0x7f15fc0039c0 2024-09-15T23:56:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 -- 172.21.15.112:0/3005062242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15fc0039c0 msgr2=0x7f15fc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 --2- 172.21.15.112:0/3005062242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15fc0039c0 0x7f15fc003de0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1600009ac0 tx=0x7f160001ca70 comp rx=0 tx=0).stop 2024-09-15T23:56:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 -- 172.21.15.112:0/3005062242 shutdown_connections 2024-09-15T23:56:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 --2- 172.21.15.112:0/3005062242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15fc0039c0 0x7f15fc003de0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 -- 172.21.15.112:0/3005062242 >> 172.21.15.112:0/3005062242 conn(0x7f161006bcc0 msgr2=0x7f161006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 -- 172.21.15.112:0/3005062242 shutdown_connections 2024-09-15T23:56:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 -- 172.21.15.112:0/3005062242 wait complete. 2024-09-15T23:56:04.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 Processor -- start 2024-09-15T23:56:04.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 -- start start 2024-09-15T23:56:04.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15fc0039c0 0x7f16100b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16100b54a0 0x7f16100b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1610136200 0x7f1610136680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1610160130 con 0x7f15fc0039c0 2024-09-15T23:56:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f16100b8260 con 0x7f16100b54a0 2024-09-15T23:56:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1614884640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f16101602b0 con 0x7f1610136200 2024-09-15T23:56:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f160e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15fc0039c0 0x7f16100b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f160e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15fc0039c0 0x7f16100b30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52394/0 (socket says 172.21.15.112:52394) 2024-09-15T23:56:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f160e59c640 1 -- 172.21.15.112:0/581711171 learned_addr learned my addr 172.21.15.112:0/581711171 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f160ed9d640 1 --2- 172.21.15.112:0/581711171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1610136200 0x7f1610136680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f1605d9b640 1 --2- 172.21.15.112:0/581711171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16100b54a0 0x7f16100b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f160e59c640 1 -- 172.21.15.112:0/581711171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1610136200 msgr2=0x7f1610136680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f160e59c640 1 --2- 172.21.15.112:0/581711171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1610136200 0x7f1610136680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f160e59c640 1 -- 172.21.15.112:0/581711171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16100b54a0 msgr2=0x7f16100b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f160e59c640 1 --2- 172.21.15.112:0/581711171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16100b54a0 0x7f16100b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f160e59c640 1 -- 172.21.15.112:0/581711171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1610136e10 con 0x7f15fc0039c0 2024-09-15T23:56:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.206+0000 7f160e59c640 1 --2- 172.21.15.112:0/581711171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15fc0039c0 0x7f16100b30c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1600009ac0 tx=0x7f1600019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.210+0000 7f16077fe640 1 -- 172.21.15.112:0/581711171 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16000b2040 con 0x7f15fc0039c0 2024-09-15T23:56:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.210+0000 7f16077fe640 1 -- 172.21.15.112:0/581711171 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16000b8440 con 0x7f15fc0039c0 2024-09-15T23:56:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.210+0000 7f1614884640 1 -- 172.21.15.112:0/581711171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16101370f0 con 0x7f15fc0039c0 2024-09-15T23:56:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.210+0000 7f16077fe640 1 -- 172.21.15.112:0/581711171 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16000b8810 con 0x7f15fc0039c0 2024-09-15T23:56:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.210+0000 7f1614884640 1 -- 172.21.15.112:0/581711171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1610138e80 con 0x7f15fc0039c0 2024-09-15T23:56:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.210+0000 7f1614884640 1 -- 172.21.15.112:0/581711171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16100d27a0 con 0x7f15fc0039c0 2024-09-15T23:56:04.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.210+0000 7f16077fe640 1 -- 172.21.15.112:0/581711171 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16000bf060 con 0x7f15fc0039c0 2024-09-15T23:56:04.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.210+0000 7f16077fe640 1 --2- 172.21.15.112:0/581711171 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15f00678f0 0x7f15f0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.210+0000 7f16077fe640 1 -- 172.21.15.112:0/581711171 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5249+0+0 (secure 0 0 0) 0x7f160011f0a0 con 0x7f15fc0039c0 2024-09-15T23:56:04.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.210+0000 7f1605d9b640 1 --2- 172.21.15.112:0/581711171 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15f00678f0 0x7f15f0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.210+0000 7f1605d9b640 1 --2- 172.21.15.112:0/581711171 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15f00678f0 0x7f15f0069db0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f161006e460 tx=0x7f15f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:04.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.214+0000 7f16077fe640 1 -- 172.21.15.112:0/581711171 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1600016780 con 0x7f15fc0039c0 2024-09-15T23:56:04.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.378+0000 7f1614884640 1 -- 172.21.15.112:0/581711171 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f16100d1ba0 con 0x7f15fc0039c0 2024-09-15T23:56:04.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.378+0000 7f16077fe640 1 -- 172.21.15.112:0/581711171 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) ==== 84+0+65 (secure 0 0 0) 0x7f16000efe30 con 0x7f15fc0039c0 2024-09-15T23:56:04.380 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:04.380 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-15T23:56:04.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:04.381 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-15T23:56:04.381 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-15T23:56:04.381 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:04.381 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-15T23:56:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.382+0000 7f1614884640 1 -- 172.21.15.112:0/581711171 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15f00678f0 msgr2=0x7f15f0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.382+0000 7f1614884640 1 --2- 172.21.15.112:0/581711171 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15f00678f0 0x7f15f0069db0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f161006e460 tx=0x7f15f8009040 comp rx=0 tx=0).stop 2024-09-15T23:56:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.382+0000 7f1614884640 1 -- 172.21.15.112:0/581711171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15fc0039c0 msgr2=0x7f16100b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.382+0000 7f1614884640 1 --2- 172.21.15.112:0/581711171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15fc0039c0 0x7f16100b30c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1600009ac0 tx=0x7f1600019810 comp rx=0 tx=0).stop 2024-09-15T23:56:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.382+0000 7f1614884640 1 -- 172.21.15.112:0/581711171 shutdown_connections 2024-09-15T23:56:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.382+0000 7f1614884640 1 --2- 172.21.15.112:0/581711171 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15f00678f0 0x7f15f0069db0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.382+0000 7f1614884640 1 --2- 172.21.15.112:0/581711171 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1610136200 0x7f1610136680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.382+0000 7f1614884640 1 --2- 172.21.15.112:0/581711171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16100b54a0 0x7f16100b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.382+0000 7f1614884640 1 --2- 172.21.15.112:0/581711171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15fc0039c0 0x7f16100b30c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.382+0000 7f1614884640 1 -- 172.21.15.112:0/581711171 >> 172.21.15.112:0/581711171 conn(0x7f161006bcc0 msgr2=0x7f161006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.382+0000 7f1614884640 1 -- 172.21.15.112:0/581711171 shutdown_connections 2024-09-15T23:56:04.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.382+0000 7f1614884640 1 -- 172.21.15.112:0/581711171 wait complete. 2024-09-15T23:56:04.399 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:56:04.399 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:56:04.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f432ac0e640 1 Processor -- start 2024-09-15T23:56:04.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f432ac0e640 1 -- start start 2024-09-15T23:56:04.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f432ac0e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f432415c2a0 0x7f43240aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f432ac0e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f43240af2a0 0x7f432406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f432ac0e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43240b3290 con 0x7f432415bec0 2024-09-15T23:56:04.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f432ac0e640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f43240b3570 con 0x7f43240af2a0 2024-09-15T23:56:04.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f432ac0e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f43240b3850 con 0x7f432415c2a0 2024-09-15T23:56:04.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f43291ab640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f43240af2a0 0x7f432406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f43291ab640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f43240af2a0 0x7f432406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52396/0 (socket says 172.21.15.112:52396) 2024-09-15T23:56:04.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f43291ab640 1 -- 172.21.15.112:0/161076811 learned_addr learned my addr 172.21.15.112:0/161076811 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:04.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f4323fff640 1 --2- 172.21.15.112:0/161076811 >> v2:172.21.15.169:3300/0 conn(0x7f432415c2a0 0x7f43240aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f43291ab640 1 -- 172.21.15.112:0/161076811 >> v2:172.21.15.169:3300/0 conn(0x7f432415c2a0 msgr2=0x7f43240aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:04.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f43291ab640 1 --2- 172.21.15.112:0/161076811 >> v2:172.21.15.169:3300/0 conn(0x7f432415c2a0 0x7f43240aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f43291ab640 1 -- 172.21.15.112:0/161076811 >> v1:172.21.15.169:6789/0 conn(0x7f432415bec0 legacy=0x7f43240ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:04.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.514+0000 7f43291ab640 1 -- 172.21.15.112:0/161076811 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43240b3b30 con 0x7f43240af2a0 2024-09-15T23:56:04.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f43291ab640 1 --2- 172.21.15.112:0/161076811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43240af2a0 0x7f432406e000 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f43240ae510 tx=0x7f431c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c243bd7ed3dff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:04.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f43237fe640 1 -- 172.21.15.112:0/161076811 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c0a5840 con 0x7f43240af2a0 2024-09-15T23:56:04.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f43237fe640 1 -- 172.21.15.112:0/161076811 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f431c0a59e0 con 0x7f43240af2a0 2024-09-15T23:56:04.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f43237fe640 1 -- 172.21.15.112:0/161076811 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c0a5db0 con 0x7f43240af2a0 2024-09-15T23:56:04.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f432ac0e640 1 -- 172.21.15.112:0/161076811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43240af2a0 msgr2=0x7f432406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f432ac0e640 1 --2- 172.21.15.112:0/161076811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43240af2a0 0x7f432406e000 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f43240ae510 tx=0x7f431c01c980 comp rx=0 tx=0).stop 2024-09-15T23:56:04.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f432ac0e640 1 -- 172.21.15.112:0/161076811 shutdown_connections 2024-09-15T23:56:04.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f432ac0e640 1 --2- 172.21.15.112:0/161076811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43240af2a0 0x7f432406e000 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f432ac0e640 1 --2- 172.21.15.112:0/161076811 >> v2:172.21.15.169:3300/0 conn(0x7f432415c2a0 0x7f43240aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f432ac0e640 1 -- 172.21.15.112:0/161076811 >> 172.21.15.112:0/161076811 conn(0x7f43240b1f90 msgr2=0x7f43240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:04.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f432ac0e640 1 -- 172.21.15.112:0/161076811 shutdown_connections 2024-09-15T23:56:04.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f432ac0e640 1 -- 172.21.15.112:0/161076811 wait complete. 2024-09-15T23:56:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f432ac0e640 1 Processor -- start 2024-09-15T23:56:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f432ac0e640 1 -- start start 2024-09-15T23:56:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f432ac0e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43240af2a0 0x7f432415d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f432ac0e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f432415bec0 0x7f4324155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f432ac0e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f432415c2a0 0x7f432414a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.518+0000 7f432ac0e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f432406ed50 con 0x7f43240af2a0 2024-09-15T23:56:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f432ac0e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43240af710 con 0x7f432415c2a0 2024-09-15T23:56:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f432ac0e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f432406eed0 con 0x7f432415bec0 2024-09-15T23:56:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43289aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43240af2a0 0x7f432415d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43289aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43240af2a0 0x7f432415d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52402/0 (socket says 172.21.15.112:52402) 2024-09-15T23:56:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43289aa640 1 -- 172.21.15.112:0/1971815526 learned_addr learned my addr 172.21.15.112:0/1971815526 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43291ab640 1 --2- 172.21.15.112:0/1971815526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f432415c2a0 0x7f432414a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43289aa640 1 -- 172.21.15.112:0/1971815526 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f432415bec0 msgr2=0x7f4324155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43289aa640 1 --2- 172.21.15.112:0/1971815526 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f432415bec0 0x7f4324155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43289aa640 1 -- 172.21.15.112:0/1971815526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f432415c2a0 msgr2=0x7f432414a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43289aa640 1 --2- 172.21.15.112:0/1971815526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f432415c2a0 0x7f432414a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43289aa640 1 -- 172.21.15.112:0/1971815526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4324156790 con 0x7f43240af2a0 2024-09-15T23:56:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43289aa640 1 --2- 172.21.15.112:0/1971815526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43240af2a0 0x7f432415d280 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f431800c450 tx=0x7f431800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43217fa640 1 -- 172.21.15.112:0/1971815526 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318012830 con 0x7f43240af2a0 2024-09-15T23:56:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43217fa640 1 -- 172.21.15.112:0/1971815526 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4318017070 con 0x7f43240af2a0 2024-09-15T23:56:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43217fa640 1 -- 172.21.15.112:0/1971815526 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318012c30 con 0x7f43240af2a0 2024-09-15T23:56:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f432ac0e640 1 -- 172.21.15.112:0/1971815526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4324156a70 con 0x7f43240af2a0 2024-09-15T23:56:04.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f432ac0e640 1 -- 172.21.15.112:0/1971815526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4324157030 con 0x7f43240af2a0 2024-09-15T23:56:04.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f432ac0e640 1 -- 172.21.15.112:0/1971815526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f432406f260 con 0x7f43240af2a0 2024-09-15T23:56:04.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43217fa640 1 -- 172.21.15.112:0/1971815526 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f431801c460 con 0x7f43240af2a0 2024-09-15T23:56:04.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43217fa640 1 --2- 172.21.15.112:0/1971815526 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f43100678c0 0x7f4310069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f4323fff640 1 --2- 172.21.15.112:0/1971815526 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f43100678c0 0x7f4310069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f43217fa640 1 -- 172.21.15.112:0/1971815526 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5249+0+0 (secure 0 0 0) 0x7f4318085900 con 0x7f43240af2a0 2024-09-15T23:56:04.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.522+0000 7f4323fff640 1 --2- 172.21.15.112:0/1971815526 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f43100678c0 0x7f4310069d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f432406d2a0 tx=0x7f4314008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.526+0000 7f43217fa640 1 -- 172.21.15.112:0/1971815526 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4318056600 con 0x7f43240af2a0 2024-09-15T23:56:04.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.674+0000 7f432ac0e640 1 -- 172.21.15.112:0/1971815526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f432406fcd0 con 0x7f43240af2a0 2024-09-15T23:56:04.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.770+0000 7f43217fa640 1 -- 172.21.15.112:0/1971815526 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) ==== 138+0+0 (secure 0 0 0) 0x7f4318055f00 con 0x7f43240af2a0 2024-09-15T23:56:04.771 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-15T23:56:04.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.770+0000 7f432ac0e640 1 -- 172.21.15.112:0/1971815526 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f43100678c0 msgr2=0x7f4310069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.770+0000 7f432ac0e640 1 --2- 172.21.15.112:0/1971815526 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f43100678c0 0x7f4310069d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f432406d2a0 tx=0x7f4314008040 comp rx=0 tx=0).stop 2024-09-15T23:56:04.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.770+0000 7f432ac0e640 1 -- 172.21.15.112:0/1971815526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43240af2a0 msgr2=0x7f432415d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.770+0000 7f432ac0e640 1 --2- 172.21.15.112:0/1971815526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43240af2a0 0x7f432415d280 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f431800c450 tx=0x7f431800c910 comp rx=0 tx=0).stop 2024-09-15T23:56:04.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.770+0000 7f432ac0e640 1 -- 172.21.15.112:0/1971815526 shutdown_connections 2024-09-15T23:56:04.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.770+0000 7f432ac0e640 1 --2- 172.21.15.112:0/1971815526 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f43100678c0 0x7f4310069d80 secure :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f432406d2a0 tx=0x7f4314008040 comp rx=0 tx=0).stop 2024-09-15T23:56:04.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.770+0000 7f432ac0e640 1 --2- 172.21.15.112:0/1971815526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f432415c2a0 0x7f432414a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.770+0000 7f432ac0e640 1 --2- 172.21.15.112:0/1971815526 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f432415bec0 0x7f4324155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.770+0000 7f432ac0e640 1 --2- 172.21.15.112:0/1971815526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f43240af2a0 0x7f432415d280 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.770+0000 7f432ac0e640 1 -- 172.21.15.112:0/1971815526 >> 172.21.15.112:0/1971815526 conn(0x7f43240b1f90 msgr2=0x7f43240b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:04.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.770+0000 7f432ac0e640 1 -- 172.21.15.112:0/1971815526 shutdown_connections 2024-09-15T23:56:04.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.770+0000 7f432ac0e640 1 -- 172.21.15.112:0/1971815526 wait complete. 2024-09-15T23:56:04.795 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:56:04.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.918+0000 7fa69167d640 1 Processor -- start 2024-09-15T23:56:04.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.918+0000 7fa69167d640 1 -- start start 2024-09-15T23:56:04.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.918+0000 7fa69167d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa68c15e640 0x7fa68c0ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.918+0000 7fa69167d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa68c0cf3c0 con 0x7fa68c0b4ab0 2024-09-15T23:56:04.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.918+0000 7fa69167d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa68c0cf6a0 con 0x7fa68c0cef20 2024-09-15T23:56:04.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.918+0000 7fa69167d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa68c15ea20 con 0x7fa68c15e640 2024-09-15T23:56:04.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.918+0000 7fa68b7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa68c0b4ab0 0x7fa68c072230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58404/0 (socket says 172.21.15.112:58404) 2024-09-15T23:56:04.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.918+0000 7fa68b7fe640 1 -- 172.21.15.112:0/2397104075 learned_addr learned my addr 172.21.15.112:0/2397104075 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:04.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.918+0000 7fa68affd640 1 --2- 172.21.15.112:0/2397104075 >> v2:172.21.15.112:3300/0 conn(0x7fa68c15e640 0x7fa68c0ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.918+0000 7fa68affd640 1 -- 172.21.15.112:0/2397104075 >> v1:172.21.15.169:6789/0 conn(0x7fa68c0cef20 legacy=0x7fa68c0b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:04.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.918+0000 7fa68affd640 1 -- 172.21.15.112:0/2397104075 >> v1:172.21.15.112:6789/0 conn(0x7fa68c0b4ab0 legacy=0x7fa68c072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.918+0000 7fa68affd640 1 -- 172.21.15.112:0/2397104075 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c0cf980 con 0x7fa68c15e640 2024-09-15T23:56:04.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.922+0000 7fa68affd640 1 --2- 172.21.15.112:0/2397104075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa68c15e640 0x7fa68c0ce9e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0097c0 tx=0x7fa67c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4df49370b08ee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:04.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.922+0000 7fa689ffb640 1 -- 172.21.15.112:0/2397104075 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0b0070 con 0x7fa68c15e640 2024-09-15T23:56:04.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.922+0000 7fa689ffb640 1 -- 172.21.15.112:0/2397104075 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67c0ab600 con 0x7fa68c15e640 2024-09-15T23:56:04.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.922+0000 7fa689ffb640 1 -- 172.21.15.112:0/2397104075 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0ab9d0 con 0x7fa68c15e640 2024-09-15T23:56:04.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.922+0000 7fa69167d640 1 -- 172.21.15.112:0/2397104075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa68c15e640 msgr2=0x7fa68c0ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.922+0000 7fa69167d640 1 --2- 172.21.15.112:0/2397104075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa68c15e640 0x7fa68c0ce9e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0097c0 tx=0x7fa67c01c460 comp rx=0 tx=0).stop 2024-09-15T23:56:04.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.922+0000 7fa69167d640 1 -- 172.21.15.112:0/2397104075 shutdown_connections 2024-09-15T23:56:04.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.922+0000 7fa69167d640 1 --2- 172.21.15.112:0/2397104075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa68c15e640 0x7fa68c0ce9e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.922+0000 7fa69167d640 1 -- 172.21.15.112:0/2397104075 >> 172.21.15.112:0/2397104075 conn(0x7fa68c0b1c80 msgr2=0x7fa68c0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:04.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.922+0000 7fa69167d640 1 -- 172.21.15.112:0/2397104075 shutdown_connections 2024-09-15T23:56:04.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.922+0000 7fa69167d640 1 -- 172.21.15.112:0/2397104075 wait complete. 2024-09-15T23:56:04.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa69167d640 1 Processor -- start 2024-09-15T23:56:04.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa69167d640 1 -- start start 2024-09-15T23:56:04.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa69167d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa68c0b4ab0 0x7fa68c155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa69167d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa68c0cef20 0x7fa68c160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa69167d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa68c15e640 0x7fa68c15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa69167d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c0733e0 con 0x7fa68c15e640 2024-09-15T23:56:04.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa69167d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c06f170 con 0x7fa68c0cef20 2024-09-15T23:56:04.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa69167d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa68c073560 con 0x7fa68c0b4ab0 2024-09-15T23:56:04.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa68b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa68c15e640 0x7fa68c15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa68b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa68c15e640 0x7fa68c15a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52420/0 (socket says 172.21.15.112:52420) 2024-09-15T23:56:04.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa68b7fe640 1 -- 172.21.15.112:0/841320019 learned_addr learned my addr 172.21.15.112:0/841320019 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:04.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa68affd640 1 --2- 172.21.15.112:0/841320019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa68c0b4ab0 0x7fa68c155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa68a7fc640 1 --2- 172.21.15.112:0/841320019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa68c0cef20 0x7fa68c160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa68b7fe640 1 -- 172.21.15.112:0/841320019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa68c0b4ab0 msgr2=0x7fa68c155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa68b7fe640 1 --2- 172.21.15.112:0/841320019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa68c0b4ab0 0x7fa68c155760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa68b7fe640 1 -- 172.21.15.112:0/841320019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa68c0cef20 msgr2=0x7fa68c160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:04.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa68b7fe640 1 --2- 172.21.15.112:0/841320019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa68c0cef20 0x7fa68c160010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:04.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa68b7fe640 1 -- 172.21.15.112:0/841320019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c160a70 con 0x7fa68c15e640 2024-09-15T23:56:04.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa68b7fe640 1 --2- 172.21.15.112:0/841320019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa68c15e640 0x7fa68c15a2b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa68400cbc0 tx=0x7fa68400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:04.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa6737fe640 1 -- 172.21.15.112:0/841320019 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684017070 con 0x7fa68c15e640 2024-09-15T23:56:04.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa6737fe640 1 -- 172.21.15.112:0/841320019 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa68400ad40 con 0x7fa68c15e640 2024-09-15T23:56:04.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa69167d640 1 -- 172.21.15.112:0/841320019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68c161000 con 0x7fa68c15e640 2024-09-15T23:56:04.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa6737fe640 1 -- 172.21.15.112:0/841320019 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684012600 con 0x7fa68c15e640 2024-09-15T23:56:04.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa69167d640 1 -- 172.21.15.112:0/841320019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa68c15bca0 con 0x7fa68c15e640 2024-09-15T23:56:04.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa69167d640 1 -- 172.21.15.112:0/841320019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa68c0ce9e0 con 0x7fa68c15e640 2024-09-15T23:56:04.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.926+0000 7fa6737fe640 1 -- 172.21.15.112:0/841320019 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa68401a070 con 0x7fa68c15e640 2024-09-15T23:56:04.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.930+0000 7fa6737fe640 1 --2- 172.21.15.112:0/841320019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6780678c0 0x7fa678069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:04.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.930+0000 7fa6737fe640 1 -- 172.21.15.112:0/841320019 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5619+0+0 (secure 0 0 0) 0x7fa6840858a0 con 0x7fa68c15e640 2024-09-15T23:56:04.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.930+0000 7fa68affd640 1 --2- 172.21.15.112:0/841320019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6780678c0 0x7fa678069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:04.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.930+0000 7fa68affd640 1 --2- 172.21.15.112:0/841320019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6780678c0 0x7fa678069d80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0ad000 tx=0x7fa67c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:04.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:04.934+0000 7fa6737fe640 1 -- 172.21.15.112:0/841320019 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa684055de0 con 0x7fa68c15e640 2024-09-15T23:56:05.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.094+0000 7fa69167d640 1 -- 172.21.15.112:0/841320019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa68c161390 con 0x7fa68c15e640 2024-09-15T23:56:05.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.778+0000 7fa6737fe640 1 -- 172.21.15.112:0/841320019 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) ==== 170+0+0 (secure 0 0 0) 0x7fa68405a0e0 con 0x7fa68c15e640 2024-09-15T23:56:05.781 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-15T23:56:05.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.782+0000 7fa69167d640 1 -- 172.21.15.112:0/841320019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6780678c0 msgr2=0x7fa678069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:05.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.782+0000 7fa69167d640 1 --2- 172.21.15.112:0/841320019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6780678c0 0x7fa678069d80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0ad000 tx=0x7fa67c008040 comp rx=0 tx=0).stop 2024-09-15T23:56:05.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.782+0000 7fa69167d640 1 -- 172.21.15.112:0/841320019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa68c15e640 msgr2=0x7fa68c15a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:05.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.782+0000 7fa69167d640 1 --2- 172.21.15.112:0/841320019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa68c15e640 0x7fa68c15a2b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa68400cbc0 tx=0x7fa68400a430 comp rx=0 tx=0).stop 2024-09-15T23:56:05.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.782+0000 7fa69167d640 1 -- 172.21.15.112:0/841320019 shutdown_connections 2024-09-15T23:56:05.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.782+0000 7fa69167d640 1 --2- 172.21.15.112:0/841320019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6780678c0 0x7fa678069d80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:05.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.782+0000 7fa69167d640 1 --2- 172.21.15.112:0/841320019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa68c15e640 0x7fa68c15a2b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:05.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.782+0000 7fa69167d640 1 --2- 172.21.15.112:0/841320019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa68c0cef20 0x7fa68c160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:05.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.782+0000 7fa69167d640 1 --2- 172.21.15.112:0/841320019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa68c0b4ab0 0x7fa68c155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:05.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.782+0000 7fa69167d640 1 -- 172.21.15.112:0/841320019 >> 172.21.15.112:0/841320019 conn(0x7fa68c0b1c80 msgr2=0x7fa68c06f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:05.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.782+0000 7fa69167d640 1 -- 172.21.15.112:0/841320019 shutdown_connections 2024-09-15T23:56:05.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.782+0000 7fa69167d640 1 -- 172.21.15.112:0/841320019 wait complete. 2024-09-15T23:56:05.822 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:56:05.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.938+0000 7f15d24b9640 1 Processor -- start 2024-09-15T23:56:05.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15d24b9640 1 -- start start 2024-09-15T23:56:05.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15d24b9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15cc070020 0x7f15cc15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:05.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15d24b9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f15cc15f1d0 0x7f15cc0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:05.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15d24b9640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15cc0aede0 con 0x7f15cc1520a0 2024-09-15T23:56:05.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15d24b9640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f15cc152480 con 0x7f15cc15f1d0 2024-09-15T23:56:05.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15d24b9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f15cc15fa10 con 0x7f15cc070020 2024-09-15T23:56:05.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15cbfff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f15cc1520a0 0x7f15cc06f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58418/0 (socket says 172.21.15.112:58418) 2024-09-15T23:56:05.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15cbfff640 1 -- 172.21.15.112:0/2634442525 learned_addr learned my addr 172.21.15.112:0/2634442525 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:05.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15d0a56640 1 --2- 172.21.15.112:0/2634442525 >> v2:172.21.15.169:3300/0 conn(0x7f15cc15f1d0 0x7f15cc0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:05.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 -- 172.21.15.112:0/2634442525 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3595433285 0 0) 0x7f15cc0aede0 con 0x7f15cc1520a0 2024-09-15T23:56:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 -- 172.21.15.112:0/2634442525 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15b4003530 con 0x7f15cc1520a0 2024-09-15T23:56:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15cb7fe640 1 --2- 172.21.15.112:0/2634442525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15cc070020 0x7f15cc15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 -- 172.21.15.112:0/2634442525 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4261889660 0 0) 0x7f15b4003530 con 0x7f15cc1520a0 2024-09-15T23:56:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 -- 172.21.15.112:0/2634442525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15cc070020 msgr2=0x7f15cc15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 --2- 172.21.15.112:0/2634442525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15cc070020 0x7f15cc15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 -- 172.21.15.112:0/2634442525 >> v2:172.21.15.169:3300/0 conn(0x7f15cc15f1d0 msgr2=0x7f15cc0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 --2- 172.21.15.112:0/2634442525 >> v2:172.21.15.169:3300/0 conn(0x7f15cc15f1d0 0x7f15cc0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 -- 172.21.15.112:0/2634442525 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc074250 con 0x7f15cc1520a0 2024-09-15T23:56:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 -- 172.21.15.112:0/2634442525 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f15c0001680 con 0x7f15cc1520a0 2024-09-15T23:56:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 -- 172.21.15.112:0/2634442525 >> v1:172.21.15.112:6789/0 conn(0x7f15cc1520a0 legacy=0x7f15cc06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 --2- 172.21.15.112:0/2634442525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b40039c0 0x7f15b4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 --2- 172.21.15.112:0/2634442525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b4004810 0x7f15b4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 --2- 172.21.15.112:0/2634442525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15cc070020 0x7f15b40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 -- 172.21.15.112:0/2634442525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc15fa10 con 0x7f15b4004810 2024-09-15T23:56:05.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 -- 172.21.15.112:0/2634442525 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15b400b9d0 con 0x7f15b40039c0 2024-09-15T23:56:05.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15caffd640 1 -- 172.21.15.112:0/2634442525 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f15b400bb50 con 0x7f15cc070020 2024-09-15T23:56:05.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15cb7fe640 1 --2- 172.21.15.112:0/2634442525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b4004810 0x7f15b4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:05.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15d0a56640 1 --2- 172.21.15.112:0/2634442525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15cc070020 0x7f15b40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:05.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15cbfff640 1 --2- 172.21.15.112:0/2634442525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b40039c0 0x7f15b4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:05.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15cb7fe640 1 -- 172.21.15.112:0/2634442525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15cc070020 msgr2=0x7f15b40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:05.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15cb7fe640 1 --2- 172.21.15.112:0/2634442525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15cc070020 0x7f15b40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:05.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15cb7fe640 1 -- 172.21.15.112:0/2634442525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b40039c0 msgr2=0x7f15b4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:05.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15cb7fe640 1 --2- 172.21.15.112:0/2634442525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b40039c0 0x7f15b4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:05.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15cb7fe640 1 -- 172.21.15.112:0/2634442525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b4003530 con 0x7f15b4004810 2024-09-15T23:56:05.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15d0a56640 1 --2- 172.21.15.112:0/2634442525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15cc070020 0x7f15b40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:05.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.942+0000 7f15cbfff640 1 --2- 172.21.15.112:0/2634442525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b40039c0 0x7f15b4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:05.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15cb7fe640 1 --2- 172.21.15.112:0/2634442525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b4004810 0x7f15b4004c90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009a90 tx=0x7f15bc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad01e46bfa7209df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:05.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15caffd640 1 -- 172.21.15.112:0/2634442525 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0b2070 con 0x7f15b4004810 2024-09-15T23:56:05.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15caffd640 1 -- 172.21.15.112:0/2634442525 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15bc0a5540 con 0x7f15b4004810 2024-09-15T23:56:05.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15caffd640 1 -- 172.21.15.112:0/2634442525 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc009690 con 0x7f15b4004810 2024-09-15T23:56:05.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d24b9640 1 -- 172.21.15.112:0/2634442525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b4004810 msgr2=0x7f15b4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:05.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d24b9640 1 --2- 172.21.15.112:0/2634442525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15b4004810 0x7f15b4004c90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009a90 tx=0x7f15bc01ca30 comp rx=0 tx=0).stop 2024-09-15T23:56:05.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d0a56640 1 -- 172.21.15.112:0/2634442525 reap_dead start 2024-09-15T23:56:05.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d24b9640 1 -- 172.21.15.112:0/2634442525 shutdown_connections 2024-09-15T23:56:05.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d24b9640 1 -- 172.21.15.112:0/2634442525 >> 172.21.15.112:0/2634442525 conn(0x7f15cc0b1f90 msgr2=0x7f15cc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:05.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d24b9640 1 -- 172.21.15.112:0/2634442525 shutdown_connections 2024-09-15T23:56:05.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d24b9640 1 -- 172.21.15.112:0/2634442525 wait complete. 2024-09-15T23:56:05.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d24b9640 1 Processor -- start 2024-09-15T23:56:05.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d24b9640 1 -- start start 2024-09-15T23:56:05.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d24b9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b4004810 0x7f15cc155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:05.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d24b9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15cc14a660 0x7f15cc06f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:05.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d24b9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15cc0ced50 0x7f15cc0cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:05.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d24b9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc073a50 con 0x7f15cc14a660 2024-09-15T23:56:05.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d24b9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc073770 con 0x7f15b4004810 2024-09-15T23:56:05.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d24b9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f15cc073d30 con 0x7f15cc0ced50 2024-09-15T23:56:05.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15cb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15cc14a660 0x7f15cc06f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:05.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15cb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15cc14a660 0x7f15cc06f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52440/0 (socket says 172.21.15.112:52440) 2024-09-15T23:56:05.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15cb7fe640 1 -- 172.21.15.112:0/1851301210 learned_addr learned my addr 172.21.15.112:0/1851301210 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:05.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15cbfff640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b4004810 0x7f15cc155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:05.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15d0a56640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15cc0ced50 0x7f15cc0cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:05.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15cb7fe640 1 -- 172.21.15.112:0/1851301210 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15cc0ced50 msgr2=0x7f15cc0cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:05.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15cb7fe640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15cc0ced50 0x7f15cc0cf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:05.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15cb7fe640 1 -- 172.21.15.112:0/1851301210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b4004810 msgr2=0x7f15cc155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:05.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.946+0000 7f15cb7fe640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b4004810 0x7f15cc155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:05.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.950+0000 7f15cb7fe640 1 -- 172.21.15.112:0/1851301210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc151840 con 0x7f15cc14a660 2024-09-15T23:56:05.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.950+0000 7f15cbfff640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b4004810 0x7f15cc155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:05.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.950+0000 7f15cb7fe640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15cc14a660 0x7f15cc06f130 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f15bc01cf10 tx=0x7f15b4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:05.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.950+0000 7f15c8ff9640 1 -- 172.21.15.112:0/1851301210 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0b2040 con 0x7f15cc14a660 2024-09-15T23:56:05.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.950+0000 7f15c8ff9640 1 -- 172.21.15.112:0/1851301210 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15bc0a5d70 con 0x7f15cc14a660 2024-09-15T23:56:05.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.950+0000 7f15d24b9640 1 -- 172.21.15.112:0/1851301210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15cc151b20 con 0x7f15cc14a660 2024-09-15T23:56:05.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.950+0000 7f15c8ff9640 1 -- 172.21.15.112:0/1851301210 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0001d50 con 0x7f15cc14a660 2024-09-15T23:56:05.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.950+0000 7f15d24b9640 1 -- 172.21.15.112:0/1851301210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15cc06ec10 con 0x7f15cc14a660 2024-09-15T23:56:05.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.950+0000 7f15d24b9640 1 -- 172.21.15.112:0/1851301210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15cc06f670 con 0x7f15cc14a660 2024-09-15T23:56:05.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.950+0000 7f15c8ff9640 1 -- 172.21.15.112:0/1851301210 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f15bc0b5070 con 0x7f15cc14a660 2024-09-15T23:56:05.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.950+0000 7f15c8ff9640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15b80678c0 0x7f15b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:05.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.950+0000 7f15c8ff9640 1 -- 172.21.15.112:0/1851301210 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6001+0+0 (secure 0 0 0) 0x7f15bc120110 con 0x7f15cc14a660 2024-09-15T23:56:05.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.950+0000 7f15cbfff640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15b80678c0 0x7f15b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:05.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.950+0000 7f15cbfff640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15b80678c0 0x7f15b8069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f15c0001210 tx=0x7f15c0001140 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:05.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:05.954+0000 7f15c8ff9640 1 -- 172.21.15.112:0/1851301210 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f15bc0bc020 con 0x7f15cc14a660 2024-09-15T23:56:06.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.150+0000 7f15d24b9640 1 -- 172.21.15.112:0/1851301210 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f15cc068e50 con 0x7f15cc14a660 2024-09-15T23:56:06.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.786+0000 7f15c8ff9640 1 -- 172.21.15.112:0/1851301210 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v27) ==== 173+0+0 (secure 0 0 0) 0x7f15bc016740 con 0x7f15cc14a660 2024-09-15T23:56:06.786 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 9 and data pool 10 2024-09-15T23:56:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.786+0000 7f15d24b9640 1 -- 172.21.15.112:0/1851301210 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15b80678c0 msgr2=0x7f15b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.786+0000 7f15d24b9640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15b80678c0 0x7f15b8069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f15c0001210 tx=0x7f15c0001140 comp rx=0 tx=0).stop 2024-09-15T23:56:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.786+0000 7f15d24b9640 1 -- 172.21.15.112:0/1851301210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15cc14a660 msgr2=0x7f15cc06f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.786+0000 7f15d24b9640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15cc14a660 0x7f15cc06f130 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f15bc01cf10 tx=0x7f15b4005840 comp rx=0 tx=0).stop 2024-09-15T23:56:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.790+0000 7f15d24b9640 1 -- 172.21.15.112:0/1851301210 shutdown_connections 2024-09-15T23:56:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.790+0000 7f15d24b9640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f15b80678c0 0x7f15b8069d80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.790+0000 7f15d24b9640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15cc0ced50 0x7f15cc0cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.790+0000 7f15d24b9640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15cc14a660 0x7f15cc06f130 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.790+0000 7f15d24b9640 1 --2- 172.21.15.112:0/1851301210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b4004810 0x7f15cc155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.790+0000 7f15d24b9640 1 -- 172.21.15.112:0/1851301210 >> 172.21.15.112:0/1851301210 conn(0x7f15cc0b1f90 msgr2=0x7f15cc0af000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:06.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.790+0000 7f15d24b9640 1 -- 172.21.15.112:0/1851301210 shutdown_connections 2024-09-15T23:56:06.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.790+0000 7f15d24b9640 1 -- 172.21.15.112:0/1851301210 wait complete. 2024-09-15T23:56:06.813 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.922+0000 7fe6abaad640 1 Processor -- start 2024-09-15T23:56:06.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6abaad640 1 -- start start 2024-09-15T23:56:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6abaad640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe6a41520a0 0x7fe6a406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6abaad640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a406fe50 0x7fe6a415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6abaad640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6a415f1d0 0x7fe6a4071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6abaad640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe6a4152480 con 0x7fe6a415f1d0 2024-09-15T23:56:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6abaad640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe6a4070250 con 0x7fe6a41520a0 2024-09-15T23:56:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6abaad640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a40aede0 con 0x7fe6a406fe50 2024-09-15T23:56:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6aa04a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6a415f1d0 0x7fe6a4071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6aa04a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6a415f1d0 0x7fe6a4071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52454/0 (socket says 172.21.15.112:52454) 2024-09-15T23:56:06.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6aa04a640 1 -- 172.21.15.112:0/1793450757 learned_addr learned my addr 172.21.15.112:0/1793450757 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6a9048640 1 --2- 172.21.15.112:0/1793450757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a406fe50 0x7fe6a415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6aa04a640 1 -- 172.21.15.112:0/1793450757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a406fe50 msgr2=0x7fe6a415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6a9849640 1 --2- 172.21.15.112:0/1793450757 >> v2:172.21.15.169:3300/0 conn(0x7fe6a41520a0 0x7fe6a406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6aa04a640 1 --2- 172.21.15.112:0/1793450757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a406fe50 0x7fe6a415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:06.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6aa04a640 1 -- 172.21.15.112:0/1793450757 >> v2:172.21.15.169:3300/0 conn(0x7fe6a41520a0 msgr2=0x7fe6a406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:06.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6aa04a640 1 --2- 172.21.15.112:0/1793450757 >> v2:172.21.15.169:3300/0 conn(0x7fe6a41520a0 0x7fe6a406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:06.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6aa04a640 1 -- 172.21.15.112:0/1793450757 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a415fa10 con 0x7fe6a415f1d0 2024-09-15T23:56:06.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6a9849640 1 --2- 172.21.15.112:0/1793450757 >> v2:172.21.15.169:3300/0 conn(0x7fe6a41520a0 0x7fe6a406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:06.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6aa04a640 1 --2- 172.21.15.112:0/1793450757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a415f1d0 0x7fe6a4071f10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4071710 tx=0x7fe6a001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26766845b5ce886 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.926+0000 7fe6a8847640 1 -- 172.21.15.112:0/1793450757 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00b0070 con 0x7fe6a415f1d0 2024-09-15T23:56:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6a8847640 1 -- 172.21.15.112:0/1793450757 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a00ab600 con 0x7fe6a415f1d0 2024-09-15T23:56:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6a8847640 1 -- 172.21.15.112:0/1793450757 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00ab9d0 con 0x7fe6a415f1d0 2024-09-15T23:56:06.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 -- 172.21.15.112:0/1793450757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a415f1d0 msgr2=0x7fe6a4071f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 --2- 172.21.15.112:0/1793450757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a415f1d0 0x7fe6a4071f10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4071710 tx=0x7fe6a001c240 comp rx=0 tx=0).stop 2024-09-15T23:56:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 -- 172.21.15.112:0/1793450757 shutdown_connections 2024-09-15T23:56:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 --2- 172.21.15.112:0/1793450757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a415f1d0 0x7fe6a4071f10 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 --2- 172.21.15.112:0/1793450757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a406fe50 0x7fe6a415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 --2- 172.21.15.112:0/1793450757 >> v2:172.21.15.169:3300/0 conn(0x7fe6a41520a0 0x7fe6a406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 -- 172.21.15.112:0/1793450757 >> 172.21.15.112:0/1793450757 conn(0x7fe6a40b1f90 msgr2=0x7fe6a40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 -- 172.21.15.112:0/1793450757 shutdown_connections 2024-09-15T23:56:06.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 -- 172.21.15.112:0/1793450757 wait complete. 2024-09-15T23:56:06.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 Processor -- start 2024-09-15T23:56:06.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 -- start start 2024-09-15T23:56:06.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a406fe50 0x7fe6a4148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a41520a0 0x7fe6a4149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a415f1d0 0x7fe6a415d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4073d30 con 0x7fe6a406fe50 2024-09-15T23:56:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4073a50 con 0x7fe6a41520a0 2024-09-15T23:56:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a415f680 con 0x7fe6a415f1d0 2024-09-15T23:56:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6a9849640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a406fe50 0x7fe6a4148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6a9849640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a406fe50 0x7fe6a4148940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52470/0 (socket says 172.21.15.112:52470) 2024-09-15T23:56:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6a9849640 1 -- 172.21.15.112:0/1085417131 learned_addr learned my addr 172.21.15.112:0/1085417131 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6a9048640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a41520a0 0x7fe6a4149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6aa04a640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a415f1d0 0x7fe6a415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6a9849640 1 -- 172.21.15.112:0/1085417131 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a415f1d0 msgr2=0x7fe6a415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6a9849640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a415f1d0 0x7fe6a415d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:06.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6a9849640 1 -- 172.21.15.112:0/1085417131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a41520a0 msgr2=0x7fe6a4149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:06.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6a9849640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a41520a0 0x7fe6a4149c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:06.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6a9849640 1 -- 172.21.15.112:0/1085417131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a40cddf0 con 0x7fe6a406fe50 2024-09-15T23:56:06.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6a9048640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a41520a0 0x7fe6a4149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:56:06.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6a9849640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a406fe50 0x7fe6a4148940 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c7f0 tx=0x7fe69400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:06.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe69a7fc640 1 -- 172.21.15.112:0/1085417131 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe694007a30 con 0x7fe6a406fe50 2024-09-15T23:56:06.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe69a7fc640 1 -- 172.21.15.112:0/1085417131 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe694007bd0 con 0x7fe6a406fe50 2024-09-15T23:56:06.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 -- 172.21.15.112:0/1085417131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a40ce0d0 con 0x7fe6a406fe50 2024-09-15T23:56:06.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe69a7fc640 1 -- 172.21.15.112:0/1085417131 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6940113f0 con 0x7fe6a406fe50 2024-09-15T23:56:06.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.930+0000 7fe6abaad640 1 -- 172.21.15.112:0/1085417131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a4149440 con 0x7fe6a406fe50 2024-09-15T23:56:06.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.934+0000 7fe6abaad640 1 -- 172.21.15.112:0/1085417131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a406f910 con 0x7fe6a406fe50 2024-09-15T23:56:06.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.934+0000 7fe69a7fc640 1 -- 172.21.15.112:0/1085417131 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe694011590 con 0x7fe6a406fe50 2024-09-15T23:56:06.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.934+0000 7fe69a7fc640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe6880678c0 0x7fe688069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:06.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.934+0000 7fe6a9048640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe6880678c0 0x7fe688069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:06.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.934+0000 7fe69a7fc640 1 -- 172.21.15.112:0/1085417131 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7fe694086020 con 0x7fe6a406fe50 2024-09-15T23:56:06.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.934+0000 7fe6a9048640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe6880678c0 0x7fe688069d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4068fd0 tx=0x7fe69c007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:06.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:06.938+0000 7fe69a7fc640 1 -- 172.21.15.112:0/1085417131 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe694015020 con 0x7fe6a406fe50 2024-09-15T23:56:07.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.102+0000 7fe6abaad640 1 -- 172.21.15.112:0/1085417131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6a40b5460 con 0x7fe6a406fe50 2024-09-15T23:56:07.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.106+0000 7fe69a7fc640 1 -- 172.21.15.112:0/1085417131 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+17017 (secure 0 0 0) 0x7fe6940569d0 con 0x7fe6a406fe50 2024-09-15T23:56:07.106 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:07.107 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":61,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:56:06.155323+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:04.716518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:05.136871+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:07.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.106+0000 7fe6abaad640 1 -- 172.21.15.112:0/1085417131 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe6880678c0 msgr2=0x7fe688069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.106+0000 7fe6abaad640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe6880678c0 0x7fe688069d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4068fd0 tx=0x7fe69c007920 comp rx=0 tx=0).stop 2024-09-15T23:56:07.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.106+0000 7fe6abaad640 1 -- 172.21.15.112:0/1085417131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a406fe50 msgr2=0x7fe6a4148940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.106+0000 7fe6abaad640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a406fe50 0x7fe6a4148940 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c7f0 tx=0x7fe69400ccb0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.106+0000 7fe6abaad640 1 -- 172.21.15.112:0/1085417131 shutdown_connections 2024-09-15T23:56:07.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.106+0000 7fe6abaad640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe6880678c0 0x7fe688069d80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.106+0000 7fe6abaad640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a415f1d0 0x7fe6a415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.106+0000 7fe6abaad640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a41520a0 0x7fe6a4149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.106+0000 7fe6abaad640 1 --2- 172.21.15.112:0/1085417131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a406fe50 0x7fe6a4148940 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.106+0000 7fe6abaad640 1 -- 172.21.15.112:0/1085417131 >> 172.21.15.112:0/1085417131 conn(0x7fe6a40b1f90 msgr2=0x7fe6a40b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:07.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.106+0000 7fe6abaad640 1 -- 172.21.15.112:0/1085417131 shutdown_connections 2024-09-15T23:56:07.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.106+0000 7fe6abaad640 1 -- 172.21.15.112:0/1085417131 wait complete. 2024-09-15T23:56:07.126 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:07.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.246+0000 7f7fa8aed640 1 Processor -- start 2024-09-15T23:56:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.246+0000 7f7fa8aed640 1 -- start start 2024-09-15T23:56:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.246+0000 7f7fa8aed640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7fa41520a0 0x7f7fa406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.246+0000 7f7fa8aed640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa406fe50 0x7f7fa415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.246+0000 7f7fa8aed640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fa4070250 con 0x7f7fa415f1d0 2024-09-15T23:56:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa8aed640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7fa4152480 con 0x7f7fa41520a0 2024-09-15T23:56:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa8aed640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa40aede0 con 0x7f7fa406fe50 2024-09-15T23:56:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa259c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7fa41520a0 0x7f7fa406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa259c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7fa41520a0 0x7f7fa406f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52476/0 (socket says 172.21.15.112:52476) 2024-09-15T23:56:07.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa259c640 1 -- 172.21.15.112:0/1637002028 learned_addr learned my addr 172.21.15.112:0/1637002028 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:07.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa1d9b640 1 --2- 172.21.15.112:0/1637002028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa406fe50 0x7f7fa415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa259c640 1 -- 172.21.15.112:0/1637002028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa406fe50 msgr2=0x7f7fa415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:07.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa259c640 1 --2- 172.21.15.112:0/1637002028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa406fe50 0x7f7fa415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa259c640 1 -- 172.21.15.112:0/1637002028 >> v1:172.21.15.169:6789/0 conn(0x7f7fa415f1d0 legacy=0x7f7fa4071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:07.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa259c640 1 -- 172.21.15.112:0/1637002028 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa415fa10 con 0x7f7fa41520a0 2024-09-15T23:56:07.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa259c640 1 --2- 172.21.15.112:0/1637002028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa41520a0 0x7f7fa406f910 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009870 tx=0x7f7f8c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319e74ffedad8832 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:07.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa159a640 1 -- 172.21.15.112:0/1637002028 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0b1070 con 0x7f7fa41520a0 2024-09-15T23:56:07.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa159a640 1 -- 172.21.15.112:0/1637002028 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f8c0a8050 con 0x7f7fa41520a0 2024-09-15T23:56:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa159a640 1 -- 172.21.15.112:0/1637002028 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0ac860 con 0x7f7fa41520a0 2024-09-15T23:56:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa8aed640 1 -- 172.21.15.112:0/1637002028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa41520a0 msgr2=0x7f7fa406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa8aed640 1 --2- 172.21.15.112:0/1637002028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa41520a0 0x7f7fa406f910 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009870 tx=0x7f7f8c01c500 comp rx=0 tx=0).stop 2024-09-15T23:56:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa8aed640 1 -- 172.21.15.112:0/1637002028 shutdown_connections 2024-09-15T23:56:07.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa8aed640 1 --2- 172.21.15.112:0/1637002028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa406fe50 0x7f7fa415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa8aed640 1 --2- 172.21.15.112:0/1637002028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa41520a0 0x7f7fa406f910 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa8aed640 1 -- 172.21.15.112:0/1637002028 >> 172.21.15.112:0/1637002028 conn(0x7f7fa40b1f90 msgr2=0x7f7fa40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:07.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa8aed640 1 -- 172.21.15.112:0/1637002028 shutdown_connections 2024-09-15T23:56:07.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.250+0000 7f7fa8aed640 1 -- 172.21.15.112:0/1637002028 wait complete. 2024-09-15T23:56:07.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa8aed640 1 Processor -- start 2024-09-15T23:56:07.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa8aed640 1 -- start start 2024-09-15T23:56:07.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa8aed640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fa406fe50 0x7f7fa409dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa8aed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa41520a0 0x7f7fa414e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa8aed640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa415f1d0 0x7f7fa40ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa8aed640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa4073d30 con 0x7f7fa41520a0 2024-09-15T23:56:07.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa8aed640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa4073a50 con 0x7f7fa406fe50 2024-09-15T23:56:07.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa8aed640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa415f680 con 0x7f7fa415f1d0 2024-09-15T23:56:07.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa1d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa41520a0 0x7f7fa414e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa1d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa41520a0 0x7f7fa414e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52480/0 (socket says 172.21.15.112:52480) 2024-09-15T23:56:07.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa1d9b640 1 -- 172.21.15.112:0/2721357583 learned_addr learned my addr 172.21.15.112:0/2721357583 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:07.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa259c640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fa406fe50 0x7f7fa409dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa2d9d640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa415f1d0 0x7f7fa40ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa1d9b640 1 -- 172.21.15.112:0/2721357583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa415f1d0 msgr2=0x7f7fa40ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa1d9b640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa415f1d0 0x7f7fa40ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa1d9b640 1 -- 172.21.15.112:0/2721357583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fa406fe50 msgr2=0x7f7fa409dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa1d9b640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fa406fe50 0x7f7fa409dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa1d9b640 1 -- 172.21.15.112:0/2721357583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa409b7a0 con 0x7f7fa41520a0 2024-09-15T23:56:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa2d9d640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa415f1d0 0x7f7fa40ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa1d9b640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa41520a0 0x7f7fa414e820 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c007e60 tx=0x7f7f9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7f9affd640 1 -- 172.21.15.112:0/2721357583 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c01a070 con 0x7f7fa41520a0 2024-09-15T23:56:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7f9affd640 1 -- 172.21.15.112:0/2721357583 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9c003ba0 con 0x7f7fa41520a0 2024-09-15T23:56:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa8aed640 1 -- 172.21.15.112:0/2721357583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa409ba80 con 0x7f7fa41520a0 2024-09-15T23:56:07.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7f9affd640 1 -- 172.21.15.112:0/2721357583 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c004030 con 0x7f7fa41520a0 2024-09-15T23:56:07.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa8aed640 1 -- 172.21.15.112:0/2721357583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa409d420 con 0x7f7fa41520a0 2024-09-15T23:56:07.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.254+0000 7f7fa8aed640 1 -- 172.21.15.112:0/2721357583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa415ec90 con 0x7f7fa41520a0 2024-09-15T23:56:07.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.258+0000 7f7f9affd640 1 -- 172.21.15.112:0/2721357583 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f9c01d070 con 0x7f7fa41520a0 2024-09-15T23:56:07.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.258+0000 7f7f9affd640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7f840678c0 0x7f7f84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.258+0000 7f7fa259c640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7f840678c0 0x7f7f84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.258+0000 7f7f9affd640 1 -- 172.21.15.112:0/2721357583 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7f7f9c085f00 con 0x7f7fa41520a0 2024-09-15T23:56:07.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.258+0000 7f7fa259c640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7f840678c0 0x7f7f84069d80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0ae000 tx=0x7f7f8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:07.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.262+0000 7f7f9affd640 1 -- 172.21.15.112:0/2721357583 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7f9c0562f0 con 0x7f7fa41520a0 2024-09-15T23:56:07.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.422+0000 7f7fa8aed640 1 -- 172.21.15.112:0/2721357583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7fa415b030 con 0x7f7fa41520a0 2024-09-15T23:56:07.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.426+0000 7f7f9affd640 1 -- 172.21.15.112:0/2721357583 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+17017 (secure 0 0 0) 0x7f7f9c05a5f0 con 0x7f7fa41520a0 2024-09-15T23:56:07.428 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:07.428 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":61,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:56:06.155323+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:04.716518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:05.136871+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:07.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.430+0000 7f7fa8aed640 1 -- 172.21.15.112:0/2721357583 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7f840678c0 msgr2=0x7f7f84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.430+0000 7f7fa8aed640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7f840678c0 0x7f7f84069d80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0ae000 tx=0x7f7f8c008040 comp rx=0 tx=0).stop 2024-09-15T23:56:07.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.430+0000 7f7fa8aed640 1 -- 172.21.15.112:0/2721357583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa41520a0 msgr2=0x7f7fa414e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.430+0000 7f7fa8aed640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa41520a0 0x7f7fa414e820 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c007e60 tx=0x7f7f9c00e4b0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.430+0000 7f7fa8aed640 1 -- 172.21.15.112:0/2721357583 shutdown_connections 2024-09-15T23:56:07.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.430+0000 7f7fa8aed640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7f840678c0 0x7f7f84069d80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.430+0000 7f7fa8aed640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa415f1d0 0x7f7fa40ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.430+0000 7f7fa8aed640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7fa41520a0 0x7f7fa414e820 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.430+0000 7f7fa8aed640 1 --2- 172.21.15.112:0/2721357583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fa406fe50 0x7f7fa409dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.430+0000 7f7fa8aed640 1 -- 172.21.15.112:0/2721357583 >> 172.21.15.112:0/2721357583 conn(0x7f7fa40b1f90 msgr2=0x7f7fa40adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:07.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.430+0000 7f7fa8aed640 1 -- 172.21.15.112:0/2721357583 shutdown_connections 2024-09-15T23:56:07.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.430+0000 7f7fa8aed640 1 -- 172.21.15.112:0/2721357583 wait complete. 2024-09-15T23:56:07.447 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:56:07.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.562+0000 7f349f421640 1 Processor -- start 2024-09-15T23:56:07.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.562+0000 7f349f421640 1 -- start start 2024-09-15T23:56:07.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349f421640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f349806fef0 0x7f349806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349f421640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34980b3d50 0x7f34980b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349f421640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f349806ee50 con 0x7f3498073e60 2024-09-15T23:56:07.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349f421640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f34980b46c0 con 0x7f34980b3d50 2024-09-15T23:56:07.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349f421640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f349806f130 con 0x7f349806fef0 2024-09-15T23:56:07.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349d9be640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34980b3d50 0x7f34980b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349d9be640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34980b3d50 0x7f34980b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52486/0 (socket says 172.21.15.112:52486) 2024-09-15T23:56:07.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349d1bd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3498073e60 0x7f349815b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58432/0 (socket says 172.21.15.112:58432) 2024-09-15T23:56:07.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349d9be640 1 -- 172.21.15.112:0/558963978 learned_addr learned my addr 172.21.15.112:0/558963978 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:07.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349c9bc640 1 --2- 172.21.15.112:0/558963978 >> v2:172.21.15.169:3300/0 conn(0x7f349806fef0 0x7f349806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349d9be640 1 -- 172.21.15.112:0/558963978 >> v2:172.21.15.169:3300/0 conn(0x7f349806fef0 msgr2=0x7f349806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:07.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349d9be640 1 --2- 172.21.15.112:0/558963978 >> v2:172.21.15.169:3300/0 conn(0x7f349806fef0 0x7f349806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349d9be640 1 -- 172.21.15.112:0/558963978 >> v1:172.21.15.112:6789/0 conn(0x7f3498073e60 legacy=0x7f349815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349d9be640 1 -- 172.21.15.112:0/558963978 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349806f410 con 0x7f34980b3d50 2024-09-15T23:56:07.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f349d9be640 1 --2- 172.21.15.112:0/558963978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34980b3d50 0x7f34980b4180 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f34980afe90 tx=0x7f349001eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef7e81faf749c64 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:07.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f348ffff640 1 -- 172.21.15.112:0/558963978 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349000b2d0 con 0x7f34980b3d50 2024-09-15T23:56:07.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f348ffff640 1 -- 172.21.15.112:0/558963978 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f349000b470 con 0x7f34980b3d50 2024-09-15T23:56:07.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.566+0000 7f348ffff640 1 -- 172.21.15.112:0/558963978 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34900a7a60 con 0x7f34980b3d50 2024-09-15T23:56:07.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 -- 172.21.15.112:0/558963978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34980b3d50 msgr2=0x7f34980b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 --2- 172.21.15.112:0/558963978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34980b3d50 0x7f34980b4180 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f34980afe90 tx=0x7f349001eb60 comp rx=0 tx=0).stop 2024-09-15T23:56:07.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 -- 172.21.15.112:0/558963978 shutdown_connections 2024-09-15T23:56:07.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 --2- 172.21.15.112:0/558963978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34980b3d50 0x7f34980b4180 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 --2- 172.21.15.112:0/558963978 >> v2:172.21.15.169:3300/0 conn(0x7f349806fef0 0x7f349806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 -- 172.21.15.112:0/558963978 >> 172.21.15.112:0/558963978 conn(0x7f34980b1f90 msgr2=0x7f34980b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:07.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 -- 172.21.15.112:0/558963978 shutdown_connections 2024-09-15T23:56:07.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 -- 172.21.15.112:0/558963978 wait complete. 2024-09-15T23:56:07.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 Processor -- start 2024-09-15T23:56:07.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 -- start start 2024-09-15T23:56:07.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f349806fef0 0x7f34981f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3498073e60 0x7f3498153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34980b3d50 0x7f3498154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f34980729a0 con 0x7f34980b3d50 2024-09-15T23:56:07.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3498072820 con 0x7f349806fef0 2024-09-15T23:56:07.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3498072b20 con 0x7f3498073e60 2024-09-15T23:56:07.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349d9be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34980b3d50 0x7f3498154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349d9be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34980b3d50 0x7f3498154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52500/0 (socket says 172.21.15.112:52500) 2024-09-15T23:56:07.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349d9be640 1 -- 172.21.15.112:0/4062307984 learned_addr learned my addr 172.21.15.112:0/4062307984 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:07.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349c9bc640 1 --2- 172.21.15.112:0/4062307984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3498073e60 0x7f3498153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349d1bd640 1 --2- 172.21.15.112:0/4062307984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f349806fef0 0x7f34981f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349d9be640 1 -- 172.21.15.112:0/4062307984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3498073e60 msgr2=0x7f3498153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349d9be640 1 --2- 172.21.15.112:0/4062307984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3498073e60 0x7f3498153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349d9be640 1 -- 172.21.15.112:0/4062307984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f349806fef0 msgr2=0x7f34981f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349d9be640 1 --2- 172.21.15.112:0/4062307984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f349806fef0 0x7f34981f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349d9be640 1 -- 172.21.15.112:0/4062307984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349814bfd0 con 0x7f34980b3d50 2024-09-15T23:56:07.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349d9be640 1 --2- 172.21.15.112:0/4062307984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34980b3d50 0x7f3498154120 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f349001b770 tx=0x7f349001b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:07.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f348dffb640 1 -- 172.21.15.112:0/4062307984 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34900be020 con 0x7f34980b3d50 2024-09-15T23:56:07.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f348dffb640 1 -- 172.21.15.112:0/4062307984 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3490009820 con 0x7f34980b3d50 2024-09-15T23:56:07.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 -- 172.21.15.112:0/4062307984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349814c2b0 con 0x7f34980b3d50 2024-09-15T23:56:07.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f348dffb640 1 -- 172.21.15.112:0/4062307984 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3490009c10 con 0x7f34980b3d50 2024-09-15T23:56:07.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 -- 172.21.15.112:0/4062307984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349814c870 con 0x7f34980b3d50 2024-09-15T23:56:07.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.570+0000 7f349f421640 1 -- 172.21.15.112:0/4062307984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f349806e800 con 0x7f34980b3d50 2024-09-15T23:56:07.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.574+0000 7f348dffb640 1 -- 172.21.15.112:0/4062307984 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f34900c1020 con 0x7f34980b3d50 2024-09-15T23:56:07.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.574+0000 7f348dffb640 1 --2- 172.21.15.112:0/4062307984 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f347c0678c0 0x7f347c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.574+0000 7f349d1bd640 1 --2- 172.21.15.112:0/4062307984 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f347c0678c0 0x7f347c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.574+0000 7f348dffb640 1 -- 172.21.15.112:0/4062307984 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6101+0+0 (secure 0 0 0) 0x7f3490122f50 con 0x7f34980b3d50 2024-09-15T23:56:07.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.574+0000 7f349d1bd640 1 --2- 172.21.15.112:0/4062307984 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f347c0678c0 0x7f347c069d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3494000f70 tx=0x7f3494007cd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:07.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.578+0000 7f348dffb640 1 -- 172.21.15.112:0/4062307984 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f34900c8030 con 0x7f34980b3d50 2024-09-15T23:56:07.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.770+0000 7f349f421640 1 -- 172.21.15.112:0/4062307984 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f34980723f0 con 0x7f34980b3d50 2024-09-15T23:56:07.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.794+0000 7f348dffb640 1 -- 172.21.15.112:0/4062307984 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7f34900187e0 con 0x7f34980b3d50 2024-09-15T23:56:07.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.794+0000 7f349f421640 1 -- 172.21.15.112:0/4062307984 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f347c0678c0 msgr2=0x7f347c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.794+0000 7f349f421640 1 --2- 172.21.15.112:0/4062307984 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f347c0678c0 0x7f347c069d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3494000f70 tx=0x7f3494007cd0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.794+0000 7f349f421640 1 -- 172.21.15.112:0/4062307984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34980b3d50 msgr2=0x7f3498154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.794+0000 7f349f421640 1 --2- 172.21.15.112:0/4062307984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34980b3d50 0x7f3498154120 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f349001b770 tx=0x7f349001b900 comp rx=0 tx=0).stop 2024-09-15T23:56:07.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.794+0000 7f349f421640 1 -- 172.21.15.112:0/4062307984 shutdown_connections 2024-09-15T23:56:07.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.794+0000 7f349f421640 1 --2- 172.21.15.112:0/4062307984 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f347c0678c0 0x7f347c069d80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.794+0000 7f349f421640 1 --2- 172.21.15.112:0/4062307984 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34980b3d50 0x7f3498154120 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.794+0000 7f349f421640 1 --2- 172.21.15.112:0/4062307984 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3498073e60 0x7f3498153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.794+0000 7f349f421640 1 --2- 172.21.15.112:0/4062307984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f349806fef0 0x7f34981f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.794+0000 7f349f421640 1 -- 172.21.15.112:0/4062307984 >> 172.21.15.112:0/4062307984 conn(0x7f34980b1f90 msgr2=0x7f349814ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:07.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.794+0000 7f349f421640 1 -- 172.21.15.112:0/4062307984 shutdown_connections 2024-09-15T23:56:07.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.794+0000 7f349f421640 1 -- 172.21.15.112:0/4062307984 wait complete. 2024-09-15T23:56:07.813 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:56:07.813 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:56:07.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.926+0000 7f1640a9d640 1 Processor -- start 2024-09-15T23:56:07.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.926+0000 7f1640a9d640 1 -- start start 2024-09-15T23:56:07.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1640a9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f163c0b3330 0x7f163c0b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1640a9d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f163c0b51b0 0x7f163c0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1640a9d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f163c0b3c50 con 0x7f163c15b570 2024-09-15T23:56:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1640a9d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f163c0d0b80 con 0x7f163c0b51b0 2024-09-15T23:56:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1640a9d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f163c0d0e60 con 0x7f163c0b3330 2024-09-15T23:56:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1631d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f163c0b51b0 0x7f163c0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1631d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f163c0b51b0 0x7f163c0b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52510/0 (socket says 172.21.15.112:52510) 2024-09-15T23:56:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1631d9b640 1 -- 172.21.15.112:0/129103804 learned_addr learned my addr 172.21.15.112:0/129103804 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1631d9b640 1 -- 172.21.15.112:0/129103804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f163c0b3330 msgr2=0x7f163c0b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1631d9b640 1 --2- 172.21.15.112:0/129103804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f163c0b3330 0x7f163c0b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1631d9b640 1 -- 172.21.15.112:0/129103804 >> v1:172.21.15.169:6789/0 conn(0x7f163c15b570 legacy=0x7f163c0cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1631d9b640 1 -- 172.21.15.112:0/129103804 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163c0b46d0 con 0x7f163c0b51b0 2024-09-15T23:56:07.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1631d9b640 1 --2- 172.21.15.112:0/129103804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f163c0b51b0 0x7f163c0b55d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1624009870 tx=0x7f162401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0929275eb89029 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:07.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1639d9b640 1 -- 172.21.15.112:0/129103804 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16240b0070 con 0x7f163c0b51b0 2024-09-15T23:56:07.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1639d9b640 1 -- 172.21.15.112:0/129103804 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16240ab600 con 0x7f163c0b51b0 2024-09-15T23:56:07.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1639d9b640 1 -- 172.21.15.112:0/129103804 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16240ab9d0 con 0x7f163c0b51b0 2024-09-15T23:56:07.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1640a9d640 1 -- 172.21.15.112:0/129103804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f163c0b51b0 msgr2=0x7f163c0b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1640a9d640 1 --2- 172.21.15.112:0/129103804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f163c0b51b0 0x7f163c0b55d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1624009870 tx=0x7f162401c490 comp rx=0 tx=0).stop 2024-09-15T23:56:07.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1640a9d640 1 -- 172.21.15.112:0/129103804 shutdown_connections 2024-09-15T23:56:07.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1640a9d640 1 --2- 172.21.15.112:0/129103804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f163c0b51b0 0x7f163c0b55d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1640a9d640 1 --2- 172.21.15.112:0/129103804 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f163c0b3330 0x7f163c0b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1640a9d640 1 -- 172.21.15.112:0/129103804 >> 172.21.15.112:0/129103804 conn(0x7f163c0b6870 msgr2=0x7f163c0b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:07.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.930+0000 7f1640a9d640 1 -- 172.21.15.112:0/129103804 shutdown_connections 2024-09-15T23:56:07.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f1640a9d640 1 -- 172.21.15.112:0/129103804 wait complete. 2024-09-15T23:56:07.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f1640a9d640 1 Processor -- start 2024-09-15T23:56:07.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f1640a9d640 1 -- start start 2024-09-15T23:56:07.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f1640a9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f163c0b3330 0x7f163c15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f1640a9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f163c0b51b0 0x7f163c13a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f1640a9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f163c15b570 0x7f163c13a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f1640a9d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f163c144e80 con 0x7f163c0b3330 2024-09-15T23:56:07.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f1640a9d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f163c144d00 con 0x7f163c0b51b0 2024-09-15T23:56:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f1640a9d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f163c166340 con 0x7f163c15b570 2024-09-15T23:56:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f163a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f163c0b3330 0x7f163c15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f163a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f163c0b3330 0x7f163c15ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52518/0 (socket says 172.21.15.112:52518) 2024-09-15T23:56:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f163a59c640 1 -- 172.21.15.112:0/2861835454 learned_addr learned my addr 172.21.15.112:0/2861835454 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f1631d9b640 1 --2- 172.21.15.112:0/2861835454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f163c0b51b0 0x7f163c13a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f163ad9d640 1 --2- 172.21.15.112:0/2861835454 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f163c15b570 0x7f163c13a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f163a59c640 1 -- 172.21.15.112:0/2861835454 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f163c15b570 msgr2=0x7f163c13a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f163a59c640 1 --2- 172.21.15.112:0/2861835454 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f163c15b570 0x7f163c13a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f163a59c640 1 -- 172.21.15.112:0/2861835454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f163c0b51b0 msgr2=0x7f163c13a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f163a59c640 1 --2- 172.21.15.112:0/2861835454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f163c0b51b0 0x7f163c13a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f163a59c640 1 -- 172.21.15.112:0/2861835454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163c140850 con 0x7f163c0b3330 2024-09-15T23:56:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f163a59c640 1 --2- 172.21.15.112:0/2861835454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f163c0b3330 0x7f163c15ab30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f162c00b550 tx=0x7f162c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f16337fe640 1 -- 172.21.15.112:0/2861835454 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c014070 con 0x7f163c0b3330 2024-09-15T23:56:07.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f16337fe640 1 -- 172.21.15.112:0/2861835454 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f162c010890 con 0x7f163c0b3330 2024-09-15T23:56:07.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f1640a9d640 1 -- 172.21.15.112:0/2861835454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f163c140b30 con 0x7f163c0b3330 2024-09-15T23:56:07.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f16337fe640 1 -- 172.21.15.112:0/2861835454 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c010c80 con 0x7f163c0b3330 2024-09-15T23:56:07.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.934+0000 7f1640a9d640 1 -- 172.21.15.112:0/2861835454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f163c1410f0 con 0x7f163c0b3330 2024-09-15T23:56:07.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.938+0000 7f1640a9d640 1 -- 172.21.15.112:0/2861835454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f163c1666b0 con 0x7f163c0b3330 2024-09-15T23:56:07.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.938+0000 7f16337fe640 1 -- 172.21.15.112:0/2861835454 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f162c017070 con 0x7f163c0b3330 2024-09-15T23:56:07.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.938+0000 7f16337fe640 1 --2- 172.21.15.112:0/2861835454 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f161c0678c0 0x7f161c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.938+0000 7f16337fe640 1 -- 172.21.15.112:0/2861835454 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f162c085c70 con 0x7f163c0b3330 2024-09-15T23:56:07.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.938+0000 7f1631d9b640 1 --2- 172.21.15.112:0/2861835454 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f161c0678c0 0x7f161c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.938+0000 7f1631d9b640 1 --2- 172.21.15.112:0/2861835454 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f161c0678c0 0x7f161c069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f16240ad000 tx=0x7f1624008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:07.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:07.942+0000 7f16337fe640 1 -- 172.21.15.112:0/2861835454 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f162c056620 con 0x7f163c0b3330 2024-09-15T23:56:08.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.138+0000 7f1640a9d640 1 -- 172.21.15.112:0/2861835454 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f163c15e4b0 con 0x7f163c0b3330 2024-09-15T23:56:08.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.794+0000 7f16337fe640 1 -- 172.21.15.112:0/2861835454 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v29) ==== 122+0+0 (secure 0 0 0) 0x7f162c010e20 con 0x7f163c0b3330 2024-09-15T23:56:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.798+0000 7f1640a9d640 1 -- 172.21.15.112:0/2861835454 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f161c0678c0 msgr2=0x7f161c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.798+0000 7f1640a9d640 1 --2- 172.21.15.112:0/2861835454 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f161c0678c0 0x7f161c069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f16240ad000 tx=0x7f1624008040 comp rx=0 tx=0).stop 2024-09-15T23:56:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.798+0000 7f1640a9d640 1 -- 172.21.15.112:0/2861835454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f163c0b3330 msgr2=0x7f163c15ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.798+0000 7f1640a9d640 1 --2- 172.21.15.112:0/2861835454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f163c0b3330 0x7f163c15ab30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f162c00b550 tx=0x7f162c00ba10 comp rx=0 tx=0).stop 2024-09-15T23:56:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.798+0000 7f1640a9d640 1 -- 172.21.15.112:0/2861835454 shutdown_connections 2024-09-15T23:56:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.798+0000 7f1640a9d640 1 --2- 172.21.15.112:0/2861835454 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f161c0678c0 0x7f161c069d80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.798+0000 7f1640a9d640 1 --2- 172.21.15.112:0/2861835454 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f163c15b570 0x7f163c13a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.798+0000 7f1640a9d640 1 --2- 172.21.15.112:0/2861835454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f163c0b51b0 0x7f163c13a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.798+0000 7f1640a9d640 1 --2- 172.21.15.112:0/2861835454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f163c0b3330 0x7f163c15ab30 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.798+0000 7f1640a9d640 1 -- 172.21.15.112:0/2861835454 >> 172.21.15.112:0/2861835454 conn(0x7f163c0b6870 msgr2=0x7f163c0b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:08.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.798+0000 7f1640a9d640 1 -- 172.21.15.112:0/2861835454 shutdown_connections 2024-09-15T23:56:08.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.798+0000 7f1640a9d640 1 -- 172.21.15.112:0/2861835454 wait complete. 2024-09-15T23:56:08.823 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:56:08.823 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:08.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec9625b640 1 Processor -- start 2024-09-15T23:56:08.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec9625b640 1 -- start start 2024-09-15T23:56:08.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec9625b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec90073e60 0x7fec9006e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec9625b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fec9006fef0 0x7fec9015b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec9625b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec9015bda0 con 0x7fec900b3d50 2024-09-15T23:56:08.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec9625b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fec9006ee50 con 0x7fec9006fef0 2024-09-15T23:56:08.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec9625b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fec9006f130 con 0x7fec90073e60 2024-09-15T23:56:08.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec8effd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fec9006fef0 0x7fec9015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:08.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec90073e60 0x7fec9006e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:08.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec8effd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fec9006fef0 0x7fec9015b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:41980/0 (socket says 172.21.15.112:41980) 2024-09-15T23:56:08.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec8effd640 1 -- 172.21.15.112:0/860854977 learned_addr learned my addr 172.21.15.112:0/860854977 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:08.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec8effd640 1 -- 172.21.15.112:0/860854977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec90073e60 msgr2=0x7fec9006e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:08.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec8effd640 1 --2- 172.21.15.112:0/860854977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec90073e60 0x7fec9006e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec8effd640 1 -- 172.21.15.112:0/860854977 >> v1:172.21.15.169:6789/0 conn(0x7fec900b3d50 legacy=0x7fec900b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.946+0000 7fec8effd640 1 -- 172.21.15.112:0/860854977 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9006f410 con 0x7fec9006fef0 2024-09-15T23:56:08.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec8effd640 1 --2- 172.21.15.112:0/860854977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec9006fef0 0x7fec9015b860 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fec84009870 tx=0x7fec8401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64f5d4e07b001a33 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:08.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec8e7fc640 1 -- 172.21.15.112:0/860854977 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840b2070 con 0x7fec9006fef0 2024-09-15T23:56:08.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec8e7fc640 1 -- 172.21.15.112:0/860854977 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec840a9070 con 0x7fec9006fef0 2024-09-15T23:56:08.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec8e7fc640 1 -- 172.21.15.112:0/860854977 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840ad880 con 0x7fec9006fef0 2024-09-15T23:56:08.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 -- 172.21.15.112:0/860854977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec9006fef0 msgr2=0x7fec9015b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 --2- 172.21.15.112:0/860854977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec9006fef0 0x7fec9015b860 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fec84009870 tx=0x7fec8401c4d0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 -- 172.21.15.112:0/860854977 shutdown_connections 2024-09-15T23:56:08.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 --2- 172.21.15.112:0/860854977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec9006fef0 0x7fec9015b860 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 --2- 172.21.15.112:0/860854977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec90073e60 0x7fec9006e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 -- 172.21.15.112:0/860854977 >> 172.21.15.112:0/860854977 conn(0x7fec900b1f90 msgr2=0x7fec900b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:08.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 -- 172.21.15.112:0/860854977 shutdown_connections 2024-09-15T23:56:08.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 -- 172.21.15.112:0/860854977 wait complete. 2024-09-15T23:56:08.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 Processor -- start 2024-09-15T23:56:08.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 -- start start 2024-09-15T23:56:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec9006fef0 0x7fec900998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec90073e60 0x7fec90155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec900b3d50 0x7fec90156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fec900731f0 con 0x7fec90073e60 2024-09-15T23:56:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fec90073070 con 0x7fec9006fef0 2024-09-15T23:56:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.950+0000 7fec9625b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fec90073370 con 0x7fec900b3d50 2024-09-15T23:56:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec8effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec90073e60 0x7fec90155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec8effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec90073e60 0x7fec90155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34874/0 (socket says 172.21.15.112:34874) 2024-09-15T23:56:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec8effd640 1 -- 172.21.15.112:0/4134342159 learned_addr learned my addr 172.21.15.112:0/4134342159 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec8f7fe640 1 --2- 172.21.15.112:0/4134342159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec9006fef0 0x7fec900998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec8ffff640 1 --2- 172.21.15.112:0/4134342159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec900b3d50 0x7fec90156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec8effd640 1 -- 172.21.15.112:0/4134342159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec900b3d50 msgr2=0x7fec90156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec8effd640 1 --2- 172.21.15.112:0/4134342159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec900b3d50 0x7fec90156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec8effd640 1 -- 172.21.15.112:0/4134342159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec9006fef0 msgr2=0x7fec900998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec8effd640 1 --2- 172.21.15.112:0/4134342159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec9006fef0 0x7fec900998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec8effd640 1 -- 172.21.15.112:0/4134342159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec90152280 con 0x7fec90073e60 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec8effd640 1 --2- 172.21.15.112:0/4134342159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec90073e60 0x7fec90155430 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fec840b0040 tx=0x7fec84019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec77fff640 1 -- 172.21.15.112:0/4134342159 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840bb070 con 0x7fec90073e60 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec77fff640 1 -- 172.21.15.112:0/4134342159 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec840adce0 con 0x7fec90073e60 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec9625b640 1 -- 172.21.15.112:0/4134342159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec90152560 con 0x7fec90073e60 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec77fff640 1 -- 172.21.15.112:0/4134342159 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840b2040 con 0x7fec90073e60 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec9625b640 1 -- 172.21.15.112:0/4134342159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec90152b20 con 0x7fec90073e60 2024-09-15T23:56:08.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec9625b640 1 -- 172.21.15.112:0/4134342159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec9015b860 con 0x7fec90073e60 2024-09-15T23:56:08.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec77fff640 1 -- 172.21.15.112:0/4134342159 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec840be070 con 0x7fec90073e60 2024-09-15T23:56:08.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec77fff640 1 --2- 172.21.15.112:0/4134342159 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec7c0678f0 0x7fec7c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec77fff640 1 -- 172.21.15.112:0/4134342159 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fec8411ec40 con 0x7fec90073e60 2024-09-15T23:56:08.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec8f7fe640 1 --2- 172.21.15.112:0/4134342159 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec7c0678f0 0x7fec7c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:08.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.954+0000 7fec8f7fe640 1 --2- 172.21.15.112:0/4134342159 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec7c0678f0 0x7fec7c069db0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fec80009a50 tx=0x7fec80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:08.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:08.958+0000 7fec77fff640 1 -- 172.21.15.112:0/4134342159 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec84016150 con 0x7fec90073e60 2024-09-15T23:56:09.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.150+0000 7fec9625b640 1 -- 172.21.15.112:0/4134342159 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec900723f0 con 0x7fec90073e60 2024-09-15T23:56:09.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.154+0000 7fec77fff640 1 -- 172.21.15.112:0/4134342159 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5233 (secure 0 0 0) 0x7fec840ef5f0 con 0x7fec90073e60 2024-09-15T23:56:09.155 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:09.155 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"btime":"2024-09-15T23:56:08:794770+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/442643148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":442643148},{"type":"v1","addr":"172.21.15.169:6833","nonce":442643148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2506338033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2506338033},{"type":"v1","addr":"172.21.15.169:6835","nonce":2506338033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3040445121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3040445121},{"type":"v1","addr":"172.21.15.112:6835","nonce":3040445121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:06.156047+0000","modified":"2024-09-15T23:56:08.141848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/3667278267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3667278267},{"type":"v1","addr":"172.21.15.112:6837","nonce":3667278267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5625,"qdb_cluster":[5625]},"id":4}]} 2024-09-15T23:56:09.155 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 29 2024-09-15T23:56:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.154+0000 7fec9625b640 1 -- 172.21.15.112:0/4134342159 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec7c0678f0 msgr2=0x7fec7c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.154+0000 7fec9625b640 1 --2- 172.21.15.112:0/4134342159 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec7c0678f0 0x7fec7c069db0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fec80009a50 tx=0x7fec80008040 comp rx=0 tx=0).stop 2024-09-15T23:56:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.154+0000 7fec9625b640 1 -- 172.21.15.112:0/4134342159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec90073e60 msgr2=0x7fec90155430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.154+0000 7fec9625b640 1 --2- 172.21.15.112:0/4134342159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec90073e60 0x7fec90155430 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fec840b0040 tx=0x7fec84019270 comp rx=0 tx=0).stop 2024-09-15T23:56:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.154+0000 7fec9625b640 1 -- 172.21.15.112:0/4134342159 shutdown_connections 2024-09-15T23:56:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.154+0000 7fec9625b640 1 --2- 172.21.15.112:0/4134342159 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec7c0678f0 0x7fec7c069db0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.154+0000 7fec9625b640 1 --2- 172.21.15.112:0/4134342159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec900b3d50 0x7fec90156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.154+0000 7fec9625b640 1 --2- 172.21.15.112:0/4134342159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec90073e60 0x7fec90155430 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.154+0000 7fec9625b640 1 --2- 172.21.15.112:0/4134342159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec9006fef0 0x7fec900998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.154+0000 7fec9625b640 1 -- 172.21.15.112:0/4134342159 >> 172.21.15.112:0/4134342159 conn(0x7fec900b1f90 msgr2=0x7fec901508c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.154+0000 7fec9625b640 1 -- 172.21.15.112:0/4134342159 shutdown_connections 2024-09-15T23:56:09.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.154+0000 7fec9625b640 1 -- 172.21.15.112:0/4134342159 wait complete. 2024-09-15T23:56:09.172 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:09.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.290+0000 7f9c69582640 1 Processor -- start 2024-09-15T23:56:09.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.290+0000 7f9c69582640 1 -- start start 2024-09-15T23:56:09.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c69582640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9c641520a0 0x7f9c6406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c69582640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c6415f3a0 0x7f9c640adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c69582640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c64070250 con 0x7f9c6406fe50 2024-09-15T23:56:09.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c69582640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9c64152480 con 0x7f9c641520a0 2024-09-15T23:56:09.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c69582640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9c640aede0 con 0x7f9c6415f3a0 2024-09-15T23:56:09.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c627fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9c6406fe50 0x7f9c6415ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38316/0 (socket says 172.21.15.112:38316) 2024-09-15T23:56:09.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c627fc640 1 -- 172.21.15.112:0/941111164 learned_addr learned my addr 172.21.15.112:0/941111164 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:09.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c62ffd640 1 --2- 172.21.15.112:0/941111164 >> v2:172.21.15.169:3300/0 conn(0x7f9c641520a0 0x7f9c6406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c637fe640 1 --2- 172.21.15.112:0/941111164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c6415f3a0 0x7f9c640adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 -- 172.21.15.112:0/941111164 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3115223637 0 0) 0x7f9c64070250 con 0x7f9c6406fe50 2024-09-15T23:56:09.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 -- 172.21.15.112:0/941111164 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c4c003530 con 0x7f9c6406fe50 2024-09-15T23:56:09.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 -- 172.21.15.112:0/941111164 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4176406835 0 0) 0x7f9c4c003530 con 0x7f9c6406fe50 2024-09-15T23:56:09.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 -- 172.21.15.112:0/941111164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c6415f3a0 msgr2=0x7f9c640adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:09.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 --2- 172.21.15.112:0/941111164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c6415f3a0 0x7f9c640adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 -- 172.21.15.112:0/941111164 >> v2:172.21.15.169:3300/0 conn(0x7f9c641520a0 msgr2=0x7f9c6406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:09.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 --2- 172.21.15.112:0/941111164 >> v2:172.21.15.169:3300/0 conn(0x7f9c641520a0 0x7f9c6406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 -- 172.21.15.112:0/941111164 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6415fa10 con 0x7f9c6406fe50 2024-09-15T23:56:09.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 -- 172.21.15.112:0/941111164 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f9c58001680 con 0x7f9c6406fe50 2024-09-15T23:56:09.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 -- 172.21.15.112:0/941111164 >> v1:172.21.15.112:6789/0 conn(0x7f9c6406fe50 legacy=0x7f9c6415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 --2- 172.21.15.112:0/941111164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c4c0039c0 0x7f9c4c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 --2- 172.21.15.112:0/941111164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c6415f3a0 0x7f9c4c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 --2- 172.21.15.112:0/941111164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c004d50 0x7f9c4c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 -- 172.21.15.112:0/941111164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9c640aede0 con 0x7f9c4c004d50 2024-09-15T23:56:09.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 -- 172.21.15.112:0/941111164 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c00b9d0 con 0x7f9c4c0039c0 2024-09-15T23:56:09.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c61ffb640 1 -- 172.21.15.112:0/941111164 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9c4c00bb50 con 0x7f9c6415f3a0 2024-09-15T23:56:09.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c637fe640 1 --2- 172.21.15.112:0/941111164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c004d50 0x7f9c4c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c62ffd640 1 --2- 172.21.15.112:0/941111164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c4c0039c0 0x7f9c4c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c637fe640 1 -- 172.21.15.112:0/941111164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c6415f3a0 msgr2=0x7f9c4c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:09.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c627fc640 1 --2- 172.21.15.112:0/941111164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c6415f3a0 0x7f9c4c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c637fe640 1 --2- 172.21.15.112:0/941111164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c6415f3a0 0x7f9c4c004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c637fe640 1 -- 172.21.15.112:0/941111164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c4c0039c0 msgr2=0x7f9c4c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c637fe640 1 --2- 172.21.15.112:0/941111164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c4c0039c0 0x7f9c4c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.294+0000 7f9c637fe640 1 -- 172.21.15.112:0/941111164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4c003530 con 0x7f9c4c004d50 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c637fe640 1 --2- 172.21.15.112:0/941111164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c004d50 0x7f9c4c0051d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00e170 tx=0x7f9c5c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fd10a238ab585a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c61ffb640 1 -- 172.21.15.112:0/941111164 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0b2070 con 0x7f9c4c004d50 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c61ffb640 1 -- 172.21.15.112:0/941111164 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5c0a5c70 con 0x7f9c4c004d50 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c61ffb640 1 -- 172.21.15.112:0/941111164 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c009c10 con 0x7f9c4c004d50 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c69582640 1 -- 172.21.15.112:0/941111164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c004d50 msgr2=0x7f9c4c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c69582640 1 --2- 172.21.15.112:0/941111164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c4c004d50 0x7f9c4c0051d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00e170 tx=0x7f9c5c01cc60 comp rx=0 tx=0).stop 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c637fe640 1 -- 172.21.15.112:0/941111164 reap_dead start 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c69582640 1 -- 172.21.15.112:0/941111164 shutdown_connections 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c69582640 1 -- 172.21.15.112:0/941111164 >> 172.21.15.112:0/941111164 conn(0x7f9c640b1f90 msgr2=0x7f9c640b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c69582640 1 -- 172.21.15.112:0/941111164 shutdown_connections 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c69582640 1 -- 172.21.15.112:0/941111164 wait complete. 2024-09-15T23:56:09.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c69582640 1 Processor -- start 2024-09-15T23:56:09.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c69582640 1 -- start start 2024-09-15T23:56:09.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c69582640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c4c004d50 0x7f9c641f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c69582640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c641ef860 0x7f9c641537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c69582640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c640ce280 0x7f9c640b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c69582640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9c64073770 con 0x7f9c641ef860 2024-09-15T23:56:09.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c69582640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9c64073490 con 0x7f9c640ce280 2024-09-15T23:56:09.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c69582640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9c64073a50 con 0x7f9c4c004d50 2024-09-15T23:56:09.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c627fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c641ef860 0x7f9c641537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c627fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c641ef860 0x7f9c641537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34890/0 (socket says 172.21.15.112:34890) 2024-09-15T23:56:09.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c627fc640 1 -- 172.21.15.112:0/13583909 learned_addr learned my addr 172.21.15.112:0/13583909 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:09.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c62ffd640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c4c004d50 0x7f9c641f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c627fc640 1 -- 172.21.15.112:0/13583909 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c4c004d50 msgr2=0x7f9c641f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c627fc640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c4c004d50 0x7f9c641f3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c637fe640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c640ce280 0x7f9c640b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c627fc640 1 -- 172.21.15.112:0/13583909 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c640ce280 msgr2=0x7f9c640b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c627fc640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c640ce280 0x7f9c640b23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c627fc640 1 -- 172.21.15.112:0/13583909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c64150420 con 0x7f9c641ef860 2024-09-15T23:56:09.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c62ffd640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c4c004d50 0x7f9c641f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:09.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c627fc640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c641ef860 0x7f9c641537a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9c58001ec0 tx=0x7f9c5800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:09.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c4b7fe640 1 -- 172.21.15.112:0/13583909 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58019070 con 0x7f9c641ef860 2024-09-15T23:56:09.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c4b7fe640 1 -- 172.21.15.112:0/13583909 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5800de50 con 0x7f9c641ef860 2024-09-15T23:56:09.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.298+0000 7f9c4b7fe640 1 -- 172.21.15.112:0/13583909 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c580047f0 con 0x7f9c641ef860 2024-09-15T23:56:09.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.302+0000 7f9c69582640 1 -- 172.21.15.112:0/13583909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c641f3d50 con 0x7f9c641ef860 2024-09-15T23:56:09.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.302+0000 7f9c69582640 1 -- 172.21.15.112:0/13583909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c641f00b0 con 0x7f9c641ef860 2024-09-15T23:56:09.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.302+0000 7f9c69582640 1 -- 172.21.15.112:0/13583909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c64073d30 con 0x7f9c641ef860 2024-09-15T23:56:09.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.302+0000 7f9c4b7fe640 1 -- 172.21.15.112:0/13583909 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9c58004990 con 0x7f9c641ef860 2024-09-15T23:56:09.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.302+0000 7f9c4b7fe640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9c50067800 0x7f9c50069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.302+0000 7f9c4b7fe640 1 -- 172.21.15.112:0/13583909 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f9c58085890 con 0x7f9c641ef860 2024-09-15T23:56:09.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.302+0000 7f9c62ffd640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9c50067800 0x7f9c50069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.302+0000 7f9c62ffd640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9c50067800 0x7f9c50069cc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009aa0 tx=0x7f9c54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:09.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.306+0000 7f9c4b7fe640 1 -- 172.21.15.112:0/13583909 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9c64150420 con 0x7f9c641ef860 2024-09-15T23:56:09.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.470+0000 7f9c69582640 1 -- 172.21.15.112:0/13583909 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c64153ce0 con 0x7f9c641ef860 2024-09-15T23:56:09.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.474+0000 7f9c4b7fe640 1 -- 172.21.15.112:0/13583909 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+17004 (secure 0 0 0) 0x7f9c58056240 con 0x7f9c641ef860 2024-09-15T23:56:09.475 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:09.475 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":62,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:56:07.723382+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:04.716518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:05.136871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:09.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.474+0000 7f9c69582640 1 -- 172.21.15.112:0/13583909 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9c50067800 msgr2=0x7f9c50069cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.474+0000 7f9c69582640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9c50067800 0x7f9c50069cc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009aa0 tx=0x7f9c54008040 comp rx=0 tx=0).stop 2024-09-15T23:56:09.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.474+0000 7f9c69582640 1 -- 172.21.15.112:0/13583909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c641ef860 msgr2=0x7f9c641537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.474+0000 7f9c69582640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c641ef860 0x7f9c641537a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9c58001ec0 tx=0x7f9c5800dc00 comp rx=0 tx=0).stop 2024-09-15T23:56:09.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.474+0000 7f9c69582640 1 -- 172.21.15.112:0/13583909 shutdown_connections 2024-09-15T23:56:09.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.474+0000 7f9c69582640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9c50067800 0x7f9c50069cc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.474+0000 7f9c69582640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c640ce280 0x7f9c640b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.474+0000 7f9c69582640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c641ef860 0x7f9c641537a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.474+0000 7f9c69582640 1 --2- 172.21.15.112:0/13583909 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c4c004d50 0x7f9c641f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.474+0000 7f9c69582640 1 -- 172.21.15.112:0/13583909 >> 172.21.15.112:0/13583909 conn(0x7f9c640b1f90 msgr2=0x7f9c640d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:09.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.474+0000 7f9c69582640 1 -- 172.21.15.112:0/13583909 shutdown_connections 2024-09-15T23:56:09.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.474+0000 7f9c69582640 1 -- 172.21.15.112:0/13583909 wait complete. 2024-09-15T23:56:09.497 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:56:09.498 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:56:09.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa76bc1f640 1 Processor -- start 2024-09-15T23:56:09.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa76bc1f640 1 -- start start 2024-09-15T23:56:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa76bc1f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa76415bec0 0x7fa7640ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa76bc1f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa76415c2a0 0x7fa7640aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa76bc1f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7640b3290 con 0x7fa7640af2a0 2024-09-15T23:56:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa76bc1f640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa7640b3570 con 0x7fa76415c2a0 2024-09-15T23:56:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa76bc1f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa7640b3850 con 0x7fa76415bec0 2024-09-15T23:56:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa7691ba640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa76415c2a0 0x7fa7640aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa7691ba640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa76415c2a0 0x7fa7640aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34896/0 (socket says 172.21.15.112:34896) 2024-09-15T23:56:09.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa7691ba640 1 -- 172.21.15.112:0/1827106535 learned_addr learned my addr 172.21.15.112:0/1827106535 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:09.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa7699bb640 1 --2- 172.21.15.112:0/1827106535 >> v2:172.21.15.169:3300/0 conn(0x7fa76415bec0 0x7fa7640ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa7691ba640 1 -- 172.21.15.112:0/1827106535 >> v2:172.21.15.169:3300/0 conn(0x7fa76415bec0 msgr2=0x7fa7640ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:09.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa7691ba640 1 --2- 172.21.15.112:0/1827106535 >> v2:172.21.15.169:3300/0 conn(0x7fa76415bec0 0x7fa7640ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa7691ba640 1 -- 172.21.15.112:0/1827106535 >> v1:172.21.15.169:6789/0 conn(0x7fa7640af2a0 legacy=0x7fa76415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:09.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.614+0000 7fa7691ba640 1 -- 172.21.15.112:0/1827106535 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7640b3b30 con 0x7fa76415c2a0 2024-09-15T23:56:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7691ba640 1 --2- 172.21.15.112:0/1827106535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76415c2a0 0x7fa7640aed60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa764071710 tx=0x7fa75401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f5cd6d152e7f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7689b9640 1 -- 172.21.15.112:0/1827106535 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7540aa610 con 0x7fa76415c2a0 2024-09-15T23:56:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7689b9640 1 -- 172.21.15.112:0/1827106535 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7540af070 con 0x7fa76415c2a0 2024-09-15T23:56:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7689b9640 1 -- 172.21.15.112:0/1827106535 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7540aa9d0 con 0x7fa76415c2a0 2024-09-15T23:56:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1827106535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76415c2a0 msgr2=0x7fa7640aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 --2- 172.21.15.112:0/1827106535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76415c2a0 0x7fa7640aed60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa764071710 tx=0x7fa75401c4b0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1827106535 shutdown_connections 2024-09-15T23:56:09.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 --2- 172.21.15.112:0/1827106535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76415c2a0 0x7fa7640aed60 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 --2- 172.21.15.112:0/1827106535 >> v2:172.21.15.169:3300/0 conn(0x7fa76415bec0 0x7fa7640ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1827106535 >> 172.21.15.112:0/1827106535 conn(0x7fa7640b1f90 msgr2=0x7fa7640b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:09.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1827106535 shutdown_connections 2024-09-15T23:56:09.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1827106535 wait complete. 2024-09-15T23:56:09.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 Processor -- start 2024-09-15T23:56:09.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 -- start start 2024-09-15T23:56:09.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7640af2a0 0x7fa76409a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa76415bec0 0x7fa76414fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa76415c2a0 0x7fa7641506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa7640ad740 con 0x7fa7640af2a0 2024-09-15T23:56:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7640af710 con 0x7fa76415bec0 2024-09-15T23:56:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa764169000 con 0x7fa76415c2a0 2024-09-15T23:56:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7699bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7640af2a0 0x7fa76409a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7699bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7640af2a0 0x7fa76409a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34900/0 (socket says 172.21.15.112:34900) 2024-09-15T23:56:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7699bb640 1 -- 172.21.15.112:0/1041210122 learned_addr learned my addr 172.21.15.112:0/1041210122 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76a1bc640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa76415c2a0 0x7fa7641506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7691ba640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa76415bec0 0x7fa76414fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7699bb640 1 -- 172.21.15.112:0/1041210122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa76415c2a0 msgr2=0x7fa7641506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7699bb640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa76415c2a0 0x7fa7641506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7699bb640 1 -- 172.21.15.112:0/1041210122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa76415bec0 msgr2=0x7fa76414fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7699bb640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa76415bec0 0x7fa76414fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7699bb640 1 -- 172.21.15.112:0/1041210122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76415e230 con 0x7fa7640af2a0 2024-09-15T23:56:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7691ba640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa76415bec0 0x7fa76414fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa7699bb640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7640af2a0 0x7fa76409a280 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa76000d800 tx=0x7fa76000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa75a7fc640 1 -- 172.21.15.112:0/1041210122 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76000b6c0 con 0x7fa7640af2a0 2024-09-15T23:56:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa75a7fc640 1 -- 172.21.15.112:0/1041210122 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760019070 con 0x7fa7640af2a0 2024-09-15T23:56:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1041210122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76409a8f0 con 0x7fa7640af2a0 2024-09-15T23:56:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa75a7fc640 1 -- 172.21.15.112:0/1041210122 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76000ba60 con 0x7fa7640af2a0 2024-09-15T23:56:09.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.618+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1041210122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76415d750 con 0x7fa7640af2a0 2024-09-15T23:56:09.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.622+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1041210122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7640ad200 con 0x7fa7640af2a0 2024-09-15T23:56:09.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.622+0000 7fa75a7fc640 1 -- 172.21.15.112:0/1041210122 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa76000bc00 con 0x7fa7640af2a0 2024-09-15T23:56:09.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.622+0000 7fa75a7fc640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa7480678c0 0x7fa748069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.622+0000 7fa75a7fc640 1 -- 172.21.15.112:0/1041210122 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fa760086290 con 0x7fa7640af2a0 2024-09-15T23:56:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.622+0000 7fa7691ba640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa7480678c0 0x7fa748069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.622+0000 7fa7691ba640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa7480678c0 0x7fa748069d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa7540ae000 tx=0x7fa7540a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:09.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.626+0000 7fa75a7fc640 1 -- 172.21.15.112:0/1041210122 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa760056c40 con 0x7fa7640af2a0 2024-09-15T23:56:09.733 INFO:tasks.ceph.mds.a.smithi112.stderr:2024-09-15T23:56:09.730+0000 7fe35c275640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:56:09.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.786+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1041210122 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa76406fcd0 con 0x7fa7480678c0 2024-09-15T23:56:09.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.790+0000 7fa75a7fc640 1 -- 172.21.15.112:0/1041210122 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239366 (secure 0 0 0) 0x7fa76406fcd0 con 0x7fa7480678c0 2024-09-15T23:56:09.795 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:09.797 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:56:09.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.794+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1041210122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa7480678c0 msgr2=0x7fa748069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.794+0000 7fa76bc1f640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa7480678c0 0x7fa748069d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa7540ae000 tx=0x7fa7540a7000 comp rx=0 tx=0).stop 2024-09-15T23:56:09.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.794+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1041210122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7640af2a0 msgr2=0x7fa76409a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.794+0000 7fa76bc1f640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7640af2a0 0x7fa76409a280 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa76000d800 tx=0x7fa76000dcc0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.794+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1041210122 shutdown_connections 2024-09-15T23:56:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.794+0000 7fa76bc1f640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa7480678c0 0x7fa748069d80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.794+0000 7fa76bc1f640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa76415c2a0 0x7fa7641506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.794+0000 7fa76bc1f640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa76415bec0 0x7fa76414fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.794+0000 7fa76bc1f640 1 --2- 172.21.15.112:0/1041210122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7640af2a0 0x7fa76409a280 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.794+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1041210122 >> 172.21.15.112:0/1041210122 conn(0x7fa7640b1f90 msgr2=0x7fa764075030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.794+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1041210122 shutdown_connections 2024-09-15T23:56:09.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.794+0000 7fa76bc1f640 1 -- 172.21.15.112:0/1041210122 wait complete. 2024-09-15T23:56:09.815 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-09-15T23:56:09.275909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":169,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":255820,"kb_used_data":6304,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718900,"statfs":{"total":773094113280,"available":772832153600,"internally_reserved":0,"allocated":6455296,"data_stored":3493444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.503198"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.776915+0000","last_change":"2024-09-15T23:56:06.772768+0000","last_active":"2024-09-15T23:56:06.776915+0000","last_peered":"2024-09-15T23:56:06.776915+0000","last_clean":"2024-09-15T23:56:06.776915+0000","last_became_active":"2024-09-15T23:56:06.771754+0000","last_became_peered":"2024-09-15T23:56:06.771754+0000","last_unstale":"2024-09-15T23:56:06.776915+0000","last_undegraded":"2024-09-15T23:56:06.776915+0000","last_fullsized":"2024-09-15T23:56:06.776915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:31.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.784026+0000","last_change":"2024-09-15T23:56:06.782667+0000","last_active":"2024-09-15T23:56:06.784026+0000","last_peered":"2024-09-15T23:56:06.784026+0000","last_clean":"2024-09-15T23:56:06.784026+0000","last_became_active":"2024-09-15T23:56:06.782133+0000","last_became_peered":"2024-09-15T23:56:06.782133+0000","last_unstale":"2024-09-15T23:56:06.784026+0000","last_undegraded":"2024-09-15T23:56:06.784026+0000","last_fullsized":"2024-09-15T23:56:06.784026+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:21.431926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.784065+0000","last_change":"2024-09-15T23:56:06.782758+0000","last_active":"2024-09-15T23:56:06.784065+0000","last_peered":"2024-09-15T23:56:06.784065+0000","last_clean":"2024-09-15T23:56:06.784065+0000","last_became_active":"2024-09-15T23:56:06.782243+0000","last_became_peered":"2024-09-15T23:56:06.782243+0000","last_unstale":"2024-09-15T23:56:06.784065+0000","last_undegraded":"2024-09-15T23:56:06.784065+0000","last_fullsized":"2024-09-15T23:56:06.784065+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:57.427444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.776872+0000","last_change":"2024-09-15T23:56:06.772343+0000","last_active":"2024-09-15T23:56:06.776872+0000","last_peered":"2024-09-15T23:56:06.776872+0000","last_clean":"2024-09-15T23:56:06.776872+0000","last_became_active":"2024-09-15T23:56:06.771732+0000","last_became_peered":"2024-09-15T23:56:06.771732+0000","last_unstale":"2024-09-15T23:56:06.776872+0000","last_undegraded":"2024-09-15T23:56:06.776872+0000","last_fullsized":"2024-09-15T23:56:06.776872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:08.291329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.802378+0000","last_change":"2024-09-15T23:56:05.831362+0000","last_active":"2024-09-15T23:56:06.802378+0000","last_peered":"2024-09-15T23:56:06.802378+0000","last_clean":"2024-09-15T23:56:06.802378+0000","last_became_active":"2024-09-15T23:56:05.830767+0000","last_became_peered":"2024-09-15T23:56:05.830767+0000","last_unstale":"2024-09-15T23:56:06.802378+0000","last_undegraded":"2024-09-15T23:56:06.802378+0000","last_fullsized":"2024-09-15T23:56:06.802378+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:38.014144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.802624+0000","last_change":"2024-09-15T23:56:05.819028+0000","last_active":"2024-09-15T23:56:06.802624+0000","last_peered":"2024-09-15T23:56:06.802624+0000","last_clean":"2024-09-15T23:56:06.802624+0000","last_became_active":"2024-09-15T23:56:05.818281+0000","last_became_peered":"2024-09-15T23:56:05.818281+0000","last_unstale":"2024-09-15T23:56:06.802624+0000","last_undegraded":"2024-09-15T23:56:06.802624+0000","last_fullsized":"2024-09-15T23:56:06.802624+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:59.787456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.805360+0000","last_change":"2024-09-15T23:56:05.829166+0000","last_active":"2024-09-15T23:56:06.805360+0000","last_peered":"2024-09-15T23:56:06.805360+0000","last_clean":"2024-09-15T23:56:06.805360+0000","last_became_active":"2024-09-15T23:56:05.828476+0000","last_became_peered":"2024-09-15T23:56:05.828476+0000","last_unstale":"2024-09-15T23:56:06.805360+0000","last_undegraded":"2024-09-15T23:56:06.805360+0000","last_fullsized":"2024-09-15T23:56:06.805360+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:32.006457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.784064+0000","last_change":"2024-09-15T23:56:06.782993+0000","last_active":"2024-09-15T23:56:06.784064+0000","last_peered":"2024-09-15T23:56:06.784064+0000","last_clean":"2024-09-15T23:56:06.784064+0000","last_became_active":"2024-09-15T23:56:06.782455+0000","last_became_peered":"2024-09-15T23:56:06.782455+0000","last_unstale":"2024-09-15T23:56:06.784064+0000","last_undegraded":"2024-09-15T23:56:06.784064+0000","last_fullsized":"2024-09-15T23:56:06.784064+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:21.887861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.801534+0000","last_change":"2024-09-15T23:56:05.805390+0000","last_active":"2024-09-15T23:56:06.801534+0000","last_peered":"2024-09-15T23:56:06.801534+0000","last_clean":"2024-09-15T23:56:06.801534+0000","last_became_active":"2024-09-15T23:56:05.804691+0000","last_became_peered":"2024-09-15T23:56:05.804691+0000","last_unstale":"2024-09-15T23:56:06.801534+0000","last_undegraded":"2024-09-15T23:56:06.801534+0000","last_fullsized":"2024-09-15T23:56:06.801534+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:40.276819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.759980+0000","last_change":"2024-09-15T23:56:05.806127+0000","last_active":"2024-09-15T23:56:06.759980+0000","last_peered":"2024-09-15T23:56:06.759980+0000","last_clean":"2024-09-15T23:56:06.759980+0000","last_became_active":"2024-09-15T23:56:05.804982+0000","last_became_peered":"2024-09-15T23:56:05.804982+0000","last_unstale":"2024-09-15T23:56:06.759980+0000","last_undegraded":"2024-09-15T23:56:06.759980+0000","last_fullsized":"2024-09-15T23:56:06.759980+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:41.773267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.760461+0000","last_change":"2024-09-15T23:56:05.806883+0000","last_active":"2024-09-15T23:56:06.760461+0000","last_peered":"2024-09-15T23:56:06.760461+0000","last_clean":"2024-09-15T23:56:06.760461+0000","last_became_active":"2024-09-15T23:56:05.806162+0000","last_became_peered":"2024-09-15T23:56:05.806162+0000","last_unstale":"2024-09-15T23:56:06.760461+0000","last_undegraded":"2024-09-15T23:56:06.760461+0000","last_fullsized":"2024-09-15T23:56:06.760461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:09.390084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.776776+0000","last_change":"2024-09-15T23:56:06.771716+0000","last_active":"2024-09-15T23:56:06.776776+0000","last_peered":"2024-09-15T23:56:06.776776+0000","last_clean":"2024-09-15T23:56:06.776776+0000","last_became_active":"2024-09-15T23:56:06.771042+0000","last_became_peered":"2024-09-15T23:56:06.771042+0000","last_unstale":"2024-09-15T23:56:06.776776+0000","last_undegraded":"2024-09-15T23:56:06.776776+0000","last_fullsized":"2024-09-15T23:56:06.776776+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:41.916409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.767761+0000","last_change":"2024-09-15T23:56:05.823993+0000","last_active":"2024-09-15T23:56:06.767761+0000","last_peered":"2024-09-15T23:56:06.767761+0000","last_clean":"2024-09-15T23:56:06.767761+0000","last_became_active":"2024-09-15T23:56:05.822463+0000","last_became_peered":"2024-09-15T23:56:05.822463+0000","last_unstale":"2024-09-15T23:56:06.767761+0000","last_undegraded":"2024-09-15T23:56:06.767761+0000","last_fullsized":"2024-09-15T23:56:06.767761+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.412663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.767857+0000","last_change":"2024-09-15T23:56:05.808917+0000","last_active":"2024-09-15T23:56:06.767857+0000","last_peered":"2024-09-15T23:56:06.767857+0000","last_clean":"2024-09-15T23:56:06.767857+0000","last_became_active":"2024-09-15T23:56:05.808220+0000","last_became_peered":"2024-09-15T23:56:05.808220+0000","last_unstale":"2024-09-15T23:56:06.767857+0000","last_undegraded":"2024-09-15T23:56:06.767857+0000","last_fullsized":"2024-09-15T23:56:06.767857+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:50.965466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":236,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-15T23:56:03.803267+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:56:03.803267+0000","last_peered":"2024-09-15T23:56:03.803267+0000","last_clean":"2024-09-15T23:56:03.803267+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:56:03.803267+0000","last_undegraded":"2024-09-15T23:56:03.803267+0000","last_fullsized":"2024-09-15T23:56:03.803267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":16,"acting":16,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31820,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31868,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":692224,"data_stored":303943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1236992,"data_stored":872359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1310720,"data_stored":907187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:56:09.819 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:56:09.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.978+0000 7ff26bb52640 1 Processor -- start 2024-09-15T23:56:09.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.978+0000 7ff26bb52640 1 -- start start 2024-09-15T23:56:09.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff26bb52640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2640d3060 0x7ff2640cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff26bb52640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff2640cf450 0x7ff26406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff26bb52640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2640d0300 con 0x7ff264161a60 2024-09-15T23:56:09.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff26bb52640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff2640b0f60 con 0x7ff2640cf450 2024-09-15T23:56:09.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff26bb52640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff2640cfd40 con 0x7ff2640d3060 2024-09-15T23:56:09.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff2698ee640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff264161a60 0x7ff2640d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38324/0 (socket says 172.21.15.112:38324) 2024-09-15T23:56:09.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff2698ee640 1 -- 172.21.15.112:0/2356363236 learned_addr learned my addr 172.21.15.112:0/2356363236 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:09.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff26a0ef640 1 --2- 172.21.15.112:0/2356363236 >> v2:172.21.15.112:3300/0 conn(0x7ff2640cf450 0x7ff26406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff2688ec640 1 -- 172.21.15.112:0/2356363236 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081215772 0 0) 0x7ff260001120 con 0x7ff264161a60 2024-09-15T23:56:09.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff2690ed640 1 --2- 172.21.15.112:0/2356363236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2640d3060 0x7ff2640cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff2688ec640 1 -- 172.21.15.112:0/2356363236 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff250003530 con 0x7ff264161a60 2024-09-15T23:56:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff26a0ef640 1 -- 172.21.15.112:0/2356363236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2640d3060 msgr2=0x7ff2640cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff26a0ef640 1 --2- 172.21.15.112:0/2356363236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2640d3060 0x7ff2640cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff26a0ef640 1 -- 172.21.15.112:0/2356363236 >> v1:172.21.15.112:6789/0 conn(0x7ff264161a60 legacy=0x7ff2640d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff2688ec640 1 -- 172.21.15.112:0/2356363236 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2818465125 0 0) 0x7ff250003530 con 0x7ff264161a60 2024-09-15T23:56:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff26a0ef640 1 -- 172.21.15.112:0/2356363236 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2640d0020 con 0x7ff2640cf450 2024-09-15T23:56:09.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff2690ed640 1 --2- 172.21.15.112:0/2356363236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2640d3060 0x7ff2640cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:56:09.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff26a0ef640 1 --2- 172.21.15.112:0/2356363236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640cf450 0x7ff26406d6b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009d90 tx=0x7ff25c01c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ed0dae508bd7e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:09.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff2688ec640 1 -- 172.21.15.112:0/2356363236 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0b2070 con 0x7ff2640cf450 2024-09-15T23:56:09.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff2688ec640 1 -- 172.21.15.112:0/2356363236 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff25c0a55d0 con 0x7ff2640cf450 2024-09-15T23:56:09.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.982+0000 7ff2688ec640 1 -- 172.21.15.112:0/2356363236 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260001850 con 0x7ff2640cf450 2024-09-15T23:56:09.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 -- 172.21.15.112:0/2356363236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640cf450 msgr2=0x7ff26406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 --2- 172.21.15.112:0/2356363236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640cf450 0x7ff26406d6b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009d90 tx=0x7ff25c01c7d0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 -- 172.21.15.112:0/2356363236 shutdown_connections 2024-09-15T23:56:09.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 --2- 172.21.15.112:0/2356363236 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640cf450 0x7ff26406d6b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 --2- 172.21.15.112:0/2356363236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2640d3060 0x7ff2640cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 -- 172.21.15.112:0/2356363236 >> 172.21.15.112:0/2356363236 conn(0x7ff26408bf90 msgr2=0x7ff26409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:09.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 -- 172.21.15.112:0/2356363236 shutdown_connections 2024-09-15T23:56:09.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 -- 172.21.15.112:0/2356363236 wait complete. 2024-09-15T23:56:09.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 Processor -- start 2024-09-15T23:56:09.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 -- start start 2024-09-15T23:56:09.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2640cf450 0x7ff264154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640d3060 0x7ff264153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff264161a60 0x7ff2640c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff26406e400 con 0x7ff2640d3060 2024-09-15T23:56:09.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2640cfaf0 con 0x7ff264161a60 2024-09-15T23:56:09.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff26406e580 con 0x7ff2640cf450 2024-09-15T23:56:09.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff2690ed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640d3060 0x7ff264153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff2690ed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640d3060 0x7ff264153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34928/0 (socket says 172.21.15.112:34928) 2024-09-15T23:56:09.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff2690ed640 1 -- 172.21.15.112:0/3511351541 learned_addr learned my addr 172.21.15.112:0/3511351541 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:09.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff2698ee640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2640cf450 0x7ff264154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff2690ed640 1 -- 172.21.15.112:0/3511351541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2640cf450 msgr2=0x7ff264154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff2690ed640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2640cf450 0x7ff264154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26a0ef640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff264161a60 0x7ff2640c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:10.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff2690ed640 1 -- 172.21.15.112:0/3511351541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff264161a60 msgr2=0x7ff2640c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff2690ed640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff264161a60 0x7ff2640c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff2690ed640 1 -- 172.21.15.112:0/3511351541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2640d4500 con 0x7ff2640d3060 2024-09-15T23:56:10.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff2698ee640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2640cf450 0x7ff264154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:10.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff2690ed640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640d3060 0x7ff264153fd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff25400d800 tx=0x7ff25400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:10.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff25a7fc640 1 -- 172.21.15.112:0/3511351541 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff254018020 con 0x7ff2640d3060 2024-09-15T23:56:10.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff25a7fc640 1 -- 172.21.15.112:0/3511351541 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2540096c0 con 0x7ff2640d3060 2024-09-15T23:56:10.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 -- 172.21.15.112:0/3511351541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2641fb5a0 con 0x7ff2640d3060 2024-09-15T23:56:10.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff25a7fc640 1 -- 172.21.15.112:0/3511351541 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff254009ab0 con 0x7ff2640d3060 2024-09-15T23:56:10.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.986+0000 7ff26bb52640 1 -- 172.21.15.112:0/3511351541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2641fa920 con 0x7ff2640d3060 2024-09-15T23:56:10.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.990+0000 7ff26bb52640 1 -- 172.21.15.112:0/3511351541 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff26406d6b0 con 0x7ff2640d3060 2024-09-15T23:56:10.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.990+0000 7ff25a7fc640 1 -- 172.21.15.112:0/3511351541 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff25401b020 con 0x7ff2640d3060 2024-09-15T23:56:10.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.990+0000 7ff25a7fc640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff2480678c0 0x7ff248069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.990+0000 7ff2698ee640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff2480678c0 0x7ff248069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:10.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.990+0000 7ff25a7fc640 1 -- 172.21.15.112:0/3511351541 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7ff254086350 con 0x7ff2640d3060 2024-09-15T23:56:10.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.990+0000 7ff2698ee640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff2480678c0 0x7ff248069d80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff260001ec0 tx=0x7ff260009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:10.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:09.994+0000 7ff25a7fc640 1 -- 172.21.15.112:0/3511351541 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff254022020 con 0x7ff2640d3060 2024-09-15T23:56:10.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.154+0000 7ff26bb52640 1 -- 172.21.15.112:0/3511351541 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2640d2c30 con 0x7ff2480678c0 2024-09-15T23:56:10.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.162+0000 7ff25a7fc640 1 -- 172.21.15.112:0/3511351541 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239366 (secure 0 0 0) 0x7ff2640d2c30 con 0x7ff2480678c0 2024-09-15T23:56:10.164 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:10.166 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:56:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.166+0000 7ff26bb52640 1 -- 172.21.15.112:0/3511351541 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff2480678c0 msgr2=0x7ff248069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.166+0000 7ff26bb52640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff2480678c0 0x7ff248069d80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff260001ec0 tx=0x7ff260009040 comp rx=0 tx=0).stop 2024-09-15T23:56:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.166+0000 7ff26bb52640 1 -- 172.21.15.112:0/3511351541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640d3060 msgr2=0x7ff264153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.166+0000 7ff26bb52640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640d3060 0x7ff264153fd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff25400d800 tx=0x7ff25400dcc0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.166+0000 7ff26bb52640 1 -- 172.21.15.112:0/3511351541 shutdown_connections 2024-09-15T23:56:10.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.166+0000 7ff26bb52640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff2480678c0 0x7ff248069d80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.166+0000 7ff26bb52640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff264161a60 0x7ff2640c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.166+0000 7ff26bb52640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2640d3060 0x7ff264153fd0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.166+0000 7ff26bb52640 1 --2- 172.21.15.112:0/3511351541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2640cf450 0x7ff264154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.166+0000 7ff26bb52640 1 -- 172.21.15.112:0/3511351541 >> 172.21.15.112:0/3511351541 conn(0x7ff26408bf90 msgr2=0x7ff264158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:10.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.166+0000 7ff26bb52640 1 -- 172.21.15.112:0/3511351541 shutdown_connections 2024-09-15T23:56:10.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.166+0000 7ff26bb52640 1 -- 172.21.15.112:0/3511351541 wait complete. 2024-09-15T23:56:10.184 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-09-15T23:56:09.275909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":169,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":255820,"kb_used_data":6304,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718900,"statfs":{"total":773094113280,"available":772832153600,"internally_reserved":0,"allocated":6455296,"data_stored":3493444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.503198"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.776915+0000","last_change":"2024-09-15T23:56:06.772768+0000","last_active":"2024-09-15T23:56:06.776915+0000","last_peered":"2024-09-15T23:56:06.776915+0000","last_clean":"2024-09-15T23:56:06.776915+0000","last_became_active":"2024-09-15T23:56:06.771754+0000","last_became_peered":"2024-09-15T23:56:06.771754+0000","last_unstale":"2024-09-15T23:56:06.776915+0000","last_undegraded":"2024-09-15T23:56:06.776915+0000","last_fullsized":"2024-09-15T23:56:06.776915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:31.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.784026+0000","last_change":"2024-09-15T23:56:06.782667+0000","last_active":"2024-09-15T23:56:06.784026+0000","last_peered":"2024-09-15T23:56:06.784026+0000","last_clean":"2024-09-15T23:56:06.784026+0000","last_became_active":"2024-09-15T23:56:06.782133+0000","last_became_peered":"2024-09-15T23:56:06.782133+0000","last_unstale":"2024-09-15T23:56:06.784026+0000","last_undegraded":"2024-09-15T23:56:06.784026+0000","last_fullsized":"2024-09-15T23:56:06.784026+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:21.431926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.784065+0000","last_change":"2024-09-15T23:56:06.782758+0000","last_active":"2024-09-15T23:56:06.784065+0000","last_peered":"2024-09-15T23:56:06.784065+0000","last_clean":"2024-09-15T23:56:06.784065+0000","last_became_active":"2024-09-15T23:56:06.782243+0000","last_became_peered":"2024-09-15T23:56:06.782243+0000","last_unstale":"2024-09-15T23:56:06.784065+0000","last_undegraded":"2024-09-15T23:56:06.784065+0000","last_fullsized":"2024-09-15T23:56:06.784065+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:57.427444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.776872+0000","last_change":"2024-09-15T23:56:06.772343+0000","last_active":"2024-09-15T23:56:06.776872+0000","last_peered":"2024-09-15T23:56:06.776872+0000","last_clean":"2024-09-15T23:56:06.776872+0000","last_became_active":"2024-09-15T23:56:06.771732+0000","last_became_peered":"2024-09-15T23:56:06.771732+0000","last_unstale":"2024-09-15T23:56:06.776872+0000","last_undegraded":"2024-09-15T23:56:06.776872+0000","last_fullsized":"2024-09-15T23:56:06.776872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:08.291329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.802378+0000","last_change":"2024-09-15T23:56:05.831362+0000","last_active":"2024-09-15T23:56:06.802378+0000","last_peered":"2024-09-15T23:56:06.802378+0000","last_clean":"2024-09-15T23:56:06.802378+0000","last_became_active":"2024-09-15T23:56:05.830767+0000","last_became_peered":"2024-09-15T23:56:05.830767+0000","last_unstale":"2024-09-15T23:56:06.802378+0000","last_undegraded":"2024-09-15T23:56:06.802378+0000","last_fullsized":"2024-09-15T23:56:06.802378+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:38.014144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.802624+0000","last_change":"2024-09-15T23:56:05.819028+0000","last_active":"2024-09-15T23:56:06.802624+0000","last_peered":"2024-09-15T23:56:06.802624+0000","last_clean":"2024-09-15T23:56:06.802624+0000","last_became_active":"2024-09-15T23:56:05.818281+0000","last_became_peered":"2024-09-15T23:56:05.818281+0000","last_unstale":"2024-09-15T23:56:06.802624+0000","last_undegraded":"2024-09-15T23:56:06.802624+0000","last_fullsized":"2024-09-15T23:56:06.802624+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:59.787456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.805360+0000","last_change":"2024-09-15T23:56:05.829166+0000","last_active":"2024-09-15T23:56:06.805360+0000","last_peered":"2024-09-15T23:56:06.805360+0000","last_clean":"2024-09-15T23:56:06.805360+0000","last_became_active":"2024-09-15T23:56:05.828476+0000","last_became_peered":"2024-09-15T23:56:05.828476+0000","last_unstale":"2024-09-15T23:56:06.805360+0000","last_undegraded":"2024-09-15T23:56:06.805360+0000","last_fullsized":"2024-09-15T23:56:06.805360+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:32.006457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.784064+0000","last_change":"2024-09-15T23:56:06.782993+0000","last_active":"2024-09-15T23:56:06.784064+0000","last_peered":"2024-09-15T23:56:06.784064+0000","last_clean":"2024-09-15T23:56:06.784064+0000","last_became_active":"2024-09-15T23:56:06.782455+0000","last_became_peered":"2024-09-15T23:56:06.782455+0000","last_unstale":"2024-09-15T23:56:06.784064+0000","last_undegraded":"2024-09-15T23:56:06.784064+0000","last_fullsized":"2024-09-15T23:56:06.784064+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:21.887861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.801534+0000","last_change":"2024-09-15T23:56:05.805390+0000","last_active":"2024-09-15T23:56:06.801534+0000","last_peered":"2024-09-15T23:56:06.801534+0000","last_clean":"2024-09-15T23:56:06.801534+0000","last_became_active":"2024-09-15T23:56:05.804691+0000","last_became_peered":"2024-09-15T23:56:05.804691+0000","last_unstale":"2024-09-15T23:56:06.801534+0000","last_undegraded":"2024-09-15T23:56:06.801534+0000","last_fullsized":"2024-09-15T23:56:06.801534+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:40.276819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.759980+0000","last_change":"2024-09-15T23:56:05.806127+0000","last_active":"2024-09-15T23:56:06.759980+0000","last_peered":"2024-09-15T23:56:06.759980+0000","last_clean":"2024-09-15T23:56:06.759980+0000","last_became_active":"2024-09-15T23:56:05.804982+0000","last_became_peered":"2024-09-15T23:56:05.804982+0000","last_unstale":"2024-09-15T23:56:06.759980+0000","last_undegraded":"2024-09-15T23:56:06.759980+0000","last_fullsized":"2024-09-15T23:56:06.759980+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:41.773267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.760461+0000","last_change":"2024-09-15T23:56:05.806883+0000","last_active":"2024-09-15T23:56:06.760461+0000","last_peered":"2024-09-15T23:56:06.760461+0000","last_clean":"2024-09-15T23:56:06.760461+0000","last_became_active":"2024-09-15T23:56:05.806162+0000","last_became_peered":"2024-09-15T23:56:05.806162+0000","last_unstale":"2024-09-15T23:56:06.760461+0000","last_undegraded":"2024-09-15T23:56:06.760461+0000","last_fullsized":"2024-09-15T23:56:06.760461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:09.390084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.776776+0000","last_change":"2024-09-15T23:56:06.771716+0000","last_active":"2024-09-15T23:56:06.776776+0000","last_peered":"2024-09-15T23:56:06.776776+0000","last_clean":"2024-09-15T23:56:06.776776+0000","last_became_active":"2024-09-15T23:56:06.771042+0000","last_became_peered":"2024-09-15T23:56:06.771042+0000","last_unstale":"2024-09-15T23:56:06.776776+0000","last_undegraded":"2024-09-15T23:56:06.776776+0000","last_fullsized":"2024-09-15T23:56:06.776776+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:41.916409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.767761+0000","last_change":"2024-09-15T23:56:05.823993+0000","last_active":"2024-09-15T23:56:06.767761+0000","last_peered":"2024-09-15T23:56:06.767761+0000","last_clean":"2024-09-15T23:56:06.767761+0000","last_became_active":"2024-09-15T23:56:05.822463+0000","last_became_peered":"2024-09-15T23:56:05.822463+0000","last_unstale":"2024-09-15T23:56:06.767761+0000","last_undegraded":"2024-09-15T23:56:06.767761+0000","last_fullsized":"2024-09-15T23:56:06.767761+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.412663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.767857+0000","last_change":"2024-09-15T23:56:05.808917+0000","last_active":"2024-09-15T23:56:06.767857+0000","last_peered":"2024-09-15T23:56:06.767857+0000","last_clean":"2024-09-15T23:56:06.767857+0000","last_became_active":"2024-09-15T23:56:05.808220+0000","last_became_peered":"2024-09-15T23:56:05.808220+0000","last_unstale":"2024-09-15T23:56:06.767857+0000","last_undegraded":"2024-09-15T23:56:06.767857+0000","last_fullsized":"2024-09-15T23:56:06.767857+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:50.965466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":236,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-15T23:56:03.803267+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:56:03.803267+0000","last_peered":"2024-09-15T23:56:03.803267+0000","last_clean":"2024-09-15T23:56:03.803267+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:56:03.803267+0000","last_undegraded":"2024-09-15T23:56:03.803267+0000","last_fullsized":"2024-09-15T23:56:03.803267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":16,"acting":16,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31820,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31868,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":692224,"data_stored":303943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1236992,"data_stored":872359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1310720,"data_stored":907187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:56:10.188 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:56:10.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f058b5de640 1 Processor -- start 2024-09-15T23:56:10.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f058b5de640 1 -- start start 2024-09-15T23:56:10.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f058b5de640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f058406fef0 0x7f058406e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f058b5de640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05840b3d50 0x7f05840b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f058b5de640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f058406ee50 con 0x7f0584073e60 2024-09-15T23:56:10.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f058b5de640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f05840b46c0 con 0x7f05840b3d50 2024-09-15T23:56:10.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f058b5de640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f058406f130 con 0x7f058406fef0 2024-09-15T23:56:10.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f0589b7b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05840b3d50 0x7f05840b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:10.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f0589b7b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05840b3d50 0x7f05840b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34934/0 (socket says 172.21.15.112:34934) 2024-09-15T23:56:10.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f0589b7b640 1 -- 172.21.15.112:0/574901499 learned_addr learned my addr 172.21.15.112:0/574901499 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:10.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f0589b7b640 1 -- 172.21.15.112:0/574901499 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f058406fef0 msgr2=0x7f058406e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:10.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f0589b7b640 1 --2- 172.21.15.112:0/574901499 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f058406fef0 0x7f058406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f0589b7b640 1 -- 172.21.15.112:0/574901499 >> v1:172.21.15.112:6789/0 conn(0x7f0584073e60 legacy=0x7f058415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f0589b7b640 1 -- 172.21.15.112:0/574901499 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058406f410 con 0x7f05840b3d50 2024-09-15T23:56:10.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.338+0000 7f0589b7b640 1 --2- 172.21.15.112:0/574901499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840b3d50 0x7f05840b4180 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f057c009e50 tx=0x7f057c01dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bd6e5c9a3cfa2d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:10.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f057bfff640 1 -- 172.21.15.112:0/574901499 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c0a67a0 con 0x7f05840b3d50 2024-09-15T23:56:10.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f057bfff640 1 -- 172.21.15.112:0/574901499 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057c0a6940 con 0x7f05840b3d50 2024-09-15T23:56:10.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f057bfff640 1 -- 172.21.15.112:0/574901499 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c0a6d10 con 0x7f05840b3d50 2024-09-15T23:56:10.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 -- 172.21.15.112:0/574901499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840b3d50 msgr2=0x7f05840b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 --2- 172.21.15.112:0/574901499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840b3d50 0x7f05840b4180 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f057c009e50 tx=0x7f057c01dab0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 -- 172.21.15.112:0/574901499 shutdown_connections 2024-09-15T23:56:10.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 --2- 172.21.15.112:0/574901499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840b3d50 0x7f05840b4180 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 --2- 172.21.15.112:0/574901499 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f058406fef0 0x7f058406e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 -- 172.21.15.112:0/574901499 >> 172.21.15.112:0/574901499 conn(0x7f05840b1f90 msgr2=0x7f05840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:10.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 -- 172.21.15.112:0/574901499 shutdown_connections 2024-09-15T23:56:10.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 -- 172.21.15.112:0/574901499 wait complete. 2024-09-15T23:56:10.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 Processor -- start 2024-09-15T23:56:10.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 -- start start 2024-09-15T23:56:10.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f058406fef0 0x7f058414d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0584073e60 0x7f058414a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840b3d50 0x7f05841504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f05840729e0 con 0x7f05840b3d50 2024-09-15T23:56:10.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0584072860 con 0x7f0584073e60 2024-09-15T23:56:10.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058b5de640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0584072b60 con 0x7f058406fef0 2024-09-15T23:56:10.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f0589b7b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840b3d50 0x7f05841504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:10.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f0589b7b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840b3d50 0x7f05841504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34950/0 (socket says 172.21.15.112:34950) 2024-09-15T23:56:10.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f0589b7b640 1 -- 172.21.15.112:0/3969989982 learned_addr learned my addr 172.21.15.112:0/3969989982 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:10.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f058937a640 1 --2- 172.21.15.112:0/3969989982 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f058406fef0 0x7f058414d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:10.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f0588b79640 1 --2- 172.21.15.112:0/3969989982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0584073e60 0x7f058414a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:10.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f0589b7b640 1 -- 172.21.15.112:0/3969989982 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f058406fef0 msgr2=0x7f058414d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f0589b7b640 1 --2- 172.21.15.112:0/3969989982 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f058406fef0 0x7f058414d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f0589b7b640 1 -- 172.21.15.112:0/3969989982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0584073e60 msgr2=0x7f058414a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f0589b7b640 1 --2- 172.21.15.112:0/3969989982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0584073e60 0x7f058414a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f0589b7b640 1 -- 172.21.15.112:0/3969989982 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058414e9c0 con 0x7f05840b3d50 2024-09-15T23:56:10.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f0589b7b640 1 --2- 172.21.15.112:0/3969989982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840b3d50 0x7f05841504f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f057c0b0040 tx=0x7f057c01c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:10.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f0579ffb640 1 -- 172.21.15.112:0/3969989982 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c0bc020 con 0x7f05840b3d50 2024-09-15T23:56:10.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f0579ffb640 1 -- 172.21.15.112:0/3969989982 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057c0b8620 con 0x7f05840b3d50 2024-09-15T23:56:10.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.342+0000 7f0579ffb640 1 -- 172.21.15.112:0/3969989982 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c0b8a10 con 0x7f05840b3d50 2024-09-15T23:56:10.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.346+0000 7f058b5de640 1 -- 172.21.15.112:0/3969989982 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058414e120 con 0x7f05840b3d50 2024-09-15T23:56:10.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.346+0000 7f058b5de640 1 -- 172.21.15.112:0/3969989982 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f058414e6e0 con 0x7f05840b3d50 2024-09-15T23:56:10.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.346+0000 7f058b5de640 1 -- 172.21.15.112:0/3969989982 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f058414dea0 con 0x7f05840b3d50 2024-09-15T23:56:10.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.346+0000 7f0579ffb640 1 -- 172.21.15.112:0/3969989982 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f057c0bf020 con 0x7f05840b3d50 2024-09-15T23:56:10.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.346+0000 7f0579ffb640 1 --2- 172.21.15.112:0/3969989982 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f05680678c0 0x7f0568069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.346+0000 7f0579ffb640 1 -- 172.21.15.112:0/3969989982 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f057c1209b0 con 0x7f05840b3d50 2024-09-15T23:56:10.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.346+0000 7f058937a640 1 --2- 172.21.15.112:0/3969989982 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f05680678c0 0x7f0568069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:10.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.346+0000 7f058937a640 1 --2- 172.21.15.112:0/3969989982 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f05680678c0 0x7f0568069d80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0574001650 tx=0x7f0574009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:10.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.350+0000 7f0579ffb640 1 -- 172.21.15.112:0/3969989982 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f058414dea0 con 0x7f05840b3d50 2024-09-15T23:56:10.501 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.498+0000 7f058b5de640 1 -- 172.21.15.112:0/3969989982 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f058406e800 con 0x7f05680678c0 2024-09-15T23:56:10.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.514+0000 7f0579ffb640 1 -- 172.21.15.112:0/3969989982 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239366 (secure 0 0 0) 0x7f058406e800 con 0x7f05680678c0 2024-09-15T23:56:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:10.520 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:56:10.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.518+0000 7f058b5de640 1 -- 172.21.15.112:0/3969989982 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f05680678c0 msgr2=0x7f0568069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.518+0000 7f058b5de640 1 --2- 172.21.15.112:0/3969989982 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f05680678c0 0x7f0568069d80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0574001650 tx=0x7f0574009040 comp rx=0 tx=0).stop 2024-09-15T23:56:10.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.518+0000 7f058b5de640 1 -- 172.21.15.112:0/3969989982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840b3d50 msgr2=0x7f05841504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.518+0000 7f058b5de640 1 --2- 172.21.15.112:0/3969989982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840b3d50 0x7f05841504f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f057c0b0040 tx=0x7f057c01c2f0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.518+0000 7f058b5de640 1 -- 172.21.15.112:0/3969989982 shutdown_connections 2024-09-15T23:56:10.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.518+0000 7f058b5de640 1 --2- 172.21.15.112:0/3969989982 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f05680678c0 0x7f0568069d80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.518+0000 7f058b5de640 1 --2- 172.21.15.112:0/3969989982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05840b3d50 0x7f05841504f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.518+0000 7f058b5de640 1 --2- 172.21.15.112:0/3969989982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0584073e60 0x7f058414a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.518+0000 7f058b5de640 1 --2- 172.21.15.112:0/3969989982 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f058406fef0 0x7f058414d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.518+0000 7f058b5de640 1 -- 172.21.15.112:0/3969989982 >> 172.21.15.112:0/3969989982 conn(0x7f05840b1f90 msgr2=0x7f0584075150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:10.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.518+0000 7f058b5de640 1 -- 172.21.15.112:0/3969989982 shutdown_connections 2024-09-15T23:56:10.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.518+0000 7f058b5de640 1 -- 172.21.15.112:0/3969989982 wait complete. 2024-09-15T23:56:10.536 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-09-15T23:56:09.275909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":169,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":255820,"kb_used_data":6304,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718900,"statfs":{"total":773094113280,"available":772832153600,"internally_reserved":0,"allocated":6455296,"data_stored":3493444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.503198"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.776915+0000","last_change":"2024-09-15T23:56:06.772768+0000","last_active":"2024-09-15T23:56:06.776915+0000","last_peered":"2024-09-15T23:56:06.776915+0000","last_clean":"2024-09-15T23:56:06.776915+0000","last_became_active":"2024-09-15T23:56:06.771754+0000","last_became_peered":"2024-09-15T23:56:06.771754+0000","last_unstale":"2024-09-15T23:56:06.776915+0000","last_undegraded":"2024-09-15T23:56:06.776915+0000","last_fullsized":"2024-09-15T23:56:06.776915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:31.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.784026+0000","last_change":"2024-09-15T23:56:06.782667+0000","last_active":"2024-09-15T23:56:06.784026+0000","last_peered":"2024-09-15T23:56:06.784026+0000","last_clean":"2024-09-15T23:56:06.784026+0000","last_became_active":"2024-09-15T23:56:06.782133+0000","last_became_peered":"2024-09-15T23:56:06.782133+0000","last_unstale":"2024-09-15T23:56:06.784026+0000","last_undegraded":"2024-09-15T23:56:06.784026+0000","last_fullsized":"2024-09-15T23:56:06.784026+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:21.431926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.784065+0000","last_change":"2024-09-15T23:56:06.782758+0000","last_active":"2024-09-15T23:56:06.784065+0000","last_peered":"2024-09-15T23:56:06.784065+0000","last_clean":"2024-09-15T23:56:06.784065+0000","last_became_active":"2024-09-15T23:56:06.782243+0000","last_became_peered":"2024-09-15T23:56:06.782243+0000","last_unstale":"2024-09-15T23:56:06.784065+0000","last_undegraded":"2024-09-15T23:56:06.784065+0000","last_fullsized":"2024-09-15T23:56:06.784065+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:57.427444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.776872+0000","last_change":"2024-09-15T23:56:06.772343+0000","last_active":"2024-09-15T23:56:06.776872+0000","last_peered":"2024-09-15T23:56:06.776872+0000","last_clean":"2024-09-15T23:56:06.776872+0000","last_became_active":"2024-09-15T23:56:06.771732+0000","last_became_peered":"2024-09-15T23:56:06.771732+0000","last_unstale":"2024-09-15T23:56:06.776872+0000","last_undegraded":"2024-09-15T23:56:06.776872+0000","last_fullsized":"2024-09-15T23:56:06.776872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:08.291329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.802378+0000","last_change":"2024-09-15T23:56:05.831362+0000","last_active":"2024-09-15T23:56:06.802378+0000","last_peered":"2024-09-15T23:56:06.802378+0000","last_clean":"2024-09-15T23:56:06.802378+0000","last_became_active":"2024-09-15T23:56:05.830767+0000","last_became_peered":"2024-09-15T23:56:05.830767+0000","last_unstale":"2024-09-15T23:56:06.802378+0000","last_undegraded":"2024-09-15T23:56:06.802378+0000","last_fullsized":"2024-09-15T23:56:06.802378+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:38.014144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.802624+0000","last_change":"2024-09-15T23:56:05.819028+0000","last_active":"2024-09-15T23:56:06.802624+0000","last_peered":"2024-09-15T23:56:06.802624+0000","last_clean":"2024-09-15T23:56:06.802624+0000","last_became_active":"2024-09-15T23:56:05.818281+0000","last_became_peered":"2024-09-15T23:56:05.818281+0000","last_unstale":"2024-09-15T23:56:06.802624+0000","last_undegraded":"2024-09-15T23:56:06.802624+0000","last_fullsized":"2024-09-15T23:56:06.802624+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:59.787456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.805360+0000","last_change":"2024-09-15T23:56:05.829166+0000","last_active":"2024-09-15T23:56:06.805360+0000","last_peered":"2024-09-15T23:56:06.805360+0000","last_clean":"2024-09-15T23:56:06.805360+0000","last_became_active":"2024-09-15T23:56:05.828476+0000","last_became_peered":"2024-09-15T23:56:05.828476+0000","last_unstale":"2024-09-15T23:56:06.805360+0000","last_undegraded":"2024-09-15T23:56:06.805360+0000","last_fullsized":"2024-09-15T23:56:06.805360+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:32.006457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.784064+0000","last_change":"2024-09-15T23:56:06.782993+0000","last_active":"2024-09-15T23:56:06.784064+0000","last_peered":"2024-09-15T23:56:06.784064+0000","last_clean":"2024-09-15T23:56:06.784064+0000","last_became_active":"2024-09-15T23:56:06.782455+0000","last_became_peered":"2024-09-15T23:56:06.782455+0000","last_unstale":"2024-09-15T23:56:06.784064+0000","last_undegraded":"2024-09-15T23:56:06.784064+0000","last_fullsized":"2024-09-15T23:56:06.784064+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:21.887861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.801534+0000","last_change":"2024-09-15T23:56:05.805390+0000","last_active":"2024-09-15T23:56:06.801534+0000","last_peered":"2024-09-15T23:56:06.801534+0000","last_clean":"2024-09-15T23:56:06.801534+0000","last_became_active":"2024-09-15T23:56:05.804691+0000","last_became_peered":"2024-09-15T23:56:05.804691+0000","last_unstale":"2024-09-15T23:56:06.801534+0000","last_undegraded":"2024-09-15T23:56:06.801534+0000","last_fullsized":"2024-09-15T23:56:06.801534+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:40.276819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.759980+0000","last_change":"2024-09-15T23:56:05.806127+0000","last_active":"2024-09-15T23:56:06.759980+0000","last_peered":"2024-09-15T23:56:06.759980+0000","last_clean":"2024-09-15T23:56:06.759980+0000","last_became_active":"2024-09-15T23:56:05.804982+0000","last_became_peered":"2024-09-15T23:56:05.804982+0000","last_unstale":"2024-09-15T23:56:06.759980+0000","last_undegraded":"2024-09-15T23:56:06.759980+0000","last_fullsized":"2024-09-15T23:56:06.759980+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:41.773267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.760461+0000","last_change":"2024-09-15T23:56:05.806883+0000","last_active":"2024-09-15T23:56:06.760461+0000","last_peered":"2024-09-15T23:56:06.760461+0000","last_clean":"2024-09-15T23:56:06.760461+0000","last_became_active":"2024-09-15T23:56:05.806162+0000","last_became_peered":"2024-09-15T23:56:05.806162+0000","last_unstale":"2024-09-15T23:56:06.760461+0000","last_undegraded":"2024-09-15T23:56:06.760461+0000","last_fullsized":"2024-09-15T23:56:06.760461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:09.390084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.776776+0000","last_change":"2024-09-15T23:56:06.771716+0000","last_active":"2024-09-15T23:56:06.776776+0000","last_peered":"2024-09-15T23:56:06.776776+0000","last_clean":"2024-09-15T23:56:06.776776+0000","last_became_active":"2024-09-15T23:56:06.771042+0000","last_became_peered":"2024-09-15T23:56:06.771042+0000","last_unstale":"2024-09-15T23:56:06.776776+0000","last_undegraded":"2024-09-15T23:56:06.776776+0000","last_fullsized":"2024-09-15T23:56:06.776776+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:41.916409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.767761+0000","last_change":"2024-09-15T23:56:05.823993+0000","last_active":"2024-09-15T23:56:06.767761+0000","last_peered":"2024-09-15T23:56:06.767761+0000","last_clean":"2024-09-15T23:56:06.767761+0000","last_became_active":"2024-09-15T23:56:05.822463+0000","last_became_peered":"2024-09-15T23:56:05.822463+0000","last_unstale":"2024-09-15T23:56:06.767761+0000","last_undegraded":"2024-09-15T23:56:06.767761+0000","last_fullsized":"2024-09-15T23:56:06.767761+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.412663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.767857+0000","last_change":"2024-09-15T23:56:05.808917+0000","last_active":"2024-09-15T23:56:06.767857+0000","last_peered":"2024-09-15T23:56:06.767857+0000","last_clean":"2024-09-15T23:56:06.767857+0000","last_became_active":"2024-09-15T23:56:05.808220+0000","last_became_peered":"2024-09-15T23:56:05.808220+0000","last_unstale":"2024-09-15T23:56:06.767857+0000","last_undegraded":"2024-09-15T23:56:06.767857+0000","last_fullsized":"2024-09-15T23:56:06.767857+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:50.965466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":236,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-15T23:56:03.803267+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:56:03.803267+0000","last_peered":"2024-09-15T23:56:03.803267+0000","last_clean":"2024-09-15T23:56:03.803267+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:56:03.803267+0000","last_undegraded":"2024-09-15T23:56:03.803267+0000","last_fullsized":"2024-09-15T23:56:03.803267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":16,"acting":16,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31820,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31868,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":692224,"data_stored":303943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1236992,"data_stored":872359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1310720,"data_stored":907187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:56:10.540 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3f is not active+clean 2024-09-15T23:56:10.540 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.541 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3d is not active+clean 2024-09-15T23:56:10.541 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.541 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3c is not active+clean 2024-09-15T23:56:10.541 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.541 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3b is not active+clean 2024-09-15T23:56:10.541 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.541 INFO:tasks.ceph.ceph_manager.ceph:PG 10.39 is not active+clean 2024-09-15T23:56:10.541 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.541 INFO:tasks.ceph.ceph_manager.ceph:PG 10.38 is not active+clean 2024-09-15T23:56:10.541 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.542 INFO:tasks.ceph.ceph_manager.ceph:PG 10.37 is not active+clean 2024-09-15T23:56:10.542 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.542 INFO:tasks.ceph.ceph_manager.ceph:PG 10.36 is not active+clean 2024-09-15T23:56:10.542 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.542 INFO:tasks.ceph.ceph_manager.ceph:PG 10.35 is not active+clean 2024-09-15T23:56:10.542 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.542 INFO:tasks.ceph.ceph_manager.ceph:PG 10.34 is not active+clean 2024-09-15T23:56:10.542 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.542 INFO:tasks.ceph.ceph_manager.ceph:PG 10.33 is not active+clean 2024-09-15T23:56:10.542 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.543 INFO:tasks.ceph.ceph_manager.ceph:PG 10.32 is not active+clean 2024-09-15T23:56:10.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.543 INFO:tasks.ceph.ceph_manager.ceph:PG 10.31 is not active+clean 2024-09-15T23:56:10.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.543 INFO:tasks.ceph.ceph_manager.ceph:PG 10.30 is not active+clean 2024-09-15T23:56:10.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.543 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2f is not active+clean 2024-09-15T23:56:10.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.543 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2e is not active+clean 2024-09-15T23:56:10.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.543 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2d is not active+clean 2024-09-15T23:56:10.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.544 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2c is not active+clean 2024-09-15T23:56:10.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.544 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2b is not active+clean 2024-09-15T23:56:10.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.544 INFO:tasks.ceph.ceph_manager.ceph:PG 10.29 is not active+clean 2024-09-15T23:56:10.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.544 INFO:tasks.ceph.ceph_manager.ceph:PG 10.28 is not active+clean 2024-09-15T23:56:10.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.544 INFO:tasks.ceph.ceph_manager.ceph:PG 10.27 is not active+clean 2024-09-15T23:56:10.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.545 INFO:tasks.ceph.ceph_manager.ceph:PG 10.26 is not active+clean 2024-09-15T23:56:10.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.545 INFO:tasks.ceph.ceph_manager.ceph:PG 10.25 is not active+clean 2024-09-15T23:56:10.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.545 INFO:tasks.ceph.ceph_manager.ceph:PG 10.24 is not active+clean 2024-09-15T23:56:10.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.545 INFO:tasks.ceph.ceph_manager.ceph:PG 10.23 is not active+clean 2024-09-15T23:56:10.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.545 INFO:tasks.ceph.ceph_manager.ceph:PG 10.22 is not active+clean 2024-09-15T23:56:10.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.545 INFO:tasks.ceph.ceph_manager.ceph:PG 10.21 is not active+clean 2024-09-15T23:56:10.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.546 INFO:tasks.ceph.ceph_manager.ceph:PG 10.20 is not active+clean 2024-09-15T23:56:10.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.546 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1c is not active+clean 2024-09-15T23:56:10.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.546 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-09-15T23:56:10.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.546 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1d is not active+clean 2024-09-15T23:56:10.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.546 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1e is not active+clean 2024-09-15T23:56:10.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.547 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1d is not active+clean 2024-09-15T23:56:10.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.547 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1f is not active+clean 2024-09-15T23:56:10.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.547 INFO:tasks.ceph.ceph_manager.ceph:PG 10.18 is not active+clean 2024-09-15T23:56:10.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.547 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1b is not active+clean 2024-09-15T23:56:10.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.547 INFO:tasks.ceph.ceph_manager.ceph:PG 10.19 is not active+clean 2024-09-15T23:56:10.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.548 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1a is not active+clean 2024-09-15T23:56:10.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.548 INFO:tasks.ceph.ceph_manager.ceph:PG 9.19 is not active+clean 2024-09-15T23:56:10.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.548 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1b is not active+clean 2024-09-15T23:56:10.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.548 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-09-15T23:56:10.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.548 INFO:tasks.ceph.ceph_manager.ceph:PG 10.14 is not active+clean 2024-09-15T23:56:10.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.549 INFO:tasks.ceph.ceph_manager.ceph:PG 9.17 is not active+clean 2024-09-15T23:56:10.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.549 INFO:tasks.ceph.ceph_manager.ceph:PG 10.15 is not active+clean 2024-09-15T23:56:10.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.549 INFO:tasks.ceph.ceph_manager.ceph:PG 9.16 is not active+clean 2024-09-15T23:56:10.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.549 INFO:tasks.ceph.ceph_manager.ceph:PG 10.16 is not active+clean 2024-09-15T23:56:10.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.549 INFO:tasks.ceph.ceph_manager.ceph:PG 9.15 is not active+clean 2024-09-15T23:56:10.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.550 INFO:tasks.ceph.ceph_manager.ceph:PG 10.17 is not active+clean 2024-09-15T23:56:10.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.550 INFO:tasks.ceph.ceph_manager.ceph:PG 10.10 is not active+clean 2024-09-15T23:56:10.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.550 INFO:tasks.ceph.ceph_manager.ceph:PG 9.13 is not active+clean 2024-09-15T23:56:10.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.550 INFO:tasks.ceph.ceph_manager.ceph:PG 10.11 is not active+clean 2024-09-15T23:56:10.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.551 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-09-15T23:56:10.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.551 INFO:tasks.ceph.ceph_manager.ceph:PG 10.12 is not active+clean 2024-09-15T23:56:10.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.551 INFO:tasks.ceph.ceph_manager.ceph:PG 9.11 is not active+clean 2024-09-15T23:56:10.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.551 INFO:tasks.ceph.ceph_manager.ceph:PG 10.13 is not active+clean 2024-09-15T23:56:10.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.551 INFO:tasks.ceph.ceph_manager.ceph:PG 9.10 is not active+clean 2024-09-15T23:56:10.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.552 INFO:tasks.ceph.ceph_manager.ceph:PG 10.c is not active+clean 2024-09-15T23:56:10.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.552 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-09-15T23:56:10.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.552 INFO:tasks.ceph.ceph_manager.ceph:PG 10.d is not active+clean 2024-09-15T23:56:10.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.552 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-09-15T23:56:10.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.552 INFO:tasks.ceph.ceph_manager.ceph:PG 10.e is not active+clean 2024-09-15T23:56:10.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.552 INFO:tasks.ceph.ceph_manager.ceph:PG 9.d is not active+clean 2024-09-15T23:56:10.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.553 INFO:tasks.ceph.ceph_manager.ceph:PG 10.f is not active+clean 2024-09-15T23:56:10.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.553 INFO:tasks.ceph.ceph_manager.ceph:PG 9.c is not active+clean 2024-09-15T23:56:10.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.553 INFO:tasks.ceph.ceph_manager.ceph:PG 10.9 is not active+clean 2024-09-15T23:56:10.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.553 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-09-15T23:56:10.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.554 INFO:tasks.ceph.ceph_manager.ceph:PG 10.a is not active+clean 2024-09-15T23:56:10.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.554 INFO:tasks.ceph.ceph_manager.ceph:PG 10.4 is not active+clean 2024-09-15T23:56:10.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.554 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-09-15T23:56:10.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.554 INFO:tasks.ceph.ceph_manager.ceph:PG 10.5 is not active+clean 2024-09-15T23:56:10.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.554 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-09-15T23:56:10.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.555 INFO:tasks.ceph.ceph_manager.ceph:PG 10.6 is not active+clean 2024-09-15T23:56:10.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.555 INFO:tasks.ceph.ceph_manager.ceph:PG 10.7 is not active+clean 2024-09-15T23:56:10.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.555 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-09-15T23:56:10.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.555 INFO:tasks.ceph.ceph_manager.ceph:PG 10.0 is not active+clean 2024-09-15T23:56:10.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.555 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3 is not active+clean 2024-09-15T23:56:10.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.556 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1 is not active+clean 2024-09-15T23:56:10.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.556 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2 is not active+clean 2024-09-15T23:56:10.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.556 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1 is not active+clean 2024-09-15T23:56:10.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:04.766700+0000', 'last_change': '2024-09-15T23:56:04.766700+0000', 'last_active': '2024-09-15T23:56:04.766700+0000', 'last_peered': '2024-09-15T23:56:04.766700+0000', 'last_clean': '2024-09-15T23:56:04.766700+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:04.766700+0000', 'last_undegraded': '2024-09-15T23:56:04.766700+0000', 'last_fullsized': '2024-09-15T23:56:04.766700+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:04.766700+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.556 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3 is not active+clean 2024-09-15T23:56:10.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.557 INFO:tasks.ceph.ceph_manager.ceph:PG 10.b is not active+clean 2024-09-15T23:56:10.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:05.772371+0000', 'last_change': '2024-09-15T23:56:05.772371+0000', 'last_active': '2024-09-15T23:56:05.772371+0000', 'last_peered': '2024-09-15T23:56:05.772371+0000', 'last_clean': '2024-09-15T23:56:05.772371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:05.772371+0000', 'last_undegraded': '2024-09-15T23:56:05.772371+0000', 'last_fullsized': '2024-09-15T23:56:05.772371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:05.772371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:56:10.558 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:56:10.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.690+0000 7fd730f8e640 1 Processor -- start 2024-09-15T23:56:10.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.690+0000 7fd730f8e640 1 -- start start 2024-09-15T23:56:10.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.690+0000 7fd730f8e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd72c1520a0 0x7fd72c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.690+0000 7fd730f8e640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd72c070250 con 0x7fd72c06fe50 2024-09-15T23:56:10.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.690+0000 7fd730f8e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd72c0aede0 con 0x7fd72c15f3a0 2024-09-15T23:56:10.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.690+0000 7fd730f8e640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd72c152480 con 0x7fd72c1520a0 2024-09-15T23:56:10.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.690+0000 7fd72a59c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd72c1520a0 0x7fd72c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:10.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.690+0000 7fd729d9b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd72c06fe50 0x7fd72c15ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38352/0 (socket says 172.21.15.112:38352) 2024-09-15T23:56:10.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.690+0000 7fd729d9b640 1 -- 172.21.15.112:0/38675801 learned_addr learned my addr 172.21.15.112:0/38675801 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:10.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.690+0000 7fd72a59c640 1 -- 172.21.15.112:0/38675801 >> v1:172.21.15.169:6789/0 conn(0x7fd72c15f3a0 legacy=0x7fd72c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:10.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.690+0000 7fd72959a640 1 -- 172.21.15.112:0/38675801 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 647601477 0 0) 0x7fd72c070250 con 0x7fd72c06fe50 2024-09-15T23:56:10.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.690+0000 7fd72a59c640 1 -- 172.21.15.112:0/38675801 >> v1:172.21.15.112:6789/0 conn(0x7fd72c06fe50 legacy=0x7fd72c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.690+0000 7fd72a59c640 1 -- 172.21.15.112:0/38675801 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72c15fa10 con 0x7fd72c1520a0 2024-09-15T23:56:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.694+0000 7fd72a59c640 1 --2- 172.21.15.112:0/38675801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c1520a0 0x7fd72c06f910 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009d90 tx=0x7fd71c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5375a512d37bccb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.694+0000 7fd72959a640 1 -- 172.21.15.112:0/38675801 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0b2070 con 0x7fd72c1520a0 2024-09-15T23:56:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.694+0000 7fd72959a640 1 -- 172.21.15.112:0/38675801 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd71c0a58e0 con 0x7fd72c1520a0 2024-09-15T23:56:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.694+0000 7fd72959a640 1 -- 172.21.15.112:0/38675801 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c0aeba0 con 0x7fd72c1520a0 2024-09-15T23:56:10.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.694+0000 7fd730f8e640 1 -- 172.21.15.112:0/38675801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c1520a0 msgr2=0x7fd72c06f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.694+0000 7fd730f8e640 1 --2- 172.21.15.112:0/38675801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c1520a0 0x7fd72c06f910 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009d90 tx=0x7fd71c01c930 comp rx=0 tx=0).stop 2024-09-15T23:56:10.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.694+0000 7fd730f8e640 1 -- 172.21.15.112:0/38675801 shutdown_connections 2024-09-15T23:56:10.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.694+0000 7fd730f8e640 1 --2- 172.21.15.112:0/38675801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c1520a0 0x7fd72c06f910 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.694+0000 7fd730f8e640 1 -- 172.21.15.112:0/38675801 >> 172.21.15.112:0/38675801 conn(0x7fd72c0b1f90 msgr2=0x7fd72c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:10.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.694+0000 7fd730f8e640 1 -- 172.21.15.112:0/38675801 shutdown_connections 2024-09-15T23:56:10.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.694+0000 7fd730f8e640 1 -- 172.21.15.112:0/38675801 wait complete. 2024-09-15T23:56:10.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.694+0000 7fd730f8e640 1 Processor -- start 2024-09-15T23:56:10.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.694+0000 7fd730f8e640 1 -- start start 2024-09-15T23:56:10.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd730f8e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c06fe50 0x7fd72c0b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd730f8e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd72c1520a0 0x7fd72c154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd730f8e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd72c15f3a0 0x7fd72c1492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd730f8e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c073d30 con 0x7fd72c06fe50 2024-09-15T23:56:10.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd730f8e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c073a50 con 0x7fd72c15f3a0 2024-09-15T23:56:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd730f8e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd72c168f20 con 0x7fd72c1520a0 2024-09-15T23:56:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd72a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c06fe50 0x7fd72c0b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd72a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c06fe50 0x7fd72c0b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34958/0 (socket says 172.21.15.112:34958) 2024-09-15T23:56:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd72a59c640 1 -- 172.21.15.112:0/2786852627 learned_addr learned my addr 172.21.15.112:0/2786852627 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:10.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd72a59c640 1 -- 172.21.15.112:0/2786852627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd72c1520a0 msgr2=0x7fd72c154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd72a59c640 1 --2- 172.21.15.112:0/2786852627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd72c1520a0 0x7fd72c154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd72a59c640 1 -- 172.21.15.112:0/2786852627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd72c15f3a0 msgr2=0x7fd72c1492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd72a59c640 1 --2- 172.21.15.112:0/2786852627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd72c15f3a0 0x7fd72c1492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd72a59c640 1 -- 172.21.15.112:0/2786852627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72c154d60 con 0x7fd72c06fe50 2024-09-15T23:56:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd72a59c640 1 --2- 172.21.15.112:0/2786852627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c06fe50 0x7fd72c0b1230 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0b0040 tx=0x7fd71c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd722ffd640 1 -- 172.21.15.112:0/2786852627 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0b2050 con 0x7fd72c06fe50 2024-09-15T23:56:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd722ffd640 1 -- 172.21.15.112:0/2786852627 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd71c0be070 con 0x7fd72c06fe50 2024-09-15T23:56:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd730f8e640 1 -- 172.21.15.112:0/2786852627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72c0cf820 con 0x7fd72c06fe50 2024-09-15T23:56:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd722ffd640 1 -- 172.21.15.112:0/2786852627 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0adb10 con 0x7fd72c06fe50 2024-09-15T23:56:10.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd730f8e640 1 -- 172.21.15.112:0/2786852627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd72c0cfde0 con 0x7fd72c06fe50 2024-09-15T23:56:10.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd730f8e640 1 -- 172.21.15.112:0/2786852627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd72c06f910 con 0x7fd72c06fe50 2024-09-15T23:56:10.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd722ffd640 1 -- 172.21.15.112:0/2786852627 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd71c0adcb0 con 0x7fd72c06fe50 2024-09-15T23:56:10.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd722ffd640 1 --2- 172.21.15.112:0/2786852627 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd7100678f0 0x7fd710069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd722ffd640 1 -- 172.21.15.112:0/2786852627 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fd71c120be0 con 0x7fd72c06fe50 2024-09-15T23:56:10.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd729d9b640 1 --2- 172.21.15.112:0/2786852627 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd7100678f0 0x7fd710069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:10.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.698+0000 7fd729d9b640 1 --2- 172.21.15.112:0/2786852627 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd7100678f0 0x7fd710069db0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0d00e0 tx=0x7fd714007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:10.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.702+0000 7fd722ffd640 1 -- 172.21.15.112:0/2786852627 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd71c0c7020 con 0x7fd72c06fe50 2024-09-15T23:56:10.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.910+0000 7fd730f8e640 1 -- 172.21.15.112:0/2786852627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd72c06e540 con 0x7fd72c06fe50 2024-09-15T23:56:10.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.910+0000 7fd722ffd640 1 -- 172.21.15.112:0/2786852627 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1677 (secure 0 0 0) 0x7fd71c016520 con 0x7fd72c06fe50 2024-09-15T23:56:10.912 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:10.913 INFO:teuthology.orchestra.run.smithi112.stdout:{"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":164,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1726444419,"num_in_osds":8,"osd_in_since":1726444408,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":82},{"state_name":"active+clean","count":15}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":591980,"bytes_used":261959680,"bytes_avail":772832153600,"bytes_total":773094113280,"unknown_pgs_ratio":0.84536081552505493,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":29,"btime":"2024-09-15T23:56:08:794770+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5625}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-15T23:54:41.248616+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:56:10.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.914+0000 7fd730f8e640 1 -- 172.21.15.112:0/2786852627 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd7100678f0 msgr2=0x7fd710069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.914+0000 7fd730f8e640 1 --2- 172.21.15.112:0/2786852627 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd7100678f0 0x7fd710069db0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0d00e0 tx=0x7fd714007970 comp rx=0 tx=0).stop 2024-09-15T23:56:10.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.914+0000 7fd730f8e640 1 -- 172.21.15.112:0/2786852627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c06fe50 msgr2=0x7fd72c0b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.914+0000 7fd730f8e640 1 --2- 172.21.15.112:0/2786852627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c06fe50 0x7fd72c0b1230 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0b0040 tx=0x7fd71c0196d0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.914+0000 7fd730f8e640 1 -- 172.21.15.112:0/2786852627 shutdown_connections 2024-09-15T23:56:10.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.914+0000 7fd730f8e640 1 --2- 172.21.15.112:0/2786852627 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd7100678f0 0x7fd710069db0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.914+0000 7fd730f8e640 1 --2- 172.21.15.112:0/2786852627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd72c15f3a0 0x7fd72c1492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.914+0000 7fd730f8e640 1 --2- 172.21.15.112:0/2786852627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd72c1520a0 0x7fd72c154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.914+0000 7fd730f8e640 1 --2- 172.21.15.112:0/2786852627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd72c06fe50 0x7fd72c0b1230 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.914+0000 7fd730f8e640 1 -- 172.21.15.112:0/2786852627 >> 172.21.15.112:0/2786852627 conn(0x7fd72c0b1f90 msgr2=0x7fd72c0b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:10.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.914+0000 7fd730f8e640 1 -- 172.21.15.112:0/2786852627 shutdown_connections 2024-09-15T23:56:10.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:10.914+0000 7fd730f8e640 1 -- 172.21.15.112:0/2786852627 wait complete. 2024-09-15T23:56:10.930 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:56:10.930 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:56:11.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.034+0000 7f86404b8640 1 Processor -- start 2024-09-15T23:56:11.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f86404b8640 1 -- start start 2024-09-15T23:56:11.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f86404b8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8638073e60 0x7f86380b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:11.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f86404b8640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86380742f0 con 0x7f863806fef0 2024-09-15T23:56:11.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f86404b8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f863806ee50 con 0x7f86380b4290 2024-09-15T23:56:11.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f86404b8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f863806f130 con 0x7f8638073e60 2024-09-15T23:56:11.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f863e254640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f863806fef0 0x7f863815b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38362/0 (socket says 172.21.15.112:38362) 2024-09-15T23:56:11.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f863e254640 1 -- 172.21.15.112:0/1848028426 learned_addr learned my addr 172.21.15.112:0/1848028426 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:11.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f863da53640 1 --2- 172.21.15.112:0/1848028426 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8638073e60 0x7f86380b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:11.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f863d252640 1 -- 172.21.15.112:0/1848028426 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3490580596 0 0) 0x7f8634001120 con 0x7f863806fef0 2024-09-15T23:56:11.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f863d252640 1 -- 172.21.15.112:0/1848028426 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8624003530 con 0x7f863806fef0 2024-09-15T23:56:11.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f863d252640 1 -- 172.21.15.112:0/1848028426 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 485023644 0 0) 0x7f863806ee50 con 0x7f86380b4290 2024-09-15T23:56:11.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f863d252640 1 -- 172.21.15.112:0/1848028426 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8634001120 con 0x7f86380b4290 2024-09-15T23:56:11.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f863d252640 1 -- 172.21.15.112:0/1848028426 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2945525543 0 0) 0x7f8624003530 con 0x7f863806fef0 2024-09-15T23:56:11.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f863da53640 1 -- 172.21.15.112:0/1848028426 >> v1:172.21.15.169:6789/0 conn(0x7f86380b4290 legacy=0x7f863806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:11.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f863da53640 1 -- 172.21.15.112:0/1848028426 >> v1:172.21.15.112:6789/0 conn(0x7f863806fef0 legacy=0x7f863815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:11.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.038+0000 7f863da53640 1 -- 172.21.15.112:0/1848028426 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863806f410 con 0x7f8638073e60 2024-09-15T23:56:11.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f863da53640 1 --2- 172.21.15.112:0/1848028426 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8638073e60 0x7f86380b3d50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f862c0097f0 tx=0x7f862c01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dae9a073d4a72e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:11.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f863d252640 1 -- 172.21.15.112:0/1848028426 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c0b0070 con 0x7f8638073e60 2024-09-15T23:56:11.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f863d252640 1 -- 172.21.15.112:0/1848028426 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f862c0ab400 con 0x7f8638073e60 2024-09-15T23:56:11.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f863d252640 1 -- 172.21.15.112:0/1848028426 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634001850 con 0x7f8638073e60 2024-09-15T23:56:11.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 -- 172.21.15.112:0/1848028426 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8638073e60 msgr2=0x7f86380b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:11.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 --2- 172.21.15.112:0/1848028426 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8638073e60 0x7f86380b3d50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f862c0097f0 tx=0x7f862c01c370 comp rx=0 tx=0).stop 2024-09-15T23:56:11.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 -- 172.21.15.112:0/1848028426 shutdown_connections 2024-09-15T23:56:11.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 --2- 172.21.15.112:0/1848028426 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8638073e60 0x7f86380b3d50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:11.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 -- 172.21.15.112:0/1848028426 >> 172.21.15.112:0/1848028426 conn(0x7f86380b1f90 msgr2=0x7f86380b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:11.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 -- 172.21.15.112:0/1848028426 shutdown_connections 2024-09-15T23:56:11.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 -- 172.21.15.112:0/1848028426 wait complete. 2024-09-15T23:56:11.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 Processor -- start 2024-09-15T23:56:11.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 -- start start 2024-09-15T23:56:11.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f863806fef0 0x7f863814b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:11.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8638073e60 0x7f8638153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:11.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86380b4290 0x7f8638154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:11.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8638169860 con 0x7f8638073e60 2024-09-15T23:56:11.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86381696e0 con 0x7f86380b4290 2024-09-15T23:56:11.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f86404b8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f86381699e0 con 0x7f863806fef0 2024-09-15T23:56:11.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f863da53640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8638073e60 0x7f8638153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:11.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f863da53640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8638073e60 0x7f8638153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34962/0 (socket says 172.21.15.112:34962) 2024-09-15T23:56:11.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f863da53640 1 -- 172.21.15.112:0/3644831448 learned_addr learned my addr 172.21.15.112:0/3644831448 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:11.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f863ea55640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86380b4290 0x7f8638154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:11.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.042+0000 7f863e254640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f863806fef0 0x7f863814b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:11.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f863da53640 1 -- 172.21.15.112:0/3644831448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f863806fef0 msgr2=0x7f863814b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:11.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f863da53640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f863806fef0 0x7f863814b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:11.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f863da53640 1 -- 172.21.15.112:0/3644831448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86380b4290 msgr2=0x7f8638154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:11.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f863da53640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86380b4290 0x7f8638154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:11.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f863da53640 1 -- 172.21.15.112:0/3644831448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863815d2c0 con 0x7f8638073e60 2024-09-15T23:56:11.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f863ea55640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86380b4290 0x7f8638154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:11.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f863e254640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f863806fef0 0x7f863814b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:11.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f863da53640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8638073e60 0x7f8638153d20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f862c019fa0 tx=0x7f862c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:11.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f862affd640 1 -- 172.21.15.112:0/3644831448 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c0b0050 con 0x7f8638073e60 2024-09-15T23:56:11.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f862affd640 1 -- 172.21.15.112:0/3644831448 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f862c0b1040 con 0x7f8638073e60 2024-09-15T23:56:11.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f86404b8640 1 -- 172.21.15.112:0/3644831448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8638166300 con 0x7f8638073e60 2024-09-15T23:56:11.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f862affd640 1 -- 172.21.15.112:0/3644831448 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c006e20 con 0x7f8638073e60 2024-09-15T23:56:11.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f86404b8640 1 -- 172.21.15.112:0/3644831448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86381665e0 con 0x7f8638073e60 2024-09-15T23:56:11.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f86404b8640 1 -- 172.21.15.112:0/3644831448 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86380b3d50 con 0x7f8638073e60 2024-09-15T23:56:11.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f862affd640 1 -- 172.21.15.112:0/3644831448 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f862c0be030 con 0x7f8638073e60 2024-09-15T23:56:11.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f862affd640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f861c0678c0 0x7f861c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f862affd640 1 -- 172.21.15.112:0/3644831448 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f862c11f930 con 0x7f8638073e60 2024-09-15T23:56:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f863e254640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f861c0678c0 0x7f861c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.046+0000 7f863e254640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f861c0678c0 0x7f861c069d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8634000fe0 tx=0x7f8634009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:11.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.050+0000 7f862affd640 1 -- 172.21.15.112:0/3644831448 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f862c0c5060 con 0x7f8638073e60 2024-09-15T23:56:11.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.206+0000 7f86404b8640 1 -- 172.21.15.112:0/3644831448 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8638151a80 con 0x7f861c0678c0 2024-09-15T23:56:11.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.218+0000 7f862affd640 1 -- 172.21.15.112:0/3644831448 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239366 (secure 0 0 0) 0x7f8638151a80 con 0x7f861c0678c0 2024-09-15T23:56:11.221 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:11.222 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:56:11.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.222+0000 7f86404b8640 1 -- 172.21.15.112:0/3644831448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f861c0678c0 msgr2=0x7f861c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:11.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.222+0000 7f86404b8640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f861c0678c0 0x7f861c069d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8634000fe0 tx=0x7f8634009040 comp rx=0 tx=0).stop 2024-09-15T23:56:11.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.222+0000 7f86404b8640 1 -- 172.21.15.112:0/3644831448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8638073e60 msgr2=0x7f8638153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:11.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.222+0000 7f86404b8640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8638073e60 0x7f8638153d20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f862c019fa0 tx=0x7f862c01abb0 comp rx=0 tx=0).stop 2024-09-15T23:56:11.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.222+0000 7f86404b8640 1 -- 172.21.15.112:0/3644831448 shutdown_connections 2024-09-15T23:56:11.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.222+0000 7f86404b8640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f861c0678c0 0x7f861c069d80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:11.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.222+0000 7f86404b8640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86380b4290 0x7f8638154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:11.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.222+0000 7f86404b8640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8638073e60 0x7f8638153d20 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:11.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.222+0000 7f86404b8640 1 --2- 172.21.15.112:0/3644831448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f863806fef0 0x7f863814b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:11.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.222+0000 7f86404b8640 1 -- 172.21.15.112:0/3644831448 >> 172.21.15.112:0/3644831448 conn(0x7f86380b1f90 msgr2=0x7f86381523a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:11.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.222+0000 7f86404b8640 1 -- 172.21.15.112:0/3644831448 shutdown_connections 2024-09-15T23:56:11.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:11.222+0000 7f86404b8640 1 -- 172.21.15.112:0/3644831448 wait complete. 2024-09-15T23:56:11.238 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-09-15T23:56:09.275909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":169,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":255820,"kb_used_data":6304,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718900,"statfs":{"total":773094113280,"available":772832153600,"internally_reserved":0,"allocated":6455296,"data_stored":3493444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.503198"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.776915+0000","last_change":"2024-09-15T23:56:06.772768+0000","last_active":"2024-09-15T23:56:06.776915+0000","last_peered":"2024-09-15T23:56:06.776915+0000","last_clean":"2024-09-15T23:56:06.776915+0000","last_became_active":"2024-09-15T23:56:06.771754+0000","last_became_peered":"2024-09-15T23:56:06.771754+0000","last_unstale":"2024-09-15T23:56:06.776915+0000","last_undegraded":"2024-09-15T23:56:06.776915+0000","last_fullsized":"2024-09-15T23:56:06.776915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:31.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.784026+0000","last_change":"2024-09-15T23:56:06.782667+0000","last_active":"2024-09-15T23:56:06.784026+0000","last_peered":"2024-09-15T23:56:06.784026+0000","last_clean":"2024-09-15T23:56:06.784026+0000","last_became_active":"2024-09-15T23:56:06.782133+0000","last_became_peered":"2024-09-15T23:56:06.782133+0000","last_unstale":"2024-09-15T23:56:06.784026+0000","last_undegraded":"2024-09-15T23:56:06.784026+0000","last_fullsized":"2024-09-15T23:56:06.784026+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:21.431926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.784065+0000","last_change":"2024-09-15T23:56:06.782758+0000","last_active":"2024-09-15T23:56:06.784065+0000","last_peered":"2024-09-15T23:56:06.784065+0000","last_clean":"2024-09-15T23:56:06.784065+0000","last_became_active":"2024-09-15T23:56:06.782243+0000","last_became_peered":"2024-09-15T23:56:06.782243+0000","last_unstale":"2024-09-15T23:56:06.784065+0000","last_undegraded":"2024-09-15T23:56:06.784065+0000","last_fullsized":"2024-09-15T23:56:06.784065+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:57.427444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.776872+0000","last_change":"2024-09-15T23:56:06.772343+0000","last_active":"2024-09-15T23:56:06.776872+0000","last_peered":"2024-09-15T23:56:06.776872+0000","last_clean":"2024-09-15T23:56:06.776872+0000","last_became_active":"2024-09-15T23:56:06.771732+0000","last_became_peered":"2024-09-15T23:56:06.771732+0000","last_unstale":"2024-09-15T23:56:06.776872+0000","last_undegraded":"2024-09-15T23:56:06.776872+0000","last_fullsized":"2024-09-15T23:56:06.776872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:08.291329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.802378+0000","last_change":"2024-09-15T23:56:05.831362+0000","last_active":"2024-09-15T23:56:06.802378+0000","last_peered":"2024-09-15T23:56:06.802378+0000","last_clean":"2024-09-15T23:56:06.802378+0000","last_became_active":"2024-09-15T23:56:05.830767+0000","last_became_peered":"2024-09-15T23:56:05.830767+0000","last_unstale":"2024-09-15T23:56:06.802378+0000","last_undegraded":"2024-09-15T23:56:06.802378+0000","last_fullsized":"2024-09-15T23:56:06.802378+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:38.014144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.802624+0000","last_change":"2024-09-15T23:56:05.819028+0000","last_active":"2024-09-15T23:56:06.802624+0000","last_peered":"2024-09-15T23:56:06.802624+0000","last_clean":"2024-09-15T23:56:06.802624+0000","last_became_active":"2024-09-15T23:56:05.818281+0000","last_became_peered":"2024-09-15T23:56:05.818281+0000","last_unstale":"2024-09-15T23:56:06.802624+0000","last_undegraded":"2024-09-15T23:56:06.802624+0000","last_fullsized":"2024-09-15T23:56:06.802624+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:59.787456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.805360+0000","last_change":"2024-09-15T23:56:05.829166+0000","last_active":"2024-09-15T23:56:06.805360+0000","last_peered":"2024-09-15T23:56:06.805360+0000","last_clean":"2024-09-15T23:56:06.805360+0000","last_became_active":"2024-09-15T23:56:05.828476+0000","last_became_peered":"2024-09-15T23:56:05.828476+0000","last_unstale":"2024-09-15T23:56:06.805360+0000","last_undegraded":"2024-09-15T23:56:06.805360+0000","last_fullsized":"2024-09-15T23:56:06.805360+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:32.006457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.784064+0000","last_change":"2024-09-15T23:56:06.782993+0000","last_active":"2024-09-15T23:56:06.784064+0000","last_peered":"2024-09-15T23:56:06.784064+0000","last_clean":"2024-09-15T23:56:06.784064+0000","last_became_active":"2024-09-15T23:56:06.782455+0000","last_became_peered":"2024-09-15T23:56:06.782455+0000","last_unstale":"2024-09-15T23:56:06.784064+0000","last_undegraded":"2024-09-15T23:56:06.784064+0000","last_fullsized":"2024-09-15T23:56:06.784064+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:21.887861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.801534+0000","last_change":"2024-09-15T23:56:05.805390+0000","last_active":"2024-09-15T23:56:06.801534+0000","last_peered":"2024-09-15T23:56:06.801534+0000","last_clean":"2024-09-15T23:56:06.801534+0000","last_became_active":"2024-09-15T23:56:05.804691+0000","last_became_peered":"2024-09-15T23:56:05.804691+0000","last_unstale":"2024-09-15T23:56:06.801534+0000","last_undegraded":"2024-09-15T23:56:06.801534+0000","last_fullsized":"2024-09-15T23:56:06.801534+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:40.276819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.759980+0000","last_change":"2024-09-15T23:56:05.806127+0000","last_active":"2024-09-15T23:56:06.759980+0000","last_peered":"2024-09-15T23:56:06.759980+0000","last_clean":"2024-09-15T23:56:06.759980+0000","last_became_active":"2024-09-15T23:56:05.804982+0000","last_became_peered":"2024-09-15T23:56:05.804982+0000","last_unstale":"2024-09-15T23:56:06.759980+0000","last_undegraded":"2024-09-15T23:56:06.759980+0000","last_fullsized":"2024-09-15T23:56:06.759980+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:41.773267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.760461+0000","last_change":"2024-09-15T23:56:05.806883+0000","last_active":"2024-09-15T23:56:06.760461+0000","last_peered":"2024-09-15T23:56:06.760461+0000","last_clean":"2024-09-15T23:56:06.760461+0000","last_became_active":"2024-09-15T23:56:05.806162+0000","last_became_peered":"2024-09-15T23:56:05.806162+0000","last_unstale":"2024-09-15T23:56:06.760461+0000","last_undegraded":"2024-09-15T23:56:06.760461+0000","last_fullsized":"2024-09-15T23:56:06.760461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:09.390084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.776776+0000","last_change":"2024-09-15T23:56:06.771716+0000","last_active":"2024-09-15T23:56:06.776776+0000","last_peered":"2024-09-15T23:56:06.776776+0000","last_clean":"2024-09-15T23:56:06.776776+0000","last_became_active":"2024-09-15T23:56:06.771042+0000","last_became_peered":"2024-09-15T23:56:06.771042+0000","last_unstale":"2024-09-15T23:56:06.776776+0000","last_undegraded":"2024-09-15T23:56:06.776776+0000","last_fullsized":"2024-09-15T23:56:06.776776+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:41.916409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:04.766700+0000","last_change":"2024-09-15T23:56:04.766700+0000","last_active":"2024-09-15T23:56:04.766700+0000","last_peered":"2024-09-15T23:56:04.766700+0000","last_clean":"2024-09-15T23:56:04.766700+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:04.766700+0000","last_undegraded":"2024-09-15T23:56:04.766700+0000","last_fullsized":"2024-09-15T23:56:04.766700+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.767761+0000","last_change":"2024-09-15T23:56:05.823993+0000","last_active":"2024-09-15T23:56:06.767761+0000","last_peered":"2024-09-15T23:56:06.767761+0000","last_clean":"2024-09-15T23:56:06.767761+0000","last_became_active":"2024-09-15T23:56:05.822463+0000","last_became_peered":"2024-09-15T23:56:05.822463+0000","last_unstale":"2024-09-15T23:56:06.767761+0000","last_undegraded":"2024-09-15T23:56:06.767761+0000","last_fullsized":"2024-09-15T23:56:06.767761+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.412663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:05.772371+0000","last_change":"2024-09-15T23:56:05.772371+0000","last_active":"2024-09-15T23:56:05.772371+0000","last_peered":"2024-09-15T23:56:05.772371+0000","last_clean":"2024-09-15T23:56:05.772371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:05.772371+0000","last_undegraded":"2024-09-15T23:56:05.772371+0000","last_fullsized":"2024-09-15T23:56:05.772371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-15T23:56:06.767857+0000","last_change":"2024-09-15T23:56:05.808917+0000","last_active":"2024-09-15T23:56:06.767857+0000","last_peered":"2024-09-15T23:56:06.767857+0000","last_clean":"2024-09-15T23:56:06.767857+0000","last_became_active":"2024-09-15T23:56:05.808220+0000","last_became_peered":"2024-09-15T23:56:05.808220+0000","last_unstale":"2024-09-15T23:56:06.767857+0000","last_undegraded":"2024-09-15T23:56:06.767857+0000","last_fullsized":"2024-09-15T23:56:06.767857+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:50.965466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":236,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-15T23:56:03.803267+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:56:03.803267+0000","last_peered":"2024-09-15T23:56:03.803267+0000","last_clean":"2024-09-15T23:56:03.803267+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:56:03.803267+0000","last_undegraded":"2024-09-15T23:56:03.803267+0000","last_fullsized":"2024-09-15T23:56:03.803267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":16,"acting":16,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31820,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31868,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":692224,"data_stored":303943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1236992,"data_stored":872359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":281991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1310720,"data_stored":907187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:56:13.448 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:56:13.451 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:56:14.243 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:56:14.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.374+0000 7f2c0dfed640 1 Processor -- start 2024-09-15T23:56:14.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c0dfed640 1 -- start start 2024-09-15T23:56:14.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c0dfed640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c081520a0 0x7f2c0806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c0dfed640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c0806fe50 0x7f2c0815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c0dfed640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2c0815f1d0 0x7f2c08071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c0dfed640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2c08152480 con 0x7f2c0806fe50 2024-09-15T23:56:14.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c0dfed640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2c08070250 con 0x7f2c0815f1d0 2024-09-15T23:56:14.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c0dfed640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2c080aede0 con 0x7f2c081520a0 2024-09-15T23:56:14.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c06ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c0806fe50 0x7f2c0815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c06ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2c0806fe50 0x7f2c0815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34964/0 (socket says 172.21.15.112:34964) 2024-09-15T23:56:14.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c06ffd640 1 -- 172.21.15.112:0/1458456022 learned_addr learned my addr 172.21.15.112:0/1458456022 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:14.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c077fe640 1 --2- 172.21.15.112:0/1458456022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c081520a0 0x7f2c0806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c07fff640 1 --2- 172.21.15.112:0/1458456022 >> v2:172.21.15.169:3300/0 conn(0x7f2c0815f1d0 0x7f2c08071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c06ffd640 1 -- 172.21.15.112:0/1458456022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c081520a0 msgr2=0x7f2c0806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:14.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c06ffd640 1 --2- 172.21.15.112:0/1458456022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c081520a0 0x7f2c0806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c06ffd640 1 -- 172.21.15.112:0/1458456022 >> v2:172.21.15.169:3300/0 conn(0x7f2c0815f1d0 msgr2=0x7f2c08071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:14.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c06ffd640 1 --2- 172.21.15.112:0/1458456022 >> v2:172.21.15.169:3300/0 conn(0x7f2c0815f1d0 0x7f2c08071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c06ffd640 1 -- 172.21.15.112:0/1458456022 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0815fa10 con 0x7f2c0806fe50 2024-09-15T23:56:14.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c06ffd640 1 --2- 172.21.15.112:0/1458456022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c0806fe50 0x7f2c0815ec90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2c0806e250 tx=0x7f2bfc01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e968ff3bb2f8fb41 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:14.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.378+0000 7f2c067fc640 1 -- 172.21.15.112:0/1458456022 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0b0070 con 0x7f2c0806fe50 2024-09-15T23:56:14.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c067fc640 1 -- 172.21.15.112:0/1458456022 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bfc0ab600 con 0x7f2c0806fe50 2024-09-15T23:56:14.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c067fc640 1 -- 172.21.15.112:0/1458456022 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0ab9d0 con 0x7f2c0806fe50 2024-09-15T23:56:14.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1458456022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c0806fe50 msgr2=0x7f2c0815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 --2- 172.21.15.112:0/1458456022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c0806fe50 0x7f2c0815ec90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2c0806e250 tx=0x7f2bfc01c240 comp rx=0 tx=0).stop 2024-09-15T23:56:14.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1458456022 shutdown_connections 2024-09-15T23:56:14.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 --2- 172.21.15.112:0/1458456022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c0806fe50 0x7f2c0815ec90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 --2- 172.21.15.112:0/1458456022 >> v2:172.21.15.169:3300/0 conn(0x7f2c0815f1d0 0x7f2c08071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 --2- 172.21.15.112:0/1458456022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c081520a0 0x7f2c0806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1458456022 >> 172.21.15.112:0/1458456022 conn(0x7f2c080b1f90 msgr2=0x7f2c080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:14.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1458456022 shutdown_connections 2024-09-15T23:56:14.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1458456022 wait complete. 2024-09-15T23:56:14.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 Processor -- start 2024-09-15T23:56:14.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 -- start start 2024-09-15T23:56:14.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c0806fe50 0x7f2c0814e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c081520a0 0x7f2c080afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c0815f1d0 0x7f2c080ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2c08073d30 con 0x7f2c081520a0 2024-09-15T23:56:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2c08073a50 con 0x7f2c0806fe50 2024-09-15T23:56:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2c0815f5e0 con 0x7f2c0815f1d0 2024-09-15T23:56:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c06ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c081520a0 0x7f2c080afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c06ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c081520a0 0x7f2c080afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34978/0 (socket says 172.21.15.112:34978) 2024-09-15T23:56:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c06ffd640 1 -- 172.21.15.112:0/1581779193 learned_addr learned my addr 172.21.15.112:0/1581779193 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c07fff640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c0815f1d0 0x7f2c080ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c077fe640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c0806fe50 0x7f2c0814e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c06ffd640 1 -- 172.21.15.112:0/1581779193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c0815f1d0 msgr2=0x7f2c080ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c06ffd640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c0815f1d0 0x7f2c080ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c06ffd640 1 -- 172.21.15.112:0/1581779193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c0806fe50 msgr2=0x7f2c0814e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c06ffd640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c0806fe50 0x7f2c0814e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c06ffd640 1 -- 172.21.15.112:0/1581779193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c080b0880 con 0x7f2c081520a0 2024-09-15T23:56:14.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c077fe640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c0806fe50 0x7f2c0814e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:14.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c06ffd640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c081520a0 0x7f2c080afe00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc01a8f0 tx=0x7f2bfc018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:14.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2beffff640 1 -- 172.21.15.112:0/1581779193 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0ba070 con 0x7f2c081520a0 2024-09-15T23:56:14.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2beffff640 1 -- 172.21.15.112:0/1581779193 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bfc0b4620 con 0x7f2c081520a0 2024-09-15T23:56:14.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2beffff640 1 -- 172.21.15.112:0/1581779193 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0b0040 con 0x7f2c081520a0 2024-09-15T23:56:14.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1581779193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c080b0b60 con 0x7f2c081520a0 2024-09-15T23:56:14.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.382+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1581779193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c080b1120 con 0x7f2c081520a0 2024-09-15T23:56:14.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.386+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1581779193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c0806f910 con 0x7f2c081520a0 2024-09-15T23:56:14.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.386+0000 7f2beffff640 1 -- 172.21.15.112:0/1581779193 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2bfc0bd070 con 0x7f2c081520a0 2024-09-15T23:56:14.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.386+0000 7f2beffff640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2bf40678c0 0x7f2bf4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.386+0000 7f2beffff640 1 -- 172.21.15.112:0/1581779193 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f2bfc11ef60 con 0x7f2c081520a0 2024-09-15T23:56:14.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.386+0000 7f2c077fe640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2bf40678c0 0x7f2bf4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.386+0000 7f2c077fe640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2bf40678c0 0x7f2bf4069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2c080aea80 tx=0x7f2bf8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:14.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.390+0000 7f2beffff640 1 -- 172.21.15.112:0/1581779193 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2bfc0160f0 con 0x7f2c081520a0 2024-09-15T23:56:14.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.550+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1581779193 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c0814ec50 con 0x7f2bf40678c0 2024-09-15T23:56:14.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.566+0000 7f2beffff640 1 -- 172.21.15.112:0/1581779193 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252024 (secure 0 0 0) 0x7f2c0814ec50 con 0x7f2bf40678c0 2024-09-15T23:56:14.573 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:14.574 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:56:14.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.574+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1581779193 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2bf40678c0 msgr2=0x7f2bf4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.574+0000 7f2c0dfed640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2bf40678c0 0x7f2bf4069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2c080aea80 tx=0x7f2bf8008040 comp rx=0 tx=0).stop 2024-09-15T23:56:14.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.574+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1581779193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c081520a0 msgr2=0x7f2c080afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.574+0000 7f2c0dfed640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c081520a0 0x7f2c080afe00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc01a8f0 tx=0x7f2bfc018fe0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.574+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1581779193 shutdown_connections 2024-09-15T23:56:14.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.574+0000 7f2c0dfed640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2bf40678c0 0x7f2bf4069d80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.574+0000 7f2c0dfed640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2c0815f1d0 0x7f2c080ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.574+0000 7f2c0dfed640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c081520a0 0x7f2c080afe00 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.574+0000 7f2c0dfed640 1 --2- 172.21.15.112:0/1581779193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c0806fe50 0x7f2c0814e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.574+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1581779193 >> 172.21.15.112:0/1581779193 conn(0x7f2c080b1f90 msgr2=0x7f2c0815c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:14.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.574+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1581779193 shutdown_connections 2024-09-15T23:56:14.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.574+0000 7f2c0dfed640 1 -- 172.21.15.112:0/1581779193 wait complete. 2024-09-15T23:56:14.592 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-15T23:56:13.277137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256552,"kb_used_data":7016,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718168,"statfs":{"total":773094113280,"available":772831404032,"internally_reserved":0,"allocated":7184384,"data_stored":3830980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.494200"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.744800+0000","last_change":"2024-09-15T23:56:06.763643+0000","last_active":"2024-09-15T23:56:07.744800+0000","last_peered":"2024-09-15T23:56:07.744800+0000","last_clean":"2024-09-15T23:56:07.744800+0000","last_became_active":"2024-09-15T23:56:06.762897+0000","last_became_peered":"2024-09-15T23:56:06.762897+0000","last_unstale":"2024-09-15T23:56:07.744800+0000","last_undegraded":"2024-09-15T23:56:07.744800+0000","last_fullsized":"2024-09-15T23:56:07.744800+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:32.458377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746401+0000","last_change":"2024-09-15T23:56:06.772768+0000","last_active":"2024-09-15T23:56:07.746401+0000","last_peered":"2024-09-15T23:56:07.746401+0000","last_clean":"2024-09-15T23:56:07.746401+0000","last_became_active":"2024-09-15T23:56:06.771754+0000","last_became_peered":"2024-09-15T23:56:06.771754+0000","last_unstale":"2024-09-15T23:56:07.746401+0000","last_undegraded":"2024-09-15T23:56:07.746401+0000","last_fullsized":"2024-09-15T23:56:07.746401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:27.406073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747543+0000","last_change":"2024-09-15T23:56:06.753846+0000","last_active":"2024-09-15T23:56:07.747543+0000","last_peered":"2024-09-15T23:56:07.747543+0000","last_clean":"2024-09-15T23:56:07.747543+0000","last_became_active":"2024-09-15T23:56:06.753100+0000","last_became_peered":"2024-09-15T23:56:06.753100+0000","last_unstale":"2024-09-15T23:56:07.747543+0000","last_undegraded":"2024-09-15T23:56:07.747543+0000","last_fullsized":"2024-09-15T23:56:07.747543+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:27.195580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746650+0000","last_change":"2024-09-15T23:56:06.747373+0000","last_active":"2024-09-15T23:56:07.746650+0000","last_peered":"2024-09-15T23:56:07.746650+0000","last_clean":"2024-09-15T23:56:07.746650+0000","last_became_active":"2024-09-15T23:56:06.746073+0000","last_became_peered":"2024-09-15T23:56:06.746073+0000","last_unstale":"2024-09-15T23:56:07.746650+0000","last_undegraded":"2024-09-15T23:56:07.746650+0000","last_fullsized":"2024-09-15T23:56:07.746650+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:45:55.738684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.745972+0000","last_change":"2024-09-15T23:56:06.758111+0000","last_active":"2024-09-15T23:56:07.745972+0000","last_peered":"2024-09-15T23:56:07.745972+0000","last_clean":"2024-09-15T23:56:07.745972+0000","last_became_active":"2024-09-15T23:56:06.757252+0000","last_became_peered":"2024-09-15T23:56:06.757252+0000","last_unstale":"2024-09-15T23:56:07.745972+0000","last_undegraded":"2024-09-15T23:56:07.745972+0000","last_fullsized":"2024-09-15T23:56:07.745972+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:04.419653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746698+0000","last_change":"2024-09-15T23:56:06.782667+0000","last_active":"2024-09-15T23:56:07.746698+0000","last_peered":"2024-09-15T23:56:07.746698+0000","last_clean":"2024-09-15T23:56:07.746698+0000","last_became_active":"2024-09-15T23:56:06.782133+0000","last_became_peered":"2024-09-15T23:56:06.782133+0000","last_unstale":"2024-09-15T23:56:07.746698+0000","last_undegraded":"2024-09-15T23:56:07.746698+0000","last_fullsized":"2024-09-15T23:56:07.746698+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:08.328160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.742572+0000","last_change":"2024-09-15T23:56:06.741638+0000","last_active":"2024-09-15T23:56:07.742572+0000","last_peered":"2024-09-15T23:56:07.742572+0000","last_clean":"2024-09-15T23:56:07.742572+0000","last_became_active":"2024-09-15T23:56:06.740933+0000","last_became_peered":"2024-09-15T23:56:06.740933+0000","last_unstale":"2024-09-15T23:56:07.742572+0000","last_undegraded":"2024-09-15T23:56:07.742572+0000","last_fullsized":"2024-09-15T23:56:07.742572+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:59.264562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.745045+0000","last_change":"2024-09-15T23:56:06.764797+0000","last_active":"2024-09-15T23:56:07.745045+0000","last_peered":"2024-09-15T23:56:07.745045+0000","last_clean":"2024-09-15T23:56:07.745045+0000","last_became_active":"2024-09-15T23:56:06.758894+0000","last_became_peered":"2024-09-15T23:56:06.758894+0000","last_unstale":"2024-09-15T23:56:07.745045+0000","last_undegraded":"2024-09-15T23:56:07.745045+0000","last_fullsized":"2024-09-15T23:56:07.745045+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:08.436812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746684+0000","last_change":"2024-09-15T23:56:06.764956+0000","last_active":"2024-09-15T23:56:07.746684+0000","last_peered":"2024-09-15T23:56:07.746684+0000","last_clean":"2024-09-15T23:56:07.746684+0000","last_became_active":"2024-09-15T23:56:06.762616+0000","last_became_peered":"2024-09-15T23:56:06.762616+0000","last_unstale":"2024-09-15T23:56:07.746684+0000","last_undegraded":"2024-09-15T23:56:07.746684+0000","last_fullsized":"2024-09-15T23:56:07.746684+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:33.522333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.738026+0000","last_change":"2024-09-15T23:56:06.763099+0000","last_active":"2024-09-15T23:56:07.738026+0000","last_peered":"2024-09-15T23:56:07.738026+0000","last_clean":"2024-09-15T23:56:07.738026+0000","last_became_active":"2024-09-15T23:56:06.761001+0000","last_became_peered":"2024-09-15T23:56:06.761001+0000","last_unstale":"2024-09-15T23:56:07.738026+0000","last_undegraded":"2024-09-15T23:56:07.738026+0000","last_fullsized":"2024-09-15T23:56:07.738026+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:00.092968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746092+0000","last_change":"2024-09-15T23:56:06.741564+0000","last_active":"2024-09-15T23:56:07.746092+0000","last_peered":"2024-09-15T23:56:07.746092+0000","last_clean":"2024-09-15T23:56:07.746092+0000","last_became_active":"2024-09-15T23:56:06.740834+0000","last_became_peered":"2024-09-15T23:56:06.740834+0000","last_unstale":"2024-09-15T23:56:07.746092+0000","last_undegraded":"2024-09-15T23:56:07.746092+0000","last_fullsized":"2024-09-15T23:56:07.746092+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:57.268867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746794+0000","last_change":"2024-09-15T23:56:06.754834+0000","last_active":"2024-09-15T23:56:07.746794+0000","last_peered":"2024-09-15T23:56:07.746794+0000","last_clean":"2024-09-15T23:56:07.746794+0000","last_became_active":"2024-09-15T23:56:06.753766+0000","last_became_peered":"2024-09-15T23:56:06.753766+0000","last_unstale":"2024-09-15T23:56:07.746794+0000","last_undegraded":"2024-09-15T23:56:07.746794+0000","last_fullsized":"2024-09-15T23:56:07.746794+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:37.447525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.744072+0000","last_change":"2024-09-15T23:56:06.779538+0000","last_active":"2024-09-15T23:56:07.744072+0000","last_peered":"2024-09-15T23:56:07.744072+0000","last_clean":"2024-09-15T23:56:07.744072+0000","last_became_active":"2024-09-15T23:56:06.774398+0000","last_became_peered":"2024-09-15T23:56:06.774398+0000","last_unstale":"2024-09-15T23:56:07.744072+0000","last_undegraded":"2024-09-15T23:56:07.744072+0000","last_fullsized":"2024-09-15T23:56:07.744072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:34.719298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.743367+0000","last_change":"2024-09-15T23:56:06.775522+0000","last_active":"2024-09-15T23:56:07.743367+0000","last_peered":"2024-09-15T23:56:07.743367+0000","last_clean":"2024-09-15T23:56:07.743367+0000","last_became_active":"2024-09-15T23:56:06.774308+0000","last_became_peered":"2024-09-15T23:56:06.774308+0000","last_unstale":"2024-09-15T23:56:07.743367+0000","last_undegraded":"2024-09-15T23:56:07.743367+0000","last_fullsized":"2024-09-15T23:56:07.743367+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:08.681192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.738189+0000","last_change":"2024-09-15T23:56:06.771780+0000","last_active":"2024-09-15T23:56:07.738189+0000","last_peered":"2024-09-15T23:56:07.738189+0000","last_clean":"2024-09-15T23:56:07.738189+0000","last_became_active":"2024-09-15T23:56:06.771098+0000","last_became_peered":"2024-09-15T23:56:06.771098+0000","last_unstale":"2024-09-15T23:56:07.738189+0000","last_undegraded":"2024-09-15T23:56:07.738189+0000","last_fullsized":"2024-09-15T23:56:07.738189+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:11.302474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.745574+0000","last_change":"2024-09-15T23:56:06.780867+0000","last_active":"2024-09-15T23:56:07.745574+0000","last_peered":"2024-09-15T23:56:07.745574+0000","last_clean":"2024-09-15T23:56:07.745574+0000","last_became_active":"2024-09-15T23:56:06.780267+0000","last_became_peered":"2024-09-15T23:56:06.780267+0000","last_unstale":"2024-09-15T23:56:07.745574+0000","last_undegraded":"2024-09-15T23:56:07.745574+0000","last_fullsized":"2024-09-15T23:56:07.745574+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:04.242208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.748799+0000","last_change":"2024-09-15T23:56:06.776937+0000","last_active":"2024-09-15T23:56:07.748799+0000","last_peered":"2024-09-15T23:56:07.748799+0000","last_clean":"2024-09-15T23:56:07.748799+0000","last_became_active":"2024-09-15T23:56:06.776105+0000","last_became_peered":"2024-09-15T23:56:06.776105+0000","last_unstale":"2024-09-15T23:56:07.748799+0000","last_undegraded":"2024-09-15T23:56:07.748799+0000","last_fullsized":"2024-09-15T23:56:07.748799+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:52.575814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747982+0000","last_change":"2024-09-15T23:56:06.778109+0000","last_active":"2024-09-15T23:56:07.747982+0000","last_peered":"2024-09-15T23:56:07.747982+0000","last_clean":"2024-09-15T23:56:07.747982+0000","last_became_active":"2024-09-15T23:56:06.777323+0000","last_became_peered":"2024-09-15T23:56:06.777323+0000","last_unstale":"2024-09-15T23:56:07.747982+0000","last_undegraded":"2024-09-15T23:56:07.747982+0000","last_fullsized":"2024-09-15T23:56:07.747982+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:40.214469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746475+0000","last_change":"2024-09-15T23:56:06.763281+0000","last_active":"2024-09-15T23:56:07.746475+0000","last_peered":"2024-09-15T23:56:07.746475+0000","last_clean":"2024-09-15T23:56:07.746475+0000","last_became_active":"2024-09-15T23:56:06.762480+0000","last_became_peered":"2024-09-15T23:56:06.762480+0000","last_unstale":"2024-09-15T23:56:07.746475+0000","last_undegraded":"2024-09-15T23:56:07.746475+0000","last_fullsized":"2024-09-15T23:56:07.746475+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:32.458377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.748222+0000","last_change":"2024-09-15T23:56:06.756089+0000","last_active":"2024-09-15T23:56:07.748222+0000","last_peered":"2024-09-15T23:56:07.748222+0000","last_clean":"2024-09-15T23:56:07.748222+0000","last_became_active":"2024-09-15T23:56:06.753163+0000","last_became_peered":"2024-09-15T23:56:06.753163+0000","last_unstale":"2024-09-15T23:56:07.748222+0000","last_undegraded":"2024-09-15T23:56:07.748222+0000","last_fullsized":"2024-09-15T23:56:07.748222+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:40.239312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.743727+0000","last_change":"2024-09-15T23:56:06.779777+0000","last_active":"2024-09-15T23:56:07.743727+0000","last_peered":"2024-09-15T23:56:07.743727+0000","last_clean":"2024-09-15T23:56:07.743727+0000","last_became_active":"2024-09-15T23:56:06.775146+0000","last_became_peered":"2024-09-15T23:56:06.775146+0000","last_unstale":"2024-09-15T23:56:07.743727+0000","last_undegraded":"2024-09-15T23:56:07.743727+0000","last_fullsized":"2024-09-15T23:56:07.743727+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:28.940405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747461+0000","last_change":"2024-09-15T23:56:06.782758+0000","last_active":"2024-09-15T23:56:07.747461+0000","last_peered":"2024-09-15T23:56:07.747461+0000","last_clean":"2024-09-15T23:56:07.747461+0000","last_became_active":"2024-09-15T23:56:06.782243+0000","last_became_peered":"2024-09-15T23:56:06.782243+0000","last_unstale":"2024-09-15T23:56:07.747461+0000","last_undegraded":"2024-09-15T23:56:07.747461+0000","last_fullsized":"2024-09-15T23:56:07.747461+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:39.695111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.748035+0000","last_change":"2024-09-15T23:56:06.773665+0000","last_active":"2024-09-15T23:56:07.748035+0000","last_peered":"2024-09-15T23:56:07.748035+0000","last_clean":"2024-09-15T23:56:07.748035+0000","last_became_active":"2024-09-15T23:56:06.773084+0000","last_became_peered":"2024-09-15T23:56:06.773084+0000","last_unstale":"2024-09-15T23:56:07.748035+0000","last_undegraded":"2024-09-15T23:56:07.748035+0000","last_fullsized":"2024-09-15T23:56:07.748035+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:14.128321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.745469+0000","last_change":"2024-09-15T23:56:06.757534+0000","last_active":"2024-09-15T23:56:07.745469+0000","last_peered":"2024-09-15T23:56:07.745469+0000","last_clean":"2024-09-15T23:56:07.745469+0000","last_became_active":"2024-09-15T23:56:06.757017+0000","last_became_peered":"2024-09-15T23:56:06.757017+0000","last_unstale":"2024-09-15T23:56:07.745469+0000","last_undegraded":"2024-09-15T23:56:07.745469+0000","last_fullsized":"2024-09-15T23:56:07.745469+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:11.525057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.743186+0000","last_change":"2024-09-15T23:56:06.775163+0000","last_active":"2024-09-15T23:56:07.743186+0000","last_peered":"2024-09-15T23:56:07.743186+0000","last_clean":"2024-09-15T23:56:07.743186+0000","last_became_active":"2024-09-15T23:56:06.774380+0000","last_became_peered":"2024-09-15T23:56:06.774380+0000","last_unstale":"2024-09-15T23:56:07.743186+0000","last_undegraded":"2024-09-15T23:56:07.743186+0000","last_fullsized":"2024-09-15T23:56:07.743186+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:32.650593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747443+0000","last_change":"2024-09-15T23:56:06.757969+0000","last_active":"2024-09-15T23:56:07.747443+0000","last_peered":"2024-09-15T23:56:07.747443+0000","last_clean":"2024-09-15T23:56:07.747443+0000","last_became_active":"2024-09-15T23:56:06.757180+0000","last_became_peered":"2024-09-15T23:56:06.757180+0000","last_unstale":"2024-09-15T23:56:07.747443+0000","last_undegraded":"2024-09-15T23:56:07.747443+0000","last_fullsized":"2024-09-15T23:56:07.747443+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:30.565622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.743521+0000","last_change":"2024-09-15T23:56:06.779577+0000","last_active":"2024-09-15T23:56:07.743521+0000","last_peered":"2024-09-15T23:56:07.743521+0000","last_clean":"2024-09-15T23:56:07.743521+0000","last_became_active":"2024-09-15T23:56:06.775301+0000","last_became_peered":"2024-09-15T23:56:06.775301+0000","last_unstale":"2024-09-15T23:56:07.743521+0000","last_undegraded":"2024-09-15T23:56:07.743521+0000","last_fullsized":"2024-09-15T23:56:07.743521+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:11.302474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.743597+0000","last_change":"2024-09-15T23:56:06.763294+0000","last_active":"2024-09-15T23:56:07.743597+0000","last_peered":"2024-09-15T23:56:07.743597+0000","last_clean":"2024-09-15T23:56:07.743597+0000","last_became_active":"2024-09-15T23:56:06.762277+0000","last_became_peered":"2024-09-15T23:56:06.762277+0000","last_unstale":"2024-09-15T23:56:07.743597+0000","last_undegraded":"2024-09-15T23:56:07.743597+0000","last_fullsized":"2024-09-15T23:56:07.743597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:57.268867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746245+0000","last_change":"2024-09-15T23:56:06.769019+0000","last_active":"2024-09-15T23:56:07.746245+0000","last_peered":"2024-09-15T23:56:07.746245+0000","last_clean":"2024-09-15T23:56:07.746245+0000","last_became_active":"2024-09-15T23:56:06.765658+0000","last_became_peered":"2024-09-15T23:56:06.765658+0000","last_unstale":"2024-09-15T23:56:07.746245+0000","last_undegraded":"2024-09-15T23:56:07.746245+0000","last_fullsized":"2024-09-15T23:56:07.746245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:59:25.166403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.745717+0000","last_change":"2024-09-15T23:56:06.756142+0000","last_active":"2024-09-15T23:56:07.745717+0000","last_peered":"2024-09-15T23:56:07.745717+0000","last_clean":"2024-09-15T23:56:07.745717+0000","last_became_active":"2024-09-15T23:56:06.755363+0000","last_became_peered":"2024-09-15T23:56:06.755363+0000","last_unstale":"2024-09-15T23:56:07.745717+0000","last_undegraded":"2024-09-15T23:56:07.745717+0000","last_fullsized":"2024-09-15T23:56:07.745717+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:24.116297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.745160+0000","last_change":"2024-09-15T23:56:06.764626+0000","last_active":"2024-09-15T23:56:07.745160+0000","last_peered":"2024-09-15T23:56:07.745160+0000","last_clean":"2024-09-15T23:56:07.745160+0000","last_became_active":"2024-09-15T23:56:06.758001+0000","last_became_peered":"2024-09-15T23:56:06.758001+0000","last_unstale":"2024-09-15T23:56:07.745160+0000","last_undegraded":"2024-09-15T23:56:07.745160+0000","last_fullsized":"2024-09-15T23:56:07.745160+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:09.570910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.743051+0000","last_change":"2024-09-15T23:56:06.769477+0000","last_active":"2024-09-15T23:56:07.743051+0000","last_peered":"2024-09-15T23:56:07.743051+0000","last_clean":"2024-09-15T23:56:07.743051+0000","last_became_active":"2024-09-15T23:56:06.768884+0000","last_became_peered":"2024-09-15T23:56:06.768884+0000","last_unstale":"2024-09-15T23:56:07.743051+0000","last_undegraded":"2024-09-15T23:56:07.743051+0000","last_fullsized":"2024-09-15T23:56:07.743051+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:06.946832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747268+0000","last_change":"2024-09-15T23:56:06.746760+0000","last_active":"2024-09-15T23:56:07.747268+0000","last_peered":"2024-09-15T23:56:07.747268+0000","last_clean":"2024-09-15T23:56:07.747268+0000","last_became_active":"2024-09-15T23:56:06.745097+0000","last_became_peered":"2024-09-15T23:56:06.745097+0000","last_unstale":"2024-09-15T23:56:07.747268+0000","last_undegraded":"2024-09-15T23:56:07.747268+0000","last_fullsized":"2024-09-15T23:56:07.747268+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:02.773155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"61'4","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.744670+0000","last_change":"2024-09-15T23:56:05.827302+0000","last_active":"2024-09-15T23:56:07.744670+0000","last_peered":"2024-09-15T23:56:07.744670+0000","last_clean":"2024-09-15T23:56:07.744670+0000","last_became_active":"2024-09-15T23:56:05.823783+0000","last_became_peered":"2024-09-15T23:56:05.823783+0000","last_unstale":"2024-09-15T23:56:07.744670+0000","last_undegraded":"2024-09-15T23:56:07.744670+0000","last_fullsized":"2024-09-15T23:56:07.744670+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:01.083685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747908+0000","last_change":"2024-09-15T23:56:06.754280+0000","last_active":"2024-09-15T23:56:07.747908+0000","last_peered":"2024-09-15T23:56:07.747908+0000","last_clean":"2024-09-15T23:56:07.747908+0000","last_became_active":"2024-09-15T23:56:06.753477+0000","last_became_peered":"2024-09-15T23:56:06.753477+0000","last_unstale":"2024-09-15T23:56:07.747908+0000","last_undegraded":"2024-09-15T23:56:07.747908+0000","last_fullsized":"2024-09-15T23:56:07.747908+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:50.529705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.744575+0000","last_change":"2024-09-15T23:56:05.798927+0000","last_active":"2024-09-15T23:56:07.744575+0000","last_peered":"2024-09-15T23:56:07.744575+0000","last_clean":"2024-09-15T23:56:07.744575+0000","last_became_active":"2024-09-15T23:56:05.798114+0000","last_became_peered":"2024-09-15T23:56:05.798114+0000","last_unstale":"2024-09-15T23:56:07.744575+0000","last_undegraded":"2024-09-15T23:56:07.744575+0000","last_fullsized":"2024-09-15T23:56:07.744575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:47:01.011894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746897+0000","last_change":"2024-09-15T23:56:06.772343+0000","last_active":"2024-09-15T23:56:07.746897+0000","last_peered":"2024-09-15T23:56:07.746897+0000","last_clean":"2024-09-15T23:56:07.746897+0000","last_became_active":"2024-09-15T23:56:06.771732+0000","last_became_peered":"2024-09-15T23:56:06.771732+0000","last_unstale":"2024-09-15T23:56:07.746897+0000","last_undegraded":"2024-09-15T23:56:07.746897+0000","last_fullsized":"2024-09-15T23:56:07.746897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:37:42.600362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.744563+0000","last_change":"2024-09-15T23:56:05.822395+0000","last_active":"2024-09-15T23:56:07.744563+0000","last_peered":"2024-09-15T23:56:07.744563+0000","last_clean":"2024-09-15T23:56:07.744563+0000","last_became_active":"2024-09-15T23:56:05.821620+0000","last_became_peered":"2024-09-15T23:56:05.821620+0000","last_unstale":"2024-09-15T23:56:07.744563+0000","last_undegraded":"2024-09-15T23:56:07.744563+0000","last_fullsized":"2024-09-15T23:56:07.744563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:07.675520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747102+0000","last_change":"2024-09-15T23:56:06.753296+0000","last_active":"2024-09-15T23:56:07.747102+0000","last_peered":"2024-09-15T23:56:07.747102+0000","last_clean":"2024-09-15T23:56:07.747102+0000","last_became_active":"2024-09-15T23:56:06.752552+0000","last_became_peered":"2024-09-15T23:56:06.752552+0000","last_unstale":"2024-09-15T23:56:07.747102+0000","last_undegraded":"2024-09-15T23:56:07.747102+0000","last_fullsized":"2024-09-15T23:56:07.747102+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:09.973389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.748355+0000","last_change":"2024-09-15T23:56:05.831362+0000","last_active":"2024-09-15T23:56:07.748355+0000","last_peered":"2024-09-15T23:56:07.748355+0000","last_clean":"2024-09-15T23:56:07.748355+0000","last_became_active":"2024-09-15T23:56:05.830767+0000","last_became_peered":"2024-09-15T23:56:05.830767+0000","last_unstale":"2024-09-15T23:56:07.748355+0000","last_undegraded":"2024-09-15T23:56:07.748355+0000","last_fullsized":"2024-09-15T23:56:07.748355+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:38.014144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.745821+0000","last_change":"2024-09-15T23:56:06.759148+0000","last_active":"2024-09-15T23:56:07.745821+0000","last_peered":"2024-09-15T23:56:07.745821+0000","last_clean":"2024-09-15T23:56:07.745821+0000","last_became_active":"2024-09-15T23:56:06.756956+0000","last_became_peered":"2024-09-15T23:56:06.756956+0000","last_unstale":"2024-09-15T23:56:07.745821+0000","last_undegraded":"2024-09-15T23:56:07.745821+0000","last_fullsized":"2024-09-15T23:56:07.745821+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:14.162477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747755+0000","last_change":"2024-09-15T23:56:05.817449+0000","last_active":"2024-09-15T23:56:07.747755+0000","last_peered":"2024-09-15T23:56:07.747755+0000","last_clean":"2024-09-15T23:56:07.747755+0000","last_became_active":"2024-09-15T23:56:05.816697+0000","last_became_peered":"2024-09-15T23:56:05.816697+0000","last_unstale":"2024-09-15T23:56:07.747755+0000","last_undegraded":"2024-09-15T23:56:07.747755+0000","last_fullsized":"2024-09-15T23:56:07.747755+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:36.441854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.742945+0000","last_change":"2024-09-15T23:56:06.761826+0000","last_active":"2024-09-15T23:56:07.742945+0000","last_peered":"2024-09-15T23:56:07.742945+0000","last_clean":"2024-09-15T23:56:07.742945+0000","last_became_active":"2024-09-15T23:56:06.761059+0000","last_became_peered":"2024-09-15T23:56:06.761059+0000","last_unstale":"2024-09-15T23:56:07.742945+0000","last_undegraded":"2024-09-15T23:56:07.742945+0000","last_fullsized":"2024-09-15T23:56:07.742945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:33.369251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747723+0000","last_change":"2024-09-15T23:56:05.819028+0000","last_active":"2024-09-15T23:56:07.747723+0000","last_peered":"2024-09-15T23:56:07.747723+0000","last_clean":"2024-09-15T23:56:07.747723+0000","last_became_active":"2024-09-15T23:56:05.818281+0000","last_became_peered":"2024-09-15T23:56:05.818281+0000","last_unstale":"2024-09-15T23:56:07.747723+0000","last_undegraded":"2024-09-15T23:56:07.747723+0000","last_fullsized":"2024-09-15T23:56:07.747723+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:59.787456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.737963+0000","last_change":"2024-09-15T23:56:06.764745+0000","last_active":"2024-09-15T23:56:07.737963+0000","last_peered":"2024-09-15T23:56:07.737963+0000","last_clean":"2024-09-15T23:56:07.737963+0000","last_became_active":"2024-09-15T23:56:06.762841+0000","last_became_peered":"2024-09-15T23:56:06.762841+0000","last_unstale":"2024-09-15T23:56:07.737963+0000","last_undegraded":"2024-09-15T23:56:07.737963+0000","last_fullsized":"2024-09-15T23:56:07.737963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:08.681192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.742853+0000","last_change":"2024-09-15T23:56:05.805698+0000","last_active":"2024-09-15T23:56:07.742853+0000","last_peered":"2024-09-15T23:56:07.742853+0000","last_clean":"2024-09-15T23:56:07.742853+0000","last_became_active":"2024-09-15T23:56:05.804966+0000","last_became_peered":"2024-09-15T23:56:05.804966+0000","last_unstale":"2024-09-15T23:56:07.742853+0000","last_undegraded":"2024-09-15T23:56:07.742853+0000","last_fullsized":"2024-09-15T23:56:07.742853+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:59.087296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747212+0000","last_change":"2024-09-15T23:56:06.758212+0000","last_active":"2024-09-15T23:56:07.747212+0000","last_peered":"2024-09-15T23:56:07.747212+0000","last_clean":"2024-09-15T23:56:07.747212+0000","last_became_active":"2024-09-15T23:56:06.757476+0000","last_became_peered":"2024-09-15T23:56:06.757476+0000","last_unstale":"2024-09-15T23:56:07.747212+0000","last_undegraded":"2024-09-15T23:56:07.747212+0000","last_fullsized":"2024-09-15T23:56:07.747212+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:57.801350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746250+0000","last_change":"2024-09-15T23:56:05.818562+0000","last_active":"2024-09-15T23:56:07.746250+0000","last_peered":"2024-09-15T23:56:07.746250+0000","last_clean":"2024-09-15T23:56:07.746250+0000","last_became_active":"2024-09-15T23:56:05.818292+0000","last_became_peered":"2024-09-15T23:56:05.818292+0000","last_unstale":"2024-09-15T23:56:07.746250+0000","last_undegraded":"2024-09-15T23:56:07.746250+0000","last_fullsized":"2024-09-15T23:56:07.746250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:35.007780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.743818+0000","last_change":"2024-09-15T23:56:06.762482+0000","last_active":"2024-09-15T23:56:07.743818+0000","last_peered":"2024-09-15T23:56:07.743818+0000","last_clean":"2024-09-15T23:56:07.743818+0000","last_became_active":"2024-09-15T23:56:06.761213+0000","last_became_peered":"2024-09-15T23:56:06.761213+0000","last_unstale":"2024-09-15T23:56:07.743818+0000","last_undegraded":"2024-09-15T23:56:07.743818+0000","last_fullsized":"2024-09-15T23:56:07.743818+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:59:25.166403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746926+0000","last_change":"2024-09-15T23:56:05.828221+0000","last_active":"2024-09-15T23:56:07.746926+0000","last_peered":"2024-09-15T23:56:07.746926+0000","last_clean":"2024-09-15T23:56:07.746926+0000","last_became_active":"2024-09-15T23:56:05.827866+0000","last_became_peered":"2024-09-15T23:56:05.827866+0000","last_unstale":"2024-09-15T23:56:07.746926+0000","last_undegraded":"2024-09-15T23:56:07.746926+0000","last_fullsized":"2024-09-15T23:56:07.746926+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:26.036595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747313+0000","last_change":"2024-09-15T23:56:06.761261+0000","last_active":"2024-09-15T23:56:07.747313+0000","last_peered":"2024-09-15T23:56:07.747313+0000","last_clean":"2024-09-15T23:56:07.747313+0000","last_became_active":"2024-09-15T23:56:06.760309+0000","last_became_peered":"2024-09-15T23:56:06.760309+0000","last_unstale":"2024-09-15T23:56:07.747313+0000","last_undegraded":"2024-09-15T23:56:07.747313+0000","last_fullsized":"2024-09-15T23:56:07.747313+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:15.219985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.744822+0000","last_change":"2024-09-15T23:56:05.813560+0000","last_active":"2024-09-15T23:56:07.744822+0000","last_peered":"2024-09-15T23:56:07.744822+0000","last_clean":"2024-09-15T23:56:07.744822+0000","last_became_active":"2024-09-15T23:56:05.813170+0000","last_became_peered":"2024-09-15T23:56:05.813170+0000","last_unstale":"2024-09-15T23:56:07.744822+0000","last_undegraded":"2024-09-15T23:56:07.744822+0000","last_fullsized":"2024-09-15T23:56:07.744822+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:13.122650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.744262+0000","last_change":"2024-09-15T23:56:06.780256+0000","last_active":"2024-09-15T23:56:07.744262+0000","last_peered":"2024-09-15T23:56:07.744262+0000","last_clean":"2024-09-15T23:56:07.744262+0000","last_became_active":"2024-09-15T23:56:06.775580+0000","last_became_peered":"2024-09-15T23:56:06.775580+0000","last_unstale":"2024-09-15T23:56:07.744262+0000","last_undegraded":"2024-09-15T23:56:07.744262+0000","last_fullsized":"2024-09-15T23:56:07.744262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:39.615757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.748185+0000","last_change":"2024-09-15T23:56:05.802924+0000","last_active":"2024-09-15T23:56:07.748185+0000","last_peered":"2024-09-15T23:56:07.748185+0000","last_clean":"2024-09-15T23:56:07.748185+0000","last_became_active":"2024-09-15T23:56:05.797987+0000","last_became_peered":"2024-09-15T23:56:05.797987+0000","last_unstale":"2024-09-15T23:56:07.748185+0000","last_undegraded":"2024-09-15T23:56:07.748185+0000","last_fullsized":"2024-09-15T23:56:07.748185+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:02.235101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.749002+0000","last_change":"2024-09-15T23:56:06.766227+0000","last_active":"2024-09-15T23:56:07.749002+0000","last_peered":"2024-09-15T23:56:07.749002+0000","last_clean":"2024-09-15T23:56:07.749002+0000","last_became_active":"2024-09-15T23:56:06.765437+0000","last_became_peered":"2024-09-15T23:56:06.765437+0000","last_unstale":"2024-09-15T23:56:07.749002+0000","last_undegraded":"2024-09-15T23:56:07.749002+0000","last_fullsized":"2024-09-15T23:56:07.749002+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:14.275730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.748555+0000","last_change":"2024-09-15T23:56:05.829166+0000","last_active":"2024-09-15T23:56:07.748555+0000","last_peered":"2024-09-15T23:56:07.748555+0000","last_clean":"2024-09-15T23:56:07.748555+0000","last_became_active":"2024-09-15T23:56:05.828476+0000","last_became_peered":"2024-09-15T23:56:05.828476+0000","last_unstale":"2024-09-15T23:56:07.748555+0000","last_undegraded":"2024-09-15T23:56:07.748555+0000","last_fullsized":"2024-09-15T23:56:07.748555+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:32.006457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.737175+0000","last_change":"2024-09-15T23:56:06.773887+0000","last_active":"2024-09-15T23:56:07.737175+0000","last_peered":"2024-09-15T23:56:07.737175+0000","last_clean":"2024-09-15T23:56:07.737175+0000","last_became_active":"2024-09-15T23:56:06.773139+0000","last_became_peered":"2024-09-15T23:56:06.773139+0000","last_unstale":"2024-09-15T23:56:07.737175+0000","last_undegraded":"2024-09-15T23:56:07.737175+0000","last_fullsized":"2024-09-15T23:56:07.737175+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:43.364404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746346+0000","last_change":"2024-09-15T23:56:05.818073+0000","last_active":"2024-09-15T23:56:07.746346+0000","last_peered":"2024-09-15T23:56:07.746346+0000","last_clean":"2024-09-15T23:56:07.746346+0000","last_became_active":"2024-09-15T23:56:05.817658+0000","last_became_peered":"2024-09-15T23:56:05.817658+0000","last_unstale":"2024-09-15T23:56:07.746346+0000","last_undegraded":"2024-09-15T23:56:07.746346+0000","last_fullsized":"2024-09-15T23:56:07.746346+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:31.522104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.737646+0000","last_change":"2024-09-15T23:56:06.766008+0000","last_active":"2024-09-15T23:56:07.737646+0000","last_peered":"2024-09-15T23:56:07.737646+0000","last_clean":"2024-09-15T23:56:07.737646+0000","last_became_active":"2024-09-15T23:56:06.765090+0000","last_became_peered":"2024-09-15T23:56:06.765090+0000","last_unstale":"2024-09-15T23:56:07.737646+0000","last_undegraded":"2024-09-15T23:56:07.737646+0000","last_fullsized":"2024-09-15T23:56:07.737646+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:02.089357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.737924+0000","last_change":"2024-09-15T23:56:05.811763+0000","last_active":"2024-09-15T23:56:07.737924+0000","last_peered":"2024-09-15T23:56:07.737924+0000","last_clean":"2024-09-15T23:56:07.737924+0000","last_became_active":"2024-09-15T23:56:05.811343+0000","last_became_peered":"2024-09-15T23:56:05.811343+0000","last_unstale":"2024-09-15T23:56:07.737924+0000","last_undegraded":"2024-09-15T23:56:07.737924+0000","last_fullsized":"2024-09-15T23:56:07.737924+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:09.755848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.737588+0000","last_change":"2024-09-15T23:56:06.784072+0000","last_active":"2024-09-15T23:56:07.737588+0000","last_peered":"2024-09-15T23:56:07.737588+0000","last_clean":"2024-09-15T23:56:07.737588+0000","last_became_active":"2024-09-15T23:56:06.778524+0000","last_became_peered":"2024-09-15T23:56:06.778524+0000","last_unstale":"2024-09-15T23:56:07.737588+0000","last_undegraded":"2024-09-15T23:56:07.737588+0000","last_fullsized":"2024-09-15T23:56:07.737588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:47:02.017565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746915+0000","last_change":"2024-09-15T23:56:05.810472+0000","last_active":"2024-09-15T23:56:07.746915+0000","last_peered":"2024-09-15T23:56:07.746915+0000","last_clean":"2024-09-15T23:56:07.746915+0000","last_became_active":"2024-09-15T23:56:05.810169+0000","last_became_peered":"2024-09-15T23:56:05.810169+0000","last_unstale":"2024-09-15T23:56:07.746915+0000","last_undegraded":"2024-09-15T23:56:07.746915+0000","last_fullsized":"2024-09-15T23:56:07.746915+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:20.293795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.742692+0000","last_change":"2024-09-15T23:56:06.748682+0000","last_active":"2024-09-15T23:56:07.742692+0000","last_peered":"2024-09-15T23:56:07.742692+0000","last_clean":"2024-09-15T23:56:07.742692+0000","last_became_active":"2024-09-15T23:56:06.747848+0000","last_became_peered":"2024-09-15T23:56:06.747848+0000","last_unstale":"2024-09-15T23:56:07.742692+0000","last_undegraded":"2024-09-15T23:56:07.742692+0000","last_fullsized":"2024-09-15T23:56:07.742692+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:24.116297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":22,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.737263+0000","last_change":"2024-09-15T23:56:05.800305+0000","last_active":"2024-09-15T23:56:07.737263+0000","last_peered":"2024-09-15T23:56:07.737263+0000","last_clean":"2024-09-15T23:56:07.737263+0000","last_became_active":"2024-09-15T23:56:05.800011+0000","last_became_peered":"2024-09-15T23:56:05.800011+0000","last_unstale":"2024-09-15T23:56:07.737263+0000","last_undegraded":"2024-09-15T23:56:07.737263+0000","last_fullsized":"2024-09-15T23:56:07.737263+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:13.122650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747632+0000","last_change":"2024-09-15T23:56:06.758366+0000","last_active":"2024-09-15T23:56:07.747632+0000","last_peered":"2024-09-15T23:56:07.747632+0000","last_clean":"2024-09-15T23:56:07.747632+0000","last_became_active":"2024-09-15T23:56:06.757652+0000","last_became_peered":"2024-09-15T23:56:06.757652+0000","last_unstale":"2024-09-15T23:56:07.747632+0000","last_undegraded":"2024-09-15T23:56:07.747632+0000","last_fullsized":"2024-09-15T23:56:07.747632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:09.915507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747028+0000","last_change":"2024-09-15T23:56:05.826449+0000","last_active":"2024-09-15T23:56:07.747028+0000","last_peered":"2024-09-15T23:56:07.747028+0000","last_clean":"2024-09-15T23:56:07.747028+0000","last_became_active":"2024-09-15T23:56:05.826120+0000","last_became_peered":"2024-09-15T23:56:05.826120+0000","last_unstale":"2024-09-15T23:56:07.747028+0000","last_undegraded":"2024-09-15T23:56:07.747028+0000","last_fullsized":"2024-09-15T23:56:07.747028+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:42.358732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.743881+0000","last_change":"2024-09-15T23:56:06.763252+0000","last_active":"2024-09-15T23:56:07.743881+0000","last_peered":"2024-09-15T23:56:07.743881+0000","last_clean":"2024-09-15T23:56:07.743881+0000","last_became_active":"2024-09-15T23:56:06.762481+0000","last_became_peered":"2024-09-15T23:56:06.762481+0000","last_unstale":"2024-09-15T23:56:07.743881+0000","last_undegraded":"2024-09-15T23:56:07.743881+0000","last_fullsized":"2024-09-15T23:56:07.743881+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:06.226239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.748245+0000","last_change":"2024-09-15T23:56:05.821472+0000","last_active":"2024-09-15T23:56:07.748245+0000","last_peered":"2024-09-15T23:56:07.748245+0000","last_clean":"2024-09-15T23:56:07.748245+0000","last_became_active":"2024-09-15T23:56:05.819143+0000","last_became_peered":"2024-09-15T23:56:05.819143+0000","last_unstale":"2024-09-15T23:56:07.748245+0000","last_undegraded":"2024-09-15T23:56:07.748245+0000","last_fullsized":"2024-09-15T23:56:07.748245+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:52:12.743315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.744590+0000","last_change":"2024-09-15T23:56:06.786244+0000","last_active":"2024-09-15T23:56:07.744590+0000","last_peered":"2024-09-15T23:56:07.744590+0000","last_clean":"2024-09-15T23:56:07.744590+0000","last_became_active":"2024-09-15T23:56:06.785642+0000","last_became_peered":"2024-09-15T23:56:06.785642+0000","last_unstale":"2024-09-15T23:56:07.744590+0000","last_undegraded":"2024-09-15T23:56:07.744590+0000","last_fullsized":"2024-09-15T23:56:07.744590+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:26.611856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.748462+0000","last_change":"2024-09-15T23:56:05.804142+0000","last_active":"2024-09-15T23:56:07.748462+0000","last_peered":"2024-09-15T23:56:07.748462+0000","last_clean":"2024-09-15T23:56:07.748462+0000","last_became_active":"2024-09-15T23:56:05.803516+0000","last_became_peered":"2024-09-15T23:56:05.803516+0000","last_unstale":"2024-09-15T23:56:07.748462+0000","last_undegraded":"2024-09-15T23:56:07.748462+0000","last_fullsized":"2024-09-15T23:56:07.748462+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:58.103804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.749147+0000","last_change":"2024-09-15T23:56:06.759523+0000","last_active":"2024-09-15T23:56:07.749147+0000","last_peered":"2024-09-15T23:56:07.749147+0000","last_clean":"2024-09-15T23:56:07.749147+0000","last_became_active":"2024-09-15T23:56:06.754120+0000","last_became_peered":"2024-09-15T23:56:06.754120+0000","last_unstale":"2024-09-15T23:56:07.749147+0000","last_undegraded":"2024-09-15T23:56:07.749147+0000","last_fullsized":"2024-09-15T23:56:07.749147+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:39.102764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746963+0000","last_change":"2024-09-15T23:56:05.820146+0000","last_active":"2024-09-15T23:56:07.746963+0000","last_peered":"2024-09-15T23:56:07.746963+0000","last_clean":"2024-09-15T23:56:07.746963+0000","last_became_active":"2024-09-15T23:56:05.815371+0000","last_became_peered":"2024-09-15T23:56:05.815371+0000","last_unstale":"2024-09-15T23:56:07.746963+0000","last_undegraded":"2024-09-15T23:56:07.746963+0000","last_fullsized":"2024-09-15T23:56:07.746963+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:51.368794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.745837+0000","last_change":"2024-09-15T23:56:06.782993+0000","last_active":"2024-09-15T23:56:07.745837+0000","last_peered":"2024-09-15T23:56:07.745837+0000","last_clean":"2024-09-15T23:56:07.745837+0000","last_became_active":"2024-09-15T23:56:06.782455+0000","last_became_peered":"2024-09-15T23:56:06.782455+0000","last_unstale":"2024-09-15T23:56:07.745837+0000","last_undegraded":"2024-09-15T23:56:07.745837+0000","last_fullsized":"2024-09-15T23:56:07.745837+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:40.061867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746207+0000","last_change":"2024-09-15T23:56:05.805390+0000","last_active":"2024-09-15T23:56:07.746207+0000","last_peered":"2024-09-15T23:56:07.746207+0000","last_clean":"2024-09-15T23:56:07.746207+0000","last_became_active":"2024-09-15T23:56:05.804691+0000","last_became_peered":"2024-09-15T23:56:05.804691+0000","last_unstale":"2024-09-15T23:56:07.746207+0000","last_undegraded":"2024-09-15T23:56:07.746207+0000","last_fullsized":"2024-09-15T23:56:07.746207+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:40.276819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.743091+0000","last_change":"2024-09-15T23:56:06.772910+0000","last_active":"2024-09-15T23:56:07.743091+0000","last_peered":"2024-09-15T23:56:07.743091+0000","last_clean":"2024-09-15T23:56:07.743091+0000","last_became_active":"2024-09-15T23:56:06.772251+0000","last_became_peered":"2024-09-15T23:56:06.772251+0000","last_unstale":"2024-09-15T23:56:07.743091+0000","last_undegraded":"2024-09-15T23:56:07.743091+0000","last_fullsized":"2024-09-15T23:56:07.743091+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:02.089357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.738170+0000","last_change":"2024-09-15T23:56:05.823127+0000","last_active":"2024-09-15T23:56:07.738170+0000","last_peered":"2024-09-15T23:56:07.738170+0000","last_clean":"2024-09-15T23:56:07.738170+0000","last_became_active":"2024-09-15T23:56:05.822748+0000","last_became_peered":"2024-09-15T23:56:05.822748+0000","last_unstale":"2024-09-15T23:56:07.738170+0000","last_undegraded":"2024-09-15T23:56:07.738170+0000","last_fullsized":"2024-09-15T23:56:07.738170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:52.188118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746983+0000","last_change":"2024-09-15T23:56:06.743354+0000","last_active":"2024-09-15T23:56:07.746983+0000","last_peered":"2024-09-15T23:56:07.746983+0000","last_clean":"2024-09-15T23:56:07.746983+0000","last_became_active":"2024-09-15T23:56:06.742590+0000","last_became_peered":"2024-09-15T23:56:06.742590+0000","last_unstale":"2024-09-15T23:56:07.746983+0000","last_undegraded":"2024-09-15T23:56:07.746983+0000","last_fullsized":"2024-09-15T23:56:07.746983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:43.160102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.745437+0000","last_change":"2024-09-15T23:56:05.806127+0000","last_active":"2024-09-15T23:56:07.745437+0000","last_peered":"2024-09-15T23:56:07.745437+0000","last_clean":"2024-09-15T23:56:07.745437+0000","last_became_active":"2024-09-15T23:56:05.804982+0000","last_became_peered":"2024-09-15T23:56:05.804982+0000","last_unstale":"2024-09-15T23:56:07.745437+0000","last_undegraded":"2024-09-15T23:56:07.745437+0000","last_fullsized":"2024-09-15T23:56:07.745437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:41.773267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.748220+0000","last_change":"2024-09-15T23:56:06.758340+0000","last_active":"2024-09-15T23:56:07.748220+0000","last_peered":"2024-09-15T23:56:07.748220+0000","last_clean":"2024-09-15T23:56:07.748220+0000","last_became_active":"2024-09-15T23:56:06.757584+0000","last_became_peered":"2024-09-15T23:56:06.757584+0000","last_unstale":"2024-09-15T23:56:07.748220+0000","last_undegraded":"2024-09-15T23:56:07.748220+0000","last_fullsized":"2024-09-15T23:56:07.748220+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:20.750068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747129+0000","last_change":"2024-09-15T23:56:05.815615+0000","last_active":"2024-09-15T23:56:07.747129+0000","last_peered":"2024-09-15T23:56:07.747129+0000","last_clean":"2024-09-15T23:56:07.747129+0000","last_became_active":"2024-09-15T23:56:05.814733+0000","last_became_peered":"2024-09-15T23:56:05.814733+0000","last_unstale":"2024-09-15T23:56:07.747129+0000","last_undegraded":"2024-09-15T23:56:07.747129+0000","last_fullsized":"2024-09-15T23:56:07.747129+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:47:01.011894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747739+0000","last_change":"2024-09-15T23:56:06.741435+0000","last_active":"2024-09-15T23:56:07.747739+0000","last_peered":"2024-09-15T23:56:07.747739+0000","last_clean":"2024-09-15T23:56:07.747739+0000","last_became_active":"2024-09-15T23:56:06.740631+0000","last_became_peered":"2024-09-15T23:56:06.740631+0000","last_unstale":"2024-09-15T23:56:07.747739+0000","last_undegraded":"2024-09-15T23:56:07.747739+0000","last_fullsized":"2024-09-15T23:56:07.747739+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:52.121926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"62'1","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:08.793871+0000","last_change":"2024-09-15T23:56:05.814902+0000","last_active":"2024-09-15T23:56:08.793871+0000","last_peered":"2024-09-15T23:56:08.793871+0000","last_clean":"2024-09-15T23:56:08.793871+0000","last_became_active":"2024-09-15T23:56:05.814456+0000","last_became_peered":"2024-09-15T23:56:05.814456+0000","last_unstale":"2024-09-15T23:56:08.793871+0000","last_undegraded":"2024-09-15T23:56:08.793871+0000","last_fullsized":"2024-09-15T23:56:08.793871+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:12.768496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.748705+0000","last_change":"2024-09-15T23:56:06.785277+0000","last_active":"2024-09-15T23:56:07.748705+0000","last_peered":"2024-09-15T23:56:07.748705+0000","last_clean":"2024-09-15T23:56:07.748705+0000","last_became_active":"2024-09-15T23:56:06.784794+0000","last_became_peered":"2024-09-15T23:56:06.784794+0000","last_unstale":"2024-09-15T23:56:07.748705+0000","last_undegraded":"2024-09-15T23:56:07.748705+0000","last_fullsized":"2024-09-15T23:56:07.748705+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:35.710351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746398+0000","last_change":"2024-09-15T23:56:05.806883+0000","last_active":"2024-09-15T23:56:07.746398+0000","last_peered":"2024-09-15T23:56:07.746398+0000","last_clean":"2024-09-15T23:56:07.746398+0000","last_became_active":"2024-09-15T23:56:05.806162+0000","last_became_peered":"2024-09-15T23:56:05.806162+0000","last_unstale":"2024-09-15T23:56:07.746398+0000","last_undegraded":"2024-09-15T23:56:07.746398+0000","last_fullsized":"2024-09-15T23:56:07.746398+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:09.390084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.749283+0000","last_change":"2024-09-15T23:56:06.754868+0000","last_active":"2024-09-15T23:56:07.749283+0000","last_peered":"2024-09-15T23:56:07.749283+0000","last_clean":"2024-09-15T23:56:07.749283+0000","last_became_active":"2024-09-15T23:56:06.753190+0000","last_became_peered":"2024-09-15T23:56:06.753190+0000","last_unstale":"2024-09-15T23:56:07.749283+0000","last_undegraded":"2024-09-15T23:56:07.749283+0000","last_fullsized":"2024-09-15T23:56:07.749283+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:30.743579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747284+0000","last_change":"2024-09-15T23:56:05.821612+0000","last_active":"2024-09-15T23:56:07.747284+0000","last_peered":"2024-09-15T23:56:07.747284+0000","last_clean":"2024-09-15T23:56:07.747284+0000","last_became_active":"2024-09-15T23:56:05.820917+0000","last_became_peered":"2024-09-15T23:56:05.820917+0000","last_unstale":"2024-09-15T23:56:07.747284+0000","last_undegraded":"2024-09-15T23:56:07.747284+0000","last_fullsized":"2024-09-15T23:56:07.747284+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:59:31.189118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746008+0000","last_change":"2024-09-15T23:56:06.777476+0000","last_active":"2024-09-15T23:56:07.746008+0000","last_peered":"2024-09-15T23:56:07.746008+0000","last_clean":"2024-09-15T23:56:07.746008+0000","last_became_active":"2024-09-15T23:56:06.769377+0000","last_became_peered":"2024-09-15T23:56:06.769377+0000","last_unstale":"2024-09-15T23:56:07.746008+0000","last_undegraded":"2024-09-15T23:56:07.746008+0000","last_fullsized":"2024-09-15T23:56:07.746008+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:33.369251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.743918+0000","last_change":"2024-09-15T23:56:05.806598+0000","last_active":"2024-09-15T23:56:07.743918+0000","last_peered":"2024-09-15T23:56:07.743918+0000","last_clean":"2024-09-15T23:56:07.743918+0000","last_became_active":"2024-09-15T23:56:05.806077+0000","last_became_peered":"2024-09-15T23:56:05.806077+0000","last_unstale":"2024-09-15T23:56:07.743918+0000","last_undegraded":"2024-09-15T23:56:07.743918+0000","last_fullsized":"2024-09-15T23:56:07.743918+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:03.236536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.743480+0000","last_change":"2024-09-15T23:56:06.763312+0000","last_active":"2024-09-15T23:56:07.743480+0000","last_peered":"2024-09-15T23:56:07.743480+0000","last_clean":"2024-09-15T23:56:07.743480+0000","last_became_active":"2024-09-15T23:56:06.762549+0000","last_became_peered":"2024-09-15T23:56:06.762549+0000","last_unstale":"2024-09-15T23:56:07.743480+0000","last_undegraded":"2024-09-15T23:56:07.743480+0000","last_fullsized":"2024-09-15T23:56:07.743480+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:00.092968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.742819+0000","last_change":"2024-09-15T23:56:05.827297+0000","last_active":"2024-09-15T23:56:07.742819+0000","last_peered":"2024-09-15T23:56:07.742819+0000","last_clean":"2024-09-15T23:56:07.742819+0000","last_became_active":"2024-09-15T23:56:05.823847+0000","last_became_peered":"2024-09-15T23:56:05.823847+0000","last_unstale":"2024-09-15T23:56:07.742819+0000","last_undegraded":"2024-09-15T23:56:07.742819+0000","last_fullsized":"2024-09-15T23:56:07.742819+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:31.644922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747093+0000","last_change":"2024-09-15T23:56:06.771716+0000","last_active":"2024-09-15T23:56:07.747093+0000","last_peered":"2024-09-15T23:56:07.747093+0000","last_clean":"2024-09-15T23:56:07.747093+0000","last_became_active":"2024-09-15T23:56:06.771042+0000","last_became_peered":"2024-09-15T23:56:06.771042+0000","last_unstale":"2024-09-15T23:56:07.747093+0000","last_undegraded":"2024-09-15T23:56:07.747093+0000","last_fullsized":"2024-09-15T23:56:07.747093+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:15.433813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.748473+0000","last_change":"2024-09-15T23:56:05.817135+0000","last_active":"2024-09-15T23:56:07.748473+0000","last_peered":"2024-09-15T23:56:07.748473+0000","last_clean":"2024-09-15T23:56:07.748473+0000","last_became_active":"2024-09-15T23:56:05.816411+0000","last_became_peered":"2024-09-15T23:56:05.816411+0000","last_unstale":"2024-09-15T23:56:07.748473+0000","last_undegraded":"2024-09-15T23:56:07.748473+0000","last_fullsized":"2024-09-15T23:56:07.748473+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:02.770984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.747494+0000","last_change":"2024-09-15T23:56:06.754289+0000","last_active":"2024-09-15T23:56:07.747494+0000","last_peered":"2024-09-15T23:56:07.747494+0000","last_clean":"2024-09-15T23:56:07.747494+0000","last_became_active":"2024-09-15T23:56:06.753026+0000","last_became_peered":"2024-09-15T23:56:06.753026+0000","last_unstale":"2024-09-15T23:56:07.747494+0000","last_undegraded":"2024-09-15T23:56:07.747494+0000","last_fullsized":"2024-09-15T23:56:07.747494+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:17.071298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.745734+0000","last_change":"2024-09-15T23:56:05.823993+0000","last_active":"2024-09-15T23:56:07.745734+0000","last_peered":"2024-09-15T23:56:07.745734+0000","last_clean":"2024-09-15T23:56:07.745734+0000","last_became_active":"2024-09-15T23:56:05.822463+0000","last_became_peered":"2024-09-15T23:56:05.822463+0000","last_unstale":"2024-09-15T23:56:07.745734+0000","last_undegraded":"2024-09-15T23:56:07.745734+0000","last_fullsized":"2024-09-15T23:56:07.745734+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:46.412663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.737711+0000","last_change":"2024-09-15T23:56:06.761578+0000","last_active":"2024-09-15T23:56:07.737711+0000","last_peered":"2024-09-15T23:56:07.737711+0000","last_clean":"2024-09-15T23:56:07.737711+0000","last_became_active":"2024-09-15T23:56:06.760782+0000","last_became_peered":"2024-09-15T23:56:06.760782+0000","last_unstale":"2024-09-15T23:56:07.737711+0000","last_undegraded":"2024-09-15T23:56:07.737711+0000","last_fullsized":"2024-09-15T23:56:07.737711+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:05.772371+0000","last_clean_scrub_stamp":"2024-09-15T23:56:05.772371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:32.650593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.746023+0000","last_change":"2024-09-15T23:56:05.808917+0000","last_active":"2024-09-15T23:56:07.746023+0000","last_peered":"2024-09-15T23:56:07.746023+0000","last_clean":"2024-09-15T23:56:07.746023+0000","last_became_active":"2024-09-15T23:56:05.808220+0000","last_became_peered":"2024-09-15T23:56:05.808220+0000","last_unstale":"2024-09-15T23:56:07.746023+0000","last_undegraded":"2024-09-15T23:56:07.746023+0000","last_fullsized":"2024-09-15T23:56:07.746023+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:04.766700+0000","last_clean_scrub_stamp":"2024-09-15T23:56:04.766700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:50.965466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":244,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T23:56:07.737232+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:56:07.737232+0000","last_peered":"2024-09-15T23:56:07.737232+0000","last_clean":"2024-09-15T23:56:07.737232+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:56:07.737232+0000","last_undegraded":"2024-09-15T23:56:07.737232+0000","last_fullsized":"2024-09-15T23:56:07.737232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509474,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":741376,"data_stored":330678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":761856,"data_stored":332942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":745472,"data_stored":331260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":749568,"data_stored":330838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":749568,"data_stored":330734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509474,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1339392,"data_stored":921080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":741376,"data_stored":330678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1355776,"data_stored":922770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:56:14.596 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:56:14.596 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:56:14.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.762+0000 7f1198cc6640 1 Processor -- start 2024-09-15T23:56:14.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.762+0000 7f1198cc6640 1 -- start start 2024-09-15T23:56:14.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1198cc6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f11940cefe0 0x7f1194071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1198cc6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f119406ef10 0x7f119406f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1198cc6640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f119415b800 con 0x7f11940af100 2024-09-15T23:56:14.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1198cc6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f119406f880 con 0x7f11940cefe0 2024-09-15T23:56:14.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1198cc6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f11940723a0 con 0x7f119406ef10 2024-09-15T23:56:14.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f119259c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f11940af100 0x7f11940acf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38376/0 (socket says 172.21.15.112:38376) 2024-09-15T23:56:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f119259c640 1 -- 172.21.15.112:0/4072945823 learned_addr learned my addr 172.21.15.112:0/4072945823 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 -- 172.21.15.112:0/4072945823 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2219018372 0 0) 0x7f119415b800 con 0x7f11940af100 2024-09-15T23:56:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f118bfff640 1 --2- 172.21.15.112:0/4072945823 >> v2:172.21.15.169:3300/0 conn(0x7f11940cefe0 0x7f1194071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 -- 172.21.15.112:0/4072945823 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1180003530 con 0x7f11940af100 2024-09-15T23:56:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1192d9d640 1 --2- 172.21.15.112:0/4072945823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f119406ef10 0x7f119406f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 -- 172.21.15.112:0/4072945823 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3058195058 0 0) 0x7f1180003530 con 0x7f11940af100 2024-09-15T23:56:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 -- 172.21.15.112:0/4072945823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f119406ef10 msgr2=0x7f119406f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 --2- 172.21.15.112:0/4072945823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f119406ef10 0x7f119406f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 -- 172.21.15.112:0/4072945823 >> v2:172.21.15.169:3300/0 conn(0x7f11940cefe0 msgr2=0x7f1194071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 --2- 172.21.15.112:0/4072945823 >> v2:172.21.15.169:3300/0 conn(0x7f11940cefe0 0x7f1194071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 -- 172.21.15.112:0/4072945823 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1194072680 con 0x7f11940af100 2024-09-15T23:56:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 -- 172.21.15.112:0/4072945823 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f1184001680 con 0x7f11940af100 2024-09-15T23:56:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 -- 172.21.15.112:0/4072945823 >> v1:172.21.15.112:6789/0 conn(0x7f11940af100 legacy=0x7f11940acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 --2- 172.21.15.112:0/4072945823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f119406ef10 0x7f11800039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 --2- 172.21.15.112:0/4072945823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1180003ff0 0x7f1180004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 --2- 172.21.15.112:0/4072945823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1180004d50 0x7f11800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 -- 172.21.15.112:0/4072945823 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f119406f880 con 0x7f1180004d50 2024-09-15T23:56:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 -- 172.21.15.112:0/4072945823 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f11940723a0 con 0x7f1180003ff0 2024-09-15T23:56:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 -- 172.21.15.112:0/4072945823 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f118000bb90 con 0x7f119406ef10 2024-09-15T23:56:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1192d9d640 1 --2- 172.21.15.112:0/4072945823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1180004d50 0x7f11800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f118bfff640 1 --2- 172.21.15.112:0/4072945823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1180003ff0 0x7f1180004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f119259c640 1 --2- 172.21.15.112:0/4072945823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f119406ef10 0x7f11800039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1192d9d640 1 -- 172.21.15.112:0/4072945823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f119406ef10 msgr2=0x7f11800039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1192d9d640 1 --2- 172.21.15.112:0/4072945823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f119406ef10 0x7f11800039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1192d9d640 1 -- 172.21.15.112:0/4072945823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1180003ff0 msgr2=0x7f1180004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:14.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1192d9d640 1 --2- 172.21.15.112:0/4072945823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1180003ff0 0x7f1180004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1192d9d640 1 -- 172.21.15.112:0/4072945823 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1180003530 con 0x7f1180004d50 2024-09-15T23:56:14.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f119259c640 1 --2- 172.21.15.112:0/4072945823 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f119406ef10 0x7f11800039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:14.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1192d9d640 1 --2- 172.21.15.112:0/4072945823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1180004d50 0x7f11800051d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f118c007360 tx=0x7f118c01ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fecd33cea8fb638 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:14.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 -- 172.21.15.112:0/4072945823 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c0b2070 con 0x7f1180004d50 2024-09-15T23:56:14.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 -- 172.21.15.112:0/4072945823 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f118c0a5d40 con 0x7f1180004d50 2024-09-15T23:56:14.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.766+0000 7f1191d9b640 1 -- 172.21.15.112:0/4072945823 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c009bc0 con 0x7f1180004d50 2024-09-15T23:56:14.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 -- 172.21.15.112:0/4072945823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1180004d50 msgr2=0x7f11800051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 --2- 172.21.15.112:0/4072945823 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1180004d50 0x7f11800051d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f118c007360 tx=0x7f118c01ce20 comp rx=0 tx=0).stop 2024-09-15T23:56:14.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1192d9d640 1 -- 172.21.15.112:0/4072945823 reap_dead start 2024-09-15T23:56:14.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 -- 172.21.15.112:0/4072945823 shutdown_connections 2024-09-15T23:56:14.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 -- 172.21.15.112:0/4072945823 >> 172.21.15.112:0/4072945823 conn(0x7f11940b1c80 msgr2=0x7f11940b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:14.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 -- 172.21.15.112:0/4072945823 shutdown_connections 2024-09-15T23:56:14.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 -- 172.21.15.112:0/4072945823 wait complete. 2024-09-15T23:56:14.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 Processor -- start 2024-09-15T23:56:14.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 -- start start 2024-09-15T23:56:14.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1194150290 0x7f119409ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11940cd020 0x7f1194150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1194150bb0 0x7f11940cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f11940ad670 con 0x7f11940cd020 2024-09-15T23:56:14.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1194072c40 con 0x7f1194150bb0 2024-09-15T23:56:14.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f11940af4e0 con 0x7f1194150290 2024-09-15T23:56:14.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f118bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11940cd020 0x7f1194150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f118bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11940cd020 0x7f1194150670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35010/0 (socket says 172.21.15.112:35010) 2024-09-15T23:56:14.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f118bfff640 1 -- 172.21.15.112:0/1152661735 learned_addr learned my addr 172.21.15.112:0/1152661735 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:14.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f119259c640 1 --2- 172.21.15.112:0/1152661735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1194150290 0x7f119409ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1192d9d640 1 --2- 172.21.15.112:0/1152661735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1194150bb0 0x7f11940cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f118bfff640 1 -- 172.21.15.112:0/1152661735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1194150290 msgr2=0x7f119409ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f118bfff640 1 --2- 172.21.15.112:0/1152661735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1194150290 0x7f119409ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f118bfff640 1 -- 172.21.15.112:0/1152661735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1194150bb0 msgr2=0x7f11940cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f118bfff640 1 --2- 172.21.15.112:0/1152661735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1194150bb0 0x7f11940cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f118bfff640 1 -- 172.21.15.112:0/1152661735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11940cd5c0 con 0x7f11940cd020 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f118bfff640 1 --2- 172.21.15.112:0/1152661735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11940cd020 0x7f1194150670 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f117c00f5a0 tx=0x7f117c00fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f118affd640 1 -- 172.21.15.112:0/1152661735 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c019020 con 0x7f11940cd020 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f118affd640 1 -- 172.21.15.112:0/1152661735 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117c014870 con 0x7f11940cd020 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 -- 172.21.15.112:0/1152661735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11940c94a0 con 0x7f11940cd020 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f118affd640 1 -- 172.21.15.112:0/1152661735 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c014c60 con 0x7f11940cd020 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.770+0000 7f1198cc6640 1 -- 172.21.15.112:0/1152661735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11940c9a60 con 0x7f11940cd020 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.774+0000 7f1198cc6640 1 -- 172.21.15.112:0/1152661735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11940cfda0 con 0x7f11940cd020 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.774+0000 7f118affd640 1 -- 172.21.15.112:0/1152661735 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f117c01c020 con 0x7f11940cd020 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.774+0000 7f118affd640 1 --2- 172.21.15.112:0/1152661735 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11740678f0 0x7f1174069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.774+0000 7f118affd640 1 -- 172.21.15.112:0/1152661735 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f117c0865b0 con 0x7f11940cd020 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.774+0000 7f119259c640 1 --2- 172.21.15.112:0/1152661735 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11740678f0 0x7f1174069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.774+0000 7f119259c640 1 --2- 172.21.15.112:0/1152661735 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11740678f0 0x7f1174069db0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f11840017f0 tx=0x7f1184001680 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:14.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.778+0000 7f118affd640 1 -- 172.21.15.112:0/1152661735 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f117c023020 con 0x7f11940cd020 2024-09-15T23:56:15.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:14.998+0000 7f1198cc6640 1 -- 172.21.15.112:0/1152661735 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f119409e060 con 0x7f11940cd020 2024-09-15T23:56:15.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.002+0000 7f118affd640 1 -- 172.21.15.112:0/1152661735 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f117c056ff0 con 0x7f11940cd020 2024-09-15T23:56:15.004 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-15T23:56:15.004 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw== 2024-09-15T23:56:15.004 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-15T23:56:15.004 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-15T23:56:15.004 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:56:15.004 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-15T23:56:15.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.006+0000 7f1198cc6640 1 -- 172.21.15.112:0/1152661735 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11740678f0 msgr2=0x7f1174069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.006+0000 7f1198cc6640 1 --2- 172.21.15.112:0/1152661735 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11740678f0 0x7f1174069db0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f11840017f0 tx=0x7f1184001680 comp rx=0 tx=0).stop 2024-09-15T23:56:15.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.006+0000 7f1198cc6640 1 -- 172.21.15.112:0/1152661735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11940cd020 msgr2=0x7f1194150670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.006+0000 7f1198cc6640 1 --2- 172.21.15.112:0/1152661735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11940cd020 0x7f1194150670 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f117c00f5a0 tx=0x7f117c00fa60 comp rx=0 tx=0).stop 2024-09-15T23:56:15.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.006+0000 7f1198cc6640 1 -- 172.21.15.112:0/1152661735 shutdown_connections 2024-09-15T23:56:15.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.006+0000 7f1198cc6640 1 --2- 172.21.15.112:0/1152661735 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11740678f0 0x7f1174069db0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.006+0000 7f1198cc6640 1 --2- 172.21.15.112:0/1152661735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1194150bb0 0x7f11940cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.006+0000 7f1198cc6640 1 --2- 172.21.15.112:0/1152661735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11940cd020 0x7f1194150670 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.006+0000 7f1198cc6640 1 --2- 172.21.15.112:0/1152661735 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1194150290 0x7f119409ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.006+0000 7f1198cc6640 1 -- 172.21.15.112:0/1152661735 >> 172.21.15.112:0/1152661735 conn(0x7f11940b1c80 msgr2=0x7f11940ada60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.006+0000 7f1198cc6640 1 -- 172.21.15.112:0/1152661735 shutdown_connections 2024-09-15T23:56:15.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.006+0000 7f1198cc6640 1 -- 172.21.15.112:0/1152661735 wait complete. 2024-09-15T23:56:15.023 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:15.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa2511ae640 1 Processor -- start 2024-09-15T23:56:15.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa2511ae640 1 -- start start 2024-09-15T23:56:15.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa2511ae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa24c15bec0 0x7fa24c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa2511ae640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa24c0af470 0x7fa24c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa2511ae640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa24c0b3290 con 0x7fa24c15c2a0 2024-09-15T23:56:15.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa2511ae640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa24c0b3570 con 0x7fa24c0af470 2024-09-15T23:56:15.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa2511ae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa24c0b3850 con 0x7fa24c15bec0 2024-09-15T23:56:15.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa24b59e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa24c0af470 0x7fa24c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa24b59e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa24c0af470 0x7fa24c06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35014/0 (socket says 172.21.15.112:35014) 2024-09-15T23:56:15.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa24b59e640 1 -- 172.21.15.112:0/2443062637 learned_addr learned my addr 172.21.15.112:0/2443062637 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:15.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa24ad9d640 1 --2- 172.21.15.112:0/2443062637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa24c15bec0 0x7fa24c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa24b59e640 1 -- 172.21.15.112:0/2443062637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa24c15bec0 msgr2=0x7fa24c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:15.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa24b59e640 1 --2- 172.21.15.112:0/2443062637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa24c15bec0 0x7fa24c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa24b59e640 1 -- 172.21.15.112:0/2443062637 >> v1:172.21.15.169:6789/0 conn(0x7fa24c15c2a0 legacy=0x7fa24c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:15.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.126+0000 7fa24b59e640 1 -- 172.21.15.112:0/2443062637 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24c0b3b30 con 0x7fa24c0af470 2024-09-15T23:56:15.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.130+0000 7fa24b59e640 1 --2- 172.21.15.112:0/2443062637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24c0af470 0x7fa24c06e000 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa244009e50 tx=0x7fa24401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e28909079cec75 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.130+0000 7fa249d9b640 1 -- 172.21.15.112:0/2443062637 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2440a5840 con 0x7fa24c0af470 2024-09-15T23:56:15.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.130+0000 7fa249d9b640 1 -- 172.21.15.112:0/2443062637 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2440a59e0 con 0x7fa24c0af470 2024-09-15T23:56:15.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.130+0000 7fa249d9b640 1 -- 172.21.15.112:0/2443062637 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2440a5db0 con 0x7fa24c0af470 2024-09-15T23:56:15.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.130+0000 7fa2511ae640 1 -- 172.21.15.112:0/2443062637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24c0af470 msgr2=0x7fa24c06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.130+0000 7fa2511ae640 1 --2- 172.21.15.112:0/2443062637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24c0af470 0x7fa24c06e000 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa244009e50 tx=0x7fa24401c9c0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.130+0000 7fa2511ae640 1 -- 172.21.15.112:0/2443062637 shutdown_connections 2024-09-15T23:56:15.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.130+0000 7fa2511ae640 1 --2- 172.21.15.112:0/2443062637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24c0af470 0x7fa24c06e000 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.130+0000 7fa2511ae640 1 --2- 172.21.15.112:0/2443062637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa24c15bec0 0x7fa24c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.130+0000 7fa2511ae640 1 -- 172.21.15.112:0/2443062637 >> 172.21.15.112:0/2443062637 conn(0x7fa24c0b1f90 msgr2=0x7fa24c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.130+0000 7fa2511ae640 1 -- 172.21.15.112:0/2443062637 shutdown_connections 2024-09-15T23:56:15.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.130+0000 7fa2511ae640 1 -- 172.21.15.112:0/2443062637 wait complete. 2024-09-15T23:56:15.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.130+0000 7fa2511ae640 1 Processor -- start 2024-09-15T23:56:15.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2511ae640 1 -- start start 2024-09-15T23:56:15.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2511ae640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24c0af470 0x7fa24c1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2511ae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa24c15bec0 0x7fa24c1549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2511ae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa24c15c2a0 0x7fa24c148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2511ae640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c06ed50 con 0x7fa24c0af470 2024-09-15T23:56:15.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2511ae640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c0ad740 con 0x7fa24c15bec0 2024-09-15T23:56:15.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2511ae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa24c06eed0 con 0x7fa24c15c2a0 2024-09-15T23:56:15.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa24ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24c0af470 0x7fa24c1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa24ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24c0af470 0x7fa24c1544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35024/0 (socket says 172.21.15.112:35024) 2024-09-15T23:56:15.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa24ad9d640 1 -- 172.21.15.112:0/3179645624 learned_addr learned my addr 172.21.15.112:0/3179645624 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:15.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa24a59c640 1 --2- 172.21.15.112:0/3179645624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa24c15bec0 0x7fa24c1549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa24b59e640 1 --2- 172.21.15.112:0/3179645624 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa24c15c2a0 0x7fa24c148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa24ad9d640 1 -- 172.21.15.112:0/3179645624 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa24c15c2a0 msgr2=0x7fa24c148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa24ad9d640 1 --2- 172.21.15.112:0/3179645624 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa24c15c2a0 0x7fa24c148f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa24ad9d640 1 -- 172.21.15.112:0/3179645624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa24c15bec0 msgr2=0x7fa24c1549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa24ad9d640 1 --2- 172.21.15.112:0/3179645624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa24c15bec0 0x7fa24c1549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa24ad9d640 1 -- 172.21.15.112:0/3179645624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24c14bc80 con 0x7fa24c0af470 2024-09-15T23:56:15.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa24ad9d640 1 --2- 172.21.15.112:0/3179645624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24c0af470 0x7fa24c1544a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00c820 tx=0x7fa23c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2337fe640 1 -- 172.21.15.112:0/3179645624 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c015070 con 0x7fa24c0af470 2024-09-15T23:56:15.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2337fe640 1 -- 172.21.15.112:0/3179645624 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23c004240 con 0x7fa24c0af470 2024-09-15T23:56:15.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2511ae640 1 -- 172.21.15.112:0/3179645624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa24c072620 con 0x7fa24c0af470 2024-09-15T23:56:15.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2337fe640 1 -- 172.21.15.112:0/3179645624 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00ce10 con 0x7fa24c0af470 2024-09-15T23:56:15.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2511ae640 1 -- 172.21.15.112:0/3179645624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa24c0b0e40 con 0x7fa24c0af470 2024-09-15T23:56:15.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2511ae640 1 -- 172.21.15.112:0/3179645624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa24c06e000 con 0x7fa24c0af470 2024-09-15T23:56:15.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2337fe640 1 -- 172.21.15.112:0/3179645624 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa23c007830 con 0x7fa24c0af470 2024-09-15T23:56:15.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2337fe640 1 --2- 172.21.15.112:0/3179645624 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2380678c0 0x7fa238069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa24a59c640 1 --2- 172.21.15.112:0/3179645624 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2380678c0 0x7fa238069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.134+0000 7fa2337fe640 1 -- 172.21.15.112:0/3179645624 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fa23c085ca0 con 0x7fa24c0af470 2024-09-15T23:56:15.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.138+0000 7fa24a59c640 1 --2- 172.21.15.112:0/3179645624 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2380678c0 0x7fa238069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa24c06fc60 tx=0x7fa240008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.138+0000 7fa2337fe640 1 -- 172.21.15.112:0/3179645624 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa23c056650 con 0x7fa24c0af470 2024-09-15T23:56:15.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.322+0000 7fa2511ae640 1 -- 172.21.15.112:0/3179645624 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa24c06fcd0 con 0x7fa24c0af470 2024-09-15T23:56:15.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.322+0000 7fa2337fe640 1 -- 172.21.15.112:0/3179645624 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5233 (secure 0 0 0) 0x7fa23c055f50 con 0x7fa24c0af470 2024-09-15T23:56:15.324 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:15.324 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"btime":"2024-09-15T23:56:08:794770+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/442643148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":442643148},{"type":"v1","addr":"172.21.15.169:6833","nonce":442643148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2506338033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2506338033},{"type":"v1","addr":"172.21.15.169:6835","nonce":2506338033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3040445121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3040445121},{"type":"v1","addr":"172.21.15.112:6835","nonce":3040445121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:06.156047+0000","modified":"2024-09-15T23:56:08.141848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/3667278267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3667278267},{"type":"v1","addr":"172.21.15.112:6837","nonce":3667278267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5625,"qdb_cluster":[5625]},"id":4}]} 2024-09-15T23:56:15.325 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 29 2024-09-15T23:56:15.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.326+0000 7fa2511ae640 1 -- 172.21.15.112:0/3179645624 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2380678c0 msgr2=0x7fa238069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.326+0000 7fa2511ae640 1 --2- 172.21.15.112:0/3179645624 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2380678c0 0x7fa238069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa24c06fc60 tx=0x7fa240008040 comp rx=0 tx=0).stop 2024-09-15T23:56:15.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.326+0000 7fa2511ae640 1 -- 172.21.15.112:0/3179645624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24c0af470 msgr2=0x7fa24c1544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.326+0000 7fa2511ae640 1 --2- 172.21.15.112:0/3179645624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24c0af470 0x7fa24c1544a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00c820 tx=0x7fa23c00cce0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.326+0000 7fa2511ae640 1 -- 172.21.15.112:0/3179645624 shutdown_connections 2024-09-15T23:56:15.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.326+0000 7fa2511ae640 1 --2- 172.21.15.112:0/3179645624 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2380678c0 0x7fa238069d80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.326+0000 7fa2511ae640 1 --2- 172.21.15.112:0/3179645624 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa24c15c2a0 0x7fa24c148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.326+0000 7fa2511ae640 1 --2- 172.21.15.112:0/3179645624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa24c15bec0 0x7fa24c1549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.326+0000 7fa2511ae640 1 --2- 172.21.15.112:0/3179645624 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa24c0af470 0x7fa24c1544a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.326+0000 7fa2511ae640 1 -- 172.21.15.112:0/3179645624 >> 172.21.15.112:0/3179645624 conn(0x7fa24c0b1f90 msgr2=0x7fa24c14f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.326+0000 7fa2511ae640 1 -- 172.21.15.112:0/3179645624 shutdown_connections 2024-09-15T23:56:15.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.326+0000 7fa2511ae640 1 -- 172.21.15.112:0/3179645624 wait complete. 2024-09-15T23:56:15.746 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:56:06.156047+0000', 'modified': '2024-09-15T23:56:08.141848+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5625}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5625': {'gid': 5625, 'name': 'a', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6837/3667278267', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 3667278267}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 3667278267}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5625, 'qdb_cluster': [5625]} 2024-09-15T23:56:15.746 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:56:15.747 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T23:56:15.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.878+0000 7f58b8fc6640 1 Processor -- start 2024-09-15T23:56:15.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.878+0000 7f58b8fc6640 1 -- start start 2024-09-15T23:56:15.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.878+0000 7f58b8fc6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f58b415bec0 0x7f58b40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.878+0000 7f58b8fc6640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b40b3290 con 0x7f58b415c2a0 2024-09-15T23:56:15.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.878+0000 7f58b8fc6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b40b3570 con 0x7f58b40af470 2024-09-15T23:56:15.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.878+0000 7f58b8fc6640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f58b40b3850 con 0x7f58b415bec0 2024-09-15T23:56:15.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.878+0000 7f58b259c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f58b415bec0 0x7f58b40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.878+0000 7f58b259c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f58b415bec0 0x7f58b40ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35038/0 (socket says 172.21.15.112:35038) 2024-09-15T23:56:15.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.878+0000 7f58b259c640 1 -- 172.21.15.112:0/2359203193 learned_addr learned my addr 172.21.15.112:0/2359203193 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:15.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.878+0000 7f58b259c640 1 -- 172.21.15.112:0/2359203193 >> v1:172.21.15.169:6789/0 conn(0x7f58b40af470 legacy=0x7f58b406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:15.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.878+0000 7f58b259c640 1 -- 172.21.15.112:0/2359203193 >> v1:172.21.15.112:6789/0 conn(0x7f58b415c2a0 legacy=0x7f58b40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.878+0000 7f58b259c640 1 -- 172.21.15.112:0/2359203193 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b40b3b30 con 0x7f58b415bec0 2024-09-15T23:56:15.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.878+0000 7f58b159a640 1 -- 172.21.15.112:0/2359203193 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2675667386 0 0) 0x7f58b40b3290 con 0x7f58b415c2a0 2024-09-15T23:56:15.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.882+0000 7f58b259c640 1 --2- 172.21.15.112:0/2359203193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58b415bec0 0x7f58b40ad200 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009e50 tx=0x7f58ac01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfbff213469054a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.882+0000 7f58b159a640 1 -- 172.21.15.112:0/2359203193 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0a5880 con 0x7f58b415bec0 2024-09-15T23:56:15.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.882+0000 7f58b159a640 1 -- 172.21.15.112:0/2359203193 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ac0a5a20 con 0x7f58b415bec0 2024-09-15T23:56:15.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.882+0000 7f58b159a640 1 -- 172.21.15.112:0/2359203193 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0a5df0 con 0x7f58b415bec0 2024-09-15T23:56:15.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.882+0000 7f58b8fc6640 1 -- 172.21.15.112:0/2359203193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58b415bec0 msgr2=0x7f58b40ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.882+0000 7f58b8fc6640 1 --2- 172.21.15.112:0/2359203193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58b415bec0 0x7f58b40ad200 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009e50 tx=0x7f58ac01c9c0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.882+0000 7f58b8fc6640 1 -- 172.21.15.112:0/2359203193 shutdown_connections 2024-09-15T23:56:15.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.882+0000 7f58b8fc6640 1 --2- 172.21.15.112:0/2359203193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58b415bec0 0x7f58b40ad200 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.882+0000 7f58b8fc6640 1 -- 172.21.15.112:0/2359203193 >> 172.21.15.112:0/2359203193 conn(0x7f58b40b1f90 msgr2=0x7f58b40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.882+0000 7f58b8fc6640 1 -- 172.21.15.112:0/2359203193 shutdown_connections 2024-09-15T23:56:15.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.882+0000 7f58b8fc6640 1 -- 172.21.15.112:0/2359203193 wait complete. 2024-09-15T23:56:15.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.882+0000 7f58b8fc6640 1 Processor -- start 2024-09-15T23:56:15.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.882+0000 7f58b8fc6640 1 -- start start 2024-09-15T23:56:15.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b8fc6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58b40af470 0x7f58b4151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b8fc6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58b415bec0 0x7f58b4073240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b8fc6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58b415c2a0 0x7f58b4156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b8fc6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f58b406ef20 con 0x7f58b415c2a0 2024-09-15T23:56:15.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b8fc6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58b40ad740 con 0x7f58b40af470 2024-09-15T23:56:15.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b8fc6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f58b406f0a0 con 0x7f58b415bec0 2024-09-15T23:56:15.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58b415c2a0 0x7f58b4156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58b415c2a0 0x7f58b4156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35048/0 (socket says 172.21.15.112:35048) 2024-09-15T23:56:15.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b2d9d640 1 -- 172.21.15.112:0/3228742078 learned_addr learned my addr 172.21.15.112:0/3228742078 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:15.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b259c640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58b40af470 0x7f58b4151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b1d9b640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58b415bec0 0x7f58b4073240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b2d9d640 1 -- 172.21.15.112:0/3228742078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58b415bec0 msgr2=0x7f58b4073240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b2d9d640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58b415bec0 0x7f58b4073240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b2d9d640 1 -- 172.21.15.112:0/3228742078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58b40af470 msgr2=0x7f58b4151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b2d9d640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58b40af470 0x7f58b4151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b2d9d640 1 -- 172.21.15.112:0/3228742078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b4073d30 con 0x7f58b415c2a0 2024-09-15T23:56:15.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b259c640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58b40af470 0x7f58b4151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:15.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b1d9b640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58b415bec0 0x7f58b4073240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:15.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b2d9d640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58b415c2a0 0x7f58b4156210 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f58a400c3f0 tx=0x7f58a400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58aaffd640 1 -- 172.21.15.112:0/3228742078 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4011790 con 0x7f58b415c2a0 2024-09-15T23:56:15.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58aaffd640 1 -- 172.21.15.112:0/3228742078 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a4017070 con 0x7f58b415c2a0 2024-09-15T23:56:15.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b8fc6640 1 -- 172.21.15.112:0/3228742078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b4072160 con 0x7f58b415c2a0 2024-09-15T23:56:15.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58aaffd640 1 -- 172.21.15.112:0/3228742078 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4011b70 con 0x7f58b415c2a0 2024-09-15T23:56:15.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b8fc6640 1 -- 172.21.15.112:0/3228742078 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b4152240 con 0x7f58b415c2a0 2024-09-15T23:56:15.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58aaffd640 1 -- 172.21.15.112:0/3228742078 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58a4011d10 con 0x7f58b415c2a0 2024-09-15T23:56:15.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58aaffd640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58940678c0 0x7f5894069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58b259c640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58940678c0 0x7f5894069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.886+0000 7f58aaffd640 1 -- 172.21.15.112:0/3228742078 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f58a4085c60 con 0x7f58b415c2a0 2024-09-15T23:56:15.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58b259c640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58940678c0 0x7f5894069d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0ae000 tx=0x7f58ac0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 Processor -- start 2024-09-15T23:56:15.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 -- start start 2024-09-15T23:56:15.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df4b20 0x55ec78df4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78df5440 0x55ec78daad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78dab290 0x55ec78dab670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ec78c92b60 con 0x55ec78df4b20 2024-09-15T23:56:15.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ec78bf9c70 con 0x55ec78dab290 2024-09-15T23:56:15.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55ec78b9fed0 con 0x55ec78df5440 2024-09-15T23:56:15.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58b259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df4b20 0x55ec78df4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58b259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df4b20 0x55ec78df4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35054/0 (socket says 172.21.15.112:35054) 2024-09-15T23:56:15.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58b259c640 1 -- 172.21.15.112:0/4020998520 learned_addr learned my addr 172.21.15.112:0/4020998520 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:15.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58b259c640 1 -- 172.21.15.112:0/4020998520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78df5440 msgr2=0x55ec78daad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:15.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58b259c640 1 --2- 172.21.15.112:0/4020998520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78df5440 0x55ec78daad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58b259c640 1 -- 172.21.15.112:0/4020998520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78dab290 msgr2=0x55ec78dab670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:15.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58b259c640 1 --2- 172.21.15.112:0/4020998520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78dab290 0x55ec78dab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58b259c640 1 -- 172.21.15.112:0/4020998520 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec78bb1e50 con 0x55ec78df4b20 2024-09-15T23:56:15.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58b259c640 1 --2- 172.21.15.112:0/4020998520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df4b20 0x55ec78df4f00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f58ac000f90 tx=0x7f58ac004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bebcbab9b62f68c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f5893fff640 1 -- 172.21.15.112:0/4020998520 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0c9070 con 0x55ec78df4b20 2024-09-15T23:56:15.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f5893fff640 1 -- 172.21.15.112:0/4020998520 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ac0c4470 con 0x55ec78df4b20 2024-09-15T23:56:15.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f5893fff640 1 -- 172.21.15.112:0/4020998520 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0c4820 con 0x55ec78df4b20 2024-09-15T23:56:15.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 -- 172.21.15.112:0/4020998520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df4b20 msgr2=0x55ec78df4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 --2- 172.21.15.112:0/4020998520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df4b20 0x55ec78df4f00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f58ac000f90 tx=0x7f58ac004ac0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 -- 172.21.15.112:0/4020998520 shutdown_connections 2024-09-15T23:56:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 --2- 172.21.15.112:0/4020998520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78dab290 0x55ec78dab670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 --2- 172.21.15.112:0/4020998520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78df5440 0x55ec78daad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 --2- 172.21.15.112:0/4020998520 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df4b20 0x55ec78df4f00 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 -- 172.21.15.112:0/4020998520 >> 172.21.15.112:0/4020998520 conn(0x55ec78db1600 msgr2=0x55ec78da9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 -- 172.21.15.112:0/4020998520 shutdown_connections 2024-09-15T23:56:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 -- 172.21.15.112:0/4020998520 wait complete. 2024-09-15T23:56:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 -- start start 2024-09-15T23:56:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.890+0000 7f58bc082000 1 Processor -- start 2024-09-15T23:56:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78df4b20 0x55ec78dafdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78df5440 0x55ec78db5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78db0330 0x55ec78db6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ec78c5bb00 con 0x55ec78db0330 2024-09-15T23:56:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ec78bd4360 con 0x55ec78df4b20 2024-09-15T23:56:15.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55ec78bd12d0 con 0x55ec78df5440 2024-09-15T23:56:15.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 10 client.0 _ll_register_callbacks cb 0x55ec78d96820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:56:15.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58b2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78db0330 0x55ec78db6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58b2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78db0330 0x55ec78db6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35058/0 (socket says 172.21.15.112:35058) 2024-09-15T23:56:15.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58b2d9d640 1 -- 172.21.15.112:0/2636960612 learned_addr learned my addr 172.21.15.112:0/2636960612 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:15.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58b259c640 1 --2- 172.21.15.112:0/2636960612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78df4b20 0x55ec78dafdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58b1d9b640 1 --2- 172.21.15.112:0/2636960612 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78df5440 0x55ec78db5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58b2d9d640 1 -- 172.21.15.112:0/2636960612 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78df5440 msgr2=0x55ec78db5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:15.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58b2d9d640 1 --2- 172.21.15.112:0/2636960612 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78df5440 0x55ec78db5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58b2d9d640 1 -- 172.21.15.112:0/2636960612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78df4b20 msgr2=0x55ec78dafdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:15.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58b2d9d640 1 --2- 172.21.15.112:0/2636960612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78df4b20 0x55ec78dafdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58b2d9d640 1 -- 172.21.15.112:0/2636960612 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec78ba0120 con 0x55ec78db0330 2024-09-15T23:56:15.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58b259c640 1 --2- 172.21.15.112:0/2636960612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78df4b20 0x55ec78dafdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:15.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58b2d9d640 1 --2- 172.21.15.112:0/2636960612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78db0330 0x55ec78db6230 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f58a4055e90 tx=0x7f58a4055fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12463b9738cc14b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58917fa640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:56:15.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58917fa640 1 -- 172.21.15.112:0/2636960612 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4052570 con 0x55ec78db0330 2024-09-15T23:56:15.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58917fa640 1 -- 172.21.15.112:0/2636960612 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f58a4055350 con 0x55ec78db0330 2024-09-15T23:56:15.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 -- 172.21.15.112:0/2636960612 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58ac0c4470 con 0x55ec78db0330 2024-09-15T23:56:15.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58917fa640 1 -- 172.21.15.112:0/2636960612 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f58a4082050 con 0x55ec78db0330 2024-09-15T23:56:15.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 10 client.5784 fetch_fsmap learned FSMap version 29 2024-09-15T23:56:15.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 -- 172.21.15.112:0/2636960612 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55ec78b99450 con 0x55ec78db0330 2024-09-15T23:56:15.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58917fa640 1 -- 172.21.15.112:0/2636960612 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ac0c4470 con 0x55ec78db0330 2024-09-15T23:56:15.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58917fa640 1 -- 172.21.15.112:0/2636960612 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f58a4051c50 con 0x55ec78db0330 2024-09-15T23:56:15.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 10 client.5784 fetch_fsmap finished waiting for FSMap version 29 2024-09-15T23:56:15.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 10 client.5784 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:56:15.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 20 client.5784 populate_metadata read hostname 'smithi112' 2024-09-15T23:56:15.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 --2- 172.21.15.112:0/2636960612 >> [v2:172.21.15.112:6836/3667278267,v1:172.21.15.112:6837/3667278267] conn(0x55ec78dfaf50 0x55ec78dfb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 4 client.5784 mds_command: new command op to 5625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:56:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 -- 172.21.15.112:0/2636960612 --> [v2:172.21.15.112:6836/3667278267,v1:172.21.15.112:6837/3667278267] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec78b93c00 con 0x55ec78dfaf50 2024-09-15T23:56:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58b259c640 1 --2- 172.21.15.112:0/2636960612 >> [v2:172.21.15.112:6836/3667278267,v1:172.21.15.112:6837/3667278267] conn(0x55ec78dfaf50 0x55ec78dfb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58917fa640 10 client.5784 ms_handle_connect on v2:172.21.15.112:6836/3667278267 2024-09-15T23:56:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58b259c640 1 --2- 172.21.15.112:0/2636960612 >> [v2:172.21.15.112:6836/3667278267,v1:172.21.15.112:6837/3667278267] conn(0x55ec78dfaf50 0x55ec78dfb330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a1c8275c30084f5 server_cookie=171f5c4bbb4db6f in_seq=0 out_seq=0 2024-09-15T23:56:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58917fa640 1 -- 172.21.15.112:0/2636960612 <== mds.0 v2:172.21.15.112:6836/3667278267 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec78b93c00 con 0x55ec78dfaf50 2024-09-15T23:56:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58917fa640 10 client.5784 handle_command_reply: tid=0 2024-09-15T23:56:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 client.5784 shutdown 2024-09-15T23:56:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 -- 172.21.15.112:0/2636960612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78db0330 msgr2=0x55ec78db6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 --2- 172.21.15.112:0/2636960612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78db0330 0x55ec78db6230 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f58a4055e90 tx=0x7f58a4055fc0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 -- 172.21.15.112:0/2636960612 shutdown_connections 2024-09-15T23:56:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 --2- 172.21.15.112:0/2636960612 >> [v2:172.21.15.112:6836/3667278267,v1:172.21.15.112:6837/3667278267] conn(0x55ec78dfaf50 0x55ec78dfb330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 --2- 172.21.15.112:0/2636960612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78db0330 0x55ec78db6230 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 --2- 172.21.15.112:0/2636960612 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78df5440 0x55ec78db5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58917fa640 0 client.5784 ms_handle_reset on v2:172.21.15.112:6836/3667278267 2024-09-15T23:56:15.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 --2- 172.21.15.112:0/2636960612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78df4b20 0x55ec78dafdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 -- 172.21.15.112:0/2636960612 >> 172.21.15.112:0/2636960612 conn(0x55ec78dab290 msgr2=0x55ec78da9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 -- 172.21.15.112:0/2636960612 shutdown_connections 2024-09-15T23:56:15.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 1 -- 172.21.15.112:0/2636960612 wait complete. 2024-09-15T23:56:15.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.894+0000 7f58bc082000 20 client.5784 trim_cache size 0 max 16384 2024-09-15T23:56:15.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 Processor -- start 2024-09-15T23:56:15.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 -- start start 2024-09-15T23:56:15.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78db0330 0x55ec78df3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78df4b20 0x55ec78df4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df5440 0x55ec78e0a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f58b4202c20 con 0x55ec78df5440 2024-09-15T23:56:15.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58b415d4b0 con 0x55ec78df4b20 2024-09-15T23:56:15.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f58b41654e0 con 0x55ec78db0330 2024-09-15T23:56:15.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58b2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df5440 0x55ec78e0a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58b2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df5440 0x55ec78e0a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35070/0 (socket says 172.21.15.112:35070) 2024-09-15T23:56:15.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58b2d9d640 1 -- 172.21.15.112:0/2769864745 learned_addr learned my addr 172.21.15.112:0/2769864745 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:15.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58b2d9d640 1 -- 172.21.15.112:0/2769864745 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78db0330 msgr2=0x55ec78df3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:15.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58b259c640 1 --2- 172.21.15.112:0/2769864745 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78db0330 0x55ec78df3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58b1d9b640 1 --2- 172.21.15.112:0/2769864745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78df4b20 0x55ec78df4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58b2d9d640 1 --2- 172.21.15.112:0/2769864745 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78db0330 0x55ec78df3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58b2d9d640 1 -- 172.21.15.112:0/2769864745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78df4b20 msgr2=0x55ec78df4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:15.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58b2d9d640 1 --2- 172.21.15.112:0/2769864745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78df4b20 0x55ec78df4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58b2d9d640 1 -- 172.21.15.112:0/2769864745 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec78df5270 con 0x55ec78df5440 2024-09-15T23:56:15.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58b1d9b640 1 --2- 172.21.15.112:0/2769864745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78df4b20 0x55ec78df4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:15.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58b2d9d640 1 --2- 172.21.15.112:0/2769864745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df5440 0x55ec78e0a070 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f58a400cdb0 tx=0x7f58a406b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2e564d39900322 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58937fe640 1 -- 172.21.15.112:0/2769864745 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4056600 con 0x55ec78df5440 2024-09-15T23:56:15.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58937fe640 1 -- 172.21.15.112:0/2769864745 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a4074430 con 0x55ec78df5440 2024-09-15T23:56:15.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58937fe640 1 -- 172.21.15.112:0/2769864745 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4052570 con 0x55ec78df5440 2024-09-15T23:56:15.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 -- 172.21.15.112:0/2769864745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df5440 msgr2=0x55ec78e0a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 --2- 172.21.15.112:0/2769864745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df5440 0x55ec78e0a070 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f58a400cdb0 tx=0x7f58a406b000 comp rx=0 tx=0).stop 2024-09-15T23:56:15.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 -- 172.21.15.112:0/2769864745 shutdown_connections 2024-09-15T23:56:15.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 --2- 172.21.15.112:0/2769864745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df5440 0x55ec78e0a070 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 --2- 172.21.15.112:0/2769864745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78df4b20 0x55ec78df4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 --2- 172.21.15.112:0/2769864745 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78db0330 0x55ec78df3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 -- 172.21.15.112:0/2769864745 >> 172.21.15.112:0/2769864745 conn(0x55ec78dab290 msgr2=0x55ec78dafa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 -- 172.21.15.112:0/2769864745 shutdown_connections 2024-09-15T23:56:15.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.914+0000 7f58bc082000 1 -- 172.21.15.112:0/2769864745 wait complete. 2024-09-15T23:56:15.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 -- start start 2024-09-15T23:56:15.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 Processor -- start 2024-09-15T23:56:15.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78db0330 0x55ec78e645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df4b20 0x55ec78dfed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78df5440 0x55ec78dff240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ec78bf8f80 con 0x55ec78df4b20 2024-09-15T23:56:15.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ec78bb1ca0 con 0x55ec78db0330 2024-09-15T23:56:15.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55ec78bfe2a0 con 0x55ec78df5440 2024-09-15T23:56:15.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 10 client.0 _ll_register_callbacks cb 0x7f58a4052260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:56:15.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58b1d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df4b20 0x55ec78dfed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58b1d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df4b20 0x55ec78dfed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35074/0 (socket says 172.21.15.112:35074) 2024-09-15T23:56:15.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58b1d9b640 1 -- 172.21.15.112:0/3156031955 learned_addr learned my addr 172.21.15.112:0/3156031955 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:15.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58b2d9d640 1 --2- 172.21.15.112:0/3156031955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78df5440 0x55ec78dff240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58b259c640 1 --2- 172.21.15.112:0/3156031955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78db0330 0x55ec78e645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58b1d9b640 1 -- 172.21.15.112:0/3156031955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78df5440 msgr2=0x55ec78dff240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:15.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58b1d9b640 1 --2- 172.21.15.112:0/3156031955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78df5440 0x55ec78dff240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58b1d9b640 1 -- 172.21.15.112:0/3156031955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78db0330 msgr2=0x55ec78e645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:15.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58b1d9b640 1 --2- 172.21.15.112:0/3156031955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78db0330 0x55ec78e645a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58b1d9b640 1 -- 172.21.15.112:0/3156031955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec78b80fd0 con 0x55ec78df4b20 2024-09-15T23:56:15.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58b1d9b640 1 --2- 172.21.15.112:0/3156031955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df4b20 0x55ec78dfed00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f589c000f70 tx=0x7f589c00f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fd1dae295c5342 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58917fa640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:56:15.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58917fa640 1 -- 172.21.15.112:0/3156031955 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c0052d0 con 0x55ec78df4b20 2024-09-15T23:56:15.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58917fa640 1 -- 172.21.15.112:0/3156031955 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f589c003600 con 0x55ec78df4b20 2024-09-15T23:56:15.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 -- 172.21.15.112:0/3156031955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58a4074430 con 0x55ec78df4b20 2024-09-15T23:56:15.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58917fa640 1 -- 172.21.15.112:0/3156031955 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f589c020050 con 0x55ec78df4b20 2024-09-15T23:56:15.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 10 client.5790 fetch_fsmap learned FSMap version 29 2024-09-15T23:56:15.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 -- 172.21.15.112:0/3156031955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55ec78c7c750 con 0x55ec78df4b20 2024-09-15T23:56:15.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58917fa640 1 -- 172.21.15.112:0/3156031955 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a4074430 con 0x55ec78df4b20 2024-09-15T23:56:15.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58917fa640 1 -- 172.21.15.112:0/3156031955 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f589c023020 con 0x55ec78df4b20 2024-09-15T23:56:15.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 10 client.5790 fetch_fsmap finished waiting for FSMap version 29 2024-09-15T23:56:15.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 10 client.5790 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:56:15.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 20 client.5790 populate_metadata read hostname 'smithi112' 2024-09-15T23:56:15.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 --2- 172.21.15.112:0/3156031955 >> [v2:172.21.15.112:6836/3667278267,v1:172.21.15.112:6837/3667278267] conn(0x55ec78dff780 0x55ec78dffb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 4 client.5790 mds_command: new command op to 5625 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:56:15.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 -- 172.21.15.112:0/3156031955 --> [v2:172.21.15.112:6836/3667278267,v1:172.21.15.112:6837/3667278267] -- command(tid 0: {"prefix": "status"}) -- 0x55ec78c073a0 con 0x55ec78dff780 2024-09-15T23:56:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58b259c640 1 --2- 172.21.15.112:0/3156031955 >> [v2:172.21.15.112:6836/3667278267,v1:172.21.15.112:6837/3667278267] conn(0x55ec78dff780 0x55ec78dffb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58b259c640 1 --2- 172.21.15.112:0/3156031955 >> [v2:172.21.15.112:6836/3667278267,v1:172.21.15.112:6837/3667278267] conn(0x55ec78dff780 0x55ec78dffb60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c5983e8a061d217 server_cookie=dba43b2b07c38d37 in_seq=0 out_seq=0 2024-09-15T23:56:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58917fa640 10 client.5790 ms_handle_connect on v2:172.21.15.112:6836/3667278267 2024-09-15T23:56:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58917fa640 1 -- 172.21.15.112:0/3156031955 <== mds.0 v2:172.21.15.112:6836/3667278267 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ec78c073a0 con 0x55ec78dff780 2024-09-15T23:56:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58917fa640 10 client.5790 handle_command_reply: tid=0 2024-09-15T23:56:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 client.5790 shutdown 2024-09-15T23:56:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 -- 172.21.15.112:0/3156031955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df4b20 msgr2=0x55ec78dfed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 --2- 172.21.15.112:0/3156031955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df4b20 0x55ec78dfed00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f589c000f70 tx=0x7f589c00f600 comp rx=0 tx=0).stop 2024-09-15T23:56:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 -- 172.21.15.112:0/3156031955 shutdown_connections 2024-09-15T23:56:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 --2- 172.21.15.112:0/3156031955 >> [v2:172.21.15.112:6836/3667278267,v1:172.21.15.112:6837/3667278267] conn(0x55ec78dff780 0x55ec78dffb60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 --2- 172.21.15.112:0/3156031955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55ec78df5440 0x55ec78dff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 --2- 172.21.15.112:0/3156031955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ec78df4b20 0x55ec78dfed00 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58917fa640 0 client.5790 ms_handle_reset on v2:172.21.15.112:6836/3667278267 2024-09-15T23:56:15.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 --2- 172.21.15.112:0/3156031955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ec78db0330 0x55ec78e645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 -- 172.21.15.112:0/3156031955 >> 172.21.15.112:0/3156031955 conn(0x55ec78dab290 msgr2=0x55ec78df2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 -- 172.21.15.112:0/3156031955 shutdown_connections 2024-09-15T23:56:15.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 1 -- 172.21.15.112:0/3156031955 wait complete. 2024-09-15T23:56:15.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.918+0000 7f58bc082000 20 client.5790 trim_cache size 0 max 16384 2024-09-15T23:56:15.929 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:56:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "1af6b673-4d40-4109-af4e-78662faa7df8", 2024-09-15T23:56:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-15T23:56:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5625, 2024-09-15T23:56:15.929 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-15T23:56:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-15T23:56:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-15T23:56:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 9.1348295690000008, 2024-09-15T23:56:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 29, 2024-09-15T23:56:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 62, 2024-09-15T23:56:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 62, 2024-09-15T23:56:15.930 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 13.201684156000001 2024-09-15T23:56:15.930 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:56:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.922+0000 7f58b8fc6640 1 -- 172.21.15.112:0/3228742078 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58940678c0 msgr2=0x7f5894069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.922+0000 7f58b8fc6640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58940678c0 0x7f5894069d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0ae000 tx=0x7f58ac0a7070 comp rx=0 tx=0).stop 2024-09-15T23:56:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.922+0000 7f58b8fc6640 1 -- 172.21.15.112:0/3228742078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58b415c2a0 msgr2=0x7f58b4156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.922+0000 7f58b8fc6640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58b415c2a0 0x7f58b4156210 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f58a400c3f0 tx=0x7f58a400c8b0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.922+0000 7f58b8fc6640 1 -- 172.21.15.112:0/3228742078 shutdown_connections 2024-09-15T23:56:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.922+0000 7f58b8fc6640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58940678c0 0x7f5894069d80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.922+0000 7f58b8fc6640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58b415c2a0 0x7f58b4156210 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.922+0000 7f58b8fc6640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58b415bec0 0x7f58b4073240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.922+0000 7f58b8fc6640 1 --2- 172.21.15.112:0/3228742078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58b40af470 0x7f58b4151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.922+0000 7f58b8fc6640 1 -- 172.21.15.112:0/3228742078 >> 172.21.15.112:0/3228742078 conn(0x7f58b40b1f90 msgr2=0x7f58b41571e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.922+0000 7f58b8fc6640 1 -- 172.21.15.112:0/3228742078 shutdown_connections 2024-09-15T23:56:15.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:15.922+0000 7f58b8fc6640 1 -- 172.21.15.112:0/3228742078 wait complete. 2024-09-15T23:56:15.937 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:56:16.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.046+0000 7fc3cd5bb640 1 Processor -- start 2024-09-15T23:56:16.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.046+0000 7fc3cd5bb640 1 -- start start 2024-09-15T23:56:16.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3cd5bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3c815c2a0 0x7fc3c80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:16.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3cd5bb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc3c80af2a0 0x7fc3c806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:16.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3cd5bb640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c80b3290 con 0x7fc3c815bec0 2024-09-15T23:56:16.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3cd5bb640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc3c80b3570 con 0x7fc3c80af2a0 2024-09-15T23:56:16.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3cd5bb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c80b3850 con 0x7fc3c815c2a0 2024-09-15T23:56:16.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3c6ffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc3c815bec0 0x7fc3c80ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:38396/0 (socket says 172.21.15.112:38396) 2024-09-15T23:56:16.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3c6ffd640 1 -- 172.21.15.112:0/2169773513 learned_addr learned my addr 172.21.15.112:0/2169773513 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:16.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3c77fe640 1 --2- 172.21.15.112:0/2169773513 >> v2:172.21.15.112:3300/0 conn(0x7fc3c80af2a0 0x7fc3c806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:16.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3c67fc640 1 --2- 172.21.15.112:0/2169773513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3c815c2a0 0x7fc3c80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:16.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3c5ffb640 1 -- 172.21.15.112:0/2169773513 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4099812854 0 0) 0x7fc3c80b3290 con 0x7fc3c815bec0 2024-09-15T23:56:16.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3c5ffb640 1 -- 172.21.15.112:0/2169773513 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3b4003530 con 0x7fc3c815bec0 2024-09-15T23:56:16.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3c77fe640 1 -- 172.21.15.112:0/2169773513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3c815c2a0 msgr2=0x7fc3c80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:16.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3c77fe640 1 --2- 172.21.15.112:0/2169773513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3c815c2a0 0x7fc3c80aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3c77fe640 1 -- 172.21.15.112:0/2169773513 >> v1:172.21.15.112:6789/0 conn(0x7fc3c815bec0 legacy=0x7fc3c80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:16.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3c77fe640 1 -- 172.21.15.112:0/2169773513 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c80b3b30 con 0x7fc3c80af2a0 2024-09-15T23:56:16.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3c77fe640 1 --2- 172.21.15.112:0/2169773513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c80af2a0 0x7fc3c806e000 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00097c0 tx=0x7fc3c001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28602fdc644c57f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:16.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3c5ffb640 1 -- 172.21.15.112:0/2169773513 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c00a7070 con 0x7fc3c80af2a0 2024-09-15T23:56:16.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3c5ffb640 1 -- 172.21.15.112:0/2169773513 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c00b0070 con 0x7fc3c80af2a0 2024-09-15T23:56:16.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.050+0000 7fc3c5ffb640 1 -- 172.21.15.112:0/2169773513 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c00ab890 con 0x7fc3c80af2a0 2024-09-15T23:56:16.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/2169773513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c80af2a0 msgr2=0x7fc3c806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:16.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 --2- 172.21.15.112:0/2169773513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c80af2a0 0x7fc3c806e000 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00097c0 tx=0x7fc3c001c470 comp rx=0 tx=0).stop 2024-09-15T23:56:16.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/2169773513 shutdown_connections 2024-09-15T23:56:16.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 --2- 172.21.15.112:0/2169773513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c80af2a0 0x7fc3c806e000 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 --2- 172.21.15.112:0/2169773513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3c815c2a0 0x7fc3c80aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/2169773513 >> 172.21.15.112:0/2169773513 conn(0x7fc3c80b1f90 msgr2=0x7fc3c80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:16.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/2169773513 shutdown_connections 2024-09-15T23:56:16.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/2169773513 wait complete. 2024-09-15T23:56:16.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 Processor -- start 2024-09-15T23:56:16.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 -- start start 2024-09-15T23:56:16.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c80af2a0 0x7fc3c814e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:16.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3c815bec0 0x7fc3c814a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:16.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3c815c2a0 0x7fc3c814ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:16.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c806ed50 con 0x7fc3c80af2a0 2024-09-15T23:56:16.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c80afc90 con 0x7fc3c815c2a0 2024-09-15T23:56:16.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c806eed0 con 0x7fc3c815bec0 2024-09-15T23:56:16.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3c6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c80af2a0 0x7fc3c814e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:16.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3c6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c80af2a0 0x7fc3c814e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35082/0 (socket says 172.21.15.112:35082) 2024-09-15T23:56:16.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3c6ffd640 1 -- 172.21.15.112:0/99931618 learned_addr learned my addr 172.21.15.112:0/99931618 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:16.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3c77fe640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3c815c2a0 0x7fc3c814ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:16.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3c67fc640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3c815bec0 0x7fc3c814a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:16.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3c6ffd640 1 -- 172.21.15.112:0/99931618 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3c815bec0 msgr2=0x7fc3c814a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:16.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3c6ffd640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3c815bec0 0x7fc3c814a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3c6ffd640 1 -- 172.21.15.112:0/99931618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3c815c2a0 msgr2=0x7fc3c814ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:16.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3c6ffd640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3c815c2a0 0x7fc3c814ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3c6ffd640 1 -- 172.21.15.112:0/99931618 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c815c6a0 con 0x7fc3c80af2a0 2024-09-15T23:56:16.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3c77fe640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3c815c2a0 0x7fc3c814ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:16.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3c6ffd640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c80af2a0 0x7fc3c814e160 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800cb40 tx=0x7fc3b800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:16.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3bf7fe640 1 -- 172.21.15.112:0/99931618 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8017070 con 0x7fc3c80af2a0 2024-09-15T23:56:16.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3bf7fe640 1 -- 172.21.15.112:0/99931618 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b800aca0 con 0x7fc3c80af2a0 2024-09-15T23:56:16.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/99931618 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c815c960 con 0x7fc3c80af2a0 2024-09-15T23:56:16.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3bf7fe640 1 -- 172.21.15.112:0/99931618 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8012620 con 0x7fc3c80af2a0 2024-09-15T23:56:16.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/99931618 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c815cf20 con 0x7fc3c80af2a0 2024-09-15T23:56:16.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.054+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/99931618 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3c806e000 con 0x7fc3c80af2a0 2024-09-15T23:56:16.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.058+0000 7fc3bf7fe640 1 -- 172.21.15.112:0/99931618 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc3b801a070 con 0x7fc3c80af2a0 2024-09-15T23:56:16.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.058+0000 7fc3bf7fe640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc3a80678c0 0x7fc3a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:16.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.058+0000 7fc3bf7fe640 1 -- 172.21.15.112:0/99931618 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fc3b8085bd0 con 0x7fc3c80af2a0 2024-09-15T23:56:16.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.058+0000 7fc3c67fc640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc3a80678c0 0x7fc3a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:16.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.058+0000 7fc3c67fc640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc3a80678c0 0x7fc3a8069d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc3c814f890 tx=0x7fc3b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:16.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.062+0000 7fc3bf7fe640 1 -- 172.21.15.112:0/99931618 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc3b8056610 con 0x7fc3c80af2a0 2024-09-15T23:56:16.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.254+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/99931618 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc3c806fcd0 con 0x7fc3c80af2a0 2024-09-15T23:56:16.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.254+0000 7fc3bf7fe640 1 -- 172.21.15.112:0/99931618 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+73 (secure 0 0 0) 0x7fc3b8055f10 con 0x7fc3c80af2a0 2024-09-15T23:56:16.256 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:56:16.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.258+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/99931618 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc3a80678c0 msgr2=0x7fc3a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:16.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.258+0000 7fc3cd5bb640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc3a80678c0 0x7fc3a8069d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc3c814f890 tx=0x7fc3b0008040 comp rx=0 tx=0).stop 2024-09-15T23:56:16.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.258+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/99931618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c80af2a0 msgr2=0x7fc3c814e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:16.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.258+0000 7fc3cd5bb640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c80af2a0 0x7fc3c814e160 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800cb40 tx=0x7fc3b800a060 comp rx=0 tx=0).stop 2024-09-15T23:56:16.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.258+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/99931618 shutdown_connections 2024-09-15T23:56:16.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.258+0000 7fc3cd5bb640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc3a80678c0 0x7fc3a8069d80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.258+0000 7fc3cd5bb640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3c815c2a0 0x7fc3c814ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.258+0000 7fc3cd5bb640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3c815bec0 0x7fc3c814a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.258+0000 7fc3cd5bb640 1 --2- 172.21.15.112:0/99931618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3c80af2a0 0x7fc3c814e160 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.258+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/99931618 >> 172.21.15.112:0/99931618 conn(0x7fc3c80b1f90 msgr2=0x7fc3c80cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:16.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.258+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/99931618 shutdown_connections 2024-09-15T23:56:16.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16.258+0000 7fc3cd5bb640 1 -- 172.21.15.112:0/99931618 wait complete. 2024-09-15T23:56:16.273 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:56:16.273 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:56:16.273 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-15T23:56:16.273 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:56:16.273 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:16.274 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:56:16.274 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:56:16.274 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:56:16.274 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:56:16.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:16.274 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-15T23:56:16.279 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:56:16.280 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:56:16.280 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:56:16.280 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:16.280 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-15T23:56:16.280 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:16.280 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:56:16.280 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:16.280 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-15T23:56:16.280 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:56:16.280 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:16.280 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-15T23:56:16.280 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:56:16.281 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:16.281 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:56:16.281 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:16.281 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T23:56:16.281 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42320sec preferred_lft 42320sec 2024-09-15T23:56:16.281 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2024-09-15T23:56:16.281 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:16.281 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T23:56:16.281 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:5c:cd:1e:d6 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:16.281 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T23:56:16.282 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:16.282 INFO:teuthology.orchestra.run.smithi112.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:56:16.282 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:16.282 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:56:16.282 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:16.282 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T23:56:16.282 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:16.282 INFO:teuthology.orchestra.run.smithi112.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:56:16.282 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:16.282 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T23:56:16.282 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:16.282 INFO:teuthology.orchestra.run.smithi112.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:56:16.282 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:56:16.282 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T23:56:16.283 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:16.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:16.283 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:56:16.338 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-15T23:56:16.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:16.339 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-15T23:56:16.389 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-15T23:56:16.389 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:56:16.389 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T23:56:16.389 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:56:16.389 INFO:teuthology.orchestra.run.smithi112.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T23:56:16.389 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T23:56:16.389 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:56:16.390 INFO:teuthology.orchestra.run.smithi112.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:56:16.390 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:56:16.390 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:56:16.390 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:56:16.390 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:56:16.390 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:56:16.390 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:56:16.390 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:56:16.390 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:56:16.390 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:56:16.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:56:16.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:16.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:16.513 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-15T23:56:16.518 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:56:16.518 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:56:16.519 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:56:16.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:16.519 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-15T23:56:16.572 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T23:56:16.572 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:56:16.572 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:16.617 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:56:16.617 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:56:16.618 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:16.670 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:56:16.728 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:56:16.780 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:56:16.780 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:56:16.780 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:56:16.780 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:56:16.780 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:56:16.780 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:56:16.780 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:56:16.781 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:56:16.781 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:56:16.781 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:56:16.781 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:56:16.781 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:56:16.781 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:56:16.781 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:56:16.781 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:56:16.781 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:56:16.781 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:56:16.781 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:56:16.781 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:56:16.781 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:56:16.782 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:56:16.782 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:56:16.782 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:56:16.782 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:56:16.782 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:56:16.782 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:56:16.782 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:56:16.782 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:56:16.782 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:56:16.782 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:16.782 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:16.782 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:56:16.782 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:56:16.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:16.783 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:56:16.826 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:56:16.826 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T23:56:16.874 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:56:16.888 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:56:16.935 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:56:16.935 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:56:16.935 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:56:16.935 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:56:16.935 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:56:16.935 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:56:16.935 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:56:16.935 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:56:16.935 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:56:16.935 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:56:16.935 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:56:16.936 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:56:16.936 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:56:16.936 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:56:16.936 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:56:16.936 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:56:16.936 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:56:16.936 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:56:16.936 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:56:16.936 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:56:16.936 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:56:16.936 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:56:16.936 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:56:16.936 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:56:16.936 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:56:16.937 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:56:16.937 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:56:16.937 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:56:16.937 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:56:16.937 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:16.937 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:16.937 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:56:16.937 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:56:16.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:16.938 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:56:16.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:2024-09-15T23:56:16.950+0000 7f749cafc580 -1 init, newargv = 0x556cd7a9fd50 newargc=15 2024-09-15T23:56:16.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[40564]: starting ceph client 2024-09-15T23:56:16.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[40564]: starting fuse 2024-09-15T23:56:18.056 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:56:18.072 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:56:18.119 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:56:18.119 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:56:18.119 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:56:18.120 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:56:18.120 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:56:18.120 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:56:18.120 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:56:18.120 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:56:18.120 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:56:18.120 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:56:18.120 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:56:18.120 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:56:18.120 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:56:18.120 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:56:18.120 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:56:18.120 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:56:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:56:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:56:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:56:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:56:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:56:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:56:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:56:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:56:18.121 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:56:18.122 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:56:18.122 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:56:18.122 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:56:18.122 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:56:18.122 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:18.122 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:18.122 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:56:18.122 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:56:18.122 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:18.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:18.123 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:56:18.175 INFO:teuthology.orchestra.run.smithi112.stdout:45 2024-09-15T23:56:18.175 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T23:56:18.175 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:18.175 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2024-09-15T23:56:18.175 DEBUG:teuthology.orchestra.run.smithi112:> import re 2024-09-15T23:56:18.175 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:56:18.175 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-15T23:56:18.175 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:18.175 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2024-09-15T23:56:18.176 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2024-09-15T23:56:18.177 DEBUG:teuthology.orchestra.run.smithi112:> return f 2024-09-15T23:56:18.177 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:18.177 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:18.177 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.0")) 2024-09-15T23:56:18.177 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:56:18.300 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.0.40564.asok 2024-09-15T23:56:18.304 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:18.311 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40564.asok 2024-09-15T23:56:18.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:18.312 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40564.asok status 2024-09-15T23:56:18.465 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:56:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2024-09-15T23:56:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:56:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:56:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "0", 2024-09-15T23:56:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2024-09-15T23:56:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:56:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "40564", 2024-09-15T23:56:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2024-09-15T23:56:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2024-09-15T23:56:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2024-09-15T23:56:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5808, 2024-09-15T23:56:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2024-09-15T23:56:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2024-09-15T23:56:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2024-09-15T23:56:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 5808 2024-09-15T23:56:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:56:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:56:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:56:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1094773438 2024-09-15T23:56:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:56:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:56:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:56:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1094773438 2024-09-15T23:56:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.5808 192.168.0.1:0/1094773438", 2024-09-15T23:56:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.1:0/1094773438", 2024-09-15T23:56:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2024-09-15T23:56:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 29, 2024-09-15T23:56:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 62, 2024-09-15T23:56:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:56:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2024-09-15T23:56:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2024-09-15T23:56:18.467 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:56:18.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:18.478 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2024-09-15T23:56:18.478 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:18.484 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2024-09-15T23:56:18.484 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:18.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:18.485 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:18.536 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_fragment_size_max 50 2024-09-15T23:56:18.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc55a81640 1 Processor -- start 2024-09-15T23:56:18.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc55a81640 1 -- start start 2024-09-15T23:56:18.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc55a81640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc50140bd0 0x7fdc50141030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc55a81640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdc500b4410 0x7fdc500b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc55a81640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc5013fb30 con 0x7fdc50156720 2024-09-15T23:56:18.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc55a81640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fdc50141570 con 0x7fdc500b4410 2024-09-15T23:56:18.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc55a81640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdc50140740 con 0x7fdc50140bd0 2024-09-15T23:56:18.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc4ffff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdc500b4410 0x7fdc500b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc4effd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc50140bd0 0x7fdc50141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc4f7fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fdc50156720 0x7fdc500b5610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:50040/0 (socket says 172.21.15.112:50040) 2024-09-15T23:56:18.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc4ffff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdc500b4410 0x7fdc500b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:52076/0 (socket says 172.21.15.112:52076) 2024-09-15T23:56:18.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc4effd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc50140bd0 0x7fdc50141030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:41918/0 (socket says 172.21.15.112:41918) 2024-09-15T23:56:18.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc4f7fe640 1 -- 172.21.15.112:0/3290509337 learned_addr learned my addr 172.21.15.112:0/3290509337 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:18.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc4ffff640 1 -- 172.21.15.112:0/3290509337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc50140bd0 msgr2=0x7fdc50141030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:18.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc4ffff640 1 --2- 172.21.15.112:0/3290509337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc50140bd0 0x7fdc50141030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc4ffff640 1 -- 172.21.15.112:0/3290509337 >> v1:172.21.15.169:6789/0 conn(0x7fdc50156720 legacy=0x7fdc500b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc4ffff640 1 -- 172.21.15.112:0/3290509337 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5013fe10 con 0x7fdc500b4410 2024-09-15T23:56:18.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.706+0000 7fdc4effd640 1 --2- 172.21.15.112:0/3290509337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc50140bd0 0x7fdc50141030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:56:18.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.710+0000 7fdc4ffff640 1 --2- 172.21.15.112:0/3290509337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc500b4410 0x7fdc500b48c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009d90 tx=0x7fdc4801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a251e306d2dd794 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:18.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.710+0000 7fdc4e7fc640 1 -- 172.21.15.112:0/3290509337 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc480b2070 con 0x7fdc500b4410 2024-09-15T23:56:18.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.710+0000 7fdc4e7fc640 1 -- 172.21.15.112:0/3290509337 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc480a5830 con 0x7fdc500b4410 2024-09-15T23:56:18.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.710+0000 7fdc4e7fc640 1 -- 172.21.15.112:0/3290509337 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc480a5c00 con 0x7fdc500b4410 2024-09-15T23:56:18.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.710+0000 7fdc55a81640 1 -- 172.21.15.112:0/3290509337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc500b4410 msgr2=0x7fdc500b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.710+0000 7fdc55a81640 1 --2- 172.21.15.112:0/3290509337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc500b4410 0x7fdc500b48c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009d90 tx=0x7fdc4801c970 comp rx=0 tx=0).stop 2024-09-15T23:56:18.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.710+0000 7fdc55a81640 1 -- 172.21.15.112:0/3290509337 shutdown_connections 2024-09-15T23:56:18.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.710+0000 7fdc55a81640 1 --2- 172.21.15.112:0/3290509337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc500b4410 0x7fdc500b48c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.710+0000 7fdc55a81640 1 --2- 172.21.15.112:0/3290509337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc50140bd0 0x7fdc50141030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.710+0000 7fdc55a81640 1 -- 172.21.15.112:0/3290509337 >> 172.21.15.112:0/3290509337 conn(0x7fdc5006c0c0 msgr2=0x7fdc5006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:18.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.710+0000 7fdc55a81640 1 -- 172.21.15.112:0/3290509337 shutdown_connections 2024-09-15T23:56:18.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.710+0000 7fdc55a81640 1 -- 172.21.15.112:0/3290509337 wait complete. 2024-09-15T23:56:18.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc55a81640 1 Processor -- start 2024-09-15T23:56:18.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc55a81640 1 -- start start 2024-09-15T23:56:18.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc55a81640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc500b4410 0x7fdc50135c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc55a81640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc50140bd0 0x7fdc501532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc55a81640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc50156720 0x7fdc50132700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc55a81640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5013f6e0 con 0x7fdc500b4410 2024-09-15T23:56:18.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc55a81640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdc500b5d20 con 0x7fdc50140bd0 2024-09-15T23:56:18.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc55a81640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5013f860 con 0x7fdc50156720 2024-09-15T23:56:18.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc4f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc500b4410 0x7fdc50135c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc4f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc500b4410 0x7fdc50135c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42840/0 (socket says 172.21.15.112:42840) 2024-09-15T23:56:18.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc4f7fe640 1 -- 172.21.15.112:0/3607697398 learned_addr learned my addr 172.21.15.112:0/3607697398 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:18.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc4effd640 1 --2- 172.21.15.112:0/3607697398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc50140bd0 0x7fdc501532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc4ffff640 1 --2- 172.21.15.112:0/3607697398 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc50156720 0x7fdc50132700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc4f7fe640 1 -- 172.21.15.112:0/3607697398 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc50156720 msgr2=0x7fdc50132700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc4f7fe640 1 --2- 172.21.15.112:0/3607697398 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc50156720 0x7fdc50132700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc4f7fe640 1 -- 172.21.15.112:0/3607697398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc50140bd0 msgr2=0x7fdc501532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc4f7fe640 1 --2- 172.21.15.112:0/3607697398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc50140bd0 0x7fdc501532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc4f7fe640 1 -- 172.21.15.112:0/3607697398 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc50132c40 con 0x7fdc500b4410 2024-09-15T23:56:18.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc4f7fe640 1 --2- 172.21.15.112:0/3607697398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc500b4410 0x7fdc50135c80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c370 tx=0x7fdc4000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:18.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc37fff640 1 -- 172.21.15.112:0/3607697398 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40017070 con 0x7fdc500b4410 2024-09-15T23:56:18.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc37fff640 1 -- 172.21.15.112:0/3607697398 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc40005cf0 con 0x7fdc500b4410 2024-09-15T23:56:18.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc55a81640 1 -- 172.21.15.112:0/3607697398 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc50132f10 con 0x7fdc500b4410 2024-09-15T23:56:18.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc37fff640 1 -- 172.21.15.112:0/3607697398 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc400072f0 con 0x7fdc500b4410 2024-09-15T23:56:18.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc55a81640 1 -- 172.21.15.112:0/3607697398 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc501334d0 con 0x7fdc500b4410 2024-09-15T23:56:18.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc55a81640 1 -- 172.21.15.112:0/3607697398 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc500b48c0 con 0x7fdc500b4410 2024-09-15T23:56:18.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc37fff640 1 -- 172.21.15.112:0/3607697398 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdc4001a070 con 0x7fdc500b4410 2024-09-15T23:56:18.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc37fff640 1 --2- 172.21.15.112:0/3607697398 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdc3c0678c0 0x7fdc3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc4effd640 1 --2- 172.21.15.112:0/3607697398 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdc3c0678c0 0x7fdc3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.714+0000 7fdc37fff640 1 -- 172.21.15.112:0/3607697398 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fdc40085110 con 0x7fdc500b4410 2024-09-15T23:56:18.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.718+0000 7fdc4effd640 1 --2- 172.21.15.112:0/3607697398 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdc3c0678c0 0x7fdc3c069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009580 tx=0x7fdc44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:18.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.722+0000 7fdc37fff640 1 -- 172.21.15.112:0/3607697398 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdc40055b50 con 0x7fdc500b4410 2024-09-15T23:56:18.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.882+0000 7fdc55a81640 1 -- 172.21.15.112:0/3607697398 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fdc50069170 con 0x7fdc500b4410 2024-09-15T23:56:18.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.890+0000 7fdc37fff640 1 -- 172.21.15.112:0/3607697398 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v17)=0 v17) ==== 124+0+0 (secure 0 0 0) 0x7fdc40055450 con 0x7fdc500b4410 2024-09-15T23:56:18.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.890+0000 7fdc55a81640 1 -- 172.21.15.112:0/3607697398 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdc3c0678c0 msgr2=0x7fdc3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.890+0000 7fdc55a81640 1 --2- 172.21.15.112:0/3607697398 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdc3c0678c0 0x7fdc3c069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009580 tx=0x7fdc44008040 comp rx=0 tx=0).stop 2024-09-15T23:56:18.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.890+0000 7fdc55a81640 1 -- 172.21.15.112:0/3607697398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc500b4410 msgr2=0x7fdc50135c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.890+0000 7fdc55a81640 1 --2- 172.21.15.112:0/3607697398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc500b4410 0x7fdc50135c80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c370 tx=0x7fdc4000c830 comp rx=0 tx=0).stop 2024-09-15T23:56:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.890+0000 7fdc55a81640 1 -- 172.21.15.112:0/3607697398 shutdown_connections 2024-09-15T23:56:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.890+0000 7fdc55a81640 1 --2- 172.21.15.112:0/3607697398 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdc3c0678c0 0x7fdc3c069d80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.890+0000 7fdc55a81640 1 --2- 172.21.15.112:0/3607697398 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc50156720 0x7fdc50132700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.890+0000 7fdc55a81640 1 --2- 172.21.15.112:0/3607697398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc50140bd0 0x7fdc501532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.890+0000 7fdc55a81640 1 --2- 172.21.15.112:0/3607697398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdc500b4410 0x7fdc50135c80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.890+0000 7fdc55a81640 1 -- 172.21.15.112:0/3607697398 >> 172.21.15.112:0/3607697398 conn(0x7fdc5006c0c0 msgr2=0x7fdc5015bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.890+0000 7fdc55a81640 1 -- 172.21.15.112:0/3607697398 shutdown_connections 2024-09-15T23:56:18.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:18.890+0000 7fdc55a81640 1 -- 172.21.15.112:0/3607697398 wait complete. 2024-09-15T23:56:18.911 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 1 2024-09-15T23:56:19.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba3441640 1 Processor -- start 2024-09-15T23:56:19.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba3441640 1 -- start start 2024-09-15T23:56:19.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba3441640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcb9c070020 0x7fcb9c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:19.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba3441640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcb9c15f1d0 0x7fcb9c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:19.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba3441640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb9c0aede0 con 0x7fcb9c1520a0 2024-09-15T23:56:19.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba3441640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcb9c152480 con 0x7fcb9c070020 2024-09-15T23:56:19.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba3441640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fcb9c15fa10 con 0x7fcb9c15f1d0 2024-09-15T23:56:19.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba09dc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcb9c070020 0x7fcb9c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:19.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba09dc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcb9c070020 0x7fcb9c15ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42844/0 (socket says 172.21.15.112:42844) 2024-09-15T23:56:19.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba09dc640 1 -- 172.21.15.112:0/1846921007 learned_addr learned my addr 172.21.15.112:0/1846921007 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:19.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba19de640 1 --2- 172.21.15.112:0/1846921007 >> v2:172.21.15.169:3300/0 conn(0x7fcb9c15f1d0 0x7fcb9c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:19.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba09dc640 1 -- 172.21.15.112:0/1846921007 >> v2:172.21.15.169:3300/0 conn(0x7fcb9c15f1d0 msgr2=0x7fcb9c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:19.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba09dc640 1 --2- 172.21.15.112:0/1846921007 >> v2:172.21.15.169:3300/0 conn(0x7fcb9c15f1d0 0x7fcb9c0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:19.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba09dc640 1 -- 172.21.15.112:0/1846921007 >> v1:172.21.15.169:6789/0 conn(0x7fcb9c1520a0 legacy=0x7fcb9c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:19.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.034+0000 7fcba09dc640 1 -- 172.21.15.112:0/1846921007 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9c074250 con 0x7fcb9c070020 2024-09-15T23:56:19.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba09dc640 1 --2- 172.21.15.112:0/1846921007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c070020 0x7fcb9c15ec90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0d0250 tx=0x7fcb8c01eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4d47a119ff6c67 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:19.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcb93fff640 1 -- 172.21.15.112:0/1846921007 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c0b4070 con 0x7fcb9c070020 2024-09-15T23:56:19.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcb93fff640 1 -- 172.21.15.112:0/1846921007 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb8c0a7c50 con 0x7fcb9c070020 2024-09-15T23:56:19.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcb93fff640 1 -- 172.21.15.112:0/1846921007 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c0af440 con 0x7fcb9c070020 2024-09-15T23:56:19.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 -- 172.21.15.112:0/1846921007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c070020 msgr2=0x7fcb9c15ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:19.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 --2- 172.21.15.112:0/1846921007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c070020 0x7fcb9c15ec90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0d0250 tx=0x7fcb8c01eb80 comp rx=0 tx=0).stop 2024-09-15T23:56:19.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 -- 172.21.15.112:0/1846921007 shutdown_connections 2024-09-15T23:56:19.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 --2- 172.21.15.112:0/1846921007 >> v2:172.21.15.169:3300/0 conn(0x7fcb9c15f1d0 0x7fcb9c0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:19.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 --2- 172.21.15.112:0/1846921007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c070020 0x7fcb9c15ec90 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:19.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 -- 172.21.15.112:0/1846921007 >> 172.21.15.112:0/1846921007 conn(0x7fcb9c0b1f90 msgr2=0x7fcb9c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:19.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 -- 172.21.15.112:0/1846921007 shutdown_connections 2024-09-15T23:56:19.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 -- 172.21.15.112:0/1846921007 wait complete. 2024-09-15T23:56:19.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 Processor -- start 2024-09-15T23:56:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 -- start start 2024-09-15T23:56:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb9c070020 0x7fcb9c155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb9c1520a0 0x7fcb9c099810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c15f1d0 0x7fcb9c150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c15f5e0 con 0x7fcb9c15f1d0 2024-09-15T23:56:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c073d30 con 0x7fcb9c1520a0 2024-09-15T23:56:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba3441640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcb9c15f760 con 0x7fcb9c070020 2024-09-15T23:56:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba19de640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c15f1d0 0x7fcb9c150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba19de640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c15f1d0 0x7fcb9c150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:42856/0 (socket says 172.21.15.112:42856) 2024-09-15T23:56:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.038+0000 7fcba19de640 1 -- 172.21.15.112:0/42069086 learned_addr learned my addr 172.21.15.112:0/42069086 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:19.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcba09dc640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb9c1520a0 0x7fcb9c099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcba11dd640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb9c070020 0x7fcb9c155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcba19de640 1 -- 172.21.15.112:0/42069086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb9c070020 msgr2=0x7fcb9c155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcba19de640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb9c070020 0x7fcb9c155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcba19de640 1 -- 172.21.15.112:0/42069086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb9c1520a0 msgr2=0x7fcb9c099810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcba19de640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb9c1520a0 0x7fcb9c099810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcba19de640 1 -- 172.21.15.112:0/42069086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9c153900 con 0x7fcb9c15f1d0 2024-09-15T23:56:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcba09dc640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb9c1520a0 0x7fcb9c099810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:56:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcba19de640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c15f1d0 0x7fcb9c150970 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcb94007e40 tx=0x7fcb9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcb91ffb640 1 -- 172.21.15.112:0/42069086 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94014620 con 0x7fcb9c15f1d0 2024-09-15T23:56:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcb91ffb640 1 -- 172.21.15.112:0/42069086 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb94019070 con 0x7fcb9c15f1d0 2024-09-15T23:56:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcba3441640 1 -- 172.21.15.112:0/42069086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb9c14fe90 con 0x7fcb9c15f1d0 2024-09-15T23:56:19.044 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcb91ffb640 1 -- 172.21.15.112:0/42069086 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94014a20 con 0x7fcb9c15f1d0 2024-09-15T23:56:19.045 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcba3441640 1 -- 172.21.15.112:0/42069086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb9c150450 con 0x7fcb9c15f1d0 2024-09-15T23:56:19.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcba3441640 1 -- 172.21.15.112:0/42069086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb9c15ec90 con 0x7fcb9c15f1d0 2024-09-15T23:56:19.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcb91ffb640 1 -- 172.21.15.112:0/42069086 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcb94014bc0 con 0x7fcb9c15f1d0 2024-09-15T23:56:19.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcb91ffb640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcb800678c0 0x7fcb80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:19.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcb91ffb640 1 -- 172.21.15.112:0/42069086 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fcb940866a0 con 0x7fcb9c15f1d0 2024-09-15T23:56:19.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcba11dd640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcb800678c0 0x7fcb80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:19.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.042+0000 7fcba11dd640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcb800678c0 0x7fcb80069d80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcb98004e30 tx=0x7fcb98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:19.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.046+0000 7fcb91ffb640 1 -- 172.21.15.112:0/42069086 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcb940570e0 con 0x7fcb9c15f1d0 2024-09-15T23:56:19.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.206+0000 7fcba3441640 1 -- 172.21.15.112:0/42069086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fcb9c06e540 con 0x7fcb9c15f1d0 2024-09-15T23:56:19.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.210+0000 7fcb91ffb640 1 -- 172.21.15.112:0/42069086 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v18)=0 v18) ==== 116+0+0 (secure 0 0 0) 0x7fcb940569e0 con 0x7fcb9c15f1d0 2024-09-15T23:56:19.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.214+0000 7fcba3441640 1 -- 172.21.15.112:0/42069086 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcb800678c0 msgr2=0x7fcb80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:19.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.214+0000 7fcba3441640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcb800678c0 0x7fcb80069d80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcb98004e30 tx=0x7fcb98009040 comp rx=0 tx=0).stop 2024-09-15T23:56:19.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.214+0000 7fcba3441640 1 -- 172.21.15.112:0/42069086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c15f1d0 msgr2=0x7fcb9c150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:19.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.214+0000 7fcba3441640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c15f1d0 0x7fcb9c150970 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcb94007e40 tx=0x7fcb9400e4b0 comp rx=0 tx=0).stop 2024-09-15T23:56:19.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.214+0000 7fcba3441640 1 -- 172.21.15.112:0/42069086 shutdown_connections 2024-09-15T23:56:19.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.214+0000 7fcba3441640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcb800678c0 0x7fcb80069d80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:19.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.214+0000 7fcba3441640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb9c15f1d0 0x7fcb9c150970 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:19.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.214+0000 7fcba3441640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb9c1520a0 0x7fcb9c099810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:19.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.214+0000 7fcba3441640 1 --2- 172.21.15.112:0/42069086 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb9c070020 0x7fcb9c155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:19.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.214+0000 7fcba3441640 1 -- 172.21.15.112:0/42069086 >> 172.21.15.112:0/42069086 conn(0x7fcb9c0b1f90 msgr2=0x7fcb9c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:19.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.214+0000 7fcba3441640 1 -- 172.21.15.112:0/42069086 shutdown_connections 2024-09-15T23:56:19.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:19.214+0000 7fcba3441640 1 -- 172.21.15.112:0/42069086 wait complete. 2024-09-15T23:56:29.232 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:56:29.233 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:29.240 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-15T23:56:29.240 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:56:29.240 DEBUG:teuthology.orchestra.run.smithi112:> import uuid 2024-09-15T23:56:29.240 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:29.240 DEBUG:teuthology.orchestra.run.smithi112:> n = 50 2024-09-15T23:56:29.240 DEBUG:teuthology.orchestra.run.smithi112:> create_hard_links = False 2024-09-15T23:56:29.240 DEBUG:teuthology.orchestra.run.smithi112:> if 0 > 0: 2024-09-15T23:56:29.240 DEBUG:teuthology.orchestra.run.smithi112:> create_hard_links = True 2024-09-15T23:56:29.240 DEBUG:teuthology.orchestra.run.smithi112:> path = "/home/ubuntu/cephtest/mnt.0/subdir/file" 2024-09-15T23:56:29.240 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:29.240 DEBUG:teuthology.orchestra.run.smithi112:> dpath = os.path.dirname(path) 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> fnameprefix = os.path.basename(path) 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> os.makedirs(dpath, exist_ok=True) 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> try: 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> for i in range(n): 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> with open(fpath, '"'"'w'"'"') as f: 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> f.write(f"{i}") 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> f.flush() 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(f.fileno()) 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> os.unlink(fpath) 2024-09-15T23:56:29.241 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-15T23:56:29.242 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(dirfd) 2024-09-15T23:56:29.242 DEBUG:teuthology.orchestra.run.smithi112:> if create_hard_links: 2024-09-15T23:56:29.242 DEBUG:teuthology.orchestra.run.smithi112:> for j in range(0): 2024-09-15T23:56:29.242 DEBUG:teuthology.orchestra.run.smithi112:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-15T23:56:29.242 DEBUG:teuthology.orchestra.run.smithi112:> if True: 2024-09-15T23:56:29.242 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(dirfd) 2024-09-15T23:56:29.242 DEBUG:teuthology.orchestra.run.smithi112:> finally: 2024-09-15T23:56:29.242 DEBUG:teuthology.orchestra.run.smithi112:> os.close(dirfd) 2024-09-15T23:56:29.242 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:56:29.499 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:29.506 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:56:29.507 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:29.555 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:56:29.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.722+0000 7f5c5b84d640 1 Processor -- start 2024-09-15T23:56:29.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.722+0000 7f5c5b84d640 1 -- start start 2024-09-15T23:56:29.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5c540afb70 0x7f5c5415f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:29.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5c540cf5c0 0x7f5c5406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:29.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c5406d210 0x7f5c540b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:29.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5c5415fa60 con 0x7f5c540afb70 2024-09-15T23:56:29.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f5c540cfa60 con 0x7f5c540cf5c0 2024-09-15T23:56:29.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5c540cfd40 con 0x7f5c5406d210 2024-09-15T23:56:29.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c595e9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5c540afb70 0x7f5c5415f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c595e9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5c540afb70 0x7f5c5415f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40408/0 (socket says 172.21.15.112:40408) 2024-09-15T23:56:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c595e9640 1 -- 172.21.15.112:0/1030488148 learned_addr learned my addr 172.21.15.112:0/1030488148 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c59dea640 1 --2- 172.21.15.112:0/1030488148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c5406d210 0x7f5c540b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c58de8640 1 --2- 172.21.15.112:0/1030488148 >> v2:172.21.15.169:3300/0 conn(0x7f5c540cf5c0 0x7f5c5406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c595e9640 1 -- 172.21.15.112:0/1030488148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c5406d210 msgr2=0x7f5c540b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c595e9640 1 --2- 172.21.15.112:0/1030488148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c5406d210 0x7f5c540b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c595e9640 1 -- 172.21.15.112:0/1030488148 >> v2:172.21.15.169:3300/0 conn(0x7f5c540cf5c0 msgr2=0x7f5c5406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c595e9640 1 --2- 172.21.15.112:0/1030488148 >> v2:172.21.15.169:3300/0 conn(0x7f5c540cf5c0 0x7f5c5406ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c595e9640 1 -- 172.21.15.112:0/1030488148 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c540d0020 con 0x7f5c540afb70 2024-09-15T23:56:29.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c595e9640 1 --2- 172.21.15.112:0/1030488148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540afb70 0x7f5c5415f520 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009870 tx=0x7f5c4401c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a31b17d003d327 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:29.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c4bfff640 1 -- 172.21.15.112:0/1030488148 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c440b0070 con 0x7f5c540afb70 2024-09-15T23:56:29.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c4bfff640 1 -- 172.21.15.112:0/1030488148 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c440ab600 con 0x7f5c540afb70 2024-09-15T23:56:29.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c4bfff640 1 -- 172.21.15.112:0/1030488148 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c440ab9d0 con 0x7f5c540afb70 2024-09-15T23:56:29.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1030488148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540afb70 msgr2=0x7f5c5415f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:29.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 --2- 172.21.15.112:0/1030488148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540afb70 0x7f5c5415f520 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009870 tx=0x7f5c4401c1d0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1030488148 shutdown_connections 2024-09-15T23:56:29.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 --2- 172.21.15.112:0/1030488148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c5406d210 0x7f5c540b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 --2- 172.21.15.112:0/1030488148 >> v2:172.21.15.169:3300/0 conn(0x7f5c540cf5c0 0x7f5c5406ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 --2- 172.21.15.112:0/1030488148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540afb70 0x7f5c5415f520 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1030488148 >> 172.21.15.112:0/1030488148 conn(0x7f5c54072670 msgr2=0x7f5c54072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:29.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1030488148 shutdown_connections 2024-09-15T23:56:29.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.726+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1030488148 wait complete. 2024-09-15T23:56:29.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c5b84d640 1 Processor -- start 2024-09-15T23:56:29.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c5b84d640 1 -- start start 2024-09-15T23:56:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c5b84d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c5406d210 0x7f5c5413c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c5b84d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540afb70 0x7f5c5415df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:29.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c5b84d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c540cf5c0 0x7f5c5413f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c5b84d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5c540b3ba0 con 0x7f5c540afb70 2024-09-15T23:56:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c5b84d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5c540aff50 con 0x7f5c5406d210 2024-09-15T23:56:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c5b84d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5c540b3d20 con 0x7f5c540cf5c0 2024-09-15T23:56:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c58de8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540afb70 0x7f5c5415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c58de8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540afb70 0x7f5c5415df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40420/0 (socket says 172.21.15.112:40420) 2024-09-15T23:56:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c58de8640 1 -- 172.21.15.112:0/1618393611 learned_addr learned my addr 172.21.15.112:0/1618393611 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c59dea640 1 --2- 172.21.15.112:0/1618393611 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c540cf5c0 0x7f5c5413f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c595e9640 1 --2- 172.21.15.112:0/1618393611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c5406d210 0x7f5c5413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c58de8640 1 -- 172.21.15.112:0/1618393611 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c540cf5c0 msgr2=0x7f5c5413f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c58de8640 1 --2- 172.21.15.112:0/1618393611 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c540cf5c0 0x7f5c5413f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c58de8640 1 -- 172.21.15.112:0/1618393611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c5406d210 msgr2=0x7f5c5413c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c58de8640 1 --2- 172.21.15.112:0/1618393611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c5406d210 0x7f5c5413c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c58de8640 1 -- 172.21.15.112:0/1618393611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5415c5c0 con 0x7f5c540afb70 2024-09-15T23:56:29.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c58de8640 1 --2- 172.21.15.112:0/1618393611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540afb70 0x7f5c5415df50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000d800 tx=0x7f5c5000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:29.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c49ffb640 1 -- 172.21.15.112:0/1618393611 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5000b6c0 con 0x7f5c540afb70 2024-09-15T23:56:29.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c49ffb640 1 -- 172.21.15.112:0/1618393611 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c50019070 con 0x7f5c540afb70 2024-09-15T23:56:29.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1618393611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c5415c8a0 con 0x7f5c540afb70 2024-09-15T23:56:29.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c49ffb640 1 -- 172.21.15.112:0/1618393611 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5000ba80 con 0x7f5c540afb70 2024-09-15T23:56:29.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1618393611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c5415ce60 con 0x7f5c540afb70 2024-09-15T23:56:29.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.730+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1618393611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c5415f520 con 0x7f5c540afb70 2024-09-15T23:56:29.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.734+0000 7f5c49ffb640 1 -- 172.21.15.112:0/1618393611 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5c5000bc20 con 0x7f5c540afb70 2024-09-15T23:56:29.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.734+0000 7f5c49ffb640 1 --2- 172.21.15.112:0/1618393611 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5c380678f0 0x7f5c38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:29.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.734+0000 7f5c49ffb640 1 -- 172.21.15.112:0/1618393611 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f5c50086130 con 0x7f5c540afb70 2024-09-15T23:56:29.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.734+0000 7f5c595e9640 1 --2- 172.21.15.112:0/1618393611 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5c380678f0 0x7f5c38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:29.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.734+0000 7f5c595e9640 1 --2- 172.21.15.112:0/1618393611 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5c380678f0 0x7f5c38069db0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5c440ad000 tx=0x7f5c440a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:29.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.738+0000 7f5c49ffb640 1 -- 172.21.15.112:0/1618393611 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5c50056ae0 con 0x7f5c540afb70 2024-09-15T23:56:29.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.914+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1618393611 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5c54072e20 con 0x7f5c540afb70 2024-09-15T23:56:29.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.914+0000 7f5c49ffb640 1 -- 172.21.15.112:0/1618393611 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v62) ==== 80+0+0 (secure 0 0 0) 0x7f5c500563e0 con 0x7f5c540afb70 2024-09-15T23:56:29.916 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:56:29.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.918+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1618393611 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5c380678f0 msgr2=0x7f5c38069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:29.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.918+0000 7f5c5b84d640 1 --2- 172.21.15.112:0/1618393611 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5c380678f0 0x7f5c38069db0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5c440ad000 tx=0x7f5c440a6000 comp rx=0 tx=0).stop 2024-09-15T23:56:29.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.918+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1618393611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540afb70 msgr2=0x7f5c5415df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:29.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.918+0000 7f5c5b84d640 1 --2- 172.21.15.112:0/1618393611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540afb70 0x7f5c5415df50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000d800 tx=0x7f5c5000dcc0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.918+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1618393611 shutdown_connections 2024-09-15T23:56:29.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.918+0000 7f5c5b84d640 1 --2- 172.21.15.112:0/1618393611 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5c380678f0 0x7f5c38069db0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.918+0000 7f5c5b84d640 1 --2- 172.21.15.112:0/1618393611 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5c540cf5c0 0x7f5c5413f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.918+0000 7f5c5b84d640 1 --2- 172.21.15.112:0/1618393611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c540afb70 0x7f5c5415df50 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.918+0000 7f5c5b84d640 1 --2- 172.21.15.112:0/1618393611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c5406d210 0x7f5c5413c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.918+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1618393611 >> 172.21.15.112:0/1618393611 conn(0x7f5c54072670 msgr2=0x7f5c5406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:29.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.918+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1618393611 shutdown_connections 2024-09-15T23:56:29.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:29.918+0000 7f5c5b84d640 1 -- 172.21.15.112:0/1618393611 wait complete. 2024-09-15T23:56:29.935 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:56:29.935 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:29.941 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:56:30.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.106+0000 7fb407ee9640 1 Processor -- start 2024-09-15T23:56:30.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.106+0000 7fb407ee9640 1 -- start start 2024-09-15T23:56:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.110+0000 7fb407ee9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4001520a0 0x7fb40006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.110+0000 7fb407ee9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb40015f3a0 0x7fb4000adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.110+0000 7fb407ee9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb400070250 con 0x7fb40006fe50 2024-09-15T23:56:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.110+0000 7fb407ee9640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb400152480 con 0x7fb40015f3a0 2024-09-15T23:56:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.110+0000 7fb407ee9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb4000aede0 con 0x7fb4001520a0 2024-09-15T23:56:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.110+0000 7fb406486640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb40015f3a0 0x7fb4000adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.110+0000 7fb406486640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb40015f3a0 0x7fb4000adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40422/0 (socket says 172.21.15.112:40422) 2024-09-15T23:56:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.110+0000 7fb406486640 1 -- 172.21.15.112:0/750766750 learned_addr learned my addr 172.21.15.112:0/750766750 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.110+0000 7fb405c85640 1 --2- 172.21.15.112:0/750766750 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4001520a0 0x7fb40006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.110+0000 7fb406486640 1 -- 172.21.15.112:0/750766750 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4001520a0 msgr2=0x7fb40006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.110+0000 7fb406486640 1 --2- 172.21.15.112:0/750766750 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4001520a0 0x7fb40006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:30.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.110+0000 7fb406486640 1 -- 172.21.15.112:0/750766750 >> v1:172.21.15.169:6789/0 conn(0x7fb40006fe50 legacy=0x7fb40015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:30.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.110+0000 7fb406486640 1 -- 172.21.15.112:0/750766750 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40015fa10 con 0x7fb40015f3a0 2024-09-15T23:56:30.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb406486640 1 --2- 172.21.15.112:0/750766750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40015f3a0 0x7fb4000adc80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009e50 tx=0x7fb3f801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d761b8a544a815 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:30.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb404c83640 1 -- 172.21.15.112:0/750766750 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f80a5900 con 0x7fb40015f3a0 2024-09-15T23:56:30.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb404c83640 1 -- 172.21.15.112:0/750766750 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f80a5aa0 con 0x7fb40015f3a0 2024-09-15T23:56:30.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb404c83640 1 -- 172.21.15.112:0/750766750 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f80ad3f0 con 0x7fb40015f3a0 2024-09-15T23:56:30.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 -- 172.21.15.112:0/750766750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40015f3a0 msgr2=0x7fb4000adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:30.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 --2- 172.21.15.112:0/750766750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40015f3a0 0x7fb4000adc80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009e50 tx=0x7fb3f801ca30 comp rx=0 tx=0).stop 2024-09-15T23:56:30.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 -- 172.21.15.112:0/750766750 shutdown_connections 2024-09-15T23:56:30.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 --2- 172.21.15.112:0/750766750 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40015f3a0 0x7fb4000adc80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:30.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 --2- 172.21.15.112:0/750766750 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4001520a0 0x7fb40006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:30.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 -- 172.21.15.112:0/750766750 >> 172.21.15.112:0/750766750 conn(0x7fb4000b1f90 msgr2=0x7fb4000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:30.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 -- 172.21.15.112:0/750766750 shutdown_connections 2024-09-15T23:56:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 -- 172.21.15.112:0/750766750 wait complete. 2024-09-15T23:56:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 Processor -- start 2024-09-15T23:56:30.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 -- start start 2024-09-15T23:56:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb40006fe50 0x7fb40006f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4001520a0 0x7fb40015d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb40015f3a0 0x7fb40014e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb400073d30 con 0x7fb4001520a0 2024-09-15T23:56:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb400073a50 con 0x7fb40015f3a0 2024-09-15T23:56:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb407ee9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb400167f10 con 0x7fb40006fe50 2024-09-15T23:56:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb405484640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4001520a0 0x7fb40015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb405484640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4001520a0 0x7fb40015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40424/0 (socket says 172.21.15.112:40424) 2024-09-15T23:56:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb405484640 1 -- 172.21.15.112:0/744970966 learned_addr learned my addr 172.21.15.112:0/744970966 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb405c85640 1 --2- 172.21.15.112:0/744970966 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb40006fe50 0x7fb40006f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb406486640 1 --2- 172.21.15.112:0/744970966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb40015f3a0 0x7fb40014e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:30.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb405484640 1 -- 172.21.15.112:0/744970966 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb40006fe50 msgr2=0x7fb40006f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb405484640 1 --2- 172.21.15.112:0/744970966 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb40006fe50 0x7fb40006f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb405484640 1 -- 172.21.15.112:0/744970966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb40015f3a0 msgr2=0x7fb40014e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb405484640 1 --2- 172.21.15.112:0/744970966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb40015f3a0 0x7fb40014e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.114+0000 7fb405484640 1 -- 172.21.15.112:0/744970966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4000b02e0 con 0x7fb4001520a0 2024-09-15T23:56:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.118+0000 7fb405484640 1 --2- 172.21.15.112:0/744970966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4001520a0 0x7fb40015d910 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000c370 tx=0x7fb3f000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.118+0000 7fb3f67fc640 1 -- 172.21.15.112:0/744970966 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f00052d0 con 0x7fb4001520a0 2024-09-15T23:56:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.118+0000 7fb3f67fc640 1 -- 172.21.15.112:0/744970966 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f0005470 con 0x7fb4001520a0 2024-09-15T23:56:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.118+0000 7fb407ee9640 1 -- 172.21.15.112:0/744970966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4000b05c0 con 0x7fb4001520a0 2024-09-15T23:56:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.118+0000 7fb3f67fc640 1 -- 172.21.15.112:0/744970966 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0007260 con 0x7fb4001520a0 2024-09-15T23:56:30.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.118+0000 7fb407ee9640 1 -- 172.21.15.112:0/744970966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4000b0b80 con 0x7fb4001520a0 2024-09-15T23:56:30.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.118+0000 7fb407ee9640 1 -- 172.21.15.112:0/744970966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb40006e540 con 0x7fb4001520a0 2024-09-15T23:56:30.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.118+0000 7fb3f67fc640 1 -- 172.21.15.112:0/744970966 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3f0007400 con 0x7fb4001520a0 2024-09-15T23:56:30.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.118+0000 7fb3f67fc640 1 --2- 172.21.15.112:0/744970966 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3e40678c0 0x7fb3e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:30.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.118+0000 7fb3f67fc640 1 -- 172.21.15.112:0/744970966 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7fb3f00851d0 con 0x7fb4001520a0 2024-09-15T23:56:30.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.118+0000 7fb405c85640 1 --2- 172.21.15.112:0/744970966 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3e40678c0 0x7fb3e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:30.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.118+0000 7fb405c85640 1 --2- 172.21.15.112:0/744970966 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3e40678c0 0x7fb3e4069d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb4000af930 tx=0x7fb3fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:30.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.122+0000 7fb3f67fc640 1 -- 172.21.15.112:0/744970966 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb3f0055c10 con 0x7fb4001520a0 2024-09-15T23:56:30.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.294+0000 7fb407ee9640 1 -- 172.21.15.112:0/744970966 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb4000b3610 con 0x7fb4001520a0 2024-09-15T23:56:30.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.298+0000 7fb3f67fc640 1 -- 172.21.15.112:0/744970966 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v62) ==== 80+0+0 (secure 0 0 0) 0x7fb3f0055510 con 0x7fb4001520a0 2024-09-15T23:56:30.298 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:56:30.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.298+0000 7fb407ee9640 1 -- 172.21.15.112:0/744970966 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3e40678c0 msgr2=0x7fb3e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:30.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.298+0000 7fb407ee9640 1 --2- 172.21.15.112:0/744970966 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3e40678c0 0x7fb3e4069d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb4000af930 tx=0x7fb3fc008040 comp rx=0 tx=0).stop 2024-09-15T23:56:30.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.298+0000 7fb407ee9640 1 -- 172.21.15.112:0/744970966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4001520a0 msgr2=0x7fb40015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:30.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.298+0000 7fb407ee9640 1 --2- 172.21.15.112:0/744970966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4001520a0 0x7fb40015d910 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000c370 tx=0x7fb3f000c830 comp rx=0 tx=0).stop 2024-09-15T23:56:30.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.298+0000 7fb407ee9640 1 -- 172.21.15.112:0/744970966 shutdown_connections 2024-09-15T23:56:30.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.298+0000 7fb407ee9640 1 --2- 172.21.15.112:0/744970966 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3e40678c0 0x7fb3e4069d80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:30.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.298+0000 7fb407ee9640 1 --2- 172.21.15.112:0/744970966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb40015f3a0 0x7fb40014e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:30.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.298+0000 7fb407ee9640 1 --2- 172.21.15.112:0/744970966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4001520a0 0x7fb40015d910 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:30.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.298+0000 7fb407ee9640 1 --2- 172.21.15.112:0/744970966 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb40006fe50 0x7fb40006f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:30.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.298+0000 7fb407ee9640 1 -- 172.21.15.112:0/744970966 >> 172.21.15.112:0/744970966 conn(0x7fb4000b1f90 msgr2=0x7fb40014f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:30.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.298+0000 7fb407ee9640 1 -- 172.21.15.112:0/744970966 shutdown_connections 2024-09-15T23:56:30.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:30.298+0000 7fb407ee9640 1 -- 172.21.15.112:0/744970966 wait complete. 2024-09-15T23:56:30.317 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2024-09-15T23:56:30.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:30.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:30.329 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[40564]: fuse finished with error 0 and tester_r 0 2024-09-15T23:56:30.330 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:56:36.432 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:56:36.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:36.433 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:56:36.455 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:36.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.630+0000 7f4eb1765640 1 Processor -- start 2024-09-15T23:56:36.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.630+0000 7f4eb1765640 1 -- start start 2024-09-15T23:56:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.630+0000 7f4eb1765640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4eac073170 0x7f4eac06e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:36.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.630+0000 7f4eb1765640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eac06ec60 con 0x7f4eac1587a0 2024-09-15T23:56:36.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.630+0000 7f4eb1765640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eac06ef40 con 0x7f4eac0b39a0 2024-09-15T23:56:36.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.630+0000 7f4eb1765640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4eac06f870 con 0x7f4eac073170 2024-09-15T23:56:36.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.630+0000 7f4eaaffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4eac1587a0 0x7f4eac0b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49614/0 (socket says 172.21.15.112:49614) 2024-09-15T23:56:36.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.630+0000 7f4eaaffd640 1 -- 172.21.15.112:0/1646286827 learned_addr learned my addr 172.21.15.112:0/1646286827 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:36.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.630+0000 7f4eab7fe640 1 --2- 172.21.15.112:0/1646286827 >> v2:172.21.15.112:3300/0 conn(0x7f4eac073170 0x7f4eac06e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:36.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.630+0000 7f4ea9ffb640 1 -- 172.21.15.112:0/1646286827 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010383326 0 0) 0x7f4eac06ec60 con 0x7f4eac1587a0 2024-09-15T23:56:36.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.630+0000 7f4ea9ffb640 1 -- 172.21.15.112:0/1646286827 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e94003530 con 0x7f4eac1587a0 2024-09-15T23:56:36.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.630+0000 7f4eab7fe640 1 -- 172.21.15.112:0/1646286827 >> v1:172.21.15.169:6789/0 conn(0x7f4eac0b39a0 legacy=0x7f4eac06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.630+0000 7f4eab7fe640 1 -- 172.21.15.112:0/1646286827 >> v1:172.21.15.112:6789/0 conn(0x7f4eac1587a0 legacy=0x7f4eac0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.630+0000 7f4eab7fe640 1 -- 172.21.15.112:0/1646286827 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac06f220 con 0x7f4eac073170 2024-09-15T23:56:36.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eab7fe640 1 --2- 172.21.15.112:0/1646286827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac073170 0x7f4eac06e680 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4eac06f9f0 tx=0x7f4ea401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed14081bc830318 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:36.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4ea9ffb640 1 -- 172.21.15.112:0/1646286827 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40b2070 con 0x7f4eac073170 2024-09-15T23:56:36.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4ea9ffb640 1 -- 172.21.15.112:0/1646286827 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea40a5900 con 0x7f4eac073170 2024-09-15T23:56:36.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4ea9ffb640 1 -- 172.21.15.112:0/1646286827 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40a5cb0 con 0x7f4eac073170 2024-09-15T23:56:36.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 -- 172.21.15.112:0/1646286827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac073170 msgr2=0x7f4eac06e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 --2- 172.21.15.112:0/1646286827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac073170 0x7f4eac06e680 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4eac06f9f0 tx=0x7f4ea401c920 comp rx=0 tx=0).stop 2024-09-15T23:56:36.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 -- 172.21.15.112:0/1646286827 shutdown_connections 2024-09-15T23:56:36.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 --2- 172.21.15.112:0/1646286827 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac073170 0x7f4eac06e680 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 -- 172.21.15.112:0/1646286827 >> 172.21.15.112:0/1646286827 conn(0x7f4eac0b1f90 msgr2=0x7f4eac0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:36.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 -- 172.21.15.112:0/1646286827 shutdown_connections 2024-09-15T23:56:36.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 -- 172.21.15.112:0/1646286827 wait complete. 2024-09-15T23:56:36.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 Processor -- start 2024-09-15T23:56:36.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 -- start start 2024-09-15T23:56:36.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4eac073170 0x7f4eac099620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:36.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4eac0b39a0 0x7f4eac144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:36.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac1587a0 0x7f4eac1451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:36.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac16bd90 con 0x7f4eac1587a0 2024-09-15T23:56:36.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac16bc10 con 0x7f4eac0b39a0 2024-09-15T23:56:36.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.634+0000 7f4eb1765640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4eac16bf10 con 0x7f4eac073170 2024-09-15T23:56:36.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eab7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac1587a0 0x7f4eac1451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eab7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac1587a0 0x7f4eac1451f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40438/0 (socket says 172.21.15.112:40438) 2024-09-15T23:56:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eab7fe640 1 -- 172.21.15.112:0/3928957234 learned_addr learned my addr 172.21.15.112:0/3928957234 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eaaffd640 1 --2- 172.21.15.112:0/3928957234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4eac073170 0x7f4eac099620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eab7fe640 1 -- 172.21.15.112:0/3928957234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4eac073170 msgr2=0x7f4eac099620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eaa7fc640 1 --2- 172.21.15.112:0/3928957234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4eac0b39a0 0x7f4eac144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eab7fe640 1 --2- 172.21.15.112:0/3928957234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4eac073170 0x7f4eac099620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eab7fe640 1 -- 172.21.15.112:0/3928957234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4eac0b39a0 msgr2=0x7f4eac144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eab7fe640 1 --2- 172.21.15.112:0/3928957234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4eac0b39a0 0x7f4eac144cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eab7fe640 1 -- 172.21.15.112:0/3928957234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac161140 con 0x7f4eac1587a0 2024-09-15T23:56:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eab7fe640 1 --2- 172.21.15.112:0/3928957234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac1587a0 0x7f4eac1451f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40b0040 tx=0x7f4ea40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4e937fe640 1 -- 172.21.15.112:0/3928957234 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40b2050 con 0x7f4eac1587a0 2024-09-15T23:56:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4e937fe640 1 -- 172.21.15.112:0/3928957234 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea40be070 con 0x7f4eac1587a0 2024-09-15T23:56:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eb1765640 1 -- 172.21.15.112:0/3928957234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eac1608a0 con 0x7f4eac1587a0 2024-09-15T23:56:36.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4e937fe640 1 -- 172.21.15.112:0/3928957234 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4004040 con 0x7f4eac1587a0 2024-09-15T23:56:36.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eb1765640 1 -- 172.21.15.112:0/3928957234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eac160e60 con 0x7f4eac1587a0 2024-09-15T23:56:36.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eb1765640 1 -- 172.21.15.112:0/3928957234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eac06ec60 con 0x7f4eac1587a0 2024-09-15T23:56:36.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4e937fe640 1 -- 172.21.15.112:0/3928957234 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ea40041e0 con 0x7f4eac1587a0 2024-09-15T23:56:36.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4e937fe640 1 --2- 172.21.15.112:0/3928957234 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4e980678c0 0x7f4e98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:36.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eaaffd640 1 --2- 172.21.15.112:0/3928957234 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4e980678c0 0x7f4e98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:36.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4e937fe640 1 -- 172.21.15.112:0/3928957234 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6304+0+0 (secure 0 0 0) 0x7f4ea4121030 con 0x7f4eac1587a0 2024-09-15T23:56:36.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.638+0000 7f4eaaffd640 1 --2- 172.21.15.112:0/3928957234 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4e980678c0 0x7f4e98069d80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00011f0 tx=0x7f4ea0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:36.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.642+0000 7f4e937fe640 1 -- 172.21.15.112:0/3928957234 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4ea4016540 con 0x7f4eac1587a0 2024-09-15T23:56:36.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.838+0000 7f4eb1765640 1 -- 172.21.15.112:0/3928957234 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4eac070080 con 0x7f4eac1587a0 2024-09-15T23:56:36.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.838+0000 7f4e937fe640 1 -- 172.21.15.112:0/3928957234 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5233 (secure 0 0 0) 0x7f4ea40f19b0 con 0x7f4eac1587a0 2024-09-15T23:56:36.841 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:36.841 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"btime":"2024-09-15T23:56:08:794770+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/442643148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":442643148},{"type":"v1","addr":"172.21.15.169:6833","nonce":442643148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2506338033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2506338033},{"type":"v1","addr":"172.21.15.169:6835","nonce":2506338033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3040445121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3040445121},{"type":"v1","addr":"172.21.15.112:6835","nonce":3040445121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:06.156047+0000","modified":"2024-09-15T23:56:08.141848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/3667278267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3667278267},{"type":"v1","addr":"172.21.15.112:6837","nonce":3667278267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5625,"qdb_cluster":[5625]},"id":4}]} 2024-09-15T23:56:36.841 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 29 2024-09-15T23:56:36.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.842+0000 7f4eb1765640 1 -- 172.21.15.112:0/3928957234 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4e980678c0 msgr2=0x7f4e98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.842+0000 7f4eb1765640 1 --2- 172.21.15.112:0/3928957234 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4e980678c0 0x7f4e98069d80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00011f0 tx=0x7f4ea0009040 comp rx=0 tx=0).stop 2024-09-15T23:56:36.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.842+0000 7f4eb1765640 1 -- 172.21.15.112:0/3928957234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac1587a0 msgr2=0x7f4eac1451f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.842+0000 7f4eb1765640 1 --2- 172.21.15.112:0/3928957234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac1587a0 0x7f4eac1451f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40b0040 tx=0x7f4ea40196c0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.842+0000 7f4eb1765640 1 -- 172.21.15.112:0/3928957234 shutdown_connections 2024-09-15T23:56:36.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.842+0000 7f4eb1765640 1 --2- 172.21.15.112:0/3928957234 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4e980678c0 0x7f4e98069d80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.842+0000 7f4eb1765640 1 --2- 172.21.15.112:0/3928957234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eac1587a0 0x7f4eac1451f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.842+0000 7f4eb1765640 1 --2- 172.21.15.112:0/3928957234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4eac0b39a0 0x7f4eac144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.842+0000 7f4eb1765640 1 --2- 172.21.15.112:0/3928957234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4eac073170 0x7f4eac099620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.842+0000 7f4eb1765640 1 -- 172.21.15.112:0/3928957234 >> 172.21.15.112:0/3928957234 conn(0x7f4eac0b1f90 msgr2=0x7f4eac0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:36.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.842+0000 7f4eb1765640 1 -- 172.21.15.112:0/3928957234 shutdown_connections 2024-09-15T23:56:36.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:36.842+0000 7f4eb1765640 1 -- 172.21.15.112:0/3928957234 wait complete. 2024-09-15T23:56:36.859 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dirfrag split /subdir 0/0 1 2024-09-15T23:56:36.993 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-15T23:56:36.994 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:37.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f216d0e5640 1 Processor -- start 2024-09-15T23:56:37.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f216d0e5640 1 -- start start 2024-09-15T23:56:37.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f216d0e5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2168070020 0x7f216815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:37.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f216d0e5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216815f1d0 0x7f21680adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:37.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f216d0e5640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21680aede0 con 0x7f21681520a0 2024-09-15T23:56:37.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f216d0e5640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2168152480 con 0x7f2168070020 2024-09-15T23:56:37.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f216d0e5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f216815fa10 con 0x7f216815f1d0 2024-09-15T23:56:37.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f215ffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2168070020 0x7f216815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:37.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f215ffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2168070020 0x7f216815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40442/0 (socket says 172.21.15.112:40442) 2024-09-15T23:56:37.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f215ffff640 1 -- 172.21.15.112:0/3162814993 learned_addr learned my addr 172.21.15.112:0/3162814993 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:37.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f216759e640 1 --2- 172.21.15.112:0/3162814993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216815f1d0 0x7f21680adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:37.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f215ffff640 1 -- 172.21.15.112:0/3162814993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216815f1d0 msgr2=0x7f21680adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:37.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f215ffff640 1 --2- 172.21.15.112:0/3162814993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216815f1d0 0x7f21680adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f215ffff640 1 -- 172.21.15.112:0/3162814993 >> v1:172.21.15.169:6789/0 conn(0x7f21681520a0 legacy=0x7f216806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:37.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.110+0000 7f215ffff640 1 -- 172.21.15.112:0/3162814993 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2168074250 con 0x7f2168070020 2024-09-15T23:56:37.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f215ffff640 1 --2- 172.21.15.112:0/3162814993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2168070020 0x7f216815ec90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2150009870 tx=0x7f215001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4355a40449d8c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:37.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216659c640 1 -- 172.21.15.112:0/3162814993 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21500a95f0 con 0x7f2168070020 2024-09-15T23:56:37.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216659c640 1 -- 172.21.15.112:0/3162814993 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21500a9790 con 0x7f2168070020 2024-09-15T23:56:37.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216659c640 1 -- 172.21.15.112:0/3162814993 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21500a9b60 con 0x7f2168070020 2024-09-15T23:56:37.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 -- 172.21.15.112:0/3162814993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2168070020 msgr2=0x7f216815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:37.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 --2- 172.21.15.112:0/3162814993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2168070020 0x7f216815ec90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2150009870 tx=0x7f215001c530 comp rx=0 tx=0).stop 2024-09-15T23:56:37.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 -- 172.21.15.112:0/3162814993 shutdown_connections 2024-09-15T23:56:37.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 --2- 172.21.15.112:0/3162814993 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216815f1d0 0x7f21680adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 --2- 172.21.15.112:0/3162814993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2168070020 0x7f216815ec90 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 -- 172.21.15.112:0/3162814993 >> 172.21.15.112:0/3162814993 conn(0x7f21680b1f90 msgr2=0x7f21680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:37.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 -- 172.21.15.112:0/3162814993 shutdown_connections 2024-09-15T23:56:37.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 -- 172.21.15.112:0/3162814993 wait complete. 2024-09-15T23:56:37.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 Processor -- start 2024-09-15T23:56:37.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 -- start start 2024-09-15T23:56:37.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21681520a0 0x7f2168146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:37.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216815f1d0 0x7f216814ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:37.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2168151ba0 0x7f216814f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:37.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f216815f600 con 0x7f2168151ba0 2024-09-15T23:56:37.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2168073d30 con 0x7f21681520a0 2024-09-15T23:56:37.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216d0e5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f216815f780 con 0x7f216815f1d0 2024-09-15T23:56:37.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216759e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2168151ba0 0x7f216814f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:37.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216759e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2168151ba0 0x7f216814f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40456/0 (socket says 172.21.15.112:40456) 2024-09-15T23:56:37.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.114+0000 7f216759e640 1 -- 172.21.15.112:0/1587766965 learned_addr learned my addr 172.21.15.112:0/1587766965 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:37.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f215ffff640 1 --2- 172.21.15.112:0/1587766965 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216815f1d0 0x7f216814ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:37.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f216759e640 1 -- 172.21.15.112:0/1587766965 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216815f1d0 msgr2=0x7f216814ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:37.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f216759e640 1 --2- 172.21.15.112:0/1587766965 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216815f1d0 0x7f216814ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f216759e640 1 -- 172.21.15.112:0/1587766965 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21681520a0 msgr2=0x7f2168146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:37.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f216759e640 1 --2- 172.21.15.112:0/1587766965 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21681520a0 0x7f2168146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f216759e640 1 -- 172.21.15.112:0/1587766965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216814ff40 con 0x7f2168151ba0 2024-09-15T23:56:37.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f216759e640 1 --2- 172.21.15.112:0/1587766965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2168151ba0 0x7f216814f4d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f216000efc0 tx=0x7f216000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:37.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f215f7fe640 1 -- 172.21.15.112:0/1587766965 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2160018020 con 0x7f2168151ba0 2024-09-15T23:56:37.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f215f7fe640 1 -- 172.21.15.112:0/1587766965 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2160014480 con 0x7f2168151ba0 2024-09-15T23:56:37.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f216d0e5640 1 -- 172.21.15.112:0/1587766965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216815aea0 con 0x7f2168151ba0 2024-09-15T23:56:37.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f215f7fe640 1 -- 172.21.15.112:0/1587766965 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2160014870 con 0x7f2168151ba0 2024-09-15T23:56:37.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f216d0e5640 1 -- 172.21.15.112:0/1587766965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21680b4280 con 0x7f2168151ba0 2024-09-15T23:56:37.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f216d0e5640 1 -- 172.21.15.112:0/1587766965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f216815ec90 con 0x7f2168151ba0 2024-09-15T23:56:37.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f215f7fe640 1 -- 172.21.15.112:0/1587766965 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f216001b020 con 0x7f2168151ba0 2024-09-15T23:56:37.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f215f7fe640 1 --2- 172.21.15.112:0/1587766965 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f21480678c0 0x7f2148069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:37.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f215f7fe640 1 -- 172.21.15.112:0/1587766965 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6304+0+0 (secure 0 0 0) 0x7f21600870d0 con 0x7f2168151ba0 2024-09-15T23:56:37.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f2166d9d640 1 --2- 172.21.15.112:0/1587766965 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f21480678c0 0x7f2148069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:37.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.118+0000 7f2166d9d640 1 --2- 172.21.15.112:0/1587766965 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f21480678c0 0x7f2148069d80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2158000f70 tx=0x7f21580079e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:37.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.122+0000 7f215f7fe640 1 -- 172.21.15.112:0/1587766965 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2160022070 con 0x7f2168151ba0 2024-09-15T23:56:37.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.310+0000 7f216d0e5640 1 -- 172.21.15.112:0/1587766965 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f216815e5b0 con 0x7f2168151ba0 2024-09-15T23:56:37.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.310+0000 7f215f7fe640 1 -- 172.21.15.112:0/1587766965 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5233 (secure 0 0 0) 0x7f2160010040 con 0x7f2168151ba0 2024-09-15T23:56:37.313 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:37.314 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"btime":"2024-09-15T23:56:08:794770+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/442643148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":442643148},{"type":"v1","addr":"172.21.15.169:6833","nonce":442643148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2506338033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2506338033},{"type":"v1","addr":"172.21.15.169:6835","nonce":2506338033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3040445121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3040445121},{"type":"v1","addr":"172.21.15.112:6835","nonce":3040445121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:06.156047+0000","modified":"2024-09-15T23:56:08.141848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/3667278267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3667278267},{"type":"v1","addr":"172.21.15.112:6837","nonce":3667278267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5625,"qdb_cluster":[5625]},"id":4}]} 2024-09-15T23:56:37.314 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 29 2024-09-15T23:56:37.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.314+0000 7f216d0e5640 1 -- 172.21.15.112:0/1587766965 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f21480678c0 msgr2=0x7f2148069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:37.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.314+0000 7f216d0e5640 1 --2- 172.21.15.112:0/1587766965 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f21480678c0 0x7f2148069d80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2158000f70 tx=0x7f21580079e0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.314+0000 7f216d0e5640 1 -- 172.21.15.112:0/1587766965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2168151ba0 msgr2=0x7f216814f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:37.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.314+0000 7f216d0e5640 1 --2- 172.21.15.112:0/1587766965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2168151ba0 0x7f216814f4d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f216000efc0 tx=0x7f216000c490 comp rx=0 tx=0).stop 2024-09-15T23:56:37.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.314+0000 7f216d0e5640 1 -- 172.21.15.112:0/1587766965 shutdown_connections 2024-09-15T23:56:37.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.314+0000 7f216d0e5640 1 --2- 172.21.15.112:0/1587766965 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f21480678c0 0x7f2148069d80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.314+0000 7f216d0e5640 1 --2- 172.21.15.112:0/1587766965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2168151ba0 0x7f216814f4d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.314+0000 7f216d0e5640 1 --2- 172.21.15.112:0/1587766965 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f216815f1d0 0x7f216814ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.314+0000 7f216d0e5640 1 --2- 172.21.15.112:0/1587766965 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21681520a0 0x7f2168146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.314+0000 7f216d0e5640 1 -- 172.21.15.112:0/1587766965 >> 172.21.15.112:0/1587766965 conn(0x7f21680b1f90 msgr2=0x7f216806efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:37.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.314+0000 7f216d0e5640 1 -- 172.21.15.112:0/1587766965 shutdown_connections 2024-09-15T23:56:37.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.314+0000 7f216d0e5640 1 -- 172.21.15.112:0/1587766965 wait complete. 2024-09-15T23:56:37.331 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi112.stdout:{"message":"","return_code":0} 2024-09-15T23:56:37.485 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-15T23:56:37.485 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:56:37.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.590+0000 7f691f160640 1 Processor -- start 2024-09-15T23:56:37.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f691f160640 1 -- start start 2024-09-15T23:56:37.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f691f160640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f69180d3060 0x7f69180cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:37.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f691f160640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69180cf450 0x7f691806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:37.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f691f160640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69180d0300 con 0x7f6918161a60 2024-09-15T23:56:37.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f691f160640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f69180b0f60 con 0x7f69180d3060 2024-09-15T23:56:37.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f691f160640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f69180cfd40 con 0x7f69180cf450 2024-09-15T23:56:37.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f691cefc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6918161a60 0x7f69180d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:49620/0 (socket says 172.21.15.112:49620) 2024-09-15T23:56:37.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f6917fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f69180d3060 0x7f69180cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:37.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f691cefc640 1 -- 172.21.15.112:0/2555697133 learned_addr learned my addr 172.21.15.112:0/2555697133 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:37.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f6917fff640 1 -- 172.21.15.112:0/2555697133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69180cf450 msgr2=0x7f691806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:37.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f6917fff640 1 --2- 172.21.15.112:0/2555697133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69180cf450 0x7f691806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f6917fff640 1 -- 172.21.15.112:0/2555697133 >> v1:172.21.15.112:6789/0 conn(0x7f6918161a60 legacy=0x7f69180d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:37.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f6917fff640 1 -- 172.21.15.112:0/2555697133 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69180d0020 con 0x7f69180d3060 2024-09-15T23:56:37.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f69177fe640 1 -- 172.21.15.112:0/2555697133 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180508463 0 0) 0x7f690c001120 con 0x7f6918161a60 2024-09-15T23:56:37.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f6917fff640 1 --2- 172.21.15.112:0/2555697133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69180d3060 0x7f69180cef10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f69040097c0 tx=0x7f690401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b0fdc55706ca16 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:37.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f69177fe640 1 -- 172.21.15.112:0/2555697133 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69040b1070 con 0x7f69180d3060 2024-09-15T23:56:37.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f69177fe640 1 -- 172.21.15.112:0/2555697133 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69040a8050 con 0x7f69180d3060 2024-09-15T23:56:37.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.594+0000 7f69177fe640 1 -- 172.21.15.112:0/2555697133 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69040ac860 con 0x7f69180d3060 2024-09-15T23:56:37.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 -- 172.21.15.112:0/2555697133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69180d3060 msgr2=0x7f69180cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:37.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 --2- 172.21.15.112:0/2555697133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69180d3060 0x7f69180cef10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f69040097c0 tx=0x7f690401c3e0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 -- 172.21.15.112:0/2555697133 shutdown_connections 2024-09-15T23:56:37.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 --2- 172.21.15.112:0/2555697133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69180cf450 0x7f691806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 --2- 172.21.15.112:0/2555697133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69180d3060 0x7f69180cef10 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 -- 172.21.15.112:0/2555697133 >> 172.21.15.112:0/2555697133 conn(0x7f691808bf90 msgr2=0x7f691809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:37.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 -- 172.21.15.112:0/2555697133 shutdown_connections 2024-09-15T23:56:37.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 -- 172.21.15.112:0/2555697133 wait complete. 2024-09-15T23:56:37.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 Processor -- start 2024-09-15T23:56:37.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 -- start start 2024-09-15T23:56:37.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69180cf450 0x7f69180cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:37.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69180d3060 0x7f69180cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:37.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6918161a60 0x7f69180cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:37.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f691806e400 con 0x7f69180d3060 2024-09-15T23:56:37.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f691806e580 con 0x7f69180cf450 2024-09-15T23:56:37.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f691806e700 con 0x7f6918161a60 2024-09-15T23:56:37.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f6917fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69180d3060 0x7f69180cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:37.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f6917fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69180d3060 0x7f69180cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:40472/0 (socket says 172.21.15.112:40472) 2024-09-15T23:56:37.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f6917fff640 1 -- 172.21.15.112:0/744257105 learned_addr learned my addr 172.21.15.112:0/744257105 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:37.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f6917fff640 1 -- 172.21.15.112:0/744257105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6918161a60 msgr2=0x7f69180cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:37.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f6917fff640 1 --2- 172.21.15.112:0/744257105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6918161a60 0x7f69180cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f6917fff640 1 -- 172.21.15.112:0/744257105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69180cf450 msgr2=0x7f69180cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:37.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f6917fff640 1 --2- 172.21.15.112:0/744257105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69180cf450 0x7f69180cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f6917fff640 1 -- 172.21.15.112:0/744257105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69180cdab0 con 0x7f69180d3060 2024-09-15T23:56:37.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f6917fff640 1 --2- 172.21.15.112:0/744257105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69180d3060 0x7f69180cb5d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f690401a010 tx=0x7f690401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:37.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f69157fa640 1 -- 172.21.15.112:0/744257105 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69040b1040 con 0x7f69180d3060 2024-09-15T23:56:37.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f69157fa640 1 -- 172.21.15.112:0/744257105 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6904004020 con 0x7f69180d3060 2024-09-15T23:56:37.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 -- 172.21.15.112:0/744257105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69180cdd90 con 0x7f69180d3060 2024-09-15T23:56:37.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f69157fa640 1 -- 172.21.15.112:0/744257105 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69040043d0 con 0x7f69180d3060 2024-09-15T23:56:37.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 -- 172.21.15.112:0/744257105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69180ce350 con 0x7f69180d3060 2024-09-15T23:56:37.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.598+0000 7f691f160640 1 -- 172.21.15.112:0/744257105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f691806d6b0 con 0x7f69180d3060 2024-09-15T23:56:37.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.602+0000 7f69157fa640 1 -- 172.21.15.112:0/744257105 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f69040b4070 con 0x7f69180d3060 2024-09-15T23:56:37.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.602+0000 7f69157fa640 1 --2- 172.21.15.112:0/744257105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68fc0678c0 0x7f68fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:37.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.602+0000 7f69157fa640 1 -- 172.21.15.112:0/744257105 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6304+0+0 (secure 0 0 0) 0x7f6904120c30 con 0x7f69180d3060 2024-09-15T23:56:37.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.602+0000 7f691cefc640 1 --2- 172.21.15.112:0/744257105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68fc0678c0 0x7f68fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:37.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.602+0000 7f691cefc640 1 --2- 172.21.15.112:0/744257105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68fc0678c0 0x7f68fc069d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f690c001680 tx=0x7f690c001320 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:37.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.606+0000 7f69157fa640 1 -- 172.21.15.112:0/744257105 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f69040c4030 con 0x7f69180d3060 2024-09-15T23:56:37.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.802+0000 7f691f160640 1 -- 172.21.15.112:0/744257105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f69180b5830 con 0x7f69180d3060 2024-09-15T23:56:37.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.802+0000 7f69157fa640 1 -- 172.21.15.112:0/744257105 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+73 (secure 0 0 0) 0x7f69040bb030 con 0x7f69180d3060 2024-09-15T23:56:37.805 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:56:37.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.806+0000 7f691f160640 1 -- 172.21.15.112:0/744257105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68fc0678c0 msgr2=0x7f68fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:37.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.806+0000 7f691f160640 1 --2- 172.21.15.112:0/744257105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68fc0678c0 0x7f68fc069d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f690c001680 tx=0x7f690c001320 comp rx=0 tx=0).stop 2024-09-15T23:56:37.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.806+0000 7f691f160640 1 -- 172.21.15.112:0/744257105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69180d3060 msgr2=0x7f69180cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:37.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.806+0000 7f691f160640 1 --2- 172.21.15.112:0/744257105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69180d3060 0x7f69180cb5d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f690401a010 tx=0x7f690401ac20 comp rx=0 tx=0).stop 2024-09-15T23:56:37.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.806+0000 7f691f160640 1 -- 172.21.15.112:0/744257105 shutdown_connections 2024-09-15T23:56:37.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.806+0000 7f691f160640 1 --2- 172.21.15.112:0/744257105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68fc0678c0 0x7f68fc069d80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.806+0000 7f691f160640 1 --2- 172.21.15.112:0/744257105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6918161a60 0x7f69180cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.806+0000 7f691f160640 1 --2- 172.21.15.112:0/744257105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f69180d3060 0x7f69180cb5d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.806+0000 7f691f160640 1 --2- 172.21.15.112:0/744257105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69180cf450 0x7f69180cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:37.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.806+0000 7f691f160640 1 -- 172.21.15.112:0/744257105 >> 172.21.15.112:0/744257105 conn(0x7f691808bf90 msgr2=0x7f69180b5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:37.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.806+0000 7f691f160640 1 -- 172.21.15.112:0/744257105 shutdown_connections 2024-09-15T23:56:37.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:37.806+0000 7f691f160640 1 -- 172.21.15.112:0/744257105 wait complete. 2024-09-15T23:56:37.824 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:56:37.824 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:56:37.824 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-15T23:56:37.824 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:56:37.824 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:37.824 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:56:37.824 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:56:37.824 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:56:37.824 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:56:37.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:37.825 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-15T23:56:37.830 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:56:37.831 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:56:37.831 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:56:37.831 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:37.831 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-15T23:56:37.831 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:37.831 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:56:37.831 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:37.831 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-15T23:56:37.831 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:56:37.831 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:37.831 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-15T23:56:37.832 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:56:37.832 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:37.832 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:56:37.832 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:37.832 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T23:56:37.832 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42299sec preferred_lft 42299sec 2024-09-15T23:56:37.832 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2024-09-15T23:56:37.832 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:37.832 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T23:56:37.832 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:5c:cd:1e:d6 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:37.832 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T23:56:37.832 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:37.832 INFO:teuthology.orchestra.run.smithi112.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:56:37.833 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:37.833 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:56:37.833 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:37.833 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T23:56:37.833 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:37.833 INFO:teuthology.orchestra.run.smithi112.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:56:37.833 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:37.833 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T23:56:37.833 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:37.833 INFO:teuthology.orchestra.run.smithi112.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:56:37.833 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:56:37.833 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T23:56:37.833 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:37.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:37.834 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:56:37.891 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-15T23:56:37.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:37.892 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-15T23:56:37.949 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-15T23:56:37.949 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:56:37.949 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T23:56:37.950 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:56:37.950 INFO:teuthology.orchestra.run.smithi112.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T23:56:37.950 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T23:56:37.950 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:56:37.950 INFO:teuthology.orchestra.run.smithi112.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:56:37.950 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:56:37.950 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:56:37.950 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:56:37.950 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:56:37.951 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:56:37.951 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:56:37.951 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:56:37.951 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:56:37.951 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:56:38.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:56:38.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:38.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:38.074 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-15T23:56:38.080 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:56:38.080 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:56:38.080 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:56:38.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:38.081 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-15T23:56:38.135 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T23:56:38.135 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:56:38.135 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:38.184 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:56:38.184 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:56:38.184 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:38.232 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:56:38.288 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:56:38.343 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:56:38.344 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:56:38.344 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:56:38.344 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:56:38.344 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:56:38.344 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:56:38.344 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:56:38.344 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:56:38.344 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:56:38.344 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:56:38.344 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:56:38.344 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:56:38.344 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:56:38.345 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:56:38.345 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:56:38.345 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:56:38.345 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:56:38.345 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:56:38.345 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:56:38.345 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:56:38.345 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:56:38.345 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:56:38.345 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:56:38.345 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:56:38.345 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:56:38.345 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:56:38.346 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:56:38.346 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:56:38.346 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:56:38.346 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:38.346 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:38.346 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:56:38.346 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:56:38.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:38.347 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:56:38.395 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:56:38.395 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T23:56:38.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:56:38.456 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:56:38.503 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:56:38.504 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:56:38.504 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:56:38.504 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:56:38.504 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:56:38.504 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:56:38.504 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:56:38.504 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:56:38.504 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:56:38.504 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:56:38.505 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:56:38.505 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:56:38.505 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:56:38.505 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:56:38.505 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:56:38.505 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:56:38.505 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:56:38.505 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:56:38.505 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:56:38.505 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:56:38.505 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:56:38.505 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:56:38.505 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:56:38.506 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:56:38.506 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:56:38.506 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:56:38.506 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:56:38.506 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:56:38.506 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:56:38.506 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:38.506 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:38.506 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:56:38.506 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:56:38.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:38.507 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:56:38.520 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:2024-09-15T23:56:38.518+0000 7f70f4f0d580 -1 init, newargv = 0x55f30c648ec0 newargc=15 2024-09-15T23:56:38.520 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[40851]: starting ceph client 2024-09-15T23:56:38.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[40851]: starting fuse 2024-09-15T23:56:38.526 INFO:teuthology.orchestra.run.smithi112.stdout:45 2024-09-15T23:56:38.527 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T23:56:38.527 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:38.527 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2024-09-15T23:56:38.527 DEBUG:teuthology.orchestra.run.smithi112:> import re 2024-09-15T23:56:38.527 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:56:38.527 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-15T23:56:38.527 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:38.527 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2024-09-15T23:56:38.527 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:56:38.527 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2024-09-15T23:56:38.527 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:56:38.527 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> return f 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:38.528 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.0")) 2024-09-15T23:56:38.529 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:56:38.642 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.0.40851.asok 2024-09-15T23:56:38.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:38.653 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40851.asok 2024-09-15T23:56:38.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:38.653 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40851.asok status 2024-09-15T23:56:38.814 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:56:38.814 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2024-09-15T23:56:38.814 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:56:38.814 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:56:38.814 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "0", 2024-09-15T23:56:38.814 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2024-09-15T23:56:38.814 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:56:38.814 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "40851", 2024-09-15T23:56:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2024-09-15T23:56:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2024-09-15T23:56:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2024-09-15T23:56:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 5859, 2024-09-15T23:56:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2024-09-15T23:56:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2024-09-15T23:56:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2024-09-15T23:56:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 5859 2024-09-15T23:56:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:56:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:56:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:56:38.815 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 4007975892 2024-09-15T23:56:38.816 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:38.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:38.816 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:56:38.816 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:56:38.816 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:56:38.816 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 4007975892 2024-09-15T23:56:38.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:38.816 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.5859 192.168.0.1:0/4007975892", 2024-09-15T23:56:38.816 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.1:0/4007975892", 2024-09-15T23:56:38.816 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2024-09-15T23:56:38.816 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 29, 2024-09-15T23:56:38.816 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 64, 2024-09-15T23:56:38.816 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:56:38.816 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2024-09-15T23:56:38.817 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2024-09-15T23:56:38.817 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:56:38.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:38.828 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2024-09-15T23:56:38.828 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:38.834 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2024-09-15T23:56:38.834 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:38.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:38.835 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:38.887 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:56:38.887 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:38.935 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-15T23:56:38.935 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:56:38.936 DEBUG:teuthology.orchestra.run.smithi112:> import uuid 2024-09-15T23:56:38.936 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:38.936 DEBUG:teuthology.orchestra.run.smithi112:> n = 75 2024-09-15T23:56:38.936 DEBUG:teuthology.orchestra.run.smithi112:> create_hard_links = False 2024-09-15T23:56:38.936 DEBUG:teuthology.orchestra.run.smithi112:> if 0 > 0: 2024-09-15T23:56:38.936 DEBUG:teuthology.orchestra.run.smithi112:> create_hard_links = True 2024-09-15T23:56:38.936 DEBUG:teuthology.orchestra.run.smithi112:> path = "/home/ubuntu/cephtest/mnt.0/subdir/file" 2024-09-15T23:56:38.936 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:38.936 DEBUG:teuthology.orchestra.run.smithi112:> dpath = os.path.dirname(path) 2024-09-15T23:56:38.936 DEBUG:teuthology.orchestra.run.smithi112:> fnameprefix = os.path.basename(path) 2024-09-15T23:56:38.936 DEBUG:teuthology.orchestra.run.smithi112:> os.makedirs(dpath, exist_ok=True) 2024-09-15T23:56:38.936 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:38.936 DEBUG:teuthology.orchestra.run.smithi112:> try: 2024-09-15T23:56:38.937 DEBUG:teuthology.orchestra.run.smithi112:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-15T23:56:38.937 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:56:38.937 DEBUG:teuthology.orchestra.run.smithi112:> for i in range(n): 2024-09-15T23:56:38.937 DEBUG:teuthology.orchestra.run.smithi112:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-15T23:56:38.937 DEBUG:teuthology.orchestra.run.smithi112:> with open(fpath, '"'"'w'"'"') as f: 2024-09-15T23:56:38.937 DEBUG:teuthology.orchestra.run.smithi112:> f.write(f"{i}") 2024-09-15T23:56:38.937 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-15T23:56:38.937 DEBUG:teuthology.orchestra.run.smithi112:> f.flush() 2024-09-15T23:56:38.937 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(f.fileno()) 2024-09-15T23:56:38.937 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-15T23:56:38.938 DEBUG:teuthology.orchestra.run.smithi112:> os.unlink(fpath) 2024-09-15T23:56:38.938 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-15T23:56:38.938 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(dirfd) 2024-09-15T23:56:38.938 DEBUG:teuthology.orchestra.run.smithi112:> if create_hard_links: 2024-09-15T23:56:38.938 DEBUG:teuthology.orchestra.run.smithi112:> for j in range(0): 2024-09-15T23:56:38.938 DEBUG:teuthology.orchestra.run.smithi112:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-15T23:56:38.938 DEBUG:teuthology.orchestra.run.smithi112:> if True: 2024-09-15T23:56:38.938 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(dirfd) 2024-09-15T23:56:38.938 DEBUG:teuthology.orchestra.run.smithi112:> finally: 2024-09-15T23:56:38.938 DEBUG:teuthology.orchestra.run.smithi112:> os.close(dirfd) 2024-09-15T23:56:38.938 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:56:39.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:39.648 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:56:39.648 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:56:39.747 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:56:39.820 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:56:39.820 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:56:39.820 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:56:39.820 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:39.826 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:56:40.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d18c7b640 1 Processor -- start 2024-09-15T23:56:40.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d18c7b640 1 -- start start 2024-09-15T23:56:40.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d18c7b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2d140d3060 0x7f2d140cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:40.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d18c7b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d140d0300 con 0x7f2d14161a60 2024-09-15T23:56:40.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d18c7b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d140b0f60 con 0x7f2d140cf450 2024-09-15T23:56:40.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d18c7b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2d140cfd40 con 0x7f2d140d3060 2024-09-15T23:56:40.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d1259c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2d14161a60 0x7f2d140d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53288/0 (socket says 172.21.15.112:53288) 2024-09-15T23:56:40.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d1259c640 1 -- 172.21.15.112:0/2876037241 learned_addr learned my addr 172.21.15.112:0/2876037241 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:40.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d0bfff640 1 --2- 172.21.15.112:0/2876037241 >> v2:172.21.15.169:3300/0 conn(0x7f2d140d3060 0x7f2d140cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:40.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 -- 172.21.15.112:0/2876037241 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1790606212 0 0) 0x7f2d04001120 con 0x7f2d14161a60 2024-09-15T23:56:40.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 -- 172.21.15.112:0/2876037241 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d00003530 con 0x7f2d14161a60 2024-09-15T23:56:40.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 -- 172.21.15.112:0/2876037241 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2016087260 0 0) 0x7f2d00003530 con 0x7f2d14161a60 2024-09-15T23:56:40.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 -- 172.21.15.112:0/2876037241 >> v2:172.21.15.169:3300/0 conn(0x7f2d140d3060 msgr2=0x7f2d140cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:40.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 --2- 172.21.15.112:0/2876037241 >> v2:172.21.15.169:3300/0 conn(0x7f2d140d3060 0x7f2d140cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 -- 172.21.15.112:0/2876037241 >> v1:172.21.15.169:6789/0 conn(0x7f2d140cf450 legacy=0x7f2d1406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 -- 172.21.15.112:0/2876037241 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d140d0020 con 0x7f2d14161a60 2024-09-15T23:56:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 -- 172.21.15.112:0/2876037241 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f2d04001850 con 0x7f2d14161a60 2024-09-15T23:56:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 -- 172.21.15.112:0/2876037241 >> v1:172.21.15.112:6789/0 conn(0x7f2d14161a60 legacy=0x7f2d140d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 --2- 172.21.15.112:0/2876037241 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d000039c0 0x7f2d00003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 --2- 172.21.15.112:0/2876037241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d00004810 0x7f2d00004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 --2- 172.21.15.112:0/2876037241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d000051d0 0x7f2d0000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 -- 172.21.15.112:0/2876037241 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2d140cfd40 con 0x7f2d000051d0 2024-09-15T23:56:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 -- 172.21.15.112:0/2876037241 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0000c170 con 0x7f2d00004810 2024-09-15T23:56:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d11d9b640 1 -- 172.21.15.112:0/2876037241 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0000c370 con 0x7f2d000039c0 2024-09-15T23:56:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d12d9d640 1 --2- 172.21.15.112:0/2876037241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d000051d0 0x7f2d0000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d1259c640 1 --2- 172.21.15.112:0/2876037241 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d000039c0 0x7f2d00003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:40.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d0bfff640 1 --2- 172.21.15.112:0/2876037241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d00004810 0x7f2d00004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:40.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d12d9d640 1 -- 172.21.15.112:0/2876037241 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d000039c0 msgr2=0x7f2d00003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:40.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d12d9d640 1 --2- 172.21.15.112:0/2876037241 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d000039c0 0x7f2d00003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d12d9d640 1 -- 172.21.15.112:0/2876037241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d00004810 msgr2=0x7f2d00004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:40.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d12d9d640 1 --2- 172.21.15.112:0/2876037241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d00004810 0x7f2d00004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d12d9d640 1 -- 172.21.15.112:0/2876037241 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d00003530 con 0x7f2d000051d0 2024-09-15T23:56:40.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.002+0000 7f2d0bfff640 1 --2- 172.21.15.112:0/2876037241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d00004810 0x7f2d00004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:40.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.006+0000 7f2d12d9d640 1 -- 172.21.15.112:0/2876037241 reap_dead start 2024-09-15T23:56:40.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.006+0000 7f2d12d9d640 1 --2- 172.21.15.112:0/2876037241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d000051d0 0x7f2d0000b9d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c001e70 tx=0x7f2d0c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa22a9a2eb0d0ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:40.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.006+0000 7f2d11d9b640 1 -- 172.21.15.112:0/2876037241 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c001a90 con 0x7f2d000051d0 2024-09-15T23:56:40.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.006+0000 7f2d11d9b640 1 -- 172.21.15.112:0/2876037241 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0c003bc0 con 0x7f2d000051d0 2024-09-15T23:56:40.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.006+0000 7f2d11d9b640 1 -- 172.21.15.112:0/2876037241 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c005020 con 0x7f2d000051d0 2024-09-15T23:56:40.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.006+0000 7f2d18c7b640 1 -- 172.21.15.112:0/2876037241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d000051d0 msgr2=0x7f2d0000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:40.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.006+0000 7f2d18c7b640 1 --2- 172.21.15.112:0/2876037241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d000051d0 0x7f2d0000b9d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c001e70 tx=0x7f2d0c01c780 comp rx=0 tx=0).stop 2024-09-15T23:56:40.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.006+0000 7f2d18c7b640 1 -- 172.21.15.112:0/2876037241 shutdown_connections 2024-09-15T23:56:40.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.006+0000 7f2d18c7b640 1 --2- 172.21.15.112:0/2876037241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d000051d0 0x7f2d0000b9d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.006+0000 7f2d18c7b640 1 -- 172.21.15.112:0/2876037241 >> 172.21.15.112:0/2876037241 conn(0x7f2d1408bf90 msgr2=0x7f2d1409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:40.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.006+0000 7f2d18c7b640 1 -- 172.21.15.112:0/2876037241 shutdown_connections 2024-09-15T23:56:40.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.006+0000 7f2d18c7b640 1 -- 172.21.15.112:0/2876037241 wait complete. 2024-09-15T23:56:40.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.006+0000 7f2d18c7b640 1 Processor -- start 2024-09-15T23:56:40.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.006+0000 7f2d18c7b640 1 -- start start 2024-09-15T23:56:40.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d18c7b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d000051d0 0x7f2d140b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d18c7b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d14159830 0x7f2d140b9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d18c7b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d140d10c0 0x7f2d140d1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d18c7b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2d140cf8c0 con 0x7f2d000051d0 2024-09-15T23:56:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d18c7b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1406d190 con 0x7f2d14159830 2024-09-15T23:56:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d18c7b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2d140cfa40 con 0x7f2d140d10c0 2024-09-15T23:56:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d1259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d000051d0 0x7f2d140b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d1259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d000051d0 0x7f2d140b83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32852/0 (socket says 172.21.15.112:32852) 2024-09-15T23:56:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d1259c640 1 -- 172.21.15.112:0/1855218567 learned_addr learned my addr 172.21.15.112:0/1855218567 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d0bfff640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d14159830 0x7f2d140b9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d12d9d640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d140d10c0 0x7f2d140d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d1259c640 1 -- 172.21.15.112:0/1855218567 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d140d10c0 msgr2=0x7f2d140d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:40.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d1259c640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d140d10c0 0x7f2d140d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d1259c640 1 -- 172.21.15.112:0/1855218567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d14159830 msgr2=0x7f2d140b9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:40.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d1259c640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d14159830 0x7f2d140b9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d1259c640 1 -- 172.21.15.112:0/1855218567 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d140b7320 con 0x7f2d000051d0 2024-09-15T23:56:40.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d12d9d640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d140d10c0 0x7f2d140d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:40.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d1259c640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d000051d0 0x7f2d140b83c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2d040118a0 tx=0x7f2d04011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:40.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d0affd640 1 -- 172.21.15.112:0/1855218567 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04010040 con 0x7f2d000051d0 2024-09-15T23:56:40.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d0affd640 1 -- 172.21.15.112:0/1855218567 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0400fb80 con 0x7f2d000051d0 2024-09-15T23:56:40.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d18c7b640 1 -- 172.21.15.112:0/1855218567 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d140b7600 con 0x7f2d000051d0 2024-09-15T23:56:40.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d0affd640 1 -- 172.21.15.112:0/1855218567 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04001830 con 0x7f2d000051d0 2024-09-15T23:56:40.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d18c7b640 1 -- 172.21.15.112:0/1855218567 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d140b7bc0 con 0x7f2d000051d0 2024-09-15T23:56:40.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d18c7b640 1 -- 172.21.15.112:0/1855218567 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d140cef10 con 0x7f2d000051d0 2024-09-15T23:56:40.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d0affd640 1 -- 172.21.15.112:0/1855218567 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2d04020470 con 0x7f2d000051d0 2024-09-15T23:56:40.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d0affd640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2cf40678f0 0x7f2cf4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:40.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d0affd640 1 -- 172.21.15.112:0/1855218567 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6304+0+0 (secure 0 0 0) 0x7f2d040890e0 con 0x7f2d000051d0 2024-09-15T23:56:40.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.010+0000 7f2d0bfff640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2cf40678f0 0x7f2cf4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:40.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.014+0000 7f2d0bfff640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2cf40678f0 0x7f2cf4069db0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2d140b5d40 tx=0x7f2cfc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:40.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.018+0000 7f2d0affd640 1 -- 172.21.15.112:0/1855218567 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2d140d0300 con 0x7f2d000051d0 2024-09-15T23:56:40.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.194+0000 7f2d18c7b640 1 -- 172.21.15.112:0/1855218567 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2d1406e180 con 0x7f2d000051d0 2024-09-15T23:56:40.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.194+0000 7f2d0affd640 1 -- 172.21.15.112:0/1855218567 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) ==== 80+0+0 (secure 0 0 0) 0x7f2d040599d0 con 0x7f2d000051d0 2024-09-15T23:56:40.196 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:56:40.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.198+0000 7f2d18c7b640 1 -- 172.21.15.112:0/1855218567 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2cf40678f0 msgr2=0x7f2cf4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:40.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.198+0000 7f2d18c7b640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2cf40678f0 0x7f2cf4069db0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2d140b5d40 tx=0x7f2cfc008040 comp rx=0 tx=0).stop 2024-09-15T23:56:40.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.198+0000 7f2d18c7b640 1 -- 172.21.15.112:0/1855218567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d000051d0 msgr2=0x7f2d140b83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:40.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.198+0000 7f2d18c7b640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d000051d0 0x7f2d140b83c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2d040118a0 tx=0x7f2d04011d60 comp rx=0 tx=0).stop 2024-09-15T23:56:40.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.198+0000 7f2d18c7b640 1 -- 172.21.15.112:0/1855218567 shutdown_connections 2024-09-15T23:56:40.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.198+0000 7f2d18c7b640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2cf40678f0 0x7f2cf4069db0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.198+0000 7f2d18c7b640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d140d10c0 0x7f2d140d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.198+0000 7f2d18c7b640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d14159830 0x7f2d140b9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.198+0000 7f2d18c7b640 1 --2- 172.21.15.112:0/1855218567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d000051d0 0x7f2d140b83c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.198+0000 7f2d18c7b640 1 -- 172.21.15.112:0/1855218567 >> 172.21.15.112:0/1855218567 conn(0x7f2d1408bf90 msgr2=0x7f2d140d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:40.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.198+0000 7f2d18c7b640 1 -- 172.21.15.112:0/1855218567 shutdown_connections 2024-09-15T23:56:40.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.198+0000 7f2d18c7b640 1 -- 172.21.15.112:0/1855218567 wait complete. 2024-09-15T23:56:40.214 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2024-09-15T23:56:40.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:40.215 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:40.226 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[40851]: fuse finished with error 0 and tester_r 0 2024-09-15T23:56:40.227 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:56:40.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:40.227 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:56:40.388 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:56:40.388 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:56:40.388 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:40.394 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:56:40.394 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:56:40.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:40.395 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:56:40.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:56:40.444 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-15T23:56:40.444 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:56:40.444 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:56:40.444 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:40.450 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:56:40.450 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:56:40.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:40.450 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-15T23:56:40.497 INFO:teuthology.orchestra.run.smithi112.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-15T23:56:40.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:56:40.499 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:56:40.499 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:56:40.499 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:40.505 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:56:40.505 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:56:40.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:40.505 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-15T23:56:40.551 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-15T23:56:40.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:56:40.552 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:40.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f46a6353640 1 Processor -- start 2024-09-15T23:56:40.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f46a6353640 1 -- start start 2024-09-15T23:56:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f46a6353640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46a015c2a0 0x7f46a00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f46a6353640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f46a00af2a0 0x7f46a006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f46a6353640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46a00b3290 con 0x7f46a015bec0 2024-09-15T23:56:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f46a6353640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f46a00b3570 con 0x7f46a00af2a0 2024-09-15T23:56:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f46a6353640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f46a00b3850 con 0x7f46a015c2a0 2024-09-15T23:56:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f46a48f0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f46a00af2a0 0x7f46a006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f46a48f0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f46a00af2a0 0x7f46a006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32868/0 (socket says 172.21.15.112:32868) 2024-09-15T23:56:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f46a48f0640 1 -- 172.21.15.112:0/699693899 learned_addr learned my addr 172.21.15.112:0/699693899 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:40.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f4697fff640 1 --2- 172.21.15.112:0/699693899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46a015c2a0 0x7f46a00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:40.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f46a48f0640 1 -- 172.21.15.112:0/699693899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46a015c2a0 msgr2=0x7f46a00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:40.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f46a48f0640 1 --2- 172.21.15.112:0/699693899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46a015c2a0 0x7f46a00aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f46a48f0640 1 -- 172.21.15.112:0/699693899 >> v1:172.21.15.169:6789/0 conn(0x7f46a015bec0 legacy=0x7f46a00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:40.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.678+0000 7f46a48f0640 1 -- 172.21.15.112:0/699693899 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a00b3b30 con 0x7f46a00af2a0 2024-09-15T23:56:40.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a48f0640 1 --2- 172.21.15.112:0/699693899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46a00af2a0 0x7f46a006e000 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4698009e50 tx=0x7f469801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d3f286985faaf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:40.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f469f7fe640 1 -- 172.21.15.112:0/699693899 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46980a58d0 con 0x7f46a00af2a0 2024-09-15T23:56:40.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f469f7fe640 1 -- 172.21.15.112:0/699693899 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46980a5a70 con 0x7f46a00af2a0 2024-09-15T23:56:40.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f469f7fe640 1 -- 172.21.15.112:0/699693899 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46980a5e40 con 0x7f46a00af2a0 2024-09-15T23:56:40.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 -- 172.21.15.112:0/699693899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46a00af2a0 msgr2=0x7f46a006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:40.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 --2- 172.21.15.112:0/699693899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46a00af2a0 0x7f46a006e000 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4698009e50 tx=0x7f469801ca00 comp rx=0 tx=0).stop 2024-09-15T23:56:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 -- 172.21.15.112:0/699693899 shutdown_connections 2024-09-15T23:56:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 --2- 172.21.15.112:0/699693899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46a00af2a0 0x7f46a006e000 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 --2- 172.21.15.112:0/699693899 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46a015c2a0 0x7f46a00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 -- 172.21.15.112:0/699693899 >> 172.21.15.112:0/699693899 conn(0x7f46a00b1f90 msgr2=0x7f46a00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 -- 172.21.15.112:0/699693899 shutdown_connections 2024-09-15T23:56:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 -- 172.21.15.112:0/699693899 wait complete. 2024-09-15T23:56:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 Processor -- start 2024-09-15T23:56:40.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 -- start start 2024-09-15T23:56:40.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46a00af2a0 0x7f46a014c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46a015bec0 0x7f46a01597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46a015c2a0 0x7f46a0159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f46a006ed50 con 0x7f46a015bec0 2024-09-15T23:56:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46a00afc90 con 0x7f46a00af2a0 2024-09-15T23:56:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a6353640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f46a006eed0 con 0x7f46a015c2a0 2024-09-15T23:56:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f4697fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46a015bec0 0x7f46a01597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f4697fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46a015bec0 0x7f46a01597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32880/0 (socket says 172.21.15.112:32880) 2024-09-15T23:56:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f4697fff640 1 -- 172.21.15.112:0/3704362201 learned_addr learned my addr 172.21.15.112:0/3704362201 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a48f0640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46a015c2a0 0x7f46a0159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f469ffff640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46a00af2a0 0x7f46a014c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f4697fff640 1 -- 172.21.15.112:0/3704362201 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46a015c2a0 msgr2=0x7f46a0159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:40.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f4697fff640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46a015c2a0 0x7f46a0159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f4697fff640 1 -- 172.21.15.112:0/3704362201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46a00af2a0 msgr2=0x7f46a014c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f4697fff640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46a00af2a0 0x7f46a014c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f4697fff640 1 -- 172.21.15.112:0/3704362201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a0164100 con 0x7f46a015bec0 2024-09-15T23:56:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f46a48f0640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46a015c2a0 0x7f46a0159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.682+0000 7f4697fff640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46a015bec0 0x7f46a01597f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f468800d5f0 tx=0x7f468800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.686+0000 7f469d7fa640 1 -- 172.21.15.112:0/3704362201 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46880125f0 con 0x7f46a015bec0 2024-09-15T23:56:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.686+0000 7f469d7fa640 1 -- 172.21.15.112:0/3704362201 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4688019070 con 0x7f46a015bec0 2024-09-15T23:56:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.686+0000 7f46a6353640 1 -- 172.21.15.112:0/3704362201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a0164380 con 0x7f46a015bec0 2024-09-15T23:56:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.686+0000 7f469d7fa640 1 -- 172.21.15.112:0/3704362201 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46880129b0 con 0x7f46a015bec0 2024-09-15T23:56:40.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.686+0000 7f46a6353640 1 -- 172.21.15.112:0/3704362201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a0164940 con 0x7f46a015bec0 2024-09-15T23:56:40.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.686+0000 7f46a6353640 1 -- 172.21.15.112:0/3704362201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a006f280 con 0x7f46a015bec0 2024-09-15T23:56:40.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.686+0000 7f469d7fa640 1 -- 172.21.15.112:0/3704362201 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4688012b50 con 0x7f46a015bec0 2024-09-15T23:56:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.686+0000 7f469d7fa640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f46800678c0 0x7f4680069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.686+0000 7f469ffff640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f46800678c0 0x7f4680069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.686+0000 7f469d7fa640 1 -- 172.21.15.112:0/3704362201 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6304+0+0 (secure 0 0 0) 0x7f4688086220 con 0x7f46a015bec0 2024-09-15T23:56:40.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.686+0000 7f469ffff640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f46800678c0 0x7f4680069d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4690001650 tx=0x7f4690009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:40.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.690+0000 7f469d7fa640 1 -- 172.21.15.112:0/3704362201 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f46a0164100 con 0x7f46a015bec0 2024-09-15T23:56:40.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.886+0000 7f46a6353640 1 -- 172.21.15.112:0/3704362201 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46a006fcd0 con 0x7f46a015bec0 2024-09-15T23:56:40.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.886+0000 7f469d7fa640 1 -- 172.21.15.112:0/3704362201 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5233 (secure 0 0 0) 0x7f4688056ba0 con 0x7f46a015bec0 2024-09-15T23:56:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:40.889 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"btime":"2024-09-15T23:56:08:794770+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/442643148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":442643148},{"type":"v1","addr":"172.21.15.169:6833","nonce":442643148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2506338033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2506338033},{"type":"v1","addr":"172.21.15.169:6835","nonce":2506338033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3040445121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3040445121},{"type":"v1","addr":"172.21.15.112:6835","nonce":3040445121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:06.156047+0000","modified":"2024-09-15T23:56:08.141848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/3667278267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3667278267},{"type":"v1","addr":"172.21.15.112:6837","nonce":3667278267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5625,"qdb_cluster":[5625]},"id":4}]} 2024-09-15T23:56:40.889 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 29 2024-09-15T23:56:40.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.890+0000 7f46a6353640 1 -- 172.21.15.112:0/3704362201 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f46800678c0 msgr2=0x7f4680069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:40.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.890+0000 7f46a6353640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f46800678c0 0x7f4680069d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4690001650 tx=0x7f4690009040 comp rx=0 tx=0).stop 2024-09-15T23:56:40.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.890+0000 7f46a6353640 1 -- 172.21.15.112:0/3704362201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46a015bec0 msgr2=0x7f46a01597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:40.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.890+0000 7f46a6353640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46a015bec0 0x7f46a01597f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f468800d5f0 tx=0x7f468800dab0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.890+0000 7f46a6353640 1 -- 172.21.15.112:0/3704362201 shutdown_connections 2024-09-15T23:56:40.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.890+0000 7f46a6353640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f46800678c0 0x7f4680069d80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.890+0000 7f46a6353640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46a015c2a0 0x7f46a0159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.890+0000 7f46a6353640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46a015bec0 0x7f46a01597f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.890+0000 7f46a6353640 1 --2- 172.21.15.112:0/3704362201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46a00af2a0 0x7f46a014c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:40.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.890+0000 7f46a6353640 1 -- 172.21.15.112:0/3704362201 >> 172.21.15.112:0/3704362201 conn(0x7f46a00b1f90 msgr2=0x7f46a00b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:40.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.890+0000 7f46a6353640 1 -- 172.21.15.112:0/3704362201 shutdown_connections 2024-09-15T23:56:40.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:40.890+0000 7f46a6353640 1 -- 172.21.15.112:0/3704362201 wait complete. 2024-09-15T23:56:40.908 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:41.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3ff9ce640 1 Processor -- start 2024-09-15T23:56:41.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3ff9ce640 1 -- start start 2024-09-15T23:56:41.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3ff9ce640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3f815e650 0x7fd3f806dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3ff9ce640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd3f80b4510 0x7fd3f80d19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3ff9ce640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f806e7a0 con 0x7fd3f806e170 2024-09-15T23:56:41.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3ff9ce640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd3f80d1550 con 0x7fd3f80b4510 2024-09-15T23:56:41.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3ff9ce640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f80d0f00 con 0x7fd3f815e650 2024-09-15T23:56:41.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3fdf6b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd3f80b4510 0x7fd3f80d19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3fdf6b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd3f80b4510 0x7fd3f80d19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32888/0 (socket says 172.21.15.112:32888) 2024-09-15T23:56:41.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3fdf6b640 1 -- 172.21.15.112:0/1926465680 learned_addr learned my addr 172.21.15.112:0/1926465680 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:41.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3fcf69640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd3f806e170 0x7fd3f80b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53300/0 (socket says 172.21.15.112:53300) 2024-09-15T23:56:41.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3fd76a640 1 --2- 172.21.15.112:0/1926465680 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3f815e650 0x7fd3f806dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3fdf6b640 1 -- 172.21.15.112:0/1926465680 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3f815e650 msgr2=0x7fd3f806dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:41.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3fdf6b640 1 --2- 172.21.15.112:0/1926465680 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3f815e650 0x7fd3f806dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3fdf6b640 1 -- 172.21.15.112:0/1926465680 >> v1:172.21.15.112:6789/0 conn(0x7fd3f806e170 legacy=0x7fd3f80b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3fdf6b640 1 -- 172.21.15.112:0/1926465680 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f80d11e0 con 0x7fd3f80b4510 2024-09-15T23:56:41.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.026+0000 7fd3f7fff640 1 -- 172.21.15.112:0/1926465680 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985538097 0 0) 0x7fd3f806e7a0 con 0x7fd3f806e170 2024-09-15T23:56:41.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3fdf6b640 1 --2- 172.21.15.112:0/1926465680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3f80b4510 0x7fd3f80d19e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009870 tx=0x7fd3f001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d88fa63e1bb55eb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:41.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3f7fff640 1 -- 172.21.15.112:0/1926465680 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00b2070 con 0x7fd3f80b4510 2024-09-15T23:56:41.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3f7fff640 1 -- 172.21.15.112:0/1926465680 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f00a9070 con 0x7fd3f80b4510 2024-09-15T23:56:41.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3f7fff640 1 -- 172.21.15.112:0/1926465680 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00ad880 con 0x7fd3f80b4510 2024-09-15T23:56:41.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/1926465680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3f80b4510 msgr2=0x7fd3f80d19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 --2- 172.21.15.112:0/1926465680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3f80b4510 0x7fd3f80d19e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009870 tx=0x7fd3f001c560 comp rx=0 tx=0).stop 2024-09-15T23:56:41.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/1926465680 shutdown_connections 2024-09-15T23:56:41.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 --2- 172.21.15.112:0/1926465680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3f80b4510 0x7fd3f80d19e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 --2- 172.21.15.112:0/1926465680 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3f815e650 0x7fd3f806dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/1926465680 >> 172.21.15.112:0/1926465680 conn(0x7fd3f806bcc0 msgr2=0x7fd3f806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:41.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/1926465680 shutdown_connections 2024-09-15T23:56:41.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/1926465680 wait complete. 2024-09-15T23:56:41.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 Processor -- start 2024-09-15T23:56:41.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 -- start start 2024-09-15T23:56:41.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3f806e170 0x7fd3f814ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3f80b4510 0x7fd3f80b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3f815e650 0x7fd3f8156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f80d2ac0 con 0x7fd3f80b4510 2024-09-15T23:56:41.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f80d2940 con 0x7fd3f815e650 2024-09-15T23:56:41.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3ff9ce640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f80d2c40 con 0x7fd3f806e170 2024-09-15T23:56:41.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3fcf69640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3f80b4510 0x7fd3f80b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3fcf69640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3f80b4510 0x7fd3f80b79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32894/0 (socket says 172.21.15.112:32894) 2024-09-15T23:56:41.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3fcf69640 1 -- 172.21.15.112:0/2792677603 learned_addr learned my addr 172.21.15.112:0/2792677603 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.030+0000 7fd3fd76a640 1 --2- 172.21.15.112:0/2792677603 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3f806e170 0x7fd3f814ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3fdf6b640 1 --2- 172.21.15.112:0/2792677603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3f815e650 0x7fd3f8156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3fcf69640 1 -- 172.21.15.112:0/2792677603 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3f806e170 msgr2=0x7fd3f814ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3fcf69640 1 --2- 172.21.15.112:0/2792677603 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3f806e170 0x7fd3f814ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3fcf69640 1 -- 172.21.15.112:0/2792677603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3f815e650 msgr2=0x7fd3f8156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3fcf69640 1 --2- 172.21.15.112:0/2792677603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3f815e650 0x7fd3f8156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3fcf69640 1 -- 172.21.15.112:0/2792677603 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f8155850 con 0x7fd3f80b4510 2024-09-15T23:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3fcf69640 1 --2- 172.21.15.112:0/2792677603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3f80b4510 0x7fd3f80b79b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00c4b0 tx=0x7fd3ec00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3f5ffb640 1 -- 172.21.15.112:0/2792677603 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec018070 con 0x7fd3f80b4510 2024-09-15T23:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3f5ffb640 1 -- 172.21.15.112:0/2792677603 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ec007500 con 0x7fd3f80b4510 2024-09-15T23:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/2792677603 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f80b6910 con 0x7fd3f80b4510 2024-09-15T23:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3f5ffb640 1 -- 172.21.15.112:0/2792677603 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec004a30 con 0x7fd3f80b4510 2024-09-15T23:56:41.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/2792677603 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f80b6ed0 con 0x7fd3f80b4510 2024-09-15T23:56:41.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/2792677603 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f80d19e0 con 0x7fd3f80b4510 2024-09-15T23:56:41.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3f5ffb640 1 -- 172.21.15.112:0/2792677603 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd3ec01b070 con 0x7fd3f80b4510 2024-09-15T23:56:41.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3f5ffb640 1 --2- 172.21.15.112:0/2792677603 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd3e40678c0 0x7fd3e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3f5ffb640 1 -- 172.21.15.112:0/2792677603 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6304+0+0 (secure 0 0 0) 0x7fd3ec085130 con 0x7fd3f80b4510 2024-09-15T23:56:41.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3fd76a640 1 --2- 172.21.15.112:0/2792677603 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd3e40678c0 0x7fd3e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.034+0000 7fd3fd76a640 1 --2- 172.21.15.112:0/2792677603 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd3e40678c0 0x7fd3e4069d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8003fd0 tx=0x7fd3e80039a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:41.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.038+0000 7fd3f5ffb640 1 -- 172.21.15.112:0/2792677603 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd3ec055b70 con 0x7fd3f80b4510 2024-09-15T23:56:41.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.242+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/2792677603 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3f80b1ac0 con 0x7fd3f80b4510 2024-09-15T23:56:41.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.242+0000 7fd3f5ffb640 1 -- 172.21.15.112:0/2792677603 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5233 (secure 0 0 0) 0x7fd3ec055470 con 0x7fd3f80b4510 2024-09-15T23:56:41.246 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:41.246 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"btime":"2024-09-15T23:56:08:794770+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/442643148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":442643148},{"type":"v1","addr":"172.21.15.169:6833","nonce":442643148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2506338033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2506338033},{"type":"v1","addr":"172.21.15.169:6835","nonce":2506338033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3040445121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3040445121},{"type":"v1","addr":"172.21.15.112:6835","nonce":3040445121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:06.156047+0000","modified":"2024-09-15T23:56:08.141848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/3667278267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3667278267},{"type":"v1","addr":"172.21.15.112:6837","nonce":3667278267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5625,"qdb_cluster":[5625]},"id":4}]} 2024-09-15T23:56:41.246 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 29 2024-09-15T23:56:41.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.246+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/2792677603 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd3e40678c0 msgr2=0x7fd3e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.246+0000 7fd3ff9ce640 1 --2- 172.21.15.112:0/2792677603 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd3e40678c0 0x7fd3e4069d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8003fd0 tx=0x7fd3e80039a0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.246+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/2792677603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3f80b4510 msgr2=0x7fd3f80b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.246+0000 7fd3ff9ce640 1 --2- 172.21.15.112:0/2792677603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3f80b4510 0x7fd3f80b79b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00c4b0 tx=0x7fd3ec00c970 comp rx=0 tx=0).stop 2024-09-15T23:56:41.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.246+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/2792677603 shutdown_connections 2024-09-15T23:56:41.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.246+0000 7fd3ff9ce640 1 --2- 172.21.15.112:0/2792677603 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd3e40678c0 0x7fd3e4069d80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.246+0000 7fd3ff9ce640 1 --2- 172.21.15.112:0/2792677603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3f815e650 0x7fd3f8156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.246+0000 7fd3ff9ce640 1 --2- 172.21.15.112:0/2792677603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3f80b4510 0x7fd3f80b79b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.246+0000 7fd3ff9ce640 1 --2- 172.21.15.112:0/2792677603 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3f806e170 0x7fd3f814ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.246+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/2792677603 >> 172.21.15.112:0/2792677603 conn(0x7fd3f806bcc0 msgr2=0x7fd3f806c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:41.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.246+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/2792677603 shutdown_connections 2024-09-15T23:56:41.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.246+0000 7fd3ff9ce640 1 -- 172.21.15.112:0/2792677603 wait complete. 2024-09-15T23:56:41.264 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:41.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55f04ec640 1 Processor -- start 2024-09-15T23:56:41.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55f04ec640 1 -- start start 2024-09-15T23:56:41.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55f04ec640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f55e8160520 0x7f55e8071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55f04ec640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f55e815cd00 0x7f55e8071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55f04ec640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e80d0d70 con 0x7f55e8160900 2024-09-15T23:56:41.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55f04ec640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f55e80d1640 con 0x7f55e815cd00 2024-09-15T23:56:41.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55f04ec640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f55e815d130 con 0x7f55e8160520 2024-09-15T23:56:41.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55eea89640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f55e815cd00 0x7f55e8071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55eda87640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f55e8160900 0x7f55e815c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53302/0 (socket says 172.21.15.112:53302) 2024-09-15T23:56:41.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55eda87640 1 -- 172.21.15.112:0/3930508970 learned_addr learned my addr 172.21.15.112:0/3930508970 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:41.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55ee288640 1 --2- 172.21.15.112:0/3930508970 >> v2:172.21.15.169:3300/0 conn(0x7f55e8160520 0x7f55e8071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55eea89640 1 -- 172.21.15.112:0/3930508970 >> v2:172.21.15.169:3300/0 conn(0x7f55e8160520 msgr2=0x7f55e8071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:41.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55eea89640 1 --2- 172.21.15.112:0/3930508970 >> v2:172.21.15.169:3300/0 conn(0x7f55e8160520 0x7f55e8071750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55eea89640 1 -- 172.21.15.112:0/3930508970 >> v1:172.21.15.112:6789/0 conn(0x7f55e8160900 legacy=0x7f55e815c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55eea89640 1 -- 172.21.15.112:0/3930508970 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e815d390 con 0x7f55e815cd00 2024-09-15T23:56:41.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.382+0000 7f55ed286640 1 -- 172.21.15.112:0/3930508970 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003534166 0 0) 0x7f55d8001120 con 0x7f55e8160900 2024-09-15T23:56:41.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55eea89640 1 --2- 172.21.15.112:0/3930508970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55e815cd00 0x7f55e8071c90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f55e80d3220 tx=0x7f55e001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1adbfdd2567a738d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:41.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55ed286640 1 -- 172.21.15.112:0/3930508970 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e00b2070 con 0x7f55e815cd00 2024-09-15T23:56:41.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55ed286640 1 -- 172.21.15.112:0/3930508970 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e00a5870 con 0x7f55e815cd00 2024-09-15T23:56:41.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55ed286640 1 -- 172.21.15.112:0/3930508970 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e00a5c40 con 0x7f55e815cd00 2024-09-15T23:56:41.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 -- 172.21.15.112:0/3930508970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55e815cd00 msgr2=0x7f55e8071c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 --2- 172.21.15.112:0/3930508970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55e815cd00 0x7f55e8071c90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f55e80d3220 tx=0x7f55e001c8a0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 -- 172.21.15.112:0/3930508970 shutdown_connections 2024-09-15T23:56:41.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 --2- 172.21.15.112:0/3930508970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55e815cd00 0x7f55e8071c90 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 --2- 172.21.15.112:0/3930508970 >> v2:172.21.15.169:3300/0 conn(0x7f55e8160520 0x7f55e8071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 -- 172.21.15.112:0/3930508970 >> 172.21.15.112:0/3930508970 conn(0x7f55e806c0c0 msgr2=0x7f55e806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:41.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 -- 172.21.15.112:0/3930508970 shutdown_connections 2024-09-15T23:56:41.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 -- 172.21.15.112:0/3930508970 wait complete. 2024-09-15T23:56:41.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 Processor -- start 2024-09-15T23:56:41.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 -- start start 2024-09-15T23:56:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55e815cd00 0x7f55e80b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55e8160520 0x7f55e813e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55e8160900 0x7f55e813ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f55e8141190 con 0x7f55e8160900 2024-09-15T23:56:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f55e80d2ae0 con 0x7f55e8160520 2024-09-15T23:56:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55f04ec640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f55e8141310 con 0x7f55e815cd00 2024-09-15T23:56:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55eea89640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55e8160900 0x7f55e813ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55eea89640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55e8160900 0x7f55e813ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32914/0 (socket says 172.21.15.112:32914) 2024-09-15T23:56:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.386+0000 7f55eea89640 1 -- 172.21.15.112:0/860071978 learned_addr learned my addr 172.21.15.112:0/860071978 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:41.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55ee288640 1 --2- 172.21.15.112:0/860071978 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55e815cd00 0x7f55e80b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55eda87640 1 --2- 172.21.15.112:0/860071978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55e8160520 0x7f55e813e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55eea89640 1 -- 172.21.15.112:0/860071978 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55e815cd00 msgr2=0x7f55e80b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55eea89640 1 --2- 172.21.15.112:0/860071978 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55e815cd00 0x7f55e80b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55eea89640 1 -- 172.21.15.112:0/860071978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55e8160520 msgr2=0x7f55e813e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55eea89640 1 --2- 172.21.15.112:0/860071978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55e8160520 0x7f55e813e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55eea89640 1 -- 172.21.15.112:0/860071978 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e8154370 con 0x7f55e8160900 2024-09-15T23:56:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55eea89640 1 --2- 172.21.15.112:0/860071978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55e8160900 0x7f55e813ed00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f55e00b0040 tx=0x7f55e0019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55deffd640 1 -- 172.21.15.112:0/860071978 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e00b2050 con 0x7f55e8160900 2024-09-15T23:56:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55deffd640 1 -- 172.21.15.112:0/860071978 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e00be070 con 0x7f55e8160900 2024-09-15T23:56:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55f04ec640 1 -- 172.21.15.112:0/860071978 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e8154650 con 0x7f55e8160900 2024-09-15T23:56:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55deffd640 1 -- 172.21.15.112:0/860071978 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e00ada90 con 0x7f55e8160900 2024-09-15T23:56:41.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55f04ec640 1 -- 172.21.15.112:0/860071978 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e8154c10 con 0x7f55e8160900 2024-09-15T23:56:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55f04ec640 1 -- 172.21.15.112:0/860071978 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e815c5f0 con 0x7f55e8160900 2024-09-15T23:56:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55deffd640 1 -- 172.21.15.112:0/860071978 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f55e00adc30 con 0x7f55e8160900 2024-09-15T23:56:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55deffd640 1 --2- 172.21.15.112:0/860071978 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f55cc0678c0 0x7f55cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55deffd640 1 -- 172.21.15.112:0/860071978 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6304+0+0 (secure 0 0 0) 0x7f55e0120fb0 con 0x7f55e8160900 2024-09-15T23:56:41.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55ee288640 1 --2- 172.21.15.112:0/860071978 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f55cc0678c0 0x7f55cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.390+0000 7f55ee288640 1 --2- 172.21.15.112:0/860071978 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f55cc0678c0 0x7f55cc069d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f55e400b9d0 tx=0x7f55e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:41.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.394+0000 7f55deffd640 1 -- 172.21.15.112:0/860071978 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f55e0016520 con 0x7f55e8160900 2024-09-15T23:56:41.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.554+0000 7f55f04ec640 1 -- 172.21.15.112:0/860071978 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55e8140710 con 0x7f55e8160900 2024-09-15T23:56:41.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.558+0000 7f55deffd640 1 -- 172.21.15.112:0/860071978 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+17341 (secure 0 0 0) 0x7f55e00ab340 con 0x7f55e8160900 2024-09-15T23:56:41.558 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:41.559 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:56:33.366131+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:04.716518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:05.136871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.2","mappings":[{"from":2,"to":7}]},{"pgid":"10.10","mappings":[{"from":2,"to":7}]},{"pgid":"10.1b","mappings":[{"from":2,"to":1}]},{"pgid":"10.2c","mappings":[{"from":4,"to":1}]},{"pgid":"10.34","mappings":[{"from":2,"to":5}]},{"pgid":"10.38","mappings":[{"from":2,"to":5}]},{"pgid":"10.3c","mappings":[{"from":2,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:41.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.558+0000 7f55f04ec640 1 -- 172.21.15.112:0/860071978 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f55cc0678c0 msgr2=0x7f55cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.558+0000 7f55f04ec640 1 --2- 172.21.15.112:0/860071978 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f55cc0678c0 0x7f55cc069d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f55e400b9d0 tx=0x7f55e4008040 comp rx=0 tx=0).stop 2024-09-15T23:56:41.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.558+0000 7f55f04ec640 1 -- 172.21.15.112:0/860071978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55e8160900 msgr2=0x7f55e813ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.558+0000 7f55f04ec640 1 --2- 172.21.15.112:0/860071978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55e8160900 0x7f55e813ed00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f55e00b0040 tx=0x7f55e0019640 comp rx=0 tx=0).stop 2024-09-15T23:56:41.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.558+0000 7f55f04ec640 1 -- 172.21.15.112:0/860071978 shutdown_connections 2024-09-15T23:56:41.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.558+0000 7f55f04ec640 1 --2- 172.21.15.112:0/860071978 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f55cc0678c0 0x7f55cc069d80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.558+0000 7f55f04ec640 1 --2- 172.21.15.112:0/860071978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f55e8160900 0x7f55e813ed00 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.558+0000 7f55f04ec640 1 --2- 172.21.15.112:0/860071978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55e8160520 0x7f55e813e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.558+0000 7f55f04ec640 1 --2- 172.21.15.112:0/860071978 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55e815cd00 0x7f55e80b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.558+0000 7f55f04ec640 1 -- 172.21.15.112:0/860071978 >> 172.21.15.112:0/860071978 conn(0x7f55e806c0c0 msgr2=0x7f55e81671a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:41.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.558+0000 7f55f04ec640 1 -- 172.21.15.112:0/860071978 shutdown_connections 2024-09-15T23:56:41.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.558+0000 7f55f04ec640 1 -- 172.21.15.112:0/860071978 wait complete. 2024-09-15T23:56:41.577 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:56:41.577 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:41.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.682+0000 7fe126517640 1 Processor -- start 2024-09-15T23:56:41.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.682+0000 7fe126517640 1 -- start start 2024-09-15T23:56:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe126517640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1200adad0 0x7fe12015f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe126517640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1200af300 con 0x7fe1200aee70 2024-09-15T23:56:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe126517640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1200af5e0 con 0x7fe120155450 2024-09-15T23:56:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe126517640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe1200af8c0 con 0x7fe1200adad0 2024-09-15T23:56:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11f7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe1200aee70 0x7fe120154d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53318/0 (socket says 172.21.15.112:53318) 2024-09-15T23:56:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11f7fe640 1 -- 172.21.15.112:0/20158566 learned_addr learned my addr 172.21.15.112:0/20158566 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11ffff640 1 --2- 172.21.15.112:0/20158566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1200adad0 0x7fe12015f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 -- 172.21.15.112:0/20158566 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3943574016 0 0) 0x7fe1200af300 con 0x7fe1200aee70 2024-09-15T23:56:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 -- 172.21.15.112:0/20158566 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe10c003530 con 0x7fe1200aee70 2024-09-15T23:56:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 -- 172.21.15.112:0/20158566 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2193976517 0 0) 0x7fe10c003530 con 0x7fe1200aee70 2024-09-15T23:56:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 -- 172.21.15.112:0/20158566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1200adad0 msgr2=0x7fe12015f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 --2- 172.21.15.112:0/20158566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1200adad0 0x7fe12015f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 -- 172.21.15.112:0/20158566 >> v1:172.21.15.169:6789/0 conn(0x7fe120155450 legacy=0x7fe1200cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 -- 172.21.15.112:0/20158566 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1200afba0 con 0x7fe1200aee70 2024-09-15T23:56:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 -- 172.21.15.112:0/20158566 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fe110001a00 con 0x7fe1200aee70 2024-09-15T23:56:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 -- 172.21.15.112:0/20158566 >> v1:172.21.15.112:6789/0 conn(0x7fe1200aee70 legacy=0x7fe120154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 --2- 172.21.15.112:0/20158566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe10c0039f0 0x7fe10c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 --2- 172.21.15.112:0/20158566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1200adad0 0x7fe10c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 --2- 172.21.15.112:0/20158566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe10c004d50 0x7fe10c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 -- 172.21.15.112:0/20158566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe1200af8c0 con 0x7fe10c004d50 2024-09-15T23:56:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 -- 172.21.15.112:0/20158566 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c00ba80 con 0x7fe10c0039f0 2024-09-15T23:56:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11effd640 1 -- 172.21.15.112:0/20158566 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe10c00bc80 con 0x7fe1200adad0 2024-09-15T23:56:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe124ab4640 1 --2- 172.21.15.112:0/20158566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe10c004d50 0x7fe10c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11f7fe640 1 --2- 172.21.15.112:0/20158566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1200adad0 0x7fe10c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe11ffff640 1 --2- 172.21.15.112:0/20158566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe10c0039f0 0x7fe10c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe124ab4640 1 -- 172.21.15.112:0/20158566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1200adad0 msgr2=0x7fe10c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe124ab4640 1 --2- 172.21.15.112:0/20158566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1200adad0 0x7fe10c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe124ab4640 1 -- 172.21.15.112:0/20158566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe10c0039f0 msgr2=0x7fe10c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe124ab4640 1 --2- 172.21.15.112:0/20158566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe10c0039f0 0x7fe10c003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.686+0000 7fe124ab4640 1 -- 172.21.15.112:0/20158566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10c003530 con 0x7fe10c004d50 2024-09-15T23:56:41.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe124ab4640 1 --2- 172.21.15.112:0/20158566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe10c004d50 0x7fe10c0051d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe108001750 tx=0x7fe10801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0a89ec93a18c92 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:41.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe11effd640 1 -- 172.21.15.112:0/20158566 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1080013a0 con 0x7fe10c004d50 2024-09-15T23:56:41.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe11effd640 1 -- 172.21.15.112:0/20158566 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1080052f0 con 0x7fe10c004d50 2024-09-15T23:56:41.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe11effd640 1 -- 172.21.15.112:0/20158566 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108003840 con 0x7fe10c004d50 2024-09-15T23:56:41.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe126517640 1 -- 172.21.15.112:0/20158566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe10c004d50 msgr2=0x7fe10c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe126517640 1 --2- 172.21.15.112:0/20158566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe10c004d50 0x7fe10c0051d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe108001750 tx=0x7fe10801c3e0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe124ab4640 1 -- 172.21.15.112:0/20158566 reap_dead start 2024-09-15T23:56:41.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe126517640 1 -- 172.21.15.112:0/20158566 shutdown_connections 2024-09-15T23:56:41.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe126517640 1 -- 172.21.15.112:0/20158566 >> 172.21.15.112:0/20158566 conn(0x7fe1200736d0 msgr2=0x7fe12006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:41.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe126517640 1 -- 172.21.15.112:0/20158566 shutdown_connections 2024-09-15T23:56:41.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe126517640 1 -- 172.21.15.112:0/20158566 wait complete. 2024-09-15T23:56:41.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe126517640 1 Processor -- start 2024-09-15T23:56:41.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe126517640 1 -- start start 2024-09-15T23:56:41.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe126517640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1201f7b60 0x7fe1201f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe126517640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe120159890 0x7fe1201f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe126517640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe120142620 0x7fe120142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe126517640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe120067c00 con 0x7fe120142620 2024-09-15T23:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe126517640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe12006f870 con 0x7fe1201f7b60 2024-09-15T23:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe126517640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe1200b03a0 con 0x7fe120159890 2024-09-15T23:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe124ab4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe120142620 0x7fe120142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe124ab4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe120142620 0x7fe120142a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32936/0 (socket says 172.21.15.112:32936) 2024-09-15T23:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe124ab4640 1 -- 172.21.15.112:0/3896665 learned_addr learned my addr 172.21.15.112:0/3896665 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe11f7fe640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe120159890 0x7fe1201f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe11ffff640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1201f7b60 0x7fe1201f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe124ab4640 1 -- 172.21.15.112:0/3896665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe120159890 msgr2=0x7fe1201f8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe124ab4640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe120159890 0x7fe1201f8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe124ab4640 1 -- 172.21.15.112:0/3896665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1201f7b60 msgr2=0x7fe1201f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe124ab4640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1201f7b60 0x7fe1201f7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe124ab4640 1 -- 172.21.15.112:0/3896665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe120142fc0 con 0x7fe120142620 2024-09-15T23:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.690+0000 7fe11ffff640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1201f7b60 0x7fe1201f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.694+0000 7fe124ab4640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe120142620 0x7fe120142a80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe108005040 tx=0x7fe10c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.694+0000 7fe11cff9640 1 -- 172.21.15.112:0/3896665 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1080013a0 con 0x7fe120142620 2024-09-15T23:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.694+0000 7fe11cff9640 1 -- 172.21.15.112:0/3896665 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1080054a0 con 0x7fe120142620 2024-09-15T23:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.694+0000 7fe126517640 1 -- 172.21.15.112:0/3896665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe120159da0 con 0x7fe120142620 2024-09-15T23:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.694+0000 7fe11cff9640 1 -- 172.21.15.112:0/3896665 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108007a40 con 0x7fe120142620 2024-09-15T23:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.694+0000 7fe126517640 1 -- 172.21.15.112:0/3896665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe12015a360 con 0x7fe120142620 2024-09-15T23:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.694+0000 7fe126517640 1 -- 172.21.15.112:0/3896665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1200adeb0 con 0x7fe120142620 2024-09-15T23:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.694+0000 7fe11cff9640 1 -- 172.21.15.112:0/3896665 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1080bb020 con 0x7fe120142620 2024-09-15T23:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.694+0000 7fe11cff9640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe1000678f0 0x7fe100069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.694+0000 7fe11cff9640 1 -- 172.21.15.112:0/3896665 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6304+0+0 (secure 0 0 0) 0x7fe10811fa60 con 0x7fe120142620 2024-09-15T23:56:41.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.694+0000 7fe11ffff640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe1000678f0 0x7fe100069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:41.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.694+0000 7fe11ffff640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe1000678f0 0x7fe100069db0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe118009a00 tx=0x7fe118008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:41.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.698+0000 7fe11cff9640 1 -- 172.21.15.112:0/3896665 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe1080c2020 con 0x7fe120142620 2024-09-15T23:56:41.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.894+0000 7fe126517640 1 -- 172.21.15.112:0/3896665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe12015a5a0 con 0x7fe120142620 2024-09-15T23:56:41.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.894+0000 7fe11cff9640 1 -- 172.21.15.112:0/3896665 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5233 (secure 0 0 0) 0x7fe1080160f0 con 0x7fe120142620 2024-09-15T23:56:41.896 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:41.896 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"btime":"2024-09-15T23:56:08:794770+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/442643148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":442643148},{"type":"v1","addr":"172.21.15.169:6833","nonce":442643148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2506338033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2506338033},{"type":"v1","addr":"172.21.15.169:6835","nonce":2506338033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3040445121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3040445121},{"type":"v1","addr":"172.21.15.112:6835","nonce":3040445121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:06.156047+0000","modified":"2024-09-15T23:56:08.141848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/3667278267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3667278267},{"type":"v1","addr":"172.21.15.112:6837","nonce":3667278267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5625,"qdb_cluster":[5625]},"id":4}]} 2024-09-15T23:56:41.896 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 29 2024-09-15T23:56:41.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.898+0000 7fe126517640 1 -- 172.21.15.112:0/3896665 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe1000678f0 msgr2=0x7fe100069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.898+0000 7fe126517640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe1000678f0 0x7fe100069db0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe118009a00 tx=0x7fe118008040 comp rx=0 tx=0).stop 2024-09-15T23:56:41.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.898+0000 7fe126517640 1 -- 172.21.15.112:0/3896665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe120142620 msgr2=0x7fe120142a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:41.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.898+0000 7fe126517640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe120142620 0x7fe120142a80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe108005040 tx=0x7fe10c005840 comp rx=0 tx=0).stop 2024-09-15T23:56:41.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.898+0000 7fe126517640 1 -- 172.21.15.112:0/3896665 shutdown_connections 2024-09-15T23:56:41.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.898+0000 7fe126517640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe1000678f0 0x7fe100069db0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.898+0000 7fe126517640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe120142620 0x7fe120142a80 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.898+0000 7fe126517640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe120159890 0x7fe1201f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.898+0000 7fe126517640 1 --2- 172.21.15.112:0/3896665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1201f7b60 0x7fe1201f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:41.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.898+0000 7fe126517640 1 -- 172.21.15.112:0/3896665 >> 172.21.15.112:0/3896665 conn(0x7fe1200736d0 msgr2=0x7fe1200b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:41.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.898+0000 7fe126517640 1 -- 172.21.15.112:0/3896665 shutdown_connections 2024-09-15T23:56:41.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:41.898+0000 7fe126517640 1 -- 172.21.15.112:0/3896665 wait complete. 2024-09-15T23:56:41.913 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:42.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.018+0000 7f805e34e640 1 Processor -- start 2024-09-15T23:56:42.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.018+0000 7f805e34e640 1 -- start start 2024-09-15T23:56:42.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f805e34e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f805815bec0 0x7f80580ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f805e34e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f80580af470 0x7f805806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f805e34e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80580b3290 con 0x7f805815c2a0 2024-09-15T23:56:42.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f805e34e640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f80580b3570 con 0x7f80580af470 2024-09-15T23:56:42.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f805e34e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f80580b3850 con 0x7f805815bec0 2024-09-15T23:56:42.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f805c8eb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f80580af470 0x7f805806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f805c8eb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f80580af470 0x7f805806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32940/0 (socket says 172.21.15.112:32940) 2024-09-15T23:56:42.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f805c8eb640 1 -- 172.21.15.112:0/2396416937 learned_addr learned my addr 172.21.15.112:0/2396416937 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:42.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f8057fff640 1 --2- 172.21.15.112:0/2396416937 >> v2:172.21.15.169:3300/0 conn(0x7f805815bec0 0x7f80580ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f805c8eb640 1 -- 172.21.15.112:0/2396416937 >> v2:172.21.15.169:3300/0 conn(0x7f805815bec0 msgr2=0x7f80580ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:42.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f805c8eb640 1 --2- 172.21.15.112:0/2396416937 >> v2:172.21.15.169:3300/0 conn(0x7f805815bec0 0x7f80580ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f805c8eb640 1 -- 172.21.15.112:0/2396416937 >> v1:172.21.15.169:6789/0 conn(0x7f805815c2a0 legacy=0x7f80580aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:42.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f805c8eb640 1 -- 172.21.15.112:0/2396416937 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80580b3b30 con 0x7f80580af470 2024-09-15T23:56:42.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f8057fff640 1 --2- 172.21.15.112:0/2396416937 >> v2:172.21.15.169:3300/0 conn(0x7f805815bec0 0x7f80580ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:42.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f805c8eb640 1 --2- 172.21.15.112:0/2396416937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80580af470 0x7f805806e000 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8058071710 tx=0x7f805001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7adb2f1dacb0e16 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:42.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f80577fe640 1 -- 172.21.15.112:0/2396416937 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80500a5840 con 0x7f80580af470 2024-09-15T23:56:42.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f80577fe640 1 -- 172.21.15.112:0/2396416937 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80500a59e0 con 0x7f80580af470 2024-09-15T23:56:42.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.022+0000 7f80577fe640 1 -- 172.21.15.112:0/2396416937 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80500a5db0 con 0x7f80580af470 2024-09-15T23:56:42.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 -- 172.21.15.112:0/2396416937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80580af470 msgr2=0x7f805806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 --2- 172.21.15.112:0/2396416937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80580af470 0x7f805806e000 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8058071710 tx=0x7f805001c980 comp rx=0 tx=0).stop 2024-09-15T23:56:42.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 -- 172.21.15.112:0/2396416937 shutdown_connections 2024-09-15T23:56:42.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 --2- 172.21.15.112:0/2396416937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80580af470 0x7f805806e000 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 --2- 172.21.15.112:0/2396416937 >> v2:172.21.15.169:3300/0 conn(0x7f805815bec0 0x7f80580ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 -- 172.21.15.112:0/2396416937 >> 172.21.15.112:0/2396416937 conn(0x7f80580b1f90 msgr2=0x7f80580b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:42.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 -- 172.21.15.112:0/2396416937 shutdown_connections 2024-09-15T23:56:42.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 -- 172.21.15.112:0/2396416937 wait complete. 2024-09-15T23:56:42.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 Processor -- start 2024-09-15T23:56:42.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 -- start start 2024-09-15T23:56:42.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580af470 0x7f805815c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f805815bec0 0x7f80580b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f805815c2a0 0x7f805814a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f805806ed50 con 0x7f805815c2a0 2024-09-15T23:56:42.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f80580ad740 con 0x7f80580af470 2024-09-15T23:56:42.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f805806eed0 con 0x7f805815bec0 2024-09-15T23:56:42.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805c8eb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f805815c2a0 0x7f805814a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805c8eb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f805815c2a0 0x7f805814a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32942/0 (socket says 172.21.15.112:32942) 2024-09-15T23:56:42.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805c8eb640 1 -- 172.21.15.112:0/2905078859 learned_addr learned my addr 172.21.15.112:0/2905078859 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:42.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f8057fff640 1 --2- 172.21.15.112:0/2905078859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580af470 0x7f805815c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805c8eb640 1 -- 172.21.15.112:0/2905078859 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f805815bec0 msgr2=0x7f80580b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f804ffff640 1 --2- 172.21.15.112:0/2905078859 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f805815bec0 0x7f80580b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805c8eb640 1 --2- 172.21.15.112:0/2905078859 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f805815bec0 0x7f80580b0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805c8eb640 1 -- 172.21.15.112:0/2905078859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580af470 msgr2=0x7f805815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805c8eb640 1 --2- 172.21.15.112:0/2905078859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580af470 0x7f805815c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805c8eb640 1 -- 172.21.15.112:0/2905078859 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80581f4f90 con 0x7f805815c2a0 2024-09-15T23:56:42.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805c8eb640 1 --2- 172.21.15.112:0/2905078859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f805815c2a0 0x7f805814a3e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f805001a5b0 tx=0x7f8050019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:42.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f80557fa640 1 -- 172.21.15.112:0/2905078859 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80500bc020 con 0x7f805815c2a0 2024-09-15T23:56:42.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f80557fa640 1 -- 172.21.15.112:0/2905078859 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80500b8880 con 0x7f805815c2a0 2024-09-15T23:56:42.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f80557fa640 1 -- 172.21.15.112:0/2905078859 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80500b8c70 con 0x7f805815c2a0 2024-09-15T23:56:42.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 -- 172.21.15.112:0/2905078859 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8058153c40 con 0x7f805815c2a0 2024-09-15T23:56:42.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.026+0000 7f805e34e640 1 -- 172.21.15.112:0/2905078859 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8058154200 con 0x7f805815c2a0 2024-09-15T23:56:42.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.030+0000 7f805e34e640 1 -- 172.21.15.112:0/2905078859 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f805806f260 con 0x7f805815c2a0 2024-09-15T23:56:42.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.030+0000 7f80557fa640 1 -- 172.21.15.112:0/2905078859 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f80500bf020 con 0x7f805815c2a0 2024-09-15T23:56:42.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.030+0000 7f80557fa640 1 --2- 172.21.15.112:0/2905078859 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f80380678c0 0x7f8038069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.030+0000 7f8057fff640 1 --2- 172.21.15.112:0/2905078859 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f80380678c0 0x7f8038069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.030+0000 7f80557fa640 1 -- 172.21.15.112:0/2905078859 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6304+0+0 (secure 0 0 0) 0x7f8050121110 con 0x7f805815c2a0 2024-09-15T23:56:42.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.030+0000 7f8057fff640 1 --2- 172.21.15.112:0/2905078859 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f80380678c0 0x7f8038069d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f804800a9a0 tx=0x7f8048008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:42.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.034+0000 7f80557fa640 1 -- 172.21.15.112:0/2905078859 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f80500c6030 con 0x7f805815c2a0 2024-09-15T23:56:42.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.226+0000 7f805e34e640 1 -- 172.21.15.112:0/2905078859 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f805806fcd0 con 0x7f805815c2a0 2024-09-15T23:56:42.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.226+0000 7f80557fa640 1 -- 172.21.15.112:0/2905078859 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5233 (secure 0 0 0) 0x7f80500165a0 con 0x7f805815c2a0 2024-09-15T23:56:42.227 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:42.227 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":29,"btime":"2024-09-15T23:56:08:794770+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/442643148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":442643148},{"type":"v1","addr":"172.21.15.169:6833","nonce":442643148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2506338033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2506338033},{"type":"v1","addr":"172.21.15.169:6835","nonce":2506338033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3040445121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3040445121},{"type":"v1","addr":"172.21.15.112:6835","nonce":3040445121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:06.156047+0000","modified":"2024-09-15T23:56:08.141848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5625},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5625":{"gid":5625,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/3667278267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3667278267},{"type":"v1","addr":"172.21.15.112:6837","nonce":3667278267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5625,"qdb_cluster":[5625]},"id":4}]} 2024-09-15T23:56:42.227 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 29 2024-09-15T23:56:42.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.230+0000 7f805e34e640 1 -- 172.21.15.112:0/2905078859 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f80380678c0 msgr2=0x7f8038069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.230+0000 7f805e34e640 1 --2- 172.21.15.112:0/2905078859 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f80380678c0 0x7f8038069d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f804800a9a0 tx=0x7f8048008040 comp rx=0 tx=0).stop 2024-09-15T23:56:42.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.230+0000 7f805e34e640 1 -- 172.21.15.112:0/2905078859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f805815c2a0 msgr2=0x7f805814a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.230+0000 7f805e34e640 1 --2- 172.21.15.112:0/2905078859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f805815c2a0 0x7f805814a3e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f805001a5b0 tx=0x7f8050019720 comp rx=0 tx=0).stop 2024-09-15T23:56:42.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.230+0000 7f805e34e640 1 -- 172.21.15.112:0/2905078859 shutdown_connections 2024-09-15T23:56:42.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.230+0000 7f805e34e640 1 --2- 172.21.15.112:0/2905078859 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f80380678c0 0x7f8038069d80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.230+0000 7f805e34e640 1 --2- 172.21.15.112:0/2905078859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f805815c2a0 0x7f805814a3e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.230+0000 7f805e34e640 1 --2- 172.21.15.112:0/2905078859 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f805815bec0 0x7f80580b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.230+0000 7f805e34e640 1 --2- 172.21.15.112:0/2905078859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580af470 0x7f805815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.230+0000 7f805e34e640 1 -- 172.21.15.112:0/2905078859 >> 172.21.15.112:0/2905078859 conn(0x7f80580b1f90 msgr2=0x7f805814fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:42.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.230+0000 7f805e34e640 1 -- 172.21.15.112:0/2905078859 shutdown_connections 2024-09-15T23:56:42.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.230+0000 7f805e34e640 1 -- 172.21.15.112:0/2905078859 wait complete. 2024-09-15T23:56:42.245 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:42.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.350+0000 7fe9347b7640 1 Processor -- start 2024-09-15T23:56:42.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.350+0000 7fe9347b7640 1 -- start start 2024-09-15T23:56:42.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe9347b7640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe92c0b39a0 0x7fe92c06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe9347b7640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe92c06ec60 con 0x7fe92c1587a0 2024-09-15T23:56:42.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe9347b7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe92c06ef40 con 0x7fe92c06e4b0 2024-09-15T23:56:42.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe9347b7640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe92c06f870 con 0x7fe92c0b39a0 2024-09-15T23:56:42.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe932553640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe92c1587a0 0x7fe92c0b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53330/0 (socket says 172.21.15.112:53330) 2024-09-15T23:56:42.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe932553640 1 -- 172.21.15.112:0/2153353917 learned_addr learned my addr 172.21.15.112:0/2153353917 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:42.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe931d52640 1 --2- 172.21.15.112:0/2153353917 >> v2:172.21.15.112:3300/0 conn(0x7fe92c0b39a0 0x7fe92c06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe931d52640 1 -- 172.21.15.112:0/2153353917 >> v1:172.21.15.169:6789/0 conn(0x7fe92c06e4b0 legacy=0x7fe92c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:42.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe931d52640 1 -- 172.21.15.112:0/2153353917 >> v1:172.21.15.112:6789/0 conn(0x7fe92c1587a0 legacy=0x7fe92c0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe931d52640 1 -- 172.21.15.112:0/2153353917 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92c06f220 con 0x7fe92c0b39a0 2024-09-15T23:56:42.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe931551640 1 -- 172.21.15.112:0/2153353917 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2621149532 0 0) 0x7fe92c06ec60 con 0x7fe92c1587a0 2024-09-15T23:56:42.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe931d52640 1 --2- 172.21.15.112:0/2153353917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe92c0b39a0 0x7fe92c06df70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe92c06f9f0 tx=0x7fe91c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9723df138b87dcb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:42.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe931551640 1 -- 172.21.15.112:0/2153353917 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0b1070 con 0x7fe92c0b39a0 2024-09-15T23:56:42.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe931551640 1 -- 172.21.15.112:0/2153353917 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91c0ac620 con 0x7fe92c0b39a0 2024-09-15T23:56:42.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe931551640 1 -- 172.21.15.112:0/2153353917 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0ac9f0 con 0x7fe92c0b39a0 2024-09-15T23:56:42.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe9347b7640 1 -- 172.21.15.112:0/2153353917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe92c0b39a0 msgr2=0x7fe92c06df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe9347b7640 1 --2- 172.21.15.112:0/2153353917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe92c0b39a0 0x7fe92c06df70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe92c06f9f0 tx=0x7fe91c01c430 comp rx=0 tx=0).stop 2024-09-15T23:56:42.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe9347b7640 1 -- 172.21.15.112:0/2153353917 shutdown_connections 2024-09-15T23:56:42.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe9347b7640 1 --2- 172.21.15.112:0/2153353917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe92c0b39a0 0x7fe92c06df70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe9347b7640 1 -- 172.21.15.112:0/2153353917 >> 172.21.15.112:0/2153353917 conn(0x7fe92c0b1f90 msgr2=0x7fe92c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:42.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe9347b7640 1 -- 172.21.15.112:0/2153353917 shutdown_connections 2024-09-15T23:56:42.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.354+0000 7fe9347b7640 1 -- 172.21.15.112:0/2153353917 wait complete. 2024-09-15T23:56:42.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe9347b7640 1 Processor -- start 2024-09-15T23:56:42.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe9347b7640 1 -- start start 2024-09-15T23:56:42.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe9347b7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe92c06e4b0 0x7fe92c099840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe9347b7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe92c0b39a0 0x7fe92c142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe9347b7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe92c1587a0 0x7fe92c09b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe9347b7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c073200 con 0x7fe92c06e4b0 2024-09-15T23:56:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe9347b7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c073080 con 0x7fe92c0b39a0 2024-09-15T23:56:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe9347b7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe92c073380 con 0x7fe92c1587a0 2024-09-15T23:56:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe932553640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe92c06e4b0 0x7fe92c099840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe932553640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe92c06e4b0 0x7fe92c099840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32962/0 (socket says 172.21.15.112:32962) 2024-09-15T23:56:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe932553640 1 -- 172.21.15.112:0/1918897274 learned_addr learned my addr 172.21.15.112:0/1918897274 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe931d52640 1 --2- 172.21.15.112:0/1918897274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe92c0b39a0 0x7fe92c142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe932553640 1 -- 172.21.15.112:0/1918897274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe92c1587a0 msgr2=0x7fe92c09b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe932553640 1 --2- 172.21.15.112:0/1918897274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe92c1587a0 0x7fe92c09b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe932553640 1 -- 172.21.15.112:0/1918897274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe92c0b39a0 msgr2=0x7fe92c142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe932553640 1 --2- 172.21.15.112:0/1918897274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe92c0b39a0 0x7fe92c142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe932553640 1 -- 172.21.15.112:0/1918897274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92c141b30 con 0x7fe92c06e4b0 2024-09-15T23:56:42.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe931d52640 1 --2- 172.21.15.112:0/1918897274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe92c0b39a0 0x7fe92c142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:42.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe932553640 1 --2- 172.21.15.112:0/1918897274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe92c06e4b0 0x7fe92c099840 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe92800c480 tx=0x7fe92800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:42.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe922ffd640 1 -- 172.21.15.112:0/1918897274 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe928018070 con 0x7fe92c06e4b0 2024-09-15T23:56:42.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe922ffd640 1 -- 172.21.15.112:0/1918897274 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe928007500 con 0x7fe92c06e4b0 2024-09-15T23:56:42.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe9347b7640 1 -- 172.21.15.112:0/1918897274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe92c141e10 con 0x7fe92c06e4b0 2024-09-15T23:56:42.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe922ffd640 1 -- 172.21.15.112:0/1918897274 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe928004a30 con 0x7fe92c06e4b0 2024-09-15T23:56:42.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe9347b7640 1 -- 172.21.15.112:0/1918897274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe92c1423d0 con 0x7fe92c06e4b0 2024-09-15T23:56:42.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe9347b7640 1 -- 172.21.15.112:0/1918897274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe92c070080 con 0x7fe92c06e4b0 2024-09-15T23:56:42.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.358+0000 7fe922ffd640 1 -- 172.21.15.112:0/1918897274 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe92801b070 con 0x7fe92c06e4b0 2024-09-15T23:56:42.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.362+0000 7fe922ffd640 1 --2- 172.21.15.112:0/1918897274 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9100678c0 0x7fe910069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.362+0000 7fe922ffd640 1 -- 172.21.15.112:0/1918897274 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6304+0+0 (secure 0 0 0) 0x7fe9280851c0 con 0x7fe92c06e4b0 2024-09-15T23:56:42.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.362+0000 7fe931d52640 1 --2- 172.21.15.112:0/1918897274 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9100678c0 0x7fe910069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.362+0000 7fe931d52640 1 --2- 172.21.15.112:0/1918897274 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9100678c0 0x7fe910069d80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0ae000 tx=0x7fe91c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:42.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.366+0000 7fe922ffd640 1 -- 172.21.15.112:0/1918897274 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe928055b40 con 0x7fe92c06e4b0 2024-09-15T23:56:42.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.514+0000 7fe9347b7640 1 -- 172.21.15.112:0/1918897274 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe92c06eca0 con 0x7fe92c06e4b0 2024-09-15T23:56:42.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.518+0000 7fe922ffd640 1 -- 172.21.15.112:0/1918897274 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+17341 (secure 0 0 0) 0x7fe928055440 con 0x7fe92c06e4b0 2024-09-15T23:56:42.518 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:42.519 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:56:33.366131+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:04.716518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:05.136871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.2","mappings":[{"from":2,"to":7}]},{"pgid":"10.10","mappings":[{"from":2,"to":7}]},{"pgid":"10.1b","mappings":[{"from":2,"to":1}]},{"pgid":"10.2c","mappings":[{"from":4,"to":1}]},{"pgid":"10.34","mappings":[{"from":2,"to":5}]},{"pgid":"10.38","mappings":[{"from":2,"to":5}]},{"pgid":"10.3c","mappings":[{"from":2,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:42.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.518+0000 7fe9347b7640 1 -- 172.21.15.112:0/1918897274 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9100678c0 msgr2=0x7fe910069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.518+0000 7fe9347b7640 1 --2- 172.21.15.112:0/1918897274 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9100678c0 0x7fe910069d80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0ae000 tx=0x7fe91c008040 comp rx=0 tx=0).stop 2024-09-15T23:56:42.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.518+0000 7fe9347b7640 1 -- 172.21.15.112:0/1918897274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe92c06e4b0 msgr2=0x7fe92c099840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.518+0000 7fe9347b7640 1 --2- 172.21.15.112:0/1918897274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe92c06e4b0 0x7fe92c099840 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe92800c480 tx=0x7fe92800c940 comp rx=0 tx=0).stop 2024-09-15T23:56:42.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.518+0000 7fe9347b7640 1 -- 172.21.15.112:0/1918897274 shutdown_connections 2024-09-15T23:56:42.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.518+0000 7fe9347b7640 1 --2- 172.21.15.112:0/1918897274 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe9100678c0 0x7fe910069d80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.518+0000 7fe9347b7640 1 --2- 172.21.15.112:0/1918897274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe92c1587a0 0x7fe92c09b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.518+0000 7fe9347b7640 1 --2- 172.21.15.112:0/1918897274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe92c0b39a0 0x7fe92c142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.518+0000 7fe9347b7640 1 --2- 172.21.15.112:0/1918897274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe92c06e4b0 0x7fe92c099840 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.518+0000 7fe9347b7640 1 -- 172.21.15.112:0/1918897274 >> 172.21.15.112:0/1918897274 conn(0x7fe92c0b1f90 msgr2=0x7fe92c144d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:42.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.518+0000 7fe9347b7640 1 -- 172.21.15.112:0/1918897274 shutdown_connections 2024-09-15T23:56:42.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.518+0000 7fe9347b7640 1 -- 172.21.15.112:0/1918897274 wait complete. 2024-09-15T23:56:42.536 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:56:42.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe6a6426640 1 Processor -- start 2024-09-15T23:56:42.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe6a6426640 1 -- start start 2024-09-15T23:56:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe6a6426640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6a015bec0 0x7fe6a00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe6a6426640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe6a015c2a0 0x7fe6a00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe6a6426640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a00b3290 con 0x7fe6a00af2a0 2024-09-15T23:56:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe6a6426640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe6a00b3570 con 0x7fe6a015bec0 2024-09-15T23:56:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe6a6426640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe6a00b3850 con 0x7fe6a015c2a0 2024-09-15T23:56:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe69ffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6a015bec0 0x7fe6a00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe69ffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe6a015bec0 0x7fe6a00ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32966/0 (socket says 172.21.15.112:32966) 2024-09-15T23:56:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe69ffff640 1 -- 172.21.15.112:0/2624638731 learned_addr learned my addr 172.21.15.112:0/2624638731 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe69f7fe640 1 --2- 172.21.15.112:0/2624638731 >> v2:172.21.15.169:3300/0 conn(0x7fe6a015c2a0 0x7fe6a00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe69ffff640 1 -- 172.21.15.112:0/2624638731 >> v2:172.21.15.169:3300/0 conn(0x7fe6a015c2a0 msgr2=0x7fe6a00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe69ffff640 1 --2- 172.21.15.112:0/2624638731 >> v2:172.21.15.169:3300/0 conn(0x7fe6a015c2a0 0x7fe6a00aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe69ffff640 1 -- 172.21.15.112:0/2624638731 >> v1:172.21.15.169:6789/0 conn(0x7fe6a00af2a0 legacy=0x7fe6a015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:42.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe69ffff640 1 -- 172.21.15.112:0/2624638731 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a00b3b30 con 0x7fe6a015bec0 2024-09-15T23:56:42.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.650+0000 7fe69f7fe640 1 --2- 172.21.15.112:0/2624638731 >> v2:172.21.15.169:3300/0 conn(0x7fe6a015c2a0 0x7fe6a00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:42.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe69ffff640 1 --2- 172.21.15.112:0/2624638731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a015bec0 0x7fe6a00ad200 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00ae510 tx=0x7fe69001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3bc681ffdeb5d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:42.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe69effd640 1 -- 172.21.15.112:0/2624638731 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6900aa610 con 0x7fe6a015bec0 2024-09-15T23:56:42.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe69effd640 1 -- 172.21.15.112:0/2624638731 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6900af070 con 0x7fe6a015bec0 2024-09-15T23:56:42.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe69effd640 1 -- 172.21.15.112:0/2624638731 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6900aa9d0 con 0x7fe6a015bec0 2024-09-15T23:56:42.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe6a6426640 1 -- 172.21.15.112:0/2624638731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a015bec0 msgr2=0x7fe6a00ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe6a6426640 1 --2- 172.21.15.112:0/2624638731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a015bec0 0x7fe6a00ad200 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00ae510 tx=0x7fe69001c4b0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe6a6426640 1 -- 172.21.15.112:0/2624638731 shutdown_connections 2024-09-15T23:56:42.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe6a6426640 1 --2- 172.21.15.112:0/2624638731 >> v2:172.21.15.169:3300/0 conn(0x7fe6a015c2a0 0x7fe6a00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe6a6426640 1 --2- 172.21.15.112:0/2624638731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a015bec0 0x7fe6a00ad200 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe6a6426640 1 -- 172.21.15.112:0/2624638731 >> 172.21.15.112:0/2624638731 conn(0x7fe6a00b1f90 msgr2=0x7fe6a00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:42.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe6a6426640 1 -- 172.21.15.112:0/2624638731 shutdown_connections 2024-09-15T23:56:42.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe6a6426640 1 -- 172.21.15.112:0/2624638731 wait complete. 2024-09-15T23:56:42.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe6a6426640 1 Processor -- start 2024-09-15T23:56:42.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe6a6426640 1 -- start start 2024-09-15T23:56:42.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.654+0000 7fe6a6426640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a00af2a0 0x7fe6a015c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe6a6426640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a015bec0 0x7fe6a01589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe6a6426640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a015c2a0 0x7fe6a00996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe6a6426640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a00ad740 con 0x7fe6a015bec0 2024-09-15T23:56:42.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe6a6426640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a00af710 con 0x7fe6a00af2a0 2024-09-15T23:56:42.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe6a6426640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a0169000 con 0x7fe6a015c2a0 2024-09-15T23:56:42.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a015bec0 0x7fe6a01589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a015bec0 0x7fe6a01589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:32974/0 (socket says 172.21.15.112:32974) 2024-09-15T23:56:42.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69f7fe640 1 -- 172.21.15.112:0/868321345 learned_addr learned my addr 172.21.15.112:0/868321345 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:42.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69ffff640 1 --2- 172.21.15.112:0/868321345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a00af2a0 0x7fe6a015c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe6a49c3640 1 --2- 172.21.15.112:0/868321345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a015c2a0 0x7fe6a00996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69f7fe640 1 -- 172.21.15.112:0/868321345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a015c2a0 msgr2=0x7fe6a00996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69f7fe640 1 --2- 172.21.15.112:0/868321345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a015c2a0 0x7fe6a00996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69f7fe640 1 -- 172.21.15.112:0/868321345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a00af2a0 msgr2=0x7fe6a015c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69f7fe640 1 --2- 172.21.15.112:0/868321345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a00af2a0 0x7fe6a015c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69f7fe640 1 -- 172.21.15.112:0/868321345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a015ebc0 con 0x7fe6a015bec0 2024-09-15T23:56:42.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69f7fe640 1 --2- 172.21.15.112:0/868321345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a015bec0 0x7fe6a01589f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c820 tx=0x7fe69400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:42.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69cff9640 1 -- 172.21.15.112:0/868321345 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe694015070 con 0x7fe6a015bec0 2024-09-15T23:56:42.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69cff9640 1 -- 172.21.15.112:0/868321345 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe694004220 con 0x7fe6a015bec0 2024-09-15T23:56:42.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe6a6426640 1 -- 172.21.15.112:0/868321345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a015ee80 con 0x7fe6a015bec0 2024-09-15T23:56:42.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69cff9640 1 -- 172.21.15.112:0/868321345 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69400ce10 con 0x7fe6a015bec0 2024-09-15T23:56:42.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe6a6426640 1 -- 172.21.15.112:0/868321345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a015f440 con 0x7fe6a015bec0 2024-09-15T23:56:42.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe6a6426640 1 -- 172.21.15.112:0/868321345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a00ad200 con 0x7fe6a015bec0 2024-09-15T23:56:42.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69cff9640 1 -- 172.21.15.112:0/868321345 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe6940077d0 con 0x7fe6a015bec0 2024-09-15T23:56:42.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69cff9640 1 --2- 172.21.15.112:0/868321345 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe68c0678f0 0x7fe68c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:42.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69cff9640 1 -- 172.21.15.112:0/868321345 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6304+0+0 (secure 0 0 0) 0x7fe694085b90 con 0x7fe6a015bec0 2024-09-15T23:56:42.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69ffff640 1 --2- 172.21.15.112:0/868321345 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe68c0678f0 0x7fe68c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:42.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.658+0000 7fe69ffff640 1 --2- 172.21.15.112:0/868321345 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe68c0678f0 0x7fe68c069db0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6900ae000 tx=0x7fe6900a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:42.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.662+0000 7fe69cff9640 1 -- 172.21.15.112:0/868321345 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe694056510 con 0x7fe6a015bec0 2024-09-15T23:56:42.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.858+0000 7fe6a6426640 1 -- 172.21.15.112:0/868321345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe6a006fcd0 con 0x7fe6a015bec0 2024-09-15T23:56:42.859 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-15T23:56:42.858+0000 7fae14e39640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:56:42.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.862+0000 7fe69cff9640 1 -- 172.21.15.112:0/868321345 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7fe694055e10 con 0x7fe6a015bec0 2024-09-15T23:56:42.863 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:56:42.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.862+0000 7fe6a6426640 1 -- 172.21.15.112:0/868321345 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe68c0678f0 msgr2=0x7fe68c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.862+0000 7fe6a6426640 1 --2- 172.21.15.112:0/868321345 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe68c0678f0 0x7fe68c069db0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6900ae000 tx=0x7fe6900a7000 comp rx=0 tx=0).stop 2024-09-15T23:56:42.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.862+0000 7fe6a6426640 1 -- 172.21.15.112:0/868321345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a015bec0 msgr2=0x7fe6a01589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:42.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.862+0000 7fe6a6426640 1 --2- 172.21.15.112:0/868321345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a015bec0 0x7fe6a01589f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c820 tx=0x7fe69400cce0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.862+0000 7fe6a6426640 1 -- 172.21.15.112:0/868321345 shutdown_connections 2024-09-15T23:56:42.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.862+0000 7fe6a6426640 1 --2- 172.21.15.112:0/868321345 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe68c0678f0 0x7fe68c069db0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.862+0000 7fe6a6426640 1 --2- 172.21.15.112:0/868321345 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6a015c2a0 0x7fe6a00996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.862+0000 7fe6a6426640 1 --2- 172.21.15.112:0/868321345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6a015bec0 0x7fe6a01589f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.862+0000 7fe6a6426640 1 --2- 172.21.15.112:0/868321345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a00af2a0 0x7fe6a015c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:42.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.862+0000 7fe6a6426640 1 -- 172.21.15.112:0/868321345 >> 172.21.15.112:0/868321345 conn(0x7fe6a00b1f90 msgr2=0x7fe6a00b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:42.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.862+0000 7fe6a6426640 1 -- 172.21.15.112:0/868321345 shutdown_connections 2024-09-15T23:56:42.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.866+0000 7fe6a6426640 1 -- 172.21.15.112:0/868321345 wait complete. 2024-09-15T23:56:42.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:56:42.914 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-15T23:56:42.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6a1485640 1 Processor -- start 2024-09-15T23:56:42.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6a1485640 1 -- start start 2024-09-15T23:56:42.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6a1485640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff69c1587a0 0x7ff69c0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6a1485640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff69c0b37d0 0x7ff69c06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6a1485640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff69c06e4b0 0x7ff69c161e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6a1485640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff69c0b3c40 con 0x7ff69c0b37d0 2024-09-15T23:56:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6a1485640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff69c06f870 con 0x7ff69c1587a0 2024-09-15T23:56:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6a1485640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff69c06ec60 con 0x7ff69c06e4b0 2024-09-15T23:56:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6927fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff69c0b37d0 0x7ff69c06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6927fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff69c0b37d0 0x7ff69c06df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33006/0 (socket says 172.21.15.112:33006) 2024-09-15T23:56:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6927fc640 1 -- 172.21.15.112:0/2577876439 learned_addr learned my addr 172.21.15.112:0/2577876439 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff69affd640 1 --2- 172.21.15.112:0/2577876439 >> v2:172.21.15.169:3300/0 conn(0x7ff69c1587a0 0x7ff69c0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff69b7fe640 1 --2- 172.21.15.112:0/2577876439 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff69c06e4b0 0x7ff69c161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6927fc640 1 -- 172.21.15.112:0/2577876439 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff69c06e4b0 msgr2=0x7ff69c161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:43.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6927fc640 1 --2- 172.21.15.112:0/2577876439 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff69c06e4b0 0x7ff69c161e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:43.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6927fc640 1 -- 172.21.15.112:0/2577876439 >> v2:172.21.15.169:3300/0 conn(0x7ff69c1587a0 msgr2=0x7ff69c0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:43.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6927fc640 1 --2- 172.21.15.112:0/2577876439 >> v2:172.21.15.169:3300/0 conn(0x7ff69c1587a0 0x7ff69c0b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:43.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff6927fc640 1 -- 172.21.15.112:0/2577876439 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c06ef40 con 0x7ff69c0b37d0 2024-09-15T23:56:43.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:42.998+0000 7ff69b7fe640 1 --2- 172.21.15.112:0/2577876439 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff69c06e4b0 0x7ff69c161e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:43.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff6927fc640 1 --2- 172.21.15.112:0/2577876439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69c0b37d0 0x7ff69c06df70 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff69c071710 tx=0x7ff68401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61be38a69826d86 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:43.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff69a7fc640 1 -- 172.21.15.112:0/2577876439 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6840b0070 con 0x7ff69c0b37d0 2024-09-15T23:56:43.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff69a7fc640 1 -- 172.21.15.112:0/2577876439 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6840ab600 con 0x7ff69c0b37d0 2024-09-15T23:56:43.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff69a7fc640 1 -- 172.21.15.112:0/2577876439 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6840ab9d0 con 0x7ff69c0b37d0 2024-09-15T23:56:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff6a1485640 1 -- 172.21.15.112:0/2577876439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69c0b37d0 msgr2=0x7ff69c06df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff6a1485640 1 --2- 172.21.15.112:0/2577876439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69c0b37d0 0x7ff69c06df70 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff69c071710 tx=0x7ff68401c230 comp rx=0 tx=0).stop 2024-09-15T23:56:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff6a1485640 1 -- 172.21.15.112:0/2577876439 shutdown_connections 2024-09-15T23:56:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff6a1485640 1 --2- 172.21.15.112:0/2577876439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69c0b37d0 0x7ff69c06df70 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:43.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff6a1485640 1 --2- 172.21.15.112:0/2577876439 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff69c06e4b0 0x7ff69c161e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:43.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff6a1485640 1 --2- 172.21.15.112:0/2577876439 >> v2:172.21.15.169:3300/0 conn(0x7ff69c1587a0 0x7ff69c0b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:43.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff6a1485640 1 -- 172.21.15.112:0/2577876439 >> 172.21.15.112:0/2577876439 conn(0x7ff69c0b1f90 msgr2=0x7ff69c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:43.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff6a1485640 1 -- 172.21.15.112:0/2577876439 shutdown_connections 2024-09-15T23:56:43.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff6a1485640 1 -- 172.21.15.112:0/2577876439 wait complete. 2024-09-15T23:56:43.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff6a1485640 1 Processor -- start 2024-09-15T23:56:43.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff6a1485640 1 -- start start 2024-09-15T23:56:43.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff6a1485640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff69c06e4b0 0x7ff69c145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:43.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.002+0000 7ff6a1485640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff69c0b37d0 0x7ff69c1471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:43.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff6a1485640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69c1587a0 0x7ff69c150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:43.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff6a1485640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c158b80 con 0x7ff69c1587a0 2024-09-15T23:56:43.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff6a1485640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c072160 con 0x7ff69c06e4b0 2024-09-15T23:56:43.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff6a1485640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff69c1612d0 con 0x7ff69c0b37d0 2024-09-15T23:56:43.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff69b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69c1587a0 0x7ff69c150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:43.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff69b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69c1587a0 0x7ff69c150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33018/0 (socket says 172.21.15.112:33018) 2024-09-15T23:56:43.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff69b7fe640 1 -- 172.21.15.112:0/4252753501 learned_addr learned my addr 172.21.15.112:0/4252753501 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:43.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff6927fc640 1 --2- 172.21.15.112:0/4252753501 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff69c0b37d0 0x7ff69c1471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:43.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff69affd640 1 --2- 172.21.15.112:0/4252753501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff69c06e4b0 0x7ff69c145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:43.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff69b7fe640 1 -- 172.21.15.112:0/4252753501 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff69c0b37d0 msgr2=0x7ff69c1471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:43.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff69b7fe640 1 --2- 172.21.15.112:0/4252753501 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff69c0b37d0 0x7ff69c1471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:43.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff69b7fe640 1 -- 172.21.15.112:0/4252753501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff69c06e4b0 msgr2=0x7ff69c145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:43.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff69b7fe640 1 --2- 172.21.15.112:0/4252753501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff69c06e4b0 0x7ff69c145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:43.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff69b7fe640 1 -- 172.21.15.112:0/4252753501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c1615b0 con 0x7ff69c1587a0 2024-09-15T23:56:43.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff69b7fe640 1 --2- 172.21.15.112:0/4252753501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69c1587a0 0x7ff69c150ad0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff69400cef0 tx=0x7ff69400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:43.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff693fff640 1 -- 172.21.15.112:0/4252753501 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69401a070 con 0x7ff69c1587a0 2024-09-15T23:56:43.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff693fff640 1 -- 172.21.15.112:0/4252753501 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff69400d840 con 0x7ff69c1587a0 2024-09-15T23:56:43.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff6a1485640 1 -- 172.21.15.112:0/4252753501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69c1466c0 con 0x7ff69c1587a0 2024-09-15T23:56:43.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff693fff640 1 -- 172.21.15.112:0/4252753501 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69400dc30 con 0x7ff69c1587a0 2024-09-15T23:56:43.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff6a1485640 1 -- 172.21.15.112:0/4252753501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69c146c80 con 0x7ff69c1587a0 2024-09-15T23:56:43.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff6a1485640 1 -- 172.21.15.112:0/4252753501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69c070080 con 0x7ff69c1587a0 2024-09-15T23:56:43.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff693fff640 1 -- 172.21.15.112:0/4252753501 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff69401d070 con 0x7ff69c1587a0 2024-09-15T23:56:43.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff693fff640 1 --2- 172.21.15.112:0/4252753501 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff67c0678c0 0x7ff67c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:43.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff69affd640 1 --2- 172.21.15.112:0/4252753501 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff67c0678c0 0x7ff67c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:43.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff693fff640 1 -- 172.21.15.112:0/4252753501 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6390+0+0 (secure 0 0 0) 0x7ff6940867f0 con 0x7ff69c1587a0 2024-09-15T23:56:43.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.006+0000 7ff69affd640 1 --2- 172.21.15.112:0/4252753501 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff67c0678c0 0x7ff67c069d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00b930 tx=0x7ff68c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:43.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.010+0000 7ff693fff640 1 -- 172.21.15.112:0/4252753501 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff694057000 con 0x7ff69c1587a0 2024-09-15T23:56:43.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.198+0000 7ff6a1485640 1 -- 172.21.15.112:0/4252753501 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff69c1463c0 con 0x7ff69c1587a0 2024-09-15T23:56:43.550 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:56:43.552 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:56:43.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.862+0000 7ff693fff640 1 -- 172.21.15.112:0/4252753501 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7ff694056900 con 0x7ff69c1587a0 2024-09-15T23:56:43.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.870+0000 7ff6a1485640 1 -- 172.21.15.112:0/4252753501 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff67c0678c0 msgr2=0x7ff67c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:43.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.870+0000 7ff6a1485640 1 --2- 172.21.15.112:0/4252753501 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff67c0678c0 0x7ff67c069d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00b930 tx=0x7ff68c008040 comp rx=0 tx=0).stop 2024-09-15T23:56:43.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.870+0000 7ff6a1485640 1 -- 172.21.15.112:0/4252753501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69c1587a0 msgr2=0x7ff69c150ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:43.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.870+0000 7ff6a1485640 1 --2- 172.21.15.112:0/4252753501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69c1587a0 0x7ff69c150ad0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff69400cef0 tx=0x7ff69400a710 comp rx=0 tx=0).stop 2024-09-15T23:56:43.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.870+0000 7ff6a1485640 1 -- 172.21.15.112:0/4252753501 shutdown_connections 2024-09-15T23:56:43.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.870+0000 7ff6a1485640 1 --2- 172.21.15.112:0/4252753501 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff67c0678c0 0x7ff67c069d80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:43.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.870+0000 7ff6a1485640 1 --2- 172.21.15.112:0/4252753501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff69c1587a0 0x7ff69c150ad0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:43.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.870+0000 7ff6a1485640 1 --2- 172.21.15.112:0/4252753501 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff69c0b37d0 0x7ff69c1471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:43.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.870+0000 7ff6a1485640 1 --2- 172.21.15.112:0/4252753501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff69c06e4b0 0x7ff69c145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:43.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.870+0000 7ff6a1485640 1 -- 172.21.15.112:0/4252753501 >> 172.21.15.112:0/4252753501 conn(0x7ff69c0b1f90 msgr2=0x7ff69c0afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:43.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.870+0000 7ff6a1485640 1 -- 172.21.15.112:0/4252753501 shutdown_connections 2024-09-15T23:56:43.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:43.870+0000 7ff6a1485640 1 -- 172.21.15.112:0/4252753501 wait complete. 2024-09-15T23:56:43.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:56:44.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.014+0000 7f09f0d64640 1 Processor -- start 2024-09-15T23:56:44.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.014+0000 7f09f0d64640 1 -- start start 2024-09-15T23:56:44.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09f0d64640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f09ec0cf800 0x7f09ec0b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:44.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09f0d64640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f09ec0b4340 0x7f09ec0d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:44.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09f0d64640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09ec0d27a0 con 0x7f09ec1457a0 2024-09-15T23:56:44.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09f0d64640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f09ec0b4790 con 0x7f09ec0b4340 2024-09-15T23:56:44.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09f0d64640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f09ec0d2a80 con 0x7f09ec0cf800 2024-09-15T23:56:44.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09ead9d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f09ec0b4340 0x7f09ec0d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:44.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09ea59c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f09ec1457a0 0x7f09ec0d1ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53354/0 (socket says 172.21.15.112:53354) 2024-09-15T23:56:44.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09ea59c640 1 -- 172.21.15.112:0/816915648 learned_addr learned my addr 172.21.15.112:0/816915648 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:44.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09e9d9b640 1 --2- 172.21.15.112:0/816915648 >> v2:172.21.15.169:3300/0 conn(0x7f09ec0cf800 0x7f09ec0b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:44.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09ead9d640 1 -- 172.21.15.112:0/816915648 >> v2:172.21.15.169:3300/0 conn(0x7f09ec0cf800 msgr2=0x7f09ec0b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:44.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09ead9d640 1 --2- 172.21.15.112:0/816915648 >> v2:172.21.15.169:3300/0 conn(0x7f09ec0cf800 0x7f09ec0b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:44.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09ead9d640 1 -- 172.21.15.112:0/816915648 >> v1:172.21.15.112:6789/0 conn(0x7f09ec1457a0 legacy=0x7f09ec0d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:44.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09ead9d640 1 -- 172.21.15.112:0/816915648 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ec0d2d60 con 0x7f09ec0b4340 2024-09-15T23:56:44.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09e959a640 1 -- 172.21.15.112:0/816915648 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2525476198 0 0) 0x7f09ec0d27a0 con 0x7f09ec1457a0 2024-09-15T23:56:44.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09ead9d640 1 --2- 172.21.15.112:0/816915648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0b4340 0x7f09ec0d0710 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0cfc70 tx=0x7f09e401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3c18d17e14cee9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:44.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09e959a640 1 -- 172.21.15.112:0/816915648 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e40b2070 con 0x7f09ec0b4340 2024-09-15T23:56:44.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09e959a640 1 -- 172.21.15.112:0/816915648 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e40a5760 con 0x7f09ec0b4340 2024-09-15T23:56:44.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09e959a640 1 -- 172.21.15.112:0/816915648 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e40a5b30 con 0x7f09ec0b4340 2024-09-15T23:56:44.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09f0d64640 1 -- 172.21.15.112:0/816915648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0b4340 msgr2=0x7f09ec0d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:44.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09f0d64640 1 --2- 172.21.15.112:0/816915648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0b4340 0x7f09ec0d0710 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0cfc70 tx=0x7f09e401c8a0 comp rx=0 tx=0).stop 2024-09-15T23:56:44.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.018+0000 7f09f0d64640 1 -- 172.21.15.112:0/816915648 shutdown_connections 2024-09-15T23:56:44.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 --2- 172.21.15.112:0/816915648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0b4340 0x7f09ec0d0710 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:44.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 --2- 172.21.15.112:0/816915648 >> v2:172.21.15.169:3300/0 conn(0x7f09ec0cf800 0x7f09ec0b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:44.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 -- 172.21.15.112:0/816915648 >> 172.21.15.112:0/816915648 conn(0x7f09ec06bcc0 msgr2=0x7f09ec06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:44.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 -- 172.21.15.112:0/816915648 shutdown_connections 2024-09-15T23:56:44.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 -- 172.21.15.112:0/816915648 wait complete. 2024-09-15T23:56:44.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 Processor -- start 2024-09-15T23:56:44.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 -- start start 2024-09-15T23:56:44.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0b4340 0x7f09ec144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:44.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09ec0cf800 0x7f09ec0cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:44.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09ec1457a0 0x7f09ec15bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:44.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec1690b0 con 0x7f09ec0b4340 2024-09-15T23:56:44.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec0d1670 con 0x7f09ec0cf800 2024-09-15T23:56:44.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f09ec169230 con 0x7f09ec1457a0 2024-09-15T23:56:44.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09ea59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0b4340 0x7f09ec144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:44.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09ea59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0b4340 0x7f09ec144880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33038/0 (socket says 172.21.15.112:33038) 2024-09-15T23:56:44.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09ea59c640 1 -- 172.21.15.112:0/3415218766 learned_addr learned my addr 172.21.15.112:0/3415218766 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:44.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09e9d9b640 1 --2- 172.21.15.112:0/3415218766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09ec0cf800 0x7f09ec0cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:44.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09ea59c640 1 -- 172.21.15.112:0/3415218766 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09ec1457a0 msgr2=0x7f09ec15bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:44.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09ea59c640 1 --2- 172.21.15.112:0/3415218766 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09ec1457a0 0x7f09ec15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:44.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09ea59c640 1 -- 172.21.15.112:0/3415218766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09ec0cf800 msgr2=0x7f09ec0cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:44.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09ea59c640 1 --2- 172.21.15.112:0/3415218766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09ec0cf800 0x7f09ec0cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:44.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09ea59c640 1 -- 172.21.15.112:0/3415218766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ec0cbfd0 con 0x7f09ec0b4340 2024-09-15T23:56:44.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09ea59c640 1 --2- 172.21.15.112:0/3415218766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0b4340 0x7f09ec144880 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00c480 tx=0x7f09dc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:44.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09daffd640 1 -- 172.21.15.112:0/3415218766 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc018070 con 0x7f09ec0b4340 2024-09-15T23:56:44.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09daffd640 1 -- 172.21.15.112:0/3415218766 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09dc007500 con 0x7f09ec0b4340 2024-09-15T23:56:44.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 -- 172.21.15.112:0/3415218766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09ec0cc2b0 con 0x7f09ec0b4340 2024-09-15T23:56:44.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09daffd640 1 -- 172.21.15.112:0/3415218766 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc004a30 con 0x7f09ec0b4340 2024-09-15T23:56:44.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 -- 172.21.15.112:0/3415218766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ec131750 con 0x7f09ec0b4340 2024-09-15T23:56:44.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.022+0000 7f09f0d64640 1 -- 172.21.15.112:0/3415218766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09ec0cc480 con 0x7f09ec0b4340 2024-09-15T23:56:44.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.026+0000 7f09daffd640 1 -- 172.21.15.112:0/3415218766 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f09dc01b070 con 0x7f09ec0b4340 2024-09-15T23:56:44.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.026+0000 7f09daffd640 1 --2- 172.21.15.112:0/3415218766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f09cc0678c0 0x7f09cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:44.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.026+0000 7f09daffd640 1 -- 172.21.15.112:0/3415218766 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6390+0+0 (secure 0 0 0) 0x7f09dc085220 con 0x7f09ec0b4340 2024-09-15T23:56:44.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.026+0000 7f09e9d9b640 1 --2- 172.21.15.112:0/3415218766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f09cc0678c0 0x7f09cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:44.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.026+0000 7f09e9d9b640 1 --2- 172.21.15.112:0/3415218766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f09cc0678c0 0x7f09cc069d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f09ec165780 tx=0x7f09e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:44.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.030+0000 7f09daffd640 1 -- 172.21.15.112:0/3415218766 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f09dc055b40 con 0x7f09ec0b4340 2024-09-15T23:56:44.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.178+0000 7f09f0d64640 1 -- 172.21.15.112:0/3415218766 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f09ec0b3810 con 0x7f09ec0b4340 2024-09-15T23:56:44.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.874+0000 7f09daffd640 1 -- 172.21.15.112:0/3415218766 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v66) ==== 181+0+0 (secure 0 0 0) 0x7f09dc055440 con 0x7f09ec0b4340 2024-09-15T23:56:44.874 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:56:44.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.878+0000 7f09f0d64640 1 -- 172.21.15.112:0/3415218766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f09cc0678c0 msgr2=0x7f09cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:44.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.878+0000 7f09f0d64640 1 --2- 172.21.15.112:0/3415218766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f09cc0678c0 0x7f09cc069d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f09ec165780 tx=0x7f09e0008040 comp rx=0 tx=0).stop 2024-09-15T23:56:44.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.878+0000 7f09f0d64640 1 -- 172.21.15.112:0/3415218766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0b4340 msgr2=0x7f09ec144880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:44.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.878+0000 7f09f0d64640 1 --2- 172.21.15.112:0/3415218766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0b4340 0x7f09ec144880 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00c480 tx=0x7f09dc00c940 comp rx=0 tx=0).stop 2024-09-15T23:56:44.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.878+0000 7f09f0d64640 1 -- 172.21.15.112:0/3415218766 shutdown_connections 2024-09-15T23:56:44.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.878+0000 7f09f0d64640 1 --2- 172.21.15.112:0/3415218766 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f09cc0678c0 0x7f09cc069d80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:44.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.878+0000 7f09f0d64640 1 --2- 172.21.15.112:0/3415218766 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09ec1457a0 0x7f09ec15bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:44.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.878+0000 7f09f0d64640 1 --2- 172.21.15.112:0/3415218766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09ec0cf800 0x7f09ec0cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:44.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.878+0000 7f09f0d64640 1 --2- 172.21.15.112:0/3415218766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0b4340 0x7f09ec144880 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:44.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.878+0000 7f09f0d64640 1 -- 172.21.15.112:0/3415218766 >> 172.21.15.112:0/3415218766 conn(0x7f09ec06bcc0 msgr2=0x7f09ec06c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:44.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.878+0000 7f09f0d64640 1 -- 172.21.15.112:0/3415218766 shutdown_connections 2024-09-15T23:56:44.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:44.878+0000 7f09f0d64640 1 -- 172.21.15.112:0/3415218766 wait complete. 2024-09-15T23:56:44.902 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:56:45.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.026+0000 7f8404072640 1 Processor -- start 2024-09-15T23:56:45.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.026+0000 7f8404072640 1 -- start start 2024-09-15T23:56:45.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8404072640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f83fc0cf620 0x7f83fc168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:45.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8404072640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83fc0d0300 con 0x7f83fc161a60 2024-09-15T23:56:45.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8404072640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83fc06e6c0 con 0x7f83fc0d3060 2024-09-15T23:56:45.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8404072640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f83fc0cfa90 con 0x7f83fc0cf620 2024-09-15T23:56:45.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8401e0e640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f83fc161a60 0x7f83fc0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53366/0 (socket says 172.21.15.112:53366) 2024-09-15T23:56:45.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8401e0e640 1 -- 172.21.15.112:0/40456104 learned_addr learned my addr 172.21.15.112:0/40456104 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:45.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 -- 172.21.15.112:0/40456104 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2541189440 0 0) 0x7f83f80014a0 con 0x7f83fc161a60 2024-09-15T23:56:45.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 -- 172.21.15.112:0/40456104 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83e8003530 con 0x7f83fc161a60 2024-09-15T23:56:45.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f840260f640 1 --2- 172.21.15.112:0/40456104 >> v2:172.21.15.169:3300/0 conn(0x7f83fc0cf620 0x7f83fc168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:45.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 -- 172.21.15.112:0/40456104 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 706887334 0 0) 0x7f83e8003530 con 0x7f83fc161a60 2024-09-15T23:56:45.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 -- 172.21.15.112:0/40456104 >> v2:172.21.15.169:3300/0 conn(0x7f83fc0cf620 msgr2=0x7f83fc168f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:45.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 --2- 172.21.15.112:0/40456104 >> v2:172.21.15.169:3300/0 conn(0x7f83fc0cf620 0x7f83fc168f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:45.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 -- 172.21.15.112:0/40456104 >> v1:172.21.15.169:6789/0 conn(0x7f83fc0d3060 legacy=0x7f83fc0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:45.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 -- 172.21.15.112:0/40456104 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83fc0b0f60 con 0x7f83fc161a60 2024-09-15T23:56:45.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 -- 172.21.15.112:0/40456104 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f83f8001bd0 con 0x7f83fc161a60 2024-09-15T23:56:45.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 -- 172.21.15.112:0/40456104 >> v1:172.21.15.112:6789/0 conn(0x7f83fc161a60 legacy=0x7f83fc0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:45.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 --2- 172.21.15.112:0/40456104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83e80039c0 0x7f83e8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:45.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 --2- 172.21.15.112:0/40456104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83e8004810 0x7f83e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:45.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 --2- 172.21.15.112:0/40456104 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83e80052f0 0x7f83e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:45.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 -- 172.21.15.112:0/40456104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc0cfa90 con 0x7f83e8004810 2024-09-15T23:56:45.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 -- 172.21.15.112:0/40456104 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f83e800c1a0 con 0x7f83e80039c0 2024-09-15T23:56:45.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 -- 172.21.15.112:0/40456104 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f83e800c3a0 con 0x7f83e80052f0 2024-09-15T23:56:45.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f840160d640 1 --2- 172.21.15.112:0/40456104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83e8004810 0x7f83e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:45.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f840160d640 1 -- 172.21.15.112:0/40456104 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83e80052f0 msgr2=0x7f83e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:45.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f840160d640 1 --2- 172.21.15.112:0/40456104 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83e80052f0 0x7f83e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:45.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f840160d640 1 -- 172.21.15.112:0/40456104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83e80039c0 msgr2=0x7f83e8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:45.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8401e0e640 1 --2- 172.21.15.112:0/40456104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83e80039c0 0x7f83e8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:45.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f840160d640 1 --2- 172.21.15.112:0/40456104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83e80039c0 0x7f83e8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:45.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f840160d640 1 -- 172.21.15.112:0/40456104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e8003530 con 0x7f83e8004810 2024-09-15T23:56:45.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f840260f640 1 -- 172.21.15.112:0/40456104 reap_dead start 2024-09-15T23:56:45.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8401e0e640 1 --2- 172.21.15.112:0/40456104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83e80039c0 0x7f83e8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:45.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f840160d640 1 --2- 172.21.15.112:0/40456104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83e8004810 0x7f83e8004c90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f83ec007fd0 tx=0x7f83ec01c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6652b340e5a38358 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:45.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.030+0000 7f8400e0c640 1 -- 172.21.15.112:0/40456104 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0b0070 con 0x7f83e8004810 2024-09-15T23:56:45.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8400e0c640 1 -- 172.21.15.112:0/40456104 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec0ab620 con 0x7f83e8004810 2024-09-15T23:56:45.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8400e0c640 1 -- 172.21.15.112:0/40456104 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0039b0 con 0x7f83e8004810 2024-09-15T23:56:45.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 -- 172.21.15.112:0/40456104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83e8004810 msgr2=0x7f83e8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:45.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 --2- 172.21.15.112:0/40456104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83e8004810 0x7f83e8004c90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f83ec007fd0 tx=0x7f83ec01c290 comp rx=0 tx=0).stop 2024-09-15T23:56:45.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 -- 172.21.15.112:0/40456104 shutdown_connections 2024-09-15T23:56:45.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 --2- 172.21.15.112:0/40456104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83e8004810 0x7f83e8004c90 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:45.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 -- 172.21.15.112:0/40456104 >> 172.21.15.112:0/40456104 conn(0x7f83fc08bf90 msgr2=0x7f83fc09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:45.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 -- 172.21.15.112:0/40456104 shutdown_connections 2024-09-15T23:56:45.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 -- 172.21.15.112:0/40456104 wait complete. 2024-09-15T23:56:45.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 Processor -- start 2024-09-15T23:56:45.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 -- start start 2024-09-15T23:56:45.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83e8004810 0x7f83fc15fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:45.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83fc0caa40 0x7f83fc0b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:45.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83fc0c8ed0 0x7f83fc0b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:45.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc0d2d60 con 0x7f83e8004810 2024-09-15T23:56:45.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc06d190 con 0x7f83fc0c8ed0 2024-09-15T23:56:45.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f83fc0d2ee0 con 0x7f83fc0caa40 2024-09-15T23:56:45.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8401e0e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83e8004810 0x7f83fc15fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:45.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8401e0e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83e8004810 0x7f83fc15fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33052/0 (socket says 172.21.15.112:33052) 2024-09-15T23:56:45.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8401e0e640 1 -- 172.21.15.112:0/4217752042 learned_addr learned my addr 172.21.15.112:0/4217752042 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:45.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f840260f640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83fc0c8ed0 0x7f83fc0b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:45.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f840160d640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83fc0caa40 0x7f83fc0b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:45.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8401e0e640 1 -- 172.21.15.112:0/4217752042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83fc0caa40 msgr2=0x7f83fc0b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:45.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8401e0e640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83fc0caa40 0x7f83fc0b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:45.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8401e0e640 1 -- 172.21.15.112:0/4217752042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83fc0c8ed0 msgr2=0x7f83fc0b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:45.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8401e0e640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83fc0c8ed0 0x7f83fc0b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:45.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8401e0e640 1 -- 172.21.15.112:0/4217752042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83fc0b9320 con 0x7f83e8004810 2024-09-15T23:56:45.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f840160d640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83fc0caa40 0x7f83fc0b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:45.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8401e0e640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83e8004810 0x7f83fc15fc20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f83f8001c20 tx=0x7f83f800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:45.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f83f27fc640 1 -- 172.21.15.112:0/4217752042 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8019070 con 0x7f83e8004810 2024-09-15T23:56:45.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f83f27fc640 1 -- 172.21.15.112:0/4217752042 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f8004d70 con 0x7f83e8004810 2024-09-15T23:56:45.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 -- 172.21.15.112:0/4217752042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83fc0b9600 con 0x7f83e8004810 2024-09-15T23:56:45.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f83f27fc640 1 -- 172.21.15.112:0/4217752042 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f80072f0 con 0x7f83e8004810 2024-09-15T23:56:45.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.034+0000 7f8404072640 1 -- 172.21.15.112:0/4217752042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83fc0b9bc0 con 0x7f83e8004810 2024-09-15T23:56:45.039 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.038+0000 7f8404072640 1 -- 172.21.15.112:0/4217752042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83fc0cf370 con 0x7f83e8004810 2024-09-15T23:56:45.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.038+0000 7f83f27fc640 1 -- 172.21.15.112:0/4217752042 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83f801c070 con 0x7f83e8004810 2024-09-15T23:56:45.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.038+0000 7f83f27fc640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83e00678f0 0x7f83e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:45.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.038+0000 7f83f27fc640 1 -- 172.21.15.112:0/4217752042 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5952+0+0 (secure 0 0 0) 0x7f83f8085f00 con 0x7f83e8004810 2024-09-15T23:56:45.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.038+0000 7f840160d640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83e00678f0 0x7f83e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:45.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.038+0000 7f840160d640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83e00678f0 0x7f83e0069db0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0ad000 tx=0x7f83ec003770 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.042+0000 7f83f27fc640 1 -- 172.21.15.112:0/4217752042 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f83fc0d0300 con 0x7f83e8004810 2024-09-15T23:56:45.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.206+0000 7f8404072640 1 -- 172.21.15.112:0/4217752042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f83fc0b24c0 con 0x7f83e8004810 2024-09-15T23:56:45.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.886+0000 7f83f27fc640 1 -- 172.21.15.112:0/4217752042 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v67) ==== 169+0+0 (secure 0 0 0) 0x7f83f8056950 con 0x7f83e8004810 2024-09-15T23:56:45.888 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-15T23:56:45.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.894+0000 7f8404072640 1 -- 172.21.15.112:0/4217752042 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83e00678f0 msgr2=0x7f83e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:45.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.894+0000 7f8404072640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83e00678f0 0x7f83e0069db0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0ad000 tx=0x7f83ec003770 comp rx=0 tx=0).stop 2024-09-15T23:56:45.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.894+0000 7f8404072640 1 -- 172.21.15.112:0/4217752042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83e8004810 msgr2=0x7f83fc15fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:45.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.894+0000 7f8404072640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83e8004810 0x7f83fc15fc20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f83f8001c20 tx=0x7f83f800b4a0 comp rx=0 tx=0).stop 2024-09-15T23:56:45.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.894+0000 7f8404072640 1 -- 172.21.15.112:0/4217752042 shutdown_connections 2024-09-15T23:56:45.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.894+0000 7f8404072640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f83e00678f0 0x7f83e0069db0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:45.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.894+0000 7f8404072640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f83fc0c8ed0 0x7f83fc0b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:45.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.894+0000 7f8404072640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83fc0caa40 0x7f83fc0b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:45.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.894+0000 7f8404072640 1 --2- 172.21.15.112:0/4217752042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83e8004810 0x7f83fc15fc20 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:45.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.894+0000 7f8404072640 1 -- 172.21.15.112:0/4217752042 >> 172.21.15.112:0/4217752042 conn(0x7f83fc08bf90 msgr2=0x7f83fc0b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:45.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.894+0000 7f8404072640 1 -- 172.21.15.112:0/4217752042 shutdown_connections 2024-09-15T23:56:45.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:45.894+0000 7f8404072640 1 -- 172.21.15.112:0/4217752042 wait complete. 2024-09-15T23:56:45.919 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:56:46.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd8880640 1 Processor -- start 2024-09-15T23:56:46.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd8880640 1 -- start start 2024-09-15T23:56:46.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd8880640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3cd41567e0 0x7f3cd40b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd8880640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3cd4160460 0x7f3cd415d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd8880640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd40b4620 con 0x7f3cd40b3c40 2024-09-15T23:56:46.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd8880640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd40b4900 con 0x7f3cd4160460 2024-09-15T23:56:46.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd8880640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd40b4be0 con 0x7f3cd41567e0 2024-09-15T23:56:46.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd1d9b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3cd40b3c40 0x7f3cd415fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53376/0 (socket says 172.21.15.112:53376) 2024-09-15T23:56:46.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd1d9b640 1 -- 172.21.15.112:0/336445537 learned_addr learned my addr 172.21.15.112:0/336445537 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:46.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd2d9d640 1 --2- 172.21.15.112:0/336445537 >> v2:172.21.15.112:3300/0 conn(0x7f3cd4160460 0x7f3cd415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd259c640 1 --2- 172.21.15.112:0/336445537 >> v2:172.21.15.169:3300/0 conn(0x7f3cd41567e0 0x7f3cd40b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd159a640 1 -- 172.21.15.112:0/336445537 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3822016398 0 0) 0x7f3cd40b4620 con 0x7f3cd40b3c40 2024-09-15T23:56:46.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd159a640 1 -- 172.21.15.112:0/336445537 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cbc003530 con 0x7f3cd40b3c40 2024-09-15T23:56:46.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd2d9d640 1 -- 172.21.15.112:0/336445537 >> v2:172.21.15.169:3300/0 conn(0x7f3cd41567e0 msgr2=0x7f3cd40b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:46.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd2d9d640 1 --2- 172.21.15.112:0/336445537 >> v2:172.21.15.169:3300/0 conn(0x7f3cd41567e0 0x7f3cd40b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd2d9d640 1 -- 172.21.15.112:0/336445537 >> v1:172.21.15.112:6789/0 conn(0x7f3cd40b3c40 legacy=0x7f3cd415fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.046+0000 7f3cd2d9d640 1 -- 172.21.15.112:0/336445537 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd40b4ec0 con 0x7f3cd4160460 2024-09-15T23:56:46.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd2d9d640 1 --2- 172.21.15.112:0/336445537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd4160460 0x7f3cd415d920 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009d90 tx=0x7f3cc401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e296ad339a3325f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:46.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd159a640 1 -- 172.21.15.112:0/336445537 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40b2070 con 0x7f3cd4160460 2024-09-15T23:56:46.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd159a640 1 -- 172.21.15.112:0/336445537 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc40a5950 con 0x7f3cd4160460 2024-09-15T23:56:46.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd159a640 1 -- 172.21.15.112:0/336445537 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40a5d00 con 0x7f3cd4160460 2024-09-15T23:56:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 -- 172.21.15.112:0/336445537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd4160460 msgr2=0x7f3cd415d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 --2- 172.21.15.112:0/336445537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd4160460 0x7f3cd415d920 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009d90 tx=0x7f3cc401c870 comp rx=0 tx=0).stop 2024-09-15T23:56:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 -- 172.21.15.112:0/336445537 shutdown_connections 2024-09-15T23:56:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 --2- 172.21.15.112:0/336445537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd4160460 0x7f3cd415d920 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 --2- 172.21.15.112:0/336445537 >> v2:172.21.15.169:3300/0 conn(0x7f3cd41567e0 0x7f3cd40b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 -- 172.21.15.112:0/336445537 >> 172.21.15.112:0/336445537 conn(0x7f3cd4073580 msgr2=0x7f3cd406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 -- 172.21.15.112:0/336445537 shutdown_connections 2024-09-15T23:56:46.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 -- 172.21.15.112:0/336445537 wait complete. 2024-09-15T23:56:46.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 Processor -- start 2024-09-15T23:56:46.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 -- start start 2024-09-15T23:56:46.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3cd40b3c40 0x7f3cd41551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cd41567e0 0x7f3cd4152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd4160460 0x7f3cd4152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd4160b50 con 0x7f3cd4160460 2024-09-15T23:56:46.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd41609d0 con 0x7f3cd41567e0 2024-09-15T23:56:46.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.050+0000 7f3cd8880640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd415e270 con 0x7f3cd40b3c40 2024-09-15T23:56:46.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd4160460 0x7f3cd4152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd4160460 0x7f3cd4152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33062/0 (socket says 172.21.15.112:33062) 2024-09-15T23:56:46.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd2d9d640 1 -- 172.21.15.112:0/1353689199 learned_addr learned my addr 172.21.15.112:0/1353689199 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:46.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd1d9b640 1 --2- 172.21.15.112:0/1353689199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cd41567e0 0x7f3cd4152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd2d9d640 1 -- 172.21.15.112:0/1353689199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3cd40b3c40 msgr2=0x7f3cd41551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd2d9d640 1 --2- 172.21.15.112:0/1353689199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3cd40b3c40 0x7f3cd41551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd2d9d640 1 -- 172.21.15.112:0/1353689199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cd41567e0 msgr2=0x7f3cd4152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd2d9d640 1 --2- 172.21.15.112:0/1353689199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cd41567e0 0x7f3cd4152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd2d9d640 1 -- 172.21.15.112:0/1353689199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd4155c30 con 0x7f3cd4160460 2024-09-15T23:56:46.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd1d9b640 1 --2- 172.21.15.112:0/1353689199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cd41567e0 0x7f3cd4152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:46.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd2d9d640 1 --2- 172.21.15.112:0/1353689199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd4160460 0x7f3cd4152a90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4019480 tx=0x7f3cc4019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:46.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cc2ffd640 1 -- 172.21.15.112:0/1353689199 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40b2050 con 0x7f3cd4160460 2024-09-15T23:56:46.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cc2ffd640 1 -- 172.21.15.112:0/1353689199 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc40be070 con 0x7f3cd4160460 2024-09-15T23:56:46.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd8880640 1 -- 172.21.15.112:0/1353689199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd4155950 con 0x7f3cd4160460 2024-09-15T23:56:46.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cc2ffd640 1 -- 172.21.15.112:0/1353689199 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4004040 con 0x7f3cd4160460 2024-09-15T23:56:46.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd8880640 1 -- 172.21.15.112:0/1353689199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd4161290 con 0x7f3cd4160460 2024-09-15T23:56:46.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd8880640 1 -- 172.21.15.112:0/1353689199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd40b56c0 con 0x7f3cd4160460 2024-09-15T23:56:46.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cc2ffd640 1 -- 172.21.15.112:0/1353689199 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3cc40041e0 con 0x7f3cd4160460 2024-09-15T23:56:46.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cc2ffd640 1 --2- 172.21.15.112:0/1353689199 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3cb40678c0 0x7f3cb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cc2ffd640 1 -- 172.21.15.112:0/1353689199 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f3cc4120bb0 con 0x7f3cd4160460 2024-09-15T23:56:46.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd259c640 1 --2- 172.21.15.112:0/1353689199 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3cb40678c0 0x7f3cb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.054+0000 7f3cd259c640 1 --2- 172.21.15.112:0/1353689199 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3cb40678c0 0x7f3cb4069d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0098f0 tx=0x7f3ccc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:46.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.058+0000 7f3cc2ffd640 1 -- 172.21.15.112:0/1353689199 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3cc4016520 con 0x7f3cd4160460 2024-09-15T23:56:46.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.222+0000 7f3cd8880640 1 -- 172.21.15.112:0/1353689199 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f3cd4070e20 con 0x7f3cd4160460 2024-09-15T23:56:46.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.226+0000 7f3cc2ffd640 1 -- 172.21.15.112:0/1353689199 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f3cc40f18f0 con 0x7f3cd4160460 2024-09-15T23:56:46.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.230+0000 7f3cd8880640 1 -- 172.21.15.112:0/1353689199 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3cb40678c0 msgr2=0x7f3cb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.230+0000 7f3cd8880640 1 --2- 172.21.15.112:0/1353689199 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3cb40678c0 0x7f3cb4069d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0098f0 tx=0x7f3ccc008040 comp rx=0 tx=0).stop 2024-09-15T23:56:46.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.230+0000 7f3cd8880640 1 -- 172.21.15.112:0/1353689199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd4160460 msgr2=0x7f3cd4152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.230+0000 7f3cd8880640 1 --2- 172.21.15.112:0/1353689199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd4160460 0x7f3cd4152a90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4019480 tx=0x7f3cc4019610 comp rx=0 tx=0).stop 2024-09-15T23:56:46.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.230+0000 7f3cd8880640 1 -- 172.21.15.112:0/1353689199 shutdown_connections 2024-09-15T23:56:46.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.230+0000 7f3cd8880640 1 --2- 172.21.15.112:0/1353689199 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3cb40678c0 0x7f3cb4069d80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.230+0000 7f3cd8880640 1 --2- 172.21.15.112:0/1353689199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3cd4160460 0x7f3cd4152a90 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.230+0000 7f3cd8880640 1 --2- 172.21.15.112:0/1353689199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cd41567e0 0x7f3cd4152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.230+0000 7f3cd8880640 1 --2- 172.21.15.112:0/1353689199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3cd40b3c40 0x7f3cd41551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.230+0000 7f3cd8880640 1 -- 172.21.15.112:0/1353689199 >> 172.21.15.112:0/1353689199 conn(0x7f3cd4073580 msgr2=0x7f3cd40b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:46.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.230+0000 7f3cd8880640 1 -- 172.21.15.112:0/1353689199 shutdown_connections 2024-09-15T23:56:46.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.230+0000 7f3cd8880640 1 -- 172.21.15.112:0/1353689199 wait complete. 2024-09-15T23:56:46.252 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_merge_size 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.374+0000 7f99112cf640 1 Processor -- start 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.374+0000 7f99112cf640 1 -- start start 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.374+0000 7f99112cf640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f990c1520a0 0x7f990c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.374+0000 7f99112cf640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f990c06fe50 0x7f990c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.374+0000 7f99112cf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f990c15f1d0 0x7f990c071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.374+0000 7f99112cf640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f990c152480 con 0x7f990c06fe50 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.374+0000 7f99112cf640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f990c070250 con 0x7f990c1520a0 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.374+0000 7f99112cf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f990c0aede0 con 0x7f990c15f1d0 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.374+0000 7f990a7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f990c06fe50 0x7f990c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.374+0000 7f990a7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f990c06fe50 0x7f990c15ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33074/0 (socket says 172.21.15.112:33074) 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.374+0000 7f990a7fc640 1 -- 172.21.15.112:0/2809740078 learned_addr learned my addr 172.21.15.112:0/2809740078 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f990affd640 1 --2- 172.21.15.112:0/2809740078 >> v2:172.21.15.169:3300/0 conn(0x7f990c1520a0 0x7f990c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f990a7fc640 1 -- 172.21.15.112:0/2809740078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f990c15f1d0 msgr2=0x7f990c071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f990b7fe640 1 --2- 172.21.15.112:0/2809740078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f990c15f1d0 0x7f990c071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f990a7fc640 1 --2- 172.21.15.112:0/2809740078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f990c15f1d0 0x7f990c071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f990a7fc640 1 -- 172.21.15.112:0/2809740078 >> v2:172.21.15.169:3300/0 conn(0x7f990c1520a0 msgr2=0x7f990c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f990a7fc640 1 --2- 172.21.15.112:0/2809740078 >> v2:172.21.15.169:3300/0 conn(0x7f990c1520a0 0x7f990c06f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f990a7fc640 1 -- 172.21.15.112:0/2809740078 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c15fa10 con 0x7f990c06fe50 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f990b7fe640 1 --2- 172.21.15.112:0/2809740078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f990c15f1d0 0x7f990c071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f990affd640 1 --2- 172.21.15.112:0/2809740078 >> v2:172.21.15.169:3300/0 conn(0x7f990c1520a0 0x7f990c06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:46.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f990a7fc640 1 --2- 172.21.15.112:0/2809740078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c06fe50 0x7f990c15ec90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f990c071710 tx=0x7f98fc01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8bf0bcfca70bd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:46.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f9909ffb640 1 -- 172.21.15.112:0/2809740078 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0b0070 con 0x7f990c06fe50 2024-09-15T23:56:46.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f9909ffb640 1 -- 172.21.15.112:0/2809740078 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98fc0ab600 con 0x7f990c06fe50 2024-09-15T23:56:46.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f9909ffb640 1 -- 172.21.15.112:0/2809740078 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0ab9d0 con 0x7f990c06fe50 2024-09-15T23:56:46.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f99112cf640 1 -- 172.21.15.112:0/2809740078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c06fe50 msgr2=0x7f990c15ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f99112cf640 1 --2- 172.21.15.112:0/2809740078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c06fe50 0x7f990c15ec90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f990c071710 tx=0x7f98fc01c240 comp rx=0 tx=0).stop 2024-09-15T23:56:46.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f99112cf640 1 -- 172.21.15.112:0/2809740078 shutdown_connections 2024-09-15T23:56:46.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f99112cf640 1 --2- 172.21.15.112:0/2809740078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c06fe50 0x7f990c15ec90 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f99112cf640 1 --2- 172.21.15.112:0/2809740078 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f990c15f1d0 0x7f990c071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f99112cf640 1 --2- 172.21.15.112:0/2809740078 >> v2:172.21.15.169:3300/0 conn(0x7f990c1520a0 0x7f990c06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f99112cf640 1 -- 172.21.15.112:0/2809740078 >> 172.21.15.112:0/2809740078 conn(0x7f990c0b1f90 msgr2=0x7f990c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:46.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f99112cf640 1 -- 172.21.15.112:0/2809740078 shutdown_connections 2024-09-15T23:56:46.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.378+0000 7f99112cf640 1 -- 172.21.15.112:0/2809740078 wait complete. 2024-09-15T23:56:46.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f99112cf640 1 Processor -- start 2024-09-15T23:56:46.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f99112cf640 1 -- start start 2024-09-15T23:56:46.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f99112cf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f990c06fe50 0x7f990c144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f99112cf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f990c1520a0 0x7f990c099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f99112cf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c15f1d0 0x7f990c0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f99112cf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f990c073d30 con 0x7f990c15f1d0 2024-09-15T23:56:46.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f99112cf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f990c073a50 con 0x7f990c06fe50 2024-09-15T23:56:46.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f99112cf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f990c15f5e0 con 0x7f990c1520a0 2024-09-15T23:56:46.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f990b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c15f1d0 0x7f990c0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f990b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c15f1d0 0x7f990c0b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33078/0 (socket says 172.21.15.112:33078) 2024-09-15T23:56:46.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f990b7fe640 1 -- 172.21.15.112:0/1261448986 learned_addr learned my addr 172.21.15.112:0/1261448986 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:46.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f990affd640 1 --2- 172.21.15.112:0/1261448986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f990c06fe50 0x7f990c144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f990a7fc640 1 --2- 172.21.15.112:0/1261448986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f990c1520a0 0x7f990c099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f990b7fe640 1 -- 172.21.15.112:0/1261448986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f990c1520a0 msgr2=0x7f990c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f990b7fe640 1 --2- 172.21.15.112:0/1261448986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f990c1520a0 0x7f990c099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f990b7fe640 1 -- 172.21.15.112:0/1261448986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f990c06fe50 msgr2=0x7f990c144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f990b7fe640 1 --2- 172.21.15.112:0/1261448986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f990c06fe50 0x7f990c144cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f990b7fe640 1 -- 172.21.15.112:0/1261448986 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c0b0c90 con 0x7f990c15f1d0 2024-09-15T23:56:46.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f990b7fe640 1 --2- 172.21.15.112:0/1261448986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c15f1d0 0x7f990c0b0750 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f990400cef0 tx=0x7f990400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:46.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f98f37fe640 1 -- 172.21.15.112:0/1261448986 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990401a070 con 0x7f990c15f1d0 2024-09-15T23:56:46.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f98f37fe640 1 -- 172.21.15.112:0/1261448986 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990400d860 con 0x7f990c15f1d0 2024-09-15T23:56:46.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f99112cf640 1 -- 172.21.15.112:0/1261448986 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f990c145340 con 0x7f990c15f1d0 2024-09-15T23:56:46.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f98f37fe640 1 -- 172.21.15.112:0/1261448986 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990400dc50 con 0x7f990c15f1d0 2024-09-15T23:56:46.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f99112cf640 1 -- 172.21.15.112:0/1261448986 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f990c145900 con 0x7f990c15f1d0 2024-09-15T23:56:46.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f99112cf640 1 -- 172.21.15.112:0/1261448986 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f990c06f910 con 0x7f990c15f1d0 2024-09-15T23:56:46.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f98f37fe640 1 -- 172.21.15.112:0/1261448986 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f990401d070 con 0x7f990c15f1d0 2024-09-15T23:56:46.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.382+0000 7f98f37fe640 1 --2- 172.21.15.112:0/1261448986 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f98f80678c0 0x7f98f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.386+0000 7f98f37fe640 1 -- 172.21.15.112:0/1261448986 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f9904086380 con 0x7f990c15f1d0 2024-09-15T23:56:46.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.386+0000 7f990affd640 1 --2- 172.21.15.112:0/1261448986 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f98f80678c0 0x7f98f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.386+0000 7f990affd640 1 --2- 172.21.15.112:0/1261448986 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f98f80678c0 0x7f98f8069d80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9900006b20 tx=0x7f9900008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:46.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.390+0000 7f98f37fe640 1 -- 172.21.15.112:0/1261448986 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f990c0b0c90 con 0x7f990c15f1d0 2024-09-15T23:56:46.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.542+0000 7f99112cf640 1 -- 172.21.15.112:0/1261448986 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"} v 0) -- 0x7f990c0b2c60 con 0x7f990c15f1d0 2024-09-15T23:56:46.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.546+0000 7f98f37fe640 1 -- 172.21.15.112:0/1261448986 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"}]=0 v20) ==== 101+0+0 (secure 0 0 0) 0x7f99040570f0 con 0x7f990c15f1d0 2024-09-15T23:56:46.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.550+0000 7f99112cf640 1 -- 172.21.15.112:0/1261448986 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f98f80678c0 msgr2=0x7f98f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.550+0000 7f99112cf640 1 --2- 172.21.15.112:0/1261448986 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f98f80678c0 0x7f98f8069d80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9900006b20 tx=0x7f9900008040 comp rx=0 tx=0).stop 2024-09-15T23:56:46.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.550+0000 7f99112cf640 1 -- 172.21.15.112:0/1261448986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c15f1d0 msgr2=0x7f990c0b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.550+0000 7f99112cf640 1 --2- 172.21.15.112:0/1261448986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c15f1d0 0x7f990c0b0750 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f990400cef0 tx=0x7f990400a710 comp rx=0 tx=0).stop 2024-09-15T23:56:46.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.550+0000 7f99112cf640 1 -- 172.21.15.112:0/1261448986 shutdown_connections 2024-09-15T23:56:46.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.550+0000 7f99112cf640 1 --2- 172.21.15.112:0/1261448986 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f98f80678c0 0x7f98f8069d80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.550+0000 7f99112cf640 1 --2- 172.21.15.112:0/1261448986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c15f1d0 0x7f990c0b0750 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.550+0000 7f99112cf640 1 --2- 172.21.15.112:0/1261448986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f990c1520a0 0x7f990c099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.550+0000 7f99112cf640 1 --2- 172.21.15.112:0/1261448986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f990c06fe50 0x7f990c144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.550+0000 7f99112cf640 1 -- 172.21.15.112:0/1261448986 >> 172.21.15.112:0/1261448986 conn(0x7f990c0b1f90 msgr2=0x7f990c1505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:46.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.550+0000 7f99112cf640 1 -- 172.21.15.112:0/1261448986 shutdown_connections 2024-09-15T23:56:46.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.550+0000 7f99112cf640 1 -- 172.21.15.112:0/1261448986 wait complete. 2024-09-15T23:56:46.566 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_fragment_size_max 2024-09-15T23:56:46.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.686+0000 7f5a78760640 1 Processor -- start 2024-09-15T23:56:46.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.686+0000 7f5a78760640 1 -- start start 2024-09-15T23:56:46.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.686+0000 7f5a78760640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5a7015c2a0 0x7f5a700aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.686+0000 7f5a78760640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a700b3290 con 0x7f5a700af2a0 2024-09-15T23:56:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.686+0000 7f5a78760640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a700b3570 con 0x7f5a7015bec0 2024-09-15T23:56:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.686+0000 7f5a78760640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f5a700b3850 con 0x7f5a7015c2a0 2024-09-15T23:56:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a76cfd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5a700af2a0 0x7f5a7006e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:53380/0 (socket says 172.21.15.112:53380) 2024-09-15T23:56:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a76cfd640 1 -- 172.21.15.112:0/3011946241 learned_addr learned my addr 172.21.15.112:0/3011946241 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a75cfb640 1 --2- 172.21.15.112:0/3011946241 >> v2:172.21.15.169:3300/0 conn(0x7f5a7015c2a0 0x7f5a700aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 -- 172.21.15.112:0/3011946241 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4188619133 0 0) 0x7f5a700b3290 con 0x7f5a700af2a0 2024-09-15T23:56:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 -- 172.21.15.112:0/3011946241 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a5c003530 con 0x7f5a700af2a0 2024-09-15T23:56:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 -- 172.21.15.112:0/3011946241 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1083263131 0 0) 0x7f5a5c003530 con 0x7f5a700af2a0 2024-09-15T23:56:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 -- 172.21.15.112:0/3011946241 >> v2:172.21.15.169:3300/0 conn(0x7f5a7015c2a0 msgr2=0x7f5a700aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 --2- 172.21.15.112:0/3011946241 >> v2:172.21.15.169:3300/0 conn(0x7f5a7015c2a0 0x7f5a700aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 -- 172.21.15.112:0/3011946241 >> v1:172.21.15.169:6789/0 conn(0x7f5a7015bec0 legacy=0x7f5a700ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 -- 172.21.15.112:0/3011946241 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a700b3b30 con 0x7f5a700af2a0 2024-09-15T23:56:46.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 -- 172.21.15.112:0/3011946241 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f5a6c001680 con 0x7f5a700af2a0 2024-09-15T23:56:46.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 -- 172.21.15.112:0/3011946241 >> v1:172.21.15.112:6789/0 conn(0x7f5a700af2a0 legacy=0x7f5a7006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 --2- 172.21.15.112:0/3011946241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a5c0039c0 0x7f5a5c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 --2- 172.21.15.112:0/3011946241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a5c004810 0x7f5a5c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 --2- 172.21.15.112:0/3011946241 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a5c0051d0 0x7f5a5c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 -- 172.21.15.112:0/3011946241 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5a700b3850 con 0x7f5a5c0039c0 2024-09-15T23:56:46.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 -- 172.21.15.112:0/3011946241 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c00c070 con 0x7f5a5c004810 2024-09-15T23:56:46.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 -- 172.21.15.112:0/3011946241 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5a5c00c270 con 0x7f5a5c0051d0 2024-09-15T23:56:46.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a764fc640 1 --2- 172.21.15.112:0/3011946241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a5c0039c0 0x7f5a5c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a75cfb640 1 --2- 172.21.15.112:0/3011946241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a5c004810 0x7f5a5c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a764fc640 1 -- 172.21.15.112:0/3011946241 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a5c0051d0 msgr2=0x7f5a5c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:46.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a76cfd640 1 --2- 172.21.15.112:0/3011946241 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a5c0051d0 0x7f5a5c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a764fc640 1 --2- 172.21.15.112:0/3011946241 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a5c0051d0 0x7f5a5c00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a764fc640 1 -- 172.21.15.112:0/3011946241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a5c004810 msgr2=0x7f5a5c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:46.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a764fc640 1 --2- 172.21.15.112:0/3011946241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a5c004810 0x7f5a5c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a76cfd640 1 -- 172.21.15.112:0/3011946241 reap_dead start 2024-09-15T23:56:46.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a764fc640 1 -- 172.21.15.112:0/3011946241 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5c003530 con 0x7f5a5c0039c0 2024-09-15T23:56:46.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a764fc640 1 --2- 172.21.15.112:0/3011946241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a5c0039c0 0x7f5a5c003de0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5a68001e70 tx=0x7f5a6801c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9022eca68933fb05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:46.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 -- 172.21.15.112:0/3011946241 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68001a90 con 0x7f5a5c0039c0 2024-09-15T23:56:46.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 -- 172.21.15.112:0/3011946241 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a68003b80 con 0x7f5a5c0039c0 2024-09-15T23:56:46.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a754fa640 1 -- 172.21.15.112:0/3011946241 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68005080 con 0x7f5a5c0039c0 2024-09-15T23:56:46.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a78760640 1 -- 172.21.15.112:0/3011946241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a5c0039c0 msgr2=0x7f5a5c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.690+0000 7f5a78760640 1 --2- 172.21.15.112:0/3011946241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a5c0039c0 0x7f5a5c003de0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5a68001e70 tx=0x7f5a6801c730 comp rx=0 tx=0).stop 2024-09-15T23:56:46.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 -- 172.21.15.112:0/3011946241 shutdown_connections 2024-09-15T23:56:46.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 --2- 172.21.15.112:0/3011946241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a5c0039c0 0x7f5a5c003de0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 -- 172.21.15.112:0/3011946241 >> 172.21.15.112:0/3011946241 conn(0x7f5a700b1f90 msgr2=0x7f5a700b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:46.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 -- 172.21.15.112:0/3011946241 shutdown_connections 2024-09-15T23:56:46.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 -- 172.21.15.112:0/3011946241 wait complete. 2024-09-15T23:56:46.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 Processor -- start 2024-09-15T23:56:46.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 -- start start 2024-09-15T23:56:46.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a5c0039c0 0x7f5a70152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a7009dd80 0x7f5a701527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a70155130 0x7f5a701555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5a700af680 con 0x7f5a70155130 2024-09-15T23:56:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5a700ad610 con 0x7f5a7009dd80 2024-09-15T23:56:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5a70152d00 con 0x7f5a5c0039c0 2024-09-15T23:56:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a76cfd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a70155130 0x7f5a701555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a76cfd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a70155130 0x7f5a701555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33096/0 (socket says 172.21.15.112:33096) 2024-09-15T23:56:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a76cfd640 1 -- 172.21.15.112:0/3860446179 learned_addr learned my addr 172.21.15.112:0/3860446179 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a76cfd640 1 -- 172.21.15.112:0/3860446179 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a5c0039c0 msgr2=0x7f5a70152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a76cfd640 1 --2- 172.21.15.112:0/3860446179 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a5c0039c0 0x7f5a70152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a76cfd640 1 -- 172.21.15.112:0/3860446179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a7009dd80 msgr2=0x7f5a701527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a76cfd640 1 --2- 172.21.15.112:0/3860446179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a7009dd80 0x7f5a701527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a76cfd640 1 -- 172.21.15.112:0/3860446179 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7009e200 con 0x7f5a70155130 2024-09-15T23:56:46.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a76cfd640 1 --2- 172.21.15.112:0/3860446179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a70155130 0x7f5a701555b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5a7015c680 tx=0x7f5a6c00d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:46.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a66ffd640 1 -- 172.21.15.112:0/3860446179 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0074e0 con 0x7f5a70155130 2024-09-15T23:56:46.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a66ffd640 1 -- 172.21.15.112:0/3860446179 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0047f0 con 0x7f5a70155130 2024-09-15T23:56:46.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 -- 172.21.15.112:0/3860446179 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a701e9a20 con 0x7f5a70155130 2024-09-15T23:56:46.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a66ffd640 1 -- 172.21.15.112:0/3860446179 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c007680 con 0x7f5a70155130 2024-09-15T23:56:46.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.694+0000 7f5a78760640 1 -- 172.21.15.112:0/3860446179 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a701e9fe0 con 0x7f5a70155130 2024-09-15T23:56:46.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.698+0000 7f5a78760640 1 -- 172.21.15.112:0/3860446179 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a70155af0 con 0x7f5a70155130 2024-09-15T23:56:46.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.698+0000 7f5a66ffd640 1 -- 172.21.15.112:0/3860446179 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a6c01b020 con 0x7f5a70155130 2024-09-15T23:56:46.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.698+0000 7f5a66ffd640 1 --2- 172.21.15.112:0/3860446179 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a540678f0 0x7f5a54069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:46.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.698+0000 7f5a66ffd640 1 -- 172.21.15.112:0/3860446179 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f5a6c085580 con 0x7f5a70155130 2024-09-15T23:56:46.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.698+0000 7f5a764fc640 1 --2- 172.21.15.112:0/3860446179 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a540678f0 0x7f5a54069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:46.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.698+0000 7f5a764fc640 1 --2- 172.21.15.112:0/3860446179 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a540678f0 0x7f5a54069db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5a68005000 tx=0x7f5a680014b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:46.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.702+0000 7f5a66ffd640 1 -- 172.21.15.112:0/3860446179 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5a6c00f2f0 con 0x7f5a70155130 2024-09-15T23:56:46.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.866+0000 7f5a78760640 1 -- 172.21.15.112:0/3860446179 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_fragment_size_max"} v 0) -- 0x7f5a70160470 con 0x7f5a70155130 2024-09-15T23:56:46.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.874+0000 7f5a66ffd640 1 -- 172.21.15.112:0/3860446179 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_fragment_size_max"}]=0 v21) ==== 108+0+0 (secure 0 0 0) 0x7f5a6c056230 con 0x7f5a70155130 2024-09-15T23:56:46.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.874+0000 7f5a78760640 1 -- 172.21.15.112:0/3860446179 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a540678f0 msgr2=0x7f5a54069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.874+0000 7f5a78760640 1 --2- 172.21.15.112:0/3860446179 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a540678f0 0x7f5a54069db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5a68005000 tx=0x7f5a680014b0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.874+0000 7f5a78760640 1 -- 172.21.15.112:0/3860446179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a70155130 msgr2=0x7f5a701555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:46.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.874+0000 7f5a78760640 1 --2- 172.21.15.112:0/3860446179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a70155130 0x7f5a701555b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5a7015c680 tx=0x7f5a6c00d960 comp rx=0 tx=0).stop 2024-09-15T23:56:46.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.874+0000 7f5a78760640 1 -- 172.21.15.112:0/3860446179 shutdown_connections 2024-09-15T23:56:46.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.874+0000 7f5a78760640 1 --2- 172.21.15.112:0/3860446179 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a540678f0 0x7f5a54069db0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.874+0000 7f5a78760640 1 --2- 172.21.15.112:0/3860446179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a70155130 0x7f5a701555b0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.874+0000 7f5a78760640 1 --2- 172.21.15.112:0/3860446179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a7009dd80 0x7f5a701527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.874+0000 7f5a78760640 1 --2- 172.21.15.112:0/3860446179 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a5c0039c0 0x7f5a70152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:46.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.874+0000 7f5a78760640 1 -- 172.21.15.112:0/3860446179 >> 172.21.15.112:0/3860446179 conn(0x7f5a700b1f90 msgr2=0x7f5a700b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:46.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.874+0000 7f5a78760640 1 -- 172.21.15.112:0/3860446179 shutdown_connections 2024-09-15T23:56:46.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:46.874+0000 7f5a78760640 1 -- 172.21.15.112:0/3860446179 wait complete. 2024-09-15T23:56:46.893 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_fragmented' 2024-09-15T23:56:47.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.010+0000 7febc215f640 1 Processor -- start 2024-09-15T23:56:47.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.010+0000 7febc215f640 1 -- start start 2024-09-15T23:56:47.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febc215f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febbc0b3330 0x7febbc0b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:47.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febc215f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7febbc0b51b0 0x7febbc0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:47.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febc215f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febbc0b3c50 con 0x7febbc15b570 2024-09-15T23:56:47.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febc215f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7febbc0d0b80 con 0x7febbc0b51b0 2024-09-15T23:56:47.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febc215f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7febbc0d0e60 con 0x7febbc0b3330 2024-09-15T23:56:47.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febbaffd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7febbc0b51b0 0x7febbc0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:47.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febbb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febbc0b3330 0x7febbc0b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:47.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febbbfff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7febbc15b570 0x7febbc0cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:40638/0 (socket says 172.21.15.112:40638) 2024-09-15T23:56:47.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febbbfff640 1 -- 172.21.15.112:0/1419707803 learned_addr learned my addr 172.21.15.112:0/1419707803 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:47.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febbb7fe640 1 -- 172.21.15.112:0/1419707803 >> v2:172.21.15.169:3300/0 conn(0x7febbc0b51b0 msgr2=0x7febbc0b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:47.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febbb7fe640 1 --2- 172.21.15.112:0/1419707803 >> v2:172.21.15.169:3300/0 conn(0x7febbc0b51b0 0x7febbc0b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:47.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febbb7fe640 1 -- 172.21.15.112:0/1419707803 >> v1:172.21.15.169:6789/0 conn(0x7febbc15b570 legacy=0x7febbc0cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:47.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febbb7fe640 1 -- 172.21.15.112:0/1419707803 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febbc0b46d0 con 0x7febbc0b3330 2024-09-15T23:56:47.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febbaffd640 1 --2- 172.21.15.112:0/1419707803 >> v2:172.21.15.169:3300/0 conn(0x7febbc0b51b0 0x7febbc0b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:56:47.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febbb7fe640 1 --2- 172.21.15.112:0/1419707803 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febbc0b3330 0x7febbc0b3710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7febb4009d90 tx=0x7febb401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5de9aef1ba15dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:47.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febba7fc640 1 -- 172.21.15.112:0/1419707803 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb40b2070 con 0x7febbc0b3330 2024-09-15T23:56:47.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febba7fc640 1 -- 172.21.15.112:0/1419707803 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb40a57a0 con 0x7febbc0b3330 2024-09-15T23:56:47.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.014+0000 7febba7fc640 1 -- 172.21.15.112:0/1419707803 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb40a5b70 con 0x7febbc0b3330 2024-09-15T23:56:47.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 -- 172.21.15.112:0/1419707803 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febbc0b3330 msgr2=0x7febbc0b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:47.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 --2- 172.21.15.112:0/1419707803 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febbc0b3330 0x7febbc0b3710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7febb4009d90 tx=0x7febb401c8e0 comp rx=0 tx=0).stop 2024-09-15T23:56:47.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 -- 172.21.15.112:0/1419707803 shutdown_connections 2024-09-15T23:56:47.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 --2- 172.21.15.112:0/1419707803 >> v2:172.21.15.169:3300/0 conn(0x7febbc0b51b0 0x7febbc0b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:47.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 --2- 172.21.15.112:0/1419707803 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febbc0b3330 0x7febbc0b3710 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:47.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 -- 172.21.15.112:0/1419707803 >> 172.21.15.112:0/1419707803 conn(0x7febbc0b6870 msgr2=0x7febbc0b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:47.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 -- 172.21.15.112:0/1419707803 shutdown_connections 2024-09-15T23:56:47.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 -- 172.21.15.112:0/1419707803 wait complete. 2024-09-15T23:56:47.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 Processor -- start 2024-09-15T23:56:47.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 -- start start 2024-09-15T23:56:47.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febbc0b3330 0x7febbc15cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:47.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febbc0b51b0 0x7febbc1385e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:47.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febbc15b570 0x7febbc13ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:47.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7febbc144e80 con 0x7febbc15b570 2024-09-15T23:56:47.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7febbc144d00 con 0x7febbc0b51b0 2024-09-15T23:56:47.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febc215f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7febbc168350 con 0x7febbc0b3330 2024-09-15T23:56:47.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febbbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febbc15b570 0x7febbc13ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:47.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febbbfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febbc15b570 0x7febbc13ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33108/0 (socket says 172.21.15.112:33108) 2024-09-15T23:56:47.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febbbfff640 1 -- 172.21.15.112:0/2856460883 learned_addr learned my addr 172.21.15.112:0/2856460883 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:47.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febbb7fe640 1 --2- 172.21.15.112:0/2856460883 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febbc0b3330 0x7febbc15cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:47.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febbaffd640 1 --2- 172.21.15.112:0/2856460883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febbc0b51b0 0x7febbc1385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:47.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febbbfff640 1 -- 172.21.15.112:0/2856460883 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febbc0b3330 msgr2=0x7febbc15cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:47.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febbbfff640 1 --2- 172.21.15.112:0/2856460883 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febbc0b3330 0x7febbc15cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:47.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febbbfff640 1 -- 172.21.15.112:0/2856460883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febbc0b51b0 msgr2=0x7febbc1385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:47.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febbbfff640 1 --2- 172.21.15.112:0/2856460883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febbc0b51b0 0x7febbc1385e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:47.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febbbfff640 1 -- 172.21.15.112:0/2856460883 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febbc138b20 con 0x7febbc15b570 2024-09-15T23:56:47.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.018+0000 7febbbfff640 1 --2- 172.21.15.112:0/2856460883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febbc15b570 0x7febbc13ce10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7febac00c400 tx=0x7febac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:47.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.022+0000 7febb3fff640 1 -- 172.21.15.112:0/2856460883 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febac017070 con 0x7febbc15b570 2024-09-15T23:56:47.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.022+0000 7febb3fff640 1 -- 172.21.15.112:0/2856460883 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febac005cf0 con 0x7febbc15b570 2024-09-15T23:56:47.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.022+0000 7febc215f640 1 -- 172.21.15.112:0/2856460883 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febbc138df0 con 0x7febbc15b570 2024-09-15T23:56:47.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.022+0000 7febb3fff640 1 -- 172.21.15.112:0/2856460883 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febac0072d0 con 0x7febbc15b570 2024-09-15T23:56:47.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.022+0000 7febc215f640 1 -- 172.21.15.112:0/2856460883 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febbc15da90 con 0x7febbc15b570 2024-09-15T23:56:47.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.022+0000 7febc215f640 1 -- 172.21.15.112:0/2856460883 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febbc0b3710 con 0x7febbc15b570 2024-09-15T23:56:47.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.022+0000 7febb3fff640 1 -- 172.21.15.112:0/2856460883 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7febac01a070 con 0x7febbc15b570 2024-09-15T23:56:47.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.022+0000 7febb3fff640 1 --2- 172.21.15.112:0/2856460883 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feb9c0678c0 0x7feb9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:47.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.022+0000 7febb3fff640 1 -- 172.21.15.112:0/2856460883 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7febac084d80 con 0x7febbc15b570 2024-09-15T23:56:47.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.022+0000 7febbb7fe640 1 --2- 172.21.15.112:0/2856460883 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feb9c0678c0 0x7feb9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:47.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.022+0000 7febbb7fe640 1 --2- 172.21.15.112:0/2856460883 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feb9c0678c0 0x7feb9c069d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7febb40af000 tx=0x7febb40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:47.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.026+0000 7febb3fff640 1 -- 172.21.15.112:0/2856460883 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7febac055470 con 0x7febbc15b570 2024-09-15T23:56:47.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.250+0000 7febc215f640 1 -- 172.21.15.112:0/2856460883 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_fragmented"]} v 0) -- 0x7febbc0b1620 con 0x7febbc15b570 2024-09-15T23:56:47.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.898+0000 7febb3fff640 1 -- 172.21.15.112:0/2856460883 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_fragmented"]}]=0 v165) ==== 144+0+0 (secure 0 0 0) 0x7febac059770 con 0x7febbc15b570 2024-09-15T23:56:47.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.902+0000 7febc215f640 1 -- 172.21.15.112:0/2856460883 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feb9c0678c0 msgr2=0x7feb9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:47.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.902+0000 7febc215f640 1 --2- 172.21.15.112:0/2856460883 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feb9c0678c0 0x7feb9c069d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7febb40af000 tx=0x7febb40a7070 comp rx=0 tx=0).stop 2024-09-15T23:56:47.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.902+0000 7febc215f640 1 -- 172.21.15.112:0/2856460883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febbc15b570 msgr2=0x7febbc13ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:47.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.902+0000 7febc215f640 1 --2- 172.21.15.112:0/2856460883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febbc15b570 0x7febbc13ce10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7febac00c400 tx=0x7febac00c8c0 comp rx=0 tx=0).stop 2024-09-15T23:56:47.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.902+0000 7febc215f640 1 -- 172.21.15.112:0/2856460883 shutdown_connections 2024-09-15T23:56:47.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.902+0000 7febc215f640 1 --2- 172.21.15.112:0/2856460883 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feb9c0678c0 0x7feb9c069d80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:47.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.902+0000 7febc215f640 1 --2- 172.21.15.112:0/2856460883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febbc15b570 0x7febbc13ce10 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:47.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.902+0000 7febc215f640 1 --2- 172.21.15.112:0/2856460883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febbc0b51b0 0x7febbc1385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:47.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.902+0000 7febc215f640 1 --2- 172.21.15.112:0/2856460883 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febbc0b3330 0x7febbc15cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:47.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.902+0000 7febc215f640 1 -- 172.21.15.112:0/2856460883 >> 172.21.15.112:0/2856460883 conn(0x7febbc0b6870 msgr2=0x7febbc141a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:47.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.902+0000 7febc215f640 1 -- 172.21.15.112:0/2856460883 shutdown_connections 2024-09-15T23:56:47.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:47.902+0000 7febc215f640 1 -- 172.21.15.112:0/2856460883 wait complete. 2024-09-15T23:56:47.922 INFO:tasks.cephfs_test_runner:That fragmentation (forced) will allow more entries to be created. ... ok 2024-09-15T23:56:47.923 INFO:tasks.cephfs_test_runner:Starting test: test_dirfrag_limit_strays (tasks.cephfs.test_strays.TestStrays) That unlinking fails when the stray directory fragment becomes too 2024-09-15T23:56:47.923 INFO:tasks.cephfs_test_runner:test_dirfrag_limit_strays (tasks.cephfs.test_strays.TestStrays) 2024-09-15T23:56:47.923 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:48.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.046+0000 7f1c3da8b640 1 Processor -- start 2024-09-15T23:56:48.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.046+0000 7f1c3da8b640 1 -- start start 2024-09-15T23:56:48.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.050+0000 7f1c3da8b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c381587a0 0x7f1c380b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.050+0000 7f1c3da8b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1c3806e680 0x7f1c38072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.050+0000 7f1c3da8b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c3806ec60 con 0x7f1c380b37d0 2024-09-15T23:56:48.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.050+0000 7f1c3da8b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1c380b3c40 con 0x7f1c381587a0 2024-09-15T23:56:48.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.050+0000 7f1c3da8b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1c3806f870 con 0x7f1c3806e680 2024-09-15T23:56:48.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.050+0000 7f1c377fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c381587a0 0x7f1c380b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.050+0000 7f1c377fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c381587a0 0x7f1c380b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33122/0 (socket says 172.21.15.112:33122) 2024-09-15T23:56:48.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.050+0000 7f1c377fe640 1 -- 172.21.15.112:0/4065658239 learned_addr learned my addr 172.21.15.112:0/4065658239 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:48.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.050+0000 7f1c37fff640 1 --2- 172.21.15.112:0/4065658239 >> v2:172.21.15.169:3300/0 conn(0x7f1c3806e680 0x7f1c38072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.050+0000 7f1c377fe640 1 -- 172.21.15.112:0/4065658239 >> v2:172.21.15.169:3300/0 conn(0x7f1c3806e680 msgr2=0x7f1c38072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:48.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.050+0000 7f1c377fe640 1 --2- 172.21.15.112:0/4065658239 >> v2:172.21.15.169:3300/0 conn(0x7f1c3806e680 0x7f1c38072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.050+0000 7f1c377fe640 1 -- 172.21.15.112:0/4065658239 >> v1:172.21.15.169:6789/0 conn(0x7f1c380b37d0 legacy=0x7f1c3806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.050+0000 7f1c377fe640 1 -- 172.21.15.112:0/4065658239 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3806ef40 con 0x7f1c381587a0 2024-09-15T23:56:48.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.054+0000 7f1c377fe640 1 --2- 172.21.15.112:0/4065658239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c381587a0 0x7f1c380b3290 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1c380af930 tx=0x7f1c2c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06c293ad85fde36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.054+0000 7f1c367fc640 1 -- 172.21.15.112:0/4065658239 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c0ab600 con 0x7f1c381587a0 2024-09-15T23:56:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.054+0000 7f1c367fc640 1 -- 172.21.15.112:0/4065658239 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2c0b0070 con 0x7f1c381587a0 2024-09-15T23:56:48.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.054+0000 7f1c367fc640 1 -- 172.21.15.112:0/4065658239 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c0ab9c0 con 0x7f1c381587a0 2024-09-15T23:56:48.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.054+0000 7f1c3da8b640 1 -- 172.21.15.112:0/4065658239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c381587a0 msgr2=0x7f1c380b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.054+0000 7f1c3da8b640 1 --2- 172.21.15.112:0/4065658239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c381587a0 0x7f1c380b3290 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1c380af930 tx=0x7f1c2c01c4f0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.054+0000 7f1c3da8b640 1 -- 172.21.15.112:0/4065658239 shutdown_connections 2024-09-15T23:56:48.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.054+0000 7f1c3da8b640 1 --2- 172.21.15.112:0/4065658239 >> v2:172.21.15.169:3300/0 conn(0x7f1c3806e680 0x7f1c38072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.054+0000 7f1c3da8b640 1 --2- 172.21.15.112:0/4065658239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c381587a0 0x7f1c380b3290 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.054+0000 7f1c3da8b640 1 -- 172.21.15.112:0/4065658239 >> 172.21.15.112:0/4065658239 conn(0x7f1c380b1f90 msgr2=0x7f1c380b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:48.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.054+0000 7f1c3da8b640 1 -- 172.21.15.112:0/4065658239 shutdown_connections 2024-09-15T23:56:48.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.054+0000 7f1c3da8b640 1 -- 172.21.15.112:0/4065658239 wait complete. 2024-09-15T23:56:48.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.054+0000 7f1c3da8b640 1 Processor -- start 2024-09-15T23:56:48.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.054+0000 7f1c3da8b640 1 -- start start 2024-09-15T23:56:48.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c3da8b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c3806e680 0x7f1c3814cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c3da8b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c380b37d0 0x7f1c38155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c3da8b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c381587a0 0x7f1c38147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c3da8b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1c38073030 con 0x7f1c381587a0 2024-09-15T23:56:48.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c3da8b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c38072eb0 con 0x7f1c3806e680 2024-09-15T23:56:48.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c3da8b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1c380731b0 con 0x7f1c380b37d0 2024-09-15T23:56:48.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c37fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c381587a0 0x7f1c38147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c37fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c381587a0 0x7f1c38147250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33132/0 (socket says 172.21.15.112:33132) 2024-09-15T23:56:48.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c37fff640 1 -- 172.21.15.112:0/1175151459 learned_addr learned my addr 172.21.15.112:0/1175151459 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:48.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c377fe640 1 --2- 172.21.15.112:0/1175151459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c3806e680 0x7f1c3814cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c36ffd640 1 --2- 172.21.15.112:0/1175151459 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c380b37d0 0x7f1c38155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c37fff640 1 -- 172.21.15.112:0/1175151459 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c380b37d0 msgr2=0x7f1c38155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c37fff640 1 --2- 172.21.15.112:0/1175151459 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c380b37d0 0x7f1c38155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c37fff640 1 -- 172.21.15.112:0/1175151459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c3806e680 msgr2=0x7f1c3814cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c37fff640 1 --2- 172.21.15.112:0/1175151459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c3806e680 0x7f1c3814cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c37fff640 1 -- 172.21.15.112:0/1175151459 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c381f83a0 con 0x7f1c381587a0 2024-09-15T23:56:48.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c37fff640 1 --2- 172.21.15.112:0/1175151459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c381587a0 0x7f1c38147250 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009d30 tx=0x7f1c3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:48.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c1ffff640 1 -- 172.21.15.112:0/1175151459 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30018020 con 0x7f1c381587a0 2024-09-15T23:56:48.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c1ffff640 1 -- 172.21.15.112:0/1175151459 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c30014480 con 0x7f1c381587a0 2024-09-15T23:56:48.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c1ffff640 1 -- 172.21.15.112:0/1175151459 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30014870 con 0x7f1c381587a0 2024-09-15T23:56:48.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c3da8b640 1 -- 172.21.15.112:0/1175151459 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c3814c420 con 0x7f1c381587a0 2024-09-15T23:56:48.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c3da8b640 1 -- 172.21.15.112:0/1175151459 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c3814c6c0 con 0x7f1c381587a0 2024-09-15T23:56:48.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c3da8b640 1 -- 172.21.15.112:0/1175151459 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c38072160 con 0x7f1c381587a0 2024-09-15T23:56:48.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c1ffff640 1 -- 172.21.15.112:0/1175151459 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c3001b020 con 0x7f1c381587a0 2024-09-15T23:56:48.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.058+0000 7f1c1ffff640 1 --2- 172.21.15.112:0/1175151459 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1c240678c0 0x7f1c24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.062+0000 7f1c1ffff640 1 -- 172.21.15.112:0/1175151459 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f1c30086b50 con 0x7f1c381587a0 2024-09-15T23:56:48.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.062+0000 7f1c377fe640 1 --2- 172.21.15.112:0/1175151459 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1c240678c0 0x7f1c24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.062+0000 7f1c377fe640 1 --2- 172.21.15.112:0/1175151459 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1c240678c0 0x7f1c24069d80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0af000 tx=0x7f1c2c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:48.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.062+0000 7f1c1ffff640 1 -- 172.21.15.112:0/1175151459 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1c30022070 con 0x7f1c381587a0 2024-09-15T23:56:48.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.226+0000 7f1c3da8b640 1 -- 172.21.15.112:0/1175151459 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c38070080 con 0x7f1c381587a0 2024-09-15T23:56:48.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.226+0000 7f1c1ffff640 1 -- 172.21.15.112:0/1175151459 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+13320 (secure 0 0 0) 0x7f1c30010040 con 0x7f1c381587a0 2024-09-15T23:56:48.228 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:48.228 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":67,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:56:45.875794+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/3667278267":"2024-09-16T23:56:42.860099+0000","172.21.15.112:6836/3667278267":"2024-09-16T23:56:42.860099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:48.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.230+0000 7f1c3da8b640 1 -- 172.21.15.112:0/1175151459 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1c240678c0 msgr2=0x7f1c24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.230+0000 7f1c3da8b640 1 --2- 172.21.15.112:0/1175151459 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1c240678c0 0x7f1c24069d80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0af000 tx=0x7f1c2c0a7000 comp rx=0 tx=0).stop 2024-09-15T23:56:48.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.230+0000 7f1c3da8b640 1 -- 172.21.15.112:0/1175151459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c381587a0 msgr2=0x7f1c38147250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.230+0000 7f1c3da8b640 1 --2- 172.21.15.112:0/1175151459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c381587a0 0x7f1c38147250 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009d30 tx=0x7f1c3000c490 comp rx=0 tx=0).stop 2024-09-15T23:56:48.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.230+0000 7f1c3da8b640 1 -- 172.21.15.112:0/1175151459 shutdown_connections 2024-09-15T23:56:48.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.230+0000 7f1c3da8b640 1 --2- 172.21.15.112:0/1175151459 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1c240678c0 0x7f1c24069d80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.230+0000 7f1c3da8b640 1 --2- 172.21.15.112:0/1175151459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c381587a0 0x7f1c38147250 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.230+0000 7f1c3da8b640 1 --2- 172.21.15.112:0/1175151459 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c380b37d0 0x7f1c38155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.230+0000 7f1c3da8b640 1 --2- 172.21.15.112:0/1175151459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c3806e680 0x7f1c3814cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.230+0000 7f1c3da8b640 1 -- 172.21.15.112:0/1175151459 >> 172.21.15.112:0/1175151459 conn(0x7f1c380b1f90 msgr2=0x7f1c380ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:48.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.230+0000 7f1c3da8b640 1 -- 172.21.15.112:0/1175151459 shutdown_connections 2024-09-15T23:56:48.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.230+0000 7f1c3da8b640 1 -- 172.21.15.112:0/1175151459 wait complete. 2024-09-15T23:56:48.246 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:53:39.301069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:56:48.247 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:56:48.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.362+0000 7f7cbd270640 1 Processor -- start 2024-09-15T23:56:48.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.362+0000 7f7cbd270640 1 -- start start 2024-09-15T23:56:48.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.366+0000 7f7cbd270640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7cb81520a0 0x7f7cb806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.366+0000 7f7cbd270640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb8070250 con 0x7f7cb815f3a0 2024-09-15T23:56:48.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.366+0000 7f7cbd270640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb80aede0 con 0x7f7cb806fe50 2024-09-15T23:56:48.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.366+0000 7f7cbd270640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7cb8152480 con 0x7f7cb81520a0 2024-09-15T23:56:48.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.366+0000 7f7cb6ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7cb81520a0 0x7f7cb806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.366+0000 7f7cb6ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7cb81520a0 0x7f7cb806f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35930/0 (socket says 172.21.15.112:35930) 2024-09-15T23:56:48.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.366+0000 7f7cb6ffd640 1 -- 172.21.15.112:0/4260953306 learned_addr learned my addr 172.21.15.112:0/4260953306 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:48.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.366+0000 7f7cb6ffd640 1 -- 172.21.15.112:0/4260953306 >> v1:172.21.15.169:6789/0 conn(0x7f7cb806fe50 legacy=0x7f7cb815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:48.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.366+0000 7f7cb6ffd640 1 -- 172.21.15.112:0/4260953306 >> v1:172.21.15.112:6789/0 conn(0x7f7cb815f3a0 legacy=0x7f7cb80adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.366+0000 7f7cb6ffd640 1 -- 172.21.15.112:0/4260953306 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb815fa10 con 0x7f7cb81520a0 2024-09-15T23:56:48.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.366+0000 7f7cb6ffd640 1 --2- 172.21.15.112:0/4260953306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cb81520a0 0x7f7cb806f910 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000d150 tx=0x7f7cb001ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40380b073dd90d7e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:48.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.366+0000 7f7cb5ffb640 1 -- 172.21.15.112:0/4260953306 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb80aeba0 con 0x7f7cb81520a0 2024-09-15T23:56:48.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.366+0000 7f7cb5ffb640 1 -- 172.21.15.112:0/4260953306 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb000b2d0 con 0x7f7cb81520a0 2024-09-15T23:56:48.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.366+0000 7f7cb5ffb640 1 -- 172.21.15.112:0/4260953306 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000b480 con 0x7f7cb81520a0 2024-09-15T23:56:48.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 -- 172.21.15.112:0/4260953306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cb81520a0 msgr2=0x7f7cb806f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 --2- 172.21.15.112:0/4260953306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cb81520a0 0x7f7cb806f910 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000d150 tx=0x7f7cb001ebf0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 -- 172.21.15.112:0/4260953306 shutdown_connections 2024-09-15T23:56:48.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 --2- 172.21.15.112:0/4260953306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cb81520a0 0x7f7cb806f910 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 -- 172.21.15.112:0/4260953306 >> 172.21.15.112:0/4260953306 conn(0x7f7cb80b1f90 msgr2=0x7f7cb80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:48.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 -- 172.21.15.112:0/4260953306 shutdown_connections 2024-09-15T23:56:48.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 -- 172.21.15.112:0/4260953306 wait complete. 2024-09-15T23:56:48.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 Processor -- start 2024-09-15T23:56:48.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 -- start start 2024-09-15T23:56:48.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cb806fe50 0x7f7cb80cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cb81520a0 0x7f7cb80cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb815f3a0 0x7f7cb8145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb8073d30 con 0x7f7cb81520a0 2024-09-15T23:56:48.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb8073a50 con 0x7f7cb815f3a0 2024-09-15T23:56:48.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb806e800 con 0x7f7cb806fe50 2024-09-15T23:56:48.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cb67fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cb81520a0 0x7f7cb80cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cb67fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cb81520a0 0x7f7cb80cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35944/0 (socket says 172.21.15.112:35944) 2024-09-15T23:56:48.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cb67fc640 1 -- 172.21.15.112:0/2548338277 learned_addr learned my addr 172.21.15.112:0/2548338277 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:48.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cb77fe640 1 --2- 172.21.15.112:0/2548338277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb815f3a0 0x7f7cb8145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cb6ffd640 1 --2- 172.21.15.112:0/2548338277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cb806fe50 0x7f7cb80cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cb67fc640 1 -- 172.21.15.112:0/2548338277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cb806fe50 msgr2=0x7f7cb80cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cb67fc640 1 --2- 172.21.15.112:0/2548338277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cb806fe50 0x7f7cb80cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cb67fc640 1 -- 172.21.15.112:0/2548338277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb815f3a0 msgr2=0x7f7cb8145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cb67fc640 1 --2- 172.21.15.112:0/2548338277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb815f3a0 0x7f7cb8145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cb67fc640 1 -- 172.21.15.112:0/2548338277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb80cf8b0 con 0x7f7cb81520a0 2024-09-15T23:56:48.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cb67fc640 1 --2- 172.21.15.112:0/2548338277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cb81520a0 0x7f7cb80cdda0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000b3e0 tx=0x7f7ca000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:48.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7caf7fe640 1 -- 172.21.15.112:0/2548338277 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0015020 con 0x7f7cb81520a0 2024-09-15T23:56:48.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 -- 172.21.15.112:0/2548338277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb806f340 con 0x7f7cb81520a0 2024-09-15T23:56:48.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7cbd270640 1 -- 172.21.15.112:0/2548338277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb80cfe30 con 0x7f7cb81520a0 2024-09-15T23:56:48.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7caf7fe640 1 -- 172.21.15.112:0/2548338277 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca0011830 con 0x7f7cb81520a0 2024-09-15T23:56:48.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.370+0000 7f7caf7fe640 1 -- 172.21.15.112:0/2548338277 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0011c20 con 0x7f7cb81520a0 2024-09-15T23:56:48.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.374+0000 7f7cbd270640 1 -- 172.21.15.112:0/2548338277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c9c0052a0 con 0x7f7cb81520a0 2024-09-15T23:56:48.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.374+0000 7f7caf7fe640 1 -- 172.21.15.112:0/2548338277 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7ca0018020 con 0x7f7cb81520a0 2024-09-15T23:56:48.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.374+0000 7f7caf7fe640 1 --2- 172.21.15.112:0/2548338277 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7c980678c0 0x7f7c98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.374+0000 7f7caf7fe640 1 -- 172.21.15.112:0/2548338277 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f7ca0085a10 con 0x7f7cb81520a0 2024-09-15T23:56:48.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.374+0000 7f7cb6ffd640 1 --2- 172.21.15.112:0/2548338277 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7c980678c0 0x7f7c98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.374+0000 7f7cb6ffd640 1 --2- 172.21.15.112:0/2548338277 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7c980678c0 0x7f7c98069d80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00b0000 tx=0x7f7cb00a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:48.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.378+0000 7f7caf7fe640 1 -- 172.21.15.112:0/2548338277 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7ca001f020 con 0x7f7cb81520a0 2024-09-15T23:56:48.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.538+0000 7f7cbd270640 1 -- 172.21.15.112:0/2548338277 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7c9c005860 con 0x7f7cb81520a0 2024-09-15T23:56:48.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.542+0000 7f7caf7fe640 1 -- 172.21.15.112:0/2548338277 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) ==== 93+0+10 (secure 0 0 0) 0x7f7ca00172c0 con 0x7f7cb81520a0 2024-09-15T23:56:48.541 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-15T23:56:48.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.542+0000 7f7cbd270640 1 -- 172.21.15.112:0/2548338277 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7c980678c0 msgr2=0x7f7c98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.542+0000 7f7cbd270640 1 --2- 172.21.15.112:0/2548338277 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7c980678c0 0x7f7c98069d80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00b0000 tx=0x7f7cb00a9070 comp rx=0 tx=0).stop 2024-09-15T23:56:48.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.542+0000 7f7cbd270640 1 -- 172.21.15.112:0/2548338277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cb81520a0 msgr2=0x7f7cb80cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.542+0000 7f7cbd270640 1 --2- 172.21.15.112:0/2548338277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cb81520a0 0x7f7cb80cdda0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000b3e0 tx=0x7f7ca000b8a0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.542+0000 7f7cbd270640 1 -- 172.21.15.112:0/2548338277 shutdown_connections 2024-09-15T23:56:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.542+0000 7f7cbd270640 1 --2- 172.21.15.112:0/2548338277 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7c980678c0 0x7f7c98069d80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.542+0000 7f7cbd270640 1 --2- 172.21.15.112:0/2548338277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb815f3a0 0x7f7cb8145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.542+0000 7f7cbd270640 1 --2- 172.21.15.112:0/2548338277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cb81520a0 0x7f7cb80cdda0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.542+0000 7f7cbd270640 1 --2- 172.21.15.112:0/2548338277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cb806fe50 0x7f7cb80cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.542+0000 7f7cbd270640 1 -- 172.21.15.112:0/2548338277 >> 172.21.15.112:0/2548338277 conn(0x7f7cb80b1f90 msgr2=0x7f7cb80b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.542+0000 7f7cbd270640 1 -- 172.21.15.112:0/2548338277 shutdown_connections 2024-09-15T23:56:48.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.542+0000 7f7cbd270640 1 -- 172.21.15.112:0/2548338277 wait complete. 2024-09-15T23:56:48.560 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_strays' 2024-09-15T23:56:48.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.678+0000 7f33a0f67640 1 Processor -- start 2024-09-15T23:56:48.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.678+0000 7f33a0f67640 1 -- start start 2024-09-15T23:56:48.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f33a0f67640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f339c15bec0 0x7f339c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f33a0f67640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f339c0af470 0x7f339c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f33a0f67640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f339c0b3290 con 0x7f339c15c2a0 2024-09-15T23:56:48.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f33a0f67640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f339c0b3570 con 0x7f339c15bec0 2024-09-15T23:56:48.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f33a0f67640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f339c0b3850 con 0x7f339c0af470 2024-09-15T23:56:48.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f339a59c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f339c15bec0 0x7f339c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f3391d9b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f339c15c2a0 0x7f339c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48306/0 (socket says 172.21.15.112:48306) 2024-09-15T23:56:48.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f3391d9b640 1 -- 172.21.15.112:0/1199473891 learned_addr learned my addr 172.21.15.112:0/1199473891 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:48.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f339ad9d640 1 --2- 172.21.15.112:0/1199473891 >> v2:172.21.15.169:3300/0 conn(0x7f339c0af470 0x7f339c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f339a59c640 1 -- 172.21.15.112:0/1199473891 >> v2:172.21.15.169:3300/0 conn(0x7f339c0af470 msgr2=0x7f339c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:48.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f339a59c640 1 --2- 172.21.15.112:0/1199473891 >> v2:172.21.15.169:3300/0 conn(0x7f339c0af470 0x7f339c06e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f339a59c640 1 -- 172.21.15.112:0/1199473891 >> v1:172.21.15.112:6789/0 conn(0x7f339c15c2a0 legacy=0x7f339c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f339a59c640 1 -- 172.21.15.112:0/1199473891 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339c0b3b30 con 0x7f339c15bec0 2024-09-15T23:56:48.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f3399d9b640 1 -- 172.21.15.112:0/1199473891 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820708814 0 0) 0x7f339c0b3290 con 0x7f339c15c2a0 2024-09-15T23:56:48.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f339a59c640 1 --2- 172.21.15.112:0/1199473891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f339c15bec0 0x7f339c0ad200 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f339c0b2fb0 tx=0x7f338c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7bef688758095a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:48.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f3399d9b640 1 -- 172.21.15.112:0/1199473891 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c0b2070 con 0x7f339c15bec0 2024-09-15T23:56:48.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f3399d9b640 1 -- 172.21.15.112:0/1199473891 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f338c0a9070 con 0x7f339c15bec0 2024-09-15T23:56:48.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.682+0000 7f3399d9b640 1 -- 172.21.15.112:0/1199473891 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c0ad880 con 0x7f339c15bec0 2024-09-15T23:56:48.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 -- 172.21.15.112:0/1199473891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f339c15bec0 msgr2=0x7f339c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 --2- 172.21.15.112:0/1199473891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f339c15bec0 0x7f339c0ad200 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f339c0b2fb0 tx=0x7f338c01c450 comp rx=0 tx=0).stop 2024-09-15T23:56:48.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 -- 172.21.15.112:0/1199473891 shutdown_connections 2024-09-15T23:56:48.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 --2- 172.21.15.112:0/1199473891 >> v2:172.21.15.169:3300/0 conn(0x7f339c0af470 0x7f339c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 --2- 172.21.15.112:0/1199473891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f339c15bec0 0x7f339c0ad200 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 -- 172.21.15.112:0/1199473891 >> 172.21.15.112:0/1199473891 conn(0x7f339c0b1f90 msgr2=0x7f339c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:48.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 -- 172.21.15.112:0/1199473891 shutdown_connections 2024-09-15T23:56:48.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 -- 172.21.15.112:0/1199473891 wait complete. 2024-09-15T23:56:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 Processor -- start 2024-09-15T23:56:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 -- start start 2024-09-15T23:56:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f339c0af470 0x7f339c150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f339c15bec0 0x7f339c1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f339c15c2a0 0x7f339c15c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f339c06ed50 con 0x7f339c0af470 2024-09-15T23:56:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f339c0ad740 con 0x7f339c15bec0 2024-09-15T23:56:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f339c06eed0 con 0x7f339c15c2a0 2024-09-15T23:56:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f339a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f339c0af470 0x7f339c150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f339a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f339c0af470 0x7f339c150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35954/0 (socket says 172.21.15.112:35954) 2024-09-15T23:56:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f339a59c640 1 -- 172.21.15.112:0/3306062538 learned_addr learned my addr 172.21.15.112:0/3306062538 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:48.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f3391d9b640 1 --2- 172.21.15.112:0/3306062538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f339c15bec0 0x7f339c1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f339a59c640 1 -- 172.21.15.112:0/3306062538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f339c15c2a0 msgr2=0x7f339c15c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f339a59c640 1 --2- 172.21.15.112:0/3306062538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f339c15c2a0 0x7f339c15c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f339a59c640 1 -- 172.21.15.112:0/3306062538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f339c15bec0 msgr2=0x7f339c1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:48.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f339a59c640 1 --2- 172.21.15.112:0/3306062538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f339c15bec0 0x7f339c1553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:48.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f339a59c640 1 -- 172.21.15.112:0/3306062538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339c150d70 con 0x7f339c0af470 2024-09-15T23:56:48.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f339a59c640 1 --2- 172.21.15.112:0/3306062538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f339c0af470 0x7f339c150470 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f338c0b0040 tx=0x7f338c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:48.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33937fe640 1 -- 172.21.15.112:0/3306062538 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c0b2050 con 0x7f339c0af470 2024-09-15T23:56:48.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33937fe640 1 -- 172.21.15.112:0/3306062538 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f338c0be070 con 0x7f339c0af470 2024-09-15T23:56:48.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 -- 172.21.15.112:0/3306062538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f339c14d100 con 0x7f339c0af470 2024-09-15T23:56:48.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33937fe640 1 -- 172.21.15.112:0/3306062538 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c0b9890 con 0x7f339c0af470 2024-09-15T23:56:48.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.686+0000 7f33a0f67640 1 -- 172.21.15.112:0/3306062538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f339c14d6c0 con 0x7f339c0af470 2024-09-15T23:56:48.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.690+0000 7f33a0f67640 1 -- 172.21.15.112:0/3306062538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f339c06e000 con 0x7f339c0af470 2024-09-15T23:56:48.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.690+0000 7f33937fe640 1 -- 172.21.15.112:0/3306062538 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f338c0ab070 con 0x7f339c0af470 2024-09-15T23:56:48.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.690+0000 7f33937fe640 1 --2- 172.21.15.112:0/3306062538 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f337c0678c0 0x7f337c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:48.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.690+0000 7f33937fe640 1 -- 172.21.15.112:0/3306062538 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f338c1200e0 con 0x7f339c0af470 2024-09-15T23:56:48.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.690+0000 7f3391d9b640 1 --2- 172.21.15.112:0/3306062538 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f337c0678c0 0x7f337c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:48.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.690+0000 7f3391d9b640 1 --2- 172.21.15.112:0/3306062538 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f337c0678c0 0x7f337c069d80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f339c15b3b0 tx=0x7f3384009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:48.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.694+0000 7f33937fe640 1 -- 172.21.15.112:0/3306062538 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f338c016070 con 0x7f339c0af470 2024-09-15T23:56:48.916 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:48.914+0000 7f33a0f67640 1 -- 172.21.15.112:0/3306062538 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_strays"]} v 0) -- 0x7f339c06fcd0 con 0x7f339c0af470 2024-09-15T23:56:49.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:49.902+0000 7f33937fe640 1 -- 172.21.15.112:0/3306062538 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_strays"]}]=0 v167) ==== 143+0+0 (secure 0 0 0) 0x7f338c0f0f40 con 0x7f339c0af470 2024-09-15T23:56:49.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:49.906+0000 7f33a0f67640 1 -- 172.21.15.112:0/3306062538 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f337c0678c0 msgr2=0x7f337c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:49.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:49.906+0000 7f33a0f67640 1 --2- 172.21.15.112:0/3306062538 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f337c0678c0 0x7f337c069d80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f339c15b3b0 tx=0x7f3384009040 comp rx=0 tx=0).stop 2024-09-15T23:56:49.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:49.906+0000 7f33a0f67640 1 -- 172.21.15.112:0/3306062538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f339c0af470 msgr2=0x7f339c150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:49.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:49.906+0000 7f33a0f67640 1 --2- 172.21.15.112:0/3306062538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f339c0af470 0x7f339c150470 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f338c0b0040 tx=0x7f338c01ac90 comp rx=0 tx=0).stop 2024-09-15T23:56:49.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:49.906+0000 7f33a0f67640 1 -- 172.21.15.112:0/3306062538 shutdown_connections 2024-09-15T23:56:49.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:49.906+0000 7f33a0f67640 1 --2- 172.21.15.112:0/3306062538 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f337c0678c0 0x7f337c069d80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:49.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:49.906+0000 7f33a0f67640 1 --2- 172.21.15.112:0/3306062538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f339c15c2a0 0x7f339c15c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:49.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:49.906+0000 7f33a0f67640 1 --2- 172.21.15.112:0/3306062538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f339c15bec0 0x7f339c1553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:49.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:49.906+0000 7f33a0f67640 1 --2- 172.21.15.112:0/3306062538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f339c0af470 0x7f339c150470 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:49.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:49.906+0000 7f33a0f67640 1 -- 172.21.15.112:0/3306062538 >> 172.21.15.112:0/3306062538 conn(0x7f339c0b1f90 msgr2=0x7f339c0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:49.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:49.906+0000 7f33a0f67640 1 -- 172.21.15.112:0/3306062538 shutdown_connections 2024-09-15T23:56:49.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:49.906+0000 7f33a0f67640 1 -- 172.21.15.112:0/3306062538 wait complete. 2024-09-15T23:56:49.927 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:56:50.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6307af4640 1 Processor -- start 2024-09-15T23:56:50.054 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6307af4640 1 -- start start 2024-09-15T23:56:50.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6307af4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f63001457a0 0x7f63000d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6307af4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63000cf800 0x7f63000b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6307af4640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63000b4340 0x7f630015ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6307af4640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f63000b47b0 con 0x7f63000b4340 2024-09-15T23:56:50.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6307af4640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f63000d27a0 con 0x7f63001457a0 2024-09-15T23:56:50.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6307af4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f63000d2a80 con 0x7f63000cf800 2024-09-15T23:56:50.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6306091640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63000b4340 0x7f630015ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6306091640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f63000b4340 0x7f630015ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35968/0 (socket says 172.21.15.112:35968) 2024-09-15T23:56:50.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6306091640 1 -- 172.21.15.112:0/4161530673 learned_addr learned my addr 172.21.15.112:0/4161530673 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:50.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6305890640 1 --2- 172.21.15.112:0/4161530673 >> v2:172.21.15.169:3300/0 conn(0x7f63001457a0 0x7f63000d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f630508f640 1 --2- 172.21.15.112:0/4161530673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63000cf800 0x7f63000b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6306091640 1 -- 172.21.15.112:0/4161530673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63000cf800 msgr2=0x7f63000b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:50.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6306091640 1 --2- 172.21.15.112:0/4161530673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63000cf800 0x7f63000b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6306091640 1 -- 172.21.15.112:0/4161530673 >> v2:172.21.15.169:3300/0 conn(0x7f63001457a0 msgr2=0x7f63000d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:50.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6306091640 1 --2- 172.21.15.112:0/4161530673 >> v2:172.21.15.169:3300/0 conn(0x7f63001457a0 0x7f63000d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.054+0000 7f6306091640 1 -- 172.21.15.112:0/4161530673 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63000d2d60 con 0x7f63000b4340 2024-09-15T23:56:50.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f6306091640 1 --2- 172.21.15.112:0/4161530673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63000b4340 0x7f630015ff20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6300068500 tx=0x7f62f801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3962f9a23c94c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:50.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f630488e640 1 -- 172.21.15.112:0/4161530673 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f80a9430 con 0x7f63000b4340 2024-09-15T23:56:50.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f630488e640 1 -- 172.21.15.112:0/4161530673 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f80ae070 con 0x7f63000b4340 2024-09-15T23:56:50.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f630488e640 1 -- 172.21.15.112:0/4161530673 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f80a97f0 con 0x7f63000b4340 2024-09-15T23:56:50.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f6307af4640 1 -- 172.21.15.112:0/4161530673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63000b4340 msgr2=0x7f630015ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f6307af4640 1 --2- 172.21.15.112:0/4161530673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63000b4340 0x7f630015ff20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6300068500 tx=0x7f62f801c6a0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f6307af4640 1 -- 172.21.15.112:0/4161530673 shutdown_connections 2024-09-15T23:56:50.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f6307af4640 1 --2- 172.21.15.112:0/4161530673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63000b4340 0x7f630015ff20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f6307af4640 1 --2- 172.21.15.112:0/4161530673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63000cf800 0x7f63000b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f6307af4640 1 --2- 172.21.15.112:0/4161530673 >> v2:172.21.15.169:3300/0 conn(0x7f63001457a0 0x7f63000d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f6307af4640 1 -- 172.21.15.112:0/4161530673 >> 172.21.15.112:0/4161530673 conn(0x7f630006bcc0 msgr2=0x7f630006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:50.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f6307af4640 1 -- 172.21.15.112:0/4161530673 shutdown_connections 2024-09-15T23:56:50.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f6307af4640 1 -- 172.21.15.112:0/4161530673 wait complete. 2024-09-15T23:56:50.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f6307af4640 1 Processor -- start 2024-09-15T23:56:50.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.058+0000 7f6307af4640 1 -- start start 2024-09-15T23:56:50.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f6307af4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63000b4340 0x7f63001f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f6307af4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63000cf800 0x7f630015a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f6307af4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63001457a0 0x7f630015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f6307af4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f63000d0890 con 0x7f63000cf800 2024-09-15T23:56:50.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f6307af4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f63000d0710 con 0x7f63001457a0 2024-09-15T23:56:50.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f6307af4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f63000d0a10 con 0x7f63000b4340 2024-09-15T23:56:50.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f630508f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63000cf800 0x7f630015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f630508f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63000cf800 0x7f630015a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35980/0 (socket says 172.21.15.112:35980) 2024-09-15T23:56:50.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f630508f640 1 -- 172.21.15.112:0/4143386311 learned_addr learned my addr 172.21.15.112:0/4143386311 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:50.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f6305890640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63000b4340 0x7f63001f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f6306091640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63001457a0 0x7f630015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f630508f640 1 -- 172.21.15.112:0/4143386311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63000b4340 msgr2=0x7f63001f7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f630508f640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63000b4340 0x7f63001f7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f630508f640 1 -- 172.21.15.112:0/4143386311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63001457a0 msgr2=0x7f630015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f630508f640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63001457a0 0x7f630015aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f630508f640 1 -- 172.21.15.112:0/4143386311 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63001f5140 con 0x7f63000cf800 2024-09-15T23:56:50.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f6306091640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63001457a0 0x7f630015aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:50.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f630508f640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63000cf800 0x7f630015a990 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f62f000d830 tx=0x7f62f000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:50.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f62f67fc640 1 -- 172.21.15.112:0/4143386311 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0018020 con 0x7f63000cf800 2024-09-15T23:56:50.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f62f67fc640 1 -- 172.21.15.112:0/4143386311 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f00096c0 con 0x7f63000cf800 2024-09-15T23:56:50.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f62f67fc640 1 -- 172.21.15.112:0/4143386311 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0009ab0 con 0x7f63000cf800 2024-09-15T23:56:50.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f6307af4640 1 -- 172.21.15.112:0/4143386311 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63001f5420 con 0x7f63000cf800 2024-09-15T23:56:50.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f6307af4640 1 -- 172.21.15.112:0/4143386311 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63001f59e0 con 0x7f63000cf800 2024-09-15T23:56:50.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f6307af4640 1 -- 172.21.15.112:0/4143386311 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63000b3e00 con 0x7f63000cf800 2024-09-15T23:56:50.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f62f67fc640 1 -- 172.21.15.112:0/4143386311 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f62f001b020 con 0x7f63000cf800 2024-09-15T23:56:50.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f62f67fc640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f62e40678c0 0x7f62e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f6305890640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f62e40678c0 0x7f62e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f62f67fc640 1 -- 172.21.15.112:0/4143386311 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f62f0086340 con 0x7f63000cf800 2024-09-15T23:56:50.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.062+0000 7f6305890640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f62e40678c0 0x7f62e4069d80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00b930 tx=0x7f62fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:50.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.066+0000 7f62f67fc640 1 -- 172.21.15.112:0/4143386311 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f62f0022020 con 0x7f63000cf800 2024-09-15T23:56:50.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.226+0000 7f6307af4640 1 -- 172.21.15.112:0/4143386311 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6300140bf0 con 0x7f63000cf800 2024-09-15T23:56:50.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.230+0000 7f62f67fc640 1 -- 172.21.15.112:0/4143386311 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f62f0011340 con 0x7f63000cf800 2024-09-15T23:56:50.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.234+0000 7f6307af4640 1 -- 172.21.15.112:0/4143386311 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f62e40678c0 msgr2=0x7f62e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.234+0000 7f6307af4640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f62e40678c0 0x7f62e4069d80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00b930 tx=0x7f62fc008040 comp rx=0 tx=0).stop 2024-09-15T23:56:50.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.234+0000 7f6307af4640 1 -- 172.21.15.112:0/4143386311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63000cf800 msgr2=0x7f630015a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.234+0000 7f6307af4640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63000cf800 0x7f630015a990 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f62f000d830 tx=0x7f62f000dcf0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.234+0000 7f6307af4640 1 -- 172.21.15.112:0/4143386311 shutdown_connections 2024-09-15T23:56:50.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.234+0000 7f6307af4640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f62e40678c0 0x7f62e4069d80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.234+0000 7f6307af4640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63001457a0 0x7f630015aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.234+0000 7f6307af4640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63000cf800 0x7f630015a990 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.234+0000 7f6307af4640 1 --2- 172.21.15.112:0/4143386311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63000b4340 0x7f63001f7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.234+0000 7f6307af4640 1 -- 172.21.15.112:0/4143386311 >> 172.21.15.112:0/4143386311 conn(0x7f630006bcc0 msgr2=0x7f63000b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:50.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.234+0000 7f6307af4640 1 -- 172.21.15.112:0/4143386311 shutdown_connections 2024-09-15T23:56:50.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.234+0000 7f6307af4640 1 -- 172.21.15.112:0/4143386311 wait complete. 2024-09-15T23:56:50.250 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:56:50.251 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:56:50.335 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:56:50.396 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:56:50.396 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:56:50.396 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:50.402 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:56:50.402 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:56:50.402 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:50.408 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:56:50.408 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:56:50.409 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:50.450 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:56:50.450 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:56:50.450 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:50.455 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:56:50.455 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:56:50.455 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:50.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.618+0000 7f91c36c0640 1 Processor -- start 2024-09-15T23:56:50.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.618+0000 7f91c36c0640 1 -- start start 2024-09-15T23:56:50.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.618+0000 7f91c36c0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f91bc15bec0 0x7f91bc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.618+0000 7f91c36c0640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91bc0b3290 con 0x7f91bc15c2a0 2024-09-15T23:56:50.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.618+0000 7f91c36c0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91bc0b3570 con 0x7f91bc0af470 2024-09-15T23:56:50.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.618+0000 7f91c36c0640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f91bc0b3850 con 0x7f91bc15bec0 2024-09-15T23:56:50.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.618+0000 7f91c145c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f91bc15bec0 0x7f91bc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.618+0000 7f91c0c5b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f91bc15c2a0 0x7f91bc0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48312/0 (socket says 172.21.15.112:48312) 2024-09-15T23:56:50.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.618+0000 7f91c0c5b640 1 -- 172.21.15.112:0/2098606285 learned_addr learned my addr 172.21.15.112:0/2098606285 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:50.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.618+0000 7f91c145c640 1 -- 172.21.15.112:0/2098606285 >> v1:172.21.15.169:6789/0 conn(0x7f91bc0af470 legacy=0x7f91bc06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.618+0000 7f91c145c640 1 -- 172.21.15.112:0/2098606285 >> v1:172.21.15.112:6789/0 conn(0x7f91bc15c2a0 legacy=0x7f91bc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.618+0000 7f91b3fff640 1 -- 172.21.15.112:0/2098606285 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187310375 0 0) 0x7f91bc0b3290 con 0x7f91bc15c2a0 2024-09-15T23:56:50.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.618+0000 7f91c145c640 1 -- 172.21.15.112:0/2098606285 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc0b3b30 con 0x7f91bc15bec0 2024-09-15T23:56:50.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.622+0000 7f91c145c640 1 --2- 172.21.15.112:0/2098606285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91bc15bec0 0x7f91bc0ad200 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f91b80097c0 tx=0x7f91b801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8d7eee48dc3263 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:50.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.622+0000 7f91b3fff640 1 -- 172.21.15.112:0/2098606285 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b80b2070 con 0x7f91bc15bec0 2024-09-15T23:56:50.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.622+0000 7f91b3fff640 1 -- 172.21.15.112:0/2098606285 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b80ad680 con 0x7f91bc15bec0 2024-09-15T23:56:50.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.622+0000 7f91b3fff640 1 -- 172.21.15.112:0/2098606285 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b80ada50 con 0x7f91bc15bec0 2024-09-15T23:56:50.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.622+0000 7f91c36c0640 1 -- 172.21.15.112:0/2098606285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91bc15bec0 msgr2=0x7f91bc0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.622+0000 7f91c36c0640 1 --2- 172.21.15.112:0/2098606285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91bc15bec0 0x7f91bc0ad200 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f91b80097c0 tx=0x7f91b801c470 comp rx=0 tx=0).stop 2024-09-15T23:56:50.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.622+0000 7f91c36c0640 1 -- 172.21.15.112:0/2098606285 shutdown_connections 2024-09-15T23:56:50.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.622+0000 7f91c36c0640 1 --2- 172.21.15.112:0/2098606285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91bc15bec0 0x7f91bc0ad200 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.622+0000 7f91c36c0640 1 -- 172.21.15.112:0/2098606285 >> 172.21.15.112:0/2098606285 conn(0x7f91bc0b1f90 msgr2=0x7f91bc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:50.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.622+0000 7f91c36c0640 1 -- 172.21.15.112:0/2098606285 shutdown_connections 2024-09-15T23:56:50.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.622+0000 7f91c36c0640 1 -- 172.21.15.112:0/2098606285 wait complete. 2024-09-15T23:56:50.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.622+0000 7f91c36c0640 1 Processor -- start 2024-09-15T23:56:50.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.622+0000 7f91c36c0640 1 -- start start 2024-09-15T23:56:50.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c36c0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91bc0af470 0x7f91bc14a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c36c0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91bc15bec0 0x7f91bc163fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c36c0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91bc15c2a0 0x7f91bc0725c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c36c0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc06ef20 con 0x7f91bc0af470 2024-09-15T23:56:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c36c0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc0ad740 con 0x7f91bc15c2a0 2024-09-15T23:56:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c36c0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f91bc06f0a0 con 0x7f91bc15bec0 2024-09-15T23:56:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c145c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91bc0af470 0x7f91bc14a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c145c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91bc0af470 0x7f91bc14a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35992/0 (socket says 172.21.15.112:35992) 2024-09-15T23:56:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c145c640 1 -- 172.21.15.112:0/2460790359 learned_addr learned my addr 172.21.15.112:0/2460790359 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c145c640 1 -- 172.21.15.112:0/2460790359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91bc15bec0 msgr2=0x7f91bc163fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c0c5b640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91bc15bec0 0x7f91bc163fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c1c5d640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91bc15c2a0 0x7f91bc0725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c145c640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91bc15bec0 0x7f91bc163fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c145c640 1 -- 172.21.15.112:0/2460790359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91bc15c2a0 msgr2=0x7f91bc0725c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c145c640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91bc15c2a0 0x7f91bc0725c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c145c640 1 -- 172.21.15.112:0/2460790359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc14e4b0 con 0x7f91bc0af470 2024-09-15T23:56:50.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c1c5d640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91bc15c2a0 0x7f91bc0725c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:50.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c145c640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91bc0af470 0x7f91bc14a280 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f91b801a0a0 tx=0x7f91b801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:50.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91b1ffb640 1 -- 172.21.15.112:0/2460790359 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b80bc020 con 0x7f91bc0af470 2024-09-15T23:56:50.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91b1ffb640 1 -- 172.21.15.112:0/2460790359 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b80adc50 con 0x7f91bc0af470 2024-09-15T23:56:50.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c36c0640 1 -- 172.21.15.112:0/2460790359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91bc14e790 con 0x7f91bc0af470 2024-09-15T23:56:50.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91b1ffb640 1 -- 172.21.15.112:0/2460790359 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b80b2040 con 0x7f91bc0af470 2024-09-15T23:56:50.629 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c36c0640 1 -- 172.21.15.112:0/2460790359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91bc14f030 con 0x7f91bc0af470 2024-09-15T23:56:50.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c36c0640 1 -- 172.21.15.112:0/2460790359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91bc14e960 con 0x7f91bc0af470 2024-09-15T23:56:50.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91b1ffb640 1 -- 172.21.15.112:0/2460790359 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f91b80bf020 con 0x7f91bc0af470 2024-09-15T23:56:50.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91b1ffb640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f91a00678c0 0x7f91a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91b1ffb640 1 -- 172.21.15.112:0/2460790359 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f91b811fe40 con 0x7f91bc0af470 2024-09-15T23:56:50.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c0c5b640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f91a00678c0 0x7f91a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.626+0000 7f91c0c5b640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f91a00678c0 0x7f91a0069d80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f91ac007fd0 tx=0x7f91ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:50.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.630+0000 7f91b1ffb640 1 -- 172.21.15.112:0/2460790359 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f91b80c6030 con 0x7f91bc0af470 2024-09-15T23:56:50.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.822+0000 7f91c36c0640 1 -- 172.21.15.112:0/2460790359 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91bc0ad200 con 0x7f91bc0af470 2024-09-15T23:56:50.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.822+0000 7f91b1ffb640 1 -- 172.21.15.112:0/2460790359 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+3920 (secure 0 0 0) 0x7f91b8016090 con 0x7f91bc0af470 2024-09-15T23:56:50.824 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:50.824 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":31,"btime":"2024-09-15T23:56:43:863861+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/442643148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":442643148},{"type":"v1","addr":"172.21.15.169:6833","nonce":442643148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2506338033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2506338033},{"type":"v1","addr":"172.21.15.169:6835","nonce":2506338033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3040445121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3040445121},{"type":"v1","addr":"172.21.15.112:6835","nonce":3040445121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5925,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/1404148486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":1404148486},{"type":"v1","addr":"172.21.15.112:6837","nonce":1404148486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[]} 2024-09-15T23:56:50.825 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 31 2024-09-15T23:56:50.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.826+0000 7f91c36c0640 1 -- 172.21.15.112:0/2460790359 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f91a00678c0 msgr2=0x7f91a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.826+0000 7f91c36c0640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f91a00678c0 0x7f91a0069d80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f91ac007fd0 tx=0x7f91ac009040 comp rx=0 tx=0).stop 2024-09-15T23:56:50.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.826+0000 7f91c36c0640 1 -- 172.21.15.112:0/2460790359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91bc0af470 msgr2=0x7f91bc14a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.826+0000 7f91c36c0640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91bc0af470 0x7f91bc14a280 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f91b801a0a0 tx=0x7f91b801acb0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.826+0000 7f91c36c0640 1 -- 172.21.15.112:0/2460790359 shutdown_connections 2024-09-15T23:56:50.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.826+0000 7f91c36c0640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f91a00678c0 0x7f91a0069d80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.826+0000 7f91c36c0640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91bc15c2a0 0x7f91bc0725c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.826+0000 7f91c36c0640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91bc15bec0 0x7f91bc163fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.826+0000 7f91c36c0640 1 --2- 172.21.15.112:0/2460790359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91bc0af470 0x7f91bc14a280 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.826+0000 7f91c36c0640 1 -- 172.21.15.112:0/2460790359 >> 172.21.15.112:0/2460790359 conn(0x7f91bc0b1f90 msgr2=0x7f91bc0b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:50.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.826+0000 7f91c36c0640 1 -- 172.21.15.112:0/2460790359 shutdown_connections 2024-09-15T23:56:50.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:50.826+0000 7f91c36c0640 1 -- 172.21.15.112:0/2460790359 wait complete. 2024-09-15T23:56:50.842 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:56:50.842 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:56:50.842 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:56:50.842 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:56:50.842 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:56:50.842 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:56:50.843 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:56:50.843 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:56:50.843 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:56:50.843 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:56:50.843 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:56:50.843 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:56:50.843 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:56:50.843 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:56:50.844 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:56:50.844 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:56:50.851 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:56:50.852 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:56:50.853 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:56:50.853 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:56:50.856 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:56:50.856 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:56:50.858 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:56:50.858 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:56:50.894 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:56:50.894 DEBUG:teuthology.parallel:result is None 2024-09-15T23:56:50.895 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:56:50.895 DEBUG:teuthology.parallel:result is None 2024-09-15T23:56:50.903 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:56:50.904 DEBUG:teuthology.parallel:result is None 2024-09-15T23:56:50.905 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:56:50.905 DEBUG:teuthology.parallel:result is None 2024-09-15T23:56:50.906 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:56:50.951 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-15T23:56:50.951 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-15T23:56:50.971 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-09-15T23:56:50.972 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-15T23:56:51.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d4a6f0640 1 Processor -- start 2024-09-15T23:56:51.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d4a6f0640 1 -- start start 2024-09-15T23:56:51.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d4a6f0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d440b5330 0x7f2d441620f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:51.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d4a6f0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2d4406ef10 0x7f2d4415f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:51.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d4a6f0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d440ae840 con 0x7f2d440b5710 2024-09-15T23:56:51.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d4a6f0640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2d441630c0 con 0x7f2d440b5330 2024-09-15T23:56:51.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d4a6f0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2d440aeae0 con 0x7f2d4406ef10 2024-09-15T23:56:51.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d43fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d440b5330 0x7f2d441620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:51.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d43fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2d440b5330 0x7f2d441620f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36030/0 (socket says 172.21.15.112:36030) 2024-09-15T23:56:51.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d43fff640 1 -- 172.21.15.112:0/3408813189 learned_addr learned my addr 172.21.15.112:0/3408813189 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:51.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d48c8d640 1 --2- 172.21.15.112:0/3408813189 >> v2:172.21.15.169:3300/0 conn(0x7f2d4406ef10 0x7f2d4415f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:51.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d43fff640 1 -- 172.21.15.112:0/3408813189 >> v2:172.21.15.169:3300/0 conn(0x7f2d4406ef10 msgr2=0x7f2d4415f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:51.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d43fff640 1 --2- 172.21.15.112:0/3408813189 >> v2:172.21.15.169:3300/0 conn(0x7f2d4406ef10 0x7f2d4415f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d43fff640 1 -- 172.21.15.112:0/3408813189 >> v1:172.21.15.169:6789/0 conn(0x7f2d440b5710 legacy=0x7f2d4406e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:51.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.022+0000 7f2d43fff640 1 -- 172.21.15.112:0/3408813189 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d44162820 con 0x7f2d440b5330 2024-09-15T23:56:51.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.026+0000 7f2d43fff640 1 --2- 172.21.15.112:0/3408813189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d440b5330 0x7f2d441620f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2d44067c40 tx=0x7f2d3401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ad594900ce82de server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:51.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.026+0000 7f2d42ffd640 1 -- 172.21.15.112:0/3408813189 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d340b0070 con 0x7f2d440b5330 2024-09-15T23:56:51.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.026+0000 7f2d42ffd640 1 -- 172.21.15.112:0/3408813189 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d340ab600 con 0x7f2d440b5330 2024-09-15T23:56:51.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.026+0000 7f2d42ffd640 1 -- 172.21.15.112:0/3408813189 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d340ab9d0 con 0x7f2d440b5330 2024-09-15T23:56:51.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.026+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/3408813189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d440b5330 msgr2=0x7f2d441620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:51.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.026+0000 7f2d4a6f0640 1 --2- 172.21.15.112:0/3408813189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d440b5330 0x7f2d441620f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2d44067c40 tx=0x7f2d3401c4e0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.026+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/3408813189 shutdown_connections 2024-09-15T23:56:51.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.026+0000 7f2d4a6f0640 1 --2- 172.21.15.112:0/3408813189 >> v2:172.21.15.169:3300/0 conn(0x7f2d4406ef10 0x7f2d4415f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.026+0000 7f2d4a6f0640 1 --2- 172.21.15.112:0/3408813189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d440b5330 0x7f2d441620f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.026+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/3408813189 >> 172.21.15.112:0/3408813189 conn(0x7f2d440b2ba0 msgr2=0x7f2d440b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:51.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.026+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/3408813189 shutdown_connections 2024-09-15T23:56:51.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.026+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/3408813189 wait complete. 2024-09-15T23:56:51.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.026+0000 7f2d4a6f0640 1 Processor -- start 2024-09-15T23:56:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.026+0000 7f2d4a6f0640 1 -- start start 2024-09-15T23:56:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d4a6f0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d4406ef10 0x7f2d4414a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d4a6f0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d440b5330 0x7f2d4414c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d4a6f0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4414fbc0 0x7f2d4414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d4a6f0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2d440afb60 con 0x7f2d4406ef10 2024-09-15T23:56:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d4a6f0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2d440af9e0 con 0x7f2d4414fbc0 2024-09-15T23:56:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d4a6f0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2d440afce0 con 0x7f2d440b5330 2024-09-15T23:56:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d43fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d4406ef10 0x7f2d4414a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d43fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d4406ef10 0x7f2d4414a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36042/0 (socket says 172.21.15.112:36042) 2024-09-15T23:56:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d43fff640 1 -- 172.21.15.112:0/4053028666 learned_addr learned my addr 172.21.15.112:0/4053028666 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d48c8d640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4414fbc0 0x7f2d4414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:51.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d437fe640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d440b5330 0x7f2d4414c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:51.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d43fff640 1 -- 172.21.15.112:0/4053028666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d440b5330 msgr2=0x7f2d4414c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:51.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d43fff640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d440b5330 0x7f2d4414c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d43fff640 1 -- 172.21.15.112:0/4053028666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4414fbc0 msgr2=0x7f2d4414d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:51.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d43fff640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4414fbc0 0x7f2d4414d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d43fff640 1 -- 172.21.15.112:0/4053028666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d4414b2e0 con 0x7f2d4406ef10 2024-09-15T23:56:51.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d48c8d640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4414fbc0 0x7f2d4414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:51.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d437fe640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d440b5330 0x7f2d4414c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:51.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d43fff640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d4406ef10 0x7f2d4414a940 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2d340ae040 tx=0x7f2d34019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:51.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d40ff9640 1 -- 172.21.15.112:0/4053028666 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d340b0040 con 0x7f2d4406ef10 2024-09-15T23:56:51.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d40ff9640 1 -- 172.21.15.112:0/4053028666 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d340b9070 con 0x7f2d4406ef10 2024-09-15T23:56:51.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d40ff9640 1 -- 172.21.15.112:0/4053028666 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d340b46a0 con 0x7f2d4406ef10 2024-09-15T23:56:51.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/4053028666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d4414b5c0 con 0x7f2d4406ef10 2024-09-15T23:56:51.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/4053028666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d4414bb80 con 0x7f2d4406ef10 2024-09-15T23:56:51.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/4053028666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d440b00a0 con 0x7f2d4406ef10 2024-09-15T23:56:51.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d40ff9640 1 -- 172.21.15.112:0/4053028666 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2d340b4840 con 0x7f2d4406ef10 2024-09-15T23:56:51.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d40ff9640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2d300678f0 0x7f2d30069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:51.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d40ff9640 1 -- 172.21.15.112:0/4053028666 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f2d3411f880 con 0x7f2d4406ef10 2024-09-15T23:56:51.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d437fe640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2d300678f0 0x7f2d30069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:51.034 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.030+0000 7f2d437fe640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2d300678f0 0x7f2d30069db0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d440cd110 tx=0x7f2d38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:51.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.034+0000 7f2d40ff9640 1 -- 172.21.15.112:0/4053028666 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2d340160d0 con 0x7f2d4406ef10 2024-09-15T23:56:51.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.206+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/4053028666 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2d4406c700 con 0x7f2d4406ef10 2024-09-15T23:56:51.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.922+0000 7f2d40ff9640 1 -- 172.21.15.112:0/4053028666 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v69) ==== 97+0+0 (secure 0 0 0) 0x7f2d340f0530 con 0x7f2d4406ef10 2024-09-15T23:56:51.924 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-15T23:56:51.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.926+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/4053028666 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2d300678f0 msgr2=0x7f2d30069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:51.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.926+0000 7f2d4a6f0640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2d300678f0 0x7f2d30069db0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d440cd110 tx=0x7f2d38009040 comp rx=0 tx=0).stop 2024-09-15T23:56:51.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.926+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/4053028666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d4406ef10 msgr2=0x7f2d4414a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.926+0000 7f2d4a6f0640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d4406ef10 0x7f2d4414a940 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2d340ae040 tx=0x7f2d34019280 comp rx=0 tx=0).stop 2024-09-15T23:56:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.926+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/4053028666 shutdown_connections 2024-09-15T23:56:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.926+0000 7f2d4a6f0640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2d300678f0 0x7f2d30069db0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.926+0000 7f2d4a6f0640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d4414fbc0 0x7f2d4414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.926+0000 7f2d4a6f0640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d440b5330 0x7f2d4414c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.926+0000 7f2d4a6f0640 1 --2- 172.21.15.112:0/4053028666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d4406ef10 0x7f2d4414a940 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.926+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/4053028666 >> 172.21.15.112:0/4053028666 conn(0x7f2d440b2ba0 msgr2=0x7f2d4406cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.926+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/4053028666 shutdown_connections 2024-09-15T23:56:51.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:51.926+0000 7f2d4a6f0640 1 -- 172.21.15.112:0/4053028666 wait complete. 2024-09-15T23:56:51.953 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:56:52.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.074+0000 7fb01e8e4640 1 Processor -- start 2024-09-15T23:56:52.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.074+0000 7fb01e8e4640 1 -- start start 2024-09-15T23:56:52.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb01e8e4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb01815bec0 0x7fb0180ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb01e8e4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0180af470 0x7fb01806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb01e8e4640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0180b3290 con 0x7fb01815c2a0 2024-09-15T23:56:52.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb01e8e4640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb0180b3570 con 0x7fb01815bec0 2024-09-15T23:56:52.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb01e8e4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb0180b3850 con 0x7fb0180af470 2024-09-15T23:56:52.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb0177fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb01815c2a0 0x7fb0180aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48318/0 (socket says 172.21.15.112:48318) 2024-09-15T23:56:52.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb0177fe640 1 -- 172.21.15.112:0/1690261778 learned_addr learned my addr 172.21.15.112:0/1690261778 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:52.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb01ce81640 1 --2- 172.21.15.112:0/1690261778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0180af470 0x7fb01806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 -- 172.21.15.112:0/1690261778 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1410880977 0 0) 0x7fb0180b3290 con 0x7fb01815c2a0 2024-09-15T23:56:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb017fff640 1 --2- 172.21.15.112:0/1690261778 >> v2:172.21.15.169:3300/0 conn(0x7fb01815bec0 0x7fb0180ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 -- 172.21.15.112:0/1690261778 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb000003530 con 0x7fb01815c2a0 2024-09-15T23:56:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 -- 172.21.15.112:0/1690261778 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3451901097 0 0) 0x7fb000003530 con 0x7fb01815c2a0 2024-09-15T23:56:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 -- 172.21.15.112:0/1690261778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0180af470 msgr2=0x7fb01806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 --2- 172.21.15.112:0/1690261778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0180af470 0x7fb01806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 -- 172.21.15.112:0/1690261778 >> v2:172.21.15.169:3300/0 conn(0x7fb01815bec0 msgr2=0x7fb0180ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 --2- 172.21.15.112:0/1690261778 >> v2:172.21.15.169:3300/0 conn(0x7fb01815bec0 0x7fb0180ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 -- 172.21.15.112:0/1690261778 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0180b3b30 con 0x7fb01815c2a0 2024-09-15T23:56:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 -- 172.21.15.112:0/1690261778 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fb00c001680 con 0x7fb01815c2a0 2024-09-15T23:56:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 -- 172.21.15.112:0/1690261778 >> v1:172.21.15.112:6789/0 conn(0x7fb01815c2a0 legacy=0x7fb0180aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 --2- 172.21.15.112:0/1690261778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0180af470 0x7fb0000039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 --2- 172.21.15.112:0/1690261778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb000003f40 0x7fb000004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 --2- 172.21.15.112:0/1690261778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb000004d50 0x7fb0000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 -- 172.21.15.112:0/1690261778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb0180b3570 con 0x7fb000003f40 2024-09-15T23:56:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 -- 172.21.15.112:0/1690261778 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb0180b3850 con 0x7fb000004d50 2024-09-15T23:56:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 -- 172.21.15.112:0/1690261778 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb00000ba20 con 0x7fb0180af470 2024-09-15T23:56:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb0177fe640 1 --2- 172.21.15.112:0/1690261778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb000003f40 0x7fb000004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb01ce81640 1 --2- 172.21.15.112:0/1690261778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb000004d50 0x7fb0000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb0177fe640 1 -- 172.21.15.112:0/1690261778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0180af470 msgr2=0x7fb0000039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb0177fe640 1 --2- 172.21.15.112:0/1690261778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb0180af470 0x7fb0000039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb0177fe640 1 -- 172.21.15.112:0/1690261778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb000004d50 msgr2=0x7fb0000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb0177fe640 1 --2- 172.21.15.112:0/1690261778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb000004d50 0x7fb0000051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb0177fe640 1 -- 172.21.15.112:0/1690261778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb000003530 con 0x7fb000003f40 2024-09-15T23:56:52.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb01ce81640 1 --2- 172.21.15.112:0/1690261778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb000004d50 0x7fb0000051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:52.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb0177fe640 1 --2- 172.21.15.112:0/1690261778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb000003f40 0x7fb000004810 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00c240 tx=0x7fb00c01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74187ff018b95e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:52.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 -- 172.21.15.112:0/1690261778 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c007d40 con 0x7fb000003f40 2024-09-15T23:56:52.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 -- 172.21.15.112:0/1690261778 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00c0a9020 con 0x7fb000003f40 2024-09-15T23:56:52.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.078+0000 7fb016ffd640 1 -- 172.21.15.112:0/1690261778 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0a5b50 con 0x7fb000003f40 2024-09-15T23:56:52.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 -- 172.21.15.112:0/1690261778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb000003f40 msgr2=0x7fb000004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 --2- 172.21.15.112:0/1690261778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb000003f40 0x7fb000004810 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00c240 tx=0x7fb00c01cc30 comp rx=0 tx=0).stop 2024-09-15T23:56:52.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01ce81640 1 -- 172.21.15.112:0/1690261778 reap_dead start 2024-09-15T23:56:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 -- 172.21.15.112:0/1690261778 shutdown_connections 2024-09-15T23:56:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 -- 172.21.15.112:0/1690261778 >> 172.21.15.112:0/1690261778 conn(0x7fb0180b1f90 msgr2=0x7fb0180b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 -- 172.21.15.112:0/1690261778 shutdown_connections 2024-09-15T23:56:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 -- 172.21.15.112:0/1690261778 wait complete. 2024-09-15T23:56:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 Processor -- start 2024-09-15T23:56:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 -- start start 2024-09-15T23:56:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb000003f40 0x7fb018145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb018153790 0x7fb0181f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0181f8550 0x7fb0181f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb01806e810 con 0x7fb000003f40 2024-09-15T23:56:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb0180ad740 con 0x7fb0181f8550 2024-09-15T23:56:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb01806e990 con 0x7fb018153790 2024-09-15T23:56:52.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb017fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb000003f40 0x7fb018145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb017fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb000003f40 0x7fb018145780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36048/0 (socket says 172.21.15.112:36048) 2024-09-15T23:56:52.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb017fff640 1 -- 172.21.15.112:0/2202373113 learned_addr learned my addr 172.21.15.112:0/2202373113 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:52.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01ce81640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0181f8550 0x7fb0181f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb0177fe640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb018153790 0x7fb0181f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb017fff640 1 -- 172.21.15.112:0/2202373113 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb018153790 msgr2=0x7fb0181f8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb017fff640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb018153790 0x7fb0181f8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb017fff640 1 -- 172.21.15.112:0/2202373113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0181f8550 msgr2=0x7fb0181f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb017fff640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0181f8550 0x7fb0181f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb017fff640 1 -- 172.21.15.112:0/2202373113 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb018153d00 con 0x7fb000003f40 2024-09-15T23:56:52.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb0177fe640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb018153790 0x7fb0181f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:52.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb017fff640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb000003f40 0x7fb018145780 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb00800e840 tx=0x7fb00800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:52.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb014ff9640 1 -- 172.21.15.112:0/2202373113 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008017070 con 0x7fb000003f40 2024-09-15T23:56:52.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb014ff9640 1 -- 172.21.15.112:0/2202373113 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00800c8c0 con 0x7fb000003f40 2024-09-15T23:56:52.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 -- 172.21.15.112:0/2202373113 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb018153fe0 con 0x7fb000003f40 2024-09-15T23:56:52.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb014ff9640 1 -- 172.21.15.112:0/2202373113 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00800ccb0 con 0x7fb000003f40 2024-09-15T23:56:52.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.082+0000 7fb01e8e4640 1 -- 172.21.15.112:0/2202373113 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0181545a0 con 0x7fb000003f40 2024-09-15T23:56:52.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.086+0000 7fb01e8e4640 1 -- 172.21.15.112:0/2202373113 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0180ad200 con 0x7fb000003f40 2024-09-15T23:56:52.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.086+0000 7fb014ff9640 1 -- 172.21.15.112:0/2202373113 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb00801a070 con 0x7fb000003f40 2024-09-15T23:56:52.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.086+0000 7fb014ff9640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb0040678f0 0x7fb004069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.086+0000 7fb0177fe640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb0040678f0 0x7fb004069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.086+0000 7fb014ff9640 1 -- 172.21.15.112:0/2202373113 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7fb008085cb0 con 0x7fb000003f40 2024-09-15T23:56:52.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.086+0000 7fb0177fe640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb0040678f0 0x7fb004069db0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0aa000 tx=0x7fb0180b3460 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:52.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.090+0000 7fb014ff9640 1 -- 172.21.15.112:0/2202373113 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb008056a40 con 0x7fb000003f40 2024-09-15T23:56:52.302 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.302+0000 7fb01e8e4640 1 -- 172.21.15.112:0/2202373113 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb01809be20 con 0x7fb000003f40 2024-09-15T23:56:52.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.302+0000 7fb014ff9640 1 -- 172.21.15.112:0/2202373113 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fb008056340 con 0x7fb000003f40 2024-09-15T23:56:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:52.304 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:56:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-15T23:56:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-15T23:56:52.304 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmPvLEFBAA/WS7KNQ60+LzhOcQyCVWoQ==", 2024-09-15T23:56:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:56:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:56:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.305 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-15T23:56:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmN/+jIxAAiXM9onNC3twhiZrqCdWtUQ==", 2024-09-15T23:56:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:52.306 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:56:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:56:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.307 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-15T23:56:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmEbNbHRAAjP+2Z2XYc0tarO48R/ocIQ==", 2024-09-15T23:56:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:56:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:56:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.308 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-15T23:56:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmg6AqLBAAZ3PKcarPcPfvIWSTnE5uLA==", 2024-09-15T23:56:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.309 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:56:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:56:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-15T23:56:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBRc+dmnOKMBxAAdaIaYmXKAFGIPTxfYt2apQ==", 2024-09-15T23:56:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:52.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-15T23:56:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBUc+dmnowGFhAAa3jXrvZ0An+9IwM9988mvQ==", 2024-09-15T23:56:52.312 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-15T23:56:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBXc+dmnj9kJRAAZbpx5TM2ukiLKqi+iZAE5g==", 2024-09-15T23:56:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:52.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-15T23:56:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBac+dmAdXtNxAA8g+Nxz1RyVf+P8KOtkw5qw==", 2024-09-15T23:56:52.315 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-15T23:56:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBhc+dmyOApAhAA9Cv9nW1b5JvO9cH9emao4A==", 2024-09-15T23:56:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:52.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-15T23:56:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBkc+dmFIDwDxAAR/59kfrjiLU4emIqtthfRg==", 2024-09-15T23:56:52.318 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-15T23:56:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBnc+dmZVB/IRAAFbvodnxisklCL/yuD+F5ew==", 2024-09-15T23:56:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:52.320 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-15T23:56:52.321 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBqc+dmuty6LxAAHWB/GByU/hXOL/+dnRpcVA==", 2024-09-15T23:56:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:56:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-15T23:56:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw==", 2024-09-15T23:56:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-15T23:56:52.323 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:56:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-15T23:56:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmmP6vORAAqxzX3OjoHnionZo1koIqRQ==", 2024-09-15T23:56:52.324 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:56:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:56:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:56:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-15T23:56:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmj2XtNhAAB5620fN0Kr8Cqgd2+1cebg==", 2024-09-15T23:56:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:56:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:56:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:56:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-15T23:56:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBOc+dmt+I7AxAA+eyV3eaThbjRNo0zJT9OQg==", 2024-09-15T23:56:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:56:52.328 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:56:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:56:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:56:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-15T23:56:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBMc+dmDuzBORAAzpiXmO3QO+1RKRvPGQLViQ==", 2024-09-15T23:56:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:56:52.330 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:56:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:56:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.331 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-15T23:56:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dm4JK5ERAA3d3OABWXchejCqjJRrhTfQ==", 2024-09-15T23:56:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:56:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-15T23:56:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:56:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-15T23:56:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dm5nULDxAAi9UvgPZ7sU/Zz2jLKsu4ng==", 2024-09-15T23:56:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:56:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:56:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-15T23:56:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:56:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.334 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-15T23:56:52.334 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:56:52.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.306+0000 7fb01e8e4640 1 -- 172.21.15.112:0/2202373113 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb0040678f0 msgr2=0x7fb004069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.306+0000 7fb01e8e4640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb0040678f0 0x7fb004069db0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0aa000 tx=0x7fb0180b3460 comp rx=0 tx=0).stop 2024-09-15T23:56:52.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.306+0000 7fb01e8e4640 1 -- 172.21.15.112:0/2202373113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb000003f40 msgr2=0x7fb018145780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.306+0000 7fb01e8e4640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb000003f40 0x7fb018145780 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb00800e840 tx=0x7fb00800ed00 comp rx=0 tx=0).stop 2024-09-15T23:56:52.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.306+0000 7fb01e8e4640 1 -- 172.21.15.112:0/2202373113 shutdown_connections 2024-09-15T23:56:52.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.306+0000 7fb01e8e4640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb0040678f0 0x7fb004069db0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.306+0000 7fb01e8e4640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0181f8550 0x7fb0181f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.306+0000 7fb01e8e4640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb018153790 0x7fb0181f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.306+0000 7fb01e8e4640 1 --2- 172.21.15.112:0/2202373113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb000003f40 0x7fb018145780 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.306+0000 7fb01e8e4640 1 -- 172.21.15.112:0/2202373113 >> 172.21.15.112:0/2202373113 conn(0x7fb0180b1f90 msgr2=0x7fb01815a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:52.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.306+0000 7fb01e8e4640 1 -- 172.21.15.112:0/2202373113 shutdown_connections 2024-09-15T23:56:52.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.306+0000 7fb01e8e4640 1 -- 172.21.15.112:0/2202373113 wait complete. 2024-09-15T23:56:52.338 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:56:52.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0be0970640 1 Processor -- start 2024-09-15T23:56:52.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0be0970640 1 -- start start 2024-09-15T23:56:52.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0be0970640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0bdc1520a0 0x7f0bdc06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0be0970640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0bdc15f3a0 0x7f0bdc0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0be0970640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bdc070250 con 0x7f0bdc06fe50 2024-09-15T23:56:52.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0be0970640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f0bdc152480 con 0x7f0bdc1520a0 2024-09-15T23:56:52.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0be0970640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0bdc0aede0 con 0x7f0bdc15f3a0 2024-09-15T23:56:52.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0bdad9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0bdc15f3a0 0x7f0bdc0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0bda59c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0bdc1520a0 0x7f0bdc06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0bdad9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0bdc15f3a0 0x7f0bdc0adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:56252/0 (socket says 172.21.15.112:56252) 2024-09-15T23:56:52.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0bdad9d640 1 -- 172.21.15.112:0/4182672136 learned_addr learned my addr 172.21.15.112:0/4182672136 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:52.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0bda59c640 1 -- 172.21.15.112:0/4182672136 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0bdc15f3a0 msgr2=0x7f0bdc0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:52.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0bda59c640 1 --2- 172.21.15.112:0/4182672136 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0bdc15f3a0 0x7f0bdc0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0bda59c640 1 -- 172.21.15.112:0/4182672136 >> v1:172.21.15.169:6789/0 conn(0x7f0bdc06fe50 legacy=0x7f0bdc15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.458+0000 7f0bda59c640 1 -- 172.21.15.112:0/4182672136 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc15fa10 con 0x7f0bdc1520a0 2024-09-15T23:56:52.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0bda59c640 1 --2- 172.21.15.112:0/4182672136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0bdc1520a0 0x7f0bdc06f910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0097c0 tx=0x7f0bcc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed149970927cb157 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:52.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0bd959a640 1 -- 172.21.15.112:0/4182672136 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0b2070 con 0x7f0bdc1520a0 2024-09-15T23:56:52.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0bd959a640 1 -- 172.21.15.112:0/4182672136 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bcc0ad640 con 0x7f0bdc1520a0 2024-09-15T23:56:52.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0bd959a640 1 -- 172.21.15.112:0/4182672136 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0ada10 con 0x7f0bdc1520a0 2024-09-15T23:56:52.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 -- 172.21.15.112:0/4182672136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0bdc1520a0 msgr2=0x7f0bdc06f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 --2- 172.21.15.112:0/4182672136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0bdc1520a0 0x7f0bdc06f910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0097c0 tx=0x7f0bcc01c4a0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 -- 172.21.15.112:0/4182672136 shutdown_connections 2024-09-15T23:56:52.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 --2- 172.21.15.112:0/4182672136 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0bdc15f3a0 0x7f0bdc0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 --2- 172.21.15.112:0/4182672136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0bdc1520a0 0x7f0bdc06f910 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 -- 172.21.15.112:0/4182672136 >> 172.21.15.112:0/4182672136 conn(0x7f0bdc0b1f90 msgr2=0x7f0bdc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:52.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 -- 172.21.15.112:0/4182672136 shutdown_connections 2024-09-15T23:56:52.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 -- 172.21.15.112:0/4182672136 wait complete. 2024-09-15T23:56:52.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 Processor -- start 2024-09-15T23:56:52.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 -- start start 2024-09-15T23:56:52.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0bdc06fe50 0x7f0bdc144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0bdc1520a0 0x7f0bdc1446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bdc15f3a0 0x7f0bdc14e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc073d30 con 0x7f0bdc15f3a0 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc073a50 con 0x7f0bdc1520a0 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0be0970640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0bdc167f10 con 0x7f0bdc06fe50 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0bdad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bdc15f3a0 0x7f0bdc14e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0bdad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bdc15f3a0 0x7f0bdc14e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36058/0 (socket says 172.21.15.112:36058) 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0bdad9d640 1 -- 172.21.15.112:0/4109478962 learned_addr learned my addr 172.21.15.112:0/4109478962 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0bda59c640 1 --2- 172.21.15.112:0/4109478962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0bdc06fe50 0x7f0bdc144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0bd9d9b640 1 --2- 172.21.15.112:0/4109478962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0bdc1520a0 0x7f0bdc1446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0bdad9d640 1 -- 172.21.15.112:0/4109478962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0bdc06fe50 msgr2=0x7f0bdc144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0bdad9d640 1 --2- 172.21.15.112:0/4109478962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0bdc06fe50 0x7f0bdc144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0bdad9d640 1 -- 172.21.15.112:0/4109478962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0bdc1520a0 msgr2=0x7f0bdc1446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0bdad9d640 1 --2- 172.21.15.112:0/4109478962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0bdc1520a0 0x7f0bdc1446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.462+0000 7f0bdad9d640 1 -- 172.21.15.112:0/4109478962 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc15e5e0 con 0x7f0bdc15f3a0 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.466+0000 7f0bdad9d640 1 --2- 172.21.15.112:0/4109478962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bdc15f3a0 0x7f0bdc14e0e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009d90 tx=0x7f0bd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.466+0000 7f0bcaffd640 1 -- 172.21.15.112:0/4109478962 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400cd20 con 0x7f0bdc15f3a0 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.466+0000 7f0bcaffd640 1 -- 172.21.15.112:0/4109478962 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd40039a0 con 0x7f0bdc15f3a0 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.466+0000 7f0be0970640 1 -- 172.21.15.112:0/4109478962 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bdc15da60 con 0x7f0bdc15f3a0 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.466+0000 7f0bcaffd640 1 -- 172.21.15.112:0/4109478962 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4003d70 con 0x7f0bdc15f3a0 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.466+0000 7f0be0970640 1 -- 172.21.15.112:0/4109478962 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bdc15e020 con 0x7f0bdc15f3a0 2024-09-15T23:56:52.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.466+0000 7f0be0970640 1 -- 172.21.15.112:0/4109478962 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bdc06f910 con 0x7f0bdc15f3a0 2024-09-15T23:56:52.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.466+0000 7f0bcaffd640 1 -- 172.21.15.112:0/4109478962 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0bd4012050 con 0x7f0bdc15f3a0 2024-09-15T23:56:52.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.466+0000 7f0bcaffd640 1 --2- 172.21.15.112:0/4109478962 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0bbc0678c0 0x7f0bbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.466+0000 7f0bcaffd640 1 -- 172.21.15.112:0/4109478962 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f0bd4086c90 con 0x7f0bdc15f3a0 2024-09-15T23:56:52.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.466+0000 7f0bda59c640 1 --2- 172.21.15.112:0/4109478962 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0bbc0678c0 0x7f0bbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.466+0000 7f0bda59c640 1 --2- 172.21.15.112:0/4109478962 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0bbc0678c0 0x7f0bbc069d80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0af000 tx=0x7f0bcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:52.471 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.470+0000 7f0bcaffd640 1 -- 172.21.15.112:0/4109478962 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0bd4022020 con 0x7f0bdc15f3a0 2024-09-15T23:56:52.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.634+0000 7f0be0970640 1 -- 172.21.15.112:0/4109478962 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0bdc14a890 con 0x7f0bdc15f3a0 2024-09-15T23:56:52.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.634+0000 7f0bcaffd640 1 -- 172.21.15.112:0/4109478962 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7f0bd4010040 con 0x7f0bdc15f3a0 2024-09-15T23:56:52.634 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:52.635 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-15T23:56:52.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:56:52.635 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-15T23:56:52.635 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-15T23:56:52.635 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:56:52.635 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-15T23:56:52.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.634+0000 7f0be0970640 1 -- 172.21.15.112:0/4109478962 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0bbc0678c0 msgr2=0x7f0bbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.634+0000 7f0be0970640 1 --2- 172.21.15.112:0/4109478962 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0bbc0678c0 0x7f0bbc069d80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0af000 tx=0x7f0bcc008040 comp rx=0 tx=0).stop 2024-09-15T23:56:52.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.634+0000 7f0be0970640 1 -- 172.21.15.112:0/4109478962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bdc15f3a0 msgr2=0x7f0bdc14e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.634+0000 7f0be0970640 1 --2- 172.21.15.112:0/4109478962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bdc15f3a0 0x7f0bdc14e0e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009d90 tx=0x7f0bd400c490 comp rx=0 tx=0).stop 2024-09-15T23:56:52.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.634+0000 7f0be0970640 1 -- 172.21.15.112:0/4109478962 shutdown_connections 2024-09-15T23:56:52.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.634+0000 7f0be0970640 1 --2- 172.21.15.112:0/4109478962 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0bbc0678c0 0x7f0bbc069d80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.634+0000 7f0be0970640 1 --2- 172.21.15.112:0/4109478962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bdc15f3a0 0x7f0bdc14e0e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.634+0000 7f0be0970640 1 --2- 172.21.15.112:0/4109478962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0bdc1520a0 0x7f0bdc1446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.634+0000 7f0be0970640 1 --2- 172.21.15.112:0/4109478962 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0bdc06fe50 0x7f0bdc144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.634+0000 7f0be0970640 1 -- 172.21.15.112:0/4109478962 >> 172.21.15.112:0/4109478962 conn(0x7f0bdc0b1f90 msgr2=0x7f0bdc0cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:52.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.634+0000 7f0be0970640 1 -- 172.21.15.112:0/4109478962 shutdown_connections 2024-09-15T23:56:52.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.634+0000 7f0be0970640 1 -- 172.21.15.112:0/4109478962 wait complete. 2024-09-15T23:56:52.654 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:56:52.654 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:56:52.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.774+0000 7f3a0e54c640 1 Processor -- start 2024-09-15T23:56:52.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.774+0000 7f3a0e54c640 1 -- start start 2024-09-15T23:56:52.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.774+0000 7f3a0e54c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a081457a0 0x7f3a080d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.774+0000 7f3a0e54c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3a080b4510 0x7f3a080d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.774+0000 7f3a0e54c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a080d27a0 con 0x7f3a080cf800 2024-09-15T23:56:52.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.774+0000 7f3a0e54c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f3a080d2a80 con 0x7f3a080b4510 2024-09-15T23:56:52.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.774+0000 7f3a0e54c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3a080d2d60 con 0x7f3a081457a0 2024-09-15T23:56:52.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.778+0000 7f3a077fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f3a080cf800 0x7f3a080b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:53646/0 (socket says 172.21.15.112:53646) 2024-09-15T23:56:52.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.778+0000 7f3a077fe640 1 -- 172.21.15.112:0/2236077297 learned_addr learned my addr 172.21.15.112:0/2236077297 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:52.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.778+0000 7f3a0cae9640 1 --2- 172.21.15.112:0/2236077297 >> v2:172.21.15.169:3300/0 conn(0x7f3a080b4510 0x7f3a080d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.778+0000 7f3a07fff640 1 --2- 172.21.15.112:0/2236077297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a081457a0 0x7f3a080d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.778+0000 7f3a0cae9640 1 -- 172.21.15.112:0/2236077297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a081457a0 msgr2=0x7f3a080d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:52.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.778+0000 7f3a0cae9640 1 --2- 172.21.15.112:0/2236077297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a081457a0 0x7f3a080d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.778+0000 7f3a0cae9640 1 -- 172.21.15.112:0/2236077297 >> v1:172.21.15.169:6789/0 conn(0x7f3a080cf800 legacy=0x7f3a080b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.778+0000 7f3a0cae9640 1 -- 172.21.15.112:0/2236077297 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a080d01f0 con 0x7f3a080b4510 2024-09-15T23:56:52.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.778+0000 7f3a07fff640 1 --2- 172.21.15.112:0/2236077297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a081457a0 0x7f3a080d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:56:52.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.778+0000 7f3a0cae9640 1 --2- 172.21.15.112:0/2236077297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a080b4510 0x7f3a080d0710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009d90 tx=0x7f3a0001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=264e2b4312bc74f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:52.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.778+0000 7f3a06ffd640 1 -- 172.21.15.112:0/2236077297 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a000b2070 con 0x7f3a080b4510 2024-09-15T23:56:52.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.778+0000 7f3a06ffd640 1 -- 172.21.15.112:0/2236077297 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a000a57a0 con 0x7f3a080b4510 2024-09-15T23:56:52.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.778+0000 7f3a06ffd640 1 -- 172.21.15.112:0/2236077297 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a000a5b70 con 0x7f3a080b4510 2024-09-15T23:56:52.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 -- 172.21.15.112:0/2236077297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a080b4510 msgr2=0x7f3a080d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 --2- 172.21.15.112:0/2236077297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a080b4510 0x7f3a080d0710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009d90 tx=0x7f3a0001c8e0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 -- 172.21.15.112:0/2236077297 shutdown_connections 2024-09-15T23:56:52.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 --2- 172.21.15.112:0/2236077297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a080b4510 0x7f3a080d0710 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 --2- 172.21.15.112:0/2236077297 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a081457a0 0x7f3a080d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 -- 172.21.15.112:0/2236077297 >> 172.21.15.112:0/2236077297 conn(0x7f3a0806bcc0 msgr2=0x7f3a0806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:52.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 -- 172.21.15.112:0/2236077297 shutdown_connections 2024-09-15T23:56:52.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 -- 172.21.15.112:0/2236077297 wait complete. 2024-09-15T23:56:52.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 Processor -- start 2024-09-15T23:56:52.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 -- start start 2024-09-15T23:56:52.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a080b4510 0x7f3a08143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a080cf800 0x7f3a08163a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a081457a0 0x7f3a08163f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3a081690b0 con 0x7f3a080b4510 2024-09-15T23:56:52.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3a080d16b0 con 0x7f3a080cf800 2024-09-15T23:56:52.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3a08169230 con 0x7f3a081457a0 2024-09-15T23:56:52.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a07fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a080b4510 0x7f3a08143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a07fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a080b4510 0x7f3a08143b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36068/0 (socket says 172.21.15.112:36068) 2024-09-15T23:56:52.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a07fff640 1 -- 172.21.15.112:0/254700531 learned_addr learned my addr 172.21.15.112:0/254700531 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:52.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0cae9640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a081457a0 0x7f3a08163f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a077fe640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a080cf800 0x7f3a08163a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a07fff640 1 -- 172.21.15.112:0/254700531 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a081457a0 msgr2=0x7f3a08163f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a07fff640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a081457a0 0x7f3a08163f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a07fff640 1 -- 172.21.15.112:0/254700531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a080cf800 msgr2=0x7f3a08163a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a07fff640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a080cf800 0x7f3a08163a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a07fff640 1 -- 172.21.15.112:0/254700531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a08164ac0 con 0x7f3a080b4510 2024-09-15T23:56:52.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0cae9640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a081457a0 0x7f3a08163f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:56:52.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a07fff640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a080b4510 0x7f3a08143b20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f39f800e980 tx=0x7f39f800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:52.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a04ff9640 1 -- 172.21.15.112:0/254700531 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f8017070 con 0x7f3a080b4510 2024-09-15T23:56:52.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a04ff9640 1 -- 172.21.15.112:0/254700531 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f800ca00 con 0x7f3a080b4510 2024-09-15T23:56:52.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a0e54c640 1 -- 172.21.15.112:0/254700531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a080a9460 con 0x7f3a080b4510 2024-09-15T23:56:52.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.782+0000 7f3a04ff9640 1 -- 172.21.15.112:0/254700531 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f800cdd0 con 0x7f3a080b4510 2024-09-15T23:56:52.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.786+0000 7f3a0e54c640 1 -- 172.21.15.112:0/254700531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a08164d60 con 0x7f3a080b4510 2024-09-15T23:56:52.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.786+0000 7f3a0e54c640 1 -- 172.21.15.112:0/254700531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a080d0710 con 0x7f3a080b4510 2024-09-15T23:56:52.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.786+0000 7f3a04ff9640 1 -- 172.21.15.112:0/254700531 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f39f801a070 con 0x7f3a080b4510 2024-09-15T23:56:52.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.786+0000 7f3a04ff9640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f39f4067910 0x7f39f4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.786+0000 7f3a04ff9640 1 -- 172.21.15.112:0/254700531 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f39f80860a0 con 0x7f3a080b4510 2024-09-15T23:56:52.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.786+0000 7f3a077fe640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f39f4067910 0x7f39f4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.786+0000 7f3a077fe640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f39f4067910 0x7f39f4069dd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3a08165b10 tx=0x7f39fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:52.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.790+0000 7f3a04ff9640 1 -- 172.21.15.112:0/254700531 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f39f8056e80 con 0x7f3a080b4510 2024-09-15T23:56:52.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:52.954+0000 7f3a0e54c640 1 -- 172.21.15.112:0/254700531 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3a080b66d0 con 0x7f3a080b4510 2024-09-15T23:56:53.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:53.930+0000 7f3a04ff9640 1 -- 172.21.15.112:0/254700531 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f39f8056780 con 0x7f3a080b4510 2024-09-15T23:56:53.930 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-15T23:56:53.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:53.934+0000 7f3a0e54c640 1 -- 172.21.15.112:0/254700531 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f39f4067910 msgr2=0x7f39f4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:53.934+0000 7f3a0e54c640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f39f4067910 0x7f39f4069dd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3a08165b10 tx=0x7f39fc009040 comp rx=0 tx=0).stop 2024-09-15T23:56:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:53.934+0000 7f3a0e54c640 1 -- 172.21.15.112:0/254700531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a080b4510 msgr2=0x7f3a08143b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:53.934+0000 7f3a0e54c640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a080b4510 0x7f3a08143b20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f39f800e980 tx=0x7f39f800ee40 comp rx=0 tx=0).stop 2024-09-15T23:56:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:53.934+0000 7f3a0e54c640 1 -- 172.21.15.112:0/254700531 shutdown_connections 2024-09-15T23:56:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:53.934+0000 7f3a0e54c640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f39f4067910 0x7f39f4069dd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:53.934+0000 7f3a0e54c640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a081457a0 0x7f3a08163f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:53.934+0000 7f3a0e54c640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a080cf800 0x7f3a08163a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:53.934+0000 7f3a0e54c640 1 --2- 172.21.15.112:0/254700531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a080b4510 0x7f3a08143b20 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:53.934+0000 7f3a0e54c640 1 -- 172.21.15.112:0/254700531 >> 172.21.15.112:0/254700531 conn(0x7f3a0806bcc0 msgr2=0x7f3a08074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:53.934+0000 7f3a0e54c640 1 -- 172.21.15.112:0/254700531 shutdown_connections 2024-09-15T23:56:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:53.934+0000 7f3a0e54c640 1 -- 172.21.15.112:0/254700531 wait complete. 2024-09-15T23:56:53.959 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:56:54.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.086+0000 7f0184958640 1 Processor -- start 2024-09-15T23:56:54.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.086+0000 7f0184958640 1 -- start start 2024-09-15T23:56:54.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f0184958640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f01800d15d0 0x7f01800cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f0184958640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0180162070 0x7f01801624c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f0184958640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01800d0350 con 0x7f018015e4f0 2024-09-15T23:56:54.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f0184958640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f0180162a00 con 0x7f01800d15d0 2024-09-15T23:56:54.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f0184958640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f01800cf070 con 0x7f0180162070 2024-09-15T23:56:54.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f017ed9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0180162070 0x7f01801624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:54.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f017dd9b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f01800d15d0 0x7f01800cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:54.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f017ed9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0180162070 0x7f01801624c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:56276/0 (socket says 172.21.15.112:56276) 2024-09-15T23:56:54.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f017ed9d640 1 -- 172.21.15.112:0/1072985004 learned_addr learned my addr 172.21.15.112:0/1072985004 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:54.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f017ed9d640 1 -- 172.21.15.112:0/1072985004 >> v2:172.21.15.169:3300/0 conn(0x7f01800d15d0 msgr2=0x7f01800cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:54.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f017ed9d640 1 --2- 172.21.15.112:0/1072985004 >> v2:172.21.15.169:3300/0 conn(0x7f01800d15d0 0x7f01800cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f017ed9d640 1 -- 172.21.15.112:0/1072985004 >> v1:172.21.15.169:6789/0 conn(0x7f018015e4f0 legacy=0x7f01800d4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f017ed9d640 1 -- 172.21.15.112:0/1072985004 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01800d1c20 con 0x7f0180162070 2024-09-15T23:56:54.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f017dd9b640 1 --2- 172.21.15.112:0/1072985004 >> v2:172.21.15.169:3300/0 conn(0x7f01800d15d0 0x7f01800cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:56:54.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f017ed9d640 1 --2- 172.21.15.112:0/1072985004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0180162070 0x7f01801624c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0178009e50 tx=0x7f017801f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dc75c655fea6f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:54.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f017d59a640 1 -- 172.21.15.112:0/1072985004 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01780b4070 con 0x7f0180162070 2024-09-15T23:56:54.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.090+0000 7f017d59a640 1 -- 172.21.15.112:0/1072985004 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01780af400 con 0x7f0180162070 2024-09-15T23:56:54.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f017d59a640 1 -- 172.21.15.112:0/1072985004 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01780af7d0 con 0x7f0180162070 2024-09-15T23:56:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 -- 172.21.15.112:0/1072985004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0180162070 msgr2=0x7f01801624c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 --2- 172.21.15.112:0/1072985004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0180162070 0x7f01801624c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0178009e50 tx=0x7f017801f210 comp rx=0 tx=0).stop 2024-09-15T23:56:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 -- 172.21.15.112:0/1072985004 shutdown_connections 2024-09-15T23:56:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 --2- 172.21.15.112:0/1072985004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0180162070 0x7f01801624c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 --2- 172.21.15.112:0/1072985004 >> v2:172.21.15.169:3300/0 conn(0x7f01800d15d0 0x7f01800cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 -- 172.21.15.112:0/1072985004 >> 172.21.15.112:0/1072985004 conn(0x7f018008bf90 msgr2=0x7f01800d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 -- 172.21.15.112:0/1072985004 shutdown_connections 2024-09-15T23:56:54.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 -- 172.21.15.112:0/1072985004 wait complete. 2024-09-15T23:56:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 Processor -- start 2024-09-15T23:56:54.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 -- start start 2024-09-15T23:56:54.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01800d15d0 0x7f018014e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f018015e4f0 0x7f018014f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0180162070 0x7f01800cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f01800cf8f0 con 0x7f01800d15d0 2024-09-15T23:56:54.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01800cf610 con 0x7f0180162070 2024-09-15T23:56:54.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f018015e8d0 con 0x7f018015e4f0 2024-09-15T23:56:54.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f017e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01800d15d0 0x7f018014e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:54.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f017e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01800d15d0 0x7f018014e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36084/0 (socket says 172.21.15.112:36084) 2024-09-15T23:56:54.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f017e59c640 1 -- 172.21.15.112:0/1793127010 learned_addr learned my addr 172.21.15.112:0/1793127010 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:54.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f017dd9b640 1 --2- 172.21.15.112:0/1793127010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f018015e4f0 0x7f018014f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f017ed9d640 1 --2- 172.21.15.112:0/1793127010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0180162070 0x7f01800cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f017e59c640 1 -- 172.21.15.112:0/1793127010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f018015e4f0 msgr2=0x7f018014f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f017e59c640 1 --2- 172.21.15.112:0/1793127010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f018015e4f0 0x7f018014f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f017e59c640 1 -- 172.21.15.112:0/1793127010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0180162070 msgr2=0x7f01800cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f017e59c640 1 --2- 172.21.15.112:0/1793127010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0180162070 0x7f01800cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f017e59c640 1 -- 172.21.15.112:0/1793127010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01800ccb10 con 0x7f01800d15d0 2024-09-15T23:56:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f017e59c640 1 --2- 172.21.15.112:0/1793127010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01800d15d0 0x7f018014e7d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f017000c450 tx=0x7f017000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f016effd640 1 -- 172.21.15.112:0/1793127010 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170016020 con 0x7f01800d15d0 2024-09-15T23:56:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f016effd640 1 -- 172.21.15.112:0/1793127010 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01700052d0 con 0x7f01800d15d0 2024-09-15T23:56:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 -- 172.21.15.112:0/1793127010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01800ccdf0 con 0x7f01800d15d0 2024-09-15T23:56:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f016effd640 1 -- 172.21.15.112:0/1793127010 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170007260 con 0x7f01800d15d0 2024-09-15T23:56:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.094+0000 7f0184958640 1 -- 172.21.15.112:0/1793127010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01800cd3b0 con 0x7f01800d15d0 2024-09-15T23:56:54.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.098+0000 7f0184958640 1 -- 172.21.15.112:0/1793127010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01800cfe10 con 0x7f01800d15d0 2024-09-15T23:56:54.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.098+0000 7f016effd640 1 -- 172.21.15.112:0/1793127010 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0170007400 con 0x7f01800d15d0 2024-09-15T23:56:54.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.098+0000 7f016effd640 1 --2- 172.21.15.112:0/1793127010 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f01600678c0 0x7f0160069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.098+0000 7f016effd640 1 -- 172.21.15.112:0/1793127010 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5619+0+0 (secure 0 0 0) 0x7f0170085570 con 0x7f01800d15d0 2024-09-15T23:56:54.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.098+0000 7f017dd9b640 1 --2- 172.21.15.112:0/1793127010 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f01600678c0 0x7f0160069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:54.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.098+0000 7f017dd9b640 1 --2- 172.21.15.112:0/1793127010 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f01600678c0 0x7f0160069d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0174009580 tx=0x7f0174009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:54.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.102+0000 7f016effd640 1 -- 172.21.15.112:0/1793127010 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0170020020 con 0x7f01800d15d0 2024-09-15T23:56:54.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.270+0000 7f0184958640 1 -- 172.21.15.112:0/1793127010 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f01800d51a0 con 0x7f01800d15d0 2024-09-15T23:56:54.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.942+0000 7f016effd640 1 -- 172.21.15.112:0/1793127010 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7f0170005480 con 0x7f01800d15d0 2024-09-15T23:56:54.941 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-15T23:56:54.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.942+0000 7f0184958640 1 -- 172.21.15.112:0/1793127010 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f01600678c0 msgr2=0x7f0160069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.942+0000 7f0184958640 1 --2- 172.21.15.112:0/1793127010 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f01600678c0 0x7f0160069d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0174009580 tx=0x7f0174009190 comp rx=0 tx=0).stop 2024-09-15T23:56:54.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.942+0000 7f0184958640 1 -- 172.21.15.112:0/1793127010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01800d15d0 msgr2=0x7f018014e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.942+0000 7f0184958640 1 --2- 172.21.15.112:0/1793127010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01800d15d0 0x7f018014e7d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f017000c450 tx=0x7f017000c910 comp rx=0 tx=0).stop 2024-09-15T23:56:54.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.942+0000 7f0184958640 1 -- 172.21.15.112:0/1793127010 shutdown_connections 2024-09-15T23:56:54.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.942+0000 7f0184958640 1 --2- 172.21.15.112:0/1793127010 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f01600678c0 0x7f0160069d80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.942+0000 7f0184958640 1 --2- 172.21.15.112:0/1793127010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0180162070 0x7f01800cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.942+0000 7f0184958640 1 --2- 172.21.15.112:0/1793127010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f018015e4f0 0x7f018014f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.942+0000 7f0184958640 1 --2- 172.21.15.112:0/1793127010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01800d15d0 0x7f018014e7d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.942+0000 7f0184958640 1 -- 172.21.15.112:0/1793127010 >> 172.21.15.112:0/1793127010 conn(0x7f018008bf90 msgr2=0x7f018015cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:54.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.942+0000 7f0184958640 1 -- 172.21.15.112:0/1793127010 shutdown_connections 2024-09-15T23:56:54.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:54.942+0000 7f0184958640 1 -- 172.21.15.112:0/1793127010 wait complete. 2024-09-15T23:56:54.980 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:56:55.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cf5e05640 1 Processor -- start 2024-09-15T23:56:55.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cf5e05640 1 -- start start 2024-09-15T23:56:55.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cf5e05640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7cf015f3a0 0x7f7cf0165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:55.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cf5e05640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf00aede0 con 0x7f7cf01520a0 2024-09-15T23:56:55.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cf5e05640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf015fa10 con 0x7f7cf0070020 2024-09-15T23:56:55.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cf5e05640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf0152480 con 0x7f7cf015f3a0 2024-09-15T23:56:55.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cef7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7cf01520a0 0x7f7cf006f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48324/0 (socket says 172.21.15.112:48324) 2024-09-15T23:56:55.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cef7fe640 1 -- 172.21.15.112:0/245260958 learned_addr learned my addr 172.21.15.112:0/245260958 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:55.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7ceffff640 1 --2- 172.21.15.112:0/245260958 >> v2:172.21.15.169:3300/0 conn(0x7f7cf015f3a0 0x7f7cf0165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:55.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 -- 172.21.15.112:0/245260958 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2279515375 0 0) 0x7f7cf00aede0 con 0x7f7cf01520a0 2024-09-15T23:56:55.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 -- 172.21.15.112:0/245260958 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cd8003530 con 0x7f7cf01520a0 2024-09-15T23:56:55.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 -- 172.21.15.112:0/245260958 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 135577284 0 0) 0x7f7cd8003530 con 0x7f7cf01520a0 2024-09-15T23:56:55.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 -- 172.21.15.112:0/245260958 >> v2:172.21.15.169:3300/0 conn(0x7f7cf015f3a0 msgr2=0x7f7cf0165f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:55.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 --2- 172.21.15.112:0/245260958 >> v2:172.21.15.169:3300/0 conn(0x7f7cf015f3a0 0x7f7cf0165f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 -- 172.21.15.112:0/245260958 >> v1:172.21.15.169:6789/0 conn(0x7f7cf0070020 legacy=0x7f7cf015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:55.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 -- 172.21.15.112:0/245260958 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf0074250 con 0x7f7cf01520a0 2024-09-15T23:56:55.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 -- 172.21.15.112:0/245260958 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f7ce4001680 con 0x7f7cf01520a0 2024-09-15T23:56:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 -- 172.21.15.112:0/245260958 >> v1:172.21.15.112:6789/0 conn(0x7f7cf01520a0 legacy=0x7f7cf006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 --2- 172.21.15.112:0/245260958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cd80039c0 0x7f7cd8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 --2- 172.21.15.112:0/245260958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd8004810 0x7f7cd8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 --2- 172.21.15.112:0/245260958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cd80051d0 0x7f7cd800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 -- 172.21.15.112:0/245260958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd800bff0 con 0x7f7cd8004810 2024-09-15T23:56:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 -- 172.21.15.112:0/245260958 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd800e3b0 con 0x7f7cd80039c0 2024-09-15T23:56:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cee7fc640 1 -- 172.21.15.112:0/245260958 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd800e5b0 con 0x7f7cd80051d0 2024-09-15T23:56:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7ceeffd640 1 --2- 172.21.15.112:0/245260958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd8004810 0x7f7cd8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cef7fe640 1 --2- 172.21.15.112:0/245260958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cd80039c0 0x7f7cd8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7ceffff640 1 --2- 172.21.15.112:0/245260958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cd80051d0 0x7f7cd800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7ceeffd640 1 -- 172.21.15.112:0/245260958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cd80051d0 msgr2=0x7f7cd800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:55.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7ceeffd640 1 --2- 172.21.15.112:0/245260958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cd80051d0 0x7f7cd800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7ceeffd640 1 -- 172.21.15.112:0/245260958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cd80039c0 msgr2=0x7f7cd8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:55.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7ceeffd640 1 --2- 172.21.15.112:0/245260958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cd80039c0 0x7f7cd8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7ceeffd640 1 -- 172.21.15.112:0/245260958 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd8003530 con 0x7f7cd8004810 2024-09-15T23:56:55.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7cef7fe640 1 --2- 172.21.15.112:0/245260958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cd80039c0 0x7f7cd8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:56:55.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.102+0000 7f7ceffff640 1 -- 172.21.15.112:0/245260958 reap_dead start 2024-09-15T23:56:55.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.106+0000 7f7ceeffd640 1 --2- 172.21.15.112:0/245260958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd8004810 0x7f7cd8004c90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0070420 tx=0x7f7ce001ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ae5bc1fb5e8cf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:55.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.106+0000 7f7cee7fc640 1 -- 172.21.15.112:0/245260958 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00b5070 con 0x7f7cd8004810 2024-09-15T23:56:55.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.106+0000 7f7cee7fc640 1 -- 172.21.15.112:0/245260958 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce00a8830 con 0x7f7cd8004810 2024-09-15T23:56:55.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.106+0000 7f7cee7fc640 1 -- 172.21.15.112:0/245260958 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0001460 con 0x7f7cd8004810 2024-09-15T23:56:55.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.106+0000 7f7cf5e05640 1 -- 172.21.15.112:0/245260958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd8004810 msgr2=0x7f7cd8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:55.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.106+0000 7f7cf5e05640 1 --2- 172.21.15.112:0/245260958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd8004810 0x7f7cd8004c90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0070420 tx=0x7f7ce001ec10 comp rx=0 tx=0).stop 2024-09-15T23:56:55.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.106+0000 7f7cf5e05640 1 -- 172.21.15.112:0/245260958 shutdown_connections 2024-09-15T23:56:55.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.106+0000 7f7cf5e05640 1 --2- 172.21.15.112:0/245260958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cd8004810 0x7f7cd8004c90 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.106+0000 7f7cf5e05640 1 -- 172.21.15.112:0/245260958 >> 172.21.15.112:0/245260958 conn(0x7f7cf00b1f90 msgr2=0x7f7cf00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:55.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.106+0000 7f7cf5e05640 1 -- 172.21.15.112:0/245260958 shutdown_connections 2024-09-15T23:56:55.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.106+0000 7f7cf5e05640 1 -- 172.21.15.112:0/245260958 wait complete. 2024-09-15T23:56:55.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.106+0000 7f7cf5e05640 1 Processor -- start 2024-09-15T23:56:55.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.106+0000 7f7cf5e05640 1 -- start start 2024-09-15T23:56:55.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cf5e05640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cd8004810 0x7f7cf014e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cf5e05640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cf014d400 0x7f7cf00b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cf5e05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf0149570 0x7f7cf00b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cf5e05640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf0073a50 con 0x7f7cf0149570 2024-09-15T23:56:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cf5e05640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf0073770 con 0x7f7cd8004810 2024-09-15T23:56:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cf5e05640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf0073d30 con 0x7f7cf014d400 2024-09-15T23:56:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7ceffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf0149570 0x7f7cf00b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7ceffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf0149570 0x7f7cf00b1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36108/0 (socket says 172.21.15.112:36108) 2024-09-15T23:56:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7ceffff640 1 -- 172.21.15.112:0/935974724 learned_addr learned my addr 172.21.15.112:0/935974724 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cef7fe640 1 --2- 172.21.15.112:0/935974724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cd8004810 0x7f7cf014e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7ceeffd640 1 --2- 172.21.15.112:0/935974724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cf014d400 0x7f7cf00b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:55.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7ceffff640 1 -- 172.21.15.112:0/935974724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cf014d400 msgr2=0x7f7cf00b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7ceffff640 1 --2- 172.21.15.112:0/935974724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cf014d400 0x7f7cf00b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7ceffff640 1 -- 172.21.15.112:0/935974724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cd8004810 msgr2=0x7f7cf014e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7ceffff640 1 --2- 172.21.15.112:0/935974724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cd8004810 0x7f7cf014e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7ceffff640 1 -- 172.21.15.112:0/935974724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf0152520 con 0x7f7cf0149570 2024-09-15T23:56:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7ceffff640 1 --2- 172.21.15.112:0/935974724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf0149570 0x7f7cf00b1390 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00b5960 tx=0x7f7ce80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cd7fff640 1 -- 172.21.15.112:0/935974724 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8011db0 con 0x7f7cf0149570 2024-09-15T23:56:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cd7fff640 1 -- 172.21.15.112:0/935974724 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce801b070 con 0x7f7cf0149570 2024-09-15T23:56:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cf5e05640 1 -- 172.21.15.112:0/935974724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf0152800 con 0x7f7cf0149570 2024-09-15T23:56:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cd7fff640 1 -- 172.21.15.112:0/935974724 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80039a0 con 0x7f7cf0149570 2024-09-15T23:56:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cf5e05640 1 -- 172.21.15.112:0/935974724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf0152dc0 con 0x7f7cf0149570 2024-09-15T23:56:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cf5e05640 1 -- 172.21.15.112:0/935974724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf0068e50 con 0x7f7cf0149570 2024-09-15T23:56:55.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cd7fff640 1 -- 172.21.15.112:0/935974724 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7ce8003b40 con 0x7f7cf0149570 2024-09-15T23:56:55.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cd7fff640 1 --2- 172.21.15.112:0/935974724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7cdc0678f0 0x7f7cdc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:55.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cd7fff640 1 -- 172.21.15.112:0/935974724 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6001+0+0 (secure 0 0 0) 0x7f7ce8087330 con 0x7f7cf0149570 2024-09-15T23:56:55.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cef7fe640 1 --2- 172.21.15.112:0/935974724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7cdc0678f0 0x7f7cdc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:55.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.110+0000 7f7cef7fe640 1 --2- 172.21.15.112:0/935974724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7cdc0678f0 0x7f7cdc069db0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4001210 tx=0x7f7ce4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:55.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.114+0000 7f7cd7fff640 1 -- 172.21.15.112:0/935974724 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7ce8057e20 con 0x7f7cf0149570 2024-09-15T23:56:55.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.314+0000 7f7cf5e05640 1 -- 172.21.15.112:0/935974724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7cf0152f90 con 0x7f7cf0149570 2024-09-15T23:56:55.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.966+0000 7f7cd7fff640 1 -- 172.21.15.112:0/935974724 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v34) ==== 174+0+0 (secure 0 0 0) 0x7f7ce8057720 con 0x7f7cf0149570 2024-09-15T23:56:55.969 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 11 and data pool 12 2024-09-15T23:56:55.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.978+0000 7f7cf5e05640 1 -- 172.21.15.112:0/935974724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7cdc0678f0 msgr2=0x7f7cdc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:55.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.978+0000 7f7cf5e05640 1 --2- 172.21.15.112:0/935974724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7cdc0678f0 0x7f7cdc069db0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4001210 tx=0x7f7ce4009040 comp rx=0 tx=0).stop 2024-09-15T23:56:55.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.978+0000 7f7cf5e05640 1 -- 172.21.15.112:0/935974724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf0149570 msgr2=0x7f7cf00b1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:55.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.978+0000 7f7cf5e05640 1 --2- 172.21.15.112:0/935974724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf0149570 0x7f7cf00b1390 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00b5960 tx=0x7f7ce80115a0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.978+0000 7f7cf5e05640 1 -- 172.21.15.112:0/935974724 shutdown_connections 2024-09-15T23:56:55.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.978+0000 7f7cf5e05640 1 --2- 172.21.15.112:0/935974724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7cdc0678f0 0x7f7cdc069db0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.978+0000 7f7cf5e05640 1 --2- 172.21.15.112:0/935974724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf0149570 0x7f7cf00b1390 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.978+0000 7f7cf5e05640 1 --2- 172.21.15.112:0/935974724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cf014d400 0x7f7cf00b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.978+0000 7f7cf5e05640 1 --2- 172.21.15.112:0/935974724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cd8004810 0x7f7cf014e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.978+0000 7f7cf5e05640 1 -- 172.21.15.112:0/935974724 >> 172.21.15.112:0/935974724 conn(0x7f7cf00b1f90 msgr2=0x7f7cf006f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:55.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.982+0000 7f7cf5e05640 1 -- 172.21.15.112:0/935974724 shutdown_connections 2024-09-15T23:56:55.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:55.982+0000 7f7cf5e05640 1 -- 172.21.15.112:0/935974724 wait complete. 2024-09-15T23:56:56.008 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f8a04ad3640 1 Processor -- start 2024-09-15T23:56:56.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f8a04ad3640 1 -- start start 2024-09-15T23:56:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f8a04ad3640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8a001520a0 0x7f8a0006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f8a04ad3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8a0006fe50 0x7f8a0015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f8a04ad3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0015f1d0 0x7f8a00071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f8a04ad3640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8a00152480 con 0x7f8a0006fe50 2024-09-15T23:56:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f8a04ad3640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8a00070250 con 0x7f8a001520a0 2024-09-15T23:56:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f8a04ad3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8a000aede0 con 0x7f8a0015f1d0 2024-09-15T23:56:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f89fdd9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8a0006fe50 0x7f8a0015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f89fdd9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8a0006fe50 0x7f8a0015ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36116/0 (socket says 172.21.15.112:36116) 2024-09-15T23:56:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f89fdd9b640 1 -- 172.21.15.112:0/1871850988 learned_addr learned my addr 172.21.15.112:0/1871850988 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:56.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f89fdd9b640 1 -- 172.21.15.112:0/1871850988 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0015f1d0 msgr2=0x7f8a00071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:56.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f89fdd9b640 1 --2- 172.21.15.112:0/1871850988 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0015f1d0 0x7f8a00071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f89fdd9b640 1 -- 172.21.15.112:0/1871850988 >> v2:172.21.15.169:3300/0 conn(0x7f8a001520a0 msgr2=0x7f8a0006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:56.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f89fe59c640 1 --2- 172.21.15.112:0/1871850988 >> v2:172.21.15.169:3300/0 conn(0x7f8a001520a0 0x7f8a0006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f89fdd9b640 1 --2- 172.21.15.112:0/1871850988 >> v2:172.21.15.169:3300/0 conn(0x7f8a001520a0 0x7f8a0006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f89fdd9b640 1 -- 172.21.15.112:0/1871850988 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0015fa10 con 0x7f8a0006fe50 2024-09-15T23:56:56.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f89fe59c640 1 --2- 172.21.15.112:0/1871850988 >> v2:172.21.15.169:3300/0 conn(0x7f8a001520a0 0x7f8a0006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:56.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.126+0000 7f89fdd9b640 1 --2- 172.21.15.112:0/1871850988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a0006fe50 0x7f8a0015ec90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8a00071710 tx=0x7f89f401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33e3f010a3f7485 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:56.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fd59a640 1 -- 172.21.15.112:0/1871850988 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f40b0070 con 0x7f8a0006fe50 2024-09-15T23:56:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fd59a640 1 -- 172.21.15.112:0/1871850988 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89f40ab600 con 0x7f8a0006fe50 2024-09-15T23:56:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fd59a640 1 -- 172.21.15.112:0/1871850988 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f40ab9d0 con 0x7f8a0006fe50 2024-09-15T23:56:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 -- 172.21.15.112:0/1871850988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a0006fe50 msgr2=0x7f8a0015ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 --2- 172.21.15.112:0/1871850988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a0006fe50 0x7f8a0015ec90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8a00071710 tx=0x7f89f401c240 comp rx=0 tx=0).stop 2024-09-15T23:56:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 -- 172.21.15.112:0/1871850988 shutdown_connections 2024-09-15T23:56:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 --2- 172.21.15.112:0/1871850988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a0006fe50 0x7f8a0015ec90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 --2- 172.21.15.112:0/1871850988 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0015f1d0 0x7f8a00071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 --2- 172.21.15.112:0/1871850988 >> v2:172.21.15.169:3300/0 conn(0x7f8a001520a0 0x7f8a0006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 -- 172.21.15.112:0/1871850988 >> 172.21.15.112:0/1871850988 conn(0x7f8a000b1f90 msgr2=0x7f8a000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 -- 172.21.15.112:0/1871850988 shutdown_connections 2024-09-15T23:56:56.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 -- 172.21.15.112:0/1871850988 wait complete. 2024-09-15T23:56:56.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 Processor -- start 2024-09-15T23:56:56.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 -- start start 2024-09-15T23:56:56.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0006fe50 0x7f8a0014e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a001520a0 0x7f8a0015d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a0015f1d0 0x7f8a0009af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8a00073d30 con 0x7f8a001520a0 2024-09-15T23:56:56.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a00073a50 con 0x7f8a0015f1d0 2024-09-15T23:56:56.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8a0015f640 con 0x7f8a0006fe50 2024-09-15T23:56:56.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fdd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a001520a0 0x7f8a0015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fdd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a001520a0 0x7f8a0015d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36128/0 (socket says 172.21.15.112:36128) 2024-09-15T23:56:56.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fdd9b640 1 -- 172.21.15.112:0/3483251360 learned_addr learned my addr 172.21.15.112:0/3483251360 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:56.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fed9d640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a0015f1d0 0x7f8a0009af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fe59c640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0006fe50 0x7f8a0014e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fdd9b640 1 -- 172.21.15.112:0/3483251360 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0006fe50 msgr2=0x7f8a0014e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fdd9b640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0006fe50 0x7f8a0014e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fdd9b640 1 -- 172.21.15.112:0/3483251360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a0015f1d0 msgr2=0x7f8a0009af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fdd9b640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a0015f1d0 0x7f8a0009af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fdd9b640 1 -- 172.21.15.112:0/3483251360 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a000af9b0 con 0x7f8a001520a0 2024-09-15T23:56:56.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fed9d640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a0015f1d0 0x7f8a0009af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:56.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fe59c640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0006fe50 0x7f8a0014e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:56.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89fdd9b640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a001520a0 0x7f8a0015d340 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f89f40ae040 tx=0x7f89f4018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:56.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89eeffd640 1 -- 172.21.15.112:0/3483251360 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f40b0040 con 0x7f8a001520a0 2024-09-15T23:56:56.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89eeffd640 1 -- 172.21.15.112:0/3483251360 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89f40b9070 con 0x7f8a001520a0 2024-09-15T23:56:56.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 -- 172.21.15.112:0/3483251360 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0015dc90 con 0x7f8a001520a0 2024-09-15T23:56:56.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f89eeffd640 1 -- 172.21.15.112:0/3483251360 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f40b48a0 con 0x7f8a001520a0 2024-09-15T23:56:56.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.130+0000 7f8a04ad3640 1 -- 172.21.15.112:0/3483251360 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0015b9e0 con 0x7f8a001520a0 2024-09-15T23:56:56.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.134+0000 7f8a04ad3640 1 -- 172.21.15.112:0/3483251360 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a0006f910 con 0x7f8a001520a0 2024-09-15T23:56:56.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.134+0000 7f89eeffd640 1 -- 172.21.15.112:0/3483251360 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f89f40ab4c0 con 0x7f8a001520a0 2024-09-15T23:56:56.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.134+0000 7f89eeffd640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f89e00678c0 0x7f89e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.134+0000 7f89fe59c640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f89e00678c0 0x7f89e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.134+0000 7f89eeffd640 1 -- 172.21.15.112:0/3483251360 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f89f411fc70 con 0x7f8a001520a0 2024-09-15T23:56:56.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.134+0000 7f89fe59c640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f89e00678c0 0x7f89e0069d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8a00151920 tx=0x7f89f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:56.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.138+0000 7f89eeffd640 1 -- 172.21.15.112:0/3483251360 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f89f40160f0 con 0x7f8a001520a0 2024-09-15T23:56:56.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.298+0000 7f8a04ad3640 1 -- 172.21.15.112:0/3483251360 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a0015af30 con 0x7f8a001520a0 2024-09-15T23:56:56.303 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.302+0000 7f89eeffd640 1 -- 172.21.15.112:0/3483251360 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16970 (secure 0 0 0) 0x7f89f40f0620 con 0x7f8a001520a0 2024-09-15T23:56:56.304 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:56.304 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":74,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:56:55.316354+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:52.995591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:54.309259+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:56.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.306+0000 7f8a04ad3640 1 -- 172.21.15.112:0/3483251360 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f89e00678c0 msgr2=0x7f89e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.306+0000 7f8a04ad3640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f89e00678c0 0x7f89e0069d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8a00151920 tx=0x7f89f0008040 comp rx=0 tx=0).stop 2024-09-15T23:56:56.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.306+0000 7f8a04ad3640 1 -- 172.21.15.112:0/3483251360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a001520a0 msgr2=0x7f8a0015d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.306+0000 7f8a04ad3640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a001520a0 0x7f8a0015d340 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f89f40ae040 tx=0x7f89f4018fe0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.306+0000 7f8a04ad3640 1 -- 172.21.15.112:0/3483251360 shutdown_connections 2024-09-15T23:56:56.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.306+0000 7f8a04ad3640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f89e00678c0 0x7f89e0069d80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.306+0000 7f8a04ad3640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a0015f1d0 0x7f8a0009af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.306+0000 7f8a04ad3640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a001520a0 0x7f8a0015d340 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.306+0000 7f8a04ad3640 1 --2- 172.21.15.112:0/3483251360 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a0006fe50 0x7f8a0014e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.306+0000 7f8a04ad3640 1 -- 172.21.15.112:0/3483251360 >> 172.21.15.112:0/3483251360 conn(0x7f8a000b1f90 msgr2=0x7f8a0014fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:56.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.306+0000 7f8a04ad3640 1 -- 172.21.15.112:0/3483251360 shutdown_connections 2024-09-15T23:56:56.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.306+0000 7f8a04ad3640 1 -- 172.21.15.112:0/3483251360 wait complete. 2024-09-15T23:56:56.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:56.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.438+0000 7f7cf8227640 1 Processor -- start 2024-09-15T23:56:56.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.438+0000 7f7cf8227640 1 -- start start 2024-09-15T23:56:56.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf8227640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7cf015c2a0 0x7f7cf00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf8227640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf00b3290 con 0x7f7cf015bec0 2024-09-15T23:56:56.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf8227640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf00b3570 con 0x7f7cf00af2a0 2024-09-15T23:56:56.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf8227640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf00b3850 con 0x7f7cf015c2a0 2024-09-15T23:56:56.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf57c2640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7cf015c2a0 0x7f7cf00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf57c2640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7cf015c2a0 0x7f7cf00aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36132/0 (socket says 172.21.15.112:36132) 2024-09-15T23:56:56.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf5fc3640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7cf015bec0 0x7f7cf00ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:48328/0 (socket says 172.21.15.112:48328) 2024-09-15T23:56:56.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf57c2640 1 -- 172.21.15.112:0/3455815980 learned_addr learned my addr 172.21.15.112:0/3455815980 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:56.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf57c2640 1 -- 172.21.15.112:0/3455815980 >> v1:172.21.15.169:6789/0 conn(0x7f7cf00af2a0 legacy=0x7f7cf006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:56.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf57c2640 1 -- 172.21.15.112:0/3455815980 >> v1:172.21.15.112:6789/0 conn(0x7f7cf015bec0 legacy=0x7f7cf00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf57c2640 1 -- 172.21.15.112:0/3455815980 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf00b3b30 con 0x7f7cf015c2a0 2024-09-15T23:56:56.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf4fc1640 1 -- 172.21.15.112:0/3455815980 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4214652235 0 0) 0x7f7cf00b3290 con 0x7f7cf015bec0 2024-09-15T23:56:56.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf57c2640 1 --2- 172.21.15.112:0/3455815980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf015c2a0 0x7f7cf00aed60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0009870 tx=0x7f7ce001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7631282151f9f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:56.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf4fc1640 1 -- 172.21.15.112:0/3455815980 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00aa650 con 0x7f7cf015c2a0 2024-09-15T23:56:56.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf4fc1640 1 -- 172.21.15.112:0/3455815980 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce00af070 con 0x7f7cf015c2a0 2024-09-15T23:56:56.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.442+0000 7f7cf4fc1640 1 -- 172.21.15.112:0/3455815980 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00aaa10 con 0x7f7cf015c2a0 2024-09-15T23:56:56.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 -- 172.21.15.112:0/3455815980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf015c2a0 msgr2=0x7f7cf00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 --2- 172.21.15.112:0/3455815980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf015c2a0 0x7f7cf00aed60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0009870 tx=0x7f7ce001c4f0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 -- 172.21.15.112:0/3455815980 shutdown_connections 2024-09-15T23:56:56.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 --2- 172.21.15.112:0/3455815980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf015c2a0 0x7f7cf00aed60 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 -- 172.21.15.112:0/3455815980 >> 172.21.15.112:0/3455815980 conn(0x7f7cf00b1f90 msgr2=0x7f7cf00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:56.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 -- 172.21.15.112:0/3455815980 shutdown_connections 2024-09-15T23:56:56.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 -- 172.21.15.112:0/3455815980 wait complete. 2024-09-15T23:56:56.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 Processor -- start 2024-09-15T23:56:56.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 -- start start 2024-09-15T23:56:56.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cf00af2a0 0x7f7cf0148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cf015bec0 0x7f7cf014b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf015c2a0 0x7f7cf014b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf006ef20 con 0x7f7cf015c2a0 2024-09-15T23:56:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf00af710 con 0x7f7cf015bec0 2024-09-15T23:56:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf006f0a0 con 0x7f7cf00af2a0 2024-09-15T23:56:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf67c4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf015c2a0 0x7f7cf014b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf67c4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf015c2a0 0x7f7cf014b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36146/0 (socket says 172.21.15.112:36146) 2024-09-15T23:56:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf67c4640 1 -- 172.21.15.112:0/3022132994 learned_addr learned my addr 172.21.15.112:0/3022132994 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf5fc3640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cf00af2a0 0x7f7cf0148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf57c2640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cf015bec0 0x7f7cf014b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf67c4640 1 -- 172.21.15.112:0/3022132994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cf00af2a0 msgr2=0x7f7cf0148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf67c4640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cf00af2a0 0x7f7cf0148940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf67c4640 1 -- 172.21.15.112:0/3022132994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cf015bec0 msgr2=0x7f7cf014b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf67c4640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cf015bec0 0x7f7cf014b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf67c4640 1 -- 172.21.15.112:0/3022132994 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf014d190 con 0x7f7cf015c2a0 2024-09-15T23:56:56.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf5fc3640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cf00af2a0 0x7f7cf0148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:56.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf67c4640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf015c2a0 0x7f7cf014b790 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800c780 tx=0x7f7ce800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:56.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7ce67fc640 1 -- 172.21.15.112:0/3022132994 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8017070 con 0x7f7cf015c2a0 2024-09-15T23:56:56.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7ce67fc640 1 -- 172.21.15.112:0/3022132994 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce8003db0 con 0x7f7cf015c2a0 2024-09-15T23:56:56.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7ce67fc640 1 -- 172.21.15.112:0/3022132994 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80052b0 con 0x7f7cf015c2a0 2024-09-15T23:56:56.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 -- 172.21.15.112:0/3022132994 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf0153810 con 0x7f7cf015c2a0 2024-09-15T23:56:56.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.446+0000 7f7cf8227640 1 -- 172.21.15.112:0/3022132994 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf0153dd0 con 0x7f7cf015c2a0 2024-09-15T23:56:56.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.450+0000 7f7cf8227640 1 -- 172.21.15.112:0/3022132994 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf00aed60 con 0x7f7cf015c2a0 2024-09-15T23:56:56.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.450+0000 7f7ce67fc640 1 -- 172.21.15.112:0/3022132994 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7ce8005450 con 0x7f7cf015c2a0 2024-09-15T23:56:56.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.450+0000 7f7ce67fc640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7cd40678c0 0x7f7cd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.450+0000 7f7ce67fc640 1 -- 172.21.15.112:0/3022132994 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f7ce8085270 con 0x7f7cf015c2a0 2024-09-15T23:56:56.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.450+0000 7f7cf5fc3640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7cd40678c0 0x7f7cd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.450+0000 7f7cf5fc3640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7cd40678c0 0x7f7cd4069d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7cec000f70 tx=0x7f7cec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:56.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.454+0000 7f7ce67fc640 1 -- 172.21.15.112:0/3022132994 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7ce8055cb0 con 0x7f7cf015c2a0 2024-09-15T23:56:56.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.610+0000 7f7cf8227640 1 -- 172.21.15.112:0/3022132994 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cf014ed70 con 0x7f7cf015c2a0 2024-09-15T23:56:56.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.610+0000 7f7ce67fc640 1 -- 172.21.15.112:0/3022132994 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16970 (secure 0 0 0) 0x7f7ce80555b0 con 0x7f7cf015c2a0 2024-09-15T23:56:56.613 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:56.613 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":74,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:56:55.316354+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:52.995591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:54.309259+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:56.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.614+0000 7f7cf8227640 1 -- 172.21.15.112:0/3022132994 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7cd40678c0 msgr2=0x7f7cd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.614+0000 7f7cf8227640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7cd40678c0 0x7f7cd4069d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7cec000f70 tx=0x7f7cec009040 comp rx=0 tx=0).stop 2024-09-15T23:56:56.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.614+0000 7f7cf8227640 1 -- 172.21.15.112:0/3022132994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf015c2a0 msgr2=0x7f7cf014b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.614+0000 7f7cf8227640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf015c2a0 0x7f7cf014b790 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800c780 tx=0x7f7ce800cc40 comp rx=0 tx=0).stop 2024-09-15T23:56:56.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.614+0000 7f7cf8227640 1 -- 172.21.15.112:0/3022132994 shutdown_connections 2024-09-15T23:56:56.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.614+0000 7f7cf8227640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7cd40678c0 0x7f7cd4069d80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.614+0000 7f7cf8227640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cf015c2a0 0x7f7cf014b790 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.614+0000 7f7cf8227640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cf015bec0 0x7f7cf014b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.614+0000 7f7cf8227640 1 --2- 172.21.15.112:0/3022132994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7cf00af2a0 0x7f7cf0148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.614+0000 7f7cf8227640 1 -- 172.21.15.112:0/3022132994 >> 172.21.15.112:0/3022132994 conn(0x7f7cf00b1f90 msgr2=0x7f7cf00cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.614+0000 7f7cf8227640 1 -- 172.21.15.112:0/3022132994 shutdown_connections 2024-09-15T23:56:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.614+0000 7f7cf8227640 1 -- 172.21.15.112:0/3022132994 wait complete. 2024-09-15T23:56:56.631 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:56:56.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c5c26b640 1 Processor -- start 2024-09-15T23:56:56.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c5c26b640 1 -- start start 2024-09-15T23:56:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c5c26b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8c54161a60 0x7f8c540d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c5c26b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c540d2e90 0x7f8c540cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c5c26b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c540d32b0 con 0x7f8c540cf450 2024-09-15T23:56:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c5c26b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8c540d0300 con 0x7f8c54161a60 2024-09-15T23:56:56.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c5c26b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5406e6c0 con 0x7f8c540d2e90 2024-09-15T23:56:56.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c5a007640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8c54161a60 0x7f8c540d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c5a808640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f8c540cf450 0x7f8c540d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:53678/0 (socket says 172.21.15.112:53678) 2024-09-15T23:56:56.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c59806640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c540d2e90 0x7f8c540cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c5a808640 1 -- 172.21.15.112:0/3714995069 learned_addr learned my addr 172.21.15.112:0/3714995069 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:56.756 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c59806640 1 -- 172.21.15.112:0/3714995069 >> v2:172.21.15.169:3300/0 conn(0x7f8c54161a60 msgr2=0x7f8c540d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:56.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c59806640 1 --2- 172.21.15.112:0/3714995069 >> v2:172.21.15.169:3300/0 conn(0x7f8c54161a60 0x7f8c540d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c59806640 1 -- 172.21.15.112:0/3714995069 >> v1:172.21.15.169:6789/0 conn(0x7f8c540cf450 legacy=0x7f8c540d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.754+0000 7f8c59806640 1 -- 172.21.15.112:0/3714995069 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c540b0f60 con 0x7f8c540d2e90 2024-09-15T23:56:56.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.758+0000 7f8c59806640 1 --2- 172.21.15.112:0/3714995069 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c540d2e90 0x7f8c540cef10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c440097c0 tx=0x7f8c4401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=518063d942368392 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:56.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.758+0000 7f8c59005640 1 -- 172.21.15.112:0/3714995069 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c440b1070 con 0x7f8c540d2e90 2024-09-15T23:56:56.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.758+0000 7f8c59005640 1 -- 172.21.15.112:0/3714995069 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c440a8050 con 0x7f8c540d2e90 2024-09-15T23:56:56.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.758+0000 7f8c59005640 1 -- 172.21.15.112:0/3714995069 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c540d1930 con 0x7f8c540d2e90 2024-09-15T23:56:56.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.758+0000 7f8c5c26b640 1 -- 172.21.15.112:0/3714995069 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c540d2e90 msgr2=0x7f8c540cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.758+0000 7f8c5c26b640 1 --2- 172.21.15.112:0/3714995069 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c540d2e90 0x7f8c540cef10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c440097c0 tx=0x7f8c4401c3e0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.758+0000 7f8c5c26b640 1 -- 172.21.15.112:0/3714995069 shutdown_connections 2024-09-15T23:56:56.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.758+0000 7f8c5c26b640 1 --2- 172.21.15.112:0/3714995069 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c540d2e90 0x7f8c540cef10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.758+0000 7f8c5c26b640 1 --2- 172.21.15.112:0/3714995069 >> v2:172.21.15.169:3300/0 conn(0x7f8c54161a60 0x7f8c540d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.758+0000 7f8c5c26b640 1 -- 172.21.15.112:0/3714995069 >> 172.21.15.112:0/3714995069 conn(0x7f8c5408bf90 msgr2=0x7f8c5409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:56.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.758+0000 7f8c5c26b640 1 -- 172.21.15.112:0/3714995069 shutdown_connections 2024-09-15T23:56:56.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.758+0000 7f8c5c26b640 1 -- 172.21.15.112:0/3714995069 wait complete. 2024-09-15T23:56:56.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5c26b640 1 Processor -- start 2024-09-15T23:56:56.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5c26b640 1 -- start start 2024-09-15T23:56:56.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5c26b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c540cf450 0x7f8c540cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5c26b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c540d2e90 0x7f8c5415d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5c26b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c54161a60 0x7f8c5415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5c26b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5416af20 con 0x7f8c540cf450 2024-09-15T23:56:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5c26b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5406d190 con 0x7f8c54161a60 2024-09-15T23:56:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5c26b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5416b0a0 con 0x7f8c540d2e90 2024-09-15T23:56:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5a007640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c540cf450 0x7f8c540cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c59806640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c540d2e90 0x7f8c5415d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5a007640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c540cf450 0x7f8c540cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36162/0 (socket says 172.21.15.112:36162) 2024-09-15T23:56:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5a007640 1 -- 172.21.15.112:0/2141987875 learned_addr learned my addr 172.21.15.112:0/2141987875 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5a808640 1 --2- 172.21.15.112:0/2141987875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c54161a60 0x7f8c5415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5a007640 1 -- 172.21.15.112:0/2141987875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c540d2e90 msgr2=0x7f8c5415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5a007640 1 --2- 172.21.15.112:0/2141987875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c540d2e90 0x7f8c5415d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5a007640 1 -- 172.21.15.112:0/2141987875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c54161a60 msgr2=0x7f8c5415b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5a007640 1 --2- 172.21.15.112:0/2141987875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c54161a60 0x7f8c5415b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5a007640 1 -- 172.21.15.112:0/2141987875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c540cdae0 con 0x7f8c540cf450 2024-09-15T23:56:56.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5a007640 1 --2- 172.21.15.112:0/2141987875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c540cf450 0x7f8c540cb440 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000e870 tx=0x7f8c5000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:56.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c4affd640 1 -- 172.21.15.112:0/2141987875 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50017070 con 0x7f8c540cf450 2024-09-15T23:56:56.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c4affd640 1 -- 172.21.15.112:0/2141987875 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5000c940 con 0x7f8c540cf450 2024-09-15T23:56:56.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5c26b640 1 -- 172.21.15.112:0/2141987875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c540cddc0 con 0x7f8c540cf450 2024-09-15T23:56:56.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c4affd640 1 -- 172.21.15.112:0/2141987875 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5000ccf0 con 0x7f8c540cf450 2024-09-15T23:56:56.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5c26b640 1 -- 172.21.15.112:0/2141987875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c540ce380 con 0x7f8c540cf450 2024-09-15T23:56:56.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c5c26b640 1 -- 172.21.15.112:0/2141987875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c540cef10 con 0x7f8c540cf450 2024-09-15T23:56:56.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.762+0000 7f8c4affd640 1 -- 172.21.15.112:0/2141987875 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c5001a070 con 0x7f8c540cf450 2024-09-15T23:56:56.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.766+0000 7f8c4affd640 1 --2- 172.21.15.112:0/2141987875 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c380678c0 0x7f8c38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.766+0000 7f8c59806640 1 --2- 172.21.15.112:0/2141987875 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c380678c0 0x7f8c38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.766+0000 7f8c4affd640 1 -- 172.21.15.112:0/2141987875 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f8c50085c60 con 0x7f8c540cf450 2024-09-15T23:56:56.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.766+0000 7f8c59806640 1 --2- 172.21.15.112:0/2141987875 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c380678c0 0x7f8c38069d80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8c440ae000 tx=0x7f8c44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:56.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.770+0000 7f8c4affd640 1 -- 172.21.15.112:0/2141987875 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8c50055fc0 con 0x7f8c540cf450 2024-09-15T23:56:56.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:56.966+0000 7f8c5c26b640 1 -- 172.21.15.112:0/2141987875 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8c5406dde0 con 0x7f8c540cf450 2024-09-15T23:56:57.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.366+0000 7f8c4affd640 1 -- 172.21.15.112:0/2141987875 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) ==== 118+0+0 (secure 0 0 0) 0x7f8c5005a2c0 con 0x7f8c540cf450 2024-09-15T23:56:57.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.370+0000 7f8c5c26b640 1 -- 172.21.15.112:0/2141987875 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c380678c0 msgr2=0x7f8c38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:57.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.370+0000 7f8c5c26b640 1 --2- 172.21.15.112:0/2141987875 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c380678c0 0x7f8c38069d80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8c440ae000 tx=0x7f8c44008040 comp rx=0 tx=0).stop 2024-09-15T23:56:57.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.370+0000 7f8c5c26b640 1 -- 172.21.15.112:0/2141987875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c540cf450 msgr2=0x7f8c540cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:57.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.370+0000 7f8c5c26b640 1 --2- 172.21.15.112:0/2141987875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c540cf450 0x7f8c540cb440 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000e870 tx=0x7f8c5000ec70 comp rx=0 tx=0).stop 2024-09-15T23:56:57.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.370+0000 7f8c5c26b640 1 -- 172.21.15.112:0/2141987875 shutdown_connections 2024-09-15T23:56:57.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.370+0000 7f8c5c26b640 1 --2- 172.21.15.112:0/2141987875 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8c380678c0 0x7f8c38069d80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:57.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.370+0000 7f8c5c26b640 1 --2- 172.21.15.112:0/2141987875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8c54161a60 0x7f8c5415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:57.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.370+0000 7f8c5c26b640 1 --2- 172.21.15.112:0/2141987875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8c540d2e90 0x7f8c5415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:57.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.370+0000 7f8c5c26b640 1 --2- 172.21.15.112:0/2141987875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c540cf450 0x7f8c540cb440 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:57.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.370+0000 7f8c5c26b640 1 -- 172.21.15.112:0/2141987875 >> 172.21.15.112:0/2141987875 conn(0x7f8c5408bf90 msgr2=0x7f8c5415f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:57.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.370+0000 7f8c5c26b640 1 -- 172.21.15.112:0/2141987875 shutdown_connections 2024-09-15T23:56:57.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.370+0000 7f8c5c26b640 1 -- 172.21.15.112:0/2141987875 wait complete. 2024-09-15T23:56:57.394 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:56:57.394 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:56:57.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f391734e640 1 Processor -- start 2024-09-15T23:56:57.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f391734e640 1 -- start start 2024-09-15T23:56:57.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f391734e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f391015bec0 0x7f39100ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:57.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f391734e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f39100af470 0x7f391006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:57.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f391734e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39100b3290 con 0x7f391015c2a0 2024-09-15T23:56:57.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f391734e640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f39100b3570 con 0x7f391015bec0 2024-09-15T23:56:57.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f391734e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f39100b3850 con 0x7f39100af470 2024-09-15T23:56:57.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f39150ea640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f391015bec0 0x7f39100ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:57.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f39150ea640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f391015bec0 0x7f39100ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36178/0 (socket says 172.21.15.112:36178) 2024-09-15T23:56:57.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f39150ea640 1 -- 172.21.15.112:0/2712772283 learned_addr learned my addr 172.21.15.112:0/2712772283 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:57.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f39158eb640 1 --2- 172.21.15.112:0/2712772283 >> v2:172.21.15.169:3300/0 conn(0x7f39100af470 0x7f391006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:57.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f39150ea640 1 -- 172.21.15.112:0/2712772283 >> v2:172.21.15.169:3300/0 conn(0x7f39100af470 msgr2=0x7f391006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:57.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f39150ea640 1 --2- 172.21.15.112:0/2712772283 >> v2:172.21.15.169:3300/0 conn(0x7f39100af470 0x7f391006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:57.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f39150ea640 1 -- 172.21.15.112:0/2712772283 >> v1:172.21.15.169:6789/0 conn(0x7f391015c2a0 legacy=0x7f39100aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:57.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.522+0000 7f39150ea640 1 -- 172.21.15.112:0/2712772283 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39100b3b30 con 0x7f391015bec0 2024-09-15T23:56:57.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f39150ea640 1 --2- 172.21.15.112:0/2712772283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f391015bec0 0x7f39100ad200 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f39100b2fb0 tx=0x7f390001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47310f012edd28e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:57.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f3907fff640 1 -- 172.21.15.112:0/2712772283 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39000b1070 con 0x7f391015bec0 2024-09-15T23:56:57.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f3907fff640 1 -- 172.21.15.112:0/2712772283 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39000ac620 con 0x7f391015bec0 2024-09-15T23:56:57.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f3907fff640 1 -- 172.21.15.112:0/2712772283 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39000ac9f0 con 0x7f391015bec0 2024-09-15T23:56:57.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 -- 172.21.15.112:0/2712772283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f391015bec0 msgr2=0x7f39100ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:57.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 --2- 172.21.15.112:0/2712772283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f391015bec0 0x7f39100ad200 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f39100b2fb0 tx=0x7f390001c4b0 comp rx=0 tx=0).stop 2024-09-15T23:56:57.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 -- 172.21.15.112:0/2712772283 shutdown_connections 2024-09-15T23:56:57.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 --2- 172.21.15.112:0/2712772283 >> v2:172.21.15.169:3300/0 conn(0x7f39100af470 0x7f391006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:57.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 --2- 172.21.15.112:0/2712772283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f391015bec0 0x7f39100ad200 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:57.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 -- 172.21.15.112:0/2712772283 >> 172.21.15.112:0/2712772283 conn(0x7f39100b1f90 msgr2=0x7f39100b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:57.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 -- 172.21.15.112:0/2712772283 shutdown_connections 2024-09-15T23:56:57.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 -- 172.21.15.112:0/2712772283 wait complete. 2024-09-15T23:56:57.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 Processor -- start 2024-09-15T23:56:57.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 -- start start 2024-09-15T23:56:57.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39100af470 0x7f39100999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:57.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f391015bec0 0x7f391015d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:57.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f391015c2a0 0x7f3910151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:57.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f39100ad740 con 0x7f391015bec0 2024-09-15T23:56:57.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3910073f20 con 0x7f391015c2a0 2024-09-15T23:56:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f391734e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f391006ed50 con 0x7f39100af470 2024-09-15T23:56:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f39148e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f391015bec0 0x7f391015d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f39148e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f391015bec0 0x7f391015d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:36184/0 (socket says 172.21.15.112:36184) 2024-09-15T23:56:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f39148e9640 1 -- 172.21.15.112:0/457076105 learned_addr learned my addr 172.21.15.112:0/457076105 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f39150ea640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39100af470 0x7f39100999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f39158eb640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f391015c2a0 0x7f3910151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f39148e9640 1 -- 172.21.15.112:0/457076105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39100af470 msgr2=0x7f39100999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f39148e9640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39100af470 0x7f39100999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f39148e9640 1 -- 172.21.15.112:0/457076105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f391015c2a0 msgr2=0x7f3910151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f39148e9640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f391015c2a0 0x7f3910151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f39148e9640 1 -- 172.21.15.112:0/457076105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391015e8a0 con 0x7f391015bec0 2024-09-15T23:56:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f39158eb640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f391015c2a0 0x7f3910151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.526+0000 7f39148e9640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f391015bec0 0x7f391015d3d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f390c00b3e0 tx=0x7f390c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:57.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.530+0000 7f3905ffb640 1 -- 172.21.15.112:0/457076105 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c015020 con 0x7f391015bec0 2024-09-15T23:56:57.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.530+0000 7f3905ffb640 1 -- 172.21.15.112:0/457076105 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f390c011830 con 0x7f391015bec0 2024-09-15T23:56:57.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.530+0000 7f391734e640 1 -- 172.21.15.112:0/457076105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f391015eb40 con 0x7f391015bec0 2024-09-15T23:56:57.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.530+0000 7f3905ffb640 1 -- 172.21.15.112:0/457076105 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c011c60 con 0x7f391015bec0 2024-09-15T23:56:57.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.530+0000 7f391734e640 1 -- 172.21.15.112:0/457076105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39101562d0 con 0x7f391015bec0 2024-09-15T23:56:57.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.530+0000 7f391734e640 1 -- 172.21.15.112:0/457076105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f391015f060 con 0x7f391015bec0 2024-09-15T23:56:57.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.530+0000 7f3905ffb640 1 -- 172.21.15.112:0/457076105 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f390c018020 con 0x7f391015bec0 2024-09-15T23:56:57.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.530+0000 7f3905ffb640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38f40678c0 0x7f38f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:57.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.530+0000 7f3905ffb640 1 -- 172.21.15.112:0/457076105 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f390c085a50 con 0x7f391015bec0 2024-09-15T23:56:57.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.530+0000 7f39150ea640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38f40678c0 0x7f38f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:57.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.530+0000 7f39150ea640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38f40678c0 0x7f38f4069d80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f39000ae000 tx=0x7f39000a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:57.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.534+0000 7f3905ffb640 1 -- 172.21.15.112:0/457076105 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f391015f060 con 0x7f391015bec0 2024-09-15T23:56:57.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:57.718+0000 7f391734e640 1 -- 172.21.15.112:0/457076105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f391006f110 con 0x7f391015bec0 2024-09-15T23:56:57.930 INFO:tasks.ceph.mds.a.smithi112.stderr:2024-09-15T23:56:57.930+0000 7f4ca31de640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:56:58.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.370+0000 7f3905ffb640 1 -- 172.21.15.112:0/457076105 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v37) ==== 122+0+0 (secure 0 0 0) 0x7f390c01f030 con 0x7f391015bec0 2024-09-15T23:56:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.374+0000 7f391734e640 1 -- 172.21.15.112:0/457076105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38f40678c0 msgr2=0x7f38f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.374+0000 7f391734e640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38f40678c0 0x7f38f4069d80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f39000ae000 tx=0x7f39000a7000 comp rx=0 tx=0).stop 2024-09-15T23:56:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.374+0000 7f391734e640 1 -- 172.21.15.112:0/457076105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f391015bec0 msgr2=0x7f391015d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.374+0000 7f391734e640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f391015bec0 0x7f391015d3d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f390c00b3e0 tx=0x7f390c00b8a0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.374+0000 7f391734e640 1 -- 172.21.15.112:0/457076105 shutdown_connections 2024-09-15T23:56:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.374+0000 7f391734e640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38f40678c0 0x7f38f4069d80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.374+0000 7f391734e640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f391015c2a0 0x7f3910151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.374+0000 7f391734e640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f391015bec0 0x7f391015d3d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.374+0000 7f391734e640 1 --2- 172.21.15.112:0/457076105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39100af470 0x7f39100999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.374+0000 7f391734e640 1 -- 172.21.15.112:0/457076105 >> 172.21.15.112:0/457076105 conn(0x7f39100b1f90 msgr2=0x7f391006f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.374+0000 7f391734e640 1 -- 172.21.15.112:0/457076105 shutdown_connections 2024-09-15T23:56:58.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.374+0000 7f391734e640 1 -- 172.21.15.112:0/457076105 wait complete. 2024-09-15T23:56:58.396 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:56:58.396 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:58.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34dcd22640 1 Processor -- start 2024-09-15T23:56:58.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34dcd22640 1 -- start start 2024-09-15T23:56:58.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34dcd22640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f34d815c2a0 0x7f34d80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34dcd22640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d80af2a0 0x7f34d806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34dcd22640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d80b3290 con 0x7f34d815bec0 2024-09-15T23:56:58.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34dcd22640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f34d80b3570 con 0x7f34d815c2a0 2024-09-15T23:56:58.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34dcd22640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f34d80b3850 con 0x7f34d80af2a0 2024-09-15T23:56:58.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34d6d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d80af2a0 0x7f34d806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34d6d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d80af2a0 0x7f34d806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:48064/0 (socket says 172.21.15.112:48064) 2024-09-15T23:56:58.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34d6d9d640 1 -- 172.21.15.112:0/41878834 learned_addr learned my addr 172.21.15.112:0/41878834 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:58.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34cdd9b640 1 --2- 172.21.15.112:0/41878834 >> v2:172.21.15.169:3300/0 conn(0x7f34d815c2a0 0x7f34d80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34d5d9b640 1 -- 172.21.15.112:0/41878834 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1905014360 0 0) 0x7f34d80b3290 con 0x7f34d815bec0 2024-09-15T23:56:58.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34d5d9b640 1 -- 172.21.15.112:0/41878834 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34c4003530 con 0x7f34d815bec0 2024-09-15T23:56:58.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34d6d9d640 1 -- 172.21.15.112:0/41878834 >> v2:172.21.15.169:3300/0 conn(0x7f34d815c2a0 msgr2=0x7f34d80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:58.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34d6d9d640 1 --2- 172.21.15.112:0/41878834 >> v2:172.21.15.169:3300/0 conn(0x7f34d815c2a0 0x7f34d80aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34d6d9d640 1 -- 172.21.15.112:0/41878834 >> v1:172.21.15.169:6789/0 conn(0x7f34d815bec0 legacy=0x7f34d80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.518+0000 7f34d6d9d640 1 -- 172.21.15.112:0/41878834 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d80b3b30 con 0x7f34d80af2a0 2024-09-15T23:56:58.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34d6d9d640 1 --2- 172.21.15.112:0/41878834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d80af2a0 0x7f34d806e000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009e50 tx=0x7f34d001ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e25e52adb39668fc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:58.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34d5d9b640 1 -- 172.21.15.112:0/41878834 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d00a58d0 con 0x7f34d80af2a0 2024-09-15T23:56:58.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34d5d9b640 1 -- 172.21.15.112:0/41878834 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d00a5a70 con 0x7f34d80af2a0 2024-09-15T23:56:58.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34d5d9b640 1 -- 172.21.15.112:0/41878834 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d00a5e20 con 0x7f34d80af2a0 2024-09-15T23:56:58.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 -- 172.21.15.112:0/41878834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d80af2a0 msgr2=0x7f34d806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 --2- 172.21.15.112:0/41878834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d80af2a0 0x7f34d806e000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009e50 tx=0x7f34d001ca00 comp rx=0 tx=0).stop 2024-09-15T23:56:58.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 -- 172.21.15.112:0/41878834 shutdown_connections 2024-09-15T23:56:58.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 --2- 172.21.15.112:0/41878834 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d80af2a0 0x7f34d806e000 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 --2- 172.21.15.112:0/41878834 >> v2:172.21.15.169:3300/0 conn(0x7f34d815c2a0 0x7f34d80aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 -- 172.21.15.112:0/41878834 >> 172.21.15.112:0/41878834 conn(0x7f34d80b1f90 msgr2=0x7f34d80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:58.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 -- 172.21.15.112:0/41878834 shutdown_connections 2024-09-15T23:56:58.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 -- 172.21.15.112:0/41878834 wait complete. 2024-09-15T23:56:58.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 Processor -- start 2024-09-15T23:56:58.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 -- start start 2024-09-15T23:56:58.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d80af2a0 0x7f34d814a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34d815bec0 0x7f34d8154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d815c2a0 0x7f34d815de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f34d806ed50 con 0x7f34d80af2a0 2024-09-15T23:56:58.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f34d80afc90 con 0x7f34d815bec0 2024-09-15T23:56:58.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34dcd22640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f34d806eed0 con 0x7f34d815c2a0 2024-09-15T23:56:58.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34d659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d80af2a0 0x7f34d814a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34d659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d80af2a0 0x7f34d814a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43356/0 (socket says 172.21.15.112:43356) 2024-09-15T23:56:58.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.522+0000 7f34d659c640 1 -- 172.21.15.112:0/695978791 learned_addr learned my addr 172.21.15.112:0/695978791 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:58.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34cdd9b640 1 --2- 172.21.15.112:0/695978791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34d815bec0 0x7f34d8154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34d6d9d640 1 --2- 172.21.15.112:0/695978791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d815c2a0 0x7f34d815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34d659c640 1 -- 172.21.15.112:0/695978791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d815c2a0 msgr2=0x7f34d815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34d659c640 1 --2- 172.21.15.112:0/695978791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d815c2a0 0x7f34d815de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34d659c640 1 -- 172.21.15.112:0/695978791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34d815bec0 msgr2=0x7f34d8154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34d659c640 1 --2- 172.21.15.112:0/695978791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34d815bec0 0x7f34d8154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34d659c640 1 -- 172.21.15.112:0/695978791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d815ee90 con 0x7f34d80af2a0 2024-09-15T23:56:58.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34d659c640 1 --2- 172.21.15.112:0/695978791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d80af2a0 0x7f34d814a7f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f34c800c500 tx=0x7f34c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:58.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34cf7fe640 1 -- 172.21.15.112:0/695978791 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c80052d0 con 0x7f34d80af2a0 2024-09-15T23:56:58.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34cf7fe640 1 -- 172.21.15.112:0/695978791 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c8005490 con 0x7f34d80af2a0 2024-09-15T23:56:58.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34cf7fe640 1 -- 172.21.15.112:0/695978791 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8012850 con 0x7f34d80af2a0 2024-09-15T23:56:58.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34dcd22640 1 -- 172.21.15.112:0/695978791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d815e8d0 con 0x7f34d80af2a0 2024-09-15T23:56:58.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34dcd22640 1 -- 172.21.15.112:0/695978791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d8153c50 con 0x7f34d80af2a0 2024-09-15T23:56:58.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34dcd22640 1 -- 172.21.15.112:0/695978791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d806e000 con 0x7f34d80af2a0 2024-09-15T23:56:58.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34cf7fe640 1 -- 172.21.15.112:0/695978791 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f34c80129f0 con 0x7f34d80af2a0 2024-09-15T23:56:58.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34cf7fe640 1 --2- 172.21.15.112:0/695978791 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34b80678c0 0x7f34b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34cdd9b640 1 --2- 172.21.15.112:0/695978791 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34b80678c0 0x7f34b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34cf7fe640 1 -- 172.21.15.112:0/695978791 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f34c8085af0 con 0x7f34d80af2a0 2024-09-15T23:56:58.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.526+0000 7f34cdd9b640 1 --2- 172.21.15.112:0/695978791 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34b80678c0 0x7f34b8069d80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f34d81f8170 tx=0x7f34c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:58.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.530+0000 7f34cf7fe640 1 -- 172.21.15.112:0/695978791 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f34c8055e60 con 0x7f34d80af2a0 2024-09-15T23:56:58.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.722+0000 7f34dcd22640 1 -- 172.21.15.112:0/695978791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34d814f780 con 0x7f34d80af2a0 2024-09-15T23:56:58.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.722+0000 7f34cf7fe640 1 -- 172.21.15.112:0/695978791 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5231 (secure 0 0 0) 0x7f34c805a160 con 0x7f34d80af2a0 2024-09-15T23:56:58.724 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:58.724 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"btime":"2024-09-15T23:56:58:369858+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2072637952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2072637952},{"type":"v1","addr":"172.21.15.169:6833","nonce":2072637952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/33750051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":33750051},{"type":"v1","addr":"172.21.15.169:6835","nonce":33750051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6018,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/4092393174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":4092393174},{"type":"v1","addr":"172.21.15.112:6837","nonce":4092393174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:55.316845+0000","modified":"2024-09-15T23:56:57.719503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6021},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6021":{"gid":6021,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1581911691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1581911691},{"type":"v1","addr":"172.21.15.112:6836","nonce":1581911691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6021,"qdb_cluster":[6021]},"id":5}]} 2024-09-15T23:56:58.724 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 37 2024-09-15T23:56:58.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.726+0000 7f34dcd22640 1 -- 172.21.15.112:0/695978791 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34b80678c0 msgr2=0x7f34b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.726+0000 7f34dcd22640 1 --2- 172.21.15.112:0/695978791 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34b80678c0 0x7f34b8069d80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f34d81f8170 tx=0x7f34c0008040 comp rx=0 tx=0).stop 2024-09-15T23:56:58.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.726+0000 7f34dcd22640 1 -- 172.21.15.112:0/695978791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d80af2a0 msgr2=0x7f34d814a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.726+0000 7f34dcd22640 1 --2- 172.21.15.112:0/695978791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d80af2a0 0x7f34d814a7f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f34c800c500 tx=0x7f34c800c9c0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.726+0000 7f34dcd22640 1 -- 172.21.15.112:0/695978791 shutdown_connections 2024-09-15T23:56:58.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.726+0000 7f34dcd22640 1 --2- 172.21.15.112:0/695978791 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34b80678c0 0x7f34b8069d80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.726+0000 7f34dcd22640 1 --2- 172.21.15.112:0/695978791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d815c2a0 0x7f34d815de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.726+0000 7f34dcd22640 1 --2- 172.21.15.112:0/695978791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34d815bec0 0x7f34d8154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.726+0000 7f34dcd22640 1 --2- 172.21.15.112:0/695978791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d80af2a0 0x7f34d814a7f0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.726+0000 7f34dcd22640 1 -- 172.21.15.112:0/695978791 >> 172.21.15.112:0/695978791 conn(0x7f34d80b1f90 msgr2=0x7f34d80cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:58.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.726+0000 7f34dcd22640 1 -- 172.21.15.112:0/695978791 shutdown_connections 2024-09-15T23:56:58.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.726+0000 7f34dcd22640 1 -- 172.21.15.112:0/695978791 wait complete. 2024-09-15T23:56:58.742 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:58.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.846+0000 7f7ba0d68640 1 Processor -- start 2024-09-15T23:56:58.848 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.846+0000 7f7ba0d68640 1 -- start start 2024-09-15T23:56:58.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7ba0d68640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b9c06fef0 0x7f7b9c06e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7ba0d68640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7b9c0b3d50 0x7f7b9c0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7ba0d68640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b9c06ee50 con 0x7f7b9c073e60 2024-09-15T23:56:58.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7ba0d68640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7b9c0b46c0 con 0x7f7b9c06fef0 2024-09-15T23:56:58.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7ba0d68640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7b9c06f130 con 0x7f7b9c0b3d50 2024-09-15T23:56:58.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7b99d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b9c06fef0 0x7f7b9c06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7b99d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b9c06fef0 0x7f7b9c06e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43358/0 (socket says 172.21.15.112:43358) 2024-09-15T23:56:58.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7b99d9b640 1 -- 172.21.15.112:0/1795513109 learned_addr learned my addr 172.21.15.112:0/1795513109 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:58.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7b9ad9d640 1 --2- 172.21.15.112:0/1795513109 >> v2:172.21.15.169:3300/0 conn(0x7f7b9c0b3d50 0x7f7b9c0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7b99d9b640 1 -- 172.21.15.112:0/1795513109 >> v2:172.21.15.169:3300/0 conn(0x7f7b9c0b3d50 msgr2=0x7f7b9c0b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:58.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7b99d9b640 1 --2- 172.21.15.112:0/1795513109 >> v2:172.21.15.169:3300/0 conn(0x7f7b9c0b3d50 0x7f7b9c0b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7b99d9b640 1 -- 172.21.15.112:0/1795513109 >> v1:172.21.15.169:6789/0 conn(0x7f7b9c073e60 legacy=0x7f7b9c15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:58.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7b99d9b640 1 -- 172.21.15.112:0/1795513109 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9c06f410 con 0x7f7b9c06fef0 2024-09-15T23:56:58.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7b99d9b640 1 --2- 172.21.15.112:0/1795513109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b9c06fef0 0x7f7b9c06e800 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0afdb0 tx=0x7f7b9001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c8ec24beed93ce server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:58.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7b9959a640 1 -- 172.21.15.112:0/1795513109 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b900b0070 con 0x7f7b9c06fef0 2024-09-15T23:56:58.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7b9959a640 1 -- 172.21.15.112:0/1795513109 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b900ab600 con 0x7f7b9c06fef0 2024-09-15T23:56:58.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7b9959a640 1 -- 172.21.15.112:0/1795513109 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b900ab9d0 con 0x7f7b9c06fef0 2024-09-15T23:56:58.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1795513109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b9c06fef0 msgr2=0x7f7b9c06e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7ba0d68640 1 --2- 172.21.15.112:0/1795513109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b9c06fef0 0x7f7b9c06e800 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0afdb0 tx=0x7f7b9001c450 comp rx=0 tx=0).stop 2024-09-15T23:56:58.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1795513109 shutdown_connections 2024-09-15T23:56:58.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7ba0d68640 1 --2- 172.21.15.112:0/1795513109 >> v2:172.21.15.169:3300/0 conn(0x7f7b9c0b3d50 0x7f7b9c0b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7ba0d68640 1 --2- 172.21.15.112:0/1795513109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b9c06fef0 0x7f7b9c06e800 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1795513109 >> 172.21.15.112:0/1795513109 conn(0x7f7b9c0b1f90 msgr2=0x7f7b9c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:58.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.850+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1795513109 shutdown_connections 2024-09-15T23:56:58.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1795513109 wait complete. 2024-09-15T23:56:58.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7ba0d68640 1 Processor -- start 2024-09-15T23:56:58.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7ba0d68640 1 -- start start 2024-09-15T23:56:58.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7ba0d68640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b9c06fef0 0x7f7b9c149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7ba0d68640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b9c073e60 0x7f7b9c14c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7ba0d68640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b9c0b3d50 0x7f7b9c0d0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7ba0d68640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c0731b0 con 0x7f7b9c0b3d50 2024-09-15T23:56:58.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7ba0d68640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c073030 con 0x7f7b9c073e60 2024-09-15T23:56:58.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7ba0d68640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7b9c073330 con 0x7f7b9c06fef0 2024-09-15T23:56:58.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b9ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b9c0b3d50 0x7f7b9c0d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b9a59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b9c06fef0 0x7f7b9c149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b99d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b9c073e60 0x7f7b9c14c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b9ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b9c0b3d50 0x7f7b9c0d0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43368/0 (socket says 172.21.15.112:43368) 2024-09-15T23:56:58.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b9a59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b9c06fef0 0x7f7b9c149020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:48080/0 (socket says 172.21.15.112:48080) 2024-09-15T23:56:58.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b9ad9d640 1 -- 172.21.15.112:0/1546489251 learned_addr learned my addr 172.21.15.112:0/1546489251 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:58.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b9ad9d640 1 -- 172.21.15.112:0/1546489251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b9c06fef0 msgr2=0x7f7b9c149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b9ad9d640 1 --2- 172.21.15.112:0/1546489251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b9c06fef0 0x7f7b9c149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b9ad9d640 1 -- 172.21.15.112:0/1546489251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b9c073e60 msgr2=0x7f7b9c14c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b9ad9d640 1 --2- 172.21.15.112:0/1546489251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b9c073e60 0x7f7b9c14c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b9ad9d640 1 -- 172.21.15.112:0/1546489251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9c0b54a0 con 0x7f7b9c0b3d50 2024-09-15T23:56:58.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b9ad9d640 1 --2- 172.21.15.112:0/1546489251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b9c0b3d50 0x7f7b9c0d0070 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400cd70 tx=0x7f7b9400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:58.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b8affd640 1 -- 172.21.15.112:0/1546489251 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94003ba0 con 0x7f7b9c0b3d50 2024-09-15T23:56:58.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b8affd640 1 -- 172.21.15.112:0/1546489251 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b94003d40 con 0x7f7b9c0b3d50 2024-09-15T23:56:58.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1546489251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b9c14b3f0 con 0x7f7b9c0b3d50 2024-09-15T23:56:58.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7b8affd640 1 -- 172.21.15.112:0/1546489251 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94004240 con 0x7f7b9c0b3d50 2024-09-15T23:56:58.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.854+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1546489251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b9c14b970 con 0x7f7b9c0b3d50 2024-09-15T23:56:58.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.858+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1546489251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b9c14d190 con 0x7f7b9c0b3d50 2024-09-15T23:56:58.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.858+0000 7f7b8affd640 1 -- 172.21.15.112:0/1546489251 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7b940043e0 con 0x7f7b9c0b3d50 2024-09-15T23:56:58.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.858+0000 7f7b8affd640 1 --2- 172.21.15.112:0/1546489251 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7b7c0678c0 0x7f7b7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.858+0000 7f7b9a59c640 1 --2- 172.21.15.112:0/1546489251 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7b7c0678c0 0x7f7b7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.858+0000 7f7b8affd640 1 -- 172.21.15.112:0/1546489251 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f7b94086710 con 0x7f7b9c0b3d50 2024-09-15T23:56:58.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.858+0000 7f7b9a59c640 1 --2- 172.21.15.112:0/1546489251 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7b7c0678c0 0x7f7b7c069d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c1531f0 tx=0x7f7b8c009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:58.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:58.862+0000 7f7b8affd640 1 -- 172.21.15.112:0/1546489251 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7b9c14d190 con 0x7f7b9c0b3d50 2024-09-15T23:56:59.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.014+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1546489251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b9c06e800 con 0x7f7b9c0b3d50 2024-09-15T23:56:59.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.014+0000 7f7b8affd640 1 -- 172.21.15.112:0/1546489251 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16957 (secure 0 0 0) 0x7f7b94056b00 con 0x7f7b9c0b3d50 2024-09-15T23:56:59.016 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:59.016 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":75,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:56:56.964900+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:52.995591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:54.309259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:59.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.018+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1546489251 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7b7c0678c0 msgr2=0x7f7b7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.018+0000 7f7ba0d68640 1 --2- 172.21.15.112:0/1546489251 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7b7c0678c0 0x7f7b7c069d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c1531f0 tx=0x7f7b8c009060 comp rx=0 tx=0).stop 2024-09-15T23:56:59.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.018+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1546489251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b9c0b3d50 msgr2=0x7f7b9c0d0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.018+0000 7f7ba0d68640 1 --2- 172.21.15.112:0/1546489251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b9c0b3d50 0x7f7b9c0d0070 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400cd70 tx=0x7f7b9400a660 comp rx=0 tx=0).stop 2024-09-15T23:56:59.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.018+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1546489251 shutdown_connections 2024-09-15T23:56:59.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.018+0000 7f7ba0d68640 1 --2- 172.21.15.112:0/1546489251 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7b7c0678c0 0x7f7b7c069d80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.018+0000 7f7ba0d68640 1 --2- 172.21.15.112:0/1546489251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b9c0b3d50 0x7f7b9c0d0070 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.018+0000 7f7ba0d68640 1 --2- 172.21.15.112:0/1546489251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b9c073e60 0x7f7b9c14c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.018+0000 7f7ba0d68640 1 --2- 172.21.15.112:0/1546489251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b9c06fef0 0x7f7b9c149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.018+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1546489251 >> 172.21.15.112:0/1546489251 conn(0x7f7b9c0b1f90 msgr2=0x7f7b9c0751b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:59.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.018+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1546489251 shutdown_connections 2024-09-15T23:56:59.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.018+0000 7f7ba0d68640 1 -- 172.21.15.112:0/1546489251 wait complete. 2024-09-15T23:56:59.034 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:56:59.034 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:56:59.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.150+0000 7f6cae762640 1 Processor -- start 2024-09-15T23:56:59.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.150+0000 7f6cae762640 1 -- start start 2024-09-15T23:56:59.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.154+0000 7f6cae762640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ca8161a60 0x7f6ca80d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.154+0000 7f6cae762640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ca80d2e90 0x7f6ca80cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.154+0000 7f6cae762640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca80d32b0 con 0x7f6ca80cf450 2024-09-15T23:56:59.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.154+0000 7f6cae762640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca80d0300 con 0x7f6ca8161a60 2024-09-15T23:56:59.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.154+0000 7f6cae762640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca806e6c0 con 0x7f6ca80d2e90 2024-09-15T23:56:59.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.154+0000 7f6ca7fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ca8161a60 0x7f6ca80d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.154+0000 7f6ca7fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ca8161a60 0x7f6ca80d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43372/0 (socket says 172.21.15.112:43372) 2024-09-15T23:56:59.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.154+0000 7f6ca7fff640 1 -- 172.21.15.112:0/1647456428 learned_addr learned my addr 172.21.15.112:0/1647456428 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:59.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.154+0000 7f6ca77fe640 1 --2- 172.21.15.112:0/1647456428 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ca80d2e90 0x7f6ca80cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.154+0000 7f6ca7fff640 1 -- 172.21.15.112:0/1647456428 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ca80d2e90 msgr2=0x7f6ca80cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:59.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.154+0000 7f6ca7fff640 1 --2- 172.21.15.112:0/1647456428 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ca80d2e90 0x7f6ca80cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.154+0000 7f6ca7fff640 1 -- 172.21.15.112:0/1647456428 >> v1:172.21.15.169:6789/0 conn(0x7f6ca80cf450 legacy=0x7f6ca80d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.154+0000 7f6ca7fff640 1 -- 172.21.15.112:0/1647456428 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca80b0f60 con 0x7f6ca8161a60 2024-09-15T23:56:59.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6ca7fff640 1 --2- 172.21.15.112:0/1647456428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca8161a60 0x7f6ca80d2950 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009870 tx=0x7f6c9801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee26a4e29d9fc0f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6ca6ffd640 1 -- 172.21.15.112:0/1647456428 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80d1930 con 0x7f6ca8161a60 2024-09-15T23:56:59.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6ca6ffd640 1 -- 172.21.15.112:0/1647456428 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c980af070 con 0x7f6ca8161a60 2024-09-15T23:56:59.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6ca6ffd640 1 -- 172.21.15.112:0/1647456428 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c980aa820 con 0x7f6ca8161a60 2024-09-15T23:56:59.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 -- 172.21.15.112:0/1647456428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca8161a60 msgr2=0x7f6ca80d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 --2- 172.21.15.112:0/1647456428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca8161a60 0x7f6ca80d2950 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009870 tx=0x7f6c9801c4a0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 -- 172.21.15.112:0/1647456428 shutdown_connections 2024-09-15T23:56:59.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 --2- 172.21.15.112:0/1647456428 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ca80d2e90 0x7f6ca80cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 --2- 172.21.15.112:0/1647456428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca8161a60 0x7f6ca80d2950 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 -- 172.21.15.112:0/1647456428 >> 172.21.15.112:0/1647456428 conn(0x7f6ca808bf90 msgr2=0x7f6ca809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:59.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 -- 172.21.15.112:0/1647456428 shutdown_connections 2024-09-15T23:56:59.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 -- 172.21.15.112:0/1647456428 wait complete. 2024-09-15T23:56:59.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 Processor -- start 2024-09-15T23:56:59.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 -- start start 2024-09-15T23:56:59.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ca80cf450 0x7f6ca80b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca80d2e90 0x7f6ca80b6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ca8161a60 0x7f6ca8158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca816af20 con 0x7f6ca80d2e90 2024-09-15T23:56:59.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca806d190 con 0x7f6ca8161a60 2024-09-15T23:56:59.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6cae762640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca816b0a0 con 0x7f6ca80cf450 2024-09-15T23:56:59.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6ca77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca80d2e90 0x7f6ca80b6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6ca77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca80d2e90 0x7f6ca80b6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43388/0 (socket says 172.21.15.112:43388) 2024-09-15T23:56:59.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6ca77fe640 1 -- 172.21.15.112:0/3371566335 learned_addr learned my addr 172.21.15.112:0/3371566335 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:59.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6ca7fff640 1 --2- 172.21.15.112:0/3371566335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ca80cf450 0x7f6ca80b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6caccff640 1 --2- 172.21.15.112:0/3371566335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ca8161a60 0x7f6ca8158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6ca77fe640 1 -- 172.21.15.112:0/3371566335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ca80cf450 msgr2=0x7f6ca80b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6ca77fe640 1 --2- 172.21.15.112:0/3371566335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ca80cf450 0x7f6ca80b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6ca77fe640 1 -- 172.21.15.112:0/3371566335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ca8161a60 msgr2=0x7f6ca8158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6ca77fe640 1 --2- 172.21.15.112:0/3371566335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ca8161a60 0x7f6ca8158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6ca77fe640 1 -- 172.21.15.112:0/3371566335 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca8150cf0 con 0x7f6ca80d2e90 2024-09-15T23:56:59.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.158+0000 7f6ca77fe640 1 --2- 172.21.15.112:0/3371566335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca80d2e90 0x7f6ca80b6380 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00d800 tx=0x7f6c9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.162+0000 7f6ca4ff9640 1 -- 172.21.15.112:0/3371566335 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c00b6c0 con 0x7f6ca80d2e90 2024-09-15T23:56:59.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.162+0000 7f6ca4ff9640 1 -- 172.21.15.112:0/3371566335 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9c019070 con 0x7f6ca80d2e90 2024-09-15T23:56:59.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.162+0000 7f6cae762640 1 -- 172.21.15.112:0/3371566335 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca8150fd0 con 0x7f6ca80d2e90 2024-09-15T23:56:59.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.162+0000 7f6ca4ff9640 1 -- 172.21.15.112:0/3371566335 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c00ba60 con 0x7f6ca80d2e90 2024-09-15T23:56:59.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.162+0000 7f6cae762640 1 -- 172.21.15.112:0/3371566335 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca8151590 con 0x7f6ca80d2e90 2024-09-15T23:56:59.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.162+0000 7f6cae762640 1 -- 172.21.15.112:0/3371566335 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca814d090 con 0x7f6ca80d2e90 2024-09-15T23:56:59.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.162+0000 7f6ca4ff9640 1 -- 172.21.15.112:0/3371566335 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c9c00bc00 con 0x7f6ca80d2e90 2024-09-15T23:56:59.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.162+0000 7f6ca4ff9640 1 --2- 172.21.15.112:0/3371566335 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6c940678c0 0x7f6c94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.162+0000 7f6ca4ff9640 1 -- 172.21.15.112:0/3371566335 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f6c9c086290 con 0x7f6ca80d2e90 2024-09-15T23:56:59.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.162+0000 7f6ca7fff640 1 --2- 172.21.15.112:0/3371566335 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6c940678c0 0x7f6c94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.162+0000 7f6ca7fff640 1 --2- 172.21.15.112:0/3371566335 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6c940678c0 0x7f6c94069d80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c980ae000 tx=0x7f6c980a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.166+0000 7f6ca4ff9640 1 -- 172.21.15.112:0/3371566335 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6ca814d090 con 0x7f6ca80d2e90 2024-09-15T23:56:59.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.314+0000 7f6cae762640 1 -- 172.21.15.112:0/3371566335 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ca8075270 con 0x7f6c940678c0 2024-09-15T23:56:59.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.326+0000 7f6ca4ff9640 1 -- 172.21.15.112:0/3371566335 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249762 (secure 0 0 0) 0x7f6ca8075270 con 0x7f6c940678c0 2024-09-15T23:56:59.330 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:59.334 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:56:59.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.330+0000 7f6cae762640 1 -- 172.21.15.112:0/3371566335 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6c940678c0 msgr2=0x7f6c94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.330+0000 7f6cae762640 1 --2- 172.21.15.112:0/3371566335 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6c940678c0 0x7f6c94069d80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c980ae000 tx=0x7f6c980a7000 comp rx=0 tx=0).stop 2024-09-15T23:56:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.330+0000 7f6cae762640 1 -- 172.21.15.112:0/3371566335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca80d2e90 msgr2=0x7f6ca80b6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.330+0000 7f6cae762640 1 --2- 172.21.15.112:0/3371566335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca80d2e90 0x7f6ca80b6380 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00d800 tx=0x7f6c9c00dcc0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.330+0000 7f6cae762640 1 -- 172.21.15.112:0/3371566335 shutdown_connections 2024-09-15T23:56:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.330+0000 7f6cae762640 1 --2- 172.21.15.112:0/3371566335 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6c940678c0 0x7f6c94069d80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.330+0000 7f6cae762640 1 --2- 172.21.15.112:0/3371566335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ca8161a60 0x7f6ca8158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.330+0000 7f6cae762640 1 --2- 172.21.15.112:0/3371566335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca80d2e90 0x7f6ca80b6380 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.330+0000 7f6cae762640 1 --2- 172.21.15.112:0/3371566335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ca80cf450 0x7f6ca80b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.330+0000 7f6cae762640 1 -- 172.21.15.112:0/3371566335 >> 172.21.15.112:0/3371566335 conn(0x7f6ca808bf90 msgr2=0x7f6ca80b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.330+0000 7f6cae762640 1 -- 172.21.15.112:0/3371566335 shutdown_connections 2024-09-15T23:56:59.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.330+0000 7f6cae762640 1 -- 172.21.15.112:0/3371566335 wait complete. 2024-09-15T23:56:59.346 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2024-09-15T23:56:59.291468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257748,"kb_used_data":8224,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716972,"statfs":{"total":773094113280,"available":772830179328,"internally_reserved":0,"allocated":8421376,"data_stored":4431824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.358953"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252528+0000","last_change":"2024-09-15T23:56:55.979224+0000","last_active":"2024-09-15T23:56:57.252528+0000","last_peered":"2024-09-15T23:56:57.252528+0000","last_clean":"2024-09-15T23:56:57.252528+0000","last_became_active":"2024-09-15T23:56:55.978887+0000","last_became_peered":"2024-09-15T23:56:55.978887+0000","last_unstale":"2024-09-15T23:56:57.252528+0000","last_undegraded":"2024-09-15T23:56:57.252528+0000","last_fullsized":"2024-09-15T23:56:57.252528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:32.013874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993595+0000","last_change":"2024-09-15T23:56:55.999113+0000","last_active":"2024-09-15T23:56:56.993595+0000","last_peered":"2024-09-15T23:56:56.993595+0000","last_clean":"2024-09-15T23:56:56.993595+0000","last_became_active":"2024-09-15T23:56:55.997840+0000","last_became_peered":"2024-09-15T23:56:55.997840+0000","last_unstale":"2024-09-15T23:56:56.993595+0000","last_undegraded":"2024-09-15T23:56:56.993595+0000","last_fullsized":"2024-09-15T23:56:56.993595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:31.205893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993705+0000","last_change":"2024-09-15T23:56:55.989925+0000","last_active":"2024-09-15T23:56:56.993705+0000","last_peered":"2024-09-15T23:56:56.993705+0000","last_clean":"2024-09-15T23:56:56.993705+0000","last_became_active":"2024-09-15T23:56:55.986690+0000","last_became_peered":"2024-09-15T23:56:55.986690+0000","last_unstale":"2024-09-15T23:56:56.993705+0000","last_undegraded":"2024-09-15T23:56:56.993705+0000","last_fullsized":"2024-09-15T23:56:56.993705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:14.922569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751951+0000","last_change":"2024-09-15T23:56:55.984311+0000","last_active":"2024-09-15T23:56:57.751951+0000","last_peered":"2024-09-15T23:56:57.751951+0000","last_clean":"2024-09-15T23:56:57.751951+0000","last_became_active":"2024-09-15T23:56:55.984038+0000","last_became_peered":"2024-09-15T23:56:55.984038+0000","last_unstale":"2024-09-15T23:56:57.751951+0000","last_undegraded":"2024-09-15T23:56:57.751951+0000","last_fullsized":"2024-09-15T23:56:57.751951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:14.917805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753296+0000","last_change":"2024-09-15T23:56:55.973914+0000","last_active":"2024-09-15T23:56:57.753296+0000","last_peered":"2024-09-15T23:56:57.753296+0000","last_clean":"2024-09-15T23:56:57.753296+0000","last_became_active":"2024-09-15T23:56:55.973108+0000","last_became_peered":"2024-09-15T23:56:55.973108+0000","last_unstale":"2024-09-15T23:56:57.753296+0000","last_undegraded":"2024-09-15T23:56:57.753296+0000","last_fullsized":"2024-09-15T23:56:57.753296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.322294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012161+0000","last_change":"2024-09-15T23:56:55.993222+0000","last_active":"2024-09-15T23:56:56.012161+0000","last_peered":"2024-09-15T23:56:56.012161+0000","last_clean":"2024-09-15T23:56:56.012161+0000","last_became_active":"2024-09-15T23:56:55.992379+0000","last_became_peered":"2024-09-15T23:56:55.992379+0000","last_unstale":"2024-09-15T23:56:56.012161+0000","last_undegraded":"2024-09-15T23:56:56.012161+0000","last_fullsized":"2024-09-15T23:56:56.012161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:29:42.435805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751410+0000","last_change":"2024-09-15T23:56:55.969504+0000","last_active":"2024-09-15T23:56:57.751410+0000","last_peered":"2024-09-15T23:56:57.751410+0000","last_clean":"2024-09-15T23:56:57.751410+0000","last_became_active":"2024-09-15T23:56:55.968813+0000","last_became_peered":"2024-09-15T23:56:55.968813+0000","last_unstale":"2024-09-15T23:56:57.751410+0000","last_undegraded":"2024-09-15T23:56:57.751410+0000","last_fullsized":"2024-09-15T23:56:57.751410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:37.530094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990258+0000","last_change":"2024-09-15T23:56:55.974436+0000","last_active":"2024-09-15T23:56:56.990258+0000","last_peered":"2024-09-15T23:56:56.990258+0000","last_clean":"2024-09-15T23:56:56.990258+0000","last_became_active":"2024-09-15T23:56:55.973689+0000","last_became_peered":"2024-09-15T23:56:55.973689+0000","last_unstale":"2024-09-15T23:56:56.990258+0000","last_undegraded":"2024-09-15T23:56:56.990258+0000","last_fullsized":"2024-09-15T23:56:56.990258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:28.820185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752677+0000","last_change":"2024-09-15T23:56:55.995299+0000","last_active":"2024-09-15T23:56:57.752677+0000","last_peered":"2024-09-15T23:56:57.752677+0000","last_clean":"2024-09-15T23:56:57.752677+0000","last_became_active":"2024-09-15T23:56:55.994979+0000","last_became_peered":"2024-09-15T23:56:55.994979+0000","last_unstale":"2024-09-15T23:56:57.752677+0000","last_undegraded":"2024-09-15T23:56:57.752677+0000","last_fullsized":"2024-09-15T23:56:57.752677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:54.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252297+0000","last_change":"2024-09-15T23:56:55.996657+0000","last_active":"2024-09-15T23:56:57.252297+0000","last_peered":"2024-09-15T23:56:57.252297+0000","last_clean":"2024-09-15T23:56:57.252297+0000","last_became_active":"2024-09-15T23:56:55.996374+0000","last_became_peered":"2024-09-15T23:56:55.996374+0000","last_unstale":"2024-09-15T23:56:57.252297+0000","last_undegraded":"2024-09-15T23:56:57.252297+0000","last_fullsized":"2024-09-15T23:56:57.252297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:28.942569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.994065+0000","last_change":"2024-09-15T23:56:56.002531+0000","last_active":"2024-09-15T23:56:56.994065+0000","last_peered":"2024-09-15T23:56:56.994065+0000","last_clean":"2024-09-15T23:56:56.994065+0000","last_became_active":"2024-09-15T23:56:55.989953+0000","last_became_peered":"2024-09-15T23:56:55.989953+0000","last_unstale":"2024-09-15T23:56:56.994065+0000","last_undegraded":"2024-09-15T23:56:56.994065+0000","last_fullsized":"2024-09-15T23:56:56.994065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:42.470630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993324+0000","last_change":"2024-09-15T23:56:56.004482+0000","last_active":"2024-09-15T23:56:56.993324+0000","last_peered":"2024-09-15T23:56:56.993324+0000","last_clean":"2024-09-15T23:56:56.993324+0000","last_became_active":"2024-09-15T23:56:56.003824+0000","last_became_peered":"2024-09-15T23:56:56.003824+0000","last_unstale":"2024-09-15T23:56:56.993324+0000","last_undegraded":"2024-09-15T23:56:56.993324+0000","last_fullsized":"2024-09-15T23:56:56.993324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:32.353177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990654+0000","last_change":"2024-09-15T23:56:55.984462+0000","last_active":"2024-09-15T23:56:56.990654+0000","last_peered":"2024-09-15T23:56:56.990654+0000","last_clean":"2024-09-15T23:56:56.990654+0000","last_became_active":"2024-09-15T23:56:55.983722+0000","last_became_peered":"2024-09-15T23:56:55.983722+0000","last_unstale":"2024-09-15T23:56:56.990654+0000","last_undegraded":"2024-09-15T23:56:56.990654+0000","last_fullsized":"2024-09-15T23:56:56.990654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:39.347880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752123+0000","last_change":"2024-09-15T23:56:56.007000+0000","last_active":"2024-09-15T23:56:57.752123+0000","last_peered":"2024-09-15T23:56:57.752123+0000","last_clean":"2024-09-15T23:56:57.752123+0000","last_became_active":"2024-09-15T23:56:56.006350+0000","last_became_peered":"2024-09-15T23:56:56.006350+0000","last_unstale":"2024-09-15T23:56:57.752123+0000","last_undegraded":"2024-09-15T23:56:57.752123+0000","last_fullsized":"2024-09-15T23:56:57.752123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:59.909567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751377+0000","last_change":"2024-09-15T23:56:55.974231+0000","last_active":"2024-09-15T23:56:57.751377+0000","last_peered":"2024-09-15T23:56:57.751377+0000","last_clean":"2024-09-15T23:56:57.751377+0000","last_became_active":"2024-09-15T23:56:55.973543+0000","last_became_peered":"2024-09-15T23:56:55.973543+0000","last_unstale":"2024-09-15T23:56:57.751377+0000","last_undegraded":"2024-09-15T23:56:57.751377+0000","last_fullsized":"2024-09-15T23:56:57.751377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:58.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991496+0000","last_change":"2024-09-15T23:56:55.958076+0000","last_active":"2024-09-15T23:56:56.991496+0000","last_peered":"2024-09-15T23:56:56.991496+0000","last_clean":"2024-09-15T23:56:56.991496+0000","last_became_active":"2024-09-15T23:56:55.957404+0000","last_became_peered":"2024-09-15T23:56:55.957404+0000","last_unstale":"2024-09-15T23:56:56.991496+0000","last_undegraded":"2024-09-15T23:56:56.991496+0000","last_fullsized":"2024-09-15T23:56:56.991496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:23.266535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993642+0000","last_change":"2024-09-15T23:56:55.998591+0000","last_active":"2024-09-15T23:56:56.993642+0000","last_peered":"2024-09-15T23:56:56.993642+0000","last_clean":"2024-09-15T23:56:56.993642+0000","last_became_active":"2024-09-15T23:56:55.997788+0000","last_became_peered":"2024-09-15T23:56:55.997788+0000","last_unstale":"2024-09-15T23:56:56.993642+0000","last_undegraded":"2024-09-15T23:56:56.993642+0000","last_fullsized":"2024-09-15T23:56:56.993642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:50.441671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991220+0000","last_change":"2024-09-15T23:56:55.997317+0000","last_active":"2024-09-15T23:56:56.991220+0000","last_peered":"2024-09-15T23:56:56.991220+0000","last_clean":"2024-09-15T23:56:56.991220+0000","last_became_active":"2024-09-15T23:56:55.996587+0000","last_became_peered":"2024-09-15T23:56:55.996587+0000","last_unstale":"2024-09-15T23:56:56.991220+0000","last_undegraded":"2024-09-15T23:56:56.991220+0000","last_fullsized":"2024-09-15T23:56:56.991220+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:33.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012508+0000","last_change":"2024-09-15T23:56:55.994322+0000","last_active":"2024-09-15T23:56:56.012508+0000","last_peered":"2024-09-15T23:56:56.012508+0000","last_clean":"2024-09-15T23:56:56.012508+0000","last_became_active":"2024-09-15T23:56:55.993525+0000","last_became_peered":"2024-09-15T23:56:55.993525+0000","last_unstale":"2024-09-15T23:56:56.012508+0000","last_undegraded":"2024-09-15T23:56:56.012508+0000","last_fullsized":"2024-09-15T23:56:56.012508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:44.991594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992685+0000","last_change":"2024-09-15T23:56:56.011861+0000","last_active":"2024-09-15T23:56:56.992685+0000","last_peered":"2024-09-15T23:56:56.992685+0000","last_clean":"2024-09-15T23:56:56.992685+0000","last_became_active":"2024-09-15T23:56:56.011149+0000","last_became_peered":"2024-09-15T23:56:56.011149+0000","last_unstale":"2024-09-15T23:56:56.992685+0000","last_undegraded":"2024-09-15T23:56:56.992685+0000","last_fullsized":"2024-09-15T23:56:56.992685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:19.060961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252117+0000","last_change":"2024-09-15T23:56:55.984314+0000","last_active":"2024-09-15T23:56:57.252117+0000","last_peered":"2024-09-15T23:56:57.252117+0000","last_clean":"2024-09-15T23:56:57.252117+0000","last_became_active":"2024-09-15T23:56:55.983952+0000","last_became_peered":"2024-09-15T23:56:55.983952+0000","last_unstale":"2024-09-15T23:56:57.252117+0000","last_undegraded":"2024-09-15T23:56:57.252117+0000","last_fullsized":"2024-09-15T23:56:57.252117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:45:10.598663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992395+0000","last_change":"2024-09-15T23:56:56.004418+0000","last_active":"2024-09-15T23:56:56.992395+0000","last_peered":"2024-09-15T23:56:56.992395+0000","last_clean":"2024-09-15T23:56:56.992395+0000","last_became_active":"2024-09-15T23:56:56.003744+0000","last_became_peered":"2024-09-15T23:56:56.003744+0000","last_unstale":"2024-09-15T23:56:56.992395+0000","last_undegraded":"2024-09-15T23:56:56.992395+0000","last_fullsized":"2024-09-15T23:56:56.992395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:14.917805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.013320+0000","last_change":"2024-09-15T23:56:56.000438+0000","last_active":"2024-09-15T23:56:56.013320+0000","last_peered":"2024-09-15T23:56:56.013320+0000","last_clean":"2024-09-15T23:56:56.013320+0000","last_became_active":"2024-09-15T23:56:55.999839+0000","last_became_peered":"2024-09-15T23:56:55.999839+0000","last_unstale":"2024-09-15T23:56:56.013320+0000","last_undegraded":"2024-09-15T23:56:56.013320+0000","last_fullsized":"2024-09-15T23:56:56.013320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:41.952442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752800+0000","last_change":"2024-09-15T23:56:55.974824+0000","last_active":"2024-09-15T23:56:57.752800+0000","last_peered":"2024-09-15T23:56:57.752800+0000","last_clean":"2024-09-15T23:56:57.752800+0000","last_became_active":"2024-09-15T23:56:55.974296+0000","last_became_peered":"2024-09-15T23:56:55.974296+0000","last_unstale":"2024-09-15T23:56:57.752800+0000","last_undegraded":"2024-09-15T23:56:57.752800+0000","last_fullsized":"2024-09-15T23:56:57.752800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:32.353177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752021+0000","last_change":"2024-09-15T23:56:55.972869+0000","last_active":"2024-09-15T23:56:57.752021+0000","last_peered":"2024-09-15T23:56:57.752021+0000","last_clean":"2024-09-15T23:56:57.752021+0000","last_became_active":"2024-09-15T23:56:55.972567+0000","last_became_peered":"2024-09-15T23:56:55.972567+0000","last_unstale":"2024-09-15T23:56:57.752021+0000","last_undegraded":"2024-09-15T23:56:57.752021+0000","last_fullsized":"2024-09-15T23:56:57.752021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:20.287580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753525+0000","last_change":"2024-09-15T23:56:55.995902+0000","last_active":"2024-09-15T23:56:57.753525+0000","last_peered":"2024-09-15T23:56:57.753525+0000","last_clean":"2024-09-15T23:56:57.753525+0000","last_became_active":"2024-09-15T23:56:55.994271+0000","last_became_peered":"2024-09-15T23:56:55.994271+0000","last_unstale":"2024-09-15T23:56:57.753525+0000","last_undegraded":"2024-09-15T23:56:57.753525+0000","last_fullsized":"2024-09-15T23:56:57.753525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:04.379802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012213+0000","last_change":"2024-09-15T23:56:55.993324+0000","last_active":"2024-09-15T23:56:56.012213+0000","last_peered":"2024-09-15T23:56:56.012213+0000","last_clean":"2024-09-15T23:56:56.012213+0000","last_became_active":"2024-09-15T23:56:55.992543+0000","last_became_peered":"2024-09-15T23:56:55.992543+0000","last_unstale":"2024-09-15T23:56:56.012213+0000","last_undegraded":"2024-09-15T23:56:56.012213+0000","last_fullsized":"2024-09-15T23:56:56.012213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:10.974266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251818+0000","last_change":"2024-09-15T23:56:56.011651+0000","last_active":"2024-09-15T23:56:57.251818+0000","last_peered":"2024-09-15T23:56:57.251818+0000","last_clean":"2024-09-15T23:56:57.251818+0000","last_became_active":"2024-09-15T23:56:56.011342+0000","last_became_peered":"2024-09-15T23:56:56.011342+0000","last_unstale":"2024-09-15T23:56:57.251818+0000","last_undegraded":"2024-09-15T23:56:57.251818+0000","last_fullsized":"2024-09-15T23:56:57.251818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:02.575095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992637+0000","last_change":"2024-09-15T23:56:55.999632+0000","last_active":"2024-09-15T23:56:56.992637+0000","last_peered":"2024-09-15T23:56:56.992637+0000","last_clean":"2024-09-15T23:56:56.992637+0000","last_became_active":"2024-09-15T23:56:55.999003+0000","last_became_peered":"2024-09-15T23:56:55.999003+0000","last_unstale":"2024-09-15T23:56:56.992637+0000","last_undegraded":"2024-09-15T23:56:56.992637+0000","last_fullsized":"2024-09-15T23:56:56.992637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:27.375798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751513+0000","last_change":"2024-09-15T23:56:56.000881+0000","last_active":"2024-09-15T23:56:57.751513+0000","last_peered":"2024-09-15T23:56:57.751513+0000","last_clean":"2024-09-15T23:56:57.751513+0000","last_became_active":"2024-09-15T23:56:56.000550+0000","last_became_peered":"2024-09-15T23:56:56.000550+0000","last_unstale":"2024-09-15T23:56:57.751513+0000","last_undegraded":"2024-09-15T23:56:57.751513+0000","last_fullsized":"2024-09-15T23:56:57.751513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:16.086562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752125+0000","last_change":"2024-09-15T23:56:55.970381+0000","last_active":"2024-09-15T23:56:57.752125+0000","last_peered":"2024-09-15T23:56:57.752125+0000","last_clean":"2024-09-15T23:56:57.752125+0000","last_became_active":"2024-09-15T23:56:55.969605+0000","last_became_peered":"2024-09-15T23:56:55.969605+0000","last_unstale":"2024-09-15T23:56:57.752125+0000","last_undegraded":"2024-09-15T23:56:57.752125+0000","last_fullsized":"2024-09-15T23:56:57.752125+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:07.077120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754074+0000","last_change":"2024-09-15T23:56:54.986431+0000","last_active":"2024-09-15T23:56:57.754074+0000","last_peered":"2024-09-15T23:56:57.754074+0000","last_clean":"2024-09-15T23:56:57.754074+0000","last_became_active":"2024-09-15T23:56:54.986031+0000","last_became_peered":"2024-09-15T23:56:54.986031+0000","last_unstale":"2024-09-15T23:56:57.754074+0000","last_undegraded":"2024-09-15T23:56:57.754074+0000","last_fullsized":"2024-09-15T23:56:57.754074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:45.418494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752493+0000","last_change":"2024-09-15T23:56:55.980727+0000","last_active":"2024-09-15T23:56:57.752493+0000","last_peered":"2024-09-15T23:56:57.752493+0000","last_clean":"2024-09-15T23:56:57.752493+0000","last_became_active":"2024-09-15T23:56:55.973498+0000","last_became_peered":"2024-09-15T23:56:55.973498+0000","last_unstale":"2024-09-15T23:56:57.752493+0000","last_undegraded":"2024-09-15T23:56:57.752493+0000","last_fullsized":"2024-09-15T23:56:57.752493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:37.501600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.942231+0000","last_change":"2024-09-15T23:56:53.942231+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.942231+0000","last_undegraded":"2024-09-15T23:56:53.942231+0000","last_fullsized":"2024-09-15T23:56:53.942231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251960+0000","last_change":"2024-09-15T23:56:54.968341+0000","last_active":"2024-09-15T23:56:57.251960+0000","last_peered":"2024-09-15T23:56:57.251960+0000","last_clean":"2024-09-15T23:56:57.251960+0000","last_became_active":"2024-09-15T23:56:54.968071+0000","last_became_peered":"2024-09-15T23:56:54.968071+0000","last_unstale":"2024-09-15T23:56:57.251960+0000","last_undegraded":"2024-09-15T23:56:57.251960+0000","last_fullsized":"2024-09-15T23:56:57.251960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:49.633991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751297+0000","last_change":"2024-09-15T23:56:55.984390+0000","last_active":"2024-09-15T23:56:57.751297+0000","last_peered":"2024-09-15T23:56:57.751297+0000","last_clean":"2024-09-15T23:56:57.751297+0000","last_became_active":"2024-09-15T23:56:55.984141+0000","last_became_peered":"2024-09-15T23:56:55.984141+0000","last_unstale":"2024-09-15T23:56:57.751297+0000","last_undegraded":"2024-09-15T23:56:57.751297+0000","last_fullsized":"2024-09-15T23:56:57.751297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:48.336601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940540+0000","last_change":"2024-09-15T23:56:53.940540+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940540+0000","last_undegraded":"2024-09-15T23:56:53.940540+0000","last_fullsized":"2024-09-15T23:56:53.940540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012541+0000","last_change":"2024-09-15T23:56:55.997214+0000","last_active":"2024-09-15T23:56:56.012541+0000","last_peered":"2024-09-15T23:56:56.012541+0000","last_clean":"2024-09-15T23:56:56.012541+0000","last_became_active":"2024-09-15T23:56:55.992307+0000","last_became_peered":"2024-09-15T23:56:55.992307+0000","last_unstale":"2024-09-15T23:56:56.012541+0000","last_undegraded":"2024-09-15T23:56:56.012541+0000","last_fullsized":"2024-09-15T23:56:56.012541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:47.802236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.939966+0000","last_change":"2024-09-15T23:56:53.939966+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.939966+0000","last_undegraded":"2024-09-15T23:56:53.939966+0000","last_fullsized":"2024-09-15T23:56:53.939966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.994384+0000","last_change":"2024-09-15T23:56:56.004365+0000","last_active":"2024-09-15T23:56:56.994384+0000","last_peered":"2024-09-15T23:56:56.994384+0000","last_clean":"2024-09-15T23:56:56.994384+0000","last_became_active":"2024-09-15T23:56:56.003697+0000","last_became_peered":"2024-09-15T23:56:56.003697+0000","last_unstale":"2024-09-15T23:56:56.994384+0000","last_undegraded":"2024-09-15T23:56:56.994384+0000","last_fullsized":"2024-09-15T23:56:56.994384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:24.370163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940540+0000","last_change":"2024-09-15T23:56:53.940540+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940540+0000","last_undegraded":"2024-09-15T23:56:53.940540+0000","last_fullsized":"2024-09-15T23:56:53.940540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990195+0000","last_change":"2024-09-15T23:56:54.965160+0000","last_active":"2024-09-15T23:56:56.990195+0000","last_peered":"2024-09-15T23:56:56.990195+0000","last_clean":"2024-09-15T23:56:56.990195+0000","last_became_active":"2024-09-15T23:56:54.964317+0000","last_became_peered":"2024-09-15T23:56:54.964317+0000","last_unstale":"2024-09-15T23:56:56.990195+0000","last_undegraded":"2024-09-15T23:56:56.990195+0000","last_fullsized":"2024-09-15T23:56:56.990195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:53.719508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992537+0000","last_change":"2024-09-15T23:56:54.984630+0000","last_active":"2024-09-15T23:56:56.992537+0000","last_peered":"2024-09-15T23:56:56.992537+0000","last_clean":"2024-09-15T23:56:56.992537+0000","last_became_active":"2024-09-15T23:56:54.983896+0000","last_became_peered":"2024-09-15T23:56:54.983896+0000","last_unstale":"2024-09-15T23:56:56.992537+0000","last_undegraded":"2024-09-15T23:56:56.992537+0000","last_fullsized":"2024-09-15T23:56:56.992537+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:28.388939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992459+0000","last_change":"2024-09-15T23:56:55.989801+0000","last_active":"2024-09-15T23:56:56.992459+0000","last_peered":"2024-09-15T23:56:56.992459+0000","last_clean":"2024-09-15T23:56:56.992459+0000","last_became_active":"2024-09-15T23:56:55.989074+0000","last_became_peered":"2024-09-15T23:56:55.989074+0000","last_unstale":"2024-09-15T23:56:56.992459+0000","last_undegraded":"2024-09-15T23:56:56.992459+0000","last_fullsized":"2024-09-15T23:56:56.992459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:20.287580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752742+0000","last_change":"2024-09-15T23:56:54.959168+0000","last_active":"2024-09-15T23:56:57.752742+0000","last_peered":"2024-09-15T23:56:57.752742+0000","last_clean":"2024-09-15T23:56:57.752742+0000","last_became_active":"2024-09-15T23:56:54.958765+0000","last_became_peered":"2024-09-15T23:56:54.958765+0000","last_unstale":"2024-09-15T23:56:57.752742+0000","last_undegraded":"2024-09-15T23:56:57.752742+0000","last_fullsized":"2024-09-15T23:56:57.752742+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:36.491410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252161+0000","last_change":"2024-09-15T23:56:54.958234+0000","last_active":"2024-09-15T23:56:57.252161+0000","last_peered":"2024-09-15T23:56:57.252161+0000","last_clean":"2024-09-15T23:56:57.252161+0000","last_became_active":"2024-09-15T23:56:54.957887+0000","last_became_peered":"2024-09-15T23:56:54.957887+0000","last_unstale":"2024-09-15T23:56:57.252161+0000","last_undegraded":"2024-09-15T23:56:57.252161+0000","last_fullsized":"2024-09-15T23:56:57.252161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:36.491410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991152+0000","last_change":"2024-09-15T23:56:55.959205+0000","last_active":"2024-09-15T23:56:56.991152+0000","last_peered":"2024-09-15T23:56:56.991152+0000","last_clean":"2024-09-15T23:56:56.991152+0000","last_became_active":"2024-09-15T23:56:55.958373+0000","last_became_peered":"2024-09-15T23:56:55.958373+0000","last_unstale":"2024-09-15T23:56:56.991152+0000","last_undegraded":"2024-09-15T23:56:56.991152+0000","last_fullsized":"2024-09-15T23:56:56.991152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:23.272483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.016000+0000","last_change":"2024-09-15T23:56:54.977562+0000","last_active":"2024-09-15T23:56:56.016000+0000","last_peered":"2024-09-15T23:56:56.016000+0000","last_clean":"2024-09-15T23:56:56.016000+0000","last_became_active":"2024-09-15T23:56:54.976751+0000","last_became_peered":"2024-09-15T23:56:54.976751+0000","last_unstale":"2024-09-15T23:56:56.016000+0000","last_undegraded":"2024-09-15T23:56:56.016000+0000","last_fullsized":"2024-09-15T23:56:56.016000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:35.674580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012244+0000","last_change":"2024-09-15T23:56:55.993382+0000","last_active":"2024-09-15T23:56:56.012244+0000","last_peered":"2024-09-15T23:56:56.012244+0000","last_clean":"2024-09-15T23:56:56.012244+0000","last_became_active":"2024-09-15T23:56:55.992592+0000","last_became_peered":"2024-09-15T23:56:55.992592+0000","last_unstale":"2024-09-15T23:56:56.012244+0000","last_undegraded":"2024-09-15T23:56:56.012244+0000","last_fullsized":"2024-09-15T23:56:56.012244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:32.291020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940983+0000","last_change":"2024-09-15T23:56:53.940983+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940983+0000","last_undegraded":"2024-09-15T23:56:53.940983+0000","last_fullsized":"2024-09-15T23:56:53.940983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752119+0000","last_change":"2024-09-15T23:56:55.995297+0000","last_active":"2024-09-15T23:56:57.752119+0000","last_peered":"2024-09-15T23:56:57.752119+0000","last_clean":"2024-09-15T23:56:57.752119+0000","last_became_active":"2024-09-15T23:56:55.994941+0000","last_became_peered":"2024-09-15T23:56:55.994941+0000","last_unstale":"2024-09-15T23:56:57.752119+0000","last_undegraded":"2024-09-15T23:56:57.752119+0000","last_fullsized":"2024-09-15T23:56:57.752119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:27.375798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252310+0000","last_change":"2024-09-15T23:56:54.967739+0000","last_active":"2024-09-15T23:56:57.252310+0000","last_peered":"2024-09-15T23:56:57.252310+0000","last_clean":"2024-09-15T23:56:57.252310+0000","last_became_active":"2024-09-15T23:56:54.967464+0000","last_became_peered":"2024-09-15T23:56:54.967464+0000","last_unstale":"2024-09-15T23:56:57.252310+0000","last_undegraded":"2024-09-15T23:56:57.252310+0000","last_fullsized":"2024-09-15T23:56:57.252310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:45.950977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252103+0000","last_change":"2024-09-15T23:56:56.006475+0000","last_active":"2024-09-15T23:56:57.252103+0000","last_peered":"2024-09-15T23:56:57.252103+0000","last_clean":"2024-09-15T23:56:57.252103+0000","last_became_active":"2024-09-15T23:56:56.006118+0000","last_became_peered":"2024-09-15T23:56:56.006118+0000","last_unstale":"2024-09-15T23:56:57.252103+0000","last_undegraded":"2024-09-15T23:56:57.252103+0000","last_fullsized":"2024-09-15T23:56:57.252103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:56.067306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.941555+0000","last_change":"2024-09-15T23:56:53.941555+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.941555+0000","last_undegraded":"2024-09-15T23:56:53.941555+0000","last_fullsized":"2024-09-15T23:56:53.941555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752761+0000","last_change":"2024-09-15T23:56:54.989708+0000","last_active":"2024-09-15T23:56:57.752761+0000","last_peered":"2024-09-15T23:56:57.752761+0000","last_clean":"2024-09-15T23:56:57.752761+0000","last_became_active":"2024-09-15T23:56:54.989300+0000","last_became_peered":"2024-09-15T23:56:54.989300+0000","last_unstale":"2024-09-15T23:56:57.752761+0000","last_undegraded":"2024-09-15T23:56:57.752761+0000","last_fullsized":"2024-09-15T23:56:57.752761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:47.414189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252603+0000","last_change":"2024-09-15T23:56:56.010338+0000","last_active":"2024-09-15T23:56:57.252603+0000","last_peered":"2024-09-15T23:56:57.252603+0000","last_clean":"2024-09-15T23:56:57.252603+0000","last_became_active":"2024-09-15T23:56:56.010068+0000","last_became_peered":"2024-09-15T23:56:56.010068+0000","last_unstale":"2024-09-15T23:56:57.252603+0000","last_undegraded":"2024-09-15T23:56:57.252603+0000","last_fullsized":"2024-09-15T23:56:57.252603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:47.563782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.015998+0000","last_change":"2024-09-15T23:56:54.971305+0000","last_active":"2024-09-15T23:56:56.015998+0000","last_peered":"2024-09-15T23:56:56.015998+0000","last_clean":"2024-09-15T23:56:56.015998+0000","last_became_active":"2024-09-15T23:56:54.970598+0000","last_became_peered":"2024-09-15T23:56:54.970598+0000","last_unstale":"2024-09-15T23:56:56.015998+0000","last_undegraded":"2024-09-15T23:56:56.015998+0000","last_fullsized":"2024-09-15T23:56:56.015998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:20.015026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752339+0000","last_change":"2024-09-15T23:56:55.992555+0000","last_active":"2024-09-15T23:56:57.752339+0000","last_peered":"2024-09-15T23:56:57.752339+0000","last_clean":"2024-09-15T23:56:57.752339+0000","last_became_active":"2024-09-15T23:56:55.991796+0000","last_became_peered":"2024-09-15T23:56:55.991796+0000","last_unstale":"2024-09-15T23:56:57.752339+0000","last_undegraded":"2024-09-15T23:56:57.752339+0000","last_fullsized":"2024-09-15T23:56:57.752339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:50.644181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752870+0000","last_change":"2024-09-15T23:56:54.969021+0000","last_active":"2024-09-15T23:56:57.752870+0000","last_peered":"2024-09-15T23:56:57.752870+0000","last_clean":"2024-09-15T23:56:57.752870+0000","last_became_active":"2024-09-15T23:56:54.968753+0000","last_became_peered":"2024-09-15T23:56:54.968753+0000","last_unstale":"2024-09-15T23:56:57.752870+0000","last_undegraded":"2024-09-15T23:56:57.752870+0000","last_fullsized":"2024-09-15T23:56:57.752870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:03.369612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992867+0000","last_change":"2024-09-15T23:56:55.989348+0000","last_active":"2024-09-15T23:56:56.992867+0000","last_peered":"2024-09-15T23:56:56.992867+0000","last_clean":"2024-09-15T23:56:56.992867+0000","last_became_active":"2024-09-15T23:56:55.975943+0000","last_became_peered":"2024-09-15T23:56:55.975943+0000","last_unstale":"2024-09-15T23:56:56.992867+0000","last_undegraded":"2024-09-15T23:56:56.992867+0000","last_fullsized":"2024-09-15T23:56:56.992867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:54.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753094+0000","last_change":"2024-09-15T23:56:54.975418+0000","last_active":"2024-09-15T23:56:57.753094+0000","last_peered":"2024-09-15T23:56:57.753094+0000","last_clean":"2024-09-15T23:56:57.753094+0000","last_became_active":"2024-09-15T23:56:54.975099+0000","last_became_peered":"2024-09-15T23:56:54.975099+0000","last_unstale":"2024-09-15T23:56:57.753094+0000","last_undegraded":"2024-09-15T23:56:57.753094+0000","last_fullsized":"2024-09-15T23:56:57.753094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:05.220925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990677+0000","last_change":"2024-09-15T23:56:56.001334+0000","last_active":"2024-09-15T23:56:56.990677+0000","last_peered":"2024-09-15T23:56:56.990677+0000","last_clean":"2024-09-15T23:56:56.990677+0000","last_became_active":"2024-09-15T23:56:56.000374+0000","last_became_peered":"2024-09-15T23:56:56.000374+0000","last_unstale":"2024-09-15T23:56:56.990677+0000","last_undegraded":"2024-09-15T23:56:56.990677+0000","last_fullsized":"2024-09-15T23:56:56.990677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:25.361845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753604+0000","last_change":"2024-09-15T23:56:54.979283+0000","last_active":"2024-09-15T23:56:57.753604+0000","last_peered":"2024-09-15T23:56:57.753604+0000","last_clean":"2024-09-15T23:56:57.753604+0000","last_became_active":"2024-09-15T23:56:54.977838+0000","last_became_peered":"2024-09-15T23:56:54.977838+0000","last_unstale":"2024-09-15T23:56:57.753604+0000","last_undegraded":"2024-09-15T23:56:57.753604+0000","last_fullsized":"2024-09-15T23:56:57.753604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:21.518878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753441+0000","last_change":"2024-09-15T23:56:55.995988+0000","last_active":"2024-09-15T23:56:57.753441+0000","last_peered":"2024-09-15T23:56:57.753441+0000","last_clean":"2024-09-15T23:56:57.753441+0000","last_became_active":"2024-09-15T23:56:55.995137+0000","last_became_peered":"2024-09-15T23:56:55.995137+0000","last_unstale":"2024-09-15T23:56:57.753441+0000","last_undegraded":"2024-09-15T23:56:57.753441+0000","last_fullsized":"2024-09-15T23:56:57.753441+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:46.961167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753667+0000","last_change":"2024-09-15T23:56:54.984311+0000","last_active":"2024-09-15T23:56:57.753667+0000","last_peered":"2024-09-15T23:56:57.753667+0000","last_clean":"2024-09-15T23:56:57.753667+0000","last_became_active":"2024-09-15T23:56:54.983912+0000","last_became_peered":"2024-09-15T23:56:54.983912+0000","last_unstale":"2024-09-15T23:56:57.753667+0000","last_undegraded":"2024-09-15T23:56:57.753667+0000","last_fullsized":"2024-09-15T23:56:57.753667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:12.265924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753712+0000","last_change":"2024-09-15T23:56:56.007768+0000","last_active":"2024-09-15T23:56:57.753712+0000","last_peered":"2024-09-15T23:56:57.753712+0000","last_clean":"2024-09-15T23:56:57.753712+0000","last_became_active":"2024-09-15T23:56:56.001858+0000","last_became_peered":"2024-09-15T23:56:56.001858+0000","last_unstale":"2024-09-15T23:56:57.753712+0000","last_undegraded":"2024-09-15T23:56:57.753712+0000","last_fullsized":"2024-09-15T23:56:57.753712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:06.231114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993111+0000","last_change":"2024-09-15T23:56:54.983601+0000","last_active":"2024-09-15T23:56:56.993111+0000","last_peered":"2024-09-15T23:56:56.993111+0000","last_clean":"2024-09-15T23:56:56.993111+0000","last_became_active":"2024-09-15T23:56:54.982965+0000","last_became_peered":"2024-09-15T23:56:54.982965+0000","last_unstale":"2024-09-15T23:56:56.993111+0000","last_undegraded":"2024-09-15T23:56:56.993111+0000","last_fullsized":"2024-09-15T23:56:56.993111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.232324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754317+0000","last_change":"2024-09-15T23:56:55.995723+0000","last_active":"2024-09-15T23:56:57.754317+0000","last_peered":"2024-09-15T23:56:57.754317+0000","last_clean":"2024-09-15T23:56:57.754317+0000","last_became_active":"2024-09-15T23:56:55.994899+0000","last_became_peered":"2024-09-15T23:56:55.994899+0000","last_unstale":"2024-09-15T23:56:57.754317+0000","last_undegraded":"2024-09-15T23:56:57.754317+0000","last_fullsized":"2024-09-15T23:56:57.754317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:09.909885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990219+0000","last_change":"2024-09-15T23:56:54.980943+0000","last_active":"2024-09-15T23:56:56.990219+0000","last_peered":"2024-09-15T23:56:56.990219+0000","last_clean":"2024-09-15T23:56:56.990219+0000","last_became_active":"2024-09-15T23:56:54.979920+0000","last_became_peered":"2024-09-15T23:56:54.979920+0000","last_unstale":"2024-09-15T23:56:56.990219+0000","last_undegraded":"2024-09-15T23:56:56.990219+0000","last_fullsized":"2024-09-15T23:56:56.990219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:31.342987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992630+0000","last_change":"2024-09-15T23:56:54.986965+0000","last_active":"2024-09-15T23:56:56.992630+0000","last_peered":"2024-09-15T23:56:56.992630+0000","last_clean":"2024-09-15T23:56:56.992630+0000","last_became_active":"2024-09-15T23:56:54.986306+0000","last_became_peered":"2024-09-15T23:56:54.986306+0000","last_unstale":"2024-09-15T23:56:56.992630+0000","last_undegraded":"2024-09-15T23:56:56.992630+0000","last_fullsized":"2024-09-15T23:56:56.992630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:40.725441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751761+0000","last_change":"2024-09-15T23:56:55.973928+0000","last_active":"2024-09-15T23:56:57.751761+0000","last_peered":"2024-09-15T23:56:57.751761+0000","last_clean":"2024-09-15T23:56:57.751761+0000","last_became_active":"2024-09-15T23:56:55.973107+0000","last_became_peered":"2024-09-15T23:56:55.973107+0000","last_unstale":"2024-09-15T23:56:57.751761+0000","last_undegraded":"2024-09-15T23:56:57.751761+0000","last_fullsized":"2024-09-15T23:56:57.751761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:30.375034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252606+0000","last_change":"2024-09-15T23:56:54.986074+0000","last_active":"2024-09-15T23:56:57.252606+0000","last_peered":"2024-09-15T23:56:57.252606+0000","last_clean":"2024-09-15T23:56:57.252606+0000","last_became_active":"2024-09-15T23:56:54.985826+0000","last_became_peered":"2024-09-15T23:56:54.985826+0000","last_unstale":"2024-09-15T23:56:57.252606+0000","last_undegraded":"2024-09-15T23:56:57.252606+0000","last_fullsized":"2024-09-15T23:56:57.252606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:06.066930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252009+0000","last_change":"2024-09-15T23:56:56.006520+0000","last_active":"2024-09-15T23:56:57.252009+0000","last_peered":"2024-09-15T23:56:57.252009+0000","last_clean":"2024-09-15T23:56:57.252009+0000","last_became_active":"2024-09-15T23:56:56.006086+0000","last_became_peered":"2024-09-15T23:56:56.006086+0000","last_unstale":"2024-09-15T23:56:57.252009+0000","last_undegraded":"2024-09-15T23:56:57.252009+0000","last_fullsized":"2024-09-15T23:56:57.252009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:04.416975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.979871+0000","last_change":"2024-09-15T23:56:54.987749+0000","last_active":"2024-09-15T23:56:56.979871+0000","last_peered":"2024-09-15T23:56:56.979871+0000","last_clean":"2024-09-15T23:56:56.979871+0000","last_became_active":"2024-09-15T23:56:54.987176+0000","last_became_peered":"2024-09-15T23:56:54.987176+0000","last_unstale":"2024-09-15T23:56:56.979871+0000","last_undegraded":"2024-09-15T23:56:56.979871+0000","last_fullsized":"2024-09-15T23:56:56.979871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:09.647148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252252+0000","last_change":"2024-09-15T23:56:54.960462+0000","last_active":"2024-09-15T23:56:57.252252+0000","last_peered":"2024-09-15T23:56:57.252252+0000","last_clean":"2024-09-15T23:56:57.252252+0000","last_became_active":"2024-09-15T23:56:54.960172+0000","last_became_peered":"2024-09-15T23:56:54.960172+0000","last_unstale":"2024-09-15T23:56:57.252252+0000","last_undegraded":"2024-09-15T23:56:57.252252+0000","last_fullsized":"2024-09-15T23:56:57.252252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:02.312104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991046+0000","last_change":"2024-09-15T23:56:55.969820+0000","last_active":"2024-09-15T23:56:56.991046+0000","last_peered":"2024-09-15T23:56:56.991046+0000","last_clean":"2024-09-15T23:56:56.991046+0000","last_became_active":"2024-09-15T23:56:55.967469+0000","last_became_peered":"2024-09-15T23:56:55.967469+0000","last_unstale":"2024-09-15T23:56:56.991046+0000","last_undegraded":"2024-09-15T23:56:56.991046+0000","last_fullsized":"2024-09-15T23:56:56.991046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:15.623608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752041+0000","last_change":"2024-09-15T23:56:54.962171+0000","last_active":"2024-09-15T23:56:57.752041+0000","last_peered":"2024-09-15T23:56:57.752041+0000","last_clean":"2024-09-15T23:56:57.752041+0000","last_became_active":"2024-09-15T23:56:54.961049+0000","last_became_peered":"2024-09-15T23:56:54.961049+0000","last_unstale":"2024-09-15T23:56:57.752041+0000","last_undegraded":"2024-09-15T23:56:57.752041+0000","last_fullsized":"2024-09-15T23:56:57.752041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:02.312104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940338+0000","last_change":"2024-09-15T23:56:53.940338+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940338+0000","last_undegraded":"2024-09-15T23:56:53.940338+0000","last_fullsized":"2024-09-15T23:56:53.940338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752209+0000","last_change":"2024-09-15T23:56:56.004365+0000","last_active":"2024-09-15T23:56:57.752209+0000","last_peered":"2024-09-15T23:56:57.752209+0000","last_clean":"2024-09-15T23:56:57.752209+0000","last_became_active":"2024-09-15T23:56:56.004079+0000","last_became_peered":"2024-09-15T23:56:56.004079+0000","last_unstale":"2024-09-15T23:56:57.752209+0000","last_undegraded":"2024-09-15T23:56:57.752209+0000","last_fullsized":"2024-09-15T23:56:57.752209+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:19.060961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:55.972124+0000","last_change":"2024-09-15T23:56:54.983702+0000","last_active":"2024-09-15T23:56:55.972124+0000","last_peered":"2024-09-15T23:56:55.972124+0000","last_clean":"2024-09-15T23:56:55.972124+0000","last_became_active":"2024-09-15T23:56:54.983127+0000","last_became_peered":"2024-09-15T23:56:54.983127+0000","last_unstale":"2024-09-15T23:56:55.972124+0000","last_undegraded":"2024-09-15T23:56:55.972124+0000","last_fullsized":"2024-09-15T23:56:55.972124+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:25.310145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993972+0000","last_change":"2024-09-15T23:56:55.987825+0000","last_active":"2024-09-15T23:56:56.993972+0000","last_peered":"2024-09-15T23:56:56.993972+0000","last_clean":"2024-09-15T23:56:56.993972+0000","last_became_active":"2024-09-15T23:56:55.976689+0000","last_became_peered":"2024-09-15T23:56:55.976689+0000","last_unstale":"2024-09-15T23:56:56.993972+0000","last_undegraded":"2024-09-15T23:56:56.993972+0000","last_fullsized":"2024-09-15T23:56:56.993972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:39.595978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751496+0000","last_change":"2024-09-15T23:56:54.957629+0000","last_active":"2024-09-15T23:56:57.751496+0000","last_peered":"2024-09-15T23:56:57.751496+0000","last_clean":"2024-09-15T23:56:57.751496+0000","last_became_active":"2024-09-15T23:56:54.957340+0000","last_became_peered":"2024-09-15T23:56:54.957340+0000","last_unstale":"2024-09-15T23:56:57.751496+0000","last_undegraded":"2024-09-15T23:56:57.751496+0000","last_fullsized":"2024-09-15T23:56:57.751496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:45.950977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754194+0000","last_change":"2024-09-15T23:56:55.994826+0000","last_active":"2024-09-15T23:56:57.754194+0000","last_peered":"2024-09-15T23:56:57.754194+0000","last_clean":"2024-09-15T23:56:57.754194+0000","last_became_active":"2024-09-15T23:56:55.994110+0000","last_became_peered":"2024-09-15T23:56:55.994110+0000","last_unstale":"2024-09-15T23:56:57.754194+0000","last_undegraded":"2024-09-15T23:56:57.754194+0000","last_fullsized":"2024-09-15T23:56:57.754194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:41.281743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992782+0000","last_change":"2024-09-15T23:56:54.984135+0000","last_active":"2024-09-15T23:56:56.992782+0000","last_peered":"2024-09-15T23:56:56.992782+0000","last_clean":"2024-09-15T23:56:56.992782+0000","last_became_active":"2024-09-15T23:56:54.983684+0000","last_became_peered":"2024-09-15T23:56:54.983684+0000","last_unstale":"2024-09-15T23:56:56.992782+0000","last_undegraded":"2024-09-15T23:56:56.992782+0000","last_fullsized":"2024-09-15T23:56:56.992782+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:37.846622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:55.971706+0000","last_change":"2024-09-15T23:56:54.974116+0000","last_active":"2024-09-15T23:56:55.971706+0000","last_peered":"2024-09-15T23:56:55.971706+0000","last_clean":"2024-09-15T23:56:55.971706+0000","last_became_active":"2024-09-15T23:56:54.973419+0000","last_became_peered":"2024-09-15T23:56:54.973419+0000","last_unstale":"2024-09-15T23:56:55.971706+0000","last_undegraded":"2024-09-15T23:56:55.971706+0000","last_fullsized":"2024-09-15T23:56:55.971706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:17.992076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251270+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:56:57.251270+0000","last_peered":"2024-09-15T23:56:57.251270+0000","last_clean":"2024-09-15T23:56:57.251270+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:56:57.251270+0000","last_undegraded":"2024-09-15T23:56:57.251270+0000","last_fullsized":"2024-09-15T23:56:57.251270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":917504,"data_stored":412618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":917504,"data_stored":412638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":913408,"data_stored":411988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":872448,"data_stored":391440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":872448,"data_stored":391440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1519616,"data_stored":1003980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":913408,"data_stored":411988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1495040,"data_stored":995732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:56:59.351 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:56:59.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b33c2640 1 Processor -- start 2024-09-15T23:56:59.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b33c2640 1 -- start start 2024-09-15T23:56:59.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b33c2640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f16ac070020 0x7f16ac15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b33c2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f16ac15f1d0 0x7f16ac0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b33c2640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16ac0aede0 con 0x7f16ac1520a0 2024-09-15T23:56:59.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b33c2640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f16ac152480 con 0x7f16ac070020 2024-09-15T23:56:59.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b33c2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f16ac15fa10 con 0x7f16ac15f1d0 2024-09-15T23:56:59.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b115e640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f16ac1520a0 0x7f16ac06f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55246/0 (socket says 172.21.15.112:55246) 2024-09-15T23:56:59.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b115e640 1 -- 172.21.15.112:0/3876764562 learned_addr learned my addr 172.21.15.112:0/3876764562 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:56:59.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b095d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f16ac070020 0x7f16ac15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b195f640 1 --2- 172.21.15.112:0/3876764562 >> v2:172.21.15.169:3300/0 conn(0x7f16ac15f1d0 0x7f16ac0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b095d640 1 -- 172.21.15.112:0/3876764562 >> v2:172.21.15.169:3300/0 conn(0x7f16ac15f1d0 msgr2=0x7f16ac0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:59.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b095d640 1 --2- 172.21.15.112:0/3876764562 >> v2:172.21.15.169:3300/0 conn(0x7f16ac15f1d0 0x7f16ac0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b095d640 1 -- 172.21.15.112:0/3876764562 >> v1:172.21.15.112:6789/0 conn(0x7f16ac1520a0 legacy=0x7f16ac06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f16b095d640 1 -- 172.21.15.112:0/3876764562 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ac074250 con 0x7f16ac070020 2024-09-15T23:56:59.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.514+0000 7f169ffff640 1 -- 172.21.15.112:0/3876764562 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317288421 0 0) 0x7f16ac0aede0 con 0x7f16ac1520a0 2024-09-15T23:56:59.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b095d640 1 --2- 172.21.15.112:0/3876764562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16ac070020 0x7f16ac15ec90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f16ac0d0250 tx=0x7f16a001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d31633ef611b5df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f169ffff640 1 -- 172.21.15.112:0/3876764562 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a00ab650 con 0x7f16ac070020 2024-09-15T23:56:59.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f169ffff640 1 -- 172.21.15.112:0/3876764562 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16a00b0070 con 0x7f16ac070020 2024-09-15T23:56:59.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f169ffff640 1 -- 172.21.15.112:0/3876764562 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a00aba10 con 0x7f16ac070020 2024-09-15T23:56:59.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 -- 172.21.15.112:0/3876764562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16ac070020 msgr2=0x7f16ac15ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 --2- 172.21.15.112:0/3876764562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16ac070020 0x7f16ac15ec90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f16ac0d0250 tx=0x7f16a001c450 comp rx=0 tx=0).stop 2024-09-15T23:56:59.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 -- 172.21.15.112:0/3876764562 shutdown_connections 2024-09-15T23:56:59.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 --2- 172.21.15.112:0/3876764562 >> v2:172.21.15.169:3300/0 conn(0x7f16ac15f1d0 0x7f16ac0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 --2- 172.21.15.112:0/3876764562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16ac070020 0x7f16ac15ec90 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 -- 172.21.15.112:0/3876764562 >> 172.21.15.112:0/3876764562 conn(0x7f16ac0b1f90 msgr2=0x7f16ac0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:59.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 -- 172.21.15.112:0/3876764562 shutdown_connections 2024-09-15T23:56:59.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 -- 172.21.15.112:0/3876764562 wait complete. 2024-09-15T23:56:59.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 Processor -- start 2024-09-15T23:56:59.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 -- start start 2024-09-15T23:56:59.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16ac070020 0x7f16ac14ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16ac1520a0 0x7f16ac13d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16ac15f1d0 0x7f16ac0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac15f5e0 con 0x7f16ac070020 2024-09-15T23:56:59.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac073d30 con 0x7f16ac1520a0 2024-09-15T23:56:59.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f16ac15f760 con 0x7f16ac15f1d0 2024-09-15T23:56:59.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b115e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16ac070020 0x7f16ac14ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b115e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16ac070020 0x7f16ac14ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43408/0 (socket says 172.21.15.112:43408) 2024-09-15T23:56:59.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b115e640 1 -- 172.21.15.112:0/930045596 learned_addr learned my addr 172.21.15.112:0/930045596 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:59.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b195f640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16ac15f1d0 0x7f16ac0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b095d640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16ac1520a0 0x7f16ac13d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b115e640 1 -- 172.21.15.112:0/930045596 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16ac15f1d0 msgr2=0x7f16ac0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b115e640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16ac15f1d0 0x7f16ac0cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b115e640 1 -- 172.21.15.112:0/930045596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16ac1520a0 msgr2=0x7f16ac13d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b115e640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16ac1520a0 0x7f16ac13d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b115e640 1 -- 172.21.15.112:0/930045596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ac0ce8b0 con 0x7f16ac070020 2024-09-15T23:56:59.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b195f640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16ac15f1d0 0x7f16ac0cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:56:59.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b115e640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16ac070020 0x7f16ac14ca30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f16a800c520 tx=0x7f16a800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f169dffb640 1 -- 172.21.15.112:0/930045596 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a8018070 con 0x7f16ac070020 2024-09-15T23:56:59.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f169dffb640 1 -- 172.21.15.112:0/930045596 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16a80074e0 con 0x7f16ac070020 2024-09-15T23:56:59.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 -- 172.21.15.112:0/930045596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16ac0cd1b0 con 0x7f16ac070020 2024-09-15T23:56:59.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f169dffb640 1 -- 172.21.15.112:0/930045596 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a80049f0 con 0x7f16ac070020 2024-09-15T23:56:59.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.518+0000 7f16b33c2640 1 -- 172.21.15.112:0/930045596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16ac0cee30 con 0x7f16ac070020 2024-09-15T23:56:59.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.522+0000 7f16b33c2640 1 -- 172.21.15.112:0/930045596 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16ac15ec90 con 0x7f16ac070020 2024-09-15T23:56:59.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.522+0000 7f169dffb640 1 -- 172.21.15.112:0/930045596 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16a801b070 con 0x7f16ac070020 2024-09-15T23:56:59.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.522+0000 7f169dffb640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f16900678c0 0x7f1690069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.522+0000 7f169dffb640 1 -- 172.21.15.112:0/930045596 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f16a8085280 con 0x7f16ac070020 2024-09-15T23:56:59.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.522+0000 7f16b095d640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f16900678c0 0x7f1690069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.522+0000 7f16b095d640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f16900678c0 0x7f1690069d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f16a00af000 tx=0x7f16a00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.526+0000 7f169dffb640 1 -- 172.21.15.112:0/930045596 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f16a8055c20 con 0x7f16ac070020 2024-09-15T23:56:59.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.686+0000 7f16b33c2640 1 -- 172.21.15.112:0/930045596 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16ac06e540 con 0x7f16900678c0 2024-09-15T23:56:59.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.690+0000 7f169dffb640 1 -- 172.21.15.112:0/930045596 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249762 (secure 0 0 0) 0x7f16ac06e540 con 0x7f16900678c0 2024-09-15T23:56:59.693 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:56:59.696 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:56:59.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.694+0000 7f16b33c2640 1 -- 172.21.15.112:0/930045596 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f16900678c0 msgr2=0x7f1690069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.694+0000 7f16b33c2640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f16900678c0 0x7f1690069d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f16a00af000 tx=0x7f16a00a7000 comp rx=0 tx=0).stop 2024-09-15T23:56:59.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.694+0000 7f16b33c2640 1 -- 172.21.15.112:0/930045596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16ac070020 msgr2=0x7f16ac14ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.694+0000 7f16b33c2640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16ac070020 0x7f16ac14ca30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f16a800c520 tx=0x7f16a800c9e0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.694+0000 7f16b33c2640 1 -- 172.21.15.112:0/930045596 shutdown_connections 2024-09-15T23:56:59.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.694+0000 7f16b33c2640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f16900678c0 0x7f1690069d80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.694+0000 7f16b33c2640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f16ac15f1d0 0x7f16ac0cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.694+0000 7f16b33c2640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16ac1520a0 0x7f16ac13d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.694+0000 7f16b33c2640 1 --2- 172.21.15.112:0/930045596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16ac070020 0x7f16ac14ca30 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.694+0000 7f16b33c2640 1 -- 172.21.15.112:0/930045596 >> 172.21.15.112:0/930045596 conn(0x7f16ac0b1f90 msgr2=0x7f16ac1516b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:59.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.694+0000 7f16b33c2640 1 -- 172.21.15.112:0/930045596 shutdown_connections 2024-09-15T23:56:59.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.694+0000 7f16b33c2640 1 -- 172.21.15.112:0/930045596 wait complete. 2024-09-15T23:56:59.713 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2024-09-15T23:56:59.291468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257748,"kb_used_data":8224,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716972,"statfs":{"total":773094113280,"available":772830179328,"internally_reserved":0,"allocated":8421376,"data_stored":4431824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.358953"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252528+0000","last_change":"2024-09-15T23:56:55.979224+0000","last_active":"2024-09-15T23:56:57.252528+0000","last_peered":"2024-09-15T23:56:57.252528+0000","last_clean":"2024-09-15T23:56:57.252528+0000","last_became_active":"2024-09-15T23:56:55.978887+0000","last_became_peered":"2024-09-15T23:56:55.978887+0000","last_unstale":"2024-09-15T23:56:57.252528+0000","last_undegraded":"2024-09-15T23:56:57.252528+0000","last_fullsized":"2024-09-15T23:56:57.252528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:32.013874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993595+0000","last_change":"2024-09-15T23:56:55.999113+0000","last_active":"2024-09-15T23:56:56.993595+0000","last_peered":"2024-09-15T23:56:56.993595+0000","last_clean":"2024-09-15T23:56:56.993595+0000","last_became_active":"2024-09-15T23:56:55.997840+0000","last_became_peered":"2024-09-15T23:56:55.997840+0000","last_unstale":"2024-09-15T23:56:56.993595+0000","last_undegraded":"2024-09-15T23:56:56.993595+0000","last_fullsized":"2024-09-15T23:56:56.993595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:31.205893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993705+0000","last_change":"2024-09-15T23:56:55.989925+0000","last_active":"2024-09-15T23:56:56.993705+0000","last_peered":"2024-09-15T23:56:56.993705+0000","last_clean":"2024-09-15T23:56:56.993705+0000","last_became_active":"2024-09-15T23:56:55.986690+0000","last_became_peered":"2024-09-15T23:56:55.986690+0000","last_unstale":"2024-09-15T23:56:56.993705+0000","last_undegraded":"2024-09-15T23:56:56.993705+0000","last_fullsized":"2024-09-15T23:56:56.993705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:14.922569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751951+0000","last_change":"2024-09-15T23:56:55.984311+0000","last_active":"2024-09-15T23:56:57.751951+0000","last_peered":"2024-09-15T23:56:57.751951+0000","last_clean":"2024-09-15T23:56:57.751951+0000","last_became_active":"2024-09-15T23:56:55.984038+0000","last_became_peered":"2024-09-15T23:56:55.984038+0000","last_unstale":"2024-09-15T23:56:57.751951+0000","last_undegraded":"2024-09-15T23:56:57.751951+0000","last_fullsized":"2024-09-15T23:56:57.751951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:14.917805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753296+0000","last_change":"2024-09-15T23:56:55.973914+0000","last_active":"2024-09-15T23:56:57.753296+0000","last_peered":"2024-09-15T23:56:57.753296+0000","last_clean":"2024-09-15T23:56:57.753296+0000","last_became_active":"2024-09-15T23:56:55.973108+0000","last_became_peered":"2024-09-15T23:56:55.973108+0000","last_unstale":"2024-09-15T23:56:57.753296+0000","last_undegraded":"2024-09-15T23:56:57.753296+0000","last_fullsized":"2024-09-15T23:56:57.753296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.322294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012161+0000","last_change":"2024-09-15T23:56:55.993222+0000","last_active":"2024-09-15T23:56:56.012161+0000","last_peered":"2024-09-15T23:56:56.012161+0000","last_clean":"2024-09-15T23:56:56.012161+0000","last_became_active":"2024-09-15T23:56:55.992379+0000","last_became_peered":"2024-09-15T23:56:55.992379+0000","last_unstale":"2024-09-15T23:56:56.012161+0000","last_undegraded":"2024-09-15T23:56:56.012161+0000","last_fullsized":"2024-09-15T23:56:56.012161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:29:42.435805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751410+0000","last_change":"2024-09-15T23:56:55.969504+0000","last_active":"2024-09-15T23:56:57.751410+0000","last_peered":"2024-09-15T23:56:57.751410+0000","last_clean":"2024-09-15T23:56:57.751410+0000","last_became_active":"2024-09-15T23:56:55.968813+0000","last_became_peered":"2024-09-15T23:56:55.968813+0000","last_unstale":"2024-09-15T23:56:57.751410+0000","last_undegraded":"2024-09-15T23:56:57.751410+0000","last_fullsized":"2024-09-15T23:56:57.751410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:37.530094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990258+0000","last_change":"2024-09-15T23:56:55.974436+0000","last_active":"2024-09-15T23:56:56.990258+0000","last_peered":"2024-09-15T23:56:56.990258+0000","last_clean":"2024-09-15T23:56:56.990258+0000","last_became_active":"2024-09-15T23:56:55.973689+0000","last_became_peered":"2024-09-15T23:56:55.973689+0000","last_unstale":"2024-09-15T23:56:56.990258+0000","last_undegraded":"2024-09-15T23:56:56.990258+0000","last_fullsized":"2024-09-15T23:56:56.990258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:28.820185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752677+0000","last_change":"2024-09-15T23:56:55.995299+0000","last_active":"2024-09-15T23:56:57.752677+0000","last_peered":"2024-09-15T23:56:57.752677+0000","last_clean":"2024-09-15T23:56:57.752677+0000","last_became_active":"2024-09-15T23:56:55.994979+0000","last_became_peered":"2024-09-15T23:56:55.994979+0000","last_unstale":"2024-09-15T23:56:57.752677+0000","last_undegraded":"2024-09-15T23:56:57.752677+0000","last_fullsized":"2024-09-15T23:56:57.752677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:54.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252297+0000","last_change":"2024-09-15T23:56:55.996657+0000","last_active":"2024-09-15T23:56:57.252297+0000","last_peered":"2024-09-15T23:56:57.252297+0000","last_clean":"2024-09-15T23:56:57.252297+0000","last_became_active":"2024-09-15T23:56:55.996374+0000","last_became_peered":"2024-09-15T23:56:55.996374+0000","last_unstale":"2024-09-15T23:56:57.252297+0000","last_undegraded":"2024-09-15T23:56:57.252297+0000","last_fullsized":"2024-09-15T23:56:57.252297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:28.942569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.994065+0000","last_change":"2024-09-15T23:56:56.002531+0000","last_active":"2024-09-15T23:56:56.994065+0000","last_peered":"2024-09-15T23:56:56.994065+0000","last_clean":"2024-09-15T23:56:56.994065+0000","last_became_active":"2024-09-15T23:56:55.989953+0000","last_became_peered":"2024-09-15T23:56:55.989953+0000","last_unstale":"2024-09-15T23:56:56.994065+0000","last_undegraded":"2024-09-15T23:56:56.994065+0000","last_fullsized":"2024-09-15T23:56:56.994065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:42.470630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993324+0000","last_change":"2024-09-15T23:56:56.004482+0000","last_active":"2024-09-15T23:56:56.993324+0000","last_peered":"2024-09-15T23:56:56.993324+0000","last_clean":"2024-09-15T23:56:56.993324+0000","last_became_active":"2024-09-15T23:56:56.003824+0000","last_became_peered":"2024-09-15T23:56:56.003824+0000","last_unstale":"2024-09-15T23:56:56.993324+0000","last_undegraded":"2024-09-15T23:56:56.993324+0000","last_fullsized":"2024-09-15T23:56:56.993324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:32.353177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990654+0000","last_change":"2024-09-15T23:56:55.984462+0000","last_active":"2024-09-15T23:56:56.990654+0000","last_peered":"2024-09-15T23:56:56.990654+0000","last_clean":"2024-09-15T23:56:56.990654+0000","last_became_active":"2024-09-15T23:56:55.983722+0000","last_became_peered":"2024-09-15T23:56:55.983722+0000","last_unstale":"2024-09-15T23:56:56.990654+0000","last_undegraded":"2024-09-15T23:56:56.990654+0000","last_fullsized":"2024-09-15T23:56:56.990654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:39.347880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752123+0000","last_change":"2024-09-15T23:56:56.007000+0000","last_active":"2024-09-15T23:56:57.752123+0000","last_peered":"2024-09-15T23:56:57.752123+0000","last_clean":"2024-09-15T23:56:57.752123+0000","last_became_active":"2024-09-15T23:56:56.006350+0000","last_became_peered":"2024-09-15T23:56:56.006350+0000","last_unstale":"2024-09-15T23:56:57.752123+0000","last_undegraded":"2024-09-15T23:56:57.752123+0000","last_fullsized":"2024-09-15T23:56:57.752123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:59.909567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751377+0000","last_change":"2024-09-15T23:56:55.974231+0000","last_active":"2024-09-15T23:56:57.751377+0000","last_peered":"2024-09-15T23:56:57.751377+0000","last_clean":"2024-09-15T23:56:57.751377+0000","last_became_active":"2024-09-15T23:56:55.973543+0000","last_became_peered":"2024-09-15T23:56:55.973543+0000","last_unstale":"2024-09-15T23:56:57.751377+0000","last_undegraded":"2024-09-15T23:56:57.751377+0000","last_fullsized":"2024-09-15T23:56:57.751377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:58.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991496+0000","last_change":"2024-09-15T23:56:55.958076+0000","last_active":"2024-09-15T23:56:56.991496+0000","last_peered":"2024-09-15T23:56:56.991496+0000","last_clean":"2024-09-15T23:56:56.991496+0000","last_became_active":"2024-09-15T23:56:55.957404+0000","last_became_peered":"2024-09-15T23:56:55.957404+0000","last_unstale":"2024-09-15T23:56:56.991496+0000","last_undegraded":"2024-09-15T23:56:56.991496+0000","last_fullsized":"2024-09-15T23:56:56.991496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:23.266535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993642+0000","last_change":"2024-09-15T23:56:55.998591+0000","last_active":"2024-09-15T23:56:56.993642+0000","last_peered":"2024-09-15T23:56:56.993642+0000","last_clean":"2024-09-15T23:56:56.993642+0000","last_became_active":"2024-09-15T23:56:55.997788+0000","last_became_peered":"2024-09-15T23:56:55.997788+0000","last_unstale":"2024-09-15T23:56:56.993642+0000","last_undegraded":"2024-09-15T23:56:56.993642+0000","last_fullsized":"2024-09-15T23:56:56.993642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:50.441671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991220+0000","last_change":"2024-09-15T23:56:55.997317+0000","last_active":"2024-09-15T23:56:56.991220+0000","last_peered":"2024-09-15T23:56:56.991220+0000","last_clean":"2024-09-15T23:56:56.991220+0000","last_became_active":"2024-09-15T23:56:55.996587+0000","last_became_peered":"2024-09-15T23:56:55.996587+0000","last_unstale":"2024-09-15T23:56:56.991220+0000","last_undegraded":"2024-09-15T23:56:56.991220+0000","last_fullsized":"2024-09-15T23:56:56.991220+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:33.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012508+0000","last_change":"2024-09-15T23:56:55.994322+0000","last_active":"2024-09-15T23:56:56.012508+0000","last_peered":"2024-09-15T23:56:56.012508+0000","last_clean":"2024-09-15T23:56:56.012508+0000","last_became_active":"2024-09-15T23:56:55.993525+0000","last_became_peered":"2024-09-15T23:56:55.993525+0000","last_unstale":"2024-09-15T23:56:56.012508+0000","last_undegraded":"2024-09-15T23:56:56.012508+0000","last_fullsized":"2024-09-15T23:56:56.012508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:44.991594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992685+0000","last_change":"2024-09-15T23:56:56.011861+0000","last_active":"2024-09-15T23:56:56.992685+0000","last_peered":"2024-09-15T23:56:56.992685+0000","last_clean":"2024-09-15T23:56:56.992685+0000","last_became_active":"2024-09-15T23:56:56.011149+0000","last_became_peered":"2024-09-15T23:56:56.011149+0000","last_unstale":"2024-09-15T23:56:56.992685+0000","last_undegraded":"2024-09-15T23:56:56.992685+0000","last_fullsized":"2024-09-15T23:56:56.992685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:19.060961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252117+0000","last_change":"2024-09-15T23:56:55.984314+0000","last_active":"2024-09-15T23:56:57.252117+0000","last_peered":"2024-09-15T23:56:57.252117+0000","last_clean":"2024-09-15T23:56:57.252117+0000","last_became_active":"2024-09-15T23:56:55.983952+0000","last_became_peered":"2024-09-15T23:56:55.983952+0000","last_unstale":"2024-09-15T23:56:57.252117+0000","last_undegraded":"2024-09-15T23:56:57.252117+0000","last_fullsized":"2024-09-15T23:56:57.252117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:45:10.598663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992395+0000","last_change":"2024-09-15T23:56:56.004418+0000","last_active":"2024-09-15T23:56:56.992395+0000","last_peered":"2024-09-15T23:56:56.992395+0000","last_clean":"2024-09-15T23:56:56.992395+0000","last_became_active":"2024-09-15T23:56:56.003744+0000","last_became_peered":"2024-09-15T23:56:56.003744+0000","last_unstale":"2024-09-15T23:56:56.992395+0000","last_undegraded":"2024-09-15T23:56:56.992395+0000","last_fullsized":"2024-09-15T23:56:56.992395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:14.917805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.013320+0000","last_change":"2024-09-15T23:56:56.000438+0000","last_active":"2024-09-15T23:56:56.013320+0000","last_peered":"2024-09-15T23:56:56.013320+0000","last_clean":"2024-09-15T23:56:56.013320+0000","last_became_active":"2024-09-15T23:56:55.999839+0000","last_became_peered":"2024-09-15T23:56:55.999839+0000","last_unstale":"2024-09-15T23:56:56.013320+0000","last_undegraded":"2024-09-15T23:56:56.013320+0000","last_fullsized":"2024-09-15T23:56:56.013320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:41.952442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752800+0000","last_change":"2024-09-15T23:56:55.974824+0000","last_active":"2024-09-15T23:56:57.752800+0000","last_peered":"2024-09-15T23:56:57.752800+0000","last_clean":"2024-09-15T23:56:57.752800+0000","last_became_active":"2024-09-15T23:56:55.974296+0000","last_became_peered":"2024-09-15T23:56:55.974296+0000","last_unstale":"2024-09-15T23:56:57.752800+0000","last_undegraded":"2024-09-15T23:56:57.752800+0000","last_fullsized":"2024-09-15T23:56:57.752800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:32.353177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752021+0000","last_change":"2024-09-15T23:56:55.972869+0000","last_active":"2024-09-15T23:56:57.752021+0000","last_peered":"2024-09-15T23:56:57.752021+0000","last_clean":"2024-09-15T23:56:57.752021+0000","last_became_active":"2024-09-15T23:56:55.972567+0000","last_became_peered":"2024-09-15T23:56:55.972567+0000","last_unstale":"2024-09-15T23:56:57.752021+0000","last_undegraded":"2024-09-15T23:56:57.752021+0000","last_fullsized":"2024-09-15T23:56:57.752021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:20.287580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753525+0000","last_change":"2024-09-15T23:56:55.995902+0000","last_active":"2024-09-15T23:56:57.753525+0000","last_peered":"2024-09-15T23:56:57.753525+0000","last_clean":"2024-09-15T23:56:57.753525+0000","last_became_active":"2024-09-15T23:56:55.994271+0000","last_became_peered":"2024-09-15T23:56:55.994271+0000","last_unstale":"2024-09-15T23:56:57.753525+0000","last_undegraded":"2024-09-15T23:56:57.753525+0000","last_fullsized":"2024-09-15T23:56:57.753525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:04.379802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012213+0000","last_change":"2024-09-15T23:56:55.993324+0000","last_active":"2024-09-15T23:56:56.012213+0000","last_peered":"2024-09-15T23:56:56.012213+0000","last_clean":"2024-09-15T23:56:56.012213+0000","last_became_active":"2024-09-15T23:56:55.992543+0000","last_became_peered":"2024-09-15T23:56:55.992543+0000","last_unstale":"2024-09-15T23:56:56.012213+0000","last_undegraded":"2024-09-15T23:56:56.012213+0000","last_fullsized":"2024-09-15T23:56:56.012213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:10.974266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251818+0000","last_change":"2024-09-15T23:56:56.011651+0000","last_active":"2024-09-15T23:56:57.251818+0000","last_peered":"2024-09-15T23:56:57.251818+0000","last_clean":"2024-09-15T23:56:57.251818+0000","last_became_active":"2024-09-15T23:56:56.011342+0000","last_became_peered":"2024-09-15T23:56:56.011342+0000","last_unstale":"2024-09-15T23:56:57.251818+0000","last_undegraded":"2024-09-15T23:56:57.251818+0000","last_fullsized":"2024-09-15T23:56:57.251818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:02.575095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992637+0000","last_change":"2024-09-15T23:56:55.999632+0000","last_active":"2024-09-15T23:56:56.992637+0000","last_peered":"2024-09-15T23:56:56.992637+0000","last_clean":"2024-09-15T23:56:56.992637+0000","last_became_active":"2024-09-15T23:56:55.999003+0000","last_became_peered":"2024-09-15T23:56:55.999003+0000","last_unstale":"2024-09-15T23:56:56.992637+0000","last_undegraded":"2024-09-15T23:56:56.992637+0000","last_fullsized":"2024-09-15T23:56:56.992637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:27.375798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751513+0000","last_change":"2024-09-15T23:56:56.000881+0000","last_active":"2024-09-15T23:56:57.751513+0000","last_peered":"2024-09-15T23:56:57.751513+0000","last_clean":"2024-09-15T23:56:57.751513+0000","last_became_active":"2024-09-15T23:56:56.000550+0000","last_became_peered":"2024-09-15T23:56:56.000550+0000","last_unstale":"2024-09-15T23:56:57.751513+0000","last_undegraded":"2024-09-15T23:56:57.751513+0000","last_fullsized":"2024-09-15T23:56:57.751513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:16.086562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752125+0000","last_change":"2024-09-15T23:56:55.970381+0000","last_active":"2024-09-15T23:56:57.752125+0000","last_peered":"2024-09-15T23:56:57.752125+0000","last_clean":"2024-09-15T23:56:57.752125+0000","last_became_active":"2024-09-15T23:56:55.969605+0000","last_became_peered":"2024-09-15T23:56:55.969605+0000","last_unstale":"2024-09-15T23:56:57.752125+0000","last_undegraded":"2024-09-15T23:56:57.752125+0000","last_fullsized":"2024-09-15T23:56:57.752125+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:07.077120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754074+0000","last_change":"2024-09-15T23:56:54.986431+0000","last_active":"2024-09-15T23:56:57.754074+0000","last_peered":"2024-09-15T23:56:57.754074+0000","last_clean":"2024-09-15T23:56:57.754074+0000","last_became_active":"2024-09-15T23:56:54.986031+0000","last_became_peered":"2024-09-15T23:56:54.986031+0000","last_unstale":"2024-09-15T23:56:57.754074+0000","last_undegraded":"2024-09-15T23:56:57.754074+0000","last_fullsized":"2024-09-15T23:56:57.754074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:45.418494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752493+0000","last_change":"2024-09-15T23:56:55.980727+0000","last_active":"2024-09-15T23:56:57.752493+0000","last_peered":"2024-09-15T23:56:57.752493+0000","last_clean":"2024-09-15T23:56:57.752493+0000","last_became_active":"2024-09-15T23:56:55.973498+0000","last_became_peered":"2024-09-15T23:56:55.973498+0000","last_unstale":"2024-09-15T23:56:57.752493+0000","last_undegraded":"2024-09-15T23:56:57.752493+0000","last_fullsized":"2024-09-15T23:56:57.752493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:37.501600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.942231+0000","last_change":"2024-09-15T23:56:53.942231+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.942231+0000","last_undegraded":"2024-09-15T23:56:53.942231+0000","last_fullsized":"2024-09-15T23:56:53.942231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251960+0000","last_change":"2024-09-15T23:56:54.968341+0000","last_active":"2024-09-15T23:56:57.251960+0000","last_peered":"2024-09-15T23:56:57.251960+0000","last_clean":"2024-09-15T23:56:57.251960+0000","last_became_active":"2024-09-15T23:56:54.968071+0000","last_became_peered":"2024-09-15T23:56:54.968071+0000","last_unstale":"2024-09-15T23:56:57.251960+0000","last_undegraded":"2024-09-15T23:56:57.251960+0000","last_fullsized":"2024-09-15T23:56:57.251960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:49.633991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751297+0000","last_change":"2024-09-15T23:56:55.984390+0000","last_active":"2024-09-15T23:56:57.751297+0000","last_peered":"2024-09-15T23:56:57.751297+0000","last_clean":"2024-09-15T23:56:57.751297+0000","last_became_active":"2024-09-15T23:56:55.984141+0000","last_became_peered":"2024-09-15T23:56:55.984141+0000","last_unstale":"2024-09-15T23:56:57.751297+0000","last_undegraded":"2024-09-15T23:56:57.751297+0000","last_fullsized":"2024-09-15T23:56:57.751297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:48.336601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940540+0000","last_change":"2024-09-15T23:56:53.940540+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940540+0000","last_undegraded":"2024-09-15T23:56:53.940540+0000","last_fullsized":"2024-09-15T23:56:53.940540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012541+0000","last_change":"2024-09-15T23:56:55.997214+0000","last_active":"2024-09-15T23:56:56.012541+0000","last_peered":"2024-09-15T23:56:56.012541+0000","last_clean":"2024-09-15T23:56:56.012541+0000","last_became_active":"2024-09-15T23:56:55.992307+0000","last_became_peered":"2024-09-15T23:56:55.992307+0000","last_unstale":"2024-09-15T23:56:56.012541+0000","last_undegraded":"2024-09-15T23:56:56.012541+0000","last_fullsized":"2024-09-15T23:56:56.012541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:47.802236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.939966+0000","last_change":"2024-09-15T23:56:53.939966+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.939966+0000","last_undegraded":"2024-09-15T23:56:53.939966+0000","last_fullsized":"2024-09-15T23:56:53.939966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.994384+0000","last_change":"2024-09-15T23:56:56.004365+0000","last_active":"2024-09-15T23:56:56.994384+0000","last_peered":"2024-09-15T23:56:56.994384+0000","last_clean":"2024-09-15T23:56:56.994384+0000","last_became_active":"2024-09-15T23:56:56.003697+0000","last_became_peered":"2024-09-15T23:56:56.003697+0000","last_unstale":"2024-09-15T23:56:56.994384+0000","last_undegraded":"2024-09-15T23:56:56.994384+0000","last_fullsized":"2024-09-15T23:56:56.994384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:24.370163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940540+0000","last_change":"2024-09-15T23:56:53.940540+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940540+0000","last_undegraded":"2024-09-15T23:56:53.940540+0000","last_fullsized":"2024-09-15T23:56:53.940540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990195+0000","last_change":"2024-09-15T23:56:54.965160+0000","last_active":"2024-09-15T23:56:56.990195+0000","last_peered":"2024-09-15T23:56:56.990195+0000","last_clean":"2024-09-15T23:56:56.990195+0000","last_became_active":"2024-09-15T23:56:54.964317+0000","last_became_peered":"2024-09-15T23:56:54.964317+0000","last_unstale":"2024-09-15T23:56:56.990195+0000","last_undegraded":"2024-09-15T23:56:56.990195+0000","last_fullsized":"2024-09-15T23:56:56.990195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:53.719508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992537+0000","last_change":"2024-09-15T23:56:54.984630+0000","last_active":"2024-09-15T23:56:56.992537+0000","last_peered":"2024-09-15T23:56:56.992537+0000","last_clean":"2024-09-15T23:56:56.992537+0000","last_became_active":"2024-09-15T23:56:54.983896+0000","last_became_peered":"2024-09-15T23:56:54.983896+0000","last_unstale":"2024-09-15T23:56:56.992537+0000","last_undegraded":"2024-09-15T23:56:56.992537+0000","last_fullsized":"2024-09-15T23:56:56.992537+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:28.388939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992459+0000","last_change":"2024-09-15T23:56:55.989801+0000","last_active":"2024-09-15T23:56:56.992459+0000","last_peered":"2024-09-15T23:56:56.992459+0000","last_clean":"2024-09-15T23:56:56.992459+0000","last_became_active":"2024-09-15T23:56:55.989074+0000","last_became_peered":"2024-09-15T23:56:55.989074+0000","last_unstale":"2024-09-15T23:56:56.992459+0000","last_undegraded":"2024-09-15T23:56:56.992459+0000","last_fullsized":"2024-09-15T23:56:56.992459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:20.287580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752742+0000","last_change":"2024-09-15T23:56:54.959168+0000","last_active":"2024-09-15T23:56:57.752742+0000","last_peered":"2024-09-15T23:56:57.752742+0000","last_clean":"2024-09-15T23:56:57.752742+0000","last_became_active":"2024-09-15T23:56:54.958765+0000","last_became_peered":"2024-09-15T23:56:54.958765+0000","last_unstale":"2024-09-15T23:56:57.752742+0000","last_undegraded":"2024-09-15T23:56:57.752742+0000","last_fullsized":"2024-09-15T23:56:57.752742+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:36.491410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252161+0000","last_change":"2024-09-15T23:56:54.958234+0000","last_active":"2024-09-15T23:56:57.252161+0000","last_peered":"2024-09-15T23:56:57.252161+0000","last_clean":"2024-09-15T23:56:57.252161+0000","last_became_active":"2024-09-15T23:56:54.957887+0000","last_became_peered":"2024-09-15T23:56:54.957887+0000","last_unstale":"2024-09-15T23:56:57.252161+0000","last_undegraded":"2024-09-15T23:56:57.252161+0000","last_fullsized":"2024-09-15T23:56:57.252161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:36.491410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991152+0000","last_change":"2024-09-15T23:56:55.959205+0000","last_active":"2024-09-15T23:56:56.991152+0000","last_peered":"2024-09-15T23:56:56.991152+0000","last_clean":"2024-09-15T23:56:56.991152+0000","last_became_active":"2024-09-15T23:56:55.958373+0000","last_became_peered":"2024-09-15T23:56:55.958373+0000","last_unstale":"2024-09-15T23:56:56.991152+0000","last_undegraded":"2024-09-15T23:56:56.991152+0000","last_fullsized":"2024-09-15T23:56:56.991152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:23.272483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.016000+0000","last_change":"2024-09-15T23:56:54.977562+0000","last_active":"2024-09-15T23:56:56.016000+0000","last_peered":"2024-09-15T23:56:56.016000+0000","last_clean":"2024-09-15T23:56:56.016000+0000","last_became_active":"2024-09-15T23:56:54.976751+0000","last_became_peered":"2024-09-15T23:56:54.976751+0000","last_unstale":"2024-09-15T23:56:56.016000+0000","last_undegraded":"2024-09-15T23:56:56.016000+0000","last_fullsized":"2024-09-15T23:56:56.016000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:35.674580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012244+0000","last_change":"2024-09-15T23:56:55.993382+0000","last_active":"2024-09-15T23:56:56.012244+0000","last_peered":"2024-09-15T23:56:56.012244+0000","last_clean":"2024-09-15T23:56:56.012244+0000","last_became_active":"2024-09-15T23:56:55.992592+0000","last_became_peered":"2024-09-15T23:56:55.992592+0000","last_unstale":"2024-09-15T23:56:56.012244+0000","last_undegraded":"2024-09-15T23:56:56.012244+0000","last_fullsized":"2024-09-15T23:56:56.012244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:32.291020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940983+0000","last_change":"2024-09-15T23:56:53.940983+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940983+0000","last_undegraded":"2024-09-15T23:56:53.940983+0000","last_fullsized":"2024-09-15T23:56:53.940983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752119+0000","last_change":"2024-09-15T23:56:55.995297+0000","last_active":"2024-09-15T23:56:57.752119+0000","last_peered":"2024-09-15T23:56:57.752119+0000","last_clean":"2024-09-15T23:56:57.752119+0000","last_became_active":"2024-09-15T23:56:55.994941+0000","last_became_peered":"2024-09-15T23:56:55.994941+0000","last_unstale":"2024-09-15T23:56:57.752119+0000","last_undegraded":"2024-09-15T23:56:57.752119+0000","last_fullsized":"2024-09-15T23:56:57.752119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:27.375798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252310+0000","last_change":"2024-09-15T23:56:54.967739+0000","last_active":"2024-09-15T23:56:57.252310+0000","last_peered":"2024-09-15T23:56:57.252310+0000","last_clean":"2024-09-15T23:56:57.252310+0000","last_became_active":"2024-09-15T23:56:54.967464+0000","last_became_peered":"2024-09-15T23:56:54.967464+0000","last_unstale":"2024-09-15T23:56:57.252310+0000","last_undegraded":"2024-09-15T23:56:57.252310+0000","last_fullsized":"2024-09-15T23:56:57.252310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:45.950977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252103+0000","last_change":"2024-09-15T23:56:56.006475+0000","last_active":"2024-09-15T23:56:57.252103+0000","last_peered":"2024-09-15T23:56:57.252103+0000","last_clean":"2024-09-15T23:56:57.252103+0000","last_became_active":"2024-09-15T23:56:56.006118+0000","last_became_peered":"2024-09-15T23:56:56.006118+0000","last_unstale":"2024-09-15T23:56:57.252103+0000","last_undegraded":"2024-09-15T23:56:57.252103+0000","last_fullsized":"2024-09-15T23:56:57.252103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:56.067306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.941555+0000","last_change":"2024-09-15T23:56:53.941555+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.941555+0000","last_undegraded":"2024-09-15T23:56:53.941555+0000","last_fullsized":"2024-09-15T23:56:53.941555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752761+0000","last_change":"2024-09-15T23:56:54.989708+0000","last_active":"2024-09-15T23:56:57.752761+0000","last_peered":"2024-09-15T23:56:57.752761+0000","last_clean":"2024-09-15T23:56:57.752761+0000","last_became_active":"2024-09-15T23:56:54.989300+0000","last_became_peered":"2024-09-15T23:56:54.989300+0000","last_unstale":"2024-09-15T23:56:57.752761+0000","last_undegraded":"2024-09-15T23:56:57.752761+0000","last_fullsized":"2024-09-15T23:56:57.752761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:47.414189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252603+0000","last_change":"2024-09-15T23:56:56.010338+0000","last_active":"2024-09-15T23:56:57.252603+0000","last_peered":"2024-09-15T23:56:57.252603+0000","last_clean":"2024-09-15T23:56:57.252603+0000","last_became_active":"2024-09-15T23:56:56.010068+0000","last_became_peered":"2024-09-15T23:56:56.010068+0000","last_unstale":"2024-09-15T23:56:57.252603+0000","last_undegraded":"2024-09-15T23:56:57.252603+0000","last_fullsized":"2024-09-15T23:56:57.252603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:47.563782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.015998+0000","last_change":"2024-09-15T23:56:54.971305+0000","last_active":"2024-09-15T23:56:56.015998+0000","last_peered":"2024-09-15T23:56:56.015998+0000","last_clean":"2024-09-15T23:56:56.015998+0000","last_became_active":"2024-09-15T23:56:54.970598+0000","last_became_peered":"2024-09-15T23:56:54.970598+0000","last_unstale":"2024-09-15T23:56:56.015998+0000","last_undegraded":"2024-09-15T23:56:56.015998+0000","last_fullsized":"2024-09-15T23:56:56.015998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:20.015026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752339+0000","last_change":"2024-09-15T23:56:55.992555+0000","last_active":"2024-09-15T23:56:57.752339+0000","last_peered":"2024-09-15T23:56:57.752339+0000","last_clean":"2024-09-15T23:56:57.752339+0000","last_became_active":"2024-09-15T23:56:55.991796+0000","last_became_peered":"2024-09-15T23:56:55.991796+0000","last_unstale":"2024-09-15T23:56:57.752339+0000","last_undegraded":"2024-09-15T23:56:57.752339+0000","last_fullsized":"2024-09-15T23:56:57.752339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:50.644181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752870+0000","last_change":"2024-09-15T23:56:54.969021+0000","last_active":"2024-09-15T23:56:57.752870+0000","last_peered":"2024-09-15T23:56:57.752870+0000","last_clean":"2024-09-15T23:56:57.752870+0000","last_became_active":"2024-09-15T23:56:54.968753+0000","last_became_peered":"2024-09-15T23:56:54.968753+0000","last_unstale":"2024-09-15T23:56:57.752870+0000","last_undegraded":"2024-09-15T23:56:57.752870+0000","last_fullsized":"2024-09-15T23:56:57.752870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:03.369612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992867+0000","last_change":"2024-09-15T23:56:55.989348+0000","last_active":"2024-09-15T23:56:56.992867+0000","last_peered":"2024-09-15T23:56:56.992867+0000","last_clean":"2024-09-15T23:56:56.992867+0000","last_became_active":"2024-09-15T23:56:55.975943+0000","last_became_peered":"2024-09-15T23:56:55.975943+0000","last_unstale":"2024-09-15T23:56:56.992867+0000","last_undegraded":"2024-09-15T23:56:56.992867+0000","last_fullsized":"2024-09-15T23:56:56.992867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:54.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753094+0000","last_change":"2024-09-15T23:56:54.975418+0000","last_active":"2024-09-15T23:56:57.753094+0000","last_peered":"2024-09-15T23:56:57.753094+0000","last_clean":"2024-09-15T23:56:57.753094+0000","last_became_active":"2024-09-15T23:56:54.975099+0000","last_became_peered":"2024-09-15T23:56:54.975099+0000","last_unstale":"2024-09-15T23:56:57.753094+0000","last_undegraded":"2024-09-15T23:56:57.753094+0000","last_fullsized":"2024-09-15T23:56:57.753094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:05.220925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990677+0000","last_change":"2024-09-15T23:56:56.001334+0000","last_active":"2024-09-15T23:56:56.990677+0000","last_peered":"2024-09-15T23:56:56.990677+0000","last_clean":"2024-09-15T23:56:56.990677+0000","last_became_active":"2024-09-15T23:56:56.000374+0000","last_became_peered":"2024-09-15T23:56:56.000374+0000","last_unstale":"2024-09-15T23:56:56.990677+0000","last_undegraded":"2024-09-15T23:56:56.990677+0000","last_fullsized":"2024-09-15T23:56:56.990677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:25.361845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753604+0000","last_change":"2024-09-15T23:56:54.979283+0000","last_active":"2024-09-15T23:56:57.753604+0000","last_peered":"2024-09-15T23:56:57.753604+0000","last_clean":"2024-09-15T23:56:57.753604+0000","last_became_active":"2024-09-15T23:56:54.977838+0000","last_became_peered":"2024-09-15T23:56:54.977838+0000","last_unstale":"2024-09-15T23:56:57.753604+0000","last_undegraded":"2024-09-15T23:56:57.753604+0000","last_fullsized":"2024-09-15T23:56:57.753604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:21.518878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753441+0000","last_change":"2024-09-15T23:56:55.995988+0000","last_active":"2024-09-15T23:56:57.753441+0000","last_peered":"2024-09-15T23:56:57.753441+0000","last_clean":"2024-09-15T23:56:57.753441+0000","last_became_active":"2024-09-15T23:56:55.995137+0000","last_became_peered":"2024-09-15T23:56:55.995137+0000","last_unstale":"2024-09-15T23:56:57.753441+0000","last_undegraded":"2024-09-15T23:56:57.753441+0000","last_fullsized":"2024-09-15T23:56:57.753441+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:46.961167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753667+0000","last_change":"2024-09-15T23:56:54.984311+0000","last_active":"2024-09-15T23:56:57.753667+0000","last_peered":"2024-09-15T23:56:57.753667+0000","last_clean":"2024-09-15T23:56:57.753667+0000","last_became_active":"2024-09-15T23:56:54.983912+0000","last_became_peered":"2024-09-15T23:56:54.983912+0000","last_unstale":"2024-09-15T23:56:57.753667+0000","last_undegraded":"2024-09-15T23:56:57.753667+0000","last_fullsized":"2024-09-15T23:56:57.753667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:12.265924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753712+0000","last_change":"2024-09-15T23:56:56.007768+0000","last_active":"2024-09-15T23:56:57.753712+0000","last_peered":"2024-09-15T23:56:57.753712+0000","last_clean":"2024-09-15T23:56:57.753712+0000","last_became_active":"2024-09-15T23:56:56.001858+0000","last_became_peered":"2024-09-15T23:56:56.001858+0000","last_unstale":"2024-09-15T23:56:57.753712+0000","last_undegraded":"2024-09-15T23:56:57.753712+0000","last_fullsized":"2024-09-15T23:56:57.753712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:06.231114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993111+0000","last_change":"2024-09-15T23:56:54.983601+0000","last_active":"2024-09-15T23:56:56.993111+0000","last_peered":"2024-09-15T23:56:56.993111+0000","last_clean":"2024-09-15T23:56:56.993111+0000","last_became_active":"2024-09-15T23:56:54.982965+0000","last_became_peered":"2024-09-15T23:56:54.982965+0000","last_unstale":"2024-09-15T23:56:56.993111+0000","last_undegraded":"2024-09-15T23:56:56.993111+0000","last_fullsized":"2024-09-15T23:56:56.993111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.232324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754317+0000","last_change":"2024-09-15T23:56:55.995723+0000","last_active":"2024-09-15T23:56:57.754317+0000","last_peered":"2024-09-15T23:56:57.754317+0000","last_clean":"2024-09-15T23:56:57.754317+0000","last_became_active":"2024-09-15T23:56:55.994899+0000","last_became_peered":"2024-09-15T23:56:55.994899+0000","last_unstale":"2024-09-15T23:56:57.754317+0000","last_undegraded":"2024-09-15T23:56:57.754317+0000","last_fullsized":"2024-09-15T23:56:57.754317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:09.909885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990219+0000","last_change":"2024-09-15T23:56:54.980943+0000","last_active":"2024-09-15T23:56:56.990219+0000","last_peered":"2024-09-15T23:56:56.990219+0000","last_clean":"2024-09-15T23:56:56.990219+0000","last_became_active":"2024-09-15T23:56:54.979920+0000","last_became_peered":"2024-09-15T23:56:54.979920+0000","last_unstale":"2024-09-15T23:56:56.990219+0000","last_undegraded":"2024-09-15T23:56:56.990219+0000","last_fullsized":"2024-09-15T23:56:56.990219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:31.342987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992630+0000","last_change":"2024-09-15T23:56:54.986965+0000","last_active":"2024-09-15T23:56:56.992630+0000","last_peered":"2024-09-15T23:56:56.992630+0000","last_clean":"2024-09-15T23:56:56.992630+0000","last_became_active":"2024-09-15T23:56:54.986306+0000","last_became_peered":"2024-09-15T23:56:54.986306+0000","last_unstale":"2024-09-15T23:56:56.992630+0000","last_undegraded":"2024-09-15T23:56:56.992630+0000","last_fullsized":"2024-09-15T23:56:56.992630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:40.725441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751761+0000","last_change":"2024-09-15T23:56:55.973928+0000","last_active":"2024-09-15T23:56:57.751761+0000","last_peered":"2024-09-15T23:56:57.751761+0000","last_clean":"2024-09-15T23:56:57.751761+0000","last_became_active":"2024-09-15T23:56:55.973107+0000","last_became_peered":"2024-09-15T23:56:55.973107+0000","last_unstale":"2024-09-15T23:56:57.751761+0000","last_undegraded":"2024-09-15T23:56:57.751761+0000","last_fullsized":"2024-09-15T23:56:57.751761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:30.375034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252606+0000","last_change":"2024-09-15T23:56:54.986074+0000","last_active":"2024-09-15T23:56:57.252606+0000","last_peered":"2024-09-15T23:56:57.252606+0000","last_clean":"2024-09-15T23:56:57.252606+0000","last_became_active":"2024-09-15T23:56:54.985826+0000","last_became_peered":"2024-09-15T23:56:54.985826+0000","last_unstale":"2024-09-15T23:56:57.252606+0000","last_undegraded":"2024-09-15T23:56:57.252606+0000","last_fullsized":"2024-09-15T23:56:57.252606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:06.066930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252009+0000","last_change":"2024-09-15T23:56:56.006520+0000","last_active":"2024-09-15T23:56:57.252009+0000","last_peered":"2024-09-15T23:56:57.252009+0000","last_clean":"2024-09-15T23:56:57.252009+0000","last_became_active":"2024-09-15T23:56:56.006086+0000","last_became_peered":"2024-09-15T23:56:56.006086+0000","last_unstale":"2024-09-15T23:56:57.252009+0000","last_undegraded":"2024-09-15T23:56:57.252009+0000","last_fullsized":"2024-09-15T23:56:57.252009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:04.416975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.979871+0000","last_change":"2024-09-15T23:56:54.987749+0000","last_active":"2024-09-15T23:56:56.979871+0000","last_peered":"2024-09-15T23:56:56.979871+0000","last_clean":"2024-09-15T23:56:56.979871+0000","last_became_active":"2024-09-15T23:56:54.987176+0000","last_became_peered":"2024-09-15T23:56:54.987176+0000","last_unstale":"2024-09-15T23:56:56.979871+0000","last_undegraded":"2024-09-15T23:56:56.979871+0000","last_fullsized":"2024-09-15T23:56:56.979871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:09.647148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252252+0000","last_change":"2024-09-15T23:56:54.960462+0000","last_active":"2024-09-15T23:56:57.252252+0000","last_peered":"2024-09-15T23:56:57.252252+0000","last_clean":"2024-09-15T23:56:57.252252+0000","last_became_active":"2024-09-15T23:56:54.960172+0000","last_became_peered":"2024-09-15T23:56:54.960172+0000","last_unstale":"2024-09-15T23:56:57.252252+0000","last_undegraded":"2024-09-15T23:56:57.252252+0000","last_fullsized":"2024-09-15T23:56:57.252252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:02.312104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991046+0000","last_change":"2024-09-15T23:56:55.969820+0000","last_active":"2024-09-15T23:56:56.991046+0000","last_peered":"2024-09-15T23:56:56.991046+0000","last_clean":"2024-09-15T23:56:56.991046+0000","last_became_active":"2024-09-15T23:56:55.967469+0000","last_became_peered":"2024-09-15T23:56:55.967469+0000","last_unstale":"2024-09-15T23:56:56.991046+0000","last_undegraded":"2024-09-15T23:56:56.991046+0000","last_fullsized":"2024-09-15T23:56:56.991046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:15.623608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752041+0000","last_change":"2024-09-15T23:56:54.962171+0000","last_active":"2024-09-15T23:56:57.752041+0000","last_peered":"2024-09-15T23:56:57.752041+0000","last_clean":"2024-09-15T23:56:57.752041+0000","last_became_active":"2024-09-15T23:56:54.961049+0000","last_became_peered":"2024-09-15T23:56:54.961049+0000","last_unstale":"2024-09-15T23:56:57.752041+0000","last_undegraded":"2024-09-15T23:56:57.752041+0000","last_fullsized":"2024-09-15T23:56:57.752041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:02.312104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940338+0000","last_change":"2024-09-15T23:56:53.940338+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940338+0000","last_undegraded":"2024-09-15T23:56:53.940338+0000","last_fullsized":"2024-09-15T23:56:53.940338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752209+0000","last_change":"2024-09-15T23:56:56.004365+0000","last_active":"2024-09-15T23:56:57.752209+0000","last_peered":"2024-09-15T23:56:57.752209+0000","last_clean":"2024-09-15T23:56:57.752209+0000","last_became_active":"2024-09-15T23:56:56.004079+0000","last_became_peered":"2024-09-15T23:56:56.004079+0000","last_unstale":"2024-09-15T23:56:57.752209+0000","last_undegraded":"2024-09-15T23:56:57.752209+0000","last_fullsized":"2024-09-15T23:56:57.752209+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:19.060961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:55.972124+0000","last_change":"2024-09-15T23:56:54.983702+0000","last_active":"2024-09-15T23:56:55.972124+0000","last_peered":"2024-09-15T23:56:55.972124+0000","last_clean":"2024-09-15T23:56:55.972124+0000","last_became_active":"2024-09-15T23:56:54.983127+0000","last_became_peered":"2024-09-15T23:56:54.983127+0000","last_unstale":"2024-09-15T23:56:55.972124+0000","last_undegraded":"2024-09-15T23:56:55.972124+0000","last_fullsized":"2024-09-15T23:56:55.972124+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:25.310145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993972+0000","last_change":"2024-09-15T23:56:55.987825+0000","last_active":"2024-09-15T23:56:56.993972+0000","last_peered":"2024-09-15T23:56:56.993972+0000","last_clean":"2024-09-15T23:56:56.993972+0000","last_became_active":"2024-09-15T23:56:55.976689+0000","last_became_peered":"2024-09-15T23:56:55.976689+0000","last_unstale":"2024-09-15T23:56:56.993972+0000","last_undegraded":"2024-09-15T23:56:56.993972+0000","last_fullsized":"2024-09-15T23:56:56.993972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:39.595978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751496+0000","last_change":"2024-09-15T23:56:54.957629+0000","last_active":"2024-09-15T23:56:57.751496+0000","last_peered":"2024-09-15T23:56:57.751496+0000","last_clean":"2024-09-15T23:56:57.751496+0000","last_became_active":"2024-09-15T23:56:54.957340+0000","last_became_peered":"2024-09-15T23:56:54.957340+0000","last_unstale":"2024-09-15T23:56:57.751496+0000","last_undegraded":"2024-09-15T23:56:57.751496+0000","last_fullsized":"2024-09-15T23:56:57.751496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:45.950977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754194+0000","last_change":"2024-09-15T23:56:55.994826+0000","last_active":"2024-09-15T23:56:57.754194+0000","last_peered":"2024-09-15T23:56:57.754194+0000","last_clean":"2024-09-15T23:56:57.754194+0000","last_became_active":"2024-09-15T23:56:55.994110+0000","last_became_peered":"2024-09-15T23:56:55.994110+0000","last_unstale":"2024-09-15T23:56:57.754194+0000","last_undegraded":"2024-09-15T23:56:57.754194+0000","last_fullsized":"2024-09-15T23:56:57.754194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:41.281743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992782+0000","last_change":"2024-09-15T23:56:54.984135+0000","last_active":"2024-09-15T23:56:56.992782+0000","last_peered":"2024-09-15T23:56:56.992782+0000","last_clean":"2024-09-15T23:56:56.992782+0000","last_became_active":"2024-09-15T23:56:54.983684+0000","last_became_peered":"2024-09-15T23:56:54.983684+0000","last_unstale":"2024-09-15T23:56:56.992782+0000","last_undegraded":"2024-09-15T23:56:56.992782+0000","last_fullsized":"2024-09-15T23:56:56.992782+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:37.846622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:55.971706+0000","last_change":"2024-09-15T23:56:54.974116+0000","last_active":"2024-09-15T23:56:55.971706+0000","last_peered":"2024-09-15T23:56:55.971706+0000","last_clean":"2024-09-15T23:56:55.971706+0000","last_became_active":"2024-09-15T23:56:54.973419+0000","last_became_peered":"2024-09-15T23:56:54.973419+0000","last_unstale":"2024-09-15T23:56:55.971706+0000","last_undegraded":"2024-09-15T23:56:55.971706+0000","last_fullsized":"2024-09-15T23:56:55.971706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:17.992076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251270+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:56:57.251270+0000","last_peered":"2024-09-15T23:56:57.251270+0000","last_clean":"2024-09-15T23:56:57.251270+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:56:57.251270+0000","last_undegraded":"2024-09-15T23:56:57.251270+0000","last_fullsized":"2024-09-15T23:56:57.251270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":917504,"data_stored":412618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":917504,"data_stored":412638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":913408,"data_stored":411988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":872448,"data_stored":391440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":872448,"data_stored":391440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1519616,"data_stored":1003980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":913408,"data_stored":411988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1495040,"data_stored":995732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:56:59.717 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:56:59.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.878+0000 7ff77df31640 1 Processor -- start 2024-09-15T23:56:59.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.878+0000 7ff77df31640 1 -- start start 2024-09-15T23:56:59.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff77df31640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff77815c2a0 0x7ff7780aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff77df31640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff7780af2a0 0x7ff77806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff77df31640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7780b3290 con 0x7ff77815bec0 2024-09-15T23:56:59.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff77df31640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff7780b3570 con 0x7ff77815c2a0 2024-09-15T23:56:59.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff77df31640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff7780b3850 con 0x7ff7780af2a0 2024-09-15T23:56:59.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff776ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff77815c2a0 0x7ff7780aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff776ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff77815c2a0 0x7ff7780aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43424/0 (socket says 172.21.15.112:43424) 2024-09-15T23:56:59.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff7777fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff77815bec0 0x7ff7780ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55248/0 (socket says 172.21.15.112:55248) 2024-09-15T23:56:59.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff776ffd640 1 -- 172.21.15.112:0/3027653453 learned_addr learned my addr 172.21.15.112:0/3027653453 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:59.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff777fff640 1 --2- 172.21.15.112:0/3027653453 >> v2:172.21.15.169:3300/0 conn(0x7ff7780af2a0 0x7ff77806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff776ffd640 1 -- 172.21.15.112:0/3027653453 >> v2:172.21.15.169:3300/0 conn(0x7ff7780af2a0 msgr2=0x7ff77806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:56:59.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff776ffd640 1 --2- 172.21.15.112:0/3027653453 >> v2:172.21.15.169:3300/0 conn(0x7ff7780af2a0 0x7ff77806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff7767fc640 1 -- 172.21.15.112:0/3027653453 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 146187659 0 0) 0x7ff7780b3290 con 0x7ff77815bec0 2024-09-15T23:56:59.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff776ffd640 1 -- 172.21.15.112:0/3027653453 >> v1:172.21.15.112:6789/0 conn(0x7ff77815bec0 legacy=0x7ff7780ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff776ffd640 1 -- 172.21.15.112:0/3027653453 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7780b3b30 con 0x7ff77815c2a0 2024-09-15T23:56:59.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff776ffd640 1 --2- 172.21.15.112:0/3027653453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77815c2a0 0x7ff7780aed60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff7780b2fb0 tx=0x7ff76c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c590ef7248d3c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff7767fc640 1 -- 172.21.15.112:0/3027653453 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0aa650 con 0x7ff77815c2a0 2024-09-15T23:56:59.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff7767fc640 1 -- 172.21.15.112:0/3027653453 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff76c0af070 con 0x7ff77815c2a0 2024-09-15T23:56:59.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.882+0000 7ff7767fc640 1 -- 172.21.15.112:0/3027653453 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0aaa10 con 0x7ff77815c2a0 2024-09-15T23:56:59.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 -- 172.21.15.112:0/3027653453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77815c2a0 msgr2=0x7ff7780aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 --2- 172.21.15.112:0/3027653453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77815c2a0 0x7ff7780aed60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff7780b2fb0 tx=0x7ff76c01c4f0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 -- 172.21.15.112:0/3027653453 shutdown_connections 2024-09-15T23:56:59.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 --2- 172.21.15.112:0/3027653453 >> v2:172.21.15.169:3300/0 conn(0x7ff7780af2a0 0x7ff77806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 --2- 172.21.15.112:0/3027653453 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff77815c2a0 0x7ff7780aed60 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 -- 172.21.15.112:0/3027653453 >> 172.21.15.112:0/3027653453 conn(0x7ff7780b1f90 msgr2=0x7ff7780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:59.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 -- 172.21.15.112:0/3027653453 shutdown_connections 2024-09-15T23:56:59.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 -- 172.21.15.112:0/3027653453 wait complete. 2024-09-15T23:56:59.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 Processor -- start 2024-09-15T23:56:59.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 -- start start 2024-09-15T23:56:59.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7780af2a0 0x7ff778154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff77815bec0 0x7ff778148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff77815c2a0 0x7ff778149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff77806ed50 con 0x7ff7780af2a0 2024-09-15T23:56:59.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff7780af6b0 con 0x7ff77815bec0 2024-09-15T23:56:59.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff77806eed0 con 0x7ff77815c2a0 2024-09-15T23:56:59.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff7777fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7780af2a0 0x7ff778154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff7777fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7780af2a0 0x7ff778154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43436/0 (socket says 172.21.15.112:43436) 2024-09-15T23:56:59.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff7777fe640 1 -- 172.21.15.112:0/1154237251 learned_addr learned my addr 172.21.15.112:0/1154237251 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:56:59.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff777fff640 1 --2- 172.21.15.112:0/1154237251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff77815c2a0 0x7ff778149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff776ffd640 1 --2- 172.21.15.112:0/1154237251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff77815bec0 0x7ff778148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff7777fe640 1 -- 172.21.15.112:0/1154237251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff77815c2a0 msgr2=0x7ff778149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff7777fe640 1 --2- 172.21.15.112:0/1154237251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff77815c2a0 0x7ff778149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff7777fe640 1 -- 172.21.15.112:0/1154237251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff77815bec0 msgr2=0x7ff778148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff7777fe640 1 --2- 172.21.15.112:0/1154237251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff77815bec0 0x7ff778148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff7777fe640 1 -- 172.21.15.112:0/1154237251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff778071fb0 con 0x7ff7780af2a0 2024-09-15T23:56:59.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff7777fe640 1 --2- 172.21.15.112:0/1154237251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7780af2a0 0x7ff778154df0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff7680011f0 tx=0x7ff76800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff75ffff640 1 -- 172.21.15.112:0/1154237251 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768018070 con 0x7ff7780af2a0 2024-09-15T23:56:59.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff75ffff640 1 -- 172.21.15.112:0/1154237251 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7680074e0 con 0x7ff7780af2a0 2024-09-15T23:56:59.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 -- 172.21.15.112:0/1154237251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff778072290 con 0x7ff7780af2a0 2024-09-15T23:56:59.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff75ffff640 1 -- 172.21.15.112:0/1154237251 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768004a10 con 0x7ff7780af2a0 2024-09-15T23:56:59.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 -- 172.21.15.112:0/1154237251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff778072850 con 0x7ff7780af2a0 2024-09-15T23:56:59.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.886+0000 7ff77df31640 1 -- 172.21.15.112:0/1154237251 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff77806f1d0 con 0x7ff7780af2a0 2024-09-15T23:56:59.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.890+0000 7ff75ffff640 1 -- 172.21.15.112:0/1154237251 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff76801b070 con 0x7ff7780af2a0 2024-09-15T23:56:59.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.890+0000 7ff75ffff640 1 --2- 172.21.15.112:0/1154237251 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff7640678f0 0x7ff764069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.890+0000 7ff75ffff640 1 -- 172.21.15.112:0/1154237251 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7ff768085130 con 0x7ff7780af2a0 2024-09-15T23:56:59.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.890+0000 7ff776ffd640 1 --2- 172.21.15.112:0/1154237251 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff7640678f0 0x7ff764069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.890+0000 7ff776ffd640 1 --2- 172.21.15.112:0/1154237251 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff7640678f0 0x7ff764069db0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0ae000 tx=0x7ff76c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:56:59.894+0000 7ff75ffff640 1 -- 172.21.15.112:0/1154237251 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff768055b70 con 0x7ff7780af2a0 2024-09-15T23:57:00.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.042+0000 7ff77df31640 1 -- 172.21.15.112:0/1154237251 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff77806fcd0 con 0x7ff7640678f0 2024-09-15T23:57:00.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.050+0000 7ff75ffff640 1 -- 172.21.15.112:0/1154237251 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249762 (secure 0 0 0) 0x7ff77806fcd0 con 0x7ff7640678f0 2024-09-15T23:57:00.054 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:00.056 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:57:00.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.054+0000 7ff77df31640 1 -- 172.21.15.112:0/1154237251 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff7640678f0 msgr2=0x7ff764069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.054+0000 7ff77df31640 1 --2- 172.21.15.112:0/1154237251 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff7640678f0 0x7ff764069db0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0ae000 tx=0x7ff76c0a7000 comp rx=0 tx=0).stop 2024-09-15T23:57:00.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.054+0000 7ff77df31640 1 -- 172.21.15.112:0/1154237251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7780af2a0 msgr2=0x7ff778154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.054+0000 7ff77df31640 1 --2- 172.21.15.112:0/1154237251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7780af2a0 0x7ff778154df0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff7680011f0 tx=0x7ff76800c9b0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.054+0000 7ff77df31640 1 -- 172.21.15.112:0/1154237251 shutdown_connections 2024-09-15T23:57:00.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.054+0000 7ff77df31640 1 --2- 172.21.15.112:0/1154237251 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff7640678f0 0x7ff764069db0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.054+0000 7ff77df31640 1 --2- 172.21.15.112:0/1154237251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff77815c2a0 0x7ff778149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.054+0000 7ff77df31640 1 --2- 172.21.15.112:0/1154237251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff77815bec0 0x7ff778148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.054+0000 7ff77df31640 1 --2- 172.21.15.112:0/1154237251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7780af2a0 0x7ff778154df0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.054+0000 7ff77df31640 1 -- 172.21.15.112:0/1154237251 >> 172.21.15.112:0/1154237251 conn(0x7ff7780b1f90 msgr2=0x7ff7781597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:00.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.054+0000 7ff77df31640 1 -- 172.21.15.112:0/1154237251 shutdown_connections 2024-09-15T23:57:00.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.054+0000 7ff77df31640 1 -- 172.21.15.112:0/1154237251 wait complete. 2024-09-15T23:57:00.072 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2024-09-15T23:56:59.291468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257748,"kb_used_data":8224,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716972,"statfs":{"total":773094113280,"available":772830179328,"internally_reserved":0,"allocated":8421376,"data_stored":4431824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.358953"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252528+0000","last_change":"2024-09-15T23:56:55.979224+0000","last_active":"2024-09-15T23:56:57.252528+0000","last_peered":"2024-09-15T23:56:57.252528+0000","last_clean":"2024-09-15T23:56:57.252528+0000","last_became_active":"2024-09-15T23:56:55.978887+0000","last_became_peered":"2024-09-15T23:56:55.978887+0000","last_unstale":"2024-09-15T23:56:57.252528+0000","last_undegraded":"2024-09-15T23:56:57.252528+0000","last_fullsized":"2024-09-15T23:56:57.252528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:32.013874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993595+0000","last_change":"2024-09-15T23:56:55.999113+0000","last_active":"2024-09-15T23:56:56.993595+0000","last_peered":"2024-09-15T23:56:56.993595+0000","last_clean":"2024-09-15T23:56:56.993595+0000","last_became_active":"2024-09-15T23:56:55.997840+0000","last_became_peered":"2024-09-15T23:56:55.997840+0000","last_unstale":"2024-09-15T23:56:56.993595+0000","last_undegraded":"2024-09-15T23:56:56.993595+0000","last_fullsized":"2024-09-15T23:56:56.993595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:31.205893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993705+0000","last_change":"2024-09-15T23:56:55.989925+0000","last_active":"2024-09-15T23:56:56.993705+0000","last_peered":"2024-09-15T23:56:56.993705+0000","last_clean":"2024-09-15T23:56:56.993705+0000","last_became_active":"2024-09-15T23:56:55.986690+0000","last_became_peered":"2024-09-15T23:56:55.986690+0000","last_unstale":"2024-09-15T23:56:56.993705+0000","last_undegraded":"2024-09-15T23:56:56.993705+0000","last_fullsized":"2024-09-15T23:56:56.993705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:14.922569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751951+0000","last_change":"2024-09-15T23:56:55.984311+0000","last_active":"2024-09-15T23:56:57.751951+0000","last_peered":"2024-09-15T23:56:57.751951+0000","last_clean":"2024-09-15T23:56:57.751951+0000","last_became_active":"2024-09-15T23:56:55.984038+0000","last_became_peered":"2024-09-15T23:56:55.984038+0000","last_unstale":"2024-09-15T23:56:57.751951+0000","last_undegraded":"2024-09-15T23:56:57.751951+0000","last_fullsized":"2024-09-15T23:56:57.751951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:14.917805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753296+0000","last_change":"2024-09-15T23:56:55.973914+0000","last_active":"2024-09-15T23:56:57.753296+0000","last_peered":"2024-09-15T23:56:57.753296+0000","last_clean":"2024-09-15T23:56:57.753296+0000","last_became_active":"2024-09-15T23:56:55.973108+0000","last_became_peered":"2024-09-15T23:56:55.973108+0000","last_unstale":"2024-09-15T23:56:57.753296+0000","last_undegraded":"2024-09-15T23:56:57.753296+0000","last_fullsized":"2024-09-15T23:56:57.753296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.322294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012161+0000","last_change":"2024-09-15T23:56:55.993222+0000","last_active":"2024-09-15T23:56:56.012161+0000","last_peered":"2024-09-15T23:56:56.012161+0000","last_clean":"2024-09-15T23:56:56.012161+0000","last_became_active":"2024-09-15T23:56:55.992379+0000","last_became_peered":"2024-09-15T23:56:55.992379+0000","last_unstale":"2024-09-15T23:56:56.012161+0000","last_undegraded":"2024-09-15T23:56:56.012161+0000","last_fullsized":"2024-09-15T23:56:56.012161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:29:42.435805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751410+0000","last_change":"2024-09-15T23:56:55.969504+0000","last_active":"2024-09-15T23:56:57.751410+0000","last_peered":"2024-09-15T23:56:57.751410+0000","last_clean":"2024-09-15T23:56:57.751410+0000","last_became_active":"2024-09-15T23:56:55.968813+0000","last_became_peered":"2024-09-15T23:56:55.968813+0000","last_unstale":"2024-09-15T23:56:57.751410+0000","last_undegraded":"2024-09-15T23:56:57.751410+0000","last_fullsized":"2024-09-15T23:56:57.751410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:37.530094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990258+0000","last_change":"2024-09-15T23:56:55.974436+0000","last_active":"2024-09-15T23:56:56.990258+0000","last_peered":"2024-09-15T23:56:56.990258+0000","last_clean":"2024-09-15T23:56:56.990258+0000","last_became_active":"2024-09-15T23:56:55.973689+0000","last_became_peered":"2024-09-15T23:56:55.973689+0000","last_unstale":"2024-09-15T23:56:56.990258+0000","last_undegraded":"2024-09-15T23:56:56.990258+0000","last_fullsized":"2024-09-15T23:56:56.990258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:28.820185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752677+0000","last_change":"2024-09-15T23:56:55.995299+0000","last_active":"2024-09-15T23:56:57.752677+0000","last_peered":"2024-09-15T23:56:57.752677+0000","last_clean":"2024-09-15T23:56:57.752677+0000","last_became_active":"2024-09-15T23:56:55.994979+0000","last_became_peered":"2024-09-15T23:56:55.994979+0000","last_unstale":"2024-09-15T23:56:57.752677+0000","last_undegraded":"2024-09-15T23:56:57.752677+0000","last_fullsized":"2024-09-15T23:56:57.752677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:54.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252297+0000","last_change":"2024-09-15T23:56:55.996657+0000","last_active":"2024-09-15T23:56:57.252297+0000","last_peered":"2024-09-15T23:56:57.252297+0000","last_clean":"2024-09-15T23:56:57.252297+0000","last_became_active":"2024-09-15T23:56:55.996374+0000","last_became_peered":"2024-09-15T23:56:55.996374+0000","last_unstale":"2024-09-15T23:56:57.252297+0000","last_undegraded":"2024-09-15T23:56:57.252297+0000","last_fullsized":"2024-09-15T23:56:57.252297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:28.942569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.994065+0000","last_change":"2024-09-15T23:56:56.002531+0000","last_active":"2024-09-15T23:56:56.994065+0000","last_peered":"2024-09-15T23:56:56.994065+0000","last_clean":"2024-09-15T23:56:56.994065+0000","last_became_active":"2024-09-15T23:56:55.989953+0000","last_became_peered":"2024-09-15T23:56:55.989953+0000","last_unstale":"2024-09-15T23:56:56.994065+0000","last_undegraded":"2024-09-15T23:56:56.994065+0000","last_fullsized":"2024-09-15T23:56:56.994065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:42.470630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993324+0000","last_change":"2024-09-15T23:56:56.004482+0000","last_active":"2024-09-15T23:56:56.993324+0000","last_peered":"2024-09-15T23:56:56.993324+0000","last_clean":"2024-09-15T23:56:56.993324+0000","last_became_active":"2024-09-15T23:56:56.003824+0000","last_became_peered":"2024-09-15T23:56:56.003824+0000","last_unstale":"2024-09-15T23:56:56.993324+0000","last_undegraded":"2024-09-15T23:56:56.993324+0000","last_fullsized":"2024-09-15T23:56:56.993324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:32.353177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990654+0000","last_change":"2024-09-15T23:56:55.984462+0000","last_active":"2024-09-15T23:56:56.990654+0000","last_peered":"2024-09-15T23:56:56.990654+0000","last_clean":"2024-09-15T23:56:56.990654+0000","last_became_active":"2024-09-15T23:56:55.983722+0000","last_became_peered":"2024-09-15T23:56:55.983722+0000","last_unstale":"2024-09-15T23:56:56.990654+0000","last_undegraded":"2024-09-15T23:56:56.990654+0000","last_fullsized":"2024-09-15T23:56:56.990654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:39.347880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752123+0000","last_change":"2024-09-15T23:56:56.007000+0000","last_active":"2024-09-15T23:56:57.752123+0000","last_peered":"2024-09-15T23:56:57.752123+0000","last_clean":"2024-09-15T23:56:57.752123+0000","last_became_active":"2024-09-15T23:56:56.006350+0000","last_became_peered":"2024-09-15T23:56:56.006350+0000","last_unstale":"2024-09-15T23:56:57.752123+0000","last_undegraded":"2024-09-15T23:56:57.752123+0000","last_fullsized":"2024-09-15T23:56:57.752123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:59.909567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751377+0000","last_change":"2024-09-15T23:56:55.974231+0000","last_active":"2024-09-15T23:56:57.751377+0000","last_peered":"2024-09-15T23:56:57.751377+0000","last_clean":"2024-09-15T23:56:57.751377+0000","last_became_active":"2024-09-15T23:56:55.973543+0000","last_became_peered":"2024-09-15T23:56:55.973543+0000","last_unstale":"2024-09-15T23:56:57.751377+0000","last_undegraded":"2024-09-15T23:56:57.751377+0000","last_fullsized":"2024-09-15T23:56:57.751377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:58.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991496+0000","last_change":"2024-09-15T23:56:55.958076+0000","last_active":"2024-09-15T23:56:56.991496+0000","last_peered":"2024-09-15T23:56:56.991496+0000","last_clean":"2024-09-15T23:56:56.991496+0000","last_became_active":"2024-09-15T23:56:55.957404+0000","last_became_peered":"2024-09-15T23:56:55.957404+0000","last_unstale":"2024-09-15T23:56:56.991496+0000","last_undegraded":"2024-09-15T23:56:56.991496+0000","last_fullsized":"2024-09-15T23:56:56.991496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:23.266535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993642+0000","last_change":"2024-09-15T23:56:55.998591+0000","last_active":"2024-09-15T23:56:56.993642+0000","last_peered":"2024-09-15T23:56:56.993642+0000","last_clean":"2024-09-15T23:56:56.993642+0000","last_became_active":"2024-09-15T23:56:55.997788+0000","last_became_peered":"2024-09-15T23:56:55.997788+0000","last_unstale":"2024-09-15T23:56:56.993642+0000","last_undegraded":"2024-09-15T23:56:56.993642+0000","last_fullsized":"2024-09-15T23:56:56.993642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:50.441671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991220+0000","last_change":"2024-09-15T23:56:55.997317+0000","last_active":"2024-09-15T23:56:56.991220+0000","last_peered":"2024-09-15T23:56:56.991220+0000","last_clean":"2024-09-15T23:56:56.991220+0000","last_became_active":"2024-09-15T23:56:55.996587+0000","last_became_peered":"2024-09-15T23:56:55.996587+0000","last_unstale":"2024-09-15T23:56:56.991220+0000","last_undegraded":"2024-09-15T23:56:56.991220+0000","last_fullsized":"2024-09-15T23:56:56.991220+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:33.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012508+0000","last_change":"2024-09-15T23:56:55.994322+0000","last_active":"2024-09-15T23:56:56.012508+0000","last_peered":"2024-09-15T23:56:56.012508+0000","last_clean":"2024-09-15T23:56:56.012508+0000","last_became_active":"2024-09-15T23:56:55.993525+0000","last_became_peered":"2024-09-15T23:56:55.993525+0000","last_unstale":"2024-09-15T23:56:56.012508+0000","last_undegraded":"2024-09-15T23:56:56.012508+0000","last_fullsized":"2024-09-15T23:56:56.012508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:44.991594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992685+0000","last_change":"2024-09-15T23:56:56.011861+0000","last_active":"2024-09-15T23:56:56.992685+0000","last_peered":"2024-09-15T23:56:56.992685+0000","last_clean":"2024-09-15T23:56:56.992685+0000","last_became_active":"2024-09-15T23:56:56.011149+0000","last_became_peered":"2024-09-15T23:56:56.011149+0000","last_unstale":"2024-09-15T23:56:56.992685+0000","last_undegraded":"2024-09-15T23:56:56.992685+0000","last_fullsized":"2024-09-15T23:56:56.992685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:19.060961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252117+0000","last_change":"2024-09-15T23:56:55.984314+0000","last_active":"2024-09-15T23:56:57.252117+0000","last_peered":"2024-09-15T23:56:57.252117+0000","last_clean":"2024-09-15T23:56:57.252117+0000","last_became_active":"2024-09-15T23:56:55.983952+0000","last_became_peered":"2024-09-15T23:56:55.983952+0000","last_unstale":"2024-09-15T23:56:57.252117+0000","last_undegraded":"2024-09-15T23:56:57.252117+0000","last_fullsized":"2024-09-15T23:56:57.252117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:45:10.598663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992395+0000","last_change":"2024-09-15T23:56:56.004418+0000","last_active":"2024-09-15T23:56:56.992395+0000","last_peered":"2024-09-15T23:56:56.992395+0000","last_clean":"2024-09-15T23:56:56.992395+0000","last_became_active":"2024-09-15T23:56:56.003744+0000","last_became_peered":"2024-09-15T23:56:56.003744+0000","last_unstale":"2024-09-15T23:56:56.992395+0000","last_undegraded":"2024-09-15T23:56:56.992395+0000","last_fullsized":"2024-09-15T23:56:56.992395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:14.917805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.013320+0000","last_change":"2024-09-15T23:56:56.000438+0000","last_active":"2024-09-15T23:56:56.013320+0000","last_peered":"2024-09-15T23:56:56.013320+0000","last_clean":"2024-09-15T23:56:56.013320+0000","last_became_active":"2024-09-15T23:56:55.999839+0000","last_became_peered":"2024-09-15T23:56:55.999839+0000","last_unstale":"2024-09-15T23:56:56.013320+0000","last_undegraded":"2024-09-15T23:56:56.013320+0000","last_fullsized":"2024-09-15T23:56:56.013320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:41.952442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752800+0000","last_change":"2024-09-15T23:56:55.974824+0000","last_active":"2024-09-15T23:56:57.752800+0000","last_peered":"2024-09-15T23:56:57.752800+0000","last_clean":"2024-09-15T23:56:57.752800+0000","last_became_active":"2024-09-15T23:56:55.974296+0000","last_became_peered":"2024-09-15T23:56:55.974296+0000","last_unstale":"2024-09-15T23:56:57.752800+0000","last_undegraded":"2024-09-15T23:56:57.752800+0000","last_fullsized":"2024-09-15T23:56:57.752800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:32.353177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752021+0000","last_change":"2024-09-15T23:56:55.972869+0000","last_active":"2024-09-15T23:56:57.752021+0000","last_peered":"2024-09-15T23:56:57.752021+0000","last_clean":"2024-09-15T23:56:57.752021+0000","last_became_active":"2024-09-15T23:56:55.972567+0000","last_became_peered":"2024-09-15T23:56:55.972567+0000","last_unstale":"2024-09-15T23:56:57.752021+0000","last_undegraded":"2024-09-15T23:56:57.752021+0000","last_fullsized":"2024-09-15T23:56:57.752021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:20.287580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753525+0000","last_change":"2024-09-15T23:56:55.995902+0000","last_active":"2024-09-15T23:56:57.753525+0000","last_peered":"2024-09-15T23:56:57.753525+0000","last_clean":"2024-09-15T23:56:57.753525+0000","last_became_active":"2024-09-15T23:56:55.994271+0000","last_became_peered":"2024-09-15T23:56:55.994271+0000","last_unstale":"2024-09-15T23:56:57.753525+0000","last_undegraded":"2024-09-15T23:56:57.753525+0000","last_fullsized":"2024-09-15T23:56:57.753525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:04.379802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012213+0000","last_change":"2024-09-15T23:56:55.993324+0000","last_active":"2024-09-15T23:56:56.012213+0000","last_peered":"2024-09-15T23:56:56.012213+0000","last_clean":"2024-09-15T23:56:56.012213+0000","last_became_active":"2024-09-15T23:56:55.992543+0000","last_became_peered":"2024-09-15T23:56:55.992543+0000","last_unstale":"2024-09-15T23:56:56.012213+0000","last_undegraded":"2024-09-15T23:56:56.012213+0000","last_fullsized":"2024-09-15T23:56:56.012213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:10.974266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251818+0000","last_change":"2024-09-15T23:56:56.011651+0000","last_active":"2024-09-15T23:56:57.251818+0000","last_peered":"2024-09-15T23:56:57.251818+0000","last_clean":"2024-09-15T23:56:57.251818+0000","last_became_active":"2024-09-15T23:56:56.011342+0000","last_became_peered":"2024-09-15T23:56:56.011342+0000","last_unstale":"2024-09-15T23:56:57.251818+0000","last_undegraded":"2024-09-15T23:56:57.251818+0000","last_fullsized":"2024-09-15T23:56:57.251818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:02.575095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992637+0000","last_change":"2024-09-15T23:56:55.999632+0000","last_active":"2024-09-15T23:56:56.992637+0000","last_peered":"2024-09-15T23:56:56.992637+0000","last_clean":"2024-09-15T23:56:56.992637+0000","last_became_active":"2024-09-15T23:56:55.999003+0000","last_became_peered":"2024-09-15T23:56:55.999003+0000","last_unstale":"2024-09-15T23:56:56.992637+0000","last_undegraded":"2024-09-15T23:56:56.992637+0000","last_fullsized":"2024-09-15T23:56:56.992637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:27.375798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751513+0000","last_change":"2024-09-15T23:56:56.000881+0000","last_active":"2024-09-15T23:56:57.751513+0000","last_peered":"2024-09-15T23:56:57.751513+0000","last_clean":"2024-09-15T23:56:57.751513+0000","last_became_active":"2024-09-15T23:56:56.000550+0000","last_became_peered":"2024-09-15T23:56:56.000550+0000","last_unstale":"2024-09-15T23:56:57.751513+0000","last_undegraded":"2024-09-15T23:56:57.751513+0000","last_fullsized":"2024-09-15T23:56:57.751513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:16.086562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752125+0000","last_change":"2024-09-15T23:56:55.970381+0000","last_active":"2024-09-15T23:56:57.752125+0000","last_peered":"2024-09-15T23:56:57.752125+0000","last_clean":"2024-09-15T23:56:57.752125+0000","last_became_active":"2024-09-15T23:56:55.969605+0000","last_became_peered":"2024-09-15T23:56:55.969605+0000","last_unstale":"2024-09-15T23:56:57.752125+0000","last_undegraded":"2024-09-15T23:56:57.752125+0000","last_fullsized":"2024-09-15T23:56:57.752125+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:07.077120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754074+0000","last_change":"2024-09-15T23:56:54.986431+0000","last_active":"2024-09-15T23:56:57.754074+0000","last_peered":"2024-09-15T23:56:57.754074+0000","last_clean":"2024-09-15T23:56:57.754074+0000","last_became_active":"2024-09-15T23:56:54.986031+0000","last_became_peered":"2024-09-15T23:56:54.986031+0000","last_unstale":"2024-09-15T23:56:57.754074+0000","last_undegraded":"2024-09-15T23:56:57.754074+0000","last_fullsized":"2024-09-15T23:56:57.754074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:45.418494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752493+0000","last_change":"2024-09-15T23:56:55.980727+0000","last_active":"2024-09-15T23:56:57.752493+0000","last_peered":"2024-09-15T23:56:57.752493+0000","last_clean":"2024-09-15T23:56:57.752493+0000","last_became_active":"2024-09-15T23:56:55.973498+0000","last_became_peered":"2024-09-15T23:56:55.973498+0000","last_unstale":"2024-09-15T23:56:57.752493+0000","last_undegraded":"2024-09-15T23:56:57.752493+0000","last_fullsized":"2024-09-15T23:56:57.752493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:37.501600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.942231+0000","last_change":"2024-09-15T23:56:53.942231+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.942231+0000","last_undegraded":"2024-09-15T23:56:53.942231+0000","last_fullsized":"2024-09-15T23:56:53.942231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251960+0000","last_change":"2024-09-15T23:56:54.968341+0000","last_active":"2024-09-15T23:56:57.251960+0000","last_peered":"2024-09-15T23:56:57.251960+0000","last_clean":"2024-09-15T23:56:57.251960+0000","last_became_active":"2024-09-15T23:56:54.968071+0000","last_became_peered":"2024-09-15T23:56:54.968071+0000","last_unstale":"2024-09-15T23:56:57.251960+0000","last_undegraded":"2024-09-15T23:56:57.251960+0000","last_fullsized":"2024-09-15T23:56:57.251960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:49.633991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751297+0000","last_change":"2024-09-15T23:56:55.984390+0000","last_active":"2024-09-15T23:56:57.751297+0000","last_peered":"2024-09-15T23:56:57.751297+0000","last_clean":"2024-09-15T23:56:57.751297+0000","last_became_active":"2024-09-15T23:56:55.984141+0000","last_became_peered":"2024-09-15T23:56:55.984141+0000","last_unstale":"2024-09-15T23:56:57.751297+0000","last_undegraded":"2024-09-15T23:56:57.751297+0000","last_fullsized":"2024-09-15T23:56:57.751297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:48.336601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940540+0000","last_change":"2024-09-15T23:56:53.940540+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940540+0000","last_undegraded":"2024-09-15T23:56:53.940540+0000","last_fullsized":"2024-09-15T23:56:53.940540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012541+0000","last_change":"2024-09-15T23:56:55.997214+0000","last_active":"2024-09-15T23:56:56.012541+0000","last_peered":"2024-09-15T23:56:56.012541+0000","last_clean":"2024-09-15T23:56:56.012541+0000","last_became_active":"2024-09-15T23:56:55.992307+0000","last_became_peered":"2024-09-15T23:56:55.992307+0000","last_unstale":"2024-09-15T23:56:56.012541+0000","last_undegraded":"2024-09-15T23:56:56.012541+0000","last_fullsized":"2024-09-15T23:56:56.012541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:47.802236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.939966+0000","last_change":"2024-09-15T23:56:53.939966+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.939966+0000","last_undegraded":"2024-09-15T23:56:53.939966+0000","last_fullsized":"2024-09-15T23:56:53.939966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.994384+0000","last_change":"2024-09-15T23:56:56.004365+0000","last_active":"2024-09-15T23:56:56.994384+0000","last_peered":"2024-09-15T23:56:56.994384+0000","last_clean":"2024-09-15T23:56:56.994384+0000","last_became_active":"2024-09-15T23:56:56.003697+0000","last_became_peered":"2024-09-15T23:56:56.003697+0000","last_unstale":"2024-09-15T23:56:56.994384+0000","last_undegraded":"2024-09-15T23:56:56.994384+0000","last_fullsized":"2024-09-15T23:56:56.994384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:24.370163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940540+0000","last_change":"2024-09-15T23:56:53.940540+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940540+0000","last_undegraded":"2024-09-15T23:56:53.940540+0000","last_fullsized":"2024-09-15T23:56:53.940540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990195+0000","last_change":"2024-09-15T23:56:54.965160+0000","last_active":"2024-09-15T23:56:56.990195+0000","last_peered":"2024-09-15T23:56:56.990195+0000","last_clean":"2024-09-15T23:56:56.990195+0000","last_became_active":"2024-09-15T23:56:54.964317+0000","last_became_peered":"2024-09-15T23:56:54.964317+0000","last_unstale":"2024-09-15T23:56:56.990195+0000","last_undegraded":"2024-09-15T23:56:56.990195+0000","last_fullsized":"2024-09-15T23:56:56.990195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:53.719508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992537+0000","last_change":"2024-09-15T23:56:54.984630+0000","last_active":"2024-09-15T23:56:56.992537+0000","last_peered":"2024-09-15T23:56:56.992537+0000","last_clean":"2024-09-15T23:56:56.992537+0000","last_became_active":"2024-09-15T23:56:54.983896+0000","last_became_peered":"2024-09-15T23:56:54.983896+0000","last_unstale":"2024-09-15T23:56:56.992537+0000","last_undegraded":"2024-09-15T23:56:56.992537+0000","last_fullsized":"2024-09-15T23:56:56.992537+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:28.388939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992459+0000","last_change":"2024-09-15T23:56:55.989801+0000","last_active":"2024-09-15T23:56:56.992459+0000","last_peered":"2024-09-15T23:56:56.992459+0000","last_clean":"2024-09-15T23:56:56.992459+0000","last_became_active":"2024-09-15T23:56:55.989074+0000","last_became_peered":"2024-09-15T23:56:55.989074+0000","last_unstale":"2024-09-15T23:56:56.992459+0000","last_undegraded":"2024-09-15T23:56:56.992459+0000","last_fullsized":"2024-09-15T23:56:56.992459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:20.287580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752742+0000","last_change":"2024-09-15T23:56:54.959168+0000","last_active":"2024-09-15T23:56:57.752742+0000","last_peered":"2024-09-15T23:56:57.752742+0000","last_clean":"2024-09-15T23:56:57.752742+0000","last_became_active":"2024-09-15T23:56:54.958765+0000","last_became_peered":"2024-09-15T23:56:54.958765+0000","last_unstale":"2024-09-15T23:56:57.752742+0000","last_undegraded":"2024-09-15T23:56:57.752742+0000","last_fullsized":"2024-09-15T23:56:57.752742+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:36.491410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252161+0000","last_change":"2024-09-15T23:56:54.958234+0000","last_active":"2024-09-15T23:56:57.252161+0000","last_peered":"2024-09-15T23:56:57.252161+0000","last_clean":"2024-09-15T23:56:57.252161+0000","last_became_active":"2024-09-15T23:56:54.957887+0000","last_became_peered":"2024-09-15T23:56:54.957887+0000","last_unstale":"2024-09-15T23:56:57.252161+0000","last_undegraded":"2024-09-15T23:56:57.252161+0000","last_fullsized":"2024-09-15T23:56:57.252161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:36.491410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991152+0000","last_change":"2024-09-15T23:56:55.959205+0000","last_active":"2024-09-15T23:56:56.991152+0000","last_peered":"2024-09-15T23:56:56.991152+0000","last_clean":"2024-09-15T23:56:56.991152+0000","last_became_active":"2024-09-15T23:56:55.958373+0000","last_became_peered":"2024-09-15T23:56:55.958373+0000","last_unstale":"2024-09-15T23:56:56.991152+0000","last_undegraded":"2024-09-15T23:56:56.991152+0000","last_fullsized":"2024-09-15T23:56:56.991152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:23.272483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.016000+0000","last_change":"2024-09-15T23:56:54.977562+0000","last_active":"2024-09-15T23:56:56.016000+0000","last_peered":"2024-09-15T23:56:56.016000+0000","last_clean":"2024-09-15T23:56:56.016000+0000","last_became_active":"2024-09-15T23:56:54.976751+0000","last_became_peered":"2024-09-15T23:56:54.976751+0000","last_unstale":"2024-09-15T23:56:56.016000+0000","last_undegraded":"2024-09-15T23:56:56.016000+0000","last_fullsized":"2024-09-15T23:56:56.016000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:35.674580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012244+0000","last_change":"2024-09-15T23:56:55.993382+0000","last_active":"2024-09-15T23:56:56.012244+0000","last_peered":"2024-09-15T23:56:56.012244+0000","last_clean":"2024-09-15T23:56:56.012244+0000","last_became_active":"2024-09-15T23:56:55.992592+0000","last_became_peered":"2024-09-15T23:56:55.992592+0000","last_unstale":"2024-09-15T23:56:56.012244+0000","last_undegraded":"2024-09-15T23:56:56.012244+0000","last_fullsized":"2024-09-15T23:56:56.012244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:32.291020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940983+0000","last_change":"2024-09-15T23:56:53.940983+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940983+0000","last_undegraded":"2024-09-15T23:56:53.940983+0000","last_fullsized":"2024-09-15T23:56:53.940983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752119+0000","last_change":"2024-09-15T23:56:55.995297+0000","last_active":"2024-09-15T23:56:57.752119+0000","last_peered":"2024-09-15T23:56:57.752119+0000","last_clean":"2024-09-15T23:56:57.752119+0000","last_became_active":"2024-09-15T23:56:55.994941+0000","last_became_peered":"2024-09-15T23:56:55.994941+0000","last_unstale":"2024-09-15T23:56:57.752119+0000","last_undegraded":"2024-09-15T23:56:57.752119+0000","last_fullsized":"2024-09-15T23:56:57.752119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:27.375798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252310+0000","last_change":"2024-09-15T23:56:54.967739+0000","last_active":"2024-09-15T23:56:57.252310+0000","last_peered":"2024-09-15T23:56:57.252310+0000","last_clean":"2024-09-15T23:56:57.252310+0000","last_became_active":"2024-09-15T23:56:54.967464+0000","last_became_peered":"2024-09-15T23:56:54.967464+0000","last_unstale":"2024-09-15T23:56:57.252310+0000","last_undegraded":"2024-09-15T23:56:57.252310+0000","last_fullsized":"2024-09-15T23:56:57.252310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:45.950977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252103+0000","last_change":"2024-09-15T23:56:56.006475+0000","last_active":"2024-09-15T23:56:57.252103+0000","last_peered":"2024-09-15T23:56:57.252103+0000","last_clean":"2024-09-15T23:56:57.252103+0000","last_became_active":"2024-09-15T23:56:56.006118+0000","last_became_peered":"2024-09-15T23:56:56.006118+0000","last_unstale":"2024-09-15T23:56:57.252103+0000","last_undegraded":"2024-09-15T23:56:57.252103+0000","last_fullsized":"2024-09-15T23:56:57.252103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:56.067306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.941555+0000","last_change":"2024-09-15T23:56:53.941555+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.941555+0000","last_undegraded":"2024-09-15T23:56:53.941555+0000","last_fullsized":"2024-09-15T23:56:53.941555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752761+0000","last_change":"2024-09-15T23:56:54.989708+0000","last_active":"2024-09-15T23:56:57.752761+0000","last_peered":"2024-09-15T23:56:57.752761+0000","last_clean":"2024-09-15T23:56:57.752761+0000","last_became_active":"2024-09-15T23:56:54.989300+0000","last_became_peered":"2024-09-15T23:56:54.989300+0000","last_unstale":"2024-09-15T23:56:57.752761+0000","last_undegraded":"2024-09-15T23:56:57.752761+0000","last_fullsized":"2024-09-15T23:56:57.752761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:47.414189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252603+0000","last_change":"2024-09-15T23:56:56.010338+0000","last_active":"2024-09-15T23:56:57.252603+0000","last_peered":"2024-09-15T23:56:57.252603+0000","last_clean":"2024-09-15T23:56:57.252603+0000","last_became_active":"2024-09-15T23:56:56.010068+0000","last_became_peered":"2024-09-15T23:56:56.010068+0000","last_unstale":"2024-09-15T23:56:57.252603+0000","last_undegraded":"2024-09-15T23:56:57.252603+0000","last_fullsized":"2024-09-15T23:56:57.252603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:47.563782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.015998+0000","last_change":"2024-09-15T23:56:54.971305+0000","last_active":"2024-09-15T23:56:56.015998+0000","last_peered":"2024-09-15T23:56:56.015998+0000","last_clean":"2024-09-15T23:56:56.015998+0000","last_became_active":"2024-09-15T23:56:54.970598+0000","last_became_peered":"2024-09-15T23:56:54.970598+0000","last_unstale":"2024-09-15T23:56:56.015998+0000","last_undegraded":"2024-09-15T23:56:56.015998+0000","last_fullsized":"2024-09-15T23:56:56.015998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:20.015026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752339+0000","last_change":"2024-09-15T23:56:55.992555+0000","last_active":"2024-09-15T23:56:57.752339+0000","last_peered":"2024-09-15T23:56:57.752339+0000","last_clean":"2024-09-15T23:56:57.752339+0000","last_became_active":"2024-09-15T23:56:55.991796+0000","last_became_peered":"2024-09-15T23:56:55.991796+0000","last_unstale":"2024-09-15T23:56:57.752339+0000","last_undegraded":"2024-09-15T23:56:57.752339+0000","last_fullsized":"2024-09-15T23:56:57.752339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:50.644181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752870+0000","last_change":"2024-09-15T23:56:54.969021+0000","last_active":"2024-09-15T23:56:57.752870+0000","last_peered":"2024-09-15T23:56:57.752870+0000","last_clean":"2024-09-15T23:56:57.752870+0000","last_became_active":"2024-09-15T23:56:54.968753+0000","last_became_peered":"2024-09-15T23:56:54.968753+0000","last_unstale":"2024-09-15T23:56:57.752870+0000","last_undegraded":"2024-09-15T23:56:57.752870+0000","last_fullsized":"2024-09-15T23:56:57.752870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:03.369612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992867+0000","last_change":"2024-09-15T23:56:55.989348+0000","last_active":"2024-09-15T23:56:56.992867+0000","last_peered":"2024-09-15T23:56:56.992867+0000","last_clean":"2024-09-15T23:56:56.992867+0000","last_became_active":"2024-09-15T23:56:55.975943+0000","last_became_peered":"2024-09-15T23:56:55.975943+0000","last_unstale":"2024-09-15T23:56:56.992867+0000","last_undegraded":"2024-09-15T23:56:56.992867+0000","last_fullsized":"2024-09-15T23:56:56.992867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:54.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753094+0000","last_change":"2024-09-15T23:56:54.975418+0000","last_active":"2024-09-15T23:56:57.753094+0000","last_peered":"2024-09-15T23:56:57.753094+0000","last_clean":"2024-09-15T23:56:57.753094+0000","last_became_active":"2024-09-15T23:56:54.975099+0000","last_became_peered":"2024-09-15T23:56:54.975099+0000","last_unstale":"2024-09-15T23:56:57.753094+0000","last_undegraded":"2024-09-15T23:56:57.753094+0000","last_fullsized":"2024-09-15T23:56:57.753094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:05.220925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990677+0000","last_change":"2024-09-15T23:56:56.001334+0000","last_active":"2024-09-15T23:56:56.990677+0000","last_peered":"2024-09-15T23:56:56.990677+0000","last_clean":"2024-09-15T23:56:56.990677+0000","last_became_active":"2024-09-15T23:56:56.000374+0000","last_became_peered":"2024-09-15T23:56:56.000374+0000","last_unstale":"2024-09-15T23:56:56.990677+0000","last_undegraded":"2024-09-15T23:56:56.990677+0000","last_fullsized":"2024-09-15T23:56:56.990677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:25.361845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753604+0000","last_change":"2024-09-15T23:56:54.979283+0000","last_active":"2024-09-15T23:56:57.753604+0000","last_peered":"2024-09-15T23:56:57.753604+0000","last_clean":"2024-09-15T23:56:57.753604+0000","last_became_active":"2024-09-15T23:56:54.977838+0000","last_became_peered":"2024-09-15T23:56:54.977838+0000","last_unstale":"2024-09-15T23:56:57.753604+0000","last_undegraded":"2024-09-15T23:56:57.753604+0000","last_fullsized":"2024-09-15T23:56:57.753604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:21.518878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753441+0000","last_change":"2024-09-15T23:56:55.995988+0000","last_active":"2024-09-15T23:56:57.753441+0000","last_peered":"2024-09-15T23:56:57.753441+0000","last_clean":"2024-09-15T23:56:57.753441+0000","last_became_active":"2024-09-15T23:56:55.995137+0000","last_became_peered":"2024-09-15T23:56:55.995137+0000","last_unstale":"2024-09-15T23:56:57.753441+0000","last_undegraded":"2024-09-15T23:56:57.753441+0000","last_fullsized":"2024-09-15T23:56:57.753441+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:46.961167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753667+0000","last_change":"2024-09-15T23:56:54.984311+0000","last_active":"2024-09-15T23:56:57.753667+0000","last_peered":"2024-09-15T23:56:57.753667+0000","last_clean":"2024-09-15T23:56:57.753667+0000","last_became_active":"2024-09-15T23:56:54.983912+0000","last_became_peered":"2024-09-15T23:56:54.983912+0000","last_unstale":"2024-09-15T23:56:57.753667+0000","last_undegraded":"2024-09-15T23:56:57.753667+0000","last_fullsized":"2024-09-15T23:56:57.753667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:12.265924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753712+0000","last_change":"2024-09-15T23:56:56.007768+0000","last_active":"2024-09-15T23:56:57.753712+0000","last_peered":"2024-09-15T23:56:57.753712+0000","last_clean":"2024-09-15T23:56:57.753712+0000","last_became_active":"2024-09-15T23:56:56.001858+0000","last_became_peered":"2024-09-15T23:56:56.001858+0000","last_unstale":"2024-09-15T23:56:57.753712+0000","last_undegraded":"2024-09-15T23:56:57.753712+0000","last_fullsized":"2024-09-15T23:56:57.753712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:06.231114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993111+0000","last_change":"2024-09-15T23:56:54.983601+0000","last_active":"2024-09-15T23:56:56.993111+0000","last_peered":"2024-09-15T23:56:56.993111+0000","last_clean":"2024-09-15T23:56:56.993111+0000","last_became_active":"2024-09-15T23:56:54.982965+0000","last_became_peered":"2024-09-15T23:56:54.982965+0000","last_unstale":"2024-09-15T23:56:56.993111+0000","last_undegraded":"2024-09-15T23:56:56.993111+0000","last_fullsized":"2024-09-15T23:56:56.993111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.232324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754317+0000","last_change":"2024-09-15T23:56:55.995723+0000","last_active":"2024-09-15T23:56:57.754317+0000","last_peered":"2024-09-15T23:56:57.754317+0000","last_clean":"2024-09-15T23:56:57.754317+0000","last_became_active":"2024-09-15T23:56:55.994899+0000","last_became_peered":"2024-09-15T23:56:55.994899+0000","last_unstale":"2024-09-15T23:56:57.754317+0000","last_undegraded":"2024-09-15T23:56:57.754317+0000","last_fullsized":"2024-09-15T23:56:57.754317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:09.909885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990219+0000","last_change":"2024-09-15T23:56:54.980943+0000","last_active":"2024-09-15T23:56:56.990219+0000","last_peered":"2024-09-15T23:56:56.990219+0000","last_clean":"2024-09-15T23:56:56.990219+0000","last_became_active":"2024-09-15T23:56:54.979920+0000","last_became_peered":"2024-09-15T23:56:54.979920+0000","last_unstale":"2024-09-15T23:56:56.990219+0000","last_undegraded":"2024-09-15T23:56:56.990219+0000","last_fullsized":"2024-09-15T23:56:56.990219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:31.342987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992630+0000","last_change":"2024-09-15T23:56:54.986965+0000","last_active":"2024-09-15T23:56:56.992630+0000","last_peered":"2024-09-15T23:56:56.992630+0000","last_clean":"2024-09-15T23:56:56.992630+0000","last_became_active":"2024-09-15T23:56:54.986306+0000","last_became_peered":"2024-09-15T23:56:54.986306+0000","last_unstale":"2024-09-15T23:56:56.992630+0000","last_undegraded":"2024-09-15T23:56:56.992630+0000","last_fullsized":"2024-09-15T23:56:56.992630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:40.725441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751761+0000","last_change":"2024-09-15T23:56:55.973928+0000","last_active":"2024-09-15T23:56:57.751761+0000","last_peered":"2024-09-15T23:56:57.751761+0000","last_clean":"2024-09-15T23:56:57.751761+0000","last_became_active":"2024-09-15T23:56:55.973107+0000","last_became_peered":"2024-09-15T23:56:55.973107+0000","last_unstale":"2024-09-15T23:56:57.751761+0000","last_undegraded":"2024-09-15T23:56:57.751761+0000","last_fullsized":"2024-09-15T23:56:57.751761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:30.375034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252606+0000","last_change":"2024-09-15T23:56:54.986074+0000","last_active":"2024-09-15T23:56:57.252606+0000","last_peered":"2024-09-15T23:56:57.252606+0000","last_clean":"2024-09-15T23:56:57.252606+0000","last_became_active":"2024-09-15T23:56:54.985826+0000","last_became_peered":"2024-09-15T23:56:54.985826+0000","last_unstale":"2024-09-15T23:56:57.252606+0000","last_undegraded":"2024-09-15T23:56:57.252606+0000","last_fullsized":"2024-09-15T23:56:57.252606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:06.066930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252009+0000","last_change":"2024-09-15T23:56:56.006520+0000","last_active":"2024-09-15T23:56:57.252009+0000","last_peered":"2024-09-15T23:56:57.252009+0000","last_clean":"2024-09-15T23:56:57.252009+0000","last_became_active":"2024-09-15T23:56:56.006086+0000","last_became_peered":"2024-09-15T23:56:56.006086+0000","last_unstale":"2024-09-15T23:56:57.252009+0000","last_undegraded":"2024-09-15T23:56:57.252009+0000","last_fullsized":"2024-09-15T23:56:57.252009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:04.416975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.979871+0000","last_change":"2024-09-15T23:56:54.987749+0000","last_active":"2024-09-15T23:56:56.979871+0000","last_peered":"2024-09-15T23:56:56.979871+0000","last_clean":"2024-09-15T23:56:56.979871+0000","last_became_active":"2024-09-15T23:56:54.987176+0000","last_became_peered":"2024-09-15T23:56:54.987176+0000","last_unstale":"2024-09-15T23:56:56.979871+0000","last_undegraded":"2024-09-15T23:56:56.979871+0000","last_fullsized":"2024-09-15T23:56:56.979871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:09.647148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252252+0000","last_change":"2024-09-15T23:56:54.960462+0000","last_active":"2024-09-15T23:56:57.252252+0000","last_peered":"2024-09-15T23:56:57.252252+0000","last_clean":"2024-09-15T23:56:57.252252+0000","last_became_active":"2024-09-15T23:56:54.960172+0000","last_became_peered":"2024-09-15T23:56:54.960172+0000","last_unstale":"2024-09-15T23:56:57.252252+0000","last_undegraded":"2024-09-15T23:56:57.252252+0000","last_fullsized":"2024-09-15T23:56:57.252252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:02.312104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991046+0000","last_change":"2024-09-15T23:56:55.969820+0000","last_active":"2024-09-15T23:56:56.991046+0000","last_peered":"2024-09-15T23:56:56.991046+0000","last_clean":"2024-09-15T23:56:56.991046+0000","last_became_active":"2024-09-15T23:56:55.967469+0000","last_became_peered":"2024-09-15T23:56:55.967469+0000","last_unstale":"2024-09-15T23:56:56.991046+0000","last_undegraded":"2024-09-15T23:56:56.991046+0000","last_fullsized":"2024-09-15T23:56:56.991046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:15.623608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752041+0000","last_change":"2024-09-15T23:56:54.962171+0000","last_active":"2024-09-15T23:56:57.752041+0000","last_peered":"2024-09-15T23:56:57.752041+0000","last_clean":"2024-09-15T23:56:57.752041+0000","last_became_active":"2024-09-15T23:56:54.961049+0000","last_became_peered":"2024-09-15T23:56:54.961049+0000","last_unstale":"2024-09-15T23:56:57.752041+0000","last_undegraded":"2024-09-15T23:56:57.752041+0000","last_fullsized":"2024-09-15T23:56:57.752041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:02.312104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940338+0000","last_change":"2024-09-15T23:56:53.940338+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940338+0000","last_undegraded":"2024-09-15T23:56:53.940338+0000","last_fullsized":"2024-09-15T23:56:53.940338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752209+0000","last_change":"2024-09-15T23:56:56.004365+0000","last_active":"2024-09-15T23:56:57.752209+0000","last_peered":"2024-09-15T23:56:57.752209+0000","last_clean":"2024-09-15T23:56:57.752209+0000","last_became_active":"2024-09-15T23:56:56.004079+0000","last_became_peered":"2024-09-15T23:56:56.004079+0000","last_unstale":"2024-09-15T23:56:57.752209+0000","last_undegraded":"2024-09-15T23:56:57.752209+0000","last_fullsized":"2024-09-15T23:56:57.752209+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:19.060961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:55.972124+0000","last_change":"2024-09-15T23:56:54.983702+0000","last_active":"2024-09-15T23:56:55.972124+0000","last_peered":"2024-09-15T23:56:55.972124+0000","last_clean":"2024-09-15T23:56:55.972124+0000","last_became_active":"2024-09-15T23:56:54.983127+0000","last_became_peered":"2024-09-15T23:56:54.983127+0000","last_unstale":"2024-09-15T23:56:55.972124+0000","last_undegraded":"2024-09-15T23:56:55.972124+0000","last_fullsized":"2024-09-15T23:56:55.972124+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:25.310145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993972+0000","last_change":"2024-09-15T23:56:55.987825+0000","last_active":"2024-09-15T23:56:56.993972+0000","last_peered":"2024-09-15T23:56:56.993972+0000","last_clean":"2024-09-15T23:56:56.993972+0000","last_became_active":"2024-09-15T23:56:55.976689+0000","last_became_peered":"2024-09-15T23:56:55.976689+0000","last_unstale":"2024-09-15T23:56:56.993972+0000","last_undegraded":"2024-09-15T23:56:56.993972+0000","last_fullsized":"2024-09-15T23:56:56.993972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:39.595978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751496+0000","last_change":"2024-09-15T23:56:54.957629+0000","last_active":"2024-09-15T23:56:57.751496+0000","last_peered":"2024-09-15T23:56:57.751496+0000","last_clean":"2024-09-15T23:56:57.751496+0000","last_became_active":"2024-09-15T23:56:54.957340+0000","last_became_peered":"2024-09-15T23:56:54.957340+0000","last_unstale":"2024-09-15T23:56:57.751496+0000","last_undegraded":"2024-09-15T23:56:57.751496+0000","last_fullsized":"2024-09-15T23:56:57.751496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:45.950977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754194+0000","last_change":"2024-09-15T23:56:55.994826+0000","last_active":"2024-09-15T23:56:57.754194+0000","last_peered":"2024-09-15T23:56:57.754194+0000","last_clean":"2024-09-15T23:56:57.754194+0000","last_became_active":"2024-09-15T23:56:55.994110+0000","last_became_peered":"2024-09-15T23:56:55.994110+0000","last_unstale":"2024-09-15T23:56:57.754194+0000","last_undegraded":"2024-09-15T23:56:57.754194+0000","last_fullsized":"2024-09-15T23:56:57.754194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:41.281743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992782+0000","last_change":"2024-09-15T23:56:54.984135+0000","last_active":"2024-09-15T23:56:56.992782+0000","last_peered":"2024-09-15T23:56:56.992782+0000","last_clean":"2024-09-15T23:56:56.992782+0000","last_became_active":"2024-09-15T23:56:54.983684+0000","last_became_peered":"2024-09-15T23:56:54.983684+0000","last_unstale":"2024-09-15T23:56:56.992782+0000","last_undegraded":"2024-09-15T23:56:56.992782+0000","last_fullsized":"2024-09-15T23:56:56.992782+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:37.846622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:55.971706+0000","last_change":"2024-09-15T23:56:54.974116+0000","last_active":"2024-09-15T23:56:55.971706+0000","last_peered":"2024-09-15T23:56:55.971706+0000","last_clean":"2024-09-15T23:56:55.971706+0000","last_became_active":"2024-09-15T23:56:54.973419+0000","last_became_peered":"2024-09-15T23:56:54.973419+0000","last_unstale":"2024-09-15T23:56:55.971706+0000","last_undegraded":"2024-09-15T23:56:55.971706+0000","last_fullsized":"2024-09-15T23:56:55.971706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:17.992076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251270+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:56:57.251270+0000","last_peered":"2024-09-15T23:56:57.251270+0000","last_clean":"2024-09-15T23:56:57.251270+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:56:57.251270+0000","last_undegraded":"2024-09-15T23:56:57.251270+0000","last_fullsized":"2024-09-15T23:56:57.251270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":917504,"data_stored":412618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":917504,"data_stored":412638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":913408,"data_stored":411988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":872448,"data_stored":391440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":872448,"data_stored":391440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1519616,"data_stored":1003980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":913408,"data_stored":411988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1495040,"data_stored":995732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:57:00.122 INFO:tasks.ceph.ceph_manager.ceph:PG 12.34 is not active+clean 2024-09-15T23:57:00.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:54.932188+0000', 'last_change': '2024-09-15T23:56:54.932188+0000', 'last_active': '2024-09-15T23:56:54.932188+0000', 'last_peered': '2024-09-15T23:56:54.932188+0000', 'last_clean': '2024-09-15T23:56:54.932188+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:54.932188+0000', 'last_undegraded': '2024-09-15T23:56:54.932188+0000', 'last_fullsized': '2024-09-15T23:56:54.932188+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:57:00.123 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2b is not active+clean 2024-09-15T23:57:00.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:54.932188+0000', 'last_change': '2024-09-15T23:56:54.932188+0000', 'last_active': '2024-09-15T23:56:54.932188+0000', 'last_peered': '2024-09-15T23:56:54.932188+0000', 'last_clean': '2024-09-15T23:56:54.932188+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:54.932188+0000', 'last_undegraded': '2024-09-15T23:56:54.932188+0000', 'last_fullsized': '2024-09-15T23:56:54.932188+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:57:00.123 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1e is not active+clean 2024-09-15T23:57:00.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:56:53.942231+0000', 'last_change': '2024-09-15T23:56:53.942231+0000', 'last_active': '2024-09-15T23:56:53.921998+0000', 'last_peered': '2024-09-15T23:56:53.921998+0000', 'last_clean': '2024-09-15T23:56:53.921998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:53.942231+0000', 'last_undegraded': '2024-09-15T23:56:53.942231+0000', 'last_fullsized': '2024-09-15T23:56:53.942231+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:57:00.123 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1a is not active+clean 2024-09-15T23:57:00.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:54.932188+0000', 'last_change': '2024-09-15T23:56:54.932188+0000', 'last_active': '2024-09-15T23:56:54.932188+0000', 'last_peered': '2024-09-15T23:56:54.932188+0000', 'last_clean': '2024-09-15T23:56:54.932188+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:54.932188+0000', 'last_undegraded': '2024-09-15T23:56:54.932188+0000', 'last_fullsized': '2024-09-15T23:56:54.932188+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:57:00.123 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1c is not active+clean 2024-09-15T23:57:00.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:56:53.940540+0000', 'last_change': '2024-09-15T23:56:53.940540+0000', 'last_active': '2024-09-15T23:56:53.921998+0000', 'last_peered': '2024-09-15T23:56:53.921998+0000', 'last_clean': '2024-09-15T23:56:53.921998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:53.940540+0000', 'last_undegraded': '2024-09-15T23:56:53.940540+0000', 'last_fullsized': '2024-09-15T23:56:53.940540+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:57:00.123 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1b is not active+clean 2024-09-15T23:57:00.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:56:53.939966+0000', 'last_change': '2024-09-15T23:56:53.939966+0000', 'last_active': '2024-09-15T23:56:53.921998+0000', 'last_peered': '2024-09-15T23:56:53.921998+0000', 'last_clean': '2024-09-15T23:56:53.921998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:53.939966+0000', 'last_undegraded': '2024-09-15T23:56:53.939966+0000', 'last_fullsized': '2024-09-15T23:56:53.939966+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:57:00.124 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1a is not active+clean 2024-09-15T23:57:00.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:56:53.940540+0000', 'last_change': '2024-09-15T23:56:53.940540+0000', 'last_active': '2024-09-15T23:56:53.921998+0000', 'last_peered': '2024-09-15T23:56:53.921998+0000', 'last_clean': '2024-09-15T23:56:53.921998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:53.940540+0000', 'last_undegraded': '2024-09-15T23:56:53.940540+0000', 'last_fullsized': '2024-09-15T23:56:53.940540+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:57:00.124 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1e is not active+clean 2024-09-15T23:57:00.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:54.932188+0000', 'last_change': '2024-09-15T23:56:54.932188+0000', 'last_active': '2024-09-15T23:56:54.932188+0000', 'last_peered': '2024-09-15T23:56:54.932188+0000', 'last_clean': '2024-09-15T23:56:54.932188+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:54.932188+0000', 'last_undegraded': '2024-09-15T23:56:54.932188+0000', 'last_fullsized': '2024-09-15T23:56:54.932188+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:57:00.124 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1f is not active+clean 2024-09-15T23:57:00.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:54.932188+0000', 'last_change': '2024-09-15T23:56:54.932188+0000', 'last_active': '2024-09-15T23:56:54.932188+0000', 'last_peered': '2024-09-15T23:56:54.932188+0000', 'last_clean': '2024-09-15T23:56:54.932188+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:54.932188+0000', 'last_undegraded': '2024-09-15T23:56:54.932188+0000', 'last_fullsized': '2024-09-15T23:56:54.932188+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:57:00.124 INFO:tasks.ceph.ceph_manager.ceph:PG 12.11 is not active+clean 2024-09-15T23:57:00.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:54.932188+0000', 'last_change': '2024-09-15T23:56:54.932188+0000', 'last_active': '2024-09-15T23:56:54.932188+0000', 'last_peered': '2024-09-15T23:56:54.932188+0000', 'last_clean': '2024-09-15T23:56:54.932188+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:54.932188+0000', 'last_undegraded': '2024-09-15T23:56:54.932188+0000', 'last_fullsized': '2024-09-15T23:56:54.932188+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:57:00.125 INFO:tasks.ceph.ceph_manager.ceph:PG 11.14 is not active+clean 2024-09-15T23:57:00.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:56:53.940983+0000', 'last_change': '2024-09-15T23:56:53.940983+0000', 'last_active': '2024-09-15T23:56:53.921998+0000', 'last_peered': '2024-09-15T23:56:53.921998+0000', 'last_clean': '2024-09-15T23:56:53.921998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:53.940983+0000', 'last_undegraded': '2024-09-15T23:56:53.940983+0000', 'last_fullsized': '2024-09-15T23:56:53.940983+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:57:00.125 INFO:tasks.ceph.ceph_manager.ceph:PG 11.12 is not active+clean 2024-09-15T23:57:00.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:56:53.941555+0000', 'last_change': '2024-09-15T23:56:53.941555+0000', 'last_active': '2024-09-15T23:56:53.921998+0000', 'last_peered': '2024-09-15T23:56:53.921998+0000', 'last_clean': '2024-09-15T23:56:53.921998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:53.941555+0000', 'last_undegraded': '2024-09-15T23:56:53.941555+0000', 'last_fullsized': '2024-09-15T23:56:53.941555+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:57:00.125 INFO:tasks.ceph.ceph_manager.ceph:PG 12.16 is not active+clean 2024-09-15T23:57:00.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:54.932188+0000', 'last_change': '2024-09-15T23:56:54.932188+0000', 'last_active': '2024-09-15T23:56:54.932188+0000', 'last_peered': '2024-09-15T23:56:54.932188+0000', 'last_clean': '2024-09-15T23:56:54.932188+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:54.932188+0000', 'last_undegraded': '2024-09-15T23:56:54.932188+0000', 'last_fullsized': '2024-09-15T23:56:54.932188+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:57:00.125 INFO:tasks.ceph.ceph_manager.ceph:PG 12.f is not active+clean 2024-09-15T23:57:00.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:54.932188+0000', 'last_change': '2024-09-15T23:56:54.932188+0000', 'last_active': '2024-09-15T23:56:54.932188+0000', 'last_peered': '2024-09-15T23:56:54.932188+0000', 'last_clean': '2024-09-15T23:56:54.932188+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:54.932188+0000', 'last_undegraded': '2024-09-15T23:56:54.932188+0000', 'last_fullsized': '2024-09-15T23:56:54.932188+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:57:00.125 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2 is not active+clean 2024-09-15T23:57:00.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:54.932188+0000', 'last_change': '2024-09-15T23:56:54.932188+0000', 'last_active': '2024-09-15T23:56:54.932188+0000', 'last_peered': '2024-09-15T23:56:54.932188+0000', 'last_clean': '2024-09-15T23:56:54.932188+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:54.932188+0000', 'last_undegraded': '2024-09-15T23:56:54.932188+0000', 'last_fullsized': '2024-09-15T23:56:54.932188+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:57:00.126 INFO:tasks.ceph.ceph_manager.ceph:PG 12.4 is not active+clean 2024-09-15T23:57:00.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:54.932188+0000', 'last_change': '2024-09-15T23:56:54.932188+0000', 'last_active': '2024-09-15T23:56:54.932188+0000', 'last_peered': '2024-09-15T23:56:54.932188+0000', 'last_clean': '2024-09-15T23:56:54.932188+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:54.932188+0000', 'last_undegraded': '2024-09-15T23:56:54.932188+0000', 'last_fullsized': '2024-09-15T23:56:54.932188+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:57:00.126 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3 is not active+clean 2024-09-15T23:57:00.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 72, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:56:53.940338+0000', 'last_change': '2024-09-15T23:56:53.940338+0000', 'last_active': '2024-09-15T23:56:53.921998+0000', 'last_peered': '2024-09-15T23:56:53.921998+0000', 'last_clean': '2024-09-15T23:56:53.921998+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:53.940338+0000', 'last_undegraded': '2024-09-15T23:56:53.940338+0000', 'last_fullsized': '2024-09-15T23:56:53.940338+0000', 'mapping_epoch': 72, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:53.921998+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:57:00.126 INFO:tasks.ceph.ceph_manager.ceph:PG 12.d is not active+clean 2024-09-15T23:57:00.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:56:54.932188+0000', 'last_change': '2024-09-15T23:56:54.932188+0000', 'last_active': '2024-09-15T23:56:54.932188+0000', 'last_peered': '2024-09-15T23:56:54.932188+0000', 'last_clean': '2024-09-15T23:56:54.932188+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:56:54.932188+0000', 'last_undegraded': '2024-09-15T23:56:54.932188+0000', 'last_fullsized': '2024-09-15T23:56:54.932188+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'last_clean_scrub_stamp': '2024-09-15T23:56:54.932188+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:57:00.127 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:57:00.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.250+0000 7f3abd0e1640 1 Processor -- start 2024-09-15T23:57:00.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.250+0000 7f3abd0e1640 1 -- start start 2024-09-15T23:57:00.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.254+0000 7f3abd0e1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab8154d60 0x7f3ab80b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.254+0000 7f3abd0e1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3ab806ccd0 0x7f3ab806d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.254+0000 7f3abd0e1640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ab8155140 con 0x7f3ab80cd500 2024-09-15T23:57:00.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.254+0000 7f3abd0e1640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3ab815bcc0 con 0x7f3ab806ccd0 2024-09-15T23:57:00.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.254+0000 7f3abd0e1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab806d660 con 0x7f3ab8154d60 2024-09-15T23:57:00.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.254+0000 7f3aae59c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3ab80cd500 0x7f3ab815b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55264/0 (socket says 172.21.15.112:55264) 2024-09-15T23:57:00.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.254+0000 7f3aae59c640 1 -- 172.21.15.112:0/3509590808 learned_addr learned my addr 172.21.15.112:0/3509590808 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:00.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.254+0000 7f3ab759e640 1 --2- 172.21.15.112:0/3509590808 >> v2:172.21.15.112:3300/0 conn(0x7f3ab806ccd0 0x7f3ab806d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:00.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.254+0000 7f3ab6d9d640 1 --2- 172.21.15.112:0/3509590808 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab8154d60 0x7f3ab80b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:00.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.254+0000 7f3ab759e640 1 -- 172.21.15.112:0/3509590808 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab8154d60 msgr2=0x7f3ab80b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:00.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.254+0000 7f3ab759e640 1 --2- 172.21.15.112:0/3509590808 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab8154d60 0x7f3ab80b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.254+0000 7f3ab759e640 1 -- 172.21.15.112:0/3509590808 >> v1:172.21.15.112:6789/0 conn(0x7f3ab80cd500 legacy=0x7f3ab815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.254+0000 7f3ab759e640 1 -- 172.21.15.112:0/3509590808 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab80b4960 con 0x7f3ab806ccd0 2024-09-15T23:57:00.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.254+0000 7f3ab659c640 1 -- 172.21.15.112:0/3509590808 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4110556021 0 0) 0x7f3ab8155140 con 0x7f3ab80cd500 2024-09-15T23:57:00.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3ab759e640 1 --2- 172.21.15.112:0/3509590808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab806ccd0 0x7f3ab806d120 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00097c0 tx=0x7f3ab001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508456c7feaac700 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:00.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3ab659c640 1 -- 172.21.15.112:0/3509590808 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab00b0070 con 0x7f3ab806ccd0 2024-09-15T23:57:00.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3ab659c640 1 -- 172.21.15.112:0/3509590808 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab00ab600 con 0x7f3ab806ccd0 2024-09-15T23:57:00.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3ab659c640 1 -- 172.21.15.112:0/3509590808 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab00ab9d0 con 0x7f3ab806ccd0 2024-09-15T23:57:00.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 -- 172.21.15.112:0/3509590808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab806ccd0 msgr2=0x7f3ab806d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 --2- 172.21.15.112:0/3509590808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab806ccd0 0x7f3ab806d120 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00097c0 tx=0x7f3ab001c410 comp rx=0 tx=0).stop 2024-09-15T23:57:00.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 -- 172.21.15.112:0/3509590808 shutdown_connections 2024-09-15T23:57:00.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 --2- 172.21.15.112:0/3509590808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab806ccd0 0x7f3ab806d120 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 --2- 172.21.15.112:0/3509590808 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab8154d60 0x7f3ab80b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 -- 172.21.15.112:0/3509590808 >> 172.21.15.112:0/3509590808 conn(0x7f3ab8072670 msgr2=0x7f3ab8072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:00.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 -- 172.21.15.112:0/3509590808 shutdown_connections 2024-09-15T23:57:00.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 -- 172.21.15.112:0/3509590808 wait complete. 2024-09-15T23:57:00.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 Processor -- start 2024-09-15T23:57:00.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 -- start start 2024-09-15T23:57:00.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab806ccd0 0x7f3ab814c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab80cd500 0x7f3ab8154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ab8154d60 0x7f3ab806fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab80b4160 con 0x7f3ab806ccd0 2024-09-15T23:57:00.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab80b3fe0 con 0x7f3ab8154d60 2024-09-15T23:57:00.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab80cecd0 con 0x7f3ab80cd500 2024-09-15T23:57:00.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3ab6d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab806ccd0 0x7f3ab814c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:00.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3ab6d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab806ccd0 0x7f3ab814c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43464/0 (socket says 172.21.15.112:43464) 2024-09-15T23:57:00.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3ab6d9d640 1 -- 172.21.15.112:0/2495122258 learned_addr learned my addr 172.21.15.112:0/2495122258 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:00.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3ab6d9d640 1 -- 172.21.15.112:0/2495122258 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab80cd500 msgr2=0x7f3ab8154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3ab6d9d640 1 --2- 172.21.15.112:0/2495122258 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab80cd500 0x7f3ab8154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3ab6d9d640 1 -- 172.21.15.112:0/2495122258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ab8154d60 msgr2=0x7f3ab806fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3ab759e640 1 --2- 172.21.15.112:0/2495122258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ab8154d60 0x7f3ab806fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3ab6d9d640 1 --2- 172.21.15.112:0/2495122258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ab8154d60 0x7f3ab806fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3ab6d9d640 1 -- 172.21.15.112:0/2495122258 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab8153a40 con 0x7f3ab806ccd0 2024-09-15T23:57:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3ab6d9d640 1 --2- 172.21.15.112:0/2495122258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab806ccd0 0x7f3ab814c380 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8007ef0 tx=0x7f3aa800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3aaffff640 1 -- 172.21.15.112:0/2495122258 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8014620 con 0x7f3ab806ccd0 2024-09-15T23:57:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3aaffff640 1 -- 172.21.15.112:0/2495122258 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa8019070 con 0x7f3ab806ccd0 2024-09-15T23:57:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 -- 172.21.15.112:0/2495122258 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab8153760 con 0x7f3ab806ccd0 2024-09-15T23:57:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3aaffff640 1 -- 172.21.15.112:0/2495122258 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8014a00 con 0x7f3ab806ccd0 2024-09-15T23:57:00.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.258+0000 7f3abd0e1640 1 -- 172.21.15.112:0/2495122258 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab80cbf40 con 0x7f3ab806ccd0 2024-09-15T23:57:00.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.262+0000 7f3abd0e1640 1 -- 172.21.15.112:0/2495122258 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ab80cba90 con 0x7f3ab806ccd0 2024-09-15T23:57:00.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.262+0000 7f3aaffff640 1 -- 172.21.15.112:0/2495122258 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3aa8014ba0 con 0x7f3ab806ccd0 2024-09-15T23:57:00.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.262+0000 7f3aaffff640 1 --2- 172.21.15.112:0/2495122258 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3a980678c0 0x7f3a98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.262+0000 7f3aaffff640 1 -- 172.21.15.112:0/2495122258 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f3aa8087600 con 0x7f3ab806ccd0 2024-09-15T23:57:00.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.262+0000 7f3aae59c640 1 --2- 172.21.15.112:0/2495122258 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3a980678c0 0x7f3a98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:00.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.262+0000 7f3aae59c640 1 --2- 172.21.15.112:0/2495122258 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3a980678c0 0x7f3a98069d80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3ab81587f0 tx=0x7f3aa0007950 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:00.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.266+0000 7f3aaffff640 1 -- 172.21.15.112:0/2495122258 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3aa801b310 con 0x7f3ab806ccd0 2024-09-15T23:57:00.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.482+0000 7f3abd0e1640 1 -- 172.21.15.112:0/2495122258 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3ab806d120 con 0x7f3ab806ccd0 2024-09-15T23:57:00.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.482+0000 7f3aaffff640 1 -- 172.21.15.112:0/2495122258 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1636 (secure 0 0 0) 0x7f3aa8058090 con 0x7f3ab806ccd0 2024-09-15T23:57:00.483 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:00.483 INFO:teuthology.orchestra.run.smithi112.stdout:{"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":213,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":75,"num_osds":8,"num_up_osds":8,"osd_up_since":1726444419,"num_in_osds":8,"osd_in_since":1726444408,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":79},{"state_name":"unknown","count":11},{"state_name":"creating+peering","count":7}],"num_pgs":97,"num_pools":3,"num_objects":19,"data_bytes":591166,"bytes_used":263933952,"bytes_avail":772830179328,"bytes_total":773094113280,"unknown_pgs_ratio":0.11340206116437912,"inactive_pgs_ratio":0.072164945304393768,"write_bytes_sec":2101,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":37,"btime":"2024-09-15T23:56:58:369858+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6021}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-15T23:56:43.287378+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:57:00.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.486+0000 7f3abd0e1640 1 -- 172.21.15.112:0/2495122258 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3a980678c0 msgr2=0x7f3a98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.486+0000 7f3abd0e1640 1 --2- 172.21.15.112:0/2495122258 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3a980678c0 0x7f3a98069d80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3ab81587f0 tx=0x7f3aa0007950 comp rx=0 tx=0).stop 2024-09-15T23:57:00.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.486+0000 7f3abd0e1640 1 -- 172.21.15.112:0/2495122258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab806ccd0 msgr2=0x7f3ab814c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.486+0000 7f3abd0e1640 1 --2- 172.21.15.112:0/2495122258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab806ccd0 0x7f3ab814c380 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8007ef0 tx=0x7f3aa800e4b0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.486+0000 7f3abd0e1640 1 -- 172.21.15.112:0/2495122258 shutdown_connections 2024-09-15T23:57:00.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.486+0000 7f3abd0e1640 1 --2- 172.21.15.112:0/2495122258 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3a980678c0 0x7f3a98069d80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.486+0000 7f3abd0e1640 1 --2- 172.21.15.112:0/2495122258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ab8154d60 0x7f3ab806fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.486+0000 7f3abd0e1640 1 --2- 172.21.15.112:0/2495122258 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ab80cd500 0x7f3ab8154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.486+0000 7f3abd0e1640 1 --2- 172.21.15.112:0/2495122258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab806ccd0 0x7f3ab814c380 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.486+0000 7f3abd0e1640 1 -- 172.21.15.112:0/2495122258 >> 172.21.15.112:0/2495122258 conn(0x7f3ab8072670 msgr2=0x7f3ab8157370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:00.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.486+0000 7f3abd0e1640 1 -- 172.21.15.112:0/2495122258 shutdown_connections 2024-09-15T23:57:00.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.486+0000 7f3abd0e1640 1 -- 172.21.15.112:0/2495122258 wait complete. 2024-09-15T23:57:00.501 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:57:00.501 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:57:00.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.606+0000 7fa2e01c2640 1 Processor -- start 2024-09-15T23:57:00.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.606+0000 7fa2e01c2640 1 -- start start 2024-09-15T23:57:00.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2e01c2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa2d815bec0 0x7fa2d80ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2e01c2640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa2d80af470 0x7fa2d806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2e01c2640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2d80b3290 con 0x7fa2d815c2a0 2024-09-15T23:57:00.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2e01c2640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa2d80b3570 con 0x7fa2d80af470 2024-09-15T23:57:00.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2e01c2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa2d80b3850 con 0x7fa2d815bec0 2024-09-15T23:57:00.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2de75f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa2d80af470 0x7fa2d806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:00.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2de75f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa2d80af470 0x7fa2d806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43466/0 (socket says 172.21.15.112:43466) 2024-09-15T23:57:00.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2de75f640 1 -- 172.21.15.112:0/3433869749 learned_addr learned my addr 172.21.15.112:0/3433869749 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:00.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2de75f640 1 -- 172.21.15.112:0/3433869749 >> v2:172.21.15.169:3300/0 conn(0x7fa2d815bec0 msgr2=0x7fa2d80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:00.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2ddf5e640 1 --2- 172.21.15.112:0/3433869749 >> v2:172.21.15.169:3300/0 conn(0x7fa2d815bec0 0x7fa2d80ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:00.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2de75f640 1 --2- 172.21.15.112:0/3433869749 >> v2:172.21.15.169:3300/0 conn(0x7fa2d815bec0 0x7fa2d80ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2de75f640 1 -- 172.21.15.112:0/3433869749 >> v1:172.21.15.169:6789/0 conn(0x7fa2d815c2a0 legacy=0x7fa2d80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:00.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2de75f640 1 -- 172.21.15.112:0/3433869749 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d80b3b30 con 0x7fa2d80af470 2024-09-15T23:57:00.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2de75f640 1 --2- 172.21.15.112:0/3433869749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2d80af470 0x7fa2d806e000 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8071710 tx=0x7fa2d001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d01dff9b831fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:00.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2dcf5c640 1 -- 172.21.15.112:0/3433869749 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00a5840 con 0x7fa2d80af470 2024-09-15T23:57:00.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2dcf5c640 1 -- 172.21.15.112:0/3433869749 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d00a59e0 con 0x7fa2d80af470 2024-09-15T23:57:00.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2dcf5c640 1 -- 172.21.15.112:0/3433869749 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00a5db0 con 0x7fa2d80af470 2024-09-15T23:57:00.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2e01c2640 1 -- 172.21.15.112:0/3433869749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2d80af470 msgr2=0x7fa2d806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2e01c2640 1 --2- 172.21.15.112:0/3433869749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2d80af470 0x7fa2d806e000 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8071710 tx=0x7fa2d001c980 comp rx=0 tx=0).stop 2024-09-15T23:57:00.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2e01c2640 1 -- 172.21.15.112:0/3433869749 shutdown_connections 2024-09-15T23:57:00.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2e01c2640 1 --2- 172.21.15.112:0/3433869749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2d80af470 0x7fa2d806e000 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2e01c2640 1 --2- 172.21.15.112:0/3433869749 >> v2:172.21.15.169:3300/0 conn(0x7fa2d815bec0 0x7fa2d80ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2e01c2640 1 -- 172.21.15.112:0/3433869749 >> 172.21.15.112:0/3433869749 conn(0x7fa2d80b1f90 msgr2=0x7fa2d80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:00.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2e01c2640 1 -- 172.21.15.112:0/3433869749 shutdown_connections 2024-09-15T23:57:00.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.610+0000 7fa2e01c2640 1 -- 172.21.15.112:0/3433869749 wait complete. 2024-09-15T23:57:00.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2e01c2640 1 Processor -- start 2024-09-15T23:57:00.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2e01c2640 1 -- start start 2024-09-15T23:57:00.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2e01c2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2d80af470 0x7fa2d8155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2e01c2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2d815bec0 0x7fa2d814a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2e01c2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d815c2a0 0x7fa2d814acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2e01c2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d806ed50 con 0x7fa2d815bec0 2024-09-15T23:57:00.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2e01c2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d80ad740 con 0x7fa2d815c2a0 2024-09-15T23:57:00.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2e01c2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa2d806eed0 con 0x7fa2d80af470 2024-09-15T23:57:00.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2dd75d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2d815bec0 0x7fa2d814a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:00.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2dd75d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2d815bec0 0x7fa2d814a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43470/0 (socket says 172.21.15.112:43470) 2024-09-15T23:57:00.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2dd75d640 1 -- 172.21.15.112:0/4250380645 learned_addr learned my addr 172.21.15.112:0/4250380645 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:00.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2ddf5e640 1 --2- 172.21.15.112:0/4250380645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2d80af470 0x7fa2d8155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:00.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2dd75d640 1 -- 172.21.15.112:0/4250380645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2d80af470 msgr2=0x7fa2d8155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2de75f640 1 --2- 172.21.15.112:0/4250380645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d815c2a0 0x7fa2d814acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:00.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2dd75d640 1 --2- 172.21.15.112:0/4250380645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2d80af470 0x7fa2d8155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2dd75d640 1 -- 172.21.15.112:0/4250380645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d815c2a0 msgr2=0x7fa2d814acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2dd75d640 1 --2- 172.21.15.112:0/4250380645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d815c2a0 0x7fa2d814acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2dd75d640 1 -- 172.21.15.112:0/4250380645 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d815c780 con 0x7fa2d815bec0 2024-09-15T23:57:00.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2dd75d640 1 --2- 172.21.15.112:0/4250380645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2d815bec0 0x7fa2d814a790 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800b3e0 tx=0x7fa2c800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:00.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2ce7fc640 1 -- 172.21.15.112:0/4250380645 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8015020 con 0x7fa2d815bec0 2024-09-15T23:57:00.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2ce7fc640 1 -- 172.21.15.112:0/4250380645 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c8011830 con 0x7fa2d815bec0 2024-09-15T23:57:00.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2e01c2640 1 -- 172.21.15.112:0/4250380645 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d815ca60 con 0x7fa2d815bec0 2024-09-15T23:57:00.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2ce7fc640 1 -- 172.21.15.112:0/4250380645 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8011c20 con 0x7fa2d815bec0 2024-09-15T23:57:00.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2e01c2640 1 -- 172.21.15.112:0/4250380645 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d815edb0 con 0x7fa2d815bec0 2024-09-15T23:57:00.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.614+0000 7fa2e01c2640 1 -- 172.21.15.112:0/4250380645 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d806f260 con 0x7fa2d815bec0 2024-09-15T23:57:00.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.618+0000 7fa2ce7fc640 1 -- 172.21.15.112:0/4250380645 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa2c8018020 con 0x7fa2d815bec0 2024-09-15T23:57:00.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.618+0000 7fa2ce7fc640 1 --2- 172.21.15.112:0/4250380645 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2bc0678c0 0x7fa2bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.618+0000 7fa2ddf5e640 1 --2- 172.21.15.112:0/4250380645 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2bc0678c0 0x7fa2bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:00.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.618+0000 7fa2ce7fc640 1 -- 172.21.15.112:0/4250380645 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fa2c8085a80 con 0x7fa2d815bec0 2024-09-15T23:57:00.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.618+0000 7fa2ddf5e640 1 --2- 172.21.15.112:0/4250380645 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2bc0678c0 0x7fa2bc069d80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80cf510 tx=0x7fa2d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:00.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.622+0000 7fa2ce7fc640 1 -- 172.21.15.112:0/4250380645 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa2c801f030 con 0x7fa2d815bec0 2024-09-15T23:57:00.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.766+0000 7fa2e01c2640 1 -- 172.21.15.112:0/4250380645 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa2d806fcd0 con 0x7fa2bc0678c0 2024-09-15T23:57:00.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.782+0000 7fa2ce7fc640 1 -- 172.21.15.112:0/4250380645 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249762 (secure 0 0 0) 0x7fa2d806fcd0 con 0x7fa2bc0678c0 2024-09-15T23:57:00.785 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:00.786 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:57:00.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.786+0000 7fa2e01c2640 1 -- 172.21.15.112:0/4250380645 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2bc0678c0 msgr2=0x7fa2bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.786+0000 7fa2e01c2640 1 --2- 172.21.15.112:0/4250380645 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2bc0678c0 0x7fa2bc069d80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80cf510 tx=0x7fa2d4008040 comp rx=0 tx=0).stop 2024-09-15T23:57:00.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.786+0000 7fa2e01c2640 1 -- 172.21.15.112:0/4250380645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2d815bec0 msgr2=0x7fa2d814a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.786+0000 7fa2e01c2640 1 --2- 172.21.15.112:0/4250380645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2d815bec0 0x7fa2d814a790 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800b3e0 tx=0x7fa2c800b8a0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.786+0000 7fa2e01c2640 1 -- 172.21.15.112:0/4250380645 shutdown_connections 2024-09-15T23:57:00.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.786+0000 7fa2e01c2640 1 --2- 172.21.15.112:0/4250380645 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa2bc0678c0 0x7fa2bc069d80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.786+0000 7fa2e01c2640 1 --2- 172.21.15.112:0/4250380645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d815c2a0 0x7fa2d814acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.786+0000 7fa2e01c2640 1 --2- 172.21.15.112:0/4250380645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa2d815bec0 0x7fa2d814a790 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.786+0000 7fa2e01c2640 1 --2- 172.21.15.112:0/4250380645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2d80af470 0x7fa2d8155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.786+0000 7fa2e01c2640 1 -- 172.21.15.112:0/4250380645 >> 172.21.15.112:0/4250380645 conn(0x7fa2d80b1f90 msgr2=0x7fa2d80cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:00.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.786+0000 7fa2e01c2640 1 -- 172.21.15.112:0/4250380645 shutdown_connections 2024-09-15T23:57:00.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:00.786+0000 7fa2e01c2640 1 -- 172.21.15.112:0/4250380645 wait complete. 2024-09-15T23:57:00.801 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2024-09-15T23:56:59.291468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257748,"kb_used_data":8224,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716972,"statfs":{"total":773094113280,"available":772830179328,"internally_reserved":0,"allocated":8421376,"data_stored":4431824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.358953"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252528+0000","last_change":"2024-09-15T23:56:55.979224+0000","last_active":"2024-09-15T23:56:57.252528+0000","last_peered":"2024-09-15T23:56:57.252528+0000","last_clean":"2024-09-15T23:56:57.252528+0000","last_became_active":"2024-09-15T23:56:55.978887+0000","last_became_peered":"2024-09-15T23:56:55.978887+0000","last_unstale":"2024-09-15T23:56:57.252528+0000","last_undegraded":"2024-09-15T23:56:57.252528+0000","last_fullsized":"2024-09-15T23:56:57.252528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:32.013874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993595+0000","last_change":"2024-09-15T23:56:55.999113+0000","last_active":"2024-09-15T23:56:56.993595+0000","last_peered":"2024-09-15T23:56:56.993595+0000","last_clean":"2024-09-15T23:56:56.993595+0000","last_became_active":"2024-09-15T23:56:55.997840+0000","last_became_peered":"2024-09-15T23:56:55.997840+0000","last_unstale":"2024-09-15T23:56:56.993595+0000","last_undegraded":"2024-09-15T23:56:56.993595+0000","last_fullsized":"2024-09-15T23:56:56.993595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:31.205893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993705+0000","last_change":"2024-09-15T23:56:55.989925+0000","last_active":"2024-09-15T23:56:56.993705+0000","last_peered":"2024-09-15T23:56:56.993705+0000","last_clean":"2024-09-15T23:56:56.993705+0000","last_became_active":"2024-09-15T23:56:55.986690+0000","last_became_peered":"2024-09-15T23:56:55.986690+0000","last_unstale":"2024-09-15T23:56:56.993705+0000","last_undegraded":"2024-09-15T23:56:56.993705+0000","last_fullsized":"2024-09-15T23:56:56.993705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:14.922569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751951+0000","last_change":"2024-09-15T23:56:55.984311+0000","last_active":"2024-09-15T23:56:57.751951+0000","last_peered":"2024-09-15T23:56:57.751951+0000","last_clean":"2024-09-15T23:56:57.751951+0000","last_became_active":"2024-09-15T23:56:55.984038+0000","last_became_peered":"2024-09-15T23:56:55.984038+0000","last_unstale":"2024-09-15T23:56:57.751951+0000","last_undegraded":"2024-09-15T23:56:57.751951+0000","last_fullsized":"2024-09-15T23:56:57.751951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:14.917805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753296+0000","last_change":"2024-09-15T23:56:55.973914+0000","last_active":"2024-09-15T23:56:57.753296+0000","last_peered":"2024-09-15T23:56:57.753296+0000","last_clean":"2024-09-15T23:56:57.753296+0000","last_became_active":"2024-09-15T23:56:55.973108+0000","last_became_peered":"2024-09-15T23:56:55.973108+0000","last_unstale":"2024-09-15T23:56:57.753296+0000","last_undegraded":"2024-09-15T23:56:57.753296+0000","last_fullsized":"2024-09-15T23:56:57.753296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.322294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012161+0000","last_change":"2024-09-15T23:56:55.993222+0000","last_active":"2024-09-15T23:56:56.012161+0000","last_peered":"2024-09-15T23:56:56.012161+0000","last_clean":"2024-09-15T23:56:56.012161+0000","last_became_active":"2024-09-15T23:56:55.992379+0000","last_became_peered":"2024-09-15T23:56:55.992379+0000","last_unstale":"2024-09-15T23:56:56.012161+0000","last_undegraded":"2024-09-15T23:56:56.012161+0000","last_fullsized":"2024-09-15T23:56:56.012161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:29:42.435805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751410+0000","last_change":"2024-09-15T23:56:55.969504+0000","last_active":"2024-09-15T23:56:57.751410+0000","last_peered":"2024-09-15T23:56:57.751410+0000","last_clean":"2024-09-15T23:56:57.751410+0000","last_became_active":"2024-09-15T23:56:55.968813+0000","last_became_peered":"2024-09-15T23:56:55.968813+0000","last_unstale":"2024-09-15T23:56:57.751410+0000","last_undegraded":"2024-09-15T23:56:57.751410+0000","last_fullsized":"2024-09-15T23:56:57.751410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:37.530094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990258+0000","last_change":"2024-09-15T23:56:55.974436+0000","last_active":"2024-09-15T23:56:56.990258+0000","last_peered":"2024-09-15T23:56:56.990258+0000","last_clean":"2024-09-15T23:56:56.990258+0000","last_became_active":"2024-09-15T23:56:55.973689+0000","last_became_peered":"2024-09-15T23:56:55.973689+0000","last_unstale":"2024-09-15T23:56:56.990258+0000","last_undegraded":"2024-09-15T23:56:56.990258+0000","last_fullsized":"2024-09-15T23:56:56.990258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:28.820185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752677+0000","last_change":"2024-09-15T23:56:55.995299+0000","last_active":"2024-09-15T23:56:57.752677+0000","last_peered":"2024-09-15T23:56:57.752677+0000","last_clean":"2024-09-15T23:56:57.752677+0000","last_became_active":"2024-09-15T23:56:55.994979+0000","last_became_peered":"2024-09-15T23:56:55.994979+0000","last_unstale":"2024-09-15T23:56:57.752677+0000","last_undegraded":"2024-09-15T23:56:57.752677+0000","last_fullsized":"2024-09-15T23:56:57.752677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:54.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252297+0000","last_change":"2024-09-15T23:56:55.996657+0000","last_active":"2024-09-15T23:56:57.252297+0000","last_peered":"2024-09-15T23:56:57.252297+0000","last_clean":"2024-09-15T23:56:57.252297+0000","last_became_active":"2024-09-15T23:56:55.996374+0000","last_became_peered":"2024-09-15T23:56:55.996374+0000","last_unstale":"2024-09-15T23:56:57.252297+0000","last_undegraded":"2024-09-15T23:56:57.252297+0000","last_fullsized":"2024-09-15T23:56:57.252297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:28.942569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.994065+0000","last_change":"2024-09-15T23:56:56.002531+0000","last_active":"2024-09-15T23:56:56.994065+0000","last_peered":"2024-09-15T23:56:56.994065+0000","last_clean":"2024-09-15T23:56:56.994065+0000","last_became_active":"2024-09-15T23:56:55.989953+0000","last_became_peered":"2024-09-15T23:56:55.989953+0000","last_unstale":"2024-09-15T23:56:56.994065+0000","last_undegraded":"2024-09-15T23:56:56.994065+0000","last_fullsized":"2024-09-15T23:56:56.994065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:42.470630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993324+0000","last_change":"2024-09-15T23:56:56.004482+0000","last_active":"2024-09-15T23:56:56.993324+0000","last_peered":"2024-09-15T23:56:56.993324+0000","last_clean":"2024-09-15T23:56:56.993324+0000","last_became_active":"2024-09-15T23:56:56.003824+0000","last_became_peered":"2024-09-15T23:56:56.003824+0000","last_unstale":"2024-09-15T23:56:56.993324+0000","last_undegraded":"2024-09-15T23:56:56.993324+0000","last_fullsized":"2024-09-15T23:56:56.993324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:32.353177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990654+0000","last_change":"2024-09-15T23:56:55.984462+0000","last_active":"2024-09-15T23:56:56.990654+0000","last_peered":"2024-09-15T23:56:56.990654+0000","last_clean":"2024-09-15T23:56:56.990654+0000","last_became_active":"2024-09-15T23:56:55.983722+0000","last_became_peered":"2024-09-15T23:56:55.983722+0000","last_unstale":"2024-09-15T23:56:56.990654+0000","last_undegraded":"2024-09-15T23:56:56.990654+0000","last_fullsized":"2024-09-15T23:56:56.990654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:39.347880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752123+0000","last_change":"2024-09-15T23:56:56.007000+0000","last_active":"2024-09-15T23:56:57.752123+0000","last_peered":"2024-09-15T23:56:57.752123+0000","last_clean":"2024-09-15T23:56:57.752123+0000","last_became_active":"2024-09-15T23:56:56.006350+0000","last_became_peered":"2024-09-15T23:56:56.006350+0000","last_unstale":"2024-09-15T23:56:57.752123+0000","last_undegraded":"2024-09-15T23:56:57.752123+0000","last_fullsized":"2024-09-15T23:56:57.752123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:59.909567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751377+0000","last_change":"2024-09-15T23:56:55.974231+0000","last_active":"2024-09-15T23:56:57.751377+0000","last_peered":"2024-09-15T23:56:57.751377+0000","last_clean":"2024-09-15T23:56:57.751377+0000","last_became_active":"2024-09-15T23:56:55.973543+0000","last_became_peered":"2024-09-15T23:56:55.973543+0000","last_unstale":"2024-09-15T23:56:57.751377+0000","last_undegraded":"2024-09-15T23:56:57.751377+0000","last_fullsized":"2024-09-15T23:56:57.751377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:58.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991496+0000","last_change":"2024-09-15T23:56:55.958076+0000","last_active":"2024-09-15T23:56:56.991496+0000","last_peered":"2024-09-15T23:56:56.991496+0000","last_clean":"2024-09-15T23:56:56.991496+0000","last_became_active":"2024-09-15T23:56:55.957404+0000","last_became_peered":"2024-09-15T23:56:55.957404+0000","last_unstale":"2024-09-15T23:56:56.991496+0000","last_undegraded":"2024-09-15T23:56:56.991496+0000","last_fullsized":"2024-09-15T23:56:56.991496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:23.266535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993642+0000","last_change":"2024-09-15T23:56:55.998591+0000","last_active":"2024-09-15T23:56:56.993642+0000","last_peered":"2024-09-15T23:56:56.993642+0000","last_clean":"2024-09-15T23:56:56.993642+0000","last_became_active":"2024-09-15T23:56:55.997788+0000","last_became_peered":"2024-09-15T23:56:55.997788+0000","last_unstale":"2024-09-15T23:56:56.993642+0000","last_undegraded":"2024-09-15T23:56:56.993642+0000","last_fullsized":"2024-09-15T23:56:56.993642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:50.441671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991220+0000","last_change":"2024-09-15T23:56:55.997317+0000","last_active":"2024-09-15T23:56:56.991220+0000","last_peered":"2024-09-15T23:56:56.991220+0000","last_clean":"2024-09-15T23:56:56.991220+0000","last_became_active":"2024-09-15T23:56:55.996587+0000","last_became_peered":"2024-09-15T23:56:55.996587+0000","last_unstale":"2024-09-15T23:56:56.991220+0000","last_undegraded":"2024-09-15T23:56:56.991220+0000","last_fullsized":"2024-09-15T23:56:56.991220+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:33.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012508+0000","last_change":"2024-09-15T23:56:55.994322+0000","last_active":"2024-09-15T23:56:56.012508+0000","last_peered":"2024-09-15T23:56:56.012508+0000","last_clean":"2024-09-15T23:56:56.012508+0000","last_became_active":"2024-09-15T23:56:55.993525+0000","last_became_peered":"2024-09-15T23:56:55.993525+0000","last_unstale":"2024-09-15T23:56:56.012508+0000","last_undegraded":"2024-09-15T23:56:56.012508+0000","last_fullsized":"2024-09-15T23:56:56.012508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:44.991594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992685+0000","last_change":"2024-09-15T23:56:56.011861+0000","last_active":"2024-09-15T23:56:56.992685+0000","last_peered":"2024-09-15T23:56:56.992685+0000","last_clean":"2024-09-15T23:56:56.992685+0000","last_became_active":"2024-09-15T23:56:56.011149+0000","last_became_peered":"2024-09-15T23:56:56.011149+0000","last_unstale":"2024-09-15T23:56:56.992685+0000","last_undegraded":"2024-09-15T23:56:56.992685+0000","last_fullsized":"2024-09-15T23:56:56.992685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:19.060961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252117+0000","last_change":"2024-09-15T23:56:55.984314+0000","last_active":"2024-09-15T23:56:57.252117+0000","last_peered":"2024-09-15T23:56:57.252117+0000","last_clean":"2024-09-15T23:56:57.252117+0000","last_became_active":"2024-09-15T23:56:55.983952+0000","last_became_peered":"2024-09-15T23:56:55.983952+0000","last_unstale":"2024-09-15T23:56:57.252117+0000","last_undegraded":"2024-09-15T23:56:57.252117+0000","last_fullsized":"2024-09-15T23:56:57.252117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:45:10.598663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992395+0000","last_change":"2024-09-15T23:56:56.004418+0000","last_active":"2024-09-15T23:56:56.992395+0000","last_peered":"2024-09-15T23:56:56.992395+0000","last_clean":"2024-09-15T23:56:56.992395+0000","last_became_active":"2024-09-15T23:56:56.003744+0000","last_became_peered":"2024-09-15T23:56:56.003744+0000","last_unstale":"2024-09-15T23:56:56.992395+0000","last_undegraded":"2024-09-15T23:56:56.992395+0000","last_fullsized":"2024-09-15T23:56:56.992395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:14.917805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.013320+0000","last_change":"2024-09-15T23:56:56.000438+0000","last_active":"2024-09-15T23:56:56.013320+0000","last_peered":"2024-09-15T23:56:56.013320+0000","last_clean":"2024-09-15T23:56:56.013320+0000","last_became_active":"2024-09-15T23:56:55.999839+0000","last_became_peered":"2024-09-15T23:56:55.999839+0000","last_unstale":"2024-09-15T23:56:56.013320+0000","last_undegraded":"2024-09-15T23:56:56.013320+0000","last_fullsized":"2024-09-15T23:56:56.013320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:41.952442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752800+0000","last_change":"2024-09-15T23:56:55.974824+0000","last_active":"2024-09-15T23:56:57.752800+0000","last_peered":"2024-09-15T23:56:57.752800+0000","last_clean":"2024-09-15T23:56:57.752800+0000","last_became_active":"2024-09-15T23:56:55.974296+0000","last_became_peered":"2024-09-15T23:56:55.974296+0000","last_unstale":"2024-09-15T23:56:57.752800+0000","last_undegraded":"2024-09-15T23:56:57.752800+0000","last_fullsized":"2024-09-15T23:56:57.752800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:32.353177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752021+0000","last_change":"2024-09-15T23:56:55.972869+0000","last_active":"2024-09-15T23:56:57.752021+0000","last_peered":"2024-09-15T23:56:57.752021+0000","last_clean":"2024-09-15T23:56:57.752021+0000","last_became_active":"2024-09-15T23:56:55.972567+0000","last_became_peered":"2024-09-15T23:56:55.972567+0000","last_unstale":"2024-09-15T23:56:57.752021+0000","last_undegraded":"2024-09-15T23:56:57.752021+0000","last_fullsized":"2024-09-15T23:56:57.752021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:20.287580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753525+0000","last_change":"2024-09-15T23:56:55.995902+0000","last_active":"2024-09-15T23:56:57.753525+0000","last_peered":"2024-09-15T23:56:57.753525+0000","last_clean":"2024-09-15T23:56:57.753525+0000","last_became_active":"2024-09-15T23:56:55.994271+0000","last_became_peered":"2024-09-15T23:56:55.994271+0000","last_unstale":"2024-09-15T23:56:57.753525+0000","last_undegraded":"2024-09-15T23:56:57.753525+0000","last_fullsized":"2024-09-15T23:56:57.753525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:04.379802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012213+0000","last_change":"2024-09-15T23:56:55.993324+0000","last_active":"2024-09-15T23:56:56.012213+0000","last_peered":"2024-09-15T23:56:56.012213+0000","last_clean":"2024-09-15T23:56:56.012213+0000","last_became_active":"2024-09-15T23:56:55.992543+0000","last_became_peered":"2024-09-15T23:56:55.992543+0000","last_unstale":"2024-09-15T23:56:56.012213+0000","last_undegraded":"2024-09-15T23:56:56.012213+0000","last_fullsized":"2024-09-15T23:56:56.012213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:10.974266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251818+0000","last_change":"2024-09-15T23:56:56.011651+0000","last_active":"2024-09-15T23:56:57.251818+0000","last_peered":"2024-09-15T23:56:57.251818+0000","last_clean":"2024-09-15T23:56:57.251818+0000","last_became_active":"2024-09-15T23:56:56.011342+0000","last_became_peered":"2024-09-15T23:56:56.011342+0000","last_unstale":"2024-09-15T23:56:57.251818+0000","last_undegraded":"2024-09-15T23:56:57.251818+0000","last_fullsized":"2024-09-15T23:56:57.251818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:02.575095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992637+0000","last_change":"2024-09-15T23:56:55.999632+0000","last_active":"2024-09-15T23:56:56.992637+0000","last_peered":"2024-09-15T23:56:56.992637+0000","last_clean":"2024-09-15T23:56:56.992637+0000","last_became_active":"2024-09-15T23:56:55.999003+0000","last_became_peered":"2024-09-15T23:56:55.999003+0000","last_unstale":"2024-09-15T23:56:56.992637+0000","last_undegraded":"2024-09-15T23:56:56.992637+0000","last_fullsized":"2024-09-15T23:56:56.992637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:27.375798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751513+0000","last_change":"2024-09-15T23:56:56.000881+0000","last_active":"2024-09-15T23:56:57.751513+0000","last_peered":"2024-09-15T23:56:57.751513+0000","last_clean":"2024-09-15T23:56:57.751513+0000","last_became_active":"2024-09-15T23:56:56.000550+0000","last_became_peered":"2024-09-15T23:56:56.000550+0000","last_unstale":"2024-09-15T23:56:57.751513+0000","last_undegraded":"2024-09-15T23:56:57.751513+0000","last_fullsized":"2024-09-15T23:56:57.751513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:16.086562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752125+0000","last_change":"2024-09-15T23:56:55.970381+0000","last_active":"2024-09-15T23:56:57.752125+0000","last_peered":"2024-09-15T23:56:57.752125+0000","last_clean":"2024-09-15T23:56:57.752125+0000","last_became_active":"2024-09-15T23:56:55.969605+0000","last_became_peered":"2024-09-15T23:56:55.969605+0000","last_unstale":"2024-09-15T23:56:57.752125+0000","last_undegraded":"2024-09-15T23:56:57.752125+0000","last_fullsized":"2024-09-15T23:56:57.752125+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:07.077120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754074+0000","last_change":"2024-09-15T23:56:54.986431+0000","last_active":"2024-09-15T23:56:57.754074+0000","last_peered":"2024-09-15T23:56:57.754074+0000","last_clean":"2024-09-15T23:56:57.754074+0000","last_became_active":"2024-09-15T23:56:54.986031+0000","last_became_peered":"2024-09-15T23:56:54.986031+0000","last_unstale":"2024-09-15T23:56:57.754074+0000","last_undegraded":"2024-09-15T23:56:57.754074+0000","last_fullsized":"2024-09-15T23:56:57.754074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:45.418494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752493+0000","last_change":"2024-09-15T23:56:55.980727+0000","last_active":"2024-09-15T23:56:57.752493+0000","last_peered":"2024-09-15T23:56:57.752493+0000","last_clean":"2024-09-15T23:56:57.752493+0000","last_became_active":"2024-09-15T23:56:55.973498+0000","last_became_peered":"2024-09-15T23:56:55.973498+0000","last_unstale":"2024-09-15T23:56:57.752493+0000","last_undegraded":"2024-09-15T23:56:57.752493+0000","last_fullsized":"2024-09-15T23:56:57.752493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:37.501600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.942231+0000","last_change":"2024-09-15T23:56:53.942231+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.942231+0000","last_undegraded":"2024-09-15T23:56:53.942231+0000","last_fullsized":"2024-09-15T23:56:53.942231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251960+0000","last_change":"2024-09-15T23:56:54.968341+0000","last_active":"2024-09-15T23:56:57.251960+0000","last_peered":"2024-09-15T23:56:57.251960+0000","last_clean":"2024-09-15T23:56:57.251960+0000","last_became_active":"2024-09-15T23:56:54.968071+0000","last_became_peered":"2024-09-15T23:56:54.968071+0000","last_unstale":"2024-09-15T23:56:57.251960+0000","last_undegraded":"2024-09-15T23:56:57.251960+0000","last_fullsized":"2024-09-15T23:56:57.251960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:49.633991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751297+0000","last_change":"2024-09-15T23:56:55.984390+0000","last_active":"2024-09-15T23:56:57.751297+0000","last_peered":"2024-09-15T23:56:57.751297+0000","last_clean":"2024-09-15T23:56:57.751297+0000","last_became_active":"2024-09-15T23:56:55.984141+0000","last_became_peered":"2024-09-15T23:56:55.984141+0000","last_unstale":"2024-09-15T23:56:57.751297+0000","last_undegraded":"2024-09-15T23:56:57.751297+0000","last_fullsized":"2024-09-15T23:56:57.751297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:48.336601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940540+0000","last_change":"2024-09-15T23:56:53.940540+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940540+0000","last_undegraded":"2024-09-15T23:56:53.940540+0000","last_fullsized":"2024-09-15T23:56:53.940540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012541+0000","last_change":"2024-09-15T23:56:55.997214+0000","last_active":"2024-09-15T23:56:56.012541+0000","last_peered":"2024-09-15T23:56:56.012541+0000","last_clean":"2024-09-15T23:56:56.012541+0000","last_became_active":"2024-09-15T23:56:55.992307+0000","last_became_peered":"2024-09-15T23:56:55.992307+0000","last_unstale":"2024-09-15T23:56:56.012541+0000","last_undegraded":"2024-09-15T23:56:56.012541+0000","last_fullsized":"2024-09-15T23:56:56.012541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:47.802236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.939966+0000","last_change":"2024-09-15T23:56:53.939966+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.939966+0000","last_undegraded":"2024-09-15T23:56:53.939966+0000","last_fullsized":"2024-09-15T23:56:53.939966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.994384+0000","last_change":"2024-09-15T23:56:56.004365+0000","last_active":"2024-09-15T23:56:56.994384+0000","last_peered":"2024-09-15T23:56:56.994384+0000","last_clean":"2024-09-15T23:56:56.994384+0000","last_became_active":"2024-09-15T23:56:56.003697+0000","last_became_peered":"2024-09-15T23:56:56.003697+0000","last_unstale":"2024-09-15T23:56:56.994384+0000","last_undegraded":"2024-09-15T23:56:56.994384+0000","last_fullsized":"2024-09-15T23:56:56.994384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:24.370163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940540+0000","last_change":"2024-09-15T23:56:53.940540+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940540+0000","last_undegraded":"2024-09-15T23:56:53.940540+0000","last_fullsized":"2024-09-15T23:56:53.940540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990195+0000","last_change":"2024-09-15T23:56:54.965160+0000","last_active":"2024-09-15T23:56:56.990195+0000","last_peered":"2024-09-15T23:56:56.990195+0000","last_clean":"2024-09-15T23:56:56.990195+0000","last_became_active":"2024-09-15T23:56:54.964317+0000","last_became_peered":"2024-09-15T23:56:54.964317+0000","last_unstale":"2024-09-15T23:56:56.990195+0000","last_undegraded":"2024-09-15T23:56:56.990195+0000","last_fullsized":"2024-09-15T23:56:56.990195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:53.719508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992537+0000","last_change":"2024-09-15T23:56:54.984630+0000","last_active":"2024-09-15T23:56:56.992537+0000","last_peered":"2024-09-15T23:56:56.992537+0000","last_clean":"2024-09-15T23:56:56.992537+0000","last_became_active":"2024-09-15T23:56:54.983896+0000","last_became_peered":"2024-09-15T23:56:54.983896+0000","last_unstale":"2024-09-15T23:56:56.992537+0000","last_undegraded":"2024-09-15T23:56:56.992537+0000","last_fullsized":"2024-09-15T23:56:56.992537+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:28.388939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992459+0000","last_change":"2024-09-15T23:56:55.989801+0000","last_active":"2024-09-15T23:56:56.992459+0000","last_peered":"2024-09-15T23:56:56.992459+0000","last_clean":"2024-09-15T23:56:56.992459+0000","last_became_active":"2024-09-15T23:56:55.989074+0000","last_became_peered":"2024-09-15T23:56:55.989074+0000","last_unstale":"2024-09-15T23:56:56.992459+0000","last_undegraded":"2024-09-15T23:56:56.992459+0000","last_fullsized":"2024-09-15T23:56:56.992459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:20.287580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752742+0000","last_change":"2024-09-15T23:56:54.959168+0000","last_active":"2024-09-15T23:56:57.752742+0000","last_peered":"2024-09-15T23:56:57.752742+0000","last_clean":"2024-09-15T23:56:57.752742+0000","last_became_active":"2024-09-15T23:56:54.958765+0000","last_became_peered":"2024-09-15T23:56:54.958765+0000","last_unstale":"2024-09-15T23:56:57.752742+0000","last_undegraded":"2024-09-15T23:56:57.752742+0000","last_fullsized":"2024-09-15T23:56:57.752742+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:36.491410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252161+0000","last_change":"2024-09-15T23:56:54.958234+0000","last_active":"2024-09-15T23:56:57.252161+0000","last_peered":"2024-09-15T23:56:57.252161+0000","last_clean":"2024-09-15T23:56:57.252161+0000","last_became_active":"2024-09-15T23:56:54.957887+0000","last_became_peered":"2024-09-15T23:56:54.957887+0000","last_unstale":"2024-09-15T23:56:57.252161+0000","last_undegraded":"2024-09-15T23:56:57.252161+0000","last_fullsized":"2024-09-15T23:56:57.252161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:36.491410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991152+0000","last_change":"2024-09-15T23:56:55.959205+0000","last_active":"2024-09-15T23:56:56.991152+0000","last_peered":"2024-09-15T23:56:56.991152+0000","last_clean":"2024-09-15T23:56:56.991152+0000","last_became_active":"2024-09-15T23:56:55.958373+0000","last_became_peered":"2024-09-15T23:56:55.958373+0000","last_unstale":"2024-09-15T23:56:56.991152+0000","last_undegraded":"2024-09-15T23:56:56.991152+0000","last_fullsized":"2024-09-15T23:56:56.991152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:23.272483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.016000+0000","last_change":"2024-09-15T23:56:54.977562+0000","last_active":"2024-09-15T23:56:56.016000+0000","last_peered":"2024-09-15T23:56:56.016000+0000","last_clean":"2024-09-15T23:56:56.016000+0000","last_became_active":"2024-09-15T23:56:54.976751+0000","last_became_peered":"2024-09-15T23:56:54.976751+0000","last_unstale":"2024-09-15T23:56:56.016000+0000","last_undegraded":"2024-09-15T23:56:56.016000+0000","last_fullsized":"2024-09-15T23:56:56.016000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:35.674580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.012244+0000","last_change":"2024-09-15T23:56:55.993382+0000","last_active":"2024-09-15T23:56:56.012244+0000","last_peered":"2024-09-15T23:56:56.012244+0000","last_clean":"2024-09-15T23:56:56.012244+0000","last_became_active":"2024-09-15T23:56:55.992592+0000","last_became_peered":"2024-09-15T23:56:55.992592+0000","last_unstale":"2024-09-15T23:56:56.012244+0000","last_undegraded":"2024-09-15T23:56:56.012244+0000","last_fullsized":"2024-09-15T23:56:56.012244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:32.291020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940983+0000","last_change":"2024-09-15T23:56:53.940983+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940983+0000","last_undegraded":"2024-09-15T23:56:53.940983+0000","last_fullsized":"2024-09-15T23:56:53.940983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752119+0000","last_change":"2024-09-15T23:56:55.995297+0000","last_active":"2024-09-15T23:56:57.752119+0000","last_peered":"2024-09-15T23:56:57.752119+0000","last_clean":"2024-09-15T23:56:57.752119+0000","last_became_active":"2024-09-15T23:56:55.994941+0000","last_became_peered":"2024-09-15T23:56:55.994941+0000","last_unstale":"2024-09-15T23:56:57.752119+0000","last_undegraded":"2024-09-15T23:56:57.752119+0000","last_fullsized":"2024-09-15T23:56:57.752119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:27.375798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252310+0000","last_change":"2024-09-15T23:56:54.967739+0000","last_active":"2024-09-15T23:56:57.252310+0000","last_peered":"2024-09-15T23:56:57.252310+0000","last_clean":"2024-09-15T23:56:57.252310+0000","last_became_active":"2024-09-15T23:56:54.967464+0000","last_became_peered":"2024-09-15T23:56:54.967464+0000","last_unstale":"2024-09-15T23:56:57.252310+0000","last_undegraded":"2024-09-15T23:56:57.252310+0000","last_fullsized":"2024-09-15T23:56:57.252310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:45.950977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252103+0000","last_change":"2024-09-15T23:56:56.006475+0000","last_active":"2024-09-15T23:56:57.252103+0000","last_peered":"2024-09-15T23:56:57.252103+0000","last_clean":"2024-09-15T23:56:57.252103+0000","last_became_active":"2024-09-15T23:56:56.006118+0000","last_became_peered":"2024-09-15T23:56:56.006118+0000","last_unstale":"2024-09-15T23:56:57.252103+0000","last_undegraded":"2024-09-15T23:56:57.252103+0000","last_fullsized":"2024-09-15T23:56:57.252103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:56.067306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.941555+0000","last_change":"2024-09-15T23:56:53.941555+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.941555+0000","last_undegraded":"2024-09-15T23:56:53.941555+0000","last_fullsized":"2024-09-15T23:56:53.941555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752761+0000","last_change":"2024-09-15T23:56:54.989708+0000","last_active":"2024-09-15T23:56:57.752761+0000","last_peered":"2024-09-15T23:56:57.752761+0000","last_clean":"2024-09-15T23:56:57.752761+0000","last_became_active":"2024-09-15T23:56:54.989300+0000","last_became_peered":"2024-09-15T23:56:54.989300+0000","last_unstale":"2024-09-15T23:56:57.752761+0000","last_undegraded":"2024-09-15T23:56:57.752761+0000","last_fullsized":"2024-09-15T23:56:57.752761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:47.414189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252603+0000","last_change":"2024-09-15T23:56:56.010338+0000","last_active":"2024-09-15T23:56:57.252603+0000","last_peered":"2024-09-15T23:56:57.252603+0000","last_clean":"2024-09-15T23:56:57.252603+0000","last_became_active":"2024-09-15T23:56:56.010068+0000","last_became_peered":"2024-09-15T23:56:56.010068+0000","last_unstale":"2024-09-15T23:56:57.252603+0000","last_undegraded":"2024-09-15T23:56:57.252603+0000","last_fullsized":"2024-09-15T23:56:57.252603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:47.563782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.015998+0000","last_change":"2024-09-15T23:56:54.971305+0000","last_active":"2024-09-15T23:56:56.015998+0000","last_peered":"2024-09-15T23:56:56.015998+0000","last_clean":"2024-09-15T23:56:56.015998+0000","last_became_active":"2024-09-15T23:56:54.970598+0000","last_became_peered":"2024-09-15T23:56:54.970598+0000","last_unstale":"2024-09-15T23:56:56.015998+0000","last_undegraded":"2024-09-15T23:56:56.015998+0000","last_fullsized":"2024-09-15T23:56:56.015998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:20.015026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752339+0000","last_change":"2024-09-15T23:56:55.992555+0000","last_active":"2024-09-15T23:56:57.752339+0000","last_peered":"2024-09-15T23:56:57.752339+0000","last_clean":"2024-09-15T23:56:57.752339+0000","last_became_active":"2024-09-15T23:56:55.991796+0000","last_became_peered":"2024-09-15T23:56:55.991796+0000","last_unstale":"2024-09-15T23:56:57.752339+0000","last_undegraded":"2024-09-15T23:56:57.752339+0000","last_fullsized":"2024-09-15T23:56:57.752339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:50.644181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752870+0000","last_change":"2024-09-15T23:56:54.969021+0000","last_active":"2024-09-15T23:56:57.752870+0000","last_peered":"2024-09-15T23:56:57.752870+0000","last_clean":"2024-09-15T23:56:57.752870+0000","last_became_active":"2024-09-15T23:56:54.968753+0000","last_became_peered":"2024-09-15T23:56:54.968753+0000","last_unstale":"2024-09-15T23:56:57.752870+0000","last_undegraded":"2024-09-15T23:56:57.752870+0000","last_fullsized":"2024-09-15T23:56:57.752870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:03.369612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992867+0000","last_change":"2024-09-15T23:56:55.989348+0000","last_active":"2024-09-15T23:56:56.992867+0000","last_peered":"2024-09-15T23:56:56.992867+0000","last_clean":"2024-09-15T23:56:56.992867+0000","last_became_active":"2024-09-15T23:56:55.975943+0000","last_became_peered":"2024-09-15T23:56:55.975943+0000","last_unstale":"2024-09-15T23:56:56.992867+0000","last_undegraded":"2024-09-15T23:56:56.992867+0000","last_fullsized":"2024-09-15T23:56:56.992867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:54.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753094+0000","last_change":"2024-09-15T23:56:54.975418+0000","last_active":"2024-09-15T23:56:57.753094+0000","last_peered":"2024-09-15T23:56:57.753094+0000","last_clean":"2024-09-15T23:56:57.753094+0000","last_became_active":"2024-09-15T23:56:54.975099+0000","last_became_peered":"2024-09-15T23:56:54.975099+0000","last_unstale":"2024-09-15T23:56:57.753094+0000","last_undegraded":"2024-09-15T23:56:57.753094+0000","last_fullsized":"2024-09-15T23:56:57.753094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:05.220925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990677+0000","last_change":"2024-09-15T23:56:56.001334+0000","last_active":"2024-09-15T23:56:56.990677+0000","last_peered":"2024-09-15T23:56:56.990677+0000","last_clean":"2024-09-15T23:56:56.990677+0000","last_became_active":"2024-09-15T23:56:56.000374+0000","last_became_peered":"2024-09-15T23:56:56.000374+0000","last_unstale":"2024-09-15T23:56:56.990677+0000","last_undegraded":"2024-09-15T23:56:56.990677+0000","last_fullsized":"2024-09-15T23:56:56.990677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:25.361845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753604+0000","last_change":"2024-09-15T23:56:54.979283+0000","last_active":"2024-09-15T23:56:57.753604+0000","last_peered":"2024-09-15T23:56:57.753604+0000","last_clean":"2024-09-15T23:56:57.753604+0000","last_became_active":"2024-09-15T23:56:54.977838+0000","last_became_peered":"2024-09-15T23:56:54.977838+0000","last_unstale":"2024-09-15T23:56:57.753604+0000","last_undegraded":"2024-09-15T23:56:57.753604+0000","last_fullsized":"2024-09-15T23:56:57.753604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:21.518878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753441+0000","last_change":"2024-09-15T23:56:55.995988+0000","last_active":"2024-09-15T23:56:57.753441+0000","last_peered":"2024-09-15T23:56:57.753441+0000","last_clean":"2024-09-15T23:56:57.753441+0000","last_became_active":"2024-09-15T23:56:55.995137+0000","last_became_peered":"2024-09-15T23:56:55.995137+0000","last_unstale":"2024-09-15T23:56:57.753441+0000","last_undegraded":"2024-09-15T23:56:57.753441+0000","last_fullsized":"2024-09-15T23:56:57.753441+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:46.961167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753667+0000","last_change":"2024-09-15T23:56:54.984311+0000","last_active":"2024-09-15T23:56:57.753667+0000","last_peered":"2024-09-15T23:56:57.753667+0000","last_clean":"2024-09-15T23:56:57.753667+0000","last_became_active":"2024-09-15T23:56:54.983912+0000","last_became_peered":"2024-09-15T23:56:54.983912+0000","last_unstale":"2024-09-15T23:56:57.753667+0000","last_undegraded":"2024-09-15T23:56:57.753667+0000","last_fullsized":"2024-09-15T23:56:57.753667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:12.265924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753712+0000","last_change":"2024-09-15T23:56:56.007768+0000","last_active":"2024-09-15T23:56:57.753712+0000","last_peered":"2024-09-15T23:56:57.753712+0000","last_clean":"2024-09-15T23:56:57.753712+0000","last_became_active":"2024-09-15T23:56:56.001858+0000","last_became_peered":"2024-09-15T23:56:56.001858+0000","last_unstale":"2024-09-15T23:56:57.753712+0000","last_undegraded":"2024-09-15T23:56:57.753712+0000","last_fullsized":"2024-09-15T23:56:57.753712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:06.231114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993111+0000","last_change":"2024-09-15T23:56:54.983601+0000","last_active":"2024-09-15T23:56:56.993111+0000","last_peered":"2024-09-15T23:56:56.993111+0000","last_clean":"2024-09-15T23:56:56.993111+0000","last_became_active":"2024-09-15T23:56:54.982965+0000","last_became_peered":"2024-09-15T23:56:54.982965+0000","last_unstale":"2024-09-15T23:56:56.993111+0000","last_undegraded":"2024-09-15T23:56:56.993111+0000","last_fullsized":"2024-09-15T23:56:56.993111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.232324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754317+0000","last_change":"2024-09-15T23:56:55.995723+0000","last_active":"2024-09-15T23:56:57.754317+0000","last_peered":"2024-09-15T23:56:57.754317+0000","last_clean":"2024-09-15T23:56:57.754317+0000","last_became_active":"2024-09-15T23:56:55.994899+0000","last_became_peered":"2024-09-15T23:56:55.994899+0000","last_unstale":"2024-09-15T23:56:57.754317+0000","last_undegraded":"2024-09-15T23:56:57.754317+0000","last_fullsized":"2024-09-15T23:56:57.754317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:09.909885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990219+0000","last_change":"2024-09-15T23:56:54.980943+0000","last_active":"2024-09-15T23:56:56.990219+0000","last_peered":"2024-09-15T23:56:56.990219+0000","last_clean":"2024-09-15T23:56:56.990219+0000","last_became_active":"2024-09-15T23:56:54.979920+0000","last_became_peered":"2024-09-15T23:56:54.979920+0000","last_unstale":"2024-09-15T23:56:56.990219+0000","last_undegraded":"2024-09-15T23:56:56.990219+0000","last_fullsized":"2024-09-15T23:56:56.990219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:31.342987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992630+0000","last_change":"2024-09-15T23:56:54.986965+0000","last_active":"2024-09-15T23:56:56.992630+0000","last_peered":"2024-09-15T23:56:56.992630+0000","last_clean":"2024-09-15T23:56:56.992630+0000","last_became_active":"2024-09-15T23:56:54.986306+0000","last_became_peered":"2024-09-15T23:56:54.986306+0000","last_unstale":"2024-09-15T23:56:56.992630+0000","last_undegraded":"2024-09-15T23:56:56.992630+0000","last_fullsized":"2024-09-15T23:56:56.992630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:40.725441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751761+0000","last_change":"2024-09-15T23:56:55.973928+0000","last_active":"2024-09-15T23:56:57.751761+0000","last_peered":"2024-09-15T23:56:57.751761+0000","last_clean":"2024-09-15T23:56:57.751761+0000","last_became_active":"2024-09-15T23:56:55.973107+0000","last_became_peered":"2024-09-15T23:56:55.973107+0000","last_unstale":"2024-09-15T23:56:57.751761+0000","last_undegraded":"2024-09-15T23:56:57.751761+0000","last_fullsized":"2024-09-15T23:56:57.751761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:30.375034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252606+0000","last_change":"2024-09-15T23:56:54.986074+0000","last_active":"2024-09-15T23:56:57.252606+0000","last_peered":"2024-09-15T23:56:57.252606+0000","last_clean":"2024-09-15T23:56:57.252606+0000","last_became_active":"2024-09-15T23:56:54.985826+0000","last_became_peered":"2024-09-15T23:56:54.985826+0000","last_unstale":"2024-09-15T23:56:57.252606+0000","last_undegraded":"2024-09-15T23:56:57.252606+0000","last_fullsized":"2024-09-15T23:56:57.252606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:06.066930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252009+0000","last_change":"2024-09-15T23:56:56.006520+0000","last_active":"2024-09-15T23:56:57.252009+0000","last_peered":"2024-09-15T23:56:57.252009+0000","last_clean":"2024-09-15T23:56:57.252009+0000","last_became_active":"2024-09-15T23:56:56.006086+0000","last_became_peered":"2024-09-15T23:56:56.006086+0000","last_unstale":"2024-09-15T23:56:57.252009+0000","last_undegraded":"2024-09-15T23:56:57.252009+0000","last_fullsized":"2024-09-15T23:56:57.252009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:04.416975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.979871+0000","last_change":"2024-09-15T23:56:54.987749+0000","last_active":"2024-09-15T23:56:56.979871+0000","last_peered":"2024-09-15T23:56:56.979871+0000","last_clean":"2024-09-15T23:56:56.979871+0000","last_became_active":"2024-09-15T23:56:54.987176+0000","last_became_peered":"2024-09-15T23:56:54.987176+0000","last_unstale":"2024-09-15T23:56:56.979871+0000","last_undegraded":"2024-09-15T23:56:56.979871+0000","last_fullsized":"2024-09-15T23:56:56.979871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:09.647148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252252+0000","last_change":"2024-09-15T23:56:54.960462+0000","last_active":"2024-09-15T23:56:57.252252+0000","last_peered":"2024-09-15T23:56:57.252252+0000","last_clean":"2024-09-15T23:56:57.252252+0000","last_became_active":"2024-09-15T23:56:54.960172+0000","last_became_peered":"2024-09-15T23:56:54.960172+0000","last_unstale":"2024-09-15T23:56:57.252252+0000","last_undegraded":"2024-09-15T23:56:57.252252+0000","last_fullsized":"2024-09-15T23:56:57.252252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:02.312104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991046+0000","last_change":"2024-09-15T23:56:55.969820+0000","last_active":"2024-09-15T23:56:56.991046+0000","last_peered":"2024-09-15T23:56:56.991046+0000","last_clean":"2024-09-15T23:56:56.991046+0000","last_became_active":"2024-09-15T23:56:55.967469+0000","last_became_peered":"2024-09-15T23:56:55.967469+0000","last_unstale":"2024-09-15T23:56:56.991046+0000","last_undegraded":"2024-09-15T23:56:56.991046+0000","last_fullsized":"2024-09-15T23:56:56.991046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:15.623608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752041+0000","last_change":"2024-09-15T23:56:54.962171+0000","last_active":"2024-09-15T23:56:57.752041+0000","last_peered":"2024-09-15T23:56:57.752041+0000","last_clean":"2024-09-15T23:56:57.752041+0000","last_became_active":"2024-09-15T23:56:54.961049+0000","last_became_peered":"2024-09-15T23:56:54.961049+0000","last_unstale":"2024-09-15T23:56:57.752041+0000","last_undegraded":"2024-09-15T23:56:57.752041+0000","last_fullsized":"2024-09-15T23:56:57.752041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:02.312104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":72,"state":"creating+peering","last_fresh":"2024-09-15T23:56:53.940338+0000","last_change":"2024-09-15T23:56:53.940338+0000","last_active":"2024-09-15T23:56:53.921998+0000","last_peered":"2024-09-15T23:56:53.921998+0000","last_clean":"2024-09-15T23:56:53.921998+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:53.940338+0000","last_undegraded":"2024-09-15T23:56:53.940338+0000","last_fullsized":"2024-09-15T23:56:53.940338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752209+0000","last_change":"2024-09-15T23:56:56.004365+0000","last_active":"2024-09-15T23:56:57.752209+0000","last_peered":"2024-09-15T23:56:57.752209+0000","last_clean":"2024-09-15T23:56:57.752209+0000","last_became_active":"2024-09-15T23:56:56.004079+0000","last_became_peered":"2024-09-15T23:56:56.004079+0000","last_unstale":"2024-09-15T23:56:57.752209+0000","last_undegraded":"2024-09-15T23:56:57.752209+0000","last_fullsized":"2024-09-15T23:56:57.752209+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:19.060961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:55.972124+0000","last_change":"2024-09-15T23:56:54.983702+0000","last_active":"2024-09-15T23:56:55.972124+0000","last_peered":"2024-09-15T23:56:55.972124+0000","last_clean":"2024-09-15T23:56:55.972124+0000","last_became_active":"2024-09-15T23:56:54.983127+0000","last_became_peered":"2024-09-15T23:56:54.983127+0000","last_unstale":"2024-09-15T23:56:55.972124+0000","last_undegraded":"2024-09-15T23:56:55.972124+0000","last_fullsized":"2024-09-15T23:56:55.972124+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:25.310145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993972+0000","last_change":"2024-09-15T23:56:55.987825+0000","last_active":"2024-09-15T23:56:56.993972+0000","last_peered":"2024-09-15T23:56:56.993972+0000","last_clean":"2024-09-15T23:56:56.993972+0000","last_became_active":"2024-09-15T23:56:55.976689+0000","last_became_peered":"2024-09-15T23:56:55.976689+0000","last_unstale":"2024-09-15T23:56:56.993972+0000","last_undegraded":"2024-09-15T23:56:56.993972+0000","last_fullsized":"2024-09-15T23:56:56.993972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:39.595978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751496+0000","last_change":"2024-09-15T23:56:54.957629+0000","last_active":"2024-09-15T23:56:57.751496+0000","last_peered":"2024-09-15T23:56:57.751496+0000","last_clean":"2024-09-15T23:56:57.751496+0000","last_became_active":"2024-09-15T23:56:54.957340+0000","last_became_peered":"2024-09-15T23:56:54.957340+0000","last_unstale":"2024-09-15T23:56:57.751496+0000","last_undegraded":"2024-09-15T23:56:57.751496+0000","last_fullsized":"2024-09-15T23:56:57.751496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:45.950977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754194+0000","last_change":"2024-09-15T23:56:55.994826+0000","last_active":"2024-09-15T23:56:57.754194+0000","last_peered":"2024-09-15T23:56:57.754194+0000","last_clean":"2024-09-15T23:56:57.754194+0000","last_became_active":"2024-09-15T23:56:55.994110+0000","last_became_peered":"2024-09-15T23:56:55.994110+0000","last_unstale":"2024-09-15T23:56:57.754194+0000","last_undegraded":"2024-09-15T23:56:57.754194+0000","last_fullsized":"2024-09-15T23:56:57.754194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:41.281743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992782+0000","last_change":"2024-09-15T23:56:54.984135+0000","last_active":"2024-09-15T23:56:56.992782+0000","last_peered":"2024-09-15T23:56:56.992782+0000","last_clean":"2024-09-15T23:56:56.992782+0000","last_became_active":"2024-09-15T23:56:54.983684+0000","last_became_peered":"2024-09-15T23:56:54.983684+0000","last_unstale":"2024-09-15T23:56:56.992782+0000","last_undegraded":"2024-09-15T23:56:56.992782+0000","last_fullsized":"2024-09-15T23:56:56.992782+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:37.846622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:56:54.932188+0000","last_change":"2024-09-15T23:56:54.932188+0000","last_active":"2024-09-15T23:56:54.932188+0000","last_peered":"2024-09-15T23:56:54.932188+0000","last_clean":"2024-09-15T23:56:54.932188+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:56:54.932188+0000","last_undegraded":"2024-09-15T23:56:54.932188+0000","last_fullsized":"2024-09-15T23:56:54.932188+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T23:56:55.971706+0000","last_change":"2024-09-15T23:56:54.974116+0000","last_active":"2024-09-15T23:56:55.971706+0000","last_peered":"2024-09-15T23:56:55.971706+0000","last_clean":"2024-09-15T23:56:55.971706+0000","last_became_active":"2024-09-15T23:56:54.973419+0000","last_became_peered":"2024-09-15T23:56:54.973419+0000","last_unstale":"2024-09-15T23:56:55.971706+0000","last_undegraded":"2024-09-15T23:56:55.971706+0000","last_fullsized":"2024-09-15T23:56:55.971706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:17.992076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251270+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:56:57.251270+0000","last_peered":"2024-09-15T23:56:57.251270+0000","last_clean":"2024-09-15T23:56:57.251270+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:56:57.251270+0000","last_undegraded":"2024-09-15T23:56:57.251270+0000","last_fullsized":"2024-09-15T23:56:57.251270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":917504,"data_stored":412618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":917504,"data_stored":412638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":913408,"data_stored":411988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":872448,"data_stored":391440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":872448,"data_stored":391440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1519616,"data_stored":1003980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":913408,"data_stored":411988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1495040,"data_stored":995732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:57:03.807 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:57:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f615f224640 1 Processor -- start 2024-09-15T23:57:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f615f224640 1 -- start start 2024-09-15T23:57:03.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f615f224640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f615815bec0 0x7f61580ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f615f224640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f615815c2a0 0x7f61580aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f615f224640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61580b3290 con 0x7f61580af2a0 2024-09-15T23:57:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f615f224640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f61580b3570 con 0x7f615815c2a0 2024-09-15T23:57:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f615f224640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f61580b3850 con 0x7f615815bec0 2024-09-15T23:57:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f6157fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f615815c2a0 0x7f61580aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f6157fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f615815c2a0 0x7f61580aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43476/0 (socket says 172.21.15.112:43476) 2024-09-15T23:57:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f6157fff640 1 -- 172.21.15.112:0/2533606347 learned_addr learned my addr 172.21.15.112:0/2533606347 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f615cfc0640 1 --2- 172.21.15.112:0/2533606347 >> v2:172.21.15.169:3300/0 conn(0x7f615815bec0 0x7f61580ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f6157fff640 1 -- 172.21.15.112:0/2533606347 >> v2:172.21.15.169:3300/0 conn(0x7f615815bec0 msgr2=0x7f61580ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f6157fff640 1 --2- 172.21.15.112:0/2533606347 >> v2:172.21.15.169:3300/0 conn(0x7f615815bec0 0x7f61580ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f6157fff640 1 -- 172.21.15.112:0/2533606347 >> v1:172.21.15.112:6789/0 conn(0x7f61580af2a0 legacy=0x7f615815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f6157fff640 1 -- 172.21.15.112:0/2533606347 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61580b3b30 con 0x7f615815c2a0 2024-09-15T23:57:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.937+0000 7f61577fe640 1 -- 172.21.15.112:0/2533606347 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1049484367 0 0) 0x7f61580b3290 con 0x7f61580af2a0 2024-09-15T23:57:03.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f6157fff640 1 --2- 172.21.15.112:0/2533606347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f615815c2a0 0x7f61580aed60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6158071710 tx=0x7f614401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ad1b78451c03f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:03.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f61577fe640 1 -- 172.21.15.112:0/2533606347 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61440aa650 con 0x7f615815c2a0 2024-09-15T23:57:03.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f61577fe640 1 -- 172.21.15.112:0/2533606347 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61440af070 con 0x7f615815c2a0 2024-09-15T23:57:03.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f61577fe640 1 -- 172.21.15.112:0/2533606347 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61440aaa10 con 0x7f615815c2a0 2024-09-15T23:57:03.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 -- 172.21.15.112:0/2533606347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f615815c2a0 msgr2=0x7f61580aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:03.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 --2- 172.21.15.112:0/2533606347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f615815c2a0 0x7f61580aed60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6158071710 tx=0x7f614401c4f0 comp rx=0 tx=0).stop 2024-09-15T23:57:03.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 -- 172.21.15.112:0/2533606347 shutdown_connections 2024-09-15T23:57:03.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 --2- 172.21.15.112:0/2533606347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f615815c2a0 0x7f61580aed60 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:03.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 --2- 172.21.15.112:0/2533606347 >> v2:172.21.15.169:3300/0 conn(0x7f615815bec0 0x7f61580ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:03.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 -- 172.21.15.112:0/2533606347 >> 172.21.15.112:0/2533606347 conn(0x7f61580b1f90 msgr2=0x7f61580b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:03.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 -- 172.21.15.112:0/2533606347 shutdown_connections 2024-09-15T23:57:03.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 -- 172.21.15.112:0/2533606347 wait complete. 2024-09-15T23:57:03.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 Processor -- start 2024-09-15T23:57:03.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 -- start start 2024-09-15T23:57:03.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61580af2a0 0x7f61581520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:03.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f615815bec0 0x7f6158152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:03.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f615815c2a0 0x7f615815ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:03.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f61580af6d0 con 0x7f615815bec0 2024-09-15T23:57:03.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61580ad740 con 0x7f615815c2a0 2024-09-15T23:57:03.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615f224640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6158169000 con 0x7f61580af2a0 2024-09-15T23:57:03.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f6157fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f615815bec0 0x7f6158152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:03.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f6157fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f615815bec0 0x7f6158152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43480/0 (socket says 172.21.15.112:43480) 2024-09-15T23:57:03.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f6157fff640 1 -- 172.21.15.112:0/3117624705 learned_addr learned my addr 172.21.15.112:0/3117624705 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:03.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615cfc0640 1 --2- 172.21.15.112:0/3117624705 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61580af2a0 0x7f61581520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:03.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f615d7c1640 1 --2- 172.21.15.112:0/3117624705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f615815c2a0 0x7f615815ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:03.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f6157fff640 1 -- 172.21.15.112:0/3117624705 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61580af2a0 msgr2=0x7f61581520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:03.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f6157fff640 1 --2- 172.21.15.112:0/3117624705 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61580af2a0 0x7f61581520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:03.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f6157fff640 1 -- 172.21.15.112:0/3117624705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f615815c2a0 msgr2=0x7f615815ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:03.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f6157fff640 1 --2- 172.21.15.112:0/3117624705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f615815c2a0 0x7f615815ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:03.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f6157fff640 1 -- 172.21.15.112:0/3117624705 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61581663b0 con 0x7f615815bec0 2024-09-15T23:57:03.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.941+0000 7f6157fff640 1 --2- 172.21.15.112:0/3117624705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f615815bec0 0x7f6158152780 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f614401a120 tx=0x7f6144019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:03.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.945+0000 7f61557fa640 1 -- 172.21.15.112:0/3117624705 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61440aae60 con 0x7f615815bec0 2024-09-15T23:57:03.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.945+0000 7f61557fa640 1 -- 172.21.15.112:0/3117624705 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61440a6040 con 0x7f615815bec0 2024-09-15T23:57:03.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.945+0000 7f615f224640 1 -- 172.21.15.112:0/3117624705 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6158166690 con 0x7f615815bec0 2024-09-15T23:57:03.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.945+0000 7f61557fa640 1 -- 172.21.15.112:0/3117624705 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61440b4a70 con 0x7f615815bec0 2024-09-15T23:57:03.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.945+0000 7f615f224640 1 -- 172.21.15.112:0/3117624705 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6158166c50 con 0x7f615815bec0 2024-09-15T23:57:03.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.945+0000 7f615f224640 1 -- 172.21.15.112:0/3117624705 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61580ad200 con 0x7f615815bec0 2024-09-15T23:57:03.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.945+0000 7f61557fa640 1 -- 172.21.15.112:0/3117624705 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f61440bc020 con 0x7f615815bec0 2024-09-15T23:57:03.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.945+0000 7f61557fa640 1 --2- 172.21.15.112:0/3117624705 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f613c0678c0 0x7f613c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:03.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.945+0000 7f615cfc0640 1 --2- 172.21.15.112:0/3117624705 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f613c0678c0 0x7f613c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:03.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.945+0000 7f61557fa640 1 -- 172.21.15.112:0/3117624705 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f61441205b0 con 0x7f615815bec0 2024-09-15T23:57:03.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.945+0000 7f615cfc0640 1 --2- 172.21.15.112:0/3117624705 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f613c0678c0 0x7f613c069d80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f614c00a970 tx=0x7f614c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:03.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:03.949+0000 7f61557fa640 1 -- 172.21.15.112:0/3117624705 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6144016110 con 0x7f615815bec0 2024-09-15T23:57:04.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.105+0000 7f615f224640 1 -- 172.21.15.112:0/3117624705 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f615806fcd0 con 0x7f613c0678c0 2024-09-15T23:57:04.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.121+0000 7f61557fa640 1 -- 172.21.15.112:0/3117624705 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252079 (secure 0 0 0) 0x7f615806fcd0 con 0x7f613c0678c0 2024-09-15T23:57:04.126 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:04.128 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:57:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.125+0000 7f615f224640 1 -- 172.21.15.112:0/3117624705 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f613c0678c0 msgr2=0x7f613c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.125+0000 7f615f224640 1 --2- 172.21.15.112:0/3117624705 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f613c0678c0 0x7f613c069d80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f614c00a970 tx=0x7f614c008040 comp rx=0 tx=0).stop 2024-09-15T23:57:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.125+0000 7f615f224640 1 -- 172.21.15.112:0/3117624705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f615815bec0 msgr2=0x7f6158152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.125+0000 7f615f224640 1 --2- 172.21.15.112:0/3117624705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f615815bec0 0x7f6158152780 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f614401a120 tx=0x7f6144019290 comp rx=0 tx=0).stop 2024-09-15T23:57:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.125+0000 7f615f224640 1 -- 172.21.15.112:0/3117624705 shutdown_connections 2024-09-15T23:57:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.125+0000 7f615f224640 1 --2- 172.21.15.112:0/3117624705 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f613c0678c0 0x7f613c069d80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.125+0000 7f615f224640 1 --2- 172.21.15.112:0/3117624705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f615815c2a0 0x7f615815ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.125+0000 7f615f224640 1 --2- 172.21.15.112:0/3117624705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f615815bec0 0x7f6158152780 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.125+0000 7f615f224640 1 --2- 172.21.15.112:0/3117624705 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61580af2a0 0x7f61581520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.125+0000 7f615f224640 1 -- 172.21.15.112:0/3117624705 >> 172.21.15.112:0/3117624705 conn(0x7f61580b1f90 msgr2=0x7f61580b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:04.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.125+0000 7f615f224640 1 -- 172.21.15.112:0/3117624705 shutdown_connections 2024-09-15T23:57:04.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.125+0000 7f615f224640 1 -- 172.21.15.112:0/3117624705 wait complete. 2024-09-15T23:57:04.146 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-09-15T23:57:03.292900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257852,"kb_used_data":8328,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716868,"statfs":{"total":773094113280,"available":772830072832,"internally_reserved":0,"allocated":8527872,"data_stored":4481284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002574"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252528+0000","last_change":"2024-09-15T23:56:55.979224+0000","last_active":"2024-09-15T23:56:57.252528+0000","last_peered":"2024-09-15T23:56:57.252528+0000","last_clean":"2024-09-15T23:56:57.252528+0000","last_became_active":"2024-09-15T23:56:55.978887+0000","last_became_peered":"2024-09-15T23:56:55.978887+0000","last_unstale":"2024-09-15T23:56:57.252528+0000","last_undegraded":"2024-09-15T23:56:57.252528+0000","last_fullsized":"2024-09-15T23:56:57.252528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:32.013874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993595+0000","last_change":"2024-09-15T23:56:55.999113+0000","last_active":"2024-09-15T23:56:56.993595+0000","last_peered":"2024-09-15T23:56:56.993595+0000","last_clean":"2024-09-15T23:56:56.993595+0000","last_became_active":"2024-09-15T23:56:55.997840+0000","last_became_peered":"2024-09-15T23:56:55.997840+0000","last_unstale":"2024-09-15T23:56:56.993595+0000","last_undegraded":"2024-09-15T23:56:56.993595+0000","last_fullsized":"2024-09-15T23:56:56.993595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:31.205893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993705+0000","last_change":"2024-09-15T23:56:55.989925+0000","last_active":"2024-09-15T23:56:56.993705+0000","last_peered":"2024-09-15T23:56:56.993705+0000","last_clean":"2024-09-15T23:56:56.993705+0000","last_became_active":"2024-09-15T23:56:55.986690+0000","last_became_peered":"2024-09-15T23:56:55.986690+0000","last_unstale":"2024-09-15T23:56:56.993705+0000","last_undegraded":"2024-09-15T23:56:56.993705+0000","last_fullsized":"2024-09-15T23:56:56.993705+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:14.922569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751951+0000","last_change":"2024-09-15T23:56:55.984311+0000","last_active":"2024-09-15T23:56:57.751951+0000","last_peered":"2024-09-15T23:56:57.751951+0000","last_clean":"2024-09-15T23:56:57.751951+0000","last_became_active":"2024-09-15T23:56:55.984038+0000","last_became_peered":"2024-09-15T23:56:55.984038+0000","last_unstale":"2024-09-15T23:56:57.751951+0000","last_undegraded":"2024-09-15T23:56:57.751951+0000","last_fullsized":"2024-09-15T23:56:57.751951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:14.917805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753296+0000","last_change":"2024-09-15T23:56:55.973914+0000","last_active":"2024-09-15T23:56:57.753296+0000","last_peered":"2024-09-15T23:56:57.753296+0000","last_clean":"2024-09-15T23:56:57.753296+0000","last_became_active":"2024-09-15T23:56:55.973108+0000","last_became_peered":"2024-09-15T23:56:55.973108+0000","last_unstale":"2024-09-15T23:56:57.753296+0000","last_undegraded":"2024-09-15T23:56:57.753296+0000","last_fullsized":"2024-09-15T23:56:57.753296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:03.322294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751732+0000","last_change":"2024-09-15T23:56:55.993222+0000","last_active":"2024-09-15T23:56:57.751732+0000","last_peered":"2024-09-15T23:56:57.751732+0000","last_clean":"2024-09-15T23:56:57.751732+0000","last_became_active":"2024-09-15T23:56:55.992379+0000","last_became_peered":"2024-09-15T23:56:55.992379+0000","last_unstale":"2024-09-15T23:56:57.751732+0000","last_undegraded":"2024-09-15T23:56:57.751732+0000","last_fullsized":"2024-09-15T23:56:57.751732+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:46.118694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751410+0000","last_change":"2024-09-15T23:56:55.969504+0000","last_active":"2024-09-15T23:56:57.751410+0000","last_peered":"2024-09-15T23:56:57.751410+0000","last_clean":"2024-09-15T23:56:57.751410+0000","last_became_active":"2024-09-15T23:56:55.968813+0000","last_became_peered":"2024-09-15T23:56:55.968813+0000","last_unstale":"2024-09-15T23:56:57.751410+0000","last_undegraded":"2024-09-15T23:56:57.751410+0000","last_fullsized":"2024-09-15T23:56:57.751410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:37.530094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990258+0000","last_change":"2024-09-15T23:56:55.974436+0000","last_active":"2024-09-15T23:56:56.990258+0000","last_peered":"2024-09-15T23:56:56.990258+0000","last_clean":"2024-09-15T23:56:56.990258+0000","last_became_active":"2024-09-15T23:56:55.973689+0000","last_became_peered":"2024-09-15T23:56:55.973689+0000","last_unstale":"2024-09-15T23:56:56.990258+0000","last_undegraded":"2024-09-15T23:56:56.990258+0000","last_fullsized":"2024-09-15T23:56:56.990258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:28.820185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752677+0000","last_change":"2024-09-15T23:56:55.995299+0000","last_active":"2024-09-15T23:56:57.752677+0000","last_peered":"2024-09-15T23:56:57.752677+0000","last_clean":"2024-09-15T23:56:57.752677+0000","last_became_active":"2024-09-15T23:56:55.994979+0000","last_became_peered":"2024-09-15T23:56:55.994979+0000","last_unstale":"2024-09-15T23:56:57.752677+0000","last_undegraded":"2024-09-15T23:56:57.752677+0000","last_fullsized":"2024-09-15T23:56:57.752677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:54.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252297+0000","last_change":"2024-09-15T23:56:55.996657+0000","last_active":"2024-09-15T23:56:57.252297+0000","last_peered":"2024-09-15T23:56:57.252297+0000","last_clean":"2024-09-15T23:56:57.252297+0000","last_became_active":"2024-09-15T23:56:55.996374+0000","last_became_peered":"2024-09-15T23:56:55.996374+0000","last_unstale":"2024-09-15T23:56:57.252297+0000","last_undegraded":"2024-09-15T23:56:57.252297+0000","last_fullsized":"2024-09-15T23:56:57.252297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:28.942569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.994065+0000","last_change":"2024-09-15T23:56:56.002531+0000","last_active":"2024-09-15T23:56:56.994065+0000","last_peered":"2024-09-15T23:56:56.994065+0000","last_clean":"2024-09-15T23:56:56.994065+0000","last_became_active":"2024-09-15T23:56:55.989953+0000","last_became_peered":"2024-09-15T23:56:55.989953+0000","last_unstale":"2024-09-15T23:56:56.994065+0000","last_undegraded":"2024-09-15T23:56:56.994065+0000","last_fullsized":"2024-09-15T23:56:56.994065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:42.470630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752844+0000","last_change":"2024-09-15T23:56:55.980052+0000","last_active":"2024-09-15T23:56:57.752844+0000","last_peered":"2024-09-15T23:56:57.752844+0000","last_clean":"2024-09-15T23:56:57.752844+0000","last_became_active":"2024-09-15T23:56:55.975257+0000","last_became_peered":"2024-09-15T23:56:55.975257+0000","last_unstale":"2024-09-15T23:56:57.752844+0000","last_undegraded":"2024-09-15T23:56:57.752844+0000","last_fullsized":"2024-09-15T23:56:57.752844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:50.441671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993324+0000","last_change":"2024-09-15T23:56:56.004482+0000","last_active":"2024-09-15T23:56:56.993324+0000","last_peered":"2024-09-15T23:56:56.993324+0000","last_clean":"2024-09-15T23:56:56.993324+0000","last_became_active":"2024-09-15T23:56:56.003824+0000","last_became_peered":"2024-09-15T23:56:56.003824+0000","last_unstale":"2024-09-15T23:56:56.993324+0000","last_undegraded":"2024-09-15T23:56:56.993324+0000","last_fullsized":"2024-09-15T23:56:56.993324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:32.353177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990654+0000","last_change":"2024-09-15T23:56:55.984462+0000","last_active":"2024-09-15T23:56:56.990654+0000","last_peered":"2024-09-15T23:56:56.990654+0000","last_clean":"2024-09-15T23:56:56.990654+0000","last_became_active":"2024-09-15T23:56:55.983722+0000","last_became_peered":"2024-09-15T23:56:55.983722+0000","last_unstale":"2024-09-15T23:56:56.990654+0000","last_undegraded":"2024-09-15T23:56:56.990654+0000","last_fullsized":"2024-09-15T23:56:56.990654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:39.347880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752123+0000","last_change":"2024-09-15T23:56:56.007000+0000","last_active":"2024-09-15T23:56:57.752123+0000","last_peered":"2024-09-15T23:56:57.752123+0000","last_clean":"2024-09-15T23:56:57.752123+0000","last_became_active":"2024-09-15T23:56:56.006350+0000","last_became_peered":"2024-09-15T23:56:56.006350+0000","last_unstale":"2024-09-15T23:56:57.752123+0000","last_undegraded":"2024-09-15T23:56:57.752123+0000","last_fullsized":"2024-09-15T23:56:57.752123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:59.909567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751377+0000","last_change":"2024-09-15T23:56:55.974231+0000","last_active":"2024-09-15T23:56:57.751377+0000","last_peered":"2024-09-15T23:56:57.751377+0000","last_clean":"2024-09-15T23:56:57.751377+0000","last_became_active":"2024-09-15T23:56:55.973543+0000","last_became_peered":"2024-09-15T23:56:55.973543+0000","last_unstale":"2024-09-15T23:56:57.751377+0000","last_undegraded":"2024-09-15T23:56:57.751377+0000","last_fullsized":"2024-09-15T23:56:57.751377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:58.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991496+0000","last_change":"2024-09-15T23:56:55.958076+0000","last_active":"2024-09-15T23:56:56.991496+0000","last_peered":"2024-09-15T23:56:56.991496+0000","last_clean":"2024-09-15T23:56:56.991496+0000","last_became_active":"2024-09-15T23:56:55.957404+0000","last_became_peered":"2024-09-15T23:56:55.957404+0000","last_unstale":"2024-09-15T23:56:56.991496+0000","last_undegraded":"2024-09-15T23:56:56.991496+0000","last_fullsized":"2024-09-15T23:56:56.991496+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:23.266535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993642+0000","last_change":"2024-09-15T23:56:55.998591+0000","last_active":"2024-09-15T23:56:56.993642+0000","last_peered":"2024-09-15T23:56:56.993642+0000","last_clean":"2024-09-15T23:56:56.993642+0000","last_became_active":"2024-09-15T23:56:55.997788+0000","last_became_peered":"2024-09-15T23:56:55.997788+0000","last_unstale":"2024-09-15T23:56:56.993642+0000","last_undegraded":"2024-09-15T23:56:56.993642+0000","last_fullsized":"2024-09-15T23:56:56.993642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:50.441671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991220+0000","last_change":"2024-09-15T23:56:55.997317+0000","last_active":"2024-09-15T23:56:56.991220+0000","last_peered":"2024-09-15T23:56:56.991220+0000","last_clean":"2024-09-15T23:56:56.991220+0000","last_became_active":"2024-09-15T23:56:55.996587+0000","last_became_peered":"2024-09-15T23:56:55.996587+0000","last_unstale":"2024-09-15T23:56:56.991220+0000","last_undegraded":"2024-09-15T23:56:56.991220+0000","last_fullsized":"2024-09-15T23:56:56.991220+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:33.672171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752928+0000","last_change":"2024-09-15T23:56:55.994322+0000","last_active":"2024-09-15T23:56:57.752928+0000","last_peered":"2024-09-15T23:56:57.752928+0000","last_clean":"2024-09-15T23:56:57.752928+0000","last_became_active":"2024-09-15T23:56:55.993525+0000","last_became_peered":"2024-09-15T23:56:55.993525+0000","last_unstale":"2024-09-15T23:56:57.752928+0000","last_undegraded":"2024-09-15T23:56:57.752928+0000","last_fullsized":"2024-09-15T23:56:57.752928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:34.470590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752823+0000","last_change":"2024-09-15T23:56:55.970776+0000","last_active":"2024-09-15T23:56:57.752823+0000","last_peered":"2024-09-15T23:56:57.752823+0000","last_clean":"2024-09-15T23:56:57.752823+0000","last_became_active":"2024-09-15T23:56:55.970301+0000","last_became_peered":"2024-09-15T23:56:55.970301+0000","last_unstale":"2024-09-15T23:56:57.752823+0000","last_undegraded":"2024-09-15T23:56:57.752823+0000","last_fullsized":"2024-09-15T23:56:57.752823+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:31.205893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992685+0000","last_change":"2024-09-15T23:56:56.011861+0000","last_active":"2024-09-15T23:56:56.992685+0000","last_peered":"2024-09-15T23:56:56.992685+0000","last_clean":"2024-09-15T23:56:56.992685+0000","last_became_active":"2024-09-15T23:56:56.011149+0000","last_became_peered":"2024-09-15T23:56:56.011149+0000","last_unstale":"2024-09-15T23:56:56.992685+0000","last_undegraded":"2024-09-15T23:56:56.992685+0000","last_fullsized":"2024-09-15T23:56:56.992685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:19.060961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252117+0000","last_change":"2024-09-15T23:56:55.984314+0000","last_active":"2024-09-15T23:56:57.252117+0000","last_peered":"2024-09-15T23:56:57.252117+0000","last_clean":"2024-09-15T23:56:57.252117+0000","last_became_active":"2024-09-15T23:56:55.983952+0000","last_became_peered":"2024-09-15T23:56:55.983952+0000","last_unstale":"2024-09-15T23:56:57.252117+0000","last_undegraded":"2024-09-15T23:56:57.252117+0000","last_fullsized":"2024-09-15T23:56:57.252117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:45:10.598663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992395+0000","last_change":"2024-09-15T23:56:56.004418+0000","last_active":"2024-09-15T23:56:56.992395+0000","last_peered":"2024-09-15T23:56:56.992395+0000","last_clean":"2024-09-15T23:56:56.992395+0000","last_became_active":"2024-09-15T23:56:56.003744+0000","last_became_peered":"2024-09-15T23:56:56.003744+0000","last_unstale":"2024-09-15T23:56:56.992395+0000","last_undegraded":"2024-09-15T23:56:56.992395+0000","last_fullsized":"2024-09-15T23:56:56.992395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:14.917805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752614+0000","last_change":"2024-09-15T23:56:56.000438+0000","last_active":"2024-09-15T23:56:57.752614+0000","last_peered":"2024-09-15T23:56:57.752614+0000","last_clean":"2024-09-15T23:56:57.752614+0000","last_became_active":"2024-09-15T23:56:55.999839+0000","last_became_peered":"2024-09-15T23:56:55.999839+0000","last_unstale":"2024-09-15T23:56:57.752614+0000","last_undegraded":"2024-09-15T23:56:57.752614+0000","last_fullsized":"2024-09-15T23:56:57.752614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:37.621270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752800+0000","last_change":"2024-09-15T23:56:55.974824+0000","last_active":"2024-09-15T23:56:57.752800+0000","last_peered":"2024-09-15T23:56:57.752800+0000","last_clean":"2024-09-15T23:56:57.752800+0000","last_became_active":"2024-09-15T23:56:55.974296+0000","last_became_peered":"2024-09-15T23:56:55.974296+0000","last_unstale":"2024-09-15T23:56:57.752800+0000","last_undegraded":"2024-09-15T23:56:57.752800+0000","last_fullsized":"2024-09-15T23:56:57.752800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:32.353177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752021+0000","last_change":"2024-09-15T23:56:55.972869+0000","last_active":"2024-09-15T23:56:57.752021+0000","last_peered":"2024-09-15T23:56:57.752021+0000","last_clean":"2024-09-15T23:56:57.752021+0000","last_became_active":"2024-09-15T23:56:55.972567+0000","last_became_peered":"2024-09-15T23:56:55.972567+0000","last_unstale":"2024-09-15T23:56:57.752021+0000","last_undegraded":"2024-09-15T23:56:57.752021+0000","last_fullsized":"2024-09-15T23:56:57.752021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:20.287580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753525+0000","last_change":"2024-09-15T23:56:55.995902+0000","last_active":"2024-09-15T23:56:57.753525+0000","last_peered":"2024-09-15T23:56:57.753525+0000","last_clean":"2024-09-15T23:56:57.753525+0000","last_became_active":"2024-09-15T23:56:55.994271+0000","last_became_peered":"2024-09-15T23:56:55.994271+0000","last_unstale":"2024-09-15T23:56:57.753525+0000","last_undegraded":"2024-09-15T23:56:57.753525+0000","last_fullsized":"2024-09-15T23:56:57.753525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:04.379802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751637+0000","last_change":"2024-09-15T23:56:55.993324+0000","last_active":"2024-09-15T23:56:57.751637+0000","last_peered":"2024-09-15T23:56:57.751637+0000","last_clean":"2024-09-15T23:56:57.751637+0000","last_became_active":"2024-09-15T23:56:55.992543+0000","last_became_peered":"2024-09-15T23:56:55.992543+0000","last_unstale":"2024-09-15T23:56:57.751637+0000","last_undegraded":"2024-09-15T23:56:57.751637+0000","last_fullsized":"2024-09-15T23:56:57.751637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:18.914333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251818+0000","last_change":"2024-09-15T23:56:56.011651+0000","last_active":"2024-09-15T23:56:57.251818+0000","last_peered":"2024-09-15T23:56:57.251818+0000","last_clean":"2024-09-15T23:56:57.251818+0000","last_became_active":"2024-09-15T23:56:56.011342+0000","last_became_peered":"2024-09-15T23:56:56.011342+0000","last_unstale":"2024-09-15T23:56:57.251818+0000","last_undegraded":"2024-09-15T23:56:57.251818+0000","last_fullsized":"2024-09-15T23:56:57.251818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:02.575095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992637+0000","last_change":"2024-09-15T23:56:55.999632+0000","last_active":"2024-09-15T23:56:56.992637+0000","last_peered":"2024-09-15T23:56:56.992637+0000","last_clean":"2024-09-15T23:56:56.992637+0000","last_became_active":"2024-09-15T23:56:55.999003+0000","last_became_peered":"2024-09-15T23:56:55.999003+0000","last_unstale":"2024-09-15T23:56:56.992637+0000","last_undegraded":"2024-09-15T23:56:56.992637+0000","last_fullsized":"2024-09-15T23:56:56.992637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:27.375798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751513+0000","last_change":"2024-09-15T23:56:56.000881+0000","last_active":"2024-09-15T23:56:57.751513+0000","last_peered":"2024-09-15T23:56:57.751513+0000","last_clean":"2024-09-15T23:56:57.751513+0000","last_became_active":"2024-09-15T23:56:56.000550+0000","last_became_peered":"2024-09-15T23:56:56.000550+0000","last_unstale":"2024-09-15T23:56:57.751513+0000","last_undegraded":"2024-09-15T23:56:57.751513+0000","last_fullsized":"2024-09-15T23:56:57.751513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:16.086562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752125+0000","last_change":"2024-09-15T23:56:55.970381+0000","last_active":"2024-09-15T23:56:57.752125+0000","last_peered":"2024-09-15T23:56:57.752125+0000","last_clean":"2024-09-15T23:56:57.752125+0000","last_became_active":"2024-09-15T23:56:55.969605+0000","last_became_peered":"2024-09-15T23:56:55.969605+0000","last_unstale":"2024-09-15T23:56:57.752125+0000","last_undegraded":"2024-09-15T23:56:57.752125+0000","last_fullsized":"2024-09-15T23:56:57.752125+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:07.077120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754074+0000","last_change":"2024-09-15T23:56:54.986431+0000","last_active":"2024-09-15T23:56:57.754074+0000","last_peered":"2024-09-15T23:56:57.754074+0000","last_clean":"2024-09-15T23:56:57.754074+0000","last_became_active":"2024-09-15T23:56:54.986031+0000","last_became_peered":"2024-09-15T23:56:54.986031+0000","last_unstale":"2024-09-15T23:56:57.754074+0000","last_undegraded":"2024-09-15T23:56:57.754074+0000","last_fullsized":"2024-09-15T23:56:57.754074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:45.418494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752493+0000","last_change":"2024-09-15T23:56:55.980727+0000","last_active":"2024-09-15T23:56:57.752493+0000","last_peered":"2024-09-15T23:56:57.752493+0000","last_clean":"2024-09-15T23:56:57.752493+0000","last_became_active":"2024-09-15T23:56:55.973498+0000","last_became_peered":"2024-09-15T23:56:55.973498+0000","last_unstale":"2024-09-15T23:56:57.752493+0000","last_undegraded":"2024-09-15T23:56:57.752493+0000","last_fullsized":"2024-09-15T23:56:57.752493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:37.501600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.983377+0000","last_change":"2024-09-15T23:56:54.971024+0000","last_active":"2024-09-15T23:56:56.983377+0000","last_peered":"2024-09-15T23:56:56.983377+0000","last_clean":"2024-09-15T23:56:56.983377+0000","last_became_active":"2024-09-15T23:56:54.970730+0000","last_became_peered":"2024-09-15T23:56:54.970730+0000","last_unstale":"2024-09-15T23:56:56.983377+0000","last_undegraded":"2024-09-15T23:56:56.983377+0000","last_fullsized":"2024-09-15T23:56:56.983377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:22.825324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751372+0000","last_change":"2024-09-15T23:56:55.993427+0000","last_active":"2024-09-15T23:56:57.751372+0000","last_peered":"2024-09-15T23:56:57.751372+0000","last_clean":"2024-09-15T23:56:57.751372+0000","last_became_active":"2024-09-15T23:56:55.993081+0000","last_became_peered":"2024-09-15T23:56:55.993081+0000","last_unstale":"2024-09-15T23:56:57.751372+0000","last_undegraded":"2024-09-15T23:56:57.751372+0000","last_fullsized":"2024-09-15T23:56:57.751372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:19.060961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251960+0000","last_change":"2024-09-15T23:56:54.968341+0000","last_active":"2024-09-15T23:56:57.251960+0000","last_peered":"2024-09-15T23:56:57.251960+0000","last_clean":"2024-09-15T23:56:57.251960+0000","last_became_active":"2024-09-15T23:56:54.968071+0000","last_became_peered":"2024-09-15T23:56:54.968071+0000","last_unstale":"2024-09-15T23:56:57.251960+0000","last_undegraded":"2024-09-15T23:56:57.251960+0000","last_fullsized":"2024-09-15T23:56:57.251960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:49.633991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751297+0000","last_change":"2024-09-15T23:56:55.984390+0000","last_active":"2024-09-15T23:56:57.751297+0000","last_peered":"2024-09-15T23:56:57.751297+0000","last_clean":"2024-09-15T23:56:57.751297+0000","last_became_active":"2024-09-15T23:56:55.984141+0000","last_became_peered":"2024-09-15T23:56:55.984141+0000","last_unstale":"2024-09-15T23:56:57.751297+0000","last_undegraded":"2024-09-15T23:56:57.751297+0000","last_fullsized":"2024-09-15T23:56:57.751297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:48.336601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753325+0000","last_change":"2024-09-15T23:56:54.970917+0000","last_active":"2024-09-15T23:56:57.753325+0000","last_peered":"2024-09-15T23:56:57.753325+0000","last_clean":"2024-09-15T23:56:57.753325+0000","last_became_active":"2024-09-15T23:56:54.970579+0000","last_became_peered":"2024-09-15T23:56:54.970579+0000","last_unstale":"2024-09-15T23:56:57.753325+0000","last_undegraded":"2024-09-15T23:56:57.753325+0000","last_fullsized":"2024-09-15T23:56:57.753325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:46.553592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753212+0000","last_change":"2024-09-15T23:56:55.997214+0000","last_active":"2024-09-15T23:56:57.753212+0000","last_peered":"2024-09-15T23:56:57.753212+0000","last_clean":"2024-09-15T23:56:57.753212+0000","last_became_active":"2024-09-15T23:56:55.992307+0000","last_became_peered":"2024-09-15T23:56:55.992307+0000","last_unstale":"2024-09-15T23:56:57.753212+0000","last_undegraded":"2024-09-15T23:56:57.753212+0000","last_fullsized":"2024-09-15T23:56:57.753212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:07.055798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753140+0000","last_change":"2024-09-15T23:56:54.969006+0000","last_active":"2024-09-15T23:56:57.753140+0000","last_peered":"2024-09-15T23:56:57.753140+0000","last_clean":"2024-09-15T23:56:57.753140+0000","last_became_active":"2024-09-15T23:56:54.968620+0000","last_became_peered":"2024-09-15T23:56:54.968620+0000","last_unstale":"2024-09-15T23:56:57.753140+0000","last_undegraded":"2024-09-15T23:56:57.753140+0000","last_fullsized":"2024-09-15T23:56:57.753140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:31.003685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.994384+0000","last_change":"2024-09-15T23:56:56.004365+0000","last_active":"2024-09-15T23:56:56.994384+0000","last_peered":"2024-09-15T23:56:56.994384+0000","last_clean":"2024-09-15T23:56:56.994384+0000","last_became_active":"2024-09-15T23:56:56.003697+0000","last_became_peered":"2024-09-15T23:56:56.003697+0000","last_unstale":"2024-09-15T23:56:56.994384+0000","last_undegraded":"2024-09-15T23:56:56.994384+0000","last_fullsized":"2024-09-15T23:56:56.994384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:24.370163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.983330+0000","last_change":"2024-09-15T23:56:54.966772+0000","last_active":"2024-09-15T23:56:56.983330+0000","last_peered":"2024-09-15T23:56:56.983330+0000","last_clean":"2024-09-15T23:56:56.983330+0000","last_became_active":"2024-09-15T23:56:54.966412+0000","last_became_peered":"2024-09-15T23:56:54.966412+0000","last_unstale":"2024-09-15T23:56:56.983330+0000","last_undegraded":"2024-09-15T23:56:56.983330+0000","last_fullsized":"2024-09-15T23:56:56.983330+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:22.519320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753598+0000","last_change":"2024-09-15T23:56:55.996046+0000","last_active":"2024-09-15T23:56:57.753598+0000","last_peered":"2024-09-15T23:56:57.753598+0000","last_clean":"2024-09-15T23:56:57.753598+0000","last_became_active":"2024-09-15T23:56:55.995722+0000","last_became_peered":"2024-09-15T23:56:55.995722+0000","last_unstale":"2024-09-15T23:56:57.753598+0000","last_undegraded":"2024-09-15T23:56:57.753598+0000","last_fullsized":"2024-09-15T23:56:57.753598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:42.470630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990195+0000","last_change":"2024-09-15T23:56:54.965160+0000","last_active":"2024-09-15T23:56:56.990195+0000","last_peered":"2024-09-15T23:56:56.990195+0000","last_clean":"2024-09-15T23:56:56.990195+0000","last_became_active":"2024-09-15T23:56:54.964317+0000","last_became_peered":"2024-09-15T23:56:54.964317+0000","last_unstale":"2024-09-15T23:56:56.990195+0000","last_undegraded":"2024-09-15T23:56:56.990195+0000","last_fullsized":"2024-09-15T23:56:56.990195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:53.719508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.983664+0000","last_change":"2024-09-15T23:56:56.006572+0000","last_active":"2024-09-15T23:56:56.983664+0000","last_peered":"2024-09-15T23:56:56.983664+0000","last_clean":"2024-09-15T23:56:56.983664+0000","last_became_active":"2024-09-15T23:56:56.006289+0000","last_became_peered":"2024-09-15T23:56:56.006289+0000","last_unstale":"2024-09-15T23:56:56.983664+0000","last_undegraded":"2024-09-15T23:56:56.983664+0000","last_fullsized":"2024-09-15T23:56:56.983664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:19.955504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992537+0000","last_change":"2024-09-15T23:56:54.984630+0000","last_active":"2024-09-15T23:56:56.992537+0000","last_peered":"2024-09-15T23:56:56.992537+0000","last_clean":"2024-09-15T23:56:56.992537+0000","last_became_active":"2024-09-15T23:56:54.983896+0000","last_became_peered":"2024-09-15T23:56:54.983896+0000","last_unstale":"2024-09-15T23:56:56.992537+0000","last_undegraded":"2024-09-15T23:56:56.992537+0000","last_fullsized":"2024-09-15T23:56:56.992537+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:28.388939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992459+0000","last_change":"2024-09-15T23:56:55.989801+0000","last_active":"2024-09-15T23:56:56.992459+0000","last_peered":"2024-09-15T23:56:56.992459+0000","last_clean":"2024-09-15T23:56:56.992459+0000","last_became_active":"2024-09-15T23:56:55.989074+0000","last_became_peered":"2024-09-15T23:56:55.989074+0000","last_unstale":"2024-09-15T23:56:56.992459+0000","last_undegraded":"2024-09-15T23:56:56.992459+0000","last_fullsized":"2024-09-15T23:56:56.992459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:20.287580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752742+0000","last_change":"2024-09-15T23:56:54.959168+0000","last_active":"2024-09-15T23:56:57.752742+0000","last_peered":"2024-09-15T23:56:57.752742+0000","last_clean":"2024-09-15T23:56:57.752742+0000","last_became_active":"2024-09-15T23:56:54.958765+0000","last_became_peered":"2024-09-15T23:56:54.958765+0000","last_unstale":"2024-09-15T23:56:57.752742+0000","last_undegraded":"2024-09-15T23:56:57.752742+0000","last_fullsized":"2024-09-15T23:56:57.752742+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:36.491410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751764+0000","last_change":"2024-09-15T23:56:55.977303+0000","last_active":"2024-09-15T23:56:57.751764+0000","last_peered":"2024-09-15T23:56:57.751764+0000","last_clean":"2024-09-15T23:56:57.751764+0000","last_became_active":"2024-09-15T23:56:55.977041+0000","last_became_peered":"2024-09-15T23:56:55.977041+0000","last_unstale":"2024-09-15T23:56:57.751764+0000","last_undegraded":"2024-09-15T23:56:57.751764+0000","last_fullsized":"2024-09-15T23:56:57.751764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:32.353177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252161+0000","last_change":"2024-09-15T23:56:54.958234+0000","last_active":"2024-09-15T23:56:57.252161+0000","last_peered":"2024-09-15T23:56:57.252161+0000","last_clean":"2024-09-15T23:56:57.252161+0000","last_became_active":"2024-09-15T23:56:54.957887+0000","last_became_peered":"2024-09-15T23:56:54.957887+0000","last_unstale":"2024-09-15T23:56:57.252161+0000","last_undegraded":"2024-09-15T23:56:57.252161+0000","last_fullsized":"2024-09-15T23:56:57.252161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:36.491410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991152+0000","last_change":"2024-09-15T23:56:55.959205+0000","last_active":"2024-09-15T23:56:56.991152+0000","last_peered":"2024-09-15T23:56:56.991152+0000","last_clean":"2024-09-15T23:56:56.991152+0000","last_became_active":"2024-09-15T23:56:55.958373+0000","last_became_peered":"2024-09-15T23:56:55.958373+0000","last_unstale":"2024-09-15T23:56:56.991152+0000","last_undegraded":"2024-09-15T23:56:56.991152+0000","last_fullsized":"2024-09-15T23:56:56.991152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:23.272483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752075+0000","last_change":"2024-09-15T23:56:54.977562+0000","last_active":"2024-09-15T23:56:57.752075+0000","last_peered":"2024-09-15T23:56:57.752075+0000","last_clean":"2024-09-15T23:56:57.752075+0000","last_became_active":"2024-09-15T23:56:54.976751+0000","last_became_peered":"2024-09-15T23:56:54.976751+0000","last_unstale":"2024-09-15T23:56:57.752075+0000","last_undegraded":"2024-09-15T23:56:57.752075+0000","last_fullsized":"2024-09-15T23:56:57.752075+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:35.674580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751769+0000","last_change":"2024-09-15T23:56:55.993382+0000","last_active":"2024-09-15T23:56:57.751769+0000","last_peered":"2024-09-15T23:56:57.751769+0000","last_clean":"2024-09-15T23:56:57.751769+0000","last_became_active":"2024-09-15T23:56:55.992592+0000","last_became_peered":"2024-09-15T23:56:55.992592+0000","last_unstale":"2024-09-15T23:56:57.751769+0000","last_undegraded":"2024-09-15T23:56:57.751769+0000","last_fullsized":"2024-09-15T23:56:57.751769+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:34.786036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.983843+0000","last_change":"2024-09-15T23:56:54.964678+0000","last_active":"2024-09-15T23:56:56.983843+0000","last_peered":"2024-09-15T23:56:56.983843+0000","last_clean":"2024-09-15T23:56:56.983843+0000","last_became_active":"2024-09-15T23:56:54.964352+0000","last_became_peered":"2024-09-15T23:56:54.964352+0000","last_unstale":"2024-09-15T23:56:56.983843+0000","last_undegraded":"2024-09-15T23:56:56.983843+0000","last_fullsized":"2024-09-15T23:56:56.983843+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:38.068011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752119+0000","last_change":"2024-09-15T23:56:55.995297+0000","last_active":"2024-09-15T23:56:57.752119+0000","last_peered":"2024-09-15T23:56:57.752119+0000","last_clean":"2024-09-15T23:56:57.752119+0000","last_became_active":"2024-09-15T23:56:55.994941+0000","last_became_peered":"2024-09-15T23:56:55.994941+0000","last_unstale":"2024-09-15T23:56:57.752119+0000","last_undegraded":"2024-09-15T23:56:57.752119+0000","last_fullsized":"2024-09-15T23:56:57.752119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:27.375798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252310+0000","last_change":"2024-09-15T23:56:54.967739+0000","last_active":"2024-09-15T23:56:57.252310+0000","last_peered":"2024-09-15T23:56:57.252310+0000","last_clean":"2024-09-15T23:56:57.252310+0000","last_became_active":"2024-09-15T23:56:54.967464+0000","last_became_peered":"2024-09-15T23:56:54.967464+0000","last_unstale":"2024-09-15T23:56:57.252310+0000","last_undegraded":"2024-09-15T23:56:57.252310+0000","last_fullsized":"2024-09-15T23:56:57.252310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:45.950977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252103+0000","last_change":"2024-09-15T23:56:56.006475+0000","last_active":"2024-09-15T23:56:57.252103+0000","last_peered":"2024-09-15T23:56:57.252103+0000","last_clean":"2024-09-15T23:56:57.252103+0000","last_became_active":"2024-09-15T23:56:56.006118+0000","last_became_peered":"2024-09-15T23:56:56.006118+0000","last_unstale":"2024-09-15T23:56:57.252103+0000","last_undegraded":"2024-09-15T23:56:57.252103+0000","last_fullsized":"2024-09-15T23:56:57.252103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:56.067306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751913+0000","last_change":"2024-09-15T23:56:54.967750+0000","last_active":"2024-09-15T23:56:57.751913+0000","last_peered":"2024-09-15T23:56:57.751913+0000","last_clean":"2024-09-15T23:56:57.751913+0000","last_became_active":"2024-09-15T23:56:54.967412+0000","last_became_peered":"2024-09-15T23:56:54.967412+0000","last_unstale":"2024-09-15T23:56:57.751913+0000","last_undegraded":"2024-09-15T23:56:57.751913+0000","last_fullsized":"2024-09-15T23:56:57.751913+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:27.932379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753580+0000","last_change":"2024-09-15T23:56:55.979148+0000","last_active":"2024-09-15T23:56:57.753580+0000","last_peered":"2024-09-15T23:56:57.753580+0000","last_clean":"2024-09-15T23:56:57.753580+0000","last_became_active":"2024-09-15T23:56:55.978774+0000","last_became_peered":"2024-09-15T23:56:55.978774+0000","last_unstale":"2024-09-15T23:56:57.753580+0000","last_undegraded":"2024-09-15T23:56:57.753580+0000","last_fullsized":"2024-09-15T23:56:57.753580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:39.595978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752761+0000","last_change":"2024-09-15T23:56:54.989708+0000","last_active":"2024-09-15T23:56:57.752761+0000","last_peered":"2024-09-15T23:56:57.752761+0000","last_clean":"2024-09-15T23:56:57.752761+0000","last_became_active":"2024-09-15T23:56:54.989300+0000","last_became_peered":"2024-09-15T23:56:54.989300+0000","last_unstale":"2024-09-15T23:56:57.752761+0000","last_undegraded":"2024-09-15T23:56:57.752761+0000","last_fullsized":"2024-09-15T23:56:57.752761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:47.414189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252603+0000","last_change":"2024-09-15T23:56:56.010338+0000","last_active":"2024-09-15T23:56:57.252603+0000","last_peered":"2024-09-15T23:56:57.252603+0000","last_clean":"2024-09-15T23:56:57.252603+0000","last_became_active":"2024-09-15T23:56:56.010068+0000","last_became_peered":"2024-09-15T23:56:56.010068+0000","last_unstale":"2024-09-15T23:56:57.252603+0000","last_undegraded":"2024-09-15T23:56:57.252603+0000","last_fullsized":"2024-09-15T23:56:57.252603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:47.563782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751179+0000","last_change":"2024-09-15T23:56:54.971305+0000","last_active":"2024-09-15T23:56:57.751179+0000","last_peered":"2024-09-15T23:56:57.751179+0000","last_clean":"2024-09-15T23:56:57.751179+0000","last_became_active":"2024-09-15T23:56:54.970598+0000","last_became_peered":"2024-09-15T23:56:54.970598+0000","last_unstale":"2024-09-15T23:56:57.751179+0000","last_undegraded":"2024-09-15T23:56:57.751179+0000","last_fullsized":"2024-09-15T23:56:57.751179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:20.015026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752339+0000","last_change":"2024-09-15T23:56:55.992555+0000","last_active":"2024-09-15T23:56:57.752339+0000","last_peered":"2024-09-15T23:56:57.752339+0000","last_clean":"2024-09-15T23:56:57.752339+0000","last_became_active":"2024-09-15T23:56:55.991796+0000","last_became_peered":"2024-09-15T23:56:55.991796+0000","last_unstale":"2024-09-15T23:56:57.752339+0000","last_undegraded":"2024-09-15T23:56:57.752339+0000","last_fullsized":"2024-09-15T23:56:57.752339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:50.644181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752870+0000","last_change":"2024-09-15T23:56:54.969021+0000","last_active":"2024-09-15T23:56:57.752870+0000","last_peered":"2024-09-15T23:56:57.752870+0000","last_clean":"2024-09-15T23:56:57.752870+0000","last_became_active":"2024-09-15T23:56:54.968753+0000","last_became_peered":"2024-09-15T23:56:54.968753+0000","last_unstale":"2024-09-15T23:56:57.752870+0000","last_undegraded":"2024-09-15T23:56:57.752870+0000","last_fullsized":"2024-09-15T23:56:57.752870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:03.369612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992867+0000","last_change":"2024-09-15T23:56:55.989348+0000","last_active":"2024-09-15T23:56:56.992867+0000","last_peered":"2024-09-15T23:56:56.992867+0000","last_clean":"2024-09-15T23:56:56.992867+0000","last_became_active":"2024-09-15T23:56:55.975943+0000","last_became_peered":"2024-09-15T23:56:55.975943+0000","last_unstale":"2024-09-15T23:56:56.992867+0000","last_undegraded":"2024-09-15T23:56:56.992867+0000","last_fullsized":"2024-09-15T23:56:56.992867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:54.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753094+0000","last_change":"2024-09-15T23:56:54.975418+0000","last_active":"2024-09-15T23:56:57.753094+0000","last_peered":"2024-09-15T23:56:57.753094+0000","last_clean":"2024-09-15T23:56:57.753094+0000","last_became_active":"2024-09-15T23:56:54.975099+0000","last_became_peered":"2024-09-15T23:56:54.975099+0000","last_unstale":"2024-09-15T23:56:57.753094+0000","last_undegraded":"2024-09-15T23:56:57.753094+0000","last_fullsized":"2024-09-15T23:56:57.753094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:05.220925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990677+0000","last_change":"2024-09-15T23:56:56.001334+0000","last_active":"2024-09-15T23:56:56.990677+0000","last_peered":"2024-09-15T23:56:56.990677+0000","last_clean":"2024-09-15T23:56:56.990677+0000","last_became_active":"2024-09-15T23:56:56.000374+0000","last_became_peered":"2024-09-15T23:56:56.000374+0000","last_unstale":"2024-09-15T23:56:56.990677+0000","last_undegraded":"2024-09-15T23:56:56.990677+0000","last_fullsized":"2024-09-15T23:56:56.990677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:25.361845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753604+0000","last_change":"2024-09-15T23:56:54.979283+0000","last_active":"2024-09-15T23:56:57.753604+0000","last_peered":"2024-09-15T23:56:57.753604+0000","last_clean":"2024-09-15T23:56:57.753604+0000","last_became_active":"2024-09-15T23:56:54.977838+0000","last_became_peered":"2024-09-15T23:56:54.977838+0000","last_unstale":"2024-09-15T23:56:57.753604+0000","last_undegraded":"2024-09-15T23:56:57.753604+0000","last_fullsized":"2024-09-15T23:56:57.753604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:21.518878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753441+0000","last_change":"2024-09-15T23:56:55.995988+0000","last_active":"2024-09-15T23:56:57.753441+0000","last_peered":"2024-09-15T23:56:57.753441+0000","last_clean":"2024-09-15T23:56:57.753441+0000","last_became_active":"2024-09-15T23:56:55.995137+0000","last_became_peered":"2024-09-15T23:56:55.995137+0000","last_unstale":"2024-09-15T23:56:57.753441+0000","last_undegraded":"2024-09-15T23:56:57.753441+0000","last_fullsized":"2024-09-15T23:56:57.753441+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:46.961167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753667+0000","last_change":"2024-09-15T23:56:54.984311+0000","last_active":"2024-09-15T23:56:57.753667+0000","last_peered":"2024-09-15T23:56:57.753667+0000","last_clean":"2024-09-15T23:56:57.753667+0000","last_became_active":"2024-09-15T23:56:54.983912+0000","last_became_peered":"2024-09-15T23:56:54.983912+0000","last_unstale":"2024-09-15T23:56:57.753667+0000","last_undegraded":"2024-09-15T23:56:57.753667+0000","last_fullsized":"2024-09-15T23:56:57.753667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:12.265924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753712+0000","last_change":"2024-09-15T23:56:56.007768+0000","last_active":"2024-09-15T23:56:57.753712+0000","last_peered":"2024-09-15T23:56:57.753712+0000","last_clean":"2024-09-15T23:56:57.753712+0000","last_became_active":"2024-09-15T23:56:56.001858+0000","last_became_peered":"2024-09-15T23:56:56.001858+0000","last_unstale":"2024-09-15T23:56:57.753712+0000","last_undegraded":"2024-09-15T23:56:57.753712+0000","last_fullsized":"2024-09-15T23:56:57.753712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:06.231114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993111+0000","last_change":"2024-09-15T23:56:54.983601+0000","last_active":"2024-09-15T23:56:56.993111+0000","last_peered":"2024-09-15T23:56:56.993111+0000","last_clean":"2024-09-15T23:56:56.993111+0000","last_became_active":"2024-09-15T23:56:54.982965+0000","last_became_peered":"2024-09-15T23:56:54.982965+0000","last_unstale":"2024-09-15T23:56:56.993111+0000","last_undegraded":"2024-09-15T23:56:56.993111+0000","last_fullsized":"2024-09-15T23:56:56.993111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:02.232324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754317+0000","last_change":"2024-09-15T23:56:55.995723+0000","last_active":"2024-09-15T23:56:57.754317+0000","last_peered":"2024-09-15T23:56:57.754317+0000","last_clean":"2024-09-15T23:56:57.754317+0000","last_became_active":"2024-09-15T23:56:55.994899+0000","last_became_peered":"2024-09-15T23:56:55.994899+0000","last_unstale":"2024-09-15T23:56:57.754317+0000","last_undegraded":"2024-09-15T23:56:57.754317+0000","last_fullsized":"2024-09-15T23:56:57.754317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:09.909885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.990219+0000","last_change":"2024-09-15T23:56:54.980943+0000","last_active":"2024-09-15T23:56:56.990219+0000","last_peered":"2024-09-15T23:56:56.990219+0000","last_clean":"2024-09-15T23:56:56.990219+0000","last_became_active":"2024-09-15T23:56:54.979920+0000","last_became_peered":"2024-09-15T23:56:54.979920+0000","last_unstale":"2024-09-15T23:56:56.990219+0000","last_undegraded":"2024-09-15T23:56:56.990219+0000","last_fullsized":"2024-09-15T23:56:56.990219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:31.342987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.983595+0000","last_change":"2024-09-15T23:56:55.980040+0000","last_active":"2024-09-15T23:56:56.983595+0000","last_peered":"2024-09-15T23:56:56.983595+0000","last_clean":"2024-09-15T23:56:56.983595+0000","last_became_active":"2024-09-15T23:56:55.979643+0000","last_became_peered":"2024-09-15T23:56:55.979643+0000","last_unstale":"2024-09-15T23:56:56.983595+0000","last_undegraded":"2024-09-15T23:56:56.983595+0000","last_fullsized":"2024-09-15T23:56:56.983595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:18.438676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992630+0000","last_change":"2024-09-15T23:56:54.986965+0000","last_active":"2024-09-15T23:56:56.992630+0000","last_peered":"2024-09-15T23:56:56.992630+0000","last_clean":"2024-09-15T23:56:56.992630+0000","last_became_active":"2024-09-15T23:56:54.986306+0000","last_became_peered":"2024-09-15T23:56:54.986306+0000","last_unstale":"2024-09-15T23:56:56.992630+0000","last_undegraded":"2024-09-15T23:56:56.992630+0000","last_fullsized":"2024-09-15T23:56:56.992630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:40.725441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751761+0000","last_change":"2024-09-15T23:56:55.973928+0000","last_active":"2024-09-15T23:56:57.751761+0000","last_peered":"2024-09-15T23:56:57.751761+0000","last_clean":"2024-09-15T23:56:57.751761+0000","last_became_active":"2024-09-15T23:56:55.973107+0000","last_became_peered":"2024-09-15T23:56:55.973107+0000","last_unstale":"2024-09-15T23:56:57.751761+0000","last_undegraded":"2024-09-15T23:56:57.751761+0000","last_fullsized":"2024-09-15T23:56:57.751761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:30.375034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252606+0000","last_change":"2024-09-15T23:56:54.986074+0000","last_active":"2024-09-15T23:56:57.252606+0000","last_peered":"2024-09-15T23:56:57.252606+0000","last_clean":"2024-09-15T23:56:57.252606+0000","last_became_active":"2024-09-15T23:56:54.985826+0000","last_became_peered":"2024-09-15T23:56:54.985826+0000","last_unstale":"2024-09-15T23:56:57.252606+0000","last_undegraded":"2024-09-15T23:56:57.252606+0000","last_fullsized":"2024-09-15T23:56:57.252606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:06.066930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252009+0000","last_change":"2024-09-15T23:56:56.006520+0000","last_active":"2024-09-15T23:56:57.252009+0000","last_peered":"2024-09-15T23:56:57.252009+0000","last_clean":"2024-09-15T23:56:57.252009+0000","last_became_active":"2024-09-15T23:56:56.006086+0000","last_became_peered":"2024-09-15T23:56:56.006086+0000","last_unstale":"2024-09-15T23:56:57.252009+0000","last_undegraded":"2024-09-15T23:56:57.252009+0000","last_fullsized":"2024-09-15T23:56:57.252009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:04.416975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752550+0000","last_change":"2024-09-15T23:56:54.987749+0000","last_active":"2024-09-15T23:56:57.752550+0000","last_peered":"2024-09-15T23:56:57.752550+0000","last_clean":"2024-09-15T23:56:57.752550+0000","last_became_active":"2024-09-15T23:56:54.987176+0000","last_became_peered":"2024-09-15T23:56:54.987176+0000","last_unstale":"2024-09-15T23:56:57.752550+0000","last_undegraded":"2024-09-15T23:56:57.752550+0000","last_fullsized":"2024-09-15T23:56:57.752550+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:09.647148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751638+0000","last_change":"2024-09-15T23:56:56.011693+0000","last_active":"2024-09-15T23:56:57.751638+0000","last_peered":"2024-09-15T23:56:57.751638+0000","last_clean":"2024-09-15T23:56:57.751638+0000","last_became_active":"2024-09-15T23:56:56.011413+0000","last_became_peered":"2024-09-15T23:56:56.011413+0000","last_unstale":"2024-09-15T23:56:57.751638+0000","last_undegraded":"2024-09-15T23:56:57.751638+0000","last_fullsized":"2024-09-15T23:56:57.751638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:54.729698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.252252+0000","last_change":"2024-09-15T23:56:54.960462+0000","last_active":"2024-09-15T23:56:57.252252+0000","last_peered":"2024-09-15T23:56:57.252252+0000","last_clean":"2024-09-15T23:56:57.252252+0000","last_became_active":"2024-09-15T23:56:54.960172+0000","last_became_peered":"2024-09-15T23:56:54.960172+0000","last_unstale":"2024-09-15T23:56:57.252252+0000","last_undegraded":"2024-09-15T23:56:57.252252+0000","last_fullsized":"2024-09-15T23:56:57.252252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:02.312104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.991046+0000","last_change":"2024-09-15T23:56:55.969820+0000","last_active":"2024-09-15T23:56:56.991046+0000","last_peered":"2024-09-15T23:56:56.991046+0000","last_clean":"2024-09-15T23:56:56.991046+0000","last_became_active":"2024-09-15T23:56:55.967469+0000","last_became_peered":"2024-09-15T23:56:55.967469+0000","last_unstale":"2024-09-15T23:56:56.991046+0000","last_undegraded":"2024-09-15T23:56:56.991046+0000","last_fullsized":"2024-09-15T23:56:56.991046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:15.623608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752041+0000","last_change":"2024-09-15T23:56:54.962171+0000","last_active":"2024-09-15T23:56:57.752041+0000","last_peered":"2024-09-15T23:56:57.752041+0000","last_clean":"2024-09-15T23:56:57.752041+0000","last_became_active":"2024-09-15T23:56:54.961049+0000","last_became_peered":"2024-09-15T23:56:54.961049+0000","last_unstale":"2024-09-15T23:56:57.752041+0000","last_undegraded":"2024-09-15T23:56:57.752041+0000","last_fullsized":"2024-09-15T23:56:57.752041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:02.312104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.753199+0000","last_change":"2024-09-15T23:56:56.001041+0000","last_active":"2024-09-15T23:56:57.753199+0000","last_peered":"2024-09-15T23:56:57.753199+0000","last_clean":"2024-09-15T23:56:57.753199+0000","last_became_active":"2024-09-15T23:56:56.000667+0000","last_became_peered":"2024-09-15T23:56:56.000667+0000","last_unstale":"2024-09-15T23:56:57.753199+0000","last_undegraded":"2024-09-15T23:56:57.753199+0000","last_fullsized":"2024-09-15T23:56:57.753199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:14.922569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.983457+0000","last_change":"2024-09-15T23:56:54.965646+0000","last_active":"2024-09-15T23:56:56.983457+0000","last_peered":"2024-09-15T23:56:56.983457+0000","last_clean":"2024-09-15T23:56:56.983457+0000","last_became_active":"2024-09-15T23:56:54.965286+0000","last_became_peered":"2024-09-15T23:56:54.965286+0000","last_unstale":"2024-09-15T23:56:56.983457+0000","last_undegraded":"2024-09-15T23:56:56.983457+0000","last_fullsized":"2024-09-15T23:56:56.983457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:07.610999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752209+0000","last_change":"2024-09-15T23:56:56.004365+0000","last_active":"2024-09-15T23:56:57.752209+0000","last_peered":"2024-09-15T23:56:57.752209+0000","last_clean":"2024-09-15T23:56:57.752209+0000","last_became_active":"2024-09-15T23:56:56.004079+0000","last_became_peered":"2024-09-15T23:56:56.004079+0000","last_unstale":"2024-09-15T23:56:57.752209+0000","last_undegraded":"2024-09-15T23:56:57.752209+0000","last_fullsized":"2024-09-15T23:56:57.752209+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:19.060961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752606+0000","last_change":"2024-09-15T23:56:54.983702+0000","last_active":"2024-09-15T23:56:57.752606+0000","last_peered":"2024-09-15T23:56:57.752606+0000","last_clean":"2024-09-15T23:56:57.752606+0000","last_became_active":"2024-09-15T23:56:54.983127+0000","last_became_peered":"2024-09-15T23:56:54.983127+0000","last_unstale":"2024-09-15T23:56:57.752606+0000","last_undegraded":"2024-09-15T23:56:57.752606+0000","last_fullsized":"2024-09-15T23:56:57.752606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:25.310145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.993972+0000","last_change":"2024-09-15T23:56:55.987825+0000","last_active":"2024-09-15T23:56:56.993972+0000","last_peered":"2024-09-15T23:56:56.993972+0000","last_clean":"2024-09-15T23:56:56.993972+0000","last_became_active":"2024-09-15T23:56:55.976689+0000","last_became_peered":"2024-09-15T23:56:55.976689+0000","last_unstale":"2024-09-15T23:56:56.993972+0000","last_undegraded":"2024-09-15T23:56:56.993972+0000","last_fullsized":"2024-09-15T23:56:56.993972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:39.595978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.751496+0000","last_change":"2024-09-15T23:56:54.957629+0000","last_active":"2024-09-15T23:56:57.751496+0000","last_peered":"2024-09-15T23:56:57.751496+0000","last_clean":"2024-09-15T23:56:57.751496+0000","last_became_active":"2024-09-15T23:56:54.957340+0000","last_became_peered":"2024-09-15T23:56:54.957340+0000","last_unstale":"2024-09-15T23:56:57.751496+0000","last_undegraded":"2024-09-15T23:56:57.751496+0000","last_fullsized":"2024-09-15T23:56:57.751496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:45.950977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.754194+0000","last_change":"2024-09-15T23:56:55.994826+0000","last_active":"2024-09-15T23:56:57.754194+0000","last_peered":"2024-09-15T23:56:57.754194+0000","last_clean":"2024-09-15T23:56:57.754194+0000","last_became_active":"2024-09-15T23:56:55.994110+0000","last_became_peered":"2024-09-15T23:56:55.994110+0000","last_unstale":"2024-09-15T23:56:57.754194+0000","last_undegraded":"2024-09-15T23:56:57.754194+0000","last_fullsized":"2024-09-15T23:56:57.754194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:41.281743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.992782+0000","last_change":"2024-09-15T23:56:54.984135+0000","last_active":"2024-09-15T23:56:56.992782+0000","last_peered":"2024-09-15T23:56:56.992782+0000","last_clean":"2024-09-15T23:56:56.992782+0000","last_became_active":"2024-09-15T23:56:54.983684+0000","last_became_peered":"2024-09-15T23:56:54.983684+0000","last_unstale":"2024-09-15T23:56:56.992782+0000","last_undegraded":"2024-09-15T23:56:56.992782+0000","last_fullsized":"2024-09-15T23:56:56.992782+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:37.846622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:56.983774+0000","last_change":"2024-09-15T23:56:56.000389+0000","last_active":"2024-09-15T23:56:56.983774+0000","last_peered":"2024-09-15T23:56:56.983774+0000","last_clean":"2024-09-15T23:56:56.983774+0000","last_became_active":"2024-09-15T23:56:56.000139+0000","last_became_peered":"2024-09-15T23:56:56.000139+0000","last_unstale":"2024-09-15T23:56:56.983774+0000","last_undegraded":"2024-09-15T23:56:56.983774+0000","last_fullsized":"2024-09-15T23:56:56.983774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:54.932188+0000","last_clean_scrub_stamp":"2024-09-15T23:56:54.932188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:39.150770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.752181+0000","last_change":"2024-09-15T23:56:54.974116+0000","last_active":"2024-09-15T23:56:57.752181+0000","last_peered":"2024-09-15T23:56:57.752181+0000","last_clean":"2024-09-15T23:56:57.752181+0000","last_became_active":"2024-09-15T23:56:54.973419+0000","last_became_peered":"2024-09-15T23:56:54.973419+0000","last_unstale":"2024-09-15T23:56:57.752181+0000","last_undegraded":"2024-09-15T23:56:57.752181+0000","last_fullsized":"2024-09-15T23:56:57.752181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:53.921998+0000","last_clean_scrub_stamp":"2024-09-15T23:56:53.921998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:17.992076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":267,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-15T23:56:57.251270+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:56:57.251270+0000","last_peered":"2024-09-15T23:56:57.251270+0000","last_clean":"2024-09-15T23:56:57.251270+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:56:57.251270+0000","last_undegraded":"2024-09-15T23:56:57.251270+0000","last_fullsized":"2024-09-15T23:56:57.251270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":917504,"data_stored":412618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":917504,"data_stored":412638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":913408,"data_stored":411988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509484,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":929792,"data_stored":413682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":909312,"data_stored":411966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1519616,"data_stored":1003980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":913408,"data_stored":411988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1507328,"data_stored":1002424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:57:04.152 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:57:04.153 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:57:04.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.317+0000 7feae56df640 1 Processor -- start 2024-09-15T23:57:04.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.317+0000 7feae56df640 1 -- start start 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.317+0000 7feae56df640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7feae00af100 0x7feae0071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.317+0000 7feae56df640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae015b800 con 0x7feae00acf60 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.317+0000 7feae56df640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae00723a0 con 0x7feae006f620 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.317+0000 7feae56df640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7feae0072680 con 0x7feae00af100 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.317+0000 7feade7fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7feae00acf60 0x7feae006ef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55290/0 (socket says 172.21.15.112:55290) 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.317+0000 7feade7fc640 1 -- 172.21.15.112:0/1905221462 learned_addr learned my addr 172.21.15.112:0/1905221462 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.317+0000 7feadeffd640 1 --2- 172.21.15.112:0/1905221462 >> v2:172.21.15.169:3300/0 conn(0x7feae00af100 0x7feae0071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 -- 172.21.15.112:0/1905221462 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1689558122 0 0) 0x7feae015b800 con 0x7feae00acf60 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 -- 172.21.15.112:0/1905221462 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feac8003530 con 0x7feae00acf60 2024-09-15T23:57:04.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 -- 172.21.15.112:0/1905221462 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2262475483 0 0) 0x7feac8003530 con 0x7feae00acf60 2024-09-15T23:57:04.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 -- 172.21.15.112:0/1905221462 >> v2:172.21.15.169:3300/0 conn(0x7feae00af100 msgr2=0x7feae0071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:04.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 --2- 172.21.15.112:0/1905221462 >> v2:172.21.15.169:3300/0 conn(0x7feae00af100 0x7feae0071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 -- 172.21.15.112:0/1905221462 >> v1:172.21.15.169:6789/0 conn(0x7feae006f620 legacy=0x7feae0073440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 -- 172.21.15.112:0/1905221462 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae0072960 con 0x7feae00acf60 2024-09-15T23:57:04.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 -- 172.21.15.112:0/1905221462 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fead4001680 con 0x7feae00acf60 2024-09-15T23:57:04.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 -- 172.21.15.112:0/1905221462 >> v1:172.21.15.112:6789/0 conn(0x7feae00acf60 legacy=0x7feae006ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 --2- 172.21.15.112:0/1905221462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feac80039c0 0x7feac8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 --2- 172.21.15.112:0/1905221462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feac8004810 0x7feac8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 --2- 172.21.15.112:0/1905221462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feac80051d0 0x7feac800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 -- 172.21.15.112:0/1905221462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feae0072680 con 0x7feac80039c0 2024-09-15T23:57:04.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 -- 172.21.15.112:0/1905221462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feac800c170 con 0x7feac8004810 2024-09-15T23:57:04.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 -- 172.21.15.112:0/1905221462 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feac800c370 con 0x7feac80051d0 2024-09-15T23:57:04.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feadeffd640 1 --2- 172.21.15.112:0/1905221462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feac80039c0 0x7feac8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feade7fc640 1 --2- 172.21.15.112:0/1905221462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feac8004810 0x7feac8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feadeffd640 1 -- 172.21.15.112:0/1905221462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feac80051d0 msgr2=0x7feac800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:04.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feadeffd640 1 --2- 172.21.15.112:0/1905221462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feac80051d0 0x7feac800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feadeffd640 1 -- 172.21.15.112:0/1905221462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feac8004810 msgr2=0x7feac8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:04.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feadeffd640 1 --2- 172.21.15.112:0/1905221462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feac8004810 0x7feac8004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feadeffd640 1 -- 172.21.15.112:0/1905221462 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac8003530 con 0x7feac80039c0 2024-09-15T23:57:04.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feadf7fe640 1 -- 172.21.15.112:0/1905221462 reap_dead start 2024-09-15T23:57:04.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feadeffd640 1 --2- 172.21.15.112:0/1905221462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feac80039c0 0x7feac8003de0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fead0009ae0 tx=0x7fead001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e230198b7efd7ef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 -- 172.21.15.112:0/1905221462 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead00096b0 con 0x7feac80039c0 2024-09-15T23:57:04.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 -- 172.21.15.112:0/1905221462 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead00a6470 con 0x7feac80039c0 2024-09-15T23:57:04.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feaddffb640 1 -- 172.21.15.112:0/1905221462 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead00a6860 con 0x7feac80039c0 2024-09-15T23:57:04.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feae56df640 1 -- 172.21.15.112:0/1905221462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feac80039c0 msgr2=0x7feac8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feae56df640 1 --2- 172.21.15.112:0/1905221462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feac80039c0 0x7feac8003de0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fead0009ae0 tx=0x7fead001ca90 comp rx=0 tx=0).stop 2024-09-15T23:57:04.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feae56df640 1 -- 172.21.15.112:0/1905221462 shutdown_connections 2024-09-15T23:57:04.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feae56df640 1 --2- 172.21.15.112:0/1905221462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feac80039c0 0x7feac8003de0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feae56df640 1 -- 172.21.15.112:0/1905221462 >> 172.21.15.112:0/1905221462 conn(0x7feae00b1c80 msgr2=0x7feae00b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:04.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feae56df640 1 -- 172.21.15.112:0/1905221462 shutdown_connections 2024-09-15T23:57:04.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.321+0000 7feae56df640 1 -- 172.21.15.112:0/1905221462 wait complete. 2024-09-15T23:57:04.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feae56df640 1 Processor -- start 2024-09-15T23:57:04.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feae56df640 1 -- start start 2024-09-15T23:57:04.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feae56df640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feac80039c0 0x7feae01e9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feae56df640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feae01e7c30 0x7feae009cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feae56df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feae01e80b0 0x7feae009d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feae56df640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feae0073c30 con 0x7feae01e80b0 2024-09-15T23:57:04.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feae56df640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feae00ad750 con 0x7feae01e7c30 2024-09-15T23:57:04.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feae56df640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feae0073db0 con 0x7feac80039c0 2024-09-15T23:57:04.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feadf7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feae01e80b0 0x7feae009d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feadf7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feae01e80b0 0x7feae009d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43496/0 (socket says 172.21.15.112:43496) 2024-09-15T23:57:04.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feadf7fe640 1 -- 172.21.15.112:0/148021203 learned_addr learned my addr 172.21.15.112:0/148021203 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:04.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feadeffd640 1 --2- 172.21.15.112:0/148021203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feac80039c0 0x7feae01e9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feade7fc640 1 --2- 172.21.15.112:0/148021203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feae01e7c30 0x7feae009cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feadf7fe640 1 -- 172.21.15.112:0/148021203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feac80039c0 msgr2=0x7feae01e9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feadf7fe640 1 --2- 172.21.15.112:0/148021203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feac80039c0 0x7feae01e9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feadf7fe640 1 -- 172.21.15.112:0/148021203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feae01e7c30 msgr2=0x7feae009cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feadf7fe640 1 --2- 172.21.15.112:0/148021203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feae01e7c30 0x7feae009cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feadf7fe640 1 -- 172.21.15.112:0/148021203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae01e8680 con 0x7feae01e80b0 2024-09-15T23:57:04.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feadf7fe640 1 --2- 172.21.15.112:0/148021203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feae01e80b0 0x7feae009d110 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7feae006fd90 tx=0x7fead800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feac77fe640 1 -- 172.21.15.112:0/148021203 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8017070 con 0x7feae01e80b0 2024-09-15T23:57:04.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feac77fe640 1 -- 172.21.15.112:0/148021203 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead8005d50 con 0x7feae01e80b0 2024-09-15T23:57:04.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feac77fe640 1 -- 172.21.15.112:0/148021203 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead800a850 con 0x7feae01e80b0 2024-09-15T23:57:04.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feae56df640 1 -- 172.21.15.112:0/148021203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae01e8960 con 0x7feae01e80b0 2024-09-15T23:57:04.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feae56df640 1 -- 172.21.15.112:0/148021203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae01e8f20 con 0x7feae01e80b0 2024-09-15T23:57:04.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feae56df640 1 -- 172.21.15.112:0/148021203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae006ef10 con 0x7feae01e80b0 2024-09-15T23:57:04.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.325+0000 7feac77fe640 1 -- 172.21.15.112:0/148021203 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fead800a9f0 con 0x7feae01e80b0 2024-09-15T23:57:04.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.329+0000 7feac77fe640 1 --2- 172.21.15.112:0/148021203 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feacc0678f0 0x7feacc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.329+0000 7feac77fe640 1 -- 172.21.15.112:0/148021203 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fead8084fb0 con 0x7feae01e80b0 2024-09-15T23:57:04.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.329+0000 7feadeffd640 1 --2- 172.21.15.112:0/148021203 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feacc0678f0 0x7feacc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.329+0000 7feadeffd640 1 --2- 172.21.15.112:0/148021203 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feacc0678f0 0x7feacc069db0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fead00ad000 tx=0x7fead00046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.333+0000 7feac77fe640 1 -- 172.21.15.112:0/148021203 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fead8055960 con 0x7feae01e80b0 2024-09-15T23:57:04.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.553+0000 7feae56df640 1 -- 172.21.15.112:0/148021203 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7feae01f4910 con 0x7feae01e80b0 2024-09-15T23:57:04.557 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.553+0000 7feac77fe640 1 -- 172.21.15.112:0/148021203 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7fead8055260 con 0x7feae01e80b0 2024-09-15T23:57:04.557 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-15T23:57:04.557 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw== 2024-09-15T23:57:04.557 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-15T23:57:04.557 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-15T23:57:04.557 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:57:04.557 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-15T23:57:04.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.557+0000 7feae56df640 1 -- 172.21.15.112:0/148021203 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feacc0678f0 msgr2=0x7feacc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.557+0000 7feae56df640 1 --2- 172.21.15.112:0/148021203 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feacc0678f0 0x7feacc069db0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fead00ad000 tx=0x7fead00046d0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.557+0000 7feae56df640 1 -- 172.21.15.112:0/148021203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feae01e80b0 msgr2=0x7feae009d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.557+0000 7feae56df640 1 --2- 172.21.15.112:0/148021203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feae01e80b0 0x7feae009d110 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7feae006fd90 tx=0x7fead800cb90 comp rx=0 tx=0).stop 2024-09-15T23:57:04.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.557+0000 7feae56df640 1 -- 172.21.15.112:0/148021203 shutdown_connections 2024-09-15T23:57:04.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.557+0000 7feae56df640 1 --2- 172.21.15.112:0/148021203 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feacc0678f0 0x7feacc069db0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.557+0000 7feae56df640 1 --2- 172.21.15.112:0/148021203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feae01e80b0 0x7feae009d110 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.557+0000 7feae56df640 1 --2- 172.21.15.112:0/148021203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feae01e7c30 0x7feae009cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.557+0000 7feae56df640 1 --2- 172.21.15.112:0/148021203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feac80039c0 0x7feae01e9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.557+0000 7feae56df640 1 -- 172.21.15.112:0/148021203 >> 172.21.15.112:0/148021203 conn(0x7feae00b1c80 msgr2=0x7feae00b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:04.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.557+0000 7feae56df640 1 -- 172.21.15.112:0/148021203 shutdown_connections 2024-09-15T23:57:04.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.557+0000 7feae56df640 1 -- 172.21.15.112:0/148021203 wait complete. 2024-09-15T23:57:04.577 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:04.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.685+0000 7f5fde655640 1 Processor -- start 2024-09-15T23:57:04.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.685+0000 7f5fde655640 1 -- start start 2024-09-15T23:57:04.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fde655640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5fd815f3a0 0x7f5fd8165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fde655640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd80aede0 con 0x7f5fd81520a0 2024-09-15T23:57:04.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fde655640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd815fa10 con 0x7f5fd8070020 2024-09-15T23:57:04.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fde655640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd8152480 con 0x7f5fd815f3a0 2024-09-15T23:57:04.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fd7fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5fd81520a0 0x7f5fd806f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55294/0 (socket says 172.21.15.112:55294) 2024-09-15T23:57:04.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fdcbf2640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5fd815f3a0 0x7f5fd8165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fd7fff640 1 -- 172.21.15.112:0/1066615839 learned_addr learned my addr 172.21.15.112:0/1066615839 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:04.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fd6ffd640 1 -- 172.21.15.112:0/1066615839 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064635943 0 0) 0x7f5fd80aede0 con 0x7f5fd81520a0 2024-09-15T23:57:04.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fd6ffd640 1 -- 172.21.15.112:0/1066615839 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fc0003530 con 0x7f5fd81520a0 2024-09-15T23:57:04.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fdcbf2640 1 -- 172.21.15.112:0/1066615839 >> v1:172.21.15.169:6789/0 conn(0x7f5fd8070020 legacy=0x7f5fd815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:04.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fdcbf2640 1 -- 172.21.15.112:0/1066615839 >> v1:172.21.15.112:6789/0 conn(0x7f5fd81520a0 legacy=0x7f5fd806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fdcbf2640 1 -- 172.21.15.112:0/1066615839 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd8074250 con 0x7f5fd815f3a0 2024-09-15T23:57:04.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fdcbf2640 1 --2- 172.21.15.112:0/1066615839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd815f3a0 0x7f5fd8165f00 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009d90 tx=0x7f5fd001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b5348e9e482266 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fd6ffd640 1 -- 172.21.15.112:0/1066615839 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00b2070 con 0x7f5fd815f3a0 2024-09-15T23:57:04.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fd6ffd640 1 -- 172.21.15.112:0/1066615839 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd00a59f0 con 0x7f5fd815f3a0 2024-09-15T23:57:04.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.689+0000 7f5fd6ffd640 1 -- 172.21.15.112:0/1066615839 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00a5da0 con 0x7f5fd815f3a0 2024-09-15T23:57:04.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 -- 172.21.15.112:0/1066615839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd815f3a0 msgr2=0x7f5fd8165f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 --2- 172.21.15.112:0/1066615839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd815f3a0 0x7f5fd8165f00 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009d90 tx=0x7f5fd001c930 comp rx=0 tx=0).stop 2024-09-15T23:57:04.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 -- 172.21.15.112:0/1066615839 shutdown_connections 2024-09-15T23:57:04.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 --2- 172.21.15.112:0/1066615839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd815f3a0 0x7f5fd8165f00 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 -- 172.21.15.112:0/1066615839 >> 172.21.15.112:0/1066615839 conn(0x7f5fd80b1f90 msgr2=0x7f5fd80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:04.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 -- 172.21.15.112:0/1066615839 shutdown_connections 2024-09-15T23:57:04.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 -- 172.21.15.112:0/1066615839 wait complete. 2024-09-15T23:57:04.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 Processor -- start 2024-09-15T23:57:04.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 -- start start 2024-09-15T23:57:04.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fd8070020 0x7f5fd8145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd81520a0 0x7f5fd8165a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fd815f3a0 0x7f5fd81514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd8168c60 con 0x7f5fd81520a0 2024-09-15T23:57:04.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd8073d30 con 0x7f5fd815f3a0 2024-09-15T23:57:04.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd8168de0 con 0x7f5fd8070020 2024-09-15T23:57:04.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fd77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd81520a0 0x7f5fd8165a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fd77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd81520a0 0x7f5fd8165a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43526/0 (socket says 172.21.15.112:43526) 2024-09-15T23:57:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fd77fe640 1 -- 172.21.15.112:0/2426371911 learned_addr learned my addr 172.21.15.112:0/2426371911 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fd7fff640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fd8070020 0x7f5fd8145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fdcbf2640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fd815f3a0 0x7f5fd81514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fd77fe640 1 -- 172.21.15.112:0/2426371911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fd8070020 msgr2=0x7f5fd8145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fd77fe640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fd8070020 0x7f5fd8145640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fd77fe640 1 -- 172.21.15.112:0/2426371911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fd815f3a0 msgr2=0x7f5fd81514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fd77fe640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fd815f3a0 0x7f5fd81514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fd77fe640 1 -- 172.21.15.112:0/2426371911 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd815af50 con 0x7f5fd81520a0 2024-09-15T23:57:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fdcbf2640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fd815f3a0 0x7f5fd81514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fd77fe640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd81520a0 0x7f5fd8165a00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00b3e0 tx=0x7f5fcc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fd4ff9640 1 -- 172.21.15.112:0/2426371911 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc015020 con 0x7f5fd81520a0 2024-09-15T23:57:04.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fd4ff9640 1 -- 172.21.15.112:0/2426371911 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fcc011830 con 0x7f5fd81520a0 2024-09-15T23:57:04.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fd4ff9640 1 -- 172.21.15.112:0/2426371911 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc011c20 con 0x7f5fd81520a0 2024-09-15T23:57:04.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 -- 172.21.15.112:0/2426371911 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd81653c0 con 0x7f5fd81520a0 2024-09-15T23:57:04.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.693+0000 7f5fde655640 1 -- 172.21.15.112:0/2426371911 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd8151a20 con 0x7f5fd81520a0 2024-09-15T23:57:04.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.697+0000 7f5fde655640 1 -- 172.21.15.112:0/2426371911 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd815ec90 con 0x7f5fd81520a0 2024-09-15T23:57:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.697+0000 7f5fd4ff9640 1 -- 172.21.15.112:0/2426371911 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5fcc018020 con 0x7f5fd81520a0 2024-09-15T23:57:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.697+0000 7f5fd4ff9640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5fc40678c0 0x7f5fc4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.697+0000 7f5fd7fff640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5fc40678c0 0x7f5fc4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.697+0000 7f5fd4ff9640 1 -- 172.21.15.112:0/2426371911 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f5fcc085db0 con 0x7f5fd81520a0 2024-09-15T23:57:04.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.697+0000 7f5fd7fff640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5fc40678c0 0x7f5fc4069d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8007fd0 tx=0x7f5fc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.701+0000 7f5fd4ff9640 1 -- 172.21.15.112:0/2426371911 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5fcc01f020 con 0x7f5fd81520a0 2024-09-15T23:57:04.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.881+0000 7f5fde655640 1 -- 172.21.15.112:0/2426371911 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fd8145c00 con 0x7f5fd81520a0 2024-09-15T23:57:04.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.881+0000 7f5fd4ff9640 1 -- 172.21.15.112:0/2426371911 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5231 (secure 0 0 0) 0x7f5fcc0172c0 con 0x7f5fd81520a0 2024-09-15T23:57:04.884 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:04.884 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"btime":"2024-09-15T23:56:58:369858+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2072637952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2072637952},{"type":"v1","addr":"172.21.15.169:6833","nonce":2072637952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/33750051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":33750051},{"type":"v1","addr":"172.21.15.169:6835","nonce":33750051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6018,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/4092393174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":4092393174},{"type":"v1","addr":"172.21.15.112:6837","nonce":4092393174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:55.316845+0000","modified":"2024-09-15T23:56:57.719503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6021},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6021":{"gid":6021,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1581911691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1581911691},{"type":"v1","addr":"172.21.15.112:6836","nonce":1581911691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6021,"qdb_cluster":[6021]},"id":5}]} 2024-09-15T23:57:04.884 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 37 2024-09-15T23:57:04.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.885+0000 7f5fde655640 1 -- 172.21.15.112:0/2426371911 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5fc40678c0 msgr2=0x7f5fc4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.885+0000 7f5fde655640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5fc40678c0 0x7f5fc4069d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8007fd0 tx=0x7f5fc8009040 comp rx=0 tx=0).stop 2024-09-15T23:57:04.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.885+0000 7f5fde655640 1 -- 172.21.15.112:0/2426371911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd81520a0 msgr2=0x7f5fd8165a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.885+0000 7f5fde655640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd81520a0 0x7f5fd8165a00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00b3e0 tx=0x7f5fcc00b8a0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.885+0000 7f5fde655640 1 -- 172.21.15.112:0/2426371911 shutdown_connections 2024-09-15T23:57:04.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.885+0000 7f5fde655640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5fc40678c0 0x7f5fc4069d80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.885+0000 7f5fde655640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fd815f3a0 0x7f5fd81514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.885+0000 7f5fde655640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5fd81520a0 0x7f5fd8165a00 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.885+0000 7f5fde655640 1 --2- 172.21.15.112:0/2426371911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fd8070020 0x7f5fd8145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.885+0000 7f5fde655640 1 -- 172.21.15.112:0/2426371911 >> 172.21.15.112:0/2426371911 conn(0x7f5fd80b1f90 msgr2=0x7f5fd814ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:04.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.885+0000 7f5fde655640 1 -- 172.21.15.112:0/2426371911 shutdown_connections 2024-09-15T23:57:04.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:04.885+0000 7f5fde655640 1 -- 172.21.15.112:0/2426371911 wait complete. 2024-09-15T23:57:05.304 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:56:55.316845+0000', 'modified': '2024-09-15T23:56:57.719503+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6021}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6021': {'gid': 6021, 'name': 'a', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6836/1581911691', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 1581911691}, {'type': 'v1', 'addr': '172.21.15.112:6836', 'nonce': 1581911691}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6021, 'qdb_cluster': [6021]} 2024-09-15T23:57:05.304 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:57:05.304 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T23:57:05.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.437+0000 7f5839c64640 1 Processor -- start 2024-09-15T23:57:05.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.437+0000 7f5839c64640 1 -- start start 2024-09-15T23:57:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.437+0000 7f5839c64640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f583415c2a0 0x7f58340aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.437+0000 7f5839c64640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58340b3290 con 0x7f58340af2a0 2024-09-15T23:57:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.437+0000 7f5839c64640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58340b3570 con 0x7f583415bec0 2024-09-15T23:57:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.437+0000 7f5839c64640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f58340b3850 con 0x7f583415c2a0 2024-09-15T23:57:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.437+0000 7f5832ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f583415c2a0 0x7f58340aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.437+0000 7f5832ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f583415c2a0 0x7f58340aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43542/0 (socket says 172.21.15.112:43542) 2024-09-15T23:57:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.437+0000 7f5833fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f58340af2a0 0x7f583406e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55310/0 (socket says 172.21.15.112:55310) 2024-09-15T23:57:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.437+0000 7f5832ffd640 1 -- 172.21.15.112:0/3353403102 learned_addr learned my addr 172.21.15.112:0/3353403102 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.437+0000 7f5832ffd640 1 -- 172.21.15.112:0/3353403102 >> v1:172.21.15.169:6789/0 conn(0x7f583415bec0 legacy=0x7f58340ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.437+0000 7f5832ffd640 1 -- 172.21.15.112:0/3353403102 >> v1:172.21.15.112:6789/0 conn(0x7f58340af2a0 legacy=0x7f583406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.437+0000 7f58327fc640 1 -- 172.21.15.112:0/3353403102 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230043247 0 0) 0x7f58340b3290 con 0x7f58340af2a0 2024-09-15T23:57:05.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.437+0000 7f5832ffd640 1 -- 172.21.15.112:0/3353403102 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58340b3b30 con 0x7f583415c2a0 2024-09-15T23:57:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.441+0000 7f5832ffd640 1 --2- 172.21.15.112:0/3353403102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f583415c2a0 0x7f58340aed60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5828009870 tx=0x7f582801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec3b5292a470c1e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.441+0000 7f58327fc640 1 -- 172.21.15.112:0/3353403102 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58280aa650 con 0x7f583415c2a0 2024-09-15T23:57:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.441+0000 7f58327fc640 1 -- 172.21.15.112:0/3353403102 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58280af070 con 0x7f583415c2a0 2024-09-15T23:57:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.441+0000 7f58327fc640 1 -- 172.21.15.112:0/3353403102 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58280aaa10 con 0x7f583415c2a0 2024-09-15T23:57:05.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.441+0000 7f5839c64640 1 -- 172.21.15.112:0/3353403102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f583415c2a0 msgr2=0x7f58340aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.441+0000 7f5839c64640 1 --2- 172.21.15.112:0/3353403102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f583415c2a0 0x7f58340aed60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5828009870 tx=0x7f582801c4f0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.441+0000 7f5839c64640 1 -- 172.21.15.112:0/3353403102 shutdown_connections 2024-09-15T23:57:05.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.441+0000 7f5839c64640 1 --2- 172.21.15.112:0/3353403102 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f583415c2a0 0x7f58340aed60 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.441+0000 7f5839c64640 1 -- 172.21.15.112:0/3353403102 >> 172.21.15.112:0/3353403102 conn(0x7f58340b1f90 msgr2=0x7f58340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.441+0000 7f5839c64640 1 -- 172.21.15.112:0/3353403102 shutdown_connections 2024-09-15T23:57:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.441+0000 7f5839c64640 1 -- 172.21.15.112:0/3353403102 wait complete. 2024-09-15T23:57:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5839c64640 1 Processor -- start 2024-09-15T23:57:05.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5839c64640 1 -- start start 2024-09-15T23:57:05.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5839c64640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58340af2a0 0x7f583414e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5839c64640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f583415bec0 0x7f583415eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5839c64640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f583415c2a0 0x7f5834147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5839c64640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f583406ef20 con 0x7f583415bec0 2024-09-15T23:57:05.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5839c64640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58340af6d0 con 0x7f58340af2a0 2024-09-15T23:57:05.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5839c64640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f583406f0a0 con 0x7f583415c2a0 2024-09-15T23:57:05.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5832ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f583415bec0 0x7f583415eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5832ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f583415bec0 0x7f583415eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43550/0 (socket says 172.21.15.112:43550) 2024-09-15T23:57:05.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5832ffd640 1 -- 172.21.15.112:0/53419368 learned_addr learned my addr 172.21.15.112:0/53419368 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:05.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5833fff640 1 --2- 172.21.15.112:0/53419368 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f583415c2a0 0x7f5834147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f58337fe640 1 --2- 172.21.15.112:0/53419368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58340af2a0 0x7f583414e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5832ffd640 1 -- 172.21.15.112:0/53419368 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f583415c2a0 msgr2=0x7f5834147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5832ffd640 1 --2- 172.21.15.112:0/53419368 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f583415c2a0 0x7f5834147930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5832ffd640 1 -- 172.21.15.112:0/53419368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58340af2a0 msgr2=0x7f583414e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5832ffd640 1 --2- 172.21.15.112:0/53419368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58340af2a0 0x7f583414e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5832ffd640 1 -- 172.21.15.112:0/53419368 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f583415f530 con 0x7f583415bec0 2024-09-15T23:57:05.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5832ffd640 1 --2- 172.21.15.112:0/53419368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f583415bec0 0x7f583415eff0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f58280ac040 tx=0x7f5828019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f581bfff640 1 -- 172.21.15.112:0/53419368 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58280aae60 con 0x7f583415bec0 2024-09-15T23:57:05.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5839c64640 1 -- 172.21.15.112:0/53419368 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f583415dbc0 con 0x7f583415bec0 2024-09-15T23:57:05.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f581bfff640 1 -- 172.21.15.112:0/53419368 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58280a6040 con 0x7f583415bec0 2024-09-15T23:57:05.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f581bfff640 1 -- 172.21.15.112:0/53419368 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58280b4a90 con 0x7f583415bec0 2024-09-15T23:57:05.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f5839c64640 1 -- 172.21.15.112:0/53419368 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f583415e180 con 0x7f583415bec0 2024-09-15T23:57:05.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.445+0000 7f581bfff640 1 -- 172.21.15.112:0/53419368 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58280bc020 con 0x7f583415bec0 2024-09-15T23:57:05.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f581bfff640 1 --2- 172.21.15.112:0/53419368 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58200678c0 0x7f5820069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f581bfff640 1 -- 172.21.15.112:0/53419368 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f5828120590 con 0x7f583415bec0 2024-09-15T23:57:05.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f58337fe640 1 --2- 172.21.15.112:0/53419368 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58200678c0 0x7f5820069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f58337fe640 1 --2- 172.21.15.112:0/53419368 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58200678c0 0x7f5820069d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5824004e30 tx=0x7f5824009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 Processor -- start 2024-09-15T23:57:05.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 -- start start 2024-09-15T23:57:05.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x55892830af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55892830b440 0x5589282c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5589282c1290 0x5589282c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5589281a8b60 con 0x55892830ab20 2024-09-15T23:57:05.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55892810fc70 con 0x5589282c1290 2024-09-15T23:57:05.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5589280b5ed0 con 0x55892830b440 2024-09-15T23:57:05.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f58337fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x55892830af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.461 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f58337fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x55892830af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43556/0 (socket says 172.21.15.112:43556) 2024-09-15T23:57:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f58337fe640 1 -- 172.21.15.112:0/219444610 learned_addr learned my addr 172.21.15.112:0/219444610 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f58337fe640 1 -- 172.21.15.112:0/219444610 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55892830b440 msgr2=0x5589282c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f58337fe640 1 --2- 172.21.15.112:0/219444610 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55892830b440 0x5589282c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f58337fe640 1 -- 172.21.15.112:0/219444610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5589282c1290 msgr2=0x5589282c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f58337fe640 1 --2- 172.21.15.112:0/219444610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5589282c1290 0x5589282c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f58337fe640 1 -- 172.21.15.112:0/219444610 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589280c7e50 con 0x55892830ab20 2024-09-15T23:57:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f58337fe640 1 --2- 172.21.15.112:0/219444610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x55892830af00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f58240055d0 tx=0x7f5824011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a597bb5582bb9e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f58197fa640 1 -- 172.21.15.112:0/219444610 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5824025070 con 0x55892830ab20 2024-09-15T23:57:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f58197fa640 1 -- 172.21.15.112:0/219444610 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5824015880 con 0x55892830ab20 2024-09-15T23:57:05.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f58197fa640 1 -- 172.21.15.112:0/219444610 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5824015c30 con 0x55892830ab20 2024-09-15T23:57:05.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 -- 172.21.15.112:0/219444610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 msgr2=0x55892830af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 --2- 172.21.15.112:0/219444610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x55892830af00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f58240055d0 tx=0x7f5824011000 comp rx=0 tx=0).stop 2024-09-15T23:57:05.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 -- 172.21.15.112:0/219444610 shutdown_connections 2024-09-15T23:57:05.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 --2- 172.21.15.112:0/219444610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5589282c1290 0x5589282c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 --2- 172.21.15.112:0/219444610 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55892830b440 0x5589282c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 --2- 172.21.15.112:0/219444610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x55892830af00 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 -- 172.21.15.112:0/219444610 >> 172.21.15.112:0/219444610 conn(0x5589282c7600 msgr2=0x5589282bf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:05.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 -- 172.21.15.112:0/219444610 shutdown_connections 2024-09-15T23:57:05.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 -- 172.21.15.112:0/219444610 wait complete. 2024-09-15T23:57:05.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 -- start start 2024-09-15T23:57:05.463 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.449+0000 7f583cd20000 1 Processor -- start 2024-09-15T23:57:05.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x5589282c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55892830b440 0x5589282cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5589282c6330 0x5589282cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558928171b00 con 0x55892830ab20 2024-09-15T23:57:05.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5589280ea360 con 0x55892830b440 2024-09-15T23:57:05.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5589280e72d0 con 0x5589282c6330 2024-09-15T23:57:05.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 10 client.0 _ll_register_callbacks cb 0x5589282ac820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:57:05.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58337fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x5589282c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58337fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x5589282c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43562/0 (socket says 172.21.15.112:43562) 2024-09-15T23:57:05.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58337fe640 1 -- 172.21.15.112:0/3146035202 learned_addr learned my addr 172.21.15.112:0/3146035202 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:05.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f5832ffd640 1 --2- 172.21.15.112:0/3146035202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55892830b440 0x5589282cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f5833fff640 1 --2- 172.21.15.112:0/3146035202 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5589282c6330 0x5589282cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58337fe640 1 -- 172.21.15.112:0/3146035202 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5589282c6330 msgr2=0x5589282cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:05.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58337fe640 1 --2- 172.21.15.112:0/3146035202 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5589282c6330 0x5589282cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58337fe640 1 -- 172.21.15.112:0/3146035202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55892830b440 msgr2=0x5589282cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:05.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58337fe640 1 --2- 172.21.15.112:0/3146035202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55892830b440 0x5589282cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58337fe640 1 -- 172.21.15.112:0/3146035202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589280b6120 con 0x55892830ab20 2024-09-15T23:57:05.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f5832ffd640 1 --2- 172.21.15.112:0/3146035202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55892830b440 0x5589282cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:05.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58337fe640 1 --2- 172.21.15.112:0/3146035202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x5589282c5df0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5824023040 tx=0x7f5824003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266fa40cbd387bd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58127fc640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:57:05.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58127fc640 1 -- 172.21.15.112:0/3146035202 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582402e060 con 0x55892830ab20 2024-09-15T23:57:05.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 -- 172.21.15.112:0/3146035202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5824015880 con 0x55892830ab20 2024-09-15T23:57:05.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58127fc640 1 -- 172.21.15.112:0/3146035202 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f5824015af0 con 0x55892830ab20 2024-09-15T23:57:05.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58127fc640 1 -- 172.21.15.112:0/3146035202 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f5824034050 con 0x55892830ab20 2024-09-15T23:57:05.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 10 client.6174 fetch_fsmap learned FSMap version 37 2024-09-15T23:57:05.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 -- 172.21.15.112:0/3146035202 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x5589280af450 con 0x55892830ab20 2024-09-15T23:57:05.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58127fc640 1 -- 172.21.15.112:0/3146035202 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5824015880 con 0x55892830ab20 2024-09-15T23:57:05.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58127fc640 1 -- 172.21.15.112:0/3146035202 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 37) ==== 3502+0+0 (secure 0 0 0) 0x7f5824037020 con 0x55892830ab20 2024-09-15T23:57:05.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 10 client.6174 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T23:57:05.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 10 client.6174 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:57:05.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 20 client.6174 populate_metadata read hostname 'smithi112' 2024-09-15T23:57:05.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 --2- 172.21.15.112:0/3146035202 >> [v2:172.21.15.112:6834/1581911691,v1:172.21.15.112:6836/1581911691] conn(0x558928310f50 0x558928311330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 4 client.6174 mds_command: new command op to 6021 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:57:05.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 -- 172.21.15.112:0/3146035202 --> [v2:172.21.15.112:6834/1581911691,v1:172.21.15.112:6836/1581911691] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589280a9c00 con 0x558928310f50 2024-09-15T23:57:05.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f5832ffd640 1 --2- 172.21.15.112:0/3146035202 >> [v2:172.21.15.112:6834/1581911691,v1:172.21.15.112:6836/1581911691] conn(0x558928310f50 0x558928311330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58127fc640 10 client.6174 ms_handle_connect on v2:172.21.15.112:6834/1581911691 2024-09-15T23:57:05.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f5832ffd640 1 --2- 172.21.15.112:0/3146035202 >> [v2:172.21.15.112:6834/1581911691,v1:172.21.15.112:6836/1581911691] conn(0x558928310f50 0x558928311330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11dd652c74c55857 server_cookie=f18a171c7bc20da2 in_seq=0 out_seq=0 2024-09-15T23:57:05.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58127fc640 1 -- 172.21.15.112:0/3146035202 <== mds.0 v2:172.21.15.112:6834/1581911691 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5589280a9c00 con 0x558928310f50 2024-09-15T23:57:05.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58127fc640 10 client.6174 handle_command_reply: tid=0 2024-09-15T23:57:05.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 client.6174 shutdown 2024-09-15T23:57:05.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 -- 172.21.15.112:0/3146035202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 msgr2=0x5589282c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 --2- 172.21.15.112:0/3146035202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x5589282c5df0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5824023040 tx=0x7f5824003700 comp rx=0 tx=0).stop 2024-09-15T23:57:05.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 -- 172.21.15.112:0/3146035202 shutdown_connections 2024-09-15T23:57:05.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 --2- 172.21.15.112:0/3146035202 >> [v2:172.21.15.112:6834/1581911691,v1:172.21.15.112:6836/1581911691] conn(0x558928310f50 0x558928311330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 --2- 172.21.15.112:0/3146035202 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5589282c6330 0x5589282cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 --2- 172.21.15.112:0/3146035202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55892830b440 0x5589282cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 --2- 172.21.15.112:0/3146035202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x5589282c5df0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f58127fc640 0 client.6174 ms_handle_reset on v2:172.21.15.112:6834/1581911691 2024-09-15T23:57:05.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 -- 172.21.15.112:0/3146035202 >> 172.21.15.112:0/3146035202 conn(0x5589282c1290 msgr2=0x5589282bfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:05.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 -- 172.21.15.112:0/3146035202 shutdown_connections 2024-09-15T23:57:05.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 1 -- 172.21.15.112:0/3146035202 wait complete. 2024-09-15T23:57:05.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.453+0000 7f583cd20000 20 client.6174 trim_cache size 0 max 16384 2024-09-15T23:57:05.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 Processor -- start 2024-09-15T23:57:05.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 -- start start 2024-09-15T23:57:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5589282c6330 0x558928309cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x55892830a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55892830b440 0x558928320070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5834200910 con 0x55892830ab20 2024-09-15T23:57:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5834156f10 con 0x5589282c6330 2024-09-15T23:57:05.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5834157560 con 0x55892830b440 2024-09-15T23:57:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f5832ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x55892830a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f5832ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x55892830a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43572/0 (socket says 172.21.15.112:43572) 2024-09-15T23:57:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f5832ffd640 1 -- 172.21.15.112:0/2480105655 learned_addr learned my addr 172.21.15.112:0/2480105655 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f5832ffd640 1 -- 172.21.15.112:0/2480105655 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55892830b440 msgr2=0x558928320070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f5833fff640 1 --2- 172.21.15.112:0/2480105655 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55892830b440 0x558928320070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f5832ffd640 1 --2- 172.21.15.112:0/2480105655 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55892830b440 0x558928320070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f5832ffd640 1 -- 172.21.15.112:0/2480105655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5589282c6330 msgr2=0x558928309cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f5832ffd640 1 --2- 172.21.15.112:0/2480105655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5589282c6330 0x558928309cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f5832ffd640 1 -- 172.21.15.112:0/2480105655 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589283108b0 con 0x55892830ab20 2024-09-15T23:57:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f5832ffd640 1 --2- 172.21.15.112:0/2480105655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x55892830a230 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f58280f0860 tx=0x7f582801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc16c02d22edf5d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f5818ff9640 1 -- 172.21.15.112:0/2480105655 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58280f4c80 con 0x55892830ab20 2024-09-15T23:57:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f5818ff9640 1 -- 172.21.15.112:0/2480105655 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58280af040 con 0x55892830ab20 2024-09-15T23:57:05.477 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f5818ff9640 1 -- 172.21.15.112:0/2480105655 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58280f94b0 con 0x55892830ab20 2024-09-15T23:57:05.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 -- 172.21.15.112:0/2480105655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 msgr2=0x55892830a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 --2- 172.21.15.112:0/2480105655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x55892830a230 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f58280f0860 tx=0x7f582801c4f0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 -- 172.21.15.112:0/2480105655 shutdown_connections 2024-09-15T23:57:05.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 --2- 172.21.15.112:0/2480105655 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55892830b440 0x558928320070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 --2- 172.21.15.112:0/2480105655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830ab20 0x55892830a230 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 --2- 172.21.15.112:0/2480105655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5589282c6330 0x558928309cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.473+0000 7f583cd20000 1 -- 172.21.15.112:0/2480105655 >> 172.21.15.112:0/2480105655 conn(0x5589282c1290 msgr2=0x5589282c55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:05.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 -- 172.21.15.112:0/2480105655 shutdown_connections 2024-09-15T23:57:05.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 -- 172.21.15.112:0/2480105655 wait complete. 2024-09-15T23:57:05.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 -- start start 2024-09-15T23:57:05.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 Processor -- start 2024-09-15T23:57:05.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5589282c6330 0x558928382090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55892830ab20 0x5589283825d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830b440 0x558928382b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55892810ef80 con 0x55892830b440 2024-09-15T23:57:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5589280c7ca0 con 0x55892830ab20 2024-09-15T23:57:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5589281142a0 con 0x5589282c6330 2024-09-15T23:57:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 10 client.0 _ll_register_callbacks cb 0x7f5824023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:57:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f5833fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830b440 0x558928382b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f5833fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830b440 0x558928382b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43580/0 (socket says 172.21.15.112:43580) 2024-09-15T23:57:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f5833fff640 1 -- 172.21.15.112:0/980831068 learned_addr learned my addr 172.21.15.112:0/980831068 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f58337fe640 1 --2- 172.21.15.112:0/980831068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5589282c6330 0x558928382090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f5832ffd640 1 --2- 172.21.15.112:0/980831068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55892830ab20 0x5589283825d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f5833fff640 1 -- 172.21.15.112:0/980831068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5589282c6330 msgr2=0x558928382090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f5833fff640 1 --2- 172.21.15.112:0/980831068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5589282c6330 0x558928382090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f5833fff640 1 -- 172.21.15.112:0/980831068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55892830ab20 msgr2=0x5589283825d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:05.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f5833fff640 1 --2- 172.21.15.112:0/980831068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55892830ab20 0x5589283825d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f5833fff640 1 -- 172.21.15.112:0/980831068 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55892830b270 con 0x55892830b440 2024-09-15T23:57:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f5833fff640 1 --2- 172.21.15.112:0/980831068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830b440 0x558928382b10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f582c007920 tx=0x7f582c001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efa5b3fd110e466 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f58127fc640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:57:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f58127fc640 1 -- 172.21.15.112:0/980831068 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c01b060 con 0x55892830b440 2024-09-15T23:57:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f58127fc640 1 -- 172.21.15.112:0/980831068 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f582c016ca0 con 0x55892830b440 2024-09-15T23:57:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 -- 172.21.15.112:0/980831068 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58280af040 con 0x55892830b440 2024-09-15T23:57:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f58127fc640 1 -- 172.21.15.112:0/980831068 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f582c0020a0 con 0x55892830b440 2024-09-15T23:57:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 10 client.6180 fetch_fsmap learned FSMap version 37 2024-09-15T23:57:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 -- 172.21.15.112:0/980831068 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x558928096fd0 con 0x55892830b440 2024-09-15T23:57:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f58127fc640 1 -- 172.21.15.112:0/980831068 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58280af040 con 0x55892830b440 2024-09-15T23:57:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f58127fc640 1 -- 172.21.15.112:0/980831068 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 37) ==== 3502+0+0 (secure 0 0 0) 0x7f582c004b70 con 0x55892830b440 2024-09-15T23:57:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 10 client.6180 fetch_fsmap finished waiting for FSMap version 37 2024-09-15T23:57:05.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 10 client.6180 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:57:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 20 client.6180 populate_metadata read hostname 'smithi112' 2024-09-15T23:57:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 --2- 172.21.15.112:0/980831068 >> [v2:172.21.15.112:6834/1581911691,v1:172.21.15.112:6836/1581911691] conn(0x55892833e7e0 0x55892833d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 4 client.6180 mds_command: new command op to 6021 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:57:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 -- 172.21.15.112:0/980831068 --> [v2:172.21.15.112:6834/1581911691,v1:172.21.15.112:6836/1581911691] -- command(tid 0: {"prefix": "status"}) -- 0x55892811d3a0 con 0x55892833e7e0 2024-09-15T23:57:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f58337fe640 1 --2- 172.21.15.112:0/980831068 >> [v2:172.21.15.112:6834/1581911691,v1:172.21.15.112:6836/1581911691] conn(0x55892833e7e0 0x55892833d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f58127fc640 10 client.6180 ms_handle_connect on v2:172.21.15.112:6834/1581911691 2024-09-15T23:57:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f58337fe640 1 --2- 172.21.15.112:0/980831068 >> [v2:172.21.15.112:6834/1581911691,v1:172.21.15.112:6836/1581911691] conn(0x55892833e7e0 0x55892833d8f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e406b252d7337f61 server_cookie=5689ec4997cb980 in_seq=0 out_seq=0 2024-09-15T23:57:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f58127fc640 1 -- 172.21.15.112:0/980831068 <== mds.0 v2:172.21.15.112:6834/1581911691 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55892811d3a0 con 0x55892833e7e0 2024-09-15T23:57:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f58127fc640 10 client.6180 handle_command_reply: tid=0 2024-09-15T23:57:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 client.6180 shutdown 2024-09-15T23:57:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 -- 172.21.15.112:0/980831068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830b440 msgr2=0x558928382b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 --2- 172.21.15.112:0/980831068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830b440 0x558928382b10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f582c007920 tx=0x7f582c001a10 comp rx=0 tx=0).stop 2024-09-15T23:57:05.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 -- 172.21.15.112:0/980831068 shutdown_connections 2024-09-15T23:57:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 --2- 172.21.15.112:0/980831068 >> [v2:172.21.15.112:6834/1581911691,v1:172.21.15.112:6836/1581911691] conn(0x55892833e7e0 0x55892833d8f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 --2- 172.21.15.112:0/980831068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55892830b440 0x558928382b10 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f58127fc640 0 client.6180 ms_handle_reset on v2:172.21.15.112:6834/1581911691 2024-09-15T23:57:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 --2- 172.21.15.112:0/980831068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55892830ab20 0x5589283825d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 --2- 172.21.15.112:0/980831068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5589282c6330 0x558928382090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 -- 172.21.15.112:0/980831068 >> 172.21.15.112:0/980831068 conn(0x5589282c1290 msgr2=0x558928308ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 -- 172.21.15.112:0/980831068 shutdown_connections 2024-09-15T23:57:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 1 -- 172.21.15.112:0/980831068 wait complete. 2024-09-15T23:57:05.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.477+0000 7f583cd20000 20 client.6180 trim_cache size 0 max 16384 2024-09-15T23:57:05.486 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:57:05.487 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "1af6b673-4d40-4109-af4e-78662faa7df8", 2024-09-15T23:57:05.487 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-15T23:57:05.487 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 6021, 2024-09-15T23:57:05.487 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-15T23:57:05.487 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-15T23:57:05.487 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-15T23:57:05.487 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 9.5111257780000003, 2024-09-15T23:57:05.487 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 37, 2024-09-15T23:57:05.487 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 75, 2024-09-15T23:57:05.487 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 75, 2024-09-15T23:57:05.487 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 14.527954701000001 2024-09-15T23:57:05.487 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:57:05.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.481+0000 7f5839c64640 1 -- 172.21.15.112:0/53419368 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58200678c0 msgr2=0x7f5820069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.481+0000 7f5839c64640 1 --2- 172.21.15.112:0/53419368 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58200678c0 0x7f5820069d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5824004e30 tx=0x7f5824009040 comp rx=0 tx=0).stop 2024-09-15T23:57:05.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.481+0000 7f5839c64640 1 -- 172.21.15.112:0/53419368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f583415bec0 msgr2=0x7f583415eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.481+0000 7f5839c64640 1 --2- 172.21.15.112:0/53419368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f583415bec0 0x7f583415eff0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f58280ac040 tx=0x7f5828019290 comp rx=0 tx=0).stop 2024-09-15T23:57:05.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.481+0000 7f5839c64640 1 -- 172.21.15.112:0/53419368 shutdown_connections 2024-09-15T23:57:05.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.481+0000 7f5839c64640 1 --2- 172.21.15.112:0/53419368 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58200678c0 0x7f5820069d80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.481+0000 7f5839c64640 1 --2- 172.21.15.112:0/53419368 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f583415c2a0 0x7f5834147930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.481+0000 7f5839c64640 1 --2- 172.21.15.112:0/53419368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f583415bec0 0x7f583415eff0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.481+0000 7f5839c64640 1 --2- 172.21.15.112:0/53419368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58340af2a0 0x7f583414e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.481+0000 7f5839c64640 1 -- 172.21.15.112:0/53419368 >> 172.21.15.112:0/53419368 conn(0x7f58340b1f90 msgr2=0x7f583414b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:05.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.481+0000 7f5839c64640 1 -- 172.21.15.112:0/53419368 shutdown_connections 2024-09-15T23:57:05.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.481+0000 7f5839c64640 1 -- 172.21.15.112:0/53419368 wait complete. 2024-09-15T23:57:05.497 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:57:05.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.605+0000 7fe7a549a640 1 Processor -- start 2024-09-15T23:57:05.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.605+0000 7fe7a549a640 1 -- start start 2024-09-15T23:57:05.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe7a549a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7a00b39a0 0x7fe7a006df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe7a549a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7a006e4b0 0x7fe7a0072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe7a549a640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a006ec60 con 0x7fe7a01587a0 2024-09-15T23:57:05.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe7a549a640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe7a006f870 con 0x7fe7a006e4b0 2024-09-15T23:57:05.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe7a549a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a006ef40 con 0x7fe7a00b39a0 2024-09-15T23:57:05.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe79effd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe7a01587a0 0x7fe7a00b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:55314/0 (socket says 172.21.15.112:55314) 2024-09-15T23:57:05.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe79f7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe7a006e4b0 0x7fe7a0072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe79effd640 1 -- 172.21.15.112:0/3507040326 learned_addr learned my addr 172.21.15.112:0/3507040326 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:05.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe79e7fc640 1 --2- 172.21.15.112:0/3507040326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7a00b39a0 0x7fe7a006df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe79f7fe640 1 -- 172.21.15.112:0/3507040326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7a00b39a0 msgr2=0x7fe7a006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:05.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe79f7fe640 1 --2- 172.21.15.112:0/3507040326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7a00b39a0 0x7fe7a006df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe79f7fe640 1 -- 172.21.15.112:0/3507040326 >> v1:172.21.15.112:6789/0 conn(0x7fe7a01587a0 legacy=0x7fe7a00b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe79f7fe640 1 -- 172.21.15.112:0/3507040326 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a006f220 con 0x7fe7a006e4b0 2024-09-15T23:57:05.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe79dffb640 1 -- 172.21.15.112:0/3507040326 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 374896965 0 0) 0x7fe7a006ec60 con 0x7fe7a01587a0 2024-09-15T23:57:05.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe79f7fe640 1 --2- 172.21.15.112:0/3507040326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a006e4b0 0x7fe7a0072160 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe798009d90 tx=0x7fe79801d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b925c691d997367 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe79dffb640 1 -- 172.21.15.112:0/3507040326 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7980b2070 con 0x7fe7a006e4b0 2024-09-15T23:57:05.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe79dffb640 1 -- 172.21.15.112:0/3507040326 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7980a5a20 con 0x7fe7a006e4b0 2024-09-15T23:57:05.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.609+0000 7fe79dffb640 1 -- 172.21.15.112:0/3507040326 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7980a5df0 con 0x7fe7a006e4b0 2024-09-15T23:57:05.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 -- 172.21.15.112:0/3507040326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a006e4b0 msgr2=0x7fe7a0072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 --2- 172.21.15.112:0/3507040326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a006e4b0 0x7fe7a0072160 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe798009d90 tx=0x7fe79801d3a0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 -- 172.21.15.112:0/3507040326 shutdown_connections 2024-09-15T23:57:05.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 --2- 172.21.15.112:0/3507040326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a006e4b0 0x7fe7a0072160 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 --2- 172.21.15.112:0/3507040326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7a00b39a0 0x7fe7a006df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 -- 172.21.15.112:0/3507040326 >> 172.21.15.112:0/3507040326 conn(0x7fe7a00b1f90 msgr2=0x7fe7a00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:05.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 -- 172.21.15.112:0/3507040326 shutdown_connections 2024-09-15T23:57:05.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 -- 172.21.15.112:0/3507040326 wait complete. 2024-09-15T23:57:05.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 Processor -- start 2024-09-15T23:57:05.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 -- start start 2024-09-15T23:57:05.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7a006e4b0 0x7fe7a00d0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7a00b39a0 0x7fe7a0155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a01587a0 0x7fe7a00ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a0073030 con 0x7fe7a01587a0 2024-09-15T23:57:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a0072eb0 con 0x7fe7a006e4b0 2024-09-15T23:57:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a00731b0 con 0x7fe7a00b39a0 2024-09-15T23:57:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe79f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a01587a0 0x7fe7a00ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe79f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a01587a0 0x7fe7a00ae9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43596/0 (socket says 172.21.15.112:43596) 2024-09-15T23:57:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe79f7fe640 1 -- 172.21.15.112:0/930637366 learned_addr learned my addr 172.21.15.112:0/930637366 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe79e7fc640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7a00b39a0 0x7fe7a0155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe79effd640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7a006e4b0 0x7fe7a00d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe79f7fe640 1 -- 172.21.15.112:0/930637366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7a00b39a0 msgr2=0x7fe7a0155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe79f7fe640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7a00b39a0 0x7fe7a0155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe79f7fe640 1 -- 172.21.15.112:0/930637366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7a006e4b0 msgr2=0x7fe7a00d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe79f7fe640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7a006e4b0 0x7fe7a00d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe79f7fe640 1 -- 172.21.15.112:0/930637366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a00d0750 con 0x7fe7a01587a0 2024-09-15T23:57:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe79e7fc640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7a00b39a0 0x7fe7a0155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe79f7fe640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a01587a0 0x7fe7a00ae9c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe7980b0040 tx=0x7fe7980196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7877fe640 1 -- 172.21.15.112:0/930637366 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7980bc030 con 0x7fe7a01587a0 2024-09-15T23:57:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7877fe640 1 -- 172.21.15.112:0/930637366 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7980ad4c0 con 0x7fe7a01587a0 2024-09-15T23:57:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 -- 172.21.15.112:0/930637366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a009dfa0 con 0x7fe7a01587a0 2024-09-15T23:57:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7877fe640 1 -- 172.21.15.112:0/930637366 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7980b2040 con 0x7fe7a01587a0 2024-09-15T23:57:05.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.613+0000 7fe7a549a640 1 -- 172.21.15.112:0/930637366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a015cfe0 con 0x7fe7a01587a0 2024-09-15T23:57:05.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.617+0000 7fe7a549a640 1 -- 172.21.15.112:0/930637366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a0072160 con 0x7fe7a01587a0 2024-09-15T23:57:05.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.617+0000 7fe7877fe640 1 -- 172.21.15.112:0/930637366 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe7980bf070 con 0x7fe7a01587a0 2024-09-15T23:57:05.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.617+0000 7fe7877fe640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe78c0678c0 0x7fe78c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.617+0000 7fe7877fe640 1 -- 172.21.15.112:0/930637366 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fe798120420 con 0x7fe7a01587a0 2024-09-15T23:57:05.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.617+0000 7fe79effd640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe78c0678c0 0x7fe78c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.617+0000 7fe79effd640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe78c0678c0 0x7fe78c069d80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe790000f70 tx=0x7fe790009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.621+0000 7fe7877fe640 1 -- 172.21.15.112:0/930637366 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe7980c7020 con 0x7fe7a01587a0 2024-09-15T23:57:05.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.821+0000 7fe7a549a640 1 -- 172.21.15.112:0/930637366 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe7a0070080 con 0x7fe7a01587a0 2024-09-15T23:57:05.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.821+0000 7fe7877fe640 1 -- 172.21.15.112:0/930637366 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) ==== 53+0+73 (secure 0 0 0) 0x7fe798016560 con 0x7fe7a01587a0 2024-09-15T23:57:05.824 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:57:05.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.825+0000 7fe7a549a640 1 -- 172.21.15.112:0/930637366 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe78c0678c0 msgr2=0x7fe78c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.825+0000 7fe7a549a640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe78c0678c0 0x7fe78c069d80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe790000f70 tx=0x7fe790009040 comp rx=0 tx=0).stop 2024-09-15T23:57:05.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.825+0000 7fe7a549a640 1 -- 172.21.15.112:0/930637366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a01587a0 msgr2=0x7fe7a00ae9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.825+0000 7fe7a549a640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a01587a0 0x7fe7a00ae9c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe7980b0040 tx=0x7fe7980196e0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.825+0000 7fe7a549a640 1 -- 172.21.15.112:0/930637366 shutdown_connections 2024-09-15T23:57:05.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.825+0000 7fe7a549a640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe78c0678c0 0x7fe78c069d80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.825+0000 7fe7a549a640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a01587a0 0x7fe7a00ae9c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.825+0000 7fe7a549a640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7a00b39a0 0x7fe7a0155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.825+0000 7fe7a549a640 1 --2- 172.21.15.112:0/930637366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7a006e4b0 0x7fe7a00d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.825+0000 7fe7a549a640 1 -- 172.21.15.112:0/930637366 >> 172.21.15.112:0/930637366 conn(0x7fe7a00b1f90 msgr2=0x7fe7a00b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:05.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.825+0000 7fe7a549a640 1 -- 172.21.15.112:0/930637366 shutdown_connections 2024-09-15T23:57:05.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:05.825+0000 7fe7a549a640 1 -- 172.21.15.112:0/930637366 wait complete. 2024-09-15T23:57:05.841 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:57:05.842 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:57:05.842 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-15T23:57:05.842 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:57:05.842 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:05.842 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:57:05.842 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:57:05.842 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:57:05.842 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:57:05.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:05.842 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-15T23:57:05.848 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:57:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:57:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:57:05.848 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-15T23:57:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:05.849 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:57:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-15T23:57:05.849 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:57:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-15T23:57:05.849 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:57:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:05.849 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:57:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:05.849 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T23:57:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42271sec preferred_lft 42271sec 2024-09-15T23:57:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2024-09-15T23:57:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:05.850 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T23:57:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:5c:cd:1e:d6 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T23:57:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:05.850 INFO:teuthology.orchestra.run.smithi112.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:57:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:57:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T23:57:05.850 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:05.850 INFO:teuthology.orchestra.run.smithi112.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:57:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T23:57:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:05.851 INFO:teuthology.orchestra.run.smithi112.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:57:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:57:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T23:57:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:05.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:05.852 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:57:05.901 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-15T23:57:05.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:05.902 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-15T23:57:05.957 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-15T23:57:05.957 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:57:05.957 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T23:57:05.957 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:57:05.957 INFO:teuthology.orchestra.run.smithi112.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T23:57:05.957 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T23:57:05.957 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:57:05.957 INFO:teuthology.orchestra.run.smithi112.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:57:05.957 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:57:05.957 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:57:05.957 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:57:05.958 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:57:05.958 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:57:05.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:57:05.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:57:05.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:57:05.958 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:57:06.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:57:06.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:57:06.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:06.078 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-15T23:57:06.126 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:57:06.126 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:57:06.126 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:57:06.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:06.127 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-15T23:57:06.185 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T23:57:06.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:57:06.185 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:06.235 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:57:06.235 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:57:06.235 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:06.281 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:57:06.339 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:57:06.389 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:57:06.389 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:57:06.390 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:57:06.390 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:57:06.390 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:57:06.390 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:57:06.390 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:57:06.390 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:57:06.390 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:57:06.390 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:57:06.390 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:57:06.391 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:57:06.391 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:57:06.391 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:57:06.391 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:57:06.391 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:57:06.391 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:57:06.391 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:57:06.391 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:57:06.391 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:57:06.391 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:57:06.391 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:57:06.391 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:57:06.391 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:57:06.391 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:57:06.392 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:57:06.392 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:57:06.392 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:57:06.392 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:57:06.392 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:06.392 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:06.392 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:57:06.392 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:57:06.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:06.392 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:57:06.437 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:57:06.438 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T23:57:06.482 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:57:06.499 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:57:06.546 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:57:06.546 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:57:06.546 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:57:06.546 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:57:06.546 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:57:06.546 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:57:06.546 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:57:06.546 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:57:06.546 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:57:06.546 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:57:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:57:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:57:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:57:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:57:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:57:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:57:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:57:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:57:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:57:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:57:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:57:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:57:06.547 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:57:06.548 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:57:06.548 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:57:06.548 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:57:06.548 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:57:06.548 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:57:06.548 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:57:06.548 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:06.548 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:06.548 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:57:06.548 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:57:06.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:06.549 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:57:06.566 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:2024-09-15T23:57:06.565+0000 7f6223d1d580 -1 init, newargv = 0x559cf4e6a070 newargc=15 2024-09-15T23:57:06.566 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[42156]: starting ceph client 2024-09-15T23:57:06.570 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[42156]: starting fuse 2024-09-15T23:57:07.672 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:57:08.083 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:57:08.133 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:57:08.133 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:57:08.133 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:57:08.133 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:57:08.133 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:57:08.133 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:57:08.133 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:57:08.134 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:57:08.134 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:57:08.134 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:57:08.134 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:57:08.134 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:57:08.134 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:57:08.134 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:57:08.134 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:57:08.134 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:57:08.134 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:57:08.134 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:57:08.134 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:57:08.134 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:57:08.135 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:57:08.135 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:57:08.135 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:57:08.135 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:57:08.135 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:57:08.135 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:57:08.135 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:57:08.135 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:57:08.135 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:57:08.135 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:08.135 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:08.136 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:57:08.136 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:57:08.136 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:08.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:08.137 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:57:08.186 INFO:teuthology.orchestra.run.smithi112.stdout:45 2024-09-15T23:57:08.186 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T23:57:08.186 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> import re 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:08.187 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2024-09-15T23:57:08.188 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:57:08.188 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:57:08.188 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:57:08.188 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2024-09-15T23:57:08.188 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2024-09-15T23:57:08.188 DEBUG:teuthology.orchestra.run.smithi112:> return f 2024-09-15T23:57:08.188 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:57:08.188 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:08.188 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.0")) 2024-09-15T23:57:08.188 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:57:08.310 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.0.42156.asok 2024-09-15T23:57:08.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:57:08.322 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42156.asok 2024-09-15T23:57:08.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:08.323 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42156.asok status 2024-09-15T23:57:08.483 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:57:08.483 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2024-09-15T23:57:08.483 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:57:08.484 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:57:08.484 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "0", 2024-09-15T23:57:08.484 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2024-09-15T23:57:08.484 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:57:08.484 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "42156", 2024-09-15T23:57:08.484 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2024-09-15T23:57:08.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:08.484 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2024-09-15T23:57:08.484 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2024-09-15T23:57:08.484 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 6195, 2024-09-15T23:57:08.484 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2024-09-15T23:57:08.484 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2024-09-15T23:57:08.484 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2024-09-15T23:57:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 6195 2024-09-15T23:57:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:57:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:57:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:57:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1172325236 2024-09-15T23:57:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:57:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:57:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:57:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1172325236 2024-09-15T23:57:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:08.485 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.6195 192.168.0.1:0/1172325236", 2024-09-15T23:57:08.486 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.1:0/1172325236", 2024-09-15T23:57:08.486 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2024-09-15T23:57:08.486 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 37, 2024-09-15T23:57:08.486 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 75, 2024-09-15T23:57:08.486 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:57:08.486 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2024-09-15T23:57:08.486 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2024-09-15T23:57:08.486 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:57:08.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:08.497 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2024-09-15T23:57:08.497 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:08.502 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2024-09-15T23:57:08.503 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:08.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:08.503 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:08.556 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_fragment_size_max 10 2024-09-15T23:57:08.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7feccadcb640 1 Processor -- start 2024-09-15T23:57:08.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7feccadcb640 1 -- start start 2024-09-15T23:57:08.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7feccadcb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fecc415bec0 0x7fecc40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:08.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7feccadcb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fecc40af470 0x7fecc406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:08.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7feccadcb640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc40b3290 con 0x7fecc415c2a0 2024-09-15T23:57:08.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7feccadcb640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fecc40b3570 con 0x7fecc40af470 2024-09-15T23:57:08.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7feccadcb640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fecc40b3850 con 0x7fecc415bec0 2024-09-15T23:57:08.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7fecc9368640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fecc40af470 0x7fecc406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:08.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7fecc9368640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fecc40af470 0x7fecc406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56744/0 (socket says 172.21.15.112:56744) 2024-09-15T23:57:08.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7fecc3fff640 1 --1- 172.21.15.112:0/103378174 >> v1:172.21.15.112:6789/0 conn(0x7fecc415c2a0 0x7fecc40aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37916/0 (socket says 172.21.15.112:37916) 2024-09-15T23:57:08.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7fecc9368640 1 -- 172.21.15.112:0/103378174 learned_addr learned my addr 172.21.15.112:0/103378174 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:08.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7fecc8b67640 1 --2- 172.21.15.112:0/103378174 >> v2:172.21.15.169:3300/0 conn(0x7fecc415bec0 0x7fecc40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:08.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7fecc9368640 1 -- 172.21.15.112:0/103378174 >> v2:172.21.15.169:3300/0 conn(0x7fecc415bec0 msgr2=0x7fecc40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:08.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7fecc9368640 1 --2- 172.21.15.112:0/103378174 >> v2:172.21.15.169:3300/0 conn(0x7fecc415bec0 0x7fecc40ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7fecc9368640 1 -- 172.21.15.112:0/103378174 >> v1:172.21.15.112:6789/0 conn(0x7fecc415c2a0 legacy=0x7fecc40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:08.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7fecc9368640 1 -- 172.21.15.112:0/103378174 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc40b3b30 con 0x7fecc40af470 2024-09-15T23:57:08.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.729+0000 7fecc37fe640 1 -- 172.21.15.112:0/103378174 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355809577 0 0) 0x7fecc40b3290 con 0x7fecc415c2a0 2024-09-15T23:57:08.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc9368640 1 --2- 172.21.15.112:0/103378174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc40af470 0x7fecc406e000 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fecc4071710 tx=0x7fecbc01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ec453a11ba7405 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:08.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc37fe640 1 -- 172.21.15.112:0/103378174 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0a5880 con 0x7fecc40af470 2024-09-15T23:57:08.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc37fe640 1 -- 172.21.15.112:0/103378174 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecbc0a5a20 con 0x7fecc40af470 2024-09-15T23:57:08.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc37fe640 1 -- 172.21.15.112:0/103378174 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0a5df0 con 0x7fecc40af470 2024-09-15T23:57:08.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 -- 172.21.15.112:0/103378174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc40af470 msgr2=0x7fecc406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:08.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 --2- 172.21.15.112:0/103378174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc40af470 0x7fecc406e000 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fecc4071710 tx=0x7fecbc01c9c0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 -- 172.21.15.112:0/103378174 shutdown_connections 2024-09-15T23:57:08.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 --2- 172.21.15.112:0/103378174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc40af470 0x7fecc406e000 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 --2- 172.21.15.112:0/103378174 >> v2:172.21.15.169:3300/0 conn(0x7fecc415bec0 0x7fecc40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 -- 172.21.15.112:0/103378174 >> 172.21.15.112:0/103378174 conn(0x7fecc40b1f90 msgr2=0x7fecc40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:08.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 -- 172.21.15.112:0/103378174 shutdown_connections 2024-09-15T23:57:08.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 -- 172.21.15.112:0/103378174 wait complete. 2024-09-15T23:57:08.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 Processor -- start 2024-09-15T23:57:08.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 -- start start 2024-09-15T23:57:08.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fecc40af470 0x7fecc414e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:08.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecc415bec0 0x7fecc4150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:08.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc415c2a0 0x7fecc415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:08.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fecc406ed50 con 0x7fecc415c2a0 2024-09-15T23:57:08.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fecc40ad740 con 0x7fecc415bec0 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fecc406eed0 con 0x7fecc40af470 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc9368640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc415c2a0 0x7fecc415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc9368640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc415c2a0 0x7fecc415f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:56746/0 (socket says 172.21.15.112:56746) 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc9368640 1 -- 172.21.15.112:0/3640366177 learned_addr learned my addr 172.21.15.112:0/3640366177 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc8b67640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fecc40af470 0x7fecc414e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc3fff640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecc415bec0 0x7fecc4150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc9368640 1 -- 172.21.15.112:0/3640366177 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fecc40af470 msgr2=0x7fecc414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc9368640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fecc40af470 0x7fecc414e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc9368640 1 -- 172.21.15.112:0/3640366177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecc415bec0 msgr2=0x7fecc4150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc9368640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecc415bec0 0x7fecc4150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc9368640 1 -- 172.21.15.112:0/3640366177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc414ee50 con 0x7fecc415c2a0 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc8b67640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fecc40af470 0x7fecc414e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc3fff640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecc415bec0 0x7fecc4150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc9368640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc415c2a0 0x7fecc415f1a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0195d0 tx=0x7fecbc019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:08.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc17fa640 1 -- 172.21.15.112:0/3640366177 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0bc030 con 0x7fecc415c2a0 2024-09-15T23:57:08.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc17fa640 1 -- 172.21.15.112:0/3640366177 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecbc0b8470 con 0x7fecc415c2a0 2024-09-15T23:57:08.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 -- 172.21.15.112:0/3640366177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc415e100 con 0x7fecc415c2a0 2024-09-15T23:57:08.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7fecc17fa640 1 -- 172.21.15.112:0/3640366177 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0b8820 con 0x7fecc415c2a0 2024-09-15T23:57:08.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.733+0000 7feccadcb640 1 -- 172.21.15.112:0/3640366177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc415e6c0 con 0x7fecc415c2a0 2024-09-15T23:57:08.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.737+0000 7feccadcb640 1 -- 172.21.15.112:0/3640366177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc406f260 con 0x7fecc415c2a0 2024-09-15T23:57:08.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.737+0000 7fecc17fa640 1 -- 172.21.15.112:0/3640366177 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fecbc0bf070 con 0x7fecc415c2a0 2024-09-15T23:57:08.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.737+0000 7fecc17fa640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feca80678f0 0x7feca8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:08.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.737+0000 7fecc8b67640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feca80678f0 0x7feca8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:08.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.737+0000 7fecc17fa640 1 -- 172.21.15.112:0/3640366177 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fecbc120970 con 0x7fecc415c2a0 2024-09-15T23:57:08.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.737+0000 7fecc8b67640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feca80678f0 0x7feca8069db0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009840 tx=0x7fecb8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:08.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.741+0000 7fecc17fa640 1 -- 172.21.15.112:0/3640366177 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fecc414ee50 con 0x7fecc415c2a0 2024-09-15T23:57:08.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.901+0000 7feccadcb640 1 -- 172.21.15.112:0/3640366177 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fecc406fcd0 con 0x7fecc415c2a0 2024-09-15T23:57:08.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.905+0000 7fecc17fa640 1 -- 172.21.15.112:0/3640366177 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v23)=0 v23) ==== 124+0+0 (secure 0 0 0) 0x7fecbc0165e0 con 0x7fecc415c2a0 2024-09-15T23:57:08.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.909+0000 7feccadcb640 1 -- 172.21.15.112:0/3640366177 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feca80678f0 msgr2=0x7feca8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:08.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.909+0000 7feccadcb640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feca80678f0 0x7feca8069db0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009840 tx=0x7fecb8008040 comp rx=0 tx=0).stop 2024-09-15T23:57:08.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.909+0000 7feccadcb640 1 -- 172.21.15.112:0/3640366177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc415c2a0 msgr2=0x7fecc415f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:08.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.909+0000 7feccadcb640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc415c2a0 0x7fecc415f1a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0195d0 tx=0x7fecbc019760 comp rx=0 tx=0).stop 2024-09-15T23:57:08.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.909+0000 7feccadcb640 1 -- 172.21.15.112:0/3640366177 shutdown_connections 2024-09-15T23:57:08.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.909+0000 7feccadcb640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feca80678f0 0x7feca8069db0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.909+0000 7feccadcb640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc415c2a0 0x7fecc415f1a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.909+0000 7feccadcb640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecc415bec0 0x7fecc4150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.909+0000 7feccadcb640 1 --2- 172.21.15.112:0/3640366177 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fecc40af470 0x7fecc414e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.909+0000 7feccadcb640 1 -- 172.21.15.112:0/3640366177 >> 172.21.15.112:0/3640366177 conn(0x7fecc40b1f90 msgr2=0x7fecc406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:08.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.909+0000 7feccadcb640 1 -- 172.21.15.112:0/3640366177 shutdown_connections 2024-09-15T23:57:08.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:08.909+0000 7feccadcb640 1 -- 172.21.15.112:0/3640366177 wait complete. 2024-09-15T23:57:13.835 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:57:13.838 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:57:18.928 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:19.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7dc1a5640 1 Processor -- start 2024-09-15T23:57:19.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7dc1a5640 1 -- start start 2024-09-15T23:57:19.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7dc1a5640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc7d41457a0 0x7fc7d40d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:19.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7dc1a5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7d40b4510 0x7fc7d40d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:19.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7dc1a5640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7d40d27a0 con 0x7fc7d40cf800 2024-09-15T23:57:19.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7dc1a5640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc7d40d2a80 con 0x7fc7d41457a0 2024-09-15T23:57:19.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7dc1a5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d40d2d60 con 0x7fc7d40b4510 2024-09-15T23:57:19.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7da742640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7d40b4510 0x7fc7d40d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:19.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7d9f41640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc7d41457a0 0x7fc7d40d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:19.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7da742640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7d40b4510 0x7fc7d40d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:53528/0 (socket says 172.21.15.112:53528) 2024-09-15T23:57:19.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7da742640 1 -- 172.21.15.112:0/811910546 learned_addr learned my addr 172.21.15.112:0/811910546 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:19.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7d9740640 1 --1- 172.21.15.112:0/811910546 >> v1:172.21.15.169:6789/0 conn(0x7fc7d40cf800 0x7fc7d40b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:58248/0 (socket says 172.21.15.112:58248) 2024-09-15T23:57:19.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7da742640 1 -- 172.21.15.112:0/811910546 >> v2:172.21.15.169:3300/0 conn(0x7fc7d41457a0 msgr2=0x7fc7d40d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:19.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7da742640 1 --2- 172.21.15.112:0/811910546 >> v2:172.21.15.169:3300/0 conn(0x7fc7d41457a0 0x7fc7d40d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7da742640 1 -- 172.21.15.112:0/811910546 >> v1:172.21.15.169:6789/0 conn(0x7fc7d40cf800 legacy=0x7fc7d40b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:19.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7da742640 1 -- 172.21.15.112:0/811910546 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d40d01f0 con 0x7fc7d40b4510 2024-09-15T23:57:19.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.061+0000 7fc7d9f41640 1 --2- 172.21.15.112:0/811910546 >> v2:172.21.15.169:3300/0 conn(0x7fc7d41457a0 0x7fc7d40d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:57:19.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.065+0000 7fc7da742640 1 --2- 172.21.15.112:0/811910546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7d40b4510 0x7fc7d40d0710 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009e50 tx=0x7fc7cc01c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83c27e8c9cfccccf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:19.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.065+0000 7fc7d8f3f640 1 -- 172.21.15.112:0/811910546 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0a5660 con 0x7fc7d40b4510 2024-09-15T23:57:19.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.065+0000 7fc7d8f3f640 1 -- 172.21.15.112:0/811910546 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7cc0a5800 con 0x7fc7d40b4510 2024-09-15T23:57:19.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.065+0000 7fc7d8f3f640 1 -- 172.21.15.112:0/811910546 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0a5bd0 con 0x7fc7d40b4510 2024-09-15T23:57:19.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.065+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/811910546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7d40b4510 msgr2=0x7fc7d40d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:19.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.065+0000 7fc7dc1a5640 1 --2- 172.21.15.112:0/811910546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7d40b4510 0x7fc7d40d0710 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009e50 tx=0x7fc7cc01c9a0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.065+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/811910546 shutdown_connections 2024-09-15T23:57:19.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.065+0000 7fc7dc1a5640 1 --2- 172.21.15.112:0/811910546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7d40b4510 0x7fc7d40d0710 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.065+0000 7fc7dc1a5640 1 --2- 172.21.15.112:0/811910546 >> v2:172.21.15.169:3300/0 conn(0x7fc7d41457a0 0x7fc7d40d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.065+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/811910546 >> 172.21.15.112:0/811910546 conn(0x7fc7d406bcc0 msgr2=0x7fc7d406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:19.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.065+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/811910546 shutdown_connections 2024-09-15T23:57:19.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.065+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/811910546 wait complete. 2024-09-15T23:57:19.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.065+0000 7fc7dc1a5640 1 Processor -- start 2024-09-15T23:57:19.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7dc1a5640 1 -- start start 2024-09-15T23:57:19.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7dc1a5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7d40b4510 0x7fc7d41421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:19.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7dc1a5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7d40cf800 0x7fc7d41f8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:19.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7dc1a5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7d41457a0 0x7fc7d41f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:19.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7dc1a5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41690b0 con 0x7fc7d41457a0 2024-09-15T23:57:19.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7dc1a5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d40d1670 con 0x7fc7d40cf800 2024-09-15T23:57:19.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7dc1a5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d4169230 con 0x7fc7d40b4510 2024-09-15T23:57:19.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7da742640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7d41457a0 0x7fc7d41f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:19.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7da742640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7d41457a0 0x7fc7d41f8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37784/0 (socket says 172.21.15.112:37784) 2024-09-15T23:57:19.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7da742640 1 -- 172.21.15.112:0/812692125 learned_addr learned my addr 172.21.15.112:0/812692125 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:19.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7d9f41640 1 --2- 172.21.15.112:0/812692125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7d40b4510 0x7fc7d41421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:19.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7d9740640 1 --2- 172.21.15.112:0/812692125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7d40cf800 0x7fc7d41f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:19.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7da742640 1 -- 172.21.15.112:0/812692125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7d40b4510 msgr2=0x7fc7d41421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:19.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7da742640 1 --2- 172.21.15.112:0/812692125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7d40b4510 0x7fc7d41421f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7da742640 1 -- 172.21.15.112:0/812692125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7d40cf800 msgr2=0x7fc7d41f8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:19.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7da742640 1 --2- 172.21.15.112:0/812692125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7d40cf800 0x7fc7d41f8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7da742640 1 -- 172.21.15.112:0/812692125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d4138500 con 0x7fc7d41457a0 2024-09-15T23:57:19.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7da742640 1 --2- 172.21.15.112:0/812692125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7d41457a0 0x7fc7d41f8d50 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc01a5d0 tx=0x7fc7cc019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:19.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7ca7fc640 1 -- 172.21.15.112:0/812692125 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0bc030 con 0x7fc7d41457a0 2024-09-15T23:57:19.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7ca7fc640 1 -- 172.21.15.112:0/812692125 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7cc0b8470 con 0x7fc7d41457a0 2024-09-15T23:57:19.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/812692125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d41387e0 con 0x7fc7d41457a0 2024-09-15T23:57:19.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7ca7fc640 1 -- 172.21.15.112:0/812692125 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc009510 con 0x7fc7d41457a0 2024-09-15T23:57:19.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/812692125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d4138e90 con 0x7fc7d41457a0 2024-09-15T23:57:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/812692125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d415def0 con 0x7fc7d41457a0 2024-09-15T23:57:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7ca7fc640 1 -- 172.21.15.112:0/812692125 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc7cc0bf070 con 0x7fc7d41457a0 2024-09-15T23:57:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.069+0000 7fc7ca7fc640 1 --2- 172.21.15.112:0/812692125 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7b80678c0 0x7fc7b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.073+0000 7fc7ca7fc640 1 -- 172.21.15.112:0/812692125 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fc7cc120920 con 0x7fc7d41457a0 2024-09-15T23:57:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.073+0000 7fc7d9f41640 1 --2- 172.21.15.112:0/812692125 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7b80678c0 0x7fc7b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:19.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.073+0000 7fc7d9f41640 1 --2- 172.21.15.112:0/812692125 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7b80678c0 0x7fc7b8069d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009580 tx=0x7fc7d0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:19.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.077+0000 7fc7ca7fc640 1 -- 172.21.15.112:0/812692125 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc7cc0c6070 con 0x7fc7d41457a0 2024-09-15T23:57:19.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.261+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/812692125 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7d40d0710 con 0x7fc7d41457a0 2024-09-15T23:57:19.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.261+0000 7fc7ca7fc640 1 -- 172.21.15.112:0/812692125 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5231 (secure 0 0 0) 0x7fc7cc016620 con 0x7fc7d41457a0 2024-09-15T23:57:19.264 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:19.265 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"btime":"2024-09-15T23:56:58:369858+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2072637952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2072637952},{"type":"v1","addr":"172.21.15.169:6833","nonce":2072637952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/33750051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":33750051},{"type":"v1","addr":"172.21.15.169:6835","nonce":33750051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6018,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/4092393174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":4092393174},{"type":"v1","addr":"172.21.15.112:6837","nonce":4092393174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:55.316845+0000","modified":"2024-09-15T23:56:57.719503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6021},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6021":{"gid":6021,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1581911691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1581911691},{"type":"v1","addr":"172.21.15.112:6836","nonce":1581911691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6021,"qdb_cluster":[6021]},"id":5}]} 2024-09-15T23:57:19.265 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 37 2024-09-15T23:57:19.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.265+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/812692125 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7b80678c0 msgr2=0x7fc7b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:19.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.265+0000 7fc7dc1a5640 1 --2- 172.21.15.112:0/812692125 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7b80678c0 0x7fc7b8069d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009580 tx=0x7fc7d0009190 comp rx=0 tx=0).stop 2024-09-15T23:57:19.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.265+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/812692125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7d41457a0 msgr2=0x7fc7d41f8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:19.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.265+0000 7fc7dc1a5640 1 --2- 172.21.15.112:0/812692125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7d41457a0 0x7fc7d41f8d50 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc01a5d0 tx=0x7fc7cc019740 comp rx=0 tx=0).stop 2024-09-15T23:57:19.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.265+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/812692125 shutdown_connections 2024-09-15T23:57:19.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.265+0000 7fc7dc1a5640 1 --2- 172.21.15.112:0/812692125 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7b80678c0 0x7fc7b8069d80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.265+0000 7fc7dc1a5640 1 --2- 172.21.15.112:0/812692125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7d41457a0 0x7fc7d41f8d50 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.265+0000 7fc7dc1a5640 1 --2- 172.21.15.112:0/812692125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7d40cf800 0x7fc7d41f8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.265+0000 7fc7dc1a5640 1 --2- 172.21.15.112:0/812692125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc7d40b4510 0x7fc7d41421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.265+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/812692125 >> 172.21.15.112:0/812692125 conn(0x7fc7d406bcc0 msgr2=0x7fc7d415feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:19.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.265+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/812692125 shutdown_connections 2024-09-15T23:57:19.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.265+0000 7fc7dc1a5640 1 -- 172.21.15.112:0/812692125 wait complete. 2024-09-15T23:57:19.281 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump mds_cache strays_created 2024-09-15T23:57:19.419 INFO:teuthology.orchestra.run.smithi112.stdout:{"mds_cache":{"strays_created":0}} 2024-09-15T23:57:19.419 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_created": 0 } } 2024-09-15T23:57:19.419 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:57:19.419 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:19.425 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-15T23:57:19.425 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:57:19.425 DEBUG:teuthology.orchestra.run.smithi112:> import uuid 2024-09-15T23:57:19.425 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:19.425 DEBUG:teuthology.orchestra.run.smithi112:> n = 100 2024-09-15T23:57:19.425 DEBUG:teuthology.orchestra.run.smithi112:> create_hard_links = False 2024-09-15T23:57:19.425 DEBUG:teuthology.orchestra.run.smithi112:> if 0 > 0: 2024-09-15T23:57:19.425 DEBUG:teuthology.orchestra.run.smithi112:> create_hard_links = True 2024-09-15T23:57:19.425 DEBUG:teuthology.orchestra.run.smithi112:> path = "/home/ubuntu/cephtest/mnt.0/subdir/file" 2024-09-15T23:57:19.425 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:19.425 DEBUG:teuthology.orchestra.run.smithi112:> dpath = os.path.dirname(path) 2024-09-15T23:57:19.425 DEBUG:teuthology.orchestra.run.smithi112:> fnameprefix = os.path.basename(path) 2024-09-15T23:57:19.425 DEBUG:teuthology.orchestra.run.smithi112:> os.makedirs(dpath, exist_ok=True) 2024-09-15T23:57:19.425 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> try: 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> for i in range(n): 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> with open(fpath, '"'"'w'"'"') as f: 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> f.write(f"{i}") 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> f.flush() 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(f.fileno()) 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> if True: 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> os.unlink(fpath) 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(dirfd) 2024-09-15T23:57:19.426 DEBUG:teuthology.orchestra.run.smithi112:> if create_hard_links: 2024-09-15T23:57:19.427 DEBUG:teuthology.orchestra.run.smithi112:> for j in range(0): 2024-09-15T23:57:19.427 DEBUG:teuthology.orchestra.run.smithi112:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-15T23:57:19.427 DEBUG:teuthology.orchestra.run.smithi112:> if True: 2024-09-15T23:57:19.427 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(dirfd) 2024-09-15T23:57:19.427 DEBUG:teuthology.orchestra.run.smithi112:> finally: 2024-09-15T23:57:19.427 DEBUG:teuthology.orchestra.run.smithi112:> os.close(dirfd) 2024-09-15T23:57:19.427 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:57:19.618 INFO:teuthology.orchestra.run.smithi112.stderr:Traceback (most recent call last): 2024-09-15T23:57:19.618 INFO:teuthology.orchestra.run.smithi112.stderr: File "", line 26, in 2024-09-15T23:57:19.618 INFO:teuthology.orchestra.run.smithi112.stderr:OSError: [Errno 28] No space left on device: '/home/ubuntu/cephtest/mnt.0/subdir/file_10' 2024-09-15T23:57:19.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2024-09-15T23:57:19.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:57:19.631 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:19.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.789+0000 7f117230d640 1 Processor -- start 2024-09-15T23:57:19.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.789+0000 7f117230d640 1 -- start start 2024-09-15T23:57:19.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f117230d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f116c15c2a0 0x7f116c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:19.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f117230d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f116c0af2a0 0x7f116c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:19.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f117230d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f116c0b3290 con 0x7f116c15bec0 2024-09-15T23:57:19.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f117230d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f116c0b3570 con 0x7f116c0af2a0 2024-09-15T23:57:19.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f117230d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f116c0b3850 con 0x7f116c15c2a0 2024-09-15T23:57:19.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f11708aa640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f116c0af2a0 0x7f116c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:19.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f116b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f116c15c2a0 0x7f116c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:19.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f116b7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f116c15c2a0 0x7f116c0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:53548/0 (socket says 172.21.15.112:53548) 2024-09-15T23:57:19.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f116bfff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f116c15bec0 0x7f116c0ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:58262/0 (socket says 172.21.15.112:58262) 2024-09-15T23:57:19.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f116b7fe640 1 -- 172.21.15.112:0/2226012166 learned_addr learned my addr 172.21.15.112:0/2226012166 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:19.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f11708aa640 1 -- 172.21.15.112:0/2226012166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f116c15c2a0 msgr2=0x7f116c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:19.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f11708aa640 1 --2- 172.21.15.112:0/2226012166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f116c15c2a0 0x7f116c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f11708aa640 1 -- 172.21.15.112:0/2226012166 >> v1:172.21.15.169:6789/0 conn(0x7f116c15bec0 legacy=0x7f116c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:19.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f11708aa640 1 -- 172.21.15.112:0/2226012166 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c0b3b30 con 0x7f116c0af2a0 2024-09-15T23:57:19.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.793+0000 7f116b7fe640 1 --2- 172.21.15.112:0/2226012166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f116c15c2a0 0x7f116c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:57:19.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f11708aa640 1 --2- 172.21.15.112:0/2226012166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c0af2a0 0x7f116c06e000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1164009d90 tx=0x7f116401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98aea89582c320a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:19.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f116affd640 1 -- 172.21.15.112:0/2226012166 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11640b2070 con 0x7f116c0af2a0 2024-09-15T23:57:19.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f116affd640 1 -- 172.21.15.112:0/2226012166 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11640a5a00 con 0x7f116c0af2a0 2024-09-15T23:57:19.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f116affd640 1 -- 172.21.15.112:0/2226012166 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11640a5dd0 con 0x7f116c0af2a0 2024-09-15T23:57:19.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 -- 172.21.15.112:0/2226012166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c0af2a0 msgr2=0x7f116c06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:19.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 --2- 172.21.15.112:0/2226012166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c0af2a0 0x7f116c06e000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1164009d90 tx=0x7f116401c940 comp rx=0 tx=0).stop 2024-09-15T23:57:19.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 -- 172.21.15.112:0/2226012166 shutdown_connections 2024-09-15T23:57:19.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 --2- 172.21.15.112:0/2226012166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c0af2a0 0x7f116c06e000 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 --2- 172.21.15.112:0/2226012166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f116c15c2a0 0x7f116c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 -- 172.21.15.112:0/2226012166 >> 172.21.15.112:0/2226012166 conn(0x7f116c0b1f90 msgr2=0x7f116c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:19.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 -- 172.21.15.112:0/2226012166 shutdown_connections 2024-09-15T23:57:19.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 -- 172.21.15.112:0/2226012166 wait complete. 2024-09-15T23:57:19.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 Processor -- start 2024-09-15T23:57:19.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 -- start start 2024-09-15T23:57:19.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f116c0af2a0 0x7f116c15c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:19.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f116c15bec0 0x7f116c14e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:19.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c15c2a0 0x7f116c09daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:19.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f116c06ed50 con 0x7f116c15bec0 2024-09-15T23:57:19.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f116c0afc90 con 0x7f116c15c2a0 2024-09-15T23:57:19.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f117230d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f116c06eed0 con 0x7f116c0af2a0 2024-09-15T23:57:19.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f116b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f116c15bec0 0x7f116c14e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:19.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f116b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f116c15bec0 0x7f116c14e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37798/0 (socket says 172.21.15.112:37798) 2024-09-15T23:57:19.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f116b7fe640 1 -- 172.21.15.112:0/2839014791 learned_addr learned my addr 172.21.15.112:0/2839014791 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:19.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f116bfff640 1 --2- 172.21.15.112:0/2839014791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f116c0af2a0 0x7f116c15c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:19.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f116b7fe640 1 -- 172.21.15.112:0/2839014791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f116c0af2a0 msgr2=0x7f116c15c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:19.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f11708aa640 1 --2- 172.21.15.112:0/2839014791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c15c2a0 0x7f116c09daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:19.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f116b7fe640 1 --2- 172.21.15.112:0/2839014791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f116c0af2a0 0x7f116c15c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f116b7fe640 1 -- 172.21.15.112:0/2839014791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c15c2a0 msgr2=0x7f116c09daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:19.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f116b7fe640 1 --2- 172.21.15.112:0/2839014791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c15c2a0 0x7f116c09daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:19.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f116b7fe640 1 -- 172.21.15.112:0/2839014791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c070890 con 0x7f116c15bec0 2024-09-15T23:57:19.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.797+0000 7f116b7fe640 1 --2- 172.21.15.112:0/2839014791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f116c15bec0 0x7f116c14e450 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f116000e960 tx=0x7f116000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:19.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.801+0000 7f1168ff9640 1 -- 172.21.15.112:0/2839014791 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1160017070 con 0x7f116c15bec0 2024-09-15T23:57:19.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.801+0000 7f1168ff9640 1 -- 172.21.15.112:0/2839014791 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f116000ca00 con 0x7f116c15bec0 2024-09-15T23:57:19.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.801+0000 7f117230d640 1 -- 172.21.15.112:0/2839014791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116c15e3f0 con 0x7f116c15bec0 2024-09-15T23:57:19.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.801+0000 7f1168ff9640 1 -- 172.21.15.112:0/2839014791 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116000cdb0 con 0x7f116c15bec0 2024-09-15T23:57:19.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.801+0000 7f117230d640 1 -- 172.21.15.112:0/2839014791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116c15e9b0 con 0x7f116c15bec0 2024-09-15T23:57:19.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.801+0000 7f117230d640 1 -- 172.21.15.112:0/2839014791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f116c06f280 con 0x7f116c15bec0 2024-09-15T23:57:19.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.801+0000 7f1168ff9640 1 -- 172.21.15.112:0/2839014791 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f116001a070 con 0x7f116c15bec0 2024-09-15T23:57:19.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.801+0000 7f1168ff9640 1 --2- 172.21.15.112:0/2839014791 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11580678c0 0x7f1158069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:19.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.801+0000 7f1168ff9640 1 -- 172.21.15.112:0/2839014791 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f1160085e70 con 0x7f116c15bec0 2024-09-15T23:57:19.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.801+0000 7f116bfff640 1 --2- 172.21.15.112:0/2839014791 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11580678c0 0x7f1158069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:19.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.801+0000 7f116bfff640 1 --2- 172.21.15.112:0/2839014791 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11580678c0 0x7f1158069d80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f115c000f70 tx=0x7f115c007cb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:19.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:19.805+0000 7f1168ff9640 1 -- 172.21.15.112:0/2839014791 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1160056700 con 0x7f116c15bec0 2024-09-15T23:57:20.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.005+0000 7f117230d640 1 -- 172.21.15.112:0/2839014791 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f116c14eb60 con 0x7f116c15bec0 2024-09-15T23:57:20.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.009+0000 7f1168ff9640 1 -- 172.21.15.112:0/2839014791 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5231 (secure 0 0 0) 0x7f1160056000 con 0x7f116c15bec0 2024-09-15T23:57:20.009 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:20.009 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"btime":"2024-09-15T23:56:58:369858+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2072637952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2072637952},{"type":"v1","addr":"172.21.15.169:6833","nonce":2072637952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/33750051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":33750051},{"type":"v1","addr":"172.21.15.169:6835","nonce":33750051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6018,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/4092393174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":4092393174},{"type":"v1","addr":"172.21.15.112:6837","nonce":4092393174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:55.316845+0000","modified":"2024-09-15T23:56:57.719503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6021},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6021":{"gid":6021,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1581911691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1581911691},{"type":"v1","addr":"172.21.15.112:6836","nonce":1581911691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6021,"qdb_cluster":[6021]},"id":5}]} 2024-09-15T23:57:20.009 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 37 2024-09-15T23:57:20.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.009+0000 7f117230d640 1 -- 172.21.15.112:0/2839014791 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11580678c0 msgr2=0x7f1158069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:20.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.009+0000 7f117230d640 1 --2- 172.21.15.112:0/2839014791 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11580678c0 0x7f1158069d80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f115c000f70 tx=0x7f115c007cb0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.009+0000 7f117230d640 1 -- 172.21.15.112:0/2839014791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f116c15bec0 msgr2=0x7f116c14e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:20.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.009+0000 7f117230d640 1 --2- 172.21.15.112:0/2839014791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f116c15bec0 0x7f116c14e450 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f116000e960 tx=0x7f116000ee20 comp rx=0 tx=0).stop 2024-09-15T23:57:20.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.009+0000 7f117230d640 1 -- 172.21.15.112:0/2839014791 shutdown_connections 2024-09-15T23:57:20.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.009+0000 7f117230d640 1 --2- 172.21.15.112:0/2839014791 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f11580678c0 0x7f1158069d80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.009+0000 7f117230d640 1 --2- 172.21.15.112:0/2839014791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f116c15c2a0 0x7f116c09daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.009+0000 7f117230d640 1 --2- 172.21.15.112:0/2839014791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f116c15bec0 0x7f116c14e450 secure :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f116000e960 tx=0x7f116000ee20 comp rx=0 tx=0).stop 2024-09-15T23:57:20.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.009+0000 7f117230d640 1 --2- 172.21.15.112:0/2839014791 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f116c0af2a0 0x7f116c15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.009+0000 7f117230d640 1 -- 172.21.15.112:0/2839014791 >> 172.21.15.112:0/2839014791 conn(0x7f116c0b1f90 msgr2=0x7f116c0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:20.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.009+0000 7f117230d640 1 -- 172.21.15.112:0/2839014791 shutdown_connections 2024-09-15T23:57:20.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.009+0000 7f117230d640 1 -- 172.21.15.112:0/2839014791 wait complete. 2024-09-15T23:57:20.028 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump mds_cache strays_created 2024-09-15T23:57:20.153 INFO:teuthology.orchestra.run.smithi112.stdout:{"mds_cache":{"strays_created":10}} 2024-09-15T23:57:20.153 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_created": 10 } } 2024-09-15T23:57:20.153 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:20.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0868934640 1 Processor -- start 2024-09-15T23:57:20.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0868934640 1 -- start start 2024-09-15T23:57:20.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0868934640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f08641630c0 0x7f086406f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0868934640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f086406df70 0x7f08641634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0868934640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08640b3290 0x7f08640b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0868934640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f086406e470 con 0x7f086406df70 2024-09-15T23:57:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0868934640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f086406e750 con 0x7f08641630c0 2024-09-15T23:57:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0868934640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f086406ea30 con 0x7f08640b3290 2024-09-15T23:57:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0861d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f086406df70 0x7f08641634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0861d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f086406df70 0x7f08641634a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37810/0 (socket says 172.21.15.112:37810) 2024-09-15T23:57:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0861d9b640 1 -- 172.21.15.112:0/2846725407 learned_addr learned my addr 172.21.15.112:0/2846725407 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0862d9d640 1 --2- 172.21.15.112:0/2846725407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08640b3290 0x7f08640b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f086259c640 1 --2- 172.21.15.112:0/2846725407 >> v2:172.21.15.169:3300/0 conn(0x7f08641630c0 0x7f086406f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0861d9b640 1 -- 172.21.15.112:0/2846725407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08640b3290 msgr2=0x7f08640b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:20.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0861d9b640 1 --2- 172.21.15.112:0/2846725407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08640b3290 0x7f08640b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0861d9b640 1 -- 172.21.15.112:0/2846725407 >> v2:172.21.15.169:3300/0 conn(0x7f08641630c0 msgr2=0x7f086406f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:20.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0861d9b640 1 --2- 172.21.15.112:0/2846725407 >> v2:172.21.15.169:3300/0 conn(0x7f08641630c0 0x7f086406f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0861d9b640 1 -- 172.21.15.112:0/2846725407 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086406ed10 con 0x7f086406df70 2024-09-15T23:57:20.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f086259c640 1 --2- 172.21.15.112:0/2846725407 >> v2:172.21.15.169:3300/0 conn(0x7f08641630c0 0x7f086406f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:20.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.261+0000 7f0862d9d640 1 --2- 172.21.15.112:0/2846725407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08640b3290 0x7f08640b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:20.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f0861d9b640 1 --2- 172.21.15.112:0/2846725407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086406df70 0x7f08641634a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f0864071710 tx=0x7f084c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f1236fead7f869 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:20.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f086159a640 1 -- 172.21.15.112:0/2846725407 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c0a5670 con 0x7f086406df70 2024-09-15T23:57:20.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f086159a640 1 -- 172.21.15.112:0/2846725407 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084c0a5810 con 0x7f086406df70 2024-09-15T23:57:20.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f086159a640 1 -- 172.21.15.112:0/2846725407 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c0a5be0 con 0x7f086406df70 2024-09-15T23:57:20.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f0868934640 1 -- 172.21.15.112:0/2846725407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086406df70 msgr2=0x7f08641634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:20.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f0868934640 1 --2- 172.21.15.112:0/2846725407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086406df70 0x7f08641634a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f0864071710 tx=0x7f084c01c9f0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f0868934640 1 -- 172.21.15.112:0/2846725407 shutdown_connections 2024-09-15T23:57:20.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f0868934640 1 --2- 172.21.15.112:0/2846725407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f086406df70 0x7f08641634a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f0868934640 1 --2- 172.21.15.112:0/2846725407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08640b3290 0x7f08640b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f0868934640 1 --2- 172.21.15.112:0/2846725407 >> v2:172.21.15.169:3300/0 conn(0x7f08641630c0 0x7f086406f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f0868934640 1 -- 172.21.15.112:0/2846725407 >> 172.21.15.112:0/2846725407 conn(0x7f08640b1f90 msgr2=0x7f08640b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:20.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f0868934640 1 -- 172.21.15.112:0/2846725407 shutdown_connections 2024-09-15T23:57:20.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f0868934640 1 -- 172.21.15.112:0/2846725407 wait complete. 2024-09-15T23:57:20.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f0868934640 1 Processor -- start 2024-09-15T23:57:20.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f0868934640 1 -- start start 2024-09-15T23:57:20.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f0868934640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f086406df70 0x7f086415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:20.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.265+0000 7f0868934640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08640b3290 0x7f0864073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:20.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0868934640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08641630c0 0x7f0864152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:20.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0868934640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0864166250 con 0x7f08640b3290 2024-09-15T23:57:20.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0868934640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f086406fc60 con 0x7f086406df70 2024-09-15T23:57:20.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0868934640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f08641663d0 con 0x7f08641630c0 2024-09-15T23:57:20.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0861d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08640b3290 0x7f0864073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:20.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0861d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08640b3290 0x7f0864073b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37818/0 (socket says 172.21.15.112:37818) 2024-09-15T23:57:20.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0861d9b640 1 -- 172.21.15.112:0/2721585369 learned_addr learned my addr 172.21.15.112:0/2721585369 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:20.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f086259c640 1 --2- 172.21.15.112:0/2721585369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f086406df70 0x7f086415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:20.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0862d9d640 1 --2- 172.21.15.112:0/2721585369 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08641630c0 0x7f0864152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:20.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0861d9b640 1 -- 172.21.15.112:0/2721585369 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08641630c0 msgr2=0x7f0864152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:20.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0861d9b640 1 --2- 172.21.15.112:0/2721585369 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08641630c0 0x7f0864152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0861d9b640 1 -- 172.21.15.112:0/2721585369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f086406df70 msgr2=0x7f086415c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:20.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0861d9b640 1 --2- 172.21.15.112:0/2721585369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f086406df70 0x7f086415c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0861d9b640 1 -- 172.21.15.112:0/2721585369 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08640728c0 con 0x7f08640b3290 2024-09-15T23:57:20.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0861d9b640 1 --2- 172.21.15.112:0/2721585369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08640b3290 0x7f0864073b30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f084c01b0a0 tx=0x7f084c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:20.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f085affd640 1 -- 172.21.15.112:0/2721585369 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c0bc020 con 0x7f08640b3290 2024-09-15T23:57:20.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f085affd640 1 -- 172.21.15.112:0/2721585369 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084c0b8670 con 0x7f08640b3290 2024-09-15T23:57:20.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0868934640 1 -- 172.21.15.112:0/2721585369 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0864072ba0 con 0x7f08640b3290 2024-09-15T23:57:20.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f085affd640 1 -- 172.21.15.112:0/2721585369 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c0b8a60 con 0x7f08640b3290 2024-09-15T23:57:20.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0868934640 1 -- 172.21.15.112:0/2721585369 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0864073160 con 0x7f08640b3290 2024-09-15T23:57:20.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f0868934640 1 -- 172.21.15.112:0/2721585369 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08640b3720 con 0x7f08640b3290 2024-09-15T23:57:20.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f085affd640 1 -- 172.21.15.112:0/2721585369 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f084c0bf020 con 0x7f08640b3290 2024-09-15T23:57:20.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f085affd640 1 --2- 172.21.15.112:0/2721585369 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f08440678c0 0x7f0844069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:20.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f085affd640 1 -- 172.21.15.112:0/2721585369 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f084c1212c0 con 0x7f08640b3290 2024-09-15T23:57:20.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f086259c640 1 --2- 172.21.15.112:0/2721585369 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f08440678c0 0x7f0844069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:20.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.269+0000 7f086259c640 1 --2- 172.21.15.112:0/2721585369 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f08440678c0 0x7f0844069d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0854006fd0 tx=0x7f0854008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:20.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.273+0000 7f085affd640 1 -- 172.21.15.112:0/2721585369 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f084c0c6030 con 0x7f08640b3290 2024-09-15T23:57:20.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.469+0000 7f0868934640 1 -- 172.21.15.112:0/2721585369 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08640cc730 con 0x7f08640b3290 2024-09-15T23:57:20.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.469+0000 7f085affd640 1 -- 172.21.15.112:0/2721585369 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5231 (secure 0 0 0) 0x7f084c0165e0 con 0x7f08640b3290 2024-09-15T23:57:20.470 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:20.471 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"btime":"2024-09-15T23:56:58:369858+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2072637952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2072637952},{"type":"v1","addr":"172.21.15.169:6833","nonce":2072637952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/33750051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":33750051},{"type":"v1","addr":"172.21.15.169:6835","nonce":33750051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6018,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/4092393174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":4092393174},{"type":"v1","addr":"172.21.15.112:6837","nonce":4092393174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:55.316845+0000","modified":"2024-09-15T23:56:57.719503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6021},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6021":{"gid":6021,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1581911691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1581911691},{"type":"v1","addr":"172.21.15.112:6836","nonce":1581911691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6021,"qdb_cluster":[6021]},"id":5}]} 2024-09-15T23:57:20.471 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 37 2024-09-15T23:57:20.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.473+0000 7f0868934640 1 -- 172.21.15.112:0/2721585369 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f08440678c0 msgr2=0x7f0844069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:20.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.473+0000 7f0868934640 1 --2- 172.21.15.112:0/2721585369 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f08440678c0 0x7f0844069d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0854006fd0 tx=0x7f0854008040 comp rx=0 tx=0).stop 2024-09-15T23:57:20.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.473+0000 7f0868934640 1 -- 172.21.15.112:0/2721585369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08640b3290 msgr2=0x7f0864073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:20.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.473+0000 7f0868934640 1 --2- 172.21.15.112:0/2721585369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08640b3290 0x7f0864073b30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f084c01b0a0 tx=0x7f084c019790 comp rx=0 tx=0).stop 2024-09-15T23:57:20.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.473+0000 7f0868934640 1 -- 172.21.15.112:0/2721585369 shutdown_connections 2024-09-15T23:57:20.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.473+0000 7f0868934640 1 --2- 172.21.15.112:0/2721585369 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f08440678c0 0x7f0844069d80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.473+0000 7f0868934640 1 --2- 172.21.15.112:0/2721585369 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08641630c0 0x7f0864152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.473+0000 7f0868934640 1 --2- 172.21.15.112:0/2721585369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08640b3290 0x7f0864073b30 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.473+0000 7f0868934640 1 --2- 172.21.15.112:0/2721585369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f086406df70 0x7f086415c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:20.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.473+0000 7f0868934640 1 -- 172.21.15.112:0/2721585369 >> 172.21.15.112:0/2721585369 conn(0x7f08640b1f90 msgr2=0x7f0864164600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:20.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.473+0000 7f0868934640 1 -- 172.21.15.112:0/2721585369 shutdown_connections 2024-09-15T23:57:20.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:20.473+0000 7f0868934640 1 -- 172.21.15.112:0/2721585369 wait complete. 2024-09-15T23:57:20.489 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump mds_cache strays_enqueued 2024-09-15T23:57:20.615 INFO:teuthology.orchestra.run.smithi112.stdout:{"mds_cache":{"strays_enqueued":0}} 2024-09-15T23:57:20.616 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_enqueued": 0 } } 2024-09-15T23:57:20.616 DEBUG:tasks.ceph_test_case:wait_until_equal: 0 != 10, waiting (timeout=60)... 2024-09-15T23:57:25.617 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:25.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f3671c64640 1 Processor -- start 2024-09-15T23:57:25.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f3671c64640 1 -- start start 2024-09-15T23:57:25.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f3671c64640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f366c1520a0 0x7f366c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f3671c64640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f366c15f3a0 0x7f366c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f3671c64640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f366c070250 con 0x7f366c06fe50 2024-09-15T23:57:25.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f3671c64640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f366c152480 con 0x7f366c15f3a0 2024-09-15T23:57:25.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f3671c64640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f366c0aede0 con 0x7f366c1520a0 2024-09-15T23:57:25.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f366affd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f366c06fe50 0x7f366c15ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58380/0 (socket says 172.21.15.112:58380) 2024-09-15T23:57:25.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f366affd640 1 -- 172.21.15.112:0/3392040737 learned_addr learned my addr 172.21.15.112:0/3392040737 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:25.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f366bfff640 1 --2- 172.21.15.112:0/3392040737 >> v2:172.21.15.112:3300/0 conn(0x7f366c15f3a0 0x7f366c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:25.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f366b7fe640 1 --2- 172.21.15.112:0/3392040737 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f366c1520a0 0x7f366c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:25.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f366a7fc640 1 -- 172.21.15.112:0/3392040737 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942355806 0 0) 0x7f366c070250 con 0x7f366c06fe50 2024-09-15T23:57:25.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f366a7fc640 1 -- 172.21.15.112:0/3392040737 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3654003530 con 0x7f366c06fe50 2024-09-15T23:57:25.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f366bfff640 1 -- 172.21.15.112:0/3392040737 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f366c1520a0 msgr2=0x7f366c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:25.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f366bfff640 1 --2- 172.21.15.112:0/3392040737 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f366c1520a0 0x7f366c06f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f366bfff640 1 -- 172.21.15.112:0/3392040737 >> v1:172.21.15.112:6789/0 conn(0x7f366c06fe50 legacy=0x7f366c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f366bfff640 1 -- 172.21.15.112:0/3392040737 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c15fa10 con 0x7f366c15f3a0 2024-09-15T23:57:25.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.749+0000 7f366b7fe640 1 --2- 172.21.15.112:0/3392040737 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f366c1520a0 0x7f366c06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:57:25.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f366bfff640 1 --2- 172.21.15.112:0/3392040737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f366c15f3a0 0x7f366c0adc80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3664009d90 tx=0x7f366401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42c3c9637cd4d02 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:25.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f366a7fc640 1 -- 172.21.15.112:0/3392040737 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36640b2070 con 0x7f366c15f3a0 2024-09-15T23:57:25.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f366a7fc640 1 -- 172.21.15.112:0/3392040737 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36640a5a30 con 0x7f366c15f3a0 2024-09-15T23:57:25.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f366a7fc640 1 -- 172.21.15.112:0/3392040737 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36640a5e00 con 0x7f366c15f3a0 2024-09-15T23:57:25.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 -- 172.21.15.112:0/3392040737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f366c15f3a0 msgr2=0x7f366c0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 --2- 172.21.15.112:0/3392040737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f366c15f3a0 0x7f366c0adc80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3664009d90 tx=0x7f366401c970 comp rx=0 tx=0).stop 2024-09-15T23:57:25.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 -- 172.21.15.112:0/3392040737 shutdown_connections 2024-09-15T23:57:25.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 --2- 172.21.15.112:0/3392040737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f366c15f3a0 0x7f366c0adc80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 --2- 172.21.15.112:0/3392040737 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f366c1520a0 0x7f366c06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 -- 172.21.15.112:0/3392040737 >> 172.21.15.112:0/3392040737 conn(0x7f366c0b1f90 msgr2=0x7f366c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:25.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 -- 172.21.15.112:0/3392040737 shutdown_connections 2024-09-15T23:57:25.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 -- 172.21.15.112:0/3392040737 wait complete. 2024-09-15T23:57:25.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 Processor -- start 2024-09-15T23:57:25.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 -- start start 2024-09-15T23:57:25.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f366c06fe50 0x7f366c1457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f366c1520a0 0x7f366c099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f366c15f3a0 0x7f366c146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f366c073d30 con 0x7f366c06fe50 2024-09-15T23:57:25.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f366c073a50 con 0x7f366c15f3a0 2024-09-15T23:57:25.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f3671c64640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f366c167f10 con 0x7f366c1520a0 2024-09-15T23:57:25.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f366b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f366c06fe50 0x7f366c1457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f366b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f366c06fe50 0x7f366c1457d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37826/0 (socket says 172.21.15.112:37826) 2024-09-15T23:57:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.753+0000 7f366b7fe640 1 -- 172.21.15.112:0/1910998057 learned_addr learned my addr 172.21.15.112:0/1910998057 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f366affd640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f366c1520a0 0x7f366c099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f366bfff640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f366c15f3a0 0x7f366c146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f366b7fe640 1 -- 172.21.15.112:0/1910998057 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f366c1520a0 msgr2=0x7f366c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f366b7fe640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f366c1520a0 0x7f366c099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f366b7fe640 1 -- 172.21.15.112:0/1910998057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f366c15f3a0 msgr2=0x7f366c146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f366b7fe640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f366c15f3a0 0x7f366c146360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f366b7fe640 1 -- 172.21.15.112:0/1910998057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c1468a0 con 0x7f366c06fe50 2024-09-15T23:57:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f366affd640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f366c1520a0 0x7f366c099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:25.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f366b7fe640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f366c06fe50 0x7f366c1457d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f365c00e810 tx=0x7f365c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f3653fff640 1 -- 172.21.15.112:0/1910998057 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c017070 con 0x7f366c06fe50 2024-09-15T23:57:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f3653fff640 1 -- 172.21.15.112:0/1910998057 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365c00c670 con 0x7f366c06fe50 2024-09-15T23:57:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f3671c64640 1 -- 172.21.15.112:0/1910998057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366c0b1920 con 0x7f366c06fe50 2024-09-15T23:57:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f3653fff640 1 -- 172.21.15.112:0/1910998057 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c00f040 con 0x7f366c06fe50 2024-09-15T23:57:25.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f3671c64640 1 -- 172.21.15.112:0/1910998057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f366c151cd0 con 0x7f366c06fe50 2024-09-15T23:57:25.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f3671c64640 1 -- 172.21.15.112:0/1910998057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f366c06f910 con 0x7f366c06fe50 2024-09-15T23:57:25.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f3653fff640 1 -- 172.21.15.112:0/1910998057 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f365c01a070 con 0x7f366c06fe50 2024-09-15T23:57:25.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f3653fff640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f36580678c0 0x7f3658069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f366affd640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f36580678c0 0x7f3658069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:25.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f3653fff640 1 -- 172.21.15.112:0/1910998057 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f365c085e40 con 0x7f366c06fe50 2024-09-15T23:57:25.760 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.757+0000 7f366affd640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f36580678c0 0x7f3658069d80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f366c165ed0 tx=0x7f3660009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:25.763 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.761+0000 7f3653fff640 1 -- 172.21.15.112:0/1910998057 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f365c0567d0 con 0x7f366c06fe50 2024-09-15T23:57:25.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.953+0000 7f3671c64640 1 -- 172.21.15.112:0/1910998057 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f366c06e540 con 0x7f366c06fe50 2024-09-15T23:57:25.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.953+0000 7f3653fff640 1 -- 172.21.15.112:0/1910998057 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5231 (secure 0 0 0) 0x7f365c0560d0 con 0x7f366c06fe50 2024-09-15T23:57:25.954 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:25.954 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"btime":"2024-09-15T23:56:58:369858+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2072637952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2072637952},{"type":"v1","addr":"172.21.15.169:6833","nonce":2072637952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/33750051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":33750051},{"type":"v1","addr":"172.21.15.169:6835","nonce":33750051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6018,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/4092393174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":4092393174},{"type":"v1","addr":"172.21.15.112:6837","nonce":4092393174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:55.316845+0000","modified":"2024-09-15T23:56:57.719503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6021},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6021":{"gid":6021,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1581911691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1581911691},{"type":"v1","addr":"172.21.15.112:6836","nonce":1581911691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6021,"qdb_cluster":[6021]},"id":5}]} 2024-09-15T23:57:25.955 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 37 2024-09-15T23:57:25.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.957+0000 7f3671c64640 1 -- 172.21.15.112:0/1910998057 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f36580678c0 msgr2=0x7f3658069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.957+0000 7f3671c64640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f36580678c0 0x7f3658069d80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f366c165ed0 tx=0x7f3660009040 comp rx=0 tx=0).stop 2024-09-15T23:57:25.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.957+0000 7f3671c64640 1 -- 172.21.15.112:0/1910998057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f366c06fe50 msgr2=0x7f366c1457d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.957+0000 7f3671c64640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f366c06fe50 0x7f366c1457d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f365c00e810 tx=0x7f365c00ecd0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.957+0000 7f3671c64640 1 -- 172.21.15.112:0/1910998057 shutdown_connections 2024-09-15T23:57:25.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.957+0000 7f3671c64640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f36580678c0 0x7f3658069d80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.957+0000 7f3671c64640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f366c15f3a0 0x7f366c146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.957+0000 7f3671c64640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f366c1520a0 0x7f366c099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.957+0000 7f3671c64640 1 --2- 172.21.15.112:0/1910998057 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f366c06fe50 0x7f366c1457d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.957+0000 7f3671c64640 1 -- 172.21.15.112:0/1910998057 >> 172.21.15.112:0/1910998057 conn(0x7f366c0b1f90 msgr2=0x7f366c14c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:25.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.957+0000 7f3671c64640 1 -- 172.21.15.112:0/1910998057 shutdown_connections 2024-09-15T23:57:25.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:25.957+0000 7f3671c64640 1 -- 172.21.15.112:0/1910998057 wait complete. 2024-09-15T23:57:25.973 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump mds_cache strays_enqueued 2024-09-15T23:57:26.110 INFO:teuthology.orchestra.run.smithi112.stdout:{"mds_cache":{"strays_enqueued":10}} 2024-09-15T23:57:26.110 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "strays_enqueued": 10 } } 2024-09-15T23:57:26.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:26.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d9142b640 1 Processor -- start 2024-09-15T23:57:26.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d9142b640 1 -- start start 2024-09-15T23:57:26.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d9142b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4d8c161a60 0x7f4d8c0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d9142b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0d2e90 0x7f4d8c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d9142b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d8c0d32b0 con 0x7f4d8c0cf450 2024-09-15T23:57:26.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d9142b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f4d8c0d0300 con 0x7f4d8c161a60 2024-09-15T23:57:26.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d9142b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4d8c06e6c0 con 0x7f4d8c0d2e90 2024-09-15T23:57:26.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d8b7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4d8c0cf450 0x7f4d8c0d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58394/0 (socket says 172.21.15.112:58394) 2024-09-15T23:57:26.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d8b7fe640 1 -- 172.21.15.112:0/2296426566 learned_addr learned my addr 172.21.15.112:0/2296426566 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:26.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d8a7fc640 1 --2- 172.21.15.112:0/2296426566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0d2e90 0x7f4d8c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d8affd640 1 --2- 172.21.15.112:0/2296426566 >> v2:172.21.15.169:3300/0 conn(0x7f4d8c161a60 0x7f4d8c0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 -- 172.21.15.112:0/2296426566 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213378220 0 0) 0x7f4d8c0d32b0 con 0x7f4d8c0cf450 2024-09-15T23:57:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 -- 172.21.15.112:0/2296426566 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d74003530 con 0x7f4d8c0cf450 2024-09-15T23:57:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 -- 172.21.15.112:0/2296426566 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 981482822 0 0) 0x7f4d74003530 con 0x7f4d8c0cf450 2024-09-15T23:57:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 -- 172.21.15.112:0/2296426566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0d2e90 msgr2=0x7f4d8c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 --2- 172.21.15.112:0/2296426566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0d2e90 0x7f4d8c0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 -- 172.21.15.112:0/2296426566 >> v2:172.21.15.169:3300/0 conn(0x7f4d8c161a60 msgr2=0x7f4d8c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 --2- 172.21.15.112:0/2296426566 >> v2:172.21.15.169:3300/0 conn(0x7f4d8c161a60 0x7f4d8c0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 -- 172.21.15.112:0/2296426566 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8c0b0f60 con 0x7f4d8c0cf450 2024-09-15T23:57:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 -- 172.21.15.112:0/2296426566 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f4d84001a00 con 0x7f4d8c0cf450 2024-09-15T23:57:26.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 -- 172.21.15.112:0/2296426566 >> v1:172.21.15.112:6789/0 conn(0x7f4d8c0cf450 legacy=0x7f4d8c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 --2- 172.21.15.112:0/2296426566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d740039c0 0x7f4d74003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 --2- 172.21.15.112:0/2296426566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d74004810 0x7f4d74004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 --2- 172.21.15.112:0/2296426566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0d2e90 0x7f4d740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 -- 172.21.15.112:0/2296426566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c0d0300 con 0x7f4d740039c0 2024-09-15T23:57:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 -- 172.21.15.112:0/2296426566 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c06e6c0 con 0x7f4d74004810 2024-09-15T23:57:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d89ffb640 1 -- 172.21.15.112:0/2296426566 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7400b9d0 con 0x7f4d8c0d2e90 2024-09-15T23:57:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d8affd640 1 --2- 172.21.15.112:0/2296426566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d740039c0 0x7f4d74003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d8a7fc640 1 --2- 172.21.15.112:0/2296426566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d74004810 0x7f4d74004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d8b7fe640 1 --2- 172.21.15.112:0/2296426566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0d2e90 0x7f4d740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d8affd640 1 -- 172.21.15.112:0/2296426566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0d2e90 msgr2=0x7f4d740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d8affd640 1 --2- 172.21.15.112:0/2296426566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0d2e90 0x7f4d740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d8affd640 1 -- 172.21.15.112:0/2296426566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d74004810 msgr2=0x7f4d74004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:26.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d8affd640 1 --2- 172.21.15.112:0/2296426566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d74004810 0x7f4d74004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d8affd640 1 -- 172.21.15.112:0/2296426566 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d74003530 con 0x7f4d740039c0 2024-09-15T23:57:26.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d8a7fc640 1 --2- 172.21.15.112:0/2296426566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d74004810 0x7f4d74004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:26.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.225+0000 7f4d8b7fe640 1 --2- 172.21.15.112:0/2296426566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0d2e90 0x7f4d740051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:26.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d8affd640 1 --2- 172.21.15.112:0/2296426566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d740039c0 0x7f4d74003de0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009b10 tx=0x7f4d7c01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681aa254b8c5dcf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:26.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d89ffb640 1 -- 172.21.15.112:0/2296426566 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c0b2070 con 0x7f4d740039c0 2024-09-15T23:57:26.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d89ffb640 1 -- 172.21.15.112:0/2296426566 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d7c0a5570 con 0x7f4d740039c0 2024-09-15T23:57:26.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d89ffb640 1 -- 172.21.15.112:0/2296426566 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c0096b0 con 0x7f4d740039c0 2024-09-15T23:57:26.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d9142b640 1 -- 172.21.15.112:0/2296426566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d740039c0 msgr2=0x7f4d74003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d9142b640 1 --2- 172.21.15.112:0/2296426566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d740039c0 0x7f4d74003de0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009b10 tx=0x7f4d7c01ca80 comp rx=0 tx=0).stop 2024-09-15T23:57:26.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d8b7fe640 1 -- 172.21.15.112:0/2296426566 reap_dead start 2024-09-15T23:57:26.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d9142b640 1 -- 172.21.15.112:0/2296426566 shutdown_connections 2024-09-15T23:57:26.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d9142b640 1 -- 172.21.15.112:0/2296426566 >> 172.21.15.112:0/2296426566 conn(0x7f4d8c08bf90 msgr2=0x7f4d8c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:26.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d9142b640 1 -- 172.21.15.112:0/2296426566 shutdown_connections 2024-09-15T23:57:26.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d9142b640 1 -- 172.21.15.112:0/2296426566 wait complete. 2024-09-15T23:57:26.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d9142b640 1 Processor -- start 2024-09-15T23:57:26.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d9142b640 1 -- start start 2024-09-15T23:57:26.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d9142b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d740039c0 0x7f4d8c0b9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d9142b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0b21b0 0x7f4d8c0b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d9142b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d8c153140 0x7f4d8c1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d9142b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c06d190 con 0x7f4d740039c0 2024-09-15T23:57:26.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d9142b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c0d1930 con 0x7f4d8c153140 2024-09-15T23:57:26.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d9142b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4d8c0cf880 con 0x7f4d8c0b21b0 2024-09-15T23:57:26.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d8affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d740039c0 0x7f4d8c0b9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:26.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d8affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d740039c0 0x7f4d8c0b9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37842/0 (socket says 172.21.15.112:37842) 2024-09-15T23:57:26.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.229+0000 7f4d8affd640 1 -- 172.21.15.112:0/1693190122 learned_addr learned my addr 172.21.15.112:0/1693190122 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:26.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d8affd640 1 -- 172.21.15.112:0/1693190122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0b21b0 msgr2=0x7f4d8c0b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d8a7fc640 1 --2- 172.21.15.112:0/1693190122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0b21b0 0x7f4d8c0b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:26.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d8affd640 1 --2- 172.21.15.112:0/1693190122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0b21b0 0x7f4d8c0b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d8affd640 1 -- 172.21.15.112:0/1693190122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d8c153140 msgr2=0x7f4d8c1535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d8affd640 1 --2- 172.21.15.112:0/1693190122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d8c153140 0x7f4d8c1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d8affd640 1 -- 172.21.15.112:0/1693190122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8c1644e0 con 0x7f4d740039c0 2024-09-15T23:57:26.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d8affd640 1 --2- 172.21.15.112:0/1693190122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d740039c0 0x7f4d8c0b9e40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c01c8b0 tx=0x7f4d74005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:26.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d737fe640 1 -- 172.21.15.112:0/1693190122 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c0bc030 con 0x7f4d740039c0 2024-09-15T23:57:26.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d737fe640 1 -- 172.21.15.112:0/1693190122 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d7c00f000 con 0x7f4d740039c0 2024-09-15T23:57:26.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d9142b640 1 -- 172.21.15.112:0/1693190122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8c1634d0 con 0x7f4d740039c0 2024-09-15T23:57:26.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d737fe640 1 -- 172.21.15.112:0/1693190122 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c0b2040 con 0x7f4d740039c0 2024-09-15T23:57:26.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d9142b640 1 -- 172.21.15.112:0/1693190122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8c1647a0 con 0x7f4d740039c0 2024-09-15T23:57:26.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d9142b640 1 -- 172.21.15.112:0/1693190122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d8c160560 con 0x7f4d740039c0 2024-09-15T23:57:26.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d737fe640 1 -- 172.21.15.112:0/1693190122 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4d7c0bf070 con 0x7f4d740039c0 2024-09-15T23:57:26.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d737fe640 1 --2- 172.21.15.112:0/1693190122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4d780678f0 0x7f4d78069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d737fe640 1 -- 172.21.15.112:0/1693190122 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f4d7c11f750 con 0x7f4d740039c0 2024-09-15T23:57:26.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d8a7fc640 1 --2- 172.21.15.112:0/1693190122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4d780678f0 0x7f4d78069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:26.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.233+0000 7f4d8a7fc640 1 --2- 172.21.15.112:0/1693190122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4d780678f0 0x7f4d78069db0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0b3290 tx=0x7f4d80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:26.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.237+0000 7f4d737fe640 1 -- 172.21.15.112:0/1693190122 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4d7c016800 con 0x7f4d740039c0 2024-09-15T23:57:26.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.433+0000 7f4d9142b640 1 -- 172.21.15.112:0/1693190122 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d8c160280 con 0x7f4d740039c0 2024-09-15T23:57:26.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.433+0000 7f4d737fe640 1 -- 172.21.15.112:0/1693190122 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5231 (secure 0 0 0) 0x7f4d7c0f02b0 con 0x7f4d740039c0 2024-09-15T23:57:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:26.436 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"btime":"2024-09-15T23:56:58:369858+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2072637952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2072637952},{"type":"v1","addr":"172.21.15.169:6833","nonce":2072637952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/33750051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":33750051},{"type":"v1","addr":"172.21.15.169:6835","nonce":33750051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6018,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/4092393174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":4092393174},{"type":"v1","addr":"172.21.15.112:6837","nonce":4092393174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:55.316845+0000","modified":"2024-09-15T23:56:57.719503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6021},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6021":{"gid":6021,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1581911691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1581911691},{"type":"v1","addr":"172.21.15.112:6836","nonce":1581911691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6021,"qdb_cluster":[6021]},"id":5}]} 2024-09-15T23:57:26.436 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 37 2024-09-15T23:57:26.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.437+0000 7f4d9142b640 1 -- 172.21.15.112:0/1693190122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4d780678f0 msgr2=0x7f4d78069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.437+0000 7f4d9142b640 1 --2- 172.21.15.112:0/1693190122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4d780678f0 0x7f4d78069db0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0b3290 tx=0x7f4d80008040 comp rx=0 tx=0).stop 2024-09-15T23:57:26.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.437+0000 7f4d9142b640 1 -- 172.21.15.112:0/1693190122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d740039c0 msgr2=0x7f4d8c0b9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.437+0000 7f4d9142b640 1 --2- 172.21.15.112:0/1693190122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d740039c0 0x7f4d8c0b9e40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c01c8b0 tx=0x7f4d74005840 comp rx=0 tx=0).stop 2024-09-15T23:57:26.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.437+0000 7f4d9142b640 1 -- 172.21.15.112:0/1693190122 shutdown_connections 2024-09-15T23:57:26.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.437+0000 7f4d9142b640 1 --2- 172.21.15.112:0/1693190122 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4d780678f0 0x7f4d78069db0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.437+0000 7f4d9142b640 1 --2- 172.21.15.112:0/1693190122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d8c153140 0x7f4d8c1535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.437+0000 7f4d9142b640 1 --2- 172.21.15.112:0/1693190122 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0b21b0 0x7f4d8c0b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.437+0000 7f4d9142b640 1 --2- 172.21.15.112:0/1693190122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d740039c0 0x7f4d8c0b9e40 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.437+0000 7f4d9142b640 1 -- 172.21.15.112:0/1693190122 >> 172.21.15.112:0/1693190122 conn(0x7f4d8c08bf90 msgr2=0x7f4d8c0b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:26.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.437+0000 7f4d9142b640 1 -- 172.21.15.112:0/1693190122 shutdown_connections 2024-09-15T23:57:26.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26.437+0000 7f4d9142b640 1 -- 172.21.15.112:0/1693190122 wait complete. 2024-09-15T23:57:26.453 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump purge_queue pq_executed 2024-09-15T23:57:26.591 INFO:teuthology.orchestra.run.smithi112.stdout:{"purge_queue":{"pq_executed":10}} 2024-09-15T23:57:26.591 DEBUG:tasks.cephfs.filesystem:_json_asok output { "purge_queue": { "pq_executed": 10 } } 2024-09-15T23:57:26.591 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:57:26.591 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:26.597 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-15T23:57:26.597 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:57:26.597 DEBUG:teuthology.orchestra.run.smithi112:> import uuid 2024-09-15T23:57:26.597 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:26.597 DEBUG:teuthology.orchestra.run.smithi112:> n = 10 2024-09-15T23:57:26.597 DEBUG:teuthology.orchestra.run.smithi112:> create_hard_links = False 2024-09-15T23:57:26.597 DEBUG:teuthology.orchestra.run.smithi112:> if 0 > 0: 2024-09-15T23:57:26.597 DEBUG:teuthology.orchestra.run.smithi112:> create_hard_links = True 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> path = "/home/ubuntu/cephtest/mnt.0/subdir/file" 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> dpath = os.path.dirname(path) 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> fnameprefix = os.path.basename(path) 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> os.makedirs(dpath, exist_ok=True) 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> try: 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> for i in range(n): 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> with open(fpath, '"'"'w'"'"') as f: 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> f.write(f"{i}") 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> f.flush() 2024-09-15T23:57:26.598 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(f.fileno()) 2024-09-15T23:57:26.599 DEBUG:teuthology.orchestra.run.smithi112:> if True: 2024-09-15T23:57:26.599 DEBUG:teuthology.orchestra.run.smithi112:> os.unlink(fpath) 2024-09-15T23:57:26.599 DEBUG:teuthology.orchestra.run.smithi112:> if True: 2024-09-15T23:57:26.599 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(dirfd) 2024-09-15T23:57:26.599 DEBUG:teuthology.orchestra.run.smithi112:> if create_hard_links: 2024-09-15T23:57:26.599 DEBUG:teuthology.orchestra.run.smithi112:> for j in range(0): 2024-09-15T23:57:26.599 DEBUG:teuthology.orchestra.run.smithi112:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-15T23:57:26.599 DEBUG:teuthology.orchestra.run.smithi112:> if False: 2024-09-15T23:57:26.599 DEBUG:teuthology.orchestra.run.smithi112:> os.fsync(dirfd) 2024-09-15T23:57:26.599 DEBUG:teuthology.orchestra.run.smithi112:> finally: 2024-09-15T23:57:26.599 DEBUG:teuthology.orchestra.run.smithi112:> os.close(dirfd) 2024-09-15T23:57:26.599 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:57:26.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:57:26.810 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:57:26.810 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:57:26.906 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:57:26.988 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:57:26.988 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:57:26.988 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:57:26.988 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:26.995 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:57:27.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.169+0000 7fa39f900640 1 Processor -- start 2024-09-15T23:57:27.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.169+0000 7fa39f900640 1 -- start start 2024-09-15T23:57:27.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.169+0000 7fa39f900640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa39806d3e0 0x7fa3980b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:27.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.169+0000 7fa39f900640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3980ae780 con 0x7fa3980b5b70 2024-09-15T23:57:27.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.169+0000 7fa39f900640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa398158ce0 con 0x7fa398158900 2024-09-15T23:57:27.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.169+0000 7fa39f900640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa3980b6020 con 0x7fa39806d3e0 2024-09-15T23:57:27.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.169+0000 7fa39ce9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa39806d3e0 0x7fa3980b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:27.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.169+0000 7fa39de9d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa3980b5b70 0x7fa3980b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58396/0 (socket says 172.21.15.112:58396) 2024-09-15T23:57:27.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.169+0000 7fa39de9d640 1 -- 172.21.15.112:0/2782526645 learned_addr learned my addr 172.21.15.112:0/2782526645 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:27.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.169+0000 7fa39ce9b640 1 -- 172.21.15.112:0/2782526645 >> v1:172.21.15.169:6789/0 conn(0x7fa398158900 legacy=0x7fa39806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:27.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.169+0000 7fa39ce9b640 1 -- 172.21.15.112:0/2782526645 >> v1:172.21.15.112:6789/0 conn(0x7fa3980b5b70 legacy=0x7fa3980b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:27.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.169+0000 7fa39ce9b640 1 -- 172.21.15.112:0/2782526645 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3980b5730 con 0x7fa39806d3e0 2024-09-15T23:57:27.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.173+0000 7fa39ce9b640 1 --2- 172.21.15.112:0/2782526645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa39806d3e0 0x7fa3980b50c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa3880097c0 tx=0x7fa38801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1213766931ff65 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:27.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.173+0000 7fa38ffff640 1 -- 172.21.15.112:0/2782526645 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3880b1070 con 0x7fa39806d3e0 2024-09-15T23:57:27.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.173+0000 7fa38ffff640 1 -- 172.21.15.112:0/2782526645 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3880ac600 con 0x7fa39806d3e0 2024-09-15T23:57:27.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.173+0000 7fa38ffff640 1 -- 172.21.15.112:0/2782526645 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3880ac9d0 con 0x7fa39806d3e0 2024-09-15T23:57:27.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.173+0000 7fa39f900640 1 -- 172.21.15.112:0/2782526645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa39806d3e0 msgr2=0x7fa3980b50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:27.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.173+0000 7fa39f900640 1 --2- 172.21.15.112:0/2782526645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa39806d3e0 0x7fa3980b50c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa3880097c0 tx=0x7fa38801c3a0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.173+0000 7fa39f900640 1 -- 172.21.15.112:0/2782526645 shutdown_connections 2024-09-15T23:57:27.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.173+0000 7fa39f900640 1 --2- 172.21.15.112:0/2782526645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa39806d3e0 0x7fa3980b50c0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.173+0000 7fa39f900640 1 -- 172.21.15.112:0/2782526645 >> 172.21.15.112:0/2782526645 conn(0x7fa398072670 msgr2=0x7fa398072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:27.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.173+0000 7fa39f900640 1 -- 172.21.15.112:0/2782526645 shutdown_connections 2024-09-15T23:57:27.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.173+0000 7fa39f900640 1 -- 172.21.15.112:0/2782526645 wait complete. 2024-09-15T23:57:27.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.173+0000 7fa39f900640 1 Processor -- start 2024-09-15T23:57:27.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.173+0000 7fa39f900640 1 -- start start 2024-09-15T23:57:27.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39f900640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa39806d3e0 0x7fa398157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:27.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39f900640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3980b5b70 0x7fa3980b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:27.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39f900640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa398158900 0x7fa398146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:27.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39f900640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa39815f720 con 0x7fa39806d3e0 2024-09-15T23:57:27.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39f900640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa39815f200 con 0x7fa398158900 2024-09-15T23:57:27.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39f900640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa39816bfc0 con 0x7fa3980b5b70 2024-09-15T23:57:27.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39d69c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa39806d3e0 0x7fa398157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:27.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39d69c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa39806d3e0 0x7fa398157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37860/0 (socket says 172.21.15.112:37860) 2024-09-15T23:57:27.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39d69c640 1 -- 172.21.15.112:0/3865108285 learned_addr learned my addr 172.21.15.112:0/3865108285 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:27.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39d69c640 1 -- 172.21.15.112:0/3865108285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3980b5b70 msgr2=0x7fa3980b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:27.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39d69c640 1 --2- 172.21.15.112:0/3865108285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3980b5b70 0x7fa3980b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39d69c640 1 -- 172.21.15.112:0/3865108285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa398158900 msgr2=0x7fa398146140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:27.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39d69c640 1 --2- 172.21.15.112:0/3865108285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa398158900 0x7fa398146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39d69c640 1 -- 172.21.15.112:0/3865108285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa398157dd0 con 0x7fa39806d3e0 2024-09-15T23:57:27.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39d69c640 1 --2- 172.21.15.112:0/3865108285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa39806d3e0 0x7fa398157220 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa39400b440 tx=0x7fa39400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:27.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa38dffb640 1 -- 172.21.15.112:0/3865108285 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa394015020 con 0x7fa39806d3e0 2024-09-15T23:57:27.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa38dffb640 1 -- 172.21.15.112:0/3865108285 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa394011890 con 0x7fa39806d3e0 2024-09-15T23:57:27.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa38dffb640 1 -- 172.21.15.112:0/3865108285 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa394011c80 con 0x7fa39806d3e0 2024-09-15T23:57:27.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39f900640 1 -- 172.21.15.112:0/3865108285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3981580b0 con 0x7fa39806d3e0 2024-09-15T23:57:27.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39f900640 1 -- 172.21.15.112:0/3865108285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3980b03e0 con 0x7fa39806d3e0 2024-09-15T23:57:27.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39f900640 1 -- 172.21.15.112:0/3865108285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3980b50c0 con 0x7fa39806d3e0 2024-09-15T23:57:27.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa38dffb640 1 -- 172.21.15.112:0/3865108285 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa394018020 con 0x7fa39806d3e0 2024-09-15T23:57:27.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa38dffb640 1 --2- 172.21.15.112:0/3865108285 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa37c0678c0 0x7fa37c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:27.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa38dffb640 1 -- 172.21.15.112:0/3865108285 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fa394085cd0 con 0x7fa39806d3e0 2024-09-15T23:57:27.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39ce9b640 1 --2- 172.21.15.112:0/3865108285 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa37c0678c0 0x7fa37c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:27.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.177+0000 7fa39ce9b640 1 --2- 172.21.15.112:0/3865108285 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa37c0678c0 0x7fa37c069d80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa3880ae000 tx=0x7fa388008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:27.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.181+0000 7fa38dffb640 1 -- 172.21.15.112:0/3865108285 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa39401f030 con 0x7fa39806d3e0 2024-09-15T23:57:27.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.357+0000 7fa39f900640 1 -- 172.21.15.112:0/3865108285 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa39815d340 con 0x7fa39806d3e0 2024-09-15T23:57:27.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.357+0000 7fa38dffb640 1 -- 172.21.15.112:0/3865108285 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) ==== 80+0+0 (secure 0 0 0) 0x7fa39400d040 con 0x7fa39806d3e0 2024-09-15T23:57:27.359 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:57:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.361+0000 7fa39f900640 1 -- 172.21.15.112:0/3865108285 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa37c0678c0 msgr2=0x7fa37c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.361+0000 7fa39f900640 1 --2- 172.21.15.112:0/3865108285 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa37c0678c0 0x7fa37c069d80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa3880ae000 tx=0x7fa388008040 comp rx=0 tx=0).stop 2024-09-15T23:57:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.361+0000 7fa39f900640 1 -- 172.21.15.112:0/3865108285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa39806d3e0 msgr2=0x7fa398157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:27.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.361+0000 7fa39f900640 1 --2- 172.21.15.112:0/3865108285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa39806d3e0 0x7fa398157220 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa39400b440 tx=0x7fa39400b900 comp rx=0 tx=0).stop 2024-09-15T23:57:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.361+0000 7fa39f900640 1 -- 172.21.15.112:0/3865108285 shutdown_connections 2024-09-15T23:57:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.361+0000 7fa39f900640 1 --2- 172.21.15.112:0/3865108285 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa37c0678c0 0x7fa37c069d80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.361+0000 7fa39f900640 1 --2- 172.21.15.112:0/3865108285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa398158900 0x7fa398146140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.361+0000 7fa39f900640 1 --2- 172.21.15.112:0/3865108285 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3980b5b70 0x7fa3980b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.361+0000 7fa39f900640 1 --2- 172.21.15.112:0/3865108285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa39806d3e0 0x7fa398157220 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.361+0000 7fa39f900640 1 -- 172.21.15.112:0/3865108285 >> 172.21.15.112:0/3865108285 conn(0x7fa398072670 msgr2=0x7fa398072a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.361+0000 7fa39f900640 1 -- 172.21.15.112:0/3865108285 shutdown_connections 2024-09-15T23:57:27.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.361+0000 7fa39f900640 1 -- 172.21.15.112:0/3865108285 wait complete. 2024-09-15T23:57:27.378 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2024-09-15T23:57:27.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:27.378 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:27.389 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[42156]: fuse finished with error 0 and tester_r 0 2024-09-15T23:57:27.390 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:57:27.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:27.390 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:57:27.557 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:57:27.558 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:57:27.558 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:27.564 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:57:27.564 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:57:27.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:27.564 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:57:27.615 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-15T23:57:27.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:57:27.616 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:57:27.616 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:57:27.616 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:27.622 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:57:27.622 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:57:27.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:27.622 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-15T23:57:27.669 INFO:teuthology.orchestra.run.smithi112.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-15T23:57:27.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:57:27.670 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:57:27.670 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:57:27.670 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:27.676 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:57:27.676 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:57:27.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:27.676 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-15T23:57:27.723 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-15T23:57:27.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:57:27.724 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:27.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.849+0000 7f729241a640 1 Processor -- start 2024-09-15T23:57:27.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.849+0000 7f729241a640 1 -- start start 2024-09-15T23:57:27.852 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.849+0000 7f729241a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f728c15bec0 0x7f728c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.849+0000 7f729241a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f728c15c2a0 0x7f728c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.849+0000 7f729241a640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f728c0b3290 con 0x7f728c0af2a0 2024-09-15T23:57:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.849+0000 7f729241a640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f728c0b3570 con 0x7f728c15bec0 2024-09-15T23:57:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.849+0000 7f729241a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f728c0b3850 con 0x7f728c15c2a0 2024-09-15T23:57:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.849+0000 7f728bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f728c15bec0 0x7f728c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.849+0000 7f72909b7640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f728c0af2a0 0x7f728c15fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58410/0 (socket says 172.21.15.112:58410) 2024-09-15T23:57:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.849+0000 7f72909b7640 1 -- 172.21.15.112:0/328503434 learned_addr learned my addr 172.21.15.112:0/328503434 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.849+0000 7f728b7fe640 1 --2- 172.21.15.112:0/328503434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f728c15c2a0 0x7f728c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f728bfff640 1 -- 172.21.15.112:0/328503434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f728c15c2a0 msgr2=0x7f728c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f728bfff640 1 --2- 172.21.15.112:0/328503434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f728c15c2a0 0x7f728c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f728bfff640 1 -- 172.21.15.112:0/328503434 >> v1:172.21.15.112:6789/0 conn(0x7f728c0af2a0 legacy=0x7f728c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:27.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f728affd640 1 -- 172.21.15.112:0/328503434 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2017885684 0 0) 0x7f728c0b3290 con 0x7f728c0af2a0 2024-09-15T23:57:27.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f728bfff640 1 -- 172.21.15.112:0/328503434 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728c0b3b30 con 0x7f728c15bec0 2024-09-15T23:57:27.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f728b7fe640 1 --2- 172.21.15.112:0/328503434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f728c15c2a0 0x7f728c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:57:27.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f728bfff640 1 --2- 172.21.15.112:0/328503434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f728c15bec0 0x7f728c0ad200 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f7284009d90 tx=0x7f728401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9fc4c727e47b60 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:27.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f728affd640 1 -- 172.21.15.112:0/328503434 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72840b2070 con 0x7f728c15bec0 2024-09-15T23:57:27.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f728affd640 1 -- 172.21.15.112:0/328503434 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72840a5a00 con 0x7f728c15bec0 2024-09-15T23:57:27.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f728affd640 1 -- 172.21.15.112:0/328503434 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72840a5dd0 con 0x7f728c15bec0 2024-09-15T23:57:27.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f729241a640 1 -- 172.21.15.112:0/328503434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f728c15bec0 msgr2=0x7f728c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:27.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f729241a640 1 --2- 172.21.15.112:0/328503434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f728c15bec0 0x7f728c0ad200 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f7284009d90 tx=0x7f728401c940 comp rx=0 tx=0).stop 2024-09-15T23:57:27.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f729241a640 1 -- 172.21.15.112:0/328503434 shutdown_connections 2024-09-15T23:57:27.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f729241a640 1 --2- 172.21.15.112:0/328503434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f728c15c2a0 0x7f728c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f729241a640 1 --2- 172.21.15.112:0/328503434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f728c15bec0 0x7f728c0ad200 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f729241a640 1 -- 172.21.15.112:0/328503434 >> 172.21.15.112:0/328503434 conn(0x7f728c0b1f90 msgr2=0x7f728c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:27.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f729241a640 1 -- 172.21.15.112:0/328503434 shutdown_connections 2024-09-15T23:57:27.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.853+0000 7f729241a640 1 -- 172.21.15.112:0/328503434 wait complete. 2024-09-15T23:57:27.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f729241a640 1 Processor -- start 2024-09-15T23:57:27.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f729241a640 1 -- start start 2024-09-15T23:57:27.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f729241a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f728c0af2a0 0x7f728c1555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:27.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f729241a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f728c15bec0 0x7f728c14dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:27.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f729241a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f728c15c2a0 0x7f728c14e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:27.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f729241a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f728c0af6f0 con 0x7f728c15c2a0 2024-09-15T23:57:27.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f729241a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f728c0ad740 con 0x7f728c15bec0 2024-09-15T23:57:27.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f729241a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f728c169000 con 0x7f728c0af2a0 2024-09-15T23:57:27.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f72909b7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f728c15c2a0 0x7f728c14e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:27.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f72909b7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f728c15c2a0 0x7f728c14e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37878/0 (socket says 172.21.15.112:37878) 2024-09-15T23:57:27.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f72909b7640 1 -- 172.21.15.112:0/3489022514 learned_addr learned my addr 172.21.15.112:0/3489022514 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:27.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f728bfff640 1 --2- 172.21.15.112:0/3489022514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f728c0af2a0 0x7f728c1555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:27.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f728b7fe640 1 --2- 172.21.15.112:0/3489022514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f728c15bec0 0x7f728c14dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:27.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f72909b7640 1 -- 172.21.15.112:0/3489022514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f728c0af2a0 msgr2=0x7f728c1555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:27.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f72909b7640 1 --2- 172.21.15.112:0/3489022514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f728c0af2a0 0x7f728c1555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f72909b7640 1 -- 172.21.15.112:0/3489022514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f728c15bec0 msgr2=0x7f728c14dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:27.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f72909b7640 1 --2- 172.21.15.112:0/3489022514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f728c15bec0 0x7f728c14dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f72909b7640 1 -- 172.21.15.112:0/3489022514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728c15a2a0 con 0x7f728c15c2a0 2024-09-15T23:57:27.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f72909b7640 1 --2- 172.21.15.112:0/3489022514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f728c15c2a0 0x7f728c14e4e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f727c00c470 tx=0x7f727c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:27.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f7288ff9640 1 -- 172.21.15.112:0/3489022514 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c018070 con 0x7f728c15c2a0 2024-09-15T23:57:27.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f7288ff9640 1 -- 172.21.15.112:0/3489022514 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727c0074e0 con 0x7f728c15c2a0 2024-09-15T23:57:27.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f729241a640 1 -- 172.21.15.112:0/3489022514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f728c15a580 con 0x7f728c15c2a0 2024-09-15T23:57:27.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f7288ff9640 1 -- 172.21.15.112:0/3489022514 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c004a30 con 0x7f728c15c2a0 2024-09-15T23:57:27.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f729241a640 1 -- 172.21.15.112:0/3489022514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f728c14da80 con 0x7f728c15c2a0 2024-09-15T23:57:27.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.857+0000 7f729241a640 1 -- 172.21.15.112:0/3489022514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f728c0ad200 con 0x7f728c15c2a0 2024-09-15T23:57:27.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.861+0000 7f7288ff9640 1 -- 172.21.15.112:0/3489022514 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f727c01b070 con 0x7f728c15c2a0 2024-09-15T23:57:27.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.861+0000 7f7288ff9640 1 --2- 172.21.15.112:0/3489022514 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f726c0678c0 0x7f726c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:27.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.861+0000 7f7288ff9640 1 -- 172.21.15.112:0/3489022514 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f727c085120 con 0x7f728c15c2a0 2024-09-15T23:57:27.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.861+0000 7f728bfff640 1 --2- 172.21.15.112:0/3489022514 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f726c0678c0 0x7f726c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:27.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.861+0000 7f728bfff640 1 --2- 172.21.15.112:0/3489022514 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f726c0678c0 0x7f726c069d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f72840af000 tx=0x7f72840a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:27.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:27.865+0000 7f7288ff9640 1 -- 172.21.15.112:0/3489022514 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f727c055ad0 con 0x7f728c15c2a0 2024-09-15T23:57:28.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.069+0000 7f729241a640 1 -- 172.21.15.112:0/3489022514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f728c14dc50 con 0x7f728c15c2a0 2024-09-15T23:57:28.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.069+0000 7f7288ff9640 1 -- 172.21.15.112:0/3489022514 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5231 (secure 0 0 0) 0x7f727c0553d0 con 0x7f728c15c2a0 2024-09-15T23:57:28.071 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:28.071 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"btime":"2024-09-15T23:56:58:369858+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2072637952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2072637952},{"type":"v1","addr":"172.21.15.169:6833","nonce":2072637952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/33750051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":33750051},{"type":"v1","addr":"172.21.15.169:6835","nonce":33750051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6018,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/4092393174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":4092393174},{"type":"v1","addr":"172.21.15.112:6837","nonce":4092393174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:55.316845+0000","modified":"2024-09-15T23:56:57.719503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6021},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6021":{"gid":6021,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1581911691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1581911691},{"type":"v1","addr":"172.21.15.112:6836","nonce":1581911691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6021,"qdb_cluster":[6021]},"id":5}]} 2024-09-15T23:57:28.071 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 37 2024-09-15T23:57:28.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.073+0000 7f729241a640 1 -- 172.21.15.112:0/3489022514 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f726c0678c0 msgr2=0x7f726c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.073+0000 7f729241a640 1 --2- 172.21.15.112:0/3489022514 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f726c0678c0 0x7f726c069d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f72840af000 tx=0x7f72840a7070 comp rx=0 tx=0).stop 2024-09-15T23:57:28.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.073+0000 7f729241a640 1 -- 172.21.15.112:0/3489022514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f728c15c2a0 msgr2=0x7f728c14e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.073+0000 7f729241a640 1 --2- 172.21.15.112:0/3489022514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f728c15c2a0 0x7f728c14e4e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f727c00c470 tx=0x7f727c00c930 comp rx=0 tx=0).stop 2024-09-15T23:57:28.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.073+0000 7f729241a640 1 -- 172.21.15.112:0/3489022514 shutdown_connections 2024-09-15T23:57:28.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.073+0000 7f729241a640 1 --2- 172.21.15.112:0/3489022514 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f726c0678c0 0x7f726c069d80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.073+0000 7f729241a640 1 --2- 172.21.15.112:0/3489022514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f728c15c2a0 0x7f728c14e4e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.073+0000 7f729241a640 1 --2- 172.21.15.112:0/3489022514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f728c15bec0 0x7f728c14dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.073+0000 7f729241a640 1 --2- 172.21.15.112:0/3489022514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f728c0af2a0 0x7f728c1555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.073+0000 7f729241a640 1 -- 172.21.15.112:0/3489022514 >> 172.21.15.112:0/3489022514 conn(0x7f728c0b1f90 msgr2=0x7f728c0b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:28.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.073+0000 7f729241a640 1 -- 172.21.15.112:0/3489022514 shutdown_connections 2024-09-15T23:57:28.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.073+0000 7f729241a640 1 -- 172.21.15.112:0/3489022514 wait complete. 2024-09-15T23:57:28.090 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:28.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f270ef27640 1 Processor -- start 2024-09-15T23:57:28.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f270ef27640 1 -- start start 2024-09-15T23:57:28.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f270ef27640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270815bec0 0x7f27080ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f270ef27640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27080b3290 con 0x7f270815c2a0 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f270ef27640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27080b3570 con 0x7f27080af470 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f270ef27640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f27080b3850 con 0x7f270815bec0 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f2707fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f270815c2a0 0x7f27080aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58412/0 (socket says 172.21.15.112:58412) 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f2707fff640 1 -- 172.21.15.112:0/4167897003 learned_addr learned my addr 172.21.15.112:0/4167897003 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f270ccc3640 1 --2- 172.21.15.112:0/4167897003 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270815bec0 0x7f27080ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 -- 172.21.15.112:0/4167897003 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 836055812 0 0) 0x7f27080b3290 con 0x7f270815c2a0 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 -- 172.21.15.112:0/4167897003 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26f0003530 con 0x7f270815c2a0 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 -- 172.21.15.112:0/4167897003 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2377266291 0 0) 0x7f26f0003530 con 0x7f270815c2a0 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 -- 172.21.15.112:0/4167897003 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270815bec0 msgr2=0x7f27080ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 --2- 172.21.15.112:0/4167897003 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270815bec0 0x7f27080ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 -- 172.21.15.112:0/4167897003 >> v1:172.21.15.169:6789/0 conn(0x7f27080af470 legacy=0x7f270806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 -- 172.21.15.112:0/4167897003 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27080b3b30 con 0x7f270815c2a0 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 -- 172.21.15.112:0/4167897003 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f26f8001680 con 0x7f270815c2a0 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 -- 172.21.15.112:0/4167897003 >> v1:172.21.15.112:6789/0 conn(0x7f270815c2a0 legacy=0x7f27080aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 --2- 172.21.15.112:0/4167897003 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270815bec0 0x7f26f00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 --2- 172.21.15.112:0/4167897003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26f0004020 0x7f26f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 --2- 172.21.15.112:0/4167897003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f0004d50 0x7f26f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 -- 172.21.15.112:0/4167897003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f27080b3850 con 0x7f26f0004d50 2024-09-15T23:57:28.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 -- 172.21.15.112:0/4167897003 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26f000bb90 con 0x7f26f0004020 2024-09-15T23:57:28.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f27077fe640 1 -- 172.21.15.112:0/4167897003 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f26f000bd90 con 0x7f270815bec0 2024-09-15T23:57:28.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f270d4c4640 1 --2- 172.21.15.112:0/4167897003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f0004d50 0x7f26f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f270ccc3640 1 --2- 172.21.15.112:0/4167897003 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270815bec0 0x7f26f00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f2707fff640 1 --2- 172.21.15.112:0/4167897003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26f0004020 0x7f26f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f270d4c4640 1 -- 172.21.15.112:0/4167897003 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270815bec0 msgr2=0x7f26f00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:28.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f270d4c4640 1 --2- 172.21.15.112:0/4167897003 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270815bec0 0x7f26f00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f270d4c4640 1 -- 172.21.15.112:0/4167897003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26f0004020 msgr2=0x7f26f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:28.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f270d4c4640 1 --2- 172.21.15.112:0/4167897003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26f0004020 0x7f26f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.205+0000 7f270d4c4640 1 -- 172.21.15.112:0/4167897003 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f0003530 con 0x7f26f0004d50 2024-09-15T23:57:28.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.209+0000 7f270d4c4640 1 --2- 172.21.15.112:0/4167897003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f0004d50 0x7f26f00051d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2700001e70 tx=0x7f270001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fe25f0f0e3a3c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:28.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.209+0000 7f27077fe640 1 -- 172.21.15.112:0/4167897003 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2700001a90 con 0x7f26f0004d50 2024-09-15T23:57:28.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.209+0000 7f27077fe640 1 -- 172.21.15.112:0/4167897003 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2700003b80 con 0x7f26f0004d50 2024-09-15T23:57:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.209+0000 7f27077fe640 1 -- 172.21.15.112:0/4167897003 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2700005080 con 0x7f26f0004d50 2024-09-15T23:57:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.209+0000 7f270ef27640 1 -- 172.21.15.112:0/4167897003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f0004d50 msgr2=0x7f26f00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.209+0000 7f270ef27640 1 --2- 172.21.15.112:0/4167897003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26f0004d50 0x7f26f00051d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2700001e70 tx=0x7f270001c780 comp rx=0 tx=0).stop 2024-09-15T23:57:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.209+0000 7f270d4c4640 1 -- 172.21.15.112:0/4167897003 reap_dead start 2024-09-15T23:57:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.209+0000 7f270ef27640 1 -- 172.21.15.112:0/4167897003 shutdown_connections 2024-09-15T23:57:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.209+0000 7f270ef27640 1 -- 172.21.15.112:0/4167897003 >> 172.21.15.112:0/4167897003 conn(0x7f27080b1f90 msgr2=0x7f27080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.209+0000 7f270ef27640 1 -- 172.21.15.112:0/4167897003 shutdown_connections 2024-09-15T23:57:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.209+0000 7f270ef27640 1 -- 172.21.15.112:0/4167897003 wait complete. 2024-09-15T23:57:28.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.209+0000 7f270ef27640 1 Processor -- start 2024-09-15T23:57:28.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.209+0000 7f270ef27640 1 -- start start 2024-09-15T23:57:28.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f270ef27640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27080b1130 0x7f27081e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f270ef27640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27080b1510 0x7f2708150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f270ef27640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f270814d160 0x7f270814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f270ef27640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f27080afc90 con 0x7f27080b1510 2024-09-15T23:57:28.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f270ef27640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f27080b40f0 con 0x7f270814d160 2024-09-15T23:57:28.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f270ef27640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f27080ad200 con 0x7f27080b1130 2024-09-15T23:57:28.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f2707fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27080b1510 0x7f2708150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f2707fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27080b1510 0x7f2708150630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37900/0 (socket says 172.21.15.112:37900) 2024-09-15T23:57:28.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f2707fff640 1 -- 172.21.15.112:0/3303455019 learned_addr learned my addr 172.21.15.112:0/3303455019 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:28.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f270ccc3640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27080b1130 0x7f27081e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f270d4c4640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f270814d160 0x7f270814d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f2707fff640 1 -- 172.21.15.112:0/3303455019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27080b1130 msgr2=0x7f27081e3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f2707fff640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27080b1130 0x7f27081e3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f2707fff640 1 -- 172.21.15.112:0/3303455019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f270814d160 msgr2=0x7f270814d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f2707fff640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f270814d160 0x7f270814d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f2707fff640 1 -- 172.21.15.112:0/3303455019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2708150cc0 con 0x7f27080b1510 2024-09-15T23:57:28.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f270d4c4640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f270814d160 0x7f270814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:28.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f2707fff640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27080b1510 0x7f2708150630 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f26f800eb20 tx=0x7f26f8001750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:28.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f27057fa640 1 -- 172.21.15.112:0/3303455019 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f800c870 con 0x7f27080b1510 2024-09-15T23:57:28.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f27057fa640 1 -- 172.21.15.112:0/3303455019 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f8018070 con 0x7f27080b1510 2024-09-15T23:57:28.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f270ef27640 1 -- 172.21.15.112:0/3303455019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2708150fa0 con 0x7f27080b1510 2024-09-15T23:57:28.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f27057fa640 1 -- 172.21.15.112:0/3303455019 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f800cc50 con 0x7f27080b1510 2024-09-15T23:57:28.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f270ef27640 1 -- 172.21.15.112:0/3303455019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2708151560 con 0x7f27080b1510 2024-09-15T23:57:28.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f270ef27640 1 -- 172.21.15.112:0/3303455019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27080ad5e0 con 0x7f27080b1510 2024-09-15T23:57:28.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f27057fa640 1 -- 172.21.15.112:0/3303455019 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f26f801d460 con 0x7f27080b1510 2024-09-15T23:57:28.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f27057fa640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26f40678c0 0x7f26f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f270ccc3640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26f40678c0 0x7f26f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f27057fa640 1 -- 172.21.15.112:0/3303455019 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f26f8085e20 con 0x7f27080b1510 2024-09-15T23:57:28.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.213+0000 7f270ccc3640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26f40678c0 0x7f26f4069d80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f26fc003620 tx=0x7f26fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:28.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.217+0000 7f27057fa640 1 -- 172.21.15.112:0/3303455019 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f26f8056860 con 0x7f27080b1510 2024-09-15T23:57:28.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.413+0000 7f270ef27640 1 -- 172.21.15.112:0/3303455019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f270806fcd0 con 0x7f27080b1510 2024-09-15T23:57:28.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.413+0000 7f27057fa640 1 -- 172.21.15.112:0/3303455019 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5231 (secure 0 0 0) 0x7f26f8056160 con 0x7f27080b1510 2024-09-15T23:57:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:28.416 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"btime":"2024-09-15T23:56:58:369858+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2072637952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2072637952},{"type":"v1","addr":"172.21.15.169:6833","nonce":2072637952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/33750051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":33750051},{"type":"v1","addr":"172.21.15.169:6835","nonce":33750051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6018,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/4092393174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":4092393174},{"type":"v1","addr":"172.21.15.112:6837","nonce":4092393174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:55.316845+0000","modified":"2024-09-15T23:56:57.719503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6021},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6021":{"gid":6021,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1581911691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1581911691},{"type":"v1","addr":"172.21.15.112:6836","nonce":1581911691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6021,"qdb_cluster":[6021]},"id":5}]} 2024-09-15T23:57:28.416 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 37 2024-09-15T23:57:28.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.417+0000 7f270ef27640 1 -- 172.21.15.112:0/3303455019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26f40678c0 msgr2=0x7f26f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.417+0000 7f270ef27640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26f40678c0 0x7f26f4069d80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f26fc003620 tx=0x7f26fc008040 comp rx=0 tx=0).stop 2024-09-15T23:57:28.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.417+0000 7f270ef27640 1 -- 172.21.15.112:0/3303455019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27080b1510 msgr2=0x7f2708150630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.417+0000 7f270ef27640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27080b1510 0x7f2708150630 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f26f800eb20 tx=0x7f26f8001750 comp rx=0 tx=0).stop 2024-09-15T23:57:28.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.417+0000 7f270ef27640 1 -- 172.21.15.112:0/3303455019 shutdown_connections 2024-09-15T23:57:28.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.417+0000 7f270ef27640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26f40678c0 0x7f26f4069d80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.417+0000 7f270ef27640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f270814d160 0x7f270814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.417+0000 7f270ef27640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27080b1510 0x7f2708150630 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.417+0000 7f270ef27640 1 --2- 172.21.15.112:0/3303455019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f27080b1130 0x7f27081e3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.417+0000 7f270ef27640 1 -- 172.21.15.112:0/3303455019 >> 172.21.15.112:0/3303455019 conn(0x7f27080b1f90 msgr2=0x7f270815af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:28.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.417+0000 7f270ef27640 1 -- 172.21.15.112:0/3303455019 shutdown_connections 2024-09-15T23:57:28.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.417+0000 7f270ef27640 1 -- 172.21.15.112:0/3303455019 wait complete. 2024-09-15T23:57:28.435 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:28.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.553+0000 7fe11aa6a640 1 Processor -- start 2024-09-15T23:57:28.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.553+0000 7fe11aa6a640 1 -- start start 2024-09-15T23:57:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.553+0000 7fe11aa6a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe114161a60 0x7fe1140d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.553+0000 7fe11aa6a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1140d2e90 0x7fe1140cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.553+0000 7fe11aa6a640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1140d32b0 con 0x7fe1140cf450 2024-09-15T23:57:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.553+0000 7fe11aa6a640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe1140d0300 con 0x7fe114161a60 2024-09-15T23:57:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.553+0000 7fe11aa6a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe11406e6c0 con 0x7fe1140d2e90 2024-09-15T23:57:28.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.553+0000 7fe118806640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe114161a60 0x7fe1140d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.553+0000 7fe119007640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe1140cf450 0x7fe1140d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:42982/0 (socket says 172.21.15.112:42982) 2024-09-15T23:57:28.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.553+0000 7fe119007640 1 -- 172.21.15.112:0/2207150242 learned_addr learned my addr 172.21.15.112:0/2207150242 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:28.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe10bfff640 1 --2- 172.21.15.112:0/2207150242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1140d2e90 0x7fe1140cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe10b7fe640 1 -- 172.21.15.112:0/2207150242 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2263709733 0 0) 0x7fe1140d32b0 con 0x7fe1140cf450 2024-09-15T23:57:28.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe10b7fe640 1 -- 172.21.15.112:0/2207150242 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0fc003530 con 0x7fe1140cf450 2024-09-15T23:57:28.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe118806640 1 -- 172.21.15.112:0/2207150242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1140d2e90 msgr2=0x7fe1140cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:28.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe118806640 1 --2- 172.21.15.112:0/2207150242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1140d2e90 0x7fe1140cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe118806640 1 -- 172.21.15.112:0/2207150242 >> v1:172.21.15.112:6789/0 conn(0x7fe1140cf450 legacy=0x7fe1140d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe118806640 1 -- 172.21.15.112:0/2207150242 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1140b0f60 con 0x7fe114161a60 2024-09-15T23:57:28.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe10bfff640 1 --2- 172.21.15.112:0/2207150242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1140d2e90 0x7fe1140cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:57:28.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe118806640 1 --2- 172.21.15.112:0/2207150242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe114161a60 0x7fe1140d2950 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe1100097c0 tx=0x7fe11001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce85cbe02a03f314 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:28.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe10b7fe640 1 -- 172.21.15.112:0/2207150242 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1100b1070 con 0x7fe114161a60 2024-09-15T23:57:28.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe10b7fe640 1 -- 172.21.15.112:0/2207150242 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1100a8050 con 0x7fe114161a60 2024-09-15T23:57:28.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe10b7fe640 1 -- 172.21.15.112:0/2207150242 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1140d1930 con 0x7fe114161a60 2024-09-15T23:57:28.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe11aa6a640 1 -- 172.21.15.112:0/2207150242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe114161a60 msgr2=0x7fe1140d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe11aa6a640 1 --2- 172.21.15.112:0/2207150242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe114161a60 0x7fe1140d2950 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe1100097c0 tx=0x7fe11001c3e0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe11aa6a640 1 -- 172.21.15.112:0/2207150242 shutdown_connections 2024-09-15T23:57:28.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe11aa6a640 1 --2- 172.21.15.112:0/2207150242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1140d2e90 0x7fe1140cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe11aa6a640 1 --2- 172.21.15.112:0/2207150242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe114161a60 0x7fe1140d2950 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe11aa6a640 1 -- 172.21.15.112:0/2207150242 >> 172.21.15.112:0/2207150242 conn(0x7fe11408bf90 msgr2=0x7fe11409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:28.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe11aa6a640 1 -- 172.21.15.112:0/2207150242 shutdown_connections 2024-09-15T23:57:28.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.557+0000 7fe11aa6a640 1 -- 172.21.15.112:0/2207150242 wait complete. 2024-09-15T23:57:28.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe11aa6a640 1 Processor -- start 2024-09-15T23:57:28.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe11aa6a640 1 -- start start 2024-09-15T23:57:28.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe11aa6a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1140cf450 0x7fe1141514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe11aa6a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1140d2e90 0x7fe1140b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe11aa6a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe114161a60 0x7fe11415d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe11aa6a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe11416af20 con 0x7fe1140cf450 2024-09-15T23:57:28.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe11aa6a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe11406d190 con 0x7fe114161a60 2024-09-15T23:57:28.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe11aa6a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe11416b0a0 con 0x7fe1140d2e90 2024-09-15T23:57:28.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe118806640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1140cf450 0x7fe1141514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe118806640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1140cf450 0x7fe1141514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39364/0 (socket says 172.21.15.112:39364) 2024-09-15T23:57:28.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe118806640 1 -- 172.21.15.112:0/3590574820 learned_addr learned my addr 172.21.15.112:0/3590574820 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:28.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe119007640 1 --2- 172.21.15.112:0/3590574820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe114161a60 0x7fe11415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe10bfff640 1 --2- 172.21.15.112:0/3590574820 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1140d2e90 0x7fe1140b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe118806640 1 -- 172.21.15.112:0/3590574820 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1140d2e90 msgr2=0x7fe1140b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe118806640 1 --2- 172.21.15.112:0/3590574820 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1140d2e90 0x7fe1140b7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe118806640 1 -- 172.21.15.112:0/3590574820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe114161a60 msgr2=0x7fe11415d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe118806640 1 --2- 172.21.15.112:0/3590574820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe114161a60 0x7fe11415d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe118806640 1 -- 172.21.15.112:0/3590574820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1140b8550 con 0x7fe1140cf450 2024-09-15T23:57:28.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe118806640 1 --2- 172.21.15.112:0/3590574820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1140cf450 0x7fe1141514a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe1100097c0 tx=0x7fe11001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:28.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe1097fa640 1 -- 172.21.15.112:0/3590574820 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1100b1040 con 0x7fe1140cf450 2024-09-15T23:57:28.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe1097fa640 1 -- 172.21.15.112:0/3590574820 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1100bd070 con 0x7fe1140cf450 2024-09-15T23:57:28.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe11aa6a640 1 -- 172.21.15.112:0/3590574820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1140b8830 con 0x7fe1140cf450 2024-09-15T23:57:28.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe1097fa640 1 -- 172.21.15.112:0/3590574820 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1100b7420 con 0x7fe1140cf450 2024-09-15T23:57:28.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe11aa6a640 1 -- 172.21.15.112:0/3590574820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1140b8df0 con 0x7fe1140cf450 2024-09-15T23:57:28.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe11aa6a640 1 -- 172.21.15.112:0/3590574820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1140cef10 con 0x7fe1140cf450 2024-09-15T23:57:28.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.561+0000 7fe1097fa640 1 -- 172.21.15.112:0/3590574820 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1100b75c0 con 0x7fe1140cf450 2024-09-15T23:57:28.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.565+0000 7fe1097fa640 1 --2- 172.21.15.112:0/3590574820 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe1000678c0 0x7fe100069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.565+0000 7fe1097fa640 1 -- 172.21.15.112:0/3590574820 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fe1101201e0 con 0x7fe1140cf450 2024-09-15T23:57:28.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.565+0000 7fe10bfff640 1 --2- 172.21.15.112:0/3590574820 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe1000678c0 0x7fe100069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.565+0000 7fe10bfff640 1 --2- 172.21.15.112:0/3590574820 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe1000678c0 0x7fe100069d80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe11415ba90 tx=0x7fe104008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:28.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.569+0000 7fe1097fa640 1 -- 172.21.15.112:0/3590574820 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe110016090 con 0x7fe1140cf450 2024-09-15T23:57:28.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.733+0000 7fe11aa6a640 1 -- 172.21.15.112:0/3590574820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1140b4290 con 0x7fe1140cf450 2024-09-15T23:57:28.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.737+0000 7fe1097fa640 1 -- 172.21.15.112:0/3590574820 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16957 (secure 0 0 0) 0x7fe1100f0b90 con 0x7fe1140cf450 2024-09-15T23:57:28.737 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:28.737 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":75,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:56:56.964900+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:52.995591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:54.309259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:28.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.737+0000 7fe11aa6a640 1 -- 172.21.15.112:0/3590574820 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe1000678c0 msgr2=0x7fe100069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.737+0000 7fe11aa6a640 1 --2- 172.21.15.112:0/3590574820 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe1000678c0 0x7fe100069d80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe11415ba90 tx=0x7fe104008040 comp rx=0 tx=0).stop 2024-09-15T23:57:28.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.737+0000 7fe11aa6a640 1 -- 172.21.15.112:0/3590574820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1140cf450 msgr2=0x7fe1141514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.737+0000 7fe11aa6a640 1 --2- 172.21.15.112:0/3590574820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1140cf450 0x7fe1141514a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe1100097c0 tx=0x7fe11001ac20 comp rx=0 tx=0).stop 2024-09-15T23:57:28.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.737+0000 7fe11aa6a640 1 -- 172.21.15.112:0/3590574820 shutdown_connections 2024-09-15T23:57:28.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.737+0000 7fe11aa6a640 1 --2- 172.21.15.112:0/3590574820 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe1000678c0 0x7fe100069d80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.737+0000 7fe11aa6a640 1 --2- 172.21.15.112:0/3590574820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe114161a60 0x7fe11415d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.737+0000 7fe11aa6a640 1 --2- 172.21.15.112:0/3590574820 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1140d2e90 0x7fe1140b7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.737+0000 7fe11aa6a640 1 --2- 172.21.15.112:0/3590574820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1140cf450 0x7fe1141514a0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.737+0000 7fe11aa6a640 1 -- 172.21.15.112:0/3590574820 >> 172.21.15.112:0/3590574820 conn(0x7fe11408bf90 msgr2=0x7fe1140b47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:28.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.737+0000 7fe11aa6a640 1 -- 172.21.15.112:0/3590574820 shutdown_connections 2024-09-15T23:57:28.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.737+0000 7fe11aa6a640 1 -- 172.21.15.112:0/3590574820 wait complete. 2024-09-15T23:57:28.756 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:57:28.757 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:28.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c9d52b640 1 Processor -- start 2024-09-15T23:57:28.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c9d52b640 1 -- start start 2024-09-15T23:57:28.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c9d52b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9c98070020 0x7f9c9815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c9d52b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9c9815f1d0 0x7f9c980adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c9d52b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c980aede0 con 0x7f9c981520a0 2024-09-15T23:57:28.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c9d52b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9c98152480 con 0x7f9c9815f1d0 2024-09-15T23:57:28.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c9d52b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9c9815fa10 con 0x7f9c98070020 2024-09-15T23:57:28.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c977fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9c9815f1d0 0x7f9c980adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.878 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c977fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9c9815f1d0 0x7f9c980adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39368/0 (socket says 172.21.15.112:39368) 2024-09-15T23:57:28.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c977fe640 1 -- 172.21.15.112:0/3302734388 learned_addr learned my addr 172.21.15.112:0/3302734388 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:28.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c967fc640 1 --2- 172.21.15.112:0/3302734388 >> v2:172.21.15.169:3300/0 conn(0x7f9c98070020 0x7f9c9815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c977fe640 1 -- 172.21.15.112:0/3302734388 >> v2:172.21.15.169:3300/0 conn(0x7f9c98070020 msgr2=0x7f9c9815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:28.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c977fe640 1 --2- 172.21.15.112:0/3302734388 >> v2:172.21.15.169:3300/0 conn(0x7f9c98070020 0x7f9c9815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c977fe640 1 -- 172.21.15.112:0/3302734388 >> v1:172.21.15.112:6789/0 conn(0x7f9c981520a0 legacy=0x7f9c9806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c977fe640 1 -- 172.21.15.112:0/3302734388 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c98074250 con 0x7f9c9815f1d0 2024-09-15T23:57:28.879 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c95ffb640 1 -- 172.21.15.112:0/3302734388 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1854558517 0 0) 0x7f9c980aede0 con 0x7f9c981520a0 2024-09-15T23:57:28.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.877+0000 7f9c977fe640 1 --2- 172.21.15.112:0/3302734388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c9815f1d0 0x7f9c980adc80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9c9806e510 tx=0x7f9c8801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b30b9054ac5b6d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:28.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c95ffb640 1 -- 172.21.15.112:0/3302734388 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c880a5880 con 0x7f9c9815f1d0 2024-09-15T23:57:28.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c95ffb640 1 -- 172.21.15.112:0/3302734388 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c880a5a20 con 0x7f9c9815f1d0 2024-09-15T23:57:28.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c95ffb640 1 -- 172.21.15.112:0/3302734388 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c880a5df0 con 0x7f9c9815f1d0 2024-09-15T23:57:28.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 -- 172.21.15.112:0/3302734388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c9815f1d0 msgr2=0x7f9c980adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 --2- 172.21.15.112:0/3302734388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c9815f1d0 0x7f9c980adc80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9c9806e510 tx=0x7f9c8801c9c0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 -- 172.21.15.112:0/3302734388 shutdown_connections 2024-09-15T23:57:28.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 --2- 172.21.15.112:0/3302734388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c9815f1d0 0x7f9c980adc80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 --2- 172.21.15.112:0/3302734388 >> v2:172.21.15.169:3300/0 conn(0x7f9c98070020 0x7f9c9815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 -- 172.21.15.112:0/3302734388 >> 172.21.15.112:0/3302734388 conn(0x7f9c980b1f90 msgr2=0x7f9c980b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:28.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 -- 172.21.15.112:0/3302734388 shutdown_connections 2024-09-15T23:57:28.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 -- 172.21.15.112:0/3302734388 wait complete. 2024-09-15T23:57:28.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 Processor -- start 2024-09-15T23:57:28.882 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 -- start start 2024-09-15T23:57:28.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c98070020 0x7f9c98099ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c981520a0 0x7f9c9815a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c9815f1d0 0x7f9c9806ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.884 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9815f680 con 0x7f9c98070020 2024-09-15T23:57:28.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9c98073d30 con 0x7f9c9815f1d0 2024-09-15T23:57:28.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9c98167f10 con 0x7f9c981520a0 2024-09-15T23:57:28.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c96ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c98070020 0x7f9c98099ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c96ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c98070020 0x7f9c98099ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39376/0 (socket says 172.21.15.112:39376) 2024-09-15T23:57:28.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c96ffd640 1 -- 172.21.15.112:0/1842852871 learned_addr learned my addr 172.21.15.112:0/1842852871 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:28.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c977fe640 1 --2- 172.21.15.112:0/1842852871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c9815f1d0 0x7f9c9806ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c96ffd640 1 -- 172.21.15.112:0/1842852871 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c981520a0 msgr2=0x7f9c9815a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c96ffd640 1 --2- 172.21.15.112:0/1842852871 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c981520a0 0x7f9c9815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c96ffd640 1 -- 172.21.15.112:0/1842852871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c9815f1d0 msgr2=0x7f9c9806ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c96ffd640 1 --2- 172.21.15.112:0/1842852871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c9815f1d0 0x7f9c9806ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c96ffd640 1 -- 172.21.15.112:0/1842852871 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c98150a40 con 0x7f9c98070020 2024-09-15T23:57:28.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c977fe640 1 --2- 172.21.15.112:0/1842852871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c9815f1d0 0x7f9c9806ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:28.885 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c96ffd640 1 --2- 172.21.15.112:0/1842852871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c98070020 0x7f9c98099ad0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000c4d0 tx=0x7f9c9000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:28.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c8f7fe640 1 -- 172.21.15.112:0/1842852871 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90017070 con 0x7f9c98070020 2024-09-15T23:57:28.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c8f7fe640 1 -- 172.21.15.112:0/1842852871 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c90005480 con 0x7f9c98070020 2024-09-15T23:57:28.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 -- 172.21.15.112:0/1842852871 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c98153870 con 0x7f9c98070020 2024-09-15T23:57:28.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c8f7fe640 1 -- 172.21.15.112:0/1842852871 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90003840 con 0x7f9c98070020 2024-09-15T23:57:28.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.881+0000 7f9c9d52b640 1 -- 172.21.15.112:0/1842852871 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c98153e30 con 0x7f9c98070020 2024-09-15T23:57:28.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.885+0000 7f9c9d52b640 1 -- 172.21.15.112:0/1842852871 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c9815ec90 con 0x7f9c98070020 2024-09-15T23:57:28.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.885+0000 7f9c8f7fe640 1 -- 172.21.15.112:0/1842852871 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9c9001a070 con 0x7f9c98070020 2024-09-15T23:57:28.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.885+0000 7f9c8f7fe640 1 --2- 172.21.15.112:0/1842852871 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9c780678c0 0x7f9c78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.885+0000 7f9c8f7fe640 1 -- 172.21.15.112:0/1842852871 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f9c90085190 con 0x7f9c98070020 2024-09-15T23:57:28.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.885+0000 7f9c967fc640 1 --2- 172.21.15.112:0/1842852871 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9c780678c0 0x7f9c78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.885+0000 7f9c967fc640 1 --2- 172.21.15.112:0/1842852871 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9c780678c0 0x7f9c78069d80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9c9806f810 tx=0x7f9c80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:28.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:28.889+0000 7f9c8f7fe640 1 -- 172.21.15.112:0/1842852871 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9c90055c90 con 0x7f9c98070020 2024-09-15T23:57:29.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.085+0000 7f9c9d52b640 1 -- 172.21.15.112:0/1842852871 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c9806e540 con 0x7f9c98070020 2024-09-15T23:57:29.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.089+0000 7f9c8f7fe640 1 -- 172.21.15.112:0/1842852871 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5231 (secure 0 0 0) 0x7f9c90055590 con 0x7f9c98070020 2024-09-15T23:57:29.089 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:29.089 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"btime":"2024-09-15T23:56:58:369858+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2072637952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2072637952},{"type":"v1","addr":"172.21.15.169:6833","nonce":2072637952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/33750051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":33750051},{"type":"v1","addr":"172.21.15.169:6835","nonce":33750051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6018,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/4092393174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":4092393174},{"type":"v1","addr":"172.21.15.112:6837","nonce":4092393174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:55.316845+0000","modified":"2024-09-15T23:56:57.719503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6021},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6021":{"gid":6021,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1581911691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1581911691},{"type":"v1","addr":"172.21.15.112:6836","nonce":1581911691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6021,"qdb_cluster":[6021]},"id":5}]} 2024-09-15T23:57:29.089 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 37 2024-09-15T23:57:29.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.089+0000 7f9c9d52b640 1 -- 172.21.15.112:0/1842852871 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9c780678c0 msgr2=0x7f9c78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.089+0000 7f9c9d52b640 1 --2- 172.21.15.112:0/1842852871 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9c780678c0 0x7f9c78069d80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9c9806f810 tx=0x7f9c80008040 comp rx=0 tx=0).stop 2024-09-15T23:57:29.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.089+0000 7f9c9d52b640 1 -- 172.21.15.112:0/1842852871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c98070020 msgr2=0x7f9c98099ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.089+0000 7f9c9d52b640 1 --2- 172.21.15.112:0/1842852871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c98070020 0x7f9c98099ad0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000c4d0 tx=0x7f9c9000c990 comp rx=0 tx=0).stop 2024-09-15T23:57:29.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.089+0000 7f9c9d52b640 1 -- 172.21.15.112:0/1842852871 shutdown_connections 2024-09-15T23:57:29.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.089+0000 7f9c9d52b640 1 --2- 172.21.15.112:0/1842852871 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9c780678c0 0x7f9c78069d80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.089+0000 7f9c9d52b640 1 --2- 172.21.15.112:0/1842852871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c9815f1d0 0x7f9c9806ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.089+0000 7f9c9d52b640 1 --2- 172.21.15.112:0/1842852871 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c981520a0 0x7f9c9815a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.089+0000 7f9c9d52b640 1 --2- 172.21.15.112:0/1842852871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9c98070020 0x7f9c98099ad0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.089+0000 7f9c9d52b640 1 -- 172.21.15.112:0/1842852871 >> 172.21.15.112:0/1842852871 conn(0x7f9c980b1f90 msgr2=0x7f9c980b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:29.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.089+0000 7f9c9d52b640 1 -- 172.21.15.112:0/1842852871 shutdown_connections 2024-09-15T23:57:29.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.089+0000 7f9c9d52b640 1 -- 172.21.15.112:0/1842852871 wait complete. 2024-09-15T23:57:29.108 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:29.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.221+0000 7f17f7403640 1 Processor -- start 2024-09-15T23:57:29.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.221+0000 7f17f7403640 1 -- start start 2024-09-15T23:57:29.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17f7403640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f17f01587a0 0x7f17f00b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17f7403640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f17f00b37d0 0x7f17f006df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17f7403640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f006ec60 con 0x7f17f006e4b0 2024-09-15T23:57:29.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17f7403640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f17f00b3c40 con 0x7f17f01587a0 2024-09-15T23:57:29.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17f7403640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f17f006f870 con 0x7f17f00b37d0 2024-09-15T23:57:29.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17f519f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f17f01587a0 0x7f17f00b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17f519f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f17f01587a0 0x7f17f00b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39382/0 (socket says 172.21.15.112:39382) 2024-09-15T23:57:29.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17f519f640 1 -- 172.21.15.112:0/2941094253 learned_addr learned my addr 172.21.15.112:0/2941094253 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:29.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17f499e640 1 --2- 172.21.15.112:0/2941094253 >> v2:172.21.15.169:3300/0 conn(0x7f17f00b37d0 0x7f17f006df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17f519f640 1 -- 172.21.15.112:0/2941094253 >> v2:172.21.15.169:3300/0 conn(0x7f17f00b37d0 msgr2=0x7f17f006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:29.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17f519f640 1 --2- 172.21.15.112:0/2941094253 >> v2:172.21.15.169:3300/0 conn(0x7f17f00b37d0 0x7f17f006df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17f519f640 1 -- 172.21.15.112:0/2941094253 >> v1:172.21.15.169:6789/0 conn(0x7f17f006e4b0 legacy=0x7f17f0161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:29.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17f519f640 1 -- 172.21.15.112:0/2941094253 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f006ef40 con 0x7f17f01587a0 2024-09-15T23:57:29.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17f519f640 1 --2- 172.21.15.112:0/2941094253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01587a0 0x7f17f00b3290 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f17f0161d90 tx=0x7f17ec01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc73a978292c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:29.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17e7fff640 1 -- 172.21.15.112:0/2941094253 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec0b1070 con 0x7f17f01587a0 2024-09-15T23:57:29.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17e7fff640 1 -- 172.21.15.112:0/2941094253 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec0ac630 con 0x7f17f01587a0 2024-09-15T23:57:29.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.225+0000 7f17e7fff640 1 -- 172.21.15.112:0/2941094253 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec0a8050 con 0x7f17f01587a0 2024-09-15T23:57:29.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 -- 172.21.15.112:0/2941094253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01587a0 msgr2=0x7f17f00b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 --2- 172.21.15.112:0/2941094253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01587a0 0x7f17f00b3290 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f17f0161d90 tx=0x7f17ec01c4b0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 -- 172.21.15.112:0/2941094253 shutdown_connections 2024-09-15T23:57:29.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 --2- 172.21.15.112:0/2941094253 >> v2:172.21.15.169:3300/0 conn(0x7f17f00b37d0 0x7f17f006df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 --2- 172.21.15.112:0/2941094253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f01587a0 0x7f17f00b3290 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 -- 172.21.15.112:0/2941094253 >> 172.21.15.112:0/2941094253 conn(0x7f17f00b1f90 msgr2=0x7f17f00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:29.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 -- 172.21.15.112:0/2941094253 shutdown_connections 2024-09-15T23:57:29.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 -- 172.21.15.112:0/2941094253 wait complete. 2024-09-15T23:57:29.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 Processor -- start 2024-09-15T23:57:29.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 -- start start 2024-09-15T23:57:29.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f006e4b0 0x7f17f0154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17f00b37d0 0x7f17f00ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17f01587a0 0x7f17f01f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f17f0158b80 con 0x7f17f006e4b0 2024-09-15T23:57:29.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f17f0073170 con 0x7f17f00b37d0 2024-09-15T23:57:29.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f7403640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f17f01f70f0 con 0x7f17f01587a0 2024-09-15T23:57:29.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f519f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f006e4b0 0x7f17f0154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f519f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f006e4b0 0x7f17f0154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39394/0 (socket says 172.21.15.112:39394) 2024-09-15T23:57:29.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f519f640 1 -- 172.21.15.112:0/2957535109 learned_addr learned my addr 172.21.15.112:0/2957535109 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:29.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f499e640 1 --2- 172.21.15.112:0/2957535109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17f00b37d0 0x7f17f00ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f519f640 1 -- 172.21.15.112:0/2957535109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17f01587a0 msgr2=0x7f17f01f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f519f640 1 --2- 172.21.15.112:0/2957535109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17f01587a0 0x7f17f01f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f519f640 1 -- 172.21.15.112:0/2957535109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17f00b37d0 msgr2=0x7f17f00ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f519f640 1 --2- 172.21.15.112:0/2957535109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17f00b37d0 0x7f17f00ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f519f640 1 -- 172.21.15.112:0/2957535109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f009bda0 con 0x7f17f006e4b0 2024-09-15T23:57:29.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.229+0000 7f17f499e640 1 --2- 172.21.15.112:0/2957535109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17f00b37d0 0x7f17f00ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:29.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.233+0000 7f17f519f640 1 --2- 172.21.15.112:0/2957535109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f006e4b0 0x7f17f0154800 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0af040 tx=0x7f17ec019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:29.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.233+0000 7f17e5ffb640 1 -- 172.21.15.112:0/2957535109 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec0b1040 con 0x7f17f006e4b0 2024-09-15T23:57:29.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.233+0000 7f17e5ffb640 1 -- 172.21.15.112:0/2957535109 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec0bc070 con 0x7f17f006e4b0 2024-09-15T23:57:29.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.233+0000 7f17f7403640 1 -- 172.21.15.112:0/2957535109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f009c080 con 0x7f17f006e4b0 2024-09-15T23:57:29.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.233+0000 7f17e5ffb640 1 -- 172.21.15.112:0/2957535109 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec0a8040 con 0x7f17f006e4b0 2024-09-15T23:57:29.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.233+0000 7f17f7403640 1 -- 172.21.15.112:0/2957535109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f0147980 con 0x7f17f006e4b0 2024-09-15T23:57:29.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.233+0000 7f17f7403640 1 -- 172.21.15.112:0/2957535109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f015f750 con 0x7f17f006e4b0 2024-09-15T23:57:29.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.233+0000 7f17e5ffb640 1 -- 172.21.15.112:0/2957535109 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f17ec0b5650 con 0x7f17f006e4b0 2024-09-15T23:57:29.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.233+0000 7f17e5ffb640 1 --2- 172.21.15.112:0/2957535109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f17d40678c0 0x7f17d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.233+0000 7f17e5ffb640 1 -- 172.21.15.112:0/2957535109 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f17ec11fab0 con 0x7f17f006e4b0 2024-09-15T23:57:29.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.233+0000 7f17f499e640 1 --2- 172.21.15.112:0/2957535109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f17d40678c0 0x7f17d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.233+0000 7f17f499e640 1 --2- 172.21.15.112:0/2957535109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f17d40678c0 0x7f17d4069d80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f17f00af900 tx=0x7f17e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:29.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.237+0000 7f17e5ffb640 1 -- 172.21.15.112:0/2957535109 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f17ec0160d0 con 0x7f17f006e4b0 2024-09-15T23:57:29.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.433+0000 7f17f7403640 1 -- 172.21.15.112:0/2957535109 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17f0070080 con 0x7f17f006e4b0 2024-09-15T23:57:29.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.437+0000 7f17e5ffb640 1 -- 172.21.15.112:0/2957535109 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5231 (secure 0 0 0) 0x7f17ec0f0460 con 0x7f17f006e4b0 2024-09-15T23:57:29.437 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:29.438 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":37,"btime":"2024-09-15T23:56:58:369858+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2072637952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2072637952},{"type":"v1","addr":"172.21.15.169:6833","nonce":2072637952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/33750051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":33750051},{"type":"v1","addr":"172.21.15.169:6835","nonce":33750051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6018,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/4092393174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":4092393174},{"type":"v1","addr":"172.21.15.112:6837","nonce":4092393174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:55.316845+0000","modified":"2024-09-15T23:56:57.719503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6021},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6021":{"gid":6021,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/1581911691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1581911691},{"type":"v1","addr":"172.21.15.112:6836","nonce":1581911691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6021,"qdb_cluster":[6021]},"id":5}]} 2024-09-15T23:57:29.438 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 37 2024-09-15T23:57:29.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.437+0000 7f17f7403640 1 -- 172.21.15.112:0/2957535109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f17d40678c0 msgr2=0x7f17d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.437+0000 7f17f7403640 1 --2- 172.21.15.112:0/2957535109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f17d40678c0 0x7f17d4069d80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f17f00af900 tx=0x7f17e0008040 comp rx=0 tx=0).stop 2024-09-15T23:57:29.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.437+0000 7f17f7403640 1 -- 172.21.15.112:0/2957535109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f006e4b0 msgr2=0x7f17f0154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.437+0000 7f17f7403640 1 --2- 172.21.15.112:0/2957535109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f006e4b0 0x7f17f0154800 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0af040 tx=0x7f17ec019250 comp rx=0 tx=0).stop 2024-09-15T23:57:29.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.437+0000 7f17f7403640 1 -- 172.21.15.112:0/2957535109 shutdown_connections 2024-09-15T23:57:29.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.437+0000 7f17f7403640 1 --2- 172.21.15.112:0/2957535109 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f17d40678c0 0x7f17d4069d80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.437+0000 7f17f7403640 1 --2- 172.21.15.112:0/2957535109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17f01587a0 0x7f17f01f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.437+0000 7f17f7403640 1 --2- 172.21.15.112:0/2957535109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17f00b37d0 0x7f17f00ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.437+0000 7f17f7403640 1 --2- 172.21.15.112:0/2957535109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17f006e4b0 0x7f17f0154800 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.437+0000 7f17f7403640 1 -- 172.21.15.112:0/2957535109 >> 172.21.15.112:0/2957535109 conn(0x7f17f00b1f90 msgr2=0x7f17f00ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:29.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.437+0000 7f17f7403640 1 -- 172.21.15.112:0/2957535109 shutdown_connections 2024-09-15T23:57:29.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.437+0000 7f17f7403640 1 -- 172.21.15.112:0/2957535109 wait complete. 2024-09-15T23:57:29.456 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:29.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.569+0000 7fb40a67f640 1 Processor -- start 2024-09-15T23:57:29.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.569+0000 7fb40a67f640 1 -- start start 2024-09-15T23:57:29.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb40a67f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb40415bec0 0x7fb4040ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb40a67f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb40415c2a0 0x7fb4040aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb40a67f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4040b3290 con 0x7fb4040af2a0 2024-09-15T23:57:29.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb40a67f640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb4040b3570 con 0x7fb40415c2a0 2024-09-15T23:57:29.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb40a67f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb4040b3850 con 0x7fb40415bec0 2024-09-15T23:57:29.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb4037fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb40415c2a0 0x7fb4040aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb4037fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb40415c2a0 0x7fb4040aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39408/0 (socket says 172.21.15.112:39408) 2024-09-15T23:57:29.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb4037fe640 1 -- 172.21.15.112:0/674615888 learned_addr learned my addr 172.21.15.112:0/674615888 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:29.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb403fff640 1 --2- 172.21.15.112:0/674615888 >> v2:172.21.15.169:3300/0 conn(0x7fb40415bec0 0x7fb4040ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb4037fe640 1 -- 172.21.15.112:0/674615888 >> v2:172.21.15.169:3300/0 conn(0x7fb40415bec0 msgr2=0x7fb4040ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:29.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb4037fe640 1 --2- 172.21.15.112:0/674615888 >> v2:172.21.15.169:3300/0 conn(0x7fb40415bec0 0x7fb4040ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb4037fe640 1 -- 172.21.15.112:0/674615888 >> v1:172.21.15.169:6789/0 conn(0x7fb4040af2a0 legacy=0x7fb40415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:29.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb4037fe640 1 -- 172.21.15.112:0/674615888 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4040b3b30 con 0x7fb40415c2a0 2024-09-15T23:57:29.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb4037fe640 1 --2- 172.21.15.112:0/674615888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40415c2a0 0x7fb4040aed60 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb404071710 tx=0x7fb3f401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a4c655c1207f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:29.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb402ffd640 1 -- 172.21.15.112:0/674615888 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40aa610 con 0x7fb40415c2a0 2024-09-15T23:57:29.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb402ffd640 1 -- 172.21.15.112:0/674615888 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f40af070 con 0x7fb40415c2a0 2024-09-15T23:57:29.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb402ffd640 1 -- 172.21.15.112:0/674615888 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40aa9d0 con 0x7fb40415c2a0 2024-09-15T23:57:29.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb40a67f640 1 -- 172.21.15.112:0/674615888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40415c2a0 msgr2=0x7fb4040aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb40a67f640 1 --2- 172.21.15.112:0/674615888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40415c2a0 0x7fb4040aed60 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb404071710 tx=0x7fb3f401c4b0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb40a67f640 1 -- 172.21.15.112:0/674615888 shutdown_connections 2024-09-15T23:57:29.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb40a67f640 1 --2- 172.21.15.112:0/674615888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40415c2a0 0x7fb4040aed60 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb40a67f640 1 --2- 172.21.15.112:0/674615888 >> v2:172.21.15.169:3300/0 conn(0x7fb40415bec0 0x7fb4040ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb40a67f640 1 -- 172.21.15.112:0/674615888 >> 172.21.15.112:0/674615888 conn(0x7fb4040b1f90 msgr2=0x7fb4040b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:29.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb40a67f640 1 -- 172.21.15.112:0/674615888 shutdown_connections 2024-09-15T23:57:29.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.573+0000 7fb40a67f640 1 -- 172.21.15.112:0/674615888 wait complete. 2024-09-15T23:57:29.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb40a67f640 1 Processor -- start 2024-09-15T23:57:29.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb40a67f640 1 -- start start 2024-09-15T23:57:29.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb40a67f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4040af2a0 0x7fb40409a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb40a67f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb40415bec0 0x7fb40414fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb40a67f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40415c2a0 0x7fb4041506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb40a67f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb4040ad740 con 0x7fb40415c2a0 2024-09-15T23:57:29.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb40a67f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb4040af710 con 0x7fb4040af2a0 2024-09-15T23:57:29.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb40a67f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb404169000 con 0x7fb40415bec0 2024-09-15T23:57:29.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb408c1c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40415c2a0 0x7fb4041506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb408c1c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40415c2a0 0x7fb4041506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39422/0 (socket says 172.21.15.112:39422) 2024-09-15T23:57:29.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb408c1c640 1 -- 172.21.15.112:0/363380497 learned_addr learned my addr 172.21.15.112:0/363380497 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:29.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb4037fe640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb40415bec0 0x7fb40414fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb403fff640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4040af2a0 0x7fb40409a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb408c1c640 1 -- 172.21.15.112:0/363380497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb40415bec0 msgr2=0x7fb40414fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb408c1c640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb40415bec0 0x7fb40414fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb408c1c640 1 -- 172.21.15.112:0/363380497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4040af2a0 msgr2=0x7fb40409a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb408c1c640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4040af2a0 0x7fb40409a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb408c1c640 1 -- 172.21.15.112:0/363380497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40415e230 con 0x7fb40415c2a0 2024-09-15T23:57:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb403fff640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4040af2a0 0x7fb40409a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb408c1c640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40415c2a0 0x7fb4041506c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00c780 tx=0x7fb3fc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb400ff9640 1 -- 172.21.15.112:0/363380497 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc004b70 con 0x7fb40415c2a0 2024-09-15T23:57:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb400ff9640 1 -- 172.21.15.112:0/363380497 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3fc004d10 con 0x7fb40415c2a0 2024-09-15T23:57:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb40a67f640 1 -- 172.21.15.112:0/363380497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40409a8f0 con 0x7fb40415c2a0 2024-09-15T23:57:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb400ff9640 1 -- 172.21.15.112:0/363380497 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc00aa90 con 0x7fb40415c2a0 2024-09-15T23:57:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb40a67f640 1 -- 172.21.15.112:0/363380497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb40415d750 con 0x7fb40415c2a0 2024-09-15T23:57:29.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb40a67f640 1 -- 172.21.15.112:0/363380497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4040ad200 con 0x7fb40415c2a0 2024-09-15T23:57:29.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.577+0000 7fb400ff9640 1 -- 172.21.15.112:0/363380497 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3fc00ac30 con 0x7fb40415c2a0 2024-09-15T23:57:29.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.581+0000 7fb400ff9640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3f00678c0 0x7fb3f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.581+0000 7fb403fff640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3f00678c0 0x7fb3f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.581+0000 7fb400ff9640 1 -- 172.21.15.112:0/363380497 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fb3fc0860e0 con 0x7fb40415c2a0 2024-09-15T23:57:29.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.581+0000 7fb403fff640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3f00678c0 0x7fb3f0069d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009840 tx=0x7fb3f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:29.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.585+0000 7fb400ff9640 1 -- 172.21.15.112:0/363380497 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb3fc020070 con 0x7fb40415c2a0 2024-09-15T23:57:29.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.745+0000 7fb40a67f640 1 -- 172.21.15.112:0/363380497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb40406fcd0 con 0x7fb40415c2a0 2024-09-15T23:57:29.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.749+0000 7fb400ff9640 1 -- 172.21.15.112:0/363380497 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16957 (secure 0 0 0) 0x7fb3fc056a90 con 0x7fb40415c2a0 2024-09-15T23:57:29.749 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:29.749 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":75,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:56:56.964900+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:52.995591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:54.309259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:29.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.749+0000 7fb40a67f640 1 -- 172.21.15.112:0/363380497 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3f00678c0 msgr2=0x7fb3f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.749+0000 7fb40a67f640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3f00678c0 0x7fb3f0069d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009840 tx=0x7fb3f8008040 comp rx=0 tx=0).stop 2024-09-15T23:57:29.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.749+0000 7fb40a67f640 1 -- 172.21.15.112:0/363380497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40415c2a0 msgr2=0x7fb4041506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.749+0000 7fb40a67f640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40415c2a0 0x7fb4041506c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00c780 tx=0x7fb3fc00cc40 comp rx=0 tx=0).stop 2024-09-15T23:57:29.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.749+0000 7fb40a67f640 1 -- 172.21.15.112:0/363380497 shutdown_connections 2024-09-15T23:57:29.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.749+0000 7fb40a67f640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3f00678c0 0x7fb3f0069d80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.749+0000 7fb40a67f640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb40415c2a0 0x7fb4041506c0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.749+0000 7fb40a67f640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb40415bec0 0x7fb40414fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.749+0000 7fb40a67f640 1 --2- 172.21.15.112:0/363380497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4040af2a0 0x7fb40409a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.749+0000 7fb40a67f640 1 -- 172.21.15.112:0/363380497 >> 172.21.15.112:0/363380497 conn(0x7fb4040b1f90 msgr2=0x7fb404075030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:29.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.749+0000 7fb40a67f640 1 -- 172.21.15.112:0/363380497 shutdown_connections 2024-09-15T23:57:29.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.749+0000 7fb40a67f640 1 -- 172.21.15.112:0/363380497 wait complete. 2024-09-15T23:57:29.768 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:57:29.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb54bcb8640 1 Processor -- start 2024-09-15T23:57:29.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb54bcb8640 1 -- start start 2024-09-15T23:57:29.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb54bcb8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb544070020 0x7fb54415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb54bcb8640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5440aede0 con 0x7fb54415f1d0 2024-09-15T23:57:29.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb54bcb8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb54415fa10 con 0x7fb5441520a0 2024-09-15T23:57:29.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb54bcb8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb544152480 con 0x7fb544070020 2024-09-15T23:57:29.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb54a255640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb54415f1d0 0x7fb5440adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43010/0 (socket says 172.21.15.112:43010) 2024-09-15T23:57:29.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb54a255640 1 -- 172.21.15.112:0/2369205996 learned_addr learned my addr 172.21.15.112:0/2369205996 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:29.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb549253640 1 --2- 172.21.15.112:0/2369205996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb544070020 0x7fb54415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 -- 172.21.15.112:0/2369205996 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150569701 0 0) 0x7fb5440aede0 con 0x7fb54415f1d0 2024-09-15T23:57:29.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 -- 172.21.15.112:0/2369205996 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb530003530 con 0x7fb54415f1d0 2024-09-15T23:57:29.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 -- 172.21.15.112:0/2369205996 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 205053154 0 0) 0x7fb530003530 con 0x7fb54415f1d0 2024-09-15T23:57:29.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 -- 172.21.15.112:0/2369205996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb544070020 msgr2=0x7fb54415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:29.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 --2- 172.21.15.112:0/2369205996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb544070020 0x7fb54415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 -- 172.21.15.112:0/2369205996 >> v1:172.21.15.169:6789/0 conn(0x7fb5441520a0 legacy=0x7fb54406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 -- 172.21.15.112:0/2369205996 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb544074250 con 0x7fb54415f1d0 2024-09-15T23:57:29.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 -- 172.21.15.112:0/2369205996 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fb53c001a00 con 0x7fb54415f1d0 2024-09-15T23:57:29.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 -- 172.21.15.112:0/2369205996 >> v1:172.21.15.112:6789/0 conn(0x7fb54415f1d0 legacy=0x7fb5440adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 --2- 172.21.15.112:0/2369205996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5300039f0 0x7fb530003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 --2- 172.21.15.112:0/2369205996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb530004810 0x7fb530004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 --2- 172.21.15.112:0/2369205996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb544070020 0x7fb5300051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 -- 172.21.15.112:0/2369205996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb53000ba80 con 0x7fb530004810 2024-09-15T23:57:29.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 -- 172.21.15.112:0/2369205996 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb53000bc30 con 0x7fb5300039f0 2024-09-15T23:57:29.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb548a52640 1 -- 172.21.15.112:0/2369205996 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb53000be30 con 0x7fb544070020 2024-09-15T23:57:29.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.889+0000 7fb549253640 1 --2- 172.21.15.112:0/2369205996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb530004810 0x7fb530004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb549a54640 1 --2- 172.21.15.112:0/2369205996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5300039f0 0x7fb530003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb549253640 1 -- 172.21.15.112:0/2369205996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb544070020 msgr2=0x7fb5300051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:29.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb549253640 1 --2- 172.21.15.112:0/2369205996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb544070020 0x7fb5300051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb549253640 1 -- 172.21.15.112:0/2369205996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5300039f0 msgr2=0x7fb530003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:29.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb549253640 1 --2- 172.21.15.112:0/2369205996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5300039f0 0x7fb530003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb549253640 1 -- 172.21.15.112:0/2369205996 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb530003530 con 0x7fb530004810 2024-09-15T23:57:29.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb549253640 1 --2- 172.21.15.112:0/2369205996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb530004810 0x7fb530004c90 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb54406e510 tx=0x7fb53401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e46fbca3366d2e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:29.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb548a52640 1 -- 172.21.15.112:0/2369205996 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5340b2070 con 0x7fb530004810 2024-09-15T23:57:29.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb548a52640 1 -- 172.21.15.112:0/2369205996 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5340a5600 con 0x7fb530004810 2024-09-15T23:57:29.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb548a52640 1 -- 172.21.15.112:0/2369205996 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb534009690 con 0x7fb530004810 2024-09-15T23:57:29.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb54bcb8640 1 -- 172.21.15.112:0/2369205996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb530004810 msgr2=0x7fb530004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb54bcb8640 1 --2- 172.21.15.112:0/2369205996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb530004810 0x7fb530004c90 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb54406e510 tx=0x7fb53401ca10 comp rx=0 tx=0).stop 2024-09-15T23:57:29.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb54a255640 1 -- 172.21.15.112:0/2369205996 reap_dead start 2024-09-15T23:57:29.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb54bcb8640 1 -- 172.21.15.112:0/2369205996 shutdown_connections 2024-09-15T23:57:29.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb54bcb8640 1 -- 172.21.15.112:0/2369205996 >> 172.21.15.112:0/2369205996 conn(0x7fb5440b1f90 msgr2=0x7fb5440b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:29.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb54bcb8640 1 -- 172.21.15.112:0/2369205996 shutdown_connections 2024-09-15T23:57:29.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.893+0000 7fb54bcb8640 1 -- 172.21.15.112:0/2369205996 wait complete. 2024-09-15T23:57:29.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb54bcb8640 1 Processor -- start 2024-09-15T23:57:29.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb54bcb8640 1 -- start start 2024-09-15T23:57:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb54bcb8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb530004810 0x7fb5441e4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb54bcb8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5440cccb0 0x7fb5440cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb54bcb8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5440cf970 0x7fb54415d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb54bcb8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb544073a50 con 0x7fb530004810 2024-09-15T23:57:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb54bcb8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb544073770 con 0x7fb5440cccb0 2024-09-15T23:57:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb54bcb8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb544073d30 con 0x7fb5440cf970 2024-09-15T23:57:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb549a54640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb530004810 0x7fb5441e4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb549a54640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb530004810 0x7fb5441e4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39442/0 (socket says 172.21.15.112:39442) 2024-09-15T23:57:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb549a54640 1 -- 172.21.15.112:0/3594341101 learned_addr learned my addr 172.21.15.112:0/3594341101 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb549253640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5440cccb0 0x7fb5440cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb54a255640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5440cf970 0x7fb54415d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb549a54640 1 -- 172.21.15.112:0/3594341101 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5440cf970 msgr2=0x7fb54415d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb549a54640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5440cf970 0x7fb54415d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb549a54640 1 -- 172.21.15.112:0/3594341101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5440cccb0 msgr2=0x7fb5440cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb549a54640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5440cccb0 0x7fb5440cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb549a54640 1 -- 172.21.15.112:0/3594341101 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5441e52a0 con 0x7fb530004810 2024-09-15T23:57:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb54a255640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5440cf970 0x7fb54415d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb549a54640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb530004810 0x7fb5441e4ba0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb54000d770 tx=0x7fb54000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb53a7fc640 1 -- 172.21.15.112:0/3594341101 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540005270 con 0x7fb530004810 2024-09-15T23:57:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb53a7fc640 1 -- 172.21.15.112:0/3594341101 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb540017070 con 0x7fb530004810 2024-09-15T23:57:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb54bcb8640 1 -- 172.21.15.112:0/3594341101 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5441e5580 con 0x7fb530004810 2024-09-15T23:57:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb53a7fc640 1 -- 172.21.15.112:0/3594341101 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54000b6b0 con 0x7fb530004810 2024-09-15T23:57:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb54bcb8640 1 -- 172.21.15.112:0/3594341101 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5441e5b40 con 0x7fb530004810 2024-09-15T23:57:29.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb54bcb8640 1 -- 172.21.15.112:0/3594341101 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb54415f680 con 0x7fb530004810 2024-09-15T23:57:29.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb53a7fc640 1 -- 172.21.15.112:0/3594341101 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb54000b850 con 0x7fb530004810 2024-09-15T23:57:29.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb53a7fc640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb5280678c0 0x7fb528069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb549253640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb5280678c0 0x7fb528069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.897+0000 7fb53a7fc640 1 -- 172.21.15.112:0/3594341101 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fb540085c70 con 0x7fb530004810 2024-09-15T23:57:29.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.901+0000 7fb549253640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb5280678c0 0x7fb528069d80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb5340af000 tx=0x7fb5340046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:29.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:29.905+0000 7fb53a7fc640 1 -- 172.21.15.112:0/3594341101 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb540019310 con 0x7fb530004810 2024-09-15T23:57:30.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.101+0000 7fb54bcb8640 1 -- 172.21.15.112:0/3594341101 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb54406e540 con 0x7fb530004810 2024-09-15T23:57:30.101 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-15T23:57:30.101+0000 7fae14e39640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:57:30.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.101+0000 7fb53a7fc640 1 -- 172.21.15.112:0/3594341101 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) ==== 161+0+0 (secure 0 0 0) 0x7fb5400566b0 con 0x7fb530004810 2024-09-15T23:57:30.104 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:57:30.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.105+0000 7fb54bcb8640 1 -- 172.21.15.112:0/3594341101 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb5280678c0 msgr2=0x7fb528069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:30.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.105+0000 7fb54bcb8640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb5280678c0 0x7fb528069d80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb5340af000 tx=0x7fb5340046d0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.105+0000 7fb54bcb8640 1 -- 172.21.15.112:0/3594341101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb530004810 msgr2=0x7fb5441e4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:30.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.105+0000 7fb54bcb8640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb530004810 0x7fb5441e4ba0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb54000d770 tx=0x7fb54000dc30 comp rx=0 tx=0).stop 2024-09-15T23:57:30.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.105+0000 7fb54bcb8640 1 -- 172.21.15.112:0/3594341101 shutdown_connections 2024-09-15T23:57:30.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.105+0000 7fb54bcb8640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb5280678c0 0x7fb528069d80 secure :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb5340af000 tx=0x7fb5340046d0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.105+0000 7fb54bcb8640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5440cf970 0x7fb54415d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.105+0000 7fb54bcb8640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5440cccb0 0x7fb5440cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.105+0000 7fb54bcb8640 1 --2- 172.21.15.112:0/3594341101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb530004810 0x7fb5441e4ba0 secure :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb54000d770 tx=0x7fb54000dc30 comp rx=0 tx=0).stop 2024-09-15T23:57:30.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.105+0000 7fb54bcb8640 1 -- 172.21.15.112:0/3594341101 >> 172.21.15.112:0/3594341101 conn(0x7fb5440b1f90 msgr2=0x7fb544151640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:30.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.105+0000 7fb54bcb8640 1 -- 172.21.15.112:0/3594341101 shutdown_connections 2024-09-15T23:57:30.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.105+0000 7fb54bcb8640 1 -- 172.21.15.112:0/3594341101 wait complete. 2024-09-15T23:57:30.127 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:57:30.146 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-15T23:57:30.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.237+0000 7f819a678640 1 Processor -- start 2024-09-15T23:57:30.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.237+0000 7f819a678640 1 -- start start 2024-09-15T23:57:30.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f819a678640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f819415e5f0 0x7f819406d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:30.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f819a678640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f81940cfaf0 0x7f81940d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:30.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f819a678640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f819406d9c0 con 0x7f81940ce9d0 2024-09-15T23:57:30.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f819a678640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f819406dca0 con 0x7f81940cfaf0 2024-09-15T23:57:30.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f819a678640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f819406df80 con 0x7f819415e5f0 2024-09-15T23:57:30.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f8198c15640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f81940cfaf0 0x7f81940d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:30.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f8198c15640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f81940cfaf0 0x7f81940d2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39488/0 (socket says 172.21.15.112:39488) 2024-09-15T23:57:30.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f8198c15640 1 -- 172.21.15.112:0/4218986335 learned_addr learned my addr 172.21.15.112:0/4218986335 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:30.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f8193fff640 1 --2- 172.21.15.112:0/4218986335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f819415e5f0 0x7f819406d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:30.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f8198c15640 1 -- 172.21.15.112:0/4218986335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f819415e5f0 msgr2=0x7f819406d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:30.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f8198c15640 1 --2- 172.21.15.112:0/4218986335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f819415e5f0 0x7f819406d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f8198c15640 1 -- 172.21.15.112:0/4218986335 >> v1:172.21.15.169:6789/0 conn(0x7f81940ce9d0 legacy=0x7f81940cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:30.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f8198c15640 1 -- 172.21.15.112:0/4218986335 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819406e260 con 0x7f81940cfaf0 2024-09-15T23:57:30.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f8198c15640 1 --2- 172.21.15.112:0/4218986335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81940cfaf0 0x7f81940d2b60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f818c009e50 tx=0x7f818c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82622f4feece806 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:30.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f81937fe640 1 -- 172.21.15.112:0/4218986335 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c0a5810 con 0x7f81940cfaf0 2024-09-15T23:57:30.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f81937fe640 1 -- 172.21.15.112:0/4218986335 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f818c0a59b0 con 0x7f81940cfaf0 2024-09-15T23:57:30.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.241+0000 7f81937fe640 1 -- 172.21.15.112:0/4218986335 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c0a5d80 con 0x7f81940cfaf0 2024-09-15T23:57:30.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 -- 172.21.15.112:0/4218986335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81940cfaf0 msgr2=0x7f81940d2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:30.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 --2- 172.21.15.112:0/4218986335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81940cfaf0 0x7f81940d2b60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f818c009e50 tx=0x7f818c01ca30 comp rx=0 tx=0).stop 2024-09-15T23:57:30.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 -- 172.21.15.112:0/4218986335 shutdown_connections 2024-09-15T23:57:30.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 --2- 172.21.15.112:0/4218986335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81940cfaf0 0x7f81940d2b60 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 --2- 172.21.15.112:0/4218986335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f819415e5f0 0x7f819406d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 -- 172.21.15.112:0/4218986335 >> 172.21.15.112:0/4218986335 conn(0x7f8194074030 msgr2=0x7f819409d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:30.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 -- 172.21.15.112:0/4218986335 shutdown_connections 2024-09-15T23:57:30.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 -- 172.21.15.112:0/4218986335 wait complete. 2024-09-15T23:57:30.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 Processor -- start 2024-09-15T23:57:30.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 -- start start 2024-09-15T23:57:30.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81940cfaf0 0x7f8194155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:30.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f819414d810 0x7f8194159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:30.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8194159d90 0x7f81940c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:30.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f81940d3c40 con 0x7f8194159d90 2024-09-15T23:57:30.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f81940d3ac0 con 0x7f81940cfaf0 2024-09-15T23:57:30.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f819416afa0 con 0x7f819414d810 2024-09-15T23:57:30.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f8198c15640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8194159d90 0x7f81940c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:30.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f8198c15640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8194159d90 0x7f81940c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39502/0 (socket says 172.21.15.112:39502) 2024-09-15T23:57:30.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f8198c15640 1 -- 172.21.15.112:0/1465569219 learned_addr learned my addr 172.21.15.112:0/1465569219 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:30.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f8193fff640 1 --2- 172.21.15.112:0/1465569219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81940cfaf0 0x7f8194155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:30.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f818bfff640 1 --2- 172.21.15.112:0/1465569219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f819414d810 0x7f8194159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:30.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f8198c15640 1 -- 172.21.15.112:0/1465569219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f819414d810 msgr2=0x7f8194159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:30.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f8198c15640 1 --2- 172.21.15.112:0/1465569219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f819414d810 0x7f8194159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f8198c15640 1 -- 172.21.15.112:0/1465569219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81940cfaf0 msgr2=0x7f8194155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:30.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f8198c15640 1 --2- 172.21.15.112:0/1465569219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81940cfaf0 0x7f8194155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f8198c15640 1 -- 172.21.15.112:0/1465569219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819415aba0 con 0x7f8194159d90 2024-09-15T23:57:30.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f8198c15640 1 --2- 172.21.15.112:0/1465569219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8194159d90 0x7f81940c8110 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f818c009e50 tx=0x7f818c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:30.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f81917fa640 1 -- 172.21.15.112:0/1465569219 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c0bc020 con 0x7f8194159d90 2024-09-15T23:57:30.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f81917fa640 1 -- 172.21.15.112:0/1465569219 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f818c0b8880 con 0x7f8194159d90 2024-09-15T23:57:30.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 -- 172.21.15.112:0/1465569219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8194158d70 con 0x7f8194159d90 2024-09-15T23:57:30.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f81917fa640 1 -- 172.21.15.112:0/1465569219 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c009510 con 0x7f8194159d90 2024-09-15T23:57:30.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.245+0000 7f819a678640 1 -- 172.21.15.112:0/1465569219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f819415ae80 con 0x7f8194159d90 2024-09-15T23:57:30.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.249+0000 7f819a678640 1 -- 172.21.15.112:0/1465569219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81940ba290 con 0x7f8194159d90 2024-09-15T23:57:30.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.249+0000 7f81917fa640 1 -- 172.21.15.112:0/1465569219 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f818c0bf020 con 0x7f8194159d90 2024-09-15T23:57:30.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.249+0000 7f81917fa640 1 --2- 172.21.15.112:0/1465569219 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f81740678f0 0x7f8174069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:30.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.249+0000 7f81917fa640 1 -- 172.21.15.112:0/1465569219 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f818c120990 con 0x7f8194159d90 2024-09-15T23:57:30.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.249+0000 7f8193fff640 1 --2- 172.21.15.112:0/1465569219 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f81740678f0 0x7f8174069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:30.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.249+0000 7f8193fff640 1 --2- 172.21.15.112:0/1465569219 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f81740678f0 0x7f8174069db0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f818400b930 tx=0x7f8184008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:30.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.253+0000 7f81917fa640 1 -- 172.21.15.112:0/1465569219 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f818c0c7020 con 0x7f8194159d90 2024-09-15T23:57:30.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:30.441+0000 7f819a678640 1 -- 172.21.15.112:0/1465569219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f81940d2b60 con 0x7f8194159d90 2024-09-15T23:57:31.107 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.105+0000 7f81917fa640 1 -- 172.21.15.112:0/1465569219 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7f818c016620 con 0x7f8194159d90 2024-09-15T23:57:31.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.109+0000 7f819a678640 1 -- 172.21.15.112:0/1465569219 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f81740678f0 msgr2=0x7f8174069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:31.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.109+0000 7f819a678640 1 --2- 172.21.15.112:0/1465569219 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f81740678f0 0x7f8174069db0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f818400b930 tx=0x7f8184008040 comp rx=0 tx=0).stop 2024-09-15T23:57:31.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.109+0000 7f819a678640 1 -- 172.21.15.112:0/1465569219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8194159d90 msgr2=0x7f81940c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:31.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.109+0000 7f819a678640 1 --2- 172.21.15.112:0/1465569219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8194159d90 0x7f81940c8110 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f818c009e50 tx=0x7f818c0197d0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.109+0000 7f819a678640 1 -- 172.21.15.112:0/1465569219 shutdown_connections 2024-09-15T23:57:31.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.109+0000 7f819a678640 1 --2- 172.21.15.112:0/1465569219 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f81740678f0 0x7f8174069db0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.109+0000 7f819a678640 1 --2- 172.21.15.112:0/1465569219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8194159d90 0x7f81940c8110 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.109+0000 7f819a678640 1 --2- 172.21.15.112:0/1465569219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f819414d810 0x7f8194159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.109+0000 7f819a678640 1 --2- 172.21.15.112:0/1465569219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81940cfaf0 0x7f8194155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.109+0000 7f819a678640 1 -- 172.21.15.112:0/1465569219 >> 172.21.15.112:0/1465569219 conn(0x7f81940ce9d0 msgr2=0x7f81940cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:31.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.109+0000 7f819a678640 1 -- 172.21.15.112:0/1465569219 shutdown_connections 2024-09-15T23:57:31.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.109+0000 7f819a678640 1 -- 172.21.15.112:0/1465569219 wait complete. 2024-09-15T23:57:31.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:57:31.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.305+0000 7fe871495640 1 Processor -- start 2024-09-15T23:57:31.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.305+0000 7fe871495640 1 -- start start 2024-09-15T23:57:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.305+0000 7fe871495640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe86c15bec0 0x7fe86c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.305+0000 7fe871495640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe86c15c2a0 0x7fe86c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.305+0000 7fe871495640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c0b3290 con 0x7fe86c0af2a0 2024-09-15T23:57:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.305+0000 7fe871495640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe86c0b3570 con 0x7fe86c15c2a0 2024-09-15T23:57:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.305+0000 7fe871495640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe86c0b3850 con 0x7fe86c15bec0 2024-09-15T23:57:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe8627fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe86c15c2a0 0x7fe86c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe8627fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe86c15c2a0 0x7fe86c0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39510/0 (socket says 172.21.15.112:39510) 2024-09-15T23:57:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe86b7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fe86c0af2a0 0x7fe86c15fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43012/0 (socket says 172.21.15.112:43012) 2024-09-15T23:57:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe8627fc640 1 -- 172.21.15.112:0/676364374 learned_addr learned my addr 172.21.15.112:0/676364374 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe86affd640 1 --2- 172.21.15.112:0/676364374 >> v2:172.21.15.169:3300/0 conn(0x7fe86c15bec0 0x7fe86c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe8627fc640 1 -- 172.21.15.112:0/676364374 >> v2:172.21.15.169:3300/0 conn(0x7fe86c15bec0 msgr2=0x7fe86c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe8627fc640 1 --2- 172.21.15.112:0/676364374 >> v2:172.21.15.169:3300/0 conn(0x7fe86c15bec0 0x7fe86c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe8627fc640 1 -- 172.21.15.112:0/676364374 >> v1:172.21.15.112:6789/0 conn(0x7fe86c0af2a0 legacy=0x7fe86c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe8627fc640 1 -- 172.21.15.112:0/676364374 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c0b3b30 con 0x7fe86c15c2a0 2024-09-15T23:57:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe86affd640 1 --2- 172.21.15.112:0/676364374 >> v2:172.21.15.169:3300/0 conn(0x7fe86c15bec0 0x7fe86c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe86a7fc640 1 -- 172.21.15.112:0/676364374 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517032928 0 0) 0x7fe86c0b3290 con 0x7fe86c0af2a0 2024-09-15T23:57:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe8627fc640 1 --2- 172.21.15.112:0/676364374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c15c2a0 0x7fe86c0aed60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe86c071710 tx=0x7fe85401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7f4ccb7f1b26f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe86a7fc640 1 -- 172.21.15.112:0/676364374 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8540aa650 con 0x7fe86c15c2a0 2024-09-15T23:57:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe86a7fc640 1 -- 172.21.15.112:0/676364374 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8540af070 con 0x7fe86c15c2a0 2024-09-15T23:57:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe86a7fc640 1 -- 172.21.15.112:0/676364374 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8540aaa10 con 0x7fe86c15c2a0 2024-09-15T23:57:31.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe871495640 1 -- 172.21.15.112:0/676364374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c15c2a0 msgr2=0x7fe86c0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:31.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe871495640 1 --2- 172.21.15.112:0/676364374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c15c2a0 0x7fe86c0aed60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe86c071710 tx=0x7fe85401c4f0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe871495640 1 -- 172.21.15.112:0/676364374 shutdown_connections 2024-09-15T23:57:31.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe871495640 1 --2- 172.21.15.112:0/676364374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c15c2a0 0x7fe86c0aed60 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe871495640 1 --2- 172.21.15.112:0/676364374 >> v2:172.21.15.169:3300/0 conn(0x7fe86c15bec0 0x7fe86c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe871495640 1 -- 172.21.15.112:0/676364374 >> 172.21.15.112:0/676364374 conn(0x7fe86c0b1f90 msgr2=0x7fe86c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:31.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe871495640 1 -- 172.21.15.112:0/676364374 shutdown_connections 2024-09-15T23:57:31.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.309+0000 7fe871495640 1 -- 172.21.15.112:0/676364374 wait complete. 2024-09-15T23:57:31.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe871495640 1 Processor -- start 2024-09-15T23:57:31.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe871495640 1 -- start start 2024-09-15T23:57:31.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe871495640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe86c0af2a0 0x7fe86c152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:31.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe871495640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c15bec0 0x7fe86c157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:31.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe871495640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe86c15c2a0 0x7fe86c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:31.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe871495640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c0af6d0 con 0x7fe86c15bec0 2024-09-15T23:57:31.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe871495640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c0ad740 con 0x7fe86c15c2a0 2024-09-15T23:57:31.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe871495640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe86c169000 con 0x7fe86c0af2a0 2024-09-15T23:57:31.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe8627fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c15bec0 0x7fe86c157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:31.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe8627fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c15bec0 0x7fe86c157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39524/0 (socket says 172.21.15.112:39524) 2024-09-15T23:57:31.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe8627fc640 1 -- 172.21.15.112:0/437829017 learned_addr learned my addr 172.21.15.112:0/437829017 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:31.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe8627fc640 1 -- 172.21.15.112:0/437829017 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe86c0af2a0 msgr2=0x7fe86c152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:31.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe8627fc640 1 --2- 172.21.15.112:0/437829017 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe86c0af2a0 0x7fe86c152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe8627fc640 1 -- 172.21.15.112:0/437829017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe86c15c2a0 msgr2=0x7fe86c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:31.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe8627fc640 1 --2- 172.21.15.112:0/437829017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe86c15c2a0 0x7fe86c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe8627fc640 1 -- 172.21.15.112:0/437829017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c156ff0 con 0x7fe86c15bec0 2024-09-15T23:57:31.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe8627fc640 1 --2- 172.21.15.112:0/437829017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c15bec0 0x7fe86c157a90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe8540ac040 tx=0x7fe854019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:31.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe863fff640 1 -- 172.21.15.112:0/437829017 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8540aae60 con 0x7fe86c15bec0 2024-09-15T23:57:31.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe863fff640 1 -- 172.21.15.112:0/437829017 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8540a6040 con 0x7fe86c15bec0 2024-09-15T23:57:31.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe871495640 1 -- 172.21.15.112:0/437829017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86c15c750 con 0x7fe86c15bec0 2024-09-15T23:57:31.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe863fff640 1 -- 172.21.15.112:0/437829017 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8540b4a70 con 0x7fe86c15bec0 2024-09-15T23:57:31.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe871495640 1 -- 172.21.15.112:0/437829017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe86c157570 con 0x7fe86c15bec0 2024-09-15T23:57:31.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe871495640 1 -- 172.21.15.112:0/437829017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86c0ad200 con 0x7fe86c15bec0 2024-09-15T23:57:31.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe863fff640 1 -- 172.21.15.112:0/437829017 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe8540bc020 con 0x7fe86c15bec0 2024-09-15T23:57:31.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe863fff640 1 --2- 172.21.15.112:0/437829017 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe84c0678c0 0x7fe84c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:31.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe863fff640 1 -- 172.21.15.112:0/437829017 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fe854120490 con 0x7fe86c15bec0 2024-09-15T23:57:31.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.313+0000 7fe86affd640 1 --2- 172.21.15.112:0/437829017 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe84c0678c0 0x7fe84c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:31.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.317+0000 7fe86affd640 1 --2- 172.21.15.112:0/437829017 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe84c0678c0 0x7fe84c069d80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00a8d0 tx=0x7fe85c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:31.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.321+0000 7fe863fff640 1 -- 172.21.15.112:0/437829017 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe854016110 con 0x7fe86c15bec0 2024-09-15T23:57:31.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:31.469+0000 7fe871495640 1 -- 172.21.15.112:0/437829017 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe86c06fcd0 con 0x7fe86c15bec0 2024-09-15T23:57:32.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.473+0000 7fe863fff640 1 -- 172.21.15.112:0/437829017 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) ==== 181+0+0 (secure 0 0 0) 0x7fe8540f0df0 con 0x7fe86c15bec0 2024-09-15T23:57:32.474 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:57:32.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.477+0000 7fe871495640 1 -- 172.21.15.112:0/437829017 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe84c0678c0 msgr2=0x7fe84c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.477+0000 7fe871495640 1 --2- 172.21.15.112:0/437829017 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe84c0678c0 0x7fe84c069d80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00a8d0 tx=0x7fe85c008040 comp rx=0 tx=0).stop 2024-09-15T23:57:32.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.477+0000 7fe871495640 1 -- 172.21.15.112:0/437829017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c15bec0 msgr2=0x7fe86c157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.477+0000 7fe871495640 1 --2- 172.21.15.112:0/437829017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c15bec0 0x7fe86c157a90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe8540ac040 tx=0x7fe854019290 comp rx=0 tx=0).stop 2024-09-15T23:57:32.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.477+0000 7fe871495640 1 -- 172.21.15.112:0/437829017 shutdown_connections 2024-09-15T23:57:32.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.477+0000 7fe871495640 1 --2- 172.21.15.112:0/437829017 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe84c0678c0 0x7fe84c069d80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.477+0000 7fe871495640 1 --2- 172.21.15.112:0/437829017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe86c15c2a0 0x7fe86c0cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.477+0000 7fe871495640 1 --2- 172.21.15.112:0/437829017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c15bec0 0x7fe86c157a90 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.477+0000 7fe871495640 1 --2- 172.21.15.112:0/437829017 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe86c0af2a0 0x7fe86c152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.477+0000 7fe871495640 1 -- 172.21.15.112:0/437829017 >> 172.21.15.112:0/437829017 conn(0x7fe86c0b1f90 msgr2=0x7fe86c1660c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:32.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.477+0000 7fe871495640 1 -- 172.21.15.112:0/437829017 shutdown_connections 2024-09-15T23:57:32.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.477+0000 7fe871495640 1 -- 172.21.15.112:0/437829017 wait complete. 2024-09-15T23:57:32.501 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:57:32.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce6b495640 1 Processor -- start 2024-09-15T23:57:32.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce6b495640 1 -- start start 2024-09-15T23:57:32.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce6b495640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce64073e60 0x7fce6406e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce6b495640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fce6406fef0 0x7fce6415b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce6b495640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6415bda0 con 0x7fce640b3d50 2024-09-15T23:57:32.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce6b495640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fce6406ee50 con 0x7fce64073e60 2024-09-15T23:57:32.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce6b495640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fce6406f130 con 0x7fce6406fef0 2024-09-15T23:57:32.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce69231640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce64073e60 0x7fce6406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce69231640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fce64073e60 0x7fce6406e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39530/0 (socket says 172.21.15.112:39530) 2024-09-15T23:57:32.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce69231640 1 -- 172.21.15.112:0/2123867693 learned_addr learned my addr 172.21.15.112:0/2123867693 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:32.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce68a30640 1 --2- 172.21.15.112:0/2123867693 >> v2:172.21.15.169:3300/0 conn(0x7fce6406fef0 0x7fce6415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce69231640 1 -- 172.21.15.112:0/2123867693 >> v2:172.21.15.169:3300/0 conn(0x7fce6406fef0 msgr2=0x7fce6415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:32.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce69231640 1 --2- 172.21.15.112:0/2123867693 >> v2:172.21.15.169:3300/0 conn(0x7fce6406fef0 0x7fce6415b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce69231640 1 -- 172.21.15.112:0/2123867693 >> v1:172.21.15.169:6789/0 conn(0x7fce640b3d50 legacy=0x7fce640b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:32.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce69231640 1 -- 172.21.15.112:0/2123867693 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6406f410 con 0x7fce64073e60 2024-09-15T23:57:32.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.621+0000 7fce68a30640 1 --2- 172.21.15.112:0/2123867693 >> v2:172.21.15.169:3300/0 conn(0x7fce6406fef0 0x7fce6415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:32.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.625+0000 7fce69231640 1 --2- 172.21.15.112:0/2123867693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce64073e60 0x7fce6406e800 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fce641589e0 tx=0x7fce6001d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc56f3a36fe7f3f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:32.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.625+0000 7fce5bfff640 1 -- 172.21.15.112:0/2123867693 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6000b040 con 0x7fce64073e60 2024-09-15T23:57:32.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.625+0000 7fce5bfff640 1 -- 172.21.15.112:0/2123867693 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce600a7710 con 0x7fce64073e60 2024-09-15T23:57:32.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.625+0000 7fce5bfff640 1 -- 172.21.15.112:0/2123867693 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce600a7ae0 con 0x7fce64073e60 2024-09-15T23:57:32.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.625+0000 7fce6b495640 1 -- 172.21.15.112:0/2123867693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce64073e60 msgr2=0x7fce6406e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.625+0000 7fce6b495640 1 --2- 172.21.15.112:0/2123867693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce64073e60 0x7fce6406e800 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fce641589e0 tx=0x7fce6001d820 comp rx=0 tx=0).stop 2024-09-15T23:57:32.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.625+0000 7fce6b495640 1 -- 172.21.15.112:0/2123867693 shutdown_connections 2024-09-15T23:57:32.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.625+0000 7fce6b495640 1 --2- 172.21.15.112:0/2123867693 >> v2:172.21.15.169:3300/0 conn(0x7fce6406fef0 0x7fce6415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.625+0000 7fce6b495640 1 --2- 172.21.15.112:0/2123867693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce64073e60 0x7fce6406e800 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.625+0000 7fce6b495640 1 -- 172.21.15.112:0/2123867693 >> 172.21.15.112:0/2123867693 conn(0x7fce640b1f90 msgr2=0x7fce640b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:32.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.625+0000 7fce6b495640 1 -- 172.21.15.112:0/2123867693 shutdown_connections 2024-09-15T23:57:32.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.625+0000 7fce6b495640 1 -- 172.21.15.112:0/2123867693 wait complete. 2024-09-15T23:57:32.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.625+0000 7fce6b495640 1 Processor -- start 2024-09-15T23:57:32.628 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.625+0000 7fce6b495640 1 -- start start 2024-09-15T23:57:32.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce6b495640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce6406fef0 0x7fce6414b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce6b495640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce64073e60 0x7fce64156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce6b495640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce640b3d50 0x7fce64156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce6b495640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fce640729a0 con 0x7fce640b3d50 2024-09-15T23:57:32.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce6b495640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fce64072820 con 0x7fce64073e60 2024-09-15T23:57:32.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce6b495640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fce64072b20 con 0x7fce6406fef0 2024-09-15T23:57:32.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce69a32640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce640b3d50 0x7fce64156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce69a32640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce640b3d50 0x7fce64156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39534/0 (socket says 172.21.15.112:39534) 2024-09-15T23:57:32.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce69a32640 1 -- 172.21.15.112:0/1960295446 learned_addr learned my addr 172.21.15.112:0/1960295446 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:32.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce69231640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce6406fef0 0x7fce6414b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce68a30640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce64073e60 0x7fce64156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce69a32640 1 -- 172.21.15.112:0/1960295446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce6406fef0 msgr2=0x7fce6414b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce69a32640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce6406fef0 0x7fce6414b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce69a32640 1 -- 172.21.15.112:0/1960295446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce64073e60 msgr2=0x7fce64156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce69a32640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce64073e60 0x7fce64156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce69a32640 1 -- 172.21.15.112:0/1960295446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce64156ec0 con 0x7fce640b3d50 2024-09-15T23:57:32.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce68a30640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce64073e60 0x7fce64156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:32.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce69a32640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce640b3d50 0x7fce64156840 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00c7b0 tx=0x7fce5c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:32.631 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce59ffb640 1 -- 172.21.15.112:0/1960295446 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c017070 con 0x7fce640b3d50 2024-09-15T23:57:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce59ffb640 1 -- 172.21.15.112:0/1960295446 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5c003db0 con 0x7fce640b3d50 2024-09-15T23:57:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce6b495640 1 -- 172.21.15.112:0/1960295446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce641571a0 con 0x7fce640b3d50 2024-09-15T23:57:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce59ffb640 1 -- 172.21.15.112:0/1960295446 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c0052b0 con 0x7fce640b3d50 2024-09-15T23:57:32.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce6b495640 1 -- 172.21.15.112:0/1960295446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce64157760 con 0x7fce640b3d50 2024-09-15T23:57:32.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce6b495640 1 -- 172.21.15.112:0/1960295446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce6415b860 con 0x7fce640b3d50 2024-09-15T23:57:32.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce59ffb640 1 -- 172.21.15.112:0/1960295446 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fce5c01a070 con 0x7fce640b3d50 2024-09-15T23:57:32.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce59ffb640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fce480678c0 0x7fce48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce59ffb640 1 -- 172.21.15.112:0/1960295446 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5749+0+0 (secure 0 0 0) 0x7fce5c0852d0 con 0x7fce640b3d50 2024-09-15T23:57:32.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce69231640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fce480678c0 0x7fce48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.629+0000 7fce69231640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fce480678c0 0x7fce48069d80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fce600b0000 tx=0x7fce60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:32.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.633+0000 7fce59ffb640 1 -- 172.21.15.112:0/1960295446 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fce5c055e70 con 0x7fce640b3d50 2024-09-15T23:57:32.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:32.785+0000 7fce6b495640 1 -- 172.21.15.112:0/1960295446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fce640723f0 con 0x7fce640b3d50 2024-09-15T23:57:33.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.481+0000 7fce59ffb640 1 -- 172.21.15.112:0/1960295446 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) ==== 169+0+0 (secure 0 0 0) 0x7fce5c055770 con 0x7fce640b3d50 2024-09-15T23:57:33.482 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-15T23:57:33.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.485+0000 7fce6b495640 1 -- 172.21.15.112:0/1960295446 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fce480678c0 msgr2=0x7fce48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.485+0000 7fce6b495640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fce480678c0 0x7fce48069d80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fce600b0000 tx=0x7fce60008040 comp rx=0 tx=0).stop 2024-09-15T23:57:33.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.485+0000 7fce6b495640 1 -- 172.21.15.112:0/1960295446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce640b3d50 msgr2=0x7fce64156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.485+0000 7fce6b495640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce640b3d50 0x7fce64156840 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00c7b0 tx=0x7fce5c00cc70 comp rx=0 tx=0).stop 2024-09-15T23:57:33.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.485+0000 7fce6b495640 1 -- 172.21.15.112:0/1960295446 shutdown_connections 2024-09-15T23:57:33.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.485+0000 7fce6b495640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fce480678c0 0x7fce48069d80 secure :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fce600b0000 tx=0x7fce60008040 comp rx=0 tx=0).stop 2024-09-15T23:57:33.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.485+0000 7fce6b495640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce640b3d50 0x7fce64156840 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.485+0000 7fce6b495640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce64073e60 0x7fce64156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.485+0000 7fce6b495640 1 --2- 172.21.15.112:0/1960295446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fce6406fef0 0x7fce6414b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.485+0000 7fce6b495640 1 -- 172.21.15.112:0/1960295446 >> 172.21.15.112:0/1960295446 conn(0x7fce640b1f90 msgr2=0x7fce6414f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:33.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.485+0000 7fce6b495640 1 -- 172.21.15.112:0/1960295446 shutdown_connections 2024-09-15T23:57:33.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.485+0000 7fce6b495640 1 -- 172.21.15.112:0/1960295446 wait complete. 2024-09-15T23:57:33.511 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:57:33.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.629+0000 7f9825b1e640 1 Processor -- start 2024-09-15T23:57:33.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.629+0000 7f9825b1e640 1 -- start start 2024-09-15T23:57:33.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f9825b1e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f98200d3060 0x7f98200cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f9825b1e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98200cf450 0x7f982006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f9825b1e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98200d0300 con 0x7f9820161a60 2024-09-15T23:57:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f9825b1e640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f98200b0f60 con 0x7f98200d3060 2024-09-15T23:57:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f9825b1e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f98200cfd40 con 0x7f98200cf450 2024-09-15T23:57:33.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f981effd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f98200d3060 0x7f98200cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f981ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98200cf450 0x7f982006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f981effd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f98200d3060 0x7f98200cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39536/0 (socket says 172.21.15.112:39536) 2024-09-15T23:57:33.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f981effd640 1 -- 172.21.15.112:0/1895300783 learned_addr learned my addr 172.21.15.112:0/1895300783 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:33.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f981effd640 1 -- 172.21.15.112:0/1895300783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98200cf450 msgr2=0x7f982006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:33.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f981effd640 1 --2- 172.21.15.112:0/1895300783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98200cf450 0x7f982006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f981effd640 1 -- 172.21.15.112:0/1895300783 >> v1:172.21.15.169:6789/0 conn(0x7f9820161a60 legacy=0x7f98200d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f981effd640 1 -- 172.21.15.112:0/1895300783 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98200d0020 con 0x7f98200d3060 2024-09-15T23:57:33.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f981effd640 1 --2- 172.21.15.112:0/1895300783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98200d3060 0x7f98200cef10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9814009870 tx=0x7f981401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b43a6e53ff66eee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:33.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f981e7fc640 1 -- 172.21.15.112:0/1895300783 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98140aa600 con 0x7f98200d3060 2024-09-15T23:57:33.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f981e7fc640 1 -- 172.21.15.112:0/1895300783 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98140af070 con 0x7f98200d3060 2024-09-15T23:57:33.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.633+0000 7f981e7fc640 1 -- 172.21.15.112:0/1895300783 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98140aa9c0 con 0x7f98200d3060 2024-09-15T23:57:33.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 -- 172.21.15.112:0/1895300783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98200d3060 msgr2=0x7f98200cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 --2- 172.21.15.112:0/1895300783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98200d3060 0x7f98200cef10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9814009870 tx=0x7f981401c4a0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 -- 172.21.15.112:0/1895300783 shutdown_connections 2024-09-15T23:57:33.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 --2- 172.21.15.112:0/1895300783 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98200cf450 0x7f982006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 --2- 172.21.15.112:0/1895300783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98200d3060 0x7f98200cef10 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 -- 172.21.15.112:0/1895300783 >> 172.21.15.112:0/1895300783 conn(0x7f982008bf90 msgr2=0x7f982009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:33.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 -- 172.21.15.112:0/1895300783 shutdown_connections 2024-09-15T23:57:33.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 -- 172.21.15.112:0/1895300783 wait complete. 2024-09-15T23:57:33.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 Processor -- start 2024-09-15T23:57:33.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 -- start start 2024-09-15T23:57:33.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98200cf450 0x7f98200c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98200d3060 0x7f98200caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.640 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9820161a60 0x7f98200cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f982016af20 con 0x7f9820161a60 2024-09-15T23:57:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f982006e690 con 0x7f98200d3060 2024-09-15T23:57:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f9825b1e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f982016b0a0 con 0x7f98200cf450 2024-09-15T23:57:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f981ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9820161a60 0x7f98200cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f981ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9820161a60 0x7f98200cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39546/0 (socket says 172.21.15.112:39546) 2024-09-15T23:57:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f981ffff640 1 -- 172.21.15.112:0/990277556 learned_addr learned my addr 172.21.15.112:0/990277556 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f981f7fe640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98200cf450 0x7f98200c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f981effd640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98200d3060 0x7f98200caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f981ffff640 1 -- 172.21.15.112:0/990277556 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98200cf450 msgr2=0x7f98200c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f981ffff640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98200cf450 0x7f98200c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f981ffff640 1 -- 172.21.15.112:0/990277556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98200d3060 msgr2=0x7f98200caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f981ffff640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98200d3060 0x7f98200caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f981ffff640 1 -- 172.21.15.112:0/990277556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98200c90e0 con 0x7f9820161a60 2024-09-15T23:57:33.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f981effd640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98200d3060 0x7f98200caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:33.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.637+0000 7f981ffff640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9820161a60 0x7f98200cd690 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f981800efc0 tx=0x7f981800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:33.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.641+0000 7f9807fff640 1 -- 172.21.15.112:0/990277556 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9818018020 con 0x7f9820161a60 2024-09-15T23:57:33.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.641+0000 7f9807fff640 1 -- 172.21.15.112:0/990277556 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9818014480 con 0x7f9820161a60 2024-09-15T23:57:33.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.641+0000 7f9807fff640 1 -- 172.21.15.112:0/990277556 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9818014870 con 0x7f9820161a60 2024-09-15T23:57:33.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.641+0000 7f9825b1e640 1 -- 172.21.15.112:0/990277556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98201f8880 con 0x7f9820161a60 2024-09-15T23:57:33.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.641+0000 7f9825b1e640 1 -- 172.21.15.112:0/990277556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98201f90c0 con 0x7f9820161a60 2024-09-15T23:57:33.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.641+0000 7f9825b1e640 1 -- 172.21.15.112:0/990277556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982006d6b0 con 0x7f9820161a60 2024-09-15T23:57:33.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.641+0000 7f9807fff640 1 -- 172.21.15.112:0/990277556 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f981801b020 con 0x7f9820161a60 2024-09-15T23:57:33.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.641+0000 7f9807fff640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f980c0678c0 0x7f980c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.641+0000 7f9807fff640 1 -- 172.21.15.112:0/990277556 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f9818086680 con 0x7f9820161a60 2024-09-15T23:57:33.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.641+0000 7f981f7fe640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f980c0678c0 0x7f980c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.641+0000 7f981f7fe640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f980c0678c0 0x7f980c069d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9810001650 tx=0x7f9810009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:33.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.645+0000 7f9807fff640 1 -- 172.21.15.112:0/990277556 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9818022070 con 0x7f9820161a60 2024-09-15T23:57:33.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.817+0000 7f9825b1e640 1 -- 172.21.15.112:0/990277556 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f9820073880 con 0x7f9820161a60 2024-09-15T23:57:33.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.821+0000 7f9807fff640 1 -- 172.21.15.112:0/990277556 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f98201f8880 con 0x7f9820161a60 2024-09-15T23:57:33.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.825+0000 7f9825b1e640 1 -- 172.21.15.112:0/990277556 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f980c0678c0 msgr2=0x7f980c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.825+0000 7f9825b1e640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f980c0678c0 0x7f980c069d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9810001650 tx=0x7f9810009040 comp rx=0 tx=0).stop 2024-09-15T23:57:33.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.825+0000 7f9825b1e640 1 -- 172.21.15.112:0/990277556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9820161a60 msgr2=0x7f98200cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.825+0000 7f9825b1e640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9820161a60 0x7f98200cd690 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f981800efc0 tx=0x7f981800c490 comp rx=0 tx=0).stop 2024-09-15T23:57:33.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.825+0000 7f9825b1e640 1 -- 172.21.15.112:0/990277556 shutdown_connections 2024-09-15T23:57:33.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.825+0000 7f9825b1e640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f980c0678c0 0x7f980c069d80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.825+0000 7f9825b1e640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9820161a60 0x7f98200cd690 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.825+0000 7f9825b1e640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f98200d3060 0x7f98200caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.825+0000 7f9825b1e640 1 --2- 172.21.15.112:0/990277556 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98200cf450 0x7f98200c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.825+0000 7f9825b1e640 1 -- 172.21.15.112:0/990277556 >> 172.21.15.112:0/990277556 conn(0x7f982008bf90 msgr2=0x7f982015f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:33.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.825+0000 7f9825b1e640 1 -- 172.21.15.112:0/990277556 shutdown_connections 2024-09-15T23:57:33.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.825+0000 7f9825b1e640 1 -- 172.21.15.112:0/990277556 wait complete. 2024-09-15T23:57:33.842 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_fragment_size_max 2024-09-15T23:57:33.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.961+0000 7fba3f1ac640 1 Processor -- start 2024-09-15T23:57:33.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.961+0000 7fba3f1ac640 1 -- start start 2024-09-15T23:57:33.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.961+0000 7fba3f1ac640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba3815c2a0 0x7fba380aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.961+0000 7fba3f1ac640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba380b3290 con 0x7fba380af2a0 2024-09-15T23:57:33.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.961+0000 7fba3f1ac640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba380b3570 con 0x7fba3815bec0 2024-09-15T23:57:33.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.961+0000 7fba3f1ac640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fba380b3850 con 0x7fba3815c2a0 2024-09-15T23:57:33.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.961+0000 7fba37fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba3815c2a0 0x7fba380aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.961+0000 7fba37fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fba3815c2a0 0x7fba380aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39560/0 (socket says 172.21.15.112:39560) 2024-09-15T23:57:33.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.961+0000 7fba3d749640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fba380af2a0 0x7fba3806e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43022/0 (socket says 172.21.15.112:43022) 2024-09-15T23:57:33.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.961+0000 7fba37fff640 1 -- 172.21.15.112:0/930648389 learned_addr learned my addr 172.21.15.112:0/930648389 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:33.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.961+0000 7fba37fff640 1 -- 172.21.15.112:0/930648389 >> v1:172.21.15.169:6789/0 conn(0x7fba3815bec0 legacy=0x7fba380ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:33.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.961+0000 7fba37fff640 1 -- 172.21.15.112:0/930648389 >> v1:172.21.15.112:6789/0 conn(0x7fba380af2a0 legacy=0x7fba3806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.961+0000 7fba377fe640 1 -- 172.21.15.112:0/930648389 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122620064 0 0) 0x7fba380b3290 con 0x7fba380af2a0 2024-09-15T23:57:33.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.961+0000 7fba37fff640 1 -- 172.21.15.112:0/930648389 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba380b3b30 con 0x7fba3815c2a0 2024-09-15T23:57:33.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba37fff640 1 --2- 172.21.15.112:0/930648389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba3815c2a0 0x7fba380aed60 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009870 tx=0x7fba2c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc06028c0d0dc23c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:33.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba377fe640 1 -- 172.21.15.112:0/930648389 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0aa650 con 0x7fba3815c2a0 2024-09-15T23:57:33.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba377fe640 1 -- 172.21.15.112:0/930648389 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba2c0af070 con 0x7fba3815c2a0 2024-09-15T23:57:33.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba377fe640 1 -- 172.21.15.112:0/930648389 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0aaa10 con 0x7fba3815c2a0 2024-09-15T23:57:33.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 -- 172.21.15.112:0/930648389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba3815c2a0 msgr2=0x7fba380aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 --2- 172.21.15.112:0/930648389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba3815c2a0 0x7fba380aed60 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009870 tx=0x7fba2c01c4f0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 -- 172.21.15.112:0/930648389 shutdown_connections 2024-09-15T23:57:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 --2- 172.21.15.112:0/930648389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba3815c2a0 0x7fba380aed60 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 -- 172.21.15.112:0/930648389 >> 172.21.15.112:0/930648389 conn(0x7fba380b1f90 msgr2=0x7fba380b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 -- 172.21.15.112:0/930648389 shutdown_connections 2024-09-15T23:57:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 -- 172.21.15.112:0/930648389 wait complete. 2024-09-15T23:57:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 Processor -- start 2024-09-15T23:57:33.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 -- start start 2024-09-15T23:57:33.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba380af2a0 0x7fba38152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba3815bec0 0x7fba3814d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fba3815c2a0 0x7fba3814d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fba3806ef20 con 0x7fba380af2a0 2024-09-15T23:57:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fba380af6d0 con 0x7fba3815bec0 2024-09-15T23:57:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3f1ac640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fba3806f0a0 con 0x7fba3815c2a0 2024-09-15T23:57:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3cf48640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba380af2a0 0x7fba38152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3cf48640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba380af2a0 0x7fba38152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39574/0 (socket says 172.21.15.112:39574) 2024-09-15T23:57:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.965+0000 7fba3cf48640 1 -- 172.21.15.112:0/2811964423 learned_addr learned my addr 172.21.15.112:0/2811964423 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba3d749640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fba3815c2a0 0x7fba3814d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba37fff640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba3815bec0 0x7fba3814d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba3cf48640 1 -- 172.21.15.112:0/2811964423 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fba3815c2a0 msgr2=0x7fba3814d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba3cf48640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fba3815c2a0 0x7fba3814d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba3cf48640 1 -- 172.21.15.112:0/2811964423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba3815bec0 msgr2=0x7fba3814d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba3cf48640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba3815bec0 0x7fba3814d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba3cf48640 1 -- 172.21.15.112:0/2811964423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3814f3c0 con 0x7fba380af2a0 2024-09-15T23:57:33.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba37fff640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba3815bec0 0x7fba3814d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba3cf48640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba380af2a0 0x7fba38152b30 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fba2800c450 tx=0x7fba2800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba357fa640 1 -- 172.21.15.112:0/2811964423 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28012830 con 0x7fba380af2a0 2024-09-15T23:57:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba357fa640 1 -- 172.21.15.112:0/2811964423 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba28017070 con 0x7fba380af2a0 2024-09-15T23:57:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba3f1ac640 1 -- 172.21.15.112:0/2811964423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3815c750 con 0x7fba380af2a0 2024-09-15T23:57:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba357fa640 1 -- 172.21.15.112:0/2811964423 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28012c30 con 0x7fba380af2a0 2024-09-15T23:57:33.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba3f1ac640 1 -- 172.21.15.112:0/2811964423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3815cca0 con 0x7fba380af2a0 2024-09-15T23:57:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba3f1ac640 1 -- 172.21.15.112:0/2811964423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba380aed60 con 0x7fba380af2a0 2024-09-15T23:57:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba357fa640 1 -- 172.21.15.112:0/2811964423 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba2801c460 con 0x7fba380af2a0 2024-09-15T23:57:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba357fa640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fba240678c0 0x7fba24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba357fa640 1 -- 172.21.15.112:0/2811964423 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7fba28085830 con 0x7fba380af2a0 2024-09-15T23:57:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba37fff640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fba240678c0 0x7fba24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.969+0000 7fba37fff640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fba240678c0 0x7fba24069d80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0ae000 tx=0x7fba2c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:33.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:33.973+0000 7fba357fa640 1 -- 172.21.15.112:0/2811964423 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fba28056570 con 0x7fba380af2a0 2024-09-15T23:57:34.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.125+0000 7fba3f1ac640 1 -- 172.21.15.112:0/2811964423 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_fragment_size_max"} v 0) -- 0x7fba3806fcd0 con 0x7fba380af2a0 2024-09-15T23:57:34.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.129+0000 7fba357fa640 1 -- 172.21.15.112:0/2811964423 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_fragment_size_max"}]=0 v25) ==== 108+0+0 (secure 0 0 0) 0x7fba28055e70 con 0x7fba380af2a0 2024-09-15T23:57:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.133+0000 7fba3f1ac640 1 -- 172.21.15.112:0/2811964423 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fba240678c0 msgr2=0x7fba24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.133+0000 7fba3f1ac640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fba240678c0 0x7fba24069d80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0ae000 tx=0x7fba2c0a7000 comp rx=0 tx=0).stop 2024-09-15T23:57:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.133+0000 7fba3f1ac640 1 -- 172.21.15.112:0/2811964423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba380af2a0 msgr2=0x7fba38152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.133+0000 7fba3f1ac640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba380af2a0 0x7fba38152b30 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fba2800c450 tx=0x7fba2800c910 comp rx=0 tx=0).stop 2024-09-15T23:57:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.133+0000 7fba3f1ac640 1 -- 172.21.15.112:0/2811964423 shutdown_connections 2024-09-15T23:57:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.133+0000 7fba3f1ac640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fba240678c0 0x7fba24069d80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.133+0000 7fba3f1ac640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fba3815c2a0 0x7fba3814d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.133+0000 7fba3f1ac640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba3815bec0 0x7fba3814d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.133+0000 7fba3f1ac640 1 --2- 172.21.15.112:0/2811964423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba380af2a0 0x7fba38152b30 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.133+0000 7fba3f1ac640 1 -- 172.21.15.112:0/2811964423 >> 172.21.15.112:0/2811964423 conn(0x7fba380b1f90 msgr2=0x7fba381597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:34.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.133+0000 7fba3f1ac640 1 -- 172.21.15.112:0/2811964423 shutdown_connections 2024-09-15T23:57:34.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.133+0000 7fba3f1ac640 1 -- 172.21.15.112:0/2811964423 wait complete. 2024-09-15T23:57:34.148 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_strays' 2024-09-15T23:57:34.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f443939d640 1 Processor -- start 2024-09-15T23:57:34.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f443939d640 1 -- start start 2024-09-15T23:57:34.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f443939d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f443415bec0 0x7f44340ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:34.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f443939d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44340af470 0x7f443406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:34.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f443939d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44340b3290 con 0x7f443415c2a0 2024-09-15T23:57:34.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f443939d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44340b3570 con 0x7f443415bec0 2024-09-15T23:57:34.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f443939d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44340b3850 con 0x7f44340af470 2024-09-15T23:57:34.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f44337fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44340af470 0x7f443406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:34.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f4432ffd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f443415bec0 0x7f44340ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:34.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f44337fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44340af470 0x7f443406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:56110/0 (socket says 172.21.15.112:56110) 2024-09-15T23:57:34.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f44337fe640 1 -- 172.21.15.112:0/1141679373 learned_addr learned my addr 172.21.15.112:0/1141679373 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:34.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f4432ffd640 1 -- 172.21.15.112:0/1141679373 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44340af470 msgr2=0x7f443406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:34.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f4432ffd640 1 --2- 172.21.15.112:0/1141679373 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44340af470 0x7f443406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f4432ffd640 1 -- 172.21.15.112:0/1141679373 >> v1:172.21.15.169:6789/0 conn(0x7f443415c2a0 legacy=0x7f44340aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:34.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f4432ffd640 1 -- 172.21.15.112:0/1141679373 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44340b3b30 con 0x7f443415bec0 2024-09-15T23:57:34.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.265+0000 7f44337fe640 1 --2- 172.21.15.112:0/1141679373 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44340af470 0x7f443406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:57:34.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.269+0000 7f4432ffd640 1 --2- 172.21.15.112:0/1141679373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f443415bec0 0x7f44340ad200 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f442c009d90 tx=0x7f442c01c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c466d2b363a3653 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:34.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.269+0000 7f4431ffb640 1 -- 172.21.15.112:0/1141679373 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c0b2070 con 0x7f443415bec0 2024-09-15T23:57:34.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.269+0000 7f4431ffb640 1 -- 172.21.15.112:0/1141679373 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f442c0a5970 con 0x7f443415bec0 2024-09-15T23:57:34.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.269+0000 7f4431ffb640 1 -- 172.21.15.112:0/1141679373 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c0a5d40 con 0x7f443415bec0 2024-09-15T23:57:34.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.269+0000 7f443939d640 1 -- 172.21.15.112:0/1141679373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f443415bec0 msgr2=0x7f44340ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:34.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.269+0000 7f443939d640 1 --2- 172.21.15.112:0/1141679373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f443415bec0 0x7f44340ad200 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f442c009d90 tx=0x7f442c01c8b0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.269+0000 7f443939d640 1 -- 172.21.15.112:0/1141679373 shutdown_connections 2024-09-15T23:57:34.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.269+0000 7f443939d640 1 --2- 172.21.15.112:0/1141679373 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44340af470 0x7f443406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.269+0000 7f443939d640 1 --2- 172.21.15.112:0/1141679373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f443415bec0 0x7f44340ad200 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.269+0000 7f443939d640 1 -- 172.21.15.112:0/1141679373 >> 172.21.15.112:0/1141679373 conn(0x7f44340b1f90 msgr2=0x7f44340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:34.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.269+0000 7f443939d640 1 -- 172.21.15.112:0/1141679373 shutdown_connections 2024-09-15T23:57:34.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.269+0000 7f443939d640 1 -- 172.21.15.112:0/1141679373 wait complete. 2024-09-15T23:57:34.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.269+0000 7f443939d640 1 Processor -- start 2024-09-15T23:57:34.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.269+0000 7f443939d640 1 -- start start 2024-09-15T23:57:34.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f443939d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44340af470 0x7f44341fadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:34.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f443939d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f443415bec0 0x7f44341544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:34.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f443939d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f443415c2a0 0x7f44341f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:34.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f443939d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f443406ed50 con 0x7f443415bec0 2024-09-15T23:57:34.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f443939d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44340ad740 con 0x7f443415c2a0 2024-09-15T23:57:34.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f443939d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f443406eed0 con 0x7f44340af470 2024-09-15T23:57:34.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f44327fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f443415bec0 0x7f44341544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:34.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f44327fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f443415bec0 0x7f44341544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39578/0 (socket says 172.21.15.112:39578) 2024-09-15T23:57:34.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f44327fc640 1 -- 172.21.15.112:0/1369436188 learned_addr learned my addr 172.21.15.112:0/1369436188 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:34.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f4432ffd640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44340af470 0x7f44341fadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:34.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f44337fe640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f443415c2a0 0x7f44341f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:34.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f44327fc640 1 -- 172.21.15.112:0/1369436188 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44340af470 msgr2=0x7f44341fadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:34.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f44327fc640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44340af470 0x7f44341fadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f44327fc640 1 -- 172.21.15.112:0/1369436188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f443415c2a0 msgr2=0x7f44341f6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:34.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f44327fc640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f443415c2a0 0x7f44341f6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f44327fc640 1 -- 172.21.15.112:0/1369436188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44341f7b00 con 0x7f443415bec0 2024-09-15T23:57:34.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f4432ffd640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44340af470 0x7f44341fadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:57:34.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f44327fc640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f443415bec0 0x7f44341544c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c3c0 tx=0x7f441c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:34.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f442b7fe640 1 -- 172.21.15.112:0/1369436188 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c017070 con 0x7f443415bec0 2024-09-15T23:57:34.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f442b7fe640 1 -- 172.21.15.112:0/1369436188 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f441c0052d0 con 0x7f443415bec0 2024-09-15T23:57:34.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f442b7fe640 1 -- 172.21.15.112:0/1369436188 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c003820 con 0x7f443415bec0 2024-09-15T23:57:34.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f443939d640 1 -- 172.21.15.112:0/1369436188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44341f7820 con 0x7f443415bec0 2024-09-15T23:57:34.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f443939d640 1 -- 172.21.15.112:0/1369436188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44341fa890 con 0x7f443415bec0 2024-09-15T23:57:34.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f443939d640 1 -- 172.21.15.112:0/1369436188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44341faa90 con 0x7f443415bec0 2024-09-15T23:57:34.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f442b7fe640 1 -- 172.21.15.112:0/1369436188 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f441c01a070 con 0x7f443415bec0 2024-09-15T23:57:34.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f442b7fe640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44140678c0 0x7f4414069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:34.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f442b7fe640 1 -- 172.21.15.112:0/1369436188 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f441c084d80 con 0x7f443415bec0 2024-09-15T23:57:34.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f4432ffd640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44140678c0 0x7f4414069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:34.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.273+0000 7f4432ffd640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44140678c0 0x7f4414069d80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f442c0af000 tx=0x7f442c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:34.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.277+0000 7f442b7fe640 1 -- 172.21.15.112:0/1369436188 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f44341faa90 con 0x7f443415bec0 2024-09-15T23:57:34.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:34.501+0000 7f443939d640 1 -- 172.21.15.112:0/1369436188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_strays"]} v 0) -- 0x7f443406e000 con 0x7f443415bec0 2024-09-15T23:57:35.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.485+0000 7f442b7fe640 1 -- 172.21.15.112:0/1369436188 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_dirfrag_limit_strays"]}]=0 v203) ==== 140+0+0 (secure 0 0 0) 0x7f441c005480 con 0x7f443415bec0 2024-09-15T23:57:35.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.489+0000 7f443939d640 1 -- 172.21.15.112:0/1369436188 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44140678c0 msgr2=0x7f4414069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.489+0000 7f443939d640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44140678c0 0x7f4414069d80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f442c0af000 tx=0x7f442c0a7070 comp rx=0 tx=0).stop 2024-09-15T23:57:35.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.489+0000 7f443939d640 1 -- 172.21.15.112:0/1369436188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f443415bec0 msgr2=0x7f44341544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.489+0000 7f443939d640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f443415bec0 0x7f44341544c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c3c0 tx=0x7f441c00c880 comp rx=0 tx=0).stop 2024-09-15T23:57:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.489+0000 7f443939d640 1 -- 172.21.15.112:0/1369436188 shutdown_connections 2024-09-15T23:57:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.489+0000 7f443939d640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44140678c0 0x7f4414069d80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.489+0000 7f443939d640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f443415c2a0 0x7f44341f6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.489+0000 7f443939d640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f443415bec0 0x7f44341544c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.489+0000 7f443939d640 1 --2- 172.21.15.112:0/1369436188 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44340af470 0x7f44341fadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.489+0000 7f443939d640 1 -- 172.21.15.112:0/1369436188 >> 172.21.15.112:0/1369436188 conn(0x7f44340b1f90 msgr2=0x7f44340cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.489+0000 7f443939d640 1 -- 172.21.15.112:0/1369436188 shutdown_connections 2024-09-15T23:57:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.489+0000 7f443939d640 1 -- 172.21.15.112:0/1369436188 wait complete. 2024-09-15T23:57:35.510 INFO:tasks.cephfs_test_runner:That unlinking fails when the stray directory fragment becomes too ... ok 2024-09-15T23:57:35.510 INFO:tasks.cephfs_test_runner:Starting test: test_fancy_layout (tasks.cephfs.test_strays.TestStrays) purge stray file with fancy layout 2024-09-15T23:57:35.510 INFO:tasks.cephfs_test_runner:test_fancy_layout (tasks.cephfs.test_strays.TestStrays) 2024-09-15T23:57:35.510 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:35.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58c5f0b640 1 Processor -- start 2024-09-15T23:57:35.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58c5f0b640 1 -- start start 2024-09-15T23:57:35.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58c5f0b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f58c015c2a0 0x7f58c00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58c5f0b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58c00af2a0 0x7f58c006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58c5f0b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58c00b3290 con 0x7f58c015bec0 2024-09-15T23:57:35.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58c5f0b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f58c00b3570 con 0x7f58c015c2a0 2024-09-15T23:57:35.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58c5f0b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f58c00b3850 con 0x7f58c00af2a0 2024-09-15T23:57:35.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58beffd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f58c015c2a0 0x7f58c00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58bffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58c00af2a0 0x7f58c006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58bf7fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f58c015bec0 0x7f58c00ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:59700/0 (socket says 172.21.15.112:59700) 2024-09-15T23:57:35.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58bffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58c00af2a0 0x7f58c006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:56128/0 (socket says 172.21.15.112:56128) 2024-09-15T23:57:35.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58beffd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f58c015c2a0 0x7f58c00aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:48074/0 (socket says 172.21.15.112:48074) 2024-09-15T23:57:35.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58bf7fe640 1 -- 172.21.15.112:0/3965400250 learned_addr learned my addr 172.21.15.112:0/3965400250 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:35.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58beffd640 1 -- 172.21.15.112:0/3965400250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58c00af2a0 msgr2=0x7f58c006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:35.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58beffd640 1 --2- 172.21.15.112:0/3965400250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58c00af2a0 0x7f58c006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58beffd640 1 -- 172.21.15.112:0/3965400250 >> v1:172.21.15.169:6789/0 conn(0x7f58c015bec0 legacy=0x7f58c00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.633+0000 7f58beffd640 1 -- 172.21.15.112:0/3965400250 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c00b3b30 con 0x7f58c015c2a0 2024-09-15T23:57:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58beffd640 1 --2- 172.21.15.112:0/3965400250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c015c2a0 0x7f58c00aed60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f58b40097c0 tx=0x7f58b401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f040a54a875f40b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58be7fc640 1 -- 172.21.15.112:0/3965400250 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b40a7070 con 0x7f58c015c2a0 2024-09-15T23:57:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58be7fc640 1 -- 172.21.15.112:0/3965400250 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b40b0070 con 0x7f58c015c2a0 2024-09-15T23:57:35.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58be7fc640 1 -- 172.21.15.112:0/3965400250 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b40ab890 con 0x7f58c015c2a0 2024-09-15T23:57:35.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 -- 172.21.15.112:0/3965400250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c015c2a0 msgr2=0x7f58c00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 --2- 172.21.15.112:0/3965400250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c015c2a0 0x7f58c00aed60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f58b40097c0 tx=0x7f58b401c470 comp rx=0 tx=0).stop 2024-09-15T23:57:35.638 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 -- 172.21.15.112:0/3965400250 shutdown_connections 2024-09-15T23:57:35.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 --2- 172.21.15.112:0/3965400250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58c00af2a0 0x7f58c006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 --2- 172.21.15.112:0/3965400250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c015c2a0 0x7f58c00aed60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 -- 172.21.15.112:0/3965400250 >> 172.21.15.112:0/3965400250 conn(0x7f58c00b1f90 msgr2=0x7f58c00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:35.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 -- 172.21.15.112:0/3965400250 shutdown_connections 2024-09-15T23:57:35.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 -- 172.21.15.112:0/3965400250 wait complete. 2024-09-15T23:57:35.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 Processor -- start 2024-09-15T23:57:35.639 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 -- start start 2024-09-15T23:57:35.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58c00af2a0 0x7f58c00999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58c015bec0 0x7f58c0152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c015c2a0 0x7f58c0153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f58c006ed50 con 0x7f58c00af2a0 2024-09-15T23:57:35.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58c00af6b0 con 0x7f58c015c2a0 2024-09-15T23:57:35.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58c5f0b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f58c006eed0 con 0x7f58c015bec0 2024-09-15T23:57:35.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.637+0000 7f58bf7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58c00af2a0 0x7f58c00999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58bf7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58c00af2a0 0x7f58c00999b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39584/0 (socket says 172.21.15.112:39584) 2024-09-15T23:57:35.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58bf7fe640 1 -- 172.21.15.112:0/1524496227 learned_addr learned my addr 172.21.15.112:0/1524496227 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:35.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58beffd640 1 --2- 172.21.15.112:0/1524496227 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58c015bec0 0x7f58c0152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58bffff640 1 --2- 172.21.15.112:0/1524496227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c015c2a0 0x7f58c0153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58bf7fe640 1 -- 172.21.15.112:0/1524496227 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58c015bec0 msgr2=0x7f58c0152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58bf7fe640 1 --2- 172.21.15.112:0/1524496227 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58c015bec0 0x7f58c0152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58bf7fe640 1 -- 172.21.15.112:0/1524496227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c015c2a0 msgr2=0x7f58c0153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58bf7fe640 1 --2- 172.21.15.112:0/1524496227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c015c2a0 0x7f58c0153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58bf7fe640 1 -- 172.21.15.112:0/1524496227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c0165c70 con 0x7f58c00af2a0 2024-09-15T23:57:35.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58bf7fe640 1 --2- 172.21.15.112:0/1524496227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58c00af2a0 0x7f58c00999b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f58b000cb40 tx=0x7f58b000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58a7fff640 1 -- 172.21.15.112:0/1524496227 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b0017070 con 0x7f58c00af2a0 2024-09-15T23:57:35.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58a7fff640 1 -- 172.21.15.112:0/1524496227 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b000aca0 con 0x7f58c00af2a0 2024-09-15T23:57:35.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58c5f0b640 1 -- 172.21.15.112:0/1524496227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c0165f50 con 0x7f58c00af2a0 2024-09-15T23:57:35.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58a7fff640 1 -- 172.21.15.112:0/1524496227 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b0012620 con 0x7f58c00af2a0 2024-09-15T23:57:35.643 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58c5f0b640 1 -- 172.21.15.112:0/1524496227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c01504d0 con 0x7f58c00af2a0 2024-09-15T23:57:35.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58c5f0b640 1 -- 172.21.15.112:0/1524496227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c006e000 con 0x7f58c00af2a0 2024-09-15T23:57:35.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58a7fff640 1 -- 172.21.15.112:0/1524496227 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58b001a070 con 0x7f58c00af2a0 2024-09-15T23:57:35.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58a7fff640 1 --2- 172.21.15.112:0/1524496227 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58ac0678c0 0x7f58ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58beffd640 1 --2- 172.21.15.112:0/1524496227 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58ac0678c0 0x7f58ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58a7fff640 1 -- 172.21.15.112:0/1524496227 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f58b00858f0 con 0x7f58c00af2a0 2024-09-15T23:57:35.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.641+0000 7f58beffd640 1 --2- 172.21.15.112:0/1524496227 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58ac0678c0 0x7f58ac069d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f58b40af000 tx=0x7f58b40b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.645+0000 7f58a7fff640 1 -- 172.21.15.112:0/1524496227 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f58b00565a0 con 0x7f58c00af2a0 2024-09-15T23:57:35.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.809+0000 7f58c5f0b640 1 -- 172.21.15.112:0/1524496227 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58c006fcd0 con 0x7f58c00af2a0 2024-09-15T23:57:35.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.809+0000 7f58a7fff640 1 -- 172.21.15.112:0/1524496227 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+13320 (secure 0 0 0) 0x7f58b0055ea0 con 0x7f58c00af2a0 2024-09-15T23:57:35.811 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:35.811 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":78,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:57:33.476270+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6836/1581911691":"2024-09-16T23:57:30.103564+0000","172.21.15.112:6834/1581911691":"2024-09-16T23:57:30.103564+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:35.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.813+0000 7f58c5f0b640 1 -- 172.21.15.112:0/1524496227 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58ac0678c0 msgr2=0x7f58ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.813+0000 7f58c5f0b640 1 --2- 172.21.15.112:0/1524496227 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58ac0678c0 0x7f58ac069d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f58b40af000 tx=0x7f58b40b6040 comp rx=0 tx=0).stop 2024-09-15T23:57:35.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.813+0000 7f58c5f0b640 1 -- 172.21.15.112:0/1524496227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58c00af2a0 msgr2=0x7f58c00999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.813+0000 7f58c5f0b640 1 --2- 172.21.15.112:0/1524496227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58c00af2a0 0x7f58c00999b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f58b000cb40 tx=0x7f58b000a060 comp rx=0 tx=0).stop 2024-09-15T23:57:35.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.813+0000 7f58c5f0b640 1 -- 172.21.15.112:0/1524496227 shutdown_connections 2024-09-15T23:57:35.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.813+0000 7f58c5f0b640 1 --2- 172.21.15.112:0/1524496227 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f58ac0678c0 0x7f58ac069d80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.813+0000 7f58c5f0b640 1 --2- 172.21.15.112:0/1524496227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c015c2a0 0x7f58c0153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.813+0000 7f58c5f0b640 1 --2- 172.21.15.112:0/1524496227 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58c015bec0 0x7f58c0152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.813+0000 7f58c5f0b640 1 --2- 172.21.15.112:0/1524496227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58c00af2a0 0x7f58c00999b0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.813+0000 7f58c5f0b640 1 -- 172.21.15.112:0/1524496227 >> 172.21.15.112:0/1524496227 conn(0x7f58c00b1f90 msgr2=0x7f58c006f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:35.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.813+0000 7f58c5f0b640 1 -- 172.21.15.112:0/1524496227 shutdown_connections 2024-09-15T23:57:35.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.813+0000 7f58c5f0b640 1 -- 172.21.15.112:0/1524496227 wait complete. 2024-09-15T23:57:35.830 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:53:39.301069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:57:35.830 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:57:35.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397f32d640 1 Processor -- start 2024-09-15T23:57:35.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397f32d640 1 -- start start 2024-09-15T23:57:35.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397f32d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f397815c2a0 0x7f39780aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397f32d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39780af2a0 0x7f397806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397f32d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39780b3290 con 0x7f397815bec0 2024-09-15T23:57:35.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397f32d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f39780b3570 con 0x7f397815c2a0 2024-09-15T23:57:35.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397f32d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f39780b3850 con 0x7f39780af2a0 2024-09-15T23:57:35.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397c8c8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f397815c2a0 0x7f39780aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397d0c9640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f397815bec0 0x7f39780ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43038/0 (socket says 172.21.15.112:43038) 2024-09-15T23:57:35.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397d0c9640 1 -- 172.21.15.112:0/1954083870 learned_addr learned my addr 172.21.15.112:0/1954083870 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:35.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397d8ca640 1 --2- 172.21.15.112:0/1954083870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39780af2a0 0x7f397806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397c8c8640 1 -- 172.21.15.112:0/1954083870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39780af2a0 msgr2=0x7f397806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:35.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397c8c8640 1 --2- 172.21.15.112:0/1954083870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39780af2a0 0x7f397806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397c8c8640 1 -- 172.21.15.112:0/1954083870 >> v1:172.21.15.112:6789/0 conn(0x7f397815bec0 legacy=0x7f39780ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f396ffff640 1 -- 172.21.15.112:0/1954083870 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 77246293 0 0) 0x7f39780b3290 con 0x7f397815bec0 2024-09-15T23:57:35.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.953+0000 7f397c8c8640 1 -- 172.21.15.112:0/1954083870 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39780b3b30 con 0x7f397815c2a0 2024-09-15T23:57:35.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397c8c8640 1 --2- 172.21.15.112:0/1954083870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f397815c2a0 0x7f39780aed60 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f39680097c0 tx=0x7f396801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d1260be2ed765f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f396ffff640 1 -- 172.21.15.112:0/1954083870 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39680a7070 con 0x7f397815c2a0 2024-09-15T23:57:35.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f396ffff640 1 -- 172.21.15.112:0/1954083870 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39680b0070 con 0x7f397815c2a0 2024-09-15T23:57:35.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f396ffff640 1 -- 172.21.15.112:0/1954083870 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39680ab890 con 0x7f397815c2a0 2024-09-15T23:57:35.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 -- 172.21.15.112:0/1954083870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f397815c2a0 msgr2=0x7f39780aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 --2- 172.21.15.112:0/1954083870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f397815c2a0 0x7f39780aed60 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f39680097c0 tx=0x7f396801c470 comp rx=0 tx=0).stop 2024-09-15T23:57:35.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 -- 172.21.15.112:0/1954083870 shutdown_connections 2024-09-15T23:57:35.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 --2- 172.21.15.112:0/1954083870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39780af2a0 0x7f397806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 --2- 172.21.15.112:0/1954083870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f397815c2a0 0x7f39780aed60 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 -- 172.21.15.112:0/1954083870 >> 172.21.15.112:0/1954083870 conn(0x7f39780b1f90 msgr2=0x7f39780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:35.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 -- 172.21.15.112:0/1954083870 shutdown_connections 2024-09-15T23:57:35.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 -- 172.21.15.112:0/1954083870 wait complete. 2024-09-15T23:57:35.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 Processor -- start 2024-09-15T23:57:35.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 -- start start 2024-09-15T23:57:35.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39780af2a0 0x7f3978156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f397815bec0 0x7f39781530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f397815c2a0 0x7f397814a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f397806ed50 con 0x7f39780af2a0 2024-09-15T23:57:35.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39780af6b0 con 0x7f397815c2a0 2024-09-15T23:57:35.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f397806eed0 con 0x7f397815bec0 2024-09-15T23:57:35.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397d0c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39780af2a0 0x7f3978156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397d0c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39780af2a0 0x7f3978156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39616/0 (socket says 172.21.15.112:39616) 2024-09-15T23:57:35.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397d0c9640 1 -- 172.21.15.112:0/4076418252 learned_addr learned my addr 172.21.15.112:0/4076418252 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:35.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397d0c9640 1 -- 172.21.15.112:0/4076418252 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f397815bec0 msgr2=0x7f39781530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397d0c9640 1 --2- 172.21.15.112:0/4076418252 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f397815bec0 0x7f39781530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397d0c9640 1 -- 172.21.15.112:0/4076418252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f397815c2a0 msgr2=0x7f397814a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397d0c9640 1 --2- 172.21.15.112:0/4076418252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f397815c2a0 0x7f397814a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397d0c9640 1 -- 172.21.15.112:0/4076418252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397814b090 con 0x7f39780af2a0 2024-09-15T23:57:35.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397d0c9640 1 --2- 172.21.15.112:0/4076418252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39780af2a0 0x7f3978156fb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f39740011f0 tx=0x7f397400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f396dffb640 1 -- 172.21.15.112:0/4076418252 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974018070 con 0x7f39780af2a0 2024-09-15T23:57:35.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f396dffb640 1 -- 172.21.15.112:0/4076418252 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39740074e0 con 0x7f39780af2a0 2024-09-15T23:57:35.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 -- 172.21.15.112:0/4076418252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397814c3d0 con 0x7f39780af2a0 2024-09-15T23:57:35.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f396dffb640 1 -- 172.21.15.112:0/4076418252 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974004a10 con 0x7f39780af2a0 2024-09-15T23:57:35.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.957+0000 7f397f32d640 1 -- 172.21.15.112:0/4076418252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397814b8f0 con 0x7f39780af2a0 2024-09-15T23:57:35.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.961+0000 7f397f32d640 1 -- 172.21.15.112:0/4076418252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f397806e000 con 0x7f39780af2a0 2024-09-15T23:57:35.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.961+0000 7f396dffb640 1 -- 172.21.15.112:0/4076418252 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f397401b070 con 0x7f39780af2a0 2024-09-15T23:57:35.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.961+0000 7f396dffb640 1 --2- 172.21.15.112:0/4076418252 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f395c0678c0 0x7f395c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.961+0000 7f397c8c8640 1 --2- 172.21.15.112:0/4076418252 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f395c0678c0 0x7f395c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.961+0000 7f396dffb640 1 -- 172.21.15.112:0/4076418252 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f3974084f00 con 0x7f39780af2a0 2024-09-15T23:57:35.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.961+0000 7f397c8c8640 1 --2- 172.21.15.112:0/4076418252 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f395c0678c0 0x7f395c069d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f39680af000 tx=0x7f3968004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:35.965+0000 7f396dffb640 1 -- 172.21.15.112:0/4076418252 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3974055b10 con 0x7f39780af2a0 2024-09-15T23:57:36.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.113+0000 7f397f32d640 1 -- 172.21.15.112:0/4076418252 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f39780755c0 con 0x7f39780af2a0 2024-09-15T23:57:36.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.117+0000 7f396dffb640 1 -- 172.21.15.112:0/4076418252 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f3974055410 con 0x7f39780af2a0 2024-09-15T23:57:36.117 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-15T23:57:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.117+0000 7f397f32d640 1 -- 172.21.15.112:0/4076418252 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f395c0678c0 msgr2=0x7f395c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.117+0000 7f397f32d640 1 --2- 172.21.15.112:0/4076418252 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f395c0678c0 0x7f395c069d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f39680af000 tx=0x7f3968004740 comp rx=0 tx=0).stop 2024-09-15T23:57:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.117+0000 7f397f32d640 1 -- 172.21.15.112:0/4076418252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39780af2a0 msgr2=0x7f3978156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.117+0000 7f397f32d640 1 --2- 172.21.15.112:0/4076418252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39780af2a0 0x7f3978156fb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f39740011f0 tx=0x7f397400c9b0 comp rx=0 tx=0).stop 2024-09-15T23:57:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.117+0000 7f397f32d640 1 -- 172.21.15.112:0/4076418252 shutdown_connections 2024-09-15T23:57:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.117+0000 7f397f32d640 1 --2- 172.21.15.112:0/4076418252 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f395c0678c0 0x7f395c069d80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.117+0000 7f397f32d640 1 --2- 172.21.15.112:0/4076418252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f397815c2a0 0x7f397814a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.117+0000 7f397f32d640 1 --2- 172.21.15.112:0/4076418252 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f397815bec0 0x7f39781530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.117+0000 7f397f32d640 1 --2- 172.21.15.112:0/4076418252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39780af2a0 0x7f3978156fb0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.117+0000 7f397f32d640 1 -- 172.21.15.112:0/4076418252 >> 172.21.15.112:0/4076418252 conn(0x7f39780b1f90 msgr2=0x7f39780cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.117+0000 7f397f32d640 1 -- 172.21.15.112:0/4076418252 shutdown_connections 2024-09-15T23:57:36.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.117+0000 7f397f32d640 1 -- 172.21.15.112:0/4076418252 wait complete. 2024-09-15T23:57:36.135 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_fancy_layout' 2024-09-15T23:57:36.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8fb184640 1 Processor -- start 2024-09-15T23:57:36.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8fb184640 1 -- start start 2024-09-15T23:57:36.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8fb184640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb8f415c2a0 0x7fb8f40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:36.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8fb184640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb8f40af2a0 0x7fb8f406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:36.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8fb184640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f40b3290 con 0x7fb8f415bec0 2024-09-15T23:57:36.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8fb184640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb8f40b3570 con 0x7fb8f415c2a0 2024-09-15T23:57:36.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8fb184640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb8f40b3850 con 0x7fb8f40af2a0 2024-09-15T23:57:36.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8f8f20640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb8f415bec0 0x7fb8f40ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43046/0 (socket says 172.21.15.112:43046) 2024-09-15T23:57:36.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8f8f20640 1 -- 172.21.15.112:0/2970886409 learned_addr learned my addr 172.21.15.112:0/2970886409 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:36.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8f3fff640 1 --2- 172.21.15.112:0/2970886409 >> v2:172.21.15.112:3300/0 conn(0x7fb8f415c2a0 0x7fb8f40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:36.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8f9721640 1 --2- 172.21.15.112:0/2970886409 >> v2:172.21.15.169:3300/0 conn(0x7fb8f40af2a0 0x7fb8f406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:36.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8f37fe640 1 -- 172.21.15.112:0/2970886409 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1167294091 0 0) 0x7fb8f40b3290 con 0x7fb8f415bec0 2024-09-15T23:57:36.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8f37fe640 1 -- 172.21.15.112:0/2970886409 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8dc003530 con 0x7fb8f415bec0 2024-09-15T23:57:36.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8f3fff640 1 -- 172.21.15.112:0/2970886409 >> v2:172.21.15.169:3300/0 conn(0x7fb8f40af2a0 msgr2=0x7fb8f406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:36.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8f3fff640 1 --2- 172.21.15.112:0/2970886409 >> v2:172.21.15.169:3300/0 conn(0x7fb8f40af2a0 0x7fb8f406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:36.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8f3fff640 1 -- 172.21.15.112:0/2970886409 >> v1:172.21.15.112:6789/0 conn(0x7fb8f415bec0 legacy=0x7fb8f40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:36.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.253+0000 7fb8f3fff640 1 -- 172.21.15.112:0/2970886409 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f40b3b30 con 0x7fb8f415c2a0 2024-09-15T23:57:36.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8f3fff640 1 --2- 172.21.15.112:0/2970886409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f415c2a0 0x7fb8f40aed60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb8f40b2fb0 tx=0x7fb8e801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ba773af4ea0d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:36.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8f37fe640 1 -- 172.21.15.112:0/2970886409 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80ab650 con 0x7fb8f415c2a0 2024-09-15T23:57:36.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8f37fe640 1 -- 172.21.15.112:0/2970886409 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e80b0070 con 0x7fb8f415c2a0 2024-09-15T23:57:36.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8f37fe640 1 -- 172.21.15.112:0/2970886409 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80aba10 con 0x7fb8f415c2a0 2024-09-15T23:57:36.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 -- 172.21.15.112:0/2970886409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f415c2a0 msgr2=0x7fb8f40aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:36.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 --2- 172.21.15.112:0/2970886409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f415c2a0 0x7fb8f40aed60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb8f40b2fb0 tx=0x7fb8e801c450 comp rx=0 tx=0).stop 2024-09-15T23:57:36.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 -- 172.21.15.112:0/2970886409 shutdown_connections 2024-09-15T23:57:36.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 --2- 172.21.15.112:0/2970886409 >> v2:172.21.15.169:3300/0 conn(0x7fb8f40af2a0 0x7fb8f406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:36.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 --2- 172.21.15.112:0/2970886409 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f415c2a0 0x7fb8f40aed60 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:36.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 -- 172.21.15.112:0/2970886409 >> 172.21.15.112:0/2970886409 conn(0x7fb8f40b1f90 msgr2=0x7fb8f40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:36.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 -- 172.21.15.112:0/2970886409 shutdown_connections 2024-09-15T23:57:36.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 -- 172.21.15.112:0/2970886409 wait complete. 2024-09-15T23:57:36.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 Processor -- start 2024-09-15T23:57:36.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 -- start start 2024-09-15T23:57:36.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f40af2a0 0x7fb8f414f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:36.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f415bec0 0x7fb8f415d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:36.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f415c2a0 0x7fb8f4152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:36.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f406ed50 con 0x7fb8f415c2a0 2024-09-15T23:57:36.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f40af6b0 con 0x7fb8f415bec0 2024-09-15T23:57:36.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8fb184640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f406eed0 con 0x7fb8f40af2a0 2024-09-15T23:57:36.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8f9721640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f415c2a0 0x7fb8f4152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:36.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8f9721640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f415c2a0 0x7fb8f4152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39644/0 (socket says 172.21.15.112:39644) 2024-09-15T23:57:36.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8f9721640 1 -- 172.21.15.112:0/3648179060 learned_addr learned my addr 172.21.15.112:0/3648179060 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:36.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8f3fff640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f415bec0 0x7fb8f415d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:36.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.257+0000 7fb8f8f20640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f40af2a0 0x7fb8f414f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:36.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f9721640 1 -- 172.21.15.112:0/3648179060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f40af2a0 msgr2=0x7fb8f414f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:36.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f9721640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f40af2a0 0x7fb8f414f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:36.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f9721640 1 -- 172.21.15.112:0/3648179060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f415bec0 msgr2=0x7fb8f415d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:36.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f9721640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f415bec0 0x7fb8f415d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:36.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f9721640 1 -- 172.21.15.112:0/3648179060 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f414fc60 con 0x7fb8f415c2a0 2024-09-15T23:57:36.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f8f20640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f40af2a0 0x7fb8f414f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:36.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f3fff640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f415bec0 0x7fb8f415d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:36.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f9721640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f415c2a0 0x7fb8f4152360 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec007e40 tx=0x7fb8ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:36.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f17fa640 1 -- 172.21.15.112:0/3648179060 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec014620 con 0x7fb8f415c2a0 2024-09-15T23:57:36.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f17fa640 1 -- 172.21.15.112:0/3648179060 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ec019070 con 0x7fb8f415c2a0 2024-09-15T23:57:36.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f17fa640 1 -- 172.21.15.112:0/3648179060 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec014a20 con 0x7fb8f415c2a0 2024-09-15T23:57:36.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8fb184640 1 -- 172.21.15.112:0/3648179060 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f415c890 con 0x7fb8f415c2a0 2024-09-15T23:57:36.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8fb184640 1 -- 172.21.15.112:0/3648179060 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f415ce50 con 0x7fb8f415c2a0 2024-09-15T23:57:36.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8fb184640 1 -- 172.21.15.112:0/3648179060 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f40d0d10 con 0x7fb8f415c2a0 2024-09-15T23:57:36.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f17fa640 1 -- 172.21.15.112:0/3648179060 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb8ec014bc0 con 0x7fb8f415c2a0 2024-09-15T23:57:36.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f17fa640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8e00678c0 0x7fb8e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:36.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f8f20640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8e00678c0 0x7fb8e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:36.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f17fa640 1 -- 172.21.15.112:0/3648179060 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7fb8ec0863a0 con 0x7fb8f415c2a0 2024-09-15T23:57:36.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.261+0000 7fb8f8f20640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8e00678c0 0x7fb8e0069d80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4005890 tx=0x7fb8e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:36.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.265+0000 7fb8f17fa640 1 -- 172.21.15.112:0/3648179060 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb8ec0570e0 con 0x7fb8f415c2a0 2024-09-15T23:57:36.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:36.489+0000 7fb8fb184640 1 -- 172.21.15.112:0/3648179060 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_fancy_layout"]} v 0) -- 0x7fb8f406f1d0 con 0x7fb8f415c2a0 2024-09-15T23:57:37.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.489+0000 7fb8f17fa640 1 -- 172.21.15.112:0/3648179060 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_fancy_layout"]}]=0 v205) ==== 135+0+0 (secure 0 0 0) 0x7fb8ec0569e0 con 0x7fb8f415c2a0 2024-09-15T23:57:37.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.493+0000 7fb8fb184640 1 -- 172.21.15.112:0/3648179060 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8e00678c0 msgr2=0x7fb8e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:37.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.493+0000 7fb8fb184640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8e00678c0 0x7fb8e0069d80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4005890 tx=0x7fb8e4009040 comp rx=0 tx=0).stop 2024-09-15T23:57:37.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.493+0000 7fb8fb184640 1 -- 172.21.15.112:0/3648179060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f415c2a0 msgr2=0x7fb8f4152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:37.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.493+0000 7fb8fb184640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f415c2a0 0x7fb8f4152360 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec007e40 tx=0x7fb8ec00e4b0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.493+0000 7fb8fb184640 1 -- 172.21.15.112:0/3648179060 shutdown_connections 2024-09-15T23:57:37.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.493+0000 7fb8fb184640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8e00678c0 0x7fb8e0069d80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.493+0000 7fb8fb184640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f415c2a0 0x7fb8f4152360 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.493+0000 7fb8fb184640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f415bec0 0x7fb8f415d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.493+0000 7fb8fb184640 1 --2- 172.21.15.112:0/3648179060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f40af2a0 0x7fb8f414f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.493+0000 7fb8fb184640 1 -- 172.21.15.112:0/3648179060 >> 172.21.15.112:0/3648179060 conn(0x7fb8f40b1f90 msgr2=0x7fb8f40aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:37.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.493+0000 7fb8fb184640 1 -- 172.21.15.112:0/3648179060 shutdown_connections 2024-09-15T23:57:37.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.493+0000 7fb8fb184640 1 -- 172.21.15.112:0/3648179060 wait complete. 2024-09-15T23:57:37.515 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:57:37.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4f0242d640 1 Processor -- start 2024-09-15T23:57:37.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4f0242d640 1 -- start start 2024-09-15T23:57:37.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4f0242d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4efc15bec0 0x7f4efc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:37.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4f0242d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4efc0af470 0x7f4efc06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:37.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4f0242d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4efc0b3290 con 0x7f4efc15c2a0 2024-09-15T23:57:37.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4f0242d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f4efc0b3570 con 0x7f4efc0af470 2024-09-15T23:57:37.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4f0242d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4efc0b3850 con 0x7f4efc15bec0 2024-09-15T23:57:37.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efb7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4efc15c2a0 0x7f4efc0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43054/0 (socket says 172.21.15.112:43054) 2024-09-15T23:57:37.642 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efb7fe640 1 -- 172.21.15.112:0/2479954137 learned_addr learned my addr 172.21.15.112:0/2479954137 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:37.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efbfff640 1 --2- 172.21.15.112:0/2479954137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4efc15bec0 0x7f4efc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:37.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4f009ca640 1 --2- 172.21.15.112:0/2479954137 >> v2:172.21.15.169:3300/0 conn(0x7f4efc0af470 0x7f4efc06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:37.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 -- 172.21.15.112:0/2479954137 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215497309 0 0) 0x7f4efc0b3290 con 0x7f4efc15c2a0 2024-09-15T23:57:37.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 -- 172.21.15.112:0/2479954137 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ee4003530 con 0x7f4efc15c2a0 2024-09-15T23:57:37.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 -- 172.21.15.112:0/2479954137 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 965943377 0 0) 0x7f4ee4003530 con 0x7f4efc15c2a0 2024-09-15T23:57:37.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 -- 172.21.15.112:0/2479954137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4efc15bec0 msgr2=0x7f4efc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:37.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 --2- 172.21.15.112:0/2479954137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4efc15bec0 0x7f4efc0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 -- 172.21.15.112:0/2479954137 >> v2:172.21.15.169:3300/0 conn(0x7f4efc0af470 msgr2=0x7f4efc06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:37.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 --2- 172.21.15.112:0/2479954137 >> v2:172.21.15.169:3300/0 conn(0x7f4efc0af470 0x7f4efc06e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 -- 172.21.15.112:0/2479954137 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4efc0b3b30 con 0x7f4efc15c2a0 2024-09-15T23:57:37.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 -- 172.21.15.112:0/2479954137 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f4ef0001680 con 0x7f4efc15c2a0 2024-09-15T23:57:37.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 -- 172.21.15.112:0/2479954137 >> v1:172.21.15.112:6789/0 conn(0x7f4efc15c2a0 legacy=0x7f4efc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:37.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 --2- 172.21.15.112:0/2479954137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee40039c0 0x7f4ee4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:37.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 --2- 172.21.15.112:0/2479954137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ee4004810 0x7f4ee4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:37.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 --2- 172.21.15.112:0/2479954137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4efc15bec0 0x7f4ee40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:37.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 -- 172.21.15.112:0/2479954137 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc0b3570 con 0x7f4ee4004810 2024-09-15T23:57:37.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 -- 172.21.15.112:0/2479954137 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc0b3850 con 0x7f4ee40039c0 2024-09-15T23:57:37.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efaffd640 1 -- 172.21.15.112:0/2479954137 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee400b9d0 con 0x7f4efc15bec0 2024-09-15T23:57:37.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efb7fe640 1 --2- 172.21.15.112:0/2479954137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ee4004810 0x7f4ee4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:37.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efb7fe640 1 -- 172.21.15.112:0/2479954137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4efc15bec0 msgr2=0x7f4ee40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:37.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efb7fe640 1 --2- 172.21.15.112:0/2479954137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4efc15bec0 0x7f4ee40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efbfff640 1 --2- 172.21.15.112:0/2479954137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee40039c0 0x7f4ee4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:37.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efb7fe640 1 -- 172.21.15.112:0/2479954137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee40039c0 msgr2=0x7f4ee4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:37.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efb7fe640 1 --2- 172.21.15.112:0/2479954137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee40039c0 0x7f4ee4003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.641+0000 7f4efb7fe640 1 -- 172.21.15.112:0/2479954137 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee4003530 con 0x7f4ee4004810 2024-09-15T23:57:37.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4efb7fe640 1 --2- 172.21.15.112:0/2479954137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ee4004810 0x7f4ee4004c90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4efc06da50 tx=0x7f4ef001f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16cd13c9889c7e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:37.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4efaffd640 1 -- 172.21.15.112:0/2479954137 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0007c70 con 0x7f4ee4004810 2024-09-15T23:57:37.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4efaffd640 1 -- 172.21.15.112:0/2479954137 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef00ac020 con 0x7f4ee4004810 2024-09-15T23:57:37.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4efaffd640 1 -- 172.21.15.112:0/2479954137 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00a8e10 con 0x7f4ee4004810 2024-09-15T23:57:37.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f0242d640 1 -- 172.21.15.112:0/2479954137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ee4004810 msgr2=0x7f4ee4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:37.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f0242d640 1 --2- 172.21.15.112:0/2479954137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ee4004810 0x7f4ee4004c90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4efc06da50 tx=0x7f4ef001f270 comp rx=0 tx=0).stop 2024-09-15T23:57:37.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f009ca640 1 -- 172.21.15.112:0/2479954137 reap_dead start 2024-09-15T23:57:37.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f0242d640 1 -- 172.21.15.112:0/2479954137 shutdown_connections 2024-09-15T23:57:37.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f0242d640 1 -- 172.21.15.112:0/2479954137 >> 172.21.15.112:0/2479954137 conn(0x7f4efc0b1f90 msgr2=0x7f4efc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:37.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f0242d640 1 -- 172.21.15.112:0/2479954137 shutdown_connections 2024-09-15T23:57:37.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f0242d640 1 -- 172.21.15.112:0/2479954137 wait complete. 2024-09-15T23:57:37.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f0242d640 1 Processor -- start 2024-09-15T23:57:37.648 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f0242d640 1 -- start start 2024-09-15T23:57:37.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f0242d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee4004810 0x7f4efc1517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:37.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f0242d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4efc09a280 0x7f4efc09cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:37.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f0242d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4efc0b4a60 0x7f4efc0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:37.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f0242d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc0afc90 con 0x7f4efc09a280 2024-09-15T23:57:37.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f0242d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc0b40f0 con 0x7f4ee4004810 2024-09-15T23:57:37.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4f0242d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4efc0ad200 con 0x7f4efc0b4a60 2024-09-15T23:57:37.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.645+0000 7f4efb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4efc09a280 0x7f4efc09cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:37.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4efb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4efc09a280 0x7f4efc09cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39662/0 (socket says 172.21.15.112:39662) 2024-09-15T23:57:37.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4efb7fe640 1 -- 172.21.15.112:0/1889932770 learned_addr learned my addr 172.21.15.112:0/1889932770 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:37.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4f009ca640 1 --2- 172.21.15.112:0/1889932770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4efc0b4a60 0x7f4efc0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:37.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4efb7fe640 1 -- 172.21.15.112:0/1889932770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4efc0b4a60 msgr2=0x7f4efc0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:37.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4efb7fe640 1 --2- 172.21.15.112:0/1889932770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4efc0b4a60 0x7f4efc0b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4efb7fe640 1 -- 172.21.15.112:0/1889932770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee4004810 msgr2=0x7f4efc1517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:37.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4efbfff640 1 --2- 172.21.15.112:0/1889932770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee4004810 0x7f4efc1517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:37.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4efb7fe640 1 --2- 172.21.15.112:0/1889932770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee4004810 0x7f4efc1517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4efb7fe640 1 -- 172.21.15.112:0/1889932770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4efc09a780 con 0x7f4efc09a280 2024-09-15T23:57:37.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4efb7fe640 1 --2- 172.21.15.112:0/1889932770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4efc09a280 0x7f4efc09cab0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0007040 tx=0x7f4ee4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:37.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4ef8ff9640 1 -- 172.21.15.112:0/1889932770 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00049f0 con 0x7f4efc09a280 2024-09-15T23:57:37.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4ef8ff9640 1 -- 172.21.15.112:0/1889932770 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef0004b90 con 0x7f4efc09a280 2024-09-15T23:57:37.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4f0242d640 1 -- 172.21.15.112:0/1889932770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4efc09aa60 con 0x7f4efc09a280 2024-09-15T23:57:37.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4ef8ff9640 1 -- 172.21.15.112:0/1889932770 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00070d0 con 0x7f4efc09a280 2024-09-15T23:57:37.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4f0242d640 1 -- 172.21.15.112:0/1889932770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4efc09b020 con 0x7f4efc09a280 2024-09-15T23:57:37.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4f0242d640 1 -- 172.21.15.112:0/1889932770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4efc0ad610 con 0x7f4efc09a280 2024-09-15T23:57:37.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4ef8ff9640 1 -- 172.21.15.112:0/1889932770 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ef0007270 con 0x7f4efc09a280 2024-09-15T23:57:37.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4ef8ff9640 1 --2- 172.21.15.112:0/1889932770 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4ee80678f0 0x7f4ee8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:37.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4efbfff640 1 --2- 172.21.15.112:0/1889932770 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4ee80678f0 0x7f4ee8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:37.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4ef8ff9640 1 -- 172.21.15.112:0/1889932770 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f4ef0122fa0 con 0x7f4efc09a280 2024-09-15T23:57:37.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.649+0000 7f4efbfff640 1 --2- 172.21.15.112:0/1889932770 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4ee80678f0 0x7f4ee8069db0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009850 tx=0x7f4eec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:37.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.653+0000 7f4ef8ff9640 1 -- 172.21.15.112:0/1889932770 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4ef0018fe0 con 0x7f4efc09a280 2024-09-15T23:57:37.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.805+0000 7f4f0242d640 1 -- 172.21.15.112:0/1889932770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f4efc151d50 con 0x7f4efc09a280 2024-09-15T23:57:37.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.809+0000 7f4ef8ff9640 1 -- 172.21.15.112:0/1889932770 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f4ef00f3ce0 con 0x7f4efc09a280 2024-09-15T23:57:37.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.813+0000 7f4f0242d640 1 -- 172.21.15.112:0/1889932770 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4ee80678f0 msgr2=0x7f4ee8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:37.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.813+0000 7f4f0242d640 1 --2- 172.21.15.112:0/1889932770 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4ee80678f0 0x7f4ee8069db0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009850 tx=0x7f4eec008040 comp rx=0 tx=0).stop 2024-09-15T23:57:37.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.813+0000 7f4f0242d640 1 -- 172.21.15.112:0/1889932770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4efc09a280 msgr2=0x7f4efc09cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:37.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.813+0000 7f4f0242d640 1 --2- 172.21.15.112:0/1889932770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4efc09a280 0x7f4efc09cab0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0007040 tx=0x7f4ee4005840 comp rx=0 tx=0).stop 2024-09-15T23:57:37.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.813+0000 7f4f0242d640 1 -- 172.21.15.112:0/1889932770 shutdown_connections 2024-09-15T23:57:37.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.813+0000 7f4f0242d640 1 --2- 172.21.15.112:0/1889932770 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4ee80678f0 0x7f4ee8069db0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.813+0000 7f4f0242d640 1 --2- 172.21.15.112:0/1889932770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4efc0b4a60 0x7f4efc0b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.813+0000 7f4f0242d640 1 --2- 172.21.15.112:0/1889932770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4efc09a280 0x7f4efc09cab0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.813+0000 7f4f0242d640 1 --2- 172.21.15.112:0/1889932770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ee4004810 0x7f4efc1517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.813+0000 7f4f0242d640 1 -- 172.21.15.112:0/1889932770 >> 172.21.15.112:0/1889932770 conn(0x7f4efc0b1f90 msgr2=0x7f4efc15a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:37.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.813+0000 7f4f0242d640 1 -- 172.21.15.112:0/1889932770 shutdown_connections 2024-09-15T23:57:37.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:37.813+0000 7f4f0242d640 1 -- 172.21.15.112:0/1889932770 wait complete. 2024-09-15T23:57:37.830 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:57:37.830 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:57:37.909 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:57:37.976 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:57:37.976 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:57:37.976 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:37.982 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:57:37.982 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:57:37.982 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:37.987 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:57:37.988 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:57:37.988 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:38.029 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:57:38.029 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:57:38.029 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:38.035 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:57:38.036 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:57:38.036 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:38.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c0e931640 1 Processor -- start 2024-09-15T23:57:38.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c0e931640 1 -- start start 2024-09-15T23:57:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c0e931640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1c081587a0 0x7f1c080b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c0e931640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c080b37d0 0x7f1c0806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c0e931640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c0806ec60 con 0x7f1c0806e4b0 2024-09-15T23:57:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c0e931640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1c080b3c40 con 0x7f1c080b37d0 2024-09-15T23:57:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c0e931640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1c0806f870 con 0x7f1c081587a0 2024-09-15T23:57:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c077fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c080b37d0 0x7f1c0806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c077fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1c080b37d0 0x7f1c0806df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39670/0 (socket says 172.21.15.112:39670) 2024-09-15T23:57:38.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c077fe640 1 -- 172.21.15.112:0/2199629963 learned_addr learned my addr 172.21.15.112:0/2199629963 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:38.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c077fe640 1 -- 172.21.15.112:0/2199629963 >> v2:172.21.15.169:3300/0 conn(0x7f1c081587a0 msgr2=0x7f1c080b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:38.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c077fe640 1 --2- 172.21.15.112:0/2199629963 >> v2:172.21.15.169:3300/0 conn(0x7f1c081587a0 0x7f1c080b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c077fe640 1 -- 172.21.15.112:0/2199629963 >> v1:172.21.15.169:6789/0 conn(0x7f1c0806e4b0 legacy=0x7f1c08161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:38.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c077fe640 1 -- 172.21.15.112:0/2199629963 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0806ef40 con 0x7f1c080b37d0 2024-09-15T23:57:38.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.193+0000 7f1c077fe640 1 --2- 172.21.15.112:0/2199629963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c080b37d0 0x7f1c0806df70 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1c08071710 tx=0x7f1bf001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3e037d0fb95c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c06ffd640 1 -- 172.21.15.112:0/2199629963 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf00b1070 con 0x7f1c080b37d0 2024-09-15T23:57:38.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c06ffd640 1 -- 172.21.15.112:0/2199629963 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf00ac630 con 0x7f1c080b37d0 2024-09-15T23:57:38.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c06ffd640 1 -- 172.21.15.112:0/2199629963 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf00a8050 con 0x7f1c080b37d0 2024-09-15T23:57:38.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 -- 172.21.15.112:0/2199629963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c080b37d0 msgr2=0x7f1c0806df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 --2- 172.21.15.112:0/2199629963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c080b37d0 0x7f1c0806df70 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1c08071710 tx=0x7f1bf001c4b0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 -- 172.21.15.112:0/2199629963 shutdown_connections 2024-09-15T23:57:38.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 --2- 172.21.15.112:0/2199629963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c080b37d0 0x7f1c0806df70 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 --2- 172.21.15.112:0/2199629963 >> v2:172.21.15.169:3300/0 conn(0x7f1c081587a0 0x7f1c080b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 -- 172.21.15.112:0/2199629963 >> 172.21.15.112:0/2199629963 conn(0x7f1c080b1f90 msgr2=0x7f1c080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:38.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 -- 172.21.15.112:0/2199629963 shutdown_connections 2024-09-15T23:57:38.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 -- 172.21.15.112:0/2199629963 wait complete. 2024-09-15T23:57:38.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 Processor -- start 2024-09-15T23:57:38.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 -- start start 2024-09-15T23:57:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c0806e4b0 0x7f1c0815eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c080b37d0 0x7f1c081fa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c081587a0 0x7f1c081fae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1c08158b80 con 0x7f1c080b37d0 2024-09-15T23:57:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c08073170 con 0x7f1c0806e4b0 2024-09-15T23:57:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1c0809e340 con 0x7f1c081587a0 2024-09-15T23:57:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c077fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c080b37d0 0x7f1c081fa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c077fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c080b37d0 0x7f1c081fa940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39680/0 (socket says 172.21.15.112:39680) 2024-09-15T23:57:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c077fe640 1 -- 172.21.15.112:0/743911526 learned_addr learned my addr 172.21.15.112:0/743911526 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c077fe640 1 -- 172.21.15.112:0/743911526 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c081587a0 msgr2=0x7f1c081fae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c077fe640 1 --2- 172.21.15.112:0/743911526 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c081587a0 0x7f1c081fae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c077fe640 1 -- 172.21.15.112:0/743911526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c0806e4b0 msgr2=0x7f1c0815eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c077fe640 1 --2- 172.21.15.112:0/743911526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c0806e4b0 0x7f1c0815eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c077fe640 1 -- 172.21.15.112:0/743911526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c08159030 con 0x7f1c080b37d0 2024-09-15T23:57:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c077fe640 1 --2- 172.21.15.112:0/743911526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c080b37d0 0x7f1c081fa940 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00af040 tx=0x7f1bf0019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c04ff9640 1 -- 172.21.15.112:0/743911526 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf00b1040 con 0x7f1c080b37d0 2024-09-15T23:57:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c04ff9640 1 -- 172.21.15.112:0/743911526 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf00bc070 con 0x7f1c080b37d0 2024-09-15T23:57:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c04ff9640 1 -- 172.21.15.112:0/743911526 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf00a8040 con 0x7f1c080b37d0 2024-09-15T23:57:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 -- 172.21.15.112:0/743911526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c08147d80 con 0x7f1c080b37d0 2024-09-15T23:57:38.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.197+0000 7f1c0e931640 1 -- 172.21.15.112:0/743911526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c08147860 con 0x7f1c080b37d0 2024-09-15T23:57:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.201+0000 7f1c0e931640 1 -- 172.21.15.112:0/743911526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c08159510 con 0x7f1c080b37d0 2024-09-15T23:57:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.201+0000 7f1c04ff9640 1 -- 172.21.15.112:0/743911526 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1bf00b5870 con 0x7f1c080b37d0 2024-09-15T23:57:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.201+0000 7f1c04ff9640 1 --2- 172.21.15.112:0/743911526 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1be80678c0 0x7f1be8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.201+0000 7f1c04ff9640 1 -- 172.21.15.112:0/743911526 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f1bf011faa0 con 0x7f1c080b37d0 2024-09-15T23:57:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.201+0000 7f1c07fff640 1 --2- 172.21.15.112:0/743911526 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1be80678c0 0x7f1be8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.201+0000 7f1c07fff640 1 --2- 172.21.15.112:0/743911526 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1be80678c0 0x7f1be8069d80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009690 tx=0x7f1bf8006c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.205+0000 7f1c04ff9640 1 -- 172.21.15.112:0/743911526 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1bf00160d0 con 0x7f1c080b37d0 2024-09-15T23:57:38.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.401+0000 7f1c0e931640 1 -- 172.21.15.112:0/743911526 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c08070080 con 0x7f1c080b37d0 2024-09-15T23:57:38.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.401+0000 7f1c04ff9640 1 -- 172.21.15.112:0/743911526 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+3914 (secure 0 0 0) 0x7f1bf00f06b0 con 0x7f1c080b37d0 2024-09-15T23:57:38.401 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:38.401 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":39,"btime":"2024-09-15T23:57:31:106529+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/2072637952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2072637952},{"type":"v1","addr":"172.21.15.169:6833","nonce":2072637952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/33750051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":33750051},{"type":"v1","addr":"172.21.15.169:6835","nonce":33750051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6018,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/4092393174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":4092393174},{"type":"v1","addr":"172.21.15.112:6837","nonce":4092393174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6297,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/941884386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":941884386},{"type":"v1","addr":"172.21.15.112:6836","nonce":941884386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[]} 2024-09-15T23:57:38.402 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 39 2024-09-15T23:57:38.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.401+0000 7f1c0e931640 1 -- 172.21.15.112:0/743911526 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1be80678c0 msgr2=0x7f1be8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.401+0000 7f1c0e931640 1 --2- 172.21.15.112:0/743911526 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1be80678c0 0x7f1be8069d80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009690 tx=0x7f1bf8006c00 comp rx=0 tx=0).stop 2024-09-15T23:57:38.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.401+0000 7f1c0e931640 1 -- 172.21.15.112:0/743911526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c080b37d0 msgr2=0x7f1c081fa940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.401+0000 7f1c0e931640 1 --2- 172.21.15.112:0/743911526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c080b37d0 0x7f1c081fa940 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00af040 tx=0x7f1bf0019250 comp rx=0 tx=0).stop 2024-09-15T23:57:38.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.401+0000 7f1c0e931640 1 -- 172.21.15.112:0/743911526 shutdown_connections 2024-09-15T23:57:38.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.401+0000 7f1c0e931640 1 --2- 172.21.15.112:0/743911526 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1be80678c0 0x7f1be8069d80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.401+0000 7f1c0e931640 1 --2- 172.21.15.112:0/743911526 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1c081587a0 0x7f1c081fae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.401+0000 7f1c0e931640 1 --2- 172.21.15.112:0/743911526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c080b37d0 0x7f1c081fa940 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.401+0000 7f1c0e931640 1 --2- 172.21.15.112:0/743911526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c0806e4b0 0x7f1c0815eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.401+0000 7f1c0e931640 1 -- 172.21.15.112:0/743911526 >> 172.21.15.112:0/743911526 conn(0x7f1c080b1f90 msgr2=0x7f1c080af040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:38.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.401+0000 7f1c0e931640 1 -- 172.21.15.112:0/743911526 shutdown_connections 2024-09-15T23:57:38.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.401+0000 7f1c0e931640 1 -- 172.21.15.112:0/743911526 wait complete. 2024-09-15T23:57:38.421 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:57:38.421 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:57:38.421 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:57:38.422 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:57:38.422 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:57:38.422 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:57:38.422 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:57:38.422 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:57:38.422 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:57:38.422 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:57:38.423 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:57:38.423 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:57:38.423 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:57:38.423 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:57:38.423 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:57:38.423 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:57:38.431 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:57:38.431 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:57:38.433 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:57:38.433 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:57:38.437 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:57:38.437 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:57:38.438 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:57:38.438 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:57:38.480 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:57:38.480 DEBUG:teuthology.parallel:result is None 2024-09-15T23:57:38.480 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:57:38.481 DEBUG:teuthology.parallel:result is None 2024-09-15T23:57:38.481 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:57:38.482 DEBUG:teuthology.parallel:result is None 2024-09-15T23:57:38.482 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:57:38.483 DEBUG:teuthology.parallel:result is None 2024-09-15T23:57:38.483 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:57:38.541 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-15T23:57:38.548 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-15T23:57:38.554 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-09-15T23:57:38.554 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-15T23:57:38.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86fdde4640 1 Processor -- start 2024-09-15T23:57:38.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86fdde4640 1 -- start start 2024-09-15T23:57:38.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86fdde4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f80b4b20 0x7f86f8141030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86fdde4640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f813fb30 con 0x7f86f8140bd0 2024-09-15T23:57:38.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86fdde4640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f813fe10 con 0x7f86f8156720 2024-09-15T23:57:38.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86fdde4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f86f8141570 con 0x7f86f80b4b20 2024-09-15T23:57:38.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86eeffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f86f8140bd0 0x7f86f80b4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:42926/0 (socket says 172.21.15.112:42926) 2024-09-15T23:57:38.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86eeffd640 1 -- 172.21.15.112:0/1033571629 learned_addr learned my addr 172.21.15.112:0/1033571629 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:38.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f7fff640 1 --2- 172.21.15.112:0/1033571629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f80b4b20 0x7f86f8141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5827571 0 0) 0x7f86f813fb30 con 0x7f86f8140bd0 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86e4003530 con 0x7f86f8140bd0 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2802672337 0 0) 0x7f86f813fe10 con 0x7f86f8156720 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86f813fb30 con 0x7f86f8156720 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1690921740 0 0) 0x7f86e4003530 con 0x7f86f8140bd0 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f80b4b20 msgr2=0x7f86f8141030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 --2- 172.21.15.112:0/1033571629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f80b4b20 0x7f86f8141030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 >> v1:172.21.15.169:6789/0 conn(0x7f86f8156720 legacy=0x7f86f80b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f81400f0 con 0x7f86f8140bd0 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f86e0001680 con 0x7f86f8140bd0 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f7fff640 1 --2- 172.21.15.112:0/1033571629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f80b4b20 0x7f86f8141030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 >> v1:172.21.15.112:6789/0 conn(0x7f86f8140bd0 legacy=0x7f86f80b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 --2- 172.21.15.112:0/1033571629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e4003b80 0x7f86e4003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 --2- 172.21.15.112:0/1033571629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86e4004810 0x7f86e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 --2- 172.21.15.112:0/1033571629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f80b4b20 0x7f86e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f86e400ba00 con 0x7f86e4003b80 2024-09-15T23:57:38.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86e400bbb0 con 0x7f86e4004810 2024-09-15T23:57:38.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f86e400bdb0 con 0x7f86f80b4b20 2024-09-15T23:57:38.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f77fe640 1 --2- 172.21.15.112:0/1033571629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e4003b80 0x7f86e4003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f7fff640 1 --2- 172.21.15.112:0/1033571629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f80b4b20 0x7f86e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86eeffd640 1 --2- 172.21.15.112:0/1033571629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86e4004810 0x7f86e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f77fe640 1 -- 172.21.15.112:0/1033571629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f80b4b20 msgr2=0x7f86e40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:38.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f77fe640 1 --2- 172.21.15.112:0/1033571629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f80b4b20 0x7f86e40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f77fe640 1 -- 172.21.15.112:0/1033571629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86e4004810 msgr2=0x7f86e4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:38.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f77fe640 1 --2- 172.21.15.112:0/1033571629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86e4004810 0x7f86e4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f77fe640 1 -- 172.21.15.112:0/1033571629 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e4003530 con 0x7f86e4003b80 2024-09-15T23:57:38.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.593+0000 7f86f7fff640 1 --2- 172.21.15.112:0/1033571629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f80b4b20 0x7f86e40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:57:38.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86f77fe640 1 --2- 172.21.15.112:0/1033571629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e4003b80 0x7f86e4003f80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f86e8007fd0 tx=0x7f86e801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5726ec8d9c4e2965 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8001520 con 0x7f86e4003b80 2024-09-15T23:57:38.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e80052f0 con 0x7f86e4003b80 2024-09-15T23:57:38.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86f6ffd640 1 -- 172.21.15.112:0/1033571629 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8003840 con 0x7f86e4003b80 2024-09-15T23:57:38.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 -- 172.21.15.112:0/1033571629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e4003b80 msgr2=0x7f86e4003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 --2- 172.21.15.112:0/1033571629 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86e4003b80 0x7f86e4003f80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f86e8007fd0 tx=0x7f86e801c540 comp rx=0 tx=0).stop 2024-09-15T23:57:38.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86f7fff640 1 -- 172.21.15.112:0/1033571629 reap_dead start 2024-09-15T23:57:38.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 -- 172.21.15.112:0/1033571629 shutdown_connections 2024-09-15T23:57:38.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 -- 172.21.15.112:0/1033571629 >> 172.21.15.112:0/1033571629 conn(0x7f86f806c0c0 msgr2=0x7f86f806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:38.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 -- 172.21.15.112:0/1033571629 shutdown_connections 2024-09-15T23:57:38.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 -- 172.21.15.112:0/1033571629 wait complete. 2024-09-15T23:57:38.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 Processor -- start 2024-09-15T23:57:38.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 -- start start 2024-09-15T23:57:38.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86e4003b80 0x7f86f80cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86f81590d0 0x7f86f8159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f812b3e0 0x7f86f812b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f86f81413c0 con 0x7f86f81590d0 2024-09-15T23:57:38.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86f8140740 con 0x7f86e4003b80 2024-09-15T23:57:38.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f86f813f6e0 con 0x7f86f812b3e0 2024-09-15T23:57:38.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86eeffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86f81590d0 0x7f86f8159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86eeffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86f81590d0 0x7f86f8159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49810/0 (socket says 172.21.15.112:49810) 2024-09-15T23:57:38.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86eeffd640 1 -- 172.21.15.112:0/924560024 learned_addr learned my addr 172.21.15.112:0/924560024 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:38.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86f77fe640 1 --2- 172.21.15.112:0/924560024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86e4003b80 0x7f86f80cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86f7fff640 1 --2- 172.21.15.112:0/924560024 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f812b3e0 0x7f86f812b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86eeffd640 1 -- 172.21.15.112:0/924560024 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f812b3e0 msgr2=0x7f86f812b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86eeffd640 1 --2- 172.21.15.112:0/924560024 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f812b3e0 0x7f86f812b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86eeffd640 1 -- 172.21.15.112:0/924560024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86e4003b80 msgr2=0x7f86f80cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86eeffd640 1 --2- 172.21.15.112:0/924560024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86e4003b80 0x7f86f80cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86eeffd640 1 -- 172.21.15.112:0/924560024 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f812c150 con 0x7f86f81590d0 2024-09-15T23:57:38.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86eeffd640 1 --2- 172.21.15.112:0/924560024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86f81590d0 0x7f86f8159550 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f86e000e7b0 tx=0x7f86e000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86f4ff9640 1 -- 172.21.15.112:0/924560024 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e000ee60 con 0x7f86f81590d0 2024-09-15T23:57:38.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86f4ff9640 1 -- 172.21.15.112:0/924560024 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e0018070 con 0x7f86f81590d0 2024-09-15T23:57:38.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 -- 172.21.15.112:0/924560024 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f812c430 con 0x7f86f81590d0 2024-09-15T23:57:38.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86f4ff9640 1 -- 172.21.15.112:0/924560024 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e000cb10 con 0x7f86f81590d0 2024-09-15T23:57:38.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.597+0000 7f86fdde4640 1 -- 172.21.15.112:0/924560024 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f812c9f0 con 0x7f86f81590d0 2024-09-15T23:57:38.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.601+0000 7f86fdde4640 1 -- 172.21.15.112:0/924560024 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f8069170 con 0x7f86f81590d0 2024-09-15T23:57:38.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.601+0000 7f86f4ff9640 1 -- 172.21.15.112:0/924560024 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f86e000ccb0 con 0x7f86f81590d0 2024-09-15T23:57:38.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.601+0000 7f86f4ff9640 1 --2- 172.21.15.112:0/924560024 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86d80678c0 0x7f86d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.601+0000 7f86f4ff9640 1 -- 172.21.15.112:0/924560024 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f86e00858d0 con 0x7f86f81590d0 2024-09-15T23:57:38.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.601+0000 7f86f77fe640 1 --2- 172.21.15.112:0/924560024 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86d80678c0 0x7f86d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.601+0000 7f86f77fe640 1 --2- 172.21.15.112:0/924560024 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86d80678c0 0x7f86d8069d80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f86e80ac000 tx=0x7f86e80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.605+0000 7f86f4ff9640 1 -- 172.21.15.112:0/924560024 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f86e0056580 con 0x7f86f81590d0 2024-09-15T23:57:38.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:38.777+0000 7f86fdde4640 1 -- 172.21.15.112:0/924560024 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f86f80b72d0 con 0x7f86f81590d0 2024-09-15T23:57:39.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.509+0000 7f86f4ff9640 1 -- 172.21.15.112:0/924560024 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v80) ==== 97+0+0 (secure 0 0 0) 0x7f86e0055e80 con 0x7f86f81590d0 2024-09-15T23:57:39.509 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-15T23:57:39.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.513+0000 7f86fdde4640 1 -- 172.21.15.112:0/924560024 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86d80678c0 msgr2=0x7f86d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:39.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.513+0000 7f86fdde4640 1 --2- 172.21.15.112:0/924560024 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86d80678c0 0x7f86d8069d80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f86e80ac000 tx=0x7f86e80a6000 comp rx=0 tx=0).stop 2024-09-15T23:57:39.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.513+0000 7f86fdde4640 1 -- 172.21.15.112:0/924560024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86f81590d0 msgr2=0x7f86f8159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:39.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.513+0000 7f86fdde4640 1 --2- 172.21.15.112:0/924560024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86f81590d0 0x7f86f8159550 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f86e000e7b0 tx=0x7f86e000ec70 comp rx=0 tx=0).stop 2024-09-15T23:57:39.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.513+0000 7f86fdde4640 1 -- 172.21.15.112:0/924560024 shutdown_connections 2024-09-15T23:57:39.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.513+0000 7f86fdde4640 1 --2- 172.21.15.112:0/924560024 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86d80678c0 0x7f86d8069d80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.513+0000 7f86fdde4640 1 --2- 172.21.15.112:0/924560024 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86f812b3e0 0x7f86f812b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.513+0000 7f86fdde4640 1 --2- 172.21.15.112:0/924560024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86f81590d0 0x7f86f8159550 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.513+0000 7f86fdde4640 1 --2- 172.21.15.112:0/924560024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86e4003b80 0x7f86f80cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.513+0000 7f86fdde4640 1 -- 172.21.15.112:0/924560024 >> 172.21.15.112:0/924560024 conn(0x7f86f806c0c0 msgr2=0x7f86f80d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:39.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.513+0000 7f86fdde4640 1 -- 172.21.15.112:0/924560024 shutdown_connections 2024-09-15T23:57:39.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.513+0000 7f86fdde4640 1 -- 172.21.15.112:0/924560024 wait complete. 2024-09-15T23:57:39.537 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:57:39.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.661+0000 7fc4d97a0640 1 Processor -- start 2024-09-15T23:57:39.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.661+0000 7fc4d97a0640 1 -- start start 2024-09-15T23:57:39.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.661+0000 7fc4d97a0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc4d415c2a0 0x7fc4d40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:39.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.661+0000 7fc4d97a0640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d40b3290 con 0x7fc4d415bec0 2024-09-15T23:57:39.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.661+0000 7fc4d97a0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d40b3570 con 0x7fc4d40af2a0 2024-09-15T23:57:39.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.661+0000 7fc4d97a0640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d40b3850 con 0x7fc4d415c2a0 2024-09-15T23:57:39.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.661+0000 7fc4d27fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc4d415c2a0 0x7fc4d40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:39.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.661+0000 7fc4d2ffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc4d415bec0 0x7fc4d40ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:42940/0 (socket says 172.21.15.112:42940) 2024-09-15T23:57:39.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.661+0000 7fc4d2ffd640 1 -- 172.21.15.112:0/70226196 learned_addr learned my addr 172.21.15.112:0/70226196 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:39.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.661+0000 7fc4d1ffb640 1 -- 172.21.15.112:0/70226196 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3269241803 0 0) 0x7fc4d40b3290 con 0x7fc4d415bec0 2024-09-15T23:57:39.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.661+0000 7fc4d1ffb640 1 -- 172.21.15.112:0/70226196 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4bc003530 con 0x7fc4d415bec0 2024-09-15T23:57:39.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.661+0000 7fc4d27fc640 1 -- 172.21.15.112:0/70226196 >> v1:172.21.15.169:6789/0 conn(0x7fc4d40af2a0 legacy=0x7fc4d406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:39.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.661+0000 7fc4d27fc640 1 -- 172.21.15.112:0/70226196 >> v1:172.21.15.112:6789/0 conn(0x7fc4d415bec0 legacy=0x7fc4d40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:39.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.661+0000 7fc4d27fc640 1 -- 172.21.15.112:0/70226196 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d40b3b30 con 0x7fc4d415c2a0 2024-09-15T23:57:39.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d27fc640 1 --2- 172.21.15.112:0/70226196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d415c2a0 0x7fc4d40aed60 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80097c0 tx=0x7fc4c801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5a456d43a54e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:39.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d1ffb640 1 -- 172.21.15.112:0/70226196 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80ab430 con 0x7fc4d415c2a0 2024-09-15T23:57:39.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d1ffb640 1 -- 172.21.15.112:0/70226196 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c80b0070 con 0x7fc4d415c2a0 2024-09-15T23:57:39.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d1ffb640 1 -- 172.21.15.112:0/70226196 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80ab7d0 con 0x7fc4d415c2a0 2024-09-15T23:57:39.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 -- 172.21.15.112:0/70226196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d415c2a0 msgr2=0x7fc4d40aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:39.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 --2- 172.21.15.112:0/70226196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d415c2a0 0x7fc4d40aed60 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80097c0 tx=0x7fc4c801c430 comp rx=0 tx=0).stop 2024-09-15T23:57:39.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 -- 172.21.15.112:0/70226196 shutdown_connections 2024-09-15T23:57:39.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 --2- 172.21.15.112:0/70226196 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d415c2a0 0x7fc4d40aed60 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 -- 172.21.15.112:0/70226196 >> 172.21.15.112:0/70226196 conn(0x7fc4d40b1f90 msgr2=0x7fc4d40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:39.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 -- 172.21.15.112:0/70226196 shutdown_connections 2024-09-15T23:57:39.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 -- 172.21.15.112:0/70226196 wait complete. 2024-09-15T23:57:39.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 Processor -- start 2024-09-15T23:57:39.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 -- start start 2024-09-15T23:57:39.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4d40af2a0 0x7fc4d414de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:39.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d415bec0 0x7fc4d4145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4d415c2a0 0x7fc4d414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d406ef20 con 0x7fc4d415bec0 2024-09-15T23:57:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40af710 con 0x7fc4d415c2a0 2024-09-15T23:57:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d406f0a0 con 0x7fc4d40af2a0 2024-09-15T23:57:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d27fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d415bec0 0x7fc4d4145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d27fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d415bec0 0x7fc4d4145a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49832/0 (socket says 172.21.15.112:49832) 2024-09-15T23:57:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d27fc640 1 -- 172.21.15.112:0/2027011769 learned_addr learned my addr 172.21.15.112:0/2027011769 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d2ffd640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4d40af2a0 0x7fc4d414de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d37fe640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4d415c2a0 0x7fc4d414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d27fc640 1 -- 172.21.15.112:0/2027011769 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4d40af2a0 msgr2=0x7fc4d414de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d27fc640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4d40af2a0 0x7fc4d414de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d27fc640 1 -- 172.21.15.112:0/2027011769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4d415c2a0 msgr2=0x7fc4d414b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d27fc640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4d415c2a0 0x7fc4d414b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d27fc640 1 -- 172.21.15.112:0/2027011769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d414cf50 con 0x7fc4d415bec0 2024-09-15T23:57:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d2ffd640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4d40af2a0 0x7fc4d414de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d27fc640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d415bec0 0x7fc4d4145a30 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8019040 tx=0x7fc4c80191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4bb7fe640 1 -- 172.21.15.112:0/2027011769 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80abb30 con 0x7fc4d415bec0 2024-09-15T23:57:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4bb7fe640 1 -- 172.21.15.112:0/2027011769 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c80abcd0 con 0x7fc4d415bec0 2024-09-15T23:57:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4bb7fe640 1 -- 172.21.15.112:0/2027011769 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80bf650 con 0x7fc4d415bec0 2024-09-15T23:57:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.665+0000 7fc4d97a0640 1 -- 172.21.15.112:0/2027011769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d415c7e0 con 0x7fc4d415bec0 2024-09-15T23:57:39.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.669+0000 7fc4d97a0640 1 -- 172.21.15.112:0/2027011769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d415cda0 con 0x7fc4d415bec0 2024-09-15T23:57:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.669+0000 7fc4d97a0640 1 -- 172.21.15.112:0/2027011769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d40aed60 con 0x7fc4d415bec0 2024-09-15T23:57:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.669+0000 7fc4bb7fe640 1 -- 172.21.15.112:0/2027011769 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4c80b43f0 con 0x7fc4d415bec0 2024-09-15T23:57:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.669+0000 7fc4bb7fe640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc4c00678c0 0x7fc4c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.669+0000 7fc4bb7fe640 1 -- 172.21.15.112:0/2027011769 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5249+0+0 (secure 0 0 0) 0x7fc4c80a8020 con 0x7fc4d415bec0 2024-09-15T23:57:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.669+0000 7fc4d2ffd640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc4c00678c0 0x7fc4c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.669+0000 7fc4d2ffd640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc4c00678c0 0x7fc4c0069d80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4005890 tx=0x7fc4c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:39.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.673+0000 7fc4bb7fe640 1 -- 172.21.15.112:0/2027011769 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc4c8016050 con 0x7fc4d415bec0 2024-09-15T23:57:39.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.893+0000 7fc4d97a0640 1 -- 172.21.15.112:0/2027011769 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fc4d406fcd0 con 0x7fc4d415bec0 2024-09-15T23:57:39.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.897+0000 7fc4bb7fe640 1 -- 172.21.15.112:0/2027011769 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7fc4c80f0d10 con 0x7fc4d415bec0 2024-09-15T23:57:39.897 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:39.897 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:57:39.897 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-15T23:57:39.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.897 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-15T23:57:39.897 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmPvLEFBAA/WS7KNQ60+LzhOcQyCVWoQ==", 2024-09-15T23:57:39.897 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.897 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:57:39.897 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:57:39.897 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:57:39.898 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.898 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.898 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-15T23:57:39.898 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmN/+jIxAAiXM9onNC3twhiZrqCdWtUQ==", 2024-09-15T23:57:39.898 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.898 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:57:39.898 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:57:39.898 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:57:39.899 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.899 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-15T23:57:39.899 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmEbNbHRAAjP+2Z2XYc0tarO48R/ocIQ==", 2024-09-15T23:57:39.899 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.899 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:57:39.899 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:57:39.899 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:57:39.899 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.900 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-15T23:57:39.900 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmg6AqLBAAZ3PKcarPcPfvIWSTnE5uLA==", 2024-09-15T23:57:39.900 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.900 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:57:39.900 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:57:39.900 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:57:39.900 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.900 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.900 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-15T23:57:39.900 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBRc+dmnOKMBxAAdaIaYmXKAFGIPTxfYt2apQ==", 2024-09-15T23:57:39.900 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.901 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:57:39.901 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:57:39.901 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.901 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.901 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-15T23:57:39.901 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBUc+dmnowGFhAAa3jXrvZ0An+9IwM9988mvQ==", 2024-09-15T23:57:39.901 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.901 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:57:39.901 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:57:39.901 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.901 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.902 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-15T23:57:39.902 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBXc+dmnj9kJRAAZbpx5TM2ukiLKqi+iZAE5g==", 2024-09-15T23:57:39.902 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.902 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:57:39.902 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:57:39.902 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.902 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.902 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-15T23:57:39.902 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBac+dmAdXtNxAA8g+Nxz1RyVf+P8KOtkw5qw==", 2024-09-15T23:57:39.902 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.903 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:57:39.903 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:57:39.903 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.903 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.903 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-15T23:57:39.903 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBhc+dmyOApAhAA9Cv9nW1b5JvO9cH9emao4A==", 2024-09-15T23:57:39.903 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.903 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:57:39.904 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:57:39.904 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.904 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.904 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-15T23:57:39.904 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBkc+dmFIDwDxAAR/59kfrjiLU4emIqtthfRg==", 2024-09-15T23:57:39.904 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.904 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:57:39.904 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:57:39.904 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.904 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.905 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-15T23:57:39.905 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBnc+dmZVB/IRAAFbvodnxisklCL/yuD+F5ew==", 2024-09-15T23:57:39.905 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.905 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:57:39.905 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:57:39.905 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.905 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.905 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-15T23:57:39.905 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBqc+dmuty6LxAAHWB/GByU/hXOL/+dnRpcVA==", 2024-09-15T23:57:39.905 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.905 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:57:39.905 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:57:39.906 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.906 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.906 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-15T23:57:39.906 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw==", 2024-09-15T23:57:39.906 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.906 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:57:39.906 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-15T23:57:39.906 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:57:39.906 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-15T23:57:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmmP6vORAAqxzX3OjoHnionZo1koIqRQ==", 2024-09-15T23:57:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:57:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:57:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:57:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:57:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-15T23:57:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmj2XtNhAAB5620fN0Kr8Cqgd2+1cebg==", 2024-09-15T23:57:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:57:39.908 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:57:39.908 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:57:39.908 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:57:39.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.908 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-15T23:57:39.908 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBOc+dmt+I7AxAA+eyV3eaThbjRNo0zJT9OQg==", 2024-09-15T23:57:39.908 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.908 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:57:39.908 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:57:39.908 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:57:39.908 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:57:39.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.909 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-15T23:57:39.909 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBMc+dmDuzBORAAzpiXmO3QO+1RKRvPGQLViQ==", 2024-09-15T23:57:39.909 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.909 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:57:39.909 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:57:39.909 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:57:39.909 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.909 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.909 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dm4JK5ERAA3d3OABWXchejCqjJRrhTfQ==", 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dm5nULDxAAi9UvgPZ7sU/Zz2jLKsu4ng==", 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:57:39.910 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:39.911 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-15T23:57:39.911 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:57:39.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.897+0000 7fc4d97a0640 1 -- 172.21.15.112:0/2027011769 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc4c00678c0 msgr2=0x7fc4c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:39.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.897+0000 7fc4d97a0640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc4c00678c0 0x7fc4c0069d80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4005890 tx=0x7fc4c4009040 comp rx=0 tx=0).stop 2024-09-15T23:57:39.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.897+0000 7fc4d97a0640 1 -- 172.21.15.112:0/2027011769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d415bec0 msgr2=0x7fc4d4145a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:39.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.897+0000 7fc4d97a0640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d415bec0 0x7fc4d4145a30 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8019040 tx=0x7fc4c80191d0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.897+0000 7fc4d97a0640 1 -- 172.21.15.112:0/2027011769 shutdown_connections 2024-09-15T23:57:39.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.897+0000 7fc4d97a0640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc4c00678c0 0x7fc4c0069d80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.897+0000 7fc4d97a0640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4d415c2a0 0x7fc4d414b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.897+0000 7fc4d97a0640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4d415bec0 0x7fc4d4145a30 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.897+0000 7fc4d97a0640 1 --2- 172.21.15.112:0/2027011769 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4d40af2a0 0x7fc4d414de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.897+0000 7fc4d97a0640 1 -- 172.21.15.112:0/2027011769 >> 172.21.15.112:0/2027011769 conn(0x7fc4d40b1f90 msgr2=0x7fc4d41597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:39.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.897+0000 7fc4d97a0640 1 -- 172.21.15.112:0/2027011769 shutdown_connections 2024-09-15T23:57:39.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:39.897+0000 7fc4d97a0640 1 -- 172.21.15.112:0/2027011769 wait complete. 2024-09-15T23:57:39.916 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:57:40.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4481689640 1 Processor -- start 2024-09-15T23:57:40.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4481689640 1 -- start start 2024-09-15T23:57:40.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4481689640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f447c0b5cf0 0x7f447c15e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4481689640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f447c15f180 con 0x7f447c15ecb0 2024-09-15T23:57:40.040 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4481689640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f447c15f460 con 0x7f447c15f8d0 2024-09-15T23:57:40.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4481689640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f447c06d440 con 0x7f447c0b5cf0 2024-09-15T23:57:40.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f447a7fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f447c15ecb0 0x7f447c06dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:42956/0 (socket says 172.21.15.112:42956) 2024-09-15T23:57:40.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f447a7fc640 1 -- 172.21.15.112:0/2797571429 learned_addr learned my addr 172.21.15.112:0/2797571429 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:40.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f447affd640 1 --2- 172.21.15.112:0/2797571429 >> v2:172.21.15.169:3300/0 conn(0x7f447c0b5cf0 0x7f447c15e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 -- 172.21.15.112:0/2797571429 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1130620498 0 0) 0x7f447c15f180 con 0x7f447c15ecb0 2024-09-15T23:57:40.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 -- 172.21.15.112:0/2797571429 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4464003530 con 0x7f447c15ecb0 2024-09-15T23:57:40.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 -- 172.21.15.112:0/2797571429 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 55995814 0 0) 0x7f4464003530 con 0x7f447c15ecb0 2024-09-15T23:57:40.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 -- 172.21.15.112:0/2797571429 >> v2:172.21.15.169:3300/0 conn(0x7f447c0b5cf0 msgr2=0x7f447c15e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:40.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 --2- 172.21.15.112:0/2797571429 >> v2:172.21.15.169:3300/0 conn(0x7f447c0b5cf0 0x7f447c15e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 -- 172.21.15.112:0/2797571429 >> v1:172.21.15.169:6789/0 conn(0x7f447c15f8d0 legacy=0x7f447c0b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 -- 172.21.15.112:0/2797571429 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447c06e350 con 0x7f447c15ecb0 2024-09-15T23:57:40.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 -- 172.21.15.112:0/2797571429 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f4470001680 con 0x7f447c15ecb0 2024-09-15T23:57:40.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f447affd640 1 --2- 172.21.15.112:0/2797571429 >> v2:172.21.15.169:3300/0 conn(0x7f447c0b5cf0 0x7f447c15e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:57:40.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 -- 172.21.15.112:0/2797571429 >> v1:172.21.15.112:6789/0 conn(0x7f447c15ecb0 legacy=0x7f447c06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 --2- 172.21.15.112:0/2797571429 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44640039c0 0x7f4464003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 --2- 172.21.15.112:0/2797571429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4464004810 0x7f4464004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 --2- 172.21.15.112:0/2797571429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44640052f0 0x7f446400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 -- 172.21.15.112:0/2797571429 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f447c06d440 con 0x7f44640052f0 2024-09-15T23:57:40.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 -- 172.21.15.112:0/2797571429 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f446400c1c0 con 0x7f4464004810 2024-09-15T23:57:40.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f4479ffb640 1 -- 172.21.15.112:0/2797571429 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f446400c3c0 con 0x7f44640039c0 2024-09-15T23:57:40.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f447b7fe640 1 --2- 172.21.15.112:0/2797571429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44640052f0 0x7f446400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f447a7fc640 1 --2- 172.21.15.112:0/2797571429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4464004810 0x7f4464004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f447affd640 1 --2- 172.21.15.112:0/2797571429 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44640039c0 0x7f4464003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f447b7fe640 1 -- 172.21.15.112:0/2797571429 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44640039c0 msgr2=0x7f4464003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:40.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f447b7fe640 1 --2- 172.21.15.112:0/2797571429 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44640039c0 0x7f4464003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f447b7fe640 1 -- 172.21.15.112:0/2797571429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4464004810 msgr2=0x7f4464004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:40.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f447b7fe640 1 --2- 172.21.15.112:0/2797571429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4464004810 0x7f4464004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f447b7fe640 1 -- 172.21.15.112:0/2797571429 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4464003530 con 0x7f44640052f0 2024-09-15T23:57:40.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f447affd640 1 --2- 172.21.15.112:0/2797571429 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44640039c0 0x7f4464003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:40.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.037+0000 7f447a7fc640 1 --2- 172.21.15.112:0/2797571429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4464004810 0x7f4464004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:57:40.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.041+0000 7f447b7fe640 1 -- 172.21.15.112:0/2797571429 reap_dead start 2024-09-15T23:57:40.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.041+0000 7f447b7fe640 1 --2- 172.21.15.112:0/2797571429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44640052f0 0x7f446400b9d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4474001e40 tx=0x7f447401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75f96f2ebe347e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.041+0000 7f4479ffb640 1 -- 172.21.15.112:0/2797571429 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474001a90 con 0x7f44640052f0 2024-09-15T23:57:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.041+0000 7f4479ffb640 1 -- 172.21.15.112:0/2797571429 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4474003b80 con 0x7f44640052f0 2024-09-15T23:57:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.041+0000 7f4479ffb640 1 -- 172.21.15.112:0/2797571429 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474005020 con 0x7f44640052f0 2024-09-15T23:57:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.041+0000 7f4481689640 1 -- 172.21.15.112:0/2797571429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44640052f0 msgr2=0x7f446400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.041+0000 7f4481689640 1 --2- 172.21.15.112:0/2797571429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44640052f0 0x7f446400b9d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4474001e40 tx=0x7f447401c760 comp rx=0 tx=0).stop 2024-09-15T23:57:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.041+0000 7f4481689640 1 -- 172.21.15.112:0/2797571429 shutdown_connections 2024-09-15T23:57:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.041+0000 7f4481689640 1 --2- 172.21.15.112:0/2797571429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44640052f0 0x7f446400b9d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.041+0000 7f4481689640 1 -- 172.21.15.112:0/2797571429 >> 172.21.15.112:0/2797571429 conn(0x7f447c06c0c0 msgr2=0x7f447c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.041+0000 7f4481689640 1 -- 172.21.15.112:0/2797571429 shutdown_connections 2024-09-15T23:57:40.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.041+0000 7f4481689640 1 -- 172.21.15.112:0/2797571429 wait complete. 2024-09-15T23:57:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.041+0000 7f4481689640 1 Processor -- start 2024-09-15T23:57:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.041+0000 7f4481689640 1 -- start start 2024-09-15T23:57:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f4481689640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44640052f0 0x7f447c154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f4481689640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f447c154b90 0x7f447c13db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f4481689640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c13e0d0 0x7f447c151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f4481689640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f447c072870 con 0x7f447c13e0d0 2024-09-15T23:57:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f4481689640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f447c0726f0 con 0x7f447c154b90 2024-09-15T23:57:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f4481689640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f447c15e770 con 0x7f44640052f0 2024-09-15T23:57:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f447b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c13e0d0 0x7f447c151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f447b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c13e0d0 0x7f447c151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49846/0 (socket says 172.21.15.112:49846) 2024-09-15T23:57:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f447b7fe640 1 -- 172.21.15.112:0/3230346446 learned_addr learned my addr 172.21.15.112:0/3230346446 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:40.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f447affd640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44640052f0 0x7f447c154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f447a7fc640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f447c154b90 0x7f447c13db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f447b7fe640 1 -- 172.21.15.112:0/3230346446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44640052f0 msgr2=0x7f447c154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f447b7fe640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44640052f0 0x7f447c154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f447b7fe640 1 -- 172.21.15.112:0/3230346446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f447c154b90 msgr2=0x7f447c13db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f447b7fe640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f447c154b90 0x7f447c13db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f447b7fe640 1 -- 172.21.15.112:0/3230346446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447c14f250 con 0x7f447c13e0d0 2024-09-15T23:57:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f447a7fc640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f447c154b90 0x7f447c13db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f447b7fe640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c13e0d0 0x7f447c151b10 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f447401c590 tx=0x7f4464005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f44637fe640 1 -- 172.21.15.112:0/3230346446 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474007dc0 con 0x7f447c13e0d0 2024-09-15T23:57:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f44637fe640 1 -- 172.21.15.112:0/3230346446 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4474003980 con 0x7f447c13e0d0 2024-09-15T23:57:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f4481689640 1 -- 172.21.15.112:0/3230346446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447c14f530 con 0x7f447c13e0d0 2024-09-15T23:57:40.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f44637fe640 1 -- 172.21.15.112:0/3230346446 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44740a6e60 con 0x7f447c13e0d0 2024-09-15T23:57:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f4481689640 1 -- 172.21.15.112:0/3230346446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f447c153b00 con 0x7f447c13e0d0 2024-09-15T23:57:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f4481689640 1 -- 172.21.15.112:0/3230346446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f447c15f140 con 0x7f447c13e0d0 2024-09-15T23:57:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f44637fe640 1 -- 172.21.15.112:0/3230346446 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f44740052d0 con 0x7f447c13e0d0 2024-09-15T23:57:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f44637fe640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44680678c0 0x7f4468069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f44637fe640 1 -- 172.21.15.112:0/3230346446 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5249+0+0 (secure 0 0 0) 0x7f447411f070 con 0x7f447c13e0d0 2024-09-15T23:57:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f447affd640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44680678c0 0x7f4468069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.045+0000 7f447affd640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44680678c0 0x7f4468069d80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f446c00e810 tx=0x7f446c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.049+0000 7f44637fe640 1 -- 172.21.15.112:0/3230346446 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4474016470 con 0x7f447c13e0d0 2024-09-15T23:57:40.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.213+0000 7f4481689640 1 -- 172.21.15.112:0/3230346446 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f447c069170 con 0x7f447c13e0d0 2024-09-15T23:57:40.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.213+0000 7f44637fe640 1 -- 172.21.15.112:0/3230346446 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7f44740efd70 con 0x7f447c13e0d0 2024-09-15T23:57:40.216 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:40.216 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-15T23:57:40.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:40.216 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-15T23:57:40.216 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-15T23:57:40.216 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:40.216 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-15T23:57:40.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.217+0000 7f4481689640 1 -- 172.21.15.112:0/3230346446 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44680678c0 msgr2=0x7f4468069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.217+0000 7f4481689640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44680678c0 0x7f4468069d80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f446c00e810 tx=0x7f446c008040 comp rx=0 tx=0).stop 2024-09-15T23:57:40.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.217+0000 7f4481689640 1 -- 172.21.15.112:0/3230346446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c13e0d0 msgr2=0x7f447c151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.217+0000 7f4481689640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c13e0d0 0x7f447c151b10 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f447401c590 tx=0x7f4464005840 comp rx=0 tx=0).stop 2024-09-15T23:57:40.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.217+0000 7f4481689640 1 -- 172.21.15.112:0/3230346446 shutdown_connections 2024-09-15T23:57:40.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.217+0000 7f4481689640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f44680678c0 0x7f4468069d80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.217+0000 7f4481689640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f447c13e0d0 0x7f447c151b10 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.217+0000 7f4481689640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f447c154b90 0x7f447c13db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.217+0000 7f4481689640 1 --2- 172.21.15.112:0/3230346446 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44640052f0 0x7f447c154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.217+0000 7f4481689640 1 -- 172.21.15.112:0/3230346446 >> 172.21.15.112:0/3230346446 conn(0x7f447c06c0c0 msgr2=0x7f447c15b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:40.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.217+0000 7f4481689640 1 -- 172.21.15.112:0/3230346446 shutdown_connections 2024-09-15T23:57:40.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.217+0000 7f4481689640 1 -- 172.21.15.112:0/3230346446 wait complete. 2024-09-15T23:57:40.235 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:57:40.235 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:57:40.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1ad036640 1 Processor -- start 2024-09-15T23:57:40.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1ad036640 1 -- start start 2024-09-15T23:57:40.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1ad036640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a815bec0 0x7fc1a80ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1ad036640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc1a815c2a0 0x7fc1a80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1ad036640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a80b3290 con 0x7fc1a80af2a0 2024-09-15T23:57:40.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1ad036640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc1a80b3570 con 0x7fc1a815c2a0 2024-09-15T23:57:40.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1ad036640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a80b3850 con 0x7fc1a815bec0 2024-09-15T23:57:40.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1a6d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a815bec0 0x7fc1a80ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1a6d9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a815bec0 0x7fc1a80ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:55584/0 (socket says 172.21.15.112:55584) 2024-09-15T23:57:40.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1a659c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc1a815c2a0 0x7fc1a80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1a6d9d640 1 -- 172.21.15.112:0/3792644522 learned_addr learned my addr 172.21.15.112:0/3792644522 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:40.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1a6d9d640 1 -- 172.21.15.112:0/3792644522 >> v2:172.21.15.169:3300/0 conn(0x7fc1a815c2a0 msgr2=0x7fc1a80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:40.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1a6d9d640 1 --2- 172.21.15.112:0/3792644522 >> v2:172.21.15.169:3300/0 conn(0x7fc1a815c2a0 0x7fc1a80aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1a6d9d640 1 -- 172.21.15.112:0/3792644522 >> v1:172.21.15.169:6789/0 conn(0x7fc1a80af2a0 legacy=0x7fc1a815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.361+0000 7fc1a6d9d640 1 -- 172.21.15.112:0/3792644522 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a80b3b30 con 0x7fc1a815bec0 2024-09-15T23:57:40.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.365+0000 7fc1a6d9d640 1 --2- 172.21.15.112:0/3792644522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a815bec0 0x7fc1a80ad200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc198009870 tx=0x7fc19801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15de27f680ab08d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.365+0000 7fc1a5d9b640 1 -- 172.21.15.112:0/3792644522 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1980a95f0 con 0x7fc1a815bec0 2024-09-15T23:57:40.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.365+0000 7fc1a5d9b640 1 -- 172.21.15.112:0/3792644522 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1980a9790 con 0x7fc1a815bec0 2024-09-15T23:57:40.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.365+0000 7fc1a5d9b640 1 -- 172.21.15.112:0/3792644522 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1980a9b60 con 0x7fc1a815bec0 2024-09-15T23:57:40.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.365+0000 7fc1ad036640 1 -- 172.21.15.112:0/3792644522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a815bec0 msgr2=0x7fc1a80ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.365+0000 7fc1ad036640 1 --2- 172.21.15.112:0/3792644522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a815bec0 0x7fc1a80ad200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc198009870 tx=0x7fc19801c530 comp rx=0 tx=0).stop 2024-09-15T23:57:40.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.365+0000 7fc1ad036640 1 -- 172.21.15.112:0/3792644522 shutdown_connections 2024-09-15T23:57:40.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.365+0000 7fc1ad036640 1 --2- 172.21.15.112:0/3792644522 >> v2:172.21.15.169:3300/0 conn(0x7fc1a815c2a0 0x7fc1a80aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.365+0000 7fc1ad036640 1 --2- 172.21.15.112:0/3792644522 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a815bec0 0x7fc1a80ad200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.365+0000 7fc1ad036640 1 -- 172.21.15.112:0/3792644522 >> 172.21.15.112:0/3792644522 conn(0x7fc1a80b1f90 msgr2=0x7fc1a80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:40.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.365+0000 7fc1ad036640 1 -- 172.21.15.112:0/3792644522 shutdown_connections 2024-09-15T23:57:40.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.365+0000 7fc1ad036640 1 -- 172.21.15.112:0/3792644522 wait complete. 2024-09-15T23:57:40.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1ad036640 1 Processor -- start 2024-09-15T23:57:40.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1ad036640 1 -- start start 2024-09-15T23:57:40.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1ad036640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a80af2a0 0x7fc1a8154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1ad036640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815bec0 0x7fc1a815efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1ad036640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1a815c2a0 0x7fc1a814f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1ad036640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a80af6b0 con 0x7fc1a815bec0 2024-09-15T23:57:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1ad036640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a80ad740 con 0x7fc1a815c2a0 2024-09-15T23:57:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1ad036640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a8169000 con 0x7fc1a80af2a0 2024-09-15T23:57:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1a659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815bec0 0x7fc1a815efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1a659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815bec0 0x7fc1a815efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49852/0 (socket says 172.21.15.112:49852) 2024-09-15T23:57:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1a659c640 1 -- 172.21.15.112:0/3742991820 learned_addr learned my addr 172.21.15.112:0/3742991820 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1a6d9d640 1 --2- 172.21.15.112:0/3742991820 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a80af2a0 0x7fc1a8154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1a759e640 1 --2- 172.21.15.112:0/3742991820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1a815c2a0 0x7fc1a814f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1a659c640 1 -- 172.21.15.112:0/3742991820 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a80af2a0 msgr2=0x7fc1a8154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1a659c640 1 --2- 172.21.15.112:0/3742991820 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a80af2a0 0x7fc1a8154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1a659c640 1 -- 172.21.15.112:0/3742991820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1a815c2a0 msgr2=0x7fc1a814f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1a659c640 1 --2- 172.21.15.112:0/3742991820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1a815c2a0 0x7fc1a814f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1a659c640 1 -- 172.21.15.112:0/3742991820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a8153d20 con 0x7fc1a815bec0 2024-09-15T23:57:40.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1a659c640 1 --2- 172.21.15.112:0/3742991820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815bec0 0x7fc1a815efe0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00e840 tx=0x7fc19c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc18f7fe640 1 -- 172.21.15.112:0/3742991820 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c017070 con 0x7fc1a815bec0 2024-09-15T23:57:40.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1ad036640 1 -- 172.21.15.112:0/3742991820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a8154000 con 0x7fc1a815bec0 2024-09-15T23:57:40.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc18f7fe640 1 -- 172.21.15.112:0/3742991820 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19c00c940 con 0x7fc1a815bec0 2024-09-15T23:57:40.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc18f7fe640 1 -- 172.21.15.112:0/3742991820 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00cd10 con 0x7fc1a815bec0 2024-09-15T23:57:40.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1ad036640 1 -- 172.21.15.112:0/3742991820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a81539b0 con 0x7fc1a815bec0 2024-09-15T23:57:40.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.369+0000 7fc1ad036640 1 -- 172.21.15.112:0/3742991820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a80ad200 con 0x7fc1a815bec0 2024-09-15T23:57:40.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.373+0000 7fc18f7fe640 1 -- 172.21.15.112:0/3742991820 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc19c01a070 con 0x7fc1a815bec0 2024-09-15T23:57:40.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.373+0000 7fc18f7fe640 1 --2- 172.21.15.112:0/3742991820 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc1940678c0 0x7fc194069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.373+0000 7fc18f7fe640 1 -- 172.21.15.112:0/3742991820 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5249+0+0 (secure 0 0 0) 0x7fc19c085e40 con 0x7fc1a815bec0 2024-09-15T23:57:40.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.373+0000 7fc1a6d9d640 1 --2- 172.21.15.112:0/3742991820 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc1940678c0 0x7fc194069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.373+0000 7fc1a6d9d640 1 --2- 172.21.15.112:0/3742991820 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc1940678c0 0x7fc194069d80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc1980ae000 tx=0x7fc1980b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.377+0000 7fc18f7fe640 1 -- 172.21.15.112:0/3742991820 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc19c056ac0 con 0x7fc1a815bec0 2024-09-15T23:57:40.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:40.541+0000 7fc1ad036640 1 -- 172.21.15.112:0/3742991820 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc1a80b2c60 con 0x7fc1a815bec0 2024-09-15T23:57:41.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.513+0000 7fc18f7fe640 1 -- 172.21.15.112:0/3742991820 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7fc19c0563c0 con 0x7fc1a815bec0 2024-09-15T23:57:41.515 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-15T23:57:41.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.517+0000 7fc1ad036640 1 -- 172.21.15.112:0/3742991820 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc1940678c0 msgr2=0x7fc194069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.517+0000 7fc1ad036640 1 --2- 172.21.15.112:0/3742991820 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc1940678c0 0x7fc194069d80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc1980ae000 tx=0x7fc1980b3040 comp rx=0 tx=0).stop 2024-09-15T23:57:41.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.517+0000 7fc1ad036640 1 -- 172.21.15.112:0/3742991820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815bec0 msgr2=0x7fc1a815efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.517+0000 7fc1ad036640 1 --2- 172.21.15.112:0/3742991820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815bec0 0x7fc1a815efe0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00e840 tx=0x7fc19c00ed00 comp rx=0 tx=0).stop 2024-09-15T23:57:41.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.517+0000 7fc1ad036640 1 -- 172.21.15.112:0/3742991820 shutdown_connections 2024-09-15T23:57:41.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.517+0000 7fc1ad036640 1 --2- 172.21.15.112:0/3742991820 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc1940678c0 0x7fc194069d80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.517+0000 7fc1ad036640 1 --2- 172.21.15.112:0/3742991820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1a815c2a0 0x7fc1a814f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.517+0000 7fc1ad036640 1 --2- 172.21.15.112:0/3742991820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1a815bec0 0x7fc1a815efe0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.517+0000 7fc1ad036640 1 --2- 172.21.15.112:0/3742991820 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc1a80af2a0 0x7fc1a8154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.517+0000 7fc1ad036640 1 -- 172.21.15.112:0/3742991820 >> 172.21.15.112:0/3742991820 conn(0x7fc1a80b1f90 msgr2=0x7fc1a80b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:41.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.517+0000 7fc1ad036640 1 -- 172.21.15.112:0/3742991820 shutdown_connections 2024-09-15T23:57:41.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.517+0000 7fc1ad036640 1 -- 172.21.15.112:0/3742991820 wait complete. 2024-09-15T23:57:41.547 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:57:41.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.677+0000 7f0b4a8b6640 1 Processor -- start 2024-09-15T23:57:41.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.677+0000 7f0b4a8b6640 1 -- start start 2024-09-15T23:57:41.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.677+0000 7f0b4a8b6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0b44162070 0x7f0b441624a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.677+0000 7f0b4a8b6640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b440cf070 con 0x7f0b440d15d0 2024-09-15T23:57:41.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.677+0000 7f0b4a8b6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b440d1c20 con 0x7f0b4415e4f0 2024-09-15T23:57:41.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.677+0000 7f0b4a8b6640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0b441629e0 con 0x7f0b44162070 2024-09-15T23:57:41.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b437fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0b440d15d0 0x7f0b440cfe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:42958/0 (socket says 172.21.15.112:42958) 2024-09-15T23:57:41.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b48e53640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0b44162070 0x7f0b441624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b437fe640 1 -- 172.21.15.112:0/1683038636 learned_addr learned my addr 172.21.15.112:0/1683038636 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:41.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b42ffd640 1 -- 172.21.15.112:0/1683038636 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2328214369 0 0) 0x7f0b440cf070 con 0x7f0b440d15d0 2024-09-15T23:57:41.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b42ffd640 1 -- 172.21.15.112:0/1683038636 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b2c003530 con 0x7f0b440d15d0 2024-09-15T23:57:41.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b48e53640 1 -- 172.21.15.112:0/1683038636 >> v1:172.21.15.169:6789/0 conn(0x7f0b4415e4f0 legacy=0x7f0b440d4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:41.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b48e53640 1 -- 172.21.15.112:0/1683038636 >> v1:172.21.15.112:6789/0 conn(0x7f0b440d15d0 legacy=0x7f0b440cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b48e53640 1 -- 172.21.15.112:0/1683038636 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b440cf330 con 0x7f0b44162070 2024-09-15T23:57:41.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b48e53640 1 --2- 172.21.15.112:0/1683038636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b44162070 0x7f0b441624a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009dc0 tx=0x7f0b3c01f140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47eda9116bd09 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b42ffd640 1 -- 172.21.15.112:0/1683038636 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c0b4070 con 0x7f0b44162070 2024-09-15T23:57:41.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b42ffd640 1 -- 172.21.15.112:0/1683038636 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b3c0af600 con 0x7f0b44162070 2024-09-15T23:57:41.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b42ffd640 1 -- 172.21.15.112:0/1683038636 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c0af9d0 con 0x7f0b44162070 2024-09-15T23:57:41.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1683038636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b44162070 msgr2=0x7f0b441624a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b4a8b6640 1 --2- 172.21.15.112:0/1683038636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b44162070 0x7f0b441624a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009dc0 tx=0x7f0b3c01f140 comp rx=0 tx=0).stop 2024-09-15T23:57:41.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1683038636 shutdown_connections 2024-09-15T23:57:41.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b4a8b6640 1 --2- 172.21.15.112:0/1683038636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b44162070 0x7f0b441624a0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1683038636 >> 172.21.15.112:0/1683038636 conn(0x7f0b4408bf90 msgr2=0x7f0b440d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:41.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1683038636 shutdown_connections 2024-09-15T23:57:41.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.681+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1683038636 wait complete. 2024-09-15T23:57:41.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b4a8b6640 1 Processor -- start 2024-09-15T23:57:41.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b4a8b6640 1 -- start start 2024-09-15T23:57:41.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b4a8b6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b440d15d0 0x7f0b441f91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b4a8b6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4415e4f0 0x7f0b441fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b4a8b6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44162070 0x7f0b440cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b4a8b6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4415e8d0 con 0x7f0b440d15d0 2024-09-15T23:57:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b4a8b6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0b440cf8f0 con 0x7f0b4415e4f0 2024-09-15T23:57:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b4a8b6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0b440b7260 con 0x7f0b44162070 2024-09-15T23:57:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b440d15d0 0x7f0b441f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b440d15d0 0x7f0b441f91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49876/0 (socket says 172.21.15.112:49876) 2024-09-15T23:57:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b43fff640 1 -- 172.21.15.112:0/1191108862 learned_addr learned my addr 172.21.15.112:0/1191108862 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b437fe640 1 --2- 172.21.15.112:0/1191108862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4415e4f0 0x7f0b441fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b48e53640 1 --2- 172.21.15.112:0/1191108862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44162070 0x7f0b440cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b43fff640 1 -- 172.21.15.112:0/1191108862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44162070 msgr2=0x7f0b440cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b43fff640 1 --2- 172.21.15.112:0/1191108862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44162070 0x7f0b440cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b43fff640 1 -- 172.21.15.112:0/1191108862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4415e4f0 msgr2=0x7f0b441fb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b43fff640 1 --2- 172.21.15.112:0/1191108862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4415e4f0 0x7f0b441fb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b43fff640 1 -- 172.21.15.112:0/1191108862 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b440cd950 con 0x7f0b440d15d0 2024-09-15T23:57:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b43fff640 1 --2- 172.21.15.112:0/1191108862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b440d15d0 0x7f0b441f91c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400c420 tx=0x7f0b3400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b40ff9640 1 -- 172.21.15.112:0/1191108862 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b340052d0 con 0x7f0b440d15d0 2024-09-15T23:57:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b40ff9640 1 -- 172.21.15.112:0/1191108862 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b34005470 con 0x7f0b440d15d0 2024-09-15T23:57:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1191108862 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b441f97a0 con 0x7f0b440d15d0 2024-09-15T23:57:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b40ff9640 1 -- 172.21.15.112:0/1191108862 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34007260 con 0x7f0b440d15d0 2024-09-15T23:57:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1191108862 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4415ed30 con 0x7f0b440d15d0 2024-09-15T23:57:41.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.685+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1191108862 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b441624a0 con 0x7f0b440d15d0 2024-09-15T23:57:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.689+0000 7f0b40ff9640 1 -- 172.21.15.112:0/1191108862 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0b34007400 con 0x7f0b440d15d0 2024-09-15T23:57:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.689+0000 7f0b40ff9640 1 --2- 172.21.15.112:0/1191108862 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0b300678f0 0x7f0b30069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.689+0000 7f0b40ff9640 1 -- 172.21.15.112:0/1191108862 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5619+0+0 (secure 0 0 0) 0x7f0b340858c0 con 0x7f0b440d15d0 2024-09-15T23:57:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.689+0000 7f0b437fe640 1 --2- 172.21.15.112:0/1191108862 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0b300678f0 0x7f0b30069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.689+0000 7f0b437fe640 1 --2- 172.21.15.112:0/1191108862 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0b300678f0 0x7f0b30069db0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0b380011f0 tx=0x7f0b38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.693+0000 7f0b40ff9640 1 -- 172.21.15.112:0/1191108862 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0b34056530 con 0x7f0b440d15d0 2024-09-15T23:57:41.845 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:41.845+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1191108862 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0b44074bb0 con 0x7f0b440d15d0 2024-09-15T23:57:42.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.517+0000 7f0b40ff9640 1 -- 172.21.15.112:0/1191108862 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) ==== 170+0+0 (secure 0 0 0) 0x7f0b34055e30 con 0x7f0b440d15d0 2024-09-15T23:57:42.520 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-15T23:57:42.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.521+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1191108862 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0b300678f0 msgr2=0x7f0b30069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:42.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.521+0000 7f0b4a8b6640 1 --2- 172.21.15.112:0/1191108862 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0b300678f0 0x7f0b30069db0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0b380011f0 tx=0x7f0b38009040 comp rx=0 tx=0).stop 2024-09-15T23:57:42.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.521+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1191108862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b440d15d0 msgr2=0x7f0b441f91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:42.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.521+0000 7f0b4a8b6640 1 --2- 172.21.15.112:0/1191108862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b440d15d0 0x7f0b441f91c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400c420 tx=0x7f0b3400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:42.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.521+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1191108862 shutdown_connections 2024-09-15T23:57:42.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.521+0000 7f0b4a8b6640 1 --2- 172.21.15.112:0/1191108862 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0b300678f0 0x7f0b30069db0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:42.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.521+0000 7f0b4a8b6640 1 --2- 172.21.15.112:0/1191108862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b44162070 0x7f0b440cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:42.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.521+0000 7f0b4a8b6640 1 --2- 172.21.15.112:0/1191108862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4415e4f0 0x7f0b441fb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:42.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.521+0000 7f0b4a8b6640 1 --2- 172.21.15.112:0/1191108862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b440d15d0 0x7f0b441f91c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:42.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.521+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1191108862 >> 172.21.15.112:0/1191108862 conn(0x7f0b4408bf90 msgr2=0x7f0b440d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:42.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.521+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1191108862 shutdown_connections 2024-09-15T23:57:42.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.521+0000 7f0b4a8b6640 1 -- 172.21.15.112:0/1191108862 wait complete. 2024-09-15T23:57:42.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:57:42.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf76bd0640 1 Processor -- start 2024-09-15T23:57:42.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf76bd0640 1 -- start start 2024-09-15T23:57:42.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf76bd0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fbf7006f010 0x7fbf70166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:42.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf76bd0640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf700b3290 con 0x7fbf7015bec0 2024-09-15T23:57:42.682 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf76bd0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf700b3570 con 0x7fbf7015c2a0 2024-09-15T23:57:42.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf76bd0640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fbf700b3850 con 0x7fbf7006f010 2024-09-15T23:57:42.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf7496c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbf7015bec0 0x7fbf700ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:42974/0 (socket says 172.21.15.112:42974) 2024-09-15T23:57:42.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf7496c640 1 -- 172.21.15.112:0/1004722212 learned_addr learned my addr 172.21.15.112:0/1004722212 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:42.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf7516d640 1 --2- 172.21.15.112:0/1004722212 >> v2:172.21.15.112:3300/0 conn(0x7fbf7006f010 0x7fbf70166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:42.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf6f7fe640 1 -- 172.21.15.112:0/1004722212 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4210806214 0 0) 0x7fbf700b3290 con 0x7fbf7015bec0 2024-09-15T23:57:42.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf6f7fe640 1 -- 172.21.15.112:0/1004722212 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf58003530 con 0x7fbf7015bec0 2024-09-15T23:57:42.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf7516d640 1 -- 172.21.15.112:0/1004722212 >> v1:172.21.15.169:6789/0 conn(0x7fbf7015c2a0 legacy=0x7fbf700aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:42.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf6f7fe640 1 -- 172.21.15.112:0/1004722212 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1010694316 0 0) 0x7fbf58003530 con 0x7fbf7015bec0 2024-09-15T23:57:42.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf7516d640 1 -- 172.21.15.112:0/1004722212 >> v1:172.21.15.112:6789/0 conn(0x7fbf7015bec0 legacy=0x7fbf700ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:42.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.681+0000 7fbf7516d640 1 -- 172.21.15.112:0/1004722212 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf700b3b30 con 0x7fbf7006f010 2024-09-15T23:57:42.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf7516d640 1 --2- 172.21.15.112:0/1004722212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf7006f010 0x7fbf70166ff0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009d90 tx=0x7fbf6801c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6939e9250f52e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:42.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf6f7fe640 1 -- 172.21.15.112:0/1004722212 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf680b2070 con 0x7fbf7006f010 2024-09-15T23:57:42.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf6f7fe640 1 -- 172.21.15.112:0/1004722212 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf680a55b0 con 0x7fbf7006f010 2024-09-15T23:57:42.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf6f7fe640 1 -- 172.21.15.112:0/1004722212 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64001680 con 0x7fbf7006f010 2024-09-15T23:57:42.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 -- 172.21.15.112:0/1004722212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf7006f010 msgr2=0x7fbf70166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:42.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 --2- 172.21.15.112:0/1004722212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf7006f010 0x7fbf70166ff0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009d90 tx=0x7fbf6801c860 comp rx=0 tx=0).stop 2024-09-15T23:57:42.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 -- 172.21.15.112:0/1004722212 shutdown_connections 2024-09-15T23:57:42.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 --2- 172.21.15.112:0/1004722212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf7006f010 0x7fbf70166ff0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:42.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 -- 172.21.15.112:0/1004722212 >> 172.21.15.112:0/1004722212 conn(0x7fbf700b1f90 msgr2=0x7fbf700b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:42.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 -- 172.21.15.112:0/1004722212 shutdown_connections 2024-09-15T23:57:42.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 -- 172.21.15.112:0/1004722212 wait complete. 2024-09-15T23:57:42.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 Processor -- start 2024-09-15T23:57:42.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 -- start start 2024-09-15T23:57:42.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf7006f010 0x7fbf701499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:42.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf7015bec0 0x7fbf70071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:42.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf7015c2a0 0x7fbf700727f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:42.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbf70169ed0 con 0x7fbf7015bec0 2024-09-15T23:57:42.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbf70169d50 con 0x7fbf7015c2a0 2024-09-15T23:57:42.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf76bd0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbf7016a050 con 0x7fbf7006f010 2024-09-15T23:57:42.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf6ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf7015bec0 0x7fbf70071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:42.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf6ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf7015bec0 0x7fbf70071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49902/0 (socket says 172.21.15.112:49902) 2024-09-15T23:57:42.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf6ffff640 1 -- 172.21.15.112:0/3696069716 learned_addr learned my addr 172.21.15.112:0/3696069716 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:42.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf7496c640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf7006f010 0x7fbf701499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:42.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf7516d640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf7015c2a0 0x7fbf700727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:42.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf6ffff640 1 -- 172.21.15.112:0/3696069716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf7006f010 msgr2=0x7fbf701499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:42.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf6ffff640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf7006f010 0x7fbf701499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:42.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf6ffff640 1 -- 172.21.15.112:0/3696069716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf7015c2a0 msgr2=0x7fbf700727f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:42.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.685+0000 7fbf6ffff640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf7015c2a0 0x7fbf700727f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:42.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.689+0000 7fbf6ffff640 1 -- 172.21.15.112:0/3696069716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf700734c0 con 0x7fbf7015bec0 2024-09-15T23:57:42.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.689+0000 7fbf7496c640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf7006f010 0x7fbf701499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:42.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.689+0000 7fbf6ffff640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf7015bec0 0x7fbf70071fc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000c3c0 tx=0x7fbf6000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:42.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.689+0000 7fbf6d7fa640 1 -- 172.21.15.112:0/3696069716 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf60017070 con 0x7fbf7015bec0 2024-09-15T23:57:42.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.689+0000 7fbf6d7fa640 1 -- 172.21.15.112:0/3696069716 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf600052d0 con 0x7fbf7015bec0 2024-09-15T23:57:42.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.689+0000 7fbf76bd0640 1 -- 172.21.15.112:0/3696069716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf700737a0 con 0x7fbf7015bec0 2024-09-15T23:57:42.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.689+0000 7fbf6d7fa640 1 -- 172.21.15.112:0/3696069716 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf60003820 con 0x7fbf7015bec0 2024-09-15T23:57:42.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.689+0000 7fbf76bd0640 1 -- 172.21.15.112:0/3696069716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf70151a10 con 0x7fbf7015bec0 2024-09-15T23:57:42.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.689+0000 7fbf76bd0640 1 -- 172.21.15.112:0/3696069716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf700ad200 con 0x7fbf7015bec0 2024-09-15T23:57:42.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.689+0000 7fbf6d7fa640 1 -- 172.21.15.112:0/3696069716 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbf6001a070 con 0x7fbf7015bec0 2024-09-15T23:57:42.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.689+0000 7fbf6d7fa640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbf5c0678f0 0x7fbf5c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:42.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.689+0000 7fbf6d7fa640 1 -- 172.21.15.112:0/3696069716 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6001+0+0 (secure 0 0 0) 0x7fbf60085110 con 0x7fbf7015bec0 2024-09-15T23:57:42.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.689+0000 7fbf7496c640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbf5c0678f0 0x7fbf5c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:42.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.689+0000 7fbf7496c640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbf5c0678f0 0x7fbf5c069db0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbf640011f0 tx=0x7fbf64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:42.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.693+0000 7fbf6d7fa640 1 -- 172.21.15.112:0/3696069716 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbf60005480 con 0x7fbf7015bec0 2024-09-15T23:57:42.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:42.893+0000 7fbf76bd0640 1 -- 172.21.15.112:0/3696069716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbf70151be0 con 0x7fbf7015bec0 2024-09-15T23:57:43.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.569+0000 7fbf6d7fa640 1 -- 172.21.15.112:0/3696069716 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v42) ==== 174+0+0 (secure 0 0 0) 0x7fbf60055b20 con 0x7fbf7015bec0 2024-09-15T23:57:43.576 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 13 and data pool 14 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.577+0000 7fbf56ffd640 1 -- 172.21.15.112:0/3696069716 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbf5c0678f0 msgr2=0x7fbf5c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.577+0000 7fbf56ffd640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbf5c0678f0 0x7fbf5c069db0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbf640011f0 tx=0x7fbf64009040 comp rx=0 tx=0).stop 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.577+0000 7fbf56ffd640 1 -- 172.21.15.112:0/3696069716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf7015bec0 msgr2=0x7fbf70071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.577+0000 7fbf56ffd640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf7015bec0 0x7fbf70071fc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000c3c0 tx=0x7fbf6000c880 comp rx=0 tx=0).stop 2024-09-15T23:57:43.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.577+0000 7fbf56ffd640 1 -- 172.21.15.112:0/3696069716 shutdown_connections 2024-09-15T23:57:43.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.577+0000 7fbf56ffd640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbf5c0678f0 0x7fbf5c069db0 secure :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbf640011f0 tx=0x7fbf64009040 comp rx=0 tx=0).stop 2024-09-15T23:57:43.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.577+0000 7fbf56ffd640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf7015c2a0 0x7fbf700727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.577+0000 7fbf56ffd640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf7015bec0 0x7fbf70071fc0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.577+0000 7fbf56ffd640 1 --2- 172.21.15.112:0/3696069716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf7006f010 0x7fbf701499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.577+0000 7fbf56ffd640 1 -- 172.21.15.112:0/3696069716 >> 172.21.15.112:0/3696069716 conn(0x7fbf700b1f90 msgr2=0x7fbf700cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:43.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.581+0000 7fbf56ffd640 1 -- 172.21.15.112:0/3696069716 shutdown_connections 2024-09-15T23:57:43.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.581+0000 7fbf56ffd640 1 -- 172.21.15.112:0/3696069716 wait complete. 2024-09-15T23:57:43.608 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:43.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.725+0000 7f7b177b2640 1 Processor -- start 2024-09-15T23:57:43.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.725+0000 7f7b177b2640 1 -- start start 2024-09-15T23:57:43.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.725+0000 7f7b177b2640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b1006f010 0x7f7b10166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:43.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.725+0000 7f7b177b2640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b100b3290 con 0x7f7b1015c2a0 2024-09-15T23:57:43.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.725+0000 7f7b177b2640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b100b3570 con 0x7f7b1015bec0 2024-09-15T23:57:43.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.725+0000 7f7b177b2640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7b100b3850 con 0x7f7b1006f010 2024-09-15T23:57:43.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.725+0000 7f7b15d4f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b1006f010 0x7f7b10166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:43.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.725+0000 7f7b15d4f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7b1006f010 0x7f7b10166ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49912/0 (socket says 172.21.15.112:49912) 2024-09-15T23:57:43.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.725+0000 7f7b15d4f640 1 -- 172.21.15.112:0/3923621655 learned_addr learned my addr 172.21.15.112:0/3923621655 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:43.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.725+0000 7f7b15d4f640 1 -- 172.21.15.112:0/3923621655 >> v1:172.21.15.169:6789/0 conn(0x7f7b1015bec0 legacy=0x7f7b100ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:43.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.725+0000 7f7b15d4f640 1 -- 172.21.15.112:0/3923621655 >> v1:172.21.15.112:6789/0 conn(0x7f7b1015c2a0 legacy=0x7f7b100aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:43.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.725+0000 7f7b15d4f640 1 -- 172.21.15.112:0/3923621655 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b100b3b30 con 0x7f7b1006f010 2024-09-15T23:57:43.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.725+0000 7f7b07fff640 1 -- 172.21.15.112:0/3923621655 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72926691 0 0) 0x7f7b100b3290 con 0x7f7b1015c2a0 2024-09-15T23:57:43.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b15d4f640 1 --2- 172.21.15.112:0/3923621655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b1006f010 0x7f7b10166ff0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f7b08009e50 tx=0x7f7b0801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc08aacfc9ec9e31 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:43.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b07fff640 1 -- 172.21.15.112:0/3923621655 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b080a5790 con 0x7f7b1006f010 2024-09-15T23:57:43.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b07fff640 1 -- 172.21.15.112:0/3923621655 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b080a5930 con 0x7f7b1006f010 2024-09-15T23:57:43.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b07fff640 1 -- 172.21.15.112:0/3923621655 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b080a5d00 con 0x7f7b1006f010 2024-09-15T23:57:43.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 -- 172.21.15.112:0/3923621655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b1006f010 msgr2=0x7f7b10166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:43.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 --2- 172.21.15.112:0/3923621655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b1006f010 0x7f7b10166ff0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f7b08009e50 tx=0x7f7b0801c9c0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 -- 172.21.15.112:0/3923621655 shutdown_connections 2024-09-15T23:57:43.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 --2- 172.21.15.112:0/3923621655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b1006f010 0x7f7b10166ff0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 -- 172.21.15.112:0/3923621655 >> 172.21.15.112:0/3923621655 conn(0x7f7b100b1f90 msgr2=0x7f7b100b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:43.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 -- 172.21.15.112:0/3923621655 shutdown_connections 2024-09-15T23:57:43.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 -- 172.21.15.112:0/3923621655 wait complete. 2024-09-15T23:57:43.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 Processor -- start 2024-09-15T23:57:43.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 -- start start 2024-09-15T23:57:43.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b1006f010 0x7f7b1014ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:43.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b1015bec0 0x7f7b10152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:43.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b1015c2a0 0x7f7b10152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:43.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7b10169ed0 con 0x7f7b1015c2a0 2024-09-15T23:57:43.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7b10169d50 con 0x7f7b1015bec0 2024-09-15T23:57:43.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1016a050 con 0x7f7b1006f010 2024-09-15T23:57:43.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b15d4f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b1015c2a0 0x7f7b10152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:43.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b15d4f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b1015c2a0 0x7f7b10152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49916/0 (socket says 172.21.15.112:49916) 2024-09-15T23:57:43.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b15d4f640 1 -- 172.21.15.112:0/1043732805 learned_addr learned my addr 172.21.15.112:0/1043732805 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:43.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b14d4d640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b1015bec0 0x7f7b10152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:43.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b1554e640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b1006f010 0x7f7b1014ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:43.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b15d4f640 1 -- 172.21.15.112:0/1043732805 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b1006f010 msgr2=0x7f7b1014ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:43.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b15d4f640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b1006f010 0x7f7b1014ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b15d4f640 1 -- 172.21.15.112:0/1043732805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b1015bec0 msgr2=0x7f7b10152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:43.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b15d4f640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b1015bec0 0x7f7b10152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b15d4f640 1 -- 172.21.15.112:0/1043732805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b100d0690 con 0x7f7b1015c2a0 2024-09-15T23:57:43.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b14d4d640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b1015bec0 0x7f7b10152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:43.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b15d4f640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b1015c2a0 0x7f7b10152940 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f7b080af040 tx=0x7f7b08019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:43.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b05ffb640 1 -- 172.21.15.112:0/1043732805 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b080b8470 con 0x7f7b1015c2a0 2024-09-15T23:57:43.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b05ffb640 1 -- 172.21.15.112:0/1043732805 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b080b8610 con 0x7f7b1015c2a0 2024-09-15T23:57:43.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 -- 172.21.15.112:0/1043732805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b101560c0 con 0x7f7b1015c2a0 2024-09-15T23:57:43.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b05ffb640 1 -- 172.21.15.112:0/1043732805 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b080b89e0 con 0x7f7b1015c2a0 2024-09-15T23:57:43.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.729+0000 7f7b177b2640 1 -- 172.21.15.112:0/1043732805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b10156710 con 0x7f7b1015c2a0 2024-09-15T23:57:43.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.733+0000 7f7b177b2640 1 -- 172.21.15.112:0/1043732805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b100b3290 con 0x7f7b1015c2a0 2024-09-15T23:57:43.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.733+0000 7f7b05ffb640 1 -- 172.21.15.112:0/1043732805 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7b080c0020 con 0x7f7b1015c2a0 2024-09-15T23:57:43.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.733+0000 7f7b05ffb640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7af40678c0 0x7f7af4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:43.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.733+0000 7f7b05ffb640 1 -- 172.21.15.112:0/1043732805 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f7b08120890 con 0x7f7b1015c2a0 2024-09-15T23:57:43.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.733+0000 7f7b1554e640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7af40678c0 0x7f7af4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:43.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.733+0000 7f7b1554e640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7af40678c0 0x7f7af4069d80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c007fd0 tx=0x7f7b0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:43.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.737+0000 7f7b05ffb640 1 -- 172.21.15.112:0/1043732805 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7b080c7020 con 0x7f7b1015c2a0 2024-09-15T23:57:43.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.901+0000 7f7b177b2640 1 -- 172.21.15.112:0/1043732805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b1014cd30 con 0x7f7b1015c2a0 2024-09-15T23:57:43.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.905+0000 7f7b05ffb640 1 -- 172.21.15.112:0/1043732805 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+17018 (secure 0 0 0) 0x7f7b080165e0 con 0x7f7b1015c2a0 2024-09-15T23:57:43.905 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:43.906 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":85,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:57:42.895665+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:40.583942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:41.884324+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:43.908 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:57:43.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.909+0000 7f7b177b2640 1 -- 172.21.15.112:0/1043732805 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7af40678c0 msgr2=0x7f7af4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:43.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.909+0000 7f7b177b2640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7af40678c0 0x7f7af4069d80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c007fd0 tx=0x7f7b0c009040 comp rx=0 tx=0).stop 2024-09-15T23:57:43.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.909+0000 7f7b177b2640 1 -- 172.21.15.112:0/1043732805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b1015c2a0 msgr2=0x7f7b10152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:43.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.909+0000 7f7b177b2640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b1015c2a0 0x7f7b10152940 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f7b080af040 tx=0x7f7b08019760 comp rx=0 tx=0).stop 2024-09-15T23:57:43.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.909+0000 7f7b177b2640 1 -- 172.21.15.112:0/1043732805 shutdown_connections 2024-09-15T23:57:43.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.909+0000 7f7b177b2640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7af40678c0 0x7f7af4069d80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.909+0000 7f7b177b2640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b1015c2a0 0x7f7b10152940 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.909+0000 7f7b177b2640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b1015bec0 0x7f7b10152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.909+0000 7f7b177b2640 1 --2- 172.21.15.112:0/1043732805 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7b1006f010 0x7f7b1014ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.909+0000 7f7b177b2640 1 -- 172.21.15.112:0/1043732805 >> 172.21.15.112:0/1043732805 conn(0x7f7b100b1f90 msgr2=0x7f7b100cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:43.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.909+0000 7f7b177b2640 1 -- 172.21.15.112:0/1043732805 shutdown_connections 2024-09-15T23:57:43.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:43.909+0000 7f7b177b2640 1 -- 172.21.15.112:0/1043732805 wait complete. 2024-09-15T23:57:43.912 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:57:43.926 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:44.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.085+0000 7f4450cd0640 1 Processor -- start 2024-09-15T23:57:44.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.085+0000 7f4450cd0640 1 -- start start 2024-09-15T23:57:44.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f4450cd0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f444c140bd0 0x7f444c141030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:44.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f4450cd0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f444c0b4410 0x7f444c0b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:44.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f4450cd0640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f444c13fb30 con 0x7f444c156720 2024-09-15T23:57:44.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f4450cd0640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f444c141570 con 0x7f444c0b4410 2024-09-15T23:57:44.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f4450cd0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f444c140740 con 0x7f444c140bd0 2024-09-15T23:57:44.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f444ad9d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f444c0b4410 0x7f444c0b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:44.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f444a59c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f444c156720 0x7f444c0b5610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43000/0 (socket says 172.21.15.112:43000) 2024-09-15T23:57:44.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f444a59c640 1 -- 172.21.15.112:0/609893395 learned_addr learned my addr 172.21.15.112:0/609893395 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:44.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f4449d9b640 1 --2- 172.21.15.112:0/609893395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f444c140bd0 0x7f444c141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:44.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f444ad9d640 1 -- 172.21.15.112:0/609893395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f444c140bd0 msgr2=0x7f444c141030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:44.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f444ad9d640 1 --2- 172.21.15.112:0/609893395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f444c140bd0 0x7f444c141030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f444ad9d640 1 -- 172.21.15.112:0/609893395 >> v1:172.21.15.112:6789/0 conn(0x7f444c156720 legacy=0x7f444c0b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:44.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f444959a640 1 -- 172.21.15.112:0/609893395 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235913524 0 0) 0x7f444c13fb30 con 0x7f444c156720 2024-09-15T23:57:44.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f444ad9d640 1 -- 172.21.15.112:0/609893395 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c13fe10 con 0x7f444c0b4410 2024-09-15T23:57:44.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f444ad9d640 1 --2- 172.21.15.112:0/609893395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c0b4410 0x7f444c0b48c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f44440097c0 tx=0x7f444401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4555ba11e9000b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:44.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.089+0000 7f444959a640 1 -- 172.21.15.112:0/609893395 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44440b0070 con 0x7f444c0b4410 2024-09-15T23:57:44.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f444959a640 1 -- 172.21.15.112:0/609893395 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44440ab600 con 0x7f444c0b4410 2024-09-15T23:57:44.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f444959a640 1 -- 172.21.15.112:0/609893395 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44440ab9d0 con 0x7f444c0b4410 2024-09-15T23:57:44.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 -- 172.21.15.112:0/609893395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c0b4410 msgr2=0x7f444c0b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:44.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 --2- 172.21.15.112:0/609893395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c0b4410 0x7f444c0b48c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f44440097c0 tx=0x7f444401c4a0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 -- 172.21.15.112:0/609893395 shutdown_connections 2024-09-15T23:57:44.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 --2- 172.21.15.112:0/609893395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c0b4410 0x7f444c0b48c0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 --2- 172.21.15.112:0/609893395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f444c140bd0 0x7f444c141030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.093 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 -- 172.21.15.112:0/609893395 >> 172.21.15.112:0/609893395 conn(0x7f444c06c0c0 msgr2=0x7f444c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:44.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 -- 172.21.15.112:0/609893395 shutdown_connections 2024-09-15T23:57:44.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 -- 172.21.15.112:0/609893395 wait complete. 2024-09-15T23:57:44.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 Processor -- start 2024-09-15T23:57:44.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 -- start start 2024-09-15T23:57:44.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f444c0b4410 0x7f444c158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:44.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c140bd0 0x7f444c1450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:44.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f444c156720 0x7f444c13e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:44.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f444c13f6e0 con 0x7f444c140bd0 2024-09-15T23:57:44.096 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f444c0b5d20 con 0x7f444c0b4410 2024-09-15T23:57:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f444c13f860 con 0x7f444c156720 2024-09-15T23:57:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4449d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c140bd0 0x7f444c1450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4449d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c140bd0 0x7f444c1450b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49946/0 (socket says 172.21.15.112:49946) 2024-09-15T23:57:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4449d9b640 1 -- 172.21.15.112:0/3698797968 learned_addr learned my addr 172.21.15.112:0/3698797968 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f444ad9d640 1 --2- 172.21.15.112:0/3698797968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f444c156720 0x7f444c13e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f444a59c640 1 --2- 172.21.15.112:0/3698797968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f444c0b4410 0x7f444c158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4449d9b640 1 -- 172.21.15.112:0/3698797968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f444c156720 msgr2=0x7f444c13e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4449d9b640 1 --2- 172.21.15.112:0/3698797968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f444c156720 0x7f444c13e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4449d9b640 1 -- 172.21.15.112:0/3698797968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f444c0b4410 msgr2=0x7f444c158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4449d9b640 1 --2- 172.21.15.112:0/3698797968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f444c0b4410 0x7f444c158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4449d9b640 1 -- 172.21.15.112:0/3698797968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c1591a0 con 0x7f444c140bd0 2024-09-15T23:57:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4449d9b640 1 --2- 172.21.15.112:0/3698797968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c140bd0 0x7f444c1450b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f443400c820 tx=0x7f443400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:44.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4442ffd640 1 -- 172.21.15.112:0/3698797968 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4434004230 con 0x7f444c140bd0 2024-09-15T23:57:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4442ffd640 1 -- 172.21.15.112:0/3698797968 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44340043d0 con 0x7f444c140bd0 2024-09-15T23:57:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4442ffd640 1 -- 172.21.15.112:0/3698797968 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4434007a70 con 0x7f444c140bd0 2024-09-15T23:57:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 -- 172.21.15.112:0/3698797968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444c1455f0 con 0x7f444c140bd0 2024-09-15T23:57:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.093+0000 7f4450cd0640 1 -- 172.21.15.112:0/3698797968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f444c06d490 con 0x7f444c140bd0 2024-09-15T23:57:44.098 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.097+0000 7f4450cd0640 1 -- 172.21.15.112:0/3698797968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f444c0b48c0 con 0x7f444c140bd0 2024-09-15T23:57:44.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.097+0000 7f4442ffd640 1 -- 172.21.15.112:0/3698797968 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4434007c10 con 0x7f444c140bd0 2024-09-15T23:57:44.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.097+0000 7f4442ffd640 1 --2- 172.21.15.112:0/3698797968 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f442c0678f0 0x7f442c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:44.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.097+0000 7f4442ffd640 1 -- 172.21.15.112:0/3698797968 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f4434085d80 con 0x7f444c140bd0 2024-09-15T23:57:44.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.097+0000 7f444a59c640 1 --2- 172.21.15.112:0/3698797968 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f442c0678f0 0x7f442c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:44.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.097+0000 7f444a59c640 1 --2- 172.21.15.112:0/3698797968 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f442c0678f0 0x7f442c069db0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f443c007fd0 tx=0x7f443c007ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:44.102 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.101+0000 7f4442ffd640 1 -- 172.21.15.112:0/3698797968 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4434015020 con 0x7f444c140bd0 2024-09-15T23:57:44.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.261+0000 7f4450cd0640 1 -- 172.21.15.112:0/3698797968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f444c069170 con 0x7f444c140bd0 2024-09-15T23:57:44.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.265+0000 7f4442ffd640 1 -- 172.21.15.112:0/3698797968 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+17018 (secure 0 0 0) 0x7f44340567c0 con 0x7f444c140bd0 2024-09-15T23:57:44.267 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:44.267 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":85,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:57:42.895665+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:40.583942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:41.884324+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:44.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.269+0000 7f4450cd0640 1 -- 172.21.15.112:0/3698797968 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f442c0678f0 msgr2=0x7f442c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:44.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.269+0000 7f4450cd0640 1 --2- 172.21.15.112:0/3698797968 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f442c0678f0 0x7f442c069db0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f443c007fd0 tx=0x7f443c007ee0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.269+0000 7f4450cd0640 1 -- 172.21.15.112:0/3698797968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c140bd0 msgr2=0x7f444c1450b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:44.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.269+0000 7f4450cd0640 1 --2- 172.21.15.112:0/3698797968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c140bd0 0x7f444c1450b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f443400c820 tx=0x7f443400cce0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.269+0000 7f4450cd0640 1 -- 172.21.15.112:0/3698797968 shutdown_connections 2024-09-15T23:57:44.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.269+0000 7f4450cd0640 1 --2- 172.21.15.112:0/3698797968 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f442c0678f0 0x7f442c069db0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.269+0000 7f4450cd0640 1 --2- 172.21.15.112:0/3698797968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f444c156720 0x7f444c13e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.269+0000 7f4450cd0640 1 --2- 172.21.15.112:0/3698797968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c140bd0 0x7f444c1450b0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.269+0000 7f4450cd0640 1 --2- 172.21.15.112:0/3698797968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f444c0b4410 0x7f444c158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.269+0000 7f4450cd0640 1 -- 172.21.15.112:0/3698797968 >> 172.21.15.112:0/3698797968 conn(0x7f444c06c0c0 msgr2=0x7f444c0d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:44.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.269+0000 7f4450cd0640 1 -- 172.21.15.112:0/3698797968 shutdown_connections 2024-09-15T23:57:44.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.269+0000 7f4450cd0640 1 -- 172.21.15.112:0/3698797968 wait complete. 2024-09-15T23:57:44.286 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:57:44.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc7812a6640 1 Processor -- start 2024-09-15T23:57:44.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc7812a6640 1 -- start start 2024-09-15T23:57:44.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc7812a6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc77c070020 0x7fc77c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:44.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc7812a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc77c15f1d0 0x7fc77c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:44.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc7812a6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77c0aede0 con 0x7fc77c1520a0 2024-09-15T23:57:44.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc7812a6640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc77c152480 con 0x7fc77c070020 2024-09-15T23:57:44.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc7812a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc77c15fa10 con 0x7fc77c15f1d0 2024-09-15T23:57:44.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc77a7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc77c070020 0x7fc77c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:44.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc77a7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc77c070020 0x7fc77c15ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49960/0 (socket says 172.21.15.112:49960) 2024-09-15T23:57:44.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc77a7fc640 1 -- 172.21.15.112:0/2313649023 learned_addr learned my addr 172.21.15.112:0/2313649023 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:44.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc77b7fe640 1 --2- 172.21.15.112:0/2313649023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc77c15f1d0 0x7fc77c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:44.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc77a7fc640 1 -- 172.21.15.112:0/2313649023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc77c15f1d0 msgr2=0x7fc77c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:44.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc77a7fc640 1 --2- 172.21.15.112:0/2313649023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc77c15f1d0 0x7fc77c0adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc77a7fc640 1 -- 172.21.15.112:0/2313649023 >> v1:172.21.15.169:6789/0 conn(0x7fc77c1520a0 legacy=0x7fc77c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:44.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.405+0000 7fc77a7fc640 1 -- 172.21.15.112:0/2313649023 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77c074250 con 0x7fc77c070020 2024-09-15T23:57:44.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc77a7fc640 1 --2- 172.21.15.112:0/2313649023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc77c070020 0x7fc77c15ec90 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009870 tx=0x7fc76c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5dc2a111b2d933c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:44.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc779ffb640 1 -- 172.21.15.112:0/2313649023 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0a95f0 con 0x7fc77c070020 2024-09-15T23:57:44.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc779ffb640 1 -- 172.21.15.112:0/2313649023 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76c0a9790 con 0x7fc77c070020 2024-09-15T23:57:44.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc779ffb640 1 -- 172.21.15.112:0/2313649023 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0a9b60 con 0x7fc77c070020 2024-09-15T23:57:44.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 -- 172.21.15.112:0/2313649023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc77c070020 msgr2=0x7fc77c15ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:44.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 --2- 172.21.15.112:0/2313649023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc77c070020 0x7fc77c15ec90 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009870 tx=0x7fc76c01c530 comp rx=0 tx=0).stop 2024-09-15T23:57:44.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 -- 172.21.15.112:0/2313649023 shutdown_connections 2024-09-15T23:57:44.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 --2- 172.21.15.112:0/2313649023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc77c15f1d0 0x7fc77c0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 --2- 172.21.15.112:0/2313649023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc77c070020 0x7fc77c15ec90 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 -- 172.21.15.112:0/2313649023 >> 172.21.15.112:0/2313649023 conn(0x7fc77c0b1f90 msgr2=0x7fc77c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:44.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 -- 172.21.15.112:0/2313649023 shutdown_connections 2024-09-15T23:57:44.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 -- 172.21.15.112:0/2313649023 wait complete. 2024-09-15T23:57:44.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 Processor -- start 2024-09-15T23:57:44.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 -- start start 2024-09-15T23:57:44.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc77c070020 0x7fc77c0cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:44.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc77c1520a0 0x7fc77c14d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:44.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc77c15f1d0 0x7fc77c09ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:44.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c15f5e0 con 0x7fc77c1520a0 2024-09-15T23:57:44.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c073d30 con 0x7fc77c070020 2024-09-15T23:57:44.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc7812a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc77c15f760 con 0x7fc77c15f1d0 2024-09-15T23:57:44.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc77a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc77c1520a0 0x7fc77c14d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:44.413 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc77a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc77c1520a0 0x7fc77c14d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49972/0 (socket says 172.21.15.112:49972) 2024-09-15T23:57:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.409+0000 7fc77a7fc640 1 -- 172.21.15.112:0/2487817497 learned_addr learned my addr 172.21.15.112:0/2487817497 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc77b7fe640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc77c15f1d0 0x7fc77c09ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc77a7fc640 1 -- 172.21.15.112:0/2487817497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc77c15f1d0 msgr2=0x7fc77c09ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc77a7fc640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc77c15f1d0 0x7fc77c09ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc77affd640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc77c070020 0x7fc77c0cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc77a7fc640 1 -- 172.21.15.112:0/2487817497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc77c070020 msgr2=0x7fc77c0cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc77a7fc640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc77c070020 0x7fc77c0cfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc77a7fc640 1 -- 172.21.15.112:0/2487817497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77c14f530 con 0x7fc77c1520a0 2024-09-15T23:57:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc77affd640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc77c070020 0x7fc77c0cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc77a7fc640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc77c1520a0 0x7fc77c14d5d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc76c01abe0 tx=0x7fc76c0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc7637fe640 1 -- 172.21.15.112:0/2487817497 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0b18c0 con 0x7fc77c1520a0 2024-09-15T23:57:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc7637fe640 1 -- 172.21.15.112:0/2487817497 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76c0b1a80 con 0x7fc77c1520a0 2024-09-15T23:57:44.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc7812a6640 1 -- 172.21.15.112:0/2487817497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77c09cd60 con 0x7fc77c1520a0 2024-09-15T23:57:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc7637fe640 1 -- 172.21.15.112:0/2487817497 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0bb3f0 con 0x7fc77c1520a0 2024-09-15T23:57:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc7812a6640 1 -- 172.21.15.112:0/2487817497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc77c09a320 con 0x7fc77c1520a0 2024-09-15T23:57:44.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc7812a6640 1 -- 172.21.15.112:0/2487817497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc77c15ec90 con 0x7fc77c1520a0 2024-09-15T23:57:44.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc7637fe640 1 -- 172.21.15.112:0/2487817497 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc76c0bb590 con 0x7fc77c1520a0 2024-09-15T23:57:44.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc7637fe640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7680678c0 0x7fc768069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:44.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc7637fe640 1 -- 172.21.15.112:0/2487817497 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7fc76c120700 con 0x7fc77c1520a0 2024-09-15T23:57:44.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc77affd640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7680678c0 0x7fc768069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:44.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.413+0000 7fc77affd640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7680678c0 0x7fc768069d80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc770000f70 tx=0x7fc770009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:44.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.417+0000 7fc7637fe640 1 -- 172.21.15.112:0/2487817497 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc76c0ad020 con 0x7fc77c1520a0 2024-09-15T23:57:44.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:44.605+0000 7fc7812a6640 1 -- 172.21.15.112:0/2487817497 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc77c06e540 con 0x7fc77c1520a0 2024-09-15T23:57:45.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.573+0000 7fc7637fe640 1 -- 172.21.15.112:0/2487817497 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) ==== 118+0+0 (secure 0 0 0) 0x7fc76c016150 con 0x7fc77c1520a0 2024-09-15T23:57:45.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.577+0000 7fc7812a6640 1 -- 172.21.15.112:0/2487817497 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7680678c0 msgr2=0x7fc768069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:45.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.577+0000 7fc7812a6640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7680678c0 0x7fc768069d80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc770000f70 tx=0x7fc770009040 comp rx=0 tx=0).stop 2024-09-15T23:57:45.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.577+0000 7fc7812a6640 1 -- 172.21.15.112:0/2487817497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc77c1520a0 msgr2=0x7fc77c14d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:45.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.577+0000 7fc7812a6640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc77c1520a0 0x7fc77c14d5d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc76c01abe0 tx=0x7fc76c0192d0 comp rx=0 tx=0).stop 2024-09-15T23:57:45.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.577+0000 7fc7812a6640 1 -- 172.21.15.112:0/2487817497 shutdown_connections 2024-09-15T23:57:45.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.577+0000 7fc7812a6640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc7680678c0 0x7fc768069d80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:45.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.577+0000 7fc7812a6640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc77c15f1d0 0x7fc77c09ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:45.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.577+0000 7fc7812a6640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc77c1520a0 0x7fc77c14d5d0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:45.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.577+0000 7fc7812a6640 1 --2- 172.21.15.112:0/2487817497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc77c070020 0x7fc77c0cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:45.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.577+0000 7fc7812a6640 1 -- 172.21.15.112:0/2487817497 >> 172.21.15.112:0/2487817497 conn(0x7fc77c0b1f90 msgr2=0x7fc77c06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:45.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.577+0000 7fc7812a6640 1 -- 172.21.15.112:0/2487817497 shutdown_connections 2024-09-15T23:57:45.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.577+0000 7fc7812a6640 1 -- 172.21.15.112:0/2487817497 wait complete. 2024-09-15T23:57:45.600 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:57:45.600 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:57:45.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.733+0000 7fa8377e4640 1 Processor -- start 2024-09-15T23:57:45.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.733+0000 7fa8377e4640 1 -- start start 2024-09-15T23:57:45.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.733+0000 7fa8377e4640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa83015f3a0 0x7fa830165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:45.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.733+0000 7fa8377e4640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8300aede0 con 0x7fa830070020 2024-09-15T23:57:45.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.733+0000 7fa8377e4640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa83015fa10 con 0x7fa8301520a0 2024-09-15T23:57:45.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.733+0000 7fa8377e4640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa830152480 con 0x7fa83015f3a0 2024-09-15T23:57:45.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.733+0000 7fa834d7f640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa830070020 0x7fa83015ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43016/0 (socket says 172.21.15.112:43016) 2024-09-15T23:57:45.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.733+0000 7fa834d7f640 1 -- 172.21.15.112:0/1128676317 learned_addr learned my addr 172.21.15.112:0/1128676317 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:45.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.733+0000 7fa835d81640 1 --2- 172.21.15.112:0/1128676317 >> v2:172.21.15.112:3300/0 conn(0x7fa83015f3a0 0x7fa830165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:45.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.733+0000 7fa827fff640 1 -- 172.21.15.112:0/1128676317 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2236342682 0 0) 0x7fa8300aede0 con 0x7fa830070020 2024-09-15T23:57:45.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.733+0000 7fa827fff640 1 -- 172.21.15.112:0/1128676317 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa81c003530 con 0x7fa830070020 2024-09-15T23:57:45.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.733+0000 7fa835d81640 1 -- 172.21.15.112:0/1128676317 >> v1:172.21.15.169:6789/0 conn(0x7fa8301520a0 legacy=0x7fa83006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:45.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.733+0000 7fa835d81640 1 -- 172.21.15.112:0/1128676317 >> v1:172.21.15.112:6789/0 conn(0x7fa830070020 legacy=0x7fa83015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:45.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.733+0000 7fa835d81640 1 -- 172.21.15.112:0/1128676317 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa830074250 con 0x7fa83015f3a0 2024-09-15T23:57:45.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa835d81640 1 --2- 172.21.15.112:0/1128676317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa83015f3a0 0x7fa830165f00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa828009d90 tx=0x7fa82801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620981e6b43a2cef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:45.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa827fff640 1 -- 172.21.15.112:0/1128676317 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8280b2070 con 0x7fa83015f3a0 2024-09-15T23:57:45.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa827fff640 1 -- 172.21.15.112:0/1128676317 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8280a5a30 con 0x7fa83015f3a0 2024-09-15T23:57:45.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa827fff640 1 -- 172.21.15.112:0/1128676317 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8280a5e00 con 0x7fa83015f3a0 2024-09-15T23:57:45.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 -- 172.21.15.112:0/1128676317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa83015f3a0 msgr2=0x7fa830165f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:45.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 --2- 172.21.15.112:0/1128676317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa83015f3a0 0x7fa830165f00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa828009d90 tx=0x7fa82801c970 comp rx=0 tx=0).stop 2024-09-15T23:57:45.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 -- 172.21.15.112:0/1128676317 shutdown_connections 2024-09-15T23:57:45.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 --2- 172.21.15.112:0/1128676317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa83015f3a0 0x7fa830165f00 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:45.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 -- 172.21.15.112:0/1128676317 >> 172.21.15.112:0/1128676317 conn(0x7fa8300b1f90 msgr2=0x7fa8300b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:45.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 -- 172.21.15.112:0/1128676317 shutdown_connections 2024-09-15T23:57:45.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 -- 172.21.15.112:0/1128676317 wait complete. 2024-09-15T23:57:45.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 Processor -- start 2024-09-15T23:57:45.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 -- start start 2024-09-15T23:57:45.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa830070020 0x7fa83009c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:45.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8301520a0 0x7fa8300cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:45.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa83015f3a0 0x7fa8300cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:45.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa830168c60 con 0x7fa830070020 2024-09-15T23:57:45.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa830073d30 con 0x7fa8301520a0 2024-09-15T23:57:45.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa830168de0 con 0x7fa83015f3a0 2024-09-15T23:57:45.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa835580640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa830070020 0x7fa83009c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:45.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa835580640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa830070020 0x7fa83009c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49976/0 (socket says 172.21.15.112:49976) 2024-09-15T23:57:45.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa835580640 1 -- 172.21.15.112:0/3397778595 learned_addr learned my addr 172.21.15.112:0/3397778595 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:45.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa835d81640 1 --2- 172.21.15.112:0/3397778595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa83015f3a0 0x7fa8300cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:45.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa834d7f640 1 --2- 172.21.15.112:0/3397778595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8301520a0 0x7fa8300cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:45.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa835580640 1 -- 172.21.15.112:0/3397778595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa83015f3a0 msgr2=0x7fa8300cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:45.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa835580640 1 --2- 172.21.15.112:0/3397778595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa83015f3a0 0x7fa8300cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:45.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa835580640 1 -- 172.21.15.112:0/3397778595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8301520a0 msgr2=0x7fa8300cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:45.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa835580640 1 --2- 172.21.15.112:0/3397778595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8301520a0 0x7fa8300cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:45.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa835580640 1 -- 172.21.15.112:0/3397778595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83009cec0 con 0x7fa830070020 2024-09-15T23:57:45.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa835580640 1 --2- 172.21.15.112:0/3397778595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa830070020 0x7fa83009c450 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00c420 tx=0x7fa82c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:45.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa825ffb640 1 -- 172.21.15.112:0/3397778595 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0052d0 con 0x7fa830070020 2024-09-15T23:57:45.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa825ffb640 1 -- 172.21.15.112:0/3397778595 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa82c005470 con 0x7fa830070020 2024-09-15T23:57:45.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.737+0000 7fa8377e4640 1 -- 172.21.15.112:0/3397778595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83009d1a0 con 0x7fa830070020 2024-09-15T23:57:45.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.741+0000 7fa825ffb640 1 -- 172.21.15.112:0/3397778595 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c007260 con 0x7fa830070020 2024-09-15T23:57:45.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.741+0000 7fa8377e4640 1 -- 172.21.15.112:0/3397778595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83014f930 con 0x7fa830070020 2024-09-15T23:57:45.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.741+0000 7fa8377e4640 1 -- 172.21.15.112:0/3397778595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa83015ec90 con 0x7fa830070020 2024-09-15T23:57:45.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.741+0000 7fa825ffb640 1 -- 172.21.15.112:0/3397778595 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa82c007400 con 0x7fa830070020 2024-09-15T23:57:45.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.741+0000 7fa825ffb640 1 --2- 172.21.15.112:0/3397778595 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa8140678c0 0x7fa814069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:45.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.741+0000 7fa834d7f640 1 --2- 172.21.15.112:0/3397778595 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa8140678c0 0x7fa814069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:45.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.741+0000 7fa825ffb640 1 -- 172.21.15.112:0/3397778595 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fa82c085360 con 0x7fa830070020 2024-09-15T23:57:45.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.741+0000 7fa834d7f640 1 --2- 172.21.15.112:0/3397778595 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa8140678c0 0x7fa814069d80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa8301f7f80 tx=0x7fa820009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:45.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.745+0000 7fa825ffb640 1 -- 172.21.15.112:0/3397778595 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa82c055d10 con 0x7fa830070020 2024-09-15T23:57:45.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:45.941+0000 7fa8377e4640 1 -- 172.21.15.112:0/3397778595 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa83006e540 con 0x7fa830070020 2024-09-15T23:57:46.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.581+0000 7fa825ffb640 1 -- 172.21.15.112:0/3397778595 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7fa82c055610 con 0x7fa830070020 2024-09-15T23:57:46.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.585+0000 7fa8377e4640 1 -- 172.21.15.112:0/3397778595 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa8140678c0 msgr2=0x7fa814069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:46.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.585+0000 7fa8377e4640 1 --2- 172.21.15.112:0/3397778595 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa8140678c0 0x7fa814069d80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa8301f7f80 tx=0x7fa820009040 comp rx=0 tx=0).stop 2024-09-15T23:57:46.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.585+0000 7fa8377e4640 1 -- 172.21.15.112:0/3397778595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa830070020 msgr2=0x7fa83009c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:46.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.585+0000 7fa8377e4640 1 --2- 172.21.15.112:0/3397778595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa830070020 0x7fa83009c450 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00c420 tx=0x7fa82c00c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.585+0000 7fa8377e4640 1 -- 172.21.15.112:0/3397778595 shutdown_connections 2024-09-15T23:57:46.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.585+0000 7fa8377e4640 1 --2- 172.21.15.112:0/3397778595 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa8140678c0 0x7fa814069d80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.585+0000 7fa8377e4640 1 --2- 172.21.15.112:0/3397778595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa83015f3a0 0x7fa8300cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.585+0000 7fa8377e4640 1 --2- 172.21.15.112:0/3397778595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8301520a0 0x7fa8300cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.585+0000 7fa8377e4640 1 --2- 172.21.15.112:0/3397778595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa830070020 0x7fa83009c450 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.585+0000 7fa8377e4640 1 -- 172.21.15.112:0/3397778595 >> 172.21.15.112:0/3397778595 conn(0x7fa8300b1f90 msgr2=0x7fa83006e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:46.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.585+0000 7fa8377e4640 1 -- 172.21.15.112:0/3397778595 shutdown_connections 2024-09-15T23:57:46.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.585+0000 7fa8377e4640 1 -- 172.21.15.112:0/3397778595 wait complete. 2024-09-15T23:57:46.606 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:57:46.606 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:46.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.729+0000 7fa9c445b640 1 Processor -- start 2024-09-15T23:57:46.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c445b640 1 -- start start 2024-09-15T23:57:46.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c445b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa9bc161a60 0x7fa9bc0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:46.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c445b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9bc0d2e90 0x7fa9bc0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:46.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c445b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa9bc0cf450 0x7fa9bc0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:46.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c445b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa9bc0d32b0 con 0x7fa9bc0cf450 2024-09-15T23:57:46.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c445b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa9bc0d0300 con 0x7fa9bc161a60 2024-09-15T23:57:46.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c445b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa9bc0b0f60 con 0x7fa9bc0d2e90 2024-09-15T23:57:46.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c29f8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa9bc0cf450 0x7fa9bc0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:46.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c29f8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa9bc0cf450 0x7fa9bc0d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49990/0 (socket says 172.21.15.112:49990) 2024-09-15T23:57:46.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c29f8640 1 -- 172.21.15.112:0/3501122813 learned_addr learned my addr 172.21.15.112:0/3501122813 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:46.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c19f6640 1 --2- 172.21.15.112:0/3501122813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9bc0d2e90 0x7fa9bc0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:46.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c21f7640 1 --2- 172.21.15.112:0/3501122813 >> v2:172.21.15.169:3300/0 conn(0x7fa9bc161a60 0x7fa9bc0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:46.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c29f8640 1 -- 172.21.15.112:0/3501122813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9bc0d2e90 msgr2=0x7fa9bc0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:46.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c29f8640 1 --2- 172.21.15.112:0/3501122813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9bc0d2e90 0x7fa9bc0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c29f8640 1 -- 172.21.15.112:0/3501122813 >> v2:172.21.15.169:3300/0 conn(0x7fa9bc161a60 msgr2=0x7fa9bc0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:46.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c29f8640 1 --2- 172.21.15.112:0/3501122813 >> v2:172.21.15.169:3300/0 conn(0x7fa9bc161a60 0x7fa9bc0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.733+0000 7fa9c29f8640 1 -- 172.21.15.112:0/3501122813 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc0cfd40 con 0x7fa9bc0cf450 2024-09-15T23:57:46.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c29f8640 1 --2- 172.21.15.112:0/3501122813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9bc0cf450 0x7fa9bc0d0a10 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc08e010 tx=0x7fa9b801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a047c4cc8e763a36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:46.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c11f5640 1 -- 172.21.15.112:0/3501122813 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b80ab620 con 0x7fa9bc0cf450 2024-09-15T23:57:46.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c11f5640 1 -- 172.21.15.112:0/3501122813 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b80b0070 con 0x7fa9bc0cf450 2024-09-15T23:57:46.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c11f5640 1 -- 172.21.15.112:0/3501122813 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b80ab9e0 con 0x7fa9bc0cf450 2024-09-15T23:57:46.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 -- 172.21.15.112:0/3501122813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9bc0cf450 msgr2=0x7fa9bc0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:46.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 --2- 172.21.15.112:0/3501122813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9bc0cf450 0x7fa9bc0d0a10 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc08e010 tx=0x7fa9b801c460 comp rx=0 tx=0).stop 2024-09-15T23:57:46.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 -- 172.21.15.112:0/3501122813 shutdown_connections 2024-09-15T23:57:46.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 --2- 172.21.15.112:0/3501122813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9bc0cf450 0x7fa9bc0d0a10 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 --2- 172.21.15.112:0/3501122813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9bc0d2e90 0x7fa9bc0cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 --2- 172.21.15.112:0/3501122813 >> v2:172.21.15.169:3300/0 conn(0x7fa9bc161a60 0x7fa9bc0d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 -- 172.21.15.112:0/3501122813 >> 172.21.15.112:0/3501122813 conn(0x7fa9bc08bf90 msgr2=0x7fa9bc09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:46.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 -- 172.21.15.112:0/3501122813 shutdown_connections 2024-09-15T23:57:46.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 -- 172.21.15.112:0/3501122813 wait complete. 2024-09-15T23:57:46.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 Processor -- start 2024-09-15T23:57:46.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 -- start start 2024-09-15T23:57:46.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9bc0cf450 0x7fa9bc153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:46.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9bc0d2e90 0x7fa9bc159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:46.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9bc161a60 0x7fa9bc159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:46.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc0cfa60 con 0x7fa9bc161a60 2024-09-15T23:57:46.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc0cf8e0 con 0x7fa9bc0d2e90 2024-09-15T23:57:46.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c445b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa9bc06d6b0 con 0x7fa9bc0cf450 2024-09-15T23:57:46.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c29f8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9bc161a60 0x7fa9bc159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:46.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c29f8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9bc161a60 0x7fa9bc159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50006/0 (socket says 172.21.15.112:50006) 2024-09-15T23:57:46.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c29f8640 1 -- 172.21.15.112:0/201825248 learned_addr learned my addr 172.21.15.112:0/201825248 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:46.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c19f6640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9bc0d2e90 0x7fa9bc159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:46.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c21f7640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9bc0cf450 0x7fa9bc153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:46.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c29f8640 1 -- 172.21.15.112:0/201825248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9bc0cf450 msgr2=0x7fa9bc153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:46.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c29f8640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9bc0cf450 0x7fa9bc153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c29f8640 1 -- 172.21.15.112:0/201825248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9bc0d2e90 msgr2=0x7fa9bc159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:46.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c29f8640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9bc0d2e90 0x7fa9bc159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c29f8640 1 -- 172.21.15.112:0/201825248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc0b72d0 con 0x7fa9bc161a60 2024-09-15T23:57:46.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c19f6640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9bc0d2e90 0x7fa9bc159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:46.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.737+0000 7fa9c21f7640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9bc0cf450 0x7fa9bc153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:46.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.741+0000 7fa9c29f8640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9bc161a60 0x7fa9bc159f50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa9b801c290 tx=0x7fa9b801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:46.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.741+0000 7fa9aeffd640 1 -- 172.21.15.112:0/201825248 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b80abd90 con 0x7fa9bc161a60 2024-09-15T23:57:46.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.741+0000 7fa9aeffd640 1 -- 172.21.15.112:0/201825248 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b80be3f0 con 0x7fa9bc161a60 2024-09-15T23:57:46.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.741+0000 7fa9c445b640 1 -- 172.21.15.112:0/201825248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9bc0b75b0 con 0x7fa9bc161a60 2024-09-15T23:57:46.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.741+0000 7fa9aeffd640 1 -- 172.21.15.112:0/201825248 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b80be7a0 con 0x7fa9bc161a60 2024-09-15T23:57:46.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.741+0000 7fa9c445b640 1 -- 172.21.15.112:0/201825248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9bc0b7b70 con 0x7fa9bc161a60 2024-09-15T23:57:46.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.741+0000 7fa9c445b640 1 -- 172.21.15.112:0/201825248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9bc0cef10 con 0x7fa9bc161a60 2024-09-15T23:57:46.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.741+0000 7fa9aeffd640 1 -- 172.21.15.112:0/201825248 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa9b80c7440 con 0x7fa9bc161a60 2024-09-15T23:57:46.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.741+0000 7fa9aeffd640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa9a00678c0 0x7fa9a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:46.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.741+0000 7fa9aeffd640 1 -- 172.21.15.112:0/201825248 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fa9b8120290 con 0x7fa9bc161a60 2024-09-15T23:57:46.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.741+0000 7fa9c21f7640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa9a00678c0 0x7fa9a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:46.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.741+0000 7fa9c21f7640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa9a00678c0 0x7fa9a0069d80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc1fa850 tx=0x7fa9b400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:46.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.745+0000 7fa9aeffd640 1 -- 172.21.15.112:0/201825248 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa9b8016110 con 0x7fa9bc161a60 2024-09-15T23:57:46.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.937+0000 7fa9c445b640 1 -- 172.21.15.112:0/201825248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9bc15d6f0 con 0x7fa9bc161a60 2024-09-15T23:57:46.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.937+0000 7fa9aeffd640 1 -- 172.21.15.112:0/201825248 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5234 (secure 0 0 0) 0x7fa9b80f0cd0 con 0x7fa9bc161a60 2024-09-15T23:57:46.937 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:46.937 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":46,"btime":"2024-09-15T23:57:46:581351+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1475104986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1475104986},{"type":"v1","addr":"172.21.15.169:6835","nonce":1475104986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2253954019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2253954019},{"type":"v1","addr":"172.21.15.169:6834","nonce":2253954019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1645054566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1645054566},{"type":"v1","addr":"172.21.15.112:6835","nonce":1645054566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:42.896416+0000","modified":"2024-09-15T23:57:45.943939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6387":{"gid":6387,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/434676840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":434676840},{"type":"v1","addr":"172.21.15.112:6837","nonce":434676840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6387,"qdb_cluster":[6387]},"id":6}]} 2024-09-15T23:57:46.938 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 46 2024-09-15T23:57:46.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.937+0000 7fa9c445b640 1 -- 172.21.15.112:0/201825248 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa9a00678c0 msgr2=0x7fa9a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:46.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.937+0000 7fa9c445b640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa9a00678c0 0x7fa9a0069d80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc1fa850 tx=0x7fa9b400b040 comp rx=0 tx=0).stop 2024-09-15T23:57:46.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.937+0000 7fa9c445b640 1 -- 172.21.15.112:0/201825248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9bc161a60 msgr2=0x7fa9bc159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:46.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.937+0000 7fa9c445b640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9bc161a60 0x7fa9bc159f50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa9b801c290 tx=0x7fa9b801aca0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.937+0000 7fa9c445b640 1 -- 172.21.15.112:0/201825248 shutdown_connections 2024-09-15T23:57:46.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.937+0000 7fa9c445b640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa9a00678c0 0x7fa9a0069d80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.937+0000 7fa9c445b640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9bc161a60 0x7fa9bc159f50 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.937+0000 7fa9c445b640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9bc0d2e90 0x7fa9bc159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.937+0000 7fa9c445b640 1 --2- 172.21.15.112:0/201825248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9bc0cf450 0x7fa9bc153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.937+0000 7fa9c445b640 1 -- 172.21.15.112:0/201825248 >> 172.21.15.112:0/201825248 conn(0x7fa9bc08bf90 msgr2=0x7fa9bc0b3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:46.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.937+0000 7fa9c445b640 1 -- 172.21.15.112:0/201825248 shutdown_connections 2024-09-15T23:57:46.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:46.937+0000 7fa9c445b640 1 -- 172.21.15.112:0/201825248 wait complete. 2024-09-15T23:57:46.955 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:47.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.073+0000 7fc55fbdf640 1 Processor -- start 2024-09-15T23:57:47.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.073+0000 7fc55fbdf640 1 -- start start 2024-09-15T23:57:47.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55fbdf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc558073170 0x7fc55806e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55fbdf640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55806ec60 con 0x7fc5581587a0 2024-09-15T23:57:47.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55fbdf640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55806ef40 con 0x7fc5580b39a0 2024-09-15T23:57:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55fbdf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc55806f870 con 0x7fc558073170 2024-09-15T23:57:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55d97b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc5581587a0 0x7fc5580b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43018/0 (socket says 172.21.15.112:43018) 2024-09-15T23:57:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55d97b640 1 -- 172.21.15.112:0/2940950284 learned_addr learned my addr 172.21.15.112:0/2940950284 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55e17c640 1 --2- 172.21.15.112:0/2940950284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc558073170 0x7fc55806e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 -- 172.21.15.112:0/2940950284 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512870848 0 0) 0x7fc55806ec60 con 0x7fc5581587a0 2024-09-15T23:57:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 -- 172.21.15.112:0/2940950284 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc544003530 con 0x7fc5581587a0 2024-09-15T23:57:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 -- 172.21.15.112:0/2940950284 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3805951748 0 0) 0x7fc544003530 con 0x7fc5581587a0 2024-09-15T23:57:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 -- 172.21.15.112:0/2940950284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc558073170 msgr2=0x7fc55806e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 --2- 172.21.15.112:0/2940950284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc558073170 0x7fc55806e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 -- 172.21.15.112:0/2940950284 >> v1:172.21.15.169:6789/0 conn(0x7fc5580b39a0 legacy=0x7fc55806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 -- 172.21.15.112:0/2940950284 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55806f220 con 0x7fc5581587a0 2024-09-15T23:57:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 -- 172.21.15.112:0/2940950284 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fc554001680 con 0x7fc5581587a0 2024-09-15T23:57:47.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 -- 172.21.15.112:0/2940950284 >> v1:172.21.15.112:6789/0 conn(0x7fc5581587a0 legacy=0x7fc5580b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 --2- 172.21.15.112:0/2940950284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc558073170 0x7fc544003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 --2- 172.21.15.112:0/2940950284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc544003f90 0x7fc544004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 --2- 172.21.15.112:0/2940950284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc544004d50 0x7fc5440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 -- 172.21.15.112:0/2940950284 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc55806f870 con 0x7fc544004d50 2024-09-15T23:57:47.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 -- 172.21.15.112:0/2940950284 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc54400bae0 con 0x7fc544003f90 2024-09-15T23:57:47.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55c979640 1 -- 172.21.15.112:0/2940950284 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc54400bce0 con 0x7fc558073170 2024-09-15T23:57:47.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55e17c640 1 --2- 172.21.15.112:0/2940950284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc544004d50 0x7fc5440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55d17a640 1 --2- 172.21.15.112:0/2940950284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc544003f90 0x7fc544004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55d97b640 1 --2- 172.21.15.112:0/2940950284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc558073170 0x7fc544003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55e17c640 1 -- 172.21.15.112:0/2940950284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc558073170 msgr2=0x7fc544003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:47.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55e17c640 1 --2- 172.21.15.112:0/2940950284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc558073170 0x7fc544003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55e17c640 1 -- 172.21.15.112:0/2940950284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc544003f90 msgr2=0x7fc544004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:47.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55e17c640 1 --2- 172.21.15.112:0/2940950284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc544003f90 0x7fc544004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.077+0000 7fc55e17c640 1 -- 172.21.15.112:0/2940950284 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc544003530 con 0x7fc544004d50 2024-09-15T23:57:47.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55e17c640 1 --2- 172.21.15.112:0/2940950284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc544004d50 0x7fc5440051d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc55815e8a0 tx=0x7fc55001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fcd108c40ed07e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:47.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55c979640 1 -- 172.21.15.112:0/2940950284 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5500b2070 con 0x7fc544004d50 2024-09-15T23:57:47.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55c979640 1 -- 172.21.15.112:0/2940950284 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5500a5c30 con 0x7fc544004d50 2024-09-15T23:57:47.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55c979640 1 -- 172.21.15.112:0/2940950284 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550009c10 con 0x7fc544004d50 2024-09-15T23:57:47.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 -- 172.21.15.112:0/2940950284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc544004d50 msgr2=0x7fc5440051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 --2- 172.21.15.112:0/2940950284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc544004d50 0x7fc5440051d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc55815e8a0 tx=0x7fc55001cc20 comp rx=0 tx=0).stop 2024-09-15T23:57:47.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55e17c640 1 -- 172.21.15.112:0/2940950284 reap_dead start 2024-09-15T23:57:47.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 -- 172.21.15.112:0/2940950284 shutdown_connections 2024-09-15T23:57:47.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 -- 172.21.15.112:0/2940950284 >> 172.21.15.112:0/2940950284 conn(0x7fc5580b1f90 msgr2=0x7fc5580b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:47.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 -- 172.21.15.112:0/2940950284 shutdown_connections 2024-09-15T23:57:47.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 -- 172.21.15.112:0/2940950284 wait complete. 2024-09-15T23:57:47.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 Processor -- start 2024-09-15T23:57:47.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 -- start start 2024-09-15T23:57:47.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc544004d50 0x7fc55809c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc55809db60 0x7fc558159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc55814b750 0x7fc55815c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc558158b80 con 0x7fc55809db60 2024-09-15T23:57:47.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc55806e680 con 0x7fc55814b750 2024-09-15T23:57:47.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc55809cac0 con 0x7fc544004d50 2024-09-15T23:57:47.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55d17a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc55809db60 0x7fc558159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55d17a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc55809db60 0x7fc558159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50022/0 (socket says 172.21.15.112:50022) 2024-09-15T23:57:47.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55d17a640 1 -- 172.21.15.112:0/789764055 learned_addr learned my addr 172.21.15.112:0/789764055 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:47.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55d97b640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc544004d50 0x7fc55809c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55e17c640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc55814b750 0x7fc55815c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55d17a640 1 -- 172.21.15.112:0/789764055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc544004d50 msgr2=0x7fc55809c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55d17a640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc544004d50 0x7fc55809c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55d17a640 1 -- 172.21.15.112:0/789764055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc55814b750 msgr2=0x7fc55815c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55d17a640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc55814b750 0x7fc55815c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55d17a640 1 -- 172.21.15.112:0/789764055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55809cda0 con 0x7fc55809db60 2024-09-15T23:57:47.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55d97b640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc544004d50 0x7fc55809c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:47.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55e17c640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc55814b750 0x7fc55815c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:47.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55d17a640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc55809db60 0x7fc558159da0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc54800f820 tx=0x7fc54800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:47.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc54e7fc640 1 -- 172.21.15.112:0/789764055 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5480050d0 con 0x7fc55809db60 2024-09-15T23:57:47.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc54e7fc640 1 -- 172.21.15.112:0/789764055 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc548018070 con 0x7fc55809db60 2024-09-15T23:57:47.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc54e7fc640 1 -- 172.21.15.112:0/789764055 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54800d730 con 0x7fc55809db60 2024-09-15T23:57:47.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 -- 172.21.15.112:0/789764055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc55809d080 con 0x7fc55809db60 2024-09-15T23:57:47.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.081+0000 7fc55fbdf640 1 -- 172.21.15.112:0/789764055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc55809d640 con 0x7fc55809db60 2024-09-15T23:57:47.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.085+0000 7fc55fbdf640 1 -- 172.21.15.112:0/789764055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55806ea10 con 0x7fc55809db60 2024-09-15T23:57:47.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.085+0000 7fc54e7fc640 1 -- 172.21.15.112:0/789764055 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc54800d8d0 con 0x7fc55809db60 2024-09-15T23:57:47.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.085+0000 7fc54e7fc640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc53c0678c0 0x7fc53c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.085+0000 7fc55d97b640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc53c0678c0 0x7fc53c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.085+0000 7fc54e7fc640 1 -- 172.21.15.112:0/789764055 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fc548085cb0 con 0x7fc55809db60 2024-09-15T23:57:47.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.085+0000 7fc55d97b640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc53c0678c0 0x7fc53c069d80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc554001870 tx=0x7fc554001160 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:47.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.089+0000 7fc54e7fc640 1 -- 172.21.15.112:0/789764055 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc548056660 con 0x7fc55809db60 2024-09-15T23:57:47.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.253+0000 7fc55fbdf640 1 -- 172.21.15.112:0/789764055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc55815e110 con 0x7fc55809db60 2024-09-15T23:57:47.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.257+0000 7fc54e7fc640 1 -- 172.21.15.112:0/789764055 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+17005 (secure 0 0 0) 0x7fc548055f60 con 0x7fc55809db60 2024-09-15T23:57:47.257 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:47.257 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":86,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:57:44.564540+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:40.583942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:41.884324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:47.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.257+0000 7fc55fbdf640 1 -- 172.21.15.112:0/789764055 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc53c0678c0 msgr2=0x7fc53c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.257+0000 7fc55fbdf640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc53c0678c0 0x7fc53c069d80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc554001870 tx=0x7fc554001160 comp rx=0 tx=0).stop 2024-09-15T23:57:47.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.257+0000 7fc55fbdf640 1 -- 172.21.15.112:0/789764055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc55809db60 msgr2=0x7fc558159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.257+0000 7fc55fbdf640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc55809db60 0x7fc558159da0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc54800f820 tx=0x7fc54800fce0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.257+0000 7fc55fbdf640 1 -- 172.21.15.112:0/789764055 shutdown_connections 2024-09-15T23:57:47.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.257+0000 7fc55fbdf640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc53c0678c0 0x7fc53c069d80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.257+0000 7fc55fbdf640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc55814b750 0x7fc55815c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.257+0000 7fc55fbdf640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc55809db60 0x7fc558159da0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.257+0000 7fc55fbdf640 1 --2- 172.21.15.112:0/789764055 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc544004d50 0x7fc55809c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.257+0000 7fc55fbdf640 1 -- 172.21.15.112:0/789764055 >> 172.21.15.112:0/789764055 conn(0x7fc5580b1f90 msgr2=0x7fc558074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.257+0000 7fc55fbdf640 1 -- 172.21.15.112:0/789764055 shutdown_connections 2024-09-15T23:57:47.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.257+0000 7fc55fbdf640 1 -- 172.21.15.112:0/789764055 wait complete. 2024-09-15T23:57:47.276 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:57:47.277 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:57:47.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f233d8d3640 1 Processor -- start 2024-09-15T23:57:47.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f233d8d3640 1 -- start start 2024-09-15T23:57:47.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f233d8d3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f233815bec0 0x7f23380ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f233d8d3640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f233815c2a0 0x7f23380aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f233d8d3640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23380b3290 con 0x7f23380af2a0 2024-09-15T23:57:47.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f233d8d3640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f23380b3570 con 0x7f233815bec0 2024-09-15T23:57:47.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f233d8d3640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f23380b3850 con 0x7f233815c2a0 2024-09-15T23:57:47.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f2336ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f233815bec0 0x7f23380ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f23377fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f23380af2a0 0x7f233815fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:43024/0 (socket says 172.21.15.112:43024) 2024-09-15T23:57:47.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f2336ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f233815bec0 0x7f23380ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50032/0 (socket says 172.21.15.112:50032) 2024-09-15T23:57:47.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f23377fe640 1 -- 172.21.15.112:0/585140717 learned_addr learned my addr 172.21.15.112:0/585140717 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:47.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f232ffff640 1 --2- 172.21.15.112:0/585140717 >> v2:172.21.15.169:3300/0 conn(0x7f233815c2a0 0x7f23380aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f2336ffd640 1 -- 172.21.15.112:0/585140717 >> v2:172.21.15.169:3300/0 conn(0x7f233815c2a0 msgr2=0x7f23380aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:47.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f2336ffd640 1 --2- 172.21.15.112:0/585140717 >> v2:172.21.15.169:3300/0 conn(0x7f233815c2a0 0x7f23380aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f2336ffd640 1 -- 172.21.15.112:0/585140717 >> v1:172.21.15.112:6789/0 conn(0x7f23380af2a0 legacy=0x7f233815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f2336ffd640 1 -- 172.21.15.112:0/585140717 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23380b3b30 con 0x7f233815bec0 2024-09-15T23:57:47.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.393+0000 7f23367fc640 1 -- 172.21.15.112:0/585140717 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3395306372 0 0) 0x7f23380b3290 con 0x7f23380af2a0 2024-09-15T23:57:47.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f2336ffd640 1 --2- 172.21.15.112:0/585140717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f233815bec0 0x7f23380ad200 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f23380ae510 tx=0x7f232801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b9c4ebb779c349 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:47.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f23367fc640 1 -- 172.21.15.112:0/585140717 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280ab650 con 0x7f233815bec0 2024-09-15T23:57:47.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f23367fc640 1 -- 172.21.15.112:0/585140717 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23280b0070 con 0x7f233815bec0 2024-09-15T23:57:47.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f23367fc640 1 -- 172.21.15.112:0/585140717 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280aba10 con 0x7f233815bec0 2024-09-15T23:57:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 -- 172.21.15.112:0/585140717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f233815bec0 msgr2=0x7f23380ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 --2- 172.21.15.112:0/585140717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f233815bec0 0x7f23380ad200 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f23380ae510 tx=0x7f232801c450 comp rx=0 tx=0).stop 2024-09-15T23:57:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 -- 172.21.15.112:0/585140717 shutdown_connections 2024-09-15T23:57:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 --2- 172.21.15.112:0/585140717 >> v2:172.21.15.169:3300/0 conn(0x7f233815c2a0 0x7f23380aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 --2- 172.21.15.112:0/585140717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f233815bec0 0x7f23380ad200 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 -- 172.21.15.112:0/585140717 >> 172.21.15.112:0/585140717 conn(0x7f23380b1f90 msgr2=0x7f23380b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:47.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 -- 172.21.15.112:0/585140717 shutdown_connections 2024-09-15T23:57:47.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 -- 172.21.15.112:0/585140717 wait complete. 2024-09-15T23:57:47.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 Processor -- start 2024-09-15T23:57:47.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 -- start start 2024-09-15T23:57:47.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23380af2a0 0x7f233814e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f233815bec0 0x7f23380d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f233815c2a0 0x7f23380d0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f23380af6d0 con 0x7f23380af2a0 2024-09-15T23:57:47.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f23380ad740 con 0x7f233815bec0 2024-09-15T23:57:47.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2338169000 con 0x7f233815c2a0 2024-09-15T23:57:47.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f2336ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23380af2a0 0x7f233814e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f2336ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23380af2a0 0x7f233814e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50044/0 (socket says 172.21.15.112:50044) 2024-09-15T23:57:47.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f2336ffd640 1 -- 172.21.15.112:0/901391767 learned_addr learned my addr 172.21.15.112:0/901391767 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:47.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f232ffff640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f233815bec0 0x7f23380d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f23377fe640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f233815c2a0 0x7f23380d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f2336ffd640 1 -- 172.21.15.112:0/901391767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f233815c2a0 msgr2=0x7f23380d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f2336ffd640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f233815c2a0 0x7f23380d0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f2336ffd640 1 -- 172.21.15.112:0/901391767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f233815bec0 msgr2=0x7f23380d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f2336ffd640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f233815bec0 0x7f23380d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f2336ffd640 1 -- 172.21.15.112:0/901391767 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2338155bf0 con 0x7f23380af2a0 2024-09-15T23:57:47.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f232ffff640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f233815bec0 0x7f23380d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:47.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f2336ffd640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23380af2a0 0x7f233814e660 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2328019060 tx=0x7f232801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:47.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f2334ff9640 1 -- 172.21.15.112:0/901391767 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2328006e20 con 0x7f23380af2a0 2024-09-15T23:57:47.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f2334ff9640 1 -- 172.21.15.112:0/901391767 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2328004230 con 0x7f23380af2a0 2024-09-15T23:57:47.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 -- 172.21.15.112:0/901391767 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f233814d2e0 con 0x7f23380af2a0 2024-09-15T23:57:47.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f2334ff9640 1 -- 172.21.15.112:0/901391767 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2328003620 con 0x7f23380af2a0 2024-09-15T23:57:47.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.397+0000 7f233d8d3640 1 -- 172.21.15.112:0/901391767 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f233814d8a0 con 0x7f23380af2a0 2024-09-15T23:57:47.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.401+0000 7f233d8d3640 1 -- 172.21.15.112:0/901391767 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23380ad200 con 0x7f23380af2a0 2024-09-15T23:57:47.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.401+0000 7f2334ff9640 1 -- 172.21.15.112:0/901391767 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f23280037c0 con 0x7f23380af2a0 2024-09-15T23:57:47.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.401+0000 7f2334ff9640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23180678c0 0x7f2318069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.401+0000 7f232ffff640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23180678c0 0x7f2318069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.401+0000 7f2334ff9640 1 -- 172.21.15.112:0/901391767 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f2328120d90 con 0x7f23380af2a0 2024-09-15T23:57:47.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.401+0000 7f232ffff640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23180678c0 0x7f2318069d80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f23381f8360 tx=0x7f2320008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:47.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.405+0000 7f2334ff9640 1 -- 172.21.15.112:0/901391767 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2328016070 con 0x7f23380af2a0 2024-09-15T23:57:47.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.561+0000 7f233d8d3640 1 -- 172.21.15.112:0/901391767 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f233806fcd0 con 0x7f23180678c0 2024-09-15T23:57:47.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.569+0000 7f2334ff9640 1 -- 172.21.15.112:0/901391767 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252012 (secure 0 0 0) 0x7f233806fcd0 con 0x7f23180678c0 2024-09-15T23:57:47.572 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:47.574 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:57:47.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.573+0000 7f233d8d3640 1 -- 172.21.15.112:0/901391767 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23180678c0 msgr2=0x7f2318069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.573+0000 7f233d8d3640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23180678c0 0x7f2318069d80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f23381f8360 tx=0x7f2320008040 comp rx=0 tx=0).stop 2024-09-15T23:57:47.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.573+0000 7f233d8d3640 1 -- 172.21.15.112:0/901391767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23380af2a0 msgr2=0x7f233814e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.573+0000 7f233d8d3640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23380af2a0 0x7f233814e660 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2328019060 tx=0x7f232801ac90 comp rx=0 tx=0).stop 2024-09-15T23:57:47.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.573+0000 7f233d8d3640 1 -- 172.21.15.112:0/901391767 shutdown_connections 2024-09-15T23:57:47.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.573+0000 7f233d8d3640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f23180678c0 0x7f2318069d80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.573+0000 7f233d8d3640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f233815c2a0 0x7f23380d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.573+0000 7f233d8d3640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f233815bec0 0x7f23380d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.573+0000 7f233d8d3640 1 --2- 172.21.15.112:0/901391767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23380af2a0 0x7f233814e660 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.573+0000 7f233d8d3640 1 -- 172.21.15.112:0/901391767 >> 172.21.15.112:0/901391767 conn(0x7f23380b1f90 msgr2=0x7f23380b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:47.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.573+0000 7f233d8d3640 1 -- 172.21.15.112:0/901391767 shutdown_connections 2024-09-15T23:57:47.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.573+0000 7f233d8d3640 1 -- 172.21.15.112:0/901391767 wait complete. 2024-09-15T23:57:47.589 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-15T23:57:47.306972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263016,"kb_used_data":9328,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754711704,"statfs":{"total":773094113280,"available":772824784896,"internally_reserved":0,"allocated":9551872,"data_stored":4959516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.787337"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.618651+0000","last_change":"2024-09-15T23:57:43.611446+0000","last_active":"2024-09-15T23:57:43.618651+0000","last_peered":"2024-09-15T23:57:43.618651+0000","last_clean":"2024-09-15T23:57:43.618651+0000","last_became_active":"2024-09-15T23:57:43.610516+0000","last_became_peered":"2024-09-15T23:57:43.610516+0000","last_unstale":"2024-09-15T23:57:43.618651+0000","last_undegraded":"2024-09-15T23:57:43.618651+0000","last_fullsized":"2024-09-15T23:57:43.618651+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:16.888607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.589775+0000","last_change":"2024-09-15T23:57:43.585275+0000","last_active":"2024-09-15T23:57:43.589775+0000","last_peered":"2024-09-15T23:57:43.589775+0000","last_clean":"2024-09-15T23:57:43.589775+0000","last_became_active":"2024-09-15T23:57:43.585008+0000","last_became_peered":"2024-09-15T23:57:43.585008+0000","last_unstale":"2024-09-15T23:57:43.589775+0000","last_undegraded":"2024-09-15T23:57:43.589775+0000","last_fullsized":"2024-09-15T23:57:43.589775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:07.201274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.609935+0000","last_change":"2024-09-15T23:57:43.601133+0000","last_active":"2024-09-15T23:57:43.609935+0000","last_peered":"2024-09-15T23:57:43.609935+0000","last_clean":"2024-09-15T23:57:43.609935+0000","last_became_active":"2024-09-15T23:57:43.593994+0000","last_became_peered":"2024-09-15T23:57:43.593994+0000","last_unstale":"2024-09-15T23:57:43.609935+0000","last_undegraded":"2024-09-15T23:57:43.609935+0000","last_fullsized":"2024-09-15T23:57:43.609935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:11.954686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.607865+0000","last_change":"2024-09-15T23:57:43.594569+0000","last_active":"2024-09-15T23:57:43.607865+0000","last_peered":"2024-09-15T23:57:43.607865+0000","last_clean":"2024-09-15T23:57:43.607865+0000","last_became_active":"2024-09-15T23:57:43.593903+0000","last_became_peered":"2024-09-15T23:57:43.593903+0000","last_unstale":"2024-09-15T23:57:43.607865+0000","last_undegraded":"2024-09-15T23:57:43.607865+0000","last_fullsized":"2024-09-15T23:57:43.607865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:27.180502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.590429+0000","last_change":"2024-09-15T23:57:43.584337+0000","last_active":"2024-09-15T23:57:43.590429+0000","last_peered":"2024-09-15T23:57:43.590429+0000","last_clean":"2024-09-15T23:57:43.590429+0000","last_became_active":"2024-09-15T23:57:43.579863+0000","last_became_peered":"2024-09-15T23:57:43.579863+0000","last_unstale":"2024-09-15T23:57:43.590429+0000","last_undegraded":"2024-09-15T23:57:43.590429+0000","last_fullsized":"2024-09-15T23:57:43.590429+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:15.092630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.607254+0000","last_change":"2024-09-15T23:57:43.605568+0000","last_active":"2024-09-15T23:57:43.607254+0000","last_peered":"2024-09-15T23:57:43.607254+0000","last_clean":"2024-09-15T23:57:43.607254+0000","last_became_active":"2024-09-15T23:57:43.604990+0000","last_became_peered":"2024-09-15T23:57:43.604990+0000","last_unstale":"2024-09-15T23:57:43.607254+0000","last_undegraded":"2024-09-15T23:57:43.607254+0000","last_fullsized":"2024-09-15T23:57:43.607254+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:57.181434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.596315+0000","last_change":"2024-09-15T23:57:43.591249+0000","last_active":"2024-09-15T23:57:43.596315+0000","last_peered":"2024-09-15T23:57:43.596315+0000","last_clean":"2024-09-15T23:57:43.596315+0000","last_became_active":"2024-09-15T23:57:43.590952+0000","last_became_peered":"2024-09-15T23:57:43.590952+0000","last_unstale":"2024-09-15T23:57:43.596315+0000","last_undegraded":"2024-09-15T23:57:43.596315+0000","last_fullsized":"2024-09-15T23:57:43.596315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:33:22.534971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.585128+0000","last_change":"2024-09-15T23:57:43.575429+0000","last_active":"2024-09-15T23:57:43.585128+0000","last_peered":"2024-09-15T23:57:43.585128+0000","last_clean":"2024-09-15T23:57:43.585128+0000","last_became_active":"2024-09-15T23:57:43.574435+0000","last_became_peered":"2024-09-15T23:57:43.574435+0000","last_unstale":"2024-09-15T23:57:43.585128+0000","last_undegraded":"2024-09-15T23:57:43.585128+0000","last_fullsized":"2024-09-15T23:57:43.585128+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:40.245532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.590025+0000","last_change":"2024-09-15T23:57:43.589478+0000","last_active":"2024-09-15T23:57:43.590025+0000","last_peered":"2024-09-15T23:57:43.590025+0000","last_clean":"2024-09-15T23:57:43.590025+0000","last_became_active":"2024-09-15T23:57:43.589224+0000","last_became_peered":"2024-09-15T23:57:43.589224+0000","last_unstale":"2024-09-15T23:57:43.590025+0000","last_undegraded":"2024-09-15T23:57:43.590025+0000","last_fullsized":"2024-09-15T23:57:43.590025+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:54.791762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.609688+0000","last_change":"2024-09-15T23:57:43.600094+0000","last_active":"2024-09-15T23:57:43.609688+0000","last_peered":"2024-09-15T23:57:43.609688+0000","last_clean":"2024-09-15T23:57:43.609688+0000","last_became_active":"2024-09-15T23:57:43.596390+0000","last_became_peered":"2024-09-15T23:57:43.596390+0000","last_unstale":"2024-09-15T23:57:43.609688+0000","last_undegraded":"2024-09-15T23:57:43.609688+0000","last_fullsized":"2024-09-15T23:57:43.609688+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:30.055154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.596308+0000","last_change":"2024-09-15T23:57:43.591287+0000","last_active":"2024-09-15T23:57:43.596308+0000","last_peered":"2024-09-15T23:57:43.596308+0000","last_clean":"2024-09-15T23:57:43.596308+0000","last_became_active":"2024-09-15T23:57:43.590832+0000","last_became_peered":"2024-09-15T23:57:43.590832+0000","last_unstale":"2024-09-15T23:57:43.596308+0000","last_undegraded":"2024-09-15T23:57:43.596308+0000","last_fullsized":"2024-09-15T23:57:43.596308+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:57.025500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.610735+0000","last_change":"2024-09-15T23:57:43.608500+0000","last_active":"2024-09-15T23:57:43.610735+0000","last_peered":"2024-09-15T23:57:43.610735+0000","last_clean":"2024-09-15T23:57:43.610735+0000","last_became_active":"2024-09-15T23:57:43.608156+0000","last_became_peered":"2024-09-15T23:57:43.608156+0000","last_unstale":"2024-09-15T23:57:43.610735+0000","last_undegraded":"2024-09-15T23:57:43.610735+0000","last_fullsized":"2024-09-15T23:57:43.610735+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:16.404709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.604379+0000","last_change":"2024-09-15T23:57:43.597735+0000","last_active":"2024-09-15T23:57:44.604379+0000","last_peered":"2024-09-15T23:57:44.604379+0000","last_clean":"2024-09-15T23:57:44.604379+0000","last_became_active":"2024-09-15T23:57:43.597390+0000","last_became_peered":"2024-09-15T23:57:43.597390+0000","last_unstale":"2024-09-15T23:57:44.604379+0000","last_undegraded":"2024-09-15T23:57:44.604379+0000","last_fullsized":"2024-09-15T23:57:44.604379+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:17.459444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.586582+0000","last_change":"2024-09-15T23:57:43.583540+0000","last_active":"2024-09-15T23:57:43.586582+0000","last_peered":"2024-09-15T23:57:43.586582+0000","last_clean":"2024-09-15T23:57:43.586582+0000","last_became_active":"2024-09-15T23:57:43.583260+0000","last_became_peered":"2024-09-15T23:57:43.583260+0000","last_unstale":"2024-09-15T23:57:43.586582+0000","last_undegraded":"2024-09-15T23:57:43.586582+0000","last_fullsized":"2024-09-15T23:57:43.586582+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:11.590840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.610116+0000","last_change":"2024-09-15T23:57:43.607881+0000","last_active":"2024-09-15T23:57:43.610116+0000","last_peered":"2024-09-15T23:57:43.610116+0000","last_clean":"2024-09-15T23:57:43.610116+0000","last_became_active":"2024-09-15T23:57:43.600729+0000","last_became_peered":"2024-09-15T23:57:43.600729+0000","last_unstale":"2024-09-15T23:57:43.610116+0000","last_undegraded":"2024-09-15T23:57:43.610116+0000","last_fullsized":"2024-09-15T23:57:43.610116+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:38.479449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.592918+0000","last_change":"2024-09-15T23:57:43.585238+0000","last_active":"2024-09-15T23:57:43.592918+0000","last_peered":"2024-09-15T23:57:43.592918+0000","last_clean":"2024-09-15T23:57:43.592918+0000","last_became_active":"2024-09-15T23:57:43.584628+0000","last_became_peered":"2024-09-15T23:57:43.584628+0000","last_unstale":"2024-09-15T23:57:43.592918+0000","last_undegraded":"2024-09-15T23:57:43.592918+0000","last_fullsized":"2024-09-15T23:57:43.592918+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:16.888607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.603387+0000","last_change":"2024-09-15T23:57:43.596244+0000","last_active":"2024-09-15T23:57:43.603387+0000","last_peered":"2024-09-15T23:57:43.603387+0000","last_clean":"2024-09-15T23:57:43.603387+0000","last_became_active":"2024-09-15T23:57:43.595711+0000","last_became_peered":"2024-09-15T23:57:43.595711+0000","last_unstale":"2024-09-15T23:57:43.603387+0000","last_undegraded":"2024-09-15T23:57:43.603387+0000","last_fullsized":"2024-09-15T23:57:43.603387+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:46.326602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.602281+0000","last_change":"2024-09-15T23:57:43.589218+0000","last_active":"2024-09-15T23:57:43.602281+0000","last_peered":"2024-09-15T23:57:43.602281+0000","last_clean":"2024-09-15T23:57:43.602281+0000","last_became_active":"2024-09-15T23:57:43.588417+0000","last_became_peered":"2024-09-15T23:57:43.588417+0000","last_unstale":"2024-09-15T23:57:43.602281+0000","last_undegraded":"2024-09-15T23:57:43.602281+0000","last_fullsized":"2024-09-15T23:57:43.602281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:02.507092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.602481+0000","last_change":"2024-09-15T23:57:43.602085+0000","last_active":"2024-09-15T23:57:43.602481+0000","last_peered":"2024-09-15T23:57:43.602481+0000","last_clean":"2024-09-15T23:57:43.602481+0000","last_became_active":"2024-09-15T23:57:43.601723+0000","last_became_peered":"2024-09-15T23:57:43.601723+0000","last_unstale":"2024-09-15T23:57:43.602481+0000","last_undegraded":"2024-09-15T23:57:43.602481+0000","last_fullsized":"2024-09-15T23:57:43.602481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:40.448042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.596571+0000","last_change":"2024-09-15T23:57:43.592903+0000","last_active":"2024-09-15T23:57:43.596571+0000","last_peered":"2024-09-15T23:57:43.596571+0000","last_clean":"2024-09-15T23:57:43.596571+0000","last_became_active":"2024-09-15T23:57:43.592110+0000","last_became_peered":"2024-09-15T23:57:43.592110+0000","last_unstale":"2024-09-15T23:57:43.596571+0000","last_undegraded":"2024-09-15T23:57:43.596571+0000","last_fullsized":"2024-09-15T23:57:43.596571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:52.267502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.589498+0000","last_change":"2024-09-15T23:57:43.580127+0000","last_active":"2024-09-15T23:57:43.589498+0000","last_peered":"2024-09-15T23:57:43.589498+0000","last_clean":"2024-09-15T23:57:43.589498+0000","last_became_active":"2024-09-15T23:57:43.579284+0000","last_became_peered":"2024-09-15T23:57:43.579284+0000","last_unstale":"2024-09-15T23:57:43.589498+0000","last_undegraded":"2024-09-15T23:57:43.589498+0000","last_fullsized":"2024-09-15T23:57:43.589498+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:47.215637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.588176+0000","last_change":"2024-09-15T23:57:43.586444+0000","last_active":"2024-09-15T23:57:43.588176+0000","last_peered":"2024-09-15T23:57:43.588176+0000","last_clean":"2024-09-15T23:57:43.588176+0000","last_became_active":"2024-09-15T23:57:43.586161+0000","last_became_peered":"2024-09-15T23:57:43.586161+0000","last_unstale":"2024-09-15T23:57:43.588176+0000","last_undegraded":"2024-09-15T23:57:43.588176+0000","last_fullsized":"2024-09-15T23:57:43.588176+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:47.033687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.613365+0000","last_change":"2024-09-15T23:57:43.612215+0000","last_active":"2024-09-15T23:57:43.613365+0000","last_peered":"2024-09-15T23:57:43.613365+0000","last_clean":"2024-09-15T23:57:43.613365+0000","last_became_active":"2024-09-15T23:57:43.611989+0000","last_became_peered":"2024-09-15T23:57:43.611989+0000","last_unstale":"2024-09-15T23:57:43.613365+0000","last_undegraded":"2024-09-15T23:57:43.613365+0000","last_fullsized":"2024-09-15T23:57:43.613365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:56.898246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.618912+0000","last_change":"2024-09-15T23:57:43.612743+0000","last_active":"2024-09-15T23:57:43.618912+0000","last_peered":"2024-09-15T23:57:43.618912+0000","last_clean":"2024-09-15T23:57:43.618912+0000","last_became_active":"2024-09-15T23:57:43.611968+0000","last_became_peered":"2024-09-15T23:57:43.611968+0000","last_unstale":"2024-09-15T23:57:43.618912+0000","last_undegraded":"2024-09-15T23:57:43.618912+0000","last_fullsized":"2024-09-15T23:57:43.618912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:52.267502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.592050+0000","last_change":"2024-09-15T23:57:43.579319+0000","last_active":"2024-09-15T23:57:43.592050+0000","last_peered":"2024-09-15T23:57:43.592050+0000","last_clean":"2024-09-15T23:57:43.592050+0000","last_became_active":"2024-09-15T23:57:43.579049+0000","last_became_peered":"2024-09-15T23:57:43.579049+0000","last_unstale":"2024-09-15T23:57:43.592050+0000","last_undegraded":"2024-09-15T23:57:43.592050+0000","last_fullsized":"2024-09-15T23:57:43.592050+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:11.590840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.589752+0000","last_change":"2024-09-15T23:57:43.585149+0000","last_active":"2024-09-15T23:57:43.589752+0000","last_peered":"2024-09-15T23:57:43.589752+0000","last_clean":"2024-09-15T23:57:43.589752+0000","last_became_active":"2024-09-15T23:57:43.584795+0000","last_became_peered":"2024-09-15T23:57:43.584795+0000","last_unstale":"2024-09-15T23:57:43.589752+0000","last_undegraded":"2024-09-15T23:57:43.589752+0000","last_fullsized":"2024-09-15T23:57:43.589752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:47.033687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.601993+0000","last_change":"2024-09-15T23:57:43.587765+0000","last_active":"2024-09-15T23:57:43.601993+0000","last_peered":"2024-09-15T23:57:43.601993+0000","last_clean":"2024-09-15T23:57:43.601993+0000","last_became_active":"2024-09-15T23:57:43.587036+0000","last_became_peered":"2024-09-15T23:57:43.587036+0000","last_unstale":"2024-09-15T23:57:43.601993+0000","last_undegraded":"2024-09-15T23:57:43.601993+0000","last_fullsized":"2024-09-15T23:57:43.601993+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:18.790416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.606189+0000","last_change":"2024-09-15T23:57:43.575096+0000","last_active":"2024-09-15T23:57:44.606189+0000","last_peered":"2024-09-15T23:57:44.606189+0000","last_clean":"2024-09-15T23:57:44.606189+0000","last_became_active":"2024-09-15T23:57:43.574387+0000","last_became_peered":"2024-09-15T23:57:43.574387+0000","last_unstale":"2024-09-15T23:57:44.606189+0000","last_undegraded":"2024-09-15T23:57:44.606189+0000","last_fullsized":"2024-09-15T23:57:44.606189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:08.645930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.613783+0000","last_change":"2024-09-15T23:57:43.613198+0000","last_active":"2024-09-15T23:57:43.613783+0000","last_peered":"2024-09-15T23:57:43.613783+0000","last_clean":"2024-09-15T23:57:43.613783+0000","last_became_active":"2024-09-15T23:57:43.612832+0000","last_became_peered":"2024-09-15T23:57:43.612832+0000","last_unstale":"2024-09-15T23:57:43.613783+0000","last_undegraded":"2024-09-15T23:57:43.613783+0000","last_fullsized":"2024-09-15T23:57:43.613783+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:07.603711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.589696+0000","last_change":"2024-09-15T23:57:43.585848+0000","last_active":"2024-09-15T23:57:43.589696+0000","last_peered":"2024-09-15T23:57:43.589696+0000","last_clean":"2024-09-15T23:57:43.589696+0000","last_became_active":"2024-09-15T23:57:43.584637+0000","last_became_peered":"2024-09-15T23:57:43.584637+0000","last_unstale":"2024-09-15T23:57:43.589696+0000","last_undegraded":"2024-09-15T23:57:43.589696+0000","last_fullsized":"2024-09-15T23:57:43.589696+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:40.448042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.618184+0000","last_change":"2024-09-15T23:57:43.617796+0000","last_active":"2024-09-15T23:57:43.618184+0000","last_peered":"2024-09-15T23:57:43.618184+0000","last_clean":"2024-09-15T23:57:43.618184+0000","last_became_active":"2024-09-15T23:57:43.617473+0000","last_became_peered":"2024-09-15T23:57:43.617473+0000","last_unstale":"2024-09-15T23:57:43.618184+0000","last_undegraded":"2024-09-15T23:57:43.618184+0000","last_fullsized":"2024-09-15T23:57:43.618184+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:19.477277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.588404+0000","last_change":"2024-09-15T23:57:43.584544+0000","last_active":"2024-09-15T23:57:43.588404+0000","last_peered":"2024-09-15T23:57:43.588404+0000","last_clean":"2024-09-15T23:57:43.588404+0000","last_became_active":"2024-09-15T23:57:43.583645+0000","last_became_peered":"2024-09-15T23:57:43.583645+0000","last_unstale":"2024-09-15T23:57:43.588404+0000","last_undegraded":"2024-09-15T23:57:43.588404+0000","last_fullsized":"2024-09-15T23:57:43.588404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:07.603711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.615235+0000","last_change":"2024-09-15T23:57:43.582850+0000","last_active":"2024-09-15T23:57:43.615235+0000","last_peered":"2024-09-15T23:57:43.615235+0000","last_clean":"2024-09-15T23:57:43.615235+0000","last_became_active":"2024-09-15T23:57:43.582098+0000","last_became_peered":"2024-09-15T23:57:43.582098+0000","last_unstale":"2024-09-15T23:57:43.615235+0000","last_undegraded":"2024-09-15T23:57:43.615235+0000","last_fullsized":"2024-09-15T23:57:43.615235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:19.477277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"85'4","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.596489+0000","last_change":"2024-09-15T23:57:42.560704+0000","last_active":"2024-09-15T23:57:43.596489+0000","last_peered":"2024-09-15T23:57:43.596489+0000","last_clean":"2024-09-15T23:57:43.596489+0000","last_became_active":"2024-09-15T23:57:42.559866+0000","last_became_peered":"2024-09-15T23:57:42.559866+0000","last_unstale":"2024-09-15T23:57:43.596489+0000","last_undegraded":"2024-09-15T23:57:43.596489+0000","last_fullsized":"2024-09-15T23:57:43.596489+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:09.841137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.596893+0000","last_change":"2024-09-15T23:57:43.593096+0000","last_active":"2024-09-15T23:57:43.596893+0000","last_peered":"2024-09-15T23:57:43.596893+0000","last_clean":"2024-09-15T23:57:43.596893+0000","last_became_active":"2024-09-15T23:57:43.592338+0000","last_became_peered":"2024-09-15T23:57:43.592338+0000","last_unstale":"2024-09-15T23:57:43.596893+0000","last_undegraded":"2024-09-15T23:57:43.596893+0000","last_fullsized":"2024-09-15T23:57:43.596893+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:23.293437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.587221+0000","last_change":"2024-09-15T23:57:42.564037+0000","last_active":"2024-09-15T23:57:43.587221+0000","last_peered":"2024-09-15T23:57:43.587221+0000","last_clean":"2024-09-15T23:57:43.587221+0000","last_became_active":"2024-09-15T23:57:42.563642+0000","last_became_peered":"2024-09-15T23:57:42.563642+0000","last_unstale":"2024-09-15T23:57:43.587221+0000","last_undegraded":"2024-09-15T23:57:43.587221+0000","last_fullsized":"2024-09-15T23:57:43.587221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:59.523941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.599539+0000","last_change":"2024-09-15T23:57:43.598377+0000","last_active":"2024-09-15T23:57:43.599539+0000","last_peered":"2024-09-15T23:57:43.599539+0000","last_clean":"2024-09-15T23:57:43.599539+0000","last_became_active":"2024-09-15T23:57:43.598074+0000","last_became_peered":"2024-09-15T23:57:43.598074+0000","last_unstale":"2024-09-15T23:57:43.599539+0000","last_undegraded":"2024-09-15T23:57:43.599539+0000","last_fullsized":"2024-09-15T23:57:43.599539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:06.803667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.612886+0000","last_change":"2024-09-15T23:57:42.547172+0000","last_active":"2024-09-15T23:57:43.612886+0000","last_peered":"2024-09-15T23:57:43.612886+0000","last_clean":"2024-09-15T23:57:43.612886+0000","last_became_active":"2024-09-15T23:57:42.546796+0000","last_became_peered":"2024-09-15T23:57:42.546796+0000","last_unstale":"2024-09-15T23:57:43.612886+0000","last_undegraded":"2024-09-15T23:57:43.612886+0000","last_fullsized":"2024-09-15T23:57:43.612886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:10.976235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.601591+0000","last_change":"2024-09-15T23:57:43.587916+0000","last_active":"2024-09-15T23:57:43.601591+0000","last_peered":"2024-09-15T23:57:43.601591+0000","last_clean":"2024-09-15T23:57:43.601591+0000","last_became_active":"2024-09-15T23:57:43.587109+0000","last_became_peered":"2024-09-15T23:57:43.587109+0000","last_unstale":"2024-09-15T23:57:43.601591+0000","last_undegraded":"2024-09-15T23:57:43.601591+0000","last_fullsized":"2024-09-15T23:57:43.601591+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:38.026195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.604753+0000","last_change":"2024-09-15T23:57:42.550275+0000","last_active":"2024-09-15T23:57:43.604753+0000","last_peered":"2024-09-15T23:57:43.604753+0000","last_clean":"2024-09-15T23:57:43.604753+0000","last_became_active":"2024-09-15T23:57:42.549902+0000","last_became_peered":"2024-09-15T23:57:42.549902+0000","last_unstale":"2024-09-15T23:57:43.604753+0000","last_undegraded":"2024-09-15T23:57:43.604753+0000","last_fullsized":"2024-09-15T23:57:43.604753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:03.607829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.604131+0000","last_change":"2024-09-15T23:57:43.617635+0000","last_active":"2024-09-15T23:57:44.604131+0000","last_peered":"2024-09-15T23:57:44.604131+0000","last_clean":"2024-09-15T23:57:44.604131+0000","last_became_active":"2024-09-15T23:57:43.617286+0000","last_became_peered":"2024-09-15T23:57:43.617286+0000","last_unstale":"2024-09-15T23:57:44.604131+0000","last_undegraded":"2024-09-15T23:57:44.604131+0000","last_fullsized":"2024-09-15T23:57:44.604131+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:53.493181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.601608+0000","last_change":"2024-09-15T23:57:42.539531+0000","last_active":"2024-09-15T23:57:43.601608+0000","last_peered":"2024-09-15T23:57:43.601608+0000","last_clean":"2024-09-15T23:57:43.601608+0000","last_became_active":"2024-09-15T23:57:42.538902+0000","last_became_peered":"2024-09-15T23:57:42.538902+0000","last_unstale":"2024-09-15T23:57:43.601608+0000","last_undegraded":"2024-09-15T23:57:43.601608+0000","last_fullsized":"2024-09-15T23:57:43.601608+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:52.928333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.596286+0000","last_change":"2024-09-15T23:57:43.591215+0000","last_active":"2024-09-15T23:57:43.596286+0000","last_peered":"2024-09-15T23:57:43.596286+0000","last_clean":"2024-09-15T23:57:43.596286+0000","last_became_active":"2024-09-15T23:57:43.590920+0000","last_became_peered":"2024-09-15T23:57:43.590920+0000","last_unstale":"2024-09-15T23:57:43.596286+0000","last_undegraded":"2024-09-15T23:57:43.596286+0000","last_fullsized":"2024-09-15T23:57:43.596286+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:43.297178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.604065+0000","last_change":"2024-09-15T23:57:42.549294+0000","last_active":"2024-09-15T23:57:44.604065+0000","last_peered":"2024-09-15T23:57:44.604065+0000","last_clean":"2024-09-15T23:57:44.604065+0000","last_became_active":"2024-09-15T23:57:42.548604+0000","last_became_peered":"2024-09-15T23:57:42.548604+0000","last_unstale":"2024-09-15T23:57:44.604065+0000","last_undegraded":"2024-09-15T23:57:44.604065+0000","last_fullsized":"2024-09-15T23:57:44.604065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:43.532090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.589804+0000","last_change":"2024-09-15T23:57:43.584736+0000","last_active":"2024-09-15T23:57:43.589804+0000","last_peered":"2024-09-15T23:57:43.589804+0000","last_clean":"2024-09-15T23:57:43.589804+0000","last_became_active":"2024-09-15T23:57:43.584287+0000","last_became_peered":"2024-09-15T23:57:43.584287+0000","last_unstale":"2024-09-15T23:57:43.589804+0000","last_undegraded":"2024-09-15T23:57:43.589804+0000","last_fullsized":"2024-09-15T23:57:43.589804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:35.754995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.579739+0000","last_change":"2024-09-15T23:57:42.563677+0000","last_active":"2024-09-15T23:57:43.579739+0000","last_peered":"2024-09-15T23:57:43.579739+0000","last_clean":"2024-09-15T23:57:43.579739+0000","last_became_active":"2024-09-15T23:57:42.562915+0000","last_became_peered":"2024-09-15T23:57:42.562915+0000","last_unstale":"2024-09-15T23:57:43.579739+0000","last_undegraded":"2024-09-15T23:57:43.579739+0000","last_fullsized":"2024-09-15T23:57:43.579739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:18.927779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.615722+0000","last_change":"2024-09-15T23:57:43.604297+0000","last_active":"2024-09-15T23:57:43.615722+0000","last_peered":"2024-09-15T23:57:43.615722+0000","last_clean":"2024-09-15T23:57:43.615722+0000","last_became_active":"2024-09-15T23:57:43.590245+0000","last_became_peered":"2024-09-15T23:57:43.590245+0000","last_unstale":"2024-09-15T23:57:43.615722+0000","last_undegraded":"2024-09-15T23:57:43.615722+0000","last_fullsized":"2024-09-15T23:57:43.615722+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:35.754995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.559027+0000","last_change":"2024-09-15T23:57:42.548411+0000","last_active":"2024-09-15T23:57:43.559027+0000","last_peered":"2024-09-15T23:57:43.559027+0000","last_clean":"2024-09-15T23:57:43.559027+0000","last_became_active":"2024-09-15T23:57:42.545752+0000","last_became_peered":"2024-09-15T23:57:42.545752+0000","last_unstale":"2024-09-15T23:57:43.559027+0000","last_undegraded":"2024-09-15T23:57:43.559027+0000","last_fullsized":"2024-09-15T23:57:43.559027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:06.813246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.600082+0000","last_change":"2024-09-15T23:57:43.599438+0000","last_active":"2024-09-15T23:57:43.600082+0000","last_peered":"2024-09-15T23:57:43.600082+0000","last_clean":"2024-09-15T23:57:43.600082+0000","last_became_active":"2024-09-15T23:57:43.599138+0000","last_became_peered":"2024-09-15T23:57:43.599138+0000","last_unstale":"2024-09-15T23:57:43.600082+0000","last_undegraded":"2024-09-15T23:57:43.600082+0000","last_fullsized":"2024-09-15T23:57:43.600082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:31.330027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.557686+0000","last_change":"2024-09-15T23:57:42.551149+0000","last_active":"2024-09-15T23:57:43.557686+0000","last_peered":"2024-09-15T23:57:43.557686+0000","last_clean":"2024-09-15T23:57:43.557686+0000","last_became_active":"2024-09-15T23:57:42.550705+0000","last_became_peered":"2024-09-15T23:57:42.550705+0000","last_unstale":"2024-09-15T23:57:43.557686+0000","last_undegraded":"2024-09-15T23:57:43.557686+0000","last_fullsized":"2024-09-15T23:57:43.557686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:29.731580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.577243+0000","last_change":"2024-09-15T23:57:43.575964+0000","last_active":"2024-09-15T23:57:43.577243+0000","last_peered":"2024-09-15T23:57:43.577243+0000","last_clean":"2024-09-15T23:57:43.577243+0000","last_became_active":"2024-09-15T23:57:43.575688+0000","last_became_peered":"2024-09-15T23:57:43.575688+0000","last_unstale":"2024-09-15T23:57:43.577243+0000","last_undegraded":"2024-09-15T23:57:43.577243+0000","last_fullsized":"2024-09-15T23:57:43.577243+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:44.761877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.578013+0000","last_change":"2024-09-15T23:57:42.555572+0000","last_active":"2024-09-15T23:57:43.578013+0000","last_peered":"2024-09-15T23:57:43.578013+0000","last_clean":"2024-09-15T23:57:43.578013+0000","last_became_active":"2024-09-15T23:57:42.554750+0000","last_became_peered":"2024-09-15T23:57:42.554750+0000","last_unstale":"2024-09-15T23:57:43.578013+0000","last_undegraded":"2024-09-15T23:57:43.578013+0000","last_fullsized":"2024-09-15T23:57:43.578013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:41.304300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.615688+0000","last_change":"2024-09-15T23:57:43.590113+0000","last_active":"2024-09-15T23:57:43.615688+0000","last_peered":"2024-09-15T23:57:43.615688+0000","last_clean":"2024-09-15T23:57:43.615688+0000","last_became_active":"2024-09-15T23:57:43.589219+0000","last_became_peered":"2024-09-15T23:57:43.589219+0000","last_unstale":"2024-09-15T23:57:43.615688+0000","last_undegraded":"2024-09-15T23:57:43.615688+0000","last_fullsized":"2024-09-15T23:57:43.615688+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:07.603711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"85'3","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.616833+0000","last_change":"2024-09-15T23:57:42.547139+0000","last_active":"2024-09-15T23:57:43.616833+0000","last_peered":"2024-09-15T23:57:43.616833+0000","last_clean":"2024-09-15T23:57:43.616833+0000","last_became_active":"2024-09-15T23:57:42.545280+0000","last_became_peered":"2024-09-15T23:57:42.545280+0000","last_unstale":"2024-09-15T23:57:43.616833+0000","last_undegraded":"2024-09-15T23:57:43.616833+0000","last_fullsized":"2024-09-15T23:57:43.616833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:40.732501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.580084+0000","last_change":"2024-09-15T23:57:43.576929+0000","last_active":"2024-09-15T23:57:43.580084+0000","last_peered":"2024-09-15T23:57:43.580084+0000","last_clean":"2024-09-15T23:57:43.580084+0000","last_became_active":"2024-09-15T23:57:43.576489+0000","last_became_peered":"2024-09-15T23:57:43.576489+0000","last_unstale":"2024-09-15T23:57:43.580084+0000","last_undegraded":"2024-09-15T23:57:43.580084+0000","last_fullsized":"2024-09-15T23:57:43.580084+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:56.898246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"85'6","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.620934+0000","last_change":"2024-09-15T23:57:42.543049+0000","last_active":"2024-09-15T23:57:43.620934+0000","last_peered":"2024-09-15T23:57:43.620934+0000","last_clean":"2024-09-15T23:57:43.620934+0000","last_became_active":"2024-09-15T23:57:42.541443+0000","last_became_peered":"2024-09-15T23:57:42.541443+0000","last_unstale":"2024-09-15T23:57:43.620934+0000","last_undegraded":"2024-09-15T23:57:43.620934+0000","last_fullsized":"2024-09-15T23:57:43.620934+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:46.023765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.615205+0000","last_change":"2024-09-15T23:57:43.587850+0000","last_active":"2024-09-15T23:57:43.615205+0000","last_peered":"2024-09-15T23:57:43.615205+0000","last_clean":"2024-09-15T23:57:43.615205+0000","last_became_active":"2024-09-15T23:57:43.583727+0000","last_became_peered":"2024-09-15T23:57:43.583727+0000","last_unstale":"2024-09-15T23:57:43.615205+0000","last_undegraded":"2024-09-15T23:57:43.615205+0000","last_fullsized":"2024-09-15T23:57:43.615205+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:40.245532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.616945+0000","last_change":"2024-09-15T23:57:42.547824+0000","last_active":"2024-09-15T23:57:43.616945+0000","last_peered":"2024-09-15T23:57:43.616945+0000","last_clean":"2024-09-15T23:57:43.616945+0000","last_became_active":"2024-09-15T23:57:42.547549+0000","last_became_peered":"2024-09-15T23:57:42.547549+0000","last_unstale":"2024-09-15T23:57:43.616945+0000","last_undegraded":"2024-09-15T23:57:43.616945+0000","last_fullsized":"2024-09-15T23:57:43.616945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:25.513540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.588912+0000","last_change":"2024-09-15T23:57:43.578289+0000","last_active":"2024-09-15T23:57:43.588912+0000","last_peered":"2024-09-15T23:57:43.588912+0000","last_clean":"2024-09-15T23:57:43.588912+0000","last_became_active":"2024-09-15T23:57:43.577964+0000","last_became_peered":"2024-09-15T23:57:43.577964+0000","last_unstale":"2024-09-15T23:57:43.588912+0000","last_undegraded":"2024-09-15T23:57:43.588912+0000","last_fullsized":"2024-09-15T23:57:43.588912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.938255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.560396+0000","last_change":"2024-09-15T23:57:42.537174+0000","last_active":"2024-09-15T23:57:43.560396+0000","last_peered":"2024-09-15T23:57:43.560396+0000","last_clean":"2024-09-15T23:57:43.560396+0000","last_became_active":"2024-09-15T23:57:42.536439+0000","last_became_peered":"2024-09-15T23:57:42.536439+0000","last_unstale":"2024-09-15T23:57:43.560396+0000","last_undegraded":"2024-09-15T23:57:43.560396+0000","last_fullsized":"2024-09-15T23:57:43.560396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:39.438120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.615565+0000","last_change":"2024-09-15T23:57:43.590096+0000","last_active":"2024-09-15T23:57:43.615565+0000","last_peered":"2024-09-15T23:57:43.615565+0000","last_clean":"2024-09-15T23:57:43.615565+0000","last_became_active":"2024-09-15T23:57:43.589327+0000","last_became_peered":"2024-09-15T23:57:43.589327+0000","last_unstale":"2024-09-15T23:57:43.615565+0000","last_undegraded":"2024-09-15T23:57:43.615565+0000","last_fullsized":"2024-09-15T23:57:43.615565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:56.898246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.554907+0000","last_change":"2024-09-15T23:57:42.568806+0000","last_active":"2024-09-15T23:57:43.554907+0000","last_peered":"2024-09-15T23:57:43.554907+0000","last_clean":"2024-09-15T23:57:43.554907+0000","last_became_active":"2024-09-15T23:57:42.568107+0000","last_became_peered":"2024-09-15T23:57:42.568107+0000","last_unstale":"2024-09-15T23:57:43.554907+0000","last_undegraded":"2024-09-15T23:57:43.554907+0000","last_fullsized":"2024-09-15T23:57:43.554907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:46.205715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.605061+0000","last_change":"2024-09-15T23:57:43.591856+0000","last_active":"2024-09-15T23:57:44.605061+0000","last_peered":"2024-09-15T23:57:44.605061+0000","last_clean":"2024-09-15T23:57:44.605061+0000","last_became_active":"2024-09-15T23:57:43.578625+0000","last_became_peered":"2024-09-15T23:57:43.578625+0000","last_unstale":"2024-09-15T23:57:44.605061+0000","last_undegraded":"2024-09-15T23:57:44.605061+0000","last_fullsized":"2024-09-15T23:57:44.605061+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:06.678929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"85'8","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.619752+0000","last_change":"2024-09-15T23:57:42.555280+0000","last_active":"2024-09-15T23:57:43.619752+0000","last_peered":"2024-09-15T23:57:43.619752+0000","last_clean":"2024-09-15T23:57:43.619752+0000","last_became_active":"2024-09-15T23:57:42.554482+0000","last_became_peered":"2024-09-15T23:57:42.554482+0000","last_unstale":"2024-09-15T23:57:43.619752+0000","last_undegraded":"2024-09-15T23:57:43.619752+0000","last_fullsized":"2024-09-15T23:57:43.619752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:05.635562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.606540+0000","last_change":"2024-09-15T23:57:43.595787+0000","last_active":"2024-09-15T23:57:44.606540+0000","last_peered":"2024-09-15T23:57:44.606540+0000","last_clean":"2024-09-15T23:57:44.606540+0000","last_became_active":"2024-09-15T23:57:43.575718+0000","last_became_peered":"2024-09-15T23:57:43.575718+0000","last_unstale":"2024-09-15T23:57:44.606540+0000","last_undegraded":"2024-09-15T23:57:44.606540+0000","last_fullsized":"2024-09-15T23:57:44.606540+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:46.532797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.586728+0000","last_change":"2024-09-15T23:57:42.533884+0000","last_active":"2024-09-15T23:57:43.586728+0000","last_peered":"2024-09-15T23:57:43.586728+0000","last_clean":"2024-09-15T23:57:43.586728+0000","last_became_active":"2024-09-15T23:57:42.533514+0000","last_became_peered":"2024-09-15T23:57:42.533514+0000","last_unstale":"2024-09-15T23:57:43.586728+0000","last_undegraded":"2024-09-15T23:57:43.586728+0000","last_fullsized":"2024-09-15T23:57:43.586728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:10.580918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.586098+0000","last_change":"2024-09-15T23:57:43.582248+0000","last_active":"2024-09-15T23:57:43.586098+0000","last_peered":"2024-09-15T23:57:43.586098+0000","last_clean":"2024-09-15T23:57:43.586098+0000","last_became_active":"2024-09-15T23:57:43.581941+0000","last_became_peered":"2024-09-15T23:57:43.581941+0000","last_unstale":"2024-09-15T23:57:43.586098+0000","last_undegraded":"2024-09-15T23:57:43.586098+0000","last_fullsized":"2024-09-15T23:57:43.586098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:00.342632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.590118+0000","last_change":"2024-09-15T23:57:42.555234+0000","last_active":"2024-09-15T23:57:43.590118+0000","last_peered":"2024-09-15T23:57:43.590118+0000","last_clean":"2024-09-15T23:57:43.590118+0000","last_became_active":"2024-09-15T23:57:42.554866+0000","last_became_peered":"2024-09-15T23:57:42.554866+0000","last_unstale":"2024-09-15T23:57:43.590118+0000","last_undegraded":"2024-09-15T23:57:43.590118+0000","last_fullsized":"2024-09-15T23:57:43.590118+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:52.928333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.585021+0000","last_change":"2024-09-15T23:57:43.575130+0000","last_active":"2024-09-15T23:57:43.585021+0000","last_peered":"2024-09-15T23:57:43.585021+0000","last_clean":"2024-09-15T23:57:43.585021+0000","last_became_active":"2024-09-15T23:57:43.574753+0000","last_became_peered":"2024-09-15T23:57:43.574753+0000","last_unstale":"2024-09-15T23:57:43.585021+0000","last_undegraded":"2024-09-15T23:57:43.585021+0000","last_fullsized":"2024-09-15T23:57:43.585021+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:04.617751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.589435+0000","last_change":"2024-09-15T23:57:42.553958+0000","last_active":"2024-09-15T23:57:43.589435+0000","last_peered":"2024-09-15T23:57:43.589435+0000","last_clean":"2024-09-15T23:57:43.589435+0000","last_became_active":"2024-09-15T23:57:42.553170+0000","last_became_peered":"2024-09-15T23:57:42.553170+0000","last_unstale":"2024-09-15T23:57:43.589435+0000","last_undegraded":"2024-09-15T23:57:43.589435+0000","last_fullsized":"2024-09-15T23:57:43.589435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:06.813246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.603537+0000","last_change":"2024-09-15T23:57:43.596612+0000","last_active":"2024-09-15T23:57:43.603537+0000","last_peered":"2024-09-15T23:57:43.603537+0000","last_clean":"2024-09-15T23:57:43.603537+0000","last_became_active":"2024-09-15T23:57:43.595941+0000","last_became_peered":"2024-09-15T23:57:43.595941+0000","last_unstale":"2024-09-15T23:57:43.603537+0000","last_undegraded":"2024-09-15T23:57:43.603537+0000","last_fullsized":"2024-09-15T23:57:43.603537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:48.230239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.612772+0000","last_change":"2024-09-15T23:57:42.547529+0000","last_active":"2024-09-15T23:57:43.612772+0000","last_peered":"2024-09-15T23:57:43.612772+0000","last_clean":"2024-09-15T23:57:43.612772+0000","last_became_active":"2024-09-15T23:57:42.546821+0000","last_became_peered":"2024-09-15T23:57:42.546821+0000","last_unstale":"2024-09-15T23:57:43.612772+0000","last_undegraded":"2024-09-15T23:57:43.612772+0000","last_fullsized":"2024-09-15T23:57:43.612772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:53.377917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.586618+0000","last_change":"2024-09-15T23:57:43.584180+0000","last_active":"2024-09-15T23:57:43.586618+0000","last_peered":"2024-09-15T23:57:43.586618+0000","last_clean":"2024-09-15T23:57:43.586618+0000","last_became_active":"2024-09-15T23:57:43.583711+0000","last_became_peered":"2024-09-15T23:57:43.583711+0000","last_unstale":"2024-09-15T23:57:43.586618+0000","last_undegraded":"2024-09-15T23:57:43.586618+0000","last_fullsized":"2024-09-15T23:57:43.586618+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:47.215637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.556754+0000","last_change":"2024-09-15T23:57:42.567277+0000","last_active":"2024-09-15T23:57:43.556754+0000","last_peered":"2024-09-15T23:57:43.556754+0000","last_clean":"2024-09-15T23:57:43.556754+0000","last_became_active":"2024-09-15T23:57:42.566683+0000","last_became_peered":"2024-09-15T23:57:42.566683+0000","last_unstale":"2024-09-15T23:57:43.556754+0000","last_undegraded":"2024-09-15T23:57:43.556754+0000","last_fullsized":"2024-09-15T23:57:43.556754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:18.467355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.587022+0000","last_change":"2024-09-15T23:57:43.583604+0000","last_active":"2024-09-15T23:57:43.587022+0000","last_peered":"2024-09-15T23:57:43.587022+0000","last_clean":"2024-09-15T23:57:43.587022+0000","last_became_active":"2024-09-15T23:57:43.583289+0000","last_became_peered":"2024-09-15T23:57:43.583289+0000","last_unstale":"2024-09-15T23:57:43.587022+0000","last_undegraded":"2024-09-15T23:57:43.587022+0000","last_fullsized":"2024-09-15T23:57:43.587022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:47.215637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.568140+0000","last_change":"2024-09-15T23:57:42.541900+0000","last_active":"2024-09-15T23:57:43.568140+0000","last_peered":"2024-09-15T23:57:43.568140+0000","last_clean":"2024-09-15T23:57:43.568140+0000","last_became_active":"2024-09-15T23:57:42.541575+0000","last_became_peered":"2024-09-15T23:57:42.541575+0000","last_unstale":"2024-09-15T23:57:43.568140+0000","last_undegraded":"2024-09-15T23:57:43.568140+0000","last_fullsized":"2024-09-15T23:57:43.568140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:10.976235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.610844+0000","last_change":"2024-09-15T23:57:43.583143+0000","last_active":"2024-09-15T23:57:43.610844+0000","last_peered":"2024-09-15T23:57:43.610844+0000","last_clean":"2024-09-15T23:57:43.610844+0000","last_became_active":"2024-09-15T23:57:43.581938+0000","last_became_peered":"2024-09-15T23:57:43.581938+0000","last_unstale":"2024-09-15T23:57:43.610844+0000","last_undegraded":"2024-09-15T23:57:43.610844+0000","last_fullsized":"2024-09-15T23:57:43.610844+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:31.330027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.603867+0000","last_change":"2024-09-15T23:57:42.551525+0000","last_active":"2024-09-15T23:57:44.603867+0000","last_peered":"2024-09-15T23:57:44.603867+0000","last_clean":"2024-09-15T23:57:44.603867+0000","last_became_active":"2024-09-15T23:57:42.550200+0000","last_became_peered":"2024-09-15T23:57:42.550200+0000","last_unstale":"2024-09-15T23:57:44.603867+0000","last_undegraded":"2024-09-15T23:57:44.603867+0000","last_fullsized":"2024-09-15T23:57:44.603867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:01.494733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.587055+0000","last_change":"2024-09-15T23:57:43.585134+0000","last_active":"2024-09-15T23:57:43.587055+0000","last_peered":"2024-09-15T23:57:43.587055+0000","last_clean":"2024-09-15T23:57:43.587055+0000","last_became_active":"2024-09-15T23:57:43.584813+0000","last_became_peered":"2024-09-15T23:57:43.584813+0000","last_unstale":"2024-09-15T23:57:43.587055+0000","last_undegraded":"2024-09-15T23:57:43.587055+0000","last_fullsized":"2024-09-15T23:57:43.587055+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:15.092630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.588540+0000","last_change":"2024-09-15T23:57:42.559262+0000","last_active":"2024-09-15T23:57:43.588540+0000","last_peered":"2024-09-15T23:57:43.588540+0000","last_clean":"2024-09-15T23:57:43.588540+0000","last_became_active":"2024-09-15T23:57:42.555807+0000","last_became_peered":"2024-09-15T23:57:42.555807+0000","last_unstale":"2024-09-15T23:57:43.588540+0000","last_undegraded":"2024-09-15T23:57:43.588540+0000","last_fullsized":"2024-09-15T23:57:43.588540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:45.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.606155+0000","last_change":"2024-09-15T23:57:43.576839+0000","last_active":"2024-09-15T23:57:44.606155+0000","last_peered":"2024-09-15T23:57:44.606155+0000","last_clean":"2024-09-15T23:57:44.606155+0000","last_became_active":"2024-09-15T23:57:43.576127+0000","last_became_peered":"2024-09-15T23:57:43.576127+0000","last_unstale":"2024-09-15T23:57:44.606155+0000","last_undegraded":"2024-09-15T23:57:44.606155+0000","last_fullsized":"2024-09-15T23:57:44.606155+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:17.475307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.572566+0000","last_change":"2024-09-15T23:57:42.558940+0000","last_active":"2024-09-15T23:57:43.572566+0000","last_peered":"2024-09-15T23:57:43.572566+0000","last_clean":"2024-09-15T23:57:43.572566+0000","last_became_active":"2024-09-15T23:57:42.558227+0000","last_became_peered":"2024-09-15T23:57:42.558227+0000","last_unstale":"2024-09-15T23:57:43.572566+0000","last_undegraded":"2024-09-15T23:57:43.572566+0000","last_fullsized":"2024-09-15T23:57:43.572566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:24.878514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.606690+0000","last_change":"2024-09-15T23:57:43.577765+0000","last_active":"2024-09-15T23:57:44.606690+0000","last_peered":"2024-09-15T23:57:44.606690+0000","last_clean":"2024-09-15T23:57:44.606690+0000","last_became_active":"2024-09-15T23:57:43.577076+0000","last_became_peered":"2024-09-15T23:57:43.577076+0000","last_unstale":"2024-09-15T23:57:44.606690+0000","last_undegraded":"2024-09-15T23:57:44.606690+0000","last_fullsized":"2024-09-15T23:57:44.606690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:00.164389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.571592+0000","last_change":"2024-09-15T23:57:42.559032+0000","last_active":"2024-09-15T23:57:43.571592+0000","last_peered":"2024-09-15T23:57:43.571592+0000","last_clean":"2024-09-15T23:57:43.571592+0000","last_became_active":"2024-09-15T23:57:42.558579+0000","last_became_peered":"2024-09-15T23:57:42.558579+0000","last_unstale":"2024-09-15T23:57:43.571592+0000","last_undegraded":"2024-09-15T23:57:43.571592+0000","last_fullsized":"2024-09-15T23:57:43.571592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:03.607829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.592187+0000","last_change":"2024-09-15T23:57:43.588292+0000","last_active":"2024-09-15T23:57:43.592187+0000","last_peered":"2024-09-15T23:57:43.592187+0000","last_clean":"2024-09-15T23:57:43.592187+0000","last_became_active":"2024-09-15T23:57:43.585751+0000","last_became_peered":"2024-09-15T23:57:43.585751+0000","last_unstale":"2024-09-15T23:57:43.592187+0000","last_undegraded":"2024-09-15T23:57:43.592187+0000","last_fullsized":"2024-09-15T23:57:43.592187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:19.477277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.569581+0000","last_change":"2024-09-15T23:57:42.568966+0000","last_active":"2024-09-15T23:57:43.569581+0000","last_peered":"2024-09-15T23:57:43.569581+0000","last_clean":"2024-09-15T23:57:43.569581+0000","last_became_active":"2024-09-15T23:57:42.568634+0000","last_became_peered":"2024-09-15T23:57:42.568634+0000","last_unstale":"2024-09-15T23:57:43.569581+0000","last_undegraded":"2024-09-15T23:57:43.569581+0000","last_fullsized":"2024-09-15T23:57:43.569581+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.154653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.575661+0000","last_change":"2024-09-15T23:57:43.572509+0000","last_active":"2024-09-15T23:57:43.575661+0000","last_peered":"2024-09-15T23:57:43.575661+0000","last_clean":"2024-09-15T23:57:43.575661+0000","last_became_active":"2024-09-15T23:57:43.571715+0000","last_became_peered":"2024-09-15T23:57:43.571715+0000","last_unstale":"2024-09-15T23:57:43.575661+0000","last_undegraded":"2024-09-15T23:57:43.575661+0000","last_fullsized":"2024-09-15T23:57:43.575661+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:31.330027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.556349+0000","last_change":"2024-09-15T23:57:42.544883+0000","last_active":"2024-09-15T23:57:43.556349+0000","last_peered":"2024-09-15T23:57:43.556349+0000","last_clean":"2024-09-15T23:57:43.556349+0000","last_became_active":"2024-09-15T23:57:42.543747+0000","last_became_peered":"2024-09-15T23:57:42.543747+0000","last_unstale":"2024-09-15T23:57:43.556349+0000","last_undegraded":"2024-09-15T23:57:43.556349+0000","last_fullsized":"2024-09-15T23:57:43.556349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:14.082708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.618402+0000","last_change":"2024-09-15T23:57:43.616557+0000","last_active":"2024-09-15T23:57:43.618402+0000","last_peered":"2024-09-15T23:57:43.618402+0000","last_clean":"2024-09-15T23:57:43.618402+0000","last_became_active":"2024-09-15T23:57:43.616020+0000","last_became_peered":"2024-09-15T23:57:43.616020+0000","last_unstale":"2024-09-15T23:57:43.618402+0000","last_undegraded":"2024-09-15T23:57:43.618402+0000","last_fullsized":"2024-09-15T23:57:43.618402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:26.932403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.555641+0000","last_change":"2024-09-15T23:57:42.566619+0000","last_active":"2024-09-15T23:57:43.555641+0000","last_peered":"2024-09-15T23:57:43.555641+0000","last_clean":"2024-09-15T23:57:43.555641+0000","last_became_active":"2024-09-15T23:57:42.566255+0000","last_became_peered":"2024-09-15T23:57:42.566255+0000","last_unstale":"2024-09-15T23:57:43.555641+0000","last_undegraded":"2024-09-15T23:57:43.555641+0000","last_fullsized":"2024-09-15T23:57:43.555641+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:09.847085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.599933+0000","last_change":"2024-09-15T23:57:43.599440+0000","last_active":"2024-09-15T23:57:43.599933+0000","last_peered":"2024-09-15T23:57:43.599933+0000","last_clean":"2024-09-15T23:57:43.599933+0000","last_became_active":"2024-09-15T23:57:43.599123+0000","last_became_peered":"2024-09-15T23:57:43.599123+0000","last_unstale":"2024-09-15T23:57:43.599933+0000","last_undegraded":"2024-09-15T23:57:43.599933+0000","last_fullsized":"2024-09-15T23:57:43.599933+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:07.201274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.556452+0000","last_change":"2024-09-15T23:57:42.572696+0000","last_active":"2024-09-15T23:57:43.556452+0000","last_peered":"2024-09-15T23:57:43.556452+0000","last_clean":"2024-09-15T23:57:43.556452+0000","last_became_active":"2024-09-15T23:57:42.572368+0000","last_became_peered":"2024-09-15T23:57:42.572368+0000","last_unstale":"2024-09-15T23:57:43.556452+0000","last_undegraded":"2024-09-15T23:57:43.556452+0000","last_fullsized":"2024-09-15T23:57:43.556452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:20.246773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.607439+0000","last_change":"2024-09-15T23:57:43.606817+0000","last_active":"2024-09-15T23:57:43.607439+0000","last_peered":"2024-09-15T23:57:43.607439+0000","last_clean":"2024-09-15T23:57:43.607439+0000","last_became_active":"2024-09-15T23:57:43.606169+0000","last_became_peered":"2024-09-15T23:57:43.606169+0000","last_unstale":"2024-09-15T23:57:43.607439+0000","last_undegraded":"2024-09-15T23:57:43.607439+0000","last_fullsized":"2024-09-15T23:57:43.607439+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:30.742294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.559023+0000","last_change":"2024-09-15T23:57:42.560060+0000","last_active":"2024-09-15T23:57:43.559023+0000","last_peered":"2024-09-15T23:57:43.559023+0000","last_clean":"2024-09-15T23:57:43.559023+0000","last_became_active":"2024-09-15T23:57:42.559687+0000","last_became_peered":"2024-09-15T23:57:42.559687+0000","last_unstale":"2024-09-15T23:57:43.559023+0000","last_undegraded":"2024-09-15T23:57:43.559023+0000","last_fullsized":"2024-09-15T23:57:43.559023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:59.523941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.600303+0000","last_change":"2024-09-15T23:57:43.599960+0000","last_active":"2024-09-15T23:57:43.600303+0000","last_peered":"2024-09-15T23:57:43.600303+0000","last_clean":"2024-09-15T23:57:43.600303+0000","last_became_active":"2024-09-15T23:57:43.599526+0000","last_became_peered":"2024-09-15T23:57:43.599526+0000","last_unstale":"2024-09-15T23:57:43.600303+0000","last_undegraded":"2024-09-15T23:57:43.600303+0000","last_fullsized":"2024-09-15T23:57:43.600303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:40.245532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.557438+0000","last_change":"2024-09-15T23:57:42.549481+0000","last_active":"2024-09-15T23:57:43.557438+0000","last_peered":"2024-09-15T23:57:43.557438+0000","last_clean":"2024-09-15T23:57:43.557438+0000","last_became_active":"2024-09-15T23:57:42.548719+0000","last_became_peered":"2024-09-15T23:57:42.548719+0000","last_unstale":"2024-09-15T23:57:43.557438+0000","last_undegraded":"2024-09-15T23:57:43.557438+0000","last_fullsized":"2024-09-15T23:57:43.557438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:06.191352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":288,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.559326+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:57:43.559326+0000","last_peered":"2024-09-15T23:57:43.559326+0000","last_clean":"2024-09-15T23:57:43.559326+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:57:43.559326+0000","last_undegraded":"2024-09-15T23:57:43.559326+0000","last_fullsized":"2024-09-15T23:57:43.559326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1028096,"data_stored":465619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509492,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":474522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1040384,"data_stored":472786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1060864,"data_stored":474510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1048576,"data_stored":473390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1622016,"data_stored":1055987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1044480,"data_stored":472856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36960,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334880,"statfs":{"total":96636764160,"available":96598917120,"internally_reserved":0,"allocated":1646592,"data_stored":1069846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:57:47.593 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:57:47.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.745+0000 7f127b305640 1 Processor -- start 2024-09-15T23:57:47.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.745+0000 7f127b305640 1 -- start start 2024-09-15T23:57:47.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f127b305640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1274140bd0 0x7f1274141030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f127b305640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f12740b4410 0x7f12740b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f127b305640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f127413fb30 con 0x7f1274156720 2024-09-15T23:57:47.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f127b305640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1274141570 con 0x7f12740b4410 2024-09-15T23:57:47.749 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f127b305640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1274140740 con 0x7f1274140bd0 2024-09-15T23:57:47.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f12788a0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1274140bd0 0x7f1274141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f12798a2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f12740b4410 0x7f12740b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f12788a0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1274140bd0 0x7f1274141030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:55696/0 (socket says 172.21.15.112:55696) 2024-09-15T23:57:47.750 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f12788a0640 1 -- 172.21.15.112:0/2386806573 learned_addr learned my addr 172.21.15.112:0/2386806573 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:47.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f12798a2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f12740b4410 0x7f12740b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:50828/0 (socket says 172.21.15.112:50828) 2024-09-15T23:57:47.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f12788a0640 1 -- 172.21.15.112:0/2386806573 >> v2:172.21.15.169:3300/0 conn(0x7f12740b4410 msgr2=0x7f12740b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:47.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f12788a0640 1 --2- 172.21.15.112:0/2386806573 >> v2:172.21.15.169:3300/0 conn(0x7f12740b4410 0x7f12740b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f12788a0640 1 -- 172.21.15.112:0/2386806573 >> v1:172.21.15.169:6789/0 conn(0x7f1274156720 legacy=0x7f12740b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f12788a0640 1 -- 172.21.15.112:0/2386806573 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127413fe10 con 0x7f1274140bd0 2024-09-15T23:57:47.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.749+0000 7f12798a2640 1 --2- 172.21.15.112:0/2386806573 >> v2:172.21.15.169:3300/0 conn(0x7f12740b4410 0x7f12740b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:57:47.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f12788a0640 1 --2- 172.21.15.112:0/2386806573 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1274140bd0 0x7f1274141030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1264009870 tx=0x7f126401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcf1b5648db49152 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:47.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f126bfff640 1 -- 172.21.15.112:0/2386806573 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12640b2070 con 0x7f1274140bd0 2024-09-15T23:57:47.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f126bfff640 1 -- 172.21.15.112:0/2386806573 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12640a9070 con 0x7f1274140bd0 2024-09-15T23:57:47.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f126bfff640 1 -- 172.21.15.112:0/2386806573 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12640ad880 con 0x7f1274140bd0 2024-09-15T23:57:47.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 -- 172.21.15.112:0/2386806573 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1274140bd0 msgr2=0x7f1274141030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 --2- 172.21.15.112:0/2386806573 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1274140bd0 0x7f1274141030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1264009870 tx=0x7f126401c560 comp rx=0 tx=0).stop 2024-09-15T23:57:47.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 -- 172.21.15.112:0/2386806573 shutdown_connections 2024-09-15T23:57:47.753 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 --2- 172.21.15.112:0/2386806573 >> v2:172.21.15.169:3300/0 conn(0x7f12740b4410 0x7f12740b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 --2- 172.21.15.112:0/2386806573 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1274140bd0 0x7f1274141030 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 -- 172.21.15.112:0/2386806573 >> 172.21.15.112:0/2386806573 conn(0x7f127406c0c0 msgr2=0x7f127406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:47.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 -- 172.21.15.112:0/2386806573 shutdown_connections 2024-09-15T23:57:47.754 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 -- 172.21.15.112:0/2386806573 wait complete. 2024-09-15T23:57:47.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 Processor -- start 2024-09-15T23:57:47.755 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 -- start start 2024-09-15T23:57:47.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12740b4410 0x7f127413c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1274140bd0 0x7f1274150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1274156720 0x7f12740d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f127413f6e0 con 0x7f1274140bd0 2024-09-15T23:57:47.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f12740b5d20 con 0x7f12740b4410 2024-09-15T23:57:47.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f127b305640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f127413f860 con 0x7f1274156720 2024-09-15T23:57:47.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f12788a0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1274140bd0 0x7f1274150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f12788a0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1274140bd0 0x7f1274150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50054/0 (socket says 172.21.15.112:50054) 2024-09-15T23:57:47.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f12788a0640 1 -- 172.21.15.112:0/3298782484 learned_addr learned my addr 172.21.15.112:0/3298782484 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:47.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f12790a1640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12740b4410 0x7f127413c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f12788a0640 1 -- 172.21.15.112:0/3298782484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1274156720 msgr2=0x7f12740d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f12798a2640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1274156720 0x7f12740d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.757 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f12788a0640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1274156720 0x7f12740d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f12788a0640 1 -- 172.21.15.112:0/3298782484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12740b4410 msgr2=0x7f127413c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f12788a0640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12740b4410 0x7f127413c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f12788a0640 1 -- 172.21.15.112:0/3298782484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12741552a0 con 0x7f1274140bd0 2024-09-15T23:57:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f12790a1640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12740b4410 0x7f127413c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f12798a2640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1274156720 0x7f12740d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.753+0000 7f12788a0640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1274140bd0 0x7f1274150860 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f12640b0040 tx=0x7f1264019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.757+0000 7f1269ffb640 1 -- 172.21.15.112:0/3298782484 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12640ba020 con 0x7f1274140bd0 2024-09-15T23:57:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.757+0000 7f1269ffb640 1 -- 172.21.15.112:0/3298782484 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12640add00 con 0x7f1274140bd0 2024-09-15T23:57:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.757+0000 7f127b305640 1 -- 172.21.15.112:0/3298782484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1274151b60 con 0x7f1274140bd0 2024-09-15T23:57:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.757+0000 7f1269ffb640 1 -- 172.21.15.112:0/3298782484 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12640b2040 con 0x7f1274140bd0 2024-09-15T23:57:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.757+0000 7f127b305640 1 -- 172.21.15.112:0/3298782484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12741570f0 con 0x7f1274140bd0 2024-09-15T23:57:47.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.757+0000 7f127b305640 1 -- 172.21.15.112:0/3298782484 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12740b48c0 con 0x7f1274140bd0 2024-09-15T23:57:47.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.757+0000 7f1269ffb640 1 -- 172.21.15.112:0/3298782484 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f12640bd020 con 0x7f1274140bd0 2024-09-15T23:57:47.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.757+0000 7f1269ffb640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f12580678f0 0x7f1258069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.757+0000 7f1269ffb640 1 -- 172.21.15.112:0/3298782484 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f126411fcc0 con 0x7f1274140bd0 2024-09-15T23:57:47.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.757+0000 7f12790a1640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f12580678f0 0x7f1258069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.757+0000 7f12790a1640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f12580678f0 0x7f1258069db0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f12700016f0 tx=0x7f1270009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:47.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.761+0000 7f1269ffb640 1 -- 172.21.15.112:0/3298782484 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f12640c4030 con 0x7f1274140bd0 2024-09-15T23:57:47.915 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.913+0000 7f127b305640 1 -- 172.21.15.112:0/3298782484 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1274069170 con 0x7f12580678f0 2024-09-15T23:57:47.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.929+0000 7f1269ffb640 1 -- 172.21.15.112:0/3298782484 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252012 (secure 0 0 0) 0x7f1274069170 con 0x7f12580678f0 2024-09-15T23:57:47.934 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:47.936 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:57:47.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.933+0000 7f127b305640 1 -- 172.21.15.112:0/3298782484 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f12580678f0 msgr2=0x7f1258069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.933+0000 7f127b305640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f12580678f0 0x7f1258069db0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f12700016f0 tx=0x7f1270009040 comp rx=0 tx=0).stop 2024-09-15T23:57:47.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.933+0000 7f127b305640 1 -- 172.21.15.112:0/3298782484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1274140bd0 msgr2=0x7f1274150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.933+0000 7f127b305640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1274140bd0 0x7f1274150860 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f12640b0040 tx=0x7f1264019300 comp rx=0 tx=0).stop 2024-09-15T23:57:47.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.933+0000 7f127b305640 1 -- 172.21.15.112:0/3298782484 shutdown_connections 2024-09-15T23:57:47.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.933+0000 7f127b305640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f12580678f0 0x7f1258069db0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.937+0000 7f127b305640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1274156720 0x7f12740d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.937+0000 7f127b305640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1274140bd0 0x7f1274150860 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.937+0000 7f127b305640 1 --2- 172.21.15.112:0/3298782484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12740b4410 0x7f127413c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.937+0000 7f127b305640 1 -- 172.21.15.112:0/3298782484 >> 172.21.15.112:0/3298782484 conn(0x7f127406c0c0 msgr2=0x7f1274152860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:47.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.937+0000 7f127b305640 1 -- 172.21.15.112:0/3298782484 shutdown_connections 2024-09-15T23:57:47.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:47.937+0000 7f127b305640 1 -- 172.21.15.112:0/3298782484 wait complete. 2024-09-15T23:57:47.951 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-15T23:57:47.306972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263016,"kb_used_data":9328,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754711704,"statfs":{"total":773094113280,"available":772824784896,"internally_reserved":0,"allocated":9551872,"data_stored":4959516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.787337"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.618651+0000","last_change":"2024-09-15T23:57:43.611446+0000","last_active":"2024-09-15T23:57:43.618651+0000","last_peered":"2024-09-15T23:57:43.618651+0000","last_clean":"2024-09-15T23:57:43.618651+0000","last_became_active":"2024-09-15T23:57:43.610516+0000","last_became_peered":"2024-09-15T23:57:43.610516+0000","last_unstale":"2024-09-15T23:57:43.618651+0000","last_undegraded":"2024-09-15T23:57:43.618651+0000","last_fullsized":"2024-09-15T23:57:43.618651+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:16.888607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.589775+0000","last_change":"2024-09-15T23:57:43.585275+0000","last_active":"2024-09-15T23:57:43.589775+0000","last_peered":"2024-09-15T23:57:43.589775+0000","last_clean":"2024-09-15T23:57:43.589775+0000","last_became_active":"2024-09-15T23:57:43.585008+0000","last_became_peered":"2024-09-15T23:57:43.585008+0000","last_unstale":"2024-09-15T23:57:43.589775+0000","last_undegraded":"2024-09-15T23:57:43.589775+0000","last_fullsized":"2024-09-15T23:57:43.589775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:07.201274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.609935+0000","last_change":"2024-09-15T23:57:43.601133+0000","last_active":"2024-09-15T23:57:43.609935+0000","last_peered":"2024-09-15T23:57:43.609935+0000","last_clean":"2024-09-15T23:57:43.609935+0000","last_became_active":"2024-09-15T23:57:43.593994+0000","last_became_peered":"2024-09-15T23:57:43.593994+0000","last_unstale":"2024-09-15T23:57:43.609935+0000","last_undegraded":"2024-09-15T23:57:43.609935+0000","last_fullsized":"2024-09-15T23:57:43.609935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:11.954686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.607865+0000","last_change":"2024-09-15T23:57:43.594569+0000","last_active":"2024-09-15T23:57:43.607865+0000","last_peered":"2024-09-15T23:57:43.607865+0000","last_clean":"2024-09-15T23:57:43.607865+0000","last_became_active":"2024-09-15T23:57:43.593903+0000","last_became_peered":"2024-09-15T23:57:43.593903+0000","last_unstale":"2024-09-15T23:57:43.607865+0000","last_undegraded":"2024-09-15T23:57:43.607865+0000","last_fullsized":"2024-09-15T23:57:43.607865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:27.180502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.590429+0000","last_change":"2024-09-15T23:57:43.584337+0000","last_active":"2024-09-15T23:57:43.590429+0000","last_peered":"2024-09-15T23:57:43.590429+0000","last_clean":"2024-09-15T23:57:43.590429+0000","last_became_active":"2024-09-15T23:57:43.579863+0000","last_became_peered":"2024-09-15T23:57:43.579863+0000","last_unstale":"2024-09-15T23:57:43.590429+0000","last_undegraded":"2024-09-15T23:57:43.590429+0000","last_fullsized":"2024-09-15T23:57:43.590429+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:15.092630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.607254+0000","last_change":"2024-09-15T23:57:43.605568+0000","last_active":"2024-09-15T23:57:43.607254+0000","last_peered":"2024-09-15T23:57:43.607254+0000","last_clean":"2024-09-15T23:57:43.607254+0000","last_became_active":"2024-09-15T23:57:43.604990+0000","last_became_peered":"2024-09-15T23:57:43.604990+0000","last_unstale":"2024-09-15T23:57:43.607254+0000","last_undegraded":"2024-09-15T23:57:43.607254+0000","last_fullsized":"2024-09-15T23:57:43.607254+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:57.181434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.596315+0000","last_change":"2024-09-15T23:57:43.591249+0000","last_active":"2024-09-15T23:57:43.596315+0000","last_peered":"2024-09-15T23:57:43.596315+0000","last_clean":"2024-09-15T23:57:43.596315+0000","last_became_active":"2024-09-15T23:57:43.590952+0000","last_became_peered":"2024-09-15T23:57:43.590952+0000","last_unstale":"2024-09-15T23:57:43.596315+0000","last_undegraded":"2024-09-15T23:57:43.596315+0000","last_fullsized":"2024-09-15T23:57:43.596315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:33:22.534971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.585128+0000","last_change":"2024-09-15T23:57:43.575429+0000","last_active":"2024-09-15T23:57:43.585128+0000","last_peered":"2024-09-15T23:57:43.585128+0000","last_clean":"2024-09-15T23:57:43.585128+0000","last_became_active":"2024-09-15T23:57:43.574435+0000","last_became_peered":"2024-09-15T23:57:43.574435+0000","last_unstale":"2024-09-15T23:57:43.585128+0000","last_undegraded":"2024-09-15T23:57:43.585128+0000","last_fullsized":"2024-09-15T23:57:43.585128+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:40.245532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.590025+0000","last_change":"2024-09-15T23:57:43.589478+0000","last_active":"2024-09-15T23:57:43.590025+0000","last_peered":"2024-09-15T23:57:43.590025+0000","last_clean":"2024-09-15T23:57:43.590025+0000","last_became_active":"2024-09-15T23:57:43.589224+0000","last_became_peered":"2024-09-15T23:57:43.589224+0000","last_unstale":"2024-09-15T23:57:43.590025+0000","last_undegraded":"2024-09-15T23:57:43.590025+0000","last_fullsized":"2024-09-15T23:57:43.590025+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:54.791762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.609688+0000","last_change":"2024-09-15T23:57:43.600094+0000","last_active":"2024-09-15T23:57:43.609688+0000","last_peered":"2024-09-15T23:57:43.609688+0000","last_clean":"2024-09-15T23:57:43.609688+0000","last_became_active":"2024-09-15T23:57:43.596390+0000","last_became_peered":"2024-09-15T23:57:43.596390+0000","last_unstale":"2024-09-15T23:57:43.609688+0000","last_undegraded":"2024-09-15T23:57:43.609688+0000","last_fullsized":"2024-09-15T23:57:43.609688+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:30.055154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.596308+0000","last_change":"2024-09-15T23:57:43.591287+0000","last_active":"2024-09-15T23:57:43.596308+0000","last_peered":"2024-09-15T23:57:43.596308+0000","last_clean":"2024-09-15T23:57:43.596308+0000","last_became_active":"2024-09-15T23:57:43.590832+0000","last_became_peered":"2024-09-15T23:57:43.590832+0000","last_unstale":"2024-09-15T23:57:43.596308+0000","last_undegraded":"2024-09-15T23:57:43.596308+0000","last_fullsized":"2024-09-15T23:57:43.596308+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:57.025500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.610735+0000","last_change":"2024-09-15T23:57:43.608500+0000","last_active":"2024-09-15T23:57:43.610735+0000","last_peered":"2024-09-15T23:57:43.610735+0000","last_clean":"2024-09-15T23:57:43.610735+0000","last_became_active":"2024-09-15T23:57:43.608156+0000","last_became_peered":"2024-09-15T23:57:43.608156+0000","last_unstale":"2024-09-15T23:57:43.610735+0000","last_undegraded":"2024-09-15T23:57:43.610735+0000","last_fullsized":"2024-09-15T23:57:43.610735+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:16.404709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.604379+0000","last_change":"2024-09-15T23:57:43.597735+0000","last_active":"2024-09-15T23:57:44.604379+0000","last_peered":"2024-09-15T23:57:44.604379+0000","last_clean":"2024-09-15T23:57:44.604379+0000","last_became_active":"2024-09-15T23:57:43.597390+0000","last_became_peered":"2024-09-15T23:57:43.597390+0000","last_unstale":"2024-09-15T23:57:44.604379+0000","last_undegraded":"2024-09-15T23:57:44.604379+0000","last_fullsized":"2024-09-15T23:57:44.604379+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:17.459444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.586582+0000","last_change":"2024-09-15T23:57:43.583540+0000","last_active":"2024-09-15T23:57:43.586582+0000","last_peered":"2024-09-15T23:57:43.586582+0000","last_clean":"2024-09-15T23:57:43.586582+0000","last_became_active":"2024-09-15T23:57:43.583260+0000","last_became_peered":"2024-09-15T23:57:43.583260+0000","last_unstale":"2024-09-15T23:57:43.586582+0000","last_undegraded":"2024-09-15T23:57:43.586582+0000","last_fullsized":"2024-09-15T23:57:43.586582+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:11.590840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.610116+0000","last_change":"2024-09-15T23:57:43.607881+0000","last_active":"2024-09-15T23:57:43.610116+0000","last_peered":"2024-09-15T23:57:43.610116+0000","last_clean":"2024-09-15T23:57:43.610116+0000","last_became_active":"2024-09-15T23:57:43.600729+0000","last_became_peered":"2024-09-15T23:57:43.600729+0000","last_unstale":"2024-09-15T23:57:43.610116+0000","last_undegraded":"2024-09-15T23:57:43.610116+0000","last_fullsized":"2024-09-15T23:57:43.610116+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:38.479449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.592918+0000","last_change":"2024-09-15T23:57:43.585238+0000","last_active":"2024-09-15T23:57:43.592918+0000","last_peered":"2024-09-15T23:57:43.592918+0000","last_clean":"2024-09-15T23:57:43.592918+0000","last_became_active":"2024-09-15T23:57:43.584628+0000","last_became_peered":"2024-09-15T23:57:43.584628+0000","last_unstale":"2024-09-15T23:57:43.592918+0000","last_undegraded":"2024-09-15T23:57:43.592918+0000","last_fullsized":"2024-09-15T23:57:43.592918+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:16.888607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.603387+0000","last_change":"2024-09-15T23:57:43.596244+0000","last_active":"2024-09-15T23:57:43.603387+0000","last_peered":"2024-09-15T23:57:43.603387+0000","last_clean":"2024-09-15T23:57:43.603387+0000","last_became_active":"2024-09-15T23:57:43.595711+0000","last_became_peered":"2024-09-15T23:57:43.595711+0000","last_unstale":"2024-09-15T23:57:43.603387+0000","last_undegraded":"2024-09-15T23:57:43.603387+0000","last_fullsized":"2024-09-15T23:57:43.603387+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:46.326602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.602281+0000","last_change":"2024-09-15T23:57:43.589218+0000","last_active":"2024-09-15T23:57:43.602281+0000","last_peered":"2024-09-15T23:57:43.602281+0000","last_clean":"2024-09-15T23:57:43.602281+0000","last_became_active":"2024-09-15T23:57:43.588417+0000","last_became_peered":"2024-09-15T23:57:43.588417+0000","last_unstale":"2024-09-15T23:57:43.602281+0000","last_undegraded":"2024-09-15T23:57:43.602281+0000","last_fullsized":"2024-09-15T23:57:43.602281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:02.507092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.602481+0000","last_change":"2024-09-15T23:57:43.602085+0000","last_active":"2024-09-15T23:57:43.602481+0000","last_peered":"2024-09-15T23:57:43.602481+0000","last_clean":"2024-09-15T23:57:43.602481+0000","last_became_active":"2024-09-15T23:57:43.601723+0000","last_became_peered":"2024-09-15T23:57:43.601723+0000","last_unstale":"2024-09-15T23:57:43.602481+0000","last_undegraded":"2024-09-15T23:57:43.602481+0000","last_fullsized":"2024-09-15T23:57:43.602481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:40.448042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.596571+0000","last_change":"2024-09-15T23:57:43.592903+0000","last_active":"2024-09-15T23:57:43.596571+0000","last_peered":"2024-09-15T23:57:43.596571+0000","last_clean":"2024-09-15T23:57:43.596571+0000","last_became_active":"2024-09-15T23:57:43.592110+0000","last_became_peered":"2024-09-15T23:57:43.592110+0000","last_unstale":"2024-09-15T23:57:43.596571+0000","last_undegraded":"2024-09-15T23:57:43.596571+0000","last_fullsized":"2024-09-15T23:57:43.596571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:52.267502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.589498+0000","last_change":"2024-09-15T23:57:43.580127+0000","last_active":"2024-09-15T23:57:43.589498+0000","last_peered":"2024-09-15T23:57:43.589498+0000","last_clean":"2024-09-15T23:57:43.589498+0000","last_became_active":"2024-09-15T23:57:43.579284+0000","last_became_peered":"2024-09-15T23:57:43.579284+0000","last_unstale":"2024-09-15T23:57:43.589498+0000","last_undegraded":"2024-09-15T23:57:43.589498+0000","last_fullsized":"2024-09-15T23:57:43.589498+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:47.215637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.588176+0000","last_change":"2024-09-15T23:57:43.586444+0000","last_active":"2024-09-15T23:57:43.588176+0000","last_peered":"2024-09-15T23:57:43.588176+0000","last_clean":"2024-09-15T23:57:43.588176+0000","last_became_active":"2024-09-15T23:57:43.586161+0000","last_became_peered":"2024-09-15T23:57:43.586161+0000","last_unstale":"2024-09-15T23:57:43.588176+0000","last_undegraded":"2024-09-15T23:57:43.588176+0000","last_fullsized":"2024-09-15T23:57:43.588176+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:47.033687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.613365+0000","last_change":"2024-09-15T23:57:43.612215+0000","last_active":"2024-09-15T23:57:43.613365+0000","last_peered":"2024-09-15T23:57:43.613365+0000","last_clean":"2024-09-15T23:57:43.613365+0000","last_became_active":"2024-09-15T23:57:43.611989+0000","last_became_peered":"2024-09-15T23:57:43.611989+0000","last_unstale":"2024-09-15T23:57:43.613365+0000","last_undegraded":"2024-09-15T23:57:43.613365+0000","last_fullsized":"2024-09-15T23:57:43.613365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:56.898246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.618912+0000","last_change":"2024-09-15T23:57:43.612743+0000","last_active":"2024-09-15T23:57:43.618912+0000","last_peered":"2024-09-15T23:57:43.618912+0000","last_clean":"2024-09-15T23:57:43.618912+0000","last_became_active":"2024-09-15T23:57:43.611968+0000","last_became_peered":"2024-09-15T23:57:43.611968+0000","last_unstale":"2024-09-15T23:57:43.618912+0000","last_undegraded":"2024-09-15T23:57:43.618912+0000","last_fullsized":"2024-09-15T23:57:43.618912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:52.267502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.592050+0000","last_change":"2024-09-15T23:57:43.579319+0000","last_active":"2024-09-15T23:57:43.592050+0000","last_peered":"2024-09-15T23:57:43.592050+0000","last_clean":"2024-09-15T23:57:43.592050+0000","last_became_active":"2024-09-15T23:57:43.579049+0000","last_became_peered":"2024-09-15T23:57:43.579049+0000","last_unstale":"2024-09-15T23:57:43.592050+0000","last_undegraded":"2024-09-15T23:57:43.592050+0000","last_fullsized":"2024-09-15T23:57:43.592050+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:11.590840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.589752+0000","last_change":"2024-09-15T23:57:43.585149+0000","last_active":"2024-09-15T23:57:43.589752+0000","last_peered":"2024-09-15T23:57:43.589752+0000","last_clean":"2024-09-15T23:57:43.589752+0000","last_became_active":"2024-09-15T23:57:43.584795+0000","last_became_peered":"2024-09-15T23:57:43.584795+0000","last_unstale":"2024-09-15T23:57:43.589752+0000","last_undegraded":"2024-09-15T23:57:43.589752+0000","last_fullsized":"2024-09-15T23:57:43.589752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:47.033687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.601993+0000","last_change":"2024-09-15T23:57:43.587765+0000","last_active":"2024-09-15T23:57:43.601993+0000","last_peered":"2024-09-15T23:57:43.601993+0000","last_clean":"2024-09-15T23:57:43.601993+0000","last_became_active":"2024-09-15T23:57:43.587036+0000","last_became_peered":"2024-09-15T23:57:43.587036+0000","last_unstale":"2024-09-15T23:57:43.601993+0000","last_undegraded":"2024-09-15T23:57:43.601993+0000","last_fullsized":"2024-09-15T23:57:43.601993+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:18.790416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.606189+0000","last_change":"2024-09-15T23:57:43.575096+0000","last_active":"2024-09-15T23:57:44.606189+0000","last_peered":"2024-09-15T23:57:44.606189+0000","last_clean":"2024-09-15T23:57:44.606189+0000","last_became_active":"2024-09-15T23:57:43.574387+0000","last_became_peered":"2024-09-15T23:57:43.574387+0000","last_unstale":"2024-09-15T23:57:44.606189+0000","last_undegraded":"2024-09-15T23:57:44.606189+0000","last_fullsized":"2024-09-15T23:57:44.606189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:08.645930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.613783+0000","last_change":"2024-09-15T23:57:43.613198+0000","last_active":"2024-09-15T23:57:43.613783+0000","last_peered":"2024-09-15T23:57:43.613783+0000","last_clean":"2024-09-15T23:57:43.613783+0000","last_became_active":"2024-09-15T23:57:43.612832+0000","last_became_peered":"2024-09-15T23:57:43.612832+0000","last_unstale":"2024-09-15T23:57:43.613783+0000","last_undegraded":"2024-09-15T23:57:43.613783+0000","last_fullsized":"2024-09-15T23:57:43.613783+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:07.603711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.589696+0000","last_change":"2024-09-15T23:57:43.585848+0000","last_active":"2024-09-15T23:57:43.589696+0000","last_peered":"2024-09-15T23:57:43.589696+0000","last_clean":"2024-09-15T23:57:43.589696+0000","last_became_active":"2024-09-15T23:57:43.584637+0000","last_became_peered":"2024-09-15T23:57:43.584637+0000","last_unstale":"2024-09-15T23:57:43.589696+0000","last_undegraded":"2024-09-15T23:57:43.589696+0000","last_fullsized":"2024-09-15T23:57:43.589696+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:40.448042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.618184+0000","last_change":"2024-09-15T23:57:43.617796+0000","last_active":"2024-09-15T23:57:43.618184+0000","last_peered":"2024-09-15T23:57:43.618184+0000","last_clean":"2024-09-15T23:57:43.618184+0000","last_became_active":"2024-09-15T23:57:43.617473+0000","last_became_peered":"2024-09-15T23:57:43.617473+0000","last_unstale":"2024-09-15T23:57:43.618184+0000","last_undegraded":"2024-09-15T23:57:43.618184+0000","last_fullsized":"2024-09-15T23:57:43.618184+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:19.477277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.588404+0000","last_change":"2024-09-15T23:57:43.584544+0000","last_active":"2024-09-15T23:57:43.588404+0000","last_peered":"2024-09-15T23:57:43.588404+0000","last_clean":"2024-09-15T23:57:43.588404+0000","last_became_active":"2024-09-15T23:57:43.583645+0000","last_became_peered":"2024-09-15T23:57:43.583645+0000","last_unstale":"2024-09-15T23:57:43.588404+0000","last_undegraded":"2024-09-15T23:57:43.588404+0000","last_fullsized":"2024-09-15T23:57:43.588404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:07.603711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.615235+0000","last_change":"2024-09-15T23:57:43.582850+0000","last_active":"2024-09-15T23:57:43.615235+0000","last_peered":"2024-09-15T23:57:43.615235+0000","last_clean":"2024-09-15T23:57:43.615235+0000","last_became_active":"2024-09-15T23:57:43.582098+0000","last_became_peered":"2024-09-15T23:57:43.582098+0000","last_unstale":"2024-09-15T23:57:43.615235+0000","last_undegraded":"2024-09-15T23:57:43.615235+0000","last_fullsized":"2024-09-15T23:57:43.615235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:19.477277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"85'4","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.596489+0000","last_change":"2024-09-15T23:57:42.560704+0000","last_active":"2024-09-15T23:57:43.596489+0000","last_peered":"2024-09-15T23:57:43.596489+0000","last_clean":"2024-09-15T23:57:43.596489+0000","last_became_active":"2024-09-15T23:57:42.559866+0000","last_became_peered":"2024-09-15T23:57:42.559866+0000","last_unstale":"2024-09-15T23:57:43.596489+0000","last_undegraded":"2024-09-15T23:57:43.596489+0000","last_fullsized":"2024-09-15T23:57:43.596489+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:09.841137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.596893+0000","last_change":"2024-09-15T23:57:43.593096+0000","last_active":"2024-09-15T23:57:43.596893+0000","last_peered":"2024-09-15T23:57:43.596893+0000","last_clean":"2024-09-15T23:57:43.596893+0000","last_became_active":"2024-09-15T23:57:43.592338+0000","last_became_peered":"2024-09-15T23:57:43.592338+0000","last_unstale":"2024-09-15T23:57:43.596893+0000","last_undegraded":"2024-09-15T23:57:43.596893+0000","last_fullsized":"2024-09-15T23:57:43.596893+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:23.293437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.587221+0000","last_change":"2024-09-15T23:57:42.564037+0000","last_active":"2024-09-15T23:57:43.587221+0000","last_peered":"2024-09-15T23:57:43.587221+0000","last_clean":"2024-09-15T23:57:43.587221+0000","last_became_active":"2024-09-15T23:57:42.563642+0000","last_became_peered":"2024-09-15T23:57:42.563642+0000","last_unstale":"2024-09-15T23:57:43.587221+0000","last_undegraded":"2024-09-15T23:57:43.587221+0000","last_fullsized":"2024-09-15T23:57:43.587221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:59.523941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.599539+0000","last_change":"2024-09-15T23:57:43.598377+0000","last_active":"2024-09-15T23:57:43.599539+0000","last_peered":"2024-09-15T23:57:43.599539+0000","last_clean":"2024-09-15T23:57:43.599539+0000","last_became_active":"2024-09-15T23:57:43.598074+0000","last_became_peered":"2024-09-15T23:57:43.598074+0000","last_unstale":"2024-09-15T23:57:43.599539+0000","last_undegraded":"2024-09-15T23:57:43.599539+0000","last_fullsized":"2024-09-15T23:57:43.599539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:06.803667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.612886+0000","last_change":"2024-09-15T23:57:42.547172+0000","last_active":"2024-09-15T23:57:43.612886+0000","last_peered":"2024-09-15T23:57:43.612886+0000","last_clean":"2024-09-15T23:57:43.612886+0000","last_became_active":"2024-09-15T23:57:42.546796+0000","last_became_peered":"2024-09-15T23:57:42.546796+0000","last_unstale":"2024-09-15T23:57:43.612886+0000","last_undegraded":"2024-09-15T23:57:43.612886+0000","last_fullsized":"2024-09-15T23:57:43.612886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:10.976235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.601591+0000","last_change":"2024-09-15T23:57:43.587916+0000","last_active":"2024-09-15T23:57:43.601591+0000","last_peered":"2024-09-15T23:57:43.601591+0000","last_clean":"2024-09-15T23:57:43.601591+0000","last_became_active":"2024-09-15T23:57:43.587109+0000","last_became_peered":"2024-09-15T23:57:43.587109+0000","last_unstale":"2024-09-15T23:57:43.601591+0000","last_undegraded":"2024-09-15T23:57:43.601591+0000","last_fullsized":"2024-09-15T23:57:43.601591+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:38.026195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.604753+0000","last_change":"2024-09-15T23:57:42.550275+0000","last_active":"2024-09-15T23:57:43.604753+0000","last_peered":"2024-09-15T23:57:43.604753+0000","last_clean":"2024-09-15T23:57:43.604753+0000","last_became_active":"2024-09-15T23:57:42.549902+0000","last_became_peered":"2024-09-15T23:57:42.549902+0000","last_unstale":"2024-09-15T23:57:43.604753+0000","last_undegraded":"2024-09-15T23:57:43.604753+0000","last_fullsized":"2024-09-15T23:57:43.604753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:03.607829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.604131+0000","last_change":"2024-09-15T23:57:43.617635+0000","last_active":"2024-09-15T23:57:44.604131+0000","last_peered":"2024-09-15T23:57:44.604131+0000","last_clean":"2024-09-15T23:57:44.604131+0000","last_became_active":"2024-09-15T23:57:43.617286+0000","last_became_peered":"2024-09-15T23:57:43.617286+0000","last_unstale":"2024-09-15T23:57:44.604131+0000","last_undegraded":"2024-09-15T23:57:44.604131+0000","last_fullsized":"2024-09-15T23:57:44.604131+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:53.493181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.601608+0000","last_change":"2024-09-15T23:57:42.539531+0000","last_active":"2024-09-15T23:57:43.601608+0000","last_peered":"2024-09-15T23:57:43.601608+0000","last_clean":"2024-09-15T23:57:43.601608+0000","last_became_active":"2024-09-15T23:57:42.538902+0000","last_became_peered":"2024-09-15T23:57:42.538902+0000","last_unstale":"2024-09-15T23:57:43.601608+0000","last_undegraded":"2024-09-15T23:57:43.601608+0000","last_fullsized":"2024-09-15T23:57:43.601608+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:52.928333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.596286+0000","last_change":"2024-09-15T23:57:43.591215+0000","last_active":"2024-09-15T23:57:43.596286+0000","last_peered":"2024-09-15T23:57:43.596286+0000","last_clean":"2024-09-15T23:57:43.596286+0000","last_became_active":"2024-09-15T23:57:43.590920+0000","last_became_peered":"2024-09-15T23:57:43.590920+0000","last_unstale":"2024-09-15T23:57:43.596286+0000","last_undegraded":"2024-09-15T23:57:43.596286+0000","last_fullsized":"2024-09-15T23:57:43.596286+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:43.297178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.604065+0000","last_change":"2024-09-15T23:57:42.549294+0000","last_active":"2024-09-15T23:57:44.604065+0000","last_peered":"2024-09-15T23:57:44.604065+0000","last_clean":"2024-09-15T23:57:44.604065+0000","last_became_active":"2024-09-15T23:57:42.548604+0000","last_became_peered":"2024-09-15T23:57:42.548604+0000","last_unstale":"2024-09-15T23:57:44.604065+0000","last_undegraded":"2024-09-15T23:57:44.604065+0000","last_fullsized":"2024-09-15T23:57:44.604065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:43.532090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.589804+0000","last_change":"2024-09-15T23:57:43.584736+0000","last_active":"2024-09-15T23:57:43.589804+0000","last_peered":"2024-09-15T23:57:43.589804+0000","last_clean":"2024-09-15T23:57:43.589804+0000","last_became_active":"2024-09-15T23:57:43.584287+0000","last_became_peered":"2024-09-15T23:57:43.584287+0000","last_unstale":"2024-09-15T23:57:43.589804+0000","last_undegraded":"2024-09-15T23:57:43.589804+0000","last_fullsized":"2024-09-15T23:57:43.589804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:35.754995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.579739+0000","last_change":"2024-09-15T23:57:42.563677+0000","last_active":"2024-09-15T23:57:43.579739+0000","last_peered":"2024-09-15T23:57:43.579739+0000","last_clean":"2024-09-15T23:57:43.579739+0000","last_became_active":"2024-09-15T23:57:42.562915+0000","last_became_peered":"2024-09-15T23:57:42.562915+0000","last_unstale":"2024-09-15T23:57:43.579739+0000","last_undegraded":"2024-09-15T23:57:43.579739+0000","last_fullsized":"2024-09-15T23:57:43.579739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:18.927779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.615722+0000","last_change":"2024-09-15T23:57:43.604297+0000","last_active":"2024-09-15T23:57:43.615722+0000","last_peered":"2024-09-15T23:57:43.615722+0000","last_clean":"2024-09-15T23:57:43.615722+0000","last_became_active":"2024-09-15T23:57:43.590245+0000","last_became_peered":"2024-09-15T23:57:43.590245+0000","last_unstale":"2024-09-15T23:57:43.615722+0000","last_undegraded":"2024-09-15T23:57:43.615722+0000","last_fullsized":"2024-09-15T23:57:43.615722+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:35.754995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.559027+0000","last_change":"2024-09-15T23:57:42.548411+0000","last_active":"2024-09-15T23:57:43.559027+0000","last_peered":"2024-09-15T23:57:43.559027+0000","last_clean":"2024-09-15T23:57:43.559027+0000","last_became_active":"2024-09-15T23:57:42.545752+0000","last_became_peered":"2024-09-15T23:57:42.545752+0000","last_unstale":"2024-09-15T23:57:43.559027+0000","last_undegraded":"2024-09-15T23:57:43.559027+0000","last_fullsized":"2024-09-15T23:57:43.559027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:06.813246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.600082+0000","last_change":"2024-09-15T23:57:43.599438+0000","last_active":"2024-09-15T23:57:43.600082+0000","last_peered":"2024-09-15T23:57:43.600082+0000","last_clean":"2024-09-15T23:57:43.600082+0000","last_became_active":"2024-09-15T23:57:43.599138+0000","last_became_peered":"2024-09-15T23:57:43.599138+0000","last_unstale":"2024-09-15T23:57:43.600082+0000","last_undegraded":"2024-09-15T23:57:43.600082+0000","last_fullsized":"2024-09-15T23:57:43.600082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:31.330027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.557686+0000","last_change":"2024-09-15T23:57:42.551149+0000","last_active":"2024-09-15T23:57:43.557686+0000","last_peered":"2024-09-15T23:57:43.557686+0000","last_clean":"2024-09-15T23:57:43.557686+0000","last_became_active":"2024-09-15T23:57:42.550705+0000","last_became_peered":"2024-09-15T23:57:42.550705+0000","last_unstale":"2024-09-15T23:57:43.557686+0000","last_undegraded":"2024-09-15T23:57:43.557686+0000","last_fullsized":"2024-09-15T23:57:43.557686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:29.731580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.577243+0000","last_change":"2024-09-15T23:57:43.575964+0000","last_active":"2024-09-15T23:57:43.577243+0000","last_peered":"2024-09-15T23:57:43.577243+0000","last_clean":"2024-09-15T23:57:43.577243+0000","last_became_active":"2024-09-15T23:57:43.575688+0000","last_became_peered":"2024-09-15T23:57:43.575688+0000","last_unstale":"2024-09-15T23:57:43.577243+0000","last_undegraded":"2024-09-15T23:57:43.577243+0000","last_fullsized":"2024-09-15T23:57:43.577243+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:44.761877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.578013+0000","last_change":"2024-09-15T23:57:42.555572+0000","last_active":"2024-09-15T23:57:43.578013+0000","last_peered":"2024-09-15T23:57:43.578013+0000","last_clean":"2024-09-15T23:57:43.578013+0000","last_became_active":"2024-09-15T23:57:42.554750+0000","last_became_peered":"2024-09-15T23:57:42.554750+0000","last_unstale":"2024-09-15T23:57:43.578013+0000","last_undegraded":"2024-09-15T23:57:43.578013+0000","last_fullsized":"2024-09-15T23:57:43.578013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:41.304300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.615688+0000","last_change":"2024-09-15T23:57:43.590113+0000","last_active":"2024-09-15T23:57:43.615688+0000","last_peered":"2024-09-15T23:57:43.615688+0000","last_clean":"2024-09-15T23:57:43.615688+0000","last_became_active":"2024-09-15T23:57:43.589219+0000","last_became_peered":"2024-09-15T23:57:43.589219+0000","last_unstale":"2024-09-15T23:57:43.615688+0000","last_undegraded":"2024-09-15T23:57:43.615688+0000","last_fullsized":"2024-09-15T23:57:43.615688+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:07.603711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"85'3","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.616833+0000","last_change":"2024-09-15T23:57:42.547139+0000","last_active":"2024-09-15T23:57:43.616833+0000","last_peered":"2024-09-15T23:57:43.616833+0000","last_clean":"2024-09-15T23:57:43.616833+0000","last_became_active":"2024-09-15T23:57:42.545280+0000","last_became_peered":"2024-09-15T23:57:42.545280+0000","last_unstale":"2024-09-15T23:57:43.616833+0000","last_undegraded":"2024-09-15T23:57:43.616833+0000","last_fullsized":"2024-09-15T23:57:43.616833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:40.732501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.580084+0000","last_change":"2024-09-15T23:57:43.576929+0000","last_active":"2024-09-15T23:57:43.580084+0000","last_peered":"2024-09-15T23:57:43.580084+0000","last_clean":"2024-09-15T23:57:43.580084+0000","last_became_active":"2024-09-15T23:57:43.576489+0000","last_became_peered":"2024-09-15T23:57:43.576489+0000","last_unstale":"2024-09-15T23:57:43.580084+0000","last_undegraded":"2024-09-15T23:57:43.580084+0000","last_fullsized":"2024-09-15T23:57:43.580084+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:56.898246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"85'6","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.620934+0000","last_change":"2024-09-15T23:57:42.543049+0000","last_active":"2024-09-15T23:57:43.620934+0000","last_peered":"2024-09-15T23:57:43.620934+0000","last_clean":"2024-09-15T23:57:43.620934+0000","last_became_active":"2024-09-15T23:57:42.541443+0000","last_became_peered":"2024-09-15T23:57:42.541443+0000","last_unstale":"2024-09-15T23:57:43.620934+0000","last_undegraded":"2024-09-15T23:57:43.620934+0000","last_fullsized":"2024-09-15T23:57:43.620934+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:46.023765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.615205+0000","last_change":"2024-09-15T23:57:43.587850+0000","last_active":"2024-09-15T23:57:43.615205+0000","last_peered":"2024-09-15T23:57:43.615205+0000","last_clean":"2024-09-15T23:57:43.615205+0000","last_became_active":"2024-09-15T23:57:43.583727+0000","last_became_peered":"2024-09-15T23:57:43.583727+0000","last_unstale":"2024-09-15T23:57:43.615205+0000","last_undegraded":"2024-09-15T23:57:43.615205+0000","last_fullsized":"2024-09-15T23:57:43.615205+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:40.245532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.616945+0000","last_change":"2024-09-15T23:57:42.547824+0000","last_active":"2024-09-15T23:57:43.616945+0000","last_peered":"2024-09-15T23:57:43.616945+0000","last_clean":"2024-09-15T23:57:43.616945+0000","last_became_active":"2024-09-15T23:57:42.547549+0000","last_became_peered":"2024-09-15T23:57:42.547549+0000","last_unstale":"2024-09-15T23:57:43.616945+0000","last_undegraded":"2024-09-15T23:57:43.616945+0000","last_fullsized":"2024-09-15T23:57:43.616945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:25.513540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.588912+0000","last_change":"2024-09-15T23:57:43.578289+0000","last_active":"2024-09-15T23:57:43.588912+0000","last_peered":"2024-09-15T23:57:43.588912+0000","last_clean":"2024-09-15T23:57:43.588912+0000","last_became_active":"2024-09-15T23:57:43.577964+0000","last_became_peered":"2024-09-15T23:57:43.577964+0000","last_unstale":"2024-09-15T23:57:43.588912+0000","last_undegraded":"2024-09-15T23:57:43.588912+0000","last_fullsized":"2024-09-15T23:57:43.588912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:53.938255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.560396+0000","last_change":"2024-09-15T23:57:42.537174+0000","last_active":"2024-09-15T23:57:43.560396+0000","last_peered":"2024-09-15T23:57:43.560396+0000","last_clean":"2024-09-15T23:57:43.560396+0000","last_became_active":"2024-09-15T23:57:42.536439+0000","last_became_peered":"2024-09-15T23:57:42.536439+0000","last_unstale":"2024-09-15T23:57:43.560396+0000","last_undegraded":"2024-09-15T23:57:43.560396+0000","last_fullsized":"2024-09-15T23:57:43.560396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:39.438120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.615565+0000","last_change":"2024-09-15T23:57:43.590096+0000","last_active":"2024-09-15T23:57:43.615565+0000","last_peered":"2024-09-15T23:57:43.615565+0000","last_clean":"2024-09-15T23:57:43.615565+0000","last_became_active":"2024-09-15T23:57:43.589327+0000","last_became_peered":"2024-09-15T23:57:43.589327+0000","last_unstale":"2024-09-15T23:57:43.615565+0000","last_undegraded":"2024-09-15T23:57:43.615565+0000","last_fullsized":"2024-09-15T23:57:43.615565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:56.898246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.554907+0000","last_change":"2024-09-15T23:57:42.568806+0000","last_active":"2024-09-15T23:57:43.554907+0000","last_peered":"2024-09-15T23:57:43.554907+0000","last_clean":"2024-09-15T23:57:43.554907+0000","last_became_active":"2024-09-15T23:57:42.568107+0000","last_became_peered":"2024-09-15T23:57:42.568107+0000","last_unstale":"2024-09-15T23:57:43.554907+0000","last_undegraded":"2024-09-15T23:57:43.554907+0000","last_fullsized":"2024-09-15T23:57:43.554907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:46.205715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.605061+0000","last_change":"2024-09-15T23:57:43.591856+0000","last_active":"2024-09-15T23:57:44.605061+0000","last_peered":"2024-09-15T23:57:44.605061+0000","last_clean":"2024-09-15T23:57:44.605061+0000","last_became_active":"2024-09-15T23:57:43.578625+0000","last_became_peered":"2024-09-15T23:57:43.578625+0000","last_unstale":"2024-09-15T23:57:44.605061+0000","last_undegraded":"2024-09-15T23:57:44.605061+0000","last_fullsized":"2024-09-15T23:57:44.605061+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:06.678929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"85'8","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.619752+0000","last_change":"2024-09-15T23:57:42.555280+0000","last_active":"2024-09-15T23:57:43.619752+0000","last_peered":"2024-09-15T23:57:43.619752+0000","last_clean":"2024-09-15T23:57:43.619752+0000","last_became_active":"2024-09-15T23:57:42.554482+0000","last_became_peered":"2024-09-15T23:57:42.554482+0000","last_unstale":"2024-09-15T23:57:43.619752+0000","last_undegraded":"2024-09-15T23:57:43.619752+0000","last_fullsized":"2024-09-15T23:57:43.619752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:05.635562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.606540+0000","last_change":"2024-09-15T23:57:43.595787+0000","last_active":"2024-09-15T23:57:44.606540+0000","last_peered":"2024-09-15T23:57:44.606540+0000","last_clean":"2024-09-15T23:57:44.606540+0000","last_became_active":"2024-09-15T23:57:43.575718+0000","last_became_peered":"2024-09-15T23:57:43.575718+0000","last_unstale":"2024-09-15T23:57:44.606540+0000","last_undegraded":"2024-09-15T23:57:44.606540+0000","last_fullsized":"2024-09-15T23:57:44.606540+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:46.532797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.586728+0000","last_change":"2024-09-15T23:57:42.533884+0000","last_active":"2024-09-15T23:57:43.586728+0000","last_peered":"2024-09-15T23:57:43.586728+0000","last_clean":"2024-09-15T23:57:43.586728+0000","last_became_active":"2024-09-15T23:57:42.533514+0000","last_became_peered":"2024-09-15T23:57:42.533514+0000","last_unstale":"2024-09-15T23:57:43.586728+0000","last_undegraded":"2024-09-15T23:57:43.586728+0000","last_fullsized":"2024-09-15T23:57:43.586728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:10.580918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.586098+0000","last_change":"2024-09-15T23:57:43.582248+0000","last_active":"2024-09-15T23:57:43.586098+0000","last_peered":"2024-09-15T23:57:43.586098+0000","last_clean":"2024-09-15T23:57:43.586098+0000","last_became_active":"2024-09-15T23:57:43.581941+0000","last_became_peered":"2024-09-15T23:57:43.581941+0000","last_unstale":"2024-09-15T23:57:43.586098+0000","last_undegraded":"2024-09-15T23:57:43.586098+0000","last_fullsized":"2024-09-15T23:57:43.586098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:00.342632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.590118+0000","last_change":"2024-09-15T23:57:42.555234+0000","last_active":"2024-09-15T23:57:43.590118+0000","last_peered":"2024-09-15T23:57:43.590118+0000","last_clean":"2024-09-15T23:57:43.590118+0000","last_became_active":"2024-09-15T23:57:42.554866+0000","last_became_peered":"2024-09-15T23:57:42.554866+0000","last_unstale":"2024-09-15T23:57:43.590118+0000","last_undegraded":"2024-09-15T23:57:43.590118+0000","last_fullsized":"2024-09-15T23:57:43.590118+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:52.928333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.585021+0000","last_change":"2024-09-15T23:57:43.575130+0000","last_active":"2024-09-15T23:57:43.585021+0000","last_peered":"2024-09-15T23:57:43.585021+0000","last_clean":"2024-09-15T23:57:43.585021+0000","last_became_active":"2024-09-15T23:57:43.574753+0000","last_became_peered":"2024-09-15T23:57:43.574753+0000","last_unstale":"2024-09-15T23:57:43.585021+0000","last_undegraded":"2024-09-15T23:57:43.585021+0000","last_fullsized":"2024-09-15T23:57:43.585021+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:04.617751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.589435+0000","last_change":"2024-09-15T23:57:42.553958+0000","last_active":"2024-09-15T23:57:43.589435+0000","last_peered":"2024-09-15T23:57:43.589435+0000","last_clean":"2024-09-15T23:57:43.589435+0000","last_became_active":"2024-09-15T23:57:42.553170+0000","last_became_peered":"2024-09-15T23:57:42.553170+0000","last_unstale":"2024-09-15T23:57:43.589435+0000","last_undegraded":"2024-09-15T23:57:43.589435+0000","last_fullsized":"2024-09-15T23:57:43.589435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:06.813246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.603537+0000","last_change":"2024-09-15T23:57:43.596612+0000","last_active":"2024-09-15T23:57:43.603537+0000","last_peered":"2024-09-15T23:57:43.603537+0000","last_clean":"2024-09-15T23:57:43.603537+0000","last_became_active":"2024-09-15T23:57:43.595941+0000","last_became_peered":"2024-09-15T23:57:43.595941+0000","last_unstale":"2024-09-15T23:57:43.603537+0000","last_undegraded":"2024-09-15T23:57:43.603537+0000","last_fullsized":"2024-09-15T23:57:43.603537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:48.230239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.612772+0000","last_change":"2024-09-15T23:57:42.547529+0000","last_active":"2024-09-15T23:57:43.612772+0000","last_peered":"2024-09-15T23:57:43.612772+0000","last_clean":"2024-09-15T23:57:43.612772+0000","last_became_active":"2024-09-15T23:57:42.546821+0000","last_became_peered":"2024-09-15T23:57:42.546821+0000","last_unstale":"2024-09-15T23:57:43.612772+0000","last_undegraded":"2024-09-15T23:57:43.612772+0000","last_fullsized":"2024-09-15T23:57:43.612772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:53.377917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.586618+0000","last_change":"2024-09-15T23:57:43.584180+0000","last_active":"2024-09-15T23:57:43.586618+0000","last_peered":"2024-09-15T23:57:43.586618+0000","last_clean":"2024-09-15T23:57:43.586618+0000","last_became_active":"2024-09-15T23:57:43.583711+0000","last_became_peered":"2024-09-15T23:57:43.583711+0000","last_unstale":"2024-09-15T23:57:43.586618+0000","last_undegraded":"2024-09-15T23:57:43.586618+0000","last_fullsized":"2024-09-15T23:57:43.586618+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:47.215637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.556754+0000","last_change":"2024-09-15T23:57:42.567277+0000","last_active":"2024-09-15T23:57:43.556754+0000","last_peered":"2024-09-15T23:57:43.556754+0000","last_clean":"2024-09-15T23:57:43.556754+0000","last_became_active":"2024-09-15T23:57:42.566683+0000","last_became_peered":"2024-09-15T23:57:42.566683+0000","last_unstale":"2024-09-15T23:57:43.556754+0000","last_undegraded":"2024-09-15T23:57:43.556754+0000","last_fullsized":"2024-09-15T23:57:43.556754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:18.467355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.587022+0000","last_change":"2024-09-15T23:57:43.583604+0000","last_active":"2024-09-15T23:57:43.587022+0000","last_peered":"2024-09-15T23:57:43.587022+0000","last_clean":"2024-09-15T23:57:43.587022+0000","last_became_active":"2024-09-15T23:57:43.583289+0000","last_became_peered":"2024-09-15T23:57:43.583289+0000","last_unstale":"2024-09-15T23:57:43.587022+0000","last_undegraded":"2024-09-15T23:57:43.587022+0000","last_fullsized":"2024-09-15T23:57:43.587022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:47.215637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.568140+0000","last_change":"2024-09-15T23:57:42.541900+0000","last_active":"2024-09-15T23:57:43.568140+0000","last_peered":"2024-09-15T23:57:43.568140+0000","last_clean":"2024-09-15T23:57:43.568140+0000","last_became_active":"2024-09-15T23:57:42.541575+0000","last_became_peered":"2024-09-15T23:57:42.541575+0000","last_unstale":"2024-09-15T23:57:43.568140+0000","last_undegraded":"2024-09-15T23:57:43.568140+0000","last_fullsized":"2024-09-15T23:57:43.568140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:10.976235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.610844+0000","last_change":"2024-09-15T23:57:43.583143+0000","last_active":"2024-09-15T23:57:43.610844+0000","last_peered":"2024-09-15T23:57:43.610844+0000","last_clean":"2024-09-15T23:57:43.610844+0000","last_became_active":"2024-09-15T23:57:43.581938+0000","last_became_peered":"2024-09-15T23:57:43.581938+0000","last_unstale":"2024-09-15T23:57:43.610844+0000","last_undegraded":"2024-09-15T23:57:43.610844+0000","last_fullsized":"2024-09-15T23:57:43.610844+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:31.330027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.603867+0000","last_change":"2024-09-15T23:57:42.551525+0000","last_active":"2024-09-15T23:57:44.603867+0000","last_peered":"2024-09-15T23:57:44.603867+0000","last_clean":"2024-09-15T23:57:44.603867+0000","last_became_active":"2024-09-15T23:57:42.550200+0000","last_became_peered":"2024-09-15T23:57:42.550200+0000","last_unstale":"2024-09-15T23:57:44.603867+0000","last_undegraded":"2024-09-15T23:57:44.603867+0000","last_fullsized":"2024-09-15T23:57:44.603867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:01.494733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.587055+0000","last_change":"2024-09-15T23:57:43.585134+0000","last_active":"2024-09-15T23:57:43.587055+0000","last_peered":"2024-09-15T23:57:43.587055+0000","last_clean":"2024-09-15T23:57:43.587055+0000","last_became_active":"2024-09-15T23:57:43.584813+0000","last_became_peered":"2024-09-15T23:57:43.584813+0000","last_unstale":"2024-09-15T23:57:43.587055+0000","last_undegraded":"2024-09-15T23:57:43.587055+0000","last_fullsized":"2024-09-15T23:57:43.587055+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:15.092630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.588540+0000","last_change":"2024-09-15T23:57:42.559262+0000","last_active":"2024-09-15T23:57:43.588540+0000","last_peered":"2024-09-15T23:57:43.588540+0000","last_clean":"2024-09-15T23:57:43.588540+0000","last_became_active":"2024-09-15T23:57:42.555807+0000","last_became_peered":"2024-09-15T23:57:42.555807+0000","last_unstale":"2024-09-15T23:57:43.588540+0000","last_undegraded":"2024-09-15T23:57:43.588540+0000","last_fullsized":"2024-09-15T23:57:43.588540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:45.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.606155+0000","last_change":"2024-09-15T23:57:43.576839+0000","last_active":"2024-09-15T23:57:44.606155+0000","last_peered":"2024-09-15T23:57:44.606155+0000","last_clean":"2024-09-15T23:57:44.606155+0000","last_became_active":"2024-09-15T23:57:43.576127+0000","last_became_peered":"2024-09-15T23:57:43.576127+0000","last_unstale":"2024-09-15T23:57:44.606155+0000","last_undegraded":"2024-09-15T23:57:44.606155+0000","last_fullsized":"2024-09-15T23:57:44.606155+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:17.475307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.572566+0000","last_change":"2024-09-15T23:57:42.558940+0000","last_active":"2024-09-15T23:57:43.572566+0000","last_peered":"2024-09-15T23:57:43.572566+0000","last_clean":"2024-09-15T23:57:43.572566+0000","last_became_active":"2024-09-15T23:57:42.558227+0000","last_became_peered":"2024-09-15T23:57:42.558227+0000","last_unstale":"2024-09-15T23:57:43.572566+0000","last_undegraded":"2024-09-15T23:57:43.572566+0000","last_fullsized":"2024-09-15T23:57:43.572566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:24.878514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T23:57:44.606690+0000","last_change":"2024-09-15T23:57:43.577765+0000","last_active":"2024-09-15T23:57:44.606690+0000","last_peered":"2024-09-15T23:57:44.606690+0000","last_clean":"2024-09-15T23:57:44.606690+0000","last_became_active":"2024-09-15T23:57:43.577076+0000","last_became_peered":"2024-09-15T23:57:43.577076+0000","last_unstale":"2024-09-15T23:57:44.606690+0000","last_undegraded":"2024-09-15T23:57:44.606690+0000","last_fullsized":"2024-09-15T23:57:44.606690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:00.164389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.571592+0000","last_change":"2024-09-15T23:57:42.559032+0000","last_active":"2024-09-15T23:57:43.571592+0000","last_peered":"2024-09-15T23:57:43.571592+0000","last_clean":"2024-09-15T23:57:43.571592+0000","last_became_active":"2024-09-15T23:57:42.558579+0000","last_became_peered":"2024-09-15T23:57:42.558579+0000","last_unstale":"2024-09-15T23:57:43.571592+0000","last_undegraded":"2024-09-15T23:57:43.571592+0000","last_fullsized":"2024-09-15T23:57:43.571592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:03.607829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.592187+0000","last_change":"2024-09-15T23:57:43.588292+0000","last_active":"2024-09-15T23:57:43.592187+0000","last_peered":"2024-09-15T23:57:43.592187+0000","last_clean":"2024-09-15T23:57:43.592187+0000","last_became_active":"2024-09-15T23:57:43.585751+0000","last_became_peered":"2024-09-15T23:57:43.585751+0000","last_unstale":"2024-09-15T23:57:43.592187+0000","last_undegraded":"2024-09-15T23:57:43.592187+0000","last_fullsized":"2024-09-15T23:57:43.592187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:19.477277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.569581+0000","last_change":"2024-09-15T23:57:42.568966+0000","last_active":"2024-09-15T23:57:43.569581+0000","last_peered":"2024-09-15T23:57:43.569581+0000","last_clean":"2024-09-15T23:57:43.569581+0000","last_became_active":"2024-09-15T23:57:42.568634+0000","last_became_peered":"2024-09-15T23:57:42.568634+0000","last_unstale":"2024-09-15T23:57:43.569581+0000","last_undegraded":"2024-09-15T23:57:43.569581+0000","last_fullsized":"2024-09-15T23:57:43.569581+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.154653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.575661+0000","last_change":"2024-09-15T23:57:43.572509+0000","last_active":"2024-09-15T23:57:43.575661+0000","last_peered":"2024-09-15T23:57:43.575661+0000","last_clean":"2024-09-15T23:57:43.575661+0000","last_became_active":"2024-09-15T23:57:43.571715+0000","last_became_peered":"2024-09-15T23:57:43.571715+0000","last_unstale":"2024-09-15T23:57:43.575661+0000","last_undegraded":"2024-09-15T23:57:43.575661+0000","last_fullsized":"2024-09-15T23:57:43.575661+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:31.330027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.556349+0000","last_change":"2024-09-15T23:57:42.544883+0000","last_active":"2024-09-15T23:57:43.556349+0000","last_peered":"2024-09-15T23:57:43.556349+0000","last_clean":"2024-09-15T23:57:43.556349+0000","last_became_active":"2024-09-15T23:57:42.543747+0000","last_became_peered":"2024-09-15T23:57:42.543747+0000","last_unstale":"2024-09-15T23:57:43.556349+0000","last_undegraded":"2024-09-15T23:57:43.556349+0000","last_fullsized":"2024-09-15T23:57:43.556349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:14.082708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.618402+0000","last_change":"2024-09-15T23:57:43.616557+0000","last_active":"2024-09-15T23:57:43.618402+0000","last_peered":"2024-09-15T23:57:43.618402+0000","last_clean":"2024-09-15T23:57:43.618402+0000","last_became_active":"2024-09-15T23:57:43.616020+0000","last_became_peered":"2024-09-15T23:57:43.616020+0000","last_unstale":"2024-09-15T23:57:43.618402+0000","last_undegraded":"2024-09-15T23:57:43.618402+0000","last_fullsized":"2024-09-15T23:57:43.618402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:26.932403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.555641+0000","last_change":"2024-09-15T23:57:42.566619+0000","last_active":"2024-09-15T23:57:43.555641+0000","last_peered":"2024-09-15T23:57:43.555641+0000","last_clean":"2024-09-15T23:57:43.555641+0000","last_became_active":"2024-09-15T23:57:42.566255+0000","last_became_peered":"2024-09-15T23:57:42.566255+0000","last_unstale":"2024-09-15T23:57:43.555641+0000","last_undegraded":"2024-09-15T23:57:43.555641+0000","last_fullsized":"2024-09-15T23:57:43.555641+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:09.847085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.599933+0000","last_change":"2024-09-15T23:57:43.599440+0000","last_active":"2024-09-15T23:57:43.599933+0000","last_peered":"2024-09-15T23:57:43.599933+0000","last_clean":"2024-09-15T23:57:43.599933+0000","last_became_active":"2024-09-15T23:57:43.599123+0000","last_became_peered":"2024-09-15T23:57:43.599123+0000","last_unstale":"2024-09-15T23:57:43.599933+0000","last_undegraded":"2024-09-15T23:57:43.599933+0000","last_fullsized":"2024-09-15T23:57:43.599933+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:07.201274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.556452+0000","last_change":"2024-09-15T23:57:42.572696+0000","last_active":"2024-09-15T23:57:43.556452+0000","last_peered":"2024-09-15T23:57:43.556452+0000","last_clean":"2024-09-15T23:57:43.556452+0000","last_became_active":"2024-09-15T23:57:42.572368+0000","last_became_peered":"2024-09-15T23:57:42.572368+0000","last_unstale":"2024-09-15T23:57:43.556452+0000","last_undegraded":"2024-09-15T23:57:43.556452+0000","last_fullsized":"2024-09-15T23:57:43.556452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:20.246773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.607439+0000","last_change":"2024-09-15T23:57:43.606817+0000","last_active":"2024-09-15T23:57:43.607439+0000","last_peered":"2024-09-15T23:57:43.607439+0000","last_clean":"2024-09-15T23:57:43.607439+0000","last_became_active":"2024-09-15T23:57:43.606169+0000","last_became_peered":"2024-09-15T23:57:43.606169+0000","last_unstale":"2024-09-15T23:57:43.607439+0000","last_undegraded":"2024-09-15T23:57:43.607439+0000","last_fullsized":"2024-09-15T23:57:43.607439+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:30.742294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.559023+0000","last_change":"2024-09-15T23:57:42.560060+0000","last_active":"2024-09-15T23:57:43.559023+0000","last_peered":"2024-09-15T23:57:43.559023+0000","last_clean":"2024-09-15T23:57:43.559023+0000","last_became_active":"2024-09-15T23:57:42.559687+0000","last_became_peered":"2024-09-15T23:57:42.559687+0000","last_unstale":"2024-09-15T23:57:43.559023+0000","last_undegraded":"2024-09-15T23:57:43.559023+0000","last_fullsized":"2024-09-15T23:57:43.559023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:59.523941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.600303+0000","last_change":"2024-09-15T23:57:43.599960+0000","last_active":"2024-09-15T23:57:43.600303+0000","last_peered":"2024-09-15T23:57:43.600303+0000","last_clean":"2024-09-15T23:57:43.600303+0000","last_became_active":"2024-09-15T23:57:43.599526+0000","last_became_peered":"2024-09-15T23:57:43.599526+0000","last_unstale":"2024-09-15T23:57:43.600303+0000","last_undegraded":"2024-09-15T23:57:43.600303+0000","last_fullsized":"2024-09-15T23:57:43.600303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:42.516711+0000","last_clean_scrub_stamp":"2024-09-15T23:57:42.516711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:40.245532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.557438+0000","last_change":"2024-09-15T23:57:42.549481+0000","last_active":"2024-09-15T23:57:43.557438+0000","last_peered":"2024-09-15T23:57:43.557438+0000","last_clean":"2024-09-15T23:57:43.557438+0000","last_became_active":"2024-09-15T23:57:42.548719+0000","last_became_peered":"2024-09-15T23:57:42.548719+0000","last_unstale":"2024-09-15T23:57:43.557438+0000","last_undegraded":"2024-09-15T23:57:43.557438+0000","last_fullsized":"2024-09-15T23:57:43.557438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:41.506789+0000","last_clean_scrub_stamp":"2024-09-15T23:57:41.506789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:06.191352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":288,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-15T23:57:43.559326+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:57:43.559326+0000","last_peered":"2024-09-15T23:57:43.559326+0000","last_clean":"2024-09-15T23:57:43.559326+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:57:43.559326+0000","last_undegraded":"2024-09-15T23:57:43.559326+0000","last_fullsized":"2024-09-15T23:57:43.559326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1028096,"data_stored":465619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509492,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":474522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1040384,"data_stored":472786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1060864,"data_stored":474510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1048576,"data_stored":473390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1622016,"data_stored":1055987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1044480,"data_stored":472856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36960,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334880,"statfs":{"total":96636764160,"available":96598917120,"internally_reserved":0,"allocated":1646592,"data_stored":1069846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:57:47.955 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:57:47.956 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:57:48.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.121+0000 7f074f5b6640 1 Processor -- start 2024-09-15T23:57:48.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.121+0000 7f074f5b6640 1 -- start start 2024-09-15T23:57:48.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.121+0000 7f074f5b6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f074806e100 0x7f0748162890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.121+0000 7f074f5b6640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07481480f0 con 0x7f07481471c0 2024-09-15T23:57:48.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.121+0000 7f074f5b6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07480cc2f0 con 0x7f07480cbe50 2024-09-15T23:57:48.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.121+0000 7f074f5b6640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0748162dd0 con 0x7f074806e100 2024-09-15T23:57:48.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.121+0000 7f074db53640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f074806e100 0x7f0748162890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.123 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.121+0000 7f074db53640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f074806e100 0x7f0748162890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50056/0 (socket says 172.21.15.112:50056) 2024-09-15T23:57:48.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.121+0000 7f074db53640 1 -- 172.21.15.112:0/2877027038 learned_addr learned my addr 172.21.15.112:0/2877027038 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:48.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.121+0000 7f074db53640 1 -- 172.21.15.112:0/2877027038 >> v1:172.21.15.169:6789/0 conn(0x7f07480cbe50 legacy=0x7f07480d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:48.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.121+0000 7f074db53640 1 -- 172.21.15.112:0/2877027038 >> v1:172.21.15.112:6789/0 conn(0x7f07481471c0 legacy=0x7f074806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.121+0000 7f074db53640 1 -- 172.21.15.112:0/2877027038 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07480cc5d0 con 0x7f074806e100 2024-09-15T23:57:48.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074db53640 1 --2- 172.21.15.112:0/2877027038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f074806e100 0x7f0748162890 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0740009e50 tx=0x7f074001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6115d0ee3af02f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:48.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f073ffff640 1 -- 172.21.15.112:0/2877027038 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07400a5880 con 0x7f074806e100 2024-09-15T23:57:48.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f073ffff640 1 -- 172.21.15.112:0/2877027038 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07400a5a20 con 0x7f074806e100 2024-09-15T23:57:48.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f073ffff640 1 -- 172.21.15.112:0/2877027038 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07400a5df0 con 0x7f074806e100 2024-09-15T23:57:48.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 -- 172.21.15.112:0/2877027038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f074806e100 msgr2=0x7f0748162890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 --2- 172.21.15.112:0/2877027038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f074806e100 0x7f0748162890 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0740009e50 tx=0x7f074001c9c0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 -- 172.21.15.112:0/2877027038 shutdown_connections 2024-09-15T23:57:48.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 --2- 172.21.15.112:0/2877027038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f074806e100 0x7f0748162890 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 -- 172.21.15.112:0/2877027038 >> 172.21.15.112:0/2877027038 conn(0x7f07480700a0 msgr2=0x7f07480704b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:48.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 -- 172.21.15.112:0/2877027038 shutdown_connections 2024-09-15T23:57:48.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 -- 172.21.15.112:0/2877027038 wait complete. 2024-09-15T23:57:48.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 Processor -- start 2024-09-15T23:57:48.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 -- start start 2024-09-15T23:57:48.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f074806e100 0x7f074812ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.131 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07480cbe50 0x7f074812d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07481471c0 0x7f0748161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f07480d24e0 con 0x7f07481471c0 2024-09-15T23:57:48.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f07481475a0 con 0x7f07480cbe50 2024-09-15T23:57:48.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074f5b6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f07480d2660 con 0x7f074806e100 2024-09-15T23:57:48.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074db53640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07481471c0 0x7f0748161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074db53640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07481471c0 0x7f0748161290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:50062/0 (socket says 172.21.15.112:50062) 2024-09-15T23:57:48.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074db53640 1 -- 172.21.15.112:0/4127736193 learned_addr learned my addr 172.21.15.112:0/4127736193 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:48.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074db53640 1 -- 172.21.15.112:0/4127736193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f074806e100 msgr2=0x7f074812ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074cb51640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07480cbe50 0x7f074812d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.125+0000 7f074d352640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f074806e100 0x7f074812ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f074db53640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f074806e100 0x7f074812ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f074db53640 1 -- 172.21.15.112:0/4127736193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07480cbe50 msgr2=0x7f074812d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f074db53640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07480cbe50 0x7f074812d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f074db53640 1 -- 172.21.15.112:0/4127736193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074812dea0 con 0x7f07481471c0 2024-09-15T23:57:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f074cb51640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07480cbe50 0x7f074812d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f074d352640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f074806e100 0x7f074812ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f074db53640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07481471c0 0x7f0748161290 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f07400af040 tx=0x7f0740019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f073dffb640 1 -- 172.21.15.112:0/4127736193 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07400bc020 con 0x7f07481471c0 2024-09-15T23:57:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f073dffb640 1 -- 172.21.15.112:0/4127736193 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07400b8880 con 0x7f07481471c0 2024-09-15T23:57:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f074f5b6640 1 -- 172.21.15.112:0/4127736193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f074812e180 con 0x7f07481471c0 2024-09-15T23:57:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f073dffb640 1 -- 172.21.15.112:0/4127736193 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07400b8c70 con 0x7f07481471c0 2024-09-15T23:57:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f074f5b6640 1 -- 172.21.15.112:0/4127736193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f074812e740 con 0x7f07481471c0 2024-09-15T23:57:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f074f5b6640 1 -- 172.21.15.112:0/4127736193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0748162890 con 0x7f07481471c0 2024-09-15T23:57:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f073dffb640 1 -- 172.21.15.112:0/4127736193 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f07400bf020 con 0x7f07481471c0 2024-09-15T23:57:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f073dffb640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f072c0678c0 0x7f072c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f073dffb640 1 -- 172.21.15.112:0/4127736193 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f0740121070 con 0x7f07481471c0 2024-09-15T23:57:48.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f074d352640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f072c0678c0 0x7f072c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.129+0000 7f074d352640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f072c0678c0 0x7f072c069d80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f07481306f0 tx=0x7f0744009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:48.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.133+0000 7f073dffb640 1 -- 172.21.15.112:0/4127736193 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f07400c6030 con 0x7f07481471c0 2024-09-15T23:57:48.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.337+0000 7f074f5b6640 1 -- 172.21.15.112:0/4127736193 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f074806e660 con 0x7f07481471c0 2024-09-15T23:57:48.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.341+0000 7f073dffb640 1 -- 172.21.15.112:0/4127736193 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f07400165e0 con 0x7f07481471c0 2024-09-15T23:57:48.343 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-15T23:57:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw== 2024-09-15T23:57:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-15T23:57:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-15T23:57:48.343 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:57:48.343 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-15T23:57:48.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.345+0000 7f074f5b6640 1 -- 172.21.15.112:0/4127736193 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f072c0678c0 msgr2=0x7f072c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.345+0000 7f074f5b6640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f072c0678c0 0x7f072c069d80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f07481306f0 tx=0x7f0744009040 comp rx=0 tx=0).stop 2024-09-15T23:57:48.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.345+0000 7f074f5b6640 1 -- 172.21.15.112:0/4127736193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07481471c0 msgr2=0x7f0748161290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.345+0000 7f074f5b6640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07481471c0 0x7f0748161290 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f07400af040 tx=0x7f0740019760 comp rx=0 tx=0).stop 2024-09-15T23:57:48.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.345+0000 7f074f5b6640 1 -- 172.21.15.112:0/4127736193 shutdown_connections 2024-09-15T23:57:48.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.345+0000 7f074f5b6640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f072c0678c0 0x7f072c069d80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.345+0000 7f074f5b6640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07481471c0 0x7f0748161290 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.345+0000 7f074f5b6640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07480cbe50 0x7f074812d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.345+0000 7f074f5b6640 1 --2- 172.21.15.112:0/4127736193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f074806e100 0x7f074812ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.345+0000 7f074f5b6640 1 -- 172.21.15.112:0/4127736193 >> 172.21.15.112:0/4127736193 conn(0x7f07480700a0 msgr2=0x7f07480ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:48.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.345+0000 7f074f5b6640 1 -- 172.21.15.112:0/4127736193 shutdown_connections 2024-09-15T23:57:48.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.345+0000 7f074f5b6640 1 -- 172.21.15.112:0/4127736193 wait complete. 2024-09-15T23:57:48.360 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:48.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb45ab3d640 1 Processor -- start 2024-09-15T23:57:48.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb45ab3d640 1 -- start start 2024-09-15T23:57:48.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb45ab3d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb454161a60 0x7fb4540d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb45ab3d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4540d2e90 0x7fb4540cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.466 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb45ab3d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb4540cf450 0x7fb4540d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb45ab3d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb4540d32b0 con 0x7fb454161a60 2024-09-15T23:57:48.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb45ab3d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb4540d0300 con 0x7fb4540cf450 2024-09-15T23:57:48.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb45ab3d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb4540b0f60 con 0x7fb4540d2e90 2024-09-15T23:57:48.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb4588d9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb454161a60 0x7fb4540d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb4588d9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb454161a60 0x7fb4540d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52358/0 (socket says 172.21.15.112:52358) 2024-09-15T23:57:48.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb4588d9640 1 -- 172.21.15.112:0/2751566177 learned_addr learned my addr 172.21.15.112:0/2751566177 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:48.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb4588d9640 1 -- 172.21.15.112:0/2751566177 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4540d2e90 msgr2=0x7fb4540cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:48.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb4588d9640 1 --2- 172.21.15.112:0/2751566177 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4540d2e90 0x7fb4540cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb4588d9640 1 -- 172.21.15.112:0/2751566177 >> v2:172.21.15.169:3300/0 conn(0x7fb4540cf450 msgr2=0x7fb4540d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:48.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb4590da640 1 --2- 172.21.15.112:0/2751566177 >> v2:172.21.15.169:3300/0 conn(0x7fb4540cf450 0x7fb4540d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb4588d9640 1 --2- 172.21.15.112:0/2751566177 >> v2:172.21.15.169:3300/0 conn(0x7fb4540cf450 0x7fb4540d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb4588d9640 1 -- 172.21.15.112:0/2751566177 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4540cfd40 con 0x7fb454161a60 2024-09-15T23:57:48.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.465+0000 7fb4590da640 1 --2- 172.21.15.112:0/2751566177 >> v2:172.21.15.169:3300/0 conn(0x7fb4540cf450 0x7fb4540d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:48.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4588d9640 1 --2- 172.21.15.112:0/2751566177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb454161a60 0x7fb4540d2950 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fb4540d23a0 tx=0x7fb44401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca0adbb7f5a904f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:48.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4537fe640 1 -- 172.21.15.112:0/2751566177 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4440ab620 con 0x7fb454161a60 2024-09-15T23:57:48.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4537fe640 1 -- 172.21.15.112:0/2751566177 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4440b0070 con 0x7fb454161a60 2024-09-15T23:57:48.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4537fe640 1 -- 172.21.15.112:0/2751566177 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4440ab9e0 con 0x7fb454161a60 2024-09-15T23:57:48.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 -- 172.21.15.112:0/2751566177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb454161a60 msgr2=0x7fb4540d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 --2- 172.21.15.112:0/2751566177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb454161a60 0x7fb4540d2950 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fb4540d23a0 tx=0x7fb44401c460 comp rx=0 tx=0).stop 2024-09-15T23:57:48.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 -- 172.21.15.112:0/2751566177 shutdown_connections 2024-09-15T23:57:48.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 --2- 172.21.15.112:0/2751566177 >> v2:172.21.15.169:3300/0 conn(0x7fb4540cf450 0x7fb4540d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 --2- 172.21.15.112:0/2751566177 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4540d2e90 0x7fb4540cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 --2- 172.21.15.112:0/2751566177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb454161a60 0x7fb4540d2950 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 -- 172.21.15.112:0/2751566177 >> 172.21.15.112:0/2751566177 conn(0x7fb45408bf90 msgr2=0x7fb45409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:48.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 -- 172.21.15.112:0/2751566177 shutdown_connections 2024-09-15T23:57:48.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 -- 172.21.15.112:0/2751566177 wait complete. 2024-09-15T23:57:48.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 Processor -- start 2024-09-15T23:57:48.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 -- start start 2024-09-15T23:57:48.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4540cf450 0x7fb4540cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4540d2e90 0x7fb45415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb454161a60 0x7fb4540b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb45406d830 con 0x7fb4540cf450 2024-09-15T23:57:48.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb45406d6b0 con 0x7fb454161a60 2024-09-15T23:57:48.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb45406d9b0 con 0x7fb4540d2e90 2024-09-15T23:57:48.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4588d9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4540cf450 0x7fb4540cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4588d9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4540cf450 0x7fb4540cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52368/0 (socket says 172.21.15.112:52368) 2024-09-15T23:57:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4588d9640 1 -- 172.21.15.112:0/385277673 learned_addr learned my addr 172.21.15.112:0/385277673 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4590da640 1 --2- 172.21.15.112:0/385277673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb454161a60 0x7fb4540b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb453fff640 1 --2- 172.21.15.112:0/385277673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4540d2e90 0x7fb45415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4588d9640 1 -- 172.21.15.112:0/385277673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4540d2e90 msgr2=0x7fb45415bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4588d9640 1 --2- 172.21.15.112:0/385277673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4540d2e90 0x7fb45415bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4588d9640 1 -- 172.21.15.112:0/385277673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb454161a60 msgr2=0x7fb4540b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4588d9640 1 --2- 172.21.15.112:0/385277673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb454161a60 0x7fb4540b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4588d9640 1 -- 172.21.15.112:0/385277673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45415c000 con 0x7fb4540cf450 2024-09-15T23:57:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4588d9640 1 --2- 172.21.15.112:0/385277673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4540cf450 0x7fb4540cbe50 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb4440ad040 tx=0x7fb44401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4517fa640 1 -- 172.21.15.112:0/385277673 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4440abdb0 con 0x7fb4540cf450 2024-09-15T23:57:48.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4517fa640 1 -- 172.21.15.112:0/385277673 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4440be3f0 con 0x7fb4540cf450 2024-09-15T23:57:48.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 -- 172.21.15.112:0/385277673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb454154150 con 0x7fb4540cf450 2024-09-15T23:57:48.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb4517fa640 1 -- 172.21.15.112:0/385277673 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4440be7e0 con 0x7fb4540cf450 2024-09-15T23:57:48.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.469+0000 7fb45ab3d640 1 -- 172.21.15.112:0/385277673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb454154710 con 0x7fb4540cf450 2024-09-15T23:57:48.474 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.473+0000 7fb45ab3d640 1 -- 172.21.15.112:0/385277673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4540cef10 con 0x7fb4540cf450 2024-09-15T23:57:48.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.473+0000 7fb4517fa640 1 -- 172.21.15.112:0/385277673 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb4440b43f0 con 0x7fb4540cf450 2024-09-15T23:57:48.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.473+0000 7fb4517fa640 1 --2- 172.21.15.112:0/385277673 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb4400678c0 0x7fb440069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.473+0000 7fb4517fa640 1 -- 172.21.15.112:0/385277673 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fb444120300 con 0x7fb4540cf450 2024-09-15T23:57:48.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.473+0000 7fb453fff640 1 --2- 172.21.15.112:0/385277673 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb4400678c0 0x7fb440069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.475 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.473+0000 7fb453fff640 1 --2- 172.21.15.112:0/385277673 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb4400678c0 0x7fb440069d80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb454159a50 tx=0x7fb4480094f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:48.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.477+0000 7fb4517fa640 1 -- 172.21.15.112:0/385277673 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb4440c4060 con 0x7fb4540cf450 2024-09-15T23:57:48.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.665+0000 7fb45ab3d640 1 -- 172.21.15.112:0/385277673 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4540b37a0 con 0x7fb4540cf450 2024-09-15T23:57:48.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.665+0000 7fb4517fa640 1 -- 172.21.15.112:0/385277673 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5234 (secure 0 0 0) 0x7fb444016110 con 0x7fb4540cf450 2024-09-15T23:57:48.668 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:48.668 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":46,"btime":"2024-09-15T23:57:46:581351+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1475104986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1475104986},{"type":"v1","addr":"172.21.15.169:6835","nonce":1475104986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2253954019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2253954019},{"type":"v1","addr":"172.21.15.169:6834","nonce":2253954019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1645054566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1645054566},{"type":"v1","addr":"172.21.15.112:6835","nonce":1645054566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:42.896416+0000","modified":"2024-09-15T23:57:45.943939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6387":{"gid":6387,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/434676840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":434676840},{"type":"v1","addr":"172.21.15.112:6837","nonce":434676840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6387,"qdb_cluster":[6387]},"id":6}]} 2024-09-15T23:57:48.668 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 46 2024-09-15T23:57:48.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.669+0000 7fb45ab3d640 1 -- 172.21.15.112:0/385277673 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb4400678c0 msgr2=0x7fb440069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.669+0000 7fb45ab3d640 1 --2- 172.21.15.112:0/385277673 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb4400678c0 0x7fb440069d80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb454159a50 tx=0x7fb4480094f0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.669+0000 7fb45ab3d640 1 -- 172.21.15.112:0/385277673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4540cf450 msgr2=0x7fb4540cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.669+0000 7fb45ab3d640 1 --2- 172.21.15.112:0/385277673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4540cf450 0x7fb4540cbe50 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb4440ad040 tx=0x7fb44401aca0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.669+0000 7fb45ab3d640 1 -- 172.21.15.112:0/385277673 shutdown_connections 2024-09-15T23:57:48.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.669+0000 7fb45ab3d640 1 --2- 172.21.15.112:0/385277673 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb4400678c0 0x7fb440069d80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.669+0000 7fb45ab3d640 1 --2- 172.21.15.112:0/385277673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb454161a60 0x7fb4540b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.669+0000 7fb45ab3d640 1 --2- 172.21.15.112:0/385277673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4540d2e90 0x7fb45415bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.669+0000 7fb45ab3d640 1 --2- 172.21.15.112:0/385277673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4540cf450 0x7fb4540cbe50 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.669+0000 7fb45ab3d640 1 -- 172.21.15.112:0/385277673 >> 172.21.15.112:0/385277673 conn(0x7fb45408bf90 msgr2=0x7fb454074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:48.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.669+0000 7fb45ab3d640 1 -- 172.21.15.112:0/385277673 shutdown_connections 2024-09-15T23:57:48.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:48.669+0000 7fb45ab3d640 1 -- 172.21.15.112:0/385277673 wait complete. 2024-09-15T23:57:49.088 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:57:42.896416+0000', 'modified': '2024-09-15T23:57:45.943939+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6387}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6387': {'gid': 6387, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6837/434676840', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 434676840}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 434676840}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6387, 'qdb_cluster': [6387]} 2024-09-15T23:57:49.088 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:57:49.089 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T23:57:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f60821bd640 1 Processor -- start 2024-09-15T23:57:49.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f60821bd640 1 -- start start 2024-09-15T23:57:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f60821bd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f607c0cf1e0 0x7f607c15d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f60821bd640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f607c0ce140 con 0x7f607c0cdb00 2024-09-15T23:57:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f60821bd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f607c0ce420 con 0x7f607c0b3280 2024-09-15T23:57:49.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f60821bd640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f607c0ce700 con 0x7f607c0cf1e0 2024-09-15T23:57:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607affd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f607c0cdb00 0x7f607c0b3660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52224/0 (socket says 172.21.15.112:52224) 2024-09-15T23:57:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607affd640 1 -- 172.21.15.112:0/2027173398 learned_addr learned my addr 172.21.15.112:0/2027173398 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607bfff640 1 --2- 172.21.15.112:0/2027173398 >> v2:172.21.15.169:3300/0 conn(0x7f607c0cf1e0 0x7f607c15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 -- 172.21.15.112:0/2027173398 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 774050726 0 0) 0x7f607c0ce140 con 0x7f607c0cdb00 2024-09-15T23:57:49.220 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 -- 172.21.15.112:0/2027173398 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6064003530 con 0x7f607c0cdb00 2024-09-15T23:57:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 -- 172.21.15.112:0/2027173398 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1378513993 0 0) 0x7f6064003530 con 0x7f607c0cdb00 2024-09-15T23:57:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 -- 172.21.15.112:0/2027173398 >> v2:172.21.15.169:3300/0 conn(0x7f607c0cf1e0 msgr2=0x7f607c15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 --2- 172.21.15.112:0/2027173398 >> v2:172.21.15.169:3300/0 conn(0x7f607c0cf1e0 0x7f607c15d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 -- 172.21.15.112:0/2027173398 >> v1:172.21.15.169:6789/0 conn(0x7f607c0b3280 legacy=0x7f607c15d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 -- 172.21.15.112:0/2027173398 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607c0ce9e0 con 0x7f607c0cdb00 2024-09-15T23:57:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 -- 172.21.15.112:0/2027173398 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f6070001680 con 0x7f607c0cdb00 2024-09-15T23:57:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 -- 172.21.15.112:0/2027173398 >> v1:172.21.15.112:6789/0 conn(0x7f607c0cdb00 legacy=0x7f607c0b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 --2- 172.21.15.112:0/2027173398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60640039c0 0x7f6064003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 --2- 172.21.15.112:0/2027173398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6064004810 0x7f6064004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 --2- 172.21.15.112:0/2027173398 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60640051d0 0x7f606400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 -- 172.21.15.112:0/2027173398 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f607c0ce700 con 0x7f60640039c0 2024-09-15T23:57:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 -- 172.21.15.112:0/2027173398 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f606400c170 con 0x7f6064004810 2024-09-15T23:57:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.217+0000 7f607a7fc640 1 -- 172.21.15.112:0/2027173398 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f606400c370 con 0x7f60640051d0 2024-09-15T23:57:49.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f607b7fe640 1 --2- 172.21.15.112:0/2027173398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60640039c0 0x7f6064003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f607affd640 1 --2- 172.21.15.112:0/2027173398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6064004810 0x7f6064004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f607b7fe640 1 -- 172.21.15.112:0/2027173398 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60640051d0 msgr2=0x7f606400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:49.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f607b7fe640 1 --2- 172.21.15.112:0/2027173398 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60640051d0 0x7f606400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f607b7fe640 1 -- 172.21.15.112:0/2027173398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6064004810 msgr2=0x7f6064004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:49.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f607b7fe640 1 --2- 172.21.15.112:0/2027173398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6064004810 0x7f6064004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f607b7fe640 1 -- 172.21.15.112:0/2027173398 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6064003530 con 0x7f60640039c0 2024-09-15T23:57:49.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f607bfff640 1 -- 172.21.15.112:0/2027173398 reap_dead start 2024-09-15T23:57:49.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f607affd640 1 --2- 172.21.15.112:0/2027173398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6064004810 0x7f6064004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:49.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f607b7fe640 1 --2- 172.21.15.112:0/2027173398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60640039c0 0x7f6064003de0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f606c001780 tx=0x7f606c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7153e38cafdf077 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f607a7fc640 1 -- 172.21.15.112:0/2027173398 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c0013a0 con 0x7f60640039c0 2024-09-15T23:57:49.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f607a7fc640 1 -- 172.21.15.112:0/2027173398 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606c0052f0 con 0x7f60640039c0 2024-09-15T23:57:49.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f607a7fc640 1 -- 172.21.15.112:0/2027173398 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c003840 con 0x7f60640039c0 2024-09-15T23:57:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f60821bd640 1 -- 172.21.15.112:0/2027173398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60640039c0 msgr2=0x7f6064003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f60821bd640 1 --2- 172.21.15.112:0/2027173398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60640039c0 0x7f6064003de0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f606c001780 tx=0x7f606c01c400 comp rx=0 tx=0).stop 2024-09-15T23:57:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f60821bd640 1 -- 172.21.15.112:0/2027173398 shutdown_connections 2024-09-15T23:57:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f60821bd640 1 --2- 172.21.15.112:0/2027173398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60640039c0 0x7f6064003de0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f60821bd640 1 -- 172.21.15.112:0/2027173398 >> 172.21.15.112:0/2027173398 conn(0x7f607c0b6870 msgr2=0x7f607c0b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f60821bd640 1 -- 172.21.15.112:0/2027173398 shutdown_connections 2024-09-15T23:57:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.221+0000 7f60821bd640 1 -- 172.21.15.112:0/2027173398 wait complete. 2024-09-15T23:57:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f60821bd640 1 Processor -- start 2024-09-15T23:57:49.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f60821bd640 1 -- start start 2024-09-15T23:57:49.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f60821bd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60640039c0 0x7f607c140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f60821bd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f607c1e7c50 0x7f607c1e91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f60821bd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f607c1519b0 0x7f607c154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f60821bd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f607c15e020 con 0x7f60640039c0 2024-09-15T23:57:49.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f60821bd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f607c15a0f0 con 0x7f607c1519b0 2024-09-15T23:57:49.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f60821bd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f607c15e1a0 con 0x7f607c1e7c50 2024-09-15T23:57:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f607b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60640039c0 0x7f607c140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f607b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60640039c0 0x7f607c140ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52382/0 (socket says 172.21.15.112:52382) 2024-09-15T23:57:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f607b7fe640 1 -- 172.21.15.112:0/15802034 learned_addr learned my addr 172.21.15.112:0/15802034 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f607bfff640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f607c1519b0 0x7f607c154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f607affd640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f607c1e7c50 0x7f607c1e91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f607b7fe640 1 -- 172.21.15.112:0/15802034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f607c1e7c50 msgr2=0x7f607c1e91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f607b7fe640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f607c1e7c50 0x7f607c1e91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f607b7fe640 1 -- 172.21.15.112:0/15802034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f607c1519b0 msgr2=0x7f607c154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f607b7fe640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f607c1519b0 0x7f607c154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f607b7fe640 1 -- 172.21.15.112:0/15802034 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607c1e8150 con 0x7f60640039c0 2024-09-15T23:57:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f607bfff640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f607c1519b0 0x7f607c154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f607affd640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f607c1e7c50 0x7f607c1e91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f607b7fe640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60640039c0 0x7f607c140ac0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f606c01c230 tx=0x7f6064005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f6063fff640 1 -- 172.21.15.112:0/15802034 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c007a40 con 0x7f60640039c0 2024-09-15T23:57:49.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f6063fff640 1 -- 172.21.15.112:0/15802034 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606c0ba070 con 0x7f60640039c0 2024-09-15T23:57:49.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f6063fff640 1 -- 172.21.15.112:0/15802034 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c0054a0 con 0x7f60640039c0 2024-09-15T23:57:49.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f60821bd640 1 -- 172.21.15.112:0/15802034 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f607c1e8430 con 0x7f60640039c0 2024-09-15T23:57:49.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f60821bd640 1 -- 172.21.15.112:0/15802034 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f607c1e89f0 con 0x7f60640039c0 2024-09-15T23:57:49.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.225+0000 7f6063fff640 1 -- 172.21.15.112:0/15802034 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f606c007030 con 0x7f60640039c0 2024-09-15T23:57:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6063fff640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f60680678f0 0x7f6068069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6063fff640 1 -- 172.21.15.112:0/15802034 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f606c11fd90 con 0x7f60640039c0 2024-09-15T23:57:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f607affd640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f60680678f0 0x7f6068069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f607affd640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f60680678f0 0x7f6068069db0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6070001ec0 tx=0x7f6070009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 Processor -- start 2024-09-15T23:57:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 -- start start 2024-09-15T23:57:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f115b20 0x55985f115f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f116440 0x55985f0cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f0cc290 0x55985f0cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55985efb3b60 con 0x55985f115b20 2024-09-15T23:57:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55985ef1ac70 con 0x55985f116440 2024-09-15T23:57:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55985eec0ed0 con 0x55985f0cc290 2024-09-15T23:57:49.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f607b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f115b20 0x55985f115f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f607b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f115b20 0x55985f115f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52390/0 (socket says 172.21.15.112:52390) 2024-09-15T23:57:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f607b7fe640 1 -- 172.21.15.112:0/2051452925 learned_addr learned my addr 172.21.15.112:0/2051452925 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f607affd640 1 --2- 172.21.15.112:0/2051452925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f116440 0x55985f0cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f607bfff640 1 --2- 172.21.15.112:0/2051452925 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f0cc290 0x55985f0cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f607b7fe640 1 -- 172.21.15.112:0/2051452925 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f0cc290 msgr2=0x55985f0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f607b7fe640 1 --2- 172.21.15.112:0/2051452925 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f0cc290 0x55985f0cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f607b7fe640 1 -- 172.21.15.112:0/2051452925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f116440 msgr2=0x55985f0cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f607b7fe640 1 --2- 172.21.15.112:0/2051452925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f116440 0x55985f0cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f607b7fe640 1 -- 172.21.15.112:0/2051452925 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55985eed2e50 con 0x55985f115b20 2024-09-15T23:57:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f607b7fe640 1 --2- 172.21.15.112:0/2051452925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f115b20 0x55985f115f00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f606c0f86f0 tx=0x7f606c001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4198b39a1ba857 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f60617fa640 1 -- 172.21.15.112:0/2051452925 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c0effb0 con 0x55985f115b20 2024-09-15T23:57:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f60617fa640 1 -- 172.21.15.112:0/2051452925 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606c0f4360 con 0x55985f115b20 2024-09-15T23:57:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f60617fa640 1 -- 172.21.15.112:0/2051452925 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c0f8c20 con 0x55985f115b20 2024-09-15T23:57:49.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 -- 172.21.15.112:0/2051452925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f115b20 msgr2=0x55985f115f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 --2- 172.21.15.112:0/2051452925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f115b20 0x55985f115f00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f606c0f86f0 tx=0x7f606c001520 comp rx=0 tx=0).stop 2024-09-15T23:57:49.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 -- 172.21.15.112:0/2051452925 shutdown_connections 2024-09-15T23:57:49.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 --2- 172.21.15.112:0/2051452925 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f0cc290 0x55985f0cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 --2- 172.21.15.112:0/2051452925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f116440 0x55985f0cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 --2- 172.21.15.112:0/2051452925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f115b20 0x55985f115f00 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 -- 172.21.15.112:0/2051452925 >> 172.21.15.112:0/2051452925 conn(0x55985f0d2600 msgr2=0x55985f0ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:49.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 -- 172.21.15.112:0/2051452925 shutdown_connections 2024-09-15T23:57:49.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 -- 172.21.15.112:0/2051452925 wait complete. 2024-09-15T23:57:49.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 -- start start 2024-09-15T23:57:49.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.229+0000 7f6085279000 1 Processor -- start 2024-09-15T23:57:49.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f115b20 0x55985f0d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f116440 0x55985f0d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f0d6cf0 0x55985f0d70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55985ef7cb00 con 0x55985f0d6cf0 2024-09-15T23:57:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55985eef5360 con 0x55985f115b20 2024-09-15T23:57:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55985eef22d0 con 0x55985f116440 2024-09-15T23:57:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 10 client.0 _ll_register_callbacks cb 0x55985f0b7820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:57:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f607bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f0d6cf0 0x55985f0d70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f607bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f0d6cf0 0x55985f0d70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52406/0 (socket says 172.21.15.112:52406) 2024-09-15T23:57:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f607bfff640 1 -- 172.21.15.112:0/3831312327 learned_addr learned my addr 172.21.15.112:0/3831312327 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f607b7fe640 1 --2- 172.21.15.112:0/3831312327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f115b20 0x55985f0d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f607bfff640 1 -- 172.21.15.112:0/3831312327 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f116440 msgr2=0x55985f0d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f607affd640 1 --2- 172.21.15.112:0/3831312327 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f116440 0x55985f0d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f607bfff640 1 --2- 172.21.15.112:0/3831312327 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f116440 0x55985f0d11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f607bfff640 1 -- 172.21.15.112:0/3831312327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f115b20 msgr2=0x55985f0d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f607bfff640 1 --2- 172.21.15.112:0/3831312327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f115b20 0x55985f0d0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f607bfff640 1 -- 172.21.15.112:0/3831312327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55985eec1120 con 0x55985f0d6cf0 2024-09-15T23:57:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f607bfff640 1 --2- 172.21.15.112:0/3831312327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f0d6cf0 0x55985f0d70d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f607c06ccf0 tx=0x7f6074008e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c330f56279dcc36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f605a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:57:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f605a7fc640 1 -- 172.21.15.112:0/3831312327 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607401b060 con 0x55985f0d6cf0 2024-09-15T23:57:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f605a7fc640 1 -- 172.21.15.112:0/3831312327 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f6074007b30 con 0x55985f0d6cf0 2024-09-15T23:57:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 -- 172.21.15.112:0/3831312327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f606c0f4360 con 0x55985f0d6cf0 2024-09-15T23:57:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f605a7fc640 1 -- 172.21.15.112:0/3831312327 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f6074021050 con 0x55985f0d6cf0 2024-09-15T23:57:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 10 client.6522 fetch_fsmap learned FSMap version 46 2024-09-15T23:57:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 -- 172.21.15.112:0/3831312327 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x55985eeba450 con 0x55985f0d6cf0 2024-09-15T23:57:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f605a7fc640 1 -- 172.21.15.112:0/3831312327 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606c0f4360 con 0x55985f0d6cf0 2024-09-15T23:57:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f605a7fc640 1 -- 172.21.15.112:0/3831312327 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f6074024020 con 0x55985f0d6cf0 2024-09-15T23:57:49.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 10 client.6522 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T23:57:49.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 10 client.6522 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:57:49.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 20 client.6522 populate_metadata read hostname 'smithi112' 2024-09-15T23:57:49.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 --2- 172.21.15.112:0/3831312327 >> [v2:172.21.15.112:6836/434676840,v1:172.21.15.112:6837/434676840] conn(0x55985f124280 0x55985f126670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 4 client.6522 mds_command: new command op to 6387 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:57:49.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 -- 172.21.15.112:0/3831312327 --> [v2:172.21.15.112:6836/434676840,v1:172.21.15.112:6837/434676840] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55985eeb4c00 con 0x55985f124280 2024-09-15T23:57:49.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f607b7fe640 1 --2- 172.21.15.112:0/3831312327 >> [v2:172.21.15.112:6836/434676840,v1:172.21.15.112:6837/434676840] conn(0x55985f124280 0x55985f126670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f605a7fc640 10 client.6522 ms_handle_connect on v2:172.21.15.112:6836/434676840 2024-09-15T23:57:49.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f607b7fe640 1 --2- 172.21.15.112:0/3831312327 >> [v2:172.21.15.112:6836/434676840,v1:172.21.15.112:6837/434676840] conn(0x55985f124280 0x55985f126670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83489d349b71a0e2 server_cookie=3e5a9ea66561d2e3 in_seq=0 out_seq=0 2024-09-15T23:57:49.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f605a7fc640 1 -- 172.21.15.112:0/3831312327 <== mds.0 v2:172.21.15.112:6836/434676840 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55985eeb4c00 con 0x55985f124280 2024-09-15T23:57:49.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f605a7fc640 10 client.6522 handle_command_reply: tid=0 2024-09-15T23:57:49.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 client.6522 shutdown 2024-09-15T23:57:49.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 -- 172.21.15.112:0/3831312327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f0d6cf0 msgr2=0x55985f0d70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 --2- 172.21.15.112:0/3831312327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f0d6cf0 0x55985f0d70d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f607c06ccf0 tx=0x7f6074008e10 comp rx=0 tx=0).stop 2024-09-15T23:57:49.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 -- 172.21.15.112:0/3831312327 shutdown_connections 2024-09-15T23:57:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 --2- 172.21.15.112:0/3831312327 >> [v2:172.21.15.112:6836/434676840,v1:172.21.15.112:6837/434676840] conn(0x55985f124280 0x55985f126670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 --2- 172.21.15.112:0/3831312327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f0d6cf0 0x55985f0d70d0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 --2- 172.21.15.112:0/3831312327 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f116440 0x55985f0d11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 --2- 172.21.15.112:0/3831312327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f115b20 0x55985f0d0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f605a7fc640 0 client.6522 ms_handle_reset on v2:172.21.15.112:6836/434676840 2024-09-15T23:57:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 -- 172.21.15.112:0/3831312327 >> 172.21.15.112:0/3831312327 conn(0x55985f0cc290 msgr2=0x55985f0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 -- 172.21.15.112:0/3831312327 shutdown_connections 2024-09-15T23:57:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 1 -- 172.21.15.112:0/3831312327 wait complete. 2024-09-15T23:57:49.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.233+0000 7f6085279000 20 client.6522 trim_cache size 0 max 16384 2024-09-15T23:57:49.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 Processor -- start 2024-09-15T23:57:49.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 -- start start 2024-09-15T23:57:49.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f0d6cf0 0x55985f114b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f115b20 0x55985f1150d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f116440 0x55985f126670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f607c201c80 con 0x55985f0d6cf0 2024-09-15T23:57:49.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f607c200fe0 con 0x55985f116440 2024-09-15T23:57:49.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f607c201630 con 0x55985f115b20 2024-09-15T23:57:49.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f607b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f0d6cf0 0x55985f114b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f607b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f0d6cf0 0x55985f114b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52418/0 (socket says 172.21.15.112:52418) 2024-09-15T23:57:49.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f607b7fe640 1 -- 172.21.15.112:0/392887181 learned_addr learned my addr 172.21.15.112:0/392887181 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:49.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f607b7fe640 1 -- 172.21.15.112:0/392887181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f115b20 msgr2=0x55985f1150d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:49.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f607b7fe640 1 --2- 172.21.15.112:0/392887181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f115b20 0x55985f1150d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f607b7fe640 1 -- 172.21.15.112:0/392887181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f116440 msgr2=0x55985f126670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:49.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f607b7fe640 1 --2- 172.21.15.112:0/392887181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f116440 0x55985f126670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f607b7fe640 1 -- 172.21.15.112:0/392887181 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55985eea1fd0 con 0x55985f0d6cf0 2024-09-15T23:57:49.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f607b7fe640 1 --2- 172.21.15.112:0/392887181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f0d6cf0 0x55985f114b90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f606c0eff40 tx=0x7f606c108000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ab6dee1ecfec31 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6060ff9640 1 -- 172.21.15.112:0/392887181 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c0effb0 con 0x55985f0d6cf0 2024-09-15T23:57:49.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6060ff9640 1 -- 172.21.15.112:0/392887181 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606c0f8c20 con 0x55985f0d6cf0 2024-09-15T23:57:49.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6060ff9640 1 -- 172.21.15.112:0/392887181 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c0ee2b0 con 0x55985f0d6cf0 2024-09-15T23:57:49.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 -- 172.21.15.112:0/392887181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f0d6cf0 msgr2=0x55985f114b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 --2- 172.21.15.112:0/392887181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f0d6cf0 0x55985f114b90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f606c0eff40 tx=0x7f606c108000 comp rx=0 tx=0).stop 2024-09-15T23:57:49.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 -- 172.21.15.112:0/392887181 shutdown_connections 2024-09-15T23:57:49.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 --2- 172.21.15.112:0/392887181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f116440 0x55985f126670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 --2- 172.21.15.112:0/392887181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f115b20 0x55985f1150d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 --2- 172.21.15.112:0/392887181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f0d6cf0 0x55985f114b90 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 -- 172.21.15.112:0/392887181 >> 172.21.15.112:0/392887181 conn(0x55985f0cc290 msgr2=0x55985f0d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:49.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 -- 172.21.15.112:0/392887181 shutdown_connections 2024-09-15T23:57:49.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 -- 172.21.15.112:0/392887181 wait complete. 2024-09-15T23:57:49.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 -- start start 2024-09-15T23:57:49.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.253+0000 7f6085279000 1 Processor -- start 2024-09-15T23:57:49.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f0d6cf0 0x55985f129320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f115b20 0x55985f129860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f116440 0x55985f144960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55985ef19f80 con 0x55985f116440 2024-09-15T23:57:49.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55985eed2ca0 con 0x55985f0d6cf0 2024-09-15T23:57:49.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55985ef1f2a0 con 0x55985f115b20 2024-09-15T23:57:49.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 10 client.0 _ll_register_callbacks cb 0x7f6074008610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:57:49.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f607bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f116440 0x55985f144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f607bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f116440 0x55985f144960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52420/0 (socket says 172.21.15.112:52420) 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f607bfff640 1 -- 172.21.15.112:0/398047780 learned_addr learned my addr 172.21.15.112:0/398047780 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f607b7fe640 1 --2- 172.21.15.112:0/398047780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f0d6cf0 0x55985f129320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f607bfff640 1 -- 172.21.15.112:0/398047780 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f115b20 msgr2=0x55985f129860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f607bfff640 1 --2- 172.21.15.112:0/398047780 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f115b20 0x55985f129860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f607bfff640 1 -- 172.21.15.112:0/398047780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f0d6cf0 msgr2=0x55985f129320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f607bfff640 1 --2- 172.21.15.112:0/398047780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f0d6cf0 0x55985f129320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f607bfff640 1 -- 172.21.15.112:0/398047780 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55985ef9d750 con 0x55985f116440 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f607b7fe640 1 --2- 172.21.15.112:0/398047780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f0d6cf0 0x55985f129320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f607bfff640 1 --2- 172.21.15.112:0/398047780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f116440 0x55985f144960 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6074000f90 tx=0x7f6074004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c1e247f4d99e34 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f605a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f605a7fc640 1 -- 172.21.15.112:0/398047780 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074007c80 con 0x55985f116440 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f605a7fc640 1 -- 172.21.15.112:0/398047780 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f60740093f0 con 0x55985f116440 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 -- 172.21.15.112:0/398047780 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f606c0f8c20 con 0x55985f116440 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f605a7fc640 1 -- 172.21.15.112:0/398047780 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f6074017b10 con 0x55985f116440 2024-09-15T23:57:49.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 10 client.6528 fetch_fsmap learned FSMap version 46 2024-09-15T23:57:49.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 -- 172.21.15.112:0/398047780 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x55985eea8a30 con 0x55985f116440 2024-09-15T23:57:49.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f605a7fc640 1 -- 172.21.15.112:0/398047780 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606c0f8c20 con 0x55985f116440 2024-09-15T23:57:49.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f605a7fc640 1 -- 172.21.15.112:0/398047780 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f6074024070 con 0x55985f116440 2024-09-15T23:57:49.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 10 client.6528 fetch_fsmap finished waiting for FSMap version 46 2024-09-15T23:57:49.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 10 client.6528 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:57:49.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 20 client.6528 populate_metadata read hostname 'smithi112' 2024-09-15T23:57:49.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 --2- 172.21.15.112:0/398047780 >> [v2:172.21.15.112:6836/434676840,v1:172.21.15.112:6837/434676840] conn(0x55985f188c00 0x55985f188fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 4 client.6528 mds_command: new command op to 6387 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:57:49.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 -- 172.21.15.112:0/398047780 --> [v2:172.21.15.112:6836/434676840,v1:172.21.15.112:6837/434676840] -- command(tid 0: {"prefix": "status"}) -- 0x55985ef283a0 con 0x55985f188c00 2024-09-15T23:57:49.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f607b7fe640 1 --2- 172.21.15.112:0/398047780 >> [v2:172.21.15.112:6836/434676840,v1:172.21.15.112:6837/434676840] conn(0x55985f188c00 0x55985f188fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f605a7fc640 10 client.6528 ms_handle_connect on v2:172.21.15.112:6836/434676840 2024-09-15T23:57:49.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f607b7fe640 1 --2- 172.21.15.112:0/398047780 >> [v2:172.21.15.112:6836/434676840,v1:172.21.15.112:6837/434676840] conn(0x55985f188c00 0x55985f188fe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9634a3995af13c7d server_cookie=a642f6b6d39d6bfc in_seq=0 out_seq=0 2024-09-15T23:57:49.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f605a7fc640 1 -- 172.21.15.112:0/398047780 <== mds.0 v2:172.21.15.112:6836/434676840 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55985ef283a0 con 0x55985f188c00 2024-09-15T23:57:49.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f605a7fc640 10 client.6528 handle_command_reply: tid=0 2024-09-15T23:57:49.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 client.6528 shutdown 2024-09-15T23:57:49.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 -- 172.21.15.112:0/398047780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f116440 msgr2=0x55985f144960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 --2- 172.21.15.112:0/398047780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f116440 0x55985f144960 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6074000f90 tx=0x7f6074004ac0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 -- 172.21.15.112:0/398047780 shutdown_connections 2024-09-15T23:57:49.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 --2- 172.21.15.112:0/398047780 >> [v2:172.21.15.112:6836/434676840,v1:172.21.15.112:6837/434676840] conn(0x55985f188c00 0x55985f188fe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 --2- 172.21.15.112:0/398047780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55985f116440 0x55985f144960 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f605a7fc640 0 client.6528 ms_handle_reset on v2:172.21.15.112:6836/434676840 2024-09-15T23:57:49.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 --2- 172.21.15.112:0/398047780 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55985f115b20 0x55985f129860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 --2- 172.21.15.112:0/398047780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55985f0d6cf0 0x55985f129320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 -- 172.21.15.112:0/398047780 >> 172.21.15.112:0/398047780 conn(0x55985f0cc290 msgr2=0x55985f0d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:49.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 -- 172.21.15.112:0/398047780 shutdown_connections 2024-09-15T23:57:49.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 1 -- 172.21.15.112:0/398047780 wait complete. 2024-09-15T23:57:49.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f6085279000 20 client.6528 trim_cache size 0 max 16384 2024-09-15T23:57:49.265 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:57:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "1af6b673-4d40-4109-af4e-78662faa7df8", 2024-09-15T23:57:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-15T23:57:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 6387, 2024-09-15T23:57:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-15T23:57:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-15T23:57:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-15T23:57:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 5.6935606270000001, 2024-09-15T23:57:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 46, 2024-09-15T23:57:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 86, 2024-09-15T23:57:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 86, 2024-09-15T23:57:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 10.708709519999999 2024-09-15T23:57:49.265 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:57:49.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f60821bd640 1 -- 172.21.15.112:0/15802034 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f60680678f0 msgr2=0x7f6068069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f60821bd640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f60680678f0 0x7f6068069db0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6070001ec0 tx=0x7f6070009040 comp rx=0 tx=0).stop 2024-09-15T23:57:49.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f60821bd640 1 -- 172.21.15.112:0/15802034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60640039c0 msgr2=0x7f607c140ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f60821bd640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60640039c0 0x7f607c140ac0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f606c01c230 tx=0x7f6064005840 comp rx=0 tx=0).stop 2024-09-15T23:57:49.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f60821bd640 1 -- 172.21.15.112:0/15802034 shutdown_connections 2024-09-15T23:57:49.266 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f60821bd640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f60680678f0 0x7f6068069db0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f60821bd640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f607c1519b0 0x7f607c154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f60821bd640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f607c1e7c50 0x7f607c1e91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f60821bd640 1 --2- 172.21.15.112:0/15802034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60640039c0 0x7f607c140ac0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f60821bd640 1 -- 172.21.15.112:0/15802034 >> 172.21.15.112:0/15802034 conn(0x7f607c0b6870 msgr2=0x7f607c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:49.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f60821bd640 1 -- 172.21.15.112:0/15802034 shutdown_connections 2024-09-15T23:57:49.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.257+0000 7f60821bd640 1 -- 172.21.15.112:0/15802034 wait complete. 2024-09-15T23:57:49.274 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:57:49.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.377+0000 7fdcd87b3640 1 Processor -- start 2024-09-15T23:57:49.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.377+0000 7fdcd87b3640 1 -- start start 2024-09-15T23:57:49.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd87b3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcd0161a60 0x7fdcd00d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd87b3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdcd00cf620 0x7fdcd006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd87b3640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcd00d32b0 con 0x7fdcd00d2e90 2024-09-15T23:57:49.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd87b3640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdcd00d0300 con 0x7fdcd00cf620 2024-09-15T23:57:49.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd87b3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd00b0f60 con 0x7fdcd0161a60 2024-09-15T23:57:49.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd6d50640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdcd00cf620 0x7fdcd006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd6d50640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdcd00cf620 0x7fdcd006d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52426/0 (socket says 172.21.15.112:52426) 2024-09-15T23:57:49.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd6d50640 1 -- 172.21.15.112:0/1101483274 learned_addr learned my addr 172.21.15.112:0/1101483274 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:49.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd654f640 1 --2- 172.21.15.112:0/1101483274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcd0161a60 0x7fdcd00d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd6d50640 1 -- 172.21.15.112:0/1101483274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcd0161a60 msgr2=0x7fdcd00d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:49.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd6d50640 1 --2- 172.21.15.112:0/1101483274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcd0161a60 0x7fdcd00d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd6d50640 1 -- 172.21.15.112:0/1101483274 >> v1:172.21.15.112:6789/0 conn(0x7fdcd00d2e90 legacy=0x7fdcd00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.382 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd6d50640 1 -- 172.21.15.112:0/1101483274 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd00cfad0 con 0x7fdcd00cf620 2024-09-15T23:57:49.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd6d50640 1 --2- 172.21.15.112:0/1101483274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd00cf620 0x7fdcd006d6b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009870 tx=0x7fdccc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1bff4b93bbabfb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd554d640 1 -- 172.21.15.112:0/1101483274 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdccc0aa600 con 0x7fdcd00cf620 2024-09-15T23:57:49.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd554d640 1 -- 172.21.15.112:0/1101483274 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdccc0af070 con 0x7fdcd00cf620 2024-09-15T23:57:49.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.381+0000 7fdcd554d640 1 -- 172.21.15.112:0/1101483274 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdccc0aa9c0 con 0x7fdcd00cf620 2024-09-15T23:57:49.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1101483274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd00cf620 msgr2=0x7fdcd006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 --2- 172.21.15.112:0/1101483274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd00cf620 0x7fdcd006d6b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009870 tx=0x7fdccc01c4a0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1101483274 shutdown_connections 2024-09-15T23:57:49.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 --2- 172.21.15.112:0/1101483274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd00cf620 0x7fdcd006d6b0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 --2- 172.21.15.112:0/1101483274 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcd0161a60 0x7fdcd00d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1101483274 >> 172.21.15.112:0/1101483274 conn(0x7fdcd008bf90 msgr2=0x7fdcd009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:49.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1101483274 shutdown_connections 2024-09-15T23:57:49.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1101483274 wait complete. 2024-09-15T23:57:49.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 Processor -- start 2024-09-15T23:57:49.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 -- start start 2024-09-15T23:57:49.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcd00cf620 0x7fdcd00a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd00d2e90 0x7fdcd00b9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcd0161a60 0x7fdcd00b98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd006e400 con 0x7fdcd00d2e90 2024-09-15T23:57:49.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd006d190 con 0x7fdcd00cf620 2024-09-15T23:57:49.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd006e580 con 0x7fdcd0161a60 2024-09-15T23:57:49.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd5d4e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd00d2e90 0x7fdcd00b9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd5d4e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd00d2e90 0x7fdcd00b9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52440/0 (socket says 172.21.15.112:52440) 2024-09-15T23:57:49.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd5d4e640 1 -- 172.21.15.112:0/1309059072 learned_addr learned my addr 172.21.15.112:0/1309059072 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd654f640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcd00cf620 0x7fdcd00a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd6d50640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcd0161a60 0x7fdcd00b98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd5d4e640 1 -- 172.21.15.112:0/1309059072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcd0161a60 msgr2=0x7fdcd00b98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd5d4e640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcd0161a60 0x7fdcd00b98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd5d4e640 1 -- 172.21.15.112:0/1309059072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcd00cf620 msgr2=0x7fdcd00a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd5d4e640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcd00cf620 0x7fdcd00a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd5d4e640 1 -- 172.21.15.112:0/1309059072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd00ce850 con 0x7fdcd00d2e90 2024-09-15T23:57:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd6d50640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcd0161a60 0x7fdcd00b98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd654f640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcd00cf620 0x7fdcd00a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:57:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd5d4e640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd00d2e90 0x7fdcd00b9370 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400c430 tx=0x7fdcc400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcc2ffd640 1 -- 172.21.15.112:0/1309059072 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40052d0 con 0x7fdcd00d2e90 2024-09-15T23:57:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcc2ffd640 1 -- 172.21.15.112:0/1309059072 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc4005470 con 0x7fdcd00d2e90 2024-09-15T23:57:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1309059072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd00ccf50 con 0x7fdcd00d2e90 2024-09-15T23:57:49.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcc2ffd640 1 -- 172.21.15.112:0/1309059072 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4007260 con 0x7fdcd00d2e90 2024-09-15T23:57:49.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.385+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1309059072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd01faad0 con 0x7fdcd00d2e90 2024-09-15T23:57:49.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.389+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1309059072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcd006d6b0 con 0x7fdcd00d2e90 2024-09-15T23:57:49.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.389+0000 7fdcc2ffd640 1 -- 172.21.15.112:0/1309059072 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdcc4007400 con 0x7fdcd00d2e90 2024-09-15T23:57:49.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.389+0000 7fdcc2ffd640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdcb40678c0 0x7fdcb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.389+0000 7fdcc2ffd640 1 -- 172.21.15.112:0/1309059072 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fdcc4085370 con 0x7fdcd00d2e90 2024-09-15T23:57:49.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.389+0000 7fdcd654f640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdcb40678c0 0x7fdcb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.389+0000 7fdcd654f640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdcb40678c0 0x7fdcb4069d80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8003fd0 tx=0x7fdcc8003a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.393+0000 7fdcc2ffd640 1 -- 172.21.15.112:0/1309059072 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdcc4055d20 con 0x7fdcd00d2e90 2024-09-15T23:57:49.514 INFO:tasks.ceph.mds.a.smithi112.stderr:2024-09-15T23:57:49.513+0000 7f057f180640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:57:49.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.573+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1309059072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdcd00b4970 con 0x7fdcd00d2e90 2024-09-15T23:57:49.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.573+0000 7fdcc2ffd640 1 -- 172.21.15.112:0/1309059072 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) ==== 53+0+73 (secure 0 0 0) 0x7fdcc4055620 con 0x7fdcd00d2e90 2024-09-15T23:57:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:57:49.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.577+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1309059072 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdcb40678c0 msgr2=0x7fdcb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.577+0000 7fdcd87b3640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdcb40678c0 0x7fdcb4069d80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8003fd0 tx=0x7fdcc8003a00 comp rx=0 tx=0).stop 2024-09-15T23:57:49.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.577+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1309059072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd00d2e90 msgr2=0x7fdcd00b9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.577+0000 7fdcd87b3640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd00d2e90 0x7fdcd00b9370 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400c430 tx=0x7fdcc400c8f0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.577+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1309059072 shutdown_connections 2024-09-15T23:57:49.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.577+0000 7fdcd87b3640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdcb40678c0 0x7fdcb4069d80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.577+0000 7fdcd87b3640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcd0161a60 0x7fdcd00b98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.577+0000 7fdcd87b3640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd00d2e90 0x7fdcd00b9370 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.577+0000 7fdcd87b3640 1 --2- 172.21.15.112:0/1309059072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcd00cf620 0x7fdcd00a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.577+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1309059072 >> 172.21.15.112:0/1309059072 conn(0x7fdcd008bf90 msgr2=0x7fdcd00b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:49.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.577+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1309059072 shutdown_connections 2024-09-15T23:57:49.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49.577+0000 7fdcd87b3640 1 -- 172.21.15.112:0/1309059072 wait complete. 2024-09-15T23:57:49.592 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:57:49.592 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:57:49.592 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-15T23:57:49.592 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:57:49.592 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:49.592 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:57:49.592 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:57:49.592 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:57:49.592 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:57:49.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:49.593 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-15T23:57:49.598 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:57:49.598 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:57:49.598 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:57:49.598 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:49.598 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-15T23:57:49.598 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:49.598 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:57:49.598 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:49.598 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-15T23:57:49.598 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:57:49.598 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:49.598 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42227sec preferred_lft 42227sec 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:5c:cd:1e:d6 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:49.599 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:57:49.600 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:49.600 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T23:57:49.600 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:49.600 INFO:teuthology.orchestra.run.smithi112.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:57:49.600 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:49.600 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T23:57:49.600 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:49.600 INFO:teuthology.orchestra.run.smithi112.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:57:49.600 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:57:49.600 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T23:57:49.600 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:49.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:49.601 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:57:49.650 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-15T23:57:49.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:49.652 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-15T23:57:49.703 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-15T23:57:49.703 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:57:49.703 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T23:57:49.703 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:57:49.703 INFO:teuthology.orchestra.run.smithi112.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T23:57:49.703 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T23:57:49.703 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:57:49.703 INFO:teuthology.orchestra.run.smithi112.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:57:49.703 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:57:49.703 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:57:49.703 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:57:49.704 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:57:49.704 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:57:49.704 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:57:49.704 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:57:49.704 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:57:49.704 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:57:49.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:57:49.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:57:49.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:49.819 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-15T23:57:49.865 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:57:49.865 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:57:49.865 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:57:49.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:49.865 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-15T23:57:49.924 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T23:57:49.924 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:57:49.924 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:49.973 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:57:49.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:57:49.973 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:50.020 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:57:50.077 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:57:50.125 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:57:50.126 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:57:50.126 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:57:50.126 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:57:50.126 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:57:50.126 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:57:50.126 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:57:50.126 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:57:50.126 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:57:50.126 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:57:50.126 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:57:50.126 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:57:50.126 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:57:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:57:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:57:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:57:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:57:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:57:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:57:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:57:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:57:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:57:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:57:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:57:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:57:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:57:50.127 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:57:50.128 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:57:50.128 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:57:50.128 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:50.128 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:50.128 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:57:50.128 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:57:50.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:50.130 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:57:50.177 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:57:50.177 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T23:57:50.222 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:57:50.237 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:57:50.286 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:57:50.286 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:57:50.286 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:57:50.286 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:57:50.286 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:57:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:57:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:57:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:57:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:57:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:57:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:57:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:57:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:57:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:57:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:57:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:57:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:57:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:57:50.287 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:57:50.288 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:57:50.288 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:57:50.288 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:57:50.288 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:57:50.288 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:57:50.288 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:57:50.288 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:57:50.288 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:57:50.288 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:57:50.288 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:57:50.288 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:50.288 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:50.289 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:57:50.289 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:57:50.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:50.289 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:57:50.302 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:2024-09-15T23:57:50.301+0000 7fa2fc699580 -1 init, newargv = 0x55d41c75b790 newargc=15 2024-09-15T23:57:50.302 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[43517]: starting ceph client 2024-09-15T23:57:50.308 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[43517]: starting fuse 2024-09-15T23:57:51.408 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:57:51.423 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:57:51.471 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:57:51.471 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:57:51.472 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:57:51.472 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:57:51.472 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:57:51.472 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:57:51.472 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:57:51.472 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:57:51.472 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:57:51.472 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:57:51.472 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:57:51.472 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:57:51.472 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:57:51.472 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:57:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:57:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:57:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:57:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:57:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:57:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:57:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:57:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:57:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:57:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:57:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:57:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:57:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:57:51.473 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:57:51.474 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:57:51.474 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:51.474 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:51.474 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:57:51.474 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:57:51.474 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:51.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:51.475 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:57:51.520 INFO:teuthology.orchestra.run.smithi112.stdout:45 2024-09-15T23:57:51.521 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T23:57:51.521 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:57:51.521 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2024-09-15T23:57:51.521 DEBUG:teuthology.orchestra.run.smithi112:> import re 2024-09-15T23:57:51.521 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:57:51.521 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-15T23:57:51.521 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:51.521 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2024-09-15T23:57:51.522 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2024-09-15T23:57:51.523 DEBUG:teuthology.orchestra.run.smithi112:> return f 2024-09-15T23:57:51.523 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:57:51.523 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:57:51.523 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.0")) 2024-09-15T23:57:51.523 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:57:51.647 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.0.43517.asok 2024-09-15T23:57:51.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:57:51.659 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43517.asok 2024-09-15T23:57:51.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:51.659 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43517.asok status 2024-09-15T23:57:51.807 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:57:51.807 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2024-09-15T23:57:51.807 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:57:51.807 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:57:51.807 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "0", 2024-09-15T23:57:51.807 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2024-09-15T23:57:51.807 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:57:51.808 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "43517", 2024-09-15T23:57:51.808 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2024-09-15T23:57:51.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:51.808 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2024-09-15T23:57:51.808 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2024-09-15T23:57:51.808 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 6543, 2024-09-15T23:57:51.808 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2024-09-15T23:57:51.808 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2024-09-15T23:57:51.808 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2024-09-15T23:57:51.808 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 6543 2024-09-15T23:57:51.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:51.809 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:57:51.809 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:57:51.809 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:57:51.809 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1762269508 2024-09-15T23:57:51.809 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:51.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:51.809 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:57:51.809 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:57:51.809 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:57:51.809 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1762269508 2024-09-15T23:57:51.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:51.809 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.6543 192.168.0.1:0/1762269508", 2024-09-15T23:57:51.810 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.1:0/1762269508", 2024-09-15T23:57:51.810 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2024-09-15T23:57:51.810 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 46, 2024-09-15T23:57:51.810 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 86, 2024-09-15T23:57:51.810 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:57:51.810 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2024-09-15T23:57:51.810 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2024-09-15T23:57:51.810 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:57:51.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:51.821 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2024-09-15T23:57:51.821 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:51.827 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2024-09-15T23:57:51.827 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:51.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:51.827 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:51.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:51.881 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch fancy_layout_file) 2024-09-15T23:57:51.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:51.938 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout -v 'stripe_unit=1048576 stripe_count=4 object_size=8388608' fancy_layout_file) 2024-09-15T23:57:51.993 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:57:51.994 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:52.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:52.041 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=fancy_layout_file bs=1M conv=fdatasync count=35 seek=0) 2024-09-15T23:57:52.428 INFO:teuthology.orchestra.run.smithi112.stderr:35+0 records in 2024-09-15T23:57:52.428 INFO:teuthology.orchestra.run.smithi112.stderr:35+0 records out 2024-09-15T23:57:52.429 INFO:teuthology.orchestra.run.smithi112.stderr:36700160 bytes (37 MB, 35 MiB) copied, 0.331645 s, 111 MB/s 2024-09-15T23:57:52.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:52.430 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f fancy_layout_file) 2024-09-15T23:57:52.442 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:52.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6c56d7640 1 Processor -- start 2024-09-15T23:57:52.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6c56d7640 1 -- start start 2024-09-15T23:57:52.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6c56d7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6c0067e30 0x7fa6c0161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:52.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6c56d7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa6c01623e0 0x7fa6c00b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:52.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6c56d7640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c00afbb0 con 0x7fa6c015e260 2024-09-15T23:57:52.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6c56d7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa6c0162830 con 0x7fa6c01623e0 2024-09-15T23:57:52.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6c56d7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c00b0700 con 0x7fa6c0067e30 2024-09-15T23:57:52.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6beffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa6c015e260 0x7fa6c00afff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52232/0 (socket says 172.21.15.112:52232) 2024-09-15T23:57:52.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6beffd640 1 -- 172.21.15.112:0/1957219434 learned_addr learned my addr 172.21.15.112:0/1957219434 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:52.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6b7fff640 1 --2- 172.21.15.112:0/1957219434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6c0067e30 0x7fa6c0161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:52.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6bf7fe640 1 --2- 172.21.15.112:0/1957219434 >> v2:172.21.15.169:3300/0 conn(0x7fa6c01623e0 0x7fa6c00b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:52.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 -- 172.21.15.112:0/1957219434 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772772503 0 0) 0x7fa6c00afbb0 con 0x7fa6c015e260 2024-09-15T23:57:52.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 -- 172.21.15.112:0/1957219434 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6a0003530 con 0x7fa6c015e260 2024-09-15T23:57:52.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 -- 172.21.15.112:0/1957219434 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3440979830 0 0) 0x7fa6a0003530 con 0x7fa6c015e260 2024-09-15T23:57:52.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 -- 172.21.15.112:0/1957219434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6c0067e30 msgr2=0x7fa6c0161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:52.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 --2- 172.21.15.112:0/1957219434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6c0067e30 0x7fa6c0161ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 -- 172.21.15.112:0/1957219434 >> v2:172.21.15.169:3300/0 conn(0x7fa6c01623e0 msgr2=0x7fa6c00b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:52.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 --2- 172.21.15.112:0/1957219434 >> v2:172.21.15.169:3300/0 conn(0x7fa6c01623e0 0x7fa6c00b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 -- 172.21.15.112:0/1957219434 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c00af310 con 0x7fa6c015e260 2024-09-15T23:57:52.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 -- 172.21.15.112:0/1957219434 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fa6b0001680 con 0x7fa6c015e260 2024-09-15T23:57:52.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 -- 172.21.15.112:0/1957219434 >> v1:172.21.15.112:6789/0 conn(0x7fa6c015e260 legacy=0x7fa6c00afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:52.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 --2- 172.21.15.112:0/1957219434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6a00039c0 0x7fa6a0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:52.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 --2- 172.21.15.112:0/1957219434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6a0004810 0x7fa6a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:52.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 --2- 172.21.15.112:0/1957219434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6a00051d0 0x7fa6a000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:52.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 -- 172.21.15.112:0/1957219434 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c0162830 con 0x7fa6a0004810 2024-09-15T23:57:52.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 -- 172.21.15.112:0/1957219434 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c00b0700 con 0x7fa6a00039c0 2024-09-15T23:57:52.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6be7fc640 1 -- 172.21.15.112:0/1957219434 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a000bf40 con 0x7fa6a00051d0 2024-09-15T23:57:52.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6b7fff640 1 --2- 172.21.15.112:0/1957219434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6c0067e30 0x7fa6c0161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:57:52.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6b7fff640 1 --2- 172.21.15.112:0/1957219434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6a0004810 0x7fa6a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:52.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6bf7fe640 1 --2- 172.21.15.112:0/1957219434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6a00051d0 0x7fa6a000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:52.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6b7fff640 1 -- 172.21.15.112:0/1957219434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6a00051d0 msgr2=0x7fa6a000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:52.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6b7fff640 1 --2- 172.21.15.112:0/1957219434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6a00051d0 0x7fa6a000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6b7fff640 1 -- 172.21.15.112:0/1957219434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6a00039c0 msgr2=0x7fa6a0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:52.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6beffd640 1 --2- 172.21.15.112:0/1957219434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6a00039c0 0x7fa6a0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:52.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6b7fff640 1 --2- 172.21.15.112:0/1957219434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6a00039c0 0x7fa6a0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6b7fff640 1 -- 172.21.15.112:0/1957219434 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a0003530 con 0x7fa6a0004810 2024-09-15T23:57:52.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.609+0000 7fa6beffd640 1 --2- 172.21.15.112:0/1957219434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6a00039c0 0x7fa6a0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:52.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.613+0000 7fa6b7fff640 1 --2- 172.21.15.112:0/1957219434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6a0004810 0x7fa6a0004c90 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00adc50 tx=0x7fa6a801c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f02bd711dd746b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.613+0000 7fa6be7fc640 1 -- 172.21.15.112:0/1957219434 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a800f040 con 0x7fa6a0004810 2024-09-15T23:57:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.613+0000 7fa6be7fc640 1 -- 172.21.15.112:0/1957219434 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a80b0070 con 0x7fa6a0004810 2024-09-15T23:57:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.613+0000 7fa6be7fc640 1 -- 172.21.15.112:0/1957219434 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80ab820 con 0x7fa6a0004810 2024-09-15T23:57:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.613+0000 7fa6c56d7640 1 -- 172.21.15.112:0/1957219434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6a0004810 msgr2=0x7fa6a0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.613+0000 7fa6c56d7640 1 --2- 172.21.15.112:0/1957219434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6a0004810 0x7fa6a0004c90 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00adc50 tx=0x7fa6a801c350 comp rx=0 tx=0).stop 2024-09-15T23:57:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.613+0000 7fa6bf7fe640 1 -- 172.21.15.112:0/1957219434 reap_dead start 2024-09-15T23:57:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.613+0000 7fa6c56d7640 1 -- 172.21.15.112:0/1957219434 shutdown_connections 2024-09-15T23:57:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.613+0000 7fa6c56d7640 1 -- 172.21.15.112:0/1957219434 >> 172.21.15.112:0/1957219434 conn(0x7fa6c0073580 msgr2=0x7fa6c006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.613+0000 7fa6c56d7640 1 -- 172.21.15.112:0/1957219434 shutdown_connections 2024-09-15T23:57:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.613+0000 7fa6c56d7640 1 -- 172.21.15.112:0/1957219434 wait complete. 2024-09-15T23:57:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.613+0000 7fa6c56d7640 1 Processor -- start 2024-09-15T23:57:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.613+0000 7fa6c56d7640 1 -- start start 2024-09-15T23:57:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6c56d7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6a0004810 0x7fa6c01f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6c56d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c00b41c0 0x7fa6c00b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6c56d7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6c00b54e0 0x7fa6c00cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6c56d7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c015f650 con 0x7fa6c00b41c0 2024-09-15T23:57:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6c56d7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c00af8d0 con 0x7fa6c00b54e0 2024-09-15T23:57:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6c56d7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c0161ea0 con 0x7fa6a0004810 2024-09-15T23:57:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c00b41c0 0x7fa6c00b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c00b41c0 0x7fa6c00b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52464/0 (socket says 172.21.15.112:52464) 2024-09-15T23:57:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b7fff640 1 -- 172.21.15.112:0/3125611043 learned_addr learned my addr 172.21.15.112:0/3125611043 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b7fff640 1 -- 172.21.15.112:0/3125611043 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6a0004810 msgr2=0x7fa6c01f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b7fff640 1 --2- 172.21.15.112:0/3125611043 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6a0004810 0x7fa6c01f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6bf7fe640 1 --2- 172.21.15.112:0/3125611043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6c00b54e0 0x7fa6c00cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b7fff640 1 -- 172.21.15.112:0/3125611043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6c00b54e0 msgr2=0x7fa6c00cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b7fff640 1 --2- 172.21.15.112:0/3125611043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6c00b54e0 0x7fa6c00cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b7fff640 1 -- 172.21.15.112:0/3125611043 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c00b59c0 con 0x7fa6c00b41c0 2024-09-15T23:57:52.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b7fff640 1 --2- 172.21.15.112:0/3125611043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c00b41c0 0x7fa6c00b4fa0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80ad040 tx=0x7fa6a0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:52.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b77fe640 1 -- 172.21.15.112:0/3125611043 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8004220 con 0x7fa6c00b41c0 2024-09-15T23:57:52.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b77fe640 1 -- 172.21.15.112:0/3125611043 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a80043e0 con 0x7fa6c00b41c0 2024-09-15T23:57:52.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6c56d7640 1 -- 172.21.15.112:0/3125611043 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c0156b40 con 0x7fa6c00b41c0 2024-09-15T23:57:52.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b77fe640 1 -- 172.21.15.112:0/3125611043 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80b5880 con 0x7fa6c00b41c0 2024-09-15T23:57:52.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6c56d7640 1 -- 172.21.15.112:0/3125611043 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c0157100 con 0x7fa6c00b41c0 2024-09-15T23:57:52.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6c56d7640 1 -- 172.21.15.112:0/3125611043 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c00afff0 con 0x7fa6c00b41c0 2024-09-15T23:57:52.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b77fe640 1 -- 172.21.15.112:0/3125611043 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa6a80c6060 con 0x7fa6c00b41c0 2024-09-15T23:57:52.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b77fe640 1 --2- 172.21.15.112:0/3125611043 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6a40678c0 0x7fa6a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:52.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6b77fe640 1 -- 172.21.15.112:0/3125611043 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fa6a811fdb0 con 0x7fa6c00b41c0 2024-09-15T23:57:52.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6beffd640 1 --2- 172.21.15.112:0/3125611043 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6a40678c0 0x7fa6a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:52.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.617+0000 7fa6beffd640 1 --2- 172.21.15.112:0/3125611043 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6a40678c0 0x7fa6a4069d80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0004880 tx=0x7fa6b0000f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:52.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.621+0000 7fa6b77fe640 1 -- 172.21.15.112:0/3125611043 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa6a80ba070 con 0x7fa6c00b41c0 2024-09-15T23:57:52.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.817+0000 7fa6c56d7640 1 -- 172.21.15.112:0/3125611043 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6c0070ee0 con 0x7fa6c00b41c0 2024-09-15T23:57:52.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.817+0000 7fa6b77fe640 1 -- 172.21.15.112:0/3125611043 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5234 (secure 0 0 0) 0x7fa6a80160c0 con 0x7fa6c00b41c0 2024-09-15T23:57:52.820 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:52.820 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":46,"btime":"2024-09-15T23:57:46:581351+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1475104986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1475104986},{"type":"v1","addr":"172.21.15.169:6835","nonce":1475104986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2253954019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2253954019},{"type":"v1","addr":"172.21.15.169:6834","nonce":2253954019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1645054566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1645054566},{"type":"v1","addr":"172.21.15.112:6835","nonce":1645054566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:42.896416+0000","modified":"2024-09-15T23:57:45.943939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6387":{"gid":6387,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/434676840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":434676840},{"type":"v1","addr":"172.21.15.112:6837","nonce":434676840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6387,"qdb_cluster":[6387]},"id":6}]} 2024-09-15T23:57:52.820 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 46 2024-09-15T23:57:52.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.821+0000 7fa6c56d7640 1 -- 172.21.15.112:0/3125611043 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6a40678c0 msgr2=0x7fa6a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:52.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.821+0000 7fa6c56d7640 1 --2- 172.21.15.112:0/3125611043 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6a40678c0 0x7fa6a4069d80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0004880 tx=0x7fa6b0000f90 comp rx=0 tx=0).stop 2024-09-15T23:57:52.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.821+0000 7fa6c56d7640 1 -- 172.21.15.112:0/3125611043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c00b41c0 msgr2=0x7fa6c00b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:52.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.821+0000 7fa6c56d7640 1 --2- 172.21.15.112:0/3125611043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c00b41c0 0x7fa6c00b4fa0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80ad040 tx=0x7fa6a0005840 comp rx=0 tx=0).stop 2024-09-15T23:57:52.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.821+0000 7fa6c56d7640 1 -- 172.21.15.112:0/3125611043 shutdown_connections 2024-09-15T23:57:52.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.821+0000 7fa6c56d7640 1 --2- 172.21.15.112:0/3125611043 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa6a40678c0 0x7fa6a4069d80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.821+0000 7fa6c56d7640 1 --2- 172.21.15.112:0/3125611043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6c00b54e0 0x7fa6c00cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.821+0000 7fa6c56d7640 1 --2- 172.21.15.112:0/3125611043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6c00b41c0 0x7fa6c00b4fa0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.821+0000 7fa6c56d7640 1 --2- 172.21.15.112:0/3125611043 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6a0004810 0x7fa6c01f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.821+0000 7fa6c56d7640 1 -- 172.21.15.112:0/3125611043 >> 172.21.15.112:0/3125611043 conn(0x7fa6c0073580 msgr2=0x7fa6c006ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:52.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.821+0000 7fa6c56d7640 1 -- 172.21.15.112:0/3125611043 shutdown_connections 2024-09-15T23:57:52.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:52.821+0000 7fa6c56d7640 1 -- 172.21.15.112:0/3125611043 wait complete. 2024-09-15T23:57:52.839 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-15T23:57:52.996 INFO:teuthology.orchestra.run.smithi112.stdout:{"message":"","return_code":0} 2024-09-15T23:57:52.997 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-15T23:57:52.997 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2024-09-15T23:57:53.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.113+0000 7f24e49d8640 1 Processor -- start 2024-09-15T23:57:53.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.113+0000 7f24e49d8640 1 -- start start 2024-09-15T23:57:53.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24e49d8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24e015f830 0x7f24e006bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24e49d8640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f24e015d290 0x7f24e006c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24e49d8640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24e015fc10 con 0x7f24e009aa00 2024-09-15T23:57:53.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24e49d8640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f24e015da40 con 0x7f24e015d290 2024-09-15T23:57:53.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24e49d8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f24e015d800 con 0x7f24e015f830 2024-09-15T23:57:53.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ded9d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f24e009aa00 0x7f24e015fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52242/0 (socket says 172.21.15.112:52242) 2024-09-15T23:57:53.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ded9d640 1 -- 172.21.15.112:0/4100319344 learned_addr learned my addr 172.21.15.112:0/4100319344 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:53.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24d5d9b640 1 --2- 172.21.15.112:0/4100319344 >> v2:172.21.15.169:3300/0 conn(0x7f24e015d290 0x7f24e006c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24de59c640 1 --2- 172.21.15.112:0/4100319344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24e015f830 0x7f24e006bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 -- 172.21.15.112:0/4100319344 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134503499 0 0) 0x7f24e015fc10 con 0x7f24e009aa00 2024-09-15T23:57:53.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 -- 172.21.15.112:0/4100319344 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24cc003530 con 0x7f24e009aa00 2024-09-15T23:57:53.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 -- 172.21.15.112:0/4100319344 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3086836244 0 0) 0x7f24cc003530 con 0x7f24e009aa00 2024-09-15T23:57:53.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 -- 172.21.15.112:0/4100319344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24e015f830 msgr2=0x7f24e006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:53.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 --2- 172.21.15.112:0/4100319344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24e015f830 0x7f24e006bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 -- 172.21.15.112:0/4100319344 >> v2:172.21.15.169:3300/0 conn(0x7f24e015d290 msgr2=0x7f24e006c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:53.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 --2- 172.21.15.112:0/4100319344 >> v2:172.21.15.169:3300/0 conn(0x7f24e015d290 0x7f24e006c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 -- 172.21.15.112:0/4100319344 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e00b3570 con 0x7f24e009aa00 2024-09-15T23:57:53.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 -- 172.21.15.112:0/4100319344 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f24d8001a00 con 0x7f24e009aa00 2024-09-15T23:57:53.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 -- 172.21.15.112:0/4100319344 >> v1:172.21.15.112:6789/0 conn(0x7f24e009aa00 legacy=0x7f24e015fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:53.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 --2- 172.21.15.112:0/4100319344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24e015f830 0x7f24cc0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 --2- 172.21.15.112:0/4100319344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24cc003f40 0x7f24cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 --2- 172.21.15.112:0/4100319344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24cc004d50 0x7f24cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 -- 172.21.15.112:0/4100319344 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f24e015da40 con 0x7f24cc003f40 2024-09-15T23:57:53.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 -- 172.21.15.112:0/4100319344 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f24e015d800 con 0x7f24cc004d50 2024-09-15T23:57:53.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 -- 172.21.15.112:0/4100319344 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f24cc00b9d0 con 0x7f24e015f830 2024-09-15T23:57:53.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24d5d9b640 1 --2- 172.21.15.112:0/4100319344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24cc003f40 0x7f24cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24de59c640 1 --2- 172.21.15.112:0/4100319344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24e015f830 0x7f24cc0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24d5d9b640 1 -- 172.21.15.112:0/4100319344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24e015f830 msgr2=0x7f24cc0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:53.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24d5d9b640 1 --2- 172.21.15.112:0/4100319344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24e015f830 0x7f24cc0039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24d5d9b640 1 -- 172.21.15.112:0/4100319344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24cc004d50 msgr2=0x7f24cc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:53.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24d5d9b640 1 --2- 172.21.15.112:0/4100319344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24cc004d50 0x7f24cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24d5d9b640 1 -- 172.21.15.112:0/4100319344 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24cc003530 con 0x7f24cc003f40 2024-09-15T23:57:53.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24d5d9b640 1 --2- 172.21.15.112:0/4100319344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24cc003f40 0x7f24cc004810 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009ab0 tx=0x7f24c801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35339deccabca761 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:53.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 -- 172.21.15.112:0/4100319344 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c80b2070 con 0x7f24cc003f40 2024-09-15T23:57:53.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 -- 172.21.15.112:0/4100319344 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c80a5680 con 0x7f24cc003f40 2024-09-15T23:57:53.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.117+0000 7f24ddd9b640 1 -- 172.21.15.112:0/4100319344 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c80096b0 con 0x7f24cc003f40 2024-09-15T23:57:53.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 -- 172.21.15.112:0/4100319344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24cc003f40 msgr2=0x7f24cc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:53.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 --2- 172.21.15.112:0/4100319344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24cc003f40 0x7f24cc004810 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009ab0 tx=0x7f24c801ca30 comp rx=0 tx=0).stop 2024-09-15T23:57:53.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24ded9d640 1 -- 172.21.15.112:0/4100319344 reap_dead start 2024-09-15T23:57:53.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 -- 172.21.15.112:0/4100319344 shutdown_connections 2024-09-15T23:57:53.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 -- 172.21.15.112:0/4100319344 >> 172.21.15.112:0/4100319344 conn(0x7f24e00b6800 msgr2=0x7f24e00b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:53.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 -- 172.21.15.112:0/4100319344 shutdown_connections 2024-09-15T23:57:53.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 -- 172.21.15.112:0/4100319344 wait complete. 2024-09-15T23:57:53.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 Processor -- start 2024-09-15T23:57:53.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 -- start start 2024-09-15T23:57:53.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24cc003f40 0x7f24e0152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24e01f7f70 0x7f24e01f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24e014f3c0 0x7f24e014f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f24e0073460 con 0x7f24e01f7f70 2024-09-15T23:57:53.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f24e00b3b30 con 0x7f24cc003f40 2024-09-15T23:57:53.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f24e00735e0 con 0x7f24e014f3c0 2024-09-15T23:57:53.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24d5d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24e01f7f70 0x7f24e01f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24d5d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24e01f7f70 0x7f24e01f83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52478/0 (socket says 172.21.15.112:52478) 2024-09-15T23:57:53.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24d5d9b640 1 -- 172.21.15.112:0/2563736384 learned_addr learned my addr 172.21.15.112:0/2563736384 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:53.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24de59c640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24cc003f40 0x7f24e0152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24ded9d640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24e014f3c0 0x7f24e014f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24d5d9b640 1 -- 172.21.15.112:0/2563736384 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24e014f3c0 msgr2=0x7f24e014f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:53.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24d5d9b640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24e014f3c0 0x7f24e014f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24d5d9b640 1 -- 172.21.15.112:0/2563736384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24cc003f40 msgr2=0x7f24e0152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:53.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24d5d9b640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24cc003f40 0x7f24e0152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24d5d9b640 1 -- 172.21.15.112:0/2563736384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e014fd80 con 0x7f24e01f7f70 2024-09-15T23:57:53.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24de59c640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24cc003f40 0x7f24e0152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:53.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24d5d9b640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24e01f7f70 0x7f24e01f83d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f24c801d2d0 tx=0x7f24cc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:53.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24d77fe640 1 -- 172.21.15.112:0/2563736384 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c80b2040 con 0x7f24e01f7f70 2024-09-15T23:57:53.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24d77fe640 1 -- 172.21.15.112:0/2563736384 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c80b8440 con 0x7f24e01f7f70 2024-09-15T23:57:53.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 -- 172.21.15.112:0/2563736384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e01520f0 con 0x7f24e01f7f70 2024-09-15T23:57:53.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24d77fe640 1 -- 172.21.15.112:0/2563736384 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c80096b0 con 0x7f24e01f7f70 2024-09-15T23:57:53.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.121+0000 7f24e49d8640 1 -- 172.21.15.112:0/2563736384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e01526b0 con 0x7f24e01f7f70 2024-09-15T23:57:53.126 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.125+0000 7f24e49d8640 1 -- 172.21.15.112:0/2563736384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e006bcc0 con 0x7f24e01f7f70 2024-09-15T23:57:53.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.125+0000 7f24d77fe640 1 -- 172.21.15.112:0/2563736384 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f24c80bf060 con 0x7f24e01f7f70 2024-09-15T23:57:53.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.125+0000 7f24d77fe640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f24c00678c0 0x7f24c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.125+0000 7f24d77fe640 1 -- 172.21.15.112:0/2563736384 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f24c811f4e0 con 0x7f24e01f7f70 2024-09-15T23:57:53.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.125+0000 7f24de59c640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f24c00678c0 0x7f24c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.125+0000 7f24de59c640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f24c00678c0 0x7f24c0069d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009930 tx=0x7f24d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:53.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.129+0000 7f24d77fe640 1 -- 172.21.15.112:0/2563736384 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f24c80167a0 con 0x7f24e01f7f70 2024-09-15T23:57:53.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.349+0000 7f24e49d8640 1 -- 172.21.15.112:0/2563736384 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) -- 0x7f24e00b0280 con 0x7f24e01f7f70 2024-09-15T23:57:53.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.349+0000 7f24d77fe640 1 -- 172.21.15.112:0/2563736384 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) ==== 75+0+1653 (secure 0 0 0) 0x7f24c80eff20 con 0x7f24e01f7f70 2024-09-15T23:57:53.351 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:53.351 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:57:53.351 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-15T23:57:53.351 INFO:teuthology.orchestra.run.smithi112.stdout: "total_bytes": 773094113280, 2024-09-15T23:57:53.351 INFO:teuthology.orchestra.run.smithi112.stdout: "total_avail_bytes": 772824662016, 2024-09-15T23:57:53.351 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_bytes": 269451264, 2024-09-15T23:57:53.352 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_bytes": 269451264, 2024-09-15T23:57:53.352 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_ratio": 0.00034853618126362562, 2024-09-15T23:57:53.352 INFO:teuthology.orchestra.run.smithi112.stdout: "num_osds": 8, 2024-09-15T23:57:53.352 INFO:teuthology.orchestra.run.smithi112.stdout: "num_per_pool_osds": 8, 2024-09-15T23:57:53.352 INFO:teuthology.orchestra.run.smithi112.stdout: "num_per_pool_omap_osds": 8 2024-09-15T23:57:53.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:53.352 INFO:teuthology.orchestra.run.smithi112.stdout: "stats_by_class": { 2024-09-15T23:57:53.352 INFO:teuthology.orchestra.run.smithi112.stdout: "ssd": { 2024-09-15T23:57:53.352 INFO:teuthology.orchestra.run.smithi112.stdout: "total_bytes": 773094113280, 2024-09-15T23:57:53.352 INFO:teuthology.orchestra.run.smithi112.stdout: "total_avail_bytes": 772824662016, 2024-09-15T23:57:53.352 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_bytes": 269451264, 2024-09-15T23:57:53.352 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_bytes": 269451264, 2024-09-15T23:57:53.353 INFO:teuthology.orchestra.run.smithi112.stdout: "total_used_raw_ratio": 0.00034853618126362562 2024-09-15T23:57:53.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:53.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:53.353 INFO:teuthology.orchestra.run.smithi112.stdout: "pools": [ 2024-09-15T23:57:53.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:53.353 INFO:teuthology.orchestra.run.smithi112.stdout: "name": ".mgr", 2024-09-15T23:57:53.353 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 1, 2024-09-15T23:57:53.353 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-15T23:57:53.353 INFO:teuthology.orchestra.run.smithi112.stdout: "stored": 590368, 2024-09-15T23:57:53.353 INFO:teuthology.orchestra.run.smithi112.stdout: "objects": 2, 2024-09-15T23:57:53.353 INFO:teuthology.orchestra.run.smithi112.stdout: "kb_used": 1160, 2024-09-15T23:57:53.353 INFO:teuthology.orchestra.run.smithi112.stdout: "bytes_used": 1187840, 2024-09-15T23:57:53.353 INFO:teuthology.orchestra.run.smithi112.stdout: "percent_used": 1.6180068769244826e-06, 2024-09-15T23:57:53.353 INFO:teuthology.orchestra.run.smithi112.stdout: "max_avail": 367068315648 2024-09-15T23:57:53.354 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:53.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:53.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:53.354 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cephfs_metadata", 2024-09-15T23:57:53.354 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 13, 2024-09-15T23:57:53.354 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-15T23:57:53.354 INFO:teuthology.orchestra.run.smithi112.stdout: "stored": 2410, 2024-09-15T23:57:53.354 INFO:teuthology.orchestra.run.smithi112.stdout: "objects": 22, 2024-09-15T23:57:53.354 INFO:teuthology.orchestra.run.smithi112.stdout: "kb_used": 64, 2024-09-15T23:57:53.354 INFO:teuthology.orchestra.run.smithi112.stdout: "bytes_used": 65536, 2024-09-15T23:57:53.354 INFO:teuthology.orchestra.run.smithi112.stdout: "percent_used": 8.9269477143716358e-08, 2024-09-15T23:57:53.354 INFO:teuthology.orchestra.run.smithi112.stdout: "max_avail": 367068315648 2024-09-15T23:57:53.354 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:53.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:57:53.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:57:53.355 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "cephfs_data", 2024-09-15T23:57:53.355 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 14, 2024-09-15T23:57:53.355 INFO:teuthology.orchestra.run.smithi112.stdout: "stats": { 2024-09-15T23:57:53.355 INFO:teuthology.orchestra.run.smithi112.stdout: "stored": 0, 2024-09-15T23:57:53.355 INFO:teuthology.orchestra.run.smithi112.stdout: "objects": 0, 2024-09-15T23:57:53.355 INFO:teuthology.orchestra.run.smithi112.stdout: "kb_used": 0, 2024-09-15T23:57:53.355 INFO:teuthology.orchestra.run.smithi112.stdout: "bytes_used": 0, 2024-09-15T23:57:53.355 INFO:teuthology.orchestra.run.smithi112.stdout: "percent_used": 0, 2024-09-15T23:57:53.355 INFO:teuthology.orchestra.run.smithi112.stdout: "max_avail": 367068315648 2024-09-15T23:57:53.355 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:53.355 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:57:53.356 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-15T23:57:53.356 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:57:53.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.353+0000 7f24e49d8640 1 -- 172.21.15.112:0/2563736384 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f24c00678c0 msgr2=0x7f24c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:53.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.353+0000 7f24e49d8640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f24c00678c0 0x7f24c0069d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009930 tx=0x7f24d0008040 comp rx=0 tx=0).stop 2024-09-15T23:57:53.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.353+0000 7f24e49d8640 1 -- 172.21.15.112:0/2563736384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24e01f7f70 msgr2=0x7f24e01f83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:53.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.353+0000 7f24e49d8640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24e01f7f70 0x7f24e01f83d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f24c801d2d0 tx=0x7f24cc005840 comp rx=0 tx=0).stop 2024-09-15T23:57:53.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.353+0000 7f24e49d8640 1 -- 172.21.15.112:0/2563736384 shutdown_connections 2024-09-15T23:57:53.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.353+0000 7f24e49d8640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f24c00678c0 0x7f24c0069d80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.353+0000 7f24e49d8640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24e014f3c0 0x7f24e014f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.353+0000 7f24e49d8640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24e01f7f70 0x7f24e01f83d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.353+0000 7f24e49d8640 1 --2- 172.21.15.112:0/2563736384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24cc003f40 0x7f24e0152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.353+0000 7f24e49d8640 1 -- 172.21.15.112:0/2563736384 >> 172.21.15.112:0/2563736384 conn(0x7f24e00b6800 msgr2=0x7f24e01e4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:53.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.353+0000 7f24e49d8640 1 -- 172.21.15.112:0/2563736384 shutdown_connections 2024-09-15T23:57:53.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.353+0000 7f24e49d8640 1 -- 172.21.15.112:0/2563736384 wait complete. 2024-09-15T23:57:53.369 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-15T23:57:53.370 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:57:53.370 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:57:53.449 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:57:53.532 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:57:53.532 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:57:53.532 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:57:53.532 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:53.539 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:57:53.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.713+0000 7f2833260640 1 Processor -- start 2024-09-15T23:57:53.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.713+0000 7f2833260640 1 -- start start 2024-09-15T23:57:53.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.713+0000 7f2833260640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f282c15c2a0 0x7f282c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.713+0000 7f2833260640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f282c0af2a0 0x7f282c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.713+0000 7f2833260640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f282c0b3290 con 0x7f282c15bec0 2024-09-15T23:57:53.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.713+0000 7f2833260640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f282c0b3570 con 0x7f282c15c2a0 2024-09-15T23:57:53.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.713+0000 7f2833260640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f282c0b3850 con 0x7f282c0af2a0 2024-09-15T23:57:53.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f282bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f282c15c2a0 0x7f282c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f282bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f282c15c2a0 0x7f282c0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52490/0 (socket says 172.21.15.112:52490) 2024-09-15T23:57:53.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f282bfff640 1 -- 172.21.15.112:0/3943973054 learned_addr learned my addr 172.21.15.112:0/3943973054 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:53.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f28317fd640 1 --2- 172.21.15.112:0/3943973054 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f282c0af2a0 0x7f282c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f282bfff640 1 -- 172.21.15.112:0/3943973054 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f282c0af2a0 msgr2=0x7f282c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:53.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f282bfff640 1 --2- 172.21.15.112:0/3943973054 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f282c0af2a0 0x7f282c06e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f282bfff640 1 -- 172.21.15.112:0/3943973054 >> v1:172.21.15.169:6789/0 conn(0x7f282c15bec0 legacy=0x7f282c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:53.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f282bfff640 1 -- 172.21.15.112:0/3943973054 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c0b3b30 con 0x7f282c15c2a0 2024-09-15T23:57:53.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f282bfff640 1 --2- 172.21.15.112:0/3943973054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f282c15c2a0 0x7f282c0aed60 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2818009870 tx=0x7f281801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2510ab733e8e118f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:53.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f282b7fe640 1 -- 172.21.15.112:0/3943973054 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28180aa610 con 0x7f282c15c2a0 2024-09-15T23:57:53.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f282b7fe640 1 -- 172.21.15.112:0/3943973054 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28180af070 con 0x7f282c15c2a0 2024-09-15T23:57:53.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f282b7fe640 1 -- 172.21.15.112:0/3943973054 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28180aa9d0 con 0x7f282c15c2a0 2024-09-15T23:57:53.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f2833260640 1 -- 172.21.15.112:0/3943973054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f282c15c2a0 msgr2=0x7f282c0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:53.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f2833260640 1 --2- 172.21.15.112:0/3943973054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f282c15c2a0 0x7f282c0aed60 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2818009870 tx=0x7f281801c4f0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f2833260640 1 -- 172.21.15.112:0/3943973054 shutdown_connections 2024-09-15T23:57:53.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f2833260640 1 --2- 172.21.15.112:0/3943973054 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f282c0af2a0 0x7f282c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f2833260640 1 --2- 172.21.15.112:0/3943973054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f282c15c2a0 0x7f282c0aed60 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f2833260640 1 -- 172.21.15.112:0/3943973054 >> 172.21.15.112:0/3943973054 conn(0x7f282c0b1f90 msgr2=0x7f282c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:53.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f2833260640 1 -- 172.21.15.112:0/3943973054 shutdown_connections 2024-09-15T23:57:53.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.717+0000 7f2833260640 1 -- 172.21.15.112:0/3943973054 wait complete. 2024-09-15T23:57:53.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f2833260640 1 Processor -- start 2024-09-15T23:57:53.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f2833260640 1 -- start start 2024-09-15T23:57:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f2833260640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f282c0af2a0 0x7f282c14b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f2833260640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f282c15bec0 0x7f282c151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f2833260640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f282c15c2a0 0x7f282c15a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f2833260640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f282c06ed50 con 0x7f282c15c2a0 2024-09-15T23:57:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f2833260640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f282c0af6b0 con 0x7f282c0af2a0 2024-09-15T23:57:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f2833260640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f282c06eed0 con 0x7f282c15bec0 2024-09-15T23:57:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f28317fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f282c15c2a0 0x7f282c15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f28317fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f282c15c2a0 0x7f282c15a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52494/0 (socket says 172.21.15.112:52494) 2024-09-15T23:57:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f28317fd640 1 -- 172.21.15.112:0/1851387208 learned_addr learned my addr 172.21.15.112:0/1851387208 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f2830ffc640 1 --2- 172.21.15.112:0/1851387208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f282c0af2a0 0x7f282c14b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f282bfff640 1 --2- 172.21.15.112:0/1851387208 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f282c15bec0 0x7f282c151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f28317fd640 1 -- 172.21.15.112:0/1851387208 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f282c15bec0 msgr2=0x7f282c151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f28317fd640 1 --2- 172.21.15.112:0/1851387208 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f282c15bec0 0x7f282c151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f28317fd640 1 -- 172.21.15.112:0/1851387208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f282c0af2a0 msgr2=0x7f282c14b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f28317fd640 1 --2- 172.21.15.112:0/1851387208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f282c0af2a0 0x7f282c14b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f28317fd640 1 -- 172.21.15.112:0/1851387208 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c1508a0 con 0x7f282c15c2a0 2024-09-15T23:57:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f28317fd640 1 --2- 172.21.15.112:0/1851387208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f282c15c2a0 0x7f282c15a450 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2824007e40 tx=0x7f282400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f28297fa640 1 -- 172.21.15.112:0/1851387208 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824014620 con 0x7f282c15c2a0 2024-09-15T23:57:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f28297fa640 1 -- 172.21.15.112:0/1851387208 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2824019070 con 0x7f282c15c2a0 2024-09-15T23:57:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f28297fa640 1 -- 172.21.15.112:0/1851387208 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824014a20 con 0x7f282c15c2a0 2024-09-15T23:57:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f2833260640 1 -- 172.21.15.112:0/1851387208 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282c150b80 con 0x7f282c15c2a0 2024-09-15T23:57:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f2833260640 1 -- 172.21.15.112:0/1851387208 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282c151140 con 0x7f282c15c2a0 2024-09-15T23:57:53.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f2833260640 1 -- 172.21.15.112:0/1851387208 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f282c06e000 con 0x7f282c15c2a0 2024-09-15T23:57:53.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.721+0000 7f28297fa640 1 -- 172.21.15.112:0/1851387208 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2824014bc0 con 0x7f282c15c2a0 2024-09-15T23:57:53.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.725+0000 7f28297fa640 1 --2- 172.21.15.112:0/1851387208 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f28100678f0 0x7f2810069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.725+0000 7f28297fa640 1 -- 172.21.15.112:0/1851387208 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f2824086650 con 0x7f282c15c2a0 2024-09-15T23:57:53.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.725+0000 7f2830ffc640 1 --2- 172.21.15.112:0/1851387208 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f28100678f0 0x7f2810069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.725+0000 7f2830ffc640 1 --2- 172.21.15.112:0/1851387208 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f28100678f0 0x7f2810069db0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2820003d60 tx=0x7f2820009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:53.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.729+0000 7f28297fa640 1 -- 172.21.15.112:0/1851387208 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2824057090 con 0x7f282c15c2a0 2024-09-15T23:57:53.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.901+0000 7f2833260640 1 -- 172.21.15.112:0/1851387208 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f282c06fcd0 con 0x7f282c15c2a0 2024-09-15T23:57:53.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.901+0000 7f28297fa640 1 -- 172.21.15.112:0/1851387208 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v86) ==== 80+0+0 (secure 0 0 0) 0x7f2824056990 con 0x7f282c15c2a0 2024-09-15T23:57:53.901 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:57:53.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.901+0000 7f2833260640 1 -- 172.21.15.112:0/1851387208 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f28100678f0 msgr2=0x7f2810069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:53.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.901+0000 7f2833260640 1 --2- 172.21.15.112:0/1851387208 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f28100678f0 0x7f2810069db0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2820003d60 tx=0x7f2820009040 comp rx=0 tx=0).stop 2024-09-15T23:57:53.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.901+0000 7f2833260640 1 -- 172.21.15.112:0/1851387208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f282c15c2a0 msgr2=0x7f282c15a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:53.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.901+0000 7f2833260640 1 --2- 172.21.15.112:0/1851387208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f282c15c2a0 0x7f282c15a450 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2824007e40 tx=0x7f282400e4b0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.901+0000 7f2833260640 1 -- 172.21.15.112:0/1851387208 shutdown_connections 2024-09-15T23:57:53.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.901+0000 7f2833260640 1 --2- 172.21.15.112:0/1851387208 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f28100678f0 0x7f2810069db0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.901+0000 7f2833260640 1 --2- 172.21.15.112:0/1851387208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f282c15c2a0 0x7f282c15a450 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.901+0000 7f2833260640 1 --2- 172.21.15.112:0/1851387208 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f282c15bec0 0x7f282c151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.901+0000 7f2833260640 1 --2- 172.21.15.112:0/1851387208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f282c0af2a0 0x7f282c14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.901+0000 7f2833260640 1 -- 172.21.15.112:0/1851387208 >> 172.21.15.112:0/1851387208 conn(0x7f282c0b1f90 msgr2=0x7f282c14f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:53.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.901+0000 7f2833260640 1 -- 172.21.15.112:0/1851387208 shutdown_connections 2024-09-15T23:57:53.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:53.901+0000 7f2833260640 1 -- 172.21.15.112:0/1851387208 wait complete. 2024-09-15T23:57:53.919 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2024-09-15T23:57:53.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:53.919 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:53.929 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[43517]: fuse finished with error 0 and tester_r 0 2024-09-15T23:57:53.930 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:57:53.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:53.930 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:57:54.094 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:57:54.095 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:57:54.095 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:54.101 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:57:54.102 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:57:54.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:54.102 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:57:54.147 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-15T23:57:54.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:57:54.148 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:57:54.148 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:57:54.148 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:54.154 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:57:54.155 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:57:54.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:54.155 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-15T23:57:54.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:57:54.201 INFO:teuthology.orchestra.run.smithi112.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-15T23:57:54.201 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:57:54.201 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:57:54.201 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:54.207 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:57:54.207 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:57:54.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:54.207 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-15T23:57:54.255 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-15T23:57:54.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:57:54.256 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:54.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f868430d640 1 Processor -- start 2024-09-15T23:57:54.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f868430d640 1 -- start start 2024-09-15T23:57:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f868430d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f867c15bec0 0x7f867c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f868430d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f867c15c2a0 0x7f867c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f868430d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f867c0b3290 con 0x7f867c0af2a0 2024-09-15T23:57:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f868430d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f867c0b3570 con 0x7f867c15c2a0 2024-09-15T23:57:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f868430d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f867c0b3850 con 0x7f867c15bec0 2024-09-15T23:57:54.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86828aa640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f867c0af2a0 0x7f867c15fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52258/0 (socket says 172.21.15.112:52258) 2024-09-15T23:57:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86828aa640 1 -- 172.21.15.112:0/1871571922 learned_addr learned my addr 172.21.15.112:0/1871571922 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86818a8640 1 --2- 172.21.15.112:0/1871571922 >> v2:172.21.15.169:3300/0 conn(0x7f867c15c2a0 0x7f867c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 -- 172.21.15.112:0/1871571922 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1340125535 0 0) 0x7f867c0b3290 con 0x7f867c0af2a0 2024-09-15T23:57:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 -- 172.21.15.112:0/1871571922 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8668003530 con 0x7f867c0af2a0 2024-09-15T23:57:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86820a9640 1 --2- 172.21.15.112:0/1871571922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f867c15bec0 0x7f867c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 -- 172.21.15.112:0/1871571922 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 163503596 0 0) 0x7f8668003530 con 0x7f867c0af2a0 2024-09-15T23:57:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 -- 172.21.15.112:0/1871571922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f867c15bec0 msgr2=0x7f867c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 --2- 172.21.15.112:0/1871571922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f867c15bec0 0x7f867c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 -- 172.21.15.112:0/1871571922 >> v2:172.21.15.169:3300/0 conn(0x7f867c15c2a0 msgr2=0x7f867c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 --2- 172.21.15.112:0/1871571922 >> v2:172.21.15.169:3300/0 conn(0x7f867c15c2a0 0x7f867c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 -- 172.21.15.112:0/1871571922 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c0b3b30 con 0x7f867c0af2a0 2024-09-15T23:57:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 -- 172.21.15.112:0/1871571922 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f8674001a00 con 0x7f867c0af2a0 2024-09-15T23:57:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 -- 172.21.15.112:0/1871571922 >> v1:172.21.15.112:6789/0 conn(0x7f867c0af2a0 legacy=0x7f867c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 --2- 172.21.15.112:0/1871571922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f867c15bec0 0x7f86680039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 --2- 172.21.15.112:0/1871571922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8668003ff0 0x7f8668004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 --2- 172.21.15.112:0/1871571922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8668004d50 0x7f86680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 -- 172.21.15.112:0/1871571922 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f867c0b3570 con 0x7f8668003ff0 2024-09-15T23:57:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 -- 172.21.15.112:0/1871571922 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f867c0b3850 con 0x7f8668004d50 2024-09-15T23:57:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86810a7640 1 -- 172.21.15.112:0/1871571922 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f866800bad0 con 0x7f867c15bec0 2024-09-15T23:57:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86818a8640 1 --2- 172.21.15.112:0/1871571922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8668003ff0 0x7f8668004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86820a9640 1 --2- 172.21.15.112:0/1871571922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f867c15bec0 0x7f86680039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86828aa640 1 --2- 172.21.15.112:0/1871571922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8668004d50 0x7f86680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86818a8640 1 -- 172.21.15.112:0/1871571922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f867c15bec0 msgr2=0x7f86680039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86818a8640 1 --2- 172.21.15.112:0/1871571922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f867c15bec0 0x7f86680039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86818a8640 1 -- 172.21.15.112:0/1871571922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8668004d50 msgr2=0x7f86680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86818a8640 1 --2- 172.21.15.112:0/1871571922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8668004d50 0x7f86680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.385+0000 7f86818a8640 1 -- 172.21.15.112:0/1871571922 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8668003530 con 0x7f8668003ff0 2024-09-15T23:57:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f86818a8640 1 --2- 172.21.15.112:0/1871571922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8668003ff0 0x7f8668004810 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f867c06da50 tx=0x7f867801c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118f51816a232799 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f86810a7640 1 -- 172.21.15.112:0/1871571922 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867800b600 con 0x7f8668003ff0 2024-09-15T23:57:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f86810a7640 1 -- 172.21.15.112:0/1871571922 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86780b1070 con 0x7f8668003ff0 2024-09-15T23:57:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f86810a7640 1 -- 172.21.15.112:0/1871571922 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86780ac860 con 0x7f8668003ff0 2024-09-15T23:57:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f868430d640 1 -- 172.21.15.112:0/1871571922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8668003ff0 msgr2=0x7f8668004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f868430d640 1 --2- 172.21.15.112:0/1871571922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8668003ff0 0x7f8668004810 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f867c06da50 tx=0x7f867801c680 comp rx=0 tx=0).stop 2024-09-15T23:57:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f86828aa640 1 -- 172.21.15.112:0/1871571922 reap_dead start 2024-09-15T23:57:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f868430d640 1 -- 172.21.15.112:0/1871571922 shutdown_connections 2024-09-15T23:57:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f868430d640 1 -- 172.21.15.112:0/1871571922 >> 172.21.15.112:0/1871571922 conn(0x7f867c0b1f90 msgr2=0x7f867c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f868430d640 1 -- 172.21.15.112:0/1871571922 shutdown_connections 2024-09-15T23:57:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f868430d640 1 -- 172.21.15.112:0/1871571922 wait complete. 2024-09-15T23:57:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f868430d640 1 Processor -- start 2024-09-15T23:57:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f868430d640 1 -- start start 2024-09-15T23:57:54.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f868430d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8668003ff0 0x7f867c14f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f868430d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f867c1f5da0 0x7f867c0b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f868430d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f867c14f6b0 0x7f867c0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f868430d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f867c0af730 con 0x7f8668003ff0 2024-09-15T23:57:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f868430d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f867c0b40f0 con 0x7f867c1f5da0 2024-09-15T23:57:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f868430d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f867c0afc90 con 0x7f867c14f6b0 2024-09-15T23:57:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f86820a9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8668003ff0 0x7f867c14f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f86820a9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8668003ff0 0x7f867c14f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52508/0 (socket says 172.21.15.112:52508) 2024-09-15T23:57:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.389+0000 7f86820a9640 1 -- 172.21.15.112:0/1337403330 learned_addr learned my addr 172.21.15.112:0/1337403330 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f86818a8640 1 --2- 172.21.15.112:0/1337403330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f867c1f5da0 0x7f867c0b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f86828aa640 1 --2- 172.21.15.112:0/1337403330 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f867c14f6b0 0x7f867c0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f86820a9640 1 -- 172.21.15.112:0/1337403330 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f867c14f6b0 msgr2=0x7f867c0b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f86820a9640 1 --2- 172.21.15.112:0/1337403330 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f867c14f6b0 0x7f867c0b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f86820a9640 1 -- 172.21.15.112:0/1337403330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f867c1f5da0 msgr2=0x7f867c0b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f86820a9640 1 --2- 172.21.15.112:0/1337403330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f867c1f5da0 0x7f867c0b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f86820a9640 1 -- 172.21.15.112:0/1337403330 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c1e3cd0 con 0x7f8668003ff0 2024-09-15T23:57:54.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f86820a9640 1 --2- 172.21.15.112:0/1337403330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8668003ff0 0x7f867c14f0a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f866c00f580 tx=0x7f866c00fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:54.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f8672ffd640 1 -- 172.21.15.112:0/1337403330 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c019020 con 0x7f8668003ff0 2024-09-15T23:57:54.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f8672ffd640 1 -- 172.21.15.112:0/1337403330 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c014870 con 0x7f8668003ff0 2024-09-15T23:57:54.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f8672ffd640 1 -- 172.21.15.112:0/1337403330 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c014c40 con 0x7f8668003ff0 2024-09-15T23:57:54.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f868430d640 1 -- 172.21.15.112:0/1337403330 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867c1e3fb0 con 0x7f8668003ff0 2024-09-15T23:57:54.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f868430d640 1 -- 172.21.15.112:0/1337403330 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867c14ff60 con 0x7f8668003ff0 2024-09-15T23:57:54.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f868430d640 1 -- 172.21.15.112:0/1337403330 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f867c0aed60 con 0x7f8668003ff0 2024-09-15T23:57:54.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f8672ffd640 1 -- 172.21.15.112:0/1337403330 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f866c01c020 con 0x7f8668003ff0 2024-09-15T23:57:54.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f8672ffd640 1 --2- 172.21.15.112:0/1337403330 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86600678c0 0x7f8660069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f8672ffd640 1 -- 172.21.15.112:0/1337403330 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f866c086520 con 0x7f8668003ff0 2024-09-15T23:57:54.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f86818a8640 1 --2- 172.21.15.112:0/1337403330 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86600678c0 0x7f8660069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.393+0000 7f86818a8640 1 --2- 172.21.15.112:0/1337403330 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86600678c0 0x7f8660069d80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f86780b0000 tx=0x7f86780046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:54.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.397+0000 7f8672ffd640 1 -- 172.21.15.112:0/1337403330 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f866c023020 con 0x7f8668003ff0 2024-09-15T23:57:54.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.601+0000 7f868430d640 1 -- 172.21.15.112:0/1337403330 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f867c06fcd0 con 0x7f8668003ff0 2024-09-15T23:57:54.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.601+0000 7f8672ffd640 1 -- 172.21.15.112:0/1337403330 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5234 (secure 0 0 0) 0x7f866c026350 con 0x7f8668003ff0 2024-09-15T23:57:54.603 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:54.603 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":46,"btime":"2024-09-15T23:57:46:581351+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1475104986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1475104986},{"type":"v1","addr":"172.21.15.169:6835","nonce":1475104986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2253954019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2253954019},{"type":"v1","addr":"172.21.15.169:6834","nonce":2253954019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1645054566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1645054566},{"type":"v1","addr":"172.21.15.112:6835","nonce":1645054566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:42.896416+0000","modified":"2024-09-15T23:57:45.943939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6387":{"gid":6387,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/434676840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":434676840},{"type":"v1","addr":"172.21.15.112:6837","nonce":434676840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6387,"qdb_cluster":[6387]},"id":6}]} 2024-09-15T23:57:54.604 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 46 2024-09-15T23:57:54.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.605+0000 7f868430d640 1 -- 172.21.15.112:0/1337403330 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86600678c0 msgr2=0x7f8660069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.605+0000 7f868430d640 1 --2- 172.21.15.112:0/1337403330 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86600678c0 0x7f8660069d80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f86780b0000 tx=0x7f86780046d0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.605+0000 7f868430d640 1 -- 172.21.15.112:0/1337403330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8668003ff0 msgr2=0x7f867c14f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.605+0000 7f868430d640 1 --2- 172.21.15.112:0/1337403330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8668003ff0 0x7f867c14f0a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f866c00f580 tx=0x7f866c00fa40 comp rx=0 tx=0).stop 2024-09-15T23:57:54.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.605+0000 7f868430d640 1 -- 172.21.15.112:0/1337403330 shutdown_connections 2024-09-15T23:57:54.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.605+0000 7f868430d640 1 --2- 172.21.15.112:0/1337403330 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86600678c0 0x7f8660069d80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.605+0000 7f868430d640 1 --2- 172.21.15.112:0/1337403330 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f867c14f6b0 0x7f867c0b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.605+0000 7f868430d640 1 --2- 172.21.15.112:0/1337403330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f867c1f5da0 0x7f867c0b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.605+0000 7f868430d640 1 --2- 172.21.15.112:0/1337403330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8668003ff0 0x7f867c14f0a0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.605+0000 7f868430d640 1 -- 172.21.15.112:0/1337403330 >> 172.21.15.112:0/1337403330 conn(0x7f867c0b1f90 msgr2=0x7f867c151890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:54.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.605+0000 7f868430d640 1 -- 172.21.15.112:0/1337403330 shutdown_connections 2024-09-15T23:57:54.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.605+0000 7f868430d640 1 -- 172.21.15.112:0/1337403330 wait complete. 2024-09-15T23:57:54.621 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:54.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7f96d640 1 Processor -- start 2024-09-15T23:57:54.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7f96d640 1 -- start start 2024-09-15T23:57:54.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7f96d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9f7815bec0 0x7f9f780ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7f96d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9f7815c2a0 0x7f9f780aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7f96d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f780b3290 con 0x7f9f780af2a0 2024-09-15T23:57:54.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7f96d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9f780b3570 con 0x7f9f7815c2a0 2024-09-15T23:57:54.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7f96d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9f780b3850 con 0x7f9f7815bec0 2024-09-15T23:57:54.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7cf08640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9f7815c2a0 0x7f9f780aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7df0a640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9f780af2a0 0x7f9f7815fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52268/0 (socket says 172.21.15.112:52268) 2024-09-15T23:57:54.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7df0a640 1 -- 172.21.15.112:0/51860077 learned_addr learned my addr 172.21.15.112:0/51860077 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:54.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7d709640 1 --2- 172.21.15.112:0/51860077 >> v2:172.21.15.169:3300/0 conn(0x7f9f7815bec0 0x7f9f780ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7cf08640 1 -- 172.21.15.112:0/51860077 >> v2:172.21.15.169:3300/0 conn(0x7f9f7815bec0 msgr2=0x7f9f780ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:54.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7cf08640 1 --2- 172.21.15.112:0/51860077 >> v2:172.21.15.169:3300/0 conn(0x7f9f7815bec0 0x7f9f780ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7cf08640 1 -- 172.21.15.112:0/51860077 >> v1:172.21.15.112:6789/0 conn(0x7f9f780af2a0 legacy=0x7f9f7815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f7cf08640 1 -- 172.21.15.112:0/51860077 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f780b3b30 con 0x7f9f7815c2a0 2024-09-15T23:57:54.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.737+0000 7f9f6ffff640 1 -- 172.21.15.112:0/51860077 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2445162052 0 0) 0x7f9f780b3290 con 0x7f9f780af2a0 2024-09-15T23:57:54.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7cf08640 1 --2- 172.21.15.112:0/51860077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f7815c2a0 0x7f9f780aed60 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9f78071710 tx=0x7f9f6801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5819e55ab84d9e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:54.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f6ffff640 1 -- 172.21.15.112:0/51860077 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f680ab650 con 0x7f9f7815c2a0 2024-09-15T23:57:54.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f6ffff640 1 -- 172.21.15.112:0/51860077 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f680b0070 con 0x7f9f7815c2a0 2024-09-15T23:57:54.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f6ffff640 1 -- 172.21.15.112:0/51860077 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f680aba10 con 0x7f9f7815c2a0 2024-09-15T23:57:54.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 -- 172.21.15.112:0/51860077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f7815c2a0 msgr2=0x7f9f780aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 --2- 172.21.15.112:0/51860077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f7815c2a0 0x7f9f780aed60 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9f78071710 tx=0x7f9f6801c450 comp rx=0 tx=0).stop 2024-09-15T23:57:54.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 -- 172.21.15.112:0/51860077 shutdown_connections 2024-09-15T23:57:54.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 --2- 172.21.15.112:0/51860077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f7815c2a0 0x7f9f780aed60 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 --2- 172.21.15.112:0/51860077 >> v2:172.21.15.169:3300/0 conn(0x7f9f7815bec0 0x7f9f780ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 -- 172.21.15.112:0/51860077 >> 172.21.15.112:0/51860077 conn(0x7f9f780b1f90 msgr2=0x7f9f780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:54.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 -- 172.21.15.112:0/51860077 shutdown_connections 2024-09-15T23:57:54.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 -- 172.21.15.112:0/51860077 wait complete. 2024-09-15T23:57:54.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 Processor -- start 2024-09-15T23:57:54.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 -- start start 2024-09-15T23:57:54.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f780af2a0 0x7f9f7814f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f7815bec0 0x7f9f78166250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f7815c2a0 0x7f9f781f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9f780af6d0 con 0x7f9f7815bec0 2024-09-15T23:57:54.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9f780ad740 con 0x7f9f7815c2a0 2024-09-15T23:57:54.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7f96d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9f78169000 con 0x7f9f780af2a0 2024-09-15T23:57:54.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7cf08640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f7815bec0 0x7f9f78166250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7cf08640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f7815bec0 0x7f9f78166250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52538/0 (socket says 172.21.15.112:52538) 2024-09-15T23:57:54.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.741+0000 7f9f7cf08640 1 -- 172.21.15.112:0/886089601 learned_addr learned my addr 172.21.15.112:0/886089601 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:54.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f7df0a640 1 --2- 172.21.15.112:0/886089601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f7815c2a0 0x7f9f781f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f7cf08640 1 -- 172.21.15.112:0/886089601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f780af2a0 msgr2=0x7f9f7814f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f7cf08640 1 --2- 172.21.15.112:0/886089601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f780af2a0 0x7f9f7814f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f7cf08640 1 -- 172.21.15.112:0/886089601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f7815c2a0 msgr2=0x7f9f781f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f7cf08640 1 --2- 172.21.15.112:0/886089601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f7815c2a0 0x7f9f781f72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f7cf08640 1 -- 172.21.15.112:0/886089601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f781651b0 con 0x7f9f7815bec0 2024-09-15T23:57:54.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f7cf08640 1 --2- 172.21.15.112:0/886089601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f7815bec0 0x7f9f78166250 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9f680ad040 tx=0x7f9f680191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:54.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f6dffb640 1 -- 172.21.15.112:0/886089601 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68004230 con 0x7f9f7815bec0 2024-09-15T23:57:54.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f6dffb640 1 -- 172.21.15.112:0/886089601 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f680043d0 con 0x7f9f7815bec0 2024-09-15T23:57:54.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f7f96d640 1 -- 172.21.15.112:0/886089601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f78165490 con 0x7f9f7815bec0 2024-09-15T23:57:54.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f6dffb640 1 -- 172.21.15.112:0/886089601 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f680abaf0 con 0x7f9f7815bec0 2024-09-15T23:57:54.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f7f96d640 1 -- 172.21.15.112:0/886089601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f78165a50 con 0x7f9f7815bec0 2024-09-15T23:57:54.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f7f96d640 1 -- 172.21.15.112:0/886089601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f780ad200 con 0x7f9f7815bec0 2024-09-15T23:57:54.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f6dffb640 1 -- 172.21.15.112:0/886089601 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9f680c5060 con 0x7f9f7815bec0 2024-09-15T23:57:54.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f6dffb640 1 --2- 172.21.15.112:0/886089601 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9f5c0678c0 0x7f9f5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f7d709640 1 --2- 172.21.15.112:0/886089601 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9f5c0678c0 0x7f9f5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f6dffb640 1 -- 172.21.15.112:0/886089601 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f9f68120210 con 0x7f9f7815bec0 2024-09-15T23:57:54.748 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.745+0000 7f9f7d709640 1 --2- 172.21.15.112:0/886089601 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9f5c0678c0 0x7f9f5c069d80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400a8b0 tx=0x7f9f74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:54.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.749+0000 7f9f6dffb640 1 -- 172.21.15.112:0/886089601 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9f680b9070 con 0x7f9f7815bec0 2024-09-15T23:57:54.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.945+0000 7f9f7f96d640 1 -- 172.21.15.112:0/886089601 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f7806fcd0 con 0x7f9f7815bec0 2024-09-15T23:57:54.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.945+0000 7f9f6dffb640 1 -- 172.21.15.112:0/886089601 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5234 (secure 0 0 0) 0x7f9f68016070 con 0x7f9f7815bec0 2024-09-15T23:57:54.946 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:54.946 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":46,"btime":"2024-09-15T23:57:46:581351+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1475104986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1475104986},{"type":"v1","addr":"172.21.15.169:6835","nonce":1475104986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2253954019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2253954019},{"type":"v1","addr":"172.21.15.169:6834","nonce":2253954019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1645054566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1645054566},{"type":"v1","addr":"172.21.15.112:6835","nonce":1645054566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:42.896416+0000","modified":"2024-09-15T23:57:45.943939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6387":{"gid":6387,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/434676840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":434676840},{"type":"v1","addr":"172.21.15.112:6837","nonce":434676840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6387,"qdb_cluster":[6387]},"id":6}]} 2024-09-15T23:57:54.946 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 46 2024-09-15T23:57:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.949+0000 7f9f7f96d640 1 -- 172.21.15.112:0/886089601 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9f5c0678c0 msgr2=0x7f9f5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.949+0000 7f9f7f96d640 1 --2- 172.21.15.112:0/886089601 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9f5c0678c0 0x7f9f5c069d80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400a8b0 tx=0x7f9f74008040 comp rx=0 tx=0).stop 2024-09-15T23:57:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.949+0000 7f9f7f96d640 1 -- 172.21.15.112:0/886089601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f7815bec0 msgr2=0x7f9f78166250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.949+0000 7f9f7f96d640 1 --2- 172.21.15.112:0/886089601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f7815bec0 0x7f9f78166250 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9f680ad040 tx=0x7f9f680191f0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.949+0000 7f9f7f96d640 1 -- 172.21.15.112:0/886089601 shutdown_connections 2024-09-15T23:57:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.949+0000 7f9f7f96d640 1 --2- 172.21.15.112:0/886089601 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9f5c0678c0 0x7f9f5c069d80 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.949+0000 7f9f7f96d640 1 --2- 172.21.15.112:0/886089601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f7815c2a0 0x7f9f781f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.949+0000 7f9f7f96d640 1 --2- 172.21.15.112:0/886089601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f7815bec0 0x7f9f78166250 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.949+0000 7f9f7f96d640 1 --2- 172.21.15.112:0/886089601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f780af2a0 0x7f9f7814f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.949+0000 7f9f7f96d640 1 -- 172.21.15.112:0/886089601 >> 172.21.15.112:0/886089601 conn(0x7f9f780b1f90 msgr2=0x7f9f78074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:54.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.949+0000 7f9f7f96d640 1 -- 172.21.15.112:0/886089601 shutdown_connections 2024-09-15T23:57:54.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:54.949+0000 7f9f7f96d640 1 -- 172.21.15.112:0/886089601 wait complete. 2024-09-15T23:57:54.965 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:55.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.073+0000 7f46fd12b640 1 Processor -- start 2024-09-15T23:57:55.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.073+0000 7f46fd12b640 1 -- start start 2024-09-15T23:57:55.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46fd12b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f46f81630c0 0x7f46f806f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46fd12b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46f806df70 0x7f46f81634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46fd12b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f806e470 con 0x7f46f80b3290 2024-09-15T23:57:55.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46fd12b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f46f806e750 con 0x7f46f81630c0 2024-09-15T23:57:55.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46fd12b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f46f806ea30 con 0x7f46f806df70 2024-09-15T23:57:55.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46f6d9d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f46f81630c0 0x7f46f806f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46f759e640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f46f80b3290 0x7f46f80ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52280/0 (socket says 172.21.15.112:52280) 2024-09-15T23:57:55.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46f759e640 1 -- 172.21.15.112:0/2145036028 learned_addr learned my addr 172.21.15.112:0/2145036028 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:55.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46f659c640 1 --2- 172.21.15.112:0/2145036028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46f806df70 0x7f46f81634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46f6d9d640 1 -- 172.21.15.112:0/2145036028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46f806df70 msgr2=0x7f46f81634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:55.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46f6d9d640 1 --2- 172.21.15.112:0/2145036028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46f806df70 0x7f46f81634a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46f6d9d640 1 -- 172.21.15.112:0/2145036028 >> v1:172.21.15.112:6789/0 conn(0x7f46f80b3290 legacy=0x7f46f80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46f5d9b640 1 -- 172.21.15.112:0/2145036028 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1576455941 0 0) 0x7f46f806e470 con 0x7f46f80b3290 2024-09-15T23:57:55.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46f6d9d640 1 -- 172.21.15.112:0/2145036028 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f806ed10 con 0x7f46f81630c0 2024-09-15T23:57:55.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46f6d9d640 1 --2- 172.21.15.112:0/2145036028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f81630c0 0x7f46f806f510 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f46f00097c0 tx=0x7f46f001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35406fbf5dd3de9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46f5d9b640 1 -- 172.21.15.112:0/2145036028 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f00b1070 con 0x7f46f81630c0 2024-09-15T23:57:55.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46f5d9b640 1 -- 172.21.15.112:0/2145036028 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f00ac410 con 0x7f46f81630c0 2024-09-15T23:57:55.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46f5d9b640 1 -- 172.21.15.112:0/2145036028 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f00ac7e0 con 0x7f46f81630c0 2024-09-15T23:57:55.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46fd12b640 1 -- 172.21.15.112:0/2145036028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f81630c0 msgr2=0x7f46f806f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46fd12b640 1 --2- 172.21.15.112:0/2145036028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f81630c0 0x7f46f806f510 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f46f00097c0 tx=0x7f46f001c4a0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46fd12b640 1 -- 172.21.15.112:0/2145036028 shutdown_connections 2024-09-15T23:57:55.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46fd12b640 1 --2- 172.21.15.112:0/2145036028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46f806df70 0x7f46f81634a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.077+0000 7f46fd12b640 1 --2- 172.21.15.112:0/2145036028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f81630c0 0x7f46f806f510 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46fd12b640 1 -- 172.21.15.112:0/2145036028 >> 172.21.15.112:0/2145036028 conn(0x7f46f80b1f90 msgr2=0x7f46f80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:55.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46fd12b640 1 -- 172.21.15.112:0/2145036028 shutdown_connections 2024-09-15T23:57:55.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46fd12b640 1 -- 172.21.15.112:0/2145036028 wait complete. 2024-09-15T23:57:55.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46fd12b640 1 Processor -- start 2024-09-15T23:57:55.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46fd12b640 1 -- start start 2024-09-15T23:57:55.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46fd12b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46f806df70 0x7f46f81569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46fd12b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f80b3290 0x7f46f8073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46fd12b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46f81630c0 0x7f46f815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46fd12b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f46f8163b60 con 0x7f46f80b3290 2024-09-15T23:57:55.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46fd12b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46f81639e0 con 0x7f46f806df70 2024-09-15T23:57:55.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46fd12b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f46f816fe00 con 0x7f46f81630c0 2024-09-15T23:57:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46f659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f80b3290 0x7f46f8073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46f659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f80b3290 0x7f46f8073210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52560/0 (socket says 172.21.15.112:52560) 2024-09-15T23:57:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46f659c640 1 -- 172.21.15.112:0/3747865289 learned_addr learned my addr 172.21.15.112:0/3747865289 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46f759e640 1 --2- 172.21.15.112:0/3747865289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46f81630c0 0x7f46f815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46f6d9d640 1 --2- 172.21.15.112:0/3747865289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46f806df70 0x7f46f81569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46f659c640 1 -- 172.21.15.112:0/3747865289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46f81630c0 msgr2=0x7f46f815b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46f659c640 1 --2- 172.21.15.112:0/3747865289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46f81630c0 0x7f46f815b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46f659c640 1 -- 172.21.15.112:0/3747865289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46f806df70 msgr2=0x7f46f81569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46f659c640 1 --2- 172.21.15.112:0/3747865289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46f806df70 0x7f46f81569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46f659c640 1 -- 172.21.15.112:0/3747865289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f8155900 con 0x7f46f80b3290 2024-09-15T23:57:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46f659c640 1 --2- 172.21.15.112:0/3747865289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f80b3290 0x7f46f8073210 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f46ec007ef0 tx=0x7f46ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46df7fe640 1 -- 172.21.15.112:0/3747865289 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec014620 con 0x7f46f80b3290 2024-09-15T23:57:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46df7fe640 1 -- 172.21.15.112:0/3747865289 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46ec019070 con 0x7f46f80b3290 2024-09-15T23:57:55.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46fd12b640 1 -- 172.21.15.112:0/3747865289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f8155be0 con 0x7f46f80b3290 2024-09-15T23:57:55.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46df7fe640 1 -- 172.21.15.112:0/3747865289 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec014a00 con 0x7f46f80b3290 2024-09-15T23:57:55.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46fd12b640 1 -- 172.21.15.112:0/3747865289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f81561a0 con 0x7f46f80b3290 2024-09-15T23:57:55.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.081+0000 7f46fd12b640 1 -- 172.21.15.112:0/3747865289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f81634a0 con 0x7f46f80b3290 2024-09-15T23:57:55.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.085+0000 7f46df7fe640 1 -- 172.21.15.112:0/3747865289 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46ec014ba0 con 0x7f46f80b3290 2024-09-15T23:57:55.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.085+0000 7f46df7fe640 1 --2- 172.21.15.112:0/3747865289 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f46e40678f0 0x7f46e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.085+0000 7f46f6d9d640 1 --2- 172.21.15.112:0/3747865289 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f46e40678f0 0x7f46e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.085+0000 7f46df7fe640 1 -- 172.21.15.112:0/3747865289 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f46ec0867b0 con 0x7f46f80b3290 2024-09-15T23:57:55.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.085+0000 7f46f6d9d640 1 --2- 172.21.15.112:0/3747865289 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f46e40678f0 0x7f46e4069db0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f46f00ae000 tx=0x7f46f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.089+0000 7f46df7fe640 1 -- 172.21.15.112:0/3747865289 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f46ec057160 con 0x7f46f80b3290 2024-09-15T23:57:55.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.241+0000 7f46fd12b640 1 -- 172.21.15.112:0/3747865289 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46f80af340 con 0x7f46f80b3290 2024-09-15T23:57:55.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.241+0000 7f46df7fe640 1 -- 172.21.15.112:0/3747865289 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+17005 (secure 0 0 0) 0x7f46ec056a60 con 0x7f46f80b3290 2024-09-15T23:57:55.243 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:55.244 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":86,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:57:44.564540+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:40.583942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:41.884324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:55.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.245+0000 7f46fd12b640 1 -- 172.21.15.112:0/3747865289 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f46e40678f0 msgr2=0x7f46e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.245+0000 7f46fd12b640 1 --2- 172.21.15.112:0/3747865289 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f46e40678f0 0x7f46e4069db0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f46f00ae000 tx=0x7f46f0008040 comp rx=0 tx=0).stop 2024-09-15T23:57:55.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.245+0000 7f46fd12b640 1 -- 172.21.15.112:0/3747865289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f80b3290 msgr2=0x7f46f8073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.245+0000 7f46fd12b640 1 --2- 172.21.15.112:0/3747865289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f80b3290 0x7f46f8073210 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f46ec007ef0 tx=0x7f46ec00e4b0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.245+0000 7f46fd12b640 1 -- 172.21.15.112:0/3747865289 shutdown_connections 2024-09-15T23:57:55.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.245+0000 7f46fd12b640 1 --2- 172.21.15.112:0/3747865289 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f46e40678f0 0x7f46e4069db0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.245+0000 7f46fd12b640 1 --2- 172.21.15.112:0/3747865289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46f81630c0 0x7f46f815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.245+0000 7f46fd12b640 1 --2- 172.21.15.112:0/3747865289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46f80b3290 0x7f46f8073210 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.245+0000 7f46fd12b640 1 --2- 172.21.15.112:0/3747865289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46f806df70 0x7f46f81569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.245+0000 7f46fd12b640 1 -- 172.21.15.112:0/3747865289 >> 172.21.15.112:0/3747865289 conn(0x7f46f80b1f90 msgr2=0x7f46f80ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:55.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.245+0000 7f46fd12b640 1 -- 172.21.15.112:0/3747865289 shutdown_connections 2024-09-15T23:57:55.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.245+0000 7f46fd12b640 1 -- 172.21.15.112:0/3747865289 wait complete. 2024-09-15T23:57:55.261 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:57:55.261 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:55.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff99b5b0640 1 Processor -- start 2024-09-15T23:57:55.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff99b5b0640 1 -- start start 2024-09-15T23:57:55.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff99b5b0640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff9940b4460 0x7ff99406e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff99b5b0640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99406ee50 con 0x7ff99406fef0 2024-09-15T23:57:55.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff99b5b0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99406f130 con 0x7ff994073e60 2024-09-15T23:57:55.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff99b5b0640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff99406f410 con 0x7ff9940b4460 2024-09-15T23:57:55.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff999b4d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff9940b4460 0x7ff99406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff999b4d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff9940b4460 0x7ff99406e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52576/0 (socket says 172.21.15.112:52576) 2024-09-15T23:57:55.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff998b4b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff99406fef0 0x7ff9940b3d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52292/0 (socket says 172.21.15.112:52292) 2024-09-15T23:57:55.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff999b4d640 1 -- 172.21.15.112:0/2122304174 learned_addr learned my addr 172.21.15.112:0/2122304174 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:55.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff999b4d640 1 -- 172.21.15.112:0/2122304174 >> v1:172.21.15.169:6789/0 conn(0x7ff994073e60 legacy=0x7ff99415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:55.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff999b4d640 1 -- 172.21.15.112:0/2122304174 >> v1:172.21.15.112:6789/0 conn(0x7ff99406fef0 legacy=0x7ff9940b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff999b4d640 1 -- 172.21.15.112:0/2122304174 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99406f6f0 con 0x7ff9940b4460 2024-09-15T23:57:55.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff999b4d640 1 --2- 172.21.15.112:0/2122304174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9940b4460 0x7ff99406e800 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009e50 tx=0x7ff98c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0b3c33b90f6b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff98bfff640 1 -- 172.21.15.112:0/2122304174 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0a56b0 con 0x7ff9940b4460 2024-09-15T23:57:55.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff98bfff640 1 -- 172.21.15.112:0/2122304174 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff98c0a5850 con 0x7ff9940b4460 2024-09-15T23:57:55.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.369+0000 7ff98bfff640 1 -- 172.21.15.112:0/2122304174 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0a5c20 con 0x7ff9940b4460 2024-09-15T23:57:55.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 -- 172.21.15.112:0/2122304174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9940b4460 msgr2=0x7ff99406e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 --2- 172.21.15.112:0/2122304174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9940b4460 0x7ff99406e800 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009e50 tx=0x7ff98c01c960 comp rx=0 tx=0).stop 2024-09-15T23:57:55.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 -- 172.21.15.112:0/2122304174 shutdown_connections 2024-09-15T23:57:55.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 --2- 172.21.15.112:0/2122304174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9940b4460 0x7ff99406e800 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 -- 172.21.15.112:0/2122304174 >> 172.21.15.112:0/2122304174 conn(0x7ff9940b1f90 msgr2=0x7ff9940b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:55.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 -- 172.21.15.112:0/2122304174 shutdown_connections 2024-09-15T23:57:55.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 -- 172.21.15.112:0/2122304174 wait complete. 2024-09-15T23:57:55.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 Processor -- start 2024-09-15T23:57:55.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 -- start start 2024-09-15T23:57:55.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff99406fef0 0x7ff99414e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff994073e60 0x7ff994097620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9940b4460 0x7ff994097b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff994168340 con 0x7ff99406fef0 2024-09-15T23:57:55.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff9941681c0 con 0x7ff994073e60 2024-09-15T23:57:55.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff9941684c0 con 0x7ff9940b4460 2024-09-15T23:57:55.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99934c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff99406fef0 0x7ff99414e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99934c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff99406fef0 0x7ff99414e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52582/0 (socket says 172.21.15.112:52582) 2024-09-15T23:57:55.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99934c640 1 -- 172.21.15.112:0/3734016950 learned_addr learned my addr 172.21.15.112:0/3734016950 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:55.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff998b4b640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff994073e60 0x7ff994097620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff999b4d640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9940b4460 0x7ff994097b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99934c640 1 -- 172.21.15.112:0/3734016950 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9940b4460 msgr2=0x7ff994097b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99934c640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9940b4460 0x7ff994097b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99934c640 1 -- 172.21.15.112:0/3734016950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff994073e60 msgr2=0x7ff994097620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99934c640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff994073e60 0x7ff994097620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99934c640 1 -- 172.21.15.112:0/3734016950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff994152f10 con 0x7ff99406fef0 2024-09-15T23:57:55.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff999b4d640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9940b4460 0x7ff994097b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:55.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99934c640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff99406fef0 0x7ff99414e9a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff99000b440 tx=0x7ff99000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff989ffb640 1 -- 172.21.15.112:0/3734016950 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990015020 con 0x7ff99406fef0 2024-09-15T23:57:55.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff989ffb640 1 -- 172.21.15.112:0/3734016950 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff990011890 con 0x7ff99406fef0 2024-09-15T23:57:55.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff989ffb640 1 -- 172.21.15.112:0/3734016950 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990011c80 con 0x7ff99406fef0 2024-09-15T23:57:55.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 -- 172.21.15.112:0/3734016950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9941531f0 con 0x7ff99406fef0 2024-09-15T23:57:55.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.373+0000 7ff99b5b0640 1 -- 172.21.15.112:0/3734016950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9940989b0 con 0x7ff99406fef0 2024-09-15T23:57:55.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.377+0000 7ff99b5b0640 1 -- 172.21.15.112:0/3734016950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff99406e800 con 0x7ff99406fef0 2024-09-15T23:57:55.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.377+0000 7ff989ffb640 1 -- 172.21.15.112:0/3734016950 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff990018020 con 0x7ff99406fef0 2024-09-15T23:57:55.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.377+0000 7ff989ffb640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff9780678c0 0x7ff978069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.377+0000 7ff989ffb640 1 -- 172.21.15.112:0/3734016950 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7ff990085cf0 con 0x7ff99406fef0 2024-09-15T23:57:55.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.377+0000 7ff998b4b640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff9780678c0 0x7ff978069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.377+0000 7ff998b4b640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff9780678c0 0x7ff978069d80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff99415c750 tx=0x7ff984007cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.381+0000 7ff989ffb640 1 -- 172.21.15.112:0/3734016950 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff99001f030 con 0x7ff99406fef0 2024-09-15T23:57:55.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.561+0000 7ff99b5b0640 1 -- 172.21.15.112:0/3734016950 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9940723f0 con 0x7ff99406fef0 2024-09-15T23:57:55.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.565+0000 7ff989ffb640 1 -- 172.21.15.112:0/3734016950 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5234 (secure 0 0 0) 0x7ff99000d040 con 0x7ff99406fef0 2024-09-15T23:57:55.565 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:55.565 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":46,"btime":"2024-09-15T23:57:46:581351+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1475104986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1475104986},{"type":"v1","addr":"172.21.15.169:6835","nonce":1475104986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2253954019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2253954019},{"type":"v1","addr":"172.21.15.169:6834","nonce":2253954019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1645054566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1645054566},{"type":"v1","addr":"172.21.15.112:6835","nonce":1645054566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:42.896416+0000","modified":"2024-09-15T23:57:45.943939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6387":{"gid":6387,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/434676840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":434676840},{"type":"v1","addr":"172.21.15.112:6837","nonce":434676840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6387,"qdb_cluster":[6387]},"id":6}]} 2024-09-15T23:57:55.565 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 46 2024-09-15T23:57:55.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.565+0000 7ff99b5b0640 1 -- 172.21.15.112:0/3734016950 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff9780678c0 msgr2=0x7ff978069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.565+0000 7ff99b5b0640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff9780678c0 0x7ff978069d80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff99415c750 tx=0x7ff984007cf0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.565+0000 7ff99b5b0640 1 -- 172.21.15.112:0/3734016950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff99406fef0 msgr2=0x7ff99414e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.565+0000 7ff99b5b0640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff99406fef0 0x7ff99414e9a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff99000b440 tx=0x7ff99000b900 comp rx=0 tx=0).stop 2024-09-15T23:57:55.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.565+0000 7ff99b5b0640 1 -- 172.21.15.112:0/3734016950 shutdown_connections 2024-09-15T23:57:55.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.565+0000 7ff99b5b0640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff9780678c0 0x7ff978069d80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.565+0000 7ff99b5b0640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9940b4460 0x7ff994097b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.565+0000 7ff99b5b0640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff994073e60 0x7ff994097620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.565+0000 7ff99b5b0640 1 --2- 172.21.15.112:0/3734016950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff99406fef0 0x7ff99414e9a0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.565+0000 7ff99b5b0640 1 -- 172.21.15.112:0/3734016950 >> 172.21.15.112:0/3734016950 conn(0x7ff9940b1f90 msgr2=0x7ff994074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:55.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.565+0000 7ff99b5b0640 1 -- 172.21.15.112:0/3734016950 shutdown_connections 2024-09-15T23:57:55.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.565+0000 7ff99b5b0640 1 -- 172.21.15.112:0/3734016950 wait complete. 2024-09-15T23:57:55.583 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:55.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c660e7640 1 Processor -- start 2024-09-15T23:57:55.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c660e7640 1 -- start start 2024-09-15T23:57:55.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c660e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c6015f3a0 0x7f6c60165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c660e7640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c600aede0 con 0x7f6c60070020 2024-09-15T23:57:55.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c660e7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c6015fa10 con 0x7f6c601520a0 2024-09-15T23:57:55.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c660e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6c60152480 con 0x7f6c6015f3a0 2024-09-15T23:57:55.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5effd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6c60070020 0x7f6c6015ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52296/0 (socket says 172.21.15.112:52296) 2024-09-15T23:57:55.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5effd640 1 -- 172.21.15.112:0/3007615493 learned_addr learned my addr 172.21.15.112:0/3007615493 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:55.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 -- 172.21.15.112:0/3007615493 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1460969769 0 0) 0x7f6c600aede0 con 0x7f6c60070020 2024-09-15T23:57:55.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 -- 172.21.15.112:0/3007615493 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c48005740 con 0x7f6c60070020 2024-09-15T23:57:55.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5ffff640 1 --2- 172.21.15.112:0/3007615493 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c6015f3a0 0x7f6c60165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 -- 172.21.15.112:0/3007615493 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3075856911 0 0) 0x7f6c48005740 con 0x7f6c60070020 2024-09-15T23:57:55.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 -- 172.21.15.112:0/3007615493 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c6015f3a0 msgr2=0x7f6c60165f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 --2- 172.21.15.112:0/3007615493 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c6015f3a0 0x7f6c60165f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 -- 172.21.15.112:0/3007615493 >> v1:172.21.15.169:6789/0 conn(0x7f6c601520a0 legacy=0x7f6c6006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 -- 172.21.15.112:0/3007615493 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c60074250 con 0x7f6c60070020 2024-09-15T23:57:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 -- 172.21.15.112:0/3007615493 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f6c54001680 con 0x7f6c60070020 2024-09-15T23:57:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 -- 172.21.15.112:0/3007615493 >> v1:172.21.15.112:6789/0 conn(0x7f6c60070020 legacy=0x7f6c6015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 --2- 172.21.15.112:0/3007615493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c48005c00 0x7f6c48006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 --2- 172.21.15.112:0/3007615493 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c6015f3a0 0x7f6c48006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 --2- 172.21.15.112:0/3007615493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c48006f60 0x7f6c480073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 -- 172.21.15.112:0/3007615493 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4800dd70 con 0x7f6c48006f60 2024-09-15T23:57:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 -- 172.21.15.112:0/3007615493 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4800def0 con 0x7f6c48005c00 2024-09-15T23:57:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5e7fc640 1 -- 172.21.15.112:0/3007615493 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4800e0f0 con 0x7f6c6015f3a0 2024-09-15T23:57:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5ffff640 1 --2- 172.21.15.112:0/3007615493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c48006f60 0x7f6c480073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5f7fe640 1 --2- 172.21.15.112:0/3007615493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c48005c00 0x7f6c48006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5ffff640 1 -- 172.21.15.112:0/3007615493 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c6015f3a0 msgr2=0x7f6c48006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:55.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5effd640 1 --2- 172.21.15.112:0/3007615493 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c6015f3a0 0x7f6c48006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5ffff640 1 --2- 172.21.15.112:0/3007615493 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c6015f3a0 0x7f6c48006a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5ffff640 1 -- 172.21.15.112:0/3007615493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c48005c00 msgr2=0x7f6c48006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:55.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5ffff640 1 --2- 172.21.15.112:0/3007615493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c48005c00 0x7f6c48006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5ffff640 1 -- 172.21.15.112:0/3007615493 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c48005740 con 0x7f6c48006f60 2024-09-15T23:57:55.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.693+0000 7f6c5f7fe640 1 --2- 172.21.15.112:0/3007615493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c48005c00 0x7f6c48006020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:55.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5ffff640 1 --2- 172.21.15.112:0/3007615493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c48006f60 0x7f6c480073e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f6c58007360 tx=0x7f6c5801ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8593779e12d8c23b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5e7fc640 1 -- 172.21.15.112:0/3007615493 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c580b2070 con 0x7f6c48006f60 2024-09-15T23:57:55.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5e7fc640 1 -- 172.21.15.112:0/3007615493 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c580a5d40 con 0x7f6c48006f60 2024-09-15T23:57:55.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5e7fc640 1 -- 172.21.15.112:0/3007615493 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58009bc0 con 0x7f6c48006f60 2024-09-15T23:57:55.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c660e7640 1 -- 172.21.15.112:0/3007615493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c48006f60 msgr2=0x7f6c480073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c660e7640 1 --2- 172.21.15.112:0/3007615493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c48006f60 0x7f6c480073e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f6c58007360 tx=0x7f6c5801ce20 comp rx=0 tx=0).stop 2024-09-15T23:57:55.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5ffff640 1 -- 172.21.15.112:0/3007615493 reap_dead start 2024-09-15T23:57:55.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c660e7640 1 -- 172.21.15.112:0/3007615493 shutdown_connections 2024-09-15T23:57:55.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c660e7640 1 -- 172.21.15.112:0/3007615493 >> 172.21.15.112:0/3007615493 conn(0x7f6c600b1f90 msgr2=0x7f6c600b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:55.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c660e7640 1 -- 172.21.15.112:0/3007615493 shutdown_connections 2024-09-15T23:57:55.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c660e7640 1 -- 172.21.15.112:0/3007615493 wait complete. 2024-09-15T23:57:55.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c660e7640 1 Processor -- start 2024-09-15T23:57:55.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c660e7640 1 -- start start 2024-09-15T23:57:55.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c660e7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c48006f60 0x7f6c60148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c660e7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c60152480 0x7f6c6014be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c660e7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c6014c380 0x7f6c60150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c660e7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6c60073a50 con 0x7f6c48006f60 2024-09-15T23:57:55.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c660e7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6c60073770 con 0x7f6c6014c380 2024-09-15T23:57:55.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c660e7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6c60073d30 con 0x7f6c60152480 2024-09-15T23:57:55.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c48006f60 0x7f6c60148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c48006f60 0x7f6c60148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52608/0 (socket says 172.21.15.112:52608) 2024-09-15T23:57:55.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5f7fe640 1 -- 172.21.15.112:0/2299923814 learned_addr learned my addr 172.21.15.112:0/2299923814 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:55.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5effd640 1 --2- 172.21.15.112:0/2299923814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c60152480 0x7f6c6014be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5ffff640 1 --2- 172.21.15.112:0/2299923814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c6014c380 0x7f6c60150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5f7fe640 1 -- 172.21.15.112:0/2299923814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c60152480 msgr2=0x7f6c6014be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5f7fe640 1 --2- 172.21.15.112:0/2299923814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c60152480 0x7f6c6014be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5f7fe640 1 -- 172.21.15.112:0/2299923814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c6014c380 msgr2=0x7f6c60150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5f7fe640 1 --2- 172.21.15.112:0/2299923814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c6014c380 0x7f6c60150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5f7fe640 1 -- 172.21.15.112:0/2299923814 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c601f00f0 con 0x7f6c48006f60 2024-09-15T23:57:55.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.697+0000 7f6c5f7fe640 1 --2- 172.21.15.112:0/2299923814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c48006f60 0x7f6c60148de0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000d7a0 tx=0x7f6c5000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.701+0000 7f6c47fff640 1 -- 172.21.15.112:0/2299923814 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c50005270 con 0x7f6c48006f60 2024-09-15T23:57:55.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.701+0000 7f6c47fff640 1 -- 172.21.15.112:0/2299923814 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c50017070 con 0x7f6c48006f60 2024-09-15T23:57:55.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.701+0000 7f6c660e7640 1 -- 172.21.15.112:0/2299923814 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c601f03d0 con 0x7f6c48006f60 2024-09-15T23:57:55.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.701+0000 7f6c47fff640 1 -- 172.21.15.112:0/2299923814 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5000b6b0 con 0x7f6c48006f60 2024-09-15T23:57:55.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.701+0000 7f6c660e7640 1 -- 172.21.15.112:0/2299923814 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c601f0990 con 0x7f6c48006f60 2024-09-15T23:57:55.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.701+0000 7f6c660e7640 1 -- 172.21.15.112:0/2299923814 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c6015ec90 con 0x7f6c48006f60 2024-09-15T23:57:55.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.701+0000 7f6c47fff640 1 -- 172.21.15.112:0/2299923814 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c5000b850 con 0x7f6c48006f60 2024-09-15T23:57:55.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.701+0000 7f6c47fff640 1 --2- 172.21.15.112:0/2299923814 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6c4c0678c0 0x7f6c4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.701+0000 7f6c5effd640 1 --2- 172.21.15.112:0/2299923814 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6c4c0678c0 0x7f6c4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.701+0000 7f6c47fff640 1 -- 172.21.15.112:0/2299923814 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f6c50085d10 con 0x7f6c48006f60 2024-09-15T23:57:55.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.701+0000 7f6c5effd640 1 --2- 172.21.15.112:0/2299923814 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6c4c0678c0 0x7f6c4c069d80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6c54001ec0 tx=0x7f6c54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.705+0000 7f6c47fff640 1 -- 172.21.15.112:0/2299923814 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6c50019310 con 0x7f6c48006f60 2024-09-15T23:57:55.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.885+0000 7f6c660e7640 1 -- 172.21.15.112:0/2299923814 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c6014d020 con 0x7f6c48006f60 2024-09-15T23:57:55.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.889+0000 7f6c47fff640 1 -- 172.21.15.112:0/2299923814 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5234 (secure 0 0 0) 0x7f6c50056750 con 0x7f6c48006f60 2024-09-15T23:57:55.888 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:55.889 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":46,"btime":"2024-09-15T23:57:46:581351+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1475104986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1475104986},{"type":"v1","addr":"172.21.15.169:6835","nonce":1475104986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2253954019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2253954019},{"type":"v1","addr":"172.21.15.169:6834","nonce":2253954019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1645054566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1645054566},{"type":"v1","addr":"172.21.15.112:6835","nonce":1645054566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:42.896416+0000","modified":"2024-09-15T23:57:45.943939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6387":{"gid":6387,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/434676840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":434676840},{"type":"v1","addr":"172.21.15.112:6837","nonce":434676840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6387,"qdb_cluster":[6387]},"id":6}]} 2024-09-15T23:57:55.889 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 46 2024-09-15T23:57:55.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.889+0000 7f6c660e7640 1 -- 172.21.15.112:0/2299923814 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6c4c0678c0 msgr2=0x7f6c4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.889+0000 7f6c660e7640 1 --2- 172.21.15.112:0/2299923814 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6c4c0678c0 0x7f6c4c069d80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6c54001ec0 tx=0x7f6c54009040 comp rx=0 tx=0).stop 2024-09-15T23:57:55.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.889+0000 7f6c660e7640 1 -- 172.21.15.112:0/2299923814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c48006f60 msgr2=0x7f6c60148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.889+0000 7f6c660e7640 1 --2- 172.21.15.112:0/2299923814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c48006f60 0x7f6c60148de0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000d7a0 tx=0x7f6c5000dc60 comp rx=0 tx=0).stop 2024-09-15T23:57:55.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.889+0000 7f6c660e7640 1 -- 172.21.15.112:0/2299923814 shutdown_connections 2024-09-15T23:57:55.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.889+0000 7f6c660e7640 1 --2- 172.21.15.112:0/2299923814 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6c4c0678c0 0x7f6c4c069d80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.889+0000 7f6c660e7640 1 --2- 172.21.15.112:0/2299923814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c6014c380 0x7f6c60150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.889+0000 7f6c660e7640 1 --2- 172.21.15.112:0/2299923814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c60152480 0x7f6c6014be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.889+0000 7f6c660e7640 1 --2- 172.21.15.112:0/2299923814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c48006f60 0x7f6c60148de0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.889+0000 7f6c660e7640 1 -- 172.21.15.112:0/2299923814 >> 172.21.15.112:0/2299923814 conn(0x7f6c600b1f90 msgr2=0x7f6c600d0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:55.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.889+0000 7f6c660e7640 1 -- 172.21.15.112:0/2299923814 shutdown_connections 2024-09-15T23:57:55.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:55.889+0000 7f6c660e7640 1 -- 172.21.15.112:0/2299923814 wait complete. 2024-09-15T23:57:55.906 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:56.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.025+0000 7efe420c8640 1 Processor -- start 2024-09-15T23:57:56.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.025+0000 7efe420c8640 1 -- start start 2024-09-15T23:57:56.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe420c8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efe3c06c6d0 0x7efe3c0b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe420c8640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe3c162290 con 0x7efe3c0cf950 2024-09-15T23:57:56.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe420c8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe3c162570 con 0x7efe3c15e6f0 2024-09-15T23:57:56.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe420c8640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7efe3c0b3c60 con 0x7efe3c06c6d0 2024-09-15T23:57:56.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe3affd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efe3c0cf950 0x7efe3c0ae2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52300/0 (socket says 172.21.15.112:52300) 2024-09-15T23:57:56.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe3affd640 1 -- 172.21.15.112:0/2041490278 learned_addr learned my addr 172.21.15.112:0/2041490278 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:56.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe3bfff640 1 --2- 172.21.15.112:0/2041490278 >> v2:172.21.15.112:3300/0 conn(0x7efe3c06c6d0 0x7efe3c0b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe3a7fc640 1 -- 172.21.15.112:0/2041490278 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1890306495 0 0) 0x7efe3c162290 con 0x7efe3c0cf950 2024-09-15T23:57:56.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe3a7fc640 1 -- 172.21.15.112:0/2041490278 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe24003530 con 0x7efe3c0cf950 2024-09-15T23:57:56.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe3bfff640 1 -- 172.21.15.112:0/2041490278 >> v1:172.21.15.169:6789/0 conn(0x7efe3c15e6f0 legacy=0x7efe3c0cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe3bfff640 1 -- 172.21.15.112:0/2041490278 >> v1:172.21.15.112:6789/0 conn(0x7efe3c0cf950 legacy=0x7efe3c0ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.030 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe3bfff640 1 -- 172.21.15.112:0/2041490278 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c162850 con 0x7efe3c06c6d0 2024-09-15T23:57:56.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe3bfff640 1 --2- 172.21.15.112:0/2041490278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe3c06c6d0 0x7efe3c0b3720 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7efe34009d90 tx=0x7efe3401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b936f366abe480 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe3a7fc640 1 -- 172.21.15.112:0/2041490278 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe340b2070 con 0x7efe3c06c6d0 2024-09-15T23:57:56.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe3a7fc640 1 -- 172.21.15.112:0/2041490278 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe340a5830 con 0x7efe3c06c6d0 2024-09-15T23:57:56.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.029+0000 7efe3a7fc640 1 -- 172.21.15.112:0/2041490278 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe340a5be0 con 0x7efe3c06c6d0 2024-09-15T23:57:56.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 -- 172.21.15.112:0/2041490278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe3c06c6d0 msgr2=0x7efe3c0b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 --2- 172.21.15.112:0/2041490278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe3c06c6d0 0x7efe3c0b3720 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7efe34009d90 tx=0x7efe3401c970 comp rx=0 tx=0).stop 2024-09-15T23:57:56.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 -- 172.21.15.112:0/2041490278 shutdown_connections 2024-09-15T23:57:56.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 --2- 172.21.15.112:0/2041490278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe3c06c6d0 0x7efe3c0b3720 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 -- 172.21.15.112:0/2041490278 >> 172.21.15.112:0/2041490278 conn(0x7efe3c09aa00 msgr2=0x7efe3c0b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:56.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 -- 172.21.15.112:0/2041490278 shutdown_connections 2024-09-15T23:57:56.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 -- 172.21.15.112:0/2041490278 wait complete. 2024-09-15T23:57:56.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 Processor -- start 2024-09-15T23:57:56.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 -- start start 2024-09-15T23:57:56.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe3c06c6d0 0x7efe3c0b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe3c0cf950 0x7efe3c150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe3c15e6f0 0x7efe3c161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c16c230 con 0x7efe3c06c6d0 2024-09-15T23:57:56.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c0af420 con 0x7efe3c15e6f0 2024-09-15T23:57:56.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c16c3b0 con 0x7efe3c0cf950 2024-09-15T23:57:56.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe3b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe3c06c6d0 0x7efe3c0b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe3b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe3c06c6d0 0x7efe3c0b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52628/0 (socket says 172.21.15.112:52628) 2024-09-15T23:57:56.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe3b7fe640 1 -- 172.21.15.112:0/2049900724 learned_addr learned my addr 172.21.15.112:0/2049900724 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:56.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe3affd640 1 --2- 172.21.15.112:0/2049900724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe3c0cf950 0x7efe3c150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe3bfff640 1 --2- 172.21.15.112:0/2049900724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe3c15e6f0 0x7efe3c161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe3b7fe640 1 -- 172.21.15.112:0/2049900724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe3c0cf950 msgr2=0x7efe3c150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe3b7fe640 1 --2- 172.21.15.112:0/2049900724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe3c0cf950 0x7efe3c150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe3b7fe640 1 -- 172.21.15.112:0/2049900724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe3c15e6f0 msgr2=0x7efe3c161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe3b7fe640 1 --2- 172.21.15.112:0/2049900724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe3c15e6f0 0x7efe3c161760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe3b7fe640 1 -- 172.21.15.112:0/2049900724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c0b13a0 con 0x7efe3c06c6d0 2024-09-15T23:57:56.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe3b7fe640 1 --2- 172.21.15.112:0/2049900724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe3c06c6d0 0x7efe3c0b2440 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00c3f0 tx=0x7efe2c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe23fff640 1 -- 172.21.15.112:0/2049900724 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c017070 con 0x7efe3c06c6d0 2024-09-15T23:57:56.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe23fff640 1 -- 172.21.15.112:0/2049900724 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe2c0052d0 con 0x7efe3c06c6d0 2024-09-15T23:57:56.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe23fff640 1 -- 172.21.15.112:0/2049900724 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c003840 con 0x7efe3c06c6d0 2024-09-15T23:57:56.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 -- 172.21.15.112:0/2049900724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3c0b1680 con 0x7efe3c06c6d0 2024-09-15T23:57:56.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 -- 172.21.15.112:0/2049900724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3c0b1c40 con 0x7efe3c06c6d0 2024-09-15T23:57:56.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.033+0000 7efe420c8640 1 -- 172.21.15.112:0/2049900724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe3c0b3720 con 0x7efe3c06c6d0 2024-09-15T23:57:56.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.037+0000 7efe23fff640 1 -- 172.21.15.112:0/2049900724 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe2c01a070 con 0x7efe3c06c6d0 2024-09-15T23:57:56.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.037+0000 7efe23fff640 1 --2- 172.21.15.112:0/2049900724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe280678c0 0x7efe28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.037+0000 7efe23fff640 1 -- 172.21.15.112:0/2049900724 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7efe2c085140 con 0x7efe3c06c6d0 2024-09-15T23:57:56.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.037+0000 7efe3affd640 1 --2- 172.21.15.112:0/2049900724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe280678c0 0x7efe28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.037+0000 7efe3affd640 1 --2- 172.21.15.112:0/2049900724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe280678c0 0x7efe28069d80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0b2bc0 tx=0x7efe30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.041 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.041+0000 7efe23fff640 1 -- 172.21.15.112:0/2049900724 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe2c005480 con 0x7efe3c06c6d0 2024-09-15T23:57:56.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.189+0000 7efe420c8640 1 -- 172.21.15.112:0/2049900724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe3c169d80 con 0x7efe3c06c6d0 2024-09-15T23:57:56.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.193+0000 7efe23fff640 1 -- 172.21.15.112:0/2049900724 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+17005 (secure 0 0 0) 0x7efe2c055b80 con 0x7efe3c06c6d0 2024-09-15T23:57:56.192 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:57:56.193 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":86,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:57:44.564540+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:40.583942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:41.884324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:56.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.193+0000 7efe420c8640 1 -- 172.21.15.112:0/2049900724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe280678c0 msgr2=0x7efe28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.193+0000 7efe420c8640 1 --2- 172.21.15.112:0/2049900724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe280678c0 0x7efe28069d80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0b2bc0 tx=0x7efe30009040 comp rx=0 tx=0).stop 2024-09-15T23:57:56.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.193+0000 7efe420c8640 1 -- 172.21.15.112:0/2049900724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe3c06c6d0 msgr2=0x7efe3c0b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.193+0000 7efe420c8640 1 --2- 172.21.15.112:0/2049900724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe3c06c6d0 0x7efe3c0b2440 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00c3f0 tx=0x7efe2c00c8b0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.197+0000 7efe420c8640 1 -- 172.21.15.112:0/2049900724 shutdown_connections 2024-09-15T23:57:56.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.197+0000 7efe420c8640 1 --2- 172.21.15.112:0/2049900724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe280678c0 0x7efe28069d80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.197+0000 7efe420c8640 1 --2- 172.21.15.112:0/2049900724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe3c15e6f0 0x7efe3c161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.197+0000 7efe420c8640 1 --2- 172.21.15.112:0/2049900724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe3c0cf950 0x7efe3c150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.197+0000 7efe420c8640 1 --2- 172.21.15.112:0/2049900724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe3c06c6d0 0x7efe3c0b2440 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.197+0000 7efe420c8640 1 -- 172.21.15.112:0/2049900724 >> 172.21.15.112:0/2049900724 conn(0x7efe3c09aa00 msgr2=0x7efe3c0ae2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:56.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.197+0000 7efe420c8640 1 -- 172.21.15.112:0/2049900724 shutdown_connections 2024-09-15T23:57:56.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.197+0000 7efe420c8640 1 -- 172.21.15.112:0/2049900724 wait complete. 2024-09-15T23:57:56.212 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:57:56.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b2ad1a640 1 Processor -- start 2024-09-15T23:57:56.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b2ad1a640 1 -- start start 2024-09-15T23:57:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b2ad1a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b2415c2a0 0x7f9b240aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b2ad1a640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9b240af2a0 0x7f9b2406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b2ad1a640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b240b3290 con 0x7f9b2415bec0 2024-09-15T23:57:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b2ad1a640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9b240b3570 con 0x7f9b240af2a0 2024-09-15T23:57:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b2ad1a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9b240b3850 con 0x7f9b2415c2a0 2024-09-15T23:57:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b28ab6640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9b2415bec0 0x7f9b240ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:52316/0 (socket says 172.21.15.112:52316) 2024-09-15T23:57:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b28ab6640 1 -- 172.21.15.112:0/3654288390 learned_addr learned my addr 172.21.15.112:0/3654288390 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b292b7640 1 --2- 172.21.15.112:0/3654288390 >> v2:172.21.15.112:3300/0 conn(0x7f9b240af2a0 0x7f9b2406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b23fff640 1 --2- 172.21.15.112:0/3654288390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b2415c2a0 0x7f9b240aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b237fe640 1 -- 172.21.15.112:0/3654288390 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151715064 0 0) 0x7f9b240b3290 con 0x7f9b2415bec0 2024-09-15T23:57:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b237fe640 1 -- 172.21.15.112:0/3654288390 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b0c003530 con 0x7f9b2415bec0 2024-09-15T23:57:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b292b7640 1 -- 172.21.15.112:0/3654288390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b2415c2a0 msgr2=0x7f9b240aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:56.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b292b7640 1 --2- 172.21.15.112:0/3654288390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b2415c2a0 0x7f9b240aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b292b7640 1 -- 172.21.15.112:0/3654288390 >> v1:172.21.15.112:6789/0 conn(0x7f9b2415bec0 legacy=0x7f9b240ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b237fe640 1 -- 172.21.15.112:0/3654288390 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3922861851 0 0) 0x7f9b0c003530 con 0x7f9b2415bec0 2024-09-15T23:57:56.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b292b7640 1 -- 172.21.15.112:0/3654288390 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b240b3b30 con 0x7f9b240af2a0 2024-09-15T23:57:56.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.329+0000 7f9b23fff640 1 --2- 172.21.15.112:0/3654288390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b2415c2a0 0x7f9b240aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:57:56.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.333+0000 7f9b292b7640 1 --2- 172.21.15.112:0/3654288390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b240af2a0 0x7f9b2406e000 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009d90 tx=0x7f9b1c01c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1235a5c43755cca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.333+0000 7f9b237fe640 1 -- 172.21.15.112:0/3654288390 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c0b2070 con 0x7f9b240af2a0 2024-09-15T23:57:56.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.333+0000 7f9b237fe640 1 -- 172.21.15.112:0/3654288390 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1c0a5660 con 0x7f9b240af2a0 2024-09-15T23:57:56.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.333+0000 7f9b237fe640 1 -- 172.21.15.112:0/3654288390 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14001680 con 0x7f9b240af2a0 2024-09-15T23:57:56.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.333+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/3654288390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b240af2a0 msgr2=0x7f9b2406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.333+0000 7f9b2ad1a640 1 --2- 172.21.15.112:0/3654288390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b240af2a0 0x7f9b2406e000 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009d90 tx=0x7f9b1c01c860 comp rx=0 tx=0).stop 2024-09-15T23:57:56.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.333+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/3654288390 shutdown_connections 2024-09-15T23:57:56.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.333+0000 7f9b2ad1a640 1 --2- 172.21.15.112:0/3654288390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b240af2a0 0x7f9b2406e000 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.333+0000 7f9b2ad1a640 1 --2- 172.21.15.112:0/3654288390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b2415c2a0 0x7f9b240aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.333+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/3654288390 >> 172.21.15.112:0/3654288390 conn(0x7f9b240b1f90 msgr2=0x7f9b240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:56.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.333+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/3654288390 shutdown_connections 2024-09-15T23:57:56.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.333+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/3654288390 wait complete. 2024-09-15T23:57:56.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.333+0000 7f9b2ad1a640 1 Processor -- start 2024-09-15T23:57:56.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.333+0000 7f9b2ad1a640 1 -- start start 2024-09-15T23:57:56.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b2ad1a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b240af2a0 0x7f9b240999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b2ad1a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b2415bec0 0x7f9b2409a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b2ad1a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b2415c2a0 0x7f9b2414b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b2ad1a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2406ed50 con 0x7f9b2415bec0 2024-09-15T23:57:56.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b2ad1a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9b240afc90 con 0x7f9b2415c2a0 2024-09-15T23:57:56.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b2ad1a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9b2406eed0 con 0x7f9b240af2a0 2024-09-15T23:57:56.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b23fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b2415bec0 0x7f9b2409a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b23fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b2415bec0 0x7f9b2409a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52646/0 (socket says 172.21.15.112:52646) 2024-09-15T23:57:56.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b23fff640 1 -- 172.21.15.112:0/4263698670 learned_addr learned my addr 172.21.15.112:0/4263698670 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:56.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b23fff640 1 -- 172.21.15.112:0/4263698670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b240af2a0 msgr2=0x7f9b240999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b292b7640 1 --2- 172.21.15.112:0/4263698670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b2415c2a0 0x7f9b2414b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b28ab6640 1 --2- 172.21.15.112:0/4263698670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b240af2a0 0x7f9b240999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b23fff640 1 --2- 172.21.15.112:0/4263698670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b240af2a0 0x7f9b240999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b23fff640 1 -- 172.21.15.112:0/4263698670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b2415c2a0 msgr2=0x7f9b2414b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b23fff640 1 --2- 172.21.15.112:0/4263698670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b2415c2a0 0x7f9b2414b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b23fff640 1 -- 172.21.15.112:0/4263698670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b24075040 con 0x7f9b2415bec0 2024-09-15T23:57:56.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b23fff640 1 --2- 172.21.15.112:0/4263698670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b2415bec0 0x7f9b2409a280 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800d800 tx=0x7f9b1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b217fa640 1 -- 172.21.15.112:0/4263698670 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1800b6c0 con 0x7f9b2415bec0 2024-09-15T23:57:56.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b217fa640 1 -- 172.21.15.112:0/4263698670 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b18019070 con 0x7f9b2415bec0 2024-09-15T23:57:56.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/4263698670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b240757d0 con 0x7f9b2415bec0 2024-09-15T23:57:56.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b217fa640 1 -- 172.21.15.112:0/4263698670 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1800baa0 con 0x7f9b2415bec0 2024-09-15T23:57:56.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/4263698670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b24154fb0 con 0x7f9b2415bec0 2024-09-15T23:57:56.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/4263698670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b2406f230 con 0x7f9b2415bec0 2024-09-15T23:57:56.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b217fa640 1 -- 172.21.15.112:0/4263698670 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b1800bc40 con 0x7f9b2415bec0 2024-09-15T23:57:56.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b217fa640 1 --2- 172.21.15.112:0/4263698670 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9b100678c0 0x7f9b10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b217fa640 1 -- 172.21.15.112:0/4263698670 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f9b18086230 con 0x7f9b2415bec0 2024-09-15T23:57:56.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b28ab6640 1 --2- 172.21.15.112:0/4263698670 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9b100678c0 0x7f9b10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.337+0000 7f9b28ab6640 1 --2- 172.21.15.112:0/4263698670 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9b100678c0 0x7f9b10069d80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9b140011f0 tx=0x7f9b14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.341+0000 7f9b217fa640 1 -- 172.21.15.112:0/4263698670 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9b18056be0 con 0x7f9b2415bec0 2024-09-15T23:57:56.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.525+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/4263698670 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9b241535f0 con 0x7f9b2415bec0 2024-09-15T23:57:56.528 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-15T23:57:56.525+0000 7fae14e39640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:57:56.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.529+0000 7f9b217fa640 1 -- 172.21.15.112:0/4263698670 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) ==== 161+0+0 (secure 0 0 0) 0x7f9b180564e0 con 0x7f9b2415bec0 2024-09-15T23:57:56.530 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:57:56.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.533+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/4263698670 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9b100678c0 msgr2=0x7f9b10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.533+0000 7f9b2ad1a640 1 --2- 172.21.15.112:0/4263698670 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9b100678c0 0x7f9b10069d80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9b140011f0 tx=0x7f9b14009040 comp rx=0 tx=0).stop 2024-09-15T23:57:56.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.533+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/4263698670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b2415bec0 msgr2=0x7f9b2409a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.533+0000 7f9b2ad1a640 1 --2- 172.21.15.112:0/4263698670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b2415bec0 0x7f9b2409a280 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800d800 tx=0x7f9b1800dcc0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.533+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/4263698670 shutdown_connections 2024-09-15T23:57:56.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.533+0000 7f9b2ad1a640 1 --2- 172.21.15.112:0/4263698670 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9b100678c0 0x7f9b10069d80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.533+0000 7f9b2ad1a640 1 --2- 172.21.15.112:0/4263698670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b2415c2a0 0x7f9b2414b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.533+0000 7f9b2ad1a640 1 --2- 172.21.15.112:0/4263698670 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b2415bec0 0x7f9b2409a280 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.533+0000 7f9b2ad1a640 1 --2- 172.21.15.112:0/4263698670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b240af2a0 0x7f9b240999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.533+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/4263698670 >> 172.21.15.112:0/4263698670 conn(0x7f9b240b1f90 msgr2=0x7f9b240cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:56.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.533+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/4263698670 shutdown_connections 2024-09-15T23:57:56.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.533+0000 7f9b2ad1a640 1 -- 172.21.15.112:0/4263698670 wait complete. 2024-09-15T23:57:56.537 INFO:tasks.ceph.mds.a.smithi112.stderr: -2654> 2024-09-15T23:57:49.513+0000 7f057f180640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:57:56.551 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:57:56.566 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-15T23:57:56.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc56ef0b640 1 Processor -- start 2024-09-15T23:57:56.662 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc56ef0b640 1 -- start start 2024-09-15T23:57:56.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc56ef0b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc568161a60 0x7fc5680d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc56ef0b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc5680d2e90 0x7fc5680cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc56ef0b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5680d32b0 con 0x7fc5680cf450 2024-09-15T23:57:56.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc56ef0b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc5680d0300 con 0x7fc5680d2e90 2024-09-15T23:57:56.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc56ef0b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc56806e6c0 con 0x7fc568161a60 2024-09-15T23:57:56.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc567fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc5680d2e90 0x7fc5680cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc567fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc5680d2e90 0x7fc5680cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52680/0 (socket says 172.21.15.112:52680) 2024-09-15T23:57:56.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc567fff640 1 -- 172.21.15.112:0/932668280 learned_addr learned my addr 172.21.15.112:0/932668280 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:56.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc56cca7640 1 --2- 172.21.15.112:0/932668280 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc568161a60 0x7fc5680d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc567fff640 1 -- 172.21.15.112:0/932668280 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc568161a60 msgr2=0x7fc5680d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:56.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc567fff640 1 --2- 172.21.15.112:0/932668280 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc568161a60 0x7fc5680d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc567fff640 1 -- 172.21.15.112:0/932668280 >> v1:172.21.15.169:6789/0 conn(0x7fc5680cf450 legacy=0x7fc5680d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:56.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.661+0000 7fc567fff640 1 -- 172.21.15.112:0/932668280 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5680b0f60 con 0x7fc5680d2e90 2024-09-15T23:57:56.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.665+0000 7fc567fff640 1 --2- 172.21.15.112:0/932668280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5680d2e90 0x7fc5680cef10 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009870 tx=0x7fc55c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f398345b4cd8863 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.665+0000 7fc5677fe640 1 -- 172.21.15.112:0/932668280 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5680d1930 con 0x7fc5680d2e90 2024-09-15T23:57:56.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.665+0000 7fc5677fe640 1 -- 172.21.15.112:0/932668280 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55c0b0070 con 0x7fc5680d2e90 2024-09-15T23:57:56.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.665+0000 7fc5677fe640 1 -- 172.21.15.112:0/932668280 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c0ab840 con 0x7fc5680d2e90 2024-09-15T23:57:56.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.665+0000 7fc56ef0b640 1 -- 172.21.15.112:0/932668280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5680d2e90 msgr2=0x7fc5680cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.665+0000 7fc56ef0b640 1 --2- 172.21.15.112:0/932668280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5680d2e90 0x7fc5680cef10 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009870 tx=0x7fc55c01c460 comp rx=0 tx=0).stop 2024-09-15T23:57:56.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.665+0000 7fc56ef0b640 1 -- 172.21.15.112:0/932668280 shutdown_connections 2024-09-15T23:57:56.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.665+0000 7fc56ef0b640 1 --2- 172.21.15.112:0/932668280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5680d2e90 0x7fc5680cef10 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.665+0000 7fc56ef0b640 1 --2- 172.21.15.112:0/932668280 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc568161a60 0x7fc5680d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.665+0000 7fc56ef0b640 1 -- 172.21.15.112:0/932668280 >> 172.21.15.112:0/932668280 conn(0x7fc56808bf90 msgr2=0x7fc56809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:56.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.665+0000 7fc56ef0b640 1 -- 172.21.15.112:0/932668280 shutdown_connections 2024-09-15T23:57:56.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.665+0000 7fc56ef0b640 1 -- 172.21.15.112:0/932668280 wait complete. 2024-09-15T23:57:56.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56ef0b640 1 Processor -- start 2024-09-15T23:57:56.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56ef0b640 1 -- start start 2024-09-15T23:57:56.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56ef0b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5680cf450 0x7fc5680cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56ef0b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5680d2e90 0x7fc56815d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56ef0b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc568161a60 0x7fc56815c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56ef0b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc5680cf900 con 0x7fc568161a60 2024-09-15T23:57:56.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56ef0b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc56806d190 con 0x7fc5680d2e90 2024-09-15T23:57:56.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56ef0b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc5680cfa80 con 0x7fc5680cf450 2024-09-15T23:57:56.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56d4a8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc568161a60 0x7fc56815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56d4a8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc568161a60 0x7fc56815c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52682/0 (socket says 172.21.15.112:52682) 2024-09-15T23:57:56.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56d4a8640 1 -- 172.21.15.112:0/3601019844 learned_addr learned my addr 172.21.15.112:0/3601019844 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:56.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56cca7640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5680cf450 0x7fc5680cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc567fff640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5680d2e90 0x7fc56815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56d4a8640 1 -- 172.21.15.112:0/3601019844 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5680cf450 msgr2=0x7fc5680cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56d4a8640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5680cf450 0x7fc5680cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56d4a8640 1 -- 172.21.15.112:0/3601019844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5680d2e90 msgr2=0x7fc56815d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56d4a8640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5680d2e90 0x7fc56815d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56d4a8640 1 -- 172.21.15.112:0/3601019844 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56815acb0 con 0x7fc568161a60 2024-09-15T23:57:56.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56cca7640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5680cf450 0x7fc5680cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:56.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc567fff640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5680d2e90 0x7fc56815d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:56.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56d4a8640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc568161a60 0x7fc56815c890 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc56000c3c0 tx=0x7fc56000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc5657fa640 1 -- 172.21.15.112:0/3601019844 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560011790 con 0x7fc568161a60 2024-09-15T23:57:56.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc5657fa640 1 -- 172.21.15.112:0/3601019844 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc560017070 con 0x7fc568161a60 2024-09-15T23:57:56.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56ef0b640 1 -- 172.21.15.112:0/3601019844 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5680cdd80 con 0x7fc568161a60 2024-09-15T23:57:56.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc5657fa640 1 -- 172.21.15.112:0/3601019844 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560011b70 con 0x7fc568161a60 2024-09-15T23:57:56.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56ef0b640 1 -- 172.21.15.112:0/3601019844 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56815dbd0 con 0x7fc568161a60 2024-09-15T23:57:56.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56ef0b640 1 -- 172.21.15.112:0/3601019844 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5680cef10 con 0x7fc568161a60 2024-09-15T23:57:56.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc5657fa640 1 -- 172.21.15.112:0/3601019844 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc560011d10 con 0x7fc568161a60 2024-09-15T23:57:56.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc5657fa640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc5540678c0 0x7fc554069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56cca7640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc5540678c0 0x7fc554069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc5657fa640 1 -- 172.21.15.112:0/3601019844 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7fc560085c20 con 0x7fc568161a60 2024-09-15T23:57:56.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.669+0000 7fc56cca7640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc5540678c0 0x7fc554069d80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc5680ba1a0 tx=0x7fc558007420 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.673+0000 7fc5657fa640 1 -- 172.21.15.112:0/3601019844 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc5680cdd80 con 0x7fc568161a60 2024-09-15T23:57:56.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:56.857+0000 7fc56ef0b640 1 -- 172.21.15.112:0/3601019844 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc5680b1500 con 0x7fc568161a60 2024-09-15T23:57:57.533 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.533+0000 7fc5657fa640 1 -- 172.21.15.112:0/3601019844 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v48) ==== 104+0+0 (secure 0 0 0) 0x7fc560056580 con 0x7fc568161a60 2024-09-15T23:57:57.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.537+0000 7fc56ef0b640 1 -- 172.21.15.112:0/3601019844 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc5540678c0 msgr2=0x7fc554069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.537+0000 7fc56ef0b640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc5540678c0 0x7fc554069d80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc5680ba1a0 tx=0x7fc558007420 comp rx=0 tx=0).stop 2024-09-15T23:57:57.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.537+0000 7fc56ef0b640 1 -- 172.21.15.112:0/3601019844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc568161a60 msgr2=0x7fc56815c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.537+0000 7fc56ef0b640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc568161a60 0x7fc56815c890 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc56000c3c0 tx=0x7fc56000c880 comp rx=0 tx=0).stop 2024-09-15T23:57:57.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.537+0000 7fc56ef0b640 1 -- 172.21.15.112:0/3601019844 shutdown_connections 2024-09-15T23:57:57.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.537+0000 7fc56ef0b640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc5540678c0 0x7fc554069d80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.537+0000 7fc56ef0b640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc568161a60 0x7fc56815c890 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.537+0000 7fc56ef0b640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5680d2e90 0x7fc56815d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.537+0000 7fc56ef0b640 1 --2- 172.21.15.112:0/3601019844 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc5680cf450 0x7fc5680cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.537+0000 7fc56ef0b640 1 -- 172.21.15.112:0/3601019844 >> 172.21.15.112:0/3601019844 conn(0x7fc56808bf90 msgr2=0x7fc5680b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:57.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.537+0000 7fc56ef0b640 1 -- 172.21.15.112:0/3601019844 shutdown_connections 2024-09-15T23:57:57.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.537+0000 7fc56ef0b640 1 -- 172.21.15.112:0/3601019844 wait complete. 2024-09-15T23:57:57.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:57:57.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f8692510640 1 Processor -- start 2024-09-15T23:57:57.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f8692510640 1 -- start start 2024-09-15T23:57:57.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f8692510640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f868c15bec0 0x7f868c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f8692510640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f868c0af470 0x7f868c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f8692510640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868c0b3290 con 0x7f868c15c2a0 2024-09-15T23:57:57.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f8692510640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f868c0b3570 con 0x7f868c0af470 2024-09-15T23:57:57.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f8692510640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f868c0b3850 con 0x7f868c15bec0 2024-09-15T23:57:57.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f8690aad640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f868c0af470 0x7f868c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f8690aad640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f868c0af470 0x7f868c06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52690/0 (socket says 172.21.15.112:52690) 2024-09-15T23:57:57.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f8690aad640 1 -- 172.21.15.112:0/675243621 learned_addr learned my addr 172.21.15.112:0/675243621 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:57.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f868bfff640 1 --2- 172.21.15.112:0/675243621 >> v2:172.21.15.169:3300/0 conn(0x7f868c15bec0 0x7f868c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f8690aad640 1 -- 172.21.15.112:0/675243621 >> v2:172.21.15.169:3300/0 conn(0x7f868c15bec0 msgr2=0x7f868c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:57.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f8690aad640 1 --2- 172.21.15.112:0/675243621 >> v2:172.21.15.169:3300/0 conn(0x7f868c15bec0 0x7f868c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f8690aad640 1 -- 172.21.15.112:0/675243621 >> v1:172.21.15.112:6789/0 conn(0x7f868c15c2a0 legacy=0x7f868c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f8690aad640 1 -- 172.21.15.112:0/675243621 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868c0b3b30 con 0x7f868c0af470 2024-09-15T23:57:57.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.729+0000 7f868bfff640 1 --2- 172.21.15.112:0/675243621 >> v2:172.21.15.169:3300/0 conn(0x7f868c15bec0 0x7f868c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:57.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.733+0000 7f8690aad640 1 --2- 172.21.15.112:0/675243621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f868c0af470 0x7f868c06e000 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f868c071710 tx=0x7f868401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f2fb8ebcf73760 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.733+0000 7f868affd640 1 -- 172.21.15.112:0/675243621 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86840aa650 con 0x7f868c0af470 2024-09-15T23:57:57.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.733+0000 7f868affd640 1 -- 172.21.15.112:0/675243621 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86840af070 con 0x7f868c0af470 2024-09-15T23:57:57.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.733+0000 7f868affd640 1 -- 172.21.15.112:0/675243621 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86840aaa10 con 0x7f868c0af470 2024-09-15T23:57:57.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.733+0000 7f8692510640 1 -- 172.21.15.112:0/675243621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f868c0af470 msgr2=0x7f868c06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.733+0000 7f8692510640 1 --2- 172.21.15.112:0/675243621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f868c0af470 0x7f868c06e000 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f868c071710 tx=0x7f868401c4f0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.733+0000 7f8692510640 1 -- 172.21.15.112:0/675243621 shutdown_connections 2024-09-15T23:57:57.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.733+0000 7f8692510640 1 --2- 172.21.15.112:0/675243621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f868c0af470 0x7f868c06e000 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.733+0000 7f8692510640 1 --2- 172.21.15.112:0/675243621 >> v2:172.21.15.169:3300/0 conn(0x7f868c15bec0 0x7f868c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.733+0000 7f8692510640 1 -- 172.21.15.112:0/675243621 >> 172.21.15.112:0/675243621 conn(0x7f868c0b1f90 msgr2=0x7f868c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:57.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.733+0000 7f8692510640 1 -- 172.21.15.112:0/675243621 shutdown_connections 2024-09-15T23:57:57.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.733+0000 7f8692510640 1 -- 172.21.15.112:0/675243621 wait complete. 2024-09-15T23:57:57.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8692510640 1 Processor -- start 2024-09-15T23:57:57.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8692510640 1 -- start start 2024-09-15T23:57:57.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8692510640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f868c0af470 0x7f868c13d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8692510640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f868c15bec0 0x7f868c157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8692510640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f868c15c2a0 0x7f868c157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8692510640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f868c06ed50 con 0x7f868c15bec0 2024-09-15T23:57:57.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8692510640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f868c0ad740 con 0x7f868c15c2a0 2024-09-15T23:57:57.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8692510640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f868c06eed0 con 0x7f868c0af470 2024-09-15T23:57:57.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f868b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f868c15bec0 0x7f868c157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f868b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f868c15bec0 0x7f868c157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:52702/0 (socket says 172.21.15.112:52702) 2024-09-15T23:57:57.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f868b7fe640 1 -- 172.21.15.112:0/2207225131 learned_addr learned my addr 172.21.15.112:0/2207225131 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:57.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f868bfff640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f868c0af470 0x7f868c13d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8690aad640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f868c15c2a0 0x7f868c157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f868b7fe640 1 -- 172.21.15.112:0/2207225131 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f868c0af470 msgr2=0x7f868c13d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f868b7fe640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f868c0af470 0x7f868c13d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f868b7fe640 1 -- 172.21.15.112:0/2207225131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f868c15c2a0 msgr2=0x7f868c157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f868b7fe640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f868c15c2a0 0x7f868c157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f868b7fe640 1 -- 172.21.15.112:0/2207225131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868c14ca10 con 0x7f868c15bec0 2024-09-15T23:57:57.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8690aad640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f868c15c2a0 0x7f868c157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:57.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f868b7fe640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f868c15bec0 0x7f868c157530 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f868000c3c0 tx=0x7f868000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8688ff9640 1 -- 172.21.15.112:0/2207225131 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8680017070 con 0x7f868c15bec0 2024-09-15T23:57:57.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8688ff9640 1 -- 172.21.15.112:0/2207225131 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86800052d0 con 0x7f868c15bec0 2024-09-15T23:57:57.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8692510640 1 -- 172.21.15.112:0/2207225131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f868c14b970 con 0x7f868c15bec0 2024-09-15T23:57:57.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8688ff9640 1 -- 172.21.15.112:0/2207225131 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8680003820 con 0x7f868c15bec0 2024-09-15T23:57:57.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8692510640 1 -- 172.21.15.112:0/2207225131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f868c14bf30 con 0x7f868c15bec0 2024-09-15T23:57:57.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8692510640 1 -- 172.21.15.112:0/2207225131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f868c06f260 con 0x7f868c15bec0 2024-09-15T23:57:57.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8688ff9640 1 -- 172.21.15.112:0/2207225131 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f868001a070 con 0x7f868c15bec0 2024-09-15T23:57:57.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8688ff9640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86780678c0 0x7f8678069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f8688ff9640 1 -- 172.21.15.112:0/2207225131 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7f86800851f0 con 0x7f868c15bec0 2024-09-15T23:57:57.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.737+0000 7f868bfff640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86780678c0 0x7f8678069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.741+0000 7f868bfff640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86780678c0 0x7f8678069d80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f867c008f80 tx=0x7f867c0084d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.745+0000 7f8688ff9640 1 -- 172.21.15.112:0/2207225131 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8680005480 con 0x7f868c15bec0 2024-09-15T23:57:57.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:57.909+0000 7f8692510640 1 -- 172.21.15.112:0/2207225131 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f868c166dd0 con 0x7f868c15bec0 2024-09-15T23:57:58.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.641+0000 7f8688ff9640 1 -- 172.21.15.112:0/2207225131 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) ==== 181+0+0 (secure 0 0 0) 0x7f8680055ac0 con 0x7f868c15bec0 2024-09-15T23:57:58.641 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:57:58.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.645+0000 7f8692510640 1 -- 172.21.15.112:0/2207225131 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86780678c0 msgr2=0x7f8678069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:58.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.645+0000 7f8692510640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86780678c0 0x7f8678069d80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f867c008f80 tx=0x7f867c0084d0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.645+0000 7f8692510640 1 -- 172.21.15.112:0/2207225131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f868c15bec0 msgr2=0x7f868c157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:58.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.645+0000 7f8692510640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f868c15bec0 0x7f868c157530 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f868000c3c0 tx=0x7f868000c880 comp rx=0 tx=0).stop 2024-09-15T23:57:58.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.645+0000 7f8692510640 1 -- 172.21.15.112:0/2207225131 shutdown_connections 2024-09-15T23:57:58.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.645+0000 7f8692510640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f86780678c0 0x7f8678069d80 secure :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f867c008f80 tx=0x7f867c0084d0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.645+0000 7f8692510640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f868c15c2a0 0x7f868c157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.645+0000 7f8692510640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f868c15bec0 0x7f868c157530 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.645+0000 7f8692510640 1 --2- 172.21.15.112:0/2207225131 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f868c0af470 0x7f868c13d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.645+0000 7f8692510640 1 -- 172.21.15.112:0/2207225131 >> 172.21.15.112:0/2207225131 conn(0x7f868c0b1f90 msgr2=0x7f868c14fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:58.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.645+0000 7f8692510640 1 -- 172.21.15.112:0/2207225131 shutdown_connections 2024-09-15T23:57:58.646 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.645+0000 7f8692510640 1 -- 172.21.15.112:0/2207225131 wait complete. 2024-09-15T23:57:58.666 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:57:58.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.793+0000 7f3191cab640 1 Processor -- start 2024-09-15T23:57:58.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.793+0000 7f3191cab640 1 -- start start 2024-09-15T23:57:58.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.793+0000 7f3191cab640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f318c1567e0 0x7f318c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:58.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.793+0000 7f3191cab640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f318c160460 0x7f318c15d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:58.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.793+0000 7f3191cab640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f318c0b4620 con 0x7f318c0b3c40 2024-09-15T23:57:58.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.793+0000 7f3191cab640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f318c0b4900 con 0x7f318c1567e0 2024-09-15T23:57:58.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.793+0000 7f3191cab640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f318c0b4be0 con 0x7f318c160460 2024-09-15T23:57:58.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.793+0000 7f318b7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f318c1567e0 0x7f318c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:58.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.793+0000 7f318b7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f318c1567e0 0x7f318c0b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37394/0 (socket says 172.21.15.112:37394) 2024-09-15T23:57:58.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.793+0000 7f318b7fe640 1 -- 172.21.15.112:0/264212268 learned_addr learned my addr 172.21.15.112:0/264212268 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:58.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.793+0000 7f318b7fe640 1 -- 172.21.15.112:0/264212268 >> v2:172.21.15.169:3300/0 conn(0x7f318c160460 msgr2=0x7f318c15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:58.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.793+0000 7f318b7fe640 1 --2- 172.21.15.112:0/264212268 >> v2:172.21.15.169:3300/0 conn(0x7f318c160460 0x7f318c15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.793+0000 7f318b7fe640 1 -- 172.21.15.112:0/264212268 >> v1:172.21.15.169:6789/0 conn(0x7f318c0b3c40 legacy=0x7f318c15fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:58.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.793+0000 7f318b7fe640 1 -- 172.21.15.112:0/264212268 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318c0b4ec0 con 0x7f318c1567e0 2024-09-15T23:57:58.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.797+0000 7f318b7fe640 1 --2- 172.21.15.112:0/264212268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f318c1567e0 0x7f318c0b56c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f317c009e50 tx=0x7f317c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c4b79aaad27fb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:58.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.797+0000 7f318a7fc640 1 -- 172.21.15.112:0/264212268 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c0a57d0 con 0x7f318c1567e0 2024-09-15T23:57:58.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.797+0000 7f318a7fc640 1 -- 172.21.15.112:0/264212268 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317c0a5970 con 0x7f318c1567e0 2024-09-15T23:57:58.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.797+0000 7f318a7fc640 1 -- 172.21.15.112:0/264212268 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c0a5d40 con 0x7f318c1567e0 2024-09-15T23:57:58.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.797+0000 7f3191cab640 1 -- 172.21.15.112:0/264212268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f318c1567e0 msgr2=0x7f318c0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:58.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.797+0000 7f3191cab640 1 --2- 172.21.15.112:0/264212268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f318c1567e0 0x7f318c0b56c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f317c009e50 tx=0x7f317c01c8f0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.797+0000 7f3191cab640 1 -- 172.21.15.112:0/264212268 shutdown_connections 2024-09-15T23:57:58.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.797+0000 7f3191cab640 1 --2- 172.21.15.112:0/264212268 >> v2:172.21.15.169:3300/0 conn(0x7f318c160460 0x7f318c15d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.797+0000 7f3191cab640 1 --2- 172.21.15.112:0/264212268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f318c1567e0 0x7f318c0b56c0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.797+0000 7f3191cab640 1 -- 172.21.15.112:0/264212268 >> 172.21.15.112:0/264212268 conn(0x7f318c073580 msgr2=0x7f318c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:58.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.797+0000 7f3191cab640 1 -- 172.21.15.112:0/264212268 shutdown_connections 2024-09-15T23:57:58.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.797+0000 7f3191cab640 1 -- 172.21.15.112:0/264212268 wait complete. 2024-09-15T23:57:58.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3191cab640 1 Processor -- start 2024-09-15T23:57:58.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3191cab640 1 -- start start 2024-09-15T23:57:58.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3191cab640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f318c0b3c40 0x7f318c148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:58.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3191cab640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f318c1567e0 0x7f318c06fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:58.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3191cab640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f318c160460 0x7f318c151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:58.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3191cab640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f318c160b50 con 0x7f318c160460 2024-09-15T23:57:58.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3191cab640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f318c1609d0 con 0x7f318c1567e0 2024-09-15T23:57:58.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3191cab640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f318c15e270 con 0x7f318c0b3c40 2024-09-15T23:57:58.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f318bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f318c160460 0x7f318c151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:58.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f318bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f318c160460 0x7f318c151870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37404/0 (socket says 172.21.15.112:37404) 2024-09-15T23:57:58.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f318bfff640 1 -- 172.21.15.112:0/669039854 learned_addr learned my addr 172.21.15.112:0/669039854 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:58.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f318b7fe640 1 --2- 172.21.15.112:0/669039854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f318c0b3c40 0x7f318c148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:58.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f318affd640 1 --2- 172.21.15.112:0/669039854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f318c1567e0 0x7f318c06fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:58.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f318bfff640 1 -- 172.21.15.112:0/669039854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f318c0b3c40 msgr2=0x7f318c148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:58.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f318bfff640 1 --2- 172.21.15.112:0/669039854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f318c0b3c40 0x7f318c148800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f318bfff640 1 -- 172.21.15.112:0/669039854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f318c1567e0 msgr2=0x7f318c06fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:58.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f318bfff640 1 --2- 172.21.15.112:0/669039854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f318c1567e0 0x7f318c06fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f318bfff640 1 -- 172.21.15.112:0/669039854 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318c06f100 con 0x7f318c160460 2024-09-15T23:57:58.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f318bfff640 1 --2- 172.21.15.112:0/669039854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f318c160460 0x7f318c151870 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f318400b3c0 tx=0x7f318400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:58.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3183fff640 1 -- 172.21.15.112:0/669039854 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184011830 con 0x7f318c160460 2024-09-15T23:57:58.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3183fff640 1 -- 172.21.15.112:0/669039854 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3184016070 con 0x7f318c160460 2024-09-15T23:57:58.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3191cab640 1 -- 172.21.15.112:0/669039854 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318c06f3e0 con 0x7f318c160460 2024-09-15T23:57:58.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3183fff640 1 -- 172.21.15.112:0/669039854 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184011c10 con 0x7f318c160460 2024-09-15T23:57:58.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3191cab640 1 -- 172.21.15.112:0/669039854 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318c148d40 con 0x7f318c160460 2024-09-15T23:57:58.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3191cab640 1 -- 172.21.15.112:0/669039854 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f318c0b56c0 con 0x7f318c160460 2024-09-15T23:57:58.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3183fff640 1 -- 172.21.15.112:0/669039854 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f318401b460 con 0x7f318c160460 2024-09-15T23:57:58.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.801+0000 7f3183fff640 1 --2- 172.21.15.112:0/669039854 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f316c0678c0 0x7f316c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:58.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.805+0000 7f3183fff640 1 -- 172.21.15.112:0/669039854 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5749+0+0 (secure 0 0 0) 0x7f31840859d0 con 0x7f318c160460 2024-09-15T23:57:58.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.805+0000 7f318b7fe640 1 --2- 172.21.15.112:0/669039854 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f316c0678c0 0x7f316c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:58.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.805+0000 7f318b7fe640 1 --2- 172.21.15.112:0/669039854 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f316c0678c0 0x7f316c069d80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f317c0ae000 tx=0x7f317c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:58.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.809+0000 7f3183fff640 1 -- 172.21.15.112:0/669039854 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f31840564e0 con 0x7f318c160460 2024-09-15T23:57:58.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:58.957+0000 7f3191cab640 1 -- 172.21.15.112:0/669039854 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f318c070e20 con 0x7f318c160460 2024-09-15T23:57:59.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.641+0000 7f3183fff640 1 -- 172.21.15.112:0/669039854 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) ==== 169+0+0 (secure 0 0 0) 0x7f3184055de0 con 0x7f318c160460 2024-09-15T23:57:59.644 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-15T23:57:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.645+0000 7f3191cab640 1 -- 172.21.15.112:0/669039854 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f316c0678c0 msgr2=0x7f316c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.645+0000 7f3191cab640 1 --2- 172.21.15.112:0/669039854 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f316c0678c0 0x7f316c069d80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f317c0ae000 tx=0x7f317c0a7070 comp rx=0 tx=0).stop 2024-09-15T23:57:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.645+0000 7f3191cab640 1 -- 172.21.15.112:0/669039854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f318c160460 msgr2=0x7f318c151870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.645+0000 7f3191cab640 1 --2- 172.21.15.112:0/669039854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f318c160460 0x7f318c151870 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f318400b3c0 tx=0x7f318400b880 comp rx=0 tx=0).stop 2024-09-15T23:57:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.645+0000 7f3191cab640 1 -- 172.21.15.112:0/669039854 shutdown_connections 2024-09-15T23:57:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.645+0000 7f3191cab640 1 --2- 172.21.15.112:0/669039854 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f316c0678c0 0x7f316c069d80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.645+0000 7f3191cab640 1 --2- 172.21.15.112:0/669039854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f318c160460 0x7f318c151870 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.645+0000 7f3191cab640 1 --2- 172.21.15.112:0/669039854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f318c1567e0 0x7f318c06fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.645+0000 7f3191cab640 1 --2- 172.21.15.112:0/669039854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f318c0b3c40 0x7f318c148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.645+0000 7f3191cab640 1 -- 172.21.15.112:0/669039854 >> 172.21.15.112:0/669039854 conn(0x7f318c073580 msgr2=0x7f318c0b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.645+0000 7f3191cab640 1 -- 172.21.15.112:0/669039854 shutdown_connections 2024-09-15T23:57:59.647 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.645+0000 7f3191cab640 1 -- 172.21.15.112:0/669039854 wait complete. 2024-09-15T23:57:59.671 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:57:59.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.781+0000 7f6ea5ab3640 1 Processor -- start 2024-09-15T23:57:59.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.781+0000 7f6ea5ab3640 1 -- start start 2024-09-15T23:57:59.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6ea5ab3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ea015c2a0 0x7f6ea00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:59.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6ea5ab3640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ea00b3290 con 0x7f6ea015bec0 2024-09-15T23:57:59.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6ea5ab3640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ea00b3570 con 0x7f6ea00af2a0 2024-09-15T23:57:59.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6ea5ab3640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6ea00b3850 con 0x7f6ea015c2a0 2024-09-15T23:57:59.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6e9f7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6ea015bec0 0x7f6ea00ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36048/0 (socket says 172.21.15.112:36048) 2024-09-15T23:57:59.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6e9f7fe640 1 -- 172.21.15.112:0/2593230415 learned_addr learned my addr 172.21.15.112:0/2593230415 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:57:59.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6e9effd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ea015c2a0 0x7f6ea00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:59.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6e9effd640 1 -- 172.21.15.112:0/2593230415 >> v1:172.21.15.169:6789/0 conn(0x7f6ea00af2a0 legacy=0x7f6ea006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:57:59.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6e9effd640 1 -- 172.21.15.112:0/2593230415 >> v1:172.21.15.112:6789/0 conn(0x7f6ea015bec0 legacy=0x7f6ea00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:59.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6e9effd640 1 -- 172.21.15.112:0/2593230415 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea00b3b30 con 0x7f6ea015c2a0 2024-09-15T23:57:59.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6e9e7fc640 1 -- 172.21.15.112:0/2593230415 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1017379131 0 0) 0x7f6ea00b3290 con 0x7f6ea015bec0 2024-09-15T23:57:59.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6e9effd640 1 --2- 172.21.15.112:0/2593230415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea015c2a0 0x7f6ea00aed60 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f6e900097c0 tx=0x7f6e9001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1ce40d950e585 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:59.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6e9e7fc640 1 -- 172.21.15.112:0/2593230415 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e900ab430 con 0x7f6ea015c2a0 2024-09-15T23:57:59.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6e9e7fc640 1 -- 172.21.15.112:0/2593230415 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e900b0070 con 0x7f6ea015c2a0 2024-09-15T23:57:59.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6e9e7fc640 1 -- 172.21.15.112:0/2593230415 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e900ab7f0 con 0x7f6ea015c2a0 2024-09-15T23:57:59.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/2593230415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea015c2a0 msgr2=0x7f6ea00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:59.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.785+0000 7f6ea5ab3640 1 --2- 172.21.15.112:0/2593230415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea015c2a0 0x7f6ea00aed60 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f6e900097c0 tx=0x7f6e9001c430 comp rx=0 tx=0).stop 2024-09-15T23:57:59.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/2593230415 shutdown_connections 2024-09-15T23:57:59.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 --2- 172.21.15.112:0/2593230415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea015c2a0 0x7f6ea00aed60 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:59.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/2593230415 >> 172.21.15.112:0/2593230415 conn(0x7f6ea00b1f90 msgr2=0x7f6ea00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:59.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/2593230415 shutdown_connections 2024-09-15T23:57:59.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/2593230415 wait complete. 2024-09-15T23:57:59.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 Processor -- start 2024-09-15T23:57:59.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 -- start start 2024-09-15T23:57:59.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea00af2a0 0x7f6ea014b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:59.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ea015bec0 0x7f6ea0145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:59.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ea015c2a0 0x7f6ea01465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:59.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea006ef20 con 0x7f6ea00af2a0 2024-09-15T23:57:59.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea00af710 con 0x7f6ea015c2a0 2024-09-15T23:57:59.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea006f0a0 con 0x7f6ea015bec0 2024-09-15T23:57:59.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e9f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea00af2a0 0x7f6ea014b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:59.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e9f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea00af2a0 0x7f6ea014b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37416/0 (socket says 172.21.15.112:37416) 2024-09-15T23:57:59.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e9f7fe640 1 -- 172.21.15.112:0/1590907608 learned_addr learned my addr 172.21.15.112:0/1590907608 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:57:59.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e9effd640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ea015bec0 0x7f6ea0145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:59.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e9ffff640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ea015c2a0 0x7f6ea01465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:59.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e9f7fe640 1 -- 172.21.15.112:0/1590907608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ea015bec0 msgr2=0x7f6ea0145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:59.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e9f7fe640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ea015bec0 0x7f6ea0145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:59.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e9f7fe640 1 -- 172.21.15.112:0/1590907608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ea015c2a0 msgr2=0x7f6ea01465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:59.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e9f7fe640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ea015c2a0 0x7f6ea01465b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:59.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e9f7fe640 1 -- 172.21.15.112:0/1590907608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea0153770 con 0x7f6ea00af2a0 2024-09-15T23:57:59.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e9effd640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ea015bec0 0x7f6ea0145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:57:59.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e9f7fe640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea00af2a0 0x7f6ea014b9d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6e940011f0 tx=0x7f6e9400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:59.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e87fff640 1 -- 172.21.15.112:0/1590907608 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94018070 con 0x7f6ea00af2a0 2024-09-15T23:57:59.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e87fff640 1 -- 172.21.15.112:0/1590907608 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e940074e0 con 0x7f6ea00af2a0 2024-09-15T23:57:59.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/1590907608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea0153a50 con 0x7f6ea00af2a0 2024-09-15T23:57:59.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6e87fff640 1 -- 172.21.15.112:0/1590907608 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94004a10 con 0x7f6ea00af2a0 2024-09-15T23:57:59.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/1590907608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea0154010 con 0x7f6ea00af2a0 2024-09-15T23:57:59.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.789+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/1590907608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea00aed60 con 0x7f6ea00af2a0 2024-09-15T23:57:59.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.793+0000 7f6e87fff640 1 -- 172.21.15.112:0/1590907608 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6e9401b070 con 0x7f6ea00af2a0 2024-09-15T23:57:59.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.793+0000 7f6e87fff640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6e8c0678c0 0x7f6e8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:59.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.793+0000 7f6e9effd640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6e8c0678c0 0x7f6e8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:59.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.793+0000 7f6e87fff640 1 -- 172.21.15.112:0/1590907608 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f6e94084db0 con 0x7f6ea00af2a0 2024-09-15T23:57:59.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.793+0000 7f6e9effd640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6e8c0678c0 0x7f6e8c069d80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6e900af000 tx=0x7f6e900a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:59.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.797+0000 7f6e87fff640 1 -- 172.21.15.112:0/1590907608 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6e94055af0 con 0x7f6ea00af2a0 2024-09-15T23:57:59.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.945+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/1590907608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f6ea00b2bd0 con 0x7f6ea00af2a0 2024-09-15T23:57:59.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.949+0000 7f6e87fff640 1 -- 172.21.15.112:0/1590907608 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7f6e940553f0 con 0x7f6ea00af2a0 2024-09-15T23:57:59.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.949+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/1590907608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6e8c0678c0 msgr2=0x7f6e8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:59.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.949+0000 7f6ea5ab3640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6e8c0678c0 0x7f6e8c069d80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6e900af000 tx=0x7f6e900a7000 comp rx=0 tx=0).stop 2024-09-15T23:57:59.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.949+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/1590907608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea00af2a0 msgr2=0x7f6ea014b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:59.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.949+0000 7f6ea5ab3640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea00af2a0 0x7f6ea014b9d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6e940011f0 tx=0x7f6e9400c9b0 comp rx=0 tx=0).stop 2024-09-15T23:57:59.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.949+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/1590907608 shutdown_connections 2024-09-15T23:57:59.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.949+0000 7f6ea5ab3640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6e8c0678c0 0x7f6e8c069d80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:59.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.949+0000 7f6ea5ab3640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ea015c2a0 0x7f6ea01465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:59.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.949+0000 7f6ea5ab3640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ea015bec0 0x7f6ea0145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:59.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.949+0000 7f6ea5ab3640 1 --2- 172.21.15.112:0/1590907608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ea00af2a0 0x7f6ea014b9d0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:59.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.949+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/1590907608 >> 172.21.15.112:0/1590907608 conn(0x7f6ea00b1f90 msgr2=0x7f6ea01598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:59.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.949+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/1590907608 shutdown_connections 2024-09-15T23:57:59.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:57:59.949+0000 7f6ea5ab3640 1 -- 172.21.15.112:0/1590907608 wait complete. 2024-09-15T23:57:59.967 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_fancy_layout' 2024-09-15T23:58:00.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.081+0000 7fa08afd4640 1 Processor -- start 2024-09-15T23:58:00.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.081+0000 7fa08afd4640 1 -- start start 2024-09-15T23:58:00.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.081+0000 7fa08afd4640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa08415e450 0x7fa08409aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:00.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.081+0000 7fa08afd4640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0840b5c90 con 0x7fa0840b40c0 2024-09-15T23:58:00.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.081+0000 7fa08afd4640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0840b4580 con 0x7fa08406c3d0 2024-09-15T23:58:00.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.081+0000 7fa08afd4640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa0840b4860 con 0x7fa08415e450 2024-09-15T23:58:00.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.081+0000 7fa088d70640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa08415e450 0x7fa08409aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:00.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.081+0000 7fa083fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa0840b40c0 0x7fa08406bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36058/0 (socket says 172.21.15.112:36058) 2024-09-15T23:58:00.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.081+0000 7fa083fff640 1 -- 172.21.15.112:0/3210950191 learned_addr learned my addr 172.21.15.112:0/3210950191 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:00.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.081+0000 7fa088d70640 1 -- 172.21.15.112:0/3210950191 >> v1:172.21.15.169:6789/0 conn(0x7fa08406c3d0 legacy=0x7fa084162370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:00.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.081+0000 7fa088d70640 1 -- 172.21.15.112:0/3210950191 >> v1:172.21.15.112:6789/0 conn(0x7fa0840b40c0 legacy=0x7fa08406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:00.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.081+0000 7fa088d70640 1 -- 172.21.15.112:0/3210950191 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0840b5f10 con 0x7fa08415e450 2024-09-15T23:58:00.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.081+0000 7fa0837fe640 1 -- 172.21.15.112:0/3210950191 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105454466 0 0) 0x7fa078001120 con 0x7fa0840b40c0 2024-09-15T23:58:00.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa088d70640 1 --2- 172.21.15.112:0/3210950191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08415e450 0x7fa08409aa00 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa0740097c0 tx=0x7fa07401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9462171c163065d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:00.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa0837fe640 1 -- 172.21.15.112:0/3210950191 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0740b0070 con 0x7fa08415e450 2024-09-15T23:58:00.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa0837fe640 1 -- 172.21.15.112:0/3210950191 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0740ab600 con 0x7fa08415e450 2024-09-15T23:58:00.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa0837fe640 1 -- 172.21.15.112:0/3210950191 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0740ab9d0 con 0x7fa08415e450 2024-09-15T23:58:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 -- 172.21.15.112:0/3210950191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08415e450 msgr2=0x7fa08409aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 --2- 172.21.15.112:0/3210950191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08415e450 0x7fa08409aa00 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa0740097c0 tx=0x7fa07401c410 comp rx=0 tx=0).stop 2024-09-15T23:58:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 -- 172.21.15.112:0/3210950191 shutdown_connections 2024-09-15T23:58:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 --2- 172.21.15.112:0/3210950191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08415e450 0x7fa08409aa00 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 -- 172.21.15.112:0/3210950191 >> 172.21.15.112:0/3210950191 conn(0x7fa0840b6800 msgr2=0x7fa0840b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 -- 172.21.15.112:0/3210950191 shutdown_connections 2024-09-15T23:58:00.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 -- 172.21.15.112:0/3210950191 wait complete. 2024-09-15T23:58:00.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 Processor -- start 2024-09-15T23:58:00.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 -- start start 2024-09-15T23:58:00.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa08406c3d0 0x7fa08414ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:00.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0840b40c0 0x7fa084150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:00.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08415e450 0x7fa084149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:00.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa08415f9c0 con 0x7fa08415e450 2024-09-15T23:58:00.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa08415f840 con 0x7fa08406c3d0 2024-09-15T23:58:00.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa08afd4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa084162e90 con 0x7fa0840b40c0 2024-09-15T23:58:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa089571640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08415e450 0x7fa084149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa089571640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08415e450 0x7fa084149da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37444/0 (socket says 172.21.15.112:37444) 2024-09-15T23:58:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa089571640 1 -- 172.21.15.112:0/3436697959 learned_addr learned my addr 172.21.15.112:0/3436697959 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa088d70640 1 --2- 172.21.15.112:0/3436697959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa08406c3d0 0x7fa08414ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa083fff640 1 --2- 172.21.15.112:0/3436697959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0840b40c0 0x7fa084150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa089571640 1 -- 172.21.15.112:0/3436697959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0840b40c0 msgr2=0x7fa084150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa089571640 1 --2- 172.21.15.112:0/3436697959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0840b40c0 0x7fa084150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa089571640 1 -- 172.21.15.112:0/3436697959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa08406c3d0 msgr2=0x7fa08414ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa089571640 1 --2- 172.21.15.112:0/3436697959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa08406c3d0 0x7fa08414ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa089571640 1 -- 172.21.15.112:0/3436697959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa084151500 con 0x7fa08415e450 2024-09-15T23:58:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.085+0000 7fa089571640 1 --2- 172.21.15.112:0/3436697959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08415e450 0x7fa084149da0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00c730 tx=0x7fa07c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.089+0000 7fa0817fa640 1 -- 172.21.15.112:0/3436697959 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c003b80 con 0x7fa08415e450 2024-09-15T23:58:00.089 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.089+0000 7fa0817fa640 1 -- 172.21.15.112:0/3436697959 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07c003d20 con 0x7fa08415e450 2024-09-15T23:58:00.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.089+0000 7fa08afd4640 1 -- 172.21.15.112:0/3436697959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0841517a0 con 0x7fa08415e450 2024-09-15T23:58:00.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.089+0000 7fa0817fa640 1 -- 172.21.15.112:0/3436697959 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c005310 con 0x7fa08415e450 2024-09-15T23:58:00.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.089+0000 7fa08afd4640 1 -- 172.21.15.112:0/3436697959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08415dc00 con 0x7fa08415e450 2024-09-15T23:58:00.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.089+0000 7fa08afd4640 1 -- 172.21.15.112:0/3436697959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08409aa00 con 0x7fa08415e450 2024-09-15T23:58:00.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.089+0000 7fa0817fa640 1 -- 172.21.15.112:0/3436697959 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa07c0056c0 con 0x7fa08415e450 2024-09-15T23:58:00.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.089+0000 7fa0817fa640 1 --2- 172.21.15.112:0/3436697959 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa0700678c0 0x7fa070069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:00.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.089+0000 7fa088d70640 1 --2- 172.21.15.112:0/3436697959 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa0700678c0 0x7fa070069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:00.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.089+0000 7fa0817fa640 1 -- 172.21.15.112:0/3436697959 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7fa07c085b20 con 0x7fa08415e450 2024-09-15T23:58:00.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.089+0000 7fa088d70640 1 --2- 172.21.15.112:0/3436697959 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa0700678c0 0x7fa070069d80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa0740ad000 tx=0x7fa074008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:00.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.093+0000 7fa0817fa640 1 -- 172.21.15.112:0/3436697959 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa07c056860 con 0x7fa08415e450 2024-09-15T23:58:00.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.317+0000 7fa08afd4640 1 -- 172.21.15.112:0/3436697959 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_fancy_layout"]} v 0) -- 0x7fa08406f510 con 0x7fa08415e450 2024-09-15T23:58:00.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.657+0000 7fa0817fa640 1 -- 172.21.15.112:0/3436697959 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_fancy_layout"]}]=0 v227) ==== 132+0+0 (secure 0 0 0) 0x7fa07c056160 con 0x7fa08415e450 2024-09-15T23:58:00.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.657+0000 7fa08afd4640 1 -- 172.21.15.112:0/3436697959 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa0700678c0 msgr2=0x7fa070069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:00.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.657+0000 7fa08afd4640 1 --2- 172.21.15.112:0/3436697959 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa0700678c0 0x7fa070069d80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa0740ad000 tx=0x7fa074008040 comp rx=0 tx=0).stop 2024-09-15T23:58:00.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.657+0000 7fa08afd4640 1 -- 172.21.15.112:0/3436697959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08415e450 msgr2=0x7fa084149da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:00.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.657+0000 7fa08afd4640 1 --2- 172.21.15.112:0/3436697959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08415e450 0x7fa084149da0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00c730 tx=0x7fa07c00cbf0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.657+0000 7fa08afd4640 1 -- 172.21.15.112:0/3436697959 shutdown_connections 2024-09-15T23:58:00.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.657+0000 7fa08afd4640 1 --2- 172.21.15.112:0/3436697959 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa0700678c0 0x7fa070069d80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.657+0000 7fa08afd4640 1 --2- 172.21.15.112:0/3436697959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa08415e450 0x7fa084149da0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.657+0000 7fa08afd4640 1 --2- 172.21.15.112:0/3436697959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0840b40c0 0x7fa084150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.657+0000 7fa08afd4640 1 --2- 172.21.15.112:0/3436697959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa08406c3d0 0x7fa08414ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.657+0000 7fa08afd4640 1 -- 172.21.15.112:0/3436697959 >> 172.21.15.112:0/3436697959 conn(0x7fa0840b6800 msgr2=0x7fa084070190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:00.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.657+0000 7fa08afd4640 1 -- 172.21.15.112:0/3436697959 shutdown_connections 2024-09-15T23:58:00.661 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.661+0000 7fa08afd4640 1 -- 172.21.15.112:0/3436697959 wait complete. 2024-09-15T23:58:00.682 INFO:tasks.cephfs_test_runner:purge stray file with fancy layout ... ok 2024-09-15T23:58:00.682 INFO:tasks.cephfs_test_runner:Starting test: test_files_throttle (tasks.cephfs.test_strays.TestStrays) 2024-09-15T23:58:00.683 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:58:00.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.805+0000 7f1f6f553640 1 Processor -- start 2024-09-15T23:58:00.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.805+0000 7f1f6f553640 1 -- start start 2024-09-15T23:58:00.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.805+0000 7f1f6f553640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f680d4130 0x7f1f680d4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:00.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.805+0000 7f1f6f553640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1f680d2a10 0x7f1f680d2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:00.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.805+0000 7f1f6f553640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f680d1f70 con 0x7f1f6815e450 2024-09-15T23:58:00.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.805+0000 7f1f6f553640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1f680b58d0 con 0x7f1f680d2a10 2024-09-15T23:58:00.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.805+0000 7f1f6f553640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1f680b55f0 con 0x7f1f680d4130 2024-09-15T23:58:00.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.805+0000 7f1f6caee640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f680d4130 0x7f1f680d4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:00.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.805+0000 7f1f6daf0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1f680d2a10 0x7f1f680d2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:00.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.805+0000 7f1f6daf0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1f680d2a10 0x7f1f680d2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:49568/0 (socket says 172.21.15.112:49568) 2024-09-15T23:58:00.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.805+0000 7f1f6daf0640 1 -- 172.21.15.112:0/359466231 learned_addr learned my addr 172.21.15.112:0/359466231 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:00.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.805+0000 7f1f6d2ef640 1 --1- 172.21.15.112:0/359466231 >> v1:172.21.15.169:6789/0 conn(0x7f1f6815e450 0x7f1f680b7130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:60230/0 (socket says 172.21.15.112:60230) 2024-09-15T23:58:00.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f6daf0640 1 -- 172.21.15.112:0/359466231 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f680d4130 msgr2=0x7f1f680d4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:00.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f6daf0640 1 --2- 172.21.15.112:0/359466231 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f680d4130 0x7f1f680d4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f6daf0640 1 -- 172.21.15.112:0/359466231 >> v1:172.21.15.169:6789/0 conn(0x7f1f6815e450 legacy=0x7f1f680b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:00.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f6daf0640 1 -- 172.21.15.112:0/359466231 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f680d2210 con 0x7f1f680d2a10 2024-09-15T23:58:00.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f6daf0640 1 --2- 172.21.15.112:0/359466231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f680d2a10 0x7f1f680d2e80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1f60009e50 tx=0x7f1f6001ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32bb04a5dd710152 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:00.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f5ffff640 1 -- 172.21.15.112:0/359466231 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f600a58d0 con 0x7f1f680d2a10 2024-09-15T23:58:00.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f5ffff640 1 -- 172.21.15.112:0/359466231 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f600a5a70 con 0x7f1f680d2a10 2024-09-15T23:58:00.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f5ffff640 1 -- 172.21.15.112:0/359466231 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f600a5e40 con 0x7f1f680d2a10 2024-09-15T23:58:00.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f6f553640 1 -- 172.21.15.112:0/359466231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f680d2a10 msgr2=0x7f1f680d2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:00.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f6f553640 1 --2- 172.21.15.112:0/359466231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f680d2a10 0x7f1f680d2e80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1f60009e50 tx=0x7f1f6001ca00 comp rx=0 tx=0).stop 2024-09-15T23:58:00.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f6f553640 1 -- 172.21.15.112:0/359466231 shutdown_connections 2024-09-15T23:58:00.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f6f553640 1 --2- 172.21.15.112:0/359466231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f680d2a10 0x7f1f680d2e80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f6f553640 1 --2- 172.21.15.112:0/359466231 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f680d4130 0x7f1f680d4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f6f553640 1 -- 172.21.15.112:0/359466231 >> 172.21.15.112:0/359466231 conn(0x7f1f6808bf90 msgr2=0x7f1f6809d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:00.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f6f553640 1 -- 172.21.15.112:0/359466231 shutdown_connections 2024-09-15T23:58:00.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.809+0000 7f1f6f553640 1 -- 172.21.15.112:0/359466231 wait complete. 2024-09-15T23:58:00.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6f553640 1 Processor -- start 2024-09-15T23:58:00.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6f553640 1 -- start start 2024-09-15T23:58:00.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6f553640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f680d2a10 0x7f1f6814db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:00.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6f553640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f680d4130 0x7f1f68152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:00.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6f553640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f6815e450 0x7f1f681530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:00.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6f553640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6815e830 con 0x7f1f680d4130 2024-09-15T23:58:00.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6f553640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1f680d33c0 con 0x7f1f6815e450 2024-09-15T23:58:00.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6f553640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1f6815e9b0 con 0x7f1f680d2a10 2024-09-15T23:58:00.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6caee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f680d4130 0x7f1f68152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:00.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6caee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f680d4130 0x7f1f68152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37458/0 (socket says 172.21.15.112:37458) 2024-09-15T23:58:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6caee640 1 -- 172.21.15.112:0/2722757593 learned_addr learned my addr 172.21.15.112:0/2722757593 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6daf0640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f6815e450 0x7f1f681530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6d2ef640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f680d2a10 0x7f1f6814db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6caee640 1 -- 172.21.15.112:0/2722757593 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f680d2a10 msgr2=0x7f1f6814db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6caee640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f680d2a10 0x7f1f6814db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6caee640 1 -- 172.21.15.112:0/2722757593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f6815e450 msgr2=0x7f1f681530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6caee640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f6815e450 0x7f1f681530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6caee640 1 -- 172.21.15.112:0/2722757593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f680b2900 con 0x7f1f680d4130 2024-09-15T23:58:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6daf0640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f6815e450 0x7f1f681530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:58:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6d2ef640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f680d2a10 0x7f1f6814db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6caee640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f680d4130 0x7f1f68152bb0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800e960 tx=0x7f1f5800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f5dffb640 1 -- 172.21.15.112:0/2722757593 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f58017070 con 0x7f1f680d4130 2024-09-15T23:58:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f5dffb640 1 -- 172.21.15.112:0/2722757593 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5800ca00 con 0x7f1f680d4130 2024-09-15T23:58:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f5dffb640 1 -- 172.21.15.112:0/2722757593 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5800cdb0 con 0x7f1f680d4130 2024-09-15T23:58:00.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6f553640 1 -- 172.21.15.112:0/2722757593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f680b2be0 con 0x7f1f680d4130 2024-09-15T23:58:00.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6f553640 1 -- 172.21.15.112:0/2722757593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f680b31a0 con 0x7f1f680d4130 2024-09-15T23:58:00.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.813+0000 7f1f6f553640 1 -- 172.21.15.112:0/2722757593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f680b5030 con 0x7f1f680d4130 2024-09-15T23:58:00.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.817+0000 7f1f5dffb640 1 -- 172.21.15.112:0/2722757593 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f5801a070 con 0x7f1f680d4130 2024-09-15T23:58:00.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.817+0000 7f1f5dffb640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1f4c0678c0 0x7f1f4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:00.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.817+0000 7f1f5dffb640 1 -- 172.21.15.112:0/2722757593 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f1f58085ea0 con 0x7f1f680d4130 2024-09-15T23:58:00.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.817+0000 7f1f6d2ef640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1f4c0678c0 0x7f1f4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:00.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.817+0000 7f1f6d2ef640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1f4c0678c0 0x7f1f4c069d80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1f64000f70 tx=0x7f1f64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:00.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.821+0000 7f1f5dffb640 1 -- 172.21.15.112:0/2722757593 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1f58056be0 con 0x7f1f680d4130 2024-09-15T23:58:00.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.981+0000 7f1f6f553640 1 -- 172.21.15.112:0/2722757593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f6815d8f0 con 0x7f1f680d4130 2024-09-15T23:58:00.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.985+0000 7f1f5dffb640 1 -- 172.21.15.112:0/2722757593 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+13318 (secure 0 0 0) 0x7f1f580564e0 con 0x7f1f680d4130 2024-09-15T23:58:00.985 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:00.985 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":89,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:57:59.643343+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/434676840":"2024-09-16T23:57:56.530384+0000","172.21.15.112:6836/434676840":"2024-09-16T23:57:56.530384+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:58:00.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.985+0000 7f1f6f553640 1 -- 172.21.15.112:0/2722757593 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1f4c0678c0 msgr2=0x7f1f4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:00.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.985+0000 7f1f6f553640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1f4c0678c0 0x7f1f4c069d80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1f64000f70 tx=0x7f1f64009040 comp rx=0 tx=0).stop 2024-09-15T23:58:00.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.985+0000 7f1f6f553640 1 -- 172.21.15.112:0/2722757593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f680d4130 msgr2=0x7f1f68152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:00.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.985+0000 7f1f6f553640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f680d4130 0x7f1f68152bb0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800e960 tx=0x7f1f5800ee20 comp rx=0 tx=0).stop 2024-09-15T23:58:00.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.985+0000 7f1f6f553640 1 -- 172.21.15.112:0/2722757593 shutdown_connections 2024-09-15T23:58:00.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.985+0000 7f1f6f553640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1f4c0678c0 0x7f1f4c069d80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.985+0000 7f1f6f553640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f6815e450 0x7f1f681530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.985+0000 7f1f6f553640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f680d4130 0x7f1f68152bb0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.985+0000 7f1f6f553640 1 --2- 172.21.15.112:0/2722757593 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f680d2a10 0x7f1f6814db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:00.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.985+0000 7f1f6f553640 1 -- 172.21.15.112:0/2722757593 >> 172.21.15.112:0/2722757593 conn(0x7f1f6808bf90 msgr2=0x7f1f6814ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:00.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.985+0000 7f1f6f553640 1 -- 172.21.15.112:0/2722757593 shutdown_connections 2024-09-15T23:58:00.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:00.985+0000 7f1f6f553640 1 -- 172.21.15.112:0/2722757593 wait complete. 2024-09-15T23:58:01.004 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:53:39.301069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:58:01.005 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:58:01.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f17480e8640 1 Processor -- start 2024-09-15T23:58:01.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f17480e8640 1 -- start start 2024-09-15T23:58:01.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f17480e8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f174015e5f0 0x7f174006d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f17480e8640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f17400ce9d0 0x7f17400cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f17480e8640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f174006d9c0 con 0x7f17400cf920 2024-09-15T23:58:01.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f17480e8640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f174006dca0 con 0x7f17400ce9d0 2024-09-15T23:58:01.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f17480e8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f174006df80 con 0x7f174015e5f0 2024-09-15T23:58:01.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1746685640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f17400cf920 0x7f17400d0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36062/0 (socket says 172.21.15.112:36062) 2024-09-15T23:58:01.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1746685640 1 -- 172.21.15.112:0/847790733 learned_addr learned my addr 172.21.15.112:0/847790733 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:01.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1745e84640 1 --2- 172.21.15.112:0/847790733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f174015e5f0 0x7f174006d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1745683640 1 --2- 172.21.15.112:0/847790733 >> v2:172.21.15.169:3300/0 conn(0x7f17400ce9d0 0x7f17400cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 -- 172.21.15.112:0/847790733 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3840685996 0 0) 0x7f174006d9c0 con 0x7f17400cf920 2024-09-15T23:58:01.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 -- 172.21.15.112:0/847790733 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f172c003530 con 0x7f17400cf920 2024-09-15T23:58:01.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 -- 172.21.15.112:0/847790733 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3026592315 0 0) 0x7f172c003530 con 0x7f17400cf920 2024-09-15T23:58:01.132 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 -- 172.21.15.112:0/847790733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f174015e5f0 msgr2=0x7f174006d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:01.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 --2- 172.21.15.112:0/847790733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f174015e5f0 0x7f174006d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 -- 172.21.15.112:0/847790733 >> v2:172.21.15.169:3300/0 conn(0x7f17400ce9d0 msgr2=0x7f17400cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:01.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 --2- 172.21.15.112:0/847790733 >> v2:172.21.15.169:3300/0 conn(0x7f17400ce9d0 0x7f17400cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 -- 172.21.15.112:0/847790733 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174006e260 con 0x7f17400cf920 2024-09-15T23:58:01.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 -- 172.21.15.112:0/847790733 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f1738001a00 con 0x7f17400cf920 2024-09-15T23:58:01.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 -- 172.21.15.112:0/847790733 >> v1:172.21.15.112:6789/0 conn(0x7f17400cf920 legacy=0x7f17400d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 --2- 172.21.15.112:0/847790733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f172c0039c0 0x7f172c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 --2- 172.21.15.112:0/847790733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f172c004810 0x7f172c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 --2- 172.21.15.112:0/847790733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f172c0051d0 0x7f172c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 -- 172.21.15.112:0/847790733 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f174006dca0 con 0x7f172c004810 2024-09-15T23:58:01.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 -- 172.21.15.112:0/847790733 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f174006df80 con 0x7f172c0039c0 2024-09-15T23:58:01.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1744e82640 1 -- 172.21.15.112:0/847790733 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f172c0045b0 con 0x7f172c0051d0 2024-09-15T23:58:01.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1745683640 1 --2- 172.21.15.112:0/847790733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f172c004810 0x7f172c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1745e84640 1 --2- 172.21.15.112:0/847790733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f172c0039c0 0x7f172c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1746685640 1 --2- 172.21.15.112:0/847790733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f172c0051d0 0x7f172c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1745683640 1 -- 172.21.15.112:0/847790733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f172c0051d0 msgr2=0x7f172c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:01.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1745683640 1 --2- 172.21.15.112:0/847790733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f172c0051d0 0x7f172c00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1745683640 1 -- 172.21.15.112:0/847790733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f172c0039c0 msgr2=0x7f172c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:01.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1745683640 1 --2- 172.21.15.112:0/847790733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f172c0039c0 0x7f172c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1745683640 1 -- 172.21.15.112:0/847790733 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172c003530 con 0x7f172c004810 2024-09-15T23:58:01.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.129+0000 7f1745e84640 1 --2- 172.21.15.112:0/847790733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f172c0039c0 0x7f172c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:58:01.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.133+0000 7f1745683640 1 --2- 172.21.15.112:0/847790733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f172c004810 0x7f172c004c90 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1730009ae0 tx=0x7f173001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef1db21950ee0f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:01.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.133+0000 7f1744e82640 1 -- 172.21.15.112:0/847790733 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300b2070 con 0x7f172c004810 2024-09-15T23:58:01.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.133+0000 7f1744e82640 1 -- 172.21.15.112:0/847790733 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17300a5660 con 0x7f172c004810 2024-09-15T23:58:01.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.133+0000 7f1744e82640 1 -- 172.21.15.112:0/847790733 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300096b0 con 0x7f172c004810 2024-09-15T23:58:01.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.133+0000 7f17480e8640 1 -- 172.21.15.112:0/847790733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f172c004810 msgr2=0x7f172c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.133+0000 7f17480e8640 1 --2- 172.21.15.112:0/847790733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f172c004810 0x7f172c004c90 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1730009ae0 tx=0x7f173001ca70 comp rx=0 tx=0).stop 2024-09-15T23:58:01.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.133+0000 7f1746685640 1 -- 172.21.15.112:0/847790733 reap_dead start 2024-09-15T23:58:01.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.133+0000 7f17480e8640 1 -- 172.21.15.112:0/847790733 shutdown_connections 2024-09-15T23:58:01.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.133+0000 7f17480e8640 1 -- 172.21.15.112:0/847790733 >> 172.21.15.112:0/847790733 conn(0x7f1740074030 msgr2=0x7f174009d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:01.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.133+0000 7f17480e8640 1 -- 172.21.15.112:0/847790733 shutdown_connections 2024-09-15T23:58:01.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.133+0000 7f17480e8640 1 -- 172.21.15.112:0/847790733 wait complete. 2024-09-15T23:58:01.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.133+0000 7f17480e8640 1 Processor -- start 2024-09-15T23:58:01.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.133+0000 7f17480e8640 1 -- start start 2024-09-15T23:58:01.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17480e8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17400cd800 0x7f17400cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17480e8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1740153460 0x7f1740160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17480e8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1740161530 0x7f17401f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17480e8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f174006d210 con 0x7f1740153460 2024-09-15T23:58:01.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17480e8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f174006d090 con 0x7f1740161530 2024-09-15T23:58:01.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17480e8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f174006d390 con 0x7f17400cd800 2024-09-15T23:58:01.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f1745683640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1740153460 0x7f1740160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f1745683640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1740153460 0x7f1740160ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37480/0 (socket says 172.21.15.112:37480) 2024-09-15T23:58:01.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f1745683640 1 -- 172.21.15.112:0/2591632816 learned_addr learned my addr 172.21.15.112:0/2591632816 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:01.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f1746685640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1740161530 0x7f17401f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f1745e84640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17400cd800 0x7f17400cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f1745683640 1 -- 172.21.15.112:0/2591632816 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17400cd800 msgr2=0x7f17400cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f1745683640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17400cd800 0x7f17400cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f1745683640 1 -- 172.21.15.112:0/2591632816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1740161530 msgr2=0x7f17401f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f1745683640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1740161530 0x7f17401f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f1745683640 1 -- 172.21.15.112:0/2591632816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17400cbae0 con 0x7f1740153460 2024-09-15T23:58:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f1746685640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1740161530 0x7f17401f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:58:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f1745683640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1740153460 0x7f1740160ff0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f17300b0040 tx=0x7f172c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17367fc640 1 -- 172.21.15.112:0/2591632816 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300b2040 con 0x7f1740153460 2024-09-15T23:58:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17367fc640 1 -- 172.21.15.112:0/2591632816 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17300ad440 con 0x7f1740153460 2024-09-15T23:58:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17480e8640 1 -- 172.21.15.112:0/2591632816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17400cbdc0 con 0x7f1740153460 2024-09-15T23:58:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17367fc640 1 -- 172.21.15.112:0/2591632816 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300096b0 con 0x7f1740153460 2024-09-15T23:58:01.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17480e8640 1 -- 172.21.15.112:0/2591632816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17400cc380 con 0x7f1740153460 2024-09-15T23:58:01.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17480e8640 1 -- 172.21.15.112:0/2591632816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f174015e5f0 con 0x7f1740153460 2024-09-15T23:58:01.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17367fc640 1 -- 172.21.15.112:0/2591632816 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f17300ad830 con 0x7f1740153460 2024-09-15T23:58:01.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17367fc640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f17240678c0 0x7f1724069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f17367fc640 1 -- 172.21.15.112:0/2591632816 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f17301201b0 con 0x7f1740153460 2024-09-15T23:58:01.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f1745e84640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f17240678c0 0x7f1724069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.137+0000 7f1745e84640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f17240678c0 0x7f1724069d80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f173c0099d0 tx=0x7f173c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:01.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.141+0000 7f17367fc640 1 -- 172.21.15.112:0/2591632816 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f17300167c0 con 0x7f1740153460 2024-09-15T23:58:01.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.289+0000 7f17480e8640 1 -- 172.21.15.112:0/2591632816 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1740161910 con 0x7f1740153460 2024-09-15T23:58:01.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.293+0000 7f17367fc640 1 -- 172.21.15.112:0/2591632816 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f17300f1010 con 0x7f1740153460 2024-09-15T23:58:01.292 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-15T23:58:01.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.293+0000 7f17480e8640 1 -- 172.21.15.112:0/2591632816 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f17240678c0 msgr2=0x7f1724069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.293+0000 7f17480e8640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f17240678c0 0x7f1724069d80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f173c0099d0 tx=0x7f173c008040 comp rx=0 tx=0).stop 2024-09-15T23:58:01.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.293+0000 7f17480e8640 1 -- 172.21.15.112:0/2591632816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1740153460 msgr2=0x7f1740160ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.293+0000 7f17480e8640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1740153460 0x7f1740160ff0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f17300b0040 tx=0x7f172c005840 comp rx=0 tx=0).stop 2024-09-15T23:58:01.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.293+0000 7f17480e8640 1 -- 172.21.15.112:0/2591632816 shutdown_connections 2024-09-15T23:58:01.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.293+0000 7f17480e8640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f17240678c0 0x7f1724069d80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.293+0000 7f17480e8640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1740161530 0x7f17401f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.293+0000 7f17480e8640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1740153460 0x7f1740160ff0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.293+0000 7f17480e8640 1 --2- 172.21.15.112:0/2591632816 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17400cd800 0x7f17400cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.293+0000 7f17480e8640 1 -- 172.21.15.112:0/2591632816 >> 172.21.15.112:0/2591632816 conn(0x7f172c004810 msgr2=0x7f17400b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:01.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.293+0000 7f17480e8640 1 -- 172.21.15.112:0/2591632816 shutdown_connections 2024-09-15T23:58:01.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.293+0000 7f17480e8640 1 -- 172.21.15.112:0/2591632816 wait complete. 2024-09-15T23:58:01.310 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_files_throttle' 2024-09-15T23:58:01.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.421+0000 7f1d3d0a6640 1 Processor -- start 2024-09-15T23:58:01.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.421+0000 7f1d3d0a6640 1 -- start start 2024-09-15T23:58:01.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3d0a6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1d3806f010 0x7f1d38166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3d0a6640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d380b3290 con 0x7f1d3815c2a0 2024-09-15T23:58:01.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3d0a6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d380b3570 con 0x7f1d3815bec0 2024-09-15T23:58:01.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3d0a6640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1d380b3850 con 0x7f1d3806f010 2024-09-15T23:58:01.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3659c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1d3815c2a0 0x7f1d380aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36066/0 (socket says 172.21.15.112:36066) 2024-09-15T23:58:01.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3659c640 1 -- 172.21.15.112:0/1400325318 learned_addr learned my addr 172.21.15.112:0/1400325318 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:01.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3759e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1d3806f010 0x7f1d38166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d35d9b640 1 -- 172.21.15.112:0/1400325318 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2597107785 0 0) 0x7f1d380b3290 con 0x7f1d3815c2a0 2024-09-15T23:58:01.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d35d9b640 1 -- 172.21.15.112:0/1400325318 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d20003530 con 0x7f1d3815c2a0 2024-09-15T23:58:01.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3759e640 1 -- 172.21.15.112:0/1400325318 >> v1:172.21.15.169:6789/0 conn(0x7f1d3815bec0 legacy=0x7f1d380ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:01.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3759e640 1 -- 172.21.15.112:0/1400325318 >> v1:172.21.15.112:6789/0 conn(0x7f1d3815c2a0 legacy=0x7f1d380aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3759e640 1 -- 172.21.15.112:0/1400325318 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d380b3b30 con 0x7f1d3806f010 2024-09-15T23:58:01.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3759e640 1 --2- 172.21.15.112:0/1400325318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d3806f010 0x7f1d38166ff0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009d90 tx=0x7f1d3001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08a24571889b803 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:01.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d35d9b640 1 -- 172.21.15.112:0/1400325318 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d300b2070 con 0x7f1d3806f010 2024-09-15T23:58:01.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d35d9b640 1 -- 172.21.15.112:0/1400325318 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d300a58d0 con 0x7f1d3806f010 2024-09-15T23:58:01.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d35d9b640 1 -- 172.21.15.112:0/1400325318 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d300a5c80 con 0x7f1d3806f010 2024-09-15T23:58:01.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1400325318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d3806f010 msgr2=0x7f1d38166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3d0a6640 1 --2- 172.21.15.112:0/1400325318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d3806f010 0x7f1d38166ff0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009d90 tx=0x7f1d3001c900 comp rx=0 tx=0).stop 2024-09-15T23:58:01.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1400325318 shutdown_connections 2024-09-15T23:58:01.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3d0a6640 1 --2- 172.21.15.112:0/1400325318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d3806f010 0x7f1d38166ff0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1400325318 >> 172.21.15.112:0/1400325318 conn(0x7f1d380b1f90 msgr2=0x7f1d380b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:01.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1400325318 shutdown_connections 2024-09-15T23:58:01.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.425+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1400325318 wait complete. 2024-09-15T23:58:01.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d3d0a6640 1 Processor -- start 2024-09-15T23:58:01.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d3d0a6640 1 -- start start 2024-09-15T23:58:01.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d3d0a6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d3806f010 0x7f1d3814fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d3d0a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3815bec0 0x7f1d3815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d3d0a6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d3815c2a0 0x7f1d3815edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d3d0a6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1d38169ed0 con 0x7f1d3806f010 2024-09-15T23:58:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d3d0a6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1d38169d50 con 0x7f1d3815c2a0 2024-09-15T23:58:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d3d0a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1d3816a050 con 0x7f1d3815bec0 2024-09-15T23:58:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d36d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d3806f010 0x7f1d3814fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d36d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d3806f010 0x7f1d3814fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37504/0 (socket says 172.21.15.112:37504) 2024-09-15T23:58:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d36d9d640 1 -- 172.21.15.112:0/1136446509 learned_addr learned my addr 172.21.15.112:0/1136446509 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d3759e640 1 --2- 172.21.15.112:0/1136446509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d3815c2a0 0x7f1d3815edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d36d9d640 1 -- 172.21.15.112:0/1136446509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3815bec0 msgr2=0x7f1d3815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d36d9d640 1 --2- 172.21.15.112:0/1136446509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3815bec0 0x7f1d3815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d36d9d640 1 -- 172.21.15.112:0/1136446509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d3815c2a0 msgr2=0x7f1d3815edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d36d9d640 1 --2- 172.21.15.112:0/1136446509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d3815c2a0 0x7f1d3815edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d36d9d640 1 -- 172.21.15.112:0/1136446509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d38150390 con 0x7f1d3806f010 2024-09-15T23:58:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d36d9d640 1 --2- 172.21.15.112:0/1136446509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d3806f010 0x7f1d3814fe50 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00c450 tx=0x7f1d2c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d1f7fe640 1 -- 172.21.15.112:0/1136446509 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c012830 con 0x7f1d3806f010 2024-09-15T23:58:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d1f7fe640 1 -- 172.21.15.112:0/1136446509 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d2c017070 con 0x7f1d3806f010 2024-09-15T23:58:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1136446509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d381f8a80 con 0x7f1d3806f010 2024-09-15T23:58:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d1f7fe640 1 -- 172.21.15.112:0/1136446509 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c012c30 con 0x7f1d3806f010 2024-09-15T23:58:01.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1136446509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d381f9040 con 0x7f1d3806f010 2024-09-15T23:58:01.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1136446509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d380b3290 con 0x7f1d3806f010 2024-09-15T23:58:01.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.429+0000 7f1d1f7fe640 1 -- 172.21.15.112:0/1136446509 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d2c01c460 con 0x7f1d3806f010 2024-09-15T23:58:01.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.433+0000 7f1d1f7fe640 1 --2- 172.21.15.112:0/1136446509 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1d240678c0 0x7f1d24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.433+0000 7f1d3659c640 1 --2- 172.21.15.112:0/1136446509 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1d240678c0 0x7f1d24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.433+0000 7f1d1f7fe640 1 -- 172.21.15.112:0/1136446509 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f1d2c085840 con 0x7f1d3806f010 2024-09-15T23:58:01.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.433+0000 7f1d3659c640 1 --2- 172.21.15.112:0/1136446509 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1d240678c0 0x7f1d24069d80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1d28007fd0 tx=0x7f1d28007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:01.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.437+0000 7f1d1f7fe640 1 -- 172.21.15.112:0/1136446509 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1d2c056580 con 0x7f1d3806f010 2024-09-15T23:58:01.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.653+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1136446509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_files_throttle"]} v 0) -- 0x7f1d380b0e20 con 0x7f1d3806f010 2024-09-15T23:58:01.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.665+0000 7f1d1f7fe640 1 -- 172.21.15.112:0/1136446509 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_files_throttle"]}]=0 v228) ==== 137+0+0 (secure 0 0 0) 0x7f1d2c055e80 con 0x7f1d3806f010 2024-09-15T23:58:01.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.665+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1136446509 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1d240678c0 msgr2=0x7f1d24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.665+0000 7f1d3d0a6640 1 --2- 172.21.15.112:0/1136446509 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1d240678c0 0x7f1d24069d80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1d28007fd0 tx=0x7f1d28007900 comp rx=0 tx=0).stop 2024-09-15T23:58:01.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.665+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1136446509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d3806f010 msgr2=0x7f1d3814fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.665+0000 7f1d3d0a6640 1 --2- 172.21.15.112:0/1136446509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d3806f010 0x7f1d3814fe50 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00c450 tx=0x7f1d2c00c910 comp rx=0 tx=0).stop 2024-09-15T23:58:01.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.665+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1136446509 shutdown_connections 2024-09-15T23:58:01.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.665+0000 7f1d3d0a6640 1 --2- 172.21.15.112:0/1136446509 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1d240678c0 0x7f1d24069d80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.665+0000 7f1d3d0a6640 1 --2- 172.21.15.112:0/1136446509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d3815c2a0 0x7f1d3815edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.665+0000 7f1d3d0a6640 1 --2- 172.21.15.112:0/1136446509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3815bec0 0x7f1d3815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.665+0000 7f1d3d0a6640 1 --2- 172.21.15.112:0/1136446509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d3806f010 0x7f1d3814fe50 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.665+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1136446509 >> 172.21.15.112:0/1136446509 conn(0x7f1d380b1f90 msgr2=0x7f1d38155040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:01.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.665+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1136446509 shutdown_connections 2024-09-15T23:58:01.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.665+0000 7f1d3d0a6640 1 -- 172.21.15.112:0/1136446509 wait complete. 2024-09-15T23:58:01.683 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:58:01.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a4d418640 1 Processor -- start 2024-09-15T23:58:01.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a4d418640 1 -- start start 2024-09-15T23:58:01.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a4d418640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7a48070020 0x7f7a4815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a4d418640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7a4815f1d0 0x7f7a480adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a4d418640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a480aede0 con 0x7f7a481520a0 2024-09-15T23:58:01.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a4d418640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f7a48152480 con 0x7f7a48070020 2024-09-15T23:58:01.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a4d418640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7a4815fa10 con 0x7f7a4815f1d0 2024-09-15T23:58:01.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a3e7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7a48070020 0x7f7a4815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a46ffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f7a481520a0 0x7f7a4806f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36076/0 (socket says 172.21.15.112:36076) 2024-09-15T23:58:01.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a3e7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f7a48070020 0x7f7a4815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37520/0 (socket says 172.21.15.112:37520) 2024-09-15T23:58:01.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a46ffd640 1 -- 172.21.15.112:0/793581979 learned_addr learned my addr 172.21.15.112:0/793581979 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:01.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a477fe640 1 --2- 172.21.15.112:0/793581979 >> v2:172.21.15.169:3300/0 conn(0x7f7a4815f1d0 0x7f7a480adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a3e7fc640 1 -- 172.21.15.112:0/793581979 >> v2:172.21.15.169:3300/0 conn(0x7f7a4815f1d0 msgr2=0x7f7a480adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:01.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a3e7fc640 1 --2- 172.21.15.112:0/793581979 >> v2:172.21.15.169:3300/0 conn(0x7f7a4815f1d0 0x7f7a480adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a3e7fc640 1 -- 172.21.15.112:0/793581979 >> v1:172.21.15.112:6789/0 conn(0x7f7a481520a0 legacy=0x7f7a4806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a3e7fc640 1 -- 172.21.15.112:0/793581979 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a48074250 con 0x7f7a48070020 2024-09-15T23:58:01.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a467fc640 1 -- 172.21.15.112:0/793581979 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2239148207 0 0) 0x7f7a480aede0 con 0x7f7a481520a0 2024-09-15T23:58:01.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.797+0000 7f7a3e7fc640 1 --2- 172.21.15.112:0/793581979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a48070020 0x7f7a4815ec90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7a480d0250 tx=0x7f7a3001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d005dfb3232ea89c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:01.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a467fc640 1 -- 172.21.15.112:0/793581979 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300ab650 con 0x7f7a48070020 2024-09-15T23:58:01.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a467fc640 1 -- 172.21.15.112:0/793581979 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a300b0070 con 0x7f7a48070020 2024-09-15T23:58:01.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a467fc640 1 -- 172.21.15.112:0/793581979 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300aba10 con 0x7f7a48070020 2024-09-15T23:58:01.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 -- 172.21.15.112:0/793581979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a48070020 msgr2=0x7f7a4815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 --2- 172.21.15.112:0/793581979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a48070020 0x7f7a4815ec90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7a480d0250 tx=0x7f7a3001c450 comp rx=0 tx=0).stop 2024-09-15T23:58:01.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 -- 172.21.15.112:0/793581979 shutdown_connections 2024-09-15T23:58:01.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 --2- 172.21.15.112:0/793581979 >> v2:172.21.15.169:3300/0 conn(0x7f7a4815f1d0 0x7f7a480adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 --2- 172.21.15.112:0/793581979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a48070020 0x7f7a4815ec90 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 -- 172.21.15.112:0/793581979 >> 172.21.15.112:0/793581979 conn(0x7f7a480b1f90 msgr2=0x7f7a480b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:01.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 -- 172.21.15.112:0/793581979 shutdown_connections 2024-09-15T23:58:01.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 -- 172.21.15.112:0/793581979 wait complete. 2024-09-15T23:58:01.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 Processor -- start 2024-09-15T23:58:01.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 -- start start 2024-09-15T23:58:01.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a48070020 0x7f7a481f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a481520a0 0x7f7a4814bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a4815f1d0 0x7f7a4814c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4815f5e0 con 0x7f7a481520a0 2024-09-15T23:58:01.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7a48073d30 con 0x7f7a4815f1d0 2024-09-15T23:58:01.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7a4815f760 con 0x7f7a48070020 2024-09-15T23:58:01.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a3e7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a481520a0 0x7f7a4814bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a3e7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a481520a0 0x7f7a4814bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37530/0 (socket says 172.21.15.112:37530) 2024-09-15T23:58:01.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a3e7fc640 1 -- 172.21.15.112:0/279214104 learned_addr learned my addr 172.21.15.112:0/279214104 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:01.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a477fe640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a4815f1d0 0x7f7a4814c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a46ffd640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a48070020 0x7f7a481f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a3e7fc640 1 -- 172.21.15.112:0/279214104 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a48070020 msgr2=0x7f7a481f4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a3e7fc640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a48070020 0x7f7a481f4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a3e7fc640 1 -- 172.21.15.112:0/279214104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a4815f1d0 msgr2=0x7f7a4814c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a3e7fc640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a4815f1d0 0x7f7a4814c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a3e7fc640 1 -- 172.21.15.112:0/279214104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a480cfea0 con 0x7f7a481520a0 2024-09-15T23:58:01.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a477fe640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a4815f1d0 0x7f7a4814c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:58:01.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a3e7fc640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a481520a0 0x7f7a4814bc30 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f7a300ad040 tx=0x7f7a3001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:01.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a3ffff640 1 -- 172.21.15.112:0/279214104 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30006e20 con 0x7f7a481520a0 2024-09-15T23:58:01.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a3ffff640 1 -- 172.21.15.112:0/279214104 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a30004220 con 0x7f7a481520a0 2024-09-15T23:58:01.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 -- 172.21.15.112:0/279214104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a480ce5b0 con 0x7f7a481520a0 2024-09-15T23:58:01.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a3ffff640 1 -- 172.21.15.112:0/279214104 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30003620 con 0x7f7a481520a0 2024-09-15T23:58:01.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.801+0000 7f7a4d418640 1 -- 172.21.15.112:0/279214104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a480b40d0 con 0x7f7a481520a0 2024-09-15T23:58:01.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.805+0000 7f7a4d418640 1 -- 172.21.15.112:0/279214104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a4815ec90 con 0x7f7a481520a0 2024-09-15T23:58:01.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.805+0000 7f7a3ffff640 1 -- 172.21.15.112:0/279214104 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a300037c0 con 0x7f7a481520a0 2024-09-15T23:58:01.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.805+0000 7f7a3ffff640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7a280678c0 0x7f7a28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:01.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.805+0000 7f7a3ffff640 1 -- 172.21.15.112:0/279214104 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f7a301203c0 con 0x7f7a481520a0 2024-09-15T23:58:01.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.805+0000 7f7a46ffd640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7a280678c0 0x7f7a28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:01.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.805+0000 7f7a46ffd640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7a280678c0 0x7f7a28069d80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7a38000f70 tx=0x7f7a38007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:01.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.809+0000 7f7a3ffff640 1 -- 172.21.15.112:0/279214104 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a30016070 con 0x7f7a481520a0 2024-09-15T23:58:01.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.969+0000 7f7a4d418640 1 -- 172.21.15.112:0/279214104 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7a4806e540 con 0x7f7a481520a0 2024-09-15T23:58:01.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.977+0000 7f7a3ffff640 1 -- 172.21.15.112:0/279214104 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f7a300f1100 con 0x7f7a481520a0 2024-09-15T23:58:01.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.977+0000 7f7a4d418640 1 -- 172.21.15.112:0/279214104 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7a280678c0 msgr2=0x7f7a28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.977+0000 7f7a4d418640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7a280678c0 0x7f7a28069d80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7a38000f70 tx=0x7f7a38007b60 comp rx=0 tx=0).stop 2024-09-15T23:58:01.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.977+0000 7f7a4d418640 1 -- 172.21.15.112:0/279214104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a481520a0 msgr2=0x7f7a4814bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:01.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.977+0000 7f7a4d418640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a481520a0 0x7f7a4814bc30 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f7a300ad040 tx=0x7f7a3001ac90 comp rx=0 tx=0).stop 2024-09-15T23:58:01.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.977+0000 7f7a4d418640 1 -- 172.21.15.112:0/279214104 shutdown_connections 2024-09-15T23:58:01.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.977+0000 7f7a4d418640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7a280678c0 0x7f7a28069d80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.977+0000 7f7a4d418640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a4815f1d0 0x7f7a4814c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.977+0000 7f7a4d418640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a481520a0 0x7f7a4814bc30 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.977+0000 7f7a4d418640 1 --2- 172.21.15.112:0/279214104 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a48070020 0x7f7a481f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:01.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.977+0000 7f7a4d418640 1 -- 172.21.15.112:0/279214104 >> 172.21.15.112:0/279214104 conn(0x7f7a480b1f90 msgr2=0x7f7a481516b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:01.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.977+0000 7f7a4d418640 1 -- 172.21.15.112:0/279214104 shutdown_connections 2024-09-15T23:58:01.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:01.977+0000 7f7a4d418640 1 -- 172.21.15.112:0/279214104 wait complete. 2024-09-15T23:58:01.996 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:58:01.996 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:58:02.090 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:58:02.164 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:58:02.164 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:58:02.164 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:58:02.170 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:58:02.170 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:58:02.171 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:58:02.177 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:58:02.177 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:58:02.177 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:58:02.217 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:58:02.217 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:58:02.217 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:58:02.223 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:58:02.224 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:58:02.224 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:02.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.381+0000 7f13aa9cd640 1 Processor -- start 2024-09-15T23:58:02.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.381+0000 7f13aa9cd640 1 -- start start 2024-09-15T23:58:02.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13aa9cd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f13a406bcc0 0x7f13a406c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:02.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13aa9cd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13a40d1050 0x7f13a40d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:02.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13aa9cd640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13a40d1d80 con 0x7f13a4145d90 2024-09-15T23:58:02.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13aa9cd640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f13a406c670 con 0x7f13a406bcc0 2024-09-15T23:58:02.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13aa9cd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f13a40afa20 con 0x7f13a40d1050 2024-09-15T23:58:02.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13a37fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f13a406bcc0 0x7f13a406c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:02.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13a3fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f13a4145d90 0x7f13a40b0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36090/0 (socket says 172.21.15.112:36090) 2024-09-15T23:58:02.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13a37fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f13a406bcc0 0x7f13a406c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37532/0 (socket says 172.21.15.112:37532) 2024-09-15T23:58:02.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13a3fff640 1 -- 172.21.15.112:0/751230358 learned_addr learned my addr 172.21.15.112:0/751230358 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:02.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13a37fe640 1 -- 172.21.15.112:0/751230358 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13a40d1050 msgr2=0x7f13a40d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:02.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13a8f6a640 1 --2- 172.21.15.112:0/751230358 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13a40d1050 0x7f13a40d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:02.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13a37fe640 1 --2- 172.21.15.112:0/751230358 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13a40d1050 0x7f13a40d14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:02.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13a37fe640 1 -- 172.21.15.112:0/751230358 >> v1:172.21.15.112:6789/0 conn(0x7f13a4145d90 legacy=0x7f13a40b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:02.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13a37fe640 1 -- 172.21.15.112:0/751230358 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a40afd00 con 0x7f13a406bcc0 2024-09-15T23:58:02.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13a2ffd640 1 -- 172.21.15.112:0/751230358 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 32555973 0 0) 0x7f13a40d1d80 con 0x7f13a4145d90 2024-09-15T23:58:02.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13a37fe640 1 --2- 172.21.15.112:0/751230358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a406bcc0 0x7f13a406c130 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f13980097c0 tx=0x7f139801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896668271ee868c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:02.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13a2ffd640 1 -- 172.21.15.112:0/751230358 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13980b0070 con 0x7f13a406bcc0 2024-09-15T23:58:02.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13a2ffd640 1 -- 172.21.15.112:0/751230358 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1398004230 con 0x7f13a406bcc0 2024-09-15T23:58:02.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.385+0000 7f13a2ffd640 1 -- 172.21.15.112:0/751230358 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1398003620 con 0x7f13a406bcc0 2024-09-15T23:58:02.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 -- 172.21.15.112:0/751230358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a406bcc0 msgr2=0x7f13a406c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:02.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 --2- 172.21.15.112:0/751230358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a406bcc0 0x7f13a406c130 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f13980097c0 tx=0x7f139801c4a0 comp rx=0 tx=0).stop 2024-09-15T23:58:02.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 -- 172.21.15.112:0/751230358 shutdown_connections 2024-09-15T23:58:02.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 --2- 172.21.15.112:0/751230358 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13a40d1050 0x7f13a40d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:02.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 --2- 172.21.15.112:0/751230358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a406bcc0 0x7f13a406c130 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:02.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 -- 172.21.15.112:0/751230358 >> 172.21.15.112:0/751230358 conn(0x7f13a409aa00 msgr2=0x7f13a40b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:02.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 -- 172.21.15.112:0/751230358 shutdown_connections 2024-09-15T23:58:02.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 -- 172.21.15.112:0/751230358 wait complete. 2024-09-15T23:58:02.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 Processor -- start 2024-09-15T23:58:02.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 -- start start 2024-09-15T23:58:02.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a406bcc0 0x7f13a4163220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:02.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13a40d1050 0x7f13a41644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:02.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13a4145d90 0x7f13a41400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:02.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f13a40b4a20 con 0x7f13a406bcc0 2024-09-15T23:58:02.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f13a40b48a0 con 0x7f13a4145d90 2024-09-15T23:58:02.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f13a40b4ba0 con 0x7f13a40d1050 2024-09-15T23:58:02.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a406bcc0 0x7f13a4163220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:02.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a406bcc0 0x7f13a4163220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37534/0 (socket says 172.21.15.112:37534) 2024-09-15T23:58:02.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a3fff640 1 -- 172.21.15.112:0/3735863852 learned_addr learned my addr 172.21.15.112:0/3735863852 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:02.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a8f6a640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13a4145d90 0x7f13a41400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:02.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a37fe640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13a40d1050 0x7f13a41644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:02.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a3fff640 1 -- 172.21.15.112:0/3735863852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13a40d1050 msgr2=0x7f13a41644e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:02.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a3fff640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13a40d1050 0x7f13a41644e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:02.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a3fff640 1 -- 172.21.15.112:0/3735863852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13a4145d90 msgr2=0x7f13a41400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:02.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a3fff640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13a4145d90 0x7f13a41400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:02.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a3fff640 1 -- 172.21.15.112:0/3735863852 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a4160da0 con 0x7f13a406bcc0 2024-09-15T23:58:02.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a8f6a640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13a4145d90 0x7f13a41400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:02.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a3fff640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a406bcc0 0x7f13a4163220 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f139c00c890 tx=0x7f139c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:02.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a0ff9640 1 -- 172.21.15.112:0/3735863852 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c018070 con 0x7f13a406bcc0 2024-09-15T23:58:02.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a0ff9640 1 -- 172.21.15.112:0/3735863852 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f139c00a640 con 0x7f13a406bcc0 2024-09-15T23:58:02.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 -- 172.21.15.112:0/3735863852 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a4163800 con 0x7f13a406bcc0 2024-09-15T23:58:02.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13a0ff9640 1 -- 172.21.15.112:0/3735863852 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c00aa30 con 0x7f13a406bcc0 2024-09-15T23:58:02.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 -- 172.21.15.112:0/3735863852 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a413f8e0 con 0x7f13a406bcc0 2024-09-15T23:58:02.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.389+0000 7f13aa9cd640 1 -- 172.21.15.112:0/3735863852 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a413f3f0 con 0x7f13a406bcc0 2024-09-15T23:58:02.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.393+0000 7f13a0ff9640 1 -- 172.21.15.112:0/3735863852 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f139c00abd0 con 0x7f13a406bcc0 2024-09-15T23:58:02.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.393+0000 7f13a0ff9640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13900678c0 0x7f1390069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:02.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.393+0000 7f13a0ff9640 1 -- 172.21.15.112:0/3735863852 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f139c0850e0 con 0x7f13a406bcc0 2024-09-15T23:58:02.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.393+0000 7f13a37fe640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13900678c0 0x7f1390069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:02.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.393+0000 7f13a37fe640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13900678c0 0x7f1390069d80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f13980ad000 tx=0x7f13980a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:02.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.397+0000 7f13a0ff9640 1 -- 172.21.15.112:0/3735863852 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f13a4160da0 con 0x7f13a406bcc0 2024-09-15T23:58:02.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.577+0000 7f13aa9cd640 1 -- 172.21.15.112:0/3735863852 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13a40d1d80 con 0x7f13a406bcc0 2024-09-15T23:58:02.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.577+0000 7f13a0ff9640 1 -- 172.21.15.112:0/3735863852 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+3920 (secure 0 0 0) 0x7f139c055da0 con 0x7f13a406bcc0 2024-09-15T23:58:02.578 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:02.578 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":48,"btime":"2024-09-15T23:57:57:532800+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1475104986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1475104986},{"type":"v1","addr":"172.21.15.169:6835","nonce":1475104986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2253954019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2253954019},{"type":"v1","addr":"172.21.15.169:6834","nonce":2253954019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1645054566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1645054566},{"type":"v1","addr":"172.21.15.112:6835","nonce":1645054566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6624,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/727497687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":727497687},{"type":"v1","addr":"172.21.15.112:6837","nonce":727497687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[]} 2024-09-15T23:58:02.578 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 48 2024-09-15T23:58:02.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.577+0000 7f13aa9cd640 1 -- 172.21.15.112:0/3735863852 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13900678c0 msgr2=0x7f1390069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:02.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.577+0000 7f13aa9cd640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13900678c0 0x7f1390069d80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f13980ad000 tx=0x7f13980a6000 comp rx=0 tx=0).stop 2024-09-15T23:58:02.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.577+0000 7f13aa9cd640 1 -- 172.21.15.112:0/3735863852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a406bcc0 msgr2=0x7f13a4163220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:02.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.577+0000 7f13aa9cd640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a406bcc0 0x7f13a4163220 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f139c00c890 tx=0x7f139c00cd50 comp rx=0 tx=0).stop 2024-09-15T23:58:02.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.577+0000 7f13aa9cd640 1 -- 172.21.15.112:0/3735863852 shutdown_connections 2024-09-15T23:58:02.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.577+0000 7f13aa9cd640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f13900678c0 0x7f1390069d80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:02.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.577+0000 7f13aa9cd640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13a4145d90 0x7f13a41400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:02.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.577+0000 7f13aa9cd640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13a40d1050 0x7f13a41644e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:02.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.577+0000 7f13aa9cd640 1 --2- 172.21.15.112:0/3735863852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a406bcc0 0x7f13a4163220 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:02.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.577+0000 7f13aa9cd640 1 -- 172.21.15.112:0/3735863852 >> 172.21.15.112:0/3735863852 conn(0x7f13a409aa00 msgr2=0x7f13a4144a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:02.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.581+0000 7f13aa9cd640 1 -- 172.21.15.112:0/3735863852 shutdown_connections 2024-09-15T23:58:02.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.581+0000 7f13aa9cd640 1 -- 172.21.15.112:0/3735863852 wait complete. 2024-09-15T23:58:02.595 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:58:02.596 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:58:02.596 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:58:02.596 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:02.596 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:58:02.596 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:58:02.597 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:58:02.597 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:02.597 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:58:02.597 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:58:02.597 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:58:02.597 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:02.597 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:58:02.597 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:58:02.598 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:58:02.598 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:02.610 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:58:02.610 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:58:02.611 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:58:02.611 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:58:02.612 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:58:02.613 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:58:02.616 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:58:02.616 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:58:02.653 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:58:02.653 DEBUG:teuthology.parallel:result is None 2024-09-15T23:58:02.654 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:58:02.654 DEBUG:teuthology.parallel:result is None 2024-09-15T23:58:02.659 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:58:02.660 DEBUG:teuthology.parallel:result is None 2024-09-15T23:58:02.661 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:58:02.661 DEBUG:teuthology.parallel:result is None 2024-09-15T23:58:02.661 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:58:02.711 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-15T23:58:02.711 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-15T23:58:02.730 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-09-15T23:58:02.737 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-15T23:58:02.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.785+0000 7f60f9fc8640 1 Processor -- start 2024-09-15T23:58:02.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.785+0000 7f60f9fc8640 1 -- start start 2024-09-15T23:58:02.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.785+0000 7f60f9fc8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f60f40cf620 0x7f60f4168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:02.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.785+0000 7f60f9fc8640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60f40d0300 con 0x7f60f4161a60 2024-09-15T23:58:02.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.785+0000 7f60f9fc8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60f406e6c0 con 0x7f60f40d3060 2024-09-15T23:58:02.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.785+0000 7f60f9fc8640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f60f40cfa90 con 0x7f60f40cf620 2024-09-15T23:58:02.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.785+0000 7f60f37fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f60f4161a60 0x7f60f40d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36108/0 (socket says 172.21.15.112:36108) 2024-09-15T23:58:02.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.785+0000 7f60f37fe640 1 -- 172.21.15.112:0/209442713 learned_addr learned my addr 172.21.15.112:0/209442713 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:02.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.785+0000 7f60f3fff640 1 --2- 172.21.15.112:0/209442713 >> v2:172.21.15.112:3300/0 conn(0x7f60f40cf620 0x7f60f4168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:02.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.785+0000 7f60f27fc640 1 -- 172.21.15.112:0/209442713 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3380063205 0 0) 0x7f60e4001120 con 0x7f60f4161a60 2024-09-15T23:58:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.785+0000 7f60f27fc640 1 -- 172.21.15.112:0/209442713 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60dc003530 con 0x7f60f4161a60 2024-09-15T23:58:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.785+0000 7f60f3fff640 1 -- 172.21.15.112:0/209442713 >> v1:172.21.15.169:6789/0 conn(0x7f60f40d3060 legacy=0x7f60f40cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.785+0000 7f60f3fff640 1 -- 172.21.15.112:0/209442713 >> v1:172.21.15.112:6789/0 conn(0x7f60f4161a60 legacy=0x7f60f40d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:02.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.785+0000 7f60f3fff640 1 -- 172.21.15.112:0/209442713 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f40b0f60 con 0x7f60f40cf620 2024-09-15T23:58:02.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f3fff640 1 --2- 172.21.15.112:0/209442713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f40cf620 0x7f60f4168f10 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009d90 tx=0x7f60ec01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fc7e6423ac5dff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:02.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f27fc640 1 -- 172.21.15.112:0/209442713 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0b2070 con 0x7f60f40cf620 2024-09-15T23:58:02.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f27fc640 1 -- 172.21.15.112:0/209442713 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ec0a5970 con 0x7f60f40cf620 2024-09-15T23:58:02.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f27fc640 1 -- 172.21.15.112:0/209442713 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0a5d20 con 0x7f60f40cf620 2024-09-15T23:58:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 -- 172.21.15.112:0/209442713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f40cf620 msgr2=0x7f60f4168f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 --2- 172.21.15.112:0/209442713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f40cf620 0x7f60f4168f10 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009d90 tx=0x7f60ec01c8b0 comp rx=0 tx=0).stop 2024-09-15T23:58:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 -- 172.21.15.112:0/209442713 shutdown_connections 2024-09-15T23:58:02.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 --2- 172.21.15.112:0/209442713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f40cf620 0x7f60f4168f10 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:02.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 -- 172.21.15.112:0/209442713 >> 172.21.15.112:0/209442713 conn(0x7f60f408bf90 msgr2=0x7f60f409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:02.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 -- 172.21.15.112:0/209442713 shutdown_connections 2024-09-15T23:58:02.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 -- 172.21.15.112:0/209442713 wait complete. 2024-09-15T23:58:02.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 Processor -- start 2024-09-15T23:58:02.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 -- start start 2024-09-15T23:58:02.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f40cf620 0x7f60f415bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:02.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60f40d3060 0x7f60f4150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:02.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60f4161a60 0x7f60f40c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f60f416bc70 con 0x7f60f40cf620 2024-09-15T23:58:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f60f406d190 con 0x7f60f40d3060 2024-09-15T23:58:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f60f416bdf0 con 0x7f60f4161a60 2024-09-15T23:58:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f40cf620 0x7f60f415bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f40cf620 0x7f60f415bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37594/0 (socket says 172.21.15.112:37594) 2024-09-15T23:58:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f37fe640 1 -- 172.21.15.112:0/1894427514 learned_addr learned my addr 172.21.15.112:0/1894427514 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f2ffd640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60f40d3060 0x7f60f4150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f3fff640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60f4161a60 0x7f60f40c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f37fe640 1 -- 172.21.15.112:0/1894427514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60f4161a60 msgr2=0x7f60f40c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f37fe640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60f4161a60 0x7f60f40c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f37fe640 1 -- 172.21.15.112:0/1894427514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60f40d3060 msgr2=0x7f60f4150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f37fe640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60f40d3060 0x7f60f4150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:02.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f37fe640 1 -- 172.21.15.112:0/1894427514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f41580f0 con 0x7f60f40cf620 2024-09-15T23:58:02.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f2ffd640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60f40d3060 0x7f60f4150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:58:02.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f37fe640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f40cf620 0x7f60f415bb50 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f60e400c430 tx=0x7f60e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:02.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60dbfff640 1 -- 172.21.15.112:0/1894427514 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4017070 con 0x7f60f40cf620 2024-09-15T23:58:02.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60dbfff640 1 -- 172.21.15.112:0/1894427514 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e4005cf0 con 0x7f60f40cf620 2024-09-15T23:58:02.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 -- 172.21.15.112:0/1894427514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f41583d0 con 0x7f60f40cf620 2024-09-15T23:58:02.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60dbfff640 1 -- 172.21.15.112:0/1894427514 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40072f0 con 0x7f60f40cf620 2024-09-15T23:58:02.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.789+0000 7f60f9fc8640 1 -- 172.21.15.112:0/1894427514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f4158990 con 0x7f60f40cf620 2024-09-15T23:58:02.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.793+0000 7f60f9fc8640 1 -- 172.21.15.112:0/1894427514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f40cef10 con 0x7f60f40cf620 2024-09-15T23:58:02.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.793+0000 7f60dbfff640 1 -- 172.21.15.112:0/1894427514 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f60e401a070 con 0x7f60f40cf620 2024-09-15T23:58:02.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.793+0000 7f60dbfff640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f60e00678c0 0x7f60e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:02.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.793+0000 7f60dbfff640 1 -- 172.21.15.112:0/1894427514 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f60e4084f70 con 0x7f60f40cf620 2024-09-15T23:58:02.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.793+0000 7f60f2ffd640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f60e00678c0 0x7f60e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:02.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.793+0000 7f60f2ffd640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f60e00678c0 0x7f60e0069d80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f60f415c5c0 tx=0x7f60e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:02.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.797+0000 7f60dbfff640 1 -- 172.21.15.112:0/1894427514 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f60f40d0300 con 0x7f60f40cf620 2024-09-15T23:58:02.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:02.969+0000 7f60f9fc8640 1 -- 172.21.15.112:0/1894427514 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f60f40d2ba0 con 0x7f60f40cf620 2024-09-15T23:58:03.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.685+0000 7f60dbfff640 1 -- 172.21.15.112:0/1894427514 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v91) ==== 97+0+0 (secure 0 0 0) 0x7f60e4055c20 con 0x7f60f40cf620 2024-09-15T23:58:03.688 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-15T23:58:03.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.689+0000 7f60f9fc8640 1 -- 172.21.15.112:0/1894427514 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f60e00678c0 msgr2=0x7f60e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:03.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.689+0000 7f60f9fc8640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f60e00678c0 0x7f60e0069d80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f60f415c5c0 tx=0x7f60e8009040 comp rx=0 tx=0).stop 2024-09-15T23:58:03.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.689+0000 7f60f9fc8640 1 -- 172.21.15.112:0/1894427514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f40cf620 msgr2=0x7f60f415bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:03.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.689+0000 7f60f9fc8640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f40cf620 0x7f60f415bb50 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f60e400c430 tx=0x7f60e400c8f0 comp rx=0 tx=0).stop 2024-09-15T23:58:03.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.689+0000 7f60f9fc8640 1 -- 172.21.15.112:0/1894427514 shutdown_connections 2024-09-15T23:58:03.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.689+0000 7f60f9fc8640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f60e00678c0 0x7f60e0069d80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:03.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.689+0000 7f60f9fc8640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60f4161a60 0x7f60f40c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:03.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.689+0000 7f60f9fc8640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60f40d3060 0x7f60f4150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:03.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.689+0000 7f60f9fc8640 1 --2- 172.21.15.112:0/1894427514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60f40cf620 0x7f60f415bb50 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:03.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.689+0000 7f60f9fc8640 1 -- 172.21.15.112:0/1894427514 >> 172.21.15.112:0/1894427514 conn(0x7f60f408bf90 msgr2=0x7f60f4160b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:03.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.689+0000 7f60f9fc8640 1 -- 172.21.15.112:0/1894427514 shutdown_connections 2024-09-15T23:58:03.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.689+0000 7f60f9fc8640 1 -- 172.21.15.112:0/1894427514 wait complete. 2024-09-15T23:58:03.714 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:58:03.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec8ecd9640 1 Processor -- start 2024-09-15T23:58:03.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec8ecd9640 1 -- start start 2024-09-15T23:58:03.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec8ecd9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec880b4f30 0x7fec8806f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:03.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec8ecd9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fec8806fec0 0x7fec880aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:03.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec8ecd9640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec88070f50 con 0x7fec88144b50 2024-09-15T23:58:03.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec8ecd9640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fec880ae8c0 con 0x7fec8806fec0 2024-09-15T23:58:03.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec8ecd9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fec880706b0 con 0x7fec880b4f30 2024-09-15T23:58:03.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec8ca75640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fec88144b50 0x7fec880b4820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36110/0 (socket says 172.21.15.112:36110) 2024-09-15T23:58:03.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec8ca75640 1 -- 172.21.15.112:0/3261196464 learned_addr learned my addr 172.21.15.112:0/3261196464 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:03.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec8d276640 1 --2- 172.21.15.112:0/3261196464 >> v2:172.21.15.112:3300/0 conn(0x7fec8806fec0 0x7fec880aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:03.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec87fff640 1 --2- 172.21.15.112:0/3261196464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec880b4f30 0x7fec8806f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:03.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec877fe640 1 -- 172.21.15.112:0/3261196464 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3536858862 0 0) 0x7fec88070f50 con 0x7fec88144b50 2024-09-15T23:58:03.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec8d276640 1 -- 172.21.15.112:0/3261196464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec880b4f30 msgr2=0x7fec8806f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:03.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec8d276640 1 --2- 172.21.15.112:0/3261196464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec880b4f30 0x7fec8806f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:03.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec8d276640 1 -- 172.21.15.112:0/3261196464 >> v1:172.21.15.112:6789/0 conn(0x7fec88144b50 legacy=0x7fec880b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:03.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.833+0000 7fec8d276640 1 -- 172.21.15.112:0/3261196464 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec88070990 con 0x7fec8806fec0 2024-09-15T23:58:03.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8d276640 1 --2- 172.21.15.112:0/3261196464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec8806fec0 0x7fec880aed50 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fec80009d90 tx=0x7fec8001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6fb3996b344660 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:03.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec877fe640 1 -- 172.21.15.112:0/3261196464 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec800b2070 con 0x7fec8806fec0 2024-09-15T23:58:03.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec877fe640 1 -- 172.21.15.112:0/3261196464 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec800a5a20 con 0x7fec8806fec0 2024-09-15T23:58:03.837 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec877fe640 1 -- 172.21.15.112:0/3261196464 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec800a5df0 con 0x7fec8806fec0 2024-09-15T23:58:03.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 -- 172.21.15.112:0/3261196464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec8806fec0 msgr2=0x7fec880aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:03.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 --2- 172.21.15.112:0/3261196464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec8806fec0 0x7fec880aed50 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fec80009d90 tx=0x7fec8001c940 comp rx=0 tx=0).stop 2024-09-15T23:58:03.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 -- 172.21.15.112:0/3261196464 shutdown_connections 2024-09-15T23:58:03.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 --2- 172.21.15.112:0/3261196464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec8806fec0 0x7fec880aed50 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:03.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 --2- 172.21.15.112:0/3261196464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec880b4f30 0x7fec8806f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:03.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 -- 172.21.15.112:0/3261196464 >> 172.21.15.112:0/3261196464 conn(0x7fec880b6650 msgr2=0x7fec880b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:03.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 -- 172.21.15.112:0/3261196464 shutdown_connections 2024-09-15T23:58:03.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 -- 172.21.15.112:0/3261196464 wait complete. 2024-09-15T23:58:03.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 Processor -- start 2024-09-15T23:58:03.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 -- start start 2024-09-15T23:58:03.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec8806fec0 0x7fec88143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:03.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec880b4f30 0x7fec88158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:03.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec88144b50 0x7fec880ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:03.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fec880afc20 con 0x7fec880b4f30 2024-09-15T23:58:03.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fec880afaa0 con 0x7fec8806fec0 2024-09-15T23:58:03.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8ecd9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fec880afda0 con 0x7fec88144b50 2024-09-15T23:58:03.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec87fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec880b4f30 0x7fec88158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:03.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec87fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec880b4f30 0x7fec88158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37600/0 (socket says 172.21.15.112:37600) 2024-09-15T23:58:03.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec87fff640 1 -- 172.21.15.112:0/1358897211 learned_addr learned my addr 172.21.15.112:0/1358897211 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:03.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.837+0000 7fec8d276640 1 --2- 172.21.15.112:0/1358897211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec88144b50 0x7fec880ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:03.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec87fff640 1 -- 172.21.15.112:0/1358897211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec88144b50 msgr2=0x7fec880ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:03.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec87fff640 1 --2- 172.21.15.112:0/1358897211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec88144b50 0x7fec880ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:03.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec87fff640 1 -- 172.21.15.112:0/1358897211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec8806fec0 msgr2=0x7fec88143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:03.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec87fff640 1 --2- 172.21.15.112:0/1358897211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec8806fec0 0x7fec88143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:03.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec87fff640 1 -- 172.21.15.112:0/1358897211 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec881594d0 con 0x7fec880b4f30 2024-09-15T23:58:03.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec8d276640 1 --2- 172.21.15.112:0/1358897211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec88144b50 0x7fec880ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:03.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec87fff640 1 --2- 172.21.15.112:0/1358897211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec880b4f30 0x7fec88158c10 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00d800 tx=0x7fec7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:03.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec857fa640 1 -- 172.21.15.112:0/1358897211 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00b6c0 con 0x7fec880b4f30 2024-09-15T23:58:03.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec857fa640 1 -- 172.21.15.112:0/1358897211 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec7c019070 con 0x7fec880b4f30 2024-09-15T23:58:03.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec8ecd9640 1 -- 172.21.15.112:0/1358897211 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec881597b0 con 0x7fec880b4f30 2024-09-15T23:58:03.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec857fa640 1 -- 172.21.15.112:0/1358897211 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00bac0 con 0x7fec880b4f30 2024-09-15T23:58:03.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec8ecd9640 1 -- 172.21.15.112:0/1358897211 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec88159d70 con 0x7fec880b4f30 2024-09-15T23:58:03.843 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec8ecd9640 1 -- 172.21.15.112:0/1358897211 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec880aed50 con 0x7fec880b4f30 2024-09-15T23:58:03.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec857fa640 1 -- 172.21.15.112:0/1358897211 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec7c00bc60 con 0x7fec880b4f30 2024-09-15T23:58:03.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec857fa640 1 --2- 172.21.15.112:0/1358897211 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec740678c0 0x7fec74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:03.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec8ca75640 1 --2- 172.21.15.112:0/1358897211 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec740678c0 0x7fec74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:03.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec857fa640 1 -- 172.21.15.112:0/1358897211 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5249+0+0 (secure 0 0 0) 0x7fec7c086040 con 0x7fec880b4f30 2024-09-15T23:58:03.844 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.841+0000 7fec8ca75640 1 --2- 172.21.15.112:0/1358897211 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec740678c0 0x7fec74069d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fec780015a0 tx=0x7fec78007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:03.846 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:03.845+0000 7fec857fa640 1 -- 172.21.15.112:0/1358897211 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec7c056cb0 con 0x7fec880b4f30 2024-09-15T23:58:04.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.065+0000 7fec8ecd9640 1 -- 172.21.15.112:0/1358897211 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fec8806bcc0 con 0x7fec880b4f30 2024-09-15T23:58:04.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.069+0000 7fec857fa640 1 -- 172.21.15.112:0/1358897211 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7fec7c0565b0 con 0x7fec880b4f30 2024-09-15T23:58:04.069 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:04.069 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:58:04.069 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-15T23:58:04.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.069 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-15T23:58:04.069 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmPvLEFBAA/WS7KNQ60+LzhOcQyCVWoQ==", 2024-09-15T23:58:04.069 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.069 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:58:04.069 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:58:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:58:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-15T23:58:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmN/+jIxAAiXM9onNC3twhiZrqCdWtUQ==", 2024-09-15T23:58:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:58:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:58:04.070 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:58:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-15T23:58:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmEbNbHRAAjP+2Z2XYc0tarO48R/ocIQ==", 2024-09-15T23:58:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:58:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:58:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:58:04.071 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-15T23:58:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmg6AqLBAAZ3PKcarPcPfvIWSTnE5uLA==", 2024-09-15T23:58:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:58:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:58:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:58:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.072 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-15T23:58:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBRc+dmnOKMBxAAdaIaYmXKAFGIPTxfYt2apQ==", 2024-09-15T23:58:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:58:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:58:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-15T23:58:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBUc+dmnowGFhAAa3jXrvZ0An+9IwM9988mvQ==", 2024-09-15T23:58:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:58:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:58:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-15T23:58:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBXc+dmnj9kJRAAZbpx5TM2ukiLKqi+iZAE5g==", 2024-09-15T23:58:04.074 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:58:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:58:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-15T23:58:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBac+dmAdXtNxAA8g+Nxz1RyVf+P8KOtkw5qw==", 2024-09-15T23:58:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:58:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:58:04.075 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-15T23:58:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBhc+dmyOApAhAA9Cv9nW1b5JvO9cH9emao4A==", 2024-09-15T23:58:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:58:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:58:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-15T23:58:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBkc+dmFIDwDxAAR/59kfrjiLU4emIqtthfRg==", 2024-09-15T23:58:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:58:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:58:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-15T23:58:04.077 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBnc+dmZVB/IRAAFbvodnxisklCL/yuD+F5ew==", 2024-09-15T23:58:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:58:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:58:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-15T23:58:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBqc+dmuty6LxAAHWB/GByU/hXOL/+dnRpcVA==", 2024-09-15T23:58:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:58:04.078 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:58:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-15T23:58:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw==", 2024-09-15T23:58:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:58:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-15T23:58:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:58:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-15T23:58:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmmP6vORAAqxzX3OjoHnionZo1koIqRQ==", 2024-09-15T23:58:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:58:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:58:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:58:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:58:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.080 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-15T23:58:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmj2XtNhAAB5620fN0Kr8Cqgd2+1cebg==", 2024-09-15T23:58:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:58:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:58:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:58:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:58:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-15T23:58:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBOc+dmt+I7AxAA+eyV3eaThbjRNo0zJT9OQg==", 2024-09-15T23:58:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:58:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:58:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:58:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:58:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-15T23:58:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBMc+dmDuzBORAAzpiXmO3QO+1RKRvPGQLViQ==", 2024-09-15T23:58:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:58:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:58:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:58:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-15T23:58:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dm4JK5ERAA3d3OABWXchejCqjJRrhTfQ==", 2024-09-15T23:58:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.084 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:58:04.084 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-15T23:58:04.084 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.084 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:04.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.084 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-15T23:58:04.084 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dm5nULDxAAi9UvgPZ7sU/Zz2jLKsu4ng==", 2024-09-15T23:58:04.084 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:58:04.084 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:58:04.084 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-15T23:58:04.084 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:58:04.085 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.085 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.085 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-15T23:58:04.085 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:58:04.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.073+0000 7fec8ecd9640 1 -- 172.21.15.112:0/1358897211 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec740678c0 msgr2=0x7fec74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:04.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.073+0000 7fec8ecd9640 1 --2- 172.21.15.112:0/1358897211 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec740678c0 0x7fec74069d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fec780015a0 tx=0x7fec78007970 comp rx=0 tx=0).stop 2024-09-15T23:58:04.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.073+0000 7fec8ecd9640 1 -- 172.21.15.112:0/1358897211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec880b4f30 msgr2=0x7fec88158c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:04.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.073+0000 7fec8ecd9640 1 --2- 172.21.15.112:0/1358897211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec880b4f30 0x7fec88158c10 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00d800 tx=0x7fec7c00dcc0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.073+0000 7fec8ecd9640 1 -- 172.21.15.112:0/1358897211 shutdown_connections 2024-09-15T23:58:04.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.073+0000 7fec8ecd9640 1 --2- 172.21.15.112:0/1358897211 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fec740678c0 0x7fec74069d80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.073+0000 7fec8ecd9640 1 --2- 172.21.15.112:0/1358897211 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec88144b50 0x7fec880ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.073+0000 7fec8ecd9640 1 --2- 172.21.15.112:0/1358897211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec880b4f30 0x7fec88158c10 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.073+0000 7fec8ecd9640 1 --2- 172.21.15.112:0/1358897211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec8806fec0 0x7fec88143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.073+0000 7fec8ecd9640 1 -- 172.21.15.112:0/1358897211 >> 172.21.15.112:0/1358897211 conn(0x7fec880b6650 msgr2=0x7fec88140f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:04.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.073+0000 7fec8ecd9640 1 -- 172.21.15.112:0/1358897211 shutdown_connections 2024-09-15T23:58:04.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.073+0000 7fec8ecd9640 1 -- 172.21.15.112:0/1358897211 wait complete. 2024-09-15T23:58:04.089 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:58:04.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.201+0000 7f21a0bee640 1 Processor -- start 2024-09-15T23:58:04.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.201+0000 7f21a0bee640 1 -- start start 2024-09-15T23:58:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f21a0bee640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f219c15bec0 0x7f219c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f21a0bee640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f219c15c2a0 0x7f219c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f21a0bee640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f219c0b3290 con 0x7f219c0af2a0 2024-09-15T23:58:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f21a0bee640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f219c0b3570 con 0x7f219c15c2a0 2024-09-15T23:58:04.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f21a0bee640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f219c0b3850 con 0x7f219c15bec0 2024-09-15T23:58:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f2199d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f219c15c2a0 0x7f219c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f2199d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f219c15c2a0 0x7f219c0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37606/0 (socket says 172.21.15.112:37606) 2024-09-15T23:58:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f2199d9b640 1 -- 172.21.15.112:0/1573017538 learned_addr learned my addr 172.21.15.112:0/1573017538 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f219a59c640 1 --2- 172.21.15.112:0/1573017538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f219c15bec0 0x7f219c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f2199d9b640 1 -- 172.21.15.112:0/1573017538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f219c15bec0 msgr2=0x7f219c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f2199d9b640 1 --2- 172.21.15.112:0/1573017538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f219c15bec0 0x7f219c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f2199d9b640 1 -- 172.21.15.112:0/1573017538 >> v1:172.21.15.169:6789/0 conn(0x7f219c0af2a0 legacy=0x7f219c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:04.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f2199d9b640 1 -- 172.21.15.112:0/1573017538 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c0b3b30 con 0x7f219c15c2a0 2024-09-15T23:58:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f2199d9b640 1 --2- 172.21.15.112:0/1573017538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c15c2a0 0x7f219c0aed60 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2190009870 tx=0x7f219001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316b9378559355d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f219959a640 1 -- 172.21.15.112:0/1573017538 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21900aa610 con 0x7f219c15c2a0 2024-09-15T23:58:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f219959a640 1 -- 172.21.15.112:0/1573017538 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21900af070 con 0x7f219c15c2a0 2024-09-15T23:58:04.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f219959a640 1 -- 172.21.15.112:0/1573017538 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21900aa9d0 con 0x7f219c15c2a0 2024-09-15T23:58:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.205+0000 7f21a0bee640 1 -- 172.21.15.112:0/1573017538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c15c2a0 msgr2=0x7f219c0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 --2- 172.21.15.112:0/1573017538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c15c2a0 0x7f219c0aed60 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2190009870 tx=0x7f219001c4f0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.208 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 -- 172.21.15.112:0/1573017538 shutdown_connections 2024-09-15T23:58:04.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 --2- 172.21.15.112:0/1573017538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c15c2a0 0x7f219c0aed60 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 --2- 172.21.15.112:0/1573017538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f219c15bec0 0x7f219c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 -- 172.21.15.112:0/1573017538 >> 172.21.15.112:0/1573017538 conn(0x7f219c0b1f90 msgr2=0x7f219c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:04.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 -- 172.21.15.112:0/1573017538 shutdown_connections 2024-09-15T23:58:04.209 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 -- 172.21.15.112:0/1573017538 wait complete. 2024-09-15T23:58:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 Processor -- start 2024-09-15T23:58:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 -- start start 2024-09-15T23:58:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f219c0af2a0 0x7f219c152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c15bec0 0x7f219c1508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f219c15c2a0 0x7f219c157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f219c0ad740 con 0x7f219c15bec0 2024-09-15T23:58:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f219c0afc90 con 0x7f219c0af2a0 2024-09-15T23:58:04.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f219c169000 con 0x7f219c15c2a0 2024-09-15T23:58:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f2199d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c15bec0 0x7f219c1508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f2199d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c15bec0 0x7f219c1508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37620/0 (socket says 172.21.15.112:37620) 2024-09-15T23:58:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f2199d9b640 1 -- 172.21.15.112:0/611706617 learned_addr learned my addr 172.21.15.112:0/611706617 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f2199d9b640 1 -- 172.21.15.112:0/611706617 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f219c15c2a0 msgr2=0x7f219c157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f2199d9b640 1 --2- 172.21.15.112:0/611706617 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f219c15c2a0 0x7f219c157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f2199d9b640 1 -- 172.21.15.112:0/611706617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f219c0af2a0 msgr2=0x7f219c152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f2199d9b640 1 --2- 172.21.15.112:0/611706617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f219c0af2a0 0x7f219c152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f2199d9b640 1 -- 172.21.15.112:0/611706617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c155a30 con 0x7f219c15bec0 2024-09-15T23:58:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f2199d9b640 1 --2- 172.21.15.112:0/611706617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c15bec0 0x7f219c1508b0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f21900ac040 tx=0x7f2190019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f218affd640 1 -- 172.21.15.112:0/611706617 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21900be610 con 0x7f219c15bec0 2024-09-15T23:58:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f218affd640 1 -- 172.21.15.112:0/611706617 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21900be7d0 con 0x7f219c15bec0 2024-09-15T23:58:04.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 -- 172.21.15.112:0/611706617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219c1528c0 con 0x7f219c15bec0 2024-09-15T23:58:04.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f218affd640 1 -- 172.21.15.112:0/611706617 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21900bebc0 con 0x7f219c15bec0 2024-09-15T23:58:04.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 -- 172.21.15.112:0/611706617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219c152e80 con 0x7f219c15bec0 2024-09-15T23:58:04.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.209+0000 7f21a0bee640 1 -- 172.21.15.112:0/611706617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f219c0ad200 con 0x7f219c15bec0 2024-09-15T23:58:04.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.213+0000 7f218affd640 1 -- 172.21.15.112:0/611706617 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f21900bc020 con 0x7f219c15bec0 2024-09-15T23:58:04.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.213+0000 7f218affd640 1 --2- 172.21.15.112:0/611706617 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f217c0678c0 0x7f217c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.213+0000 7f218affd640 1 -- 172.21.15.112:0/611706617 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5249+0+0 (secure 0 0 0) 0x7f2190120180 con 0x7f219c15bec0 2024-09-15T23:58:04.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.213+0000 7f219a59c640 1 --2- 172.21.15.112:0/611706617 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f217c0678c0 0x7f217c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:04.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.213+0000 7f219a59c640 1 --2- 172.21.15.112:0/611706617 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f217c0678c0 0x7f217c069d80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f218c0070b0 tx=0x7f218c007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:04.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.217+0000 7f218affd640 1 -- 172.21.15.112:0/611706617 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f21900a7070 con 0x7f219c15bec0 2024-09-15T23:58:04.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.369+0000 7f21a0bee640 1 -- 172.21.15.112:0/611706617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f219c06fcd0 con 0x7f219c15bec0 2024-09-15T23:58:04.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.369+0000 7f218affd640 1 -- 172.21.15.112:0/611706617 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v93) ==== 84+0+65 (secure 0 0 0) 0x7f2190016110 con 0x7f219c15bec0 2024-09-15T23:58:04.394 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:04.394 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-15T23:58:04.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:58:04.395 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-15T23:58:04.395 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-15T23:58:04.395 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:04.395 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-15T23:58:04.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.373+0000 7f21a0bee640 1 -- 172.21.15.112:0/611706617 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f217c0678c0 msgr2=0x7f217c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:04.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.373+0000 7f21a0bee640 1 --2- 172.21.15.112:0/611706617 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f217c0678c0 0x7f217c069d80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f218c0070b0 tx=0x7f218c007040 comp rx=0 tx=0).stop 2024-09-15T23:58:04.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.373+0000 7f21a0bee640 1 -- 172.21.15.112:0/611706617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c15bec0 msgr2=0x7f219c1508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:04.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.373+0000 7f21a0bee640 1 --2- 172.21.15.112:0/611706617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c15bec0 0x7f219c1508b0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f21900ac040 tx=0x7f2190019290 comp rx=0 tx=0).stop 2024-09-15T23:58:04.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.373+0000 7f21a0bee640 1 -- 172.21.15.112:0/611706617 shutdown_connections 2024-09-15T23:58:04.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.373+0000 7f21a0bee640 1 --2- 172.21.15.112:0/611706617 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f217c0678c0 0x7f217c069d80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.373+0000 7f21a0bee640 1 --2- 172.21.15.112:0/611706617 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f219c15c2a0 0x7f219c157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.373+0000 7f21a0bee640 1 --2- 172.21.15.112:0/611706617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c15bec0 0x7f219c1508b0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.373+0000 7f21a0bee640 1 --2- 172.21.15.112:0/611706617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f219c0af2a0 0x7f219c152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.373+0000 7f21a0bee640 1 -- 172.21.15.112:0/611706617 >> 172.21.15.112:0/611706617 conn(0x7f219c0b1f90 msgr2=0x7f219c15acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:04.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.373+0000 7f21a0bee640 1 -- 172.21.15.112:0/611706617 shutdown_connections 2024-09-15T23:58:04.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.373+0000 7f21a0bee640 1 -- 172.21.15.112:0/611706617 wait complete. 2024-09-15T23:58:04.397 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:58:04.397 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:58:04.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb82bbae640 1 Processor -- start 2024-09-15T23:58:04.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb82bbae640 1 -- start start 2024-09-15T23:58:04.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb82bbae640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb82415bec0 0x7fb8240ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb82bbae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8240af470 0x7fb82406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb82bbae640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8240b3290 con 0x7fb82415c2a0 2024-09-15T23:58:04.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb82bbae640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb8240b3570 con 0x7fb82415bec0 2024-09-15T23:58:04.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb82bbae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb8240b3850 con 0x7fb8240af470 2024-09-15T23:58:04.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb829149640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb82415c2a0 0x7fb8240aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36120/0 (socket says 172.21.15.112:36120) 2024-09-15T23:58:04.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb829149640 1 -- 172.21.15.112:0/2254030918 learned_addr learned my addr 172.21.15.112:0/2254030918 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb82a14b640 1 --2- 172.21.15.112:0/2254030918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8240af470 0x7fb82406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb82994a640 1 --2- 172.21.15.112:0/2254030918 >> v2:172.21.15.169:3300/0 conn(0x7fb82415bec0 0x7fb8240ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 -- 172.21.15.112:0/2254030918 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020065969 0 0) 0x7fb8240b3290 con 0x7fb82415c2a0 2024-09-15T23:58:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 -- 172.21.15.112:0/2254030918 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb810003530 con 0x7fb82415c2a0 2024-09-15T23:58:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 -- 172.21.15.112:0/2254030918 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 629564066 0 0) 0x7fb810003530 con 0x7fb82415c2a0 2024-09-15T23:58:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 -- 172.21.15.112:0/2254030918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8240af470 msgr2=0x7fb82406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 --2- 172.21.15.112:0/2254030918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8240af470 0x7fb82406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 -- 172.21.15.112:0/2254030918 >> v2:172.21.15.169:3300/0 conn(0x7fb82415bec0 msgr2=0x7fb8240ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 --2- 172.21.15.112:0/2254030918 >> v2:172.21.15.169:3300/0 conn(0x7fb82415bec0 0x7fb8240ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 -- 172.21.15.112:0/2254030918 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8240b3b30 con 0x7fb82415c2a0 2024-09-15T23:58:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 -- 172.21.15.112:0/2254030918 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fb814001680 con 0x7fb82415c2a0 2024-09-15T23:58:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 -- 172.21.15.112:0/2254030918 >> v1:172.21.15.112:6789/0 conn(0x7fb82415c2a0 legacy=0x7fb8240aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 --2- 172.21.15.112:0/2254030918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8240af470 0x7fb8100039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 --2- 172.21.15.112:0/2254030918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb810003f40 0x7fb810004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 --2- 172.21.15.112:0/2254030918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb810004d50 0x7fb8100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 -- 172.21.15.112:0/2254030918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb8240b3570 con 0x7fb810003f40 2024-09-15T23:58:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 -- 172.21.15.112:0/2254030918 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8240b3850 con 0x7fb810004d50 2024-09-15T23:58:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb828948640 1 -- 172.21.15.112:0/2254030918 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb8100099c0 con 0x7fb8240af470 2024-09-15T23:58:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb829149640 1 --2- 172.21.15.112:0/2254030918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb810003f40 0x7fb810004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb82994a640 1 --2- 172.21.15.112:0/2254030918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8240af470 0x7fb8100039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:04.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb82a14b640 1 --2- 172.21.15.112:0/2254030918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb810004d50 0x7fb8100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:04.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb829149640 1 -- 172.21.15.112:0/2254030918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8240af470 msgr2=0x7fb8100039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:04.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb829149640 1 --2- 172.21.15.112:0/2254030918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8240af470 0x7fb8100039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb829149640 1 -- 172.21.15.112:0/2254030918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb810004d50 msgr2=0x7fb8100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:04.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb829149640 1 --2- 172.21.15.112:0/2254030918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb810004d50 0x7fb8100051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb829149640 1 -- 172.21.15.112:0/2254030918 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb810003530 con 0x7fb810003f40 2024-09-15T23:58:04.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.525+0000 7fb82994a640 1 --2- 172.21.15.112:0/2254030918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8240af470 0x7fb8100039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:04.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.529+0000 7fb829149640 1 --2- 172.21.15.112:0/2254030918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb810003f40 0x7fb810004810 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb81400c240 tx=0x7fb81401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ba17f1e40d7fe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:04.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.529+0000 7fb828948640 1 -- 172.21.15.112:0/2254030918 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814007d40 con 0x7fb810003f40 2024-09-15T23:58:04.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.529+0000 7fb828948640 1 -- 172.21.15.112:0/2254030918 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8140a9020 con 0x7fb810003f40 2024-09-15T23:58:04.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.529+0000 7fb828948640 1 -- 172.21.15.112:0/2254030918 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814005b00 con 0x7fb810003f40 2024-09-15T23:58:04.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.529+0000 7fb82bbae640 1 -- 172.21.15.112:0/2254030918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb810003f40 msgr2=0x7fb810004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:04.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.529+0000 7fb82bbae640 1 --2- 172.21.15.112:0/2254030918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb810003f40 0x7fb810004810 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb81400c240 tx=0x7fb81401cc30 comp rx=0 tx=0).stop 2024-09-15T23:58:04.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.529+0000 7fb82a14b640 1 -- 172.21.15.112:0/2254030918 reap_dead start 2024-09-15T23:58:04.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.529+0000 7fb82bbae640 1 -- 172.21.15.112:0/2254030918 shutdown_connections 2024-09-15T23:58:04.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.529+0000 7fb82bbae640 1 -- 172.21.15.112:0/2254030918 >> 172.21.15.112:0/2254030918 conn(0x7fb8240b1f90 msgr2=0x7fb8240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:04.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.529+0000 7fb82bbae640 1 -- 172.21.15.112:0/2254030918 shutdown_connections 2024-09-15T23:58:04.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.529+0000 7fb82bbae640 1 -- 172.21.15.112:0/2254030918 wait complete. 2024-09-15T23:58:04.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.529+0000 7fb82bbae640 1 Processor -- start 2024-09-15T23:58:04.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.529+0000 7fb82bbae640 1 -- start start 2024-09-15T23:58:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82bbae640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb810003f40 0x7fb82414ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82bbae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82414f290 0x7fb824146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82bbae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8241f2ce0 0x7fb82415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82bbae640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb82406e810 con 0x7fb810003f40 2024-09-15T23:58:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82bbae640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8240ad740 con 0x7fb8241f2ce0 2024-09-15T23:58:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82bbae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb82406e990 con 0x7fb82414f290 2024-09-15T23:58:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82994a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb810003f40 0x7fb82414ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82994a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb810003f40 0x7fb82414ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37638/0 (socket says 172.21.15.112:37638) 2024-09-15T23:58:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82994a640 1 -- 172.21.15.112:0/3267924390 learned_addr learned my addr 172.21.15.112:0/3267924390 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb829149640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82414f290 0x7fb824146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82994a640 1 -- 172.21.15.112:0/3267924390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82414f290 msgr2=0x7fb824146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:04.534 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82a14b640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8241f2ce0 0x7fb82415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:04.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82994a640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82414f290 0x7fb824146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82994a640 1 -- 172.21.15.112:0/3267924390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8241f2ce0 msgr2=0x7fb82415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:04.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82994a640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8241f2ce0 0x7fb82415a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:04.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82994a640 1 -- 172.21.15.112:0/3267924390 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82414f720 con 0x7fb810003f40 2024-09-15T23:58:04.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb829149640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82414f290 0x7fb824146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:04.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82994a640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb810003f40 0x7fb82414ed10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb82000f3d0 tx=0x7fb82000f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:04.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb81a7fc640 1 -- 172.21.15.112:0/3267924390 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8200039a0 con 0x7fb810003f40 2024-09-15T23:58:04.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb81a7fc640 1 -- 172.21.15.112:0/3267924390 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb820003b40 con 0x7fb810003f40 2024-09-15T23:58:04.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb81a7fc640 1 -- 172.21.15.112:0/3267924390 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820004020 con 0x7fb810003f40 2024-09-15T23:58:04.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82bbae640 1 -- 172.21.15.112:0/3267924390 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb824154dc0 con 0x7fb810003f40 2024-09-15T23:58:04.535 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82bbae640 1 -- 172.21.15.112:0/3267924390 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb824155380 con 0x7fb810003f40 2024-09-15T23:58:04.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb82bbae640 1 -- 172.21.15.112:0/3267924390 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8240ad200 con 0x7fb810003f40 2024-09-15T23:58:04.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb81a7fc640 1 -- 172.21.15.112:0/3267924390 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb82001d020 con 0x7fb810003f40 2024-09-15T23:58:04.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb81a7fc640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8080678c0 0x7fb808069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:04.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb829149640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8080678c0 0x7fb808069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:04.536 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.533+0000 7fb81a7fc640 1 -- 172.21.15.112:0/3267924390 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5249+0+0 (secure 0 0 0) 0x7fb820086450 con 0x7fb810003f40 2024-09-15T23:58:04.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.537+0000 7fb829149640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8080678c0 0x7fb808069d80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb8140aa000 tx=0x7fb8240b3460 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:04.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.541+0000 7fb81a7fc640 1 -- 172.21.15.112:0/3267924390 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb8200571e0 con 0x7fb810003f40 2024-09-15T23:58:04.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:04.705+0000 7fb82bbae640 1 -- 172.21.15.112:0/3267924390 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb82415f990 con 0x7fb810003f40 2024-09-15T23:58:05.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.693+0000 7fb81a7fc640 1 -- 172.21.15.112:0/3267924390 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v94) ==== 138+0+0 (secure 0 0 0) 0x7fb820056ae0 con 0x7fb810003f40 2024-09-15T23:58:05.694 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-15T23:58:05.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.697+0000 7fb82bbae640 1 -- 172.21.15.112:0/3267924390 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8080678c0 msgr2=0x7fb808069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:05.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.697+0000 7fb82bbae640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8080678c0 0x7fb808069d80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb8140aa000 tx=0x7fb8240b3460 comp rx=0 tx=0).stop 2024-09-15T23:58:05.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.697+0000 7fb82bbae640 1 -- 172.21.15.112:0/3267924390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb810003f40 msgr2=0x7fb82414ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:05.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.697+0000 7fb82bbae640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb810003f40 0x7fb82414ed10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb82000f3d0 tx=0x7fb82000f890 comp rx=0 tx=0).stop 2024-09-15T23:58:05.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.697+0000 7fb82bbae640 1 -- 172.21.15.112:0/3267924390 shutdown_connections 2024-09-15T23:58:05.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.697+0000 7fb82bbae640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8080678c0 0x7fb808069d80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:05.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.697+0000 7fb82bbae640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8241f2ce0 0x7fb82415a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:05.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.697+0000 7fb82bbae640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb82414f290 0x7fb824146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:05.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.697+0000 7fb82bbae640 1 --2- 172.21.15.112:0/3267924390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb810003f40 0x7fb82414ed10 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:05.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.697+0000 7fb82bbae640 1 -- 172.21.15.112:0/3267924390 >> 172.21.15.112:0/3267924390 conn(0x7fb8240b1f90 msgr2=0x7fb824074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:05.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.697+0000 7fb82bbae640 1 -- 172.21.15.112:0/3267924390 shutdown_connections 2024-09-15T23:58:05.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.697+0000 7fb82bbae640 1 -- 172.21.15.112:0/3267924390 wait complete. 2024-09-15T23:58:05.722 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:58:05.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef10875640 1 Processor -- start 2024-09-15T23:58:05.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef10875640 1 -- start start 2024-09-15T23:58:05.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef10875640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef0c0b6cc0 0x7fef0c15b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:05.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef10875640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0c0b4790 con 0x7fef0c15af30 2024-09-15T23:58:05.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef10875640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0c15b900 con 0x7fef0c0d16a0 2024-09-15T23:58:05.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef10875640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fef0c0d2030 con 0x7fef0c0b6cc0 2024-09-15T23:58:05.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0a59c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fef0c15af30 0x7fef0c0d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36134/0 (socket says 172.21.15.112:36134) 2024-09-15T23:58:05.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0a59c640 1 -- 172.21.15.112:0/1932896853 learned_addr learned my addr 172.21.15.112:0/1932896853 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:05.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0ad9d640 1 --2- 172.21.15.112:0/1932896853 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef0c0b6cc0 0x7fef0c15b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:05.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 -- 172.21.15.112:0/1932896853 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2638124883 0 0) 0x7fef0c0b4790 con 0x7fef0c15af30 2024-09-15T23:58:05.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 -- 172.21.15.112:0/1932896853 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feef4003530 con 0x7fef0c15af30 2024-09-15T23:58:05.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 -- 172.21.15.112:0/1932896853 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 805673673 0 0) 0x7feef4003530 con 0x7fef0c15af30 2024-09-15T23:58:05.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 -- 172.21.15.112:0/1932896853 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef0c0b6cc0 msgr2=0x7fef0c15b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:05.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 --2- 172.21.15.112:0/1932896853 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef0c0b6cc0 0x7fef0c15b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:05.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 -- 172.21.15.112:0/1932896853 >> v1:172.21.15.169:6789/0 conn(0x7fef0c0d16a0 legacy=0x7fef0c15c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:05.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 -- 172.21.15.112:0/1932896853 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0c15bbe0 con 0x7fef0c15af30 2024-09-15T23:58:05.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 -- 172.21.15.112:0/1932896853 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7feefc001680 con 0x7fef0c15af30 2024-09-15T23:58:05.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 -- 172.21.15.112:0/1932896853 >> v1:172.21.15.112:6789/0 conn(0x7fef0c15af30 legacy=0x7fef0c0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:05.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 --2- 172.21.15.112:0/1932896853 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef0c0b6cc0 0x7feef40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:05.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 --2- 172.21.15.112:0/1932896853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feef4003f70 0x7feef4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:05.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 --2- 172.21.15.112:0/1932896853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feef4004d50 0x7feef40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:05.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 -- 172.21.15.112:0/1932896853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feef400ba80 con 0x7feef4003f70 2024-09-15T23:58:05.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 -- 172.21.15.112:0/1932896853 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feef400bc30 con 0x7feef4004d50 2024-09-15T23:58:05.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0959a640 1 -- 172.21.15.112:0/1932896853 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feef400be30 con 0x7fef0c0b6cc0 2024-09-15T23:58:05.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef09d9b640 1 --2- 172.21.15.112:0/1932896853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feef4003f70 0x7feef4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:05.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0a59c640 1 --2- 172.21.15.112:0/1932896853 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef0c0b6cc0 0x7feef40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:05.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0ad9d640 1 --2- 172.21.15.112:0/1932896853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feef4004d50 0x7feef40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:05.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef09d9b640 1 -- 172.21.15.112:0/1932896853 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef0c0b6cc0 msgr2=0x7feef40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:05.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef09d9b640 1 --2- 172.21.15.112:0/1932896853 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef0c0b6cc0 0x7feef40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:05.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef09d9b640 1 -- 172.21.15.112:0/1932896853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feef4004d50 msgr2=0x7feef40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:05.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef09d9b640 1 --2- 172.21.15.112:0/1932896853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feef4004d50 0x7feef40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:05.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef09d9b640 1 -- 172.21.15.112:0/1932896853 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef4003530 con 0x7feef4003f70 2024-09-15T23:58:05.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.853+0000 7fef0ad9d640 1 --2- 172.21.15.112:0/1932896853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feef4004d50 0x7feef40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:05.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.857+0000 7fef09d9b640 1 --2- 172.21.15.112:0/1932896853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feef4003f70 0x7feef4004810 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fef00001780 tx=0x7fef0001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88ed250ceeab6db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.857+0000 7fef0959a640 1 -- 172.21.15.112:0/1932896853 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef000013a0 con 0x7feef4003f70 2024-09-15T23:58:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.857+0000 7fef0959a640 1 -- 172.21.15.112:0/1932896853 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef000052f0 con 0x7feef4003f70 2024-09-15T23:58:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.857+0000 7fef0959a640 1 -- 172.21.15.112:0/1932896853 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef00003840 con 0x7feef4003f70 2024-09-15T23:58:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.857+0000 7fef10875640 1 -- 172.21.15.112:0/1932896853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feef4003f70 msgr2=0x7feef4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.857+0000 7fef10875640 1 --2- 172.21.15.112:0/1932896853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feef4003f70 0x7feef4004810 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fef00001780 tx=0x7fef0001c420 comp rx=0 tx=0).stop 2024-09-15T23:58:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.857+0000 7fef0ad9d640 1 -- 172.21.15.112:0/1932896853 reap_dead start 2024-09-15T23:58:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.857+0000 7fef10875640 1 -- 172.21.15.112:0/1932896853 shutdown_connections 2024-09-15T23:58:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.857+0000 7fef10875640 1 -- 172.21.15.112:0/1932896853 >> 172.21.15.112:0/1932896853 conn(0x7fef0c09aa00 msgr2=0x7fef0c0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.857+0000 7fef10875640 1 -- 172.21.15.112:0/1932896853 shutdown_connections 2024-09-15T23:58:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.857+0000 7fef10875640 1 -- 172.21.15.112:0/1932896853 wait complete. 2024-09-15T23:58:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.857+0000 7fef10875640 1 Processor -- start 2024-09-15T23:58:05.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.857+0000 7fef10875640 1 -- start start 2024-09-15T23:58:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef10875640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feef4003f70 0x7fef0c149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef10875640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef0c13fc90 0x7fef0c14ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:05.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef10875640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c140200 0x7fef0c14bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef10875640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fef0c15b310 con 0x7fef0c140200 2024-09-15T23:58:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef10875640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fef0c15c230 con 0x7fef0c13fc90 2024-09-15T23:58:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef10875640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fef0c15b490 con 0x7feef4003f70 2024-09-15T23:58:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef0ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c140200 0x7fef0c14bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef0ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c140200 0x7fef0c14bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37644/0 (socket says 172.21.15.112:37644) 2024-09-15T23:58:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef0ad9d640 1 -- 172.21.15.112:0/3870530623 learned_addr learned my addr 172.21.15.112:0/3870530623 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef0a59c640 1 --2- 172.21.15.112:0/3870530623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feef4003f70 0x7fef0c149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef0ad9d640 1 -- 172.21.15.112:0/3870530623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feef4003f70 msgr2=0x7fef0c149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef0ad9d640 1 --2- 172.21.15.112:0/3870530623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feef4003f70 0x7fef0c149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef09d9b640 1 --2- 172.21.15.112:0/3870530623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef0c13fc90 0x7fef0c14ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef0ad9d640 1 -- 172.21.15.112:0/3870530623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef0c13fc90 msgr2=0x7fef0c14ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef0ad9d640 1 --2- 172.21.15.112:0/3870530623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef0c13fc90 0x7fef0c14ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef0ad9d640 1 -- 172.21.15.112:0/3870530623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0c142980 con 0x7fef0c140200 2024-09-15T23:58:05.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef0ad9d640 1 --2- 172.21.15.112:0/3870530623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c140200 0x7fef0c14bfa0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0b2d60 tx=0x7fef0400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:05.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7feefaffd640 1 -- 172.21.15.112:0/3870530623 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0401c070 con 0x7fef0c140200 2024-09-15T23:58:05.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7feefaffd640 1 -- 172.21.15.112:0/3870530623 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef04017400 con 0x7fef0c140200 2024-09-15T23:58:05.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7feefaffd640 1 -- 172.21.15.112:0/3870530623 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040177f0 con 0x7fef0c140200 2024-09-15T23:58:05.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef10875640 1 -- 172.21.15.112:0/3870530623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef0c142c60 con 0x7fef0c140200 2024-09-15T23:58:05.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef10875640 1 -- 172.21.15.112:0/3870530623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef0c142630 con 0x7fef0c140200 2024-09-15T23:58:05.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef10875640 1 -- 172.21.15.112:0/3870530623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef0c0b4090 con 0x7fef0c140200 2024-09-15T23:58:05.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7feefaffd640 1 -- 172.21.15.112:0/3870530623 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fef0401f070 con 0x7fef0c140200 2024-09-15T23:58:05.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7feefaffd640 1 --2- 172.21.15.112:0/3870530623 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feeec0678c0 0x7feeec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:05.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7feefaffd640 1 -- 172.21.15.112:0/3870530623 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5619+0+0 (secure 0 0 0) 0x7fef040861c0 con 0x7fef0c140200 2024-09-15T23:58:05.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.861+0000 7fef0a59c640 1 --2- 172.21.15.112:0/3870530623 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feeec0678c0 0x7feeec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:05.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.865+0000 7fef0a59c640 1 --2- 172.21.15.112:0/3870530623 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feeec0678c0 0x7feeec069d80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7feefc000c10 tx=0x7feefc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:05.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:05.865+0000 7feefaffd640 1 -- 172.21.15.112:0/3870530623 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fef04026080 con 0x7fef0c140200 2024-09-15T23:58:06.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.029+0000 7fef10875640 1 -- 172.21.15.112:0/3870530623 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fef0c0cd430 con 0x7fef0c140200 2024-09-15T23:58:06.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.697+0000 7feefaffd640 1 -- 172.21.15.112:0/3870530623 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v95) ==== 170+0+0 (secure 0 0 0) 0x7fef04012070 con 0x7fef0c140200 2024-09-15T23:58:06.699 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-15T23:58:06.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.701+0000 7fef10875640 1 -- 172.21.15.112:0/3870530623 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feeec0678c0 msgr2=0x7feeec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:06.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.701+0000 7fef10875640 1 --2- 172.21.15.112:0/3870530623 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feeec0678c0 0x7feeec069d80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7feefc000c10 tx=0x7feefc009040 comp rx=0 tx=0).stop 2024-09-15T23:58:06.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.701+0000 7fef10875640 1 -- 172.21.15.112:0/3870530623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c140200 msgr2=0x7fef0c14bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:06.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.701+0000 7fef10875640 1 --2- 172.21.15.112:0/3870530623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c140200 0x7fef0c14bfa0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0b2d60 tx=0x7fef0400f4a0 comp rx=0 tx=0).stop 2024-09-15T23:58:06.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.701+0000 7fef10875640 1 -- 172.21.15.112:0/3870530623 shutdown_connections 2024-09-15T23:58:06.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.701+0000 7fef10875640 1 --2- 172.21.15.112:0/3870530623 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7feeec0678c0 0x7feeec069d80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:06.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.701+0000 7fef10875640 1 --2- 172.21.15.112:0/3870530623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef0c140200 0x7fef0c14bfa0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:06.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.701+0000 7fef10875640 1 --2- 172.21.15.112:0/3870530623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef0c13fc90 0x7fef0c14ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:06.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.701+0000 7fef10875640 1 --2- 172.21.15.112:0/3870530623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feef4003f70 0x7fef0c149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:06.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.701+0000 7fef10875640 1 -- 172.21.15.112:0/3870530623 >> 172.21.15.112:0/3870530623 conn(0x7fef0c09aa00 msgr2=0x7fef0c0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:06.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.701+0000 7fef10875640 1 -- 172.21.15.112:0/3870530623 shutdown_connections 2024-09-15T23:58:06.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.701+0000 7fef10875640 1 -- 172.21.15.112:0/3870530623 wait complete. 2024-09-15T23:58:06.734 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:58:06.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f564e668640 1 Processor -- start 2024-09-15T23:58:06.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f564e668640 1 -- start start 2024-09-15T23:58:06.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f564e668640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56480cf620 0x7f5648168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:06.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f564e668640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56480d0300 con 0x7f5648161a60 2024-09-15T23:58:06.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f564e668640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56480cfab0 con 0x7f56480d3060 2024-09-15T23:58:06.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f564e668640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f564806e6c0 con 0x7f56480cf620 2024-09-15T23:58:06.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f5647fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5648161a60 0x7f56480d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:36136/0 (socket says 172.21.15.112:36136) 2024-09-15T23:58:06.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f5647fff640 1 -- 172.21.15.112:0/2942106811 learned_addr learned my addr 172.21.15.112:0/2942106811 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:06.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f564cc05640 1 --2- 172.21.15.112:0/2942106811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56480cf620 0x7f5648168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:06.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f56477fe640 1 -- 172.21.15.112:0/2942106811 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244376275 0 0) 0x7f5638001120 con 0x7f5648161a60 2024-09-15T23:58:06.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f56477fe640 1 -- 172.21.15.112:0/2942106811 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5634003530 con 0x7f5648161a60 2024-09-15T23:58:06.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f56477fe640 1 -- 172.21.15.112:0/2942106811 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1700098250 0 0) 0x7f56480cfab0 con 0x7f56480d3060 2024-09-15T23:58:06.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f56477fe640 1 -- 172.21.15.112:0/2942106811 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5638001120 con 0x7f56480d3060 2024-09-15T23:58:06.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f56477fe640 1 -- 172.21.15.112:0/2942106811 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1332352675 0 0) 0x7f5634003530 con 0x7f5648161a60 2024-09-15T23:58:06.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f564cc05640 1 -- 172.21.15.112:0/2942106811 >> v1:172.21.15.169:6789/0 conn(0x7f56480d3060 legacy=0x7f56480cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:06.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f564cc05640 1 -- 172.21.15.112:0/2942106811 >> v1:172.21.15.112:6789/0 conn(0x7f5648161a60 legacy=0x7f56480d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:06.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.861+0000 7f564cc05640 1 -- 172.21.15.112:0/2942106811 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56480b0f60 con 0x7f56480cf620 2024-09-15T23:58:06.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564cc05640 1 --2- 172.21.15.112:0/2942106811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56480cf620 0x7f5648168f10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5640009dc0 tx=0x7f564001c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7206ad326090a54e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:06.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f56477fe640 1 -- 172.21.15.112:0/2942106811 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56400b2070 con 0x7f56480cf620 2024-09-15T23:58:06.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f56477fe640 1 -- 172.21.15.112:0/2942106811 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56400a5630 con 0x7f56480cf620 2024-09-15T23:58:06.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f56477fe640 1 -- 172.21.15.112:0/2942106811 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638001850 con 0x7f56480cf620 2024-09-15T23:58:06.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 -- 172.21.15.112:0/2942106811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56480cf620 msgr2=0x7f5648168f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:06.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 --2- 172.21.15.112:0/2942106811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56480cf620 0x7f5648168f10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5640009dc0 tx=0x7f564001c7f0 comp rx=0 tx=0).stop 2024-09-15T23:58:06.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 -- 172.21.15.112:0/2942106811 shutdown_connections 2024-09-15T23:58:06.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 --2- 172.21.15.112:0/2942106811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56480cf620 0x7f5648168f10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:06.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 -- 172.21.15.112:0/2942106811 >> 172.21.15.112:0/2942106811 conn(0x7f564808bf90 msgr2=0x7f564809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:06.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 -- 172.21.15.112:0/2942106811 shutdown_connections 2024-09-15T23:58:06.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 -- 172.21.15.112:0/2942106811 wait complete. 2024-09-15T23:58:06.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 Processor -- start 2024-09-15T23:58:06.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 -- start start 2024-09-15T23:58:06.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56480cf620 0x7f56480ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:06.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56480d3060 0x7f56480b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:06.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5648161a60 0x7f5648155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:06.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f564816bc70 con 0x7f5648161a60 2024-09-15T23:58:06.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f564806d190 con 0x7f56480d3060 2024-09-15T23:58:06.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.865+0000 7f564e668640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f564816bdf0 con 0x7f56480cf620 2024-09-15T23:58:06.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f564cc05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5648161a60 0x7f5648155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:06.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f564cc05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5648161a60 0x7f5648155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37656/0 (socket says 172.21.15.112:37656) 2024-09-15T23:58:06.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f564cc05640 1 -- 172.21.15.112:0/1697785248 learned_addr learned my addr 172.21.15.112:0/1697785248 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:06.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f5647fff640 1 --2- 172.21.15.112:0/1697785248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56480cf620 0x7f56480ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:06.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f563ffff640 1 --2- 172.21.15.112:0/1697785248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56480d3060 0x7f56480b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:06.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f564cc05640 1 -- 172.21.15.112:0/1697785248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56480cf620 msgr2=0x7f56480ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:06.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f564cc05640 1 --2- 172.21.15.112:0/1697785248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56480cf620 0x7f56480ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:06.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f564cc05640 1 -- 172.21.15.112:0/1697785248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56480d3060 msgr2=0x7f56480b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:06.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f564cc05640 1 --2- 172.21.15.112:0/1697785248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56480d3060 0x7f56480b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:06.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f564cc05640 1 -- 172.21.15.112:0/1697785248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56480c92f0 con 0x7f5648161a60 2024-09-15T23:58:06.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f564cc05640 1 --2- 172.21.15.112:0/1697785248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5648161a60 0x7f5648155dd0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f564001aea0 tx=0x7f5640019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:06.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f56457fa640 1 -- 172.21.15.112:0/1697785248 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56400b2070 con 0x7f5648161a60 2024-09-15T23:58:06.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f56457fa640 1 -- 172.21.15.112:0/1697785248 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56400bc070 con 0x7f5648161a60 2024-09-15T23:58:06.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f564e668640 1 -- 172.21.15.112:0/1697785248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56480c95d0 con 0x7f5648161a60 2024-09-15T23:58:06.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f56457fa640 1 -- 172.21.15.112:0/1697785248 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56400a5df0 con 0x7f5648161a60 2024-09-15T23:58:06.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f564e668640 1 -- 172.21.15.112:0/1697785248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56480c9b90 con 0x7f5648161a60 2024-09-15T23:58:06.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f564e668640 1 -- 172.21.15.112:0/1697785248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56480cef10 con 0x7f5648161a60 2024-09-15T23:58:06.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f56457fa640 1 -- 172.21.15.112:0/1697785248 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5640004040 con 0x7f5648161a60 2024-09-15T23:58:06.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f56457fa640 1 --2- 172.21.15.112:0/1697785248 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f56280678c0 0x7f5628069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:06.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f56457fa640 1 -- 172.21.15.112:0/1697785248 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6001+0+0 (secure 0 0 0) 0x7f56401211c0 con 0x7f5648161a60 2024-09-15T23:58:06.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f5647fff640 1 --2- 172.21.15.112:0/1697785248 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f56280678c0 0x7f5628069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:06.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.869+0000 7f5647fff640 1 --2- 172.21.15.112:0/1697785248 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f56280678c0 0x7f5628069d80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5638001ec0 tx=0x7f5638009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:06.874 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:06.873+0000 7f56457fa640 1 -- 172.21.15.112:0/1697785248 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f56400164a0 con 0x7f5648161a60 2024-09-15T23:58:07.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.057+0000 7f564e668640 1 -- 172.21.15.112:0/1697785248 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f564806bcc0 con 0x7f5648161a60 2024-09-15T23:58:07.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.769+0000 7f56457fa640 1 -- 172.21.15.112:0/1697785248 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v51) ==== 174+0+0 (secure 0 0 0) 0x7f56400f1d80 con 0x7f5648161a60 2024-09-15T23:58:07.771 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 15 and data pool 16 2024-09-15T23:58:07.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.781+0000 7f564e668640 1 -- 172.21.15.112:0/1697785248 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f56280678c0 msgr2=0x7f5628069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:07.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.781+0000 7f564e668640 1 --2- 172.21.15.112:0/1697785248 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f56280678c0 0x7f5628069d80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5638001ec0 tx=0x7f5638009040 comp rx=0 tx=0).stop 2024-09-15T23:58:07.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.781+0000 7f564e668640 1 -- 172.21.15.112:0/1697785248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5648161a60 msgr2=0x7f5648155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:07.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.781+0000 7f564e668640 1 --2- 172.21.15.112:0/1697785248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5648161a60 0x7f5648155dd0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f564001aea0 tx=0x7f5640019590 comp rx=0 tx=0).stop 2024-09-15T23:58:07.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.785+0000 7f564e668640 1 -- 172.21.15.112:0/1697785248 shutdown_connections 2024-09-15T23:58:07.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.785+0000 7f564e668640 1 --2- 172.21.15.112:0/1697785248 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f56280678c0 0x7f5628069d80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:07.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.785+0000 7f564e668640 1 --2- 172.21.15.112:0/1697785248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5648161a60 0x7f5648155dd0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:07.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.785+0000 7f564e668640 1 --2- 172.21.15.112:0/1697785248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56480d3060 0x7f56480b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:07.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.785+0000 7f564e668640 1 --2- 172.21.15.112:0/1697785248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56480cf620 0x7f56480ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:07.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.785+0000 7f564e668640 1 -- 172.21.15.112:0/1697785248 >> 172.21.15.112:0/1697785248 conn(0x7f564808bf90 msgr2=0x7f56480d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:07.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.785+0000 7f564e668640 1 -- 172.21.15.112:0/1697785248 shutdown_connections 2024-09-15T23:58:07.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.785+0000 7f564e668640 1 -- 172.21.15.112:0/1697785248 wait complete. 2024-09-15T23:58:07.812 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:58:07.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10ca47b640 1 Processor -- start 2024-09-15T23:58:07.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10ca47b640 1 -- start start 2024-09-15T23:58:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10ca47b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f10c41520a0 0x7f10c406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10ca47b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f10c406fe50 0x7f10c415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10ca47b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c4070250 con 0x7f10c415f1d0 2024-09-15T23:58:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10ca47b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f10c4152480 con 0x7f10c406fe50 2024-09-15T23:58:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10ca47b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f10c40aede0 con 0x7f10c41520a0 2024-09-15T23:58:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10c37fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f10c406fe50 0x7f10c415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10c37fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f10c406fe50 0x7f10c415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37668/0 (socket says 172.21.15.112:37668) 2024-09-15T23:58:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10c37fe640 1 -- 172.21.15.112:0/51242751 learned_addr learned my addr 172.21.15.112:0/51242751 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10c3fff640 1 --2- 172.21.15.112:0/51242751 >> v2:172.21.15.169:3300/0 conn(0x7f10c41520a0 0x7f10c406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10c37fe640 1 -- 172.21.15.112:0/51242751 >> v2:172.21.15.169:3300/0 conn(0x7f10c41520a0 msgr2=0x7f10c406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10c37fe640 1 --2- 172.21.15.112:0/51242751 >> v2:172.21.15.169:3300/0 conn(0x7f10c41520a0 0x7f10c406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10c37fe640 1 -- 172.21.15.112:0/51242751 >> v1:172.21.15.169:6789/0 conn(0x7f10c415f1d0 legacy=0x7f10c4071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:07.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10c37fe640 1 -- 172.21.15.112:0/51242751 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c415fa10 con 0x7f10c406fe50 2024-09-15T23:58:07.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.929+0000 7f10c3fff640 1 --2- 172.21.15.112:0/51242751 >> v2:172.21.15.169:3300/0 conn(0x7f10c41520a0 0x7f10c406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:07.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.933+0000 7f10c37fe640 1 --2- 172.21.15.112:0/51242751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c406fe50 0x7f10c415ec90 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f10c4071710 tx=0x7f10b801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ec7b53c779f22 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:07.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.933+0000 7f10c2ffd640 1 -- 172.21.15.112:0/51242751 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b80b1070 con 0x7f10c406fe50 2024-09-15T23:58:07.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.933+0000 7f10c2ffd640 1 -- 172.21.15.112:0/51242751 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b80a8050 con 0x7f10c406fe50 2024-09-15T23:58:07.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.933+0000 7f10c2ffd640 1 -- 172.21.15.112:0/51242751 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b80ac860 con 0x7f10c406fe50 2024-09-15T23:58:07.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.933+0000 7f10ca47b640 1 -- 172.21.15.112:0/51242751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c406fe50 msgr2=0x7f10c415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:07.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.933+0000 7f10ca47b640 1 --2- 172.21.15.112:0/51242751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c406fe50 0x7f10c415ec90 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f10c4071710 tx=0x7f10b801c4c0 comp rx=0 tx=0).stop 2024-09-15T23:58:07.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.933+0000 7f10ca47b640 1 -- 172.21.15.112:0/51242751 shutdown_connections 2024-09-15T23:58:07.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.933+0000 7f10ca47b640 1 --2- 172.21.15.112:0/51242751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c406fe50 0x7f10c415ec90 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:07.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.933+0000 7f10ca47b640 1 --2- 172.21.15.112:0/51242751 >> v2:172.21.15.169:3300/0 conn(0x7f10c41520a0 0x7f10c406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:07.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.933+0000 7f10ca47b640 1 -- 172.21.15.112:0/51242751 >> 172.21.15.112:0/51242751 conn(0x7f10c40b1f90 msgr2=0x7f10c40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:07.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.933+0000 7f10ca47b640 1 -- 172.21.15.112:0/51242751 shutdown_connections 2024-09-15T23:58:07.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.933+0000 7f10ca47b640 1 -- 172.21.15.112:0/51242751 wait complete. 2024-09-15T23:58:07.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.933+0000 7f10ca47b640 1 Processor -- start 2024-09-15T23:58:07.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.933+0000 7f10ca47b640 1 -- start start 2024-09-15T23:58:07.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10ca47b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10c406fe50 0x7f10c414eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:07.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10ca47b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10c41520a0 0x7f10c40cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10ca47b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c415f1d0 0x7f10c409a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10ca47b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f10c4073d30 con 0x7f10c415f1d0 2024-09-15T23:58:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10ca47b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10c4073a50 con 0x7f10c41520a0 2024-09-15T23:58:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10ca47b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f10c415f660 con 0x7f10c406fe50 2024-09-15T23:58:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c8a18640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c415f1d0 0x7f10c409a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c8a18640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c415f1d0 0x7f10c409a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37676/0 (socket says 172.21.15.112:37676) 2024-09-15T23:58:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c8a18640 1 -- 172.21.15.112:0/4212709197 learned_addr learned my addr 172.21.15.112:0/4212709197 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c37fe640 1 --2- 172.21.15.112:0/4212709197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10c41520a0 0x7f10c40cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c3fff640 1 --2- 172.21.15.112:0/4212709197 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10c406fe50 0x7f10c414eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c8a18640 1 -- 172.21.15.112:0/4212709197 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10c406fe50 msgr2=0x7f10c414eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c8a18640 1 --2- 172.21.15.112:0/4212709197 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10c406fe50 0x7f10c414eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:07.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c8a18640 1 -- 172.21.15.112:0/4212709197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10c41520a0 msgr2=0x7f10c40cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:07.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c8a18640 1 --2- 172.21.15.112:0/4212709197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10c41520a0 0x7f10c40cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:07.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c8a18640 1 -- 172.21.15.112:0/4212709197 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c40ce2e0 con 0x7f10c415f1d0 2024-09-15T23:58:07.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c8a18640 1 --2- 172.21.15.112:0/4212709197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c415f1d0 0x7f10c409a380 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00c780 tx=0x7f10bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:07.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c0ff9640 1 -- 172.21.15.112:0/4212709197 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc004b70 con 0x7f10c415f1d0 2024-09-15T23:58:07.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c0ff9640 1 -- 172.21.15.112:0/4212709197 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10bc004d10 con 0x7f10c415f1d0 2024-09-15T23:58:07.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10ca47b640 1 -- 172.21.15.112:0/4212709197 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c40ce5c0 con 0x7f10c415f1d0 2024-09-15T23:58:07.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c0ff9640 1 -- 172.21.15.112:0/4212709197 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00aa90 con 0x7f10c415f1d0 2024-09-15T23:58:07.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10ca47b640 1 -- 172.21.15.112:0/4212709197 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c40ceb80 con 0x7f10c415f1d0 2024-09-15T23:58:07.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10ca47b640 1 -- 172.21.15.112:0/4212709197 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c415ec90 con 0x7f10c415f1d0 2024-09-15T23:58:07.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c0ff9640 1 -- 172.21.15.112:0/4212709197 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f10bc00ac30 con 0x7f10c415f1d0 2024-09-15T23:58:07.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c0ff9640 1 --2- 172.21.15.112:0/4212709197 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f10b00678f0 0x7f10b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:07.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c0ff9640 1 -- 172.21.15.112:0/4212709197 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6101+0+0 (secure 0 0 0) 0x7f10bc086320 con 0x7f10c415f1d0 2024-09-15T23:58:07.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c3fff640 1 --2- 172.21.15.112:0/4212709197 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f10b00678f0 0x7f10b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:07.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.937+0000 7f10c3fff640 1 --2- 172.21.15.112:0/4212709197 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f10b00678f0 0x7f10b0069db0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f10b4006fd0 tx=0x7f10b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:07.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:07.941+0000 7f10c0ff9640 1 -- 172.21.15.112:0/4212709197 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f10bc056d60 con 0x7f10c415f1d0 2024-09-15T23:58:08.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.101+0000 7f10ca47b640 1 -- 172.21.15.112:0/4212709197 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10c406e540 con 0x7f10c415f1d0 2024-09-15T23:58:08.106 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.105+0000 7f10c0ff9640 1 -- 172.21.15.112:0/4212709197 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+16974 (secure 0 0 0) 0x7f10bc056660 con 0x7f10c415f1d0 2024-09-15T23:58:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:08.107 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":96,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:58:07.063230+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:58:04.747828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-15T23:58:06.072735+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:58:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.109+0000 7f10ca47b640 1 -- 172.21.15.112:0/4212709197 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f10b00678f0 msgr2=0x7f10b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.109+0000 7f10ca47b640 1 --2- 172.21.15.112:0/4212709197 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f10b00678f0 0x7f10b0069db0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f10b4006fd0 tx=0x7f10b4008040 comp rx=0 tx=0).stop 2024-09-15T23:58:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.109+0000 7f10ca47b640 1 -- 172.21.15.112:0/4212709197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c415f1d0 msgr2=0x7f10c409a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.109+0000 7f10ca47b640 1 --2- 172.21.15.112:0/4212709197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c415f1d0 0x7f10c409a380 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00c780 tx=0x7f10bc00cc40 comp rx=0 tx=0).stop 2024-09-15T23:58:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.109+0000 7f10ca47b640 1 -- 172.21.15.112:0/4212709197 shutdown_connections 2024-09-15T23:58:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.109+0000 7f10ca47b640 1 --2- 172.21.15.112:0/4212709197 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f10b00678f0 0x7f10b0069db0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.109+0000 7f10ca47b640 1 --2- 172.21.15.112:0/4212709197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c415f1d0 0x7f10c409a380 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.109+0000 7f10ca47b640 1 --2- 172.21.15.112:0/4212709197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10c41520a0 0x7f10c40cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.109+0000 7f10ca47b640 1 --2- 172.21.15.112:0/4212709197 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10c406fe50 0x7f10c414eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.109+0000 7f10ca47b640 1 -- 172.21.15.112:0/4212709197 >> 172.21.15.112:0/4212709197 conn(0x7f10c40b1f90 msgr2=0x7f10c40b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:08.109 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.109+0000 7f10ca47b640 1 -- 172.21.15.112:0/4212709197 shutdown_connections 2024-09-15T23:58:08.110 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.109+0000 7f10ca47b640 1 -- 172.21.15.112:0/4212709197 wait complete. 2024-09-15T23:58:08.126 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:58:08.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.245+0000 7fadcc6cf640 1 Processor -- start 2024-09-15T23:58:08.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadcc6cf640 1 -- start start 2024-09-15T23:58:08.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadcc6cf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadc4070020 0x7fadc415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:08.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadcc6cf640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fadc415f1d0 0x7fadc40adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:08.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadcc6cf640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc40aede0 con 0x7fadc41520a0 2024-09-15T23:58:08.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadcc6cf640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fadc4152480 con 0x7fadc415f1d0 2024-09-15T23:58:08.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadcc6cf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fadc415fa10 con 0x7fadc4070020 2024-09-15T23:58:08.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadc9c6a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadc4070020 0x7fadc415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:08.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadcac6c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fadc415f1d0 0x7fadc40adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:08.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadc9c6a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadc4070020 0x7fadc415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:38790/0 (socket says 172.21.15.112:38790) 2024-09-15T23:58:08.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadc9c6a640 1 -- 172.21.15.112:0/934997178 learned_addr learned my addr 172.21.15.112:0/934997178 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:08.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadcac6c640 1 -- 172.21.15.112:0/934997178 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadc4070020 msgr2=0x7fadc415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:08.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadcac6c640 1 --2- 172.21.15.112:0/934997178 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadc4070020 0x7fadc415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadcac6c640 1 -- 172.21.15.112:0/934997178 >> v1:172.21.15.169:6789/0 conn(0x7fadc41520a0 legacy=0x7fadc406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:08.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadcac6c640 1 -- 172.21.15.112:0/934997178 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc4074250 con 0x7fadc415f1d0 2024-09-15T23:58:08.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.249+0000 7fadc9c6a640 1 --2- 172.21.15.112:0/934997178 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadc4070020 0x7fadc415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:58:08.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcac6c640 1 --2- 172.21.15.112:0/934997178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadc415f1d0 0x7fadc40adc80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009dc0 tx=0x7fadbc01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f765bd489349a70 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:08.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadc9469640 1 -- 172.21.15.112:0/934997178 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc0b2070 con 0x7fadc415f1d0 2024-09-15T23:58:08.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadc9469640 1 -- 172.21.15.112:0/934997178 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadbc0a59e0 con 0x7fadc415f1d0 2024-09-15T23:58:08.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadc9469640 1 -- 172.21.15.112:0/934997178 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc0a5db0 con 0x7fadc415f1d0 2024-09-15T23:58:08.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 -- 172.21.15.112:0/934997178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadc415f1d0 msgr2=0x7fadc40adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:08.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 --2- 172.21.15.112:0/934997178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadc415f1d0 0x7fadc40adc80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009dc0 tx=0x7fadbc01c920 comp rx=0 tx=0).stop 2024-09-15T23:58:08.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 -- 172.21.15.112:0/934997178 shutdown_connections 2024-09-15T23:58:08.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 --2- 172.21.15.112:0/934997178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadc415f1d0 0x7fadc40adc80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 --2- 172.21.15.112:0/934997178 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadc4070020 0x7fadc415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 -- 172.21.15.112:0/934997178 >> 172.21.15.112:0/934997178 conn(0x7fadc40b1f90 msgr2=0x7fadc40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 -- 172.21.15.112:0/934997178 shutdown_connections 2024-09-15T23:58:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 -- 172.21.15.112:0/934997178 wait complete. 2024-09-15T23:58:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 Processor -- start 2024-09-15T23:58:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 -- start start 2024-09-15T23:58:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadc4070020 0x7fadc414e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadc41520a0 0x7fadc40b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadc415f1d0 0x7fadc40b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fadc415f680 con 0x7fadc4070020 2024-09-15T23:58:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fadc4073d30 con 0x7fadc415f1d0 2024-09-15T23:58:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadcc6cf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fadc406e800 con 0x7fadc41520a0 2024-09-15T23:58:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadca46b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadc4070020 0x7fadc414e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:08.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadca46b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadc4070020 0x7fadc414e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37690/0 (socket says 172.21.15.112:37690) 2024-09-15T23:58:08.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadca46b640 1 -- 172.21.15.112:0/860077733 learned_addr learned my addr 172.21.15.112:0/860077733 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:08.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.253+0000 7fadc9c6a640 1 --2- 172.21.15.112:0/860077733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadc41520a0 0x7fadc40b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:08.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadcac6c640 1 --2- 172.21.15.112:0/860077733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadc415f1d0 0x7fadc40b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:08.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadca46b640 1 -- 172.21.15.112:0/860077733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadc41520a0 msgr2=0x7fadc40b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:08.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadca46b640 1 --2- 172.21.15.112:0/860077733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadc41520a0 0x7fadc40b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadca46b640 1 -- 172.21.15.112:0/860077733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadc415f1d0 msgr2=0x7fadc40b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:08.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadca46b640 1 --2- 172.21.15.112:0/860077733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadc415f1d0 0x7fadc40b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadca46b640 1 -- 172.21.15.112:0/860077733 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc415b080 con 0x7fadc4070020 2024-09-15T23:58:08.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadca46b640 1 --2- 172.21.15.112:0/860077733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadc4070020 0x7fadc414e000 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c450 tx=0x7fadc000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:08.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadbaffd640 1 -- 172.21.15.112:0/860077733 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0016020 con 0x7fadc4070020 2024-09-15T23:58:08.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadbaffd640 1 -- 172.21.15.112:0/860077733 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc00052d0 con 0x7fadc4070020 2024-09-15T23:58:08.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadcc6cf640 1 -- 172.21.15.112:0/860077733 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc409dc40 con 0x7fadc4070020 2024-09-15T23:58:08.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadbaffd640 1 -- 172.21.15.112:0/860077733 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0007260 con 0x7fadc4070020 2024-09-15T23:58:08.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadcc6cf640 1 -- 172.21.15.112:0/860077733 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc40ce100 con 0x7fadc4070020 2024-09-15T23:58:08.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadcc6cf640 1 -- 172.21.15.112:0/860077733 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc415ec90 con 0x7fadc4070020 2024-09-15T23:58:08.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadbaffd640 1 -- 172.21.15.112:0/860077733 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fadc0007400 con 0x7fadc4070020 2024-09-15T23:58:08.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadbaffd640 1 --2- 172.21.15.112:0/860077733 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fada80678c0 0x7fada8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:08.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadbaffd640 1 -- 172.21.15.112:0/860077733 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6101+0+0 (secure 0 0 0) 0x7fadc0085750 con 0x7fadc4070020 2024-09-15T23:58:08.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadc9c6a640 1 --2- 172.21.15.112:0/860077733 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fada80678c0 0x7fada8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:08.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.257+0000 7fadc9c6a640 1 --2- 172.21.15.112:0/860077733 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fada80678c0 0x7fada8069d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fadc415ac70 tx=0x7fadb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:08.262 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.261+0000 7fadbaffd640 1 -- 172.21.15.112:0/860077733 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fadc0020020 con 0x7fadc4070020 2024-09-15T23:58:08.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.425+0000 7fadcc6cf640 1 -- 172.21.15.112:0/860077733 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fadc406e540 con 0x7fadc4070020 2024-09-15T23:58:08.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.429+0000 7fadbaffd640 1 -- 172.21.15.112:0/860077733 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+16974 (secure 0 0 0) 0x7fadc0005480 con 0x7fadc4070020 2024-09-15T23:58:08.429 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:08.429 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":96,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:58:07.063230+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:58:04.747828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-15T23:58:06.072735+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:58:08.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.429+0000 7fadcc6cf640 1 -- 172.21.15.112:0/860077733 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fada80678c0 msgr2=0x7fada8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:08.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.429+0000 7fadcc6cf640 1 --2- 172.21.15.112:0/860077733 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fada80678c0 0x7fada8069d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fadc415ac70 tx=0x7fadb4008040 comp rx=0 tx=0).stop 2024-09-15T23:58:08.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.429+0000 7fadcc6cf640 1 -- 172.21.15.112:0/860077733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadc4070020 msgr2=0x7fadc414e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:08.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.429+0000 7fadcc6cf640 1 --2- 172.21.15.112:0/860077733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadc4070020 0x7fadc414e000 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c450 tx=0x7fadc000c910 comp rx=0 tx=0).stop 2024-09-15T23:58:08.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.429+0000 7fadcc6cf640 1 -- 172.21.15.112:0/860077733 shutdown_connections 2024-09-15T23:58:08.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.429+0000 7fadcc6cf640 1 --2- 172.21.15.112:0/860077733 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fada80678c0 0x7fada8069d80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.429+0000 7fadcc6cf640 1 --2- 172.21.15.112:0/860077733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadc415f1d0 0x7fadc40b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.429+0000 7fadcc6cf640 1 --2- 172.21.15.112:0/860077733 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadc41520a0 0x7fadc40b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.429+0000 7fadcc6cf640 1 --2- 172.21.15.112:0/860077733 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadc4070020 0x7fadc414e000 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.429+0000 7fadcc6cf640 1 -- 172.21.15.112:0/860077733 >> 172.21.15.112:0/860077733 conn(0x7fadc40b1f90 msgr2=0x7fadc4151390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:08.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.429+0000 7fadcc6cf640 1 -- 172.21.15.112:0/860077733 shutdown_connections 2024-09-15T23:58:08.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.429+0000 7fadcc6cf640 1 -- 172.21.15.112:0/860077733 wait complete. 2024-09-15T23:58:08.448 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:58:08.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff3815640 1 Processor -- start 2024-09-15T23:58:08.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff3815640 1 -- start start 2024-09-15T23:58:08.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff3815640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbfec161a60 0x7fbfec0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:08.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff3815640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfec0d32b0 con 0x7fbfec0d2e90 2024-09-15T23:58:08.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff3815640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfec0d0300 con 0x7fbfec0cf620 2024-09-15T23:58:08.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff3815640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fbfec0cfa90 con 0x7fbfec161a60 2024-09-15T23:58:08.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff0db0640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbfec0d2e90 0x7fbfec0cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58616/0 (socket says 172.21.15.112:58616) 2024-09-15T23:58:08.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff0db0640 1 -- 172.21.15.112:0/3162341822 learned_addr learned my addr 172.21.15.112:0/3162341822 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:08.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff15b1640 1 --2- 172.21.15.112:0/3162341822 >> v2:172.21.15.169:3300/0 conn(0x7fbfec161a60 0x7fbfec0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:08.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 -- 172.21.15.112:0/3162341822 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2847913078 0 0) 0x7fbfec0d32b0 con 0x7fbfec0d2e90 2024-09-15T23:58:08.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 -- 172.21.15.112:0/3162341822 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfd8003530 con 0x7fbfec0d2e90 2024-09-15T23:58:08.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 -- 172.21.15.112:0/3162341822 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2634002225 0 0) 0x7fbfd8003530 con 0x7fbfec0d2e90 2024-09-15T23:58:08.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 -- 172.21.15.112:0/3162341822 >> v2:172.21.15.169:3300/0 conn(0x7fbfec161a60 msgr2=0x7fbfec0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 --2- 172.21.15.112:0/3162341822 >> v2:172.21.15.169:3300/0 conn(0x7fbfec161a60 0x7fbfec0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 -- 172.21.15.112:0/3162341822 >> v1:172.21.15.169:6789/0 conn(0x7fbfec0cf620 legacy=0x7fbfec06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 -- 172.21.15.112:0/3162341822 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfec0b0f60 con 0x7fbfec0d2e90 2024-09-15T23:58:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 -- 172.21.15.112:0/3162341822 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fbfdc001680 con 0x7fbfec0d2e90 2024-09-15T23:58:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 -- 172.21.15.112:0/3162341822 >> v1:172.21.15.112:6789/0 conn(0x7fbfec0d2e90 legacy=0x7fbfec0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 --2- 172.21.15.112:0/3162341822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbfd80039c0 0x7fbfd8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 --2- 172.21.15.112:0/3162341822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfd8004810 0x7fbfd8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 --2- 172.21.15.112:0/3162341822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd80051d0 0x7fbfd800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 -- 172.21.15.112:0/3162341822 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec0cfa90 con 0x7fbfd80051d0 2024-09-15T23:58:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 -- 172.21.15.112:0/3162341822 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd800c170 con 0x7fbfd8004810 2024-09-15T23:58:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbfe3fff640 1 -- 172.21.15.112:0/3162341822 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd800c370 con 0x7fbfd80039c0 2024-09-15T23:58:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff1db2640 1 --2- 172.21.15.112:0/3162341822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd80051d0 0x7fbfd800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff15b1640 1 --2- 172.21.15.112:0/3162341822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbfd80039c0 0x7fbfd8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:08.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff0db0640 1 --2- 172.21.15.112:0/3162341822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfd8004810 0x7fbfd8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:08.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff1db2640 1 -- 172.21.15.112:0/3162341822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbfd80039c0 msgr2=0x7fbfd8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:08.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff1db2640 1 --2- 172.21.15.112:0/3162341822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbfd80039c0 0x7fbfd8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff1db2640 1 -- 172.21.15.112:0/3162341822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfd8004810 msgr2=0x7fbfd8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:08.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff1db2640 1 --2- 172.21.15.112:0/3162341822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfd8004810 0x7fbfd8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.577+0000 7fbff1db2640 1 -- 172.21.15.112:0/3162341822 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd8003530 con 0x7fbfd80051d0 2024-09-15T23:58:08.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff1db2640 1 -- 172.21.15.112:0/3162341822 reap_dead start 2024-09-15T23:58:08.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff1db2640 1 --2- 172.21.15.112:0/3162341822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd80051d0 0x7fbfd800b9d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4001e70 tx=0x7fbfe401c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c29aefad8a0d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:08.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbfe3fff640 1 -- 172.21.15.112:0/3162341822 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40a8050 con 0x7fbfd80051d0 2024-09-15T23:58:08.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbfe3fff640 1 -- 172.21.15.112:0/3162341822 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe4003bc0 con 0x7fbfd80051d0 2024-09-15T23:58:08.582 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbfe3fff640 1 -- 172.21.15.112:0/3162341822 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4001a90 con 0x7fbfd80051d0 2024-09-15T23:58:08.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 -- 172.21.15.112:0/3162341822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd80051d0 msgr2=0x7fbfd800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:08.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 --2- 172.21.15.112:0/3162341822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd80051d0 0x7fbfd800b9d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4001e70 tx=0x7fbfe401c5a0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 -- 172.21.15.112:0/3162341822 shutdown_connections 2024-09-15T23:58:08.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 --2- 172.21.15.112:0/3162341822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfd80051d0 0x7fbfd800b9d0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 -- 172.21.15.112:0/3162341822 >> 172.21.15.112:0/3162341822 conn(0x7fbfec08bf90 msgr2=0x7fbfec09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:08.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 -- 172.21.15.112:0/3162341822 shutdown_connections 2024-09-15T23:58:08.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 -- 172.21.15.112:0/3162341822 wait complete. 2024-09-15T23:58:08.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 Processor -- start 2024-09-15T23:58:08.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 -- start start 2024-09-15T23:58:08.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfd80051d0 0x7fbfec0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:08.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfec0c8ed0 0x7fbfec1f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbfec0cb440 0x7fbfec0cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec06d190 con 0x7fbfec0c8ed0 2024-09-15T23:58:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec06ceb0 con 0x7fbfd80051d0 2024-09-15T23:58:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff3815640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbfec0cfc70 con 0x7fbfec0cb440 2024-09-15T23:58:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.581+0000 7fbff0db0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfec0c8ed0 0x7fbfec1f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff0db0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfec0c8ed0 0x7fbfec1f6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59742/0 (socket says 172.21.15.112:59742) 2024-09-15T23:58:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff0db0640 1 -- 172.21.15.112:0/1556203895 learned_addr learned my addr 172.21.15.112:0/1556203895 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff1db2640 1 --2- 172.21.15.112:0/1556203895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbfec0cb440 0x7fbfec0cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff15b1640 1 --2- 172.21.15.112:0/1556203895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfd80051d0 0x7fbfec0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff0db0640 1 -- 172.21.15.112:0/1556203895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbfec0cb440 msgr2=0x7fbfec0cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff0db0640 1 --2- 172.21.15.112:0/1556203895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbfec0cb440 0x7fbfec0cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff0db0640 1 -- 172.21.15.112:0/1556203895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfd80051d0 msgr2=0x7fbfec0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:08.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff0db0640 1 --2- 172.21.15.112:0/1556203895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfd80051d0 0x7fbfec0cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:08.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff0db0640 1 -- 172.21.15.112:0/1556203895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfec0b7bc0 con 0x7fbfec0c8ed0 2024-09-15T23:58:08.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff0db0640 1 --2- 172.21.15.112:0/1556203895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfec0c8ed0 0x7fbfec1f6ed0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0118c0 tx=0x7fbfdc011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:08.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbfe1ffb640 1 -- 172.21.15.112:0/1556203895 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc010040 con 0x7fbfec0c8ed0 2024-09-15T23:58:08.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbfe1ffb640 1 -- 172.21.15.112:0/1556203895 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfdc01a070 con 0x7fbfec0c8ed0 2024-09-15T23:58:08.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff3815640 1 -- 172.21.15.112:0/1556203895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfec0c9350 con 0x7fbfec0c8ed0 2024-09-15T23:58:08.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbfe1ffb640 1 -- 172.21.15.112:0/1556203895 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00fda0 con 0x7fbfec0c8ed0 2024-09-15T23:58:08.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff3815640 1 -- 172.21.15.112:0/1556203895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfec0c98b0 con 0x7fbfec0c8ed0 2024-09-15T23:58:08.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff3815640 1 -- 172.21.15.112:0/1556203895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfec0d1620 con 0x7fbfec0c8ed0 2024-09-15T23:58:08.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbfe1ffb640 1 -- 172.21.15.112:0/1556203895 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbfdc01f460 con 0x7fbfec0c8ed0 2024-09-15T23:58:08.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbfe1ffb640 1 --2- 172.21.15.112:0/1556203895 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbfd00678f0 0x7fbfd0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:08.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbfe1ffb640 1 -- 172.21.15.112:0/1556203895 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6101+0+0 (secure 0 0 0) 0x7fbfdc0890d0 con 0x7fbfec0c8ed0 2024-09-15T23:58:08.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff15b1640 1 --2- 172.21.15.112:0/1556203895 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbfd00678f0 0x7fbfd0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:08.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.585+0000 7fbff15b1640 1 --2- 172.21.15.112:0/1556203895 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbfd00678f0 0x7fbfd0069db0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0c7a60 tx=0x7fbfe8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:08.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.589+0000 7fbfe1ffb640 1 -- 172.21.15.112:0/1556203895 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbfec0c9350 con 0x7fbfec0c8ed0 2024-09-15T23:58:08.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:08.793+0000 7fbff3815640 1 -- 172.21.15.112:0/1556203895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbfec0d1060 con 0x7fbfec0c8ed0 2024-09-15T23:58:09.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.777+0000 7fbfe1ffb640 1 -- 172.21.15.112:0/1556203895 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) ==== 118+0+0 (secure 0 0 0) 0x7fbfdc059a00 con 0x7fbfec0c8ed0 2024-09-15T23:58:09.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.785+0000 7fbff3815640 1 -- 172.21.15.112:0/1556203895 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbfd00678f0 msgr2=0x7fbfd0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:09.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.785+0000 7fbff3815640 1 --2- 172.21.15.112:0/1556203895 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbfd00678f0 0x7fbfd0069db0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0c7a60 tx=0x7fbfe8008040 comp rx=0 tx=0).stop 2024-09-15T23:58:09.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.785+0000 7fbff3815640 1 -- 172.21.15.112:0/1556203895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfec0c8ed0 msgr2=0x7fbfec1f6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:09.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.785+0000 7fbff3815640 1 --2- 172.21.15.112:0/1556203895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfec0c8ed0 0x7fbfec1f6ed0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0118c0 tx=0x7fbfdc011cc0 comp rx=0 tx=0).stop 2024-09-15T23:58:09.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.785+0000 7fbff3815640 1 -- 172.21.15.112:0/1556203895 shutdown_connections 2024-09-15T23:58:09.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.785+0000 7fbff3815640 1 --2- 172.21.15.112:0/1556203895 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbfd00678f0 0x7fbfd0069db0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:09.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.785+0000 7fbff3815640 1 --2- 172.21.15.112:0/1556203895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbfec0cb440 0x7fbfec0cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:09.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.785+0000 7fbff3815640 1 --2- 172.21.15.112:0/1556203895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfec0c8ed0 0x7fbfec1f6ed0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:09.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.785+0000 7fbff3815640 1 --2- 172.21.15.112:0/1556203895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbfd80051d0 0x7fbfec0cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:09.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.785+0000 7fbff3815640 1 -- 172.21.15.112:0/1556203895 >> 172.21.15.112:0/1556203895 conn(0x7fbfec08bf90 msgr2=0x7fbfec0b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:09.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.785+0000 7fbff3815640 1 -- 172.21.15.112:0/1556203895 shutdown_connections 2024-09-15T23:58:09.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.785+0000 7fbff3815640 1 -- 172.21.15.112:0/1556203895 wait complete. 2024-09-15T23:58:09.806 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:58:09.807 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:58:09.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae3479640 1 Processor -- start 2024-09-15T23:58:09.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae3479640 1 -- start start 2024-09-15T23:58:09.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae3479640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1adc161a60 0x7f1adc0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae3479640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1adc0cf620 0x7f1adc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae3479640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1adc0d32b0 con 0x7f1adc0d2e90 2024-09-15T23:58:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae3479640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1adc0d0300 con 0x7f1adc161a60 2024-09-15T23:58:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae3479640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1adc0cfa90 con 0x7f1adc0cf620 2024-09-15T23:58:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae1215640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1adc161a60 0x7f1adc0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae1215640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1adc161a60 0x7f1adc0d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59744/0 (socket says 172.21.15.112:59744) 2024-09-15T23:58:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae1215640 1 -- 172.21.15.112:0/3388578100 learned_addr learned my addr 172.21.15.112:0/3388578100 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae1a16640 1 --2- 172.21.15.112:0/3388578100 >> v2:172.21.15.169:3300/0 conn(0x7f1adc0cf620 0x7f1adc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae1215640 1 -- 172.21.15.112:0/3388578100 >> v2:172.21.15.169:3300/0 conn(0x7f1adc0cf620 msgr2=0x7f1adc06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae1215640 1 --2- 172.21.15.112:0/3388578100 >> v2:172.21.15.169:3300/0 conn(0x7f1adc0cf620 0x7f1adc06d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae1215640 1 -- 172.21.15.112:0/3388578100 >> v1:172.21.15.169:6789/0 conn(0x7f1adc0d2e90 legacy=0x7f1adc0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:09.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.933+0000 7f1ae1215640 1 -- 172.21.15.112:0/3388578100 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc0b0f60 con 0x7f1adc161a60 2024-09-15T23:58:09.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae1215640 1 --2- 172.21.15.112:0/3388578100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1adc161a60 0x7f1adc0d2950 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0ce950 tx=0x7f1ad801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37dec317243a27e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:09.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ad3fff640 1 -- 172.21.15.112:0/3388578100 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80ab620 con 0x7f1adc161a60 2024-09-15T23:58:09.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ad3fff640 1 -- 172.21.15.112:0/3388578100 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad80b0070 con 0x7f1adc161a60 2024-09-15T23:58:09.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ad3fff640 1 -- 172.21.15.112:0/3388578100 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80ab9e0 con 0x7f1adc161a60 2024-09-15T23:58:09.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 -- 172.21.15.112:0/3388578100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1adc161a60 msgr2=0x7f1adc0d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 --2- 172.21.15.112:0/3388578100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1adc161a60 0x7f1adc0d2950 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0ce950 tx=0x7f1ad801c420 comp rx=0 tx=0).stop 2024-09-15T23:58:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 -- 172.21.15.112:0/3388578100 shutdown_connections 2024-09-15T23:58:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 --2- 172.21.15.112:0/3388578100 >> v2:172.21.15.169:3300/0 conn(0x7f1adc0cf620 0x7f1adc06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 --2- 172.21.15.112:0/3388578100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1adc161a60 0x7f1adc0d2950 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 -- 172.21.15.112:0/3388578100 >> 172.21.15.112:0/3388578100 conn(0x7f1adc08bf90 msgr2=0x7f1adc09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 -- 172.21.15.112:0/3388578100 shutdown_connections 2024-09-15T23:58:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 -- 172.21.15.112:0/3388578100 wait complete. 2024-09-15T23:58:09.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 Processor -- start 2024-09-15T23:58:09.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 -- start start 2024-09-15T23:58:09.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1adc0cf620 0x7f1adc160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:09.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1adc0d2e90 0x7f1adc0cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1adc161a60 0x7f1adc0cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc06e400 con 0x7f1adc0cf620 2024-09-15T23:58:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc06d190 con 0x7f1adc0d2e90 2024-09-15T23:58:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae3479640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1adc06e580 con 0x7f1adc161a60 2024-09-15T23:58:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae1215640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1adc0cf620 0x7f1adc160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae1215640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1adc0cf620 0x7f1adc160940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59748/0 (socket says 172.21.15.112:59748) 2024-09-15T23:58:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae1215640 1 -- 172.21.15.112:0/1598364077 learned_addr learned my addr 172.21.15.112:0/1598364077 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.937+0000 7f1ae1215640 1 -- 172.21.15.112:0/1598364077 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1adc161a60 msgr2=0x7f1adc0cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ae1215640 1 --2- 172.21.15.112:0/1598364077 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1adc161a60 0x7f1adc0cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ae1215640 1 -- 172.21.15.112:0/1598364077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1adc0d2e90 msgr2=0x7f1adc0cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ae0a14640 1 --2- 172.21.15.112:0/1598364077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1adc0d2e90 0x7f1adc0cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ae1215640 1 --2- 172.21.15.112:0/1598364077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1adc0d2e90 0x7f1adc0cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ae1215640 1 -- 172.21.15.112:0/1598364077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc14e120 con 0x7f1adc0cf620 2024-09-15T23:58:09.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ae0a14640 1 --2- 172.21.15.112:0/1598364077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1adc0d2e90 0x7f1adc0cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:09.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ae1215640 1 --2- 172.21.15.112:0/1598364077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1adc0cf620 0x7f1adc160940 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1ad801a050 tx=0x7f1ad801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:09.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ad1ffb640 1 -- 172.21.15.112:0/1598364077 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80abd90 con 0x7f1adc0cf620 2024-09-15T23:58:09.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ad1ffb640 1 -- 172.21.15.112:0/1598364077 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad80be3f0 con 0x7f1adc0cf620 2024-09-15T23:58:09.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ae3479640 1 -- 172.21.15.112:0/1598364077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1adc15f8a0 con 0x7f1adc0cf620 2024-09-15T23:58:09.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ad1ffb640 1 -- 172.21.15.112:0/1598364077 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80be7e0 con 0x7f1adc0cf620 2024-09-15T23:58:09.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ae3479640 1 -- 172.21.15.112:0/1598364077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1adc15fe60 con 0x7f1adc0cf620 2024-09-15T23:58:09.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ae3479640 1 -- 172.21.15.112:0/1598364077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1adc06d6b0 con 0x7f1adc0cf620 2024-09-15T23:58:09.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ad1ffb640 1 -- 172.21.15.112:0/1598364077 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ad80c7440 con 0x7f1adc0cf620 2024-09-15T23:58:09.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ad1ffb640 1 --2- 172.21.15.112:0/1598364077 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ac00678c0 0x7f1ac0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:09.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ad1ffb640 1 -- 172.21.15.112:0/1598364077 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f1ad8120330 con 0x7f1adc0cf620 2024-09-15T23:58:09.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ae0a14640 1 --2- 172.21.15.112:0/1598364077 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ac00678c0 0x7f1ac0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:09.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.941+0000 7f1ae0a14640 1 --2- 172.21.15.112:0/1598364077 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ac00678c0 0x7f1ac0069d80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1adc15ac50 tx=0x7f1acc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:09.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:09.945+0000 7f1ad1ffb640 1 -- 172.21.15.112:0/1598364077 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1ad80160d0 con 0x7f1adc0cf620 2024-09-15T23:58:10.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.133+0000 7f1ae3479640 1 -- 172.21.15.112:0/1598364077 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1adc0b5090 con 0x7f1adc0cf620 2024-09-15T23:58:10.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.789+0000 7f1ad1ffb640 1 -- 172.21.15.112:0/1598364077 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v55) ==== 122+0+0 (secure 0 0 0) 0x7f1ad80f0d70 con 0x7f1adc0cf620 2024-09-15T23:58:10.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.789+0000 7f1ae3479640 1 -- 172.21.15.112:0/1598364077 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ac00678c0 msgr2=0x7f1ac0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:10.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.789+0000 7f1ae3479640 1 --2- 172.21.15.112:0/1598364077 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ac00678c0 0x7f1ac0069d80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1adc15ac50 tx=0x7f1acc008040 comp rx=0 tx=0).stop 2024-09-15T23:58:10.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.789+0000 7f1ae3479640 1 -- 172.21.15.112:0/1598364077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1adc0cf620 msgr2=0x7f1adc160940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:10.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.789+0000 7f1ae3479640 1 --2- 172.21.15.112:0/1598364077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1adc0cf620 0x7f1adc160940 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1ad801a050 tx=0x7f1ad801ac60 comp rx=0 tx=0).stop 2024-09-15T23:58:10.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.789+0000 7f1ae3479640 1 -- 172.21.15.112:0/1598364077 shutdown_connections 2024-09-15T23:58:10.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.789+0000 7f1ae3479640 1 --2- 172.21.15.112:0/1598364077 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1ac00678c0 0x7f1ac0069d80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:10.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.789+0000 7f1ae3479640 1 --2- 172.21.15.112:0/1598364077 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1adc161a60 0x7f1adc0cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:10.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.789+0000 7f1ae3479640 1 --2- 172.21.15.112:0/1598364077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1adc0d2e90 0x7f1adc0cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:10.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.789+0000 7f1ae3479640 1 --2- 172.21.15.112:0/1598364077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1adc0cf620 0x7f1adc160940 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:10.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.789+0000 7f1ae3479640 1 -- 172.21.15.112:0/1598364077 >> 172.21.15.112:0/1598364077 conn(0x7f1adc08bf90 msgr2=0x7f1adc0b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:10.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.789+0000 7f1ae3479640 1 -- 172.21.15.112:0/1598364077 shutdown_connections 2024-09-15T23:58:10.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.793+0000 7f1ae3479640 1 -- 172.21.15.112:0/1598364077 wait complete. 2024-09-15T23:58:10.813 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:58:10.813 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:10.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.937+0000 7f6cc7397640 1 Processor -- start 2024-09-15T23:58:10.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.937+0000 7f6cc7397640 1 -- start start 2024-09-15T23:58:10.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cc7397640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6cc0073170 0x7f6cc006e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:10.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cc7397640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc006ec60 con 0x7f6cc01587a0 2024-09-15T23:58:10.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cc7397640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc006ef40 con 0x7f6cc00b39a0 2024-09-15T23:58:10.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cc7397640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6cc006f870 con 0x7f6cc0073170 2024-09-15T23:58:10.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cc5934640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6cc0073170 0x7f6cc006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:10.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cc5934640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6cc0073170 0x7f6cc006e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59754/0 (socket says 172.21.15.112:59754) 2024-09-15T23:58:10.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cc5934640 1 -- 172.21.15.112:0/1640788094 learned_addr learned my addr 172.21.15.112:0/1640788094 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:10.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cc5934640 1 -- 172.21.15.112:0/1640788094 >> v1:172.21.15.169:6789/0 conn(0x7f6cc00b39a0 legacy=0x7f6cc006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:10.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cc5934640 1 -- 172.21.15.112:0/1640788094 >> v1:172.21.15.112:6789/0 conn(0x7f6cc01587a0 legacy=0x7f6cc00b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:10.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cc5934640 1 -- 172.21.15.112:0/1640788094 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc006f220 con 0x7f6cc0073170 2024-09-15T23:58:10.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cb3fff640 1 -- 172.21.15.112:0/1640788094 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038620786 0 0) 0x7f6cc006ec60 con 0x7f6cc01587a0 2024-09-15T23:58:10.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cc5934640 1 --2- 172.21.15.112:0/1640788094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc0073170 0x7f6cc006e680 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6cc006f9f0 tx=0x7f6cb801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b63b6a0916bc43 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:10.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cb3fff640 1 -- 172.21.15.112:0/1640788094 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80ab5f0 con 0x7f6cc0073170 2024-09-15T23:58:10.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cb3fff640 1 -- 172.21.15.112:0/1640788094 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb80b0070 con 0x7f6cc0073170 2024-09-15T23:58:10.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.941+0000 7f6cb3fff640 1 -- 172.21.15.112:0/1640788094 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80ab9b0 con 0x7f6cc0073170 2024-09-15T23:58:10.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 -- 172.21.15.112:0/1640788094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc0073170 msgr2=0x7f6cc006e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:10.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 --2- 172.21.15.112:0/1640788094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc0073170 0x7f6cc006e680 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6cc006f9f0 tx=0x7f6cb801c4d0 comp rx=0 tx=0).stop 2024-09-15T23:58:10.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 -- 172.21.15.112:0/1640788094 shutdown_connections 2024-09-15T23:58:10.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 --2- 172.21.15.112:0/1640788094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc0073170 0x7f6cc006e680 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:10.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 -- 172.21.15.112:0/1640788094 >> 172.21.15.112:0/1640788094 conn(0x7f6cc00b1f90 msgr2=0x7f6cc00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:10.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 -- 172.21.15.112:0/1640788094 shutdown_connections 2024-09-15T23:58:10.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 -- 172.21.15.112:0/1640788094 wait complete. 2024-09-15T23:58:10.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 Processor -- start 2024-09-15T23:58:10.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 -- start start 2024-09-15T23:58:10.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc0073170 0x7f6cc0155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:10.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cc00b39a0 0x7f6cc0157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:10.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6cc01587a0 0x7f6cc014faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:10.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc016bd90 con 0x7f6cc0073170 2024-09-15T23:58:10.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc016bc10 con 0x7f6cc00b39a0 2024-09-15T23:58:10.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc016bf10 con 0x7f6cc01587a0 2024-09-15T23:58:10.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc5133640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc0073170 0x7f6cc0155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:10.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc5133640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc0073170 0x7f6cc0155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59766/0 (socket says 172.21.15.112:59766) 2024-09-15T23:58:10.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc5133640 1 -- 172.21.15.112:0/3431196290 learned_addr learned my addr 172.21.15.112:0/3431196290 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:10.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc4932640 1 --2- 172.21.15.112:0/3431196290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cc00b39a0 0x7f6cc0157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:10.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc5934640 1 --2- 172.21.15.112:0/3431196290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6cc01587a0 0x7f6cc014faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:10.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc5133640 1 -- 172.21.15.112:0/3431196290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6cc01587a0 msgr2=0x7f6cc014faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:10.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc5133640 1 --2- 172.21.15.112:0/3431196290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6cc01587a0 0x7f6cc014faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:10.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc5133640 1 -- 172.21.15.112:0/3431196290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cc00b39a0 msgr2=0x7f6cc0157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:10.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc5133640 1 --2- 172.21.15.112:0/3431196290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cc00b39a0 0x7f6cc0157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:10.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc5133640 1 -- 172.21.15.112:0/3431196290 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc0156ad0 con 0x7f6cc0073170 2024-09-15T23:58:10.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc5133640 1 --2- 172.21.15.112:0/3431196290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc0073170 0x7f6cc0155d00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400c500 tx=0x7f6cb400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:10.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cb1ffb640 1 -- 172.21.15.112:0/3431196290 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4017070 con 0x7f6cc0073170 2024-09-15T23:58:10.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cb1ffb640 1 -- 172.21.15.112:0/3431196290 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb4003600 con 0x7f6cc0073170 2024-09-15T23:58:10.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 -- 172.21.15.112:0/3431196290 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc0156db0 con 0x7f6cc0073170 2024-09-15T23:58:10.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cb1ffb640 1 -- 172.21.15.112:0/3431196290 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb40039f0 con 0x7f6cc0073170 2024-09-15T23:58:10.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 -- 172.21.15.112:0/3431196290 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc0157370 con 0x7f6cc0073170 2024-09-15T23:58:10.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.945+0000 7f6cc7397640 1 -- 172.21.15.112:0/3431196290 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc00b3290 con 0x7f6cc0073170 2024-09-15T23:58:10.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.949+0000 7f6cb1ffb640 1 -- 172.21.15.112:0/3431196290 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6cb401a070 con 0x7f6cc0073170 2024-09-15T23:58:10.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.949+0000 7f6cb1ffb640 1 --2- 172.21.15.112:0/3431196290 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6ca40678c0 0x7f6ca4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:10.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.949+0000 7f6cb1ffb640 1 -- 172.21.15.112:0/3431196290 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f6cb4085240 con 0x7f6cc0073170 2024-09-15T23:58:10.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.949+0000 7f6cc4932640 1 --2- 172.21.15.112:0/3431196290 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6ca40678c0 0x7f6ca4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:10.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.949+0000 7f6cc4932640 1 --2- 172.21.15.112:0/3431196290 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6ca40678c0 0x7f6ca4069d80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6cc01fa3d0 tx=0x7f6cbc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:10.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:10.953+0000 7f6cb1ffb640 1 -- 172.21.15.112:0/3431196290 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6cb4055d40 con 0x7f6cc0073170 2024-09-15T23:58:11.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.137+0000 7f6cc7397640 1 -- 172.21.15.112:0/3431196290 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cc0070080 con 0x7f6cc0073170 2024-09-15T23:58:11.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.141+0000 7f6cb1ffb640 1 -- 172.21.15.112:0/3431196290 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5237 (secure 0 0 0) 0x7f6cb4055640 con 0x7f6cc0073170 2024-09-15T23:58:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:11.141 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":55,"btime":"2024-09-15T23:58:10:787850+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5587,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1676423720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1676423720},{"type":"v1","addr":"172.21.15.169:6833","nonce":1676423720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":5593,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2404488385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2404488385},{"type":"v1","addr":"172.21.15.169:6835","nonce":2404488385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6708,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/2061515349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2061515349},{"type":"v1","addr":"172.21.15.112:6836","nonce":2061515349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:10.137643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6711":{"gid":6711,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2378546307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2378546307},{"type":"v1","addr":"172.21.15.112:6837","nonce":2378546307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6711,"qdb_cluster":[6711]},"id":7}]} 2024-09-15T23:58:11.141 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 55 2024-09-15T23:58:11.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.141+0000 7f6cc7397640 1 -- 172.21.15.112:0/3431196290 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6ca40678c0 msgr2=0x7f6ca4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.141+0000 7f6cc7397640 1 --2- 172.21.15.112:0/3431196290 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6ca40678c0 0x7f6ca4069d80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6cc01fa3d0 tx=0x7f6cbc009040 comp rx=0 tx=0).stop 2024-09-15T23:58:11.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.141+0000 7f6cc7397640 1 -- 172.21.15.112:0/3431196290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc0073170 msgr2=0x7f6cc0155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.141+0000 7f6cc7397640 1 --2- 172.21.15.112:0/3431196290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc0073170 0x7f6cc0155d00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400c500 tx=0x7f6cb400c9c0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.141+0000 7f6cc7397640 1 -- 172.21.15.112:0/3431196290 shutdown_connections 2024-09-15T23:58:11.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.141+0000 7f6cc7397640 1 --2- 172.21.15.112:0/3431196290 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6ca40678c0 0x7f6ca4069d80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.141+0000 7f6cc7397640 1 --2- 172.21.15.112:0/3431196290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6cc01587a0 0x7f6cc014faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.141+0000 7f6cc7397640 1 --2- 172.21.15.112:0/3431196290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cc00b39a0 0x7f6cc0157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.141+0000 7f6cc7397640 1 --2- 172.21.15.112:0/3431196290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc0073170 0x7f6cc0155d00 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.141+0000 7f6cc7397640 1 -- 172.21.15.112:0/3431196290 >> 172.21.15.112:0/3431196290 conn(0x7f6cc00b1f90 msgr2=0x7f6cc00af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:11.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.141+0000 7f6cc7397640 1 -- 172.21.15.112:0/3431196290 shutdown_connections 2024-09-15T23:58:11.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.141+0000 7f6cc7397640 1 -- 172.21.15.112:0/3431196290 wait complete. 2024-09-15T23:58:11.160 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:58:11.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.269+0000 7f2b0afe1640 1 Processor -- start 2024-09-15T23:58:11.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.269+0000 7f2b0afe1640 1 -- start start 2024-09-15T23:58:11.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.269+0000 7f2b0afe1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2b040b51b0 0x7f2b040b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.269+0000 7f2b0afe1640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b040d0b80 con 0x7f2b0415b570 2024-09-15T23:58:11.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.269+0000 7f2b0afe1640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b040d0e60 con 0x7f2b040b3330 2024-09-15T23:58:11.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.269+0000 7f2b0afe1640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2b040b46d0 con 0x7f2b040b51b0 2024-09-15T23:58:11.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.269+0000 7f2b03fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2b040b51b0 0x7f2b040b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:11.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.269+0000 7f2b03fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2b040b51b0 0x7f2b040b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59768/0 (socket says 172.21.15.112:59768) 2024-09-15T23:58:11.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.269+0000 7f2b0957e640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2b0415b570 0x7f2b0415b9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58628/0 (socket says 172.21.15.112:58628) 2024-09-15T23:58:11.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.269+0000 7f2b03fff640 1 -- 172.21.15.112:0/447746309 learned_addr learned my addr 172.21.15.112:0/447746309 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:11.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.269+0000 7f2b03fff640 1 -- 172.21.15.112:0/447746309 >> v1:172.21.15.169:6789/0 conn(0x7f2b040b3330 legacy=0x7f2b040b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.269+0000 7f2b03fff640 1 -- 172.21.15.112:0/447746309 >> v1:172.21.15.112:6789/0 conn(0x7f2b0415b570 legacy=0x7f2b0415b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.269+0000 7f2b03fff640 1 -- 172.21.15.112:0/447746309 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b040b49b0 con 0x7f2b040b51b0 2024-09-15T23:58:11.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.269+0000 7f2b037fe640 1 -- 172.21.15.112:0/447746309 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76081736 0 0) 0x7f2b040d0b80 con 0x7f2b0415b570 2024-09-15T23:58:11.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b03fff640 1 --2- 172.21.15.112:0/447746309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040b51b0 0x7f2b040b55d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2af800bb10 tx=0x7f2af801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9b75a22825aab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:11.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b037fe640 1 -- 172.21.15.112:0/447746309 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af80b4070 con 0x7f2b040b51b0 2024-09-15T23:58:11.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b037fe640 1 -- 172.21.15.112:0/447746309 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b04144f10 con 0x7f2b040b51b0 2024-09-15T23:58:11.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b037fe640 1 -- 172.21.15.112:0/447746309 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af80a7da0 con 0x7f2b040b51b0 2024-09-15T23:58:11.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 -- 172.21.15.112:0/447746309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040b51b0 msgr2=0x7f2b040b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 --2- 172.21.15.112:0/447746309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040b51b0 0x7f2b040b55d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2af800bb10 tx=0x7f2af801eba0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 -- 172.21.15.112:0/447746309 shutdown_connections 2024-09-15T23:58:11.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 --2- 172.21.15.112:0/447746309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040b51b0 0x7f2b040b55d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 -- 172.21.15.112:0/447746309 >> 172.21.15.112:0/447746309 conn(0x7f2b040b6870 msgr2=0x7f2b040b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:11.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 -- 172.21.15.112:0/447746309 shutdown_connections 2024-09-15T23:58:11.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 -- 172.21.15.112:0/447746309 wait complete. 2024-09-15T23:58:11.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 Processor -- start 2024-09-15T23:58:11.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 -- start start 2024-09-15T23:58:11.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040b3330 0x7f2b0415ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b040b51b0 0x7f2b0413fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b0415b570 0x7f2b040c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0406bcc0 con 0x7f2b040b3330 2024-09-15T23:58:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2b040d0840 con 0x7f2b0415b570 2024-09-15T23:58:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2b0406be40 con 0x7f2b040b51b0 2024-09-15T23:58:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b08d7d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040b3330 0x7f2b0415ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b08d7d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040b3330 0x7f2b0415ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59770/0 (socket says 172.21.15.112:59770) 2024-09-15T23:58:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b08d7d640 1 -- 172.21.15.112:0/4103459120 learned_addr learned my addr 172.21.15.112:0/4103459120 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b08d7d640 1 -- 172.21.15.112:0/4103459120 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b040b51b0 msgr2=0x7f2b0413fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b08d7d640 1 --2- 172.21.15.112:0/4103459120 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b040b51b0 0x7f2b0413fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b08d7d640 1 -- 172.21.15.112:0/4103459120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b0415b570 msgr2=0x7f2b040c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b08d7d640 1 --2- 172.21.15.112:0/4103459120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b0415b570 0x7f2b040c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b08d7d640 1 -- 172.21.15.112:0/4103459120 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b04140410 con 0x7f2b040b3330 2024-09-15T23:58:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b08d7d640 1 --2- 172.21.15.112:0/4103459120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040b3330 0x7f2b0415ab40 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c530 tx=0x7f2af400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:11.276 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b017fa640 1 -- 172.21.15.112:0/4103459120 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4016020 con 0x7f2b040b3330 2024-09-15T23:58:11.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b017fa640 1 -- 172.21.15.112:0/4103459120 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af4005220 con 0x7f2b040b3330 2024-09-15T23:58:11.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 -- 172.21.15.112:0/4103459120 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b041406f0 con 0x7f2b040b3330 2024-09-15T23:58:11.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b017fa640 1 -- 172.21.15.112:0/4103459120 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4007030 con 0x7f2b040b3330 2024-09-15T23:58:11.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.273+0000 7f2b0afe1640 1 -- 172.21.15.112:0/4103459120 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b04140cb0 con 0x7f2b040b3330 2024-09-15T23:58:11.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.277+0000 7f2b0afe1640 1 -- 172.21.15.112:0/4103459120 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b040b55d0 con 0x7f2b040b3330 2024-09-15T23:58:11.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.277+0000 7f2b017fa640 1 -- 172.21.15.112:0/4103459120 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2af40071d0 con 0x7f2b040b3330 2024-09-15T23:58:11.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.277+0000 7f2b017fa640 1 --2- 172.21.15.112:0/4103459120 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2af00678f0 0x7f2af0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.277+0000 7f2b017fa640 1 -- 172.21.15.112:0/4103459120 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f2af4085840 con 0x7f2b040b3330 2024-09-15T23:58:11.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.277+0000 7f2b03fff640 1 --2- 172.21.15.112:0/4103459120 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2af00678f0 0x7f2af0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:11.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.277+0000 7f2b03fff640 1 --2- 172.21.15.112:0/4103459120 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2af00678f0 0x7f2af0069db0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2af80b1000 tx=0x7f2af8004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:11.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.281+0000 7f2b017fa640 1 -- 172.21.15.112:0/4103459120 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2af4020020 con 0x7f2b040b3330 2024-09-15T23:58:11.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.437+0000 7f2b0afe1640 1 -- 172.21.15.112:0/4103459120 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b040ce590 con 0x7f2b040b3330 2024-09-15T23:58:11.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.441+0000 7f2b017fa640 1 -- 172.21.15.112:0/4103459120 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+16961 (secure 0 0 0) 0x7f2af40074c0 con 0x7f2b040b3330 2024-09-15T23:58:11.440 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:11.440 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":97,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:58:08.737140+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:58:04.747828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-15T23:58:06.072735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:58:11.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.441+0000 7f2b0afe1640 1 -- 172.21.15.112:0/4103459120 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2af00678f0 msgr2=0x7f2af0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.441+0000 7f2b0afe1640 1 --2- 172.21.15.112:0/4103459120 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2af00678f0 0x7f2af0069db0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2af80b1000 tx=0x7f2af8004740 comp rx=0 tx=0).stop 2024-09-15T23:58:11.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.441+0000 7f2b0afe1640 1 -- 172.21.15.112:0/4103459120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040b3330 msgr2=0x7f2b0415ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.441+0000 7f2b0afe1640 1 --2- 172.21.15.112:0/4103459120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040b3330 0x7f2b0415ab40 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c530 tx=0x7f2af400c9f0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.441+0000 7f2b0afe1640 1 -- 172.21.15.112:0/4103459120 shutdown_connections 2024-09-15T23:58:11.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.441+0000 7f2b0afe1640 1 --2- 172.21.15.112:0/4103459120 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2af00678f0 0x7f2af0069db0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.441+0000 7f2b0afe1640 1 --2- 172.21.15.112:0/4103459120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b0415b570 0x7f2b040c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.441+0000 7f2b0afe1640 1 --2- 172.21.15.112:0/4103459120 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b040b51b0 0x7f2b0413fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.441+0000 7f2b0afe1640 1 --2- 172.21.15.112:0/4103459120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b040b3330 0x7f2b0415ab40 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.441+0000 7f2b0afe1640 1 -- 172.21.15.112:0/4103459120 >> 172.21.15.112:0/4103459120 conn(0x7f2b040b6870 msgr2=0x7f2b0415d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:11.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.441+0000 7f2b0afe1640 1 -- 172.21.15.112:0/4103459120 shutdown_connections 2024-09-15T23:58:11.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.441+0000 7f2b0afe1640 1 -- 172.21.15.112:0/4103459120 wait complete. 2024-09-15T23:58:11.458 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:58:11.458 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:58:11.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.569+0000 7f2fb57f6640 1 Processor -- start 2024-09-15T23:58:11.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.569+0000 7f2fb57f6640 1 -- start start 2024-09-15T23:58:11.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fb57f6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2fb015bec0 0x7f2fb00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fb57f6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2fb015c2a0 0x7f2fb00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fb57f6640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb00b3290 con 0x7f2fb00af2a0 2024-09-15T23:58:11.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fb57f6640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb00b3570 con 0x7f2fb015c2a0 2024-09-15T23:58:11.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fb57f6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb00b3850 con 0x7f2fb015bec0 2024-09-15T23:58:11.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fae7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2fb015c2a0 0x7f2fb00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:11.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2faf7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2fb00af2a0 0x7f2fb015fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58642/0 (socket says 172.21.15.112:58642) 2024-09-15T23:58:11.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fae7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2fb015c2a0 0x7f2fb00aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59776/0 (socket says 172.21.15.112:59776) 2024-09-15T23:58:11.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2faf7fe640 1 -- 172.21.15.112:0/1841002307 learned_addr learned my addr 172.21.15.112:0/1841002307 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:11.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fae7fc640 1 -- 172.21.15.112:0/1841002307 >> v2:172.21.15.169:3300/0 conn(0x7f2fb015bec0 msgr2=0x7f2fb00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:11.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2faeffd640 1 --2- 172.21.15.112:0/1841002307 >> v2:172.21.15.169:3300/0 conn(0x7f2fb015bec0 0x7f2fb00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:11.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fadffb640 1 -- 172.21.15.112:0/1841002307 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 688125139 0 0) 0x7f2fb00b3290 con 0x7f2fb00af2a0 2024-09-15T23:58:11.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fae7fc640 1 --2- 172.21.15.112:0/1841002307 >> v2:172.21.15.169:3300/0 conn(0x7f2fb015bec0 0x7f2fb00ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fae7fc640 1 -- 172.21.15.112:0/1841002307 >> v1:172.21.15.112:6789/0 conn(0x7f2fb00af2a0 legacy=0x7f2fb015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fae7fc640 1 -- 172.21.15.112:0/1841002307 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb00b3b30 con 0x7f2fb015c2a0 2024-09-15T23:58:11.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2faeffd640 1 --2- 172.21.15.112:0/1841002307 >> v2:172.21.15.169:3300/0 conn(0x7f2fb015bec0 0x7f2fb00ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:11.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fae7fc640 1 --2- 172.21.15.112:0/1841002307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fb015c2a0 0x7f2fb00aed60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0071710 tx=0x7f2fa401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af6d6c8bb435ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:11.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fadffb640 1 -- 172.21.15.112:0/1841002307 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa40ab650 con 0x7f2fb015c2a0 2024-09-15T23:58:11.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fadffb640 1 -- 172.21.15.112:0/1841002307 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa40b0070 con 0x7f2fb015c2a0 2024-09-15T23:58:11.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fadffb640 1 -- 172.21.15.112:0/1841002307 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa40aba10 con 0x7f2fb015c2a0 2024-09-15T23:58:11.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fb57f6640 1 -- 172.21.15.112:0/1841002307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fb015c2a0 msgr2=0x7f2fb00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fb57f6640 1 --2- 172.21.15.112:0/1841002307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fb015c2a0 0x7f2fb00aed60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0071710 tx=0x7f2fa401c450 comp rx=0 tx=0).stop 2024-09-15T23:58:11.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fb57f6640 1 -- 172.21.15.112:0/1841002307 shutdown_connections 2024-09-15T23:58:11.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fb57f6640 1 --2- 172.21.15.112:0/1841002307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fb015c2a0 0x7f2fb00aed60 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fb57f6640 1 --2- 172.21.15.112:0/1841002307 >> v2:172.21.15.169:3300/0 conn(0x7f2fb015bec0 0x7f2fb00ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fb57f6640 1 -- 172.21.15.112:0/1841002307 >> 172.21.15.112:0/1841002307 conn(0x7f2fb00b1f90 msgr2=0x7f2fb00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:11.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fb57f6640 1 -- 172.21.15.112:0/1841002307 shutdown_connections 2024-09-15T23:58:11.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.573+0000 7f2fb57f6640 1 -- 172.21.15.112:0/1841002307 wait complete. 2024-09-15T23:58:11.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fb57f6640 1 Processor -- start 2024-09-15T23:58:11.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fb57f6640 1 -- start start 2024-09-15T23:58:11.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fb57f6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fb00af2a0 0x7f2fb015f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fb57f6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fb015bec0 0x7f2fb015d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fb57f6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fb015c2a0 0x7f2fb014f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fb57f6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb00af6d0 con 0x7f2fb015bec0 2024-09-15T23:58:11.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fb57f6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb00ad740 con 0x7f2fb00af2a0 2024-09-15T23:58:11.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fb57f6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb0169000 con 0x7f2fb015c2a0 2024-09-15T23:58:11.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fae7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fb015bec0 0x7f2fb015d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:11.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fae7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fb015bec0 0x7f2fb015d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59790/0 (socket says 172.21.15.112:59790) 2024-09-15T23:58:11.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fae7fc640 1 -- 172.21.15.112:0/3836439287 learned_addr learned my addr 172.21.15.112:0/3836439287 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:11.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2faf7fe640 1 --2- 172.21.15.112:0/3836439287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fb015c2a0 0x7f2fb014f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:11.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fae7fc640 1 -- 172.21.15.112:0/3836439287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fb015c2a0 msgr2=0x7f2fb014f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fae7fc640 1 --2- 172.21.15.112:0/3836439287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fb015c2a0 0x7f2fb014f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fae7fc640 1 -- 172.21.15.112:0/3836439287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fb00af2a0 msgr2=0x7f2fb015f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fae7fc640 1 --2- 172.21.15.112:0/3836439287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fb00af2a0 0x7f2fb015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fae7fc640 1 -- 172.21.15.112:0/3836439287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb015d600 con 0x7f2fb015bec0 2024-09-15T23:58:11.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fae7fc640 1 --2- 172.21.15.112:0/3836439287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fb015bec0 0x7f2fb015d0c0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2fa401a080 tx=0x7f2fa40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:11.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2f977fe640 1 -- 172.21.15.112:0/3836439287 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa40abde0 con 0x7f2fb015bec0 2024-09-15T23:58:11.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2f977fe640 1 -- 172.21.15.112:0/3836439287 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa40bf450 con 0x7f2fb015bec0 2024-09-15T23:58:11.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fb57f6640 1 -- 172.21.15.112:0/3836439287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb014fdd0 con 0x7f2fb015bec0 2024-09-15T23:58:11.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2f977fe640 1 -- 172.21.15.112:0/3836439287 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa40bf840 con 0x7f2fb015bec0 2024-09-15T23:58:11.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fb57f6640 1 -- 172.21.15.112:0/3836439287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb015db60 con 0x7f2fb015bec0 2024-09-15T23:58:11.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2fb57f6640 1 -- 172.21.15.112:0/3836439287 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb00ad200 con 0x7f2fb015bec0 2024-09-15T23:58:11.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.577+0000 7f2f977fe640 1 -- 172.21.15.112:0/3836439287 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2fa40b43f0 con 0x7f2fb015bec0 2024-09-15T23:58:11.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.581+0000 7f2f977fe640 1 --2- 172.21.15.112:0/3836439287 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2f9c0678c0 0x7f2f9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.581+0000 7f2f977fe640 1 -- 172.21.15.112:0/3836439287 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f2fa4120a20 con 0x7f2fb015bec0 2024-09-15T23:58:11.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.581+0000 7f2faeffd640 1 --2- 172.21.15.112:0/3836439287 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2f9c0678c0 0x7f2f9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:11.580 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.581+0000 7f2faeffd640 1 --2- 172.21.15.112:0/3836439287 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2f9c0678c0 0x7f2f9c069d80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000a8d0 tx=0x7f2fa0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:11.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.585+0000 7f2f977fe640 1 -- 172.21.15.112:0/3836439287 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2fb015d600 con 0x7f2fb015bec0 2024-09-15T23:58:11.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.729+0000 7f2fb57f6640 1 -- 172.21.15.112:0/3836439287 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2fb006fcd0 con 0x7f2f9c0678c0 2024-09-15T23:58:11.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.737+0000 7f2f977fe640 1 -- 172.21.15.112:0/3836439287 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251666 (secure 0 0 0) 0x7f2fb006fcd0 con 0x7f2f9c0678c0 2024-09-15T23:58:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:11.742 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:58:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.741+0000 7f2fb57f6640 1 -- 172.21.15.112:0/3836439287 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2f9c0678c0 msgr2=0x7f2f9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.741+0000 7f2fb57f6640 1 --2- 172.21.15.112:0/3836439287 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2f9c0678c0 0x7f2f9c069d80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000a8d0 tx=0x7f2fa0008040 comp rx=0 tx=0).stop 2024-09-15T23:58:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.741+0000 7f2fb57f6640 1 -- 172.21.15.112:0/3836439287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fb015bec0 msgr2=0x7f2fb015d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.741+0000 7f2fb57f6640 1 --2- 172.21.15.112:0/3836439287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fb015bec0 0x7f2fb015d0c0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2fa401a080 tx=0x7f2fa40191f0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.741+0000 7f2fb57f6640 1 -- 172.21.15.112:0/3836439287 shutdown_connections 2024-09-15T23:58:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.741+0000 7f2fb57f6640 1 --2- 172.21.15.112:0/3836439287 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2f9c0678c0 0x7f2f9c069d80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.741+0000 7f2fb57f6640 1 --2- 172.21.15.112:0/3836439287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fb015c2a0 0x7f2fb014f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.741+0000 7f2fb57f6640 1 --2- 172.21.15.112:0/3836439287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fb015bec0 0x7f2fb015d0c0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.741+0000 7f2fb57f6640 1 --2- 172.21.15.112:0/3836439287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fb00af2a0 0x7f2fb015f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.741+0000 7f2fb57f6640 1 -- 172.21.15.112:0/3836439287 >> 172.21.15.112:0/3836439287 conn(0x7f2fb00b1f90 msgr2=0x7f2fb00b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.741+0000 7f2fb57f6640 1 -- 172.21.15.112:0/3836439287 shutdown_connections 2024-09-15T23:58:11.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.741+0000 7f2fb57f6640 1 -- 172.21.15.112:0/3836439287 wait complete. 2024-09-15T23:58:11.757 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-15T23:58:11.313780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":268328,"kb_used_data":10476,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754706392,"statfs":{"total":773094113280,"available":772819345408,"internally_reserved":0,"allocated":10727424,"data_stored":5514058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.614632"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757324+0000","last_change":"2024-09-15T23:58:07.765376+0000","last_active":"2024-09-15T23:58:08.757324+0000","last_peered":"2024-09-15T23:58:08.757324+0000","last_clean":"2024-09-15T23:58:08.757324+0000","last_became_active":"2024-09-15T23:58:07.764634+0000","last_became_peered":"2024-09-15T23:58:07.764634+0000","last_unstale":"2024-09-15T23:58:08.757324+0000","last_undegraded":"2024-09-15T23:58:08.757324+0000","last_fullsized":"2024-09-15T23:58:08.757324+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:17.697740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753334+0000","last_change":"2024-09-15T23:58:07.773180+0000","last_active":"2024-09-15T23:58:08.753334+0000","last_peered":"2024-09-15T23:58:08.753334+0000","last_clean":"2024-09-15T23:58:08.753334+0000","last_became_active":"2024-09-15T23:58:07.772756+0000","last_became_peered":"2024-09-15T23:58:07.772756+0000","last_unstale":"2024-09-15T23:58:08.753334+0000","last_undegraded":"2024-09-15T23:58:08.753334+0000","last_fullsized":"2024-09-15T23:58:08.753334+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:25.286230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.722018+0000","last_change":"2024-09-15T23:58:06.722018+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.722018+0000","last_undegraded":"2024-09-15T23:58:06.722018+0000","last_fullsized":"2024-09-15T23:58:06.722018+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756033+0000","last_change":"2024-09-15T23:58:07.792209+0000","last_active":"2024-09-15T23:58:08.756033+0000","last_peered":"2024-09-15T23:58:08.756033+0000","last_clean":"2024-09-15T23:58:08.756033+0000","last_became_active":"2024-09-15T23:58:07.783955+0000","last_became_peered":"2024-09-15T23:58:07.783955+0000","last_unstale":"2024-09-15T23:58:08.756033+0000","last_undegraded":"2024-09-15T23:58:08.756033+0000","last_fullsized":"2024-09-15T23:58:08.756033+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:01.050859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756642+0000","last_change":"2024-09-15T23:58:07.766302+0000","last_active":"2024-09-15T23:58:08.756642+0000","last_peered":"2024-09-15T23:58:08.756642+0000","last_clean":"2024-09-15T23:58:08.756642+0000","last_became_active":"2024-09-15T23:58:07.765484+0000","last_became_peered":"2024-09-15T23:58:07.765484+0000","last_unstale":"2024-09-15T23:58:08.756642+0000","last_undegraded":"2024-09-15T23:58:08.756642+0000","last_fullsized":"2024-09-15T23:58:08.756642+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:35.296757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791365+0000","last_change":"2024-09-15T23:58:07.780199+0000","last_active":"2024-09-15T23:58:08.791365+0000","last_peered":"2024-09-15T23:58:08.791365+0000","last_clean":"2024-09-15T23:58:08.791365+0000","last_became_active":"2024-09-15T23:58:07.779937+0000","last_became_peered":"2024-09-15T23:58:07.779937+0000","last_unstale":"2024-09-15T23:58:08.791365+0000","last_undegraded":"2024-09-15T23:58:08.791365+0000","last_fullsized":"2024-09-15T23:58:08.791365+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:34.415985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.790898+0000","last_change":"2024-09-15T23:58:07.779584+0000","last_active":"2024-09-15T23:58:08.790898+0000","last_peered":"2024-09-15T23:58:08.790898+0000","last_clean":"2024-09-15T23:58:08.790898+0000","last_became_active":"2024-09-15T23:58:07.776328+0000","last_became_peered":"2024-09-15T23:58:07.776328+0000","last_unstale":"2024-09-15T23:58:08.790898+0000","last_undegraded":"2024-09-15T23:58:08.790898+0000","last_fullsized":"2024-09-15T23:58:08.790898+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:20.154190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757373+0000","last_change":"2024-09-15T23:58:07.759525+0000","last_active":"2024-09-15T23:58:08.757373+0000","last_peered":"2024-09-15T23:58:08.757373+0000","last_clean":"2024-09-15T23:58:08.757373+0000","last_became_active":"2024-09-15T23:58:07.759015+0000","last_became_peered":"2024-09-15T23:58:07.759015+0000","last_unstale":"2024-09-15T23:58:08.757373+0000","last_undegraded":"2024-09-15T23:58:08.757373+0000","last_fullsized":"2024-09-15T23:58:08.757373+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:38.225855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753896+0000","last_change":"2024-09-15T23:58:07.800146+0000","last_active":"2024-09-15T23:58:08.753896+0000","last_peered":"2024-09-15T23:58:08.753896+0000","last_clean":"2024-09-15T23:58:08.753896+0000","last_became_active":"2024-09-15T23:58:07.799851+0000","last_became_peered":"2024-09-15T23:58:07.799851+0000","last_unstale":"2024-09-15T23:58:08.753896+0000","last_undegraded":"2024-09-15T23:58:08.753896+0000","last_fullsized":"2024-09-15T23:58:08.753896+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:36.707754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758499+0000","last_change":"2024-09-15T23:58:07.753670+0000","last_active":"2024-09-15T23:58:08.758499+0000","last_peered":"2024-09-15T23:58:08.758499+0000","last_clean":"2024-09-15T23:58:08.758499+0000","last_became_active":"2024-09-15T23:58:07.752863+0000","last_became_peered":"2024-09-15T23:58:07.752863+0000","last_unstale":"2024-09-15T23:58:08.758499+0000","last_undegraded":"2024-09-15T23:58:08.758499+0000","last_fullsized":"2024-09-15T23:58:08.758499+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:53.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128244+0000","last_change":"2024-09-15T23:58:07.773082+0000","last_active":"2024-09-15T23:58:09.128244+0000","last_peered":"2024-09-15T23:58:09.128244+0000","last_clean":"2024-09-15T23:58:09.128244+0000","last_became_active":"2024-09-15T23:58:07.768580+0000","last_became_peered":"2024-09-15T23:58:07.768580+0000","last_unstale":"2024-09-15T23:58:09.128244+0000","last_undegraded":"2024-09-15T23:58:09.128244+0000","last_fullsized":"2024-09-15T23:58:09.128244+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:55.098428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791187+0000","last_change":"2024-09-15T23:58:07.779856+0000","last_active":"2024-09-15T23:58:08.791187+0000","last_peered":"2024-09-15T23:58:08.791187+0000","last_clean":"2024-09-15T23:58:08.791187+0000","last_became_active":"2024-09-15T23:58:07.779553+0000","last_became_peered":"2024-09-15T23:58:07.779553+0000","last_unstale":"2024-09-15T23:58:08.791187+0000","last_undegraded":"2024-09-15T23:58:08.791187+0000","last_fullsized":"2024-09-15T23:58:08.791187+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:45.241169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.755836+0000","last_change":"2024-09-15T23:58:07.796750+0000","last_active":"2024-09-15T23:58:08.755836+0000","last_peered":"2024-09-15T23:58:08.755836+0000","last_clean":"2024-09-15T23:58:08.755836+0000","last_became_active":"2024-09-15T23:58:07.792310+0000","last_became_peered":"2024-09-15T23:58:07.792310+0000","last_unstale":"2024-09-15T23:58:08.755836+0000","last_undegraded":"2024-09-15T23:58:08.755836+0000","last_fullsized":"2024-09-15T23:58:08.755836+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:20.742739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791283+0000","last_change":"2024-09-15T23:58:07.776737+0000","last_active":"2024-09-15T23:58:08.791283+0000","last_peered":"2024-09-15T23:58:08.791283+0000","last_clean":"2024-09-15T23:58:08.791283+0000","last_became_active":"2024-09-15T23:58:07.776475+0000","last_became_peered":"2024-09-15T23:58:07.776475+0000","last_unstale":"2024-09-15T23:58:08.791283+0000","last_undegraded":"2024-09-15T23:58:08.791283+0000","last_fullsized":"2024-09-15T23:58:08.791283+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:58.182086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.752647+0000","last_change":"2024-09-15T23:58:07.789278+0000","last_active":"2024-09-15T23:58:08.752647+0000","last_peered":"2024-09-15T23:58:08.752647+0000","last_clean":"2024-09-15T23:58:08.752647+0000","last_became_active":"2024-09-15T23:58:07.788374+0000","last_became_peered":"2024-09-15T23:58:07.788374+0000","last_unstale":"2024-09-15T23:58:08.752647+0000","last_undegraded":"2024-09-15T23:58:08.752647+0000","last_fullsized":"2024-09-15T23:58:08.752647+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:10.386941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.127573+0000","last_change":"2024-09-15T23:58:07.777214+0000","last_active":"2024-09-15T23:58:09.127573+0000","last_peered":"2024-09-15T23:58:09.127573+0000","last_clean":"2024-09-15T23:58:09.127573+0000","last_became_active":"2024-09-15T23:58:07.776537+0000","last_became_peered":"2024-09-15T23:58:07.776537+0000","last_unstale":"2024-09-15T23:58:09.127573+0000","last_undegraded":"2024-09-15T23:58:09.127573+0000","last_fullsized":"2024-09-15T23:58:09.127573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:38.958811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.727455+0000","last_change":"2024-09-15T23:58:06.727455+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.727455+0000","last_undegraded":"2024-09-15T23:58:06.727455+0000","last_fullsized":"2024-09-15T23:58:06.727455+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753613+0000","last_change":"2024-09-15T23:58:07.773809+0000","last_active":"2024-09-15T23:58:08.753613+0000","last_peered":"2024-09-15T23:58:08.753613+0000","last_clean":"2024-09-15T23:58:08.753613+0000","last_became_active":"2024-09-15T23:58:07.773013+0000","last_became_peered":"2024-09-15T23:58:07.773013+0000","last_unstale":"2024-09-15T23:58:08.753613+0000","last_undegraded":"2024-09-15T23:58:08.753613+0000","last_fullsized":"2024-09-15T23:58:08.753613+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:35.110846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756318+0000","last_change":"2024-09-15T23:58:07.797639+0000","last_active":"2024-09-15T23:58:08.756318+0000","last_peered":"2024-09-15T23:58:08.756318+0000","last_clean":"2024-09-15T23:58:08.756318+0000","last_became_active":"2024-09-15T23:58:07.796983+0000","last_became_peered":"2024-09-15T23:58:07.796983+0000","last_unstale":"2024-09-15T23:58:08.756318+0000","last_undegraded":"2024-09-15T23:58:08.756318+0000","last_fullsized":"2024-09-15T23:58:08.756318+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:34.778205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128194+0000","last_change":"2024-09-15T23:58:07.762602+0000","last_active":"2024-09-15T23:58:09.128194+0000","last_peered":"2024-09-15T23:58:09.128194+0000","last_clean":"2024-09-15T23:58:09.128194+0000","last_became_active":"2024-09-15T23:58:07.761868+0000","last_became_peered":"2024-09-15T23:58:07.761868+0000","last_unstale":"2024-09-15T23:58:09.128194+0000","last_undegraded":"2024-09-15T23:58:09.128194+0000","last_fullsized":"2024-09-15T23:58:09.128194+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:38.225855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.726154+0000","last_change":"2024-09-15T23:58:06.726154+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.726154+0000","last_undegraded":"2024-09-15T23:58:06.726154+0000","last_fullsized":"2024-09-15T23:58:06.726154+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126816+0000","last_change":"2024-09-15T23:58:07.782785+0000","last_active":"2024-09-15T23:58:09.126816+0000","last_peered":"2024-09-15T23:58:09.126816+0000","last_clean":"2024-09-15T23:58:09.126816+0000","last_became_active":"2024-09-15T23:58:07.782088+0000","last_became_peered":"2024-09-15T23:58:07.782088+0000","last_unstale":"2024-09-15T23:58:09.126816+0000","last_undegraded":"2024-09-15T23:58:09.126816+0000","last_fullsized":"2024-09-15T23:58:09.126816+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:21.579619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758736+0000","last_change":"2024-09-15T23:58:07.778120+0000","last_active":"2024-09-15T23:58:08.758736+0000","last_peered":"2024-09-15T23:58:08.758736+0000","last_clean":"2024-09-15T23:58:08.758736+0000","last_became_active":"2024-09-15T23:58:07.777366+0000","last_became_peered":"2024-09-15T23:58:07.777366+0000","last_unstale":"2024-09-15T23:58:08.758736+0000","last_undegraded":"2024-09-15T23:58:08.758736+0000","last_fullsized":"2024-09-15T23:58:08.758736+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:28.979657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757763+0000","last_change":"2024-09-15T23:58:07.768580+0000","last_active":"2024-09-15T23:58:08.757763+0000","last_peered":"2024-09-15T23:58:08.757763+0000","last_clean":"2024-09-15T23:58:08.757763+0000","last_became_active":"2024-09-15T23:58:07.768022+0000","last_became_peered":"2024-09-15T23:58:07.768022+0000","last_unstale":"2024-09-15T23:58:08.757763+0000","last_undegraded":"2024-09-15T23:58:08.757763+0000","last_fullsized":"2024-09-15T23:58:08.757763+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:00.705487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129489+0000","last_change":"2024-09-15T23:58:07.796575+0000","last_active":"2024-09-15T23:58:09.129489+0000","last_peered":"2024-09-15T23:58:09.129489+0000","last_clean":"2024-09-15T23:58:09.129489+0000","last_became_active":"2024-09-15T23:58:07.788327+0000","last_became_peered":"2024-09-15T23:58:07.788327+0000","last_unstale":"2024-09-15T23:58:09.129489+0000","last_undegraded":"2024-09-15T23:58:09.129489+0000","last_fullsized":"2024-09-15T23:58:09.129489+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:28.979657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129311+0000","last_change":"2024-09-15T23:58:07.796461+0000","last_active":"2024-09-15T23:58:09.129311+0000","last_peered":"2024-09-15T23:58:09.129311+0000","last_clean":"2024-09-15T23:58:09.129311+0000","last_became_active":"2024-09-15T23:58:07.796172+0000","last_became_peered":"2024-09-15T23:58:07.796172+0000","last_unstale":"2024-09-15T23:58:09.129311+0000","last_undegraded":"2024-09-15T23:58:09.129311+0000","last_fullsized":"2024-09-15T23:58:09.129311+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:26.451417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129132+0000","last_change":"2024-09-15T23:58:07.779754+0000","last_active":"2024-09-15T23:58:09.129132+0000","last_peered":"2024-09-15T23:58:09.129132+0000","last_clean":"2024-09-15T23:58:09.129132+0000","last_became_active":"2024-09-15T23:58:07.779070+0000","last_became_peered":"2024-09-15T23:58:07.779070+0000","last_unstale":"2024-09-15T23:58:09.129132+0000","last_undegraded":"2024-09-15T23:58:09.129132+0000","last_fullsized":"2024-09-15T23:58:09.129132+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:53.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791414+0000","last_change":"2024-09-15T23:58:07.781973+0000","last_active":"2024-09-15T23:58:08.791414+0000","last_peered":"2024-09-15T23:58:08.791414+0000","last_clean":"2024-09-15T23:58:08.791414+0000","last_became_active":"2024-09-15T23:58:07.781646+0000","last_became_peered":"2024-09-15T23:58:07.781646+0000","last_unstale":"2024-09-15T23:58:08.791414+0000","last_undegraded":"2024-09-15T23:58:08.791414+0000","last_fullsized":"2024-09-15T23:58:08.791414+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:54.991980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758938+0000","last_change":"2024-09-15T23:58:07.780326+0000","last_active":"2024-09-15T23:58:08.758938+0000","last_peered":"2024-09-15T23:58:08.758938+0000","last_clean":"2024-09-15T23:58:08.758938+0000","last_became_active":"2024-09-15T23:58:07.779866+0000","last_became_peered":"2024-09-15T23:58:07.779866+0000","last_unstale":"2024-09-15T23:58:08.758938+0000","last_undegraded":"2024-09-15T23:58:08.758938+0000","last_fullsized":"2024-09-15T23:58:08.758938+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:32.670128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129254+0000","last_change":"2024-09-15T23:58:07.772116+0000","last_active":"2024-09-15T23:58:09.129254+0000","last_peered":"2024-09-15T23:58:09.129254+0000","last_clean":"2024-09-15T23:58:09.129254+0000","last_became_active":"2024-09-15T23:58:07.771400+0000","last_became_peered":"2024-09-15T23:58:07.771400+0000","last_unstale":"2024-09-15T23:58:09.129254+0000","last_undegraded":"2024-09-15T23:58:09.129254+0000","last_fullsized":"2024-09-15T23:58:09.129254+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:53.111663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791001+0000","last_change":"2024-09-15T23:58:07.780570+0000","last_active":"2024-09-15T23:58:08.791001+0000","last_peered":"2024-09-15T23:58:08.791001+0000","last_clean":"2024-09-15T23:58:08.791001+0000","last_became_active":"2024-09-15T23:58:07.779637+0000","last_became_peered":"2024-09-15T23:58:07.779637+0000","last_unstale":"2024-09-15T23:58:08.791001+0000","last_undegraded":"2024-09-15T23:58:08.791001+0000","last_fullsized":"2024-09-15T23:58:08.791001+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:04.943802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.125806+0000","last_change":"2024-09-15T23:58:07.767211+0000","last_active":"2024-09-15T23:58:09.125806+0000","last_peered":"2024-09-15T23:58:09.125806+0000","last_clean":"2024-09-15T23:58:09.125806+0000","last_became_active":"2024-09-15T23:58:07.766427+0000","last_became_peered":"2024-09-15T23:58:07.766427+0000","last_unstale":"2024-09-15T23:58:09.125806+0000","last_undegraded":"2024-09-15T23:58:09.125806+0000","last_fullsized":"2024-09-15T23:58:09.125806+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:10.506341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.720275+0000","last_change":"2024-09-15T23:58:06.720275+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.720275+0000","last_undegraded":"2024-09-15T23:58:06.720275+0000","last_fullsized":"2024-09-15T23:58:06.720275+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1f","version":"96'4","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126760+0000","last_change":"2024-09-15T23:58:06.737380+0000","last_active":"2024-09-15T23:58:09.126760+0000","last_peered":"2024-09-15T23:58:09.126760+0000","last_clean":"2024-09-15T23:58:09.126760+0000","last_became_active":"2024-09-15T23:58:06.736527+0000","last_became_peered":"2024-09-15T23:58:06.736527+0000","last_unstale":"2024-09-15T23:58:09.126760+0000","last_undegraded":"2024-09-15T23:58:09.126760+0000","last_fullsized":"2024-09-15T23:58:09.126760+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:42.645715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758832+0000","last_change":"2024-09-15T23:58:07.776944+0000","last_active":"2024-09-15T23:58:08.758832+0000","last_peered":"2024-09-15T23:58:08.758832+0000","last_clean":"2024-09-15T23:58:08.758832+0000","last_became_active":"2024-09-15T23:58:07.776174+0000","last_became_peered":"2024-09-15T23:58:07.776174+0000","last_unstale":"2024-09-15T23:58:08.758832+0000","last_undegraded":"2024-09-15T23:58:08.758832+0000","last_fullsized":"2024-09-15T23:58:08.758832+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:51.731861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753413+0000","last_change":"2024-09-15T23:58:06.747179+0000","last_active":"2024-09-15T23:58:06.753413+0000","last_peered":"2024-09-15T23:58:06.753413+0000","last_clean":"2024-09-15T23:58:06.753413+0000","last_became_active":"2024-09-15T23:58:06.746346+0000","last_became_peered":"2024-09-15T23:58:06.746346+0000","last_unstale":"2024-09-15T23:58:06.753413+0000","last_undegraded":"2024-09-15T23:58:06.753413+0000","last_fullsized":"2024-09-15T23:58:06.753413+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:39.718082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.752931+0000","last_change":"2024-09-15T23:58:07.755258+0000","last_active":"2024-09-15T23:58:08.752931+0000","last_peered":"2024-09-15T23:58:08.752931+0000","last_clean":"2024-09-15T23:58:08.752931+0000","last_became_active":"2024-09-15T23:58:07.754455+0000","last_became_peered":"2024-09-15T23:58:07.754455+0000","last_unstale":"2024-09-15T23:58:08.752931+0000","last_undegraded":"2024-09-15T23:58:08.752931+0000","last_fullsized":"2024-09-15T23:58:08.752931+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:07.269079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753420+0000","last_change":"2024-09-15T23:58:06.739251+0000","last_active":"2024-09-15T23:58:08.753420+0000","last_peered":"2024-09-15T23:58:08.753420+0000","last_clean":"2024-09-15T23:58:08.753420+0000","last_became_active":"2024-09-15T23:58:06.738972+0000","last_became_peered":"2024-09-15T23:58:06.738972+0000","last_unstale":"2024-09-15T23:58:08.753420+0000","last_undegraded":"2024-09-15T23:58:08.753420+0000","last_fullsized":"2024-09-15T23:58:08.753420+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:15.435941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128549+0000","last_change":"2024-09-15T23:58:07.783162+0000","last_active":"2024-09-15T23:58:09.128549+0000","last_peered":"2024-09-15T23:58:09.128549+0000","last_clean":"2024-09-15T23:58:09.128549+0000","last_became_active":"2024-09-15T23:58:07.782870+0000","last_became_peered":"2024-09-15T23:58:07.782870+0000","last_unstale":"2024-09-15T23:58:09.128549+0000","last_undegraded":"2024-09-15T23:58:09.128549+0000","last_fullsized":"2024-09-15T23:58:09.128549+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:54.734314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758412+0000","last_change":"2024-09-15T23:58:06.724258+0000","last_active":"2024-09-15T23:58:08.758412+0000","last_peered":"2024-09-15T23:58:08.758412+0000","last_clean":"2024-09-15T23:58:08.758412+0000","last_became_active":"2024-09-15T23:58:06.723572+0000","last_became_peered":"2024-09-15T23:58:06.723572+0000","last_unstale":"2024-09-15T23:58:08.758412+0000","last_undegraded":"2024-09-15T23:58:08.758412+0000","last_fullsized":"2024-09-15T23:58:08.758412+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:08.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756965+0000","last_change":"2024-09-15T23:58:07.784732+0000","last_active":"2024-09-15T23:58:08.756965+0000","last_peered":"2024-09-15T23:58:08.756965+0000","last_clean":"2024-09-15T23:58:08.756965+0000","last_became_active":"2024-09-15T23:58:07.782292+0000","last_became_peered":"2024-09-15T23:58:07.782292+0000","last_unstale":"2024-09-15T23:58:08.756965+0000","last_undegraded":"2024-09-15T23:58:08.756965+0000","last_fullsized":"2024-09-15T23:58:08.756965+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:33.544108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1b","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128878+0000","last_change":"2024-09-15T23:58:06.735612+0000","last_active":"2024-09-15T23:58:09.128878+0000","last_peered":"2024-09-15T23:58:09.128878+0000","last_clean":"2024-09-15T23:58:09.128878+0000","last_became_active":"2024-09-15T23:58:06.735170+0000","last_became_peered":"2024-09-15T23:58:06.735170+0000","last_unstale":"2024-09-15T23:58:09.128878+0000","last_undegraded":"2024-09-15T23:58:09.128878+0000","last_fullsized":"2024-09-15T23:58:09.128878+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:43.931563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756768+0000","last_change":"2024-09-15T23:58:07.765505+0000","last_active":"2024-09-15T23:58:08.756768+0000","last_peered":"2024-09-15T23:58:08.756768+0000","last_clean":"2024-09-15T23:58:08.756768+0000","last_became_active":"2024-09-15T23:58:07.764711+0000","last_became_peered":"2024-09-15T23:58:07.764711+0000","last_unstale":"2024-09-15T23:58:08.756768+0000","last_undegraded":"2024-09-15T23:58:08.756768+0000","last_fullsized":"2024-09-15T23:58:08.756768+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:39.153021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129582+0000","last_change":"2024-09-15T23:58:06.736878+0000","last_active":"2024-09-15T23:58:09.129582+0000","last_peered":"2024-09-15T23:58:09.129582+0000","last_clean":"2024-09-15T23:58:09.129582+0000","last_became_active":"2024-09-15T23:58:06.736545+0000","last_became_peered":"2024-09-15T23:58:06.736545+0000","last_unstale":"2024-09-15T23:58:09.129582+0000","last_undegraded":"2024-09-15T23:58:09.129582+0000","last_fullsized":"2024-09-15T23:58:09.129582+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:06.203702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129816+0000","last_change":"2024-09-15T23:58:07.764136+0000","last_active":"2024-09-15T23:58:09.129816+0000","last_peered":"2024-09-15T23:58:09.129816+0000","last_clean":"2024-09-15T23:58:09.129816+0000","last_became_active":"2024-09-15T23:58:07.762035+0000","last_became_peered":"2024-09-15T23:58:07.762035+0000","last_unstale":"2024-09-15T23:58:09.129816+0000","last_undegraded":"2024-09-15T23:58:09.129816+0000","last_fullsized":"2024-09-15T23:58:09.129816+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:13.530423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128008+0000","last_change":"2024-09-15T23:58:06.737494+0000","last_active":"2024-09-15T23:58:09.128008+0000","last_peered":"2024-09-15T23:58:09.128008+0000","last_clean":"2024-09-15T23:58:09.128008+0000","last_became_active":"2024-09-15T23:58:06.736714+0000","last_became_peered":"2024-09-15T23:58:06.736714+0000","last_unstale":"2024-09-15T23:58:09.128008+0000","last_undegraded":"2024-09-15T23:58:09.128008+0000","last_fullsized":"2024-09-15T23:58:09.128008+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.690650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757533+0000","last_change":"2024-09-15T23:58:07.770649+0000","last_active":"2024-09-15T23:58:08.757533+0000","last_peered":"2024-09-15T23:58:08.757533+0000","last_clean":"2024-09-15T23:58:08.757533+0000","last_became_active":"2024-09-15T23:58:07.768011+0000","last_became_peered":"2024-09-15T23:58:07.768011+0000","last_unstale":"2024-09-15T23:58:08.757533+0000","last_undegraded":"2024-09-15T23:58:08.757533+0000","last_fullsized":"2024-09-15T23:58:08.757533+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:22.781437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126273+0000","last_change":"2024-09-15T23:58:06.745052+0000","last_active":"2024-09-15T23:58:09.126273+0000","last_peered":"2024-09-15T23:58:09.126273+0000","last_clean":"2024-09-15T23:58:09.126273+0000","last_became_active":"2024-09-15T23:58:06.743906+0000","last_became_peered":"2024-09-15T23:58:06.743906+0000","last_unstale":"2024-09-15T23:58:09.126273+0000","last_undegraded":"2024-09-15T23:58:09.126273+0000","last_fullsized":"2024-09-15T23:58:09.126273+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:03.616480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.755433+0000","last_change":"2024-09-15T23:58:07.782085+0000","last_active":"2024-09-15T23:58:08.755433+0000","last_peered":"2024-09-15T23:58:08.755433+0000","last_clean":"2024-09-15T23:58:08.755433+0000","last_became_active":"2024-09-15T23:58:07.781272+0000","last_became_peered":"2024-09-15T23:58:07.781272+0000","last_unstale":"2024-09-15T23:58:08.755433+0000","last_undegraded":"2024-09-15T23:58:08.755433+0000","last_fullsized":"2024-09-15T23:58:08.755433+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:32.190984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791527+0000","last_change":"2024-09-15T23:58:06.723519+0000","last_active":"2024-09-15T23:58:08.791527+0000","last_peered":"2024-09-15T23:58:08.791527+0000","last_clean":"2024-09-15T23:58:08.791527+0000","last_became_active":"2024-09-15T23:58:06.722945+0000","last_became_peered":"2024-09-15T23:58:06.722945+0000","last_unstale":"2024-09-15T23:58:08.791527+0000","last_undegraded":"2024-09-15T23:58:08.791527+0000","last_fullsized":"2024-09-15T23:58:08.791527+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:24.274929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756588+0000","last_change":"2024-09-15T23:58:07.766786+0000","last_active":"2024-09-15T23:58:08.756588+0000","last_peered":"2024-09-15T23:58:08.756588+0000","last_clean":"2024-09-15T23:58:08.756588+0000","last_became_active":"2024-09-15T23:58:07.764533+0000","last_became_peered":"2024-09-15T23:58:07.764533+0000","last_unstale":"2024-09-15T23:58:08.756588+0000","last_undegraded":"2024-09-15T23:58:08.756588+0000","last_fullsized":"2024-09-15T23:58:08.756588+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:25.695282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758744+0000","last_change":"2024-09-15T23:58:06.748827+0000","last_active":"2024-09-15T23:58:08.758744+0000","last_peered":"2024-09-15T23:58:08.758744+0000","last_clean":"2024-09-15T23:58:08.758744+0000","last_became_active":"2024-09-15T23:58:06.748419+0000","last_became_peered":"2024-09-15T23:58:06.748419+0000","last_unstale":"2024-09-15T23:58:08.758744+0000","last_undegraded":"2024-09-15T23:58:08.758744+0000","last_fullsized":"2024-09-15T23:58:08.758744+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.690650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758808+0000","last_change":"2024-09-15T23:58:07.769178+0000","last_active":"2024-09-15T23:58:08.758808+0000","last_peered":"2024-09-15T23:58:08.758808+0000","last_clean":"2024-09-15T23:58:08.758808+0000","last_became_active":"2024-09-15T23:58:07.768505+0000","last_became_peered":"2024-09-15T23:58:07.768505+0000","last_unstale":"2024-09-15T23:58:08.758808+0000","last_undegraded":"2024-09-15T23:58:08.758808+0000","last_fullsized":"2024-09-15T23:58:08.758808+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:43.017275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"96'3","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791897+0000","last_change":"2024-09-15T23:58:06.743819+0000","last_active":"2024-09-15T23:58:08.791897+0000","last_peered":"2024-09-15T23:58:08.791897+0000","last_clean":"2024-09-15T23:58:08.791897+0000","last_became_active":"2024-09-15T23:58:06.743512+0000","last_became_peered":"2024-09-15T23:58:06.743512+0000","last_unstale":"2024-09-15T23:58:08.791897+0000","last_undegraded":"2024-09-15T23:58:08.791897+0000","last_fullsized":"2024-09-15T23:58:08.791897+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:38.845066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126282+0000","last_change":"2024-09-15T23:58:07.787170+0000","last_active":"2024-09-15T23:58:09.126282+0000","last_peered":"2024-09-15T23:58:09.126282+0000","last_clean":"2024-09-15T23:58:09.126282+0000","last_became_active":"2024-09-15T23:58:07.786487+0000","last_became_peered":"2024-09-15T23:58:07.786487+0000","last_unstale":"2024-09-15T23:58:09.126282+0000","last_undegraded":"2024-09-15T23:58:09.126282+0000","last_fullsized":"2024-09-15T23:58:09.126282+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:54.922033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"96'6","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128875+0000","last_change":"2024-09-15T23:58:06.735492+0000","last_active":"2024-09-15T23:58:09.128875+0000","last_peered":"2024-09-15T23:58:09.128875+0000","last_clean":"2024-09-15T23:58:09.128875+0000","last_became_active":"2024-09-15T23:58:06.734834+0000","last_became_peered":"2024-09-15T23:58:06.734834+0000","last_unstale":"2024-09-15T23:58:09.128875+0000","last_undegraded":"2024-09-15T23:58:09.128875+0000","last_fullsized":"2024-09-15T23:58:09.128875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:26.410446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753230+0000","last_change":"2024-09-15T23:58:07.799903+0000","last_active":"2024-09-15T23:58:08.753230+0000","last_peered":"2024-09-15T23:58:08.753230+0000","last_clean":"2024-09-15T23:58:08.753230+0000","last_became_active":"2024-09-15T23:58:07.799564+0000","last_became_peered":"2024-09-15T23:58:07.799564+0000","last_unstale":"2024-09-15T23:58:08.753230+0000","last_undegraded":"2024-09-15T23:58:08.753230+0000","last_fullsized":"2024-09-15T23:58:08.753230+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:09.804410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756456+0000","last_change":"2024-09-15T23:58:06.753728+0000","last_active":"2024-09-15T23:58:08.756456+0000","last_peered":"2024-09-15T23:58:08.756456+0000","last_clean":"2024-09-15T23:58:08.756456+0000","last_became_active":"2024-09-15T23:58:06.753064+0000","last_became_peered":"2024-09-15T23:58:06.753064+0000","last_unstale":"2024-09-15T23:58:08.756456+0000","last_undegraded":"2024-09-15T23:58:08.756456+0000","last_fullsized":"2024-09-15T23:58:08.756456+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:37.947511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753219+0000","last_change":"2024-09-15T23:58:07.758875+0000","last_active":"2024-09-15T23:58:08.753219+0000","last_peered":"2024-09-15T23:58:08.753219+0000","last_clean":"2024-09-15T23:58:08.753219+0000","last_became_active":"2024-09-15T23:58:07.756469+0000","last_became_peered":"2024-09-15T23:58:07.756469+0000","last_unstale":"2024-09-15T23:58:08.753219+0000","last_undegraded":"2024-09-15T23:58:08.753219+0000","last_fullsized":"2024-09-15T23:58:08.753219+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:39.856367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758820+0000","last_change":"2024-09-15T23:58:06.730917+0000","last_active":"2024-09-15T23:58:08.758820+0000","last_peered":"2024-09-15T23:58:08.758820+0000","last_clean":"2024-09-15T23:58:08.758820+0000","last_became_active":"2024-09-15T23:58:06.730153+0000","last_became_peered":"2024-09-15T23:58:06.730153+0000","last_unstale":"2024-09-15T23:58:08.758820+0000","last_undegraded":"2024-09-15T23:58:08.758820+0000","last_fullsized":"2024-09-15T23:58:08.758820+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:06.203702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126587+0000","last_change":"2024-09-15T23:58:07.784939+0000","last_active":"2024-09-15T23:58:09.126587+0000","last_peered":"2024-09-15T23:58:09.126587+0000","last_clean":"2024-09-15T23:58:09.126587+0000","last_became_active":"2024-09-15T23:58:07.783654+0000","last_became_peered":"2024-09-15T23:58:07.783654+0000","last_unstale":"2024-09-15T23:58:09.126587+0000","last_undegraded":"2024-09-15T23:58:09.126587+0000","last_fullsized":"2024-09-15T23:58:09.126587+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:42.052614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756142+0000","last_change":"2024-09-15T23:58:06.733047+0000","last_active":"2024-09-15T23:58:08.756142+0000","last_peered":"2024-09-15T23:58:08.756142+0000","last_clean":"2024-09-15T23:58:08.756142+0000","last_became_active":"2024-09-15T23:58:06.732148+0000","last_became_peered":"2024-09-15T23:58:06.732148+0000","last_unstale":"2024-09-15T23:58:08.756142+0000","last_undegraded":"2024-09-15T23:58:08.756142+0000","last_fullsized":"2024-09-15T23:58:08.756142+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:33.404685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.726429+0000","last_change":"2024-09-15T23:58:06.726429+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.726429+0000","last_undegraded":"2024-09-15T23:58:06.726429+0000","last_fullsized":"2024-09-15T23:58:06.726429+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"96'8","reported_seq":22,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.127657+0000","last_change":"2024-09-15T23:58:06.732340+0000","last_active":"2024-09-15T23:58:09.127657+0000","last_peered":"2024-09-15T23:58:09.127657+0000","last_clean":"2024-09-15T23:58:09.127657+0000","last_became_active":"2024-09-15T23:58:06.732080+0000","last_became_peered":"2024-09-15T23:58:06.732080+0000","last_unstale":"2024-09-15T23:58:09.127657+0000","last_undegraded":"2024-09-15T23:58:09.127657+0000","last_fullsized":"2024-09-15T23:58:09.127657+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:45.077686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758512+0000","last_change":"2024-09-15T23:58:07.770015+0000","last_active":"2024-09-15T23:58:08.758512+0000","last_peered":"2024-09-15T23:58:08.758512+0000","last_clean":"2024-09-15T23:58:08.758512+0000","last_became_active":"2024-09-15T23:58:07.769509+0000","last_became_peered":"2024-09-15T23:58:07.769509+0000","last_unstale":"2024-09-15T23:58:08.758512+0000","last_undegraded":"2024-09-15T23:58:08.758512+0000","last_fullsized":"2024-09-15T23:58:08.758512+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:26.451417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791651+0000","last_change":"2024-09-15T23:58:06.722578+0000","last_active":"2024-09-15T23:58:08.791651+0000","last_peered":"2024-09-15T23:58:08.791651+0000","last_clean":"2024-09-15T23:58:08.791651+0000","last_became_active":"2024-09-15T23:58:06.722138+0000","last_became_peered":"2024-09-15T23:58:06.722138+0000","last_unstale":"2024-09-15T23:58:08.791651+0000","last_undegraded":"2024-09-15T23:58:08.791651+0000","last_fullsized":"2024-09-15T23:58:08.791651+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:35.696453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129439+0000","last_change":"2024-09-15T23:58:07.776105+0000","last_active":"2024-09-15T23:58:09.129439+0000","last_peered":"2024-09-15T23:58:09.129439+0000","last_clean":"2024-09-15T23:58:09.129439+0000","last_became_active":"2024-09-15T23:58:07.775809+0000","last_became_peered":"2024-09-15T23:58:07.775809+0000","last_unstale":"2024-09-15T23:58:09.129439+0000","last_undegraded":"2024-09-15T23:58:09.129439+0000","last_fullsized":"2024-09-15T23:58:09.129439+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:36.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.d","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129069+0000","last_change":"2024-09-15T23:58:06.738994+0000","last_active":"2024-09-15T23:58:09.129069+0000","last_peered":"2024-09-15T23:58:09.129069+0000","last_clean":"2024-09-15T23:58:09.129069+0000","last_became_active":"2024-09-15T23:58:06.738495+0000","last_became_peered":"2024-09-15T23:58:06.738495+0000","last_unstale":"2024-09-15T23:58:09.129069+0000","last_undegraded":"2024-09-15T23:58:09.129069+0000","last_fullsized":"2024-09-15T23:58:09.129069+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:44.651235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126141+0000","last_change":"2024-09-15T23:58:07.782366+0000","last_active":"2024-09-15T23:58:09.126141+0000","last_peered":"2024-09-15T23:58:09.126141+0000","last_clean":"2024-09-15T23:58:09.126141+0000","last_became_active":"2024-09-15T23:58:07.781871+0000","last_became_peered":"2024-09-15T23:58:07.781871+0000","last_unstale":"2024-09-15T23:58:09.126141+0000","last_undegraded":"2024-09-15T23:58:09.126141+0000","last_fullsized":"2024-09-15T23:58:09.126141+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:21.361174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791312+0000","last_change":"2024-09-15T23:58:06.723437+0000","last_active":"2024-09-15T23:58:08.791312+0000","last_peered":"2024-09-15T23:58:08.791312+0000","last_clean":"2024-09-15T23:58:08.791312+0000","last_became_active":"2024-09-15T23:58:06.722488+0000","last_became_peered":"2024-09-15T23:58:06.722488+0000","last_unstale":"2024-09-15T23:58:08.791312+0000","last_undegraded":"2024-09-15T23:58:08.791312+0000","last_fullsized":"2024-09-15T23:58:08.791312+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:08.793109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757296+0000","last_change":"2024-09-15T23:58:07.791345+0000","last_active":"2024-09-15T23:58:08.757296+0000","last_peered":"2024-09-15T23:58:08.757296+0000","last_clean":"2024-09-15T23:58:08.757296+0000","last_became_active":"2024-09-15T23:58:07.781515+0000","last_became_peered":"2024-09-15T23:58:07.781515+0000","last_unstale":"2024-09-15T23:58:08.757296+0000","last_undegraded":"2024-09-15T23:58:08.757296+0000","last_fullsized":"2024-09-15T23:58:08.757296+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:55.061923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753593+0000","last_change":"2024-09-15T23:58:06.742316+0000","last_active":"2024-09-15T23:58:06.753593+0000","last_peered":"2024-09-15T23:58:06.753593+0000","last_clean":"2024-09-15T23:58:06.753593+0000","last_became_active":"2024-09-15T23:58:06.741127+0000","last_became_peered":"2024-09-15T23:58:06.741127+0000","last_unstale":"2024-09-15T23:58:06.753593+0000","last_undegraded":"2024-09-15T23:58:06.753593+0000","last_fullsized":"2024-09-15T23:58:06.753593+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:41.281238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126663+0000","last_change":"2024-09-15T23:58:07.795069+0000","last_active":"2024-09-15T23:58:09.126663+0000","last_peered":"2024-09-15T23:58:09.126663+0000","last_clean":"2024-09-15T23:58:09.126663+0000","last_became_active":"2024-09-15T23:58:07.794212+0000","last_became_peered":"2024-09-15T23:58:07.794212+0000","last_unstale":"2024-09-15T23:58:09.126663+0000","last_undegraded":"2024-09-15T23:58:09.126663+0000","last_fullsized":"2024-09-15T23:58:09.126663+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:23.262308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753608+0000","last_change":"2024-09-15T23:58:06.747941+0000","last_active":"2024-09-15T23:58:06.753608+0000","last_peered":"2024-09-15T23:58:06.753608+0000","last_clean":"2024-09-15T23:58:06.753608+0000","last_became_active":"2024-09-15T23:58:06.747101+0000","last_became_peered":"2024-09-15T23:58:06.747101+0000","last_unstale":"2024-09-15T23:58:06.753608+0000","last_undegraded":"2024-09-15T23:58:06.753608+0000","last_fullsized":"2024-09-15T23:58:06.753608+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:01.213481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126526+0000","last_change":"2024-09-15T23:58:07.775709+0000","last_active":"2024-09-15T23:58:09.126526+0000","last_peered":"2024-09-15T23:58:09.126526+0000","last_clean":"2024-09-15T23:58:09.126526+0000","last_became_active":"2024-09-15T23:58:07.774896+0000","last_became_peered":"2024-09-15T23:58:07.774896+0000","last_unstale":"2024-09-15T23:58:09.126526+0000","last_undegraded":"2024-09-15T23:58:09.126526+0000","last_fullsized":"2024-09-15T23:58:09.126526+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:42.839656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791159+0000","last_change":"2024-09-15T23:58:06.732322+0000","last_active":"2024-09-15T23:58:08.791159+0000","last_peered":"2024-09-15T23:58:08.791159+0000","last_clean":"2024-09-15T23:58:08.791159+0000","last_became_active":"2024-09-15T23:58:06.731337+0000","last_became_peered":"2024-09-15T23:58:06.731337+0000","last_unstale":"2024-09-15T23:58:08.791159+0000","last_undegraded":"2024-09-15T23:58:08.791159+0000","last_fullsized":"2024-09-15T23:58:08.791159+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:00.946105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757489+0000","last_change":"2024-09-15T23:58:07.769923+0000","last_active":"2024-09-15T23:58:08.757489+0000","last_peered":"2024-09-15T23:58:08.757489+0000","last_clean":"2024-09-15T23:58:08.757489+0000","last_became_active":"2024-09-15T23:58:07.769057+0000","last_became_peered":"2024-09-15T23:58:07.769057+0000","last_unstale":"2024-09-15T23:58:08.757489+0000","last_undegraded":"2024-09-15T23:58:08.757489+0000","last_fullsized":"2024-09-15T23:58:08.757489+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:25.029723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758016+0000","last_change":"2024-09-15T23:58:06.737190+0000","last_active":"2024-09-15T23:58:08.758016+0000","last_peered":"2024-09-15T23:58:08.758016+0000","last_clean":"2024-09-15T23:58:08.758016+0000","last_became_active":"2024-09-15T23:58:06.736804+0000","last_became_peered":"2024-09-15T23:58:06.736804+0000","last_unstale":"2024-09-15T23:58:08.758016+0000","last_undegraded":"2024-09-15T23:58:08.758016+0000","last_fullsized":"2024-09-15T23:58:08.758016+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:30.329573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.125911+0000","last_change":"2024-09-15T23:58:07.775890+0000","last_active":"2024-09-15T23:58:09.125911+0000","last_peered":"2024-09-15T23:58:09.125911+0000","last_clean":"2024-09-15T23:58:09.125911+0000","last_became_active":"2024-09-15T23:58:07.774559+0000","last_became_peered":"2024-09-15T23:58:07.774559+0000","last_unstale":"2024-09-15T23:58:09.125911+0000","last_undegraded":"2024-09-15T23:58:09.125911+0000","last_fullsized":"2024-09-15T23:58:09.125911+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:12.409978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.752582+0000","last_change":"2024-09-15T23:58:06.746347+0000","last_active":"2024-09-15T23:58:06.752582+0000","last_peered":"2024-09-15T23:58:06.752582+0000","last_clean":"2024-09-15T23:58:06.752582+0000","last_became_active":"2024-09-15T23:58:06.742108+0000","last_became_peered":"2024-09-15T23:58:06.742108+0000","last_unstale":"2024-09-15T23:58:06.752582+0000","last_undegraded":"2024-09-15T23:58:06.752582+0000","last_fullsized":"2024-09-15T23:58:06.752582+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:20.013521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129655+0000","last_change":"2024-09-15T23:58:07.766829+0000","last_active":"2024-09-15T23:58:09.129655+0000","last_peered":"2024-09-15T23:58:09.129655+0000","last_clean":"2024-09-15T23:58:09.129655+0000","last_became_active":"2024-09-15T23:58:07.766205+0000","last_became_peered":"2024-09-15T23:58:07.766205+0000","last_unstale":"2024-09-15T23:58:09.129655+0000","last_undegraded":"2024-09-15T23:58:09.129655+0000","last_fullsized":"2024-09-15T23:58:09.129655+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:53.825799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.752630+0000","last_change":"2024-09-15T23:58:06.746464+0000","last_active":"2024-09-15T23:58:06.752630+0000","last_peered":"2024-09-15T23:58:06.752630+0000","last_clean":"2024-09-15T23:58:06.752630+0000","last_became_active":"2024-09-15T23:58:06.741814+0000","last_became_peered":"2024-09-15T23:58:06.741814+0000","last_unstale":"2024-09-15T23:58:06.752630+0000","last_undegraded":"2024-09-15T23:58:06.752630+0000","last_fullsized":"2024-09-15T23:58:06.752630+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:43.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758539+0000","last_change":"2024-09-15T23:58:07.760444+0000","last_active":"2024-09-15T23:58:08.758539+0000","last_peered":"2024-09-15T23:58:08.758539+0000","last_clean":"2024-09-15T23:58:08.758539+0000","last_became_active":"2024-09-15T23:58:07.759706+0000","last_became_peered":"2024-09-15T23:58:07.759706+0000","last_unstale":"2024-09-15T23:58:08.758539+0000","last_undegraded":"2024-09-15T23:58:08.758539+0000","last_fullsized":"2024-09-15T23:58:08.758539+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:36.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128487+0000","last_change":"2024-09-15T23:58:06.738930+0000","last_active":"2024-09-15T23:58:09.128487+0000","last_peered":"2024-09-15T23:58:09.128487+0000","last_clean":"2024-09-15T23:58:09.128487+0000","last_became_active":"2024-09-15T23:58:06.737965+0000","last_became_peered":"2024-09-15T23:58:06.737965+0000","last_unstale":"2024-09-15T23:58:09.128487+0000","last_undegraded":"2024-09-15T23:58:09.128487+0000","last_fullsized":"2024-09-15T23:58:09.128487+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:27.303288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128573+0000","last_change":"2024-09-15T23:58:07.771056+0000","last_active":"2024-09-15T23:58:09.128573+0000","last_peered":"2024-09-15T23:58:09.128573+0000","last_clean":"2024-09-15T23:58:09.128573+0000","last_became_active":"2024-09-15T23:58:07.770335+0000","last_became_peered":"2024-09-15T23:58:07.770335+0000","last_unstale":"2024-09-15T23:58:09.128573+0000","last_undegraded":"2024-09-15T23:58:09.128573+0000","last_fullsized":"2024-09-15T23:58:09.128573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:00.705487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757220+0000","last_change":"2024-09-15T23:58:06.733282+0000","last_active":"2024-09-15T23:58:08.757220+0000","last_peered":"2024-09-15T23:58:08.757220+0000","last_clean":"2024-09-15T23:58:08.757220+0000","last_became_active":"2024-09-15T23:58:06.731829+0000","last_became_peered":"2024-09-15T23:58:06.731829+0000","last_unstale":"2024-09-15T23:58:08.757220+0000","last_undegraded":"2024-09-15T23:58:08.757220+0000","last_fullsized":"2024-09-15T23:58:08.757220+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:37.214555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756733+0000","last_change":"2024-09-15T23:58:07.796182+0000","last_active":"2024-09-15T23:58:08.756733+0000","last_peered":"2024-09-15T23:58:08.756733+0000","last_clean":"2024-09-15T23:58:08.756733+0000","last_became_active":"2024-09-15T23:58:07.783093+0000","last_became_peered":"2024-09-15T23:58:07.783093+0000","last_unstale":"2024-09-15T23:58:08.756733+0000","last_undegraded":"2024-09-15T23:58:08.756733+0000","last_fullsized":"2024-09-15T23:58:08.756733+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:01.714283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129162+0000","last_change":"2024-09-15T23:58:06.736436+0000","last_active":"2024-09-15T23:58:09.129162+0000","last_peered":"2024-09-15T23:58:09.129162+0000","last_clean":"2024-09-15T23:58:09.129162+0000","last_became_active":"2024-09-15T23:58:06.736078+0000","last_became_peered":"2024-09-15T23:58:06.736078+0000","last_unstale":"2024-09-15T23:58:09.129162+0000","last_undegraded":"2024-09-15T23:58:09.129162+0000","last_fullsized":"2024-09-15T23:58:09.129162+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:49.214605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756427+0000","last_change":"2024-09-15T23:58:07.791074+0000","last_active":"2024-09-15T23:58:08.756427+0000","last_peered":"2024-09-15T23:58:08.756427+0000","last_clean":"2024-09-15T23:58:08.756427+0000","last_became_active":"2024-09-15T23:58:07.782975+0000","last_became_peered":"2024-09-15T23:58:07.782975+0000","last_unstale":"2024-09-15T23:58:08.756427+0000","last_undegraded":"2024-09-15T23:58:08.756427+0000","last_fullsized":"2024-09-15T23:58:08.756427+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:22.748219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753553+0000","last_change":"2024-09-15T23:58:06.747357+0000","last_active":"2024-09-15T23:58:06.753553+0000","last_peered":"2024-09-15T23:58:06.753553+0000","last_clean":"2024-09-15T23:58:06.753553+0000","last_became_active":"2024-09-15T23:58:06.746786+0000","last_became_peered":"2024-09-15T23:58:06.746786+0000","last_unstale":"2024-09-15T23:58:06.753553+0000","last_undegraded":"2024-09-15T23:58:06.753553+0000","last_fullsized":"2024-09-15T23:58:06.753553+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:16.498783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791793+0000","last_change":"2024-09-15T23:58:07.781892+0000","last_active":"2024-09-15T23:58:08.791793+0000","last_peered":"2024-09-15T23:58:08.791793+0000","last_clean":"2024-09-15T23:58:08.791793+0000","last_became_active":"2024-09-15T23:58:07.781560+0000","last_became_peered":"2024-09-15T23:58:07.781560+0000","last_unstale":"2024-09-15T23:58:08.791793+0000","last_undegraded":"2024-09-15T23:58:08.791793+0000","last_fullsized":"2024-09-15T23:58:08.791793+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:38.958811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128120+0000","last_change":"2024-09-15T23:58:06.734272+0000","last_active":"2024-09-15T23:58:09.128120+0000","last_peered":"2024-09-15T23:58:09.128120+0000","last_clean":"2024-09-15T23:58:09.128120+0000","last_became_active":"2024-09-15T23:58:06.734020+0000","last_became_peered":"2024-09-15T23:58:06.734020+0000","last_unstale":"2024-09-15T23:58:09.128120+0000","last_undegraded":"2024-09-15T23:58:09.128120+0000","last_fullsized":"2024-09-15T23:58:09.128120+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:30.329573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753804+0000","last_change":"2024-09-15T23:58:07.772545+0000","last_active":"2024-09-15T23:58:08.753804+0000","last_peered":"2024-09-15T23:58:08.753804+0000","last_clean":"2024-09-15T23:58:08.753804+0000","last_became_active":"2024-09-15T23:58:07.772139+0000","last_became_peered":"2024-09-15T23:58:07.772139+0000","last_unstale":"2024-09-15T23:58:08.753804+0000","last_undegraded":"2024-09-15T23:58:08.753804+0000","last_fullsized":"2024-09-15T23:58:08.753804+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:01.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753650+0000","last_change":"2024-09-15T23:58:06.748574+0000","last_active":"2024-09-15T23:58:06.753650+0000","last_peered":"2024-09-15T23:58:06.753650+0000","last_clean":"2024-09-15T23:58:06.753650+0000","last_became_active":"2024-09-15T23:58:06.740503+0000","last_became_peered":"2024-09-15T23:58:06.740503+0000","last_unstale":"2024-09-15T23:58:06.753650+0000","last_undegraded":"2024-09-15T23:58:06.753650+0000","last_fullsized":"2024-09-15T23:58:06.753650+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:59.706046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791109+0000","last_change":"2024-09-15T23:58:07.778092+0000","last_active":"2024-09-15T23:58:08.791109+0000","last_peered":"2024-09-15T23:58:08.791109+0000","last_clean":"2024-09-15T23:58:08.791109+0000","last_became_active":"2024-09-15T23:58:07.775739+0000","last_became_peered":"2024-09-15T23:58:07.775739+0000","last_unstale":"2024-09-15T23:58:08.791109+0000","last_undegraded":"2024-09-15T23:58:08.791109+0000","last_fullsized":"2024-09-15T23:58:08.791109+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:22:00.044070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756867+0000","last_change":"2024-09-15T23:58:06.737213+0000","last_active":"2024-09-15T23:58:08.756867+0000","last_peered":"2024-09-15T23:58:08.756867+0000","last_clean":"2024-09-15T23:58:08.756867+0000","last_became_active":"2024-09-15T23:58:06.736308+0000","last_became_peered":"2024-09-15T23:58:06.736308+0000","last_unstale":"2024-09-15T23:58:08.756867+0000","last_undegraded":"2024-09-15T23:58:08.756867+0000","last_fullsized":"2024-09-15T23:58:08.756867+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:53.980679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":309,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128100+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:58:09.128100+0000","last_peered":"2024-09-15T23:58:09.128100+0000","last_clean":"2024-09-15T23:58:09.128100+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:58:09.128100+0000","last_undegraded":"2024-09-15T23:58:09.128100+0000","last_fullsized":"2024-09-15T23:58:09.128100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1191936,"data_stored":540950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1196032,"data_stored":541910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":547024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36520,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335320,"statfs":{"total":96636764160,"available":96599367680,"internally_reserved":0,"allocated":1196032,"data_stored":541910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1204224,"data_stored":547102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1130758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":547572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37068,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334772,"statfs":{"total":96636764160,"available":96598806528,"internally_reserved":0,"allocated":1753088,"data_stored":1116832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:58:11.761 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:58:11.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.905+0000 7f5533fff640 1 Processor -- start 2024-09-15T23:58:11.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f5533fff640 1 -- start start 2024-09-15T23:58:11.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f5533fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f553413de60 0x7f553415f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f5533fff640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5534072140 con 0x7f5534073540 2024-09-15T23:58:11.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f5533fff640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55340cec10 con 0x7f5534071ba0 2024-09-15T23:58:11.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f5533fff640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f55340cf260 con 0x7f553413de60 2024-09-15T23:58:11.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f5532ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f553413de60 0x7f553415f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:11.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f55337fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5534073540 0x7f5534073950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58658/0 (socket says 172.21.15.112:58658) 2024-09-15T23:58:11.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f55337fe640 1 -- 172.21.15.112:0/939405857 learned_addr learned my addr 172.21.15.112:0/939405857 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:11.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f5532ffd640 1 -- 172.21.15.112:0/939405857 >> v1:172.21.15.169:6789/0 conn(0x7f5534071ba0 legacy=0x7f55340cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:11.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f5532ffd640 1 -- 172.21.15.112:0/939405857 >> v1:172.21.15.112:6789/0 conn(0x7f5534073540 legacy=0x7f5534073950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f5532ffd640 1 -- 172.21.15.112:0/939405857 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55340ceef0 con 0x7f553413de60 2024-09-15T23:58:11.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f5532ffd640 1 --2- 172.21.15.112:0/939405857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f553413de60 0x7f553415f330 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f55340cf3e0 tx=0x7f552401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c443a9365b28e56a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:11.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f5531ffb640 1 -- 172.21.15.112:0/939405857 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55240b2070 con 0x7f553413de60 2024-09-15T23:58:11.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f5531ffb640 1 -- 172.21.15.112:0/939405857 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55240a58e0 con 0x7f553413de60 2024-09-15T23:58:11.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.909+0000 7f5531ffb640 1 -- 172.21.15.112:0/939405857 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55240a5cb0 con 0x7f553413de60 2024-09-15T23:58:11.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 -- 172.21.15.112:0/939405857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f553413de60 msgr2=0x7f553415f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 --2- 172.21.15.112:0/939405857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f553413de60 0x7f553415f330 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f55340cf3e0 tx=0x7f552401c910 comp rx=0 tx=0).stop 2024-09-15T23:58:11.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 -- 172.21.15.112:0/939405857 shutdown_connections 2024-09-15T23:58:11.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 --2- 172.21.15.112:0/939405857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f553413de60 0x7f553415f330 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 -- 172.21.15.112:0/939405857 >> 172.21.15.112:0/939405857 conn(0x7f55340b1bf0 msgr2=0x7f55340b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:11.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 -- 172.21.15.112:0/939405857 shutdown_connections 2024-09-15T23:58:11.914 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 -- 172.21.15.112:0/939405857 wait complete. 2024-09-15T23:58:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 Processor -- start 2024-09-15T23:58:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 -- start start 2024-09-15T23:58:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5534071ba0 0x7f553415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5534073540 0x7f553415df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f553413de60 0x7f55341407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f553413f1e0 con 0x7f5534071ba0 2024-09-15T23:58:11.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f553413f060 con 0x7f5534073540 2024-09-15T23:58:11.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5534168ac0 con 0x7f553413de60 2024-09-15T23:58:11.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5532ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5534071ba0 0x7f553415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:11.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5532ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5534071ba0 0x7f553415a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59802/0 (socket says 172.21.15.112:59802) 2024-09-15T23:58:11.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5532ffd640 1 -- 172.21.15.112:0/1243103346 learned_addr learned my addr 172.21.15.112:0/1243103346 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:11.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5532ffd640 1 -- 172.21.15.112:0/1243103346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f553413de60 msgr2=0x7f55341407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5532ffd640 1 --2- 172.21.15.112:0/1243103346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f553413de60 0x7f55341407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5532ffd640 1 -- 172.21.15.112:0/1243103346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5534073540 msgr2=0x7f553415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:11.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5532ffd640 1 --2- 172.21.15.112:0/1243103346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5534073540 0x7f553415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:11.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5532ffd640 1 -- 172.21.15.112:0/1243103346 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553413f740 con 0x7f5534071ba0 2024-09-15T23:58:11.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5532ffd640 1 --2- 172.21.15.112:0/1243103346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5534071ba0 0x7f553415a3c0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f55240b0040 tx=0x7f55240196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:11.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f551bfff640 1 -- 172.21.15.112:0/1243103346 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55240b2050 con 0x7f5534071ba0 2024-09-15T23:58:11.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f551bfff640 1 -- 172.21.15.112:0/1243103346 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55240be070 con 0x7f5534071ba0 2024-09-15T23:58:11.920 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f551bfff640 1 -- 172.21.15.112:0/1243103346 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55240adab0 con 0x7f5534071ba0 2024-09-15T23:58:11.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 -- 172.21.15.112:0/1243103346 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553413fa20 con 0x7f5534071ba0 2024-09-15T23:58:11.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.913+0000 7f5533fff640 1 -- 172.21.15.112:0/1243103346 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553413ffe0 con 0x7f5534071ba0 2024-09-15T23:58:11.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.917+0000 7f5533fff640 1 -- 172.21.15.112:0/1243103346 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f553415f330 con 0x7f5534071ba0 2024-09-15T23:58:11.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.917+0000 7f551bfff640 1 -- 172.21.15.112:0/1243103346 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f55240adc50 con 0x7f5534071ba0 2024-09-15T23:58:11.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.917+0000 7f551bfff640 1 --2- 172.21.15.112:0/1243103346 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f55200678c0 0x7f5520069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:11.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.917+0000 7f551bfff640 1 -- 172.21.15.112:0/1243103346 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f55241210e0 con 0x7f5534071ba0 2024-09-15T23:58:11.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.917+0000 7f55327fc640 1 --2- 172.21.15.112:0/1243103346 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f55200678c0 0x7f5520069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:11.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.917+0000 7f55327fc640 1 --2- 172.21.15.112:0/1243103346 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f55200678c0 0x7f5520069d80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f553415acd0 tx=0x7f55280079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:11.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:11.921+0000 7f551bfff640 1 -- 172.21.15.112:0/1243103346 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5524016500 con 0x7f5534071ba0 2024-09-15T23:58:12.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.065+0000 7f5533fff640 1 -- 172.21.15.112:0/1243103346 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5534073040 con 0x7f55200678c0 2024-09-15T23:58:12.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.073+0000 7f551bfff640 1 -- 172.21.15.112:0/1243103346 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251666 (secure 0 0 0) 0x7f5534073040 con 0x7f55200678c0 2024-09-15T23:58:12.075 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:12.076 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:58:12.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.077+0000 7f5533fff640 1 -- 172.21.15.112:0/1243103346 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f55200678c0 msgr2=0x7f5520069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.077+0000 7f5533fff640 1 --2- 172.21.15.112:0/1243103346 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f55200678c0 0x7f5520069d80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f553415acd0 tx=0x7f55280079c0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.077+0000 7f5533fff640 1 -- 172.21.15.112:0/1243103346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5534071ba0 msgr2=0x7f553415a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.077+0000 7f5533fff640 1 --2- 172.21.15.112:0/1243103346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5534071ba0 0x7f553415a3c0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f55240b0040 tx=0x7f55240196b0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.077+0000 7f5533fff640 1 -- 172.21.15.112:0/1243103346 shutdown_connections 2024-09-15T23:58:12.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.077+0000 7f5533fff640 1 --2- 172.21.15.112:0/1243103346 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f55200678c0 0x7f5520069d80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.077+0000 7f5533fff640 1 --2- 172.21.15.112:0/1243103346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f553413de60 0x7f55341407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.077+0000 7f5533fff640 1 --2- 172.21.15.112:0/1243103346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5534073540 0x7f553415df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.077+0000 7f5533fff640 1 --2- 172.21.15.112:0/1243103346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5534071ba0 0x7f553415a3c0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.077+0000 7f5533fff640 1 -- 172.21.15.112:0/1243103346 >> 172.21.15.112:0/1243103346 conn(0x7f55340b1bf0 msgr2=0x7f5534143690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:12.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.077+0000 7f5533fff640 1 -- 172.21.15.112:0/1243103346 shutdown_connections 2024-09-15T23:58:12.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.077+0000 7f5533fff640 1 -- 172.21.15.112:0/1243103346 wait complete. 2024-09-15T23:58:12.091 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-15T23:58:11.313780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":268328,"kb_used_data":10476,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754706392,"statfs":{"total":773094113280,"available":772819345408,"internally_reserved":0,"allocated":10727424,"data_stored":5514058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.614632"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757324+0000","last_change":"2024-09-15T23:58:07.765376+0000","last_active":"2024-09-15T23:58:08.757324+0000","last_peered":"2024-09-15T23:58:08.757324+0000","last_clean":"2024-09-15T23:58:08.757324+0000","last_became_active":"2024-09-15T23:58:07.764634+0000","last_became_peered":"2024-09-15T23:58:07.764634+0000","last_unstale":"2024-09-15T23:58:08.757324+0000","last_undegraded":"2024-09-15T23:58:08.757324+0000","last_fullsized":"2024-09-15T23:58:08.757324+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:17.697740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753334+0000","last_change":"2024-09-15T23:58:07.773180+0000","last_active":"2024-09-15T23:58:08.753334+0000","last_peered":"2024-09-15T23:58:08.753334+0000","last_clean":"2024-09-15T23:58:08.753334+0000","last_became_active":"2024-09-15T23:58:07.772756+0000","last_became_peered":"2024-09-15T23:58:07.772756+0000","last_unstale":"2024-09-15T23:58:08.753334+0000","last_undegraded":"2024-09-15T23:58:08.753334+0000","last_fullsized":"2024-09-15T23:58:08.753334+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:25.286230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.722018+0000","last_change":"2024-09-15T23:58:06.722018+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.722018+0000","last_undegraded":"2024-09-15T23:58:06.722018+0000","last_fullsized":"2024-09-15T23:58:06.722018+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756033+0000","last_change":"2024-09-15T23:58:07.792209+0000","last_active":"2024-09-15T23:58:08.756033+0000","last_peered":"2024-09-15T23:58:08.756033+0000","last_clean":"2024-09-15T23:58:08.756033+0000","last_became_active":"2024-09-15T23:58:07.783955+0000","last_became_peered":"2024-09-15T23:58:07.783955+0000","last_unstale":"2024-09-15T23:58:08.756033+0000","last_undegraded":"2024-09-15T23:58:08.756033+0000","last_fullsized":"2024-09-15T23:58:08.756033+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:01.050859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756642+0000","last_change":"2024-09-15T23:58:07.766302+0000","last_active":"2024-09-15T23:58:08.756642+0000","last_peered":"2024-09-15T23:58:08.756642+0000","last_clean":"2024-09-15T23:58:08.756642+0000","last_became_active":"2024-09-15T23:58:07.765484+0000","last_became_peered":"2024-09-15T23:58:07.765484+0000","last_unstale":"2024-09-15T23:58:08.756642+0000","last_undegraded":"2024-09-15T23:58:08.756642+0000","last_fullsized":"2024-09-15T23:58:08.756642+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:35.296757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791365+0000","last_change":"2024-09-15T23:58:07.780199+0000","last_active":"2024-09-15T23:58:08.791365+0000","last_peered":"2024-09-15T23:58:08.791365+0000","last_clean":"2024-09-15T23:58:08.791365+0000","last_became_active":"2024-09-15T23:58:07.779937+0000","last_became_peered":"2024-09-15T23:58:07.779937+0000","last_unstale":"2024-09-15T23:58:08.791365+0000","last_undegraded":"2024-09-15T23:58:08.791365+0000","last_fullsized":"2024-09-15T23:58:08.791365+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:34.415985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.790898+0000","last_change":"2024-09-15T23:58:07.779584+0000","last_active":"2024-09-15T23:58:08.790898+0000","last_peered":"2024-09-15T23:58:08.790898+0000","last_clean":"2024-09-15T23:58:08.790898+0000","last_became_active":"2024-09-15T23:58:07.776328+0000","last_became_peered":"2024-09-15T23:58:07.776328+0000","last_unstale":"2024-09-15T23:58:08.790898+0000","last_undegraded":"2024-09-15T23:58:08.790898+0000","last_fullsized":"2024-09-15T23:58:08.790898+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:20.154190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757373+0000","last_change":"2024-09-15T23:58:07.759525+0000","last_active":"2024-09-15T23:58:08.757373+0000","last_peered":"2024-09-15T23:58:08.757373+0000","last_clean":"2024-09-15T23:58:08.757373+0000","last_became_active":"2024-09-15T23:58:07.759015+0000","last_became_peered":"2024-09-15T23:58:07.759015+0000","last_unstale":"2024-09-15T23:58:08.757373+0000","last_undegraded":"2024-09-15T23:58:08.757373+0000","last_fullsized":"2024-09-15T23:58:08.757373+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:38.225855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753896+0000","last_change":"2024-09-15T23:58:07.800146+0000","last_active":"2024-09-15T23:58:08.753896+0000","last_peered":"2024-09-15T23:58:08.753896+0000","last_clean":"2024-09-15T23:58:08.753896+0000","last_became_active":"2024-09-15T23:58:07.799851+0000","last_became_peered":"2024-09-15T23:58:07.799851+0000","last_unstale":"2024-09-15T23:58:08.753896+0000","last_undegraded":"2024-09-15T23:58:08.753896+0000","last_fullsized":"2024-09-15T23:58:08.753896+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:36.707754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758499+0000","last_change":"2024-09-15T23:58:07.753670+0000","last_active":"2024-09-15T23:58:08.758499+0000","last_peered":"2024-09-15T23:58:08.758499+0000","last_clean":"2024-09-15T23:58:08.758499+0000","last_became_active":"2024-09-15T23:58:07.752863+0000","last_became_peered":"2024-09-15T23:58:07.752863+0000","last_unstale":"2024-09-15T23:58:08.758499+0000","last_undegraded":"2024-09-15T23:58:08.758499+0000","last_fullsized":"2024-09-15T23:58:08.758499+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:53.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128244+0000","last_change":"2024-09-15T23:58:07.773082+0000","last_active":"2024-09-15T23:58:09.128244+0000","last_peered":"2024-09-15T23:58:09.128244+0000","last_clean":"2024-09-15T23:58:09.128244+0000","last_became_active":"2024-09-15T23:58:07.768580+0000","last_became_peered":"2024-09-15T23:58:07.768580+0000","last_unstale":"2024-09-15T23:58:09.128244+0000","last_undegraded":"2024-09-15T23:58:09.128244+0000","last_fullsized":"2024-09-15T23:58:09.128244+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:55.098428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791187+0000","last_change":"2024-09-15T23:58:07.779856+0000","last_active":"2024-09-15T23:58:08.791187+0000","last_peered":"2024-09-15T23:58:08.791187+0000","last_clean":"2024-09-15T23:58:08.791187+0000","last_became_active":"2024-09-15T23:58:07.779553+0000","last_became_peered":"2024-09-15T23:58:07.779553+0000","last_unstale":"2024-09-15T23:58:08.791187+0000","last_undegraded":"2024-09-15T23:58:08.791187+0000","last_fullsized":"2024-09-15T23:58:08.791187+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:45.241169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.755836+0000","last_change":"2024-09-15T23:58:07.796750+0000","last_active":"2024-09-15T23:58:08.755836+0000","last_peered":"2024-09-15T23:58:08.755836+0000","last_clean":"2024-09-15T23:58:08.755836+0000","last_became_active":"2024-09-15T23:58:07.792310+0000","last_became_peered":"2024-09-15T23:58:07.792310+0000","last_unstale":"2024-09-15T23:58:08.755836+0000","last_undegraded":"2024-09-15T23:58:08.755836+0000","last_fullsized":"2024-09-15T23:58:08.755836+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:20.742739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791283+0000","last_change":"2024-09-15T23:58:07.776737+0000","last_active":"2024-09-15T23:58:08.791283+0000","last_peered":"2024-09-15T23:58:08.791283+0000","last_clean":"2024-09-15T23:58:08.791283+0000","last_became_active":"2024-09-15T23:58:07.776475+0000","last_became_peered":"2024-09-15T23:58:07.776475+0000","last_unstale":"2024-09-15T23:58:08.791283+0000","last_undegraded":"2024-09-15T23:58:08.791283+0000","last_fullsized":"2024-09-15T23:58:08.791283+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:58.182086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.752647+0000","last_change":"2024-09-15T23:58:07.789278+0000","last_active":"2024-09-15T23:58:08.752647+0000","last_peered":"2024-09-15T23:58:08.752647+0000","last_clean":"2024-09-15T23:58:08.752647+0000","last_became_active":"2024-09-15T23:58:07.788374+0000","last_became_peered":"2024-09-15T23:58:07.788374+0000","last_unstale":"2024-09-15T23:58:08.752647+0000","last_undegraded":"2024-09-15T23:58:08.752647+0000","last_fullsized":"2024-09-15T23:58:08.752647+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:10.386941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.127573+0000","last_change":"2024-09-15T23:58:07.777214+0000","last_active":"2024-09-15T23:58:09.127573+0000","last_peered":"2024-09-15T23:58:09.127573+0000","last_clean":"2024-09-15T23:58:09.127573+0000","last_became_active":"2024-09-15T23:58:07.776537+0000","last_became_peered":"2024-09-15T23:58:07.776537+0000","last_unstale":"2024-09-15T23:58:09.127573+0000","last_undegraded":"2024-09-15T23:58:09.127573+0000","last_fullsized":"2024-09-15T23:58:09.127573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:38.958811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.727455+0000","last_change":"2024-09-15T23:58:06.727455+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.727455+0000","last_undegraded":"2024-09-15T23:58:06.727455+0000","last_fullsized":"2024-09-15T23:58:06.727455+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753613+0000","last_change":"2024-09-15T23:58:07.773809+0000","last_active":"2024-09-15T23:58:08.753613+0000","last_peered":"2024-09-15T23:58:08.753613+0000","last_clean":"2024-09-15T23:58:08.753613+0000","last_became_active":"2024-09-15T23:58:07.773013+0000","last_became_peered":"2024-09-15T23:58:07.773013+0000","last_unstale":"2024-09-15T23:58:08.753613+0000","last_undegraded":"2024-09-15T23:58:08.753613+0000","last_fullsized":"2024-09-15T23:58:08.753613+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:35.110846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756318+0000","last_change":"2024-09-15T23:58:07.797639+0000","last_active":"2024-09-15T23:58:08.756318+0000","last_peered":"2024-09-15T23:58:08.756318+0000","last_clean":"2024-09-15T23:58:08.756318+0000","last_became_active":"2024-09-15T23:58:07.796983+0000","last_became_peered":"2024-09-15T23:58:07.796983+0000","last_unstale":"2024-09-15T23:58:08.756318+0000","last_undegraded":"2024-09-15T23:58:08.756318+0000","last_fullsized":"2024-09-15T23:58:08.756318+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:34.778205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128194+0000","last_change":"2024-09-15T23:58:07.762602+0000","last_active":"2024-09-15T23:58:09.128194+0000","last_peered":"2024-09-15T23:58:09.128194+0000","last_clean":"2024-09-15T23:58:09.128194+0000","last_became_active":"2024-09-15T23:58:07.761868+0000","last_became_peered":"2024-09-15T23:58:07.761868+0000","last_unstale":"2024-09-15T23:58:09.128194+0000","last_undegraded":"2024-09-15T23:58:09.128194+0000","last_fullsized":"2024-09-15T23:58:09.128194+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:38.225855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.726154+0000","last_change":"2024-09-15T23:58:06.726154+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.726154+0000","last_undegraded":"2024-09-15T23:58:06.726154+0000","last_fullsized":"2024-09-15T23:58:06.726154+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126816+0000","last_change":"2024-09-15T23:58:07.782785+0000","last_active":"2024-09-15T23:58:09.126816+0000","last_peered":"2024-09-15T23:58:09.126816+0000","last_clean":"2024-09-15T23:58:09.126816+0000","last_became_active":"2024-09-15T23:58:07.782088+0000","last_became_peered":"2024-09-15T23:58:07.782088+0000","last_unstale":"2024-09-15T23:58:09.126816+0000","last_undegraded":"2024-09-15T23:58:09.126816+0000","last_fullsized":"2024-09-15T23:58:09.126816+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:21.579619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758736+0000","last_change":"2024-09-15T23:58:07.778120+0000","last_active":"2024-09-15T23:58:08.758736+0000","last_peered":"2024-09-15T23:58:08.758736+0000","last_clean":"2024-09-15T23:58:08.758736+0000","last_became_active":"2024-09-15T23:58:07.777366+0000","last_became_peered":"2024-09-15T23:58:07.777366+0000","last_unstale":"2024-09-15T23:58:08.758736+0000","last_undegraded":"2024-09-15T23:58:08.758736+0000","last_fullsized":"2024-09-15T23:58:08.758736+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:28.979657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757763+0000","last_change":"2024-09-15T23:58:07.768580+0000","last_active":"2024-09-15T23:58:08.757763+0000","last_peered":"2024-09-15T23:58:08.757763+0000","last_clean":"2024-09-15T23:58:08.757763+0000","last_became_active":"2024-09-15T23:58:07.768022+0000","last_became_peered":"2024-09-15T23:58:07.768022+0000","last_unstale":"2024-09-15T23:58:08.757763+0000","last_undegraded":"2024-09-15T23:58:08.757763+0000","last_fullsized":"2024-09-15T23:58:08.757763+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:00.705487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129489+0000","last_change":"2024-09-15T23:58:07.796575+0000","last_active":"2024-09-15T23:58:09.129489+0000","last_peered":"2024-09-15T23:58:09.129489+0000","last_clean":"2024-09-15T23:58:09.129489+0000","last_became_active":"2024-09-15T23:58:07.788327+0000","last_became_peered":"2024-09-15T23:58:07.788327+0000","last_unstale":"2024-09-15T23:58:09.129489+0000","last_undegraded":"2024-09-15T23:58:09.129489+0000","last_fullsized":"2024-09-15T23:58:09.129489+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:28.979657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129311+0000","last_change":"2024-09-15T23:58:07.796461+0000","last_active":"2024-09-15T23:58:09.129311+0000","last_peered":"2024-09-15T23:58:09.129311+0000","last_clean":"2024-09-15T23:58:09.129311+0000","last_became_active":"2024-09-15T23:58:07.796172+0000","last_became_peered":"2024-09-15T23:58:07.796172+0000","last_unstale":"2024-09-15T23:58:09.129311+0000","last_undegraded":"2024-09-15T23:58:09.129311+0000","last_fullsized":"2024-09-15T23:58:09.129311+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:26.451417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129132+0000","last_change":"2024-09-15T23:58:07.779754+0000","last_active":"2024-09-15T23:58:09.129132+0000","last_peered":"2024-09-15T23:58:09.129132+0000","last_clean":"2024-09-15T23:58:09.129132+0000","last_became_active":"2024-09-15T23:58:07.779070+0000","last_became_peered":"2024-09-15T23:58:07.779070+0000","last_unstale":"2024-09-15T23:58:09.129132+0000","last_undegraded":"2024-09-15T23:58:09.129132+0000","last_fullsized":"2024-09-15T23:58:09.129132+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:53.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791414+0000","last_change":"2024-09-15T23:58:07.781973+0000","last_active":"2024-09-15T23:58:08.791414+0000","last_peered":"2024-09-15T23:58:08.791414+0000","last_clean":"2024-09-15T23:58:08.791414+0000","last_became_active":"2024-09-15T23:58:07.781646+0000","last_became_peered":"2024-09-15T23:58:07.781646+0000","last_unstale":"2024-09-15T23:58:08.791414+0000","last_undegraded":"2024-09-15T23:58:08.791414+0000","last_fullsized":"2024-09-15T23:58:08.791414+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:54.991980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758938+0000","last_change":"2024-09-15T23:58:07.780326+0000","last_active":"2024-09-15T23:58:08.758938+0000","last_peered":"2024-09-15T23:58:08.758938+0000","last_clean":"2024-09-15T23:58:08.758938+0000","last_became_active":"2024-09-15T23:58:07.779866+0000","last_became_peered":"2024-09-15T23:58:07.779866+0000","last_unstale":"2024-09-15T23:58:08.758938+0000","last_undegraded":"2024-09-15T23:58:08.758938+0000","last_fullsized":"2024-09-15T23:58:08.758938+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:32.670128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129254+0000","last_change":"2024-09-15T23:58:07.772116+0000","last_active":"2024-09-15T23:58:09.129254+0000","last_peered":"2024-09-15T23:58:09.129254+0000","last_clean":"2024-09-15T23:58:09.129254+0000","last_became_active":"2024-09-15T23:58:07.771400+0000","last_became_peered":"2024-09-15T23:58:07.771400+0000","last_unstale":"2024-09-15T23:58:09.129254+0000","last_undegraded":"2024-09-15T23:58:09.129254+0000","last_fullsized":"2024-09-15T23:58:09.129254+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:53.111663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791001+0000","last_change":"2024-09-15T23:58:07.780570+0000","last_active":"2024-09-15T23:58:08.791001+0000","last_peered":"2024-09-15T23:58:08.791001+0000","last_clean":"2024-09-15T23:58:08.791001+0000","last_became_active":"2024-09-15T23:58:07.779637+0000","last_became_peered":"2024-09-15T23:58:07.779637+0000","last_unstale":"2024-09-15T23:58:08.791001+0000","last_undegraded":"2024-09-15T23:58:08.791001+0000","last_fullsized":"2024-09-15T23:58:08.791001+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:04.943802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.125806+0000","last_change":"2024-09-15T23:58:07.767211+0000","last_active":"2024-09-15T23:58:09.125806+0000","last_peered":"2024-09-15T23:58:09.125806+0000","last_clean":"2024-09-15T23:58:09.125806+0000","last_became_active":"2024-09-15T23:58:07.766427+0000","last_became_peered":"2024-09-15T23:58:07.766427+0000","last_unstale":"2024-09-15T23:58:09.125806+0000","last_undegraded":"2024-09-15T23:58:09.125806+0000","last_fullsized":"2024-09-15T23:58:09.125806+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:10.506341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.720275+0000","last_change":"2024-09-15T23:58:06.720275+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.720275+0000","last_undegraded":"2024-09-15T23:58:06.720275+0000","last_fullsized":"2024-09-15T23:58:06.720275+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1f","version":"96'4","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126760+0000","last_change":"2024-09-15T23:58:06.737380+0000","last_active":"2024-09-15T23:58:09.126760+0000","last_peered":"2024-09-15T23:58:09.126760+0000","last_clean":"2024-09-15T23:58:09.126760+0000","last_became_active":"2024-09-15T23:58:06.736527+0000","last_became_peered":"2024-09-15T23:58:06.736527+0000","last_unstale":"2024-09-15T23:58:09.126760+0000","last_undegraded":"2024-09-15T23:58:09.126760+0000","last_fullsized":"2024-09-15T23:58:09.126760+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:42.645715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758832+0000","last_change":"2024-09-15T23:58:07.776944+0000","last_active":"2024-09-15T23:58:08.758832+0000","last_peered":"2024-09-15T23:58:08.758832+0000","last_clean":"2024-09-15T23:58:08.758832+0000","last_became_active":"2024-09-15T23:58:07.776174+0000","last_became_peered":"2024-09-15T23:58:07.776174+0000","last_unstale":"2024-09-15T23:58:08.758832+0000","last_undegraded":"2024-09-15T23:58:08.758832+0000","last_fullsized":"2024-09-15T23:58:08.758832+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:51.731861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753413+0000","last_change":"2024-09-15T23:58:06.747179+0000","last_active":"2024-09-15T23:58:06.753413+0000","last_peered":"2024-09-15T23:58:06.753413+0000","last_clean":"2024-09-15T23:58:06.753413+0000","last_became_active":"2024-09-15T23:58:06.746346+0000","last_became_peered":"2024-09-15T23:58:06.746346+0000","last_unstale":"2024-09-15T23:58:06.753413+0000","last_undegraded":"2024-09-15T23:58:06.753413+0000","last_fullsized":"2024-09-15T23:58:06.753413+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:39.718082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.752931+0000","last_change":"2024-09-15T23:58:07.755258+0000","last_active":"2024-09-15T23:58:08.752931+0000","last_peered":"2024-09-15T23:58:08.752931+0000","last_clean":"2024-09-15T23:58:08.752931+0000","last_became_active":"2024-09-15T23:58:07.754455+0000","last_became_peered":"2024-09-15T23:58:07.754455+0000","last_unstale":"2024-09-15T23:58:08.752931+0000","last_undegraded":"2024-09-15T23:58:08.752931+0000","last_fullsized":"2024-09-15T23:58:08.752931+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:07.269079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753420+0000","last_change":"2024-09-15T23:58:06.739251+0000","last_active":"2024-09-15T23:58:08.753420+0000","last_peered":"2024-09-15T23:58:08.753420+0000","last_clean":"2024-09-15T23:58:08.753420+0000","last_became_active":"2024-09-15T23:58:06.738972+0000","last_became_peered":"2024-09-15T23:58:06.738972+0000","last_unstale":"2024-09-15T23:58:08.753420+0000","last_undegraded":"2024-09-15T23:58:08.753420+0000","last_fullsized":"2024-09-15T23:58:08.753420+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:15.435941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128549+0000","last_change":"2024-09-15T23:58:07.783162+0000","last_active":"2024-09-15T23:58:09.128549+0000","last_peered":"2024-09-15T23:58:09.128549+0000","last_clean":"2024-09-15T23:58:09.128549+0000","last_became_active":"2024-09-15T23:58:07.782870+0000","last_became_peered":"2024-09-15T23:58:07.782870+0000","last_unstale":"2024-09-15T23:58:09.128549+0000","last_undegraded":"2024-09-15T23:58:09.128549+0000","last_fullsized":"2024-09-15T23:58:09.128549+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:54.734314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758412+0000","last_change":"2024-09-15T23:58:06.724258+0000","last_active":"2024-09-15T23:58:08.758412+0000","last_peered":"2024-09-15T23:58:08.758412+0000","last_clean":"2024-09-15T23:58:08.758412+0000","last_became_active":"2024-09-15T23:58:06.723572+0000","last_became_peered":"2024-09-15T23:58:06.723572+0000","last_unstale":"2024-09-15T23:58:08.758412+0000","last_undegraded":"2024-09-15T23:58:08.758412+0000","last_fullsized":"2024-09-15T23:58:08.758412+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:08.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756965+0000","last_change":"2024-09-15T23:58:07.784732+0000","last_active":"2024-09-15T23:58:08.756965+0000","last_peered":"2024-09-15T23:58:08.756965+0000","last_clean":"2024-09-15T23:58:08.756965+0000","last_became_active":"2024-09-15T23:58:07.782292+0000","last_became_peered":"2024-09-15T23:58:07.782292+0000","last_unstale":"2024-09-15T23:58:08.756965+0000","last_undegraded":"2024-09-15T23:58:08.756965+0000","last_fullsized":"2024-09-15T23:58:08.756965+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:33.544108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1b","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128878+0000","last_change":"2024-09-15T23:58:06.735612+0000","last_active":"2024-09-15T23:58:09.128878+0000","last_peered":"2024-09-15T23:58:09.128878+0000","last_clean":"2024-09-15T23:58:09.128878+0000","last_became_active":"2024-09-15T23:58:06.735170+0000","last_became_peered":"2024-09-15T23:58:06.735170+0000","last_unstale":"2024-09-15T23:58:09.128878+0000","last_undegraded":"2024-09-15T23:58:09.128878+0000","last_fullsized":"2024-09-15T23:58:09.128878+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:43.931563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756768+0000","last_change":"2024-09-15T23:58:07.765505+0000","last_active":"2024-09-15T23:58:08.756768+0000","last_peered":"2024-09-15T23:58:08.756768+0000","last_clean":"2024-09-15T23:58:08.756768+0000","last_became_active":"2024-09-15T23:58:07.764711+0000","last_became_peered":"2024-09-15T23:58:07.764711+0000","last_unstale":"2024-09-15T23:58:08.756768+0000","last_undegraded":"2024-09-15T23:58:08.756768+0000","last_fullsized":"2024-09-15T23:58:08.756768+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:39.153021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129582+0000","last_change":"2024-09-15T23:58:06.736878+0000","last_active":"2024-09-15T23:58:09.129582+0000","last_peered":"2024-09-15T23:58:09.129582+0000","last_clean":"2024-09-15T23:58:09.129582+0000","last_became_active":"2024-09-15T23:58:06.736545+0000","last_became_peered":"2024-09-15T23:58:06.736545+0000","last_unstale":"2024-09-15T23:58:09.129582+0000","last_undegraded":"2024-09-15T23:58:09.129582+0000","last_fullsized":"2024-09-15T23:58:09.129582+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:06.203702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129816+0000","last_change":"2024-09-15T23:58:07.764136+0000","last_active":"2024-09-15T23:58:09.129816+0000","last_peered":"2024-09-15T23:58:09.129816+0000","last_clean":"2024-09-15T23:58:09.129816+0000","last_became_active":"2024-09-15T23:58:07.762035+0000","last_became_peered":"2024-09-15T23:58:07.762035+0000","last_unstale":"2024-09-15T23:58:09.129816+0000","last_undegraded":"2024-09-15T23:58:09.129816+0000","last_fullsized":"2024-09-15T23:58:09.129816+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:13.530423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128008+0000","last_change":"2024-09-15T23:58:06.737494+0000","last_active":"2024-09-15T23:58:09.128008+0000","last_peered":"2024-09-15T23:58:09.128008+0000","last_clean":"2024-09-15T23:58:09.128008+0000","last_became_active":"2024-09-15T23:58:06.736714+0000","last_became_peered":"2024-09-15T23:58:06.736714+0000","last_unstale":"2024-09-15T23:58:09.128008+0000","last_undegraded":"2024-09-15T23:58:09.128008+0000","last_fullsized":"2024-09-15T23:58:09.128008+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.690650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757533+0000","last_change":"2024-09-15T23:58:07.770649+0000","last_active":"2024-09-15T23:58:08.757533+0000","last_peered":"2024-09-15T23:58:08.757533+0000","last_clean":"2024-09-15T23:58:08.757533+0000","last_became_active":"2024-09-15T23:58:07.768011+0000","last_became_peered":"2024-09-15T23:58:07.768011+0000","last_unstale":"2024-09-15T23:58:08.757533+0000","last_undegraded":"2024-09-15T23:58:08.757533+0000","last_fullsized":"2024-09-15T23:58:08.757533+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:22.781437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126273+0000","last_change":"2024-09-15T23:58:06.745052+0000","last_active":"2024-09-15T23:58:09.126273+0000","last_peered":"2024-09-15T23:58:09.126273+0000","last_clean":"2024-09-15T23:58:09.126273+0000","last_became_active":"2024-09-15T23:58:06.743906+0000","last_became_peered":"2024-09-15T23:58:06.743906+0000","last_unstale":"2024-09-15T23:58:09.126273+0000","last_undegraded":"2024-09-15T23:58:09.126273+0000","last_fullsized":"2024-09-15T23:58:09.126273+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:03.616480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.755433+0000","last_change":"2024-09-15T23:58:07.782085+0000","last_active":"2024-09-15T23:58:08.755433+0000","last_peered":"2024-09-15T23:58:08.755433+0000","last_clean":"2024-09-15T23:58:08.755433+0000","last_became_active":"2024-09-15T23:58:07.781272+0000","last_became_peered":"2024-09-15T23:58:07.781272+0000","last_unstale":"2024-09-15T23:58:08.755433+0000","last_undegraded":"2024-09-15T23:58:08.755433+0000","last_fullsized":"2024-09-15T23:58:08.755433+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:32.190984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791527+0000","last_change":"2024-09-15T23:58:06.723519+0000","last_active":"2024-09-15T23:58:08.791527+0000","last_peered":"2024-09-15T23:58:08.791527+0000","last_clean":"2024-09-15T23:58:08.791527+0000","last_became_active":"2024-09-15T23:58:06.722945+0000","last_became_peered":"2024-09-15T23:58:06.722945+0000","last_unstale":"2024-09-15T23:58:08.791527+0000","last_undegraded":"2024-09-15T23:58:08.791527+0000","last_fullsized":"2024-09-15T23:58:08.791527+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:24.274929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756588+0000","last_change":"2024-09-15T23:58:07.766786+0000","last_active":"2024-09-15T23:58:08.756588+0000","last_peered":"2024-09-15T23:58:08.756588+0000","last_clean":"2024-09-15T23:58:08.756588+0000","last_became_active":"2024-09-15T23:58:07.764533+0000","last_became_peered":"2024-09-15T23:58:07.764533+0000","last_unstale":"2024-09-15T23:58:08.756588+0000","last_undegraded":"2024-09-15T23:58:08.756588+0000","last_fullsized":"2024-09-15T23:58:08.756588+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:25.695282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758744+0000","last_change":"2024-09-15T23:58:06.748827+0000","last_active":"2024-09-15T23:58:08.758744+0000","last_peered":"2024-09-15T23:58:08.758744+0000","last_clean":"2024-09-15T23:58:08.758744+0000","last_became_active":"2024-09-15T23:58:06.748419+0000","last_became_peered":"2024-09-15T23:58:06.748419+0000","last_unstale":"2024-09-15T23:58:08.758744+0000","last_undegraded":"2024-09-15T23:58:08.758744+0000","last_fullsized":"2024-09-15T23:58:08.758744+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.690650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758808+0000","last_change":"2024-09-15T23:58:07.769178+0000","last_active":"2024-09-15T23:58:08.758808+0000","last_peered":"2024-09-15T23:58:08.758808+0000","last_clean":"2024-09-15T23:58:08.758808+0000","last_became_active":"2024-09-15T23:58:07.768505+0000","last_became_peered":"2024-09-15T23:58:07.768505+0000","last_unstale":"2024-09-15T23:58:08.758808+0000","last_undegraded":"2024-09-15T23:58:08.758808+0000","last_fullsized":"2024-09-15T23:58:08.758808+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:43.017275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"96'3","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791897+0000","last_change":"2024-09-15T23:58:06.743819+0000","last_active":"2024-09-15T23:58:08.791897+0000","last_peered":"2024-09-15T23:58:08.791897+0000","last_clean":"2024-09-15T23:58:08.791897+0000","last_became_active":"2024-09-15T23:58:06.743512+0000","last_became_peered":"2024-09-15T23:58:06.743512+0000","last_unstale":"2024-09-15T23:58:08.791897+0000","last_undegraded":"2024-09-15T23:58:08.791897+0000","last_fullsized":"2024-09-15T23:58:08.791897+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:38.845066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126282+0000","last_change":"2024-09-15T23:58:07.787170+0000","last_active":"2024-09-15T23:58:09.126282+0000","last_peered":"2024-09-15T23:58:09.126282+0000","last_clean":"2024-09-15T23:58:09.126282+0000","last_became_active":"2024-09-15T23:58:07.786487+0000","last_became_peered":"2024-09-15T23:58:07.786487+0000","last_unstale":"2024-09-15T23:58:09.126282+0000","last_undegraded":"2024-09-15T23:58:09.126282+0000","last_fullsized":"2024-09-15T23:58:09.126282+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:54.922033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"96'6","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128875+0000","last_change":"2024-09-15T23:58:06.735492+0000","last_active":"2024-09-15T23:58:09.128875+0000","last_peered":"2024-09-15T23:58:09.128875+0000","last_clean":"2024-09-15T23:58:09.128875+0000","last_became_active":"2024-09-15T23:58:06.734834+0000","last_became_peered":"2024-09-15T23:58:06.734834+0000","last_unstale":"2024-09-15T23:58:09.128875+0000","last_undegraded":"2024-09-15T23:58:09.128875+0000","last_fullsized":"2024-09-15T23:58:09.128875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:26.410446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753230+0000","last_change":"2024-09-15T23:58:07.799903+0000","last_active":"2024-09-15T23:58:08.753230+0000","last_peered":"2024-09-15T23:58:08.753230+0000","last_clean":"2024-09-15T23:58:08.753230+0000","last_became_active":"2024-09-15T23:58:07.799564+0000","last_became_peered":"2024-09-15T23:58:07.799564+0000","last_unstale":"2024-09-15T23:58:08.753230+0000","last_undegraded":"2024-09-15T23:58:08.753230+0000","last_fullsized":"2024-09-15T23:58:08.753230+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:09.804410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756456+0000","last_change":"2024-09-15T23:58:06.753728+0000","last_active":"2024-09-15T23:58:08.756456+0000","last_peered":"2024-09-15T23:58:08.756456+0000","last_clean":"2024-09-15T23:58:08.756456+0000","last_became_active":"2024-09-15T23:58:06.753064+0000","last_became_peered":"2024-09-15T23:58:06.753064+0000","last_unstale":"2024-09-15T23:58:08.756456+0000","last_undegraded":"2024-09-15T23:58:08.756456+0000","last_fullsized":"2024-09-15T23:58:08.756456+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:37.947511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753219+0000","last_change":"2024-09-15T23:58:07.758875+0000","last_active":"2024-09-15T23:58:08.753219+0000","last_peered":"2024-09-15T23:58:08.753219+0000","last_clean":"2024-09-15T23:58:08.753219+0000","last_became_active":"2024-09-15T23:58:07.756469+0000","last_became_peered":"2024-09-15T23:58:07.756469+0000","last_unstale":"2024-09-15T23:58:08.753219+0000","last_undegraded":"2024-09-15T23:58:08.753219+0000","last_fullsized":"2024-09-15T23:58:08.753219+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:39.856367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758820+0000","last_change":"2024-09-15T23:58:06.730917+0000","last_active":"2024-09-15T23:58:08.758820+0000","last_peered":"2024-09-15T23:58:08.758820+0000","last_clean":"2024-09-15T23:58:08.758820+0000","last_became_active":"2024-09-15T23:58:06.730153+0000","last_became_peered":"2024-09-15T23:58:06.730153+0000","last_unstale":"2024-09-15T23:58:08.758820+0000","last_undegraded":"2024-09-15T23:58:08.758820+0000","last_fullsized":"2024-09-15T23:58:08.758820+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:06.203702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126587+0000","last_change":"2024-09-15T23:58:07.784939+0000","last_active":"2024-09-15T23:58:09.126587+0000","last_peered":"2024-09-15T23:58:09.126587+0000","last_clean":"2024-09-15T23:58:09.126587+0000","last_became_active":"2024-09-15T23:58:07.783654+0000","last_became_peered":"2024-09-15T23:58:07.783654+0000","last_unstale":"2024-09-15T23:58:09.126587+0000","last_undegraded":"2024-09-15T23:58:09.126587+0000","last_fullsized":"2024-09-15T23:58:09.126587+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:42.052614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756142+0000","last_change":"2024-09-15T23:58:06.733047+0000","last_active":"2024-09-15T23:58:08.756142+0000","last_peered":"2024-09-15T23:58:08.756142+0000","last_clean":"2024-09-15T23:58:08.756142+0000","last_became_active":"2024-09-15T23:58:06.732148+0000","last_became_peered":"2024-09-15T23:58:06.732148+0000","last_unstale":"2024-09-15T23:58:08.756142+0000","last_undegraded":"2024-09-15T23:58:08.756142+0000","last_fullsized":"2024-09-15T23:58:08.756142+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:33.404685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.726429+0000","last_change":"2024-09-15T23:58:06.726429+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.726429+0000","last_undegraded":"2024-09-15T23:58:06.726429+0000","last_fullsized":"2024-09-15T23:58:06.726429+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"96'8","reported_seq":22,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.127657+0000","last_change":"2024-09-15T23:58:06.732340+0000","last_active":"2024-09-15T23:58:09.127657+0000","last_peered":"2024-09-15T23:58:09.127657+0000","last_clean":"2024-09-15T23:58:09.127657+0000","last_became_active":"2024-09-15T23:58:06.732080+0000","last_became_peered":"2024-09-15T23:58:06.732080+0000","last_unstale":"2024-09-15T23:58:09.127657+0000","last_undegraded":"2024-09-15T23:58:09.127657+0000","last_fullsized":"2024-09-15T23:58:09.127657+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:45.077686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758512+0000","last_change":"2024-09-15T23:58:07.770015+0000","last_active":"2024-09-15T23:58:08.758512+0000","last_peered":"2024-09-15T23:58:08.758512+0000","last_clean":"2024-09-15T23:58:08.758512+0000","last_became_active":"2024-09-15T23:58:07.769509+0000","last_became_peered":"2024-09-15T23:58:07.769509+0000","last_unstale":"2024-09-15T23:58:08.758512+0000","last_undegraded":"2024-09-15T23:58:08.758512+0000","last_fullsized":"2024-09-15T23:58:08.758512+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:26.451417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791651+0000","last_change":"2024-09-15T23:58:06.722578+0000","last_active":"2024-09-15T23:58:08.791651+0000","last_peered":"2024-09-15T23:58:08.791651+0000","last_clean":"2024-09-15T23:58:08.791651+0000","last_became_active":"2024-09-15T23:58:06.722138+0000","last_became_peered":"2024-09-15T23:58:06.722138+0000","last_unstale":"2024-09-15T23:58:08.791651+0000","last_undegraded":"2024-09-15T23:58:08.791651+0000","last_fullsized":"2024-09-15T23:58:08.791651+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:35.696453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129439+0000","last_change":"2024-09-15T23:58:07.776105+0000","last_active":"2024-09-15T23:58:09.129439+0000","last_peered":"2024-09-15T23:58:09.129439+0000","last_clean":"2024-09-15T23:58:09.129439+0000","last_became_active":"2024-09-15T23:58:07.775809+0000","last_became_peered":"2024-09-15T23:58:07.775809+0000","last_unstale":"2024-09-15T23:58:09.129439+0000","last_undegraded":"2024-09-15T23:58:09.129439+0000","last_fullsized":"2024-09-15T23:58:09.129439+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:36.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.d","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129069+0000","last_change":"2024-09-15T23:58:06.738994+0000","last_active":"2024-09-15T23:58:09.129069+0000","last_peered":"2024-09-15T23:58:09.129069+0000","last_clean":"2024-09-15T23:58:09.129069+0000","last_became_active":"2024-09-15T23:58:06.738495+0000","last_became_peered":"2024-09-15T23:58:06.738495+0000","last_unstale":"2024-09-15T23:58:09.129069+0000","last_undegraded":"2024-09-15T23:58:09.129069+0000","last_fullsized":"2024-09-15T23:58:09.129069+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:44.651235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126141+0000","last_change":"2024-09-15T23:58:07.782366+0000","last_active":"2024-09-15T23:58:09.126141+0000","last_peered":"2024-09-15T23:58:09.126141+0000","last_clean":"2024-09-15T23:58:09.126141+0000","last_became_active":"2024-09-15T23:58:07.781871+0000","last_became_peered":"2024-09-15T23:58:07.781871+0000","last_unstale":"2024-09-15T23:58:09.126141+0000","last_undegraded":"2024-09-15T23:58:09.126141+0000","last_fullsized":"2024-09-15T23:58:09.126141+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:21.361174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791312+0000","last_change":"2024-09-15T23:58:06.723437+0000","last_active":"2024-09-15T23:58:08.791312+0000","last_peered":"2024-09-15T23:58:08.791312+0000","last_clean":"2024-09-15T23:58:08.791312+0000","last_became_active":"2024-09-15T23:58:06.722488+0000","last_became_peered":"2024-09-15T23:58:06.722488+0000","last_unstale":"2024-09-15T23:58:08.791312+0000","last_undegraded":"2024-09-15T23:58:08.791312+0000","last_fullsized":"2024-09-15T23:58:08.791312+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:08.793109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757296+0000","last_change":"2024-09-15T23:58:07.791345+0000","last_active":"2024-09-15T23:58:08.757296+0000","last_peered":"2024-09-15T23:58:08.757296+0000","last_clean":"2024-09-15T23:58:08.757296+0000","last_became_active":"2024-09-15T23:58:07.781515+0000","last_became_peered":"2024-09-15T23:58:07.781515+0000","last_unstale":"2024-09-15T23:58:08.757296+0000","last_undegraded":"2024-09-15T23:58:08.757296+0000","last_fullsized":"2024-09-15T23:58:08.757296+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:55.061923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753593+0000","last_change":"2024-09-15T23:58:06.742316+0000","last_active":"2024-09-15T23:58:06.753593+0000","last_peered":"2024-09-15T23:58:06.753593+0000","last_clean":"2024-09-15T23:58:06.753593+0000","last_became_active":"2024-09-15T23:58:06.741127+0000","last_became_peered":"2024-09-15T23:58:06.741127+0000","last_unstale":"2024-09-15T23:58:06.753593+0000","last_undegraded":"2024-09-15T23:58:06.753593+0000","last_fullsized":"2024-09-15T23:58:06.753593+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:41.281238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126663+0000","last_change":"2024-09-15T23:58:07.795069+0000","last_active":"2024-09-15T23:58:09.126663+0000","last_peered":"2024-09-15T23:58:09.126663+0000","last_clean":"2024-09-15T23:58:09.126663+0000","last_became_active":"2024-09-15T23:58:07.794212+0000","last_became_peered":"2024-09-15T23:58:07.794212+0000","last_unstale":"2024-09-15T23:58:09.126663+0000","last_undegraded":"2024-09-15T23:58:09.126663+0000","last_fullsized":"2024-09-15T23:58:09.126663+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:23.262308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753608+0000","last_change":"2024-09-15T23:58:06.747941+0000","last_active":"2024-09-15T23:58:06.753608+0000","last_peered":"2024-09-15T23:58:06.753608+0000","last_clean":"2024-09-15T23:58:06.753608+0000","last_became_active":"2024-09-15T23:58:06.747101+0000","last_became_peered":"2024-09-15T23:58:06.747101+0000","last_unstale":"2024-09-15T23:58:06.753608+0000","last_undegraded":"2024-09-15T23:58:06.753608+0000","last_fullsized":"2024-09-15T23:58:06.753608+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:01.213481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126526+0000","last_change":"2024-09-15T23:58:07.775709+0000","last_active":"2024-09-15T23:58:09.126526+0000","last_peered":"2024-09-15T23:58:09.126526+0000","last_clean":"2024-09-15T23:58:09.126526+0000","last_became_active":"2024-09-15T23:58:07.774896+0000","last_became_peered":"2024-09-15T23:58:07.774896+0000","last_unstale":"2024-09-15T23:58:09.126526+0000","last_undegraded":"2024-09-15T23:58:09.126526+0000","last_fullsized":"2024-09-15T23:58:09.126526+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:42.839656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791159+0000","last_change":"2024-09-15T23:58:06.732322+0000","last_active":"2024-09-15T23:58:08.791159+0000","last_peered":"2024-09-15T23:58:08.791159+0000","last_clean":"2024-09-15T23:58:08.791159+0000","last_became_active":"2024-09-15T23:58:06.731337+0000","last_became_peered":"2024-09-15T23:58:06.731337+0000","last_unstale":"2024-09-15T23:58:08.791159+0000","last_undegraded":"2024-09-15T23:58:08.791159+0000","last_fullsized":"2024-09-15T23:58:08.791159+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:00.946105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757489+0000","last_change":"2024-09-15T23:58:07.769923+0000","last_active":"2024-09-15T23:58:08.757489+0000","last_peered":"2024-09-15T23:58:08.757489+0000","last_clean":"2024-09-15T23:58:08.757489+0000","last_became_active":"2024-09-15T23:58:07.769057+0000","last_became_peered":"2024-09-15T23:58:07.769057+0000","last_unstale":"2024-09-15T23:58:08.757489+0000","last_undegraded":"2024-09-15T23:58:08.757489+0000","last_fullsized":"2024-09-15T23:58:08.757489+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:25.029723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758016+0000","last_change":"2024-09-15T23:58:06.737190+0000","last_active":"2024-09-15T23:58:08.758016+0000","last_peered":"2024-09-15T23:58:08.758016+0000","last_clean":"2024-09-15T23:58:08.758016+0000","last_became_active":"2024-09-15T23:58:06.736804+0000","last_became_peered":"2024-09-15T23:58:06.736804+0000","last_unstale":"2024-09-15T23:58:08.758016+0000","last_undegraded":"2024-09-15T23:58:08.758016+0000","last_fullsized":"2024-09-15T23:58:08.758016+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:30.329573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.125911+0000","last_change":"2024-09-15T23:58:07.775890+0000","last_active":"2024-09-15T23:58:09.125911+0000","last_peered":"2024-09-15T23:58:09.125911+0000","last_clean":"2024-09-15T23:58:09.125911+0000","last_became_active":"2024-09-15T23:58:07.774559+0000","last_became_peered":"2024-09-15T23:58:07.774559+0000","last_unstale":"2024-09-15T23:58:09.125911+0000","last_undegraded":"2024-09-15T23:58:09.125911+0000","last_fullsized":"2024-09-15T23:58:09.125911+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:12.409978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.752582+0000","last_change":"2024-09-15T23:58:06.746347+0000","last_active":"2024-09-15T23:58:06.752582+0000","last_peered":"2024-09-15T23:58:06.752582+0000","last_clean":"2024-09-15T23:58:06.752582+0000","last_became_active":"2024-09-15T23:58:06.742108+0000","last_became_peered":"2024-09-15T23:58:06.742108+0000","last_unstale":"2024-09-15T23:58:06.752582+0000","last_undegraded":"2024-09-15T23:58:06.752582+0000","last_fullsized":"2024-09-15T23:58:06.752582+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:20.013521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129655+0000","last_change":"2024-09-15T23:58:07.766829+0000","last_active":"2024-09-15T23:58:09.129655+0000","last_peered":"2024-09-15T23:58:09.129655+0000","last_clean":"2024-09-15T23:58:09.129655+0000","last_became_active":"2024-09-15T23:58:07.766205+0000","last_became_peered":"2024-09-15T23:58:07.766205+0000","last_unstale":"2024-09-15T23:58:09.129655+0000","last_undegraded":"2024-09-15T23:58:09.129655+0000","last_fullsized":"2024-09-15T23:58:09.129655+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:53.825799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.752630+0000","last_change":"2024-09-15T23:58:06.746464+0000","last_active":"2024-09-15T23:58:06.752630+0000","last_peered":"2024-09-15T23:58:06.752630+0000","last_clean":"2024-09-15T23:58:06.752630+0000","last_became_active":"2024-09-15T23:58:06.741814+0000","last_became_peered":"2024-09-15T23:58:06.741814+0000","last_unstale":"2024-09-15T23:58:06.752630+0000","last_undegraded":"2024-09-15T23:58:06.752630+0000","last_fullsized":"2024-09-15T23:58:06.752630+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:43.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758539+0000","last_change":"2024-09-15T23:58:07.760444+0000","last_active":"2024-09-15T23:58:08.758539+0000","last_peered":"2024-09-15T23:58:08.758539+0000","last_clean":"2024-09-15T23:58:08.758539+0000","last_became_active":"2024-09-15T23:58:07.759706+0000","last_became_peered":"2024-09-15T23:58:07.759706+0000","last_unstale":"2024-09-15T23:58:08.758539+0000","last_undegraded":"2024-09-15T23:58:08.758539+0000","last_fullsized":"2024-09-15T23:58:08.758539+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:36.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128487+0000","last_change":"2024-09-15T23:58:06.738930+0000","last_active":"2024-09-15T23:58:09.128487+0000","last_peered":"2024-09-15T23:58:09.128487+0000","last_clean":"2024-09-15T23:58:09.128487+0000","last_became_active":"2024-09-15T23:58:06.737965+0000","last_became_peered":"2024-09-15T23:58:06.737965+0000","last_unstale":"2024-09-15T23:58:09.128487+0000","last_undegraded":"2024-09-15T23:58:09.128487+0000","last_fullsized":"2024-09-15T23:58:09.128487+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:27.303288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128573+0000","last_change":"2024-09-15T23:58:07.771056+0000","last_active":"2024-09-15T23:58:09.128573+0000","last_peered":"2024-09-15T23:58:09.128573+0000","last_clean":"2024-09-15T23:58:09.128573+0000","last_became_active":"2024-09-15T23:58:07.770335+0000","last_became_peered":"2024-09-15T23:58:07.770335+0000","last_unstale":"2024-09-15T23:58:09.128573+0000","last_undegraded":"2024-09-15T23:58:09.128573+0000","last_fullsized":"2024-09-15T23:58:09.128573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:00.705487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757220+0000","last_change":"2024-09-15T23:58:06.733282+0000","last_active":"2024-09-15T23:58:08.757220+0000","last_peered":"2024-09-15T23:58:08.757220+0000","last_clean":"2024-09-15T23:58:08.757220+0000","last_became_active":"2024-09-15T23:58:06.731829+0000","last_became_peered":"2024-09-15T23:58:06.731829+0000","last_unstale":"2024-09-15T23:58:08.757220+0000","last_undegraded":"2024-09-15T23:58:08.757220+0000","last_fullsized":"2024-09-15T23:58:08.757220+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:37.214555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756733+0000","last_change":"2024-09-15T23:58:07.796182+0000","last_active":"2024-09-15T23:58:08.756733+0000","last_peered":"2024-09-15T23:58:08.756733+0000","last_clean":"2024-09-15T23:58:08.756733+0000","last_became_active":"2024-09-15T23:58:07.783093+0000","last_became_peered":"2024-09-15T23:58:07.783093+0000","last_unstale":"2024-09-15T23:58:08.756733+0000","last_undegraded":"2024-09-15T23:58:08.756733+0000","last_fullsized":"2024-09-15T23:58:08.756733+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:01.714283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129162+0000","last_change":"2024-09-15T23:58:06.736436+0000","last_active":"2024-09-15T23:58:09.129162+0000","last_peered":"2024-09-15T23:58:09.129162+0000","last_clean":"2024-09-15T23:58:09.129162+0000","last_became_active":"2024-09-15T23:58:06.736078+0000","last_became_peered":"2024-09-15T23:58:06.736078+0000","last_unstale":"2024-09-15T23:58:09.129162+0000","last_undegraded":"2024-09-15T23:58:09.129162+0000","last_fullsized":"2024-09-15T23:58:09.129162+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:49.214605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756427+0000","last_change":"2024-09-15T23:58:07.791074+0000","last_active":"2024-09-15T23:58:08.756427+0000","last_peered":"2024-09-15T23:58:08.756427+0000","last_clean":"2024-09-15T23:58:08.756427+0000","last_became_active":"2024-09-15T23:58:07.782975+0000","last_became_peered":"2024-09-15T23:58:07.782975+0000","last_unstale":"2024-09-15T23:58:08.756427+0000","last_undegraded":"2024-09-15T23:58:08.756427+0000","last_fullsized":"2024-09-15T23:58:08.756427+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:22.748219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753553+0000","last_change":"2024-09-15T23:58:06.747357+0000","last_active":"2024-09-15T23:58:06.753553+0000","last_peered":"2024-09-15T23:58:06.753553+0000","last_clean":"2024-09-15T23:58:06.753553+0000","last_became_active":"2024-09-15T23:58:06.746786+0000","last_became_peered":"2024-09-15T23:58:06.746786+0000","last_unstale":"2024-09-15T23:58:06.753553+0000","last_undegraded":"2024-09-15T23:58:06.753553+0000","last_fullsized":"2024-09-15T23:58:06.753553+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:16.498783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791793+0000","last_change":"2024-09-15T23:58:07.781892+0000","last_active":"2024-09-15T23:58:08.791793+0000","last_peered":"2024-09-15T23:58:08.791793+0000","last_clean":"2024-09-15T23:58:08.791793+0000","last_became_active":"2024-09-15T23:58:07.781560+0000","last_became_peered":"2024-09-15T23:58:07.781560+0000","last_unstale":"2024-09-15T23:58:08.791793+0000","last_undegraded":"2024-09-15T23:58:08.791793+0000","last_fullsized":"2024-09-15T23:58:08.791793+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:38.958811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128120+0000","last_change":"2024-09-15T23:58:06.734272+0000","last_active":"2024-09-15T23:58:09.128120+0000","last_peered":"2024-09-15T23:58:09.128120+0000","last_clean":"2024-09-15T23:58:09.128120+0000","last_became_active":"2024-09-15T23:58:06.734020+0000","last_became_peered":"2024-09-15T23:58:06.734020+0000","last_unstale":"2024-09-15T23:58:09.128120+0000","last_undegraded":"2024-09-15T23:58:09.128120+0000","last_fullsized":"2024-09-15T23:58:09.128120+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:30.329573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753804+0000","last_change":"2024-09-15T23:58:07.772545+0000","last_active":"2024-09-15T23:58:08.753804+0000","last_peered":"2024-09-15T23:58:08.753804+0000","last_clean":"2024-09-15T23:58:08.753804+0000","last_became_active":"2024-09-15T23:58:07.772139+0000","last_became_peered":"2024-09-15T23:58:07.772139+0000","last_unstale":"2024-09-15T23:58:08.753804+0000","last_undegraded":"2024-09-15T23:58:08.753804+0000","last_fullsized":"2024-09-15T23:58:08.753804+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:01.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753650+0000","last_change":"2024-09-15T23:58:06.748574+0000","last_active":"2024-09-15T23:58:06.753650+0000","last_peered":"2024-09-15T23:58:06.753650+0000","last_clean":"2024-09-15T23:58:06.753650+0000","last_became_active":"2024-09-15T23:58:06.740503+0000","last_became_peered":"2024-09-15T23:58:06.740503+0000","last_unstale":"2024-09-15T23:58:06.753650+0000","last_undegraded":"2024-09-15T23:58:06.753650+0000","last_fullsized":"2024-09-15T23:58:06.753650+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:59.706046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791109+0000","last_change":"2024-09-15T23:58:07.778092+0000","last_active":"2024-09-15T23:58:08.791109+0000","last_peered":"2024-09-15T23:58:08.791109+0000","last_clean":"2024-09-15T23:58:08.791109+0000","last_became_active":"2024-09-15T23:58:07.775739+0000","last_became_peered":"2024-09-15T23:58:07.775739+0000","last_unstale":"2024-09-15T23:58:08.791109+0000","last_undegraded":"2024-09-15T23:58:08.791109+0000","last_fullsized":"2024-09-15T23:58:08.791109+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:22:00.044070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756867+0000","last_change":"2024-09-15T23:58:06.737213+0000","last_active":"2024-09-15T23:58:08.756867+0000","last_peered":"2024-09-15T23:58:08.756867+0000","last_clean":"2024-09-15T23:58:08.756867+0000","last_became_active":"2024-09-15T23:58:06.736308+0000","last_became_peered":"2024-09-15T23:58:06.736308+0000","last_unstale":"2024-09-15T23:58:08.756867+0000","last_undegraded":"2024-09-15T23:58:08.756867+0000","last_fullsized":"2024-09-15T23:58:08.756867+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:53.980679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":309,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128100+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:58:09.128100+0000","last_peered":"2024-09-15T23:58:09.128100+0000","last_clean":"2024-09-15T23:58:09.128100+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:58:09.128100+0000","last_undegraded":"2024-09-15T23:58:09.128100+0000","last_fullsized":"2024-09-15T23:58:09.128100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1191936,"data_stored":540950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1196032,"data_stored":541910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":547024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36520,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335320,"statfs":{"total":96636764160,"available":96599367680,"internally_reserved":0,"allocated":1196032,"data_stored":541910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1204224,"data_stored":547102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1130758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":547572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37068,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334772,"statfs":{"total":96636764160,"available":96598806528,"internally_reserved":0,"allocated":1753088,"data_stored":1116832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:58:12.095 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:58:12.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.241+0000 7fb382a66640 1 Processor -- start 2024-09-15T23:58:12.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.241+0000 7fb382a66640 1 -- start start 2024-09-15T23:58:12.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.241+0000 7fb382a66640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb37c0d3060 0x7fb37c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.241+0000 7fb382a66640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb37c0d0300 con 0x7fb37c161a60 2024-09-15T23:58:12.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.241+0000 7fb382a66640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb37c0b0f60 con 0x7fb37c0cf450 2024-09-15T23:58:12.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.241+0000 7fb382a66640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb37c0cfd40 con 0x7fb37c0d3060 2024-09-15T23:58:12.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb380802640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb37c161a60 0x7fb37c0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58664/0 (socket says 172.21.15.112:58664) 2024-09-15T23:58:12.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb380802640 1 -- 172.21.15.112:0/1597686942 learned_addr learned my addr 172.21.15.112:0/1597686942 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:12.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb37bfff640 1 --2- 172.21.15.112:0/1597686942 >> v2:172.21.15.169:3300/0 conn(0x7fb37c0d3060 0x7fb37c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb37b7fe640 1 -- 172.21.15.112:0/1597686942 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4225860163 0 0) 0x7fb36c001120 con 0x7fb37c161a60 2024-09-15T23:58:12.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb37b7fe640 1 -- 172.21.15.112:0/1597686942 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb364003530 con 0x7fb37c161a60 2024-09-15T23:58:12.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb37bfff640 1 -- 172.21.15.112:0/1597686942 >> v1:172.21.15.169:6789/0 conn(0x7fb37c0cf450 legacy=0x7fb37c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:12.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb37bfff640 1 -- 172.21.15.112:0/1597686942 >> v1:172.21.15.112:6789/0 conn(0x7fb37c161a60 legacy=0x7fb37c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb37b7fe640 1 -- 172.21.15.112:0/1597686942 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3679458837 0 0) 0x7fb364003530 con 0x7fb37c161a60 2024-09-15T23:58:12.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb37bfff640 1 -- 172.21.15.112:0/1597686942 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c0d0020 con 0x7fb37c0d3060 2024-09-15T23:58:12.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb37bfff640 1 --2- 172.21.15.112:0/1597686942 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb37c0d3060 0x7fb37c0cef10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb3700097c0 tx=0x7fb37001c2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55a596ac7df931d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:12.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb37b7fe640 1 -- 172.21.15.112:0/1597686942 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3700b0070 con 0x7fb37c0d3060 2024-09-15T23:58:12.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb37b7fe640 1 -- 172.21.15.112:0/1597686942 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3700ab400 con 0x7fb37c0d3060 2024-09-15T23:58:12.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb37b7fe640 1 -- 172.21.15.112:0/1597686942 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c001850 con 0x7fb37c0d3060 2024-09-15T23:58:12.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb382a66640 1 -- 172.21.15.112:0/1597686942 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb37c0d3060 msgr2=0x7fb37c0cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb382a66640 1 --2- 172.21.15.112:0/1597686942 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb37c0d3060 0x7fb37c0cef10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb3700097c0 tx=0x7fb37001c2c0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb382a66640 1 -- 172.21.15.112:0/1597686942 shutdown_connections 2024-09-15T23:58:12.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb382a66640 1 --2- 172.21.15.112:0/1597686942 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb37c0d3060 0x7fb37c0cef10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb382a66640 1 -- 172.21.15.112:0/1597686942 >> 172.21.15.112:0/1597686942 conn(0x7fb37c08bf90 msgr2=0x7fb37c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:12.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb382a66640 1 -- 172.21.15.112:0/1597686942 shutdown_connections 2024-09-15T23:58:12.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.245+0000 7fb382a66640 1 -- 172.21.15.112:0/1597686942 wait complete. 2024-09-15T23:58:12.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb382a66640 1 Processor -- start 2024-09-15T23:58:12.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb382a66640 1 -- start start 2024-09-15T23:58:12.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb382a66640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb37c0cf450 0x7fb37c15b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb382a66640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb37c0d3060 0x7fb37c0d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb382a66640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c161a60 0x7fb37c0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb382a66640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c16bf30 con 0x7fb37c161a60 2024-09-15T23:58:12.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb382a66640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c0cfad0 con 0x7fb37c0d3060 2024-09-15T23:58:12.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb382a66640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb37c16c0b0 con 0x7fb37c0cf450 2024-09-15T23:58:12.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb381003640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c161a60 0x7fb37c0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb381003640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c161a60 0x7fb37c0d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59808/0 (socket says 172.21.15.112:59808) 2024-09-15T23:58:12.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb381003640 1 -- 172.21.15.112:0/2191838090 learned_addr learned my addr 172.21.15.112:0/2191838090 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:12.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb37bfff640 1 --2- 172.21.15.112:0/2191838090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb37c0d3060 0x7fb37c0d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb380802640 1 --2- 172.21.15.112:0/2191838090 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb37c0cf450 0x7fb37c15b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb381003640 1 -- 172.21.15.112:0/2191838090 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb37c0cf450 msgr2=0x7fb37c15b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb381003640 1 --2- 172.21.15.112:0/2191838090 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb37c0cf450 0x7fb37c15b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb381003640 1 -- 172.21.15.112:0/2191838090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb37c0d3060 msgr2=0x7fb37c0d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb381003640 1 --2- 172.21.15.112:0/2191838090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb37c0d3060 0x7fb37c0d0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb381003640 1 -- 172.21.15.112:0/2191838090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c0b1490 con 0x7fb37c161a60 2024-09-15T23:58:12.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb381003640 1 --2- 172.21.15.112:0/2191838090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c161a60 0x7fb37c0d0fc0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fb37400b970 tx=0x7fb37400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:12.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb3797fa640 1 -- 172.21.15.112:0/2191838090 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374019070 con 0x7fb37c161a60 2024-09-15T23:58:12.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb3797fa640 1 -- 172.21.15.112:0/2191838090 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb37400cb40 con 0x7fb37c161a60 2024-09-15T23:58:12.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb382a66640 1 -- 172.21.15.112:0/2191838090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb37c0cd4f0 con 0x7fb37c161a60 2024-09-15T23:58:12.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb3797fa640 1 -- 172.21.15.112:0/2191838090 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374014440 con 0x7fb37c161a60 2024-09-15T23:58:12.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb382a66640 1 -- 172.21.15.112:0/2191838090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb37c0cdab0 con 0x7fb37c161a60 2024-09-15T23:58:12.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.249+0000 7fb382a66640 1 -- 172.21.15.112:0/2191838090 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb37c0cef10 con 0x7fb37c161a60 2024-09-15T23:58:12.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.253+0000 7fb3797fa640 1 -- 172.21.15.112:0/2191838090 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb37401c070 con 0x7fb37c161a60 2024-09-15T23:58:12.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.253+0000 7fb3797fa640 1 --2- 172.21.15.112:0/2191838090 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3680678c0 0x7fb368069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.260 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.253+0000 7fb3797fa640 1 -- 172.21.15.112:0/2191838090 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7fb374085ba0 con 0x7fb37c161a60 2024-09-15T23:58:12.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.253+0000 7fb380802640 1 --2- 172.21.15.112:0/2191838090 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3680678c0 0x7fb368069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.253+0000 7fb380802640 1 --2- 172.21.15.112:0/2191838090 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3680678c0 0x7fb368069d80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb37c159520 tx=0x7fb36c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:12.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.257+0000 7fb3797fa640 1 -- 172.21.15.112:0/2191838090 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb374056550 con 0x7fb37c161a60 2024-09-15T23:58:12.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.409+0000 7fb382a66640 1 -- 172.21.15.112:0/2191838090 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb37c0d3840 con 0x7fb3680678c0 2024-09-15T23:58:12.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.417+0000 7fb3797fa640 1 -- 172.21.15.112:0/2191838090 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251666 (secure 0 0 0) 0x7fb37c0d3840 con 0x7fb3680678c0 2024-09-15T23:58:12.419 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:12.420 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:58:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.421+0000 7fb382a66640 1 -- 172.21.15.112:0/2191838090 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3680678c0 msgr2=0x7fb368069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.421+0000 7fb382a66640 1 --2- 172.21.15.112:0/2191838090 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3680678c0 0x7fb368069d80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb37c159520 tx=0x7fb36c009040 comp rx=0 tx=0).stop 2024-09-15T23:58:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.421+0000 7fb382a66640 1 -- 172.21.15.112:0/2191838090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c161a60 msgr2=0x7fb37c0d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.421+0000 7fb382a66640 1 --2- 172.21.15.112:0/2191838090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c161a60 0x7fb37c0d0fc0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fb37400b970 tx=0x7fb37400be30 comp rx=0 tx=0).stop 2024-09-15T23:58:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.421+0000 7fb382a66640 1 -- 172.21.15.112:0/2191838090 shutdown_connections 2024-09-15T23:58:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.421+0000 7fb382a66640 1 --2- 172.21.15.112:0/2191838090 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3680678c0 0x7fb368069d80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.421+0000 7fb382a66640 1 --2- 172.21.15.112:0/2191838090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c161a60 0x7fb37c0d0fc0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.421+0000 7fb382a66640 1 --2- 172.21.15.112:0/2191838090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb37c0d3060 0x7fb37c0d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.421+0000 7fb382a66640 1 --2- 172.21.15.112:0/2191838090 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb37c0cf450 0x7fb37c15b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.421+0000 7fb382a66640 1 -- 172.21.15.112:0/2191838090 >> 172.21.15.112:0/2191838090 conn(0x7fb37c08bf90 msgr2=0x7fb37c0d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.421+0000 7fb382a66640 1 -- 172.21.15.112:0/2191838090 shutdown_connections 2024-09-15T23:58:12.422 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.421+0000 7fb382a66640 1 -- 172.21.15.112:0/2191838090 wait complete. 2024-09-15T23:58:12.435 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-15T23:58:11.313780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":268328,"kb_used_data":10476,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754706392,"statfs":{"total":773094113280,"available":772819345408,"internally_reserved":0,"allocated":10727424,"data_stored":5514058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.614632"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757324+0000","last_change":"2024-09-15T23:58:07.765376+0000","last_active":"2024-09-15T23:58:08.757324+0000","last_peered":"2024-09-15T23:58:08.757324+0000","last_clean":"2024-09-15T23:58:08.757324+0000","last_became_active":"2024-09-15T23:58:07.764634+0000","last_became_peered":"2024-09-15T23:58:07.764634+0000","last_unstale":"2024-09-15T23:58:08.757324+0000","last_undegraded":"2024-09-15T23:58:08.757324+0000","last_fullsized":"2024-09-15T23:58:08.757324+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:17.697740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753334+0000","last_change":"2024-09-15T23:58:07.773180+0000","last_active":"2024-09-15T23:58:08.753334+0000","last_peered":"2024-09-15T23:58:08.753334+0000","last_clean":"2024-09-15T23:58:08.753334+0000","last_became_active":"2024-09-15T23:58:07.772756+0000","last_became_peered":"2024-09-15T23:58:07.772756+0000","last_unstale":"2024-09-15T23:58:08.753334+0000","last_undegraded":"2024-09-15T23:58:08.753334+0000","last_fullsized":"2024-09-15T23:58:08.753334+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:25.286230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.722018+0000","last_change":"2024-09-15T23:58:06.722018+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.722018+0000","last_undegraded":"2024-09-15T23:58:06.722018+0000","last_fullsized":"2024-09-15T23:58:06.722018+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756033+0000","last_change":"2024-09-15T23:58:07.792209+0000","last_active":"2024-09-15T23:58:08.756033+0000","last_peered":"2024-09-15T23:58:08.756033+0000","last_clean":"2024-09-15T23:58:08.756033+0000","last_became_active":"2024-09-15T23:58:07.783955+0000","last_became_peered":"2024-09-15T23:58:07.783955+0000","last_unstale":"2024-09-15T23:58:08.756033+0000","last_undegraded":"2024-09-15T23:58:08.756033+0000","last_fullsized":"2024-09-15T23:58:08.756033+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:01.050859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756642+0000","last_change":"2024-09-15T23:58:07.766302+0000","last_active":"2024-09-15T23:58:08.756642+0000","last_peered":"2024-09-15T23:58:08.756642+0000","last_clean":"2024-09-15T23:58:08.756642+0000","last_became_active":"2024-09-15T23:58:07.765484+0000","last_became_peered":"2024-09-15T23:58:07.765484+0000","last_unstale":"2024-09-15T23:58:08.756642+0000","last_undegraded":"2024-09-15T23:58:08.756642+0000","last_fullsized":"2024-09-15T23:58:08.756642+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:35.296757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791365+0000","last_change":"2024-09-15T23:58:07.780199+0000","last_active":"2024-09-15T23:58:08.791365+0000","last_peered":"2024-09-15T23:58:08.791365+0000","last_clean":"2024-09-15T23:58:08.791365+0000","last_became_active":"2024-09-15T23:58:07.779937+0000","last_became_peered":"2024-09-15T23:58:07.779937+0000","last_unstale":"2024-09-15T23:58:08.791365+0000","last_undegraded":"2024-09-15T23:58:08.791365+0000","last_fullsized":"2024-09-15T23:58:08.791365+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:34.415985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.790898+0000","last_change":"2024-09-15T23:58:07.779584+0000","last_active":"2024-09-15T23:58:08.790898+0000","last_peered":"2024-09-15T23:58:08.790898+0000","last_clean":"2024-09-15T23:58:08.790898+0000","last_became_active":"2024-09-15T23:58:07.776328+0000","last_became_peered":"2024-09-15T23:58:07.776328+0000","last_unstale":"2024-09-15T23:58:08.790898+0000","last_undegraded":"2024-09-15T23:58:08.790898+0000","last_fullsized":"2024-09-15T23:58:08.790898+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:20.154190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757373+0000","last_change":"2024-09-15T23:58:07.759525+0000","last_active":"2024-09-15T23:58:08.757373+0000","last_peered":"2024-09-15T23:58:08.757373+0000","last_clean":"2024-09-15T23:58:08.757373+0000","last_became_active":"2024-09-15T23:58:07.759015+0000","last_became_peered":"2024-09-15T23:58:07.759015+0000","last_unstale":"2024-09-15T23:58:08.757373+0000","last_undegraded":"2024-09-15T23:58:08.757373+0000","last_fullsized":"2024-09-15T23:58:08.757373+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:38.225855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753896+0000","last_change":"2024-09-15T23:58:07.800146+0000","last_active":"2024-09-15T23:58:08.753896+0000","last_peered":"2024-09-15T23:58:08.753896+0000","last_clean":"2024-09-15T23:58:08.753896+0000","last_became_active":"2024-09-15T23:58:07.799851+0000","last_became_peered":"2024-09-15T23:58:07.799851+0000","last_unstale":"2024-09-15T23:58:08.753896+0000","last_undegraded":"2024-09-15T23:58:08.753896+0000","last_fullsized":"2024-09-15T23:58:08.753896+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:36.707754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758499+0000","last_change":"2024-09-15T23:58:07.753670+0000","last_active":"2024-09-15T23:58:08.758499+0000","last_peered":"2024-09-15T23:58:08.758499+0000","last_clean":"2024-09-15T23:58:08.758499+0000","last_became_active":"2024-09-15T23:58:07.752863+0000","last_became_peered":"2024-09-15T23:58:07.752863+0000","last_unstale":"2024-09-15T23:58:08.758499+0000","last_undegraded":"2024-09-15T23:58:08.758499+0000","last_fullsized":"2024-09-15T23:58:08.758499+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:53.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128244+0000","last_change":"2024-09-15T23:58:07.773082+0000","last_active":"2024-09-15T23:58:09.128244+0000","last_peered":"2024-09-15T23:58:09.128244+0000","last_clean":"2024-09-15T23:58:09.128244+0000","last_became_active":"2024-09-15T23:58:07.768580+0000","last_became_peered":"2024-09-15T23:58:07.768580+0000","last_unstale":"2024-09-15T23:58:09.128244+0000","last_undegraded":"2024-09-15T23:58:09.128244+0000","last_fullsized":"2024-09-15T23:58:09.128244+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:55.098428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791187+0000","last_change":"2024-09-15T23:58:07.779856+0000","last_active":"2024-09-15T23:58:08.791187+0000","last_peered":"2024-09-15T23:58:08.791187+0000","last_clean":"2024-09-15T23:58:08.791187+0000","last_became_active":"2024-09-15T23:58:07.779553+0000","last_became_peered":"2024-09-15T23:58:07.779553+0000","last_unstale":"2024-09-15T23:58:08.791187+0000","last_undegraded":"2024-09-15T23:58:08.791187+0000","last_fullsized":"2024-09-15T23:58:08.791187+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:45.241169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.755836+0000","last_change":"2024-09-15T23:58:07.796750+0000","last_active":"2024-09-15T23:58:08.755836+0000","last_peered":"2024-09-15T23:58:08.755836+0000","last_clean":"2024-09-15T23:58:08.755836+0000","last_became_active":"2024-09-15T23:58:07.792310+0000","last_became_peered":"2024-09-15T23:58:07.792310+0000","last_unstale":"2024-09-15T23:58:08.755836+0000","last_undegraded":"2024-09-15T23:58:08.755836+0000","last_fullsized":"2024-09-15T23:58:08.755836+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:20.742739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791283+0000","last_change":"2024-09-15T23:58:07.776737+0000","last_active":"2024-09-15T23:58:08.791283+0000","last_peered":"2024-09-15T23:58:08.791283+0000","last_clean":"2024-09-15T23:58:08.791283+0000","last_became_active":"2024-09-15T23:58:07.776475+0000","last_became_peered":"2024-09-15T23:58:07.776475+0000","last_unstale":"2024-09-15T23:58:08.791283+0000","last_undegraded":"2024-09-15T23:58:08.791283+0000","last_fullsized":"2024-09-15T23:58:08.791283+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:58.182086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.752647+0000","last_change":"2024-09-15T23:58:07.789278+0000","last_active":"2024-09-15T23:58:08.752647+0000","last_peered":"2024-09-15T23:58:08.752647+0000","last_clean":"2024-09-15T23:58:08.752647+0000","last_became_active":"2024-09-15T23:58:07.788374+0000","last_became_peered":"2024-09-15T23:58:07.788374+0000","last_unstale":"2024-09-15T23:58:08.752647+0000","last_undegraded":"2024-09-15T23:58:08.752647+0000","last_fullsized":"2024-09-15T23:58:08.752647+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:10.386941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.127573+0000","last_change":"2024-09-15T23:58:07.777214+0000","last_active":"2024-09-15T23:58:09.127573+0000","last_peered":"2024-09-15T23:58:09.127573+0000","last_clean":"2024-09-15T23:58:09.127573+0000","last_became_active":"2024-09-15T23:58:07.776537+0000","last_became_peered":"2024-09-15T23:58:07.776537+0000","last_unstale":"2024-09-15T23:58:09.127573+0000","last_undegraded":"2024-09-15T23:58:09.127573+0000","last_fullsized":"2024-09-15T23:58:09.127573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:38.958811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.727455+0000","last_change":"2024-09-15T23:58:06.727455+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.727455+0000","last_undegraded":"2024-09-15T23:58:06.727455+0000","last_fullsized":"2024-09-15T23:58:06.727455+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753613+0000","last_change":"2024-09-15T23:58:07.773809+0000","last_active":"2024-09-15T23:58:08.753613+0000","last_peered":"2024-09-15T23:58:08.753613+0000","last_clean":"2024-09-15T23:58:08.753613+0000","last_became_active":"2024-09-15T23:58:07.773013+0000","last_became_peered":"2024-09-15T23:58:07.773013+0000","last_unstale":"2024-09-15T23:58:08.753613+0000","last_undegraded":"2024-09-15T23:58:08.753613+0000","last_fullsized":"2024-09-15T23:58:08.753613+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:35.110846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756318+0000","last_change":"2024-09-15T23:58:07.797639+0000","last_active":"2024-09-15T23:58:08.756318+0000","last_peered":"2024-09-15T23:58:08.756318+0000","last_clean":"2024-09-15T23:58:08.756318+0000","last_became_active":"2024-09-15T23:58:07.796983+0000","last_became_peered":"2024-09-15T23:58:07.796983+0000","last_unstale":"2024-09-15T23:58:08.756318+0000","last_undegraded":"2024-09-15T23:58:08.756318+0000","last_fullsized":"2024-09-15T23:58:08.756318+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:34.778205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128194+0000","last_change":"2024-09-15T23:58:07.762602+0000","last_active":"2024-09-15T23:58:09.128194+0000","last_peered":"2024-09-15T23:58:09.128194+0000","last_clean":"2024-09-15T23:58:09.128194+0000","last_became_active":"2024-09-15T23:58:07.761868+0000","last_became_peered":"2024-09-15T23:58:07.761868+0000","last_unstale":"2024-09-15T23:58:09.128194+0000","last_undegraded":"2024-09-15T23:58:09.128194+0000","last_fullsized":"2024-09-15T23:58:09.128194+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:38.225855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.726154+0000","last_change":"2024-09-15T23:58:06.726154+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.726154+0000","last_undegraded":"2024-09-15T23:58:06.726154+0000","last_fullsized":"2024-09-15T23:58:06.726154+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126816+0000","last_change":"2024-09-15T23:58:07.782785+0000","last_active":"2024-09-15T23:58:09.126816+0000","last_peered":"2024-09-15T23:58:09.126816+0000","last_clean":"2024-09-15T23:58:09.126816+0000","last_became_active":"2024-09-15T23:58:07.782088+0000","last_became_peered":"2024-09-15T23:58:07.782088+0000","last_unstale":"2024-09-15T23:58:09.126816+0000","last_undegraded":"2024-09-15T23:58:09.126816+0000","last_fullsized":"2024-09-15T23:58:09.126816+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:21.579619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758736+0000","last_change":"2024-09-15T23:58:07.778120+0000","last_active":"2024-09-15T23:58:08.758736+0000","last_peered":"2024-09-15T23:58:08.758736+0000","last_clean":"2024-09-15T23:58:08.758736+0000","last_became_active":"2024-09-15T23:58:07.777366+0000","last_became_peered":"2024-09-15T23:58:07.777366+0000","last_unstale":"2024-09-15T23:58:08.758736+0000","last_undegraded":"2024-09-15T23:58:08.758736+0000","last_fullsized":"2024-09-15T23:58:08.758736+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:28.979657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757763+0000","last_change":"2024-09-15T23:58:07.768580+0000","last_active":"2024-09-15T23:58:08.757763+0000","last_peered":"2024-09-15T23:58:08.757763+0000","last_clean":"2024-09-15T23:58:08.757763+0000","last_became_active":"2024-09-15T23:58:07.768022+0000","last_became_peered":"2024-09-15T23:58:07.768022+0000","last_unstale":"2024-09-15T23:58:08.757763+0000","last_undegraded":"2024-09-15T23:58:08.757763+0000","last_fullsized":"2024-09-15T23:58:08.757763+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:00.705487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129489+0000","last_change":"2024-09-15T23:58:07.796575+0000","last_active":"2024-09-15T23:58:09.129489+0000","last_peered":"2024-09-15T23:58:09.129489+0000","last_clean":"2024-09-15T23:58:09.129489+0000","last_became_active":"2024-09-15T23:58:07.788327+0000","last_became_peered":"2024-09-15T23:58:07.788327+0000","last_unstale":"2024-09-15T23:58:09.129489+0000","last_undegraded":"2024-09-15T23:58:09.129489+0000","last_fullsized":"2024-09-15T23:58:09.129489+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:28.979657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129311+0000","last_change":"2024-09-15T23:58:07.796461+0000","last_active":"2024-09-15T23:58:09.129311+0000","last_peered":"2024-09-15T23:58:09.129311+0000","last_clean":"2024-09-15T23:58:09.129311+0000","last_became_active":"2024-09-15T23:58:07.796172+0000","last_became_peered":"2024-09-15T23:58:07.796172+0000","last_unstale":"2024-09-15T23:58:09.129311+0000","last_undegraded":"2024-09-15T23:58:09.129311+0000","last_fullsized":"2024-09-15T23:58:09.129311+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:26.451417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129132+0000","last_change":"2024-09-15T23:58:07.779754+0000","last_active":"2024-09-15T23:58:09.129132+0000","last_peered":"2024-09-15T23:58:09.129132+0000","last_clean":"2024-09-15T23:58:09.129132+0000","last_became_active":"2024-09-15T23:58:07.779070+0000","last_became_peered":"2024-09-15T23:58:07.779070+0000","last_unstale":"2024-09-15T23:58:09.129132+0000","last_undegraded":"2024-09-15T23:58:09.129132+0000","last_fullsized":"2024-09-15T23:58:09.129132+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:53.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791414+0000","last_change":"2024-09-15T23:58:07.781973+0000","last_active":"2024-09-15T23:58:08.791414+0000","last_peered":"2024-09-15T23:58:08.791414+0000","last_clean":"2024-09-15T23:58:08.791414+0000","last_became_active":"2024-09-15T23:58:07.781646+0000","last_became_peered":"2024-09-15T23:58:07.781646+0000","last_unstale":"2024-09-15T23:58:08.791414+0000","last_undegraded":"2024-09-15T23:58:08.791414+0000","last_fullsized":"2024-09-15T23:58:08.791414+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:54.991980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758938+0000","last_change":"2024-09-15T23:58:07.780326+0000","last_active":"2024-09-15T23:58:08.758938+0000","last_peered":"2024-09-15T23:58:08.758938+0000","last_clean":"2024-09-15T23:58:08.758938+0000","last_became_active":"2024-09-15T23:58:07.779866+0000","last_became_peered":"2024-09-15T23:58:07.779866+0000","last_unstale":"2024-09-15T23:58:08.758938+0000","last_undegraded":"2024-09-15T23:58:08.758938+0000","last_fullsized":"2024-09-15T23:58:08.758938+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:32.670128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129254+0000","last_change":"2024-09-15T23:58:07.772116+0000","last_active":"2024-09-15T23:58:09.129254+0000","last_peered":"2024-09-15T23:58:09.129254+0000","last_clean":"2024-09-15T23:58:09.129254+0000","last_became_active":"2024-09-15T23:58:07.771400+0000","last_became_peered":"2024-09-15T23:58:07.771400+0000","last_unstale":"2024-09-15T23:58:09.129254+0000","last_undegraded":"2024-09-15T23:58:09.129254+0000","last_fullsized":"2024-09-15T23:58:09.129254+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:53.111663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791001+0000","last_change":"2024-09-15T23:58:07.780570+0000","last_active":"2024-09-15T23:58:08.791001+0000","last_peered":"2024-09-15T23:58:08.791001+0000","last_clean":"2024-09-15T23:58:08.791001+0000","last_became_active":"2024-09-15T23:58:07.779637+0000","last_became_peered":"2024-09-15T23:58:07.779637+0000","last_unstale":"2024-09-15T23:58:08.791001+0000","last_undegraded":"2024-09-15T23:58:08.791001+0000","last_fullsized":"2024-09-15T23:58:08.791001+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:04.943802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.125806+0000","last_change":"2024-09-15T23:58:07.767211+0000","last_active":"2024-09-15T23:58:09.125806+0000","last_peered":"2024-09-15T23:58:09.125806+0000","last_clean":"2024-09-15T23:58:09.125806+0000","last_became_active":"2024-09-15T23:58:07.766427+0000","last_became_peered":"2024-09-15T23:58:07.766427+0000","last_unstale":"2024-09-15T23:58:09.125806+0000","last_undegraded":"2024-09-15T23:58:09.125806+0000","last_fullsized":"2024-09-15T23:58:09.125806+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:10.506341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.720275+0000","last_change":"2024-09-15T23:58:06.720275+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.720275+0000","last_undegraded":"2024-09-15T23:58:06.720275+0000","last_fullsized":"2024-09-15T23:58:06.720275+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1f","version":"96'4","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126760+0000","last_change":"2024-09-15T23:58:06.737380+0000","last_active":"2024-09-15T23:58:09.126760+0000","last_peered":"2024-09-15T23:58:09.126760+0000","last_clean":"2024-09-15T23:58:09.126760+0000","last_became_active":"2024-09-15T23:58:06.736527+0000","last_became_peered":"2024-09-15T23:58:06.736527+0000","last_unstale":"2024-09-15T23:58:09.126760+0000","last_undegraded":"2024-09-15T23:58:09.126760+0000","last_fullsized":"2024-09-15T23:58:09.126760+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:42.645715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758832+0000","last_change":"2024-09-15T23:58:07.776944+0000","last_active":"2024-09-15T23:58:08.758832+0000","last_peered":"2024-09-15T23:58:08.758832+0000","last_clean":"2024-09-15T23:58:08.758832+0000","last_became_active":"2024-09-15T23:58:07.776174+0000","last_became_peered":"2024-09-15T23:58:07.776174+0000","last_unstale":"2024-09-15T23:58:08.758832+0000","last_undegraded":"2024-09-15T23:58:08.758832+0000","last_fullsized":"2024-09-15T23:58:08.758832+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:51.731861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753413+0000","last_change":"2024-09-15T23:58:06.747179+0000","last_active":"2024-09-15T23:58:06.753413+0000","last_peered":"2024-09-15T23:58:06.753413+0000","last_clean":"2024-09-15T23:58:06.753413+0000","last_became_active":"2024-09-15T23:58:06.746346+0000","last_became_peered":"2024-09-15T23:58:06.746346+0000","last_unstale":"2024-09-15T23:58:06.753413+0000","last_undegraded":"2024-09-15T23:58:06.753413+0000","last_fullsized":"2024-09-15T23:58:06.753413+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:39.718082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.752931+0000","last_change":"2024-09-15T23:58:07.755258+0000","last_active":"2024-09-15T23:58:08.752931+0000","last_peered":"2024-09-15T23:58:08.752931+0000","last_clean":"2024-09-15T23:58:08.752931+0000","last_became_active":"2024-09-15T23:58:07.754455+0000","last_became_peered":"2024-09-15T23:58:07.754455+0000","last_unstale":"2024-09-15T23:58:08.752931+0000","last_undegraded":"2024-09-15T23:58:08.752931+0000","last_fullsized":"2024-09-15T23:58:08.752931+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:07.269079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753420+0000","last_change":"2024-09-15T23:58:06.739251+0000","last_active":"2024-09-15T23:58:08.753420+0000","last_peered":"2024-09-15T23:58:08.753420+0000","last_clean":"2024-09-15T23:58:08.753420+0000","last_became_active":"2024-09-15T23:58:06.738972+0000","last_became_peered":"2024-09-15T23:58:06.738972+0000","last_unstale":"2024-09-15T23:58:08.753420+0000","last_undegraded":"2024-09-15T23:58:08.753420+0000","last_fullsized":"2024-09-15T23:58:08.753420+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:15.435941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128549+0000","last_change":"2024-09-15T23:58:07.783162+0000","last_active":"2024-09-15T23:58:09.128549+0000","last_peered":"2024-09-15T23:58:09.128549+0000","last_clean":"2024-09-15T23:58:09.128549+0000","last_became_active":"2024-09-15T23:58:07.782870+0000","last_became_peered":"2024-09-15T23:58:07.782870+0000","last_unstale":"2024-09-15T23:58:09.128549+0000","last_undegraded":"2024-09-15T23:58:09.128549+0000","last_fullsized":"2024-09-15T23:58:09.128549+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:54.734314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758412+0000","last_change":"2024-09-15T23:58:06.724258+0000","last_active":"2024-09-15T23:58:08.758412+0000","last_peered":"2024-09-15T23:58:08.758412+0000","last_clean":"2024-09-15T23:58:08.758412+0000","last_became_active":"2024-09-15T23:58:06.723572+0000","last_became_peered":"2024-09-15T23:58:06.723572+0000","last_unstale":"2024-09-15T23:58:08.758412+0000","last_undegraded":"2024-09-15T23:58:08.758412+0000","last_fullsized":"2024-09-15T23:58:08.758412+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:08.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756965+0000","last_change":"2024-09-15T23:58:07.784732+0000","last_active":"2024-09-15T23:58:08.756965+0000","last_peered":"2024-09-15T23:58:08.756965+0000","last_clean":"2024-09-15T23:58:08.756965+0000","last_became_active":"2024-09-15T23:58:07.782292+0000","last_became_peered":"2024-09-15T23:58:07.782292+0000","last_unstale":"2024-09-15T23:58:08.756965+0000","last_undegraded":"2024-09-15T23:58:08.756965+0000","last_fullsized":"2024-09-15T23:58:08.756965+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:33.544108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1b","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128878+0000","last_change":"2024-09-15T23:58:06.735612+0000","last_active":"2024-09-15T23:58:09.128878+0000","last_peered":"2024-09-15T23:58:09.128878+0000","last_clean":"2024-09-15T23:58:09.128878+0000","last_became_active":"2024-09-15T23:58:06.735170+0000","last_became_peered":"2024-09-15T23:58:06.735170+0000","last_unstale":"2024-09-15T23:58:09.128878+0000","last_undegraded":"2024-09-15T23:58:09.128878+0000","last_fullsized":"2024-09-15T23:58:09.128878+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:43.931563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756768+0000","last_change":"2024-09-15T23:58:07.765505+0000","last_active":"2024-09-15T23:58:08.756768+0000","last_peered":"2024-09-15T23:58:08.756768+0000","last_clean":"2024-09-15T23:58:08.756768+0000","last_became_active":"2024-09-15T23:58:07.764711+0000","last_became_peered":"2024-09-15T23:58:07.764711+0000","last_unstale":"2024-09-15T23:58:08.756768+0000","last_undegraded":"2024-09-15T23:58:08.756768+0000","last_fullsized":"2024-09-15T23:58:08.756768+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:39.153021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129582+0000","last_change":"2024-09-15T23:58:06.736878+0000","last_active":"2024-09-15T23:58:09.129582+0000","last_peered":"2024-09-15T23:58:09.129582+0000","last_clean":"2024-09-15T23:58:09.129582+0000","last_became_active":"2024-09-15T23:58:06.736545+0000","last_became_peered":"2024-09-15T23:58:06.736545+0000","last_unstale":"2024-09-15T23:58:09.129582+0000","last_undegraded":"2024-09-15T23:58:09.129582+0000","last_fullsized":"2024-09-15T23:58:09.129582+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:06.203702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129816+0000","last_change":"2024-09-15T23:58:07.764136+0000","last_active":"2024-09-15T23:58:09.129816+0000","last_peered":"2024-09-15T23:58:09.129816+0000","last_clean":"2024-09-15T23:58:09.129816+0000","last_became_active":"2024-09-15T23:58:07.762035+0000","last_became_peered":"2024-09-15T23:58:07.762035+0000","last_unstale":"2024-09-15T23:58:09.129816+0000","last_undegraded":"2024-09-15T23:58:09.129816+0000","last_fullsized":"2024-09-15T23:58:09.129816+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:13.530423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128008+0000","last_change":"2024-09-15T23:58:06.737494+0000","last_active":"2024-09-15T23:58:09.128008+0000","last_peered":"2024-09-15T23:58:09.128008+0000","last_clean":"2024-09-15T23:58:09.128008+0000","last_became_active":"2024-09-15T23:58:06.736714+0000","last_became_peered":"2024-09-15T23:58:06.736714+0000","last_unstale":"2024-09-15T23:58:09.128008+0000","last_undegraded":"2024-09-15T23:58:09.128008+0000","last_fullsized":"2024-09-15T23:58:09.128008+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.690650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757533+0000","last_change":"2024-09-15T23:58:07.770649+0000","last_active":"2024-09-15T23:58:08.757533+0000","last_peered":"2024-09-15T23:58:08.757533+0000","last_clean":"2024-09-15T23:58:08.757533+0000","last_became_active":"2024-09-15T23:58:07.768011+0000","last_became_peered":"2024-09-15T23:58:07.768011+0000","last_unstale":"2024-09-15T23:58:08.757533+0000","last_undegraded":"2024-09-15T23:58:08.757533+0000","last_fullsized":"2024-09-15T23:58:08.757533+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:22.781437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126273+0000","last_change":"2024-09-15T23:58:06.745052+0000","last_active":"2024-09-15T23:58:09.126273+0000","last_peered":"2024-09-15T23:58:09.126273+0000","last_clean":"2024-09-15T23:58:09.126273+0000","last_became_active":"2024-09-15T23:58:06.743906+0000","last_became_peered":"2024-09-15T23:58:06.743906+0000","last_unstale":"2024-09-15T23:58:09.126273+0000","last_undegraded":"2024-09-15T23:58:09.126273+0000","last_fullsized":"2024-09-15T23:58:09.126273+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:03.616480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.755433+0000","last_change":"2024-09-15T23:58:07.782085+0000","last_active":"2024-09-15T23:58:08.755433+0000","last_peered":"2024-09-15T23:58:08.755433+0000","last_clean":"2024-09-15T23:58:08.755433+0000","last_became_active":"2024-09-15T23:58:07.781272+0000","last_became_peered":"2024-09-15T23:58:07.781272+0000","last_unstale":"2024-09-15T23:58:08.755433+0000","last_undegraded":"2024-09-15T23:58:08.755433+0000","last_fullsized":"2024-09-15T23:58:08.755433+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:32.190984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791527+0000","last_change":"2024-09-15T23:58:06.723519+0000","last_active":"2024-09-15T23:58:08.791527+0000","last_peered":"2024-09-15T23:58:08.791527+0000","last_clean":"2024-09-15T23:58:08.791527+0000","last_became_active":"2024-09-15T23:58:06.722945+0000","last_became_peered":"2024-09-15T23:58:06.722945+0000","last_unstale":"2024-09-15T23:58:08.791527+0000","last_undegraded":"2024-09-15T23:58:08.791527+0000","last_fullsized":"2024-09-15T23:58:08.791527+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:24.274929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756588+0000","last_change":"2024-09-15T23:58:07.766786+0000","last_active":"2024-09-15T23:58:08.756588+0000","last_peered":"2024-09-15T23:58:08.756588+0000","last_clean":"2024-09-15T23:58:08.756588+0000","last_became_active":"2024-09-15T23:58:07.764533+0000","last_became_peered":"2024-09-15T23:58:07.764533+0000","last_unstale":"2024-09-15T23:58:08.756588+0000","last_undegraded":"2024-09-15T23:58:08.756588+0000","last_fullsized":"2024-09-15T23:58:08.756588+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:25.695282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758744+0000","last_change":"2024-09-15T23:58:06.748827+0000","last_active":"2024-09-15T23:58:08.758744+0000","last_peered":"2024-09-15T23:58:08.758744+0000","last_clean":"2024-09-15T23:58:08.758744+0000","last_became_active":"2024-09-15T23:58:06.748419+0000","last_became_peered":"2024-09-15T23:58:06.748419+0000","last_unstale":"2024-09-15T23:58:08.758744+0000","last_undegraded":"2024-09-15T23:58:08.758744+0000","last_fullsized":"2024-09-15T23:58:08.758744+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.690650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758808+0000","last_change":"2024-09-15T23:58:07.769178+0000","last_active":"2024-09-15T23:58:08.758808+0000","last_peered":"2024-09-15T23:58:08.758808+0000","last_clean":"2024-09-15T23:58:08.758808+0000","last_became_active":"2024-09-15T23:58:07.768505+0000","last_became_peered":"2024-09-15T23:58:07.768505+0000","last_unstale":"2024-09-15T23:58:08.758808+0000","last_undegraded":"2024-09-15T23:58:08.758808+0000","last_fullsized":"2024-09-15T23:58:08.758808+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:43.017275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"96'3","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791897+0000","last_change":"2024-09-15T23:58:06.743819+0000","last_active":"2024-09-15T23:58:08.791897+0000","last_peered":"2024-09-15T23:58:08.791897+0000","last_clean":"2024-09-15T23:58:08.791897+0000","last_became_active":"2024-09-15T23:58:06.743512+0000","last_became_peered":"2024-09-15T23:58:06.743512+0000","last_unstale":"2024-09-15T23:58:08.791897+0000","last_undegraded":"2024-09-15T23:58:08.791897+0000","last_fullsized":"2024-09-15T23:58:08.791897+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:38.845066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126282+0000","last_change":"2024-09-15T23:58:07.787170+0000","last_active":"2024-09-15T23:58:09.126282+0000","last_peered":"2024-09-15T23:58:09.126282+0000","last_clean":"2024-09-15T23:58:09.126282+0000","last_became_active":"2024-09-15T23:58:07.786487+0000","last_became_peered":"2024-09-15T23:58:07.786487+0000","last_unstale":"2024-09-15T23:58:09.126282+0000","last_undegraded":"2024-09-15T23:58:09.126282+0000","last_fullsized":"2024-09-15T23:58:09.126282+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:54.922033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"96'6","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128875+0000","last_change":"2024-09-15T23:58:06.735492+0000","last_active":"2024-09-15T23:58:09.128875+0000","last_peered":"2024-09-15T23:58:09.128875+0000","last_clean":"2024-09-15T23:58:09.128875+0000","last_became_active":"2024-09-15T23:58:06.734834+0000","last_became_peered":"2024-09-15T23:58:06.734834+0000","last_unstale":"2024-09-15T23:58:09.128875+0000","last_undegraded":"2024-09-15T23:58:09.128875+0000","last_fullsized":"2024-09-15T23:58:09.128875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:26.410446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753230+0000","last_change":"2024-09-15T23:58:07.799903+0000","last_active":"2024-09-15T23:58:08.753230+0000","last_peered":"2024-09-15T23:58:08.753230+0000","last_clean":"2024-09-15T23:58:08.753230+0000","last_became_active":"2024-09-15T23:58:07.799564+0000","last_became_peered":"2024-09-15T23:58:07.799564+0000","last_unstale":"2024-09-15T23:58:08.753230+0000","last_undegraded":"2024-09-15T23:58:08.753230+0000","last_fullsized":"2024-09-15T23:58:08.753230+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:09.804410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756456+0000","last_change":"2024-09-15T23:58:06.753728+0000","last_active":"2024-09-15T23:58:08.756456+0000","last_peered":"2024-09-15T23:58:08.756456+0000","last_clean":"2024-09-15T23:58:08.756456+0000","last_became_active":"2024-09-15T23:58:06.753064+0000","last_became_peered":"2024-09-15T23:58:06.753064+0000","last_unstale":"2024-09-15T23:58:08.756456+0000","last_undegraded":"2024-09-15T23:58:08.756456+0000","last_fullsized":"2024-09-15T23:58:08.756456+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:37.947511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753219+0000","last_change":"2024-09-15T23:58:07.758875+0000","last_active":"2024-09-15T23:58:08.753219+0000","last_peered":"2024-09-15T23:58:08.753219+0000","last_clean":"2024-09-15T23:58:08.753219+0000","last_became_active":"2024-09-15T23:58:07.756469+0000","last_became_peered":"2024-09-15T23:58:07.756469+0000","last_unstale":"2024-09-15T23:58:08.753219+0000","last_undegraded":"2024-09-15T23:58:08.753219+0000","last_fullsized":"2024-09-15T23:58:08.753219+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:39.856367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758820+0000","last_change":"2024-09-15T23:58:06.730917+0000","last_active":"2024-09-15T23:58:08.758820+0000","last_peered":"2024-09-15T23:58:08.758820+0000","last_clean":"2024-09-15T23:58:08.758820+0000","last_became_active":"2024-09-15T23:58:06.730153+0000","last_became_peered":"2024-09-15T23:58:06.730153+0000","last_unstale":"2024-09-15T23:58:08.758820+0000","last_undegraded":"2024-09-15T23:58:08.758820+0000","last_fullsized":"2024-09-15T23:58:08.758820+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:06.203702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126587+0000","last_change":"2024-09-15T23:58:07.784939+0000","last_active":"2024-09-15T23:58:09.126587+0000","last_peered":"2024-09-15T23:58:09.126587+0000","last_clean":"2024-09-15T23:58:09.126587+0000","last_became_active":"2024-09-15T23:58:07.783654+0000","last_became_peered":"2024-09-15T23:58:07.783654+0000","last_unstale":"2024-09-15T23:58:09.126587+0000","last_undegraded":"2024-09-15T23:58:09.126587+0000","last_fullsized":"2024-09-15T23:58:09.126587+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:42.052614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756142+0000","last_change":"2024-09-15T23:58:06.733047+0000","last_active":"2024-09-15T23:58:08.756142+0000","last_peered":"2024-09-15T23:58:08.756142+0000","last_clean":"2024-09-15T23:58:08.756142+0000","last_became_active":"2024-09-15T23:58:06.732148+0000","last_became_peered":"2024-09-15T23:58:06.732148+0000","last_unstale":"2024-09-15T23:58:08.756142+0000","last_undegraded":"2024-09-15T23:58:08.756142+0000","last_fullsized":"2024-09-15T23:58:08.756142+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:33.404685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.726429+0000","last_change":"2024-09-15T23:58:06.726429+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.726429+0000","last_undegraded":"2024-09-15T23:58:06.726429+0000","last_fullsized":"2024-09-15T23:58:06.726429+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"96'8","reported_seq":22,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.127657+0000","last_change":"2024-09-15T23:58:06.732340+0000","last_active":"2024-09-15T23:58:09.127657+0000","last_peered":"2024-09-15T23:58:09.127657+0000","last_clean":"2024-09-15T23:58:09.127657+0000","last_became_active":"2024-09-15T23:58:06.732080+0000","last_became_peered":"2024-09-15T23:58:06.732080+0000","last_unstale":"2024-09-15T23:58:09.127657+0000","last_undegraded":"2024-09-15T23:58:09.127657+0000","last_fullsized":"2024-09-15T23:58:09.127657+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:45.077686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758512+0000","last_change":"2024-09-15T23:58:07.770015+0000","last_active":"2024-09-15T23:58:08.758512+0000","last_peered":"2024-09-15T23:58:08.758512+0000","last_clean":"2024-09-15T23:58:08.758512+0000","last_became_active":"2024-09-15T23:58:07.769509+0000","last_became_peered":"2024-09-15T23:58:07.769509+0000","last_unstale":"2024-09-15T23:58:08.758512+0000","last_undegraded":"2024-09-15T23:58:08.758512+0000","last_fullsized":"2024-09-15T23:58:08.758512+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:26.451417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791651+0000","last_change":"2024-09-15T23:58:06.722578+0000","last_active":"2024-09-15T23:58:08.791651+0000","last_peered":"2024-09-15T23:58:08.791651+0000","last_clean":"2024-09-15T23:58:08.791651+0000","last_became_active":"2024-09-15T23:58:06.722138+0000","last_became_peered":"2024-09-15T23:58:06.722138+0000","last_unstale":"2024-09-15T23:58:08.791651+0000","last_undegraded":"2024-09-15T23:58:08.791651+0000","last_fullsized":"2024-09-15T23:58:08.791651+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:35.696453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129439+0000","last_change":"2024-09-15T23:58:07.776105+0000","last_active":"2024-09-15T23:58:09.129439+0000","last_peered":"2024-09-15T23:58:09.129439+0000","last_clean":"2024-09-15T23:58:09.129439+0000","last_became_active":"2024-09-15T23:58:07.775809+0000","last_became_peered":"2024-09-15T23:58:07.775809+0000","last_unstale":"2024-09-15T23:58:09.129439+0000","last_undegraded":"2024-09-15T23:58:09.129439+0000","last_fullsized":"2024-09-15T23:58:09.129439+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:36.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.d","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129069+0000","last_change":"2024-09-15T23:58:06.738994+0000","last_active":"2024-09-15T23:58:09.129069+0000","last_peered":"2024-09-15T23:58:09.129069+0000","last_clean":"2024-09-15T23:58:09.129069+0000","last_became_active":"2024-09-15T23:58:06.738495+0000","last_became_peered":"2024-09-15T23:58:06.738495+0000","last_unstale":"2024-09-15T23:58:09.129069+0000","last_undegraded":"2024-09-15T23:58:09.129069+0000","last_fullsized":"2024-09-15T23:58:09.129069+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:44.651235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126141+0000","last_change":"2024-09-15T23:58:07.782366+0000","last_active":"2024-09-15T23:58:09.126141+0000","last_peered":"2024-09-15T23:58:09.126141+0000","last_clean":"2024-09-15T23:58:09.126141+0000","last_became_active":"2024-09-15T23:58:07.781871+0000","last_became_peered":"2024-09-15T23:58:07.781871+0000","last_unstale":"2024-09-15T23:58:09.126141+0000","last_undegraded":"2024-09-15T23:58:09.126141+0000","last_fullsized":"2024-09-15T23:58:09.126141+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:21.361174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791312+0000","last_change":"2024-09-15T23:58:06.723437+0000","last_active":"2024-09-15T23:58:08.791312+0000","last_peered":"2024-09-15T23:58:08.791312+0000","last_clean":"2024-09-15T23:58:08.791312+0000","last_became_active":"2024-09-15T23:58:06.722488+0000","last_became_peered":"2024-09-15T23:58:06.722488+0000","last_unstale":"2024-09-15T23:58:08.791312+0000","last_undegraded":"2024-09-15T23:58:08.791312+0000","last_fullsized":"2024-09-15T23:58:08.791312+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:08.793109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757296+0000","last_change":"2024-09-15T23:58:07.791345+0000","last_active":"2024-09-15T23:58:08.757296+0000","last_peered":"2024-09-15T23:58:08.757296+0000","last_clean":"2024-09-15T23:58:08.757296+0000","last_became_active":"2024-09-15T23:58:07.781515+0000","last_became_peered":"2024-09-15T23:58:07.781515+0000","last_unstale":"2024-09-15T23:58:08.757296+0000","last_undegraded":"2024-09-15T23:58:08.757296+0000","last_fullsized":"2024-09-15T23:58:08.757296+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:55.061923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753593+0000","last_change":"2024-09-15T23:58:06.742316+0000","last_active":"2024-09-15T23:58:06.753593+0000","last_peered":"2024-09-15T23:58:06.753593+0000","last_clean":"2024-09-15T23:58:06.753593+0000","last_became_active":"2024-09-15T23:58:06.741127+0000","last_became_peered":"2024-09-15T23:58:06.741127+0000","last_unstale":"2024-09-15T23:58:06.753593+0000","last_undegraded":"2024-09-15T23:58:06.753593+0000","last_fullsized":"2024-09-15T23:58:06.753593+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:41.281238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126663+0000","last_change":"2024-09-15T23:58:07.795069+0000","last_active":"2024-09-15T23:58:09.126663+0000","last_peered":"2024-09-15T23:58:09.126663+0000","last_clean":"2024-09-15T23:58:09.126663+0000","last_became_active":"2024-09-15T23:58:07.794212+0000","last_became_peered":"2024-09-15T23:58:07.794212+0000","last_unstale":"2024-09-15T23:58:09.126663+0000","last_undegraded":"2024-09-15T23:58:09.126663+0000","last_fullsized":"2024-09-15T23:58:09.126663+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:23.262308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753608+0000","last_change":"2024-09-15T23:58:06.747941+0000","last_active":"2024-09-15T23:58:06.753608+0000","last_peered":"2024-09-15T23:58:06.753608+0000","last_clean":"2024-09-15T23:58:06.753608+0000","last_became_active":"2024-09-15T23:58:06.747101+0000","last_became_peered":"2024-09-15T23:58:06.747101+0000","last_unstale":"2024-09-15T23:58:06.753608+0000","last_undegraded":"2024-09-15T23:58:06.753608+0000","last_fullsized":"2024-09-15T23:58:06.753608+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:01.213481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126526+0000","last_change":"2024-09-15T23:58:07.775709+0000","last_active":"2024-09-15T23:58:09.126526+0000","last_peered":"2024-09-15T23:58:09.126526+0000","last_clean":"2024-09-15T23:58:09.126526+0000","last_became_active":"2024-09-15T23:58:07.774896+0000","last_became_peered":"2024-09-15T23:58:07.774896+0000","last_unstale":"2024-09-15T23:58:09.126526+0000","last_undegraded":"2024-09-15T23:58:09.126526+0000","last_fullsized":"2024-09-15T23:58:09.126526+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:42.839656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791159+0000","last_change":"2024-09-15T23:58:06.732322+0000","last_active":"2024-09-15T23:58:08.791159+0000","last_peered":"2024-09-15T23:58:08.791159+0000","last_clean":"2024-09-15T23:58:08.791159+0000","last_became_active":"2024-09-15T23:58:06.731337+0000","last_became_peered":"2024-09-15T23:58:06.731337+0000","last_unstale":"2024-09-15T23:58:08.791159+0000","last_undegraded":"2024-09-15T23:58:08.791159+0000","last_fullsized":"2024-09-15T23:58:08.791159+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:00.946105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757489+0000","last_change":"2024-09-15T23:58:07.769923+0000","last_active":"2024-09-15T23:58:08.757489+0000","last_peered":"2024-09-15T23:58:08.757489+0000","last_clean":"2024-09-15T23:58:08.757489+0000","last_became_active":"2024-09-15T23:58:07.769057+0000","last_became_peered":"2024-09-15T23:58:07.769057+0000","last_unstale":"2024-09-15T23:58:08.757489+0000","last_undegraded":"2024-09-15T23:58:08.757489+0000","last_fullsized":"2024-09-15T23:58:08.757489+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:25.029723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758016+0000","last_change":"2024-09-15T23:58:06.737190+0000","last_active":"2024-09-15T23:58:08.758016+0000","last_peered":"2024-09-15T23:58:08.758016+0000","last_clean":"2024-09-15T23:58:08.758016+0000","last_became_active":"2024-09-15T23:58:06.736804+0000","last_became_peered":"2024-09-15T23:58:06.736804+0000","last_unstale":"2024-09-15T23:58:08.758016+0000","last_undegraded":"2024-09-15T23:58:08.758016+0000","last_fullsized":"2024-09-15T23:58:08.758016+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:30.329573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.125911+0000","last_change":"2024-09-15T23:58:07.775890+0000","last_active":"2024-09-15T23:58:09.125911+0000","last_peered":"2024-09-15T23:58:09.125911+0000","last_clean":"2024-09-15T23:58:09.125911+0000","last_became_active":"2024-09-15T23:58:07.774559+0000","last_became_peered":"2024-09-15T23:58:07.774559+0000","last_unstale":"2024-09-15T23:58:09.125911+0000","last_undegraded":"2024-09-15T23:58:09.125911+0000","last_fullsized":"2024-09-15T23:58:09.125911+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:12.409978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.752582+0000","last_change":"2024-09-15T23:58:06.746347+0000","last_active":"2024-09-15T23:58:06.752582+0000","last_peered":"2024-09-15T23:58:06.752582+0000","last_clean":"2024-09-15T23:58:06.752582+0000","last_became_active":"2024-09-15T23:58:06.742108+0000","last_became_peered":"2024-09-15T23:58:06.742108+0000","last_unstale":"2024-09-15T23:58:06.752582+0000","last_undegraded":"2024-09-15T23:58:06.752582+0000","last_fullsized":"2024-09-15T23:58:06.752582+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:20.013521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129655+0000","last_change":"2024-09-15T23:58:07.766829+0000","last_active":"2024-09-15T23:58:09.129655+0000","last_peered":"2024-09-15T23:58:09.129655+0000","last_clean":"2024-09-15T23:58:09.129655+0000","last_became_active":"2024-09-15T23:58:07.766205+0000","last_became_peered":"2024-09-15T23:58:07.766205+0000","last_unstale":"2024-09-15T23:58:09.129655+0000","last_undegraded":"2024-09-15T23:58:09.129655+0000","last_fullsized":"2024-09-15T23:58:09.129655+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:53.825799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.752630+0000","last_change":"2024-09-15T23:58:06.746464+0000","last_active":"2024-09-15T23:58:06.752630+0000","last_peered":"2024-09-15T23:58:06.752630+0000","last_clean":"2024-09-15T23:58:06.752630+0000","last_became_active":"2024-09-15T23:58:06.741814+0000","last_became_peered":"2024-09-15T23:58:06.741814+0000","last_unstale":"2024-09-15T23:58:06.752630+0000","last_undegraded":"2024-09-15T23:58:06.752630+0000","last_fullsized":"2024-09-15T23:58:06.752630+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:43.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758539+0000","last_change":"2024-09-15T23:58:07.760444+0000","last_active":"2024-09-15T23:58:08.758539+0000","last_peered":"2024-09-15T23:58:08.758539+0000","last_clean":"2024-09-15T23:58:08.758539+0000","last_became_active":"2024-09-15T23:58:07.759706+0000","last_became_peered":"2024-09-15T23:58:07.759706+0000","last_unstale":"2024-09-15T23:58:08.758539+0000","last_undegraded":"2024-09-15T23:58:08.758539+0000","last_fullsized":"2024-09-15T23:58:08.758539+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:36.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128487+0000","last_change":"2024-09-15T23:58:06.738930+0000","last_active":"2024-09-15T23:58:09.128487+0000","last_peered":"2024-09-15T23:58:09.128487+0000","last_clean":"2024-09-15T23:58:09.128487+0000","last_became_active":"2024-09-15T23:58:06.737965+0000","last_became_peered":"2024-09-15T23:58:06.737965+0000","last_unstale":"2024-09-15T23:58:09.128487+0000","last_undegraded":"2024-09-15T23:58:09.128487+0000","last_fullsized":"2024-09-15T23:58:09.128487+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:27.303288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128573+0000","last_change":"2024-09-15T23:58:07.771056+0000","last_active":"2024-09-15T23:58:09.128573+0000","last_peered":"2024-09-15T23:58:09.128573+0000","last_clean":"2024-09-15T23:58:09.128573+0000","last_became_active":"2024-09-15T23:58:07.770335+0000","last_became_peered":"2024-09-15T23:58:07.770335+0000","last_unstale":"2024-09-15T23:58:09.128573+0000","last_undegraded":"2024-09-15T23:58:09.128573+0000","last_fullsized":"2024-09-15T23:58:09.128573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:00.705487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757220+0000","last_change":"2024-09-15T23:58:06.733282+0000","last_active":"2024-09-15T23:58:08.757220+0000","last_peered":"2024-09-15T23:58:08.757220+0000","last_clean":"2024-09-15T23:58:08.757220+0000","last_became_active":"2024-09-15T23:58:06.731829+0000","last_became_peered":"2024-09-15T23:58:06.731829+0000","last_unstale":"2024-09-15T23:58:08.757220+0000","last_undegraded":"2024-09-15T23:58:08.757220+0000","last_fullsized":"2024-09-15T23:58:08.757220+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:37.214555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756733+0000","last_change":"2024-09-15T23:58:07.796182+0000","last_active":"2024-09-15T23:58:08.756733+0000","last_peered":"2024-09-15T23:58:08.756733+0000","last_clean":"2024-09-15T23:58:08.756733+0000","last_became_active":"2024-09-15T23:58:07.783093+0000","last_became_peered":"2024-09-15T23:58:07.783093+0000","last_unstale":"2024-09-15T23:58:08.756733+0000","last_undegraded":"2024-09-15T23:58:08.756733+0000","last_fullsized":"2024-09-15T23:58:08.756733+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:01.714283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129162+0000","last_change":"2024-09-15T23:58:06.736436+0000","last_active":"2024-09-15T23:58:09.129162+0000","last_peered":"2024-09-15T23:58:09.129162+0000","last_clean":"2024-09-15T23:58:09.129162+0000","last_became_active":"2024-09-15T23:58:06.736078+0000","last_became_peered":"2024-09-15T23:58:06.736078+0000","last_unstale":"2024-09-15T23:58:09.129162+0000","last_undegraded":"2024-09-15T23:58:09.129162+0000","last_fullsized":"2024-09-15T23:58:09.129162+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:49.214605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756427+0000","last_change":"2024-09-15T23:58:07.791074+0000","last_active":"2024-09-15T23:58:08.756427+0000","last_peered":"2024-09-15T23:58:08.756427+0000","last_clean":"2024-09-15T23:58:08.756427+0000","last_became_active":"2024-09-15T23:58:07.782975+0000","last_became_peered":"2024-09-15T23:58:07.782975+0000","last_unstale":"2024-09-15T23:58:08.756427+0000","last_undegraded":"2024-09-15T23:58:08.756427+0000","last_fullsized":"2024-09-15T23:58:08.756427+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:22.748219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753553+0000","last_change":"2024-09-15T23:58:06.747357+0000","last_active":"2024-09-15T23:58:06.753553+0000","last_peered":"2024-09-15T23:58:06.753553+0000","last_clean":"2024-09-15T23:58:06.753553+0000","last_became_active":"2024-09-15T23:58:06.746786+0000","last_became_peered":"2024-09-15T23:58:06.746786+0000","last_unstale":"2024-09-15T23:58:06.753553+0000","last_undegraded":"2024-09-15T23:58:06.753553+0000","last_fullsized":"2024-09-15T23:58:06.753553+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:16.498783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791793+0000","last_change":"2024-09-15T23:58:07.781892+0000","last_active":"2024-09-15T23:58:08.791793+0000","last_peered":"2024-09-15T23:58:08.791793+0000","last_clean":"2024-09-15T23:58:08.791793+0000","last_became_active":"2024-09-15T23:58:07.781560+0000","last_became_peered":"2024-09-15T23:58:07.781560+0000","last_unstale":"2024-09-15T23:58:08.791793+0000","last_undegraded":"2024-09-15T23:58:08.791793+0000","last_fullsized":"2024-09-15T23:58:08.791793+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:38.958811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128120+0000","last_change":"2024-09-15T23:58:06.734272+0000","last_active":"2024-09-15T23:58:09.128120+0000","last_peered":"2024-09-15T23:58:09.128120+0000","last_clean":"2024-09-15T23:58:09.128120+0000","last_became_active":"2024-09-15T23:58:06.734020+0000","last_became_peered":"2024-09-15T23:58:06.734020+0000","last_unstale":"2024-09-15T23:58:09.128120+0000","last_undegraded":"2024-09-15T23:58:09.128120+0000","last_fullsized":"2024-09-15T23:58:09.128120+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:30.329573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753804+0000","last_change":"2024-09-15T23:58:07.772545+0000","last_active":"2024-09-15T23:58:08.753804+0000","last_peered":"2024-09-15T23:58:08.753804+0000","last_clean":"2024-09-15T23:58:08.753804+0000","last_became_active":"2024-09-15T23:58:07.772139+0000","last_became_peered":"2024-09-15T23:58:07.772139+0000","last_unstale":"2024-09-15T23:58:08.753804+0000","last_undegraded":"2024-09-15T23:58:08.753804+0000","last_fullsized":"2024-09-15T23:58:08.753804+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:01.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753650+0000","last_change":"2024-09-15T23:58:06.748574+0000","last_active":"2024-09-15T23:58:06.753650+0000","last_peered":"2024-09-15T23:58:06.753650+0000","last_clean":"2024-09-15T23:58:06.753650+0000","last_became_active":"2024-09-15T23:58:06.740503+0000","last_became_peered":"2024-09-15T23:58:06.740503+0000","last_unstale":"2024-09-15T23:58:06.753650+0000","last_undegraded":"2024-09-15T23:58:06.753650+0000","last_fullsized":"2024-09-15T23:58:06.753650+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:59.706046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791109+0000","last_change":"2024-09-15T23:58:07.778092+0000","last_active":"2024-09-15T23:58:08.791109+0000","last_peered":"2024-09-15T23:58:08.791109+0000","last_clean":"2024-09-15T23:58:08.791109+0000","last_became_active":"2024-09-15T23:58:07.775739+0000","last_became_peered":"2024-09-15T23:58:07.775739+0000","last_unstale":"2024-09-15T23:58:08.791109+0000","last_undegraded":"2024-09-15T23:58:08.791109+0000","last_fullsized":"2024-09-15T23:58:08.791109+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:22:00.044070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756867+0000","last_change":"2024-09-15T23:58:06.737213+0000","last_active":"2024-09-15T23:58:08.756867+0000","last_peered":"2024-09-15T23:58:08.756867+0000","last_clean":"2024-09-15T23:58:08.756867+0000","last_became_active":"2024-09-15T23:58:06.736308+0000","last_became_peered":"2024-09-15T23:58:06.736308+0000","last_unstale":"2024-09-15T23:58:08.756867+0000","last_undegraded":"2024-09-15T23:58:08.756867+0000","last_fullsized":"2024-09-15T23:58:08.756867+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:53.980679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":309,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128100+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:58:09.128100+0000","last_peered":"2024-09-15T23:58:09.128100+0000","last_clean":"2024-09-15T23:58:09.128100+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:58:09.128100+0000","last_undegraded":"2024-09-15T23:58:09.128100+0000","last_fullsized":"2024-09-15T23:58:09.128100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1191936,"data_stored":540950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1196032,"data_stored":541910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":547024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36520,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335320,"statfs":{"total":96636764160,"available":96599367680,"internally_reserved":0,"allocated":1196032,"data_stored":541910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1204224,"data_stored":547102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1130758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":547572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37068,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334772,"statfs":{"total":96636764160,"available":96598806528,"internally_reserved":0,"allocated":1753088,"data_stored":1116832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:58:12.439 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3d is not active+clean 2024-09-15T23:58:12.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 95, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:58:06.722018+0000', 'last_change': '2024-09-15T23:58:06.722018+0000', 'last_active': '2024-09-15T23:58:06.696451+0000', 'last_peered': '2024-09-15T23:58:06.696451+0000', 'last_clean': '2024-09-15T23:58:06.696451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:58:06.722018+0000', 'last_undegraded': '2024-09-15T23:58:06.722018+0000', 'last_fullsized': '2024-09-15T23:58:06.722018+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'last_clean_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:58:12.439 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2f is not active+clean 2024-09-15T23:58:12.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 95, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:58:06.727455+0000', 'last_change': '2024-09-15T23:58:06.727455+0000', 'last_active': '2024-09-15T23:58:06.696451+0000', 'last_peered': '2024-09-15T23:58:06.696451+0000', 'last_clean': '2024-09-15T23:58:06.696451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:58:06.727455+0000', 'last_undegraded': '2024-09-15T23:58:06.727455+0000', 'last_fullsized': '2024-09-15T23:58:06.727455+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'last_clean_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:58:12.439 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2b is not active+clean 2024-09-15T23:58:12.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 95, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:58:06.726154+0000', 'last_change': '2024-09-15T23:58:06.726154+0000', 'last_active': '2024-09-15T23:58:06.696451+0000', 'last_peered': '2024-09-15T23:58:06.696451+0000', 'last_clean': '2024-09-15T23:58:06.696451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:58:06.726154+0000', 'last_undegraded': '2024-09-15T23:58:06.726154+0000', 'last_fullsized': '2024-09-15T23:58:06.726154+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'last_clean_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:58:12.439 INFO:tasks.ceph.ceph_manager.ceph:PG 16.0 is not active+clean 2024-09-15T23:58:12.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 95, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:58:06.720275+0000', 'last_change': '2024-09-15T23:58:06.720275+0000', 'last_active': '2024-09-15T23:58:06.696451+0000', 'last_peered': '2024-09-15T23:58:06.696451+0000', 'last_clean': '2024-09-15T23:58:06.696451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:58:06.720275+0000', 'last_undegraded': '2024-09-15T23:58:06.720275+0000', 'last_fullsized': '2024-09-15T23:58:06.720275+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'last_clean_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:58:12.440 INFO:tasks.ceph.ceph_manager.ceph:PG 16.f is not active+clean 2024-09-15T23:58:12.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 95, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:58:06.726429+0000', 'last_change': '2024-09-15T23:58:06.726429+0000', 'last_active': '2024-09-15T23:58:06.696451+0000', 'last_peered': '2024-09-15T23:58:06.696451+0000', 'last_clean': '2024-09-15T23:58:06.696451+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:58:06.726429+0000', 'last_undegraded': '2024-09-15T23:58:06.726429+0000', 'last_fullsized': '2024-09-15T23:58:06.726429+0000', 'mapping_epoch': 95, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 95, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'last_clean_scrub_stamp': '2024-09-15T23:58:06.696451+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:58:12.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:58:12.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.597+0000 7f05c6ba3640 1 Processor -- start 2024-09-15T23:58:12.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.597+0000 7f05c6ba3640 1 -- start start 2024-09-15T23:58:12.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.597+0000 7f05c6ba3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05c00b39a0 0x7f05c006df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.597+0000 7f05c6ba3640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f05c006e4b0 0x7f05c0072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.597+0000 7f05c6ba3640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c006ec60 con 0x7f05c01587a0 2024-09-15T23:58:12.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.597+0000 7f05c6ba3640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f05c006f870 con 0x7f05c00b39a0 2024-09-15T23:58:12.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.597+0000 7f05c6ba3640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f05c006ef40 con 0x7f05c006e4b0 2024-09-15T23:58:12.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.597+0000 7f05bffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05c00b39a0 0x7f05c006df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.597+0000 7f05bffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f05c00b39a0 0x7f05c006df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59814/0 (socket says 172.21.15.112:59814) 2024-09-15T23:58:12.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.597+0000 7f05bffff640 1 -- 172.21.15.112:0/751019097 learned_addr learned my addr 172.21.15.112:0/751019097 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:12.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05c5140640 1 --2- 172.21.15.112:0/751019097 >> v2:172.21.15.169:3300/0 conn(0x7f05c006e4b0 0x7f05c0072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05bffff640 1 -- 172.21.15.112:0/751019097 >> v2:172.21.15.169:3300/0 conn(0x7f05c006e4b0 msgr2=0x7f05c0072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:12.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05bffff640 1 --2- 172.21.15.112:0/751019097 >> v2:172.21.15.169:3300/0 conn(0x7f05c006e4b0 0x7f05c0072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05bffff640 1 -- 172.21.15.112:0/751019097 >> v1:172.21.15.169:6789/0 conn(0x7f05c01587a0 legacy=0x7f05c00b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:12.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05bffff640 1 -- 172.21.15.112:0/751019097 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c006f220 con 0x7f05c00b39a0 2024-09-15T23:58:12.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05c5140640 1 --2- 172.21.15.112:0/751019097 >> v2:172.21.15.169:3300/0 conn(0x7f05c006e4b0 0x7f05c0072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:12.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05bffff640 1 --2- 172.21.15.112:0/751019097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c00b39a0 0x7f05c006df70 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f05c015e860 tx=0x7f05b401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a520f8ef9aef893 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:12.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05bf7fe640 1 -- 172.21.15.112:0/751019097 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b40b1070 con 0x7f05c00b39a0 2024-09-15T23:58:12.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05bf7fe640 1 -- 172.21.15.112:0/751019097 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b40a8050 con 0x7f05c00b39a0 2024-09-15T23:58:12.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05bf7fe640 1 -- 172.21.15.112:0/751019097 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b40ac860 con 0x7f05c00b39a0 2024-09-15T23:58:12.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05c6ba3640 1 -- 172.21.15.112:0/751019097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c00b39a0 msgr2=0x7f05c006df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05c6ba3640 1 --2- 172.21.15.112:0/751019097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c00b39a0 0x7f05c006df70 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f05c015e860 tx=0x7f05b401c4b0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05c6ba3640 1 -- 172.21.15.112:0/751019097 shutdown_connections 2024-09-15T23:58:12.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05c6ba3640 1 --2- 172.21.15.112:0/751019097 >> v2:172.21.15.169:3300/0 conn(0x7f05c006e4b0 0x7f05c0072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05c6ba3640 1 --2- 172.21.15.112:0/751019097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c00b39a0 0x7f05c006df70 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05c6ba3640 1 -- 172.21.15.112:0/751019097 >> 172.21.15.112:0/751019097 conn(0x7f05c00b1f90 msgr2=0x7f05c00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:12.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05c6ba3640 1 -- 172.21.15.112:0/751019097 shutdown_connections 2024-09-15T23:58:12.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.601+0000 7f05c6ba3640 1 -- 172.21.15.112:0/751019097 wait complete. 2024-09-15T23:58:12.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c6ba3640 1 Processor -- start 2024-09-15T23:58:12.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c6ba3640 1 -- start start 2024-09-15T23:58:12.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c6ba3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c006e4b0 0x7f05c014f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c6ba3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05c00b39a0 0x7f05c01513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c6ba3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05c01587a0 0x7f05c0147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c6ba3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f05c0073030 con 0x7f05c006e4b0 2024-09-15T23:58:12.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c6ba3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05c0072eb0 con 0x7f05c01587a0 2024-09-15T23:58:12.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c6ba3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f05c00731b0 con 0x7f05c00b39a0 2024-09-15T23:58:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c493f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c006e4b0 0x7f05c014f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c493f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c006e4b0 0x7f05c014f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59820/0 (socket says 172.21.15.112:59820) 2024-09-15T23:58:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c493f640 1 -- 172.21.15.112:0/3165542632 learned_addr learned my addr 172.21.15.112:0/3165542632 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c5140640 1 --2- 172.21.15.112:0/3165542632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05c01587a0 0x7f05c0147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05bffff640 1 --2- 172.21.15.112:0/3165542632 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05c00b39a0 0x7f05c01513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c493f640 1 -- 172.21.15.112:0/3165542632 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05c00b39a0 msgr2=0x7f05c01513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c493f640 1 --2- 172.21.15.112:0/3165542632 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05c00b39a0 0x7f05c01513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c493f640 1 -- 172.21.15.112:0/3165542632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05c01587a0 msgr2=0x7f05c0147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c493f640 1 --2- 172.21.15.112:0/3165542632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05c01587a0 0x7f05c0147680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c493f640 1 -- 172.21.15.112:0/3165542632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c0151930 con 0x7f05c006e4b0 2024-09-15T23:58:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c493f640 1 --2- 172.21.15.112:0/3165542632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c006e4b0 0x7f05c014f770 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f05b000b410 tx=0x7f05b000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05bd7fa640 1 -- 172.21.15.112:0/3165542632 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0015030 con 0x7f05c006e4b0 2024-09-15T23:58:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05bd7fa640 1 -- 172.21.15.112:0/3165542632 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b0004020 con 0x7f05c006e4b0 2024-09-15T23:58:12.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c6ba3640 1 -- 172.21.15.112:0/3165542632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c014fd50 con 0x7f05c006e4b0 2024-09-15T23:58:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05bd7fa640 1 -- 172.21.15.112:0/3165542632 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0004450 con 0x7f05c006e4b0 2024-09-15T23:58:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c6ba3640 1 -- 172.21.15.112:0/3165542632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c0150310 con 0x7f05c006e4b0 2024-09-15T23:58:12.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05c6ba3640 1 -- 172.21.15.112:0/3165542632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c0072160 con 0x7f05c006e4b0 2024-09-15T23:58:12.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05bd7fa640 1 -- 172.21.15.112:0/3165542632 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f05b0018070 con 0x7f05c006e4b0 2024-09-15T23:58:12.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05bd7fa640 1 --2- 172.21.15.112:0/3165542632 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f05ac0678c0 0x7f05ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.605+0000 7f05bd7fa640 1 -- 172.21.15.112:0/3165542632 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f05b00858e0 con 0x7f05c006e4b0 2024-09-15T23:58:12.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.609+0000 7f05bffff640 1 --2- 172.21.15.112:0/3165542632 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f05ac0678c0 0x7f05ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.609+0000 7f05bffff640 1 --2- 172.21.15.112:0/3165542632 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f05ac0678c0 0x7f05ac069d80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f05b40ae000 tx=0x7f05b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:12.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.613+0000 7f05bd7fa640 1 -- 172.21.15.112:0/3165542632 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f05b0056320 con 0x7f05c006e4b0 2024-09-15T23:58:12.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.833+0000 7f05c6ba3640 1 -- 172.21.15.112:0/3165542632 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f05c0070080 con 0x7f05c006e4b0 2024-09-15T23:58:12.835 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.833+0000 7f05bd7fa640 1 -- 172.21.15.112:0/3165542632 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1560 (secure 0 0 0) 0x7f05b0055c20 con 0x7f05c006e4b0 2024-09-15T23:58:12.835 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:12.836 INFO:teuthology.orchestra.run.smithi112.stdout:{"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":286,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":97,"num_osds":8,"num_up_osds":8,"osd_up_since":1726444419,"num_in_osds":8,"osd_in_since":1726444408,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"creating+peering","count":5}],"num_pgs":97,"num_pools":3,"num_objects":21,"data_bytes":592778,"bytes_used":274767872,"bytes_avail":772819345408,"bytes_total":773094113280,"inactive_pgs_ratio":0.051546391099691391,"write_bytes_sec":2553,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":55,"btime":"2024-09-15T23:58:10:787850+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":6711}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-15T23:57:57.309874+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:58:12.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.837+0000 7f05c6ba3640 1 -- 172.21.15.112:0/3165542632 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f05ac0678c0 msgr2=0x7f05ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.837+0000 7f05c6ba3640 1 --2- 172.21.15.112:0/3165542632 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f05ac0678c0 0x7f05ac069d80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f05b40ae000 tx=0x7f05b4008040 comp rx=0 tx=0).stop 2024-09-15T23:58:12.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.837+0000 7f05c6ba3640 1 -- 172.21.15.112:0/3165542632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c006e4b0 msgr2=0x7f05c014f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.837+0000 7f05c6ba3640 1 --2- 172.21.15.112:0/3165542632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c006e4b0 0x7f05c014f770 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f05b000b410 tx=0x7f05b000b8d0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.837+0000 7f05c6ba3640 1 -- 172.21.15.112:0/3165542632 shutdown_connections 2024-09-15T23:58:12.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.837+0000 7f05c6ba3640 1 --2- 172.21.15.112:0/3165542632 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f05ac0678c0 0x7f05ac069d80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.837+0000 7f05c6ba3640 1 --2- 172.21.15.112:0/3165542632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05c01587a0 0x7f05c0147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.837+0000 7f05c6ba3640 1 --2- 172.21.15.112:0/3165542632 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05c00b39a0 0x7f05c01513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.837+0000 7f05c6ba3640 1 --2- 172.21.15.112:0/3165542632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05c006e4b0 0x7f05c014f770 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.837+0000 7f05c6ba3640 1 -- 172.21.15.112:0/3165542632 >> 172.21.15.112:0/3165542632 conn(0x7f05c00b1f90 msgr2=0x7f05c00b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.837+0000 7f05c6ba3640 1 -- 172.21.15.112:0/3165542632 shutdown_connections 2024-09-15T23:58:12.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.837+0000 7f05c6ba3640 1 -- 172.21.15.112:0/3165542632 wait complete. 2024-09-15T23:58:12.855 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:58:12.855 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:58:12.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.965+0000 7fb9253b5640 1 Processor -- start 2024-09-15T23:58:12.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.965+0000 7fb9253b5640 1 -- start start 2024-09-15T23:58:12.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb9253b5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb92015c2a0 0x7fb9200aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb9253b5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb9200af2a0 0x7fb92006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb9253b5640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9200b3290 con 0x7fb92015bec0 2024-09-15T23:58:12.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb9253b5640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb9200b3570 con 0x7fb9200af2a0 2024-09-15T23:58:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb9253b5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb9200b3850 con 0x7fb92015c2a0 2024-09-15T23:58:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb91effd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb92015bec0 0x7fb9200ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58666/0 (socket says 172.21.15.112:58666) 2024-09-15T23:58:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb91effd640 1 -- 172.21.15.112:0/2200586502 learned_addr learned my addr 172.21.15.112:0/2200586502 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb91f7fe640 1 --2- 172.21.15.112:0/2200586502 >> v2:172.21.15.112:3300/0 conn(0x7fb9200af2a0 0x7fb92006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb91e7fc640 1 --2- 172.21.15.112:0/2200586502 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb92015c2a0 0x7fb9200aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb91dffb640 1 -- 172.21.15.112:0/2200586502 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 135641632 0 0) 0x7fb9200b3290 con 0x7fb92015bec0 2024-09-15T23:58:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb91dffb640 1 -- 172.21.15.112:0/2200586502 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb908003530 con 0x7fb92015bec0 2024-09-15T23:58:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb91f7fe640 1 -- 172.21.15.112:0/2200586502 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb92015c2a0 msgr2=0x7fb9200aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb91f7fe640 1 --2- 172.21.15.112:0/2200586502 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb92015c2a0 0x7fb9200aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb91f7fe640 1 -- 172.21.15.112:0/2200586502 >> v1:172.21.15.112:6789/0 conn(0x7fb92015bec0 legacy=0x7fb9200ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb91f7fe640 1 -- 172.21.15.112:0/2200586502 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9200b3b30 con 0x7fb9200af2a0 2024-09-15T23:58:12.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb91f7fe640 1 --2- 172.21.15.112:0/2200586502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9200af2a0 0x7fb92006e000 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fb9180097c0 tx=0x7fb91801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe9aa46e3b2ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:12.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb91dffb640 1 -- 172.21.15.112:0/2200586502 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9180a7070 con 0x7fb9200af2a0 2024-09-15T23:58:12.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb91dffb640 1 -- 172.21.15.112:0/2200586502 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9180b0070 con 0x7fb9200af2a0 2024-09-15T23:58:12.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.969+0000 7fb91dffb640 1 -- 172.21.15.112:0/2200586502 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9180ab890 con 0x7fb9200af2a0 2024-09-15T23:58:12.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 -- 172.21.15.112:0/2200586502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9200af2a0 msgr2=0x7fb92006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 --2- 172.21.15.112:0/2200586502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9200af2a0 0x7fb92006e000 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fb9180097c0 tx=0x7fb91801c470 comp rx=0 tx=0).stop 2024-09-15T23:58:12.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 -- 172.21.15.112:0/2200586502 shutdown_connections 2024-09-15T23:58:12.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 --2- 172.21.15.112:0/2200586502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9200af2a0 0x7fb92006e000 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 --2- 172.21.15.112:0/2200586502 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb92015c2a0 0x7fb9200aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 -- 172.21.15.112:0/2200586502 >> 172.21.15.112:0/2200586502 conn(0x7fb9200b1f90 msgr2=0x7fb9200b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:12.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 -- 172.21.15.112:0/2200586502 shutdown_connections 2024-09-15T23:58:12.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 -- 172.21.15.112:0/2200586502 wait complete. 2024-09-15T23:58:12.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 Processor -- start 2024-09-15T23:58:12.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 -- start start 2024-09-15T23:58:12.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9200af2a0 0x7fb92014e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb92015bec0 0x7fb92014a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb92015c2a0 0x7fb92014ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb92006ed50 con 0x7fb9200af2a0 2024-09-15T23:58:12.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb9200afc90 con 0x7fb92015bec0 2024-09-15T23:58:12.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb92006eed0 con 0x7fb92015c2a0 2024-09-15T23:58:12.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb91effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9200af2a0 0x7fb92014e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb91effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9200af2a0 0x7fb92014e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59838/0 (socket says 172.21.15.112:59838) 2024-09-15T23:58:12.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb91effd640 1 -- 172.21.15.112:0/3376947843 learned_addr learned my addr 172.21.15.112:0/3376947843 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb91f7fe640 1 --2- 172.21.15.112:0/3376947843 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb92015c2a0 0x7fb92014ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb91e7fc640 1 --2- 172.21.15.112:0/3376947843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb92015bec0 0x7fb92014a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb91effd640 1 -- 172.21.15.112:0/3376947843 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb92015c2a0 msgr2=0x7fb92014ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb91effd640 1 --2- 172.21.15.112:0/3376947843 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb92015c2a0 0x7fb92014ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb91effd640 1 -- 172.21.15.112:0/3376947843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb92015bec0 msgr2=0x7fb92014a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb91effd640 1 --2- 172.21.15.112:0/3376947843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb92015bec0 0x7fb92014a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb91effd640 1 -- 172.21.15.112:0/3376947843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92015c6a0 con 0x7fb9200af2a0 2024-09-15T23:58:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb91effd640 1 --2- 172.21.15.112:0/3376947843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9200af2a0 0x7fb92014e160 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fb91000c450 tx=0x7fb91000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9077fe640 1 -- 172.21.15.112:0/3376947843 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910017070 con 0x7fb9200af2a0 2024-09-15T23:58:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9077fe640 1 -- 172.21.15.112:0/3376947843 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb910005cf0 con 0x7fb9200af2a0 2024-09-15T23:58:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9077fe640 1 -- 172.21.15.112:0/3376947843 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910007290 con 0x7fb9200af2a0 2024-09-15T23:58:12.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 -- 172.21.15.112:0/3376947843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92015c960 con 0x7fb9200af2a0 2024-09-15T23:58:12.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.973+0000 7fb9253b5640 1 -- 172.21.15.112:0/3376947843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92015cf20 con 0x7fb9200af2a0 2024-09-15T23:58:12.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.977+0000 7fb9253b5640 1 -- 172.21.15.112:0/3376947843 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92006e000 con 0x7fb9200af2a0 2024-09-15T23:58:12.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.977+0000 7fb9077fe640 1 -- 172.21.15.112:0/3376947843 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb91001a070 con 0x7fb9200af2a0 2024-09-15T23:58:12.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.977+0000 7fb9077fe640 1 --2- 172.21.15.112:0/3376947843 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb90c0678c0 0x7fb90c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:12.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.977+0000 7fb91e7fc640 1 --2- 172.21.15.112:0/3376947843 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb90c0678c0 0x7fb90c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:12.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.977+0000 7fb9077fe640 1 -- 172.21.15.112:0/3376947843 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7fb910085150 con 0x7fb9200af2a0 2024-09-15T23:58:12.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.977+0000 7fb91e7fc640 1 --2- 172.21.15.112:0/3376947843 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb90c0678c0 0x7fb90c069d80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb914003fd0 tx=0x7fb9140039a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:12.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:12.981+0000 7fb9077fe640 1 -- 172.21.15.112:0/3376947843 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb910055b90 con 0x7fb9200af2a0 2024-09-15T23:58:13.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:13.129+0000 7fb9253b5640 1 -- 172.21.15.112:0/3376947843 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb92015d720 con 0x7fb90c0678c0 2024-09-15T23:58:13.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:13.145+0000 7fb9077fe640 1 -- 172.21.15.112:0/3376947843 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251666 (secure 0 0 0) 0x7fb914004690 con 0x7fb90c0678c0 2024-09-15T23:58:13.147 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:13.150 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:58:13.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:13.149+0000 7fb9253b5640 1 -- 172.21.15.112:0/3376947843 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb90c0678c0 msgr2=0x7fb90c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:13.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:13.149+0000 7fb9253b5640 1 --2- 172.21.15.112:0/3376947843 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb90c0678c0 0x7fb90c069d80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb914003fd0 tx=0x7fb9140039a0 comp rx=0 tx=0).stop 2024-09-15T23:58:13.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:13.149+0000 7fb9253b5640 1 -- 172.21.15.112:0/3376947843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9200af2a0 msgr2=0x7fb92014e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:13.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:13.149+0000 7fb9253b5640 1 --2- 172.21.15.112:0/3376947843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9200af2a0 0x7fb92014e160 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fb91000c450 tx=0x7fb91000c910 comp rx=0 tx=0).stop 2024-09-15T23:58:13.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:13.149+0000 7fb9253b5640 1 -- 172.21.15.112:0/3376947843 shutdown_connections 2024-09-15T23:58:13.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:13.149+0000 7fb9253b5640 1 --2- 172.21.15.112:0/3376947843 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb90c0678c0 0x7fb90c069d80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:13.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:13.149+0000 7fb9253b5640 1 --2- 172.21.15.112:0/3376947843 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb92015c2a0 0x7fb92014ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:13.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:13.149+0000 7fb9253b5640 1 --2- 172.21.15.112:0/3376947843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb92015bec0 0x7fb92014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:13.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:13.149+0000 7fb9253b5640 1 --2- 172.21.15.112:0/3376947843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9200af2a0 0x7fb92014e160 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:13.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:13.149+0000 7fb9253b5640 1 -- 172.21.15.112:0/3376947843 >> 172.21.15.112:0/3376947843 conn(0x7fb9200b1f90 msgr2=0x7fb9200cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:13.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:13.149+0000 7fb9253b5640 1 -- 172.21.15.112:0/3376947843 shutdown_connections 2024-09-15T23:58:13.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:13.149+0000 7fb9253b5640 1 -- 172.21.15.112:0/3376947843 wait complete. 2024-09-15T23:58:13.166 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-15T23:58:11.313780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":268328,"kb_used_data":10476,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754706392,"statfs":{"total":773094113280,"available":772819345408,"internally_reserved":0,"allocated":10727424,"data_stored":5514058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.614632"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757324+0000","last_change":"2024-09-15T23:58:07.765376+0000","last_active":"2024-09-15T23:58:08.757324+0000","last_peered":"2024-09-15T23:58:08.757324+0000","last_clean":"2024-09-15T23:58:08.757324+0000","last_became_active":"2024-09-15T23:58:07.764634+0000","last_became_peered":"2024-09-15T23:58:07.764634+0000","last_unstale":"2024-09-15T23:58:08.757324+0000","last_undegraded":"2024-09-15T23:58:08.757324+0000","last_fullsized":"2024-09-15T23:58:08.757324+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:17.697740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753334+0000","last_change":"2024-09-15T23:58:07.773180+0000","last_active":"2024-09-15T23:58:08.753334+0000","last_peered":"2024-09-15T23:58:08.753334+0000","last_clean":"2024-09-15T23:58:08.753334+0000","last_became_active":"2024-09-15T23:58:07.772756+0000","last_became_peered":"2024-09-15T23:58:07.772756+0000","last_unstale":"2024-09-15T23:58:08.753334+0000","last_undegraded":"2024-09-15T23:58:08.753334+0000","last_fullsized":"2024-09-15T23:58:08.753334+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:25.286230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.722018+0000","last_change":"2024-09-15T23:58:06.722018+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.722018+0000","last_undegraded":"2024-09-15T23:58:06.722018+0000","last_fullsized":"2024-09-15T23:58:06.722018+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756033+0000","last_change":"2024-09-15T23:58:07.792209+0000","last_active":"2024-09-15T23:58:08.756033+0000","last_peered":"2024-09-15T23:58:08.756033+0000","last_clean":"2024-09-15T23:58:08.756033+0000","last_became_active":"2024-09-15T23:58:07.783955+0000","last_became_peered":"2024-09-15T23:58:07.783955+0000","last_unstale":"2024-09-15T23:58:08.756033+0000","last_undegraded":"2024-09-15T23:58:08.756033+0000","last_fullsized":"2024-09-15T23:58:08.756033+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:01.050859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756642+0000","last_change":"2024-09-15T23:58:07.766302+0000","last_active":"2024-09-15T23:58:08.756642+0000","last_peered":"2024-09-15T23:58:08.756642+0000","last_clean":"2024-09-15T23:58:08.756642+0000","last_became_active":"2024-09-15T23:58:07.765484+0000","last_became_peered":"2024-09-15T23:58:07.765484+0000","last_unstale":"2024-09-15T23:58:08.756642+0000","last_undegraded":"2024-09-15T23:58:08.756642+0000","last_fullsized":"2024-09-15T23:58:08.756642+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:35.296757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791365+0000","last_change":"2024-09-15T23:58:07.780199+0000","last_active":"2024-09-15T23:58:08.791365+0000","last_peered":"2024-09-15T23:58:08.791365+0000","last_clean":"2024-09-15T23:58:08.791365+0000","last_became_active":"2024-09-15T23:58:07.779937+0000","last_became_peered":"2024-09-15T23:58:07.779937+0000","last_unstale":"2024-09-15T23:58:08.791365+0000","last_undegraded":"2024-09-15T23:58:08.791365+0000","last_fullsized":"2024-09-15T23:58:08.791365+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:34.415985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.790898+0000","last_change":"2024-09-15T23:58:07.779584+0000","last_active":"2024-09-15T23:58:08.790898+0000","last_peered":"2024-09-15T23:58:08.790898+0000","last_clean":"2024-09-15T23:58:08.790898+0000","last_became_active":"2024-09-15T23:58:07.776328+0000","last_became_peered":"2024-09-15T23:58:07.776328+0000","last_unstale":"2024-09-15T23:58:08.790898+0000","last_undegraded":"2024-09-15T23:58:08.790898+0000","last_fullsized":"2024-09-15T23:58:08.790898+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:20.154190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757373+0000","last_change":"2024-09-15T23:58:07.759525+0000","last_active":"2024-09-15T23:58:08.757373+0000","last_peered":"2024-09-15T23:58:08.757373+0000","last_clean":"2024-09-15T23:58:08.757373+0000","last_became_active":"2024-09-15T23:58:07.759015+0000","last_became_peered":"2024-09-15T23:58:07.759015+0000","last_unstale":"2024-09-15T23:58:08.757373+0000","last_undegraded":"2024-09-15T23:58:08.757373+0000","last_fullsized":"2024-09-15T23:58:08.757373+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:38.225855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753896+0000","last_change":"2024-09-15T23:58:07.800146+0000","last_active":"2024-09-15T23:58:08.753896+0000","last_peered":"2024-09-15T23:58:08.753896+0000","last_clean":"2024-09-15T23:58:08.753896+0000","last_became_active":"2024-09-15T23:58:07.799851+0000","last_became_peered":"2024-09-15T23:58:07.799851+0000","last_unstale":"2024-09-15T23:58:08.753896+0000","last_undegraded":"2024-09-15T23:58:08.753896+0000","last_fullsized":"2024-09-15T23:58:08.753896+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:36.707754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758499+0000","last_change":"2024-09-15T23:58:07.753670+0000","last_active":"2024-09-15T23:58:08.758499+0000","last_peered":"2024-09-15T23:58:08.758499+0000","last_clean":"2024-09-15T23:58:08.758499+0000","last_became_active":"2024-09-15T23:58:07.752863+0000","last_became_peered":"2024-09-15T23:58:07.752863+0000","last_unstale":"2024-09-15T23:58:08.758499+0000","last_undegraded":"2024-09-15T23:58:08.758499+0000","last_fullsized":"2024-09-15T23:58:08.758499+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:53.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128244+0000","last_change":"2024-09-15T23:58:07.773082+0000","last_active":"2024-09-15T23:58:09.128244+0000","last_peered":"2024-09-15T23:58:09.128244+0000","last_clean":"2024-09-15T23:58:09.128244+0000","last_became_active":"2024-09-15T23:58:07.768580+0000","last_became_peered":"2024-09-15T23:58:07.768580+0000","last_unstale":"2024-09-15T23:58:09.128244+0000","last_undegraded":"2024-09-15T23:58:09.128244+0000","last_fullsized":"2024-09-15T23:58:09.128244+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:55.098428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791187+0000","last_change":"2024-09-15T23:58:07.779856+0000","last_active":"2024-09-15T23:58:08.791187+0000","last_peered":"2024-09-15T23:58:08.791187+0000","last_clean":"2024-09-15T23:58:08.791187+0000","last_became_active":"2024-09-15T23:58:07.779553+0000","last_became_peered":"2024-09-15T23:58:07.779553+0000","last_unstale":"2024-09-15T23:58:08.791187+0000","last_undegraded":"2024-09-15T23:58:08.791187+0000","last_fullsized":"2024-09-15T23:58:08.791187+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:45.241169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.755836+0000","last_change":"2024-09-15T23:58:07.796750+0000","last_active":"2024-09-15T23:58:08.755836+0000","last_peered":"2024-09-15T23:58:08.755836+0000","last_clean":"2024-09-15T23:58:08.755836+0000","last_became_active":"2024-09-15T23:58:07.792310+0000","last_became_peered":"2024-09-15T23:58:07.792310+0000","last_unstale":"2024-09-15T23:58:08.755836+0000","last_undegraded":"2024-09-15T23:58:08.755836+0000","last_fullsized":"2024-09-15T23:58:08.755836+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:20.742739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791283+0000","last_change":"2024-09-15T23:58:07.776737+0000","last_active":"2024-09-15T23:58:08.791283+0000","last_peered":"2024-09-15T23:58:08.791283+0000","last_clean":"2024-09-15T23:58:08.791283+0000","last_became_active":"2024-09-15T23:58:07.776475+0000","last_became_peered":"2024-09-15T23:58:07.776475+0000","last_unstale":"2024-09-15T23:58:08.791283+0000","last_undegraded":"2024-09-15T23:58:08.791283+0000","last_fullsized":"2024-09-15T23:58:08.791283+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:58.182086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.752647+0000","last_change":"2024-09-15T23:58:07.789278+0000","last_active":"2024-09-15T23:58:08.752647+0000","last_peered":"2024-09-15T23:58:08.752647+0000","last_clean":"2024-09-15T23:58:08.752647+0000","last_became_active":"2024-09-15T23:58:07.788374+0000","last_became_peered":"2024-09-15T23:58:07.788374+0000","last_unstale":"2024-09-15T23:58:08.752647+0000","last_undegraded":"2024-09-15T23:58:08.752647+0000","last_fullsized":"2024-09-15T23:58:08.752647+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:10.386941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.127573+0000","last_change":"2024-09-15T23:58:07.777214+0000","last_active":"2024-09-15T23:58:09.127573+0000","last_peered":"2024-09-15T23:58:09.127573+0000","last_clean":"2024-09-15T23:58:09.127573+0000","last_became_active":"2024-09-15T23:58:07.776537+0000","last_became_peered":"2024-09-15T23:58:07.776537+0000","last_unstale":"2024-09-15T23:58:09.127573+0000","last_undegraded":"2024-09-15T23:58:09.127573+0000","last_fullsized":"2024-09-15T23:58:09.127573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:38.958811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.727455+0000","last_change":"2024-09-15T23:58:06.727455+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.727455+0000","last_undegraded":"2024-09-15T23:58:06.727455+0000","last_fullsized":"2024-09-15T23:58:06.727455+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753613+0000","last_change":"2024-09-15T23:58:07.773809+0000","last_active":"2024-09-15T23:58:08.753613+0000","last_peered":"2024-09-15T23:58:08.753613+0000","last_clean":"2024-09-15T23:58:08.753613+0000","last_became_active":"2024-09-15T23:58:07.773013+0000","last_became_peered":"2024-09-15T23:58:07.773013+0000","last_unstale":"2024-09-15T23:58:08.753613+0000","last_undegraded":"2024-09-15T23:58:08.753613+0000","last_fullsized":"2024-09-15T23:58:08.753613+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:35.110846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756318+0000","last_change":"2024-09-15T23:58:07.797639+0000","last_active":"2024-09-15T23:58:08.756318+0000","last_peered":"2024-09-15T23:58:08.756318+0000","last_clean":"2024-09-15T23:58:08.756318+0000","last_became_active":"2024-09-15T23:58:07.796983+0000","last_became_peered":"2024-09-15T23:58:07.796983+0000","last_unstale":"2024-09-15T23:58:08.756318+0000","last_undegraded":"2024-09-15T23:58:08.756318+0000","last_fullsized":"2024-09-15T23:58:08.756318+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:34.778205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128194+0000","last_change":"2024-09-15T23:58:07.762602+0000","last_active":"2024-09-15T23:58:09.128194+0000","last_peered":"2024-09-15T23:58:09.128194+0000","last_clean":"2024-09-15T23:58:09.128194+0000","last_became_active":"2024-09-15T23:58:07.761868+0000","last_became_peered":"2024-09-15T23:58:07.761868+0000","last_unstale":"2024-09-15T23:58:09.128194+0000","last_undegraded":"2024-09-15T23:58:09.128194+0000","last_fullsized":"2024-09-15T23:58:09.128194+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:38.225855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.726154+0000","last_change":"2024-09-15T23:58:06.726154+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.726154+0000","last_undegraded":"2024-09-15T23:58:06.726154+0000","last_fullsized":"2024-09-15T23:58:06.726154+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126816+0000","last_change":"2024-09-15T23:58:07.782785+0000","last_active":"2024-09-15T23:58:09.126816+0000","last_peered":"2024-09-15T23:58:09.126816+0000","last_clean":"2024-09-15T23:58:09.126816+0000","last_became_active":"2024-09-15T23:58:07.782088+0000","last_became_peered":"2024-09-15T23:58:07.782088+0000","last_unstale":"2024-09-15T23:58:09.126816+0000","last_undegraded":"2024-09-15T23:58:09.126816+0000","last_fullsized":"2024-09-15T23:58:09.126816+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:21.579619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758736+0000","last_change":"2024-09-15T23:58:07.778120+0000","last_active":"2024-09-15T23:58:08.758736+0000","last_peered":"2024-09-15T23:58:08.758736+0000","last_clean":"2024-09-15T23:58:08.758736+0000","last_became_active":"2024-09-15T23:58:07.777366+0000","last_became_peered":"2024-09-15T23:58:07.777366+0000","last_unstale":"2024-09-15T23:58:08.758736+0000","last_undegraded":"2024-09-15T23:58:08.758736+0000","last_fullsized":"2024-09-15T23:58:08.758736+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:28.979657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757763+0000","last_change":"2024-09-15T23:58:07.768580+0000","last_active":"2024-09-15T23:58:08.757763+0000","last_peered":"2024-09-15T23:58:08.757763+0000","last_clean":"2024-09-15T23:58:08.757763+0000","last_became_active":"2024-09-15T23:58:07.768022+0000","last_became_peered":"2024-09-15T23:58:07.768022+0000","last_unstale":"2024-09-15T23:58:08.757763+0000","last_undegraded":"2024-09-15T23:58:08.757763+0000","last_fullsized":"2024-09-15T23:58:08.757763+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:00.705487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129489+0000","last_change":"2024-09-15T23:58:07.796575+0000","last_active":"2024-09-15T23:58:09.129489+0000","last_peered":"2024-09-15T23:58:09.129489+0000","last_clean":"2024-09-15T23:58:09.129489+0000","last_became_active":"2024-09-15T23:58:07.788327+0000","last_became_peered":"2024-09-15T23:58:07.788327+0000","last_unstale":"2024-09-15T23:58:09.129489+0000","last_undegraded":"2024-09-15T23:58:09.129489+0000","last_fullsized":"2024-09-15T23:58:09.129489+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:28.979657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129311+0000","last_change":"2024-09-15T23:58:07.796461+0000","last_active":"2024-09-15T23:58:09.129311+0000","last_peered":"2024-09-15T23:58:09.129311+0000","last_clean":"2024-09-15T23:58:09.129311+0000","last_became_active":"2024-09-15T23:58:07.796172+0000","last_became_peered":"2024-09-15T23:58:07.796172+0000","last_unstale":"2024-09-15T23:58:09.129311+0000","last_undegraded":"2024-09-15T23:58:09.129311+0000","last_fullsized":"2024-09-15T23:58:09.129311+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:26.451417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129132+0000","last_change":"2024-09-15T23:58:07.779754+0000","last_active":"2024-09-15T23:58:09.129132+0000","last_peered":"2024-09-15T23:58:09.129132+0000","last_clean":"2024-09-15T23:58:09.129132+0000","last_became_active":"2024-09-15T23:58:07.779070+0000","last_became_peered":"2024-09-15T23:58:07.779070+0000","last_unstale":"2024-09-15T23:58:09.129132+0000","last_undegraded":"2024-09-15T23:58:09.129132+0000","last_fullsized":"2024-09-15T23:58:09.129132+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:53.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791414+0000","last_change":"2024-09-15T23:58:07.781973+0000","last_active":"2024-09-15T23:58:08.791414+0000","last_peered":"2024-09-15T23:58:08.791414+0000","last_clean":"2024-09-15T23:58:08.791414+0000","last_became_active":"2024-09-15T23:58:07.781646+0000","last_became_peered":"2024-09-15T23:58:07.781646+0000","last_unstale":"2024-09-15T23:58:08.791414+0000","last_undegraded":"2024-09-15T23:58:08.791414+0000","last_fullsized":"2024-09-15T23:58:08.791414+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:54.991980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758938+0000","last_change":"2024-09-15T23:58:07.780326+0000","last_active":"2024-09-15T23:58:08.758938+0000","last_peered":"2024-09-15T23:58:08.758938+0000","last_clean":"2024-09-15T23:58:08.758938+0000","last_became_active":"2024-09-15T23:58:07.779866+0000","last_became_peered":"2024-09-15T23:58:07.779866+0000","last_unstale":"2024-09-15T23:58:08.758938+0000","last_undegraded":"2024-09-15T23:58:08.758938+0000","last_fullsized":"2024-09-15T23:58:08.758938+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:32.670128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129254+0000","last_change":"2024-09-15T23:58:07.772116+0000","last_active":"2024-09-15T23:58:09.129254+0000","last_peered":"2024-09-15T23:58:09.129254+0000","last_clean":"2024-09-15T23:58:09.129254+0000","last_became_active":"2024-09-15T23:58:07.771400+0000","last_became_peered":"2024-09-15T23:58:07.771400+0000","last_unstale":"2024-09-15T23:58:09.129254+0000","last_undegraded":"2024-09-15T23:58:09.129254+0000","last_fullsized":"2024-09-15T23:58:09.129254+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:53.111663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791001+0000","last_change":"2024-09-15T23:58:07.780570+0000","last_active":"2024-09-15T23:58:08.791001+0000","last_peered":"2024-09-15T23:58:08.791001+0000","last_clean":"2024-09-15T23:58:08.791001+0000","last_became_active":"2024-09-15T23:58:07.779637+0000","last_became_peered":"2024-09-15T23:58:07.779637+0000","last_unstale":"2024-09-15T23:58:08.791001+0000","last_undegraded":"2024-09-15T23:58:08.791001+0000","last_fullsized":"2024-09-15T23:58:08.791001+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:04.943802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.125806+0000","last_change":"2024-09-15T23:58:07.767211+0000","last_active":"2024-09-15T23:58:09.125806+0000","last_peered":"2024-09-15T23:58:09.125806+0000","last_clean":"2024-09-15T23:58:09.125806+0000","last_became_active":"2024-09-15T23:58:07.766427+0000","last_became_peered":"2024-09-15T23:58:07.766427+0000","last_unstale":"2024-09-15T23:58:09.125806+0000","last_undegraded":"2024-09-15T23:58:09.125806+0000","last_fullsized":"2024-09-15T23:58:09.125806+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:10.506341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.720275+0000","last_change":"2024-09-15T23:58:06.720275+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.720275+0000","last_undegraded":"2024-09-15T23:58:06.720275+0000","last_fullsized":"2024-09-15T23:58:06.720275+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1f","version":"96'4","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126760+0000","last_change":"2024-09-15T23:58:06.737380+0000","last_active":"2024-09-15T23:58:09.126760+0000","last_peered":"2024-09-15T23:58:09.126760+0000","last_clean":"2024-09-15T23:58:09.126760+0000","last_became_active":"2024-09-15T23:58:06.736527+0000","last_became_peered":"2024-09-15T23:58:06.736527+0000","last_unstale":"2024-09-15T23:58:09.126760+0000","last_undegraded":"2024-09-15T23:58:09.126760+0000","last_fullsized":"2024-09-15T23:58:09.126760+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:42.645715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758832+0000","last_change":"2024-09-15T23:58:07.776944+0000","last_active":"2024-09-15T23:58:08.758832+0000","last_peered":"2024-09-15T23:58:08.758832+0000","last_clean":"2024-09-15T23:58:08.758832+0000","last_became_active":"2024-09-15T23:58:07.776174+0000","last_became_peered":"2024-09-15T23:58:07.776174+0000","last_unstale":"2024-09-15T23:58:08.758832+0000","last_undegraded":"2024-09-15T23:58:08.758832+0000","last_fullsized":"2024-09-15T23:58:08.758832+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:51.731861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753413+0000","last_change":"2024-09-15T23:58:06.747179+0000","last_active":"2024-09-15T23:58:06.753413+0000","last_peered":"2024-09-15T23:58:06.753413+0000","last_clean":"2024-09-15T23:58:06.753413+0000","last_became_active":"2024-09-15T23:58:06.746346+0000","last_became_peered":"2024-09-15T23:58:06.746346+0000","last_unstale":"2024-09-15T23:58:06.753413+0000","last_undegraded":"2024-09-15T23:58:06.753413+0000","last_fullsized":"2024-09-15T23:58:06.753413+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:39.718082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.752931+0000","last_change":"2024-09-15T23:58:07.755258+0000","last_active":"2024-09-15T23:58:08.752931+0000","last_peered":"2024-09-15T23:58:08.752931+0000","last_clean":"2024-09-15T23:58:08.752931+0000","last_became_active":"2024-09-15T23:58:07.754455+0000","last_became_peered":"2024-09-15T23:58:07.754455+0000","last_unstale":"2024-09-15T23:58:08.752931+0000","last_undegraded":"2024-09-15T23:58:08.752931+0000","last_fullsized":"2024-09-15T23:58:08.752931+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:07.269079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753420+0000","last_change":"2024-09-15T23:58:06.739251+0000","last_active":"2024-09-15T23:58:08.753420+0000","last_peered":"2024-09-15T23:58:08.753420+0000","last_clean":"2024-09-15T23:58:08.753420+0000","last_became_active":"2024-09-15T23:58:06.738972+0000","last_became_peered":"2024-09-15T23:58:06.738972+0000","last_unstale":"2024-09-15T23:58:08.753420+0000","last_undegraded":"2024-09-15T23:58:08.753420+0000","last_fullsized":"2024-09-15T23:58:08.753420+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:15.435941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128549+0000","last_change":"2024-09-15T23:58:07.783162+0000","last_active":"2024-09-15T23:58:09.128549+0000","last_peered":"2024-09-15T23:58:09.128549+0000","last_clean":"2024-09-15T23:58:09.128549+0000","last_became_active":"2024-09-15T23:58:07.782870+0000","last_became_peered":"2024-09-15T23:58:07.782870+0000","last_unstale":"2024-09-15T23:58:09.128549+0000","last_undegraded":"2024-09-15T23:58:09.128549+0000","last_fullsized":"2024-09-15T23:58:09.128549+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:54.734314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758412+0000","last_change":"2024-09-15T23:58:06.724258+0000","last_active":"2024-09-15T23:58:08.758412+0000","last_peered":"2024-09-15T23:58:08.758412+0000","last_clean":"2024-09-15T23:58:08.758412+0000","last_became_active":"2024-09-15T23:58:06.723572+0000","last_became_peered":"2024-09-15T23:58:06.723572+0000","last_unstale":"2024-09-15T23:58:08.758412+0000","last_undegraded":"2024-09-15T23:58:08.758412+0000","last_fullsized":"2024-09-15T23:58:08.758412+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:08.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756965+0000","last_change":"2024-09-15T23:58:07.784732+0000","last_active":"2024-09-15T23:58:08.756965+0000","last_peered":"2024-09-15T23:58:08.756965+0000","last_clean":"2024-09-15T23:58:08.756965+0000","last_became_active":"2024-09-15T23:58:07.782292+0000","last_became_peered":"2024-09-15T23:58:07.782292+0000","last_unstale":"2024-09-15T23:58:08.756965+0000","last_undegraded":"2024-09-15T23:58:08.756965+0000","last_fullsized":"2024-09-15T23:58:08.756965+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:33.544108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1b","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128878+0000","last_change":"2024-09-15T23:58:06.735612+0000","last_active":"2024-09-15T23:58:09.128878+0000","last_peered":"2024-09-15T23:58:09.128878+0000","last_clean":"2024-09-15T23:58:09.128878+0000","last_became_active":"2024-09-15T23:58:06.735170+0000","last_became_peered":"2024-09-15T23:58:06.735170+0000","last_unstale":"2024-09-15T23:58:09.128878+0000","last_undegraded":"2024-09-15T23:58:09.128878+0000","last_fullsized":"2024-09-15T23:58:09.128878+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:43.931563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756768+0000","last_change":"2024-09-15T23:58:07.765505+0000","last_active":"2024-09-15T23:58:08.756768+0000","last_peered":"2024-09-15T23:58:08.756768+0000","last_clean":"2024-09-15T23:58:08.756768+0000","last_became_active":"2024-09-15T23:58:07.764711+0000","last_became_peered":"2024-09-15T23:58:07.764711+0000","last_unstale":"2024-09-15T23:58:08.756768+0000","last_undegraded":"2024-09-15T23:58:08.756768+0000","last_fullsized":"2024-09-15T23:58:08.756768+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:39.153021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129582+0000","last_change":"2024-09-15T23:58:06.736878+0000","last_active":"2024-09-15T23:58:09.129582+0000","last_peered":"2024-09-15T23:58:09.129582+0000","last_clean":"2024-09-15T23:58:09.129582+0000","last_became_active":"2024-09-15T23:58:06.736545+0000","last_became_peered":"2024-09-15T23:58:06.736545+0000","last_unstale":"2024-09-15T23:58:09.129582+0000","last_undegraded":"2024-09-15T23:58:09.129582+0000","last_fullsized":"2024-09-15T23:58:09.129582+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:06.203702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129816+0000","last_change":"2024-09-15T23:58:07.764136+0000","last_active":"2024-09-15T23:58:09.129816+0000","last_peered":"2024-09-15T23:58:09.129816+0000","last_clean":"2024-09-15T23:58:09.129816+0000","last_became_active":"2024-09-15T23:58:07.762035+0000","last_became_peered":"2024-09-15T23:58:07.762035+0000","last_unstale":"2024-09-15T23:58:09.129816+0000","last_undegraded":"2024-09-15T23:58:09.129816+0000","last_fullsized":"2024-09-15T23:58:09.129816+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:13.530423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128008+0000","last_change":"2024-09-15T23:58:06.737494+0000","last_active":"2024-09-15T23:58:09.128008+0000","last_peered":"2024-09-15T23:58:09.128008+0000","last_clean":"2024-09-15T23:58:09.128008+0000","last_became_active":"2024-09-15T23:58:06.736714+0000","last_became_peered":"2024-09-15T23:58:06.736714+0000","last_unstale":"2024-09-15T23:58:09.128008+0000","last_undegraded":"2024-09-15T23:58:09.128008+0000","last_fullsized":"2024-09-15T23:58:09.128008+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.690650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757533+0000","last_change":"2024-09-15T23:58:07.770649+0000","last_active":"2024-09-15T23:58:08.757533+0000","last_peered":"2024-09-15T23:58:08.757533+0000","last_clean":"2024-09-15T23:58:08.757533+0000","last_became_active":"2024-09-15T23:58:07.768011+0000","last_became_peered":"2024-09-15T23:58:07.768011+0000","last_unstale":"2024-09-15T23:58:08.757533+0000","last_undegraded":"2024-09-15T23:58:08.757533+0000","last_fullsized":"2024-09-15T23:58:08.757533+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:22.781437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126273+0000","last_change":"2024-09-15T23:58:06.745052+0000","last_active":"2024-09-15T23:58:09.126273+0000","last_peered":"2024-09-15T23:58:09.126273+0000","last_clean":"2024-09-15T23:58:09.126273+0000","last_became_active":"2024-09-15T23:58:06.743906+0000","last_became_peered":"2024-09-15T23:58:06.743906+0000","last_unstale":"2024-09-15T23:58:09.126273+0000","last_undegraded":"2024-09-15T23:58:09.126273+0000","last_fullsized":"2024-09-15T23:58:09.126273+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:03.616480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.755433+0000","last_change":"2024-09-15T23:58:07.782085+0000","last_active":"2024-09-15T23:58:08.755433+0000","last_peered":"2024-09-15T23:58:08.755433+0000","last_clean":"2024-09-15T23:58:08.755433+0000","last_became_active":"2024-09-15T23:58:07.781272+0000","last_became_peered":"2024-09-15T23:58:07.781272+0000","last_unstale":"2024-09-15T23:58:08.755433+0000","last_undegraded":"2024-09-15T23:58:08.755433+0000","last_fullsized":"2024-09-15T23:58:08.755433+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:32.190984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791527+0000","last_change":"2024-09-15T23:58:06.723519+0000","last_active":"2024-09-15T23:58:08.791527+0000","last_peered":"2024-09-15T23:58:08.791527+0000","last_clean":"2024-09-15T23:58:08.791527+0000","last_became_active":"2024-09-15T23:58:06.722945+0000","last_became_peered":"2024-09-15T23:58:06.722945+0000","last_unstale":"2024-09-15T23:58:08.791527+0000","last_undegraded":"2024-09-15T23:58:08.791527+0000","last_fullsized":"2024-09-15T23:58:08.791527+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:24.274929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756588+0000","last_change":"2024-09-15T23:58:07.766786+0000","last_active":"2024-09-15T23:58:08.756588+0000","last_peered":"2024-09-15T23:58:08.756588+0000","last_clean":"2024-09-15T23:58:08.756588+0000","last_became_active":"2024-09-15T23:58:07.764533+0000","last_became_peered":"2024-09-15T23:58:07.764533+0000","last_unstale":"2024-09-15T23:58:08.756588+0000","last_undegraded":"2024-09-15T23:58:08.756588+0000","last_fullsized":"2024-09-15T23:58:08.756588+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:25.695282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758744+0000","last_change":"2024-09-15T23:58:06.748827+0000","last_active":"2024-09-15T23:58:08.758744+0000","last_peered":"2024-09-15T23:58:08.758744+0000","last_clean":"2024-09-15T23:58:08.758744+0000","last_became_active":"2024-09-15T23:58:06.748419+0000","last_became_peered":"2024-09-15T23:58:06.748419+0000","last_unstale":"2024-09-15T23:58:08.758744+0000","last_undegraded":"2024-09-15T23:58:08.758744+0000","last_fullsized":"2024-09-15T23:58:08.758744+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.690650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758808+0000","last_change":"2024-09-15T23:58:07.769178+0000","last_active":"2024-09-15T23:58:08.758808+0000","last_peered":"2024-09-15T23:58:08.758808+0000","last_clean":"2024-09-15T23:58:08.758808+0000","last_became_active":"2024-09-15T23:58:07.768505+0000","last_became_peered":"2024-09-15T23:58:07.768505+0000","last_unstale":"2024-09-15T23:58:08.758808+0000","last_undegraded":"2024-09-15T23:58:08.758808+0000","last_fullsized":"2024-09-15T23:58:08.758808+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:43.017275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"96'3","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791897+0000","last_change":"2024-09-15T23:58:06.743819+0000","last_active":"2024-09-15T23:58:08.791897+0000","last_peered":"2024-09-15T23:58:08.791897+0000","last_clean":"2024-09-15T23:58:08.791897+0000","last_became_active":"2024-09-15T23:58:06.743512+0000","last_became_peered":"2024-09-15T23:58:06.743512+0000","last_unstale":"2024-09-15T23:58:08.791897+0000","last_undegraded":"2024-09-15T23:58:08.791897+0000","last_fullsized":"2024-09-15T23:58:08.791897+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:38.845066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126282+0000","last_change":"2024-09-15T23:58:07.787170+0000","last_active":"2024-09-15T23:58:09.126282+0000","last_peered":"2024-09-15T23:58:09.126282+0000","last_clean":"2024-09-15T23:58:09.126282+0000","last_became_active":"2024-09-15T23:58:07.786487+0000","last_became_peered":"2024-09-15T23:58:07.786487+0000","last_unstale":"2024-09-15T23:58:09.126282+0000","last_undegraded":"2024-09-15T23:58:09.126282+0000","last_fullsized":"2024-09-15T23:58:09.126282+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:54.922033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"96'6","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128875+0000","last_change":"2024-09-15T23:58:06.735492+0000","last_active":"2024-09-15T23:58:09.128875+0000","last_peered":"2024-09-15T23:58:09.128875+0000","last_clean":"2024-09-15T23:58:09.128875+0000","last_became_active":"2024-09-15T23:58:06.734834+0000","last_became_peered":"2024-09-15T23:58:06.734834+0000","last_unstale":"2024-09-15T23:58:09.128875+0000","last_undegraded":"2024-09-15T23:58:09.128875+0000","last_fullsized":"2024-09-15T23:58:09.128875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:26.410446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753230+0000","last_change":"2024-09-15T23:58:07.799903+0000","last_active":"2024-09-15T23:58:08.753230+0000","last_peered":"2024-09-15T23:58:08.753230+0000","last_clean":"2024-09-15T23:58:08.753230+0000","last_became_active":"2024-09-15T23:58:07.799564+0000","last_became_peered":"2024-09-15T23:58:07.799564+0000","last_unstale":"2024-09-15T23:58:08.753230+0000","last_undegraded":"2024-09-15T23:58:08.753230+0000","last_fullsized":"2024-09-15T23:58:08.753230+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:09.804410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756456+0000","last_change":"2024-09-15T23:58:06.753728+0000","last_active":"2024-09-15T23:58:08.756456+0000","last_peered":"2024-09-15T23:58:08.756456+0000","last_clean":"2024-09-15T23:58:08.756456+0000","last_became_active":"2024-09-15T23:58:06.753064+0000","last_became_peered":"2024-09-15T23:58:06.753064+0000","last_unstale":"2024-09-15T23:58:08.756456+0000","last_undegraded":"2024-09-15T23:58:08.756456+0000","last_fullsized":"2024-09-15T23:58:08.756456+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:37.947511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753219+0000","last_change":"2024-09-15T23:58:07.758875+0000","last_active":"2024-09-15T23:58:08.753219+0000","last_peered":"2024-09-15T23:58:08.753219+0000","last_clean":"2024-09-15T23:58:08.753219+0000","last_became_active":"2024-09-15T23:58:07.756469+0000","last_became_peered":"2024-09-15T23:58:07.756469+0000","last_unstale":"2024-09-15T23:58:08.753219+0000","last_undegraded":"2024-09-15T23:58:08.753219+0000","last_fullsized":"2024-09-15T23:58:08.753219+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:39.856367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758820+0000","last_change":"2024-09-15T23:58:06.730917+0000","last_active":"2024-09-15T23:58:08.758820+0000","last_peered":"2024-09-15T23:58:08.758820+0000","last_clean":"2024-09-15T23:58:08.758820+0000","last_became_active":"2024-09-15T23:58:06.730153+0000","last_became_peered":"2024-09-15T23:58:06.730153+0000","last_unstale":"2024-09-15T23:58:08.758820+0000","last_undegraded":"2024-09-15T23:58:08.758820+0000","last_fullsized":"2024-09-15T23:58:08.758820+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:06.203702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126587+0000","last_change":"2024-09-15T23:58:07.784939+0000","last_active":"2024-09-15T23:58:09.126587+0000","last_peered":"2024-09-15T23:58:09.126587+0000","last_clean":"2024-09-15T23:58:09.126587+0000","last_became_active":"2024-09-15T23:58:07.783654+0000","last_became_peered":"2024-09-15T23:58:07.783654+0000","last_unstale":"2024-09-15T23:58:09.126587+0000","last_undegraded":"2024-09-15T23:58:09.126587+0000","last_fullsized":"2024-09-15T23:58:09.126587+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:42.052614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756142+0000","last_change":"2024-09-15T23:58:06.733047+0000","last_active":"2024-09-15T23:58:08.756142+0000","last_peered":"2024-09-15T23:58:08.756142+0000","last_clean":"2024-09-15T23:58:08.756142+0000","last_became_active":"2024-09-15T23:58:06.732148+0000","last_became_peered":"2024-09-15T23:58:06.732148+0000","last_unstale":"2024-09-15T23:58:08.756142+0000","last_undegraded":"2024-09-15T23:58:08.756142+0000","last_fullsized":"2024-09-15T23:58:08.756142+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:33.404685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-15T23:58:06.726429+0000","last_change":"2024-09-15T23:58:06.726429+0000","last_active":"2024-09-15T23:58:06.696451+0000","last_peered":"2024-09-15T23:58:06.696451+0000","last_clean":"2024-09-15T23:58:06.696451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:58:06.726429+0000","last_undegraded":"2024-09-15T23:58:06.726429+0000","last_fullsized":"2024-09-15T23:58:06.726429+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"96'8","reported_seq":22,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.127657+0000","last_change":"2024-09-15T23:58:06.732340+0000","last_active":"2024-09-15T23:58:09.127657+0000","last_peered":"2024-09-15T23:58:09.127657+0000","last_clean":"2024-09-15T23:58:09.127657+0000","last_became_active":"2024-09-15T23:58:06.732080+0000","last_became_peered":"2024-09-15T23:58:06.732080+0000","last_unstale":"2024-09-15T23:58:09.127657+0000","last_undegraded":"2024-09-15T23:58:09.127657+0000","last_fullsized":"2024-09-15T23:58:09.127657+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:45.077686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758512+0000","last_change":"2024-09-15T23:58:07.770015+0000","last_active":"2024-09-15T23:58:08.758512+0000","last_peered":"2024-09-15T23:58:08.758512+0000","last_clean":"2024-09-15T23:58:08.758512+0000","last_became_active":"2024-09-15T23:58:07.769509+0000","last_became_peered":"2024-09-15T23:58:07.769509+0000","last_unstale":"2024-09-15T23:58:08.758512+0000","last_undegraded":"2024-09-15T23:58:08.758512+0000","last_fullsized":"2024-09-15T23:58:08.758512+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:26.451417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791651+0000","last_change":"2024-09-15T23:58:06.722578+0000","last_active":"2024-09-15T23:58:08.791651+0000","last_peered":"2024-09-15T23:58:08.791651+0000","last_clean":"2024-09-15T23:58:08.791651+0000","last_became_active":"2024-09-15T23:58:06.722138+0000","last_became_peered":"2024-09-15T23:58:06.722138+0000","last_unstale":"2024-09-15T23:58:08.791651+0000","last_undegraded":"2024-09-15T23:58:08.791651+0000","last_fullsized":"2024-09-15T23:58:08.791651+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:35.696453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129439+0000","last_change":"2024-09-15T23:58:07.776105+0000","last_active":"2024-09-15T23:58:09.129439+0000","last_peered":"2024-09-15T23:58:09.129439+0000","last_clean":"2024-09-15T23:58:09.129439+0000","last_became_active":"2024-09-15T23:58:07.775809+0000","last_became_peered":"2024-09-15T23:58:07.775809+0000","last_unstale":"2024-09-15T23:58:09.129439+0000","last_undegraded":"2024-09-15T23:58:09.129439+0000","last_fullsized":"2024-09-15T23:58:09.129439+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:36.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.d","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129069+0000","last_change":"2024-09-15T23:58:06.738994+0000","last_active":"2024-09-15T23:58:09.129069+0000","last_peered":"2024-09-15T23:58:09.129069+0000","last_clean":"2024-09-15T23:58:09.129069+0000","last_became_active":"2024-09-15T23:58:06.738495+0000","last_became_peered":"2024-09-15T23:58:06.738495+0000","last_unstale":"2024-09-15T23:58:09.129069+0000","last_undegraded":"2024-09-15T23:58:09.129069+0000","last_fullsized":"2024-09-15T23:58:09.129069+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:44.651235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126141+0000","last_change":"2024-09-15T23:58:07.782366+0000","last_active":"2024-09-15T23:58:09.126141+0000","last_peered":"2024-09-15T23:58:09.126141+0000","last_clean":"2024-09-15T23:58:09.126141+0000","last_became_active":"2024-09-15T23:58:07.781871+0000","last_became_peered":"2024-09-15T23:58:07.781871+0000","last_unstale":"2024-09-15T23:58:09.126141+0000","last_undegraded":"2024-09-15T23:58:09.126141+0000","last_fullsized":"2024-09-15T23:58:09.126141+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:21.361174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791312+0000","last_change":"2024-09-15T23:58:06.723437+0000","last_active":"2024-09-15T23:58:08.791312+0000","last_peered":"2024-09-15T23:58:08.791312+0000","last_clean":"2024-09-15T23:58:08.791312+0000","last_became_active":"2024-09-15T23:58:06.722488+0000","last_became_peered":"2024-09-15T23:58:06.722488+0000","last_unstale":"2024-09-15T23:58:08.791312+0000","last_undegraded":"2024-09-15T23:58:08.791312+0000","last_fullsized":"2024-09-15T23:58:08.791312+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:08.793109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757296+0000","last_change":"2024-09-15T23:58:07.791345+0000","last_active":"2024-09-15T23:58:08.757296+0000","last_peered":"2024-09-15T23:58:08.757296+0000","last_clean":"2024-09-15T23:58:08.757296+0000","last_became_active":"2024-09-15T23:58:07.781515+0000","last_became_peered":"2024-09-15T23:58:07.781515+0000","last_unstale":"2024-09-15T23:58:08.757296+0000","last_undegraded":"2024-09-15T23:58:08.757296+0000","last_fullsized":"2024-09-15T23:58:08.757296+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:55.061923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753593+0000","last_change":"2024-09-15T23:58:06.742316+0000","last_active":"2024-09-15T23:58:06.753593+0000","last_peered":"2024-09-15T23:58:06.753593+0000","last_clean":"2024-09-15T23:58:06.753593+0000","last_became_active":"2024-09-15T23:58:06.741127+0000","last_became_peered":"2024-09-15T23:58:06.741127+0000","last_unstale":"2024-09-15T23:58:06.753593+0000","last_undegraded":"2024-09-15T23:58:06.753593+0000","last_fullsized":"2024-09-15T23:58:06.753593+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:41.281238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126663+0000","last_change":"2024-09-15T23:58:07.795069+0000","last_active":"2024-09-15T23:58:09.126663+0000","last_peered":"2024-09-15T23:58:09.126663+0000","last_clean":"2024-09-15T23:58:09.126663+0000","last_became_active":"2024-09-15T23:58:07.794212+0000","last_became_peered":"2024-09-15T23:58:07.794212+0000","last_unstale":"2024-09-15T23:58:09.126663+0000","last_undegraded":"2024-09-15T23:58:09.126663+0000","last_fullsized":"2024-09-15T23:58:09.126663+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:23.262308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753608+0000","last_change":"2024-09-15T23:58:06.747941+0000","last_active":"2024-09-15T23:58:06.753608+0000","last_peered":"2024-09-15T23:58:06.753608+0000","last_clean":"2024-09-15T23:58:06.753608+0000","last_became_active":"2024-09-15T23:58:06.747101+0000","last_became_peered":"2024-09-15T23:58:06.747101+0000","last_unstale":"2024-09-15T23:58:06.753608+0000","last_undegraded":"2024-09-15T23:58:06.753608+0000","last_fullsized":"2024-09-15T23:58:06.753608+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:01.213481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126526+0000","last_change":"2024-09-15T23:58:07.775709+0000","last_active":"2024-09-15T23:58:09.126526+0000","last_peered":"2024-09-15T23:58:09.126526+0000","last_clean":"2024-09-15T23:58:09.126526+0000","last_became_active":"2024-09-15T23:58:07.774896+0000","last_became_peered":"2024-09-15T23:58:07.774896+0000","last_unstale":"2024-09-15T23:58:09.126526+0000","last_undegraded":"2024-09-15T23:58:09.126526+0000","last_fullsized":"2024-09-15T23:58:09.126526+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:42.839656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791159+0000","last_change":"2024-09-15T23:58:06.732322+0000","last_active":"2024-09-15T23:58:08.791159+0000","last_peered":"2024-09-15T23:58:08.791159+0000","last_clean":"2024-09-15T23:58:08.791159+0000","last_became_active":"2024-09-15T23:58:06.731337+0000","last_became_peered":"2024-09-15T23:58:06.731337+0000","last_unstale":"2024-09-15T23:58:08.791159+0000","last_undegraded":"2024-09-15T23:58:08.791159+0000","last_fullsized":"2024-09-15T23:58:08.791159+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:00.946105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757489+0000","last_change":"2024-09-15T23:58:07.769923+0000","last_active":"2024-09-15T23:58:08.757489+0000","last_peered":"2024-09-15T23:58:08.757489+0000","last_clean":"2024-09-15T23:58:08.757489+0000","last_became_active":"2024-09-15T23:58:07.769057+0000","last_became_peered":"2024-09-15T23:58:07.769057+0000","last_unstale":"2024-09-15T23:58:08.757489+0000","last_undegraded":"2024-09-15T23:58:08.757489+0000","last_fullsized":"2024-09-15T23:58:08.757489+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:25.029723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758016+0000","last_change":"2024-09-15T23:58:06.737190+0000","last_active":"2024-09-15T23:58:08.758016+0000","last_peered":"2024-09-15T23:58:08.758016+0000","last_clean":"2024-09-15T23:58:08.758016+0000","last_became_active":"2024-09-15T23:58:06.736804+0000","last_became_peered":"2024-09-15T23:58:06.736804+0000","last_unstale":"2024-09-15T23:58:08.758016+0000","last_undegraded":"2024-09-15T23:58:08.758016+0000","last_fullsized":"2024-09-15T23:58:08.758016+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:30.329573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.125911+0000","last_change":"2024-09-15T23:58:07.775890+0000","last_active":"2024-09-15T23:58:09.125911+0000","last_peered":"2024-09-15T23:58:09.125911+0000","last_clean":"2024-09-15T23:58:09.125911+0000","last_became_active":"2024-09-15T23:58:07.774559+0000","last_became_peered":"2024-09-15T23:58:07.774559+0000","last_unstale":"2024-09-15T23:58:09.125911+0000","last_undegraded":"2024-09-15T23:58:09.125911+0000","last_fullsized":"2024-09-15T23:58:09.125911+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:12.409978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.752582+0000","last_change":"2024-09-15T23:58:06.746347+0000","last_active":"2024-09-15T23:58:06.752582+0000","last_peered":"2024-09-15T23:58:06.752582+0000","last_clean":"2024-09-15T23:58:06.752582+0000","last_became_active":"2024-09-15T23:58:06.742108+0000","last_became_peered":"2024-09-15T23:58:06.742108+0000","last_unstale":"2024-09-15T23:58:06.752582+0000","last_undegraded":"2024-09-15T23:58:06.752582+0000","last_fullsized":"2024-09-15T23:58:06.752582+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:20.013521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129655+0000","last_change":"2024-09-15T23:58:07.766829+0000","last_active":"2024-09-15T23:58:09.129655+0000","last_peered":"2024-09-15T23:58:09.129655+0000","last_clean":"2024-09-15T23:58:09.129655+0000","last_became_active":"2024-09-15T23:58:07.766205+0000","last_became_peered":"2024-09-15T23:58:07.766205+0000","last_unstale":"2024-09-15T23:58:09.129655+0000","last_undegraded":"2024-09-15T23:58:09.129655+0000","last_fullsized":"2024-09-15T23:58:09.129655+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:53.825799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.752630+0000","last_change":"2024-09-15T23:58:06.746464+0000","last_active":"2024-09-15T23:58:06.752630+0000","last_peered":"2024-09-15T23:58:06.752630+0000","last_clean":"2024-09-15T23:58:06.752630+0000","last_became_active":"2024-09-15T23:58:06.741814+0000","last_became_peered":"2024-09-15T23:58:06.741814+0000","last_unstale":"2024-09-15T23:58:06.752630+0000","last_undegraded":"2024-09-15T23:58:06.752630+0000","last_fullsized":"2024-09-15T23:58:06.752630+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:43.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758539+0000","last_change":"2024-09-15T23:58:07.760444+0000","last_active":"2024-09-15T23:58:08.758539+0000","last_peered":"2024-09-15T23:58:08.758539+0000","last_clean":"2024-09-15T23:58:08.758539+0000","last_became_active":"2024-09-15T23:58:07.759706+0000","last_became_peered":"2024-09-15T23:58:07.759706+0000","last_unstale":"2024-09-15T23:58:08.758539+0000","last_undegraded":"2024-09-15T23:58:08.758539+0000","last_fullsized":"2024-09-15T23:58:08.758539+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:36.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128487+0000","last_change":"2024-09-15T23:58:06.738930+0000","last_active":"2024-09-15T23:58:09.128487+0000","last_peered":"2024-09-15T23:58:09.128487+0000","last_clean":"2024-09-15T23:58:09.128487+0000","last_became_active":"2024-09-15T23:58:06.737965+0000","last_became_peered":"2024-09-15T23:58:06.737965+0000","last_unstale":"2024-09-15T23:58:09.128487+0000","last_undegraded":"2024-09-15T23:58:09.128487+0000","last_fullsized":"2024-09-15T23:58:09.128487+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:27.303288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128573+0000","last_change":"2024-09-15T23:58:07.771056+0000","last_active":"2024-09-15T23:58:09.128573+0000","last_peered":"2024-09-15T23:58:09.128573+0000","last_clean":"2024-09-15T23:58:09.128573+0000","last_became_active":"2024-09-15T23:58:07.770335+0000","last_became_peered":"2024-09-15T23:58:07.770335+0000","last_unstale":"2024-09-15T23:58:09.128573+0000","last_undegraded":"2024-09-15T23:58:09.128573+0000","last_fullsized":"2024-09-15T23:58:09.128573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:00.705487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757220+0000","last_change":"2024-09-15T23:58:06.733282+0000","last_active":"2024-09-15T23:58:08.757220+0000","last_peered":"2024-09-15T23:58:08.757220+0000","last_clean":"2024-09-15T23:58:08.757220+0000","last_became_active":"2024-09-15T23:58:06.731829+0000","last_became_peered":"2024-09-15T23:58:06.731829+0000","last_unstale":"2024-09-15T23:58:08.757220+0000","last_undegraded":"2024-09-15T23:58:08.757220+0000","last_fullsized":"2024-09-15T23:58:08.757220+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:37.214555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756733+0000","last_change":"2024-09-15T23:58:07.796182+0000","last_active":"2024-09-15T23:58:08.756733+0000","last_peered":"2024-09-15T23:58:08.756733+0000","last_clean":"2024-09-15T23:58:08.756733+0000","last_became_active":"2024-09-15T23:58:07.783093+0000","last_became_peered":"2024-09-15T23:58:07.783093+0000","last_unstale":"2024-09-15T23:58:08.756733+0000","last_undegraded":"2024-09-15T23:58:08.756733+0000","last_fullsized":"2024-09-15T23:58:08.756733+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:01.714283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129162+0000","last_change":"2024-09-15T23:58:06.736436+0000","last_active":"2024-09-15T23:58:09.129162+0000","last_peered":"2024-09-15T23:58:09.129162+0000","last_clean":"2024-09-15T23:58:09.129162+0000","last_became_active":"2024-09-15T23:58:06.736078+0000","last_became_peered":"2024-09-15T23:58:06.736078+0000","last_unstale":"2024-09-15T23:58:09.129162+0000","last_undegraded":"2024-09-15T23:58:09.129162+0000","last_fullsized":"2024-09-15T23:58:09.129162+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:49.214605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756427+0000","last_change":"2024-09-15T23:58:07.791074+0000","last_active":"2024-09-15T23:58:08.756427+0000","last_peered":"2024-09-15T23:58:08.756427+0000","last_clean":"2024-09-15T23:58:08.756427+0000","last_became_active":"2024-09-15T23:58:07.782975+0000","last_became_peered":"2024-09-15T23:58:07.782975+0000","last_unstale":"2024-09-15T23:58:08.756427+0000","last_undegraded":"2024-09-15T23:58:08.756427+0000","last_fullsized":"2024-09-15T23:58:08.756427+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:22.748219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753553+0000","last_change":"2024-09-15T23:58:06.747357+0000","last_active":"2024-09-15T23:58:06.753553+0000","last_peered":"2024-09-15T23:58:06.753553+0000","last_clean":"2024-09-15T23:58:06.753553+0000","last_became_active":"2024-09-15T23:58:06.746786+0000","last_became_peered":"2024-09-15T23:58:06.746786+0000","last_unstale":"2024-09-15T23:58:06.753553+0000","last_undegraded":"2024-09-15T23:58:06.753553+0000","last_fullsized":"2024-09-15T23:58:06.753553+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:16.498783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791793+0000","last_change":"2024-09-15T23:58:07.781892+0000","last_active":"2024-09-15T23:58:08.791793+0000","last_peered":"2024-09-15T23:58:08.791793+0000","last_clean":"2024-09-15T23:58:08.791793+0000","last_became_active":"2024-09-15T23:58:07.781560+0000","last_became_peered":"2024-09-15T23:58:07.781560+0000","last_unstale":"2024-09-15T23:58:08.791793+0000","last_undegraded":"2024-09-15T23:58:08.791793+0000","last_fullsized":"2024-09-15T23:58:08.791793+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:38.958811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128120+0000","last_change":"2024-09-15T23:58:06.734272+0000","last_active":"2024-09-15T23:58:09.128120+0000","last_peered":"2024-09-15T23:58:09.128120+0000","last_clean":"2024-09-15T23:58:09.128120+0000","last_became_active":"2024-09-15T23:58:06.734020+0000","last_became_peered":"2024-09-15T23:58:06.734020+0000","last_unstale":"2024-09-15T23:58:09.128120+0000","last_undegraded":"2024-09-15T23:58:09.128120+0000","last_fullsized":"2024-09-15T23:58:09.128120+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:30.329573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753804+0000","last_change":"2024-09-15T23:58:07.772545+0000","last_active":"2024-09-15T23:58:08.753804+0000","last_peered":"2024-09-15T23:58:08.753804+0000","last_clean":"2024-09-15T23:58:08.753804+0000","last_became_active":"2024-09-15T23:58:07.772139+0000","last_became_peered":"2024-09-15T23:58:07.772139+0000","last_unstale":"2024-09-15T23:58:08.753804+0000","last_undegraded":"2024-09-15T23:58:08.753804+0000","last_fullsized":"2024-09-15T23:58:08.753804+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:01.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-15T23:58:06.753650+0000","last_change":"2024-09-15T23:58:06.748574+0000","last_active":"2024-09-15T23:58:06.753650+0000","last_peered":"2024-09-15T23:58:06.753650+0000","last_clean":"2024-09-15T23:58:06.753650+0000","last_became_active":"2024-09-15T23:58:06.740503+0000","last_became_peered":"2024-09-15T23:58:06.740503+0000","last_unstale":"2024-09-15T23:58:06.753650+0000","last_undegraded":"2024-09-15T23:58:06.753650+0000","last_fullsized":"2024-09-15T23:58:06.753650+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:59.706046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791109+0000","last_change":"2024-09-15T23:58:07.778092+0000","last_active":"2024-09-15T23:58:08.791109+0000","last_peered":"2024-09-15T23:58:08.791109+0000","last_clean":"2024-09-15T23:58:08.791109+0000","last_became_active":"2024-09-15T23:58:07.775739+0000","last_became_peered":"2024-09-15T23:58:07.775739+0000","last_unstale":"2024-09-15T23:58:08.791109+0000","last_undegraded":"2024-09-15T23:58:08.791109+0000","last_fullsized":"2024-09-15T23:58:08.791109+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:22:00.044070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756867+0000","last_change":"2024-09-15T23:58:06.737213+0000","last_active":"2024-09-15T23:58:08.756867+0000","last_peered":"2024-09-15T23:58:08.756867+0000","last_clean":"2024-09-15T23:58:08.756867+0000","last_became_active":"2024-09-15T23:58:06.736308+0000","last_became_peered":"2024-09-15T23:58:06.736308+0000","last_unstale":"2024-09-15T23:58:08.756867+0000","last_undegraded":"2024-09-15T23:58:08.756867+0000","last_fullsized":"2024-09-15T23:58:08.756867+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:53.980679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":309,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128100+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:58:09.128100+0000","last_peered":"2024-09-15T23:58:09.128100+0000","last_clean":"2024-09-15T23:58:09.128100+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:58:09.128100+0000","last_undegraded":"2024-09-15T23:58:09.128100+0000","last_fullsized":"2024-09-15T23:58:09.128100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1191936,"data_stored":540950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1196032,"data_stored":541910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":547024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36520,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335320,"statfs":{"total":96636764160,"available":96599367680,"internally_reserved":0,"allocated":1196032,"data_stored":541910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1204224,"data_stored":547102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1130758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":547572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37068,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334772,"statfs":{"total":96636764160,"available":96598806528,"internally_reserved":0,"allocated":1753088,"data_stored":1116832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:58:13.692 INFO:tasks.ceph.mds.a.smithi112.stderr:2024-09-15T23:58:13.693+0000 7fc3f90a7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:58:14.018 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:58:14.020 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:58:16.170 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:58:16.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc486fa640 1 Processor -- start 2024-09-15T23:58:16.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc486fa640 1 -- start start 2024-09-15T23:58:16.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc486fa640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efc400af8d0 0x7efc4006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:16.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc486fa640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc4006eec0 0x7efc400b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:16.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc486fa640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efc400b3b00 0x7efc4015def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:16.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc486fa640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7efc40072120 con 0x7efc400af8d0 2024-09-15T23:58:16.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc486fa640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7efc4006f400 con 0x7efc400b3b00 2024-09-15T23:58:16.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc486fa640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efc4006f6e0 con 0x7efc4006eec0 2024-09-15T23:58:16.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc46496640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efc400af8d0 0x7efc4006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:16.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc46496640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efc400af8d0 0x7efc4006e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59850/0 (socket says 172.21.15.112:59850) 2024-09-15T23:58:16.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc46496640 1 -- 172.21.15.112:0/1219874989 learned_addr learned my addr 172.21.15.112:0/1219874989 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:16.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc45c95640 1 --2- 172.21.15.112:0/1219874989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc4006eec0 0x7efc400b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:16.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc46c97640 1 --2- 172.21.15.112:0/1219874989 >> v2:172.21.15.169:3300/0 conn(0x7efc400b3b00 0x7efc4015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:16.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc46496640 1 -- 172.21.15.112:0/1219874989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc4006eec0 msgr2=0x7efc400b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:16.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc46496640 1 --2- 172.21.15.112:0/1219874989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc4006eec0 0x7efc400b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc46496640 1 -- 172.21.15.112:0/1219874989 >> v2:172.21.15.169:3300/0 conn(0x7efc400b3b00 msgr2=0x7efc4015def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:16.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc46496640 1 --2- 172.21.15.112:0/1219874989 >> v2:172.21.15.169:3300/0 conn(0x7efc400b3b00 0x7efc4015def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.305+0000 7efc46496640 1 -- 172.21.15.112:0/1219874989 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc40072370 con 0x7efc400af8d0 2024-09-15T23:58:16.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.309+0000 7efc46496640 1 --2- 172.21.15.112:0/1219874989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc400af8d0 0x7efc4006e980 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7efc4006f300 tx=0x7efc3c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ca2fead0f87466 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:16.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.309+0000 7efc45494640 1 -- 172.21.15.112:0/1219874989 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c0b0070 con 0x7efc400af8d0 2024-09-15T23:58:16.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.309+0000 7efc45494640 1 -- 172.21.15.112:0/1219874989 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc3c0a4e50 con 0x7efc400af8d0 2024-09-15T23:58:16.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.309+0000 7efc45494640 1 -- 172.21.15.112:0/1219874989 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c0ab820 con 0x7efc400af8d0 2024-09-15T23:58:16.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.309+0000 7efc486fa640 1 -- 172.21.15.112:0/1219874989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc400af8d0 msgr2=0x7efc4006e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:16.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.309+0000 7efc486fa640 1 --2- 172.21.15.112:0/1219874989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc400af8d0 0x7efc4006e980 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7efc4006f300 tx=0x7efc3c01c400 comp rx=0 tx=0).stop 2024-09-15T23:58:16.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.309+0000 7efc486fa640 1 -- 172.21.15.112:0/1219874989 shutdown_connections 2024-09-15T23:58:16.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.309+0000 7efc486fa640 1 --2- 172.21.15.112:0/1219874989 >> v2:172.21.15.169:3300/0 conn(0x7efc400b3b00 0x7efc4015def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.309+0000 7efc486fa640 1 --2- 172.21.15.112:0/1219874989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc4006eec0 0x7efc400b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.309+0000 7efc486fa640 1 --2- 172.21.15.112:0/1219874989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc400af8d0 0x7efc4006e980 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.309+0000 7efc486fa640 1 -- 172.21.15.112:0/1219874989 >> 172.21.15.112:0/1219874989 conn(0x7efc400b1f90 msgr2=0x7efc400b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:16.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.309+0000 7efc486fa640 1 -- 172.21.15.112:0/1219874989 shutdown_connections 2024-09-15T23:58:16.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.309+0000 7efc486fa640 1 -- 172.21.15.112:0/1219874989 wait complete. 2024-09-15T23:58:16.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc486fa640 1 Processor -- start 2024-09-15T23:58:16.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc486fa640 1 -- start start 2024-09-15T23:58:16.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc486fa640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc4006eec0 0x7efc4009bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:16.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc486fa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc400af8d0 0x7efc40099810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:16.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc486fa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc400b3b00 0x7efc400cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:16.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc486fa640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efc40072f00 con 0x7efc400af8d0 2024-09-15T23:58:16.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc486fa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efc40072d80 con 0x7efc400b3b00 2024-09-15T23:58:16.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc486fa640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efc40073080 con 0x7efc4006eec0 2024-09-15T23:58:16.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc45c95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc400af8d0 0x7efc40099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:16.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc45c95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc400af8d0 0x7efc40099810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59852/0 (socket says 172.21.15.112:59852) 2024-09-15T23:58:16.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc45c95640 1 -- 172.21.15.112:0/1170280655 learned_addr learned my addr 172.21.15.112:0/1170280655 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:16.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc46496640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc4006eec0 0x7efc4009bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:16.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc46c97640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc400b3b00 0x7efc400cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:16.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc45c95640 1 -- 172.21.15.112:0/1170280655 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc4006eec0 msgr2=0x7efc4009bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:16.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc45c95640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc4006eec0 0x7efc4009bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc45c95640 1 -- 172.21.15.112:0/1170280655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc400b3b00 msgr2=0x7efc400cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:16.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc45c95640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc400b3b00 0x7efc400cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc45c95640 1 -- 172.21.15.112:0/1170280655 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc40159e90 con 0x7efc400af8d0 2024-09-15T23:58:16.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc46c97640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc400b3b00 0x7efc400cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:16.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc45c95640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc400af8d0 0x7efc40099810 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7efc3000d830 tx=0x7efc3000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:16.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc36ffd640 1 -- 172.21.15.112:0/1170280655 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30018020 con 0x7efc400af8d0 2024-09-15T23:58:16.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc36ffd640 1 -- 172.21.15.112:0/1170280655 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc300096a0 con 0x7efc400af8d0 2024-09-15T23:58:16.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc486fa640 1 -- 172.21.15.112:0/1170280655 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4009c110 con 0x7efc400af8d0 2024-09-15T23:58:16.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc36ffd640 1 -- 172.21.15.112:0/1170280655 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30009a50 con 0x7efc400af8d0 2024-09-15T23:58:16.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc486fa640 1 -- 172.21.15.112:0/1170280655 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc40159870 con 0x7efc400af8d0 2024-09-15T23:58:16.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc486fa640 1 -- 172.21.15.112:0/1170280655 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc4006e980 con 0x7efc400af8d0 2024-09-15T23:58:16.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc36ffd640 1 -- 172.21.15.112:0/1170280655 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efc3001b020 con 0x7efc400af8d0 2024-09-15T23:58:16.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.313+0000 7efc36ffd640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efc240678f0 0x7efc24069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:16.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.317+0000 7efc36ffd640 1 -- 172.21.15.112:0/1170280655 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7efc30086600 con 0x7efc400af8d0 2024-09-15T23:58:16.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.317+0000 7efc46496640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efc240678f0 0x7efc24069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:16.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.317+0000 7efc46496640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efc240678f0 0x7efc24069db0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0ad000 tx=0x7efc3c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:16.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.321+0000 7efc36ffd640 1 -- 172.21.15.112:0/1170280655 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efc30022020 con 0x7efc400af8d0 2024-09-15T23:58:16.478 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.477+0000 7efc486fa640 1 -- 172.21.15.112:0/1170280655 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc4009a640 con 0x7efc240678f0 2024-09-15T23:58:16.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.489+0000 7efc36ffd640 1 -- 172.21.15.112:0/1170280655 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252003 (secure 0 0 0) 0x7efc4009a640 con 0x7efc240678f0 2024-09-15T23:58:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:16.493 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:58:16.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.493+0000 7efc486fa640 1 -- 172.21.15.112:0/1170280655 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efc240678f0 msgr2=0x7efc24069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:16.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.493+0000 7efc486fa640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efc240678f0 0x7efc24069db0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0ad000 tx=0x7efc3c0a6000 comp rx=0 tx=0).stop 2024-09-15T23:58:16.494 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.493+0000 7efc486fa640 1 -- 172.21.15.112:0/1170280655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc400af8d0 msgr2=0x7efc40099810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:16.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.493+0000 7efc486fa640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc400af8d0 0x7efc40099810 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7efc3000d830 tx=0x7efc3000dcf0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.493+0000 7efc486fa640 1 -- 172.21.15.112:0/1170280655 shutdown_connections 2024-09-15T23:58:16.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.493+0000 7efc486fa640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efc240678f0 0x7efc24069db0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.493+0000 7efc486fa640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc400b3b00 0x7efc400cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.493+0000 7efc486fa640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc400af8d0 0x7efc40099810 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.493+0000 7efc486fa640 1 --2- 172.21.15.112:0/1170280655 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc4006eec0 0x7efc4009bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.493+0000 7efc486fa640 1 -- 172.21.15.112:0/1170280655 >> 172.21.15.112:0/1170280655 conn(0x7efc400b1f90 msgr2=0x7efc4015a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:16.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.493+0000 7efc486fa640 1 -- 172.21.15.112:0/1170280655 shutdown_connections 2024-09-15T23:58:16.495 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.493+0000 7efc486fa640 1 -- 172.21.15.112:0/1170280655 wait complete. 2024-09-15T23:58:16.509 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-09-15T23:58:15.314796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":268404,"kb_used_data":10568,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754706316,"statfs":{"total":773094113280,"available":772819267584,"internally_reserved":0,"allocated":10821632,"data_stored":5561476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002323"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757324+0000","last_change":"2024-09-15T23:58:07.765376+0000","last_active":"2024-09-15T23:58:08.757324+0000","last_peered":"2024-09-15T23:58:08.757324+0000","last_clean":"2024-09-15T23:58:08.757324+0000","last_became_active":"2024-09-15T23:58:07.764634+0000","last_became_peered":"2024-09-15T23:58:07.764634+0000","last_unstale":"2024-09-15T23:58:08.757324+0000","last_undegraded":"2024-09-15T23:58:08.757324+0000","last_fullsized":"2024-09-15T23:58:08.757324+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:17.697740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753334+0000","last_change":"2024-09-15T23:58:07.773180+0000","last_active":"2024-09-15T23:58:08.753334+0000","last_peered":"2024-09-15T23:58:08.753334+0000","last_clean":"2024-09-15T23:58:08.753334+0000","last_became_active":"2024-09-15T23:58:07.772756+0000","last_became_peered":"2024-09-15T23:58:07.772756+0000","last_unstale":"2024-09-15T23:58:08.753334+0000","last_undegraded":"2024-09-15T23:58:08.753334+0000","last_fullsized":"2024-09-15T23:58:08.753334+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:25.286230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.786086+0000","last_change":"2024-09-15T23:58:07.782135+0000","last_active":"2024-09-15T23:58:08.786086+0000","last_peered":"2024-09-15T23:58:08.786086+0000","last_clean":"2024-09-15T23:58:08.786086+0000","last_became_active":"2024-09-15T23:58:07.781669+0000","last_became_peered":"2024-09-15T23:58:07.781669+0000","last_unstale":"2024-09-15T23:58:08.786086+0000","last_undegraded":"2024-09-15T23:58:08.786086+0000","last_fullsized":"2024-09-15T23:58:08.786086+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:17.448597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756033+0000","last_change":"2024-09-15T23:58:07.792209+0000","last_active":"2024-09-15T23:58:08.756033+0000","last_peered":"2024-09-15T23:58:08.756033+0000","last_clean":"2024-09-15T23:58:08.756033+0000","last_became_active":"2024-09-15T23:58:07.783955+0000","last_became_peered":"2024-09-15T23:58:07.783955+0000","last_unstale":"2024-09-15T23:58:08.756033+0000","last_undegraded":"2024-09-15T23:58:08.756033+0000","last_fullsized":"2024-09-15T23:58:08.756033+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:01.050859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756642+0000","last_change":"2024-09-15T23:58:07.766302+0000","last_active":"2024-09-15T23:58:08.756642+0000","last_peered":"2024-09-15T23:58:08.756642+0000","last_clean":"2024-09-15T23:58:08.756642+0000","last_became_active":"2024-09-15T23:58:07.765484+0000","last_became_peered":"2024-09-15T23:58:07.765484+0000","last_unstale":"2024-09-15T23:58:08.756642+0000","last_undegraded":"2024-09-15T23:58:08.756642+0000","last_fullsized":"2024-09-15T23:58:08.756642+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:35.296757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791365+0000","last_change":"2024-09-15T23:58:07.780199+0000","last_active":"2024-09-15T23:58:08.791365+0000","last_peered":"2024-09-15T23:58:08.791365+0000","last_clean":"2024-09-15T23:58:08.791365+0000","last_became_active":"2024-09-15T23:58:07.779937+0000","last_became_peered":"2024-09-15T23:58:07.779937+0000","last_unstale":"2024-09-15T23:58:08.791365+0000","last_undegraded":"2024-09-15T23:58:08.791365+0000","last_fullsized":"2024-09-15T23:58:08.791365+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:34.415985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.790898+0000","last_change":"2024-09-15T23:58:07.779584+0000","last_active":"2024-09-15T23:58:08.790898+0000","last_peered":"2024-09-15T23:58:08.790898+0000","last_clean":"2024-09-15T23:58:08.790898+0000","last_became_active":"2024-09-15T23:58:07.776328+0000","last_became_peered":"2024-09-15T23:58:07.776328+0000","last_unstale":"2024-09-15T23:58:08.790898+0000","last_undegraded":"2024-09-15T23:58:08.790898+0000","last_fullsized":"2024-09-15T23:58:08.790898+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:20.154190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757373+0000","last_change":"2024-09-15T23:58:07.759525+0000","last_active":"2024-09-15T23:58:08.757373+0000","last_peered":"2024-09-15T23:58:08.757373+0000","last_clean":"2024-09-15T23:58:08.757373+0000","last_became_active":"2024-09-15T23:58:07.759015+0000","last_became_peered":"2024-09-15T23:58:07.759015+0000","last_unstale":"2024-09-15T23:58:08.757373+0000","last_undegraded":"2024-09-15T23:58:08.757373+0000","last_fullsized":"2024-09-15T23:58:08.757373+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:38.225855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753896+0000","last_change":"2024-09-15T23:58:07.800146+0000","last_active":"2024-09-15T23:58:08.753896+0000","last_peered":"2024-09-15T23:58:08.753896+0000","last_clean":"2024-09-15T23:58:08.753896+0000","last_became_active":"2024-09-15T23:58:07.799851+0000","last_became_peered":"2024-09-15T23:58:07.799851+0000","last_unstale":"2024-09-15T23:58:08.753896+0000","last_undegraded":"2024-09-15T23:58:08.753896+0000","last_fullsized":"2024-09-15T23:58:08.753896+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:36.707754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758499+0000","last_change":"2024-09-15T23:58:07.753670+0000","last_active":"2024-09-15T23:58:08.758499+0000","last_peered":"2024-09-15T23:58:08.758499+0000","last_clean":"2024-09-15T23:58:08.758499+0000","last_became_active":"2024-09-15T23:58:07.752863+0000","last_became_peered":"2024-09-15T23:58:07.752863+0000","last_unstale":"2024-09-15T23:58:08.758499+0000","last_undegraded":"2024-09-15T23:58:08.758499+0000","last_fullsized":"2024-09-15T23:58:08.758499+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:53.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128244+0000","last_change":"2024-09-15T23:58:07.773082+0000","last_active":"2024-09-15T23:58:09.128244+0000","last_peered":"2024-09-15T23:58:09.128244+0000","last_clean":"2024-09-15T23:58:09.128244+0000","last_became_active":"2024-09-15T23:58:07.768580+0000","last_became_peered":"2024-09-15T23:58:07.768580+0000","last_unstale":"2024-09-15T23:58:09.128244+0000","last_undegraded":"2024-09-15T23:58:09.128244+0000","last_fullsized":"2024-09-15T23:58:09.128244+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:55.098428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791187+0000","last_change":"2024-09-15T23:58:07.779856+0000","last_active":"2024-09-15T23:58:08.791187+0000","last_peered":"2024-09-15T23:58:08.791187+0000","last_clean":"2024-09-15T23:58:08.791187+0000","last_became_active":"2024-09-15T23:58:07.779553+0000","last_became_peered":"2024-09-15T23:58:07.779553+0000","last_unstale":"2024-09-15T23:58:08.791187+0000","last_undegraded":"2024-09-15T23:58:08.791187+0000","last_fullsized":"2024-09-15T23:58:08.791187+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:45.241169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.755836+0000","last_change":"2024-09-15T23:58:07.796750+0000","last_active":"2024-09-15T23:58:08.755836+0000","last_peered":"2024-09-15T23:58:08.755836+0000","last_clean":"2024-09-15T23:58:08.755836+0000","last_became_active":"2024-09-15T23:58:07.792310+0000","last_became_peered":"2024-09-15T23:58:07.792310+0000","last_unstale":"2024-09-15T23:58:08.755836+0000","last_undegraded":"2024-09-15T23:58:08.755836+0000","last_fullsized":"2024-09-15T23:58:08.755836+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:20.742739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791283+0000","last_change":"2024-09-15T23:58:07.776737+0000","last_active":"2024-09-15T23:58:08.791283+0000","last_peered":"2024-09-15T23:58:08.791283+0000","last_clean":"2024-09-15T23:58:08.791283+0000","last_became_active":"2024-09-15T23:58:07.776475+0000","last_became_peered":"2024-09-15T23:58:07.776475+0000","last_unstale":"2024-09-15T23:58:08.791283+0000","last_undegraded":"2024-09-15T23:58:08.791283+0000","last_fullsized":"2024-09-15T23:58:08.791283+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:58.182086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.752647+0000","last_change":"2024-09-15T23:58:07.789278+0000","last_active":"2024-09-15T23:58:08.752647+0000","last_peered":"2024-09-15T23:58:08.752647+0000","last_clean":"2024-09-15T23:58:08.752647+0000","last_became_active":"2024-09-15T23:58:07.788374+0000","last_became_peered":"2024-09-15T23:58:07.788374+0000","last_unstale":"2024-09-15T23:58:08.752647+0000","last_undegraded":"2024-09-15T23:58:08.752647+0000","last_fullsized":"2024-09-15T23:58:08.752647+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:10.386941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.127573+0000","last_change":"2024-09-15T23:58:07.777214+0000","last_active":"2024-09-15T23:58:09.127573+0000","last_peered":"2024-09-15T23:58:09.127573+0000","last_clean":"2024-09-15T23:58:09.127573+0000","last_became_active":"2024-09-15T23:58:07.776537+0000","last_became_peered":"2024-09-15T23:58:07.776537+0000","last_unstale":"2024-09-15T23:58:09.127573+0000","last_undegraded":"2024-09-15T23:58:09.127573+0000","last_fullsized":"2024-09-15T23:58:09.127573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:38.958811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.786349+0000","last_change":"2024-09-15T23:58:07.782190+0000","last_active":"2024-09-15T23:58:08.786349+0000","last_peered":"2024-09-15T23:58:08.786349+0000","last_clean":"2024-09-15T23:58:08.786349+0000","last_became_active":"2024-09-15T23:58:07.781519+0000","last_became_peered":"2024-09-15T23:58:07.781519+0000","last_unstale":"2024-09-15T23:58:08.786349+0000","last_undegraded":"2024-09-15T23:58:08.786349+0000","last_fullsized":"2024-09-15T23:58:08.786349+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:06.018463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753613+0000","last_change":"2024-09-15T23:58:07.773809+0000","last_active":"2024-09-15T23:58:08.753613+0000","last_peered":"2024-09-15T23:58:08.753613+0000","last_clean":"2024-09-15T23:58:08.753613+0000","last_became_active":"2024-09-15T23:58:07.773013+0000","last_became_peered":"2024-09-15T23:58:07.773013+0000","last_unstale":"2024-09-15T23:58:08.753613+0000","last_undegraded":"2024-09-15T23:58:08.753613+0000","last_fullsized":"2024-09-15T23:58:08.753613+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:35.110846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756318+0000","last_change":"2024-09-15T23:58:07.797639+0000","last_active":"2024-09-15T23:58:08.756318+0000","last_peered":"2024-09-15T23:58:08.756318+0000","last_clean":"2024-09-15T23:58:08.756318+0000","last_became_active":"2024-09-15T23:58:07.796983+0000","last_became_peered":"2024-09-15T23:58:07.796983+0000","last_unstale":"2024-09-15T23:58:08.756318+0000","last_undegraded":"2024-09-15T23:58:08.756318+0000","last_fullsized":"2024-09-15T23:58:08.756318+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:34.778205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128194+0000","last_change":"2024-09-15T23:58:07.762602+0000","last_active":"2024-09-15T23:58:09.128194+0000","last_peered":"2024-09-15T23:58:09.128194+0000","last_clean":"2024-09-15T23:58:09.128194+0000","last_became_active":"2024-09-15T23:58:07.761868+0000","last_became_peered":"2024-09-15T23:58:07.761868+0000","last_unstale":"2024-09-15T23:58:09.128194+0000","last_undegraded":"2024-09-15T23:58:09.128194+0000","last_fullsized":"2024-09-15T23:58:09.128194+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:38.225855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.785715+0000","last_change":"2024-09-15T23:58:07.758999+0000","last_active":"2024-09-15T23:58:08.785715+0000","last_peered":"2024-09-15T23:58:08.785715+0000","last_clean":"2024-09-15T23:58:08.785715+0000","last_became_active":"2024-09-15T23:58:07.758264+0000","last_became_peered":"2024-09-15T23:58:07.758264+0000","last_unstale":"2024-09-15T23:58:08.785715+0000","last_undegraded":"2024-09-15T23:58:08.785715+0000","last_fullsized":"2024-09-15T23:58:08.785715+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:49.878767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126816+0000","last_change":"2024-09-15T23:58:07.782785+0000","last_active":"2024-09-15T23:58:09.126816+0000","last_peered":"2024-09-15T23:58:09.126816+0000","last_clean":"2024-09-15T23:58:09.126816+0000","last_became_active":"2024-09-15T23:58:07.782088+0000","last_became_peered":"2024-09-15T23:58:07.782088+0000","last_unstale":"2024-09-15T23:58:09.126816+0000","last_undegraded":"2024-09-15T23:58:09.126816+0000","last_fullsized":"2024-09-15T23:58:09.126816+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:21.579619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758736+0000","last_change":"2024-09-15T23:58:07.778120+0000","last_active":"2024-09-15T23:58:08.758736+0000","last_peered":"2024-09-15T23:58:08.758736+0000","last_clean":"2024-09-15T23:58:08.758736+0000","last_became_active":"2024-09-15T23:58:07.777366+0000","last_became_peered":"2024-09-15T23:58:07.777366+0000","last_unstale":"2024-09-15T23:58:08.758736+0000","last_undegraded":"2024-09-15T23:58:08.758736+0000","last_fullsized":"2024-09-15T23:58:08.758736+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:28.979657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757763+0000","last_change":"2024-09-15T23:58:07.768580+0000","last_active":"2024-09-15T23:58:08.757763+0000","last_peered":"2024-09-15T23:58:08.757763+0000","last_clean":"2024-09-15T23:58:08.757763+0000","last_became_active":"2024-09-15T23:58:07.768022+0000","last_became_peered":"2024-09-15T23:58:07.768022+0000","last_unstale":"2024-09-15T23:58:08.757763+0000","last_undegraded":"2024-09-15T23:58:08.757763+0000","last_fullsized":"2024-09-15T23:58:08.757763+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:00.705487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129489+0000","last_change":"2024-09-15T23:58:07.796575+0000","last_active":"2024-09-15T23:58:09.129489+0000","last_peered":"2024-09-15T23:58:09.129489+0000","last_clean":"2024-09-15T23:58:09.129489+0000","last_became_active":"2024-09-15T23:58:07.788327+0000","last_became_peered":"2024-09-15T23:58:07.788327+0000","last_unstale":"2024-09-15T23:58:09.129489+0000","last_undegraded":"2024-09-15T23:58:09.129489+0000","last_fullsized":"2024-09-15T23:58:09.129489+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:28.979657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129311+0000","last_change":"2024-09-15T23:58:07.796461+0000","last_active":"2024-09-15T23:58:09.129311+0000","last_peered":"2024-09-15T23:58:09.129311+0000","last_clean":"2024-09-15T23:58:09.129311+0000","last_became_active":"2024-09-15T23:58:07.796172+0000","last_became_peered":"2024-09-15T23:58:07.796172+0000","last_unstale":"2024-09-15T23:58:09.129311+0000","last_undegraded":"2024-09-15T23:58:09.129311+0000","last_fullsized":"2024-09-15T23:58:09.129311+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:26.451417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129132+0000","last_change":"2024-09-15T23:58:07.779754+0000","last_active":"2024-09-15T23:58:09.129132+0000","last_peered":"2024-09-15T23:58:09.129132+0000","last_clean":"2024-09-15T23:58:09.129132+0000","last_became_active":"2024-09-15T23:58:07.779070+0000","last_became_peered":"2024-09-15T23:58:07.779070+0000","last_unstale":"2024-09-15T23:58:09.129132+0000","last_undegraded":"2024-09-15T23:58:09.129132+0000","last_fullsized":"2024-09-15T23:58:09.129132+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:53.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791414+0000","last_change":"2024-09-15T23:58:07.781973+0000","last_active":"2024-09-15T23:58:08.791414+0000","last_peered":"2024-09-15T23:58:08.791414+0000","last_clean":"2024-09-15T23:58:08.791414+0000","last_became_active":"2024-09-15T23:58:07.781646+0000","last_became_peered":"2024-09-15T23:58:07.781646+0000","last_unstale":"2024-09-15T23:58:08.791414+0000","last_undegraded":"2024-09-15T23:58:08.791414+0000","last_fullsized":"2024-09-15T23:58:08.791414+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:54.991980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758938+0000","last_change":"2024-09-15T23:58:07.780326+0000","last_active":"2024-09-15T23:58:08.758938+0000","last_peered":"2024-09-15T23:58:08.758938+0000","last_clean":"2024-09-15T23:58:08.758938+0000","last_became_active":"2024-09-15T23:58:07.779866+0000","last_became_peered":"2024-09-15T23:58:07.779866+0000","last_unstale":"2024-09-15T23:58:08.758938+0000","last_undegraded":"2024-09-15T23:58:08.758938+0000","last_fullsized":"2024-09-15T23:58:08.758938+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:32.670128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129254+0000","last_change":"2024-09-15T23:58:07.772116+0000","last_active":"2024-09-15T23:58:09.129254+0000","last_peered":"2024-09-15T23:58:09.129254+0000","last_clean":"2024-09-15T23:58:09.129254+0000","last_became_active":"2024-09-15T23:58:07.771400+0000","last_became_peered":"2024-09-15T23:58:07.771400+0000","last_unstale":"2024-09-15T23:58:09.129254+0000","last_undegraded":"2024-09-15T23:58:09.129254+0000","last_fullsized":"2024-09-15T23:58:09.129254+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:53.111663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791001+0000","last_change":"2024-09-15T23:58:07.780570+0000","last_active":"2024-09-15T23:58:08.791001+0000","last_peered":"2024-09-15T23:58:08.791001+0000","last_clean":"2024-09-15T23:58:08.791001+0000","last_became_active":"2024-09-15T23:58:07.779637+0000","last_became_peered":"2024-09-15T23:58:07.779637+0000","last_unstale":"2024-09-15T23:58:08.791001+0000","last_undegraded":"2024-09-15T23:58:08.791001+0000","last_fullsized":"2024-09-15T23:58:08.791001+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:04.943802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.125806+0000","last_change":"2024-09-15T23:58:07.767211+0000","last_active":"2024-09-15T23:58:09.125806+0000","last_peered":"2024-09-15T23:58:09.125806+0000","last_clean":"2024-09-15T23:58:09.125806+0000","last_became_active":"2024-09-15T23:58:07.766427+0000","last_became_peered":"2024-09-15T23:58:07.766427+0000","last_unstale":"2024-09-15T23:58:09.125806+0000","last_undegraded":"2024-09-15T23:58:09.125806+0000","last_fullsized":"2024-09-15T23:58:09.125806+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:10.506341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.785431+0000","last_change":"2024-09-15T23:58:07.779942+0000","last_active":"2024-09-15T23:58:08.785431+0000","last_peered":"2024-09-15T23:58:08.785431+0000","last_clean":"2024-09-15T23:58:08.785431+0000","last_became_active":"2024-09-15T23:58:07.779232+0000","last_became_peered":"2024-09-15T23:58:07.779232+0000","last_unstale":"2024-09-15T23:58:08.785431+0000","last_undegraded":"2024-09-15T23:58:08.785431+0000","last_fullsized":"2024-09-15T23:58:08.785431+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:55.677944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1f","version":"96'4","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126760+0000","last_change":"2024-09-15T23:58:06.737380+0000","last_active":"2024-09-15T23:58:09.126760+0000","last_peered":"2024-09-15T23:58:09.126760+0000","last_clean":"2024-09-15T23:58:09.126760+0000","last_became_active":"2024-09-15T23:58:06.736527+0000","last_became_peered":"2024-09-15T23:58:06.736527+0000","last_unstale":"2024-09-15T23:58:09.126760+0000","last_undegraded":"2024-09-15T23:58:09.126760+0000","last_fullsized":"2024-09-15T23:58:09.126760+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:42.645715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758832+0000","last_change":"2024-09-15T23:58:07.776944+0000","last_active":"2024-09-15T23:58:08.758832+0000","last_peered":"2024-09-15T23:58:08.758832+0000","last_clean":"2024-09-15T23:58:08.758832+0000","last_became_active":"2024-09-15T23:58:07.776174+0000","last_became_peered":"2024-09-15T23:58:07.776174+0000","last_unstale":"2024-09-15T23:58:08.758832+0000","last_undegraded":"2024-09-15T23:58:08.758832+0000","last_fullsized":"2024-09-15T23:58:08.758832+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:51.731861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.786052+0000","last_change":"2024-09-15T23:58:06.747179+0000","last_active":"2024-09-15T23:58:08.786052+0000","last_peered":"2024-09-15T23:58:08.786052+0000","last_clean":"2024-09-15T23:58:08.786052+0000","last_became_active":"2024-09-15T23:58:06.746346+0000","last_became_peered":"2024-09-15T23:58:06.746346+0000","last_unstale":"2024-09-15T23:58:08.786052+0000","last_undegraded":"2024-09-15T23:58:08.786052+0000","last_fullsized":"2024-09-15T23:58:08.786052+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:11.522070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.752931+0000","last_change":"2024-09-15T23:58:07.755258+0000","last_active":"2024-09-15T23:58:08.752931+0000","last_peered":"2024-09-15T23:58:08.752931+0000","last_clean":"2024-09-15T23:58:08.752931+0000","last_became_active":"2024-09-15T23:58:07.754455+0000","last_became_peered":"2024-09-15T23:58:07.754455+0000","last_unstale":"2024-09-15T23:58:08.752931+0000","last_undegraded":"2024-09-15T23:58:08.752931+0000","last_fullsized":"2024-09-15T23:58:08.752931+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:07.269079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753420+0000","last_change":"2024-09-15T23:58:06.739251+0000","last_active":"2024-09-15T23:58:08.753420+0000","last_peered":"2024-09-15T23:58:08.753420+0000","last_clean":"2024-09-15T23:58:08.753420+0000","last_became_active":"2024-09-15T23:58:06.738972+0000","last_became_peered":"2024-09-15T23:58:06.738972+0000","last_unstale":"2024-09-15T23:58:08.753420+0000","last_undegraded":"2024-09-15T23:58:08.753420+0000","last_fullsized":"2024-09-15T23:58:08.753420+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:15.435941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128549+0000","last_change":"2024-09-15T23:58:07.783162+0000","last_active":"2024-09-15T23:58:09.128549+0000","last_peered":"2024-09-15T23:58:09.128549+0000","last_clean":"2024-09-15T23:58:09.128549+0000","last_became_active":"2024-09-15T23:58:07.782870+0000","last_became_peered":"2024-09-15T23:58:07.782870+0000","last_unstale":"2024-09-15T23:58:09.128549+0000","last_undegraded":"2024-09-15T23:58:09.128549+0000","last_fullsized":"2024-09-15T23:58:09.128549+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:54.734314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758412+0000","last_change":"2024-09-15T23:58:06.724258+0000","last_active":"2024-09-15T23:58:08.758412+0000","last_peered":"2024-09-15T23:58:08.758412+0000","last_clean":"2024-09-15T23:58:08.758412+0000","last_became_active":"2024-09-15T23:58:06.723572+0000","last_became_peered":"2024-09-15T23:58:06.723572+0000","last_unstale":"2024-09-15T23:58:08.758412+0000","last_undegraded":"2024-09-15T23:58:08.758412+0000","last_fullsized":"2024-09-15T23:58:08.758412+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:08.272391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756965+0000","last_change":"2024-09-15T23:58:07.784732+0000","last_active":"2024-09-15T23:58:08.756965+0000","last_peered":"2024-09-15T23:58:08.756965+0000","last_clean":"2024-09-15T23:58:08.756965+0000","last_became_active":"2024-09-15T23:58:07.782292+0000","last_became_peered":"2024-09-15T23:58:07.782292+0000","last_unstale":"2024-09-15T23:58:08.756965+0000","last_undegraded":"2024-09-15T23:58:08.756965+0000","last_fullsized":"2024-09-15T23:58:08.756965+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:33.544108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1b","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128878+0000","last_change":"2024-09-15T23:58:06.735612+0000","last_active":"2024-09-15T23:58:09.128878+0000","last_peered":"2024-09-15T23:58:09.128878+0000","last_clean":"2024-09-15T23:58:09.128878+0000","last_became_active":"2024-09-15T23:58:06.735170+0000","last_became_peered":"2024-09-15T23:58:06.735170+0000","last_unstale":"2024-09-15T23:58:09.128878+0000","last_undegraded":"2024-09-15T23:58:09.128878+0000","last_fullsized":"2024-09-15T23:58:09.128878+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:43.931563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756768+0000","last_change":"2024-09-15T23:58:07.765505+0000","last_active":"2024-09-15T23:58:08.756768+0000","last_peered":"2024-09-15T23:58:08.756768+0000","last_clean":"2024-09-15T23:58:08.756768+0000","last_became_active":"2024-09-15T23:58:07.764711+0000","last_became_peered":"2024-09-15T23:58:07.764711+0000","last_unstale":"2024-09-15T23:58:08.756768+0000","last_undegraded":"2024-09-15T23:58:08.756768+0000","last_fullsized":"2024-09-15T23:58:08.756768+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:39.153021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129582+0000","last_change":"2024-09-15T23:58:06.736878+0000","last_active":"2024-09-15T23:58:09.129582+0000","last_peered":"2024-09-15T23:58:09.129582+0000","last_clean":"2024-09-15T23:58:09.129582+0000","last_became_active":"2024-09-15T23:58:06.736545+0000","last_became_peered":"2024-09-15T23:58:06.736545+0000","last_unstale":"2024-09-15T23:58:09.129582+0000","last_undegraded":"2024-09-15T23:58:09.129582+0000","last_fullsized":"2024-09-15T23:58:09.129582+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:06.203702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129816+0000","last_change":"2024-09-15T23:58:07.764136+0000","last_active":"2024-09-15T23:58:09.129816+0000","last_peered":"2024-09-15T23:58:09.129816+0000","last_clean":"2024-09-15T23:58:09.129816+0000","last_became_active":"2024-09-15T23:58:07.762035+0000","last_became_peered":"2024-09-15T23:58:07.762035+0000","last_unstale":"2024-09-15T23:58:09.129816+0000","last_undegraded":"2024-09-15T23:58:09.129816+0000","last_fullsized":"2024-09-15T23:58:09.129816+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:13.530423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128008+0000","last_change":"2024-09-15T23:58:06.737494+0000","last_active":"2024-09-15T23:58:09.128008+0000","last_peered":"2024-09-15T23:58:09.128008+0000","last_clean":"2024-09-15T23:58:09.128008+0000","last_became_active":"2024-09-15T23:58:06.736714+0000","last_became_peered":"2024-09-15T23:58:06.736714+0000","last_unstale":"2024-09-15T23:58:09.128008+0000","last_undegraded":"2024-09-15T23:58:09.128008+0000","last_fullsized":"2024-09-15T23:58:09.128008+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.690650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757533+0000","last_change":"2024-09-15T23:58:07.770649+0000","last_active":"2024-09-15T23:58:08.757533+0000","last_peered":"2024-09-15T23:58:08.757533+0000","last_clean":"2024-09-15T23:58:08.757533+0000","last_became_active":"2024-09-15T23:58:07.768011+0000","last_became_peered":"2024-09-15T23:58:07.768011+0000","last_unstale":"2024-09-15T23:58:08.757533+0000","last_undegraded":"2024-09-15T23:58:08.757533+0000","last_fullsized":"2024-09-15T23:58:08.757533+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:22.781437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126273+0000","last_change":"2024-09-15T23:58:06.745052+0000","last_active":"2024-09-15T23:58:09.126273+0000","last_peered":"2024-09-15T23:58:09.126273+0000","last_clean":"2024-09-15T23:58:09.126273+0000","last_became_active":"2024-09-15T23:58:06.743906+0000","last_became_peered":"2024-09-15T23:58:06.743906+0000","last_unstale":"2024-09-15T23:58:09.126273+0000","last_undegraded":"2024-09-15T23:58:09.126273+0000","last_fullsized":"2024-09-15T23:58:09.126273+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:03.616480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.755433+0000","last_change":"2024-09-15T23:58:07.782085+0000","last_active":"2024-09-15T23:58:08.755433+0000","last_peered":"2024-09-15T23:58:08.755433+0000","last_clean":"2024-09-15T23:58:08.755433+0000","last_became_active":"2024-09-15T23:58:07.781272+0000","last_became_peered":"2024-09-15T23:58:07.781272+0000","last_unstale":"2024-09-15T23:58:08.755433+0000","last_undegraded":"2024-09-15T23:58:08.755433+0000","last_fullsized":"2024-09-15T23:58:08.755433+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:32.190984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791527+0000","last_change":"2024-09-15T23:58:06.723519+0000","last_active":"2024-09-15T23:58:08.791527+0000","last_peered":"2024-09-15T23:58:08.791527+0000","last_clean":"2024-09-15T23:58:08.791527+0000","last_became_active":"2024-09-15T23:58:06.722945+0000","last_became_peered":"2024-09-15T23:58:06.722945+0000","last_unstale":"2024-09-15T23:58:08.791527+0000","last_undegraded":"2024-09-15T23:58:08.791527+0000","last_fullsized":"2024-09-15T23:58:08.791527+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:24.274929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756588+0000","last_change":"2024-09-15T23:58:07.766786+0000","last_active":"2024-09-15T23:58:08.756588+0000","last_peered":"2024-09-15T23:58:08.756588+0000","last_clean":"2024-09-15T23:58:08.756588+0000","last_became_active":"2024-09-15T23:58:07.764533+0000","last_became_peered":"2024-09-15T23:58:07.764533+0000","last_unstale":"2024-09-15T23:58:08.756588+0000","last_undegraded":"2024-09-15T23:58:08.756588+0000","last_fullsized":"2024-09-15T23:58:08.756588+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:25.695282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758744+0000","last_change":"2024-09-15T23:58:06.748827+0000","last_active":"2024-09-15T23:58:08.758744+0000","last_peered":"2024-09-15T23:58:08.758744+0000","last_clean":"2024-09-15T23:58:08.758744+0000","last_became_active":"2024-09-15T23:58:06.748419+0000","last_became_peered":"2024-09-15T23:58:06.748419+0000","last_unstale":"2024-09-15T23:58:08.758744+0000","last_undegraded":"2024-09-15T23:58:08.758744+0000","last_fullsized":"2024-09-15T23:58:08.758744+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.690650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758808+0000","last_change":"2024-09-15T23:58:07.769178+0000","last_active":"2024-09-15T23:58:08.758808+0000","last_peered":"2024-09-15T23:58:08.758808+0000","last_clean":"2024-09-15T23:58:08.758808+0000","last_became_active":"2024-09-15T23:58:07.768505+0000","last_became_peered":"2024-09-15T23:58:07.768505+0000","last_unstale":"2024-09-15T23:58:08.758808+0000","last_undegraded":"2024-09-15T23:58:08.758808+0000","last_fullsized":"2024-09-15T23:58:08.758808+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:43.017275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"96'3","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791897+0000","last_change":"2024-09-15T23:58:06.743819+0000","last_active":"2024-09-15T23:58:08.791897+0000","last_peered":"2024-09-15T23:58:08.791897+0000","last_clean":"2024-09-15T23:58:08.791897+0000","last_became_active":"2024-09-15T23:58:06.743512+0000","last_became_peered":"2024-09-15T23:58:06.743512+0000","last_unstale":"2024-09-15T23:58:08.791897+0000","last_undegraded":"2024-09-15T23:58:08.791897+0000","last_fullsized":"2024-09-15T23:58:08.791897+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:38.845066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126282+0000","last_change":"2024-09-15T23:58:07.787170+0000","last_active":"2024-09-15T23:58:09.126282+0000","last_peered":"2024-09-15T23:58:09.126282+0000","last_clean":"2024-09-15T23:58:09.126282+0000","last_became_active":"2024-09-15T23:58:07.786487+0000","last_became_peered":"2024-09-15T23:58:07.786487+0000","last_unstale":"2024-09-15T23:58:09.126282+0000","last_undegraded":"2024-09-15T23:58:09.126282+0000","last_fullsized":"2024-09-15T23:58:09.126282+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:54.922033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"96'6","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128875+0000","last_change":"2024-09-15T23:58:06.735492+0000","last_active":"2024-09-15T23:58:09.128875+0000","last_peered":"2024-09-15T23:58:09.128875+0000","last_clean":"2024-09-15T23:58:09.128875+0000","last_became_active":"2024-09-15T23:58:06.734834+0000","last_became_peered":"2024-09-15T23:58:06.734834+0000","last_unstale":"2024-09-15T23:58:09.128875+0000","last_undegraded":"2024-09-15T23:58:09.128875+0000","last_fullsized":"2024-09-15T23:58:09.128875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:26.410446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753230+0000","last_change":"2024-09-15T23:58:07.799903+0000","last_active":"2024-09-15T23:58:08.753230+0000","last_peered":"2024-09-15T23:58:08.753230+0000","last_clean":"2024-09-15T23:58:08.753230+0000","last_became_active":"2024-09-15T23:58:07.799564+0000","last_became_peered":"2024-09-15T23:58:07.799564+0000","last_unstale":"2024-09-15T23:58:08.753230+0000","last_undegraded":"2024-09-15T23:58:08.753230+0000","last_fullsized":"2024-09-15T23:58:08.753230+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:09.804410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756456+0000","last_change":"2024-09-15T23:58:06.753728+0000","last_active":"2024-09-15T23:58:08.756456+0000","last_peered":"2024-09-15T23:58:08.756456+0000","last_clean":"2024-09-15T23:58:08.756456+0000","last_became_active":"2024-09-15T23:58:06.753064+0000","last_became_peered":"2024-09-15T23:58:06.753064+0000","last_unstale":"2024-09-15T23:58:08.756456+0000","last_undegraded":"2024-09-15T23:58:08.756456+0000","last_fullsized":"2024-09-15T23:58:08.756456+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:37.947511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753219+0000","last_change":"2024-09-15T23:58:07.758875+0000","last_active":"2024-09-15T23:58:08.753219+0000","last_peered":"2024-09-15T23:58:08.753219+0000","last_clean":"2024-09-15T23:58:08.753219+0000","last_became_active":"2024-09-15T23:58:07.756469+0000","last_became_peered":"2024-09-15T23:58:07.756469+0000","last_unstale":"2024-09-15T23:58:08.753219+0000","last_undegraded":"2024-09-15T23:58:08.753219+0000","last_fullsized":"2024-09-15T23:58:08.753219+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:39.856367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758820+0000","last_change":"2024-09-15T23:58:06.730917+0000","last_active":"2024-09-15T23:58:08.758820+0000","last_peered":"2024-09-15T23:58:08.758820+0000","last_clean":"2024-09-15T23:58:08.758820+0000","last_became_active":"2024-09-15T23:58:06.730153+0000","last_became_peered":"2024-09-15T23:58:06.730153+0000","last_unstale":"2024-09-15T23:58:08.758820+0000","last_undegraded":"2024-09-15T23:58:08.758820+0000","last_fullsized":"2024-09-15T23:58:08.758820+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:06.203702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126587+0000","last_change":"2024-09-15T23:58:07.784939+0000","last_active":"2024-09-15T23:58:09.126587+0000","last_peered":"2024-09-15T23:58:09.126587+0000","last_clean":"2024-09-15T23:58:09.126587+0000","last_became_active":"2024-09-15T23:58:07.783654+0000","last_became_peered":"2024-09-15T23:58:07.783654+0000","last_unstale":"2024-09-15T23:58:09.126587+0000","last_undegraded":"2024-09-15T23:58:09.126587+0000","last_fullsized":"2024-09-15T23:58:09.126587+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:42.052614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756142+0000","last_change":"2024-09-15T23:58:06.733047+0000","last_active":"2024-09-15T23:58:08.756142+0000","last_peered":"2024-09-15T23:58:08.756142+0000","last_clean":"2024-09-15T23:58:08.756142+0000","last_became_active":"2024-09-15T23:58:06.732148+0000","last_became_peered":"2024-09-15T23:58:06.732148+0000","last_unstale":"2024-09-15T23:58:08.756142+0000","last_undegraded":"2024-09-15T23:58:08.756142+0000","last_fullsized":"2024-09-15T23:58:08.756142+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:33.404685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.786321+0000","last_change":"2024-09-15T23:58:07.770545+0000","last_active":"2024-09-15T23:58:08.786321+0000","last_peered":"2024-09-15T23:58:08.786321+0000","last_clean":"2024-09-15T23:58:08.786321+0000","last_became_active":"2024-09-15T23:58:07.769829+0000","last_became_peered":"2024-09-15T23:58:07.769829+0000","last_unstale":"2024-09-15T23:58:08.786321+0000","last_undegraded":"2024-09-15T23:58:08.786321+0000","last_fullsized":"2024-09-15T23:58:08.786321+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:01.345565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"96'8","reported_seq":22,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.127657+0000","last_change":"2024-09-15T23:58:06.732340+0000","last_active":"2024-09-15T23:58:09.127657+0000","last_peered":"2024-09-15T23:58:09.127657+0000","last_clean":"2024-09-15T23:58:09.127657+0000","last_became_active":"2024-09-15T23:58:06.732080+0000","last_became_peered":"2024-09-15T23:58:06.732080+0000","last_unstale":"2024-09-15T23:58:09.127657+0000","last_undegraded":"2024-09-15T23:58:09.127657+0000","last_fullsized":"2024-09-15T23:58:09.127657+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:45.077686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758512+0000","last_change":"2024-09-15T23:58:07.770015+0000","last_active":"2024-09-15T23:58:08.758512+0000","last_peered":"2024-09-15T23:58:08.758512+0000","last_clean":"2024-09-15T23:58:08.758512+0000","last_became_active":"2024-09-15T23:58:07.769509+0000","last_became_peered":"2024-09-15T23:58:07.769509+0000","last_unstale":"2024-09-15T23:58:08.758512+0000","last_undegraded":"2024-09-15T23:58:08.758512+0000","last_fullsized":"2024-09-15T23:58:08.758512+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:26.451417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791651+0000","last_change":"2024-09-15T23:58:06.722578+0000","last_active":"2024-09-15T23:58:08.791651+0000","last_peered":"2024-09-15T23:58:08.791651+0000","last_clean":"2024-09-15T23:58:08.791651+0000","last_became_active":"2024-09-15T23:58:06.722138+0000","last_became_peered":"2024-09-15T23:58:06.722138+0000","last_unstale":"2024-09-15T23:58:08.791651+0000","last_undegraded":"2024-09-15T23:58:08.791651+0000","last_fullsized":"2024-09-15T23:58:08.791651+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:35.696453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129439+0000","last_change":"2024-09-15T23:58:07.776105+0000","last_active":"2024-09-15T23:58:09.129439+0000","last_peered":"2024-09-15T23:58:09.129439+0000","last_clean":"2024-09-15T23:58:09.129439+0000","last_became_active":"2024-09-15T23:58:07.775809+0000","last_became_peered":"2024-09-15T23:58:07.775809+0000","last_unstale":"2024-09-15T23:58:09.129439+0000","last_undegraded":"2024-09-15T23:58:09.129439+0000","last_fullsized":"2024-09-15T23:58:09.129439+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:36.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.d","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129069+0000","last_change":"2024-09-15T23:58:06.738994+0000","last_active":"2024-09-15T23:58:09.129069+0000","last_peered":"2024-09-15T23:58:09.129069+0000","last_clean":"2024-09-15T23:58:09.129069+0000","last_became_active":"2024-09-15T23:58:06.738495+0000","last_became_peered":"2024-09-15T23:58:06.738495+0000","last_unstale":"2024-09-15T23:58:09.129069+0000","last_undegraded":"2024-09-15T23:58:09.129069+0000","last_fullsized":"2024-09-15T23:58:09.129069+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:44.651235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126141+0000","last_change":"2024-09-15T23:58:07.782366+0000","last_active":"2024-09-15T23:58:09.126141+0000","last_peered":"2024-09-15T23:58:09.126141+0000","last_clean":"2024-09-15T23:58:09.126141+0000","last_became_active":"2024-09-15T23:58:07.781871+0000","last_became_peered":"2024-09-15T23:58:07.781871+0000","last_unstale":"2024-09-15T23:58:09.126141+0000","last_undegraded":"2024-09-15T23:58:09.126141+0000","last_fullsized":"2024-09-15T23:58:09.126141+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:15:21.361174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791312+0000","last_change":"2024-09-15T23:58:06.723437+0000","last_active":"2024-09-15T23:58:08.791312+0000","last_peered":"2024-09-15T23:58:08.791312+0000","last_clean":"2024-09-15T23:58:08.791312+0000","last_became_active":"2024-09-15T23:58:06.722488+0000","last_became_peered":"2024-09-15T23:58:06.722488+0000","last_unstale":"2024-09-15T23:58:08.791312+0000","last_undegraded":"2024-09-15T23:58:08.791312+0000","last_fullsized":"2024-09-15T23:58:08.791312+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:08.793109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757296+0000","last_change":"2024-09-15T23:58:07.791345+0000","last_active":"2024-09-15T23:58:08.757296+0000","last_peered":"2024-09-15T23:58:08.757296+0000","last_clean":"2024-09-15T23:58:08.757296+0000","last_became_active":"2024-09-15T23:58:07.781515+0000","last_became_peered":"2024-09-15T23:58:07.781515+0000","last_unstale":"2024-09-15T23:58:08.757296+0000","last_undegraded":"2024-09-15T23:58:08.757296+0000","last_fullsized":"2024-09-15T23:58:08.757296+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:55.061923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.b","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.785764+0000","last_change":"2024-09-15T23:58:06.742316+0000","last_active":"2024-09-15T23:58:08.785764+0000","last_peered":"2024-09-15T23:58:08.785764+0000","last_clean":"2024-09-15T23:58:08.785764+0000","last_became_active":"2024-09-15T23:58:06.741127+0000","last_became_peered":"2024-09-15T23:58:06.741127+0000","last_unstale":"2024-09-15T23:58:08.785764+0000","last_undegraded":"2024-09-15T23:58:08.785764+0000","last_fullsized":"2024-09-15T23:58:08.785764+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:34:43.547199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126663+0000","last_change":"2024-09-15T23:58:07.795069+0000","last_active":"2024-09-15T23:58:09.126663+0000","last_peered":"2024-09-15T23:58:09.126663+0000","last_clean":"2024-09-15T23:58:09.126663+0000","last_became_active":"2024-09-15T23:58:07.794212+0000","last_became_peered":"2024-09-15T23:58:07.794212+0000","last_unstale":"2024-09-15T23:58:09.126663+0000","last_undegraded":"2024-09-15T23:58:09.126663+0000","last_fullsized":"2024-09-15T23:58:09.126663+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:23.262308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.785291+0000","last_change":"2024-09-15T23:58:06.747941+0000","last_active":"2024-09-15T23:58:08.785291+0000","last_peered":"2024-09-15T23:58:08.785291+0000","last_clean":"2024-09-15T23:58:08.785291+0000","last_became_active":"2024-09-15T23:58:06.747101+0000","last_became_peered":"2024-09-15T23:58:06.747101+0000","last_unstale":"2024-09-15T23:58:08.785291+0000","last_undegraded":"2024-09-15T23:58:08.785291+0000","last_fullsized":"2024-09-15T23:58:08.785291+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:45.491484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.126526+0000","last_change":"2024-09-15T23:58:07.775709+0000","last_active":"2024-09-15T23:58:09.126526+0000","last_peered":"2024-09-15T23:58:09.126526+0000","last_clean":"2024-09-15T23:58:09.126526+0000","last_became_active":"2024-09-15T23:58:07.774896+0000","last_became_peered":"2024-09-15T23:58:07.774896+0000","last_unstale":"2024-09-15T23:58:09.126526+0000","last_undegraded":"2024-09-15T23:58:09.126526+0000","last_fullsized":"2024-09-15T23:58:09.126526+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:42.839656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791159+0000","last_change":"2024-09-15T23:58:06.732322+0000","last_active":"2024-09-15T23:58:08.791159+0000","last_peered":"2024-09-15T23:58:08.791159+0000","last_clean":"2024-09-15T23:58:08.791159+0000","last_became_active":"2024-09-15T23:58:06.731337+0000","last_became_peered":"2024-09-15T23:58:06.731337+0000","last_unstale":"2024-09-15T23:58:08.791159+0000","last_undegraded":"2024-09-15T23:58:08.791159+0000","last_fullsized":"2024-09-15T23:58:08.791159+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:00.946105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757489+0000","last_change":"2024-09-15T23:58:07.769923+0000","last_active":"2024-09-15T23:58:08.757489+0000","last_peered":"2024-09-15T23:58:08.757489+0000","last_clean":"2024-09-15T23:58:08.757489+0000","last_became_active":"2024-09-15T23:58:07.769057+0000","last_became_peered":"2024-09-15T23:58:07.769057+0000","last_unstale":"2024-09-15T23:58:08.757489+0000","last_undegraded":"2024-09-15T23:58:08.757489+0000","last_fullsized":"2024-09-15T23:58:08.757489+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:25.029723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758016+0000","last_change":"2024-09-15T23:58:06.737190+0000","last_active":"2024-09-15T23:58:08.758016+0000","last_peered":"2024-09-15T23:58:08.758016+0000","last_clean":"2024-09-15T23:58:08.758016+0000","last_became_active":"2024-09-15T23:58:06.736804+0000","last_became_peered":"2024-09-15T23:58:06.736804+0000","last_unstale":"2024-09-15T23:58:08.758016+0000","last_undegraded":"2024-09-15T23:58:08.758016+0000","last_fullsized":"2024-09-15T23:58:08.758016+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:30.329573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.125911+0000","last_change":"2024-09-15T23:58:07.775890+0000","last_active":"2024-09-15T23:58:09.125911+0000","last_peered":"2024-09-15T23:58:09.125911+0000","last_clean":"2024-09-15T23:58:09.125911+0000","last_became_active":"2024-09-15T23:58:07.774559+0000","last_became_peered":"2024-09-15T23:58:07.774559+0000","last_unstale":"2024-09-15T23:58:09.125911+0000","last_undegraded":"2024-09-15T23:58:09.125911+0000","last_fullsized":"2024-09-15T23:58:09.125911+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:12.409978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.7","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.786611+0000","last_change":"2024-09-15T23:58:06.746347+0000","last_active":"2024-09-15T23:58:08.786611+0000","last_peered":"2024-09-15T23:58:08.786611+0000","last_clean":"2024-09-15T23:58:08.786611+0000","last_became_active":"2024-09-15T23:58:06.742108+0000","last_became_peered":"2024-09-15T23:58:06.742108+0000","last_unstale":"2024-09-15T23:58:08.786611+0000","last_undegraded":"2024-09-15T23:58:08.786611+0000","last_fullsized":"2024-09-15T23:58:08.786611+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:53.594713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129655+0000","last_change":"2024-09-15T23:58:07.766829+0000","last_active":"2024-09-15T23:58:09.129655+0000","last_peered":"2024-09-15T23:58:09.129655+0000","last_clean":"2024-09-15T23:58:09.129655+0000","last_became_active":"2024-09-15T23:58:07.766205+0000","last_became_peered":"2024-09-15T23:58:07.766205+0000","last_unstale":"2024-09-15T23:58:09.129655+0000","last_undegraded":"2024-09-15T23:58:09.129655+0000","last_fullsized":"2024-09-15T23:58:09.129655+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:53.825799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"97'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.786308+0000","last_change":"2024-09-15T23:58:06.746464+0000","last_active":"2024-09-15T23:58:08.786308+0000","last_peered":"2024-09-15T23:58:08.786308+0000","last_clean":"2024-09-15T23:58:08.786308+0000","last_became_active":"2024-09-15T23:58:06.741814+0000","last_became_peered":"2024-09-15T23:58:06.741814+0000","last_unstale":"2024-09-15T23:58:08.786308+0000","last_undegraded":"2024-09-15T23:58:08.786308+0000","last_fullsized":"2024-09-15T23:58:08.786308+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:12.854554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.758539+0000","last_change":"2024-09-15T23:58:07.760444+0000","last_active":"2024-09-15T23:58:08.758539+0000","last_peered":"2024-09-15T23:58:08.758539+0000","last_clean":"2024-09-15T23:58:08.758539+0000","last_became_active":"2024-09-15T23:58:07.759706+0000","last_became_peered":"2024-09-15T23:58:07.759706+0000","last_unstale":"2024-09-15T23:58:08.758539+0000","last_undegraded":"2024-09-15T23:58:08.758539+0000","last_fullsized":"2024-09-15T23:58:08.758539+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:36.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128487+0000","last_change":"2024-09-15T23:58:06.738930+0000","last_active":"2024-09-15T23:58:09.128487+0000","last_peered":"2024-09-15T23:58:09.128487+0000","last_clean":"2024-09-15T23:58:09.128487+0000","last_became_active":"2024-09-15T23:58:06.737965+0000","last_became_peered":"2024-09-15T23:58:06.737965+0000","last_unstale":"2024-09-15T23:58:09.128487+0000","last_undegraded":"2024-09-15T23:58:09.128487+0000","last_fullsized":"2024-09-15T23:58:09.128487+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:27.303288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128573+0000","last_change":"2024-09-15T23:58:07.771056+0000","last_active":"2024-09-15T23:58:09.128573+0000","last_peered":"2024-09-15T23:58:09.128573+0000","last_clean":"2024-09-15T23:58:09.128573+0000","last_became_active":"2024-09-15T23:58:07.770335+0000","last_became_peered":"2024-09-15T23:58:07.770335+0000","last_unstale":"2024-09-15T23:58:09.128573+0000","last_undegraded":"2024-09-15T23:58:09.128573+0000","last_fullsized":"2024-09-15T23:58:09.128573+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:23:00.705487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.757220+0000","last_change":"2024-09-15T23:58:06.733282+0000","last_active":"2024-09-15T23:58:08.757220+0000","last_peered":"2024-09-15T23:58:08.757220+0000","last_clean":"2024-09-15T23:58:08.757220+0000","last_became_active":"2024-09-15T23:58:06.731829+0000","last_became_peered":"2024-09-15T23:58:06.731829+0000","last_unstale":"2024-09-15T23:58:08.757220+0000","last_undegraded":"2024-09-15T23:58:08.757220+0000","last_fullsized":"2024-09-15T23:58:08.757220+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:37.214555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756733+0000","last_change":"2024-09-15T23:58:07.796182+0000","last_active":"2024-09-15T23:58:08.756733+0000","last_peered":"2024-09-15T23:58:08.756733+0000","last_clean":"2024-09-15T23:58:08.756733+0000","last_became_active":"2024-09-15T23:58:07.783093+0000","last_became_peered":"2024-09-15T23:58:07.783093+0000","last_unstale":"2024-09-15T23:58:08.756733+0000","last_undegraded":"2024-09-15T23:58:08.756733+0000","last_fullsized":"2024-09-15T23:58:08.756733+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:01.714283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.129162+0000","last_change":"2024-09-15T23:58:06.736436+0000","last_active":"2024-09-15T23:58:09.129162+0000","last_peered":"2024-09-15T23:58:09.129162+0000","last_clean":"2024-09-15T23:58:09.129162+0000","last_became_active":"2024-09-15T23:58:06.736078+0000","last_became_peered":"2024-09-15T23:58:06.736078+0000","last_unstale":"2024-09-15T23:58:09.129162+0000","last_undegraded":"2024-09-15T23:58:09.129162+0000","last_fullsized":"2024-09-15T23:58:09.129162+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:49.214605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756427+0000","last_change":"2024-09-15T23:58:07.791074+0000","last_active":"2024-09-15T23:58:08.756427+0000","last_peered":"2024-09-15T23:58:08.756427+0000","last_clean":"2024-09-15T23:58:08.756427+0000","last_became_active":"2024-09-15T23:58:07.782975+0000","last_became_peered":"2024-09-15T23:58:07.782975+0000","last_unstale":"2024-09-15T23:58:08.756427+0000","last_undegraded":"2024-09-15T23:58:08.756427+0000","last_fullsized":"2024-09-15T23:58:08.756427+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:22.748219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.785477+0000","last_change":"2024-09-15T23:58:06.747357+0000","last_active":"2024-09-15T23:58:08.785477+0000","last_peered":"2024-09-15T23:58:08.785477+0000","last_clean":"2024-09-15T23:58:08.785477+0000","last_became_active":"2024-09-15T23:58:06.746786+0000","last_became_peered":"2024-09-15T23:58:06.746786+0000","last_unstale":"2024-09-15T23:58:08.785477+0000","last_undegraded":"2024-09-15T23:58:08.785477+0000","last_fullsized":"2024-09-15T23:58:08.785477+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:43.764047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791793+0000","last_change":"2024-09-15T23:58:07.781892+0000","last_active":"2024-09-15T23:58:08.791793+0000","last_peered":"2024-09-15T23:58:08.791793+0000","last_clean":"2024-09-15T23:58:08.791793+0000","last_became_active":"2024-09-15T23:58:07.781560+0000","last_became_peered":"2024-09-15T23:58:07.781560+0000","last_unstale":"2024-09-15T23:58:08.791793+0000","last_undegraded":"2024-09-15T23:58:08.791793+0000","last_fullsized":"2024-09-15T23:58:08.791793+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:38.958811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128120+0000","last_change":"2024-09-15T23:58:06.734272+0000","last_active":"2024-09-15T23:58:09.128120+0000","last_peered":"2024-09-15T23:58:09.128120+0000","last_clean":"2024-09-15T23:58:09.128120+0000","last_became_active":"2024-09-15T23:58:06.734020+0000","last_became_peered":"2024-09-15T23:58:06.734020+0000","last_unstale":"2024-09-15T23:58:09.128120+0000","last_undegraded":"2024-09-15T23:58:09.128120+0000","last_fullsized":"2024-09-15T23:58:09.128120+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:30.329573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.753804+0000","last_change":"2024-09-15T23:58:07.772545+0000","last_active":"2024-09-15T23:58:08.753804+0000","last_peered":"2024-09-15T23:58:08.753804+0000","last_clean":"2024-09-15T23:58:08.753804+0000","last_became_active":"2024-09-15T23:58:07.772139+0000","last_became_peered":"2024-09-15T23:58:07.772139+0000","last_unstale":"2024-09-15T23:58:08.753804+0000","last_undegraded":"2024-09-15T23:58:08.753804+0000","last_fullsized":"2024-09-15T23:58:08.753804+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:01.957406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.785452+0000","last_change":"2024-09-15T23:58:06.748574+0000","last_active":"2024-09-15T23:58:08.785452+0000","last_peered":"2024-09-15T23:58:08.785452+0000","last_clean":"2024-09-15T23:58:08.785452+0000","last_became_active":"2024-09-15T23:58:06.740503+0000","last_became_peered":"2024-09-15T23:58:06.740503+0000","last_unstale":"2024-09-15T23:58:08.785452+0000","last_undegraded":"2024-09-15T23:58:08.785452+0000","last_fullsized":"2024-09-15T23:58:08.785452+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:51.937530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.791109+0000","last_change":"2024-09-15T23:58:07.778092+0000","last_active":"2024-09-15T23:58:08.791109+0000","last_peered":"2024-09-15T23:58:08.791109+0000","last_clean":"2024-09-15T23:58:08.791109+0000","last_became_active":"2024-09-15T23:58:07.775739+0000","last_became_peered":"2024-09-15T23:58:07.775739+0000","last_unstale":"2024-09-15T23:58:08.791109+0000","last_undegraded":"2024-09-15T23:58:08.791109+0000","last_fullsized":"2024-09-15T23:58:08.791109+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:06.696451+0000","last_clean_scrub_stamp":"2024-09-15T23:58:06.696451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:22:00.044070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:08.756867+0000","last_change":"2024-09-15T23:58:06.737213+0000","last_active":"2024-09-15T23:58:08.756867+0000","last_peered":"2024-09-15T23:58:08.756867+0000","last_clean":"2024-09-15T23:58:08.756867+0000","last_became_active":"2024-09-15T23:58:06.736308+0000","last_became_peered":"2024-09-15T23:58:06.736308+0000","last_unstale":"2024-09-15T23:58:08.756867+0000","last_undegraded":"2024-09-15T23:58:08.756867+0000","last_fullsized":"2024-09-15T23:58:08.756867+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:58:05.685150+0000","last_clean_scrub_stamp":"2024-09-15T23:58:05.685150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:53.980679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":309,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:58:09.128100+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:58:09.128100+0000","last_peered":"2024-09-15T23:58:09.128100+0000","last_clean":"2024-09-15T23:58:09.128100+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:58:09.128100+0000","last_undegraded":"2024-09-15T23:58:09.128100+0000","last_fullsized":"2024-09-15T23:58:09.128100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1204224,"data_stored":547642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1208320,"data_stored":548602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":547024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36528,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335312,"statfs":{"total":96636764160,"available":96599359488,"internally_reserved":0,"allocated":1208320,"data_stored":548602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1204224,"data_stored":547102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509499,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1798144,"data_stored":1137450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509498,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":547572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37108,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334732,"statfs":{"total":96636764160,"available":96598765568,"internally_reserved":0,"allocated":1798144,"data_stored":1137482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:58:16.513 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:58:16.514 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:58:16.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.681+0000 7f14eabd6640 1 Processor -- start 2024-09-15T23:58:16.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.681+0000 7f14eabd6640 1 -- start start 2024-09-15T23:58:16.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.685+0000 7f14eabd6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f14e415e4f0 0x7f14e40d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:16.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.685+0000 7f14eabd6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e40d4e20 0x7f14e40cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:16.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.685+0000 7f14eabd6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e40d0350 con 0x7f14e4162070 2024-09-15T23:58:16.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.685+0000 7f14eabd6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f14e40cf070 con 0x7f14e415e4f0 2024-09-15T23:58:16.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.685+0000 7f14eabd6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f14e40d1c20 con 0x7f14e40d4e20 2024-09-15T23:58:16.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.685+0000 7f14e8972640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f14e415e4f0 0x7f14e40d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:16.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.685+0000 7f14e3fff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e40d4e20 0x7f14e40cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:16.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.685+0000 7f14e8972640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f14e415e4f0 0x7f14e40d15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:48358/0 (socket says 172.21.15.112:48358) 2024-09-15T23:58:16.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.685+0000 7f14e8972640 1 -- 172.21.15.112:0/1377804999 learned_addr learned my addr 172.21.15.112:0/1377804999 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:16.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.685+0000 7f14e8972640 1 -- 172.21.15.112:0/1377804999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e40d4e20 msgr2=0x7f14e40cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:16.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.685+0000 7f14e8972640 1 --2- 172.21.15.112:0/1377804999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e40d4e20 0x7f14e40cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.685+0000 7f14e8972640 1 -- 172.21.15.112:0/1377804999 >> v1:172.21.15.169:6789/0 conn(0x7f14e4162070 legacy=0x7f14e40b7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:16.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.685+0000 7f14e8972640 1 -- 172.21.15.112:0/1377804999 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e40cf330 con 0x7f14e415e4f0 2024-09-15T23:58:16.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.689+0000 7f14e8972640 1 --2- 172.21.15.112:0/1377804999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14e415e4f0 0x7f14e40d15d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009870 tx=0x7f14d801ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6b22ea23d620f30 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:16.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.689+0000 7f14e37fe640 1 -- 172.21.15.112:0/1377804999 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d80b5070 con 0x7f14e415e4f0 2024-09-15T23:58:16.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.689+0000 7f14e37fe640 1 -- 172.21.15.112:0/1377804999 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d80a8a50 con 0x7f14e415e4f0 2024-09-15T23:58:16.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.689+0000 7f14e37fe640 1 -- 172.21.15.112:0/1377804999 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d80a8e20 con 0x7f14e415e4f0 2024-09-15T23:58:16.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.689+0000 7f14eabd6640 1 -- 172.21.15.112:0/1377804999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14e415e4f0 msgr2=0x7f14e40d15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:16.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.689+0000 7f14eabd6640 1 --2- 172.21.15.112:0/1377804999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14e415e4f0 0x7f14e40d15d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009870 tx=0x7f14d801ed50 comp rx=0 tx=0).stop 2024-09-15T23:58:16.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.689+0000 7f14eabd6640 1 -- 172.21.15.112:0/1377804999 shutdown_connections 2024-09-15T23:58:16.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.689+0000 7f14eabd6640 1 --2- 172.21.15.112:0/1377804999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e40d4e20 0x7f14e40cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.689+0000 7f14eabd6640 1 --2- 172.21.15.112:0/1377804999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14e415e4f0 0x7f14e40d15d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.689+0000 7f14eabd6640 1 -- 172.21.15.112:0/1377804999 >> 172.21.15.112:0/1377804999 conn(0x7f14e408bf90 msgr2=0x7f14e40d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:16.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.689+0000 7f14eabd6640 1 -- 172.21.15.112:0/1377804999 shutdown_connections 2024-09-15T23:58:16.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.689+0000 7f14eabd6640 1 -- 172.21.15.112:0/1377804999 wait complete. 2024-09-15T23:58:16.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.689+0000 7f14eabd6640 1 Processor -- start 2024-09-15T23:58:16.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.689+0000 7f14eabd6640 1 -- start start 2024-09-15T23:58:16.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14eabd6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e40d4e20 0x7f14e41f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:16.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14eabd6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14e415e4f0 0x7f14e41609f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:16.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14eabd6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e4162070 0x7f14e4160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:16.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14eabd6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f14e415e8d0 con 0x7f14e4162070 2024-09-15T23:58:16.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14eabd6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f14e40cf8f0 con 0x7f14e415e4f0 2024-09-15T23:58:16.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14eabd6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f14e40d5270 con 0x7f14e40d4e20 2024-09-15T23:58:16.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e9173640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e4162070 0x7f14e4160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:16.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e9173640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e4162070 0x7f14e4160f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59854/0 (socket says 172.21.15.112:59854) 2024-09-15T23:58:16.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e9173640 1 -- 172.21.15.112:0/3559863249 learned_addr learned my addr 172.21.15.112:0/3559863249 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:16.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e3fff640 1 --2- 172.21.15.112:0/3559863249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14e415e4f0 0x7f14e41609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:16.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e8972640 1 --2- 172.21.15.112:0/3559863249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e40d4e20 0x7f14e41f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:16.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e9173640 1 -- 172.21.15.112:0/3559863249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e40d4e20 msgr2=0x7f14e41f3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:16.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e9173640 1 --2- 172.21.15.112:0/3559863249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e40d4e20 0x7f14e41f3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e9173640 1 -- 172.21.15.112:0/3559863249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14e415e4f0 msgr2=0x7f14e41609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:16.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e9173640 1 --2- 172.21.15.112:0/3559863249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14e415e4f0 0x7f14e41609f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e9173640 1 -- 172.21.15.112:0/3559863249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e4161540 con 0x7f14e4162070 2024-09-15T23:58:16.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e9173640 1 --2- 172.21.15.112:0/3559863249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e4162070 0x7f14e4160f30 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00c6f0 tx=0x7f14dc00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:16.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e17fa640 1 -- 172.21.15.112:0/3559863249 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc003980 con 0x7f14e4162070 2024-09-15T23:58:16.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e17fa640 1 -- 172.21.15.112:0/3559863249 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14dc003b20 con 0x7f14e4162070 2024-09-15T23:58:16.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e17fa640 1 -- 172.21.15.112:0/3559863249 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc00a850 con 0x7f14e4162070 2024-09-15T23:58:16.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14eabd6640 1 -- 172.21.15.112:0/3559863249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e4161820 con 0x7f14e4162070 2024-09-15T23:58:16.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14eabd6640 1 -- 172.21.15.112:0/3559863249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e41f4400 con 0x7f14e4162070 2024-09-15T23:58:16.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14eabd6640 1 -- 172.21.15.112:0/3559863249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e40cfe10 con 0x7f14e4162070 2024-09-15T23:58:16.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e17fa640 1 -- 172.21.15.112:0/3559863249 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f14dc00a9f0 con 0x7f14e4162070 2024-09-15T23:58:16.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e17fa640 1 --2- 172.21.15.112:0/3559863249 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f14c80678f0 0x7f14c8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:16.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e8972640 1 --2- 172.21.15.112:0/3559863249 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f14c80678f0 0x7f14c8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:16.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.693+0000 7f14e17fa640 1 -- 172.21.15.112:0/3559863249 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f14dc085c20 con 0x7f14e4162070 2024-09-15T23:58:16.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.697+0000 7f14e8972640 1 --2- 172.21.15.112:0/3559863249 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f14c80678f0 0x7f14c8069db0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f14d80b2000 tx=0x7f14d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:16.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.701+0000 7f14e17fa640 1 -- 172.21.15.112:0/3559863249 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f14dc056660 con 0x7f14e4162070 2024-09-15T23:58:16.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.925+0000 7f14eabd6640 1 -- 172.21.15.112:0/3559863249 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f14e40d4b20 con 0x7f14e4162070 2024-09-15T23:58:16.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.929+0000 7f14e17fa640 1 -- 172.21.15.112:0/3559863249 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f14dc055f60 con 0x7f14e4162070 2024-09-15T23:58:16.928 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-15T23:58:16.928 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw== 2024-09-15T23:58:16.928 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-15T23:58:16.928 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-15T23:58:16.928 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:58:16.929 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-15T23:58:16.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.929+0000 7f14eabd6640 1 -- 172.21.15.112:0/3559863249 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f14c80678f0 msgr2=0x7f14c8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:16.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.929+0000 7f14eabd6640 1 --2- 172.21.15.112:0/3559863249 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f14c80678f0 0x7f14c8069db0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f14d80b2000 tx=0x7f14d8008040 comp rx=0 tx=0).stop 2024-09-15T23:58:16.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.929+0000 7f14eabd6640 1 -- 172.21.15.112:0/3559863249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e4162070 msgr2=0x7f14e4160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:16.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.929+0000 7f14eabd6640 1 --2- 172.21.15.112:0/3559863249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e4162070 0x7f14e4160f30 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00c6f0 tx=0x7f14dc00cbb0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.929+0000 7f14eabd6640 1 -- 172.21.15.112:0/3559863249 shutdown_connections 2024-09-15T23:58:16.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.929+0000 7f14eabd6640 1 --2- 172.21.15.112:0/3559863249 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f14c80678f0 0x7f14c8069db0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.929+0000 7f14eabd6640 1 --2- 172.21.15.112:0/3559863249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e4162070 0x7f14e4160f30 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.929+0000 7f14eabd6640 1 --2- 172.21.15.112:0/3559863249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14e415e4f0 0x7f14e41609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.929+0000 7f14eabd6640 1 --2- 172.21.15.112:0/3559863249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14e40d4e20 0x7f14e41f3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:16.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.929+0000 7f14eabd6640 1 -- 172.21.15.112:0/3559863249 >> 172.21.15.112:0/3559863249 conn(0x7f14e408bf90 msgr2=0x7f14e40b78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:16.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.929+0000 7f14eabd6640 1 -- 172.21.15.112:0/3559863249 shutdown_connections 2024-09-15T23:58:16.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:16.929+0000 7f14eabd6640 1 -- 172.21.15.112:0/3559863249 wait complete. 2024-09-15T23:58:16.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:17.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.061+0000 7f550d7e5640 1 Processor -- start 2024-09-15T23:58:17.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.061+0000 7f550d7e5640 1 -- start start 2024-09-15T23:58:17.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f550d7e5640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f550815bec0 0x7f55080ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f550d7e5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f550815c2a0 0x7f55080aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f550d7e5640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55080b3290 con 0x7f55080af2a0 2024-09-15T23:58:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f550d7e5640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f55080b3570 con 0x7f550815c2a0 2024-09-15T23:58:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f550d7e5640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f55080b3850 con 0x7f550815bec0 2024-09-15T23:58:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f55067fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f550815c2a0 0x7f55080aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f55067fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f550815c2a0 0x7f55080aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59860/0 (socket says 172.21.15.112:59860) 2024-09-15T23:58:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f55067fc640 1 -- 172.21.15.112:0/3572302736 learned_addr learned my addr 172.21.15.112:0/3572302736 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f55067fc640 1 -- 172.21.15.112:0/3572302736 >> v2:172.21.15.169:3300/0 conn(0x7f550815bec0 msgr2=0x7f55080ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f55067fc640 1 --2- 172.21.15.112:0/3572302736 >> v2:172.21.15.169:3300/0 conn(0x7f550815bec0 0x7f55080ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f55067fc640 1 -- 172.21.15.112:0/3572302736 >> v1:172.21.15.169:6789/0 conn(0x7f55080af2a0 legacy=0x7f550815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:17.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f55067fc640 1 -- 172.21.15.112:0/3572302736 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55080b3b30 con 0x7f550815c2a0 2024-09-15T23:58:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f55067fc640 1 --2- 172.21.15.112:0/3572302736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f550815c2a0 0x7f55080aed60 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f5508071710 tx=0x7f54f001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ae370c788ab5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f5505ffb640 1 -- 172.21.15.112:0/3572302736 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f00aa610 con 0x7f550815c2a0 2024-09-15T23:58:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f5505ffb640 1 -- 172.21.15.112:0/3572302736 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f00af070 con 0x7f550815c2a0 2024-09-15T23:58:17.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f5505ffb640 1 -- 172.21.15.112:0/3572302736 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f00aa9d0 con 0x7f550815c2a0 2024-09-15T23:58:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f550d7e5640 1 -- 172.21.15.112:0/3572302736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f550815c2a0 msgr2=0x7f55080aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f550d7e5640 1 --2- 172.21.15.112:0/3572302736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f550815c2a0 0x7f55080aed60 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f5508071710 tx=0x7f54f001c4b0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f550d7e5640 1 -- 172.21.15.112:0/3572302736 shutdown_connections 2024-09-15T23:58:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f550d7e5640 1 --2- 172.21.15.112:0/3572302736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f550815c2a0 0x7f55080aed60 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f550d7e5640 1 --2- 172.21.15.112:0/3572302736 >> v2:172.21.15.169:3300/0 conn(0x7f550815bec0 0x7f55080ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.065+0000 7f550d7e5640 1 -- 172.21.15.112:0/3572302736 >> 172.21.15.112:0/3572302736 conn(0x7f55080b1f90 msgr2=0x7f55080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f550d7e5640 1 -- 172.21.15.112:0/3572302736 shutdown_connections 2024-09-15T23:58:17.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f550d7e5640 1 -- 172.21.15.112:0/3572302736 wait complete. 2024-09-15T23:58:17.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f550d7e5640 1 Processor -- start 2024-09-15T23:58:17.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f550d7e5640 1 -- start start 2024-09-15T23:58:17.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f550d7e5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55080af2a0 0x7f5508152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f550d7e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f550815bec0 0x7f5508154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f550d7e5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f550815c2a0 0x7f550815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f550d7e5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f55080ad740 con 0x7f550815bec0 2024-09-15T23:58:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f550d7e5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f55080af710 con 0x7f55080af2a0 2024-09-15T23:58:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f550d7e5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5508169000 con 0x7f550815c2a0 2024-09-15T23:58:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f55067fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f550815bec0 0x7f5508154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f55067fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f550815bec0 0x7f5508154ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59876/0 (socket says 172.21.15.112:59876) 2024-09-15T23:58:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f55067fc640 1 -- 172.21.15.112:0/3701818509 learned_addr learned my addr 172.21.15.112:0/3701818509 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f55067fc640 1 -- 172.21.15.112:0/3701818509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f550815c2a0 msgr2=0x7f550815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f55067fc640 1 --2- 172.21.15.112:0/3701818509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f550815c2a0 0x7f550815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f55067fc640 1 -- 172.21.15.112:0/3701818509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55080af2a0 msgr2=0x7f5508152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f55067fc640 1 --2- 172.21.15.112:0/3701818509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55080af2a0 0x7f5508152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f55067fc640 1 -- 172.21.15.112:0/3701818509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550815e020 con 0x7f550815bec0 2024-09-15T23:58:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f55067fc640 1 --2- 172.21.15.112:0/3701818509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f550815bec0 0x7f5508154ae0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f54f00ac040 tx=0x7f54f0019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f54ff7fe640 1 -- 172.21.15.112:0/3701818509 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f00b4810 con 0x7f550815bec0 2024-09-15T23:58:17.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f54ff7fe640 1 -- 172.21.15.112:0/3701818509 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f00b49b0 con 0x7f550815bec0 2024-09-15T23:58:17.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f550d7e5640 1 -- 172.21.15.112:0/3701818509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550809df20 con 0x7f550815bec0 2024-09-15T23:58:17.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f54ff7fe640 1 -- 172.21.15.112:0/3701818509 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f00b4da0 con 0x7f550815bec0 2024-09-15T23:58:17.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f550d7e5640 1 -- 172.21.15.112:0/3701818509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5508151f30 con 0x7f550815bec0 2024-09-15T23:58:17.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.069+0000 7f550d7e5640 1 -- 172.21.15.112:0/3701818509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f550806fcd0 con 0x7f550815bec0 2024-09-15T23:58:17.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.073+0000 7f54ff7fe640 1 -- 172.21.15.112:0/3701818509 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f54f00bc020 con 0x7f550815bec0 2024-09-15T23:58:17.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.073+0000 7f54ff7fe640 1 --2- 172.21.15.112:0/3701818509 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f54e80678f0 0x7f54e8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.073+0000 7f54ff7fe640 1 -- 172.21.15.112:0/3701818509 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f54f01207a0 con 0x7f550815bec0 2024-09-15T23:58:17.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.073+0000 7f5506ffd640 1 --2- 172.21.15.112:0/3701818509 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f54e80678f0 0x7f54e8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.073+0000 7f5506ffd640 1 --2- 172.21.15.112:0/3701818509 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f54e80678f0 0x7f54e8069db0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009730 tx=0x7f54f8006ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:17.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.077+0000 7f54ff7fe640 1 -- 172.21.15.112:0/3701818509 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f54f00a7070 con 0x7f550815bec0 2024-09-15T23:58:17.264 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.265+0000 7f550d7e5640 1 -- 172.21.15.112:0/3701818509 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55080d0870 con 0x7f550815bec0 2024-09-15T23:58:17.265 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.265+0000 7f54ff7fe640 1 -- 172.21.15.112:0/3701818509 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5237 (secure 0 0 0) 0x7f54f00160d0 con 0x7f550815bec0 2024-09-15T23:58:17.265 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:17.265 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":55,"btime":"2024-09-15T23:58:10:787850+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5587,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1676423720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1676423720},{"type":"v1","addr":"172.21.15.169:6833","nonce":1676423720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":5593,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2404488385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2404488385},{"type":"v1","addr":"172.21.15.169:6835","nonce":2404488385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6708,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/2061515349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2061515349},{"type":"v1","addr":"172.21.15.112:6836","nonce":2061515349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:10.137643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6711":{"gid":6711,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2378546307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":2378546307},{"type":"v1","addr":"172.21.15.112:6837","nonce":2378546307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6711,"qdb_cluster":[6711]},"id":7}]} 2024-09-15T23:58:17.265 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 55 2024-09-15T23:58:17.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.265+0000 7f550d7e5640 1 -- 172.21.15.112:0/3701818509 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f54e80678f0 msgr2=0x7f54e8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.265+0000 7f550d7e5640 1 --2- 172.21.15.112:0/3701818509 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f54e80678f0 0x7f54e8069db0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009730 tx=0x7f54f8006ca0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.265+0000 7f550d7e5640 1 -- 172.21.15.112:0/3701818509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f550815bec0 msgr2=0x7f5508154ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.265+0000 7f550d7e5640 1 --2- 172.21.15.112:0/3701818509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f550815bec0 0x7f5508154ae0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f54f00ac040 tx=0x7f54f0019250 comp rx=0 tx=0).stop 2024-09-15T23:58:17.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.265+0000 7f550d7e5640 1 -- 172.21.15.112:0/3701818509 shutdown_connections 2024-09-15T23:58:17.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.265+0000 7f550d7e5640 1 --2- 172.21.15.112:0/3701818509 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f54e80678f0 0x7f54e8069db0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.265+0000 7f550d7e5640 1 --2- 172.21.15.112:0/3701818509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f550815c2a0 0x7f550815ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.265+0000 7f550d7e5640 1 --2- 172.21.15.112:0/3701818509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f550815bec0 0x7f5508154ae0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.265+0000 7f550d7e5640 1 --2- 172.21.15.112:0/3701818509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55080af2a0 0x7f5508152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.265+0000 7f550d7e5640 1 -- 172.21.15.112:0/3701818509 >> 172.21.15.112:0/3701818509 conn(0x7f55080b1f90 msgr2=0x7f55080cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:17.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.265+0000 7f550d7e5640 1 -- 172.21.15.112:0/3701818509 shutdown_connections 2024-09-15T23:58:17.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.265+0000 7f550d7e5640 1 -- 172.21.15.112:0/3701818509 wait complete. 2024-09-15T23:58:17.685 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:58:07.063973+0000', 'modified': '2024-09-15T23:58:10.137643+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6711}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6711': {'gid': 6711, 'name': 'a', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6837/2378546307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6835', 'nonce': 2378546307}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 2378546307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6711, 'qdb_cluster': [6711]} 2024-09-15T23:58:17.685 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:58:17.685 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T23:58:17.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.817+0000 7f8a74397640 1 Processor -- start 2024-09-15T23:58:17.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.817+0000 7f8a74397640 1 -- start start 2024-09-15T23:58:17.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.817+0000 7f8a74397640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8a6c161a60 0x7f8a6c0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a74397640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8a6c0cf620 0x7f8a6c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a74397640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a6c0d32b0 con 0x7f8a6c0d2e90 2024-09-15T23:58:17.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a74397640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8a6c0d0300 con 0x7f8a6c0cf620 2024-09-15T23:58:17.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a74397640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8a6c0cfa90 con 0x7f8a6c161a60 2024-09-15T23:58:17.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a72934640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8a6c0cf620 0x7f8a6c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a71932640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8a6c0d2e90 0x7f8a6c0cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58682/0 (socket says 172.21.15.112:58682) 2024-09-15T23:58:17.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a71932640 1 -- 172.21.15.112:0/1961173919 learned_addr learned my addr 172.21.15.112:0/1961173919 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:17.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a72133640 1 --2- 172.21.15.112:0/1961173919 >> v2:172.21.15.169:3300/0 conn(0x7f8a6c161a60 0x7f8a6c0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a72934640 1 -- 172.21.15.112:0/1961173919 >> v2:172.21.15.169:3300/0 conn(0x7f8a6c161a60 msgr2=0x7f8a6c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:17.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a72934640 1 --2- 172.21.15.112:0/1961173919 >> v2:172.21.15.169:3300/0 conn(0x7f8a6c161a60 0x7f8a6c0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a72934640 1 -- 172.21.15.112:0/1961173919 >> v1:172.21.15.112:6789/0 conn(0x7f8a6c0d2e90 legacy=0x7f8a6c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a71131640 1 -- 172.21.15.112:0/1961173919 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 482671107 0 0) 0x7f8a6c0d32b0 con 0x7f8a6c0d2e90 2024-09-15T23:58:17.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a72934640 1 -- 172.21.15.112:0/1961173919 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6c0b0f60 con 0x7f8a6c0cf620 2024-09-15T23:58:17.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a72934640 1 --2- 172.21.15.112:0/1961173919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a6c0cf620 0x7f8a6c06d6b0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c08e010 tx=0x7f8a6401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa0a84ae8906a3d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:17.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a71131640 1 -- 172.21.15.112:0/1961173919 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640b2070 con 0x7f8a6c0cf620 2024-09-15T23:58:17.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a71131640 1 -- 172.21.15.112:0/1961173919 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a640a5930 con 0x7f8a6c0cf620 2024-09-15T23:58:17.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a71131640 1 -- 172.21.15.112:0/1961173919 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640a5d00 con 0x7f8a6c0cf620 2024-09-15T23:58:17.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a74397640 1 -- 172.21.15.112:0/1961173919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a6c0cf620 msgr2=0x7f8a6c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a74397640 1 --2- 172.21.15.112:0/1961173919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a6c0cf620 0x7f8a6c06d6b0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c08e010 tx=0x7f8a6401c870 comp rx=0 tx=0).stop 2024-09-15T23:58:17.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a74397640 1 -- 172.21.15.112:0/1961173919 shutdown_connections 2024-09-15T23:58:17.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a74397640 1 --2- 172.21.15.112:0/1961173919 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a6c0cf620 0x7f8a6c06d6b0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a74397640 1 --2- 172.21.15.112:0/1961173919 >> v2:172.21.15.169:3300/0 conn(0x7f8a6c161a60 0x7f8a6c0d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a74397640 1 -- 172.21.15.112:0/1961173919 >> 172.21.15.112:0/1961173919 conn(0x7f8a6c08bf90 msgr2=0x7f8a6c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:17.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a74397640 1 -- 172.21.15.112:0/1961173919 shutdown_connections 2024-09-15T23:58:17.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.821+0000 7f8a74397640 1 -- 172.21.15.112:0/1961173919 wait complete. 2024-09-15T23:58:17.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a74397640 1 Processor -- start 2024-09-15T23:58:17.824 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a74397640 1 -- start start 2024-09-15T23:58:17.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a74397640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a6c0cf620 0x7f8a6c15f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a74397640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a6c0d2e90 0x7f8a6c15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a74397640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a6c161a60 0x7f8a6c15f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a74397640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c06e400 con 0x7f8a6c0d2e90 2024-09-15T23:58:17.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a74397640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c06d190 con 0x7f8a6c161a60 2024-09-15T23:58:17.826 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a74397640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6c06e580 con 0x7f8a6c0cf620 2024-09-15T23:58:17.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a71932640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a6c0d2e90 0x7f8a6c15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a71932640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a6c0d2e90 0x7f8a6c15ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59890/0 (socket says 172.21.15.112:59890) 2024-09-15T23:58:17.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a71932640 1 -- 172.21.15.112:0/1973363028 learned_addr learned my addr 172.21.15.112:0/1973363028 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:17.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a72934640 1 --2- 172.21.15.112:0/1973363028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a6c161a60 0x7f8a6c15f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a72133640 1 --2- 172.21.15.112:0/1973363028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a6c0cf620 0x7f8a6c15f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a71932640 1 -- 172.21.15.112:0/1973363028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a6c0cf620 msgr2=0x7f8a6c15f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a71932640 1 --2- 172.21.15.112:0/1973363028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a6c0cf620 0x7f8a6c15f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a71932640 1 -- 172.21.15.112:0/1973363028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a6c161a60 msgr2=0x7f8a6c15f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a71932640 1 --2- 172.21.15.112:0/1973363028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a6c161a60 0x7f8a6c15f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a71932640 1 -- 172.21.15.112:0/1973363028 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6c15a580 con 0x7f8a6c0d2e90 2024-09-15T23:58:17.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a71932640 1 --2- 172.21.15.112:0/1973363028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a6c0d2e90 0x7f8a6c15ebe0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0011f0 tx=0x7f8a5c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:17.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a62ffd640 1 -- 172.21.15.112:0/1973363028 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c018070 con 0x7f8a6c0d2e90 2024-09-15T23:58:17.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a62ffd640 1 -- 172.21.15.112:0/1973363028 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5c0074e0 con 0x7f8a6c0d2e90 2024-09-15T23:58:17.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a74397640 1 -- 172.21.15.112:0/1973363028 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6c15a860 con 0x7f8a6c0d2e90 2024-09-15T23:58:17.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a62ffd640 1 -- 172.21.15.112:0/1973363028 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c004a10 con 0x7f8a6c0d2e90 2024-09-15T23:58:17.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.825+0000 7f8a74397640 1 -- 172.21.15.112:0/1973363028 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6c15ae20 con 0x7f8a6c0d2e90 2024-09-15T23:58:17.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a62ffd640 1 -- 172.21.15.112:0/1973363028 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a5c01b070 con 0x7f8a6c0d2e90 2024-09-15T23:58:17.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a62ffd640 1 --2- 172.21.15.112:0/1973363028 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8a500678c0 0x7f8a50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a62ffd640 1 -- 172.21.15.112:0/1973363028 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f8a5c085200 con 0x7f8a6c0d2e90 2024-09-15T23:58:17.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a72133640 1 --2- 172.21.15.112:0/1973363028 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8a500678c0 0x7f8a50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a72133640 1 --2- 172.21.15.112:0/1973363028 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8a500678c0 0x7f8a50069d80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0d4800 tx=0x7f8a68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:17.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a77453000 1 Processor -- start 2024-09-15T23:58:17.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a77453000 1 -- start start 2024-09-15T23:58:17.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a77453000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728afb20 0x55aa728aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a77453000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728b0440 0x55aa72865d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a77453000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa72866290 0x55aa72866670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a77453000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55aa7274db60 con 0x55aa728afb20 2024-09-15T23:58:17.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a77453000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55aa726b4c70 con 0x55aa728b0440 2024-09-15T23:58:17.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a77453000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55aa7265aed0 con 0x55aa72866290 2024-09-15T23:58:17.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a72133640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728afb20 0x55aa728aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a72133640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728afb20 0x55aa728aff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59906/0 (socket says 172.21.15.112:59906) 2024-09-15T23:58:17.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a72133640 1 -- 172.21.15.112:0/40955124 learned_addr learned my addr 172.21.15.112:0/40955124 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:17.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a72934640 1 --2- 172.21.15.112:0/40955124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa72866290 0x55aa72866670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a71932640 1 --2- 172.21.15.112:0/40955124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728b0440 0x55aa72865d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a72133640 1 -- 172.21.15.112:0/40955124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa72866290 msgr2=0x55aa72866670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:17.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a72133640 1 --2- 172.21.15.112:0/40955124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa72866290 0x55aa72866670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a72133640 1 -- 172.21.15.112:0/40955124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728b0440 msgr2=0x55aa72865d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:17.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a72133640 1 --2- 172.21.15.112:0/40955124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728b0440 0x55aa72865d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a72133640 1 -- 172.21.15.112:0/40955124 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa7266ce50 con 0x55aa728afb20 2024-09-15T23:58:17.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a71932640 1 --2- 172.21.15.112:0/40955124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728b0440 0x55aa72865d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:17.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a72133640 1 --2- 172.21.15.112:0/40955124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728afb20 0x55aa728aff00 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800fa50 tx=0x7f8a68012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9917fdb788009ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:17.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a4ffff640 1 -- 172.21.15.112:0/40955124 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6801b050 con 0x55aa728afb20 2024-09-15T23:58:17.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a4ffff640 1 -- 172.21.15.112:0/40955124 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a68025070 con 0x55aa728afb20 2024-09-15T23:58:17.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a4ffff640 1 -- 172.21.15.112:0/40955124 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68014e20 con 0x55aa728afb20 2024-09-15T23:58:17.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a77453000 1 -- 172.21.15.112:0/40955124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728afb20 msgr2=0x55aa728aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a77453000 1 --2- 172.21.15.112:0/40955124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728afb20 0x55aa728aff00 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800fa50 tx=0x7f8a68012000 comp rx=0 tx=0).stop 2024-09-15T23:58:17.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.829+0000 7f8a77453000 1 -- 172.21.15.112:0/40955124 shutdown_connections 2024-09-15T23:58:17.833 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 --2- 172.21.15.112:0/40955124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa72866290 0x55aa72866670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 --2- 172.21.15.112:0/40955124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728b0440 0x55aa72865d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 --2- 172.21.15.112:0/40955124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728afb20 0x55aa728aff00 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 -- 172.21.15.112:0/40955124 >> 172.21.15.112:0/40955124 conn(0x55aa7286c600 msgr2=0x55aa72864630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:17.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 -- 172.21.15.112:0/40955124 shutdown_connections 2024-09-15T23:58:17.834 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 -- 172.21.15.112:0/40955124 wait complete. 2024-09-15T23:58:17.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 -- start start 2024-09-15T23:58:17.838 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 Processor -- start 2024-09-15T23:58:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728afb20 0x55aa7286ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa728b0440 0x55aa72870cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa7286b390 0x55aa72871230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55aa72716b00 con 0x55aa7286b390 2024-09-15T23:58:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55aa7268f360 con 0x55aa728afb20 2024-09-15T23:58:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55aa7268c2d0 con 0x55aa728b0440 2024-09-15T23:58:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 10 client.0 _ll_register_callbacks cb 0x55aa72851820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:58:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a72934640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa7286b390 0x55aa72871230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a72934640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa7286b390 0x55aa72871230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59910/0 (socket says 172.21.15.112:59910) 2024-09-15T23:58:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a72934640 1 -- 172.21.15.112:0/3984384500 learned_addr learned my addr 172.21.15.112:0/3984384500 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a71932640 1 --2- 172.21.15.112:0/3984384500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa728b0440 0x55aa72870cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a72133640 1 --2- 172.21.15.112:0/3984384500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728afb20 0x55aa7286ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a72934640 1 -- 172.21.15.112:0/3984384500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa728b0440 msgr2=0x55aa72870cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:17.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a72934640 1 --2- 172.21.15.112:0/3984384500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa728b0440 0x55aa72870cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a72934640 1 -- 172.21.15.112:0/3984384500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728afb20 msgr2=0x55aa7286ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:17.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a72934640 1 --2- 172.21.15.112:0/3984384500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728afb20 0x55aa7286ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a72934640 1 -- 172.21.15.112:0/3984384500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa7265b120 con 0x55aa7286b390 2024-09-15T23:58:17.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a72934640 1 --2- 172.21.15.112:0/3984384500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa7286b390 0x55aa72871230 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f8a640b0040 tx=0x7f8a6401b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b8ccf2c04f6988 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:17.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:58:17.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a4d7fa640 1 -- 172.21.15.112:0/3984384500 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640b2040 con 0x55aa7286b390 2024-09-15T23:58:17.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a4d7fa640 1 -- 172.21.15.112:0/3984384500 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f8a640ad440 con 0x55aa7286b390 2024-09-15T23:58:17.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 -- 172.21.15.112:0/3984384500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a68025070 con 0x55aa7286b390 2024-09-15T23:58:17.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a4d7fa640 1 -- 172.21.15.112:0/3984384500 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f8a640c9050 con 0x55aa7286b390 2024-09-15T23:58:17.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 10 client.6873 fetch_fsmap learned FSMap version 55 2024-09-15T23:58:17.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 -- 172.21.15.112:0/3984384500 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55aa72654450 con 0x55aa7286b390 2024-09-15T23:58:17.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a4d7fa640 1 -- 172.21.15.112:0/3984384500 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a68025070 con 0x55aa7286b390 2024-09-15T23:58:17.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a4d7fa640 1 -- 172.21.15.112:0/3984384500 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 55) ==== 3502+0+0 (secure 0 0 0) 0x7f8a640cc020 con 0x55aa7286b390 2024-09-15T23:58:17.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 10 client.6873 fetch_fsmap finished waiting for FSMap version 55 2024-09-15T23:58:17.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 10 client.6873 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:58:17.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 20 client.6873 populate_metadata read hostname 'smithi112' 2024-09-15T23:58:17.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 --2- 172.21.15.112:0/3984384500 >> [v2:172.21.15.112:6835/2378546307,v1:172.21.15.112:6837/2378546307] conn(0x55aa728be280 0x55aa728c0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 4 client.6873 mds_command: new command op to 6711 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:58:17.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a77453000 1 -- 172.21.15.112:0/3984384500 --> [v2:172.21.15.112:6835/2378546307,v1:172.21.15.112:6837/2378546307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa7264ec00 con 0x55aa728be280 2024-09-15T23:58:17.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a72133640 1 --2- 172.21.15.112:0/3984384500 >> [v2:172.21.15.112:6835/2378546307,v1:172.21.15.112:6837/2378546307] conn(0x55aa728be280 0x55aa728c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a72133640 1 --2- 172.21.15.112:0/3984384500 >> [v2:172.21.15.112:6835/2378546307,v1:172.21.15.112:6837/2378546307] conn(0x55aa728be280 0x55aa728c0670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f893db0803d6396d server_cookie=3dad9a35aa18f82d in_seq=0 out_seq=0 2024-09-15T23:58:17.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.833+0000 7f8a4d7fa640 10 client.6873 ms_handle_connect on v2:172.21.15.112:6835/2378546307 2024-09-15T23:58:17.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a4d7fa640 1 -- 172.21.15.112:0/3984384500 <== mds.0 v2:172.21.15.112:6835/2378546307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa7264ec00 con 0x55aa728be280 2024-09-15T23:58:17.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a4d7fa640 10 client.6873 handle_command_reply: tid=0 2024-09-15T23:58:17.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a77453000 1 client.6873 shutdown 2024-09-15T23:58:17.841 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a77453000 1 -- 172.21.15.112:0/3984384500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa7286b390 msgr2=0x55aa72871230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a77453000 1 --2- 172.21.15.112:0/3984384500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa7286b390 0x55aa72871230 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f8a640b0040 tx=0x7f8a6401b0b0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a77453000 1 -- 172.21.15.112:0/3984384500 shutdown_connections 2024-09-15T23:58:17.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a77453000 1 --2- 172.21.15.112:0/3984384500 >> [v2:172.21.15.112:6835/2378546307,v1:172.21.15.112:6837/2378546307] conn(0x55aa728be280 0x55aa728c0670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a77453000 1 --2- 172.21.15.112:0/3984384500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa7286b390 0x55aa72871230 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a77453000 1 --2- 172.21.15.112:0/3984384500 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa728b0440 0x55aa72870cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a4d7fa640 0 client.6873 ms_handle_reset on v2:172.21.15.112:6835/2378546307 2024-09-15T23:58:17.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a77453000 1 --2- 172.21.15.112:0/3984384500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728afb20 0x55aa7286ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a77453000 1 -- 172.21.15.112:0/3984384500 >> 172.21.15.112:0/3984384500 conn(0x55aa72866290 msgr2=0x55aa72864d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:17.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a77453000 1 -- 172.21.15.112:0/3984384500 shutdown_connections 2024-09-15T23:58:17.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a77453000 1 -- 172.21.15.112:0/3984384500 wait complete. 2024-09-15T23:58:17.842 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.837+0000 7f8a77453000 20 client.6873 trim_cache size 0 max 16384 2024-09-15T23:58:17.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.853+0000 7f8a77453000 1 Processor -- start 2024-09-15T23:58:17.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.853+0000 7f8a77453000 1 -- start start 2024-09-15T23:58:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa7286b390 0x55aa728aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728afb20 0x55aa728af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728b0440 0x55aa728c0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c202ad0 con 0x55aa728afb20 2024-09-15T23:58:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1581a0 con 0x55aa728b0440 2024-09-15T23:58:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6c2025d0 con 0x55aa7286b390 2024-09-15T23:58:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a71932640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728afb20 0x55aa728af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a71932640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728afb20 0x55aa728af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59926/0 (socket says 172.21.15.112:59926) 2024-09-15T23:58:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a71932640 1 -- 172.21.15.112:0/1678712060 learned_addr learned my addr 172.21.15.112:0/1678712060 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a71932640 1 -- 172.21.15.112:0/1678712060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa7286b390 msgr2=0x55aa728aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a71932640 1 --2- 172.21.15.112:0/1678712060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa7286b390 0x55aa728aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a71932640 1 -- 172.21.15.112:0/1678712060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728b0440 msgr2=0x55aa728c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a71932640 1 --2- 172.21.15.112:0/1678712060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728b0440 0x55aa728c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a71932640 1 -- 172.21.15.112:0/1678712060 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa7263bfd0 con 0x55aa728afb20 2024-09-15T23:58:17.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a71932640 1 --2- 172.21.15.112:0/1678712060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728afb20 0x55aa728af1d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c055110 tx=0x7f8a5c054e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247ae2abed83f0ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a4f7fe640 1 -- 172.21.15.112:0/1678712060 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c07ce60 con 0x55aa728afb20 2024-09-15T23:58:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a4f7fe640 1 -- 172.21.15.112:0/1678712060 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5c0597c0 con 0x55aa728afb20 2024-09-15T23:58:17.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a4f7fe640 1 -- 172.21.15.112:0/1678712060 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c05dff0 con 0x55aa728afb20 2024-09-15T23:58:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 -- 172.21.15.112:0/1678712060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728afb20 msgr2=0x55aa728af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 --2- 172.21.15.112:0/1678712060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728afb20 0x55aa728af1d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c055110 tx=0x7f8a5c054e80 comp rx=0 tx=0).stop 2024-09-15T23:58:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 -- 172.21.15.112:0/1678712060 shutdown_connections 2024-09-15T23:58:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 --2- 172.21.15.112:0/1678712060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa728b0440 0x55aa728c0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 --2- 172.21.15.112:0/1678712060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728afb20 0x55aa728af1d0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 --2- 172.21.15.112:0/1678712060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa7286b390 0x55aa728aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 -- 172.21.15.112:0/1678712060 >> 172.21.15.112:0/1678712060 conn(0x55aa72866290 msgr2=0x55aa7286a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 -- 172.21.15.112:0/1678712060 shutdown_connections 2024-09-15T23:58:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 -- 172.21.15.112:0/1678712060 wait complete. 2024-09-15T23:58:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 -- start start 2024-09-15T23:58:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 Processor -- start 2024-09-15T23:58:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa7286b390 0x55aa728c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa728afb20 0x55aa728de960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728b0440 0x55aa728deea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55aa726b3f80 con 0x55aa728b0440 2024-09-15T23:58:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55aa7266cca0 con 0x55aa7286b390 2024-09-15T23:58:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55aa726b92a0 con 0x55aa728afb20 2024-09-15T23:58:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 10 client.0 _ll_register_callbacks cb 0x7f8a640b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:58:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a72934640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728b0440 0x55aa728deea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a72934640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728b0440 0x55aa728deea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59934/0 (socket says 172.21.15.112:59934) 2024-09-15T23:58:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a72934640 1 -- 172.21.15.112:0/3510938455 learned_addr learned my addr 172.21.15.112:0/3510938455 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a72133640 1 --2- 172.21.15.112:0/3510938455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa7286b390 0x55aa728c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a71932640 1 --2- 172.21.15.112:0/3510938455 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa728afb20 0x55aa728de960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a72934640 1 -- 172.21.15.112:0/3510938455 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa728afb20 msgr2=0x55aa728de960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a72934640 1 --2- 172.21.15.112:0/3510938455 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa728afb20 0x55aa728de960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a72934640 1 -- 172.21.15.112:0/3510938455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa7286b390 msgr2=0x55aa728c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a72934640 1 --2- 172.21.15.112:0/3510938455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa7286b390 0x55aa728c3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a72934640 1 -- 172.21.15.112:0/3510938455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa72737750 con 0x55aa728b0440 2024-09-15T23:58:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a72934640 1 --2- 172.21.15.112:0/3510938455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728b0440 0x55aa728deea0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f8a6401b0f0 tx=0x7f8a64019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43619ce26d804b0a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:17.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:58:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a4d7fa640 1 -- 172.21.15.112:0/3510938455 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640d2060 con 0x55aa728b0440 2024-09-15T23:58:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a4d7fa640 1 -- 172.21.15.112:0/3510938455 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f8a640a5ce0 con 0x55aa728b0440 2024-09-15T23:58:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 -- 172.21.15.112:0/3510938455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a5c0597c0 con 0x55aa728b0440 2024-09-15T23:58:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a4d7fa640 1 -- 172.21.15.112:0/3510938455 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f8a640b2070 con 0x55aa728b0440 2024-09-15T23:58:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 10 client.6879 fetch_fsmap learned FSMap version 55 2024-09-15T23:58:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.857+0000 7f8a77453000 1 -- 172.21.15.112:0/3510938455 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55aa72642a30 con 0x55aa728b0440 2024-09-15T23:58:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a4d7fa640 1 -- 172.21.15.112:0/3510938455 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5c0597c0 con 0x55aa728b0440 2024-09-15T23:58:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a4d7fa640 1 -- 172.21.15.112:0/3510938455 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 55) ==== 3502+0+0 (secure 0 0 0) 0x7f8a640cc070 con 0x55aa728b0440 2024-09-15T23:58:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 10 client.6879 fetch_fsmap finished waiting for FSMap version 55 2024-09-15T23:58:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 10 client.6879 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:58:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 20 client.6879 populate_metadata read hostname 'smithi112' 2024-09-15T23:58:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 1 --2- 172.21.15.112:0/3510938455 >> [v2:172.21.15.112:6835/2378546307,v1:172.21.15.112:6837/2378546307] conn(0x55aa728df3e0 0x55aa72922c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 4 client.6879 mds_command: new command op to 6711 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:58:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 1 -- 172.21.15.112:0/3510938455 --> [v2:172.21.15.112:6835/2378546307,v1:172.21.15.112:6837/2378546307] -- command(tid 0: {"prefix": "status"}) -- 0x55aa726c23a0 con 0x55aa728df3e0 2024-09-15T23:58:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a72133640 1 --2- 172.21.15.112:0/3510938455 >> [v2:172.21.15.112:6835/2378546307,v1:172.21.15.112:6837/2378546307] conn(0x55aa728df3e0 0x55aa72922c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a4d7fa640 10 client.6879 ms_handle_connect on v2:172.21.15.112:6835/2378546307 2024-09-15T23:58:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a72133640 1 --2- 172.21.15.112:0/3510938455 >> [v2:172.21.15.112:6835/2378546307,v1:172.21.15.112:6837/2378546307] conn(0x55aa728df3e0 0x55aa72922c70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6efbd7c8f439f530 server_cookie=37b061c35b04096f in_seq=0 out_seq=0 2024-09-15T23:58:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a4d7fa640 1 -- 172.21.15.112:0/3510938455 <== mds.0 v2:172.21.15.112:6835/2378546307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55aa726c23a0 con 0x55aa728df3e0 2024-09-15T23:58:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a4d7fa640 10 client.6879 handle_command_reply: tid=0 2024-09-15T23:58:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 1 client.6879 shutdown 2024-09-15T23:58:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 1 -- 172.21.15.112:0/3510938455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728b0440 msgr2=0x55aa728deea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 1 --2- 172.21.15.112:0/3510938455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728b0440 0x55aa728deea0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f8a6401b0f0 tx=0x7f8a64019610 comp rx=0 tx=0).stop 2024-09-15T23:58:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 1 -- 172.21.15.112:0/3510938455 shutdown_connections 2024-09-15T23:58:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 1 --2- 172.21.15.112:0/3510938455 >> [v2:172.21.15.112:6835/2378546307,v1:172.21.15.112:6837/2378546307] conn(0x55aa728df3e0 0x55aa72922c70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 1 --2- 172.21.15.112:0/3510938455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa728b0440 0x55aa728deea0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 1 --2- 172.21.15.112:0/3510938455 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55aa728afb20 0x55aa728de960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 1 --2- 172.21.15.112:0/3510938455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aa7286b390 0x55aa728c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a4d7fa640 0 client.6879 ms_handle_reset on v2:172.21.15.112:6835/2378546307 2024-09-15T23:58:17.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 1 -- 172.21.15.112:0/3510938455 >> 172.21.15.112:0/3510938455 conn(0x55aa72866290 msgr2=0x55aa728adc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:17.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 1 -- 172.21.15.112:0/3510938455 shutdown_connections 2024-09-15T23:58:17.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 1 -- 172.21.15.112:0/3510938455 wait complete. 2024-09-15T23:58:17.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a77453000 20 client.6879 trim_cache size 0 max 16384 2024-09-15T23:58:17.867 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:58:17.867 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "1af6b673-4d40-4109-af4e-78662faa7df8", 2024-09-15T23:58:17.867 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-15T23:58:17.867 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 6711, 2024-09-15T23:58:17.867 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-15T23:58:17.868 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-15T23:58:17.868 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-15T23:58:17.868 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 10.088752179, 2024-09-15T23:58:17.868 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 55, 2024-09-15T23:58:17.868 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 97, 2024-09-15T23:58:17.868 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 97, 2024-09-15T23:58:17.868 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 15.147849279000001 2024-09-15T23:58:17.868 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:58:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a74397640 1 -- 172.21.15.112:0/1973363028 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8a500678c0 msgr2=0x7f8a50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a74397640 1 --2- 172.21.15.112:0/1973363028 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8a500678c0 0x7f8a50069d80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0d4800 tx=0x7f8a68008040 comp rx=0 tx=0).stop 2024-09-15T23:58:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a74397640 1 -- 172.21.15.112:0/1973363028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a6c0d2e90 msgr2=0x7f8a6c15ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a74397640 1 --2- 172.21.15.112:0/1973363028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a6c0d2e90 0x7f8a6c15ebe0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0011f0 tx=0x7f8a5c00c9b0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a74397640 1 -- 172.21.15.112:0/1973363028 shutdown_connections 2024-09-15T23:58:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a74397640 1 --2- 172.21.15.112:0/1973363028 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8a500678c0 0x7f8a50069d80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a74397640 1 --2- 172.21.15.112:0/1973363028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a6c161a60 0x7f8a6c15f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a74397640 1 --2- 172.21.15.112:0/1973363028 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a6c0d2e90 0x7f8a6c15ebe0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a74397640 1 --2- 172.21.15.112:0/1973363028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8a6c0cf620 0x7f8a6c15f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a74397640 1 -- 172.21.15.112:0/1973363028 >> 172.21.15.112:0/1973363028 conn(0x7f8a6c08bf90 msgr2=0x7f8a6c0ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a74397640 1 -- 172.21.15.112:0/1973363028 shutdown_connections 2024-09-15T23:58:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.861+0000 7f8a74397640 1 -- 172.21.15.112:0/1973363028 wait complete. 2024-09-15T23:58:17.877 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:58:17.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.981+0000 7fb36d3ee640 1 Processor -- start 2024-09-15T23:58:17.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.981+0000 7fb36d3ee640 1 -- start start 2024-09-15T23:58:17.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb36d3ee640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3681457a0 0x7fb3680d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb36d3ee640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb3680cf800 0x7fb3680b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb36d3ee640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3680d27a0 con 0x7fb3680b4340 2024-09-15T23:58:17.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb36d3ee640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb3680d1720 con 0x7fb3680cf800 2024-09-15T23:58:17.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb36d3ee640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb3680b4790 con 0x7fb3681457a0 2024-09-15T23:58:17.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb35ffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb3680cf800 0x7fb3680b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb35ffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb3680cf800 0x7fb3680b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59940/0 (socket says 172.21.15.112:59940) 2024-09-15T23:58:17.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb35ffff640 1 -- 172.21.15.112:0/3724340307 learned_addr learned my addr 172.21.15.112:0/3724340307 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:17.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb366ffd640 1 --2- 172.21.15.112:0/3724340307 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3681457a0 0x7fb3680d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb35ffff640 1 -- 172.21.15.112:0/3724340307 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3681457a0 msgr2=0x7fb3680d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:17.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb35ffff640 1 --2- 172.21.15.112:0/3724340307 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3681457a0 0x7fb3680d1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb35ffff640 1 -- 172.21.15.112:0/3724340307 >> v1:172.21.15.169:6789/0 conn(0x7fb3680b4340 legacy=0x7fb36815ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:17.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb35ffff640 1 -- 172.21.15.112:0/3724340307 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3680d2a80 con 0x7fb3680cf800 2024-09-15T23:58:17.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb35ffff640 1 --2- 172.21.15.112:0/3724340307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3680cf800 0x7fb3680b3e00 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fb350009870 tx=0x7fb35001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3352ee7145fdb941 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:17.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb3667fc640 1 -- 172.21.15.112:0/3724340307 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3500b0070 con 0x7fb3680cf800 2024-09-15T23:58:17.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb3667fc640 1 -- 172.21.15.112:0/3724340307 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3500ab400 con 0x7fb3680cf800 2024-09-15T23:58:17.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.985+0000 7fb3667fc640 1 -- 172.21.15.112:0/3724340307 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3500ab7d0 con 0x7fb3680cf800 2024-09-15T23:58:17.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3724340307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3680cf800 msgr2=0x7fb3680b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 --2- 172.21.15.112:0/3724340307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3680cf800 0x7fb3680b3e00 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fb350009870 tx=0x7fb35001c490 comp rx=0 tx=0).stop 2024-09-15T23:58:17.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3724340307 shutdown_connections 2024-09-15T23:58:17.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 --2- 172.21.15.112:0/3724340307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3680cf800 0x7fb3680b3e00 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 --2- 172.21.15.112:0/3724340307 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3681457a0 0x7fb3680d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3724340307 >> 172.21.15.112:0/3724340307 conn(0x7fb36806bcc0 msgr2=0x7fb36806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:17.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3724340307 shutdown_connections 2024-09-15T23:58:17.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3724340307 wait complete. 2024-09-15T23:58:17.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 Processor -- start 2024-09-15T23:58:17.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 -- start start 2024-09-15T23:58:17.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3680b4340 0x7fb368143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3680cf800 0x7fb3680b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3681457a0 0x7fb3680b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb3680b52f0 con 0x7fb3680cf800 2024-09-15T23:58:17.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb3680b5170 con 0x7fb3681457a0 2024-09-15T23:58:17.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb3681690b0 con 0x7fb3680b4340 2024-09-15T23:58:17.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb35ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3680cf800 0x7fb3680b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb35ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3680cf800 0x7fb3680b5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:59950/0 (socket says 172.21.15.112:59950) 2024-09-15T23:58:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb35ffff640 1 -- 172.21.15.112:0/3366009041 learned_addr learned my addr 172.21.15.112:0/3366009041 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb3677fe640 1 --2- 172.21.15.112:0/3366009041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3681457a0 0x7fb3680b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb35ffff640 1 -- 172.21.15.112:0/3366009041 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3680b4340 msgr2=0x7fb368143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb35ffff640 1 --2- 172.21.15.112:0/3366009041 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3680b4340 0x7fb368143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb35ffff640 1 -- 172.21.15.112:0/3366009041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3681457a0 msgr2=0x7fb3680b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb35ffff640 1 --2- 172.21.15.112:0/3366009041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3681457a0 0x7fb3680b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb35ffff640 1 -- 172.21.15.112:0/3366009041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb368163740 con 0x7fb3680cf800 2024-09-15T23:58:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb3677fe640 1 --2- 172.21.15.112:0/3366009041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3681457a0 0x7fb3680b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb35ffff640 1 --2- 172.21.15.112:0/3366009041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3680cf800 0x7fb3680b5ce0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fb3500ae040 tx=0x7fb350019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb35f7fe640 1 -- 172.21.15.112:0/3366009041 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3500bb070 con 0x7fb3680cf800 2024-09-15T23:58:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb35f7fe640 1 -- 172.21.15.112:0/3366009041 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3500b6430 con 0x7fb3680cf800 2024-09-15T23:58:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3366009041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3680cba40 con 0x7fb3680cf800 2024-09-15T23:58:17.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb35f7fe640 1 -- 172.21.15.112:0/3366009041 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3500b0040 con 0x7fb3680cf800 2024-09-15T23:58:17.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3366009041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3681639c0 con 0x7fb3680cf800 2024-09-15T23:58:17.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.989+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3366009041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3680b3e00 con 0x7fb3680cf800 2024-09-15T23:58:17.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.993+0000 7fb35f7fe640 1 -- 172.21.15.112:0/3366009041 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3500be070 con 0x7fb3680cf800 2024-09-15T23:58:17.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.993+0000 7fb35f7fe640 1 --2- 172.21.15.112:0/3366009041 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3480678c0 0x7fb348069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:17.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.993+0000 7fb366ffd640 1 --2- 172.21.15.112:0/3366009041 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3480678c0 0x7fb348069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:17.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.993+0000 7fb35f7fe640 1 -- 172.21.15.112:0/3366009041 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7fb35011f550 con 0x7fb3680cf800 2024-09-15T23:58:17.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.993+0000 7fb366ffd640 1 --2- 172.21.15.112:0/3366009041 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3480678c0 0x7fb348069d80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb35800a810 tx=0x7fb358008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:17.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:17.997+0000 7fb35f7fe640 1 -- 172.21.15.112:0/3366009041 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb368163740 con 0x7fb3680cf800 2024-09-15T23:58:18.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18.189+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3366009041 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb36815d470 con 0x7fb3680cf800 2024-09-15T23:58:18.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18.189+0000 7fb35f7fe640 1 -- 172.21.15.112:0/3366009041 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) ==== 53+0+73 (secure 0 0 0) 0x7fb350016110 con 0x7fb3680cf800 2024-09-15T23:58:18.188 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:58:18.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18.189+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3366009041 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3480678c0 msgr2=0x7fb348069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:18.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18.189+0000 7fb36d3ee640 1 --2- 172.21.15.112:0/3366009041 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3480678c0 0x7fb348069d80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb35800a810 tx=0x7fb358008040 comp rx=0 tx=0).stop 2024-09-15T23:58:18.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18.189+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3366009041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3680cf800 msgr2=0x7fb3680b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:18.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18.189+0000 7fb36d3ee640 1 --2- 172.21.15.112:0/3366009041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3680cf800 0x7fb3680b5ce0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fb3500ae040 tx=0x7fb350019230 comp rx=0 tx=0).stop 2024-09-15T23:58:18.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18.189+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3366009041 shutdown_connections 2024-09-15T23:58:18.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18.189+0000 7fb36d3ee640 1 --2- 172.21.15.112:0/3366009041 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3480678c0 0x7fb348069d80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:18.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18.189+0000 7fb36d3ee640 1 --2- 172.21.15.112:0/3366009041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3681457a0 0x7fb3680b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:18.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18.189+0000 7fb36d3ee640 1 --2- 172.21.15.112:0/3366009041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3680cf800 0x7fb3680b5ce0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:18.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18.189+0000 7fb36d3ee640 1 --2- 172.21.15.112:0/3366009041 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3680b4340 0x7fb368143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:18.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18.189+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3366009041 >> 172.21.15.112:0/3366009041 conn(0x7fb36806bcc0 msgr2=0x7fb3680d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:18.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18.189+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3366009041 shutdown_connections 2024-09-15T23:58:18.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18.189+0000 7fb36d3ee640 1 -- 172.21.15.112:0/3366009041 wait complete. 2024-09-15T23:58:18.206 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:58:18.206 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:58:18.206 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-15T23:58:18.206 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:58:18.206 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:58:18.206 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:58:18.206 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:58:18.206 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:58:18.206 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:58:18.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:18.207 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-15T23:58:18.212 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:58:18.213 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:58:18.213 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:58:18.213 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:58:18.213 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-15T23:58:18.213 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:58:18.213 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:58:18.214 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:58:18.214 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-15T23:58:18.214 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:58:18.214 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:58:18.214 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-15T23:58:18.214 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:58:18.214 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:58:18.214 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:58:18.214 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:58:18.214 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T23:58:18.214 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42198sec preferred_lft 42198sec 2024-09-15T23:58:18.214 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2024-09-15T23:58:18.214 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:58:18.214 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T23:58:18.215 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:5c:cd:1e:d6 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:58:18.215 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T23:58:18.215 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:58:18.215 INFO:teuthology.orchestra.run.smithi112.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:58:18.215 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T23:58:18.215 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:58:18.215 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:58:18.215 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T23:58:18.215 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:58:18.215 INFO:teuthology.orchestra.run.smithi112.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:58:18.215 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:58:18.215 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T23:58:18.215 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:58:18.216 INFO:teuthology.orchestra.run.smithi112.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:58:18.216 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:58:18.216 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T23:58:18.216 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:58:18.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:18.216 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:58:18.266 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-15T23:58:18.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:18.267 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-15T23:58:18.320 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-15T23:58:18.320 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:58:18.320 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T23:58:18.320 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:58:18.320 INFO:teuthology.orchestra.run.smithi112.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T23:58:18.320 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T23:58:18.320 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:58:18.320 INFO:teuthology.orchestra.run.smithi112.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:58:18.320 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:58:18.320 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:58:18.321 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:58:18.321 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:58:18.321 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:58:18.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:58:18.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:58:18.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:58:18.321 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:58:18.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:58:18.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:58:18.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:18.440 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-15T23:58:18.493 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:58:18.493 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:58:18.493 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:58:18.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:18.493 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-15T23:58:18.549 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T23:58:18.549 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:58:18.550 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:58:18.597 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:58:18.598 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:58:18.598 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:58:18.644 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:58:18.702 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:58:18.751 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:58:18.751 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:58:18.751 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:58:18.751 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:58:18.751 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:58:18.751 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:58:18.751 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:58:18.751 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:58:18.751 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:58:18.751 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:58:18.752 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:58:18.752 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:58:18.752 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:58:18.752 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:58:18.752 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:58:18.752 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:58:18.752 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:58:18.752 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:58:18.752 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:58:18.752 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:58:18.752 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:58:18.752 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:58:18.752 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:58:18.753 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:58:18.753 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:58:18.753 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:58:18.753 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:58:18.753 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:58:18.753 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:58:18.753 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:58:18.753 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:58:18.753 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:58:18.753 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:58:18.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:18.754 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:58:18.801 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:58:18.801 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T23:58:18.846 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:58:18.861 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:58:18.908 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:58:18.909 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:58:18.909 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:58:18.909 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:58:18.909 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:58:18.909 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:58:18.909 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:58:18.909 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:58:18.909 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:58:18.909 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:58:18.910 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:58:18.910 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:58:18.910 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:58:18.910 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:58:18.910 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:58:18.910 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:58:18.910 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:58:18.910 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:58:18.910 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:58:18.910 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:58:18.910 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:58:18.911 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:58:18.911 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:58:18.911 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:58:18.911 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:58:18.911 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:58:18.911 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:58:18.911 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:58:18.911 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:58:18.911 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:58:18.912 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:58:18.912 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:58:18.912 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:58:18.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:18.913 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:58:18.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:2024-09-15T23:58:18.925+0000 7f27378e4580 -1 init, newargv = 0x559f979d9350 newargc=15 2024-09-15T23:58:18.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[44835]: starting ceph client 2024-09-15T23:58:18.932 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[44835]: starting fuse 2024-09-15T23:58:20.032 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:58:20.049 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:58:20.099 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:58:20.099 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:58:20.099 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:58:20.099 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:58:20.099 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:58:20.099 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:58:20.099 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:58:20.100 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:58:20.100 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:58:20.100 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:58:20.100 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:58:20.100 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:58:20.100 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:58:20.100 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:58:20.100 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:58:20.100 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:58:20.100 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:58:20.100 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:58:20.100 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:58:20.100 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:58:20.101 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:58:20.101 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:58:20.101 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:58:20.101 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:58:20.101 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:58:20.101 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:58:20.101 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:58:20.101 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:58:20.101 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:58:20.101 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:58:20.101 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:58:20.101 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:58:20.101 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:58:20.101 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:58:20.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:20.102 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:58:20.154 INFO:teuthology.orchestra.run.smithi112.stdout:45 2024-09-15T23:58:20.154 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T23:58:20.154 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:58:20.154 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2024-09-15T23:58:20.154 DEBUG:teuthology.orchestra.run.smithi112:> import re 2024-09-15T23:58:20.154 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:58:20.154 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:58:20.155 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:58:20.156 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2024-09-15T23:58:20.156 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2024-09-15T23:58:20.156 DEBUG:teuthology.orchestra.run.smithi112:> return f 2024-09-15T23:58:20.156 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:58:20.156 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:58:20.156 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.0")) 2024-09-15T23:58:20.156 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:58:20.277 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.0.44835.asok 2024-09-15T23:58:20.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:58:20.289 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44835.asok 2024-09-15T23:58:20.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:20.289 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44835.asok status 2024-09-15T23:58:20.442 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:58:20.443 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2024-09-15T23:58:20.443 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:58:20.443 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:58:20.443 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "0", 2024-09-15T23:58:20.443 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2024-09-15T23:58:20.443 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:58:20.443 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "44835", 2024-09-15T23:58:20.443 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2024-09-15T23:58:20.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:20.443 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2024-09-15T23:58:20.443 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2024-09-15T23:58:20.444 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 6891, 2024-09-15T23:58:20.444 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2024-09-15T23:58:20.444 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2024-09-15T23:58:20.444 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2024-09-15T23:58:20.444 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 6891 2024-09-15T23:58:20.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:20.444 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:58:20.444 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:58:20.444 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:58:20.444 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1776455092 2024-09-15T23:58:20.444 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:58:20.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:20.444 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:58:20.445 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:58:20.445 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:58:20.445 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 1776455092 2024-09-15T23:58:20.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:58:20.445 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.6891 192.168.0.1:0/1776455092", 2024-09-15T23:58:20.445 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.1:0/1776455092", 2024-09-15T23:58:20.445 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2024-09-15T23:58:20.445 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 55, 2024-09-15T23:58:20.445 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 97, 2024-09-15T23:58:20.445 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:58:20.445 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2024-09-15T23:58:20.445 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2024-09-15T23:58:20.446 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:58:20.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:20.456 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2024-09-15T23:58:20.457 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:58:20.462 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2024-09-15T23:58:20.463 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:58:20.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:20.463 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:58:20.517 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:58:20.561 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:58:20.586 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-15T23:58:20.587 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-09-15T23:58:20.587 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:58:20.587 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-09-15T23:58:20.587 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.587 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-09-15T23:58:20.587 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.587 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-09-15T23:58:20.587 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.587 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-09-15T23:58:20.587 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-09-15T23:58:20.587 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.587 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-09-15T23:58:20.587 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-09-15T23:58:20.588 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.588 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:58:20.588 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-09-15T23:58:20.588 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.588 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:58:20.588 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:58:20.588 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.588 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-09-15T23:58:20.588 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.588 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-09-15T23:58:20.588 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-09-15T23:58:20.588 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:58:20.588 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:58:20.588 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-09-15T23:58:20.589 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:58:20.589 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-09-15T23:58:20.589 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:58:20.589 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:58:20.589 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-09-15T23:58:20.589 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.589 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:58:20.589 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.589 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-09-15T23:58:20.589 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.589 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-09-15T23:58:20.589 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.589 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-09-15T23:58:20.590 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-09-15T23:58:20.590 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-09-15T23:58:20.590 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-15T23:58:20.590 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:58:20.590 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.590 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-09-15T23:58:20.590 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-09-15T23:58:20.590 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.590 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-09-15T23:58:20.590 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-09-15T23:58:20.590 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:58:20.590 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.590 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-09-15T23:58:20.590 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-09-15T23:58:20.591 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.591 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-09-15T23:58:20.591 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-09-15T23:58:20.591 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-09-15T23:58:20.591 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-09-15T23:58:20.591 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.591 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-09-15T23:58:20.591 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-09-15T23:58:20.591 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.591 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:58:20.591 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.591 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-09-15T23:58:20.591 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.591 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-09-15T23:58:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:58:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-09-15T23:58:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-09-15T23:58:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-09-15T23:58:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-09-15T23:58:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-09-15T23:58:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 20 2024-09-15T23:58:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 20 2024-09-15T23:58:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-09-15T23:58:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 10 2024-09-15T23:58:20.592 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:58:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-09-15T23:58:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:58:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:58:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-09-15T23:58:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-15T23:58:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.593 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-09-15T23:58:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-09-15T23:58:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-15T23:58:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-15T23:58:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:58:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:58:20.593 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-09-15T23:58:20.594 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-15T23:58:20.594 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.594 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-09-15T23:58:20.594 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:20.594 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-15T23:58:20.594 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-09-15T23:58:20.594 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-15T23:58:20.594 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-09-15T23:58:20.594 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-09-15T23:58:20.594 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:58:20.594 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-09-15T23:58:20.594 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-09-15T23:58:20.594 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:58:20.594 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.595 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:58:20.595 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:58:20.595 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:58:20.595 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.595 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:58:20.595 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:58:20.595 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:58:20.595 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.595 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-09-15T23:58:20.595 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:58:20.595 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.595 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:58:20.595 INFO:teuthology.orchestra.run.smithi112.stdout: mon down mkfs grace = 300 2024-09-15T23:58:20.595 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2024-09-15T23:58:20.596 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on pool no app = False 2024-09-15T23:58:20.596 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.596 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-09-15T23:58:20.596 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-09-15T23:58:20.596 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-09-15T23:58:20.596 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-09-15T23:58:20.596 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:58:20.596 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:58:20.596 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2024-09-15T23:58:20.596 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-15T23:58:20.596 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:20.596 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2024-09-15T23:58:20.596 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-15T23:58:20.597 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-15T23:58:20.597 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-09-15T23:58:20.597 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-09-15T23:58:20.597 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-09-15T23:58:20.597 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-15T23:58:20.597 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-09-15T23:58:20.597 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-09-15T23:58:20.597 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-09-15T23:58:20.597 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2024-09-15T23:58:20.597 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2024-09-15T23:58:20.597 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds balancer = 20 2024-09-15T23:58:20.597 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:20.597 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2024-09-15T23:58:20.597 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2024-09-15T23:58:20.598 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2024-09-15T23:58:20.598 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2024-09-15T23:58:20.598 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-15T23:58:20.598 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-15T23:58:20.598 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-15T23:58:20.598 INFO:teuthology.orchestra.run.smithi112.stdout: mds_max_purge_files = 6 2024-09-15T23:58:20.598 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-09-15T23:58:20.599 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-09-15T23:58:20.599 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:58:20.599 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-09-15T23:58:20.599 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.599 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-09-15T23:58:20.599 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.599 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-09-15T23:58:20.599 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.599 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-09-15T23:58:20.599 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-09-15T23:58:20.599 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.599 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-09-15T23:58:20.599 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-09-15T23:58:20.599 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.600 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:58:20.600 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-09-15T23:58:20.600 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.600 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:58:20.600 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:58:20.600 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.600 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-09-15T23:58:20.600 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.600 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-09-15T23:58:20.600 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-09-15T23:58:20.600 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:58:20.600 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:58:20.600 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-09-15T23:58:20.601 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-09-15T23:58:20.602 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-09-15T23:58:20.603 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.604 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-09-15T23:58:20.604 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-09-15T23:58:20.604 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-09-15T23:58:20.604 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-09-15T23:58:20.604 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 20 2024-09-15T23:58:20.604 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 20 2024-09-15T23:58:20.604 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:20.604 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-09-15T23:58:20.604 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 10 2024-09-15T23:58:20.604 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:58:20.604 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-09-15T23:58:20.604 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:58:20.604 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:58:20.604 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-09-15T23:58:20.605 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-15T23:58:20.605 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.605 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-09-15T23:58:20.605 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:20.605 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-09-15T23:58:20.605 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-15T23:58:20.605 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-15T23:58:20.605 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:58:20.605 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:58:20.605 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-09-15T23:58:20.605 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-15T23:58:20.605 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.605 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-09-15T23:58:20.605 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.606 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout: mon down mkfs grace = 300 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on pool no app = False 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-09-15T23:58:20.607 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-09-15T23:58:20.608 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:58:20.608 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:58:20.608 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2024-09-15T23:58:20.608 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-15T23:58:20.608 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:20.608 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = "" 2024-09-15T23:58:20.608 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-15T23:58:20.608 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-15T23:58:20.608 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-09-15T23:58:20.608 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2024-09-15T23:58:20.608 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2024-09-15T23:58:20.608 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-09-15T23:58:20.608 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-09-15T23:58:20.608 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-09-15T23:58:20.609 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-09-15T23:58:20.609 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2024-09-15T23:58:20.609 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2024-09-15T23:58:20.609 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds balancer = 20 2024-09-15T23:58:20.609 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:20.609 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2024-09-15T23:58:20.609 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2024-09-15T23:58:20.609 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2024-09-15T23:58:20.609 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2024-09-15T23:58:20.609 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-15T23:58:20.609 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-15T23:58:20.609 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-15T23:58:20.609 INFO:teuthology.orchestra.run.smithi169.stdout: mds_max_purge_files = 6 2024-09-15T23:58:20.612 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:58:20.653 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:58:20.682 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-15T23:58:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-09-15T23:58:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:58:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-09-15T23:58:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-09-15T23:58:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-09-15T23:58:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-09-15T23:58:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-09-15T23:58:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-09-15T23:58:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-09-15T23:58:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:58:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-09-15T23:58:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:58:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:58:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-09-15T23:58:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-09-15T23:58:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-09-15T23:58:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:58:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:58:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-09-15T23:58:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:58:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-09-15T23:58:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:58:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:58:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-09-15T23:58:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:58:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-09-15T23:58:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-09-15T23:58:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-09-15T23:58:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-09-15T23:58:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-09-15T23:58:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-15T23:58:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:58:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.685 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-09-15T23:58:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-09-15T23:58:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-09-15T23:58:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-09-15T23:58:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:58:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-09-15T23:58:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-09-15T23:58:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-09-15T23:58:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-09-15T23:58:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-09-15T23:58:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-09-15T23:58:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-09-15T23:58:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-09-15T23:58:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:58:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-09-15T23:58:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-09-15T23:58:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:58:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-09-15T23:58:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-09-15T23:58:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-09-15T23:58:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-09-15T23:58:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-09-15T23:58:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 20 2024-09-15T23:58:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 20 2024-09-15T23:58:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-09-15T23:58:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 10 2024-09-15T23:58:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:58:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-09-15T23:58:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:58:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:58:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-09-15T23:58:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-15T23:58:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.688 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-09-15T23:58:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-09-15T23:58:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-15T23:58:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-15T23:58:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:58:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:58:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-09-15T23:58:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-15T23:58:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.689 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-09-15T23:58:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-15T23:58:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-09-15T23:58:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-15T23:58:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-09-15T23:58:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-09-15T23:58:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:58:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-09-15T23:58:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-09-15T23:58:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:58:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:58:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:58:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:58:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:58:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:58:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:58:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-09-15T23:58:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:58:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:58:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: mon down mkfs grace = 300 2024-09-15T23:58:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2024-09-15T23:58:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on pool no app = False 2024-09-15T23:58:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:20.691 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-09-15T23:58:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-09-15T23:58:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-09-15T23:58:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-09-15T23:58:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:58:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:58:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2024-09-15T23:58:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-15T23:58:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2024-09-15T23:58:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-15T23:58:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-15T23:58:20.692 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-09-15T23:58:20.692 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-09-15T23:58:20.692 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-09-15T23:58:20.692 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-15T23:58:20.692 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-09-15T23:58:20.692 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-09-15T23:58:20.692 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-09-15T23:58:20.692 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2024-09-15T23:58:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2024-09-15T23:58:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds balancer = 20 2024-09-15T23:58:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2024-09-15T23:58:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2024-09-15T23:58:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2024-09-15T23:58:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2024-09-15T23:58:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-15T23:58:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-15T23:58:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-15T23:58:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: mds_max_purge_files = 6 2024-09-15T23:58:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: mds_max_purge_ops = 100000000 2024-09-15T23:58:20.695 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-09-15T23:58:20.695 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-09-15T23:58:20.695 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:58:20.695 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-09-15T23:58:20.695 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.695 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-09-15T23:58:20.695 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.695 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-09-15T23:58:20.695 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.695 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-09-15T23:58:20.695 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-09-15T23:58:20.696 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.696 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-09-15T23:58:20.696 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-09-15T23:58:20.696 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.696 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:58:20.696 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-09-15T23:58:20.696 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.696 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:58:20.696 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:58:20.696 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.696 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-09-15T23:58:20.696 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.696 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-09-15T23:58:20.696 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-09-15T23:58:20.697 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:58:20.697 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:58:20.697 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-09-15T23:58:20.697 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:58:20.697 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-09-15T23:58:20.697 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:58:20.697 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:58:20.697 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-09-15T23:58:20.697 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.697 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:58:20.697 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.697 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-09-15T23:58:20.697 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.698 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-09-15T23:58:20.698 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.698 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-09-15T23:58:20.698 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-09-15T23:58:20.698 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-09-15T23:58:20.698 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-15T23:58:20.698 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:58:20.698 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.698 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-09-15T23:58:20.698 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-09-15T23:58:20.698 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.698 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-09-15T23:58:20.698 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-09-15T23:58:20.698 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:58:20.699 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.699 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-09-15T23:58:20.699 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-09-15T23:58:20.699 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.699 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-09-15T23:58:20.699 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-09-15T23:58:20.699 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-09-15T23:58:20.699 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-09-15T23:58:20.699 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.699 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-09-15T23:58:20.699 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-09-15T23:58:20.699 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.699 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:58:20.699 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.700 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-09-15T23:58:20.700 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.700 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-09-15T23:58:20.700 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.700 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:58:20.700 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-09-15T23:58:20.700 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.700 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-09-15T23:58:20.700 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-09-15T23:58:20.700 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-09-15T23:58:20.700 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-09-15T23:58:20.700 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 20 2024-09-15T23:58:20.700 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 20 2024-09-15T23:58:20.700 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:20.701 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-09-15T23:58:20.701 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 10 2024-09-15T23:58:20.701 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:58:20.701 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-09-15T23:58:20.701 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:58:20.701 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:58:20.701 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-09-15T23:58:20.701 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-15T23:58:20.701 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.701 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-09-15T23:58:20.701 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:20.701 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-09-15T23:58:20.701 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-15T23:58:20.701 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-09-15T23:58:20.702 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-09-15T23:58:20.703 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:58:20.703 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.703 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:58:20.703 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:58:20.703 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:58:20.703 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.703 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:58:20.703 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:58:20.703 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:58:20.703 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.703 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-09-15T23:58:20.703 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:58:20.703 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.703 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:58:20.704 INFO:teuthology.orchestra.run.smithi169.stdout: mon down mkfs grace = 300 2024-09-15T23:58:20.704 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2024-09-15T23:58:20.704 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on pool no app = False 2024-09-15T23:58:20.704 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:20.704 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-09-15T23:58:20.704 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-09-15T23:58:20.704 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-09-15T23:58:20.704 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-09-15T23:58:20.704 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:58:20.704 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:58:20.704 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2024-09-15T23:58:20.704 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-15T23:58:20.704 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:20.704 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = "" 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds balancer = 20 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2024-09-15T23:58:20.705 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2024-09-15T23:58:20.706 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2024-09-15T23:58:20.706 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2024-09-15T23:58:20.706 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-15T23:58:20.706 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-15T23:58:20.706 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-15T23:58:20.706 INFO:teuthology.orchestra.run.smithi169.stdout: mds_max_purge_files = 6 2024-09-15T23:58:20.706 INFO:teuthology.orchestra.run.smithi169.stdout: mds_max_purge_ops = 100000000 2024-09-15T23:58:20.706 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T23:58:20.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.865+0000 7f6603f59640 1 Processor -- start 2024-09-15T23:58:20.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.865+0000 7f6603f59640 1 -- start start 2024-09-15T23:58:20.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6603f59640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f65fc1557b0 0x7f65fc0adce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:20.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6603f59640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65fc15c000 0x7f65fc0d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:20.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6603f59640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65fc071f50 con 0x7f65fc0d0340 2024-09-15T23:58:20.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6603f59640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f65fc155b90 con 0x7f65fc1557b0 2024-09-15T23:58:20.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6603f59640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f65fc0d0cf0 con 0x7f65fc15c000 2024-09-15T23:58:20.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6601cf5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f65fc1557b0 0x7f65fc0adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:20.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6601cf5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f65fc1557b0 0x7f65fc0adce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37094/0 (socket says 172.21.15.112:37094) 2024-09-15T23:58:20.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6601cf5640 1 -- 172.21.15.112:0/964426810 learned_addr learned my addr 172.21.15.112:0/964426810 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:20.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6601cf5640 1 -- 172.21.15.112:0/964426810 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65fc15c000 msgr2=0x7f65fc0d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:20.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f66024f6640 1 --2- 172.21.15.112:0/964426810 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65fc15c000 0x7f65fc0d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:20.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6601cf5640 1 --2- 172.21.15.112:0/964426810 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65fc15c000 0x7f65fc0d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:20.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6601cf5640 1 -- 172.21.15.112:0/964426810 >> v1:172.21.15.169:6789/0 conn(0x7f65fc0d0340 legacy=0x7f65fc15b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:20.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6601cf5640 1 -- 172.21.15.112:0/964426810 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc072230 con 0x7f65fc1557b0 2024-09-15T23:58:20.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6601cf5640 1 --2- 172.21.15.112:0/964426810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65fc1557b0 0x7f65fc0adce0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009e50 tx=0x7f65f801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacb5d07ef66b8b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:20.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6600cf3640 1 -- 172.21.15.112:0/964426810 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f80a5670 con 0x7f65fc1557b0 2024-09-15T23:58:20.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6600cf3640 1 -- 172.21.15.112:0/964426810 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f80a5810 con 0x7f65fc1557b0 2024-09-15T23:58:20.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.869+0000 7f6600cf3640 1 -- 172.21.15.112:0/964426810 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f80a5be0 con 0x7f65fc1557b0 2024-09-15T23:58:20.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 -- 172.21.15.112:0/964426810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65fc1557b0 msgr2=0x7f65fc0adce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:20.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 --2- 172.21.15.112:0/964426810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65fc1557b0 0x7f65fc0adce0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009e50 tx=0x7f65f801c9f0 comp rx=0 tx=0).stop 2024-09-15T23:58:20.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 -- 172.21.15.112:0/964426810 shutdown_connections 2024-09-15T23:58:20.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 --2- 172.21.15.112:0/964426810 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65fc15c000 0x7f65fc0d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:20.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 --2- 172.21.15.112:0/964426810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65fc1557b0 0x7f65fc0adce0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:20.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 -- 172.21.15.112:0/964426810 >> 172.21.15.112:0/964426810 conn(0x7f65fc0b2140 msgr2=0x7f65fc0b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:20.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 -- 172.21.15.112:0/964426810 shutdown_connections 2024-09-15T23:58:20.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 -- 172.21.15.112:0/964426810 wait complete. 2024-09-15T23:58:20.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 Processor -- start 2024-09-15T23:58:20.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 -- start start 2024-09-15T23:58:20.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65fc0d0340 0x7f65fc099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:20.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65fc1557b0 0x7f65fc14d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:20.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65fc15c000 0x7f65fc06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:20.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc0738d0 con 0x7f65fc1557b0 2024-09-15T23:58:20.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc073750 con 0x7f65fc0d0340 2024-09-15T23:58:20.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f65fc073a50 con 0x7f65fc15c000 2024-09-15T23:58:20.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f66014f4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65fc1557b0 0x7f65fc14d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:20.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f66014f4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65fc1557b0 0x7f65fc14d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37106/0 (socket says 172.21.15.112:37106) 2024-09-15T23:58:20.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f66014f4640 1 -- 172.21.15.112:0/2034794168 learned_addr learned my addr 172.21.15.112:0/2034794168 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:20.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6601cf5640 1 --2- 172.21.15.112:0/2034794168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65fc0d0340 0x7f65fc099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:20.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f66024f6640 1 --2- 172.21.15.112:0/2034794168 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65fc15c000 0x7f65fc06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:20.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f66014f4640 1 -- 172.21.15.112:0/2034794168 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65fc15c000 msgr2=0x7f65fc06dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:20.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f66014f4640 1 --2- 172.21.15.112:0/2034794168 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65fc15c000 0x7f65fc06dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:20.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f66014f4640 1 -- 172.21.15.112:0/2034794168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65fc0d0340 msgr2=0x7f65fc099900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:20.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f66014f4640 1 --2- 172.21.15.112:0/2034794168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65fc0d0340 0x7f65fc099900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:20.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f66014f4640 1 -- 172.21.15.112:0/2034794168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc153500 con 0x7f65fc1557b0 2024-09-15T23:58:20.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f66014f4640 1 --2- 172.21.15.112:0/2034794168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65fc1557b0 0x7f65fc14d890 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00b410 tx=0x7f65ec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:20.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f65f27fc640 1 -- 172.21.15.112:0/2034794168 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec015030 con 0x7f65fc1557b0 2024-09-15T23:58:20.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f65f27fc640 1 -- 172.21.15.112:0/2034794168 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ec004020 con 0x7f65fc1557b0 2024-09-15T23:58:20.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 -- 172.21.15.112:0/2034794168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65fc099e40 con 0x7f65fc1557b0 2024-09-15T23:58:20.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f65f27fc640 1 -- 172.21.15.112:0/2034794168 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec004450 con 0x7f65fc1557b0 2024-09-15T23:58:20.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.873+0000 7f6603f59640 1 -- 172.21.15.112:0/2034794168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65fc14e610 con 0x7f65fc1557b0 2024-09-15T23:58:20.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.877+0000 7f6603f59640 1 -- 172.21.15.112:0/2034794168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65fc0adce0 con 0x7f65fc1557b0 2024-09-15T23:58:20.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.877+0000 7f65f27fc640 1 -- 172.21.15.112:0/2034794168 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65ec018070 con 0x7f65fc1557b0 2024-09-15T23:58:20.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.877+0000 7f65f27fc640 1 --2- 172.21.15.112:0/2034794168 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f65e00678c0 0x7f65e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:20.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.877+0000 7f65f27fc640 1 -- 172.21.15.112:0/2034794168 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f65ec0859d0 con 0x7f65fc1557b0 2024-09-15T23:58:20.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.877+0000 7f6601cf5640 1 --2- 172.21.15.112:0/2034794168 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f65e00678c0 0x7f65e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:20.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.877+0000 7f6601cf5640 1 --2- 172.21.15.112:0/2034794168 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f65e00678c0 0x7f65e0069d80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f65f80ae000 tx=0x7f65f80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:20.881 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:20.881+0000 7f65f27fc640 1 -- 172.21.15.112:0/2034794168 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f65ec056380 con 0x7f65fc1557b0 2024-09-15T23:58:21.042 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.041+0000 7f6603f59640 1 -- 172.21.15.112:0/2034794168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f65fc14e850 con 0x7f65fc1557b0 2024-09-15T23:58:21.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.041+0000 7f65f27fc640 1 -- 172.21.15.112:0/2034794168 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) ==== 100+0+11 (secure 0 0 0) 0x7f65ec055c80 con 0x7f65fc1557b0 2024-09-15T23:58:21.043 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 64 2024-09-15T23:58:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.045+0000 7f6603f59640 1 -- 172.21.15.112:0/2034794168 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f65e00678c0 msgr2=0x7f65e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.045+0000 7f6603f59640 1 --2- 172.21.15.112:0/2034794168 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f65e00678c0 0x7f65e0069d80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f65f80ae000 tx=0x7f65f80a7070 comp rx=0 tx=0).stop 2024-09-15T23:58:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.045+0000 7f6603f59640 1 -- 172.21.15.112:0/2034794168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65fc1557b0 msgr2=0x7f65fc14d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.045+0000 7f6603f59640 1 --2- 172.21.15.112:0/2034794168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65fc1557b0 0x7f65fc14d890 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00b410 tx=0x7f65ec00b8d0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.045+0000 7f6603f59640 1 -- 172.21.15.112:0/2034794168 shutdown_connections 2024-09-15T23:58:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.045+0000 7f6603f59640 1 --2- 172.21.15.112:0/2034794168 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f65e00678c0 0x7f65e0069d80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.045+0000 7f6603f59640 1 --2- 172.21.15.112:0/2034794168 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65fc15c000 0x7f65fc06dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.045+0000 7f6603f59640 1 --2- 172.21.15.112:0/2034794168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65fc1557b0 0x7f65fc14d890 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.045+0000 7f6603f59640 1 --2- 172.21.15.112:0/2034794168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65fc0d0340 0x7f65fc099900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.045+0000 7f6603f59640 1 -- 172.21.15.112:0/2034794168 >> 172.21.15.112:0/2034794168 conn(0x7f65fc0b2140 msgr2=0x7f65fc0ae3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.045+0000 7f6603f59640 1 -- 172.21.15.112:0/2034794168 shutdown_connections 2024-09-15T23:58:21.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.045+0000 7f6603f59640 1 -- 172.21.15.112:0/2034794168 wait complete. 2024-09-15T23:58:21.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:58:21.065 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:58:21.088 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-15T23:58:21.088 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-09-15T23:58:21.088 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:58:21.088 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-09-15T23:58:21.088 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.088 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-09-15T23:58:21.088 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.088 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-09-15T23:58:21.089 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.089 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-09-15T23:58:21.089 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-09-15T23:58:21.089 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.089 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-09-15T23:58:21.089 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-09-15T23:58:21.089 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.089 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:58:21.089 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-09-15T23:58:21.089 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.089 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:58:21.089 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:58:21.089 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.089 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.090 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-09-15T23:58:21.091 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.091 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-09-15T23:58:21.091 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.091 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-09-15T23:58:21.091 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-09-15T23:58:21.091 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-09-15T23:58:21.091 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-15T23:58:21.091 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:58:21.091 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.091 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-09-15T23:58:21.091 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-09-15T23:58:21.091 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.091 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-09-15T23:58:21.091 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-09-15T23:58:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:58:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-09-15T23:58:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-09-15T23:58:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-09-15T23:58:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-09-15T23:58:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-09-15T23:58:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-09-15T23:58:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-09-15T23:58:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-09-15T23:58:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.092 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 20 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 20 2024-09-15T23:58:21.093 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:21.094 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-09-15T23:58:21.094 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 10 2024-09-15T23:58:21.094 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:58:21.094 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-09-15T23:58:21.094 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:58:21.094 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:58:21.094 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-09-15T23:58:21.094 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-15T23:58:21.094 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.094 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-09-15T23:58:21.094 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:21.094 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-09-15T23:58:21.094 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-15T23:58:21.094 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-15T23:58:21.095 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:58:21.095 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:58:21.095 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-09-15T23:58:21.095 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-15T23:58:21.095 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.095 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-09-15T23:58:21.095 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:21.095 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-15T23:58:21.095 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-09-15T23:58:21.095 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-15T23:58:21.095 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-09-15T23:58:21.095 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-09-15T23:58:21.095 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:58:21.095 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-09-15T23:58:21.096 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-09-15T23:58:21.096 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:58:21.096 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.096 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:58:21.096 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:58:21.096 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:58:21.096 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.096 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:58:21.096 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:58:21.096 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:58:21.096 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.096 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-09-15T23:58:21.096 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:58:21.096 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.097 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:58:21.097 INFO:teuthology.orchestra.run.smithi112.stdout: mon down mkfs grace = 300 2024-09-15T23:58:21.097 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2024-09-15T23:58:21.097 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on pool no app = False 2024-09-15T23:58:21.097 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:21.097 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-09-15T23:58:21.097 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-09-15T23:58:21.097 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-09-15T23:58:21.097 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-09-15T23:58:21.097 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:58:21.097 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:58:21.097 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2024-09-15T23:58:21.097 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-15T23:58:21.097 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds balancer = 20 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2024-09-15T23:58:21.098 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2024-09-15T23:58:21.099 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2024-09-15T23:58:21.099 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2024-09-15T23:58:21.099 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-15T23:58:21.099 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-15T23:58:21.099 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-15T23:58:21.099 INFO:teuthology.orchestra.run.smithi112.stdout: mds_max_purge_files = 6 2024-09-15T23:58:21.099 INFO:teuthology.orchestra.run.smithi112.stdout: mds_max_purge_ops = 100000000 2024-09-15T23:58:21.099 INFO:teuthology.orchestra.run.smithi112.stdout: mds_max_purge_ops_per_pg = 1562500.0 2024-09-15T23:58:21.100 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-09-15T23:58:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-09-15T23:58:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:58:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-09-15T23:58:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-09-15T23:58:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-09-15T23:58:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-09-15T23:58:21.100 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-09-15T23:58:21.101 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-09-15T23:58:21.102 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.103 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:58:21.104 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-09-15T23:58:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-09-15T23:58:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-09-15T23:58:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-09-15T23:58:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-09-15T23:58:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 20 2024-09-15T23:58:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 20 2024-09-15T23:58:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-09-15T23:58:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 10 2024-09-15T23:58:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:58:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-09-15T23:58:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:58:21.105 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:58:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-09-15T23:58:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-15T23:58:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.106 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-09-15T23:58:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-09-15T23:58:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-15T23:58:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-15T23:58:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:58:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:58:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-09-15T23:58:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-15T23:58:21.106 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:58:21.107 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: mon down mkfs grace = 300 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on pool no app = False 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = "" 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2024-09-15T23:58:21.109 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds balancer = 20 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-15T23:58:21.110 INFO:teuthology.orchestra.run.smithi169.stdout: mds_max_purge_files = 6 2024-09-15T23:58:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: mds_max_purge_ops = 100000000 2024-09-15T23:58:21.111 INFO:teuthology.orchestra.run.smithi169.stdout: mds_max_purge_ops_per_pg = 1562500.0 2024-09-15T23:58:21.112 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:58:21.112 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:21.113 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:58:21.113 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:21.113 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:58:21.113 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:21.113 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:58:21.113 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:21.173 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:58:21.174 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-15T23:58:21.175 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:58:21.175 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-15T23:58:21.176 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:58:21.176 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-15T23:58:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f0f5035c640 1 Processor -- start 2024-09-15T23:58:21.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f687178f640 1 Processor -- start 2024-09-15T23:58:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f0f5035c640 1 -- start start 2024-09-15T23:58:21.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f2e02cad640 1 Processor -- start 2024-09-15T23:58:21.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f687178f640 1 -- start start 2024-09-15T23:58:21.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f2e02cad640 1 -- start start 2024-09-15T23:58:21.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f0f5035c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0f4806c6a0 0x7f0f4806cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f2e02cad640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2dfc0b2a70 0x7f2dfc15c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f687178f640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f686c072090 0x7f686c0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f687178f640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f686c0b4e20 con 0x7f686c15b2b0 2024-09-15T23:58:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f687178f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f686c0b5100 con 0x7f686c06e270 2024-09-15T23:58:21.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f687178f640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f686c0b53e0 con 0x7f686c072090 2024-09-15T23:58:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f0f5035c640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f480b76e0 con 0x7f0f4815f2e0 2024-09-15T23:58:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f0f5035c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4806d3d0 con 0x7f0f4815e860 2024-09-15T23:58:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.329+0000 7f0f5035c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f0f4806d020 con 0x7f0f4806c6a0 2024-09-15T23:58:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4e8f9640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f0f4815f2e0 0x7f0f4815f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59372/0 (socket says 172.21.15.112:59372) 2024-09-15T23:58:21.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4e8f9640 1 -- 172.21.15.112:0/2629058008 learned_addr learned my addr 172.21.15.112:0/2629058008 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f6863fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f686c072090 0x7f686c0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2e02cad640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dfc15dfd0 con 0x7f2dfc075740 2024-09-15T23:58:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2e0124a640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2dfc075740 0x7f2dfc15f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59384/0 (socket says 172.21.15.112:59384) 2024-09-15T23:58:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2e0124a640 1 -- 172.21.15.112:0/4221125994 learned_addr learned my addr 172.21.15.112:0/4221125994 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2e02cad640 1 -- 172.21.15.112:0/4221125994 --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dfc15e2b0 con 0x7f2dfc15c5e0 2024-09-15T23:58:21.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2e02cad640 1 -- 172.21.15.112:0/4221125994 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2dfc15e590 con 0x7f2dfc0b2a70 2024-09-15T23:58:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f6863fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f686c072090 0x7f686c0b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37108/0 (socket says 172.21.15.112:37108) 2024-09-15T23:58:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f6863fff640 1 -- 172.21.15.112:0/533472413 learned_addr learned my addr 172.21.15.112:0/533472413 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d8f7640 1 --2- 172.21.15.112:0/2629058008 >> v2:172.21.15.169:3300/0 conn(0x7f0f4806c6a0 0x7f0f4806cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2dfbfff640 1 --2- 172.21.15.112:0/4221125994 >> v2:172.21.15.169:3300/0 conn(0x7f2dfc0b2a70 0x7f2dfc15c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f6863fff640 1 -- 172.21.15.112:0/533472413 >> v1:172.21.15.169:6789/0 conn(0x7f686c06e270 legacy=0x7f686c06e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:21.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f6863fff640 1 -- 172.21.15.112:0/533472413 >> v1:172.21.15.112:6789/0 conn(0x7f686c15b2b0 legacy=0x7f686c0b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:21.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 -- 172.21.15.112:0/2629058008 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 817294094 0 0) 0x7f0f480b76e0 con 0x7f0f4815f2e0 2024-09-15T23:58:21.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 -- 172.21.15.112:0/2629058008 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f30003530 con 0x7f0f4815f2e0 2024-09-15T23:58:21.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2dfb7fe640 1 -- 172.21.15.112:0/4221125994 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3293828797 0 0) 0x7f2dfc15dfd0 con 0x7f2dfc075740 2024-09-15T23:58:21.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2dfb7fe640 1 -- 172.21.15.112:0/4221125994 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dec003530 con 0x7f2dfc075740 2024-09-15T23:58:21.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f6863fff640 1 -- 172.21.15.112:0/533472413 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c0b56c0 con 0x7f686c072090 2024-09-15T23:58:21.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 -- 172.21.15.112:0/2629058008 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1422277540 0 0) 0x7f0f30003530 con 0x7f0f4815f2e0 2024-09-15T23:58:21.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 -- 172.21.15.112:0/2629058008 >> v2:172.21.15.169:3300/0 conn(0x7f0f4806c6a0 msgr2=0x7f0f4806cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:21.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 --2- 172.21.15.112:0/2629058008 >> v2:172.21.15.169:3300/0 conn(0x7f0f4806c6a0 0x7f0f4806cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2dfbfff640 1 -- 172.21.15.112:0/4221125994 >> v1:172.21.15.169:6789/0 conn(0x7f2dfc15c5e0 legacy=0x7f2dfc075030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2dfbfff640 1 -- 172.21.15.112:0/4221125994 >> v1:172.21.15.112:6789/0 conn(0x7f2dfc075740 legacy=0x7f2dfc15f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 -- 172.21.15.112:0/2629058008 >> v1:172.21.15.169:6789/0 conn(0x7f0f4815e860 legacy=0x7f0f480b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 -- 172.21.15.112:0/2629058008 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f480b6b60 con 0x7f0f4815f2e0 2024-09-15T23:58:21.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 -- 172.21.15.112:0/2629058008 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f0f40001680 con 0x7f0f4815f2e0 2024-09-15T23:58:21.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 -- 172.21.15.112:0/2629058008 >> v1:172.21.15.112:6789/0 conn(0x7f0f4815f2e0 legacy=0x7f0f4815f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.341 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2dfbfff640 1 -- 172.21.15.112:0/4221125994 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dfc15e870 con 0x7f2dfc0b2a70 2024-09-15T23:58:21.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 --2- 172.21.15.112:0/2629058008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f300039c0 0x7f0f30003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 --2- 172.21.15.112:0/2629058008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f30004810 0x7f0f30004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 --2- 172.21.15.112:0/2629058008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f300051d0 0x7f0f3000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 -- 172.21.15.112:0/2629058008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4806d020 con 0x7f0f300039c0 2024-09-15T23:58:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 -- 172.21.15.112:0/2629058008 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3000c0d0 con 0x7f0f30004810 2024-09-15T23:58:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d0f6640 1 -- 172.21.15.112:0/2629058008 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3000c2d0 con 0x7f0f300051d0 2024-09-15T23:58:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4e0f8640 1 --2- 172.21.15.112:0/2629058008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f300039c0 0x7f0f30003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d8f7640 1 --2- 172.21.15.112:0/2629058008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f30004810 0x7f0f30004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4e8f9640 1 --2- 172.21.15.112:0/2629058008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f300051d0 0x7f0f3000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4e0f8640 1 -- 172.21.15.112:0/2629058008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f300051d0 msgr2=0x7f0f3000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4e0f8640 1 --2- 172.21.15.112:0/2629058008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f300051d0 0x7f0f3000b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4e0f8640 1 -- 172.21.15.112:0/2629058008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f30004810 msgr2=0x7f0f30004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4e0f8640 1 --2- 172.21.15.112:0/2629058008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f30004810 0x7f0f30004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4e0f8640 1 -- 172.21.15.112:0/2629058008 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f480b6b60 con 0x7f0f300039c0 2024-09-15T23:58:21.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4e8f9640 1 -- 172.21.15.112:0/2629058008 reap_dead start 2024-09-15T23:58:21.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f0f4d8f7640 1 --2- 172.21.15.112:0/2629058008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f30004810 0x7f0f30004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:58:21.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2dfbfff640 1 --2- 172.21.15.112:0/4221125994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dfc0b2a70 0x7f2dfc15c9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2de80097c0 tx=0x7f2de801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29953edf6451390f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:21.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2dfb7fe640 1 -- 172.21.15.112:0/4221125994 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de80b5070 con 0x7f2dfc0b2a70 2024-09-15T23:58:21.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2dfb7fe640 1 -- 172.21.15.112:0/4221125994 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de80a8990 con 0x7f2dfc0b2a70 2024-09-15T23:58:21.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f2dfb7fe640 1 -- 172.21.15.112:0/4221125994 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de80a8d40 con 0x7f2dfc0b2a70 2024-09-15T23:58:21.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f6863fff640 1 --2- 172.21.15.112:0/533472413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c072090 0x7f686c0b4760 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f6854009870 tx=0x7f685401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c597932cae23ab88 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:21.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.333+0000 7f686a7fc640 1 -- 172.21.15.112:0/533472413 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68540ab680 con 0x7f686c072090 2024-09-15T23:58:21.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f686a7fc640 1 -- 172.21.15.112:0/533472413 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68540b0070 con 0x7f686c072090 2024-09-15T23:58:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f686a7fc640 1 -- 172.21.15.112:0/533472413 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68540aba40 con 0x7f686c072090 2024-09-15T23:58:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 -- 172.21.15.112:0/4221125994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dfc0b2a70 msgr2=0x7f2dfc15c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 --2- 172.21.15.112:0/4221125994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dfc0b2a70 0x7f2dfc15c9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2de80097c0 tx=0x7f2de801ec90 comp rx=0 tx=0).stop 2024-09-15T23:58:21.346 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 -- 172.21.15.112:0/4221125994 shutdown_connections 2024-09-15T23:58:21.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 --2- 172.21.15.112:0/4221125994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dfc0b2a70 0x7f2dfc15c9c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 -- 172.21.15.112:0/4221125994 >> 172.21.15.112:0/4221125994 conn(0x7f2dfc0b2e70 msgr2=0x7f2dfc0b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:21.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 -- 172.21.15.112:0/4221125994 shutdown_connections 2024-09-15T23:58:21.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 -- 172.21.15.112:0/4221125994 wait complete. 2024-09-15T23:58:21.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f0f4e0f8640 1 --2- 172.21.15.112:0/2629058008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f300039c0 0x7f0f30003de0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0f38001e70 tx=0x7f0f3801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52c9bec52b230f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:21.347 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f0f4d0f6640 1 -- 172.21.15.112:0/2629058008 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f380b0070 con 0x7f0f300039c0 2024-09-15T23:58:21.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f0f4d0f6640 1 -- 172.21.15.112:0/2629058008 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f380a7070 con 0x7f0f300039c0 2024-09-15T23:58:21.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f0f4d0f6640 1 -- 172.21.15.112:0/2629058008 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38001a90 con 0x7f0f300039c0 2024-09-15T23:58:21.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 -- 172.21.15.112:0/533472413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c072090 msgr2=0x7f686c0b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 --2- 172.21.15.112:0/533472413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c072090 0x7f686c0b4760 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f6854009870 tx=0x7f685401c460 comp rx=0 tx=0).stop 2024-09-15T23:58:21.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 -- 172.21.15.112:0/533472413 shutdown_connections 2024-09-15T23:58:21.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 --2- 172.21.15.112:0/533472413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c072090 0x7f686c0b4760 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 -- 172.21.15.112:0/533472413 >> 172.21.15.112:0/533472413 conn(0x7f686c0b3110 msgr2=0x7f686c0b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:21.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 -- 172.21.15.112:0/533472413 shutdown_connections 2024-09-15T23:58:21.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 -- 172.21.15.112:0/533472413 wait complete. 2024-09-15T23:58:21.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f0f5035c640 1 -- 172.21.15.112:0/2629058008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f300039c0 msgr2=0x7f0f30003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f0f5035c640 1 --2- 172.21.15.112:0/2629058008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f300039c0 0x7f0f30003de0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0f38001e70 tx=0x7f0f3801c760 comp rx=0 tx=0).stop 2024-09-15T23:58:21.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f0f5035c640 1 -- 172.21.15.112:0/2629058008 shutdown_connections 2024-09-15T23:58:21.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f0f5035c640 1 --2- 172.21.15.112:0/2629058008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f300039c0 0x7f0f30003de0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f0f5035c640 1 -- 172.21.15.112:0/2629058008 >> 172.21.15.112:0/2629058008 conn(0x7f0f48073620 msgr2=0x7f0f4809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:21.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f0f5035c640 1 -- 172.21.15.112:0/2629058008 shutdown_connections 2024-09-15T23:58:21.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f0f5035c640 1 -- 172.21.15.112:0/2629058008 wait complete. 2024-09-15T23:58:21.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 Processor -- start 2024-09-15T23:58:21.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 -- start start 2024-09-15T23:58:21.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 Processor -- start 2024-09-15T23:58:21.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 -- start start 2024-09-15T23:58:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dfc075740 0x7f2dfc159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dfc0b2a70 0x7f2dfc1fb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dfc15c5e0 0x7f2dfc0b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc15db90 con 0x7f2dfc075740 2024-09-15T23:58:21.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc15da10 con 0x7f2dfc15c5e0 2024-09-15T23:58:21.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e02cad640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2dfc15dd10 con 0x7f2dfc0b2a70 2024-09-15T23:58:21.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e00a49640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dfc075740 0x7f2dfc159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e00a49640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dfc075740 0x7f2dfc159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37126/0 (socket says 172.21.15.112:37126) 2024-09-15T23:58:21.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e00a49640 1 -- 172.21.15.112:0/1454613764 learned_addr learned my addr 172.21.15.112:0/1454613764 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:21.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e0124a640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dfc15c5e0 0x7f2dfc0b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c06e270 0x7f686c15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f0f5035c640 1 Processor -- start 2024-09-15T23:58:21.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e00a49640 1 -- 172.21.15.112:0/1454613764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dfc0b2a70 msgr2=0x7f2dfc1fb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2dfbfff640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dfc0b2a70 0x7f2dfc1fb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f686affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c06e270 0x7f686c15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e00a49640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dfc0b2a70 0x7f2dfc1fb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e00a49640 1 -- 172.21.15.112:0/1454613764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dfc15c5e0 msgr2=0x7f2dfc0b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e00a49640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dfc15c5e0 0x7f2dfc0b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e00a49640 1 -- 172.21.15.112:0/1454613764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dfc0b0530 con 0x7f2dfc075740 2024-09-15T23:58:21.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f686c072090 0x7f686c145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f686affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c06e270 0x7f686c15c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37140/0 (socket says 172.21.15.112:37140) 2024-09-15T23:58:21.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f686affd640 1 -- 172.21.15.112:0/3664850365 learned_addr learned my addr 172.21.15.112:0/3664850365 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e0124a640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dfc15c5e0 0x7f2dfc0b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:58:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2dfbfff640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dfc0b2a70 0x7f2dfc1fb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f686c15b2b0 0x7f686c15dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 -- 172.21.15.112:0/3664850365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f686c15c020 con 0x7f686c06e270 2024-09-15T23:58:21.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 -- 172.21.15.112:0/3664850365 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f686c15bea0 con 0x7f686c15b2b0 2024-09-15T23:58:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f687178f640 1 -- 172.21.15.112:0/3664850365 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f686c075030 con 0x7f686c072090 2024-09-15T23:58:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2e00a49640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dfc075740 0x7f2dfc159030 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f2df000c3a0 tx=0x7f2df000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f0f5035c640 1 -- start start 2024-09-15T23:58:21.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f6863fff640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f686c072090 0x7f686c145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f686b7fe640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f686c15b2b0 0x7f686c15dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.337+0000 7f2df97fa640 1 -- 172.21.15.112:0/1454613764 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df00052d0 con 0x7f2dfc075740 2024-09-15T23:58:21.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f686affd640 1 -- 172.21.15.112:0/3664850365 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f686c072090 msgr2=0x7f686c145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f686affd640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f686c072090 0x7f686c145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f686affd640 1 -- 172.21.15.112:0/3664850365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f686c15b2b0 msgr2=0x7f686c15dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f686affd640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f686c15b2b0 0x7f686c15dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f686affd640 1 -- 172.21.15.112:0/3664850365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c15e2d0 con 0x7f686c06e270 2024-09-15T23:58:21.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f2df97fa640 1 -- 172.21.15.112:0/1454613764 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df0005470 con 0x7f2dfc075740 2024-09-15T23:58:21.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f2df97fa640 1 -- 172.21.15.112:0/1454613764 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df0007260 con 0x7f2dfc075740 2024-09-15T23:58:21.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f2e02cad640 1 -- 172.21.15.112:0/1454613764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dfc0b0810 con 0x7f2dfc075740 2024-09-15T23:58:21.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f2e02cad640 1 -- 172.21.15.112:0/1454613764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dfc0b0dd0 con 0x7f2dfc075740 2024-09-15T23:58:21.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f686affd640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c06e270 0x7f686c15c1a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f685c00c370 tx=0x7f685c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:21.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f68637fe640 1 -- 172.21.15.112:0/3664850365 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0052d0 con 0x7f686c06e270 2024-09-15T23:58:21.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f68637fe640 1 -- 172.21.15.112:0/3664850365 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f685c005470 con 0x7f686c06e270 2024-09-15T23:58:21.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f687178f640 1 -- 172.21.15.112:0/3664850365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686c15c780 con 0x7f686c06e270 2024-09-15T23:58:21.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f68637fe640 1 -- 172.21.15.112:0/3664850365 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c007260 con 0x7f686c06e270 2024-09-15T23:58:21.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f687178f640 1 -- 172.21.15.112:0/3664850365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f686c15cd40 con 0x7f686c06e270 2024-09-15T23:58:21.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f2e02cad640 1 -- 172.21.15.112:0/1454613764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dfc15c9c0 con 0x7f2dfc075740 2024-09-15T23:58:21.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f5035c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f300039c0 0x7f0f48154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f5035c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f48162a20 0x7f0f481f76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f5035c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481f7c10 0x7f0f48150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f687178f640 1 -- 172.21.15.112:0/3664850365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f686c0b4760 con 0x7f686c06e270 2024-09-15T23:58:21.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f5035c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4815ec40 con 0x7f0f481f7c10 2024-09-15T23:58:21.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f5035c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4815edc0 con 0x7f0f48162a20 2024-09-15T23:58:21.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f5035c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0f480d20a0 con 0x7f0f300039c0 2024-09-15T23:58:21.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f2df97fa640 1 -- 172.21.15.112:0/1454613764 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2df0007400 con 0x7f2dfc075740 2024-09-15T23:58:21.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f4e0f8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f300039c0 0x7f0f48154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f4d8f7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f48162a20 0x7f0f481f76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f4e0f8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f300039c0 0x7f0f48154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:50550/0 (socket says 172.21.15.112:50550) 2024-09-15T23:58:21.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f4d8f7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f48162a20 0x7f0f481f76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:35436/0 (socket says 172.21.15.112:35436) 2024-09-15T23:58:21.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f4e0f8640 1 -- 172.21.15.112:0/1488338452 learned_addr learned my addr 172.21.15.112:0/1488338452 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:21.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f4e8f9640 1 --2- 172.21.15.112:0/1488338452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481f7c10 0x7f0f48150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f2df97fa640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2de00678c0 0x7f2de0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f2df97fa640 1 -- 172.21.15.112:0/1454613764 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f2df0085200 con 0x7f2dfc075740 2024-09-15T23:58:21.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f4e8f9640 1 -- 172.21.15.112:0/1488338452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f300039c0 msgr2=0x7f0f48154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f4e8f9640 1 --2- 172.21.15.112:0/1488338452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f300039c0 0x7f0f48154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f4e8f9640 1 -- 172.21.15.112:0/1488338452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f48162a20 msgr2=0x7f0f481f76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:21.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f4e8f9640 1 --2- 172.21.15.112:0/1488338452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f48162a20 0x7f0f481f76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:21.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f4e8f9640 1 -- 172.21.15.112:0/1488338452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f481555a0 con 0x7f0f481f7c10 2024-09-15T23:58:21.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f2dfbfff640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2de00678c0 0x7f2de0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f0f4e8f9640 1 --2- 172.21.15.112:0/1488338452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481f7c10 0x7f0f48150630 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f0f480b34a0 tx=0x7f0f4000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:21.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f68637fe640 1 -- 172.21.15.112:0/3664850365 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f685c007400 con 0x7f686c06e270 2024-09-15T23:58:21.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f2dfbfff640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2de00678c0 0x7f2de0069d80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2de80b2000 tx=0x7f2de8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:21.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f68637fe640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f684c0678c0 0x7f684c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f6863fff640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f684c0678c0 0x7f684c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.341+0000 7f68637fe640 1 -- 172.21.15.112:0/3664850365 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f685c085a60 con 0x7f686c06e270 2024-09-15T23:58:21.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.345+0000 7f6863fff640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f684c0678c0 0x7f684c069d80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f68540af000 tx=0x7f68540a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:21.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.345+0000 7f2df97fa640 1 -- 172.21.15.112:0/1454613764 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2df0055c40 con 0x7f2dfc075740 2024-09-15T23:58:21.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.349+0000 7f0f46ffd640 1 -- 172.21.15.112:0/1488338452 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40019070 con 0x7f0f481f7c10 2024-09-15T23:58:21.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.349+0000 7f0f46ffd640 1 -- 172.21.15.112:0/1488338452 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f40007270 con 0x7f0f481f7c10 2024-09-15T23:58:21.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.349+0000 7f0f46ffd640 1 -- 172.21.15.112:0/1488338452 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40007660 con 0x7f0f481f7c10 2024-09-15T23:58:21.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.349+0000 7f0f5035c640 1 -- 172.21.15.112:0/1488338452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f48155880 con 0x7f0f481f7c10 2024-09-15T23:58:21.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.349+0000 7f0f5035c640 1 -- 172.21.15.112:0/1488338452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f48155e40 con 0x7f0f481f7c10 2024-09-15T23:58:21.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.349+0000 7f68637fe640 1 -- 172.21.15.112:0/3664850365 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f685c0564f0 con 0x7f686c06e270 2024-09-15T23:58:21.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.353+0000 7f0f5035c640 1 -- 172.21.15.112:0/1488338452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f480d2430 con 0x7f0f481f7c10 2024-09-15T23:58:21.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.353+0000 7f0f46ffd640 1 -- 172.21.15.112:0/1488338452 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f400047f0 con 0x7f0f481f7c10 2024-09-15T23:58:21.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.353+0000 7f0f46ffd640 1 --2- 172.21.15.112:0/1488338452 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0f340678f0 0x7f0f34069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:21.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.353+0000 7f0f46ffd640 1 -- 172.21.15.112:0/1488338452 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f0f400854d0 con 0x7f0f481f7c10 2024-09-15T23:58:21.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.353+0000 7f0f4e0f8640 1 --2- 172.21.15.112:0/1488338452 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0f340678f0 0x7f0f34069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:21.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.353+0000 7f0f4e0f8640 1 --2- 172.21.15.112:0/1488338452 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0f340678f0 0x7f0f34069db0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0f38001e70 tx=0x7f0f38001520 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:21.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.361+0000 7f0f46ffd640 1 -- 172.21.15.112:0/1488338452 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0f40055790 con 0x7f0f481f7c10 2024-09-15T23:58:21.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.569+0000 7f2e02cad640 1 -- 172.21.15.112:0/1454613764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f2dfc159570 con 0x7f2dfc075740 2024-09-15T23:58:21.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.577+0000 7f687178f640 1 -- 172.21.15.112:0/3664850365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f686c154180 con 0x7f686c06e270 2024-09-15T23:58:21.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:21.585+0000 7f0f5035c640 1 -- 172.21.15.112:0/1488338452 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f0f4815e090 con 0x7f0f481f7c10 2024-09-15T23:58:22.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:22.393+0000 7f2df97fa640 1 -- 172.21.15.112:0/1454613764 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5593 v56) ==== 95+0+0 (secure 0 0 0) 0x7f2df0055540 con 0x7f2dfc075740 2024-09-15T23:58:22.396 INFO:teuthology.orchestra.run.smithi112.stderr:failed mds gid 5593 2024-09-15T23:58:22.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:22.397+0000 7f2e02cad640 1 -- 172.21.15.112:0/1454613764 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2de00678c0 msgr2=0x7f2de0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:22.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:22.397+0000 7f2e02cad640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2de00678c0 0x7f2de0069d80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2de80b2000 tx=0x7f2de8008040 comp rx=0 tx=0).stop 2024-09-15T23:58:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:22.397+0000 7f2e02cad640 1 -- 172.21.15.112:0/1454613764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dfc075740 msgr2=0x7f2dfc159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:22.397+0000 7f2e02cad640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dfc075740 0x7f2dfc159030 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f2df000c3a0 tx=0x7f2df000c860 comp rx=0 tx=0).stop 2024-09-15T23:58:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:22.397+0000 7f2e02cad640 1 -- 172.21.15.112:0/1454613764 shutdown_connections 2024-09-15T23:58:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:22.397+0000 7f2e02cad640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2de00678c0 0x7f2de0069d80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:22.397+0000 7f2e02cad640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dfc15c5e0 0x7f2dfc0b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:22.397+0000 7f2e02cad640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2dfc0b2a70 0x7f2dfc1fb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:22.397+0000 7f2e02cad640 1 --2- 172.21.15.112:0/1454613764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dfc075740 0x7f2dfc159030 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:22.397+0000 7f2e02cad640 1 -- 172.21.15.112:0/1454613764 >> 172.21.15.112:0/1454613764 conn(0x7f2dfc0b2e70 msgr2=0x7f2dfc0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:22.397+0000 7f2e02cad640 1 -- 172.21.15.112:0/1454613764 shutdown_connections 2024-09-15T23:58:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:22.397+0000 7f2e02cad640 1 -- 172.21.15.112:0/1454613764 wait complete. 2024-09-15T23:58:22.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-15T23:58:22.425 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:58:22.425 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:58:22.427 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:58:22.428 DEBUG:teuthology.parallel:result is None 2024-09-15T23:58:22.501 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-15T23:58:23.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.397+0000 7f68637fe640 1 -- 172.21.15.112:0/3664850365 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5587 v57) ==== 95+0+0 (secure 0 0 0) 0x7f685c055df0 con 0x7f686c06e270 2024-09-15T23:58:23.398 INFO:teuthology.orchestra.run.smithi112.stderr:failed mds gid 5587 2024-09-15T23:58:23.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.397+0000 7f0f46ffd640 1 -- 172.21.15.112:0/1488338452 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6708 v57) ==== 95+0+0 (secure 0 0 0) 0x7f0f40059a90 con 0x7f0f481f7c10 2024-09-15T23:58:23.398 INFO:teuthology.orchestra.run.smithi112.stderr:failed mds gid 6708 2024-09-15T23:58:23.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f687178f640 1 -- 172.21.15.112:0/3664850365 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f684c0678c0 msgr2=0x7f684c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:23.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f687178f640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f684c0678c0 0x7f684c069d80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f68540af000 tx=0x7f68540a7000 comp rx=0 tx=0).stop 2024-09-15T23:58:23.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f687178f640 1 -- 172.21.15.112:0/3664850365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c06e270 msgr2=0x7f686c15c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:23.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f687178f640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c06e270 0x7f686c15c1a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f685c00c370 tx=0x7f685c00c830 comp rx=0 tx=0).stop 2024-09-15T23:58:23.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f687178f640 1 -- 172.21.15.112:0/3664850365 shutdown_connections 2024-09-15T23:58:23.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f687178f640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f684c0678c0 0x7f684c069d80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:23.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f687178f640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f686c15b2b0 0x7f686c15dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:23.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f687178f640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f686c072090 0x7f686c145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:23.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f687178f640 1 --2- 172.21.15.112:0/3664850365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f686c06e270 0x7f686c15c1a0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:23.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f687178f640 1 -- 172.21.15.112:0/3664850365 >> 172.21.15.112:0/3664850365 conn(0x7f686c0b3110 msgr2=0x7f686c072700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:23.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f687178f640 1 -- 172.21.15.112:0/3664850365 shutdown_connections 2024-09-15T23:58:23.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f687178f640 1 -- 172.21.15.112:0/3664850365 wait complete. 2024-09-15T23:58:23.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f0f5035c640 1 -- 172.21.15.112:0/1488338452 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0f340678f0 msgr2=0x7f0f34069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:23.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f0f5035c640 1 --2- 172.21.15.112:0/1488338452 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0f340678f0 0x7f0f34069db0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0f38001e70 tx=0x7f0f38001520 comp rx=0 tx=0).stop 2024-09-15T23:58:23.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f0f5035c640 1 -- 172.21.15.112:0/1488338452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481f7c10 msgr2=0x7f0f48150630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:23.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f0f5035c640 1 --2- 172.21.15.112:0/1488338452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481f7c10 0x7f0f48150630 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f0f480b34a0 tx=0x7f0f4000dc00 comp rx=0 tx=0).stop 2024-09-15T23:58:23.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f0f5035c640 1 -- 172.21.15.112:0/1488338452 shutdown_connections 2024-09-15T23:58:23.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f0f5035c640 1 --2- 172.21.15.112:0/1488338452 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0f340678f0 0x7f0f34069db0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:23.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f0f5035c640 1 --2- 172.21.15.112:0/1488338452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f481f7c10 0x7f0f48150630 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:23.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f0f5035c640 1 --2- 172.21.15.112:0/1488338452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f48162a20 0x7f0f481f76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:23.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f0f5035c640 1 --2- 172.21.15.112:0/1488338452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f300039c0 0x7f0f48154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:23.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f0f5035c640 1 -- 172.21.15.112:0/1488338452 >> 172.21.15.112:0/1488338452 conn(0x7f0f48073620 msgr2=0x7f0f48070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:23.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f0f5035c640 1 -- 172.21.15.112:0/1488338452 shutdown_connections 2024-09-15T23:58:23.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:23.401+0000 7f0f5035c640 1 -- 172.21.15.112:0/1488338452 wait complete. 2024-09-15T23:58:23.423 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:58:23.424 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:58:23.425 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:58:23.425 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:58:23.427 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:58:23.427 DEBUG:teuthology.parallel:result is None 2024-09-15T23:58:23.469 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:58:23.469 DEBUG:teuthology.parallel:result is None 2024-09-15T23:58:23.503 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-09-15T23:58:23.538 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-15T23:58:24.172 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:2024-09-15T23:58:24.173+0000 7f27353f8640 -1 --2- 192.168.0.1:0/1776455092 >> [v2:172.21.15.112:6835/2378546307,v1:172.21.15.112:6837/2378546307] conn(0x559f979e8610 0x559f979eaa00 unknown :-1 s=BANNER_CONNECTING pgs=15 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.112:6835/2378546307,v1:172.21.15.112:6837/2378546307] is using msgr V1 protocol 2024-09-15T23:58:27.173 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:58:27.173 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-15T23:58:27.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.305+0000 7f6ecc5f6640 1 Processor -- start 2024-09-15T23:58:27.305 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.305+0000 7f6ecc5f6640 1 -- start start 2024-09-15T23:58:27.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.305+0000 7f6ecc5f6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ec40d0890 0x7f6ec40b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:27.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.305+0000 7f6ecc5f6640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec406d2c0 con 0x7f6ec40d0420 2024-09-15T23:58:27.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.305+0000 7f6ecc5f6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec406d5a0 con 0x7f6ec40cf5e0 2024-09-15T23:58:27.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.305+0000 7f6ecc5f6640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec406d880 con 0x7f6ec40d0890 2024-09-15T23:58:27.306 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.305+0000 7f6ecab93640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f6ec40d0890 0x7f6ec40b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:27.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.305+0000 7f6ec9b91640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f6ec40d0420 0x7f6ec40b3440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59394/0 (socket says 172.21.15.112:59394) 2024-09-15T23:58:27.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.305+0000 7f6ec9b91640 1 -- 172.21.15.112:0/445023069 learned_addr learned my addr 172.21.15.112:0/445023069 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:27.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.305+0000 7f6ecab93640 1 -- 172.21.15.112:0/445023069 >> v1:172.21.15.169:6789/0 conn(0x7f6ec40cf5e0 legacy=0x7f6ec40af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:27.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.305+0000 7f6ecab93640 1 -- 172.21.15.112:0/445023069 >> v1:172.21.15.112:6789/0 conn(0x7f6ec40d0420 legacy=0x7f6ec40b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:27.307 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.305+0000 7f6ecab93640 1 -- 172.21.15.112:0/445023069 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec406db60 con 0x7f6ec40d0890 2024-09-15T23:58:27.308 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.305+0000 7f6ec9390640 1 -- 172.21.15.112:0/445023069 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2220771777 0 0) 0x7f6ec406d2c0 con 0x7f6ec40d0420 2024-09-15T23:58:27.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.309+0000 7f6ecab93640 1 --2- 172.21.15.112:0/445023069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec40d0890 0x7f6ec40b3b50 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40097c0 tx=0x7f6eb401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8afb14d2aecb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:27.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.309+0000 7f6ec9390640 1 -- 172.21.15.112:0/445023069 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb40b0070 con 0x7f6ec40d0890 2024-09-15T23:58:27.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.309+0000 7f6ec9390640 1 -- 172.21.15.112:0/445023069 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb40ab600 con 0x7f6ec40d0890 2024-09-15T23:58:27.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.309+0000 7f6ec9390640 1 -- 172.21.15.112:0/445023069 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb40ab9d0 con 0x7f6ec40d0890 2024-09-15T23:58:27.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.309+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/445023069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec40d0890 msgr2=0x7f6ec40b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:27.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.309+0000 7f6ecc5f6640 1 --2- 172.21.15.112:0/445023069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec40d0890 0x7f6ec40b3b50 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40097c0 tx=0x7f6eb401c460 comp rx=0 tx=0).stop 2024-09-15T23:58:27.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.309+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/445023069 shutdown_connections 2024-09-15T23:58:27.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.309+0000 7f6ecc5f6640 1 --2- 172.21.15.112:0/445023069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec40d0890 0x7f6ec40b3b50 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.309+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/445023069 >> 172.21.15.112:0/445023069 conn(0x7f6ec4075200 msgr2=0x7f6ec4075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:27.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.309+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/445023069 shutdown_connections 2024-09-15T23:58:27.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.309+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/445023069 wait complete. 2024-09-15T23:58:27.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.309+0000 7f6ecc5f6640 1 Processor -- start 2024-09-15T23:58:27.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.309+0000 7f6ecc5f6640 1 -- start start 2024-09-15T23:58:27.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ecc5f6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec40cf5e0 0x7f6ec409a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:27.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ecc5f6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec40d0420 0x7f6ec409c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:27.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ecc5f6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec40d0890 0x7f6ec409c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:27.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ecc5f6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec4170740 con 0x7f6ec40d0420 2024-09-15T23:58:27.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ecc5f6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec41705c0 con 0x7f6ec40cf5e0 2024-09-15T23:58:27.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ecc5f6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec41708c0 con 0x7f6ec40d0890 2024-09-15T23:58:27.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec9b91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec40d0420 0x7f6ec409c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:27.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec9b91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec40d0420 0x7f6ec409c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37178/0 (socket says 172.21.15.112:37178) 2024-09-15T23:58:27.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec9b91640 1 -- 172.21.15.112:0/1841452186 learned_addr learned my addr 172.21.15.112:0/1841452186 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:27.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6eca392640 1 --2- 172.21.15.112:0/1841452186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec40cf5e0 0x7f6ec409a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:27.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ecab93640 1 --2- 172.21.15.112:0/1841452186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec40d0890 0x7f6ec409c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:27.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec9b91640 1 -- 172.21.15.112:0/1841452186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec40d0890 msgr2=0x7f6ec409c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:27.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec9b91640 1 --2- 172.21.15.112:0/1841452186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec40d0890 0x7f6ec409c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec9b91640 1 -- 172.21.15.112:0/1841452186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec40cf5e0 msgr2=0x7f6ec409a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:27.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec9b91640 1 --2- 172.21.15.112:0/1841452186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec40cf5e0 0x7f6ec409a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec9b91640 1 -- 172.21.15.112:0/1841452186 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec409d750 con 0x7f6ec40d0420 2024-09-15T23:58:27.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec9b91640 1 --2- 172.21.15.112:0/1841452186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec40d0420 0x7f6ec409c300 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8001570 tx=0x7f6eb800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:27.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec2ffd640 1 -- 172.21.15.112:0/1841452186 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8018070 con 0x7f6ec40d0420 2024-09-15T23:58:27.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec2ffd640 1 -- 172.21.15.112:0/1841452186 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb800a640 con 0x7f6ec40d0420 2024-09-15T23:58:27.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/1841452186 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec409ceb0 con 0x7f6ec40d0420 2024-09-15T23:58:27.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec2ffd640 1 -- 172.21.15.112:0/1841452186 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800aa30 con 0x7f6ec40d0420 2024-09-15T23:58:27.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/1841452186 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec409d470 con 0x7f6ec40d0420 2024-09-15T23:58:27.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/1841452186 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec40af570 con 0x7f6ec40d0420 2024-09-15T23:58:27.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec2ffd640 1 -- 172.21.15.112:0/1841452186 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6eb801b070 con 0x7f6ec40d0420 2024-09-15T23:58:27.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec2ffd640 1 --2- 172.21.15.112:0/1841452186 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6eb00678c0 0x7f6eb0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:27.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6eca392640 1 --2- 172.21.15.112:0/1841452186 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6eb00678c0 0x7f6eb0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:27.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6ec2ffd640 1 -- 172.21.15.112:0/1841452186 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f6eb8085470 con 0x7f6ec40d0420 2024-09-15T23:58:27.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.313+0000 7f6eca392640 1 --2- 172.21.15.112:0/1841452186 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6eb00678c0 0x7f6eb0069d80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40ce0e0 tx=0x7f6ebc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:27.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.321+0000 7f6ec2ffd640 1 -- 172.21.15.112:0/1841452186 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6eb8055eb0 con 0x7f6ec40d0420 2024-09-15T23:58:27.376 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:2024-09-15T23:58:27.377+0000 7f27353f8640 -1 --2- 192.168.0.1:0/1776455092 >> [v2:172.21.15.112:6835/2378546307,v1:172.21.15.112:6837/2378546307] conn(0x559f979e8610 0x559f979eaa00 unknown :-1 s=BANNER_CONNECTING pgs=15 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.112:6835/2378546307,v1:172.21.15.112:6837/2378546307] is using msgr V1 protocol 2024-09-15T23:58:27.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.545+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/1841452186 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f6ec40b07e0 con 0x7f6ec40d0420 2024-09-15T23:58:27.545 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-15T23:58:27.545+0000 7fae14e39640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:58:27.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.549+0000 7f6ec2ffd640 1 -- 172.21.15.112:0/1841452186 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6711 v59) ==== 95+0+0 (secure 0 0 0) 0x7f6eb805c080 con 0x7f6ec40d0420 2024-09-15T23:58:27.549 INFO:teuthology.orchestra.run.smithi112.stderr:failed mds gid 6711 2024-09-15T23:58:27.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.553+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/1841452186 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6eb00678c0 msgr2=0x7f6eb0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:27.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.553+0000 7f6ecc5f6640 1 --2- 172.21.15.112:0/1841452186 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6eb00678c0 0x7f6eb0069d80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40ce0e0 tx=0x7f6ebc009040 comp rx=0 tx=0).stop 2024-09-15T23:58:27.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.553+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/1841452186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec40d0420 msgr2=0x7f6ec409c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:27.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.553+0000 7f6ecc5f6640 1 --2- 172.21.15.112:0/1841452186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec40d0420 0x7f6ec409c300 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8001570 tx=0x7f6eb800cd20 comp rx=0 tx=0).stop 2024-09-15T23:58:27.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.553+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/1841452186 shutdown_connections 2024-09-15T23:58:27.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.553+0000 7f6ecc5f6640 1 --2- 172.21.15.112:0/1841452186 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f6eb00678c0 0x7f6eb0069d80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.553+0000 7f6ecc5f6640 1 --2- 172.21.15.112:0/1841452186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec40d0890 0x7f6ec409c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.553+0000 7f6ecc5f6640 1 --2- 172.21.15.112:0/1841452186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ec40d0420 0x7f6ec409c300 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.553+0000 7f6ecc5f6640 1 --2- 172.21.15.112:0/1841452186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec40cf5e0 0x7f6ec409a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.553+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/1841452186 >> 172.21.15.112:0/1841452186 conn(0x7f6ec4075200 msgr2=0x7f6ec4072f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:27.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.553+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/1841452186 shutdown_connections 2024-09-15T23:58:27.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.553+0000 7f6ecc5f6640 1 -- 172.21.15.112:0/1841452186 wait complete. 2024-09-15T23:58:27.573 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:58:27.574 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:58:27.576 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:58:27.576 DEBUG:teuthology.parallel:result is None 2024-09-15T23:58:27.576 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:27.639 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-15T23:58:27.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.685+0000 7f4ac41e0640 1 Processor -- start 2024-09-15T23:58:27.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.685+0000 7f4ac41e0640 1 -- start start 2024-09-15T23:58:27.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.685+0000 7f4ac41e0640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4abc0d3350 0x7f4abc0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:27.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.685+0000 7f4ac41e0640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4abc0b7740 con 0x7f4abc0d1400 2024-09-15T23:58:27.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.685+0000 7f4ac41e0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4abc0d1810 con 0x7f4abc15e6f0 2024-09-15T23:58:27.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.685+0000 7f4ac41e0640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f4abc0cfdd0 con 0x7f4abc0d3350 2024-09-15T23:58:27.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.685+0000 7f4ac277d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4abc0d1400 0x7f4abc0b7c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:59404/0 (socket says 172.21.15.112:59404) 2024-09-15T23:58:27.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.685+0000 7f4ac277d640 1 -- 172.21.15.112:0/2431359707 learned_addr learned my addr 172.21.15.112:0/2431359707 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:27.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.685+0000 7f4ac177b640 1 --2- 172.21.15.112:0/2431359707 >> v2:172.21.15.169:3300/0 conn(0x7f4abc0d3350 0x7f4abc0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:27.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.685+0000 7f4ac0f7a640 1 -- 172.21.15.112:0/2431359707 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1999785231 0 0) 0x7f4abc0b7740 con 0x7f4abc0d1400 2024-09-15T23:58:27.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.685+0000 7f4ac0f7a640 1 -- 172.21.15.112:0/2431359707 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aa8003530 con 0x7f4abc0d1400 2024-09-15T23:58:27.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 -- 172.21.15.112:0/2431359707 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1002902475 0 0) 0x7f4aa8003530 con 0x7f4abc0d1400 2024-09-15T23:58:27.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 -- 172.21.15.112:0/2431359707 >> v2:172.21.15.169:3300/0 conn(0x7f4abc0d3350 msgr2=0x7f4abc0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:27.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 --2- 172.21.15.112:0/2431359707 >> v2:172.21.15.169:3300/0 conn(0x7f4abc0d3350 0x7f4abc0d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 -- 172.21.15.112:0/2431359707 >> v1:172.21.15.169:6789/0 conn(0x7f4abc15e6f0 legacy=0x7f4abc0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:27.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 -- 172.21.15.112:0/2431359707 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4abc0d3850 con 0x7f4abc0d1400 2024-09-15T23:58:27.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 -- 172.21.15.112:0/2431359707 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f4ab4001a20 con 0x7f4abc0d1400 2024-09-15T23:58:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 -- 172.21.15.112:0/2431359707 >> v1:172.21.15.112:6789/0 conn(0x7f4abc0d1400 legacy=0x7f4abc0b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 --2- 172.21.15.112:0/2431359707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4aa80039c0 0x7f4aa8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 --2- 172.21.15.112:0/2431359707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4aa8004810 0x7f4aa8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 --2- 172.21.15.112:0/2431359707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80051d0 0x7f4aa800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 -- 172.21.15.112:0/2431359707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc0cfdd0 con 0x7f4aa80039c0 2024-09-15T23:58:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 -- 172.21.15.112:0/2431359707 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa800c170 con 0x7f4aa80051d0 2024-09-15T23:58:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 -- 172.21.15.112:0/2431359707 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa800c370 con 0x7f4aa8004810 2024-09-15T23:58:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac1f7c640 1 --2- 172.21.15.112:0/2431359707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4aa80039c0 0x7f4aa8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac1f7c640 1 -- 172.21.15.112:0/2431359707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4aa8004810 msgr2=0x7f4aa8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac177b640 1 --2- 172.21.15.112:0/2431359707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4aa8004810 0x7f4aa8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac277d640 1 --2- 172.21.15.112:0/2431359707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80051d0 0x7f4aa800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac1f7c640 1 --2- 172.21.15.112:0/2431359707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4aa8004810 0x7f4aa8004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac1f7c640 1 -- 172.21.15.112:0/2431359707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80051d0 msgr2=0x7f4aa800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:27.690 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac1f7c640 1 --2- 172.21.15.112:0/2431359707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80051d0 0x7f4aa800b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac277d640 1 -- 172.21.15.112:0/2431359707 reap_dead start 2024-09-15T23:58:27.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac1f7c640 1 -- 172.21.15.112:0/2431359707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa8003530 con 0x7f4aa80039c0 2024-09-15T23:58:27.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac1f7c640 1 --2- 172.21.15.112:0/2431359707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4aa80039c0 0x7f4aa8003de0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8001750 tx=0x7f4ab801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527fbfedb825a005 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:27.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 -- 172.21.15.112:0/2431359707 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80013a0 con 0x7f4aa80039c0 2024-09-15T23:58:27.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 -- 172.21.15.112:0/2431359707 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab80a4e50 con 0x7f4aa80039c0 2024-09-15T23:58:27.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac0f7a640 1 -- 172.21.15.112:0/2431359707 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8003600 con 0x7f4aa80039c0 2024-09-15T23:58:27.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2431359707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4aa80039c0 msgr2=0x7f4aa8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:27.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac41e0640 1 --2- 172.21.15.112:0/2431359707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4aa80039c0 0x7f4aa8003de0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8001750 tx=0x7f4ab801c390 comp rx=0 tx=0).stop 2024-09-15T23:58:27.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2431359707 shutdown_connections 2024-09-15T23:58:27.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac41e0640 1 --2- 172.21.15.112:0/2431359707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4aa80039c0 0x7f4aa8003de0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2431359707 >> 172.21.15.112:0/2431359707 conn(0x7f4abc0722a0 msgr2=0x7f4abc0726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:27.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2431359707 shutdown_connections 2024-09-15T23:58:27.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.689+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2431359707 wait complete. 2024-09-15T23:58:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac41e0640 1 Processor -- start 2024-09-15T23:58:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac41e0640 1 -- start start 2024-09-15T23:58:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac41e0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80039c0 0x7f4abc158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac41e0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0d4800 0x7f4abc1566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac41e0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4abc0d4c80 0x7f4abc156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac41e0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc0cfad0 con 0x7f4abc0d4800 2024-09-15T23:58:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac41e0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc15ead0 con 0x7f4aa80039c0 2024-09-15T23:58:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac41e0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4abc0cfc50 con 0x7f4abc0d4c80 2024-09-15T23:58:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac177b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0d4800 0x7f4abc1566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:27.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac177b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0d4800 0x7f4abc1566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37208/0 (socket says 172.21.15.112:37208) 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac177b640 1 -- 172.21.15.112:0/2676032325 learned_addr learned my addr 172.21.15.112:0/2676032325 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac1f7c640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80039c0 0x7f4abc158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac277d640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4abc0d4c80 0x7f4abc156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac177b640 1 -- 172.21.15.112:0/2676032325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4abc0d4c80 msgr2=0x7f4abc156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac177b640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4abc0d4c80 0x7f4abc156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac177b640 1 -- 172.21.15.112:0/2676032325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80039c0 msgr2=0x7f4abc158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac177b640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80039c0 0x7f4abc158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac177b640 1 -- 172.21.15.112:0/2676032325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4abc1572c0 con 0x7f4abc0d4800 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac277d640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4abc0d4c80 0x7f4abc156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac1f7c640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80039c0 0x7f4abc158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac177b640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0d4800 0x7f4abc1566e0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4aac010930 tx=0x7f4aac010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ab27fc640 1 -- 172.21.15.112:0/2676032325 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00f040 con 0x7f4abc0d4800 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ab27fc640 1 -- 172.21.15.112:0/2676032325 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aac00ebc0 con 0x7f4abc0d4800 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2676032325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4abc1575a0 con 0x7f4abc0d4800 2024-09-15T23:58:27.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ab27fc640 1 -- 172.21.15.112:0/2676032325 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac01c400 con 0x7f4abc0d4800 2024-09-15T23:58:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2676032325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4abc157b60 con 0x7f4abc0d4800 2024-09-15T23:58:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.693+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2676032325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4abc0b68a0 con 0x7f4abc0d4800 2024-09-15T23:58:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.697+0000 7f4ab27fc640 1 -- 172.21.15.112:0/2676032325 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4aac01c5a0 con 0x7f4abc0d4800 2024-09-15T23:58:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.697+0000 7f4ab27fc640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4aa00678c0 0x7f4aa0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:27.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.697+0000 7f4ab27fc640 1 -- 172.21.15.112:0/2676032325 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6187+0+0 (secure 0 0 0) 0x7f4aac0864e0 con 0x7f4abc0d4800 2024-09-15T23:58:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.697+0000 7f4ac1f7c640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4aa00678c0 0x7f4aa0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:27.698 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.697+0000 7f4ac1f7c640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4aa00678c0 0x7f4aa0069d80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0d19e0 tx=0x7f4ab80011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:27.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.701+0000 7f4ab27fc640 1 -- 172.21.15.112:0/2676032325 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4aac018030 con 0x7f4abc0d4800 2024-09-15T23:58:27.887 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.885+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2676032325 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4abc0b9c40 con 0x7f4abc0d4800 2024-09-15T23:58:27.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.889+0000 7f4ab27fc640 1 -- 172.21.15.112:0/2676032325 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+4398 (secure 0 0 0) 0x7f4aac056f00 con 0x7f4abc0d4800 2024-09-15T23:58:27.888 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:27.888 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":60,"btime":"2024-09-15T23:58:27:557597+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:27.557582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:replay","state_seq":1,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-09-15T23:58:27.889 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 60 2024-09-15T23:58:27.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.889+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2676032325 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4aa00678c0 msgr2=0x7f4aa0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:27.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.889+0000 7f4ac41e0640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4aa00678c0 0x7f4aa0069d80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0d19e0 tx=0x7f4ab80011a0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.889+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2676032325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0d4800 msgr2=0x7f4abc1566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:27.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.889+0000 7f4ac41e0640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0d4800 0x7f4abc1566e0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4aac010930 tx=0x7f4aac010df0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.889+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2676032325 shutdown_connections 2024-09-15T23:58:27.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.889+0000 7f4ac41e0640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4aa00678c0 0x7f4aa0069d80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.889+0000 7f4ac41e0640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4abc0d4c80 0x7f4abc156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.889+0000 7f4ac41e0640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4abc0d4800 0x7f4abc1566e0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.889+0000 7f4ac41e0640 1 --2- 172.21.15.112:0/2676032325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80039c0 0x7f4abc158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:27.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.889+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2676032325 >> 172.21.15.112:0/2676032325 conn(0x7f4abc0722a0 msgr2=0x7f4abc0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:27.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.889+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2676032325 shutdown_connections 2024-09-15T23:58:27.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:27.889+0000 7f4ac41e0640 1 -- 172.21.15.112:0/2676032325 wait complete. 2024-09-15T23:58:28.310 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:58:07.063973+0000', 'modified': '2024-09-15T23:58:27.557582+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6936}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6936': {'gid': 6936, 'name': 'c', 'rank': 0, 'incarnation': 60, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.112:6835/960124820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 960124820}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 960124820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-15T23:58:28.310 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6936:up:replay 2024-09-15T23:58:29.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-15T23:58:29.312 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:29.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f7423521640 1 Processor -- start 2024-09-15T23:58:29.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f7423521640 1 -- start start 2024-09-15T23:58:29.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f7423521640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f741c0d0420 0x7f741c0b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:29.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f7423521640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f741c0b3160 0x7f741c0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:29.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f7423521640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f741c0d0d40 con 0x7f741c0cd370 2024-09-15T23:58:29.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f7423521640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f741c0ad140 con 0x7f741c0b3160 2024-09-15T23:58:29.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f7423521640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f741c0ad390 con 0x7f741c0d0420 2024-09-15T23:58:29.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f7420abc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f741c0b3160 0x7f741c0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:29.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f7420abc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f741c0b3160 0x7f741c0d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60072/0 (socket says 172.21.15.112:60072) 2024-09-15T23:58:29.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f7420abc640 1 -- 172.21.15.112:0/357498718 learned_addr learned my addr 172.21.15.112:0/357498718 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:29.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f74212bd640 1 --2- 172.21.15.112:0/357498718 >> v2:172.21.15.169:3300/0 conn(0x7f741c0d0420 0x7f741c0b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:29.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f7420abc640 1 -- 172.21.15.112:0/357498718 >> v2:172.21.15.169:3300/0 conn(0x7f741c0d0420 msgr2=0x7f741c0b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:29.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f7420abc640 1 --2- 172.21.15.112:0/357498718 >> v2:172.21.15.169:3300/0 conn(0x7f741c0d0420 0x7f741c0b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:29.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f7420abc640 1 -- 172.21.15.112:0/357498718 >> v1:172.21.15.169:6789/0 conn(0x7f741c0cd370 legacy=0x7f741c0ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:29.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f7420abc640 1 -- 172.21.15.112:0/357498718 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c0ad670 con 0x7f741c0b3160 2024-09-15T23:58:29.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.445+0000 7f74212bd640 1 --2- 172.21.15.112:0/357498718 >> v2:172.21.15.169:3300/0 conn(0x7f741c0d0420 0x7f741c0b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:29.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7420abc640 1 --2- 172.21.15.112:0/357498718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c0b3160 0x7f741c0d0800 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f741c06f3b0 tx=0x7f740c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b66ce3de767daf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:29.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7413fff640 1 -- 172.21.15.112:0/357498718 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c0b0070 con 0x7f741c0b3160 2024-09-15T23:58:29.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7413fff640 1 -- 172.21.15.112:0/357498718 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f740c0ab600 con 0x7f741c0b3160 2024-09-15T23:58:29.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7413fff640 1 -- 172.21.15.112:0/357498718 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c0ab9d0 con 0x7f741c0b3160 2024-09-15T23:58:29.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 -- 172.21.15.112:0/357498718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c0b3160 msgr2=0x7f741c0d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:29.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 --2- 172.21.15.112:0/357498718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c0b3160 0x7f741c0d0800 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f741c06f3b0 tx=0x7f740c01c450 comp rx=0 tx=0).stop 2024-09-15T23:58:29.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 -- 172.21.15.112:0/357498718 shutdown_connections 2024-09-15T23:58:29.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 --2- 172.21.15.112:0/357498718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c0b3160 0x7f741c0d0800 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:29.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 --2- 172.21.15.112:0/357498718 >> v2:172.21.15.169:3300/0 conn(0x7f741c0d0420 0x7f741c0b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:29.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 -- 172.21.15.112:0/357498718 >> 172.21.15.112:0/357498718 conn(0x7f741c075200 msgr2=0x7f741c075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:29.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 -- 172.21.15.112:0/357498718 shutdown_connections 2024-09-15T23:58:29.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 -- 172.21.15.112:0/357498718 wait complete. 2024-09-15T23:58:29.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 Processor -- start 2024-09-15T23:58:29.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 -- start start 2024-09-15T23:58:29.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f741c0cd370 0x7f741c1f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c0d0420 0x7f741c1445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f741c06cf00 0x7f741c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f741c168660 con 0x7f741c0d0420 2024-09-15T23:58:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f741c0b4bc0 con 0x7f741c06cf00 2024-09-15T23:58:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f741c1687e0 con 0x7f741c0cd370 2024-09-15T23:58:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7420abc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c0d0420 0x7f741c1445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7420abc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c0d0420 0x7f741c1445c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60082/0 (socket says 172.21.15.112:60082) 2024-09-15T23:58:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7420abc640 1 -- 172.21.15.112:0/2525080299 learned_addr learned my addr 172.21.15.112:0/2525080299 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7421abe640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f741c06cf00 0x7f741c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f74212bd640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f741c0cd370 0x7f741c1f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7420abc640 1 -- 172.21.15.112:0/2525080299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f741c0cd370 msgr2=0x7f741c1f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7420abc640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f741c0cd370 0x7f741c1f7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7420abc640 1 -- 172.21.15.112:0/2525080299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f741c06cf00 msgr2=0x7f741c06d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:29.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7420abc640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f741c06cf00 0x7f741c06d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:29.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7420abc640 1 -- 172.21.15.112:0/2525080299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c144b00 con 0x7f741c0d0420 2024-09-15T23:58:29.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7421abe640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f741c06cf00 0x7f741c06d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:29.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7420abc640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c0d0420 0x7f741c1445c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f740c019060 tx=0x7f740c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:29.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7411ffb640 1 -- 172.21.15.112:0/2525080299 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c0b9070 con 0x7f741c0d0420 2024-09-15T23:58:29.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7411ffb640 1 -- 172.21.15.112:0/2525080299 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f740c0b4400 con 0x7f741c0d0420 2024-09-15T23:58:29.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 -- 172.21.15.112:0/2525080299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741c158d10 con 0x7f741c0d0420 2024-09-15T23:58:29.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7411ffb640 1 -- 172.21.15.112:0/2525080299 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c0b0040 con 0x7f741c0d0420 2024-09-15T23:58:29.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.449+0000 7f7423521640 1 -- 172.21.15.112:0/2525080299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f741c1592d0 con 0x7f741c0d0420 2024-09-15T23:58:29.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.453+0000 7f7423521640 1 -- 172.21.15.112:0/2525080299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f741c0d0800 con 0x7f741c0d0420 2024-09-15T23:58:29.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.453+0000 7f7411ffb640 1 -- 172.21.15.112:0/2525080299 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f740c0bc070 con 0x7f741c0d0420 2024-09-15T23:58:29.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.453+0000 7f7411ffb640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f74000678f0 0x7f7400069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:29.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.453+0000 7f7411ffb640 1 -- 172.21.15.112:0/2525080299 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6187+0+0 (secure 0 0 0) 0x7f740c11ed90 con 0x7f741c0d0420 2024-09-15T23:58:29.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.453+0000 7f74212bd640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f74000678f0 0x7f7400069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:29.454 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.453+0000 7f74212bd640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f74000678f0 0x7f7400069db0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f741c1581b0 tx=0x7f74180084f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:29.457 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.457+0000 7f7411ffb640 1 -- 172.21.15.112:0/2525080299 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f740c0160d0 con 0x7f741c0d0420 2024-09-15T23:58:29.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.641+0000 7f7423521640 1 -- 172.21.15.112:0/2525080299 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f741c0cdd00 con 0x7f741c0d0420 2024-09-15T23:58:29.641 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.641+0000 7f7411ffb640 1 -- 172.21.15.112:0/2525080299 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5223 (secure 0 0 0) 0x7f740c0ef980 con 0x7f741c0d0420 2024-09-15T23:58:29.642 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:29.642 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":62,"btime":"2024-09-15T23:58:29:563631+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:28.567742+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:rejoin","state_seq":4,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-09-15T23:58:29.642 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 62 2024-09-15T23:58:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.645+0000 7f7423521640 1 -- 172.21.15.112:0/2525080299 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f74000678f0 msgr2=0x7f7400069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:29.644 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.645+0000 7f7423521640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f74000678f0 0x7f7400069db0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f741c1581b0 tx=0x7f74180084f0 comp rx=0 tx=0).stop 2024-09-15T23:58:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.645+0000 7f7423521640 1 -- 172.21.15.112:0/2525080299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c0d0420 msgr2=0x7f741c1445c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.645+0000 7f7423521640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c0d0420 0x7f741c1445c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f740c019060 tx=0x7f740c0191f0 comp rx=0 tx=0).stop 2024-09-15T23:58:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.645+0000 7f7423521640 1 -- 172.21.15.112:0/2525080299 shutdown_connections 2024-09-15T23:58:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.645+0000 7f7423521640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f74000678f0 0x7f7400069db0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.645+0000 7f7423521640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f741c06cf00 0x7f741c06d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.645+0000 7f7423521640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f741c0d0420 0x7f741c1445c0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.645+0000 7f7423521640 1 --2- 172.21.15.112:0/2525080299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f741c0cd370 0x7f741c1f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.645+0000 7f7423521640 1 -- 172.21.15.112:0/2525080299 >> 172.21.15.112:0/2525080299 conn(0x7f741c075200 msgr2=0x7f741c0ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.645+0000 7f7423521640 1 -- 172.21.15.112:0/2525080299 shutdown_connections 2024-09-15T23:58:29.645 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:29.645+0000 7f7423521640 1 -- 172.21.15.112:0/2525080299 wait complete. 2024-09-15T23:58:30.062 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:58:07.063973+0000', 'modified': '2024-09-15T23:58:28.567742+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6936}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6936': {'gid': 6936, 'name': 'c', 'rank': 0, 'incarnation': 60, 'state': 'up:rejoin', 'state_seq': 4, 'addr': '172.21.15.112:6835/960124820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 960124820}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 960124820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-15T23:58:30.062 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6936:up:rejoin 2024-09-15T23:58:31.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:31.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.197+0000 7f9ac9754640 1 Processor -- start 2024-09-15T23:58:31.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.197+0000 7f9ac9754640 1 -- start start 2024-09-15T23:58:31.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.197+0000 7f9ac9754640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9ac415e6f0 0x7f9ac40cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:31.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.197+0000 7f9ac9754640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac40b7740 con 0x7f9ac40d15d0 2024-09-15T23:58:31.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.197+0000 7f9ac9754640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac40d3850 con 0x7f9ac40cfc00 2024-09-15T23:58:31.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.197+0000 7f9ac9754640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac40d3b30 con 0x7f9ac415e6f0 2024-09-15T23:58:31.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.197+0000 7f9ac2ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9ac415e6f0 0x7f9ac40cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:31.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.197+0000 7f9ac37fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9ac40d15d0 0x7f9ac40b7c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:37488/0 (socket says 172.21.15.112:37488) 2024-09-15T23:58:31.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.197+0000 7f9ac37fe640 1 -- 172.21.15.112:0/749604808 learned_addr learned my addr 172.21.15.112:0/749604808 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:31.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.197+0000 7f9ac2ffd640 1 -- 172.21.15.112:0/749604808 >> v1:172.21.15.169:6789/0 conn(0x7f9ac40cfc00 legacy=0x7f9ac40d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:31.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.197+0000 7f9ac2ffd640 1 -- 172.21.15.112:0/749604808 >> v1:172.21.15.112:6789/0 conn(0x7f9ac40d15d0 legacy=0x7f9ac40b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:31.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.197+0000 7f9ac2ffd640 1 -- 172.21.15.112:0/749604808 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac40d3e10 con 0x7f9ac415e6f0 2024-09-15T23:58:31.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.197+0000 7f9ac1ffb640 1 -- 172.21.15.112:0/749604808 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 627278294 0 0) 0x7f9ac40b7740 con 0x7f9ac40d15d0 2024-09-15T23:58:31.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac2ffd640 1 --2- 172.21.15.112:0/749604808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ac415e6f0 0x7f9ac40cf6c0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4074480 tx=0x7f9ab401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348ce0a147ac4c63 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:31.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac1ffb640 1 -- 172.21.15.112:0/749604808 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40b1070 con 0x7f9ac415e6f0 2024-09-15T23:58:31.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac1ffb640 1 -- 172.21.15.112:0/749604808 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab40ac640 con 0x7f9ac415e6f0 2024-09-15T23:58:31.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac1ffb640 1 -- 172.21.15.112:0/749604808 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40aca10 con 0x7f9ac415e6f0 2024-09-15T23:58:31.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 -- 172.21.15.112:0/749604808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ac415e6f0 msgr2=0x7f9ac40cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:31.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 --2- 172.21.15.112:0/749604808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ac415e6f0 0x7f9ac40cf6c0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4074480 tx=0x7f9ab401c380 comp rx=0 tx=0).stop 2024-09-15T23:58:31.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 -- 172.21.15.112:0/749604808 shutdown_connections 2024-09-15T23:58:31.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 --2- 172.21.15.112:0/749604808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ac415e6f0 0x7f9ac40cf6c0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:31.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 -- 172.21.15.112:0/749604808 >> 172.21.15.112:0/749604808 conn(0x7f9ac40722a0 msgr2=0x7f9ac40726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:31.201 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 -- 172.21.15.112:0/749604808 shutdown_connections 2024-09-15T23:58:31.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 -- 172.21.15.112:0/749604808 wait complete. 2024-09-15T23:58:31.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 Processor -- start 2024-09-15T23:58:31.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 -- start start 2024-09-15T23:58:31.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ac40d15d0 0x7f9ac415d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:31.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ac415e6f0 0x7f9ac40ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:31.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ac4151040 0x7f9ac40cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:31.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac40b8f50 con 0x7f9ac415e6f0 2024-09-15T23:58:31.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac40b8dd0 con 0x7f9ac4151040 2024-09-15T23:58:31.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac9754640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac416c2d0 con 0x7f9ac40d15d0 2024-09-15T23:58:31.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac27fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ac415e6f0 0x7f9ac40ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:31.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac27fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ac415e6f0 0x7f9ac40ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60098/0 (socket says 172.21.15.112:60098) 2024-09-15T23:58:31.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac27fc640 1 -- 172.21.15.112:0/4057265583 learned_addr learned my addr 172.21.15.112:0/4057265583 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:31.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac37fe640 1 --2- 172.21.15.112:0/4057265583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ac4151040 0x7f9ac40cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:31.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac27fc640 1 -- 172.21.15.112:0/4057265583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ac40d15d0 msgr2=0x7f9ac415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:31.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac27fc640 1 --2- 172.21.15.112:0/4057265583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ac40d15d0 0x7f9ac415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:31.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac27fc640 1 -- 172.21.15.112:0/4057265583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ac4151040 msgr2=0x7f9ac40cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:31.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac27fc640 1 --2- 172.21.15.112:0/4057265583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ac4151040 0x7f9ac40cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:31.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.201+0000 7f9ac27fc640 1 -- 172.21.15.112:0/4057265583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac40cd760 con 0x7f9ac415e6f0 2024-09-15T23:58:31.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.205+0000 7f9ac27fc640 1 --2- 172.21.15.112:0/4057265583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ac415e6f0 0x7f9ac40ccce0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800c450 tx=0x7f9ab800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:31.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.205+0000 7f9aab7fe640 1 -- 172.21.15.112:0/4057265583 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8012830 con 0x7f9ac415e6f0 2024-09-15T23:58:31.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.205+0000 7f9aab7fe640 1 -- 172.21.15.112:0/4057265583 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab8017070 con 0x7f9ac415e6f0 2024-09-15T23:58:31.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.205+0000 7f9aab7fe640 1 -- 172.21.15.112:0/4057265583 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8012c30 con 0x7f9ac415e6f0 2024-09-15T23:58:31.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.205+0000 7f9ac9754640 1 -- 172.21.15.112:0/4057265583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac40cd480 con 0x7f9ac415e6f0 2024-09-15T23:58:31.205 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.205+0000 7f9ac9754640 1 -- 172.21.15.112:0/4057265583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac40cba60 con 0x7f9ac415e6f0 2024-09-15T23:58:31.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.205+0000 7f9ac9754640 1 -- 172.21.15.112:0/4057265583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac40728d0 con 0x7f9ac415e6f0 2024-09-15T23:58:31.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.205+0000 7f9aab7fe640 1 -- 172.21.15.112:0/4057265583 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ab801c460 con 0x7f9ac415e6f0 2024-09-15T23:58:31.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.205+0000 7f9aab7fe640 1 --2- 172.21.15.112:0/4057265583 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9ab00678f0 0x7f9ab0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:31.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.205+0000 7f9aab7fe640 1 -- 172.21.15.112:0/4057265583 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6187+0+0 (secure 0 0 0) 0x7f9ab8085b90 con 0x7f9ac415e6f0 2024-09-15T23:58:31.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.205+0000 7f9ac2ffd640 1 --2- 172.21.15.112:0/4057265583 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9ab00678f0 0x7f9ab0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:31.207 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.205+0000 7f9ac2ffd640 1 --2- 172.21.15.112:0/4057265583 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9ab00678f0 0x7f9ab0069db0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40ae000 tx=0x7f9ab4004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:31.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.213+0000 7f9aab7fe640 1 -- 172.21.15.112:0/4057265583 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9ab80564f0 con 0x7f9ac415e6f0 2024-09-15T23:58:31.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.401+0000 7f9ac9754640 1 -- 172.21.15.112:0/4057265583 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ac40cf670 con 0x7f9ac415e6f0 2024-09-15T23:58:31.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.401+0000 7f9aab7fe640 1 -- 172.21.15.112:0/4057265583 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5229 (secure 0 0 0) 0x7f9ab8055df0 con 0x7f9ac415e6f0 2024-09-15T23:58:31.401 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:31.401 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":63,"btime":"2024-09-15T23:58:30:571653+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:29.576800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:clientreplay","state_seq":5,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-09-15T23:58:31.402 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 63 2024-09-15T23:58:31.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.401+0000 7f9ac9754640 1 -- 172.21.15.112:0/4057265583 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9ab00678f0 msgr2=0x7f9ab0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:31.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.401+0000 7f9ac9754640 1 --2- 172.21.15.112:0/4057265583 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9ab00678f0 0x7f9ab0069db0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40ae000 tx=0x7f9ab4004740 comp rx=0 tx=0).stop 2024-09-15T23:58:31.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.401+0000 7f9ac9754640 1 -- 172.21.15.112:0/4057265583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ac415e6f0 msgr2=0x7f9ac40ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:31.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.401+0000 7f9ac9754640 1 --2- 172.21.15.112:0/4057265583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ac415e6f0 0x7f9ac40ccce0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800c450 tx=0x7f9ab800c910 comp rx=0 tx=0).stop 2024-09-15T23:58:31.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.405+0000 7f9ac9754640 1 -- 172.21.15.112:0/4057265583 shutdown_connections 2024-09-15T23:58:31.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.405+0000 7f9ac9754640 1 --2- 172.21.15.112:0/4057265583 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9ab00678f0 0x7f9ab0069db0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:31.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.405+0000 7f9ac9754640 1 --2- 172.21.15.112:0/4057265583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ac4151040 0x7f9ac40cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.405+0000 7f9ac9754640 1 --2- 172.21.15.112:0/4057265583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ac415e6f0 0x7f9ac40ccce0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.405+0000 7f9ac9754640 1 --2- 172.21.15.112:0/4057265583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9ac40d15d0 0x7f9ac415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.405+0000 7f9ac9754640 1 -- 172.21.15.112:0/4057265583 >> 172.21.15.112:0/4057265583 conn(0x7f9ac40722a0 msgr2=0x7f9ac4156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.405+0000 7f9ac9754640 1 -- 172.21.15.112:0/4057265583 shutdown_connections 2024-09-15T23:58:31.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:31.405+0000 7f9ac9754640 1 -- 172.21.15.112:0/4057265583 wait complete. 2024-09-15T23:58:31.821 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:58:07.063973+0000', 'modified': '2024-09-15T23:58:29.576800+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6936}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6936': {'gid': 6936, 'name': 'c', 'rank': 0, 'incarnation': 60, 'state': 'up:clientreplay', 'state_seq': 5, 'addr': '172.21.15.112:6835/960124820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 960124820}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 960124820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-15T23:58:31.821 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6936:up:clientreplay 2024-09-15T23:58:32.822 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:32.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93af4f2640 1 Processor -- start 2024-09-15T23:58:32.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93af4f2640 1 -- start start 2024-09-15T23:58:32.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93af4f2640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f93a80d0420 0x7f93a80b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93af4f2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93a80b3160 0x7f93a80d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93af4f2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f93a80cd370 0x7f93a80ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93af4f2640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f93a80ad140 con 0x7f93a80d0420 2024-09-15T23:58:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93af4f2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f93a80d0d40 con 0x7f93a80cd370 2024-09-15T23:58:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93af4f2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f93a80ad390 con 0x7f93a80b3160 2024-09-15T23:58:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93ad28e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f93a80d0420 0x7f93a80b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93ad28e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f93a80d0420 0x7f93a80b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60112/0 (socket says 172.21.15.112:60112) 2024-09-15T23:58:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93ad28e640 1 -- 172.21.15.112:0/1427856449 learned_addr learned my addr 172.21.15.112:0/1427856449 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93ada8f640 1 --2- 172.21.15.112:0/1427856449 >> v2:172.21.15.169:3300/0 conn(0x7f93a80cd370 0x7f93a80ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93ad28e640 1 -- 172.21.15.112:0/1427856449 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93a80b3160 msgr2=0x7f93a80d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93aca8d640 1 --2- 172.21.15.112:0/1427856449 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93a80b3160 0x7f93a80d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93ad28e640 1 --2- 172.21.15.112:0/1427856449 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93a80b3160 0x7f93a80d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:32.954 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93ad28e640 1 -- 172.21.15.112:0/1427856449 >> v2:172.21.15.169:3300/0 conn(0x7f93a80cd370 msgr2=0x7f93a80ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93ad28e640 1 --2- 172.21.15.112:0/1427856449 >> v2:172.21.15.169:3300/0 conn(0x7f93a80cd370 0x7f93a80ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93ad28e640 1 -- 172.21.15.112:0/1427856449 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a80ad670 con 0x7f93a80d0420 2024-09-15T23:58:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.953+0000 7f93ada8f640 1 --2- 172.21.15.112:0/1427856449 >> v2:172.21.15.169:3300/0 conn(0x7f93a80cd370 0x7f93a80ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:32.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93ad28e640 1 --2- 172.21.15.112:0/1427856449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a80d0420 0x7f93a80b4050 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f93a80cd140 tx=0x7f939801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f4cd45bbcfec8d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:32.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f939ffff640 1 -- 172.21.15.112:0/1427856449 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93980b4070 con 0x7f93a80d0420 2024-09-15T23:58:32.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f939ffff640 1 -- 172.21.15.112:0/1427856449 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93980a79f0 con 0x7f93a80d0420 2024-09-15T23:58:32.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f939ffff640 1 -- 172.21.15.112:0/1427856449 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93980a7dc0 con 0x7f93a80d0420 2024-09-15T23:58:32.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 -- 172.21.15.112:0/1427856449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a80d0420 msgr2=0x7f93a80b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:32.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 --2- 172.21.15.112:0/1427856449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a80d0420 0x7f93a80b4050 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f93a80cd140 tx=0x7f939801eb60 comp rx=0 tx=0).stop 2024-09-15T23:58:32.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 -- 172.21.15.112:0/1427856449 shutdown_connections 2024-09-15T23:58:32.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 --2- 172.21.15.112:0/1427856449 >> v2:172.21.15.169:3300/0 conn(0x7f93a80cd370 0x7f93a80ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:32.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 --2- 172.21.15.112:0/1427856449 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93a80b3160 0x7f93a80d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:32.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 --2- 172.21.15.112:0/1427856449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a80d0420 0x7f93a80b4050 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:32.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 -- 172.21.15.112:0/1427856449 >> 172.21.15.112:0/1427856449 conn(0x7f93a8075200 msgr2=0x7f93a8075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:32.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 -- 172.21.15.112:0/1427856449 shutdown_connections 2024-09-15T23:58:32.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 -- 172.21.15.112:0/1427856449 wait complete. 2024-09-15T23:58:32.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 Processor -- start 2024-09-15T23:58:32.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 -- start start 2024-09-15T23:58:32.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a80b3160 0x7f93a81481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93a80cd370 0x7f93a814b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93a80d0420 0x7f93a814b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f93a80aec20 con 0x7f93a80b3160 2024-09-15T23:58:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f93a80aeaa0 con 0x7f93a80d0420 2024-09-15T23:58:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93af4f2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f93a815f560 con 0x7f93a80cd370 2024-09-15T23:58:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93ad28e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a80b3160 0x7f93a81481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93ad28e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a80b3160 0x7f93a81481b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60122/0 (socket says 172.21.15.112:60122) 2024-09-15T23:58:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93ad28e640 1 -- 172.21.15.112:0/1468213927 learned_addr learned my addr 172.21.15.112:0/1468213927 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93ada8f640 1 --2- 172.21.15.112:0/1468213927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93a80d0420 0x7f93a814b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93ad28e640 1 -- 172.21.15.112:0/1468213927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93a80cd370 msgr2=0x7f93a814b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93ad28e640 1 --2- 172.21.15.112:0/1468213927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93a80cd370 0x7f93a814b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93ad28e640 1 -- 172.21.15.112:0/1468213927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93a80d0420 msgr2=0x7f93a814b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:32.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93ad28e640 1 --2- 172.21.15.112:0/1468213927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93a80d0420 0x7f93a814b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:32.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.957+0000 7f93ad28e640 1 -- 172.21.15.112:0/1468213927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a814db40 con 0x7f93a80b3160 2024-09-15T23:58:32.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.961+0000 7f93ad28e640 1 --2- 172.21.15.112:0/1468213927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a80b3160 0x7f93a81481b0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f939800b2c0 tx=0x7f939801b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:32.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.961+0000 7f939dffb640 1 -- 172.21.15.112:0/1468213927 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93980be020 con 0x7f93a80b3160 2024-09-15T23:58:32.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.961+0000 7f939dffb640 1 -- 172.21.15.112:0/1468213927 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93980af840 con 0x7f93a80b3160 2024-09-15T23:58:32.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.961+0000 7f939dffb640 1 -- 172.21.15.112:0/1468213927 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93980b4040 con 0x7f93a80b3160 2024-09-15T23:58:32.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.961+0000 7f93af4f2640 1 -- 172.21.15.112:0/1468213927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a814de20 con 0x7f93a80b3160 2024-09-15T23:58:32.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.961+0000 7f93af4f2640 1 -- 172.21.15.112:0/1468213927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a8072170 con 0x7f93a80b3160 2024-09-15T23:58:32.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.961+0000 7f93af4f2640 1 -- 172.21.15.112:0/1468213927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93a815f840 con 0x7f93a80b3160 2024-09-15T23:58:32.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.961+0000 7f939dffb640 1 -- 172.21.15.112:0/1468213927 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f93980c1020 con 0x7f93a80b3160 2024-09-15T23:58:32.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.961+0000 7f939dffb640 1 --2- 172.21.15.112:0/1468213927 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f938c0678c0 0x7f938c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:32.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.961+0000 7f939dffb640 1 -- 172.21.15.112:0/1468213927 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6303+0+0 (secure 0 0 0) 0x7f9398122d00 con 0x7f93a80b3160 2024-09-15T23:58:32.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.961+0000 7f93aca8d640 1 --2- 172.21.15.112:0/1468213927 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f938c0678c0 0x7f938c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:32.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.961+0000 7f93aca8d640 1 --2- 172.21.15.112:0/1468213927 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f938c0678c0 0x7f938c069d80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f93a4006b20 tx=0x7f93a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:32.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:32.965+0000 7f939dffb640 1 -- 172.21.15.112:0/1468213927 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f93980c8030 con 0x7f93a80b3160 2024-09-15T23:58:33.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.161+0000 7f93af4f2640 1 -- 172.21.15.112:0/1468213927 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93a80b0940 con 0x7f93a80b3160 2024-09-15T23:58:33.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.165+0000 7f939dffb640 1 -- 172.21.15.112:0/1468213927 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7f93980187e0 con 0x7f93a80b3160 2024-09-15T23:58:33.164 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:33.164 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:33.164 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:33.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.165+0000 7f93af4f2640 1 -- 172.21.15.112:0/1468213927 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f938c0678c0 msgr2=0x7f938c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:33.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.165+0000 7f93af4f2640 1 --2- 172.21.15.112:0/1468213927 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f938c0678c0 0x7f938c069d80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f93a4006b20 tx=0x7f93a4008040 comp rx=0 tx=0).stop 2024-09-15T23:58:33.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.165+0000 7f93af4f2640 1 -- 172.21.15.112:0/1468213927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a80b3160 msgr2=0x7f93a81481b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:33.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.165+0000 7f93af4f2640 1 --2- 172.21.15.112:0/1468213927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a80b3160 0x7f93a81481b0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f939800b2c0 tx=0x7f939801b900 comp rx=0 tx=0).stop 2024-09-15T23:58:33.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.165+0000 7f93af4f2640 1 -- 172.21.15.112:0/1468213927 shutdown_connections 2024-09-15T23:58:33.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.165+0000 7f93af4f2640 1 --2- 172.21.15.112:0/1468213927 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f938c0678c0 0x7f938c069d80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.165+0000 7f93af4f2640 1 --2- 172.21.15.112:0/1468213927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93a80d0420 0x7f93a814b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.165+0000 7f93af4f2640 1 --2- 172.21.15.112:0/1468213927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f93a80cd370 0x7f93a814b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.165+0000 7f93af4f2640 1 --2- 172.21.15.112:0/1468213927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a80b3160 0x7f93a81481b0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.165+0000 7f93af4f2640 1 -- 172.21.15.112:0/1468213927 >> 172.21.15.112:0/1468213927 conn(0x7f93a8075200 msgr2=0x7f93a80ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:33.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.165+0000 7f93af4f2640 1 -- 172.21.15.112:0/1468213927 shutdown_connections 2024-09-15T23:58:33.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.165+0000 7f93af4f2640 1 -- 172.21.15.112:0/1468213927 wait complete. 2024-09-15T23:58:33.586 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:58:07.063973+0000', 'modified': '2024-09-15T23:58:31.580890+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6936}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6936': {'gid': 6936, 'name': 'c', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.112:6835/960124820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 960124820}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 960124820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6936, 'qdb_cluster': [6936]} 2024-09-15T23:58:33.586 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:58:33.586 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T23:58:33.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37d4eea640 1 Processor -- start 2024-09-15T23:58:33.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37d4eea640 1 -- start start 2024-09-15T23:58:33.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37d4eea640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f37d015aa40 0x7f37d00b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37d4eea640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f37d00adae0 0x7f37d00adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37d4eea640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d00b3dd0 con 0x7f37d00ad260 2024-09-15T23:58:33.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37d4eea640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f37d00ae490 con 0x7f37d015aa40 2024-09-15T23:58:33.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37d4eea640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f37d00b3b80 con 0x7f37d00adae0 2024-09-15T23:58:33.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37ce59c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f37d015aa40 0x7f37d00b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37ce59c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f37d015aa40 0x7f37d00b4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60132/0 (socket says 172.21.15.112:60132) 2024-09-15T23:58:33.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37ce59c640 1 -- 172.21.15.112:0/2660400912 learned_addr learned my addr 172.21.15.112:0/2660400912 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:33.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37ced9d640 1 --2- 172.21.15.112:0/2660400912 >> v2:172.21.15.169:3300/0 conn(0x7f37d00adae0 0x7f37d00adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37ce59c640 1 -- 172.21.15.112:0/2660400912 >> v2:172.21.15.169:3300/0 conn(0x7f37d00adae0 msgr2=0x7f37d00adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:33.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37ce59c640 1 --2- 172.21.15.112:0/2660400912 >> v2:172.21.15.169:3300/0 conn(0x7f37d00adae0 0x7f37d00adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37ce59c640 1 -- 172.21.15.112:0/2660400912 >> v1:172.21.15.112:6789/0 conn(0x7f37d00ad260 legacy=0x7f37d015b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:33.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37ce59c640 1 -- 172.21.15.112:0/2660400912 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d00b40b0 con 0x7f37d015aa40 2024-09-15T23:58:33.726 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.725+0000 7f37ced9d640 1 --2- 172.21.15.112:0/2660400912 >> v2:172.21.15.169:3300/0 conn(0x7f37d00adae0 0x7f37d00adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:58:33.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37ce59c640 1 --2- 172.21.15.112:0/2660400912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d015aa40 0x7f37d00b4e70 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f37d00afd80 tx=0x7f37c001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc30c58efb34aa46 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:33.727 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37cdd9b640 1 -- 172.21.15.112:0/2660400912 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c00b1070 con 0x7f37d015aa40 2024-09-15T23:58:33.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37cdd9b640 1 -- 172.21.15.112:0/2660400912 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c00ac5f0 con 0x7f37d015aa40 2024-09-15T23:58:33.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37cdd9b640 1 -- 172.21.15.112:0/2660400912 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c00ac9c0 con 0x7f37d015aa40 2024-09-15T23:58:33.728 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 -- 172.21.15.112:0/2660400912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d015aa40 msgr2=0x7f37d00b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:33.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 --2- 172.21.15.112:0/2660400912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d015aa40 0x7f37d00b4e70 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f37d00afd80 tx=0x7f37c001c520 comp rx=0 tx=0).stop 2024-09-15T23:58:33.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 -- 172.21.15.112:0/2660400912 shutdown_connections 2024-09-15T23:58:33.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 --2- 172.21.15.112:0/2660400912 >> v2:172.21.15.169:3300/0 conn(0x7f37d00adae0 0x7f37d00adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 --2- 172.21.15.112:0/2660400912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d015aa40 0x7f37d00b4e70 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 -- 172.21.15.112:0/2660400912 >> 172.21.15.112:0/2660400912 conn(0x7f37d0075200 msgr2=0x7f37d0075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:33.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 -- 172.21.15.112:0/2660400912 shutdown_connections 2024-09-15T23:58:33.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 -- 172.21.15.112:0/2660400912 wait complete. 2024-09-15T23:58:33.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 Processor -- start 2024-09-15T23:58:33.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 -- start start 2024-09-15T23:58:33.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d00adae0 0x7f37d0144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37d015aa40 0x7f37d0158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37d0147b70 0x7f37d0159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f37d006d080 con 0x7f37d00adae0 2024-09-15T23:58:33.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f37d006cf00 con 0x7f37d015aa40 2024-09-15T23:58:33.731 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f37d006d200 con 0x7f37d0147b70 2024-09-15T23:58:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37ce59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d00adae0 0x7f37d0144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37ce59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d00adae0 0x7f37d0144a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60136/0 (socket says 172.21.15.112:60136) 2024-09-15T23:58:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37ce59c640 1 -- 172.21.15.112:0/4226380314 learned_addr learned my addr 172.21.15.112:0/4226380314 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37ce59c640 1 -- 172.21.15.112:0/4226380314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37d0147b70 msgr2=0x7f37d0159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37ce59c640 1 --2- 172.21.15.112:0/4226380314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37d0147b70 0x7f37d0159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37ce59c640 1 -- 172.21.15.112:0/4226380314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37d015aa40 msgr2=0x7f37d0158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37ce59c640 1 --2- 172.21.15.112:0/4226380314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37d015aa40 0x7f37d0158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37ce59c640 1 -- 172.21.15.112:0/4226380314 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d015a270 con 0x7f37d00adae0 2024-09-15T23:58:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37ce59c640 1 --2- 172.21.15.112:0/4226380314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d00adae0 0x7f37d0144a80 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f37c001ca00 tx=0x7f37c00192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37c77fe640 1 -- 172.21.15.112:0/4226380314 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c00bc070 con 0x7f37d00adae0 2024-09-15T23:58:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37c77fe640 1 -- 172.21.15.112:0/4226380314 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c00ab5a0 con 0x7f37d00adae0 2024-09-15T23:58:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 -- 172.21.15.112:0/4226380314 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d014a5b0 con 0x7f37d00adae0 2024-09-15T23:58:33.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37c77fe640 1 -- 172.21.15.112:0/4226380314 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c00b1070 con 0x7f37d00adae0 2024-09-15T23:58:33.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.729+0000 7f37d4eea640 1 -- 172.21.15.112:0/4226380314 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d0159d50 con 0x7f37d00adae0 2024-09-15T23:58:33.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37c77fe640 1 -- 172.21.15.112:0/4226380314 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f37c00bf070 con 0x7f37d00adae0 2024-09-15T23:58:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37c77fe640 1 --2- 172.21.15.112:0/4226380314 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f37b00678f0 0x7f37b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37c77fe640 1 -- 172.21.15.112:0/4226380314 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f37c011f9d0 con 0x7f37d00adae0 2024-09-15T23:58:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37c5d9b640 1 --2- 172.21.15.112:0/4226380314 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f37b00678f0 0x7f37b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37c5d9b640 1 --2- 172.21.15.112:0/4226380314 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f37b00678f0 0x7f37b0069db0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f37b8000f70 tx=0x7f37b80079e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37d7fa6000 1 Processor -- start 2024-09-15T23:58:33.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37d7fa6000 1 -- start start 2024-09-15T23:58:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37d7fa6000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b0b20 0x55fa109b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37d7fa6000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa109b1440 0x55fa10966d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37d7fa6000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa10967290 0x55fa10967670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37d7fa6000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fa1084eb60 con 0x55fa109b0b20 2024-09-15T23:58:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37d7fa6000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fa107b5c70 con 0x55fa109b1440 2024-09-15T23:58:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37d7fa6000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55fa1075bed0 con 0x55fa10967290 2024-09-15T23:58:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37ce59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b0b20 0x55fa109b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37ce59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b0b20 0x55fa109b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60144/0 (socket says 172.21.15.112:60144) 2024-09-15T23:58:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37ce59c640 1 -- 172.21.15.112:0/3268471502 learned_addr learned my addr 172.21.15.112:0/3268471502 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37ce59c640 1 -- 172.21.15.112:0/3268471502 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa10967290 msgr2=0x55fa10967670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37ce59c640 1 --2- 172.21.15.112:0/3268471502 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa10967290 0x55fa10967670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37ce59c640 1 -- 172.21.15.112:0/3268471502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa109b1440 msgr2=0x55fa10966d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37c5d9b640 1 --2- 172.21.15.112:0/3268471502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa109b1440 0x55fa10966d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37ce59c640 1 --2- 172.21.15.112:0/3268471502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa109b1440 0x55fa10966d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37ce59c640 1 -- 172.21.15.112:0/3268471502 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa1076de50 con 0x55fa109b0b20 2024-09-15T23:58:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37ce59c640 1 --2- 172.21.15.112:0/3268471502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b0b20 0x55fa109b0f00 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f37c00ebf80 tx=0x7f37c00ac6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733a9674c9ef1b43 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.733+0000 7f37affff640 1 -- 172.21.15.112:0/3268471502 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c00f8700 con 0x55fa109b0b20 2024-09-15T23:58:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37affff640 1 -- 172.21.15.112:0/3268471502 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c00f0e50 con 0x55fa109b0b20 2024-09-15T23:58:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37affff640 1 -- 172.21.15.112:0/3268471502 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c00ec190 con 0x55fa109b0b20 2024-09-15T23:58:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 -- 172.21.15.112:0/3268471502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b0b20 msgr2=0x55fa109b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/3268471502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b0b20 0x55fa109b0f00 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f37c00ebf80 tx=0x7f37c00ac6f0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 -- 172.21.15.112:0/3268471502 shutdown_connections 2024-09-15T23:58:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/3268471502 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa10967290 0x55fa10967670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/3268471502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa109b1440 0x55fa10966d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/3268471502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b0b20 0x55fa109b0f00 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 -- 172.21.15.112:0/3268471502 >> 172.21.15.112:0/3268471502 conn(0x55fa1096d600 msgr2=0x55fa10965630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 -- 172.21.15.112:0/3268471502 shutdown_connections 2024-09-15T23:58:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 -- 172.21.15.112:0/3268471502 wait complete. 2024-09-15T23:58:33.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 -- start start 2024-09-15T23:58:33.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 Processor -- start 2024-09-15T23:58:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa109b0b20 0x55fa1096bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b1440 0x55fa1096c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa10971cf0 0x55fa109720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fa10817b00 con 0x55fa109b1440 2024-09-15T23:58:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fa10790360 con 0x55fa10971cf0 2024-09-15T23:58:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55fa1078d2d0 con 0x55fa109b0b20 2024-09-15T23:58:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 10 client.0 _ll_register_callbacks cb 0x55fa10952820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:58:33.742 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37c5d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b1440 0x55fa1096c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37c5d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b1440 0x55fa1096c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60148/0 (socket says 172.21.15.112:60148) 2024-09-15T23:58:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37c5d9b640 1 -- 172.21.15.112:0/567599338 learned_addr learned my addr 172.21.15.112:0/567599338 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37ce59c640 1 --2- 172.21.15.112:0/567599338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa109b0b20 0x55fa1096bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37ced9d640 1 --2- 172.21.15.112:0/567599338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa10971cf0 0x55fa109720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37c5d9b640 1 -- 172.21.15.112:0/567599338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa109b0b20 msgr2=0x55fa1096bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37c5d9b640 1 --2- 172.21.15.112:0/567599338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa109b0b20 0x55fa1096bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37c5d9b640 1 -- 172.21.15.112:0/567599338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa10971cf0 msgr2=0x55fa109720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37c5d9b640 1 --2- 172.21.15.112:0/567599338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa10971cf0 0x55fa109720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37c5d9b640 1 -- 172.21.15.112:0/567599338 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa1075c120 con 0x55fa109b1440 2024-09-15T23:58:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37c5d9b640 1 --2- 172.21.15.112:0/567599338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b1440 0x55fa1096c150 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f37b8007c20 tx=0x7f37b8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a5d2949cb34178 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:58:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37ad7fa640 1 -- 172.21.15.112:0/567599338 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b8005310 con 0x55fa109b1440 2024-09-15T23:58:33.743 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 -- 172.21.15.112:0/567599338 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37c00f0e50 con 0x55fa109b1440 2024-09-15T23:58:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37ad7fa640 1 -- 172.21.15.112:0/567599338 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f37b8022d20 con 0x55fa109b1440 2024-09-15T23:58:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37ad7fa640 1 -- 172.21.15.112:0/567599338 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f37b8003600 con 0x55fa109b1440 2024-09-15T23:58:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 10 client.6990 fetch_fsmap learned FSMap version 64 2024-09-15T23:58:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 -- 172.21.15.112:0/567599338 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) -- 0x55fa10755450 con 0x55fa109b1440 2024-09-15T23:58:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37ad7fa640 1 -- 172.21.15.112:0/567599338 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c00f0e50 con 0x55fa109b1440 2024-09-15T23:58:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37ad7fa640 1 -- 172.21.15.112:0/567599338 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 64) ==== 3502+0+0 (secure 0 0 0) 0x7f37b8029050 con 0x55fa109b1440 2024-09-15T23:58:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 10 client.6990 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:58:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 10 client.6990 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:58:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 20 client.6990 populate_metadata read hostname 'smithi112' 2024-09-15T23:58:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/567599338 >> [v2:172.21.15.112:6834/960124820,v1:172.21.15.112:6835/960124820] conn(0x55fa109bf280 0x55fa109c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 4 client.6990 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:58:33.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37d7fa6000 1 -- 172.21.15.112:0/567599338 --> [v2:172.21.15.112:6834/960124820,v1:172.21.15.112:6835/960124820] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa1074fc00 con 0x55fa109bf280 2024-09-15T23:58:33.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37ce59c640 1 --2- 172.21.15.112:0/567599338 >> [v2:172.21.15.112:6834/960124820,v1:172.21.15.112:6835/960124820] conn(0x55fa109bf280 0x55fa109c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37ad7fa640 10 client.6990 ms_handle_connect on v2:172.21.15.112:6834/960124820 2024-09-15T23:58:33.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.737+0000 7f37ce59c640 1 --2- 172.21.15.112:0/567599338 >> [v2:172.21.15.112:6834/960124820,v1:172.21.15.112:6835/960124820] conn(0x55fa109bf280 0x55fa109c1670 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=403f9f80a1042525 server_cookie=2d759f345478949b in_seq=0 out_seq=0 2024-09-15T23:58:33.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37ad7fa640 1 -- 172.21.15.112:0/567599338 <== mds.0 v2:172.21.15.112:6834/960124820 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa1074fc00 con 0x55fa109bf280 2024-09-15T23:58:33.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37ad7fa640 10 client.6990 handle_command_reply: tid=0 2024-09-15T23:58:33.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37d7fa6000 1 client.6990 shutdown 2024-09-15T23:58:33.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37d7fa6000 1 -- 172.21.15.112:0/567599338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b1440 msgr2=0x55fa1096c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:33.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/567599338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b1440 0x55fa1096c150 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f37b8007c20 tx=0x7f37b8000ee0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37d7fa6000 1 -- 172.21.15.112:0/567599338 shutdown_connections 2024-09-15T23:58:33.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/567599338 >> [v2:172.21.15.112:6834/960124820,v1:172.21.15.112:6835/960124820] conn(0x55fa109bf280 0x55fa109c1670 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/567599338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa10971cf0 0x55fa109720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37ad7fa640 0 client.6990 ms_handle_reset on v2:172.21.15.112:6834/960124820 2024-09-15T23:58:33.745 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/567599338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b1440 0x55fa1096c150 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/567599338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa109b0b20 0x55fa1096bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37d7fa6000 1 -- 172.21.15.112:0/567599338 >> 172.21.15.112:0/567599338 conn(0x55fa10967290 msgr2=0x55fa10965d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:33.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37d7fa6000 1 -- 172.21.15.112:0/567599338 shutdown_connections 2024-09-15T23:58:33.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37d7fa6000 1 -- 172.21.15.112:0/567599338 wait complete. 2024-09-15T23:58:33.746 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.741+0000 7f37d7fa6000 20 client.6990 trim_cache size 0 max 16384 2024-09-15T23:58:33.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.757+0000 7f37d7fa6000 1 Processor -- start 2024-09-15T23:58:33.759 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.757+0000 7f37d7fa6000 1 -- start start 2024-09-15T23:58:33.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa10971cf0 0x55fa109afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa109b0b20 0x55fa109b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b1440 0x55fa109c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f37d0203400 con 0x55fa109b1440 2024-09-15T23:58:33.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f37d00b0d90 con 0x55fa10971cf0 2024-09-15T23:58:33.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f37d0202d30 con 0x55fa109b0b20 2024-09-15T23:58:33.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ced9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b1440 0x55fa109c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ced9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b1440 0x55fa109c1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60160/0 (socket says 172.21.15.112:60160) 2024-09-15T23:58:33.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ced9d640 1 -- 172.21.15.112:0/2386121375 learned_addr learned my addr 172.21.15.112:0/2386121375 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:33.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ce59c640 1 --2- 172.21.15.112:0/2386121375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa10971cf0 0x55fa109afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37c5d9b640 1 --2- 172.21.15.112:0/2386121375 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa109b0b20 0x55fa109b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ced9d640 1 -- 172.21.15.112:0/2386121375 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa109b0b20 msgr2=0x55fa109b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:33.761 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ced9d640 1 --2- 172.21.15.112:0/2386121375 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa109b0b20 0x55fa109b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ced9d640 1 -- 172.21.15.112:0/2386121375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa10971cf0 msgr2=0x55fa109afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:33.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ced9d640 1 --2- 172.21.15.112:0/2386121375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa10971cf0 0x55fa109afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ced9d640 1 -- 172.21.15.112:0/2386121375 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa1073cfd0 con 0x55fa109b1440 2024-09-15T23:58:33.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ced9d640 1 --2- 172.21.15.112:0/2386121375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b1440 0x55fa109c1670 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f37c80099b0 tx=0x7f37c8009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f3d0a0523fdad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:33.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37af7fe640 1 -- 172.21.15.112:0/2386121375 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c8019070 con 0x55fa109b1440 2024-09-15T23:58:33.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37af7fe640 1 -- 172.21.15.112:0/2386121375 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c8014400 con 0x55fa109b1440 2024-09-15T23:58:33.762 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37af7fe640 1 -- 172.21.15.112:0/2386121375 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c80147f0 con 0x55fa109b1440 2024-09-15T23:58:33.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 -- 172.21.15.112:0/2386121375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b1440 msgr2=0x55fa109c1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:33.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/2386121375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b1440 0x55fa109c1670 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f37c80099b0 tx=0x7f37c8009e70 comp rx=0 tx=0).stop 2024-09-15T23:58:33.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 -- 172.21.15.112:0/2386121375 shutdown_connections 2024-09-15T23:58:33.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/2386121375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa109b1440 0x55fa109c1670 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/2386121375 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa109b0b20 0x55fa109b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/2386121375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa10971cf0 0x55fa109afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 -- 172.21.15.112:0/2386121375 >> 172.21.15.112:0/2386121375 conn(0x55fa10967290 msgr2=0x55fa1096b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:33.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 -- 172.21.15.112:0/2386121375 shutdown_connections 2024-09-15T23:58:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 -- 172.21.15.112:0/2386121375 wait complete. 2024-09-15T23:58:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 -- start start 2024-09-15T23:58:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 Processor -- start 2024-09-15T23:58:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa10971cf0 0x55fa109c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa109b0b20 0x55fa109df960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa109b1440 0x55fa109dfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fa107b4f80 con 0x55fa10971cf0 2024-09-15T23:58:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fa1076dca0 con 0x55fa109b0b20 2024-09-15T23:58:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55fa107740f0 con 0x55fa109b1440 2024-09-15T23:58:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37d7fa6000 10 client.0 _ll_register_callbacks cb 0x7f37b8007cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:58:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ce59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa10971cf0 0x55fa109c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ce59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa10971cf0 0x55fa109c4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60172/0 (socket says 172.21.15.112:60172) 2024-09-15T23:58:33.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ce59c640 1 -- 172.21.15.112:0/2356580063 learned_addr learned my addr 172.21.15.112:0/2356580063 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ce59c640 1 -- 172.21.15.112:0/2356580063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa109b1440 msgr2=0x55fa109dfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ce59c640 1 --2- 172.21.15.112:0/2356580063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa109b1440 0x55fa109dfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ce59c640 1 -- 172.21.15.112:0/2356580063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa109b0b20 msgr2=0x55fa109df960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ce59c640 1 --2- 172.21.15.112:0/2356580063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa109b0b20 0x55fa109df960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ce59c640 1 -- 172.21.15.112:0/2356580063 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa10838750 con 0x55fa10971cf0 2024-09-15T23:58:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ce59c640 1 --2- 172.21.15.112:0/2356580063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa10971cf0 0x55fa109c4aa0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f37c00eddd0 tx=0x7f37c00efa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0aa1a9d9cce1306 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:58:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.761+0000 7f37ad7fa640 1 -- 172.21.15.112:0/2356580063 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c00f0e50 con 0x55fa10971cf0 2024-09-15T23:58:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 -- 172.21.15.112:0/2356580063 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37c8014400 con 0x55fa10971cf0 2024-09-15T23:58:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37ad7fa640 1 -- 172.21.15.112:0/2356580063 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f37c00ec190 con 0x55fa10971cf0 2024-09-15T23:58:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37ad7fa640 1 -- 172.21.15.112:0/2356580063 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f37c00eef70 con 0x55fa10971cf0 2024-09-15T23:58:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 10 client.6996 fetch_fsmap learned FSMap version 64 2024-09-15T23:58:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 -- 172.21.15.112:0/2356580063 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) -- 0x55fa10743a30 con 0x55fa10971cf0 2024-09-15T23:58:33.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37ad7fa640 1 -- 172.21.15.112:0/2356580063 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c8014400 con 0x55fa10971cf0 2024-09-15T23:58:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37ad7fa640 1 -- 172.21.15.112:0/2356580063 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 64) ==== 3502+0+0 (secure 0 0 0) 0x7f37c00ab070 con 0x55fa10971cf0 2024-09-15T23:58:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 10 client.6996 fetch_fsmap finished waiting for FSMap version 64 2024-09-15T23:58:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 10 client.6996 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:58:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 20 client.6996 populate_metadata read hostname 'smithi112' 2024-09-15T23:58:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/2356580063 >> [v2:172.21.15.112:6834/960124820,v1:172.21.15.112:6835/960124820] conn(0x55fa109e03e0 0x55fa10a23bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 4 client.6996 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:58:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 -- 172.21.15.112:0/2356580063 --> [v2:172.21.15.112:6834/960124820,v1:172.21.15.112:6835/960124820] -- command(tid 0: {"prefix": "status"}) -- 0x55fa107c33a0 con 0x55fa109e03e0 2024-09-15T23:58:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37c5d9b640 1 --2- 172.21.15.112:0/2356580063 >> [v2:172.21.15.112:6834/960124820,v1:172.21.15.112:6835/960124820] conn(0x55fa109e03e0 0x55fa10a23bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37ad7fa640 10 client.6996 ms_handle_connect on v2:172.21.15.112:6834/960124820 2024-09-15T23:58:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37c5d9b640 1 --2- 172.21.15.112:0/2356580063 >> [v2:172.21.15.112:6834/960124820,v1:172.21.15.112:6835/960124820] conn(0x55fa109e03e0 0x55fa10a23bb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ec8bdeedf39fe61 server_cookie=d143d94835d00df4 in_seq=0 out_seq=0 2024-09-15T23:58:33.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37ad7fa640 1 -- 172.21.15.112:0/2356580063 <== mds.0 v2:172.21.15.112:6834/960124820 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55fa107c33a0 con 0x55fa109e03e0 2024-09-15T23:58:33.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37ad7fa640 10 client.6996 handle_command_reply: tid=0 2024-09-15T23:58:33.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 client.6996 shutdown 2024-09-15T23:58:33.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 -- 172.21.15.112:0/2356580063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa10971cf0 msgr2=0x55fa109c4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:33.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/2356580063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa10971cf0 0x55fa109c4aa0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f37c00eddd0 tx=0x7f37c00efa20 comp rx=0 tx=0).stop 2024-09-15T23:58:33.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 -- 172.21.15.112:0/2356580063 shutdown_connections 2024-09-15T23:58:33.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/2356580063 >> [v2:172.21.15.112:6834/960124820,v1:172.21.15.112:6835/960124820] conn(0x55fa109e03e0 0x55fa10a23bb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/2356580063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fa109b1440 0x55fa109dfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/2356580063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fa109b0b20 0x55fa109df960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37ad7fa640 0 client.6996 ms_handle_reset on v2:172.21.15.112:6834/960124820 2024-09-15T23:58:33.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 --2- 172.21.15.112:0/2356580063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fa10971cf0 0x55fa109c4aa0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 -- 172.21.15.112:0/2356580063 >> 172.21.15.112:0/2356580063 conn(0x55fa10967290 msgr2=0x55fa109aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:33.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 -- 172.21.15.112:0/2356580063 shutdown_connections 2024-09-15T23:58:33.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 1 -- 172.21.15.112:0/2356580063 wait complete. 2024-09-15T23:58:33.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d7fa6000 20 client.6996 trim_cache size 0 max 16384 2024-09-15T23:58:33.771 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:58:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "1af6b673-4d40-4109-af4e-78662faa7df8", 2024-09-15T23:58:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-15T23:58:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 6936, 2024-09-15T23:58:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-15T23:58:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-15T23:58:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-15T23:58:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 6.2063773869999999, 2024-09-15T23:58:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 64, 2024-09-15T23:58:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 103, 2024-09-15T23:58:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 101, 2024-09-15T23:58:33.771 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 10.225036960000001 2024-09-15T23:58:33.771 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:58:33.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d4eea640 1 -- 172.21.15.112:0/4226380314 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f37b00678f0 msgr2=0x7f37b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:33.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d4eea640 1 --2- 172.21.15.112:0/4226380314 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f37b00678f0 0x7f37b0069db0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f37b8000f70 tx=0x7f37b80079e0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d4eea640 1 -- 172.21.15.112:0/4226380314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d00adae0 msgr2=0x7f37d0144a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:33.772 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d4eea640 1 --2- 172.21.15.112:0/4226380314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d00adae0 0x7f37d0144a80 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f37c001ca00 tx=0x7f37c00192c0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d4eea640 1 -- 172.21.15.112:0/4226380314 shutdown_connections 2024-09-15T23:58:33.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d4eea640 1 --2- 172.21.15.112:0/4226380314 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f37b00678f0 0x7f37b0069db0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d4eea640 1 --2- 172.21.15.112:0/4226380314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37d0147b70 0x7f37d0159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d4eea640 1 --2- 172.21.15.112:0/4226380314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37d015aa40 0x7f37d0158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d4eea640 1 --2- 172.21.15.112:0/4226380314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37d00adae0 0x7f37d0144a80 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:33.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d4eea640 1 -- 172.21.15.112:0/4226380314 >> 172.21.15.112:0/4226380314 conn(0x7f37d0075200 msgr2=0x7f37d01515c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:33.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d4eea640 1 -- 172.21.15.112:0/4226380314 shutdown_connections 2024-09-15T23:58:33.773 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:33.765+0000 7f37d4eea640 1 -- 172.21.15.112:0/4226380314 wait complete. 2024-09-15T23:58:33.782 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-15T23:58:33.782 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:58:33.782 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:58:33.782 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:58:33.782 DEBUG:teuthology.orchestra.run.smithi112:> subdir = "delete_me" 2024-09-15T23:58:33.782 DEBUG:teuthology.orchestra.run.smithi112:> size_unit = 1024 2024-09-15T23:58:33.783 DEBUG:teuthology.orchestra.run.smithi112:> file_multiplier = 200 2024-09-15T23:58:33.783 DEBUG:teuthology.orchestra.run.smithi112:> os.mkdir(os.path.join(mountpoint, subdir)) 2024-09-15T23:58:33.783 DEBUG:teuthology.orchestra.run.smithi112:> for i in range(0, file_multiplier): 2024-09-15T23:58:33.783 DEBUG:teuthology.orchestra.run.smithi112:> for size in range(0, 16*size_unit, size_unit): 2024-09-15T23:58:33.783 DEBUG:teuthology.orchestra.run.smithi112:> filename = "{0}_{1}.bin".format(i, size // size_unit) 2024-09-15T23:58:33.783 DEBUG:teuthology.orchestra.run.smithi112:> with open(os.path.join(mountpoint, subdir, filename), '"'"'w'"'"') as f: 2024-09-15T23:58:33.783 DEBUG:teuthology.orchestra.run.smithi112:> f.write(size * '"'"'x'"'"') 2024-09-15T23:58:33.783 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:58:34.428 INFO:tasks.ceph.mds.c.smithi112.stderr:2024-09-15T23:58:34.429+0000 7f7bae0ae640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:58:40.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:58:40.587 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_purge_ops 2024-09-15T23:58:40.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:40.587 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -rf delete_me) 2024-09-15T23:58:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:{"mds_max_purge_ops":"100000000"} 2024-09-15T23:58:40.772 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_purge_ops": "100000000" } 2024-09-15T23:58:40.773 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config get mds_max_purge_files 2024-09-15T23:58:40.920 INFO:teuthology.orchestra.run.smithi169.stdout:{"mds_max_purge_files":"6"} 2024-09-15T23:58:40.920 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_purge_files": "6" } 2024-09-15T23:58:40.920 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:41.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.044+0000 7f0186e3c640 1 Processor -- start 2024-09-15T23:58:41.046 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.044+0000 7f0186e3c640 1 -- start start 2024-09-15T23:58:41.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.044+0000 7f0186e3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f018006fad0 0x7f0180072780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:41.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.044+0000 7f0186e3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800734c0 0x7f0180072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:41.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.044+0000 7f0186e3c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f018006ea30 con 0x7f018015c2b0 2024-09-15T23:58:41.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.044+0000 7f0186e3c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f018006ed10 con 0x7f018006fad0 2024-09-15T23:58:41.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f0186e3c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f018006eff0 con 0x7f01800734c0 2024-09-15T23:58:41.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f01853d9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800734c0 0x7f0180072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:41.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f017ffff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f018006fad0 0x7f0180072780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:41.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f0184bd8640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f018015c2b0 0x7f018006e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:37034/0 (socket says 172.21.15.112:37034) 2024-09-15T23:58:41.048 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f01853d9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800734c0 0x7f0180072cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:35334/0 (socket says 172.21.15.112:35334) 2024-09-15T23:58:41.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f0184bd8640 1 -- 172.21.15.112:0/3973516697 learned_addr learned my addr 172.21.15.112:0/3973516697 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:41.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f01853d9640 1 -- 172.21.15.112:0/3973516697 >> v2:172.21.15.169:3300/0 conn(0x7f018006fad0 msgr2=0x7f0180072780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:41.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f01853d9640 1 --2- 172.21.15.112:0/3973516697 >> v2:172.21.15.169:3300/0 conn(0x7f018006fad0 0x7f0180072780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:41.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f01853d9640 1 -- 172.21.15.112:0/3973516697 >> v1:172.21.15.169:6789/0 conn(0x7f018015c2b0 legacy=0x7f018006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:41.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f01853d9640 1 -- 172.21.15.112:0/3973516697 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018006f2d0 con 0x7f01800734c0 2024-09-15T23:58:41.049 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f017ffff640 1 --2- 172.21.15.112:0/3973516697 >> v2:172.21.15.169:3300/0 conn(0x7f018006fad0 0x7f0180072780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:58:41.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f01853d9640 1 --2- 172.21.15.112:0/3973516697 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800734c0 0x7f0180072cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0178009d90 tx=0x7f017801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7290f67b4c0a2ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:41.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f017f7fe640 1 -- 172.21.15.112:0/3973516697 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01780b2070 con 0x7f01800734c0 2024-09-15T23:58:41.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f017f7fe640 1 -- 172.21.15.112:0/3973516697 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01780a5990 con 0x7f01800734c0 2024-09-15T23:58:41.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.048+0000 7f017f7fe640 1 -- 172.21.15.112:0/3973516697 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01780a5d60 con 0x7f01800734c0 2024-09-15T23:58:41.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 -- 172.21.15.112:0/3973516697 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800734c0 msgr2=0x7f0180072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:41.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 --2- 172.21.15.112:0/3973516697 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800734c0 0x7f0180072cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0178009d90 tx=0x7f017801c8b0 comp rx=0 tx=0).stop 2024-09-15T23:58:41.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 -- 172.21.15.112:0/3973516697 shutdown_connections 2024-09-15T23:58:41.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 --2- 172.21.15.112:0/3973516697 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800734c0 0x7f0180072cc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:41.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 --2- 172.21.15.112:0/3973516697 >> v2:172.21.15.169:3300/0 conn(0x7f018006fad0 0x7f0180072780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:41.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 -- 172.21.15.112:0/3973516697 >> 172.21.15.112:0/3973516697 conn(0x7f01800b2820 msgr2=0x7f01800b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:41.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 -- 172.21.15.112:0/3973516697 shutdown_connections 2024-09-15T23:58:41.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 -- 172.21.15.112:0/3973516697 wait complete. 2024-09-15T23:58:41.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 Processor -- start 2024-09-15T23:58:41.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 -- start start 2024-09-15T23:58:41.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f018006fad0 0x7f0180143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:41.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01800734c0 0x7f0180153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:41.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f018015c2b0 0x7f018014c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:41.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f018015d230 con 0x7f01800734c0 2024-09-15T23:58:41.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f018015d0b0 con 0x7f018006fad0 2024-09-15T23:58:41.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f0186e3c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f018015d3b0 con 0x7f018015c2b0 2024-09-15T23:58:41.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f017ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01800734c0 0x7f0180153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:41.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f017ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01800734c0 0x7f0180153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54686/0 (socket says 172.21.15.112:54686) 2024-09-15T23:58:41.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.052+0000 7f017ffff640 1 -- 172.21.15.112:0/3460407613 learned_addr learned my addr 172.21.15.112:0/3460407613 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:41.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f01853d9640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f018015c2b0 0x7f018014c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:41.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f0184bd8640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f018006fad0 0x7f0180143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:41.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f017ffff640 1 -- 172.21.15.112:0/3460407613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f018015c2b0 msgr2=0x7f018014c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:41.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f017ffff640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f018015c2b0 0x7f018014c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:41.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f017ffff640 1 -- 172.21.15.112:0/3460407613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f018006fad0 msgr2=0x7f0180143f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:41.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f017ffff640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f018006fad0 0x7f0180143f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:41.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f017ffff640 1 -- 172.21.15.112:0/3460407613 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018014b0e0 con 0x7f01800734c0 2024-09-15T23:58:41.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f0184bd8640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f018006fad0 0x7f0180143f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:41.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f017ffff640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01800734c0 0x7f0180153330 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f016c00e9b0 tx=0x7f016c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:41.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f017d7fa640 1 -- 172.21.15.112:0/3460407613 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c017070 con 0x7f01800734c0 2024-09-15T23:58:41.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f017d7fa640 1 -- 172.21.15.112:0/3460407613 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016c00ca00 con 0x7f01800734c0 2024-09-15T23:58:41.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f0186e3c640 1 -- 172.21.15.112:0/3460407613 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018014b3c0 con 0x7f01800734c0 2024-09-15T23:58:41.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f0186e3c640 1 -- 172.21.15.112:0/3460407613 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f018014b980 con 0x7f01800734c0 2024-09-15T23:58:41.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f017d7fa640 1 -- 172.21.15.112:0/3460407613 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c00cdd0 con 0x7f01800734c0 2024-09-15T23:58:41.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f0186e3c640 1 -- 172.21.15.112:0/3460407613 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01600052a0 con 0x7f01800734c0 2024-09-15T23:58:41.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f017d7fa640 1 -- 172.21.15.112:0/3460407613 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f016c01a070 con 0x7f01800734c0 2024-09-15T23:58:41.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f017d7fa640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f01640678f0 0x7f0164069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:41.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f017d7fa640 1 -- 172.21.15.112:0/3460407613 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f016c086140 con 0x7f01800734c0 2024-09-15T23:58:41.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f0184bd8640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f01640678f0 0x7f0164069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:41.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.056+0000 7f0184bd8640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f01640678f0 0x7f0164069db0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f01801f8400 tx=0x7f0174009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:41.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.068+0000 7f017d7fa640 1 -- 172.21.15.112:0/3460407613 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f016c056a30 con 0x7f01800734c0 2024-09-15T23:58:41.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.292+0000 7f0186e3c640 1 -- 172.21.15.112:0/3460407613 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0160005860 con 0x7f01800734c0 2024-09-15T23:58:41.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.292+0000 7f017d7fa640 1 -- 172.21.15.112:0/3460407613 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7f016c056330 con 0x7f01800734c0 2024-09-15T23:58:41.294 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:41.294 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:41.294 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:41.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.296+0000 7f0186e3c640 1 -- 172.21.15.112:0/3460407613 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f01640678f0 msgr2=0x7f0164069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:41.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.296+0000 7f0186e3c640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f01640678f0 0x7f0164069db0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f01801f8400 tx=0x7f0174009040 comp rx=0 tx=0).stop 2024-09-15T23:58:41.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.296+0000 7f0186e3c640 1 -- 172.21.15.112:0/3460407613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01800734c0 msgr2=0x7f0180153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:41.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.296+0000 7f0186e3c640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01800734c0 0x7f0180153330 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f016c00e9b0 tx=0x7f016c00ee70 comp rx=0 tx=0).stop 2024-09-15T23:58:41.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.296+0000 7f0186e3c640 1 -- 172.21.15.112:0/3460407613 shutdown_connections 2024-09-15T23:58:41.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.296+0000 7f0186e3c640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f01640678f0 0x7f0164069db0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:41.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.296+0000 7f0186e3c640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f018015c2b0 0x7f018014c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:41.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.296+0000 7f0186e3c640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01800734c0 0x7f0180153330 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:41.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.296+0000 7f0186e3c640 1 --2- 172.21.15.112:0/3460407613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f018006fad0 0x7f0180143f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:41.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.296+0000 7f0186e3c640 1 -- 172.21.15.112:0/3460407613 >> 172.21.15.112:0/3460407613 conn(0x7f01800b2820 msgr2=0x7f01800724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:41.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.296+0000 7f0186e3c640 1 -- 172.21.15.112:0/3460407613 shutdown_connections 2024-09-15T23:58:41.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:41.296+0000 7f0186e3c640 1 -- 172.21.15.112:0/3460407613 wait complete. 2024-09-15T23:58:41.316 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-15T23:58:41.473 INFO:teuthology.orchestra.run.smithi112.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":4464,"msgr_send_messages":10455,"msgr_recv_bytes":1573542,"msgr_send_bytes":6027651,"msgr_created_connections":10,"msgr_active_connections":2,"msgr_running_total_time":0.459224691,"msgr_running_send_time":0.245282710,"msgr_running_recv_time":0.252367158,"msgr_running_fast_dispatch_time":0.000774632,"msgr_send_messages_queue_lat":{"avgcount":10454,"sum":0.182588573,"avgtime":0.000017465},"msgr_handle_ack_lat":{"avgcount":14766,"sum":0.002042737,"avgtime":0.000000138},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":48,"msgr_send_messages":54,"msgr_recv_bytes":20307,"msgr_send_bytes":8836229,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.028980861,"msgr_running_send_time":0.017483988,"msgr_running_recv_time":0.004919972,"msgr_running_fast_dispatch_time":0.005995152,"msgr_send_messages_queue_lat":{"avgcount":52,"sum":0.009369555,"avgtime":0.000180183},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":93728},"AsyncMessenger::Worker-2":{"msgr_recv_messages":35,"msgr_send_messages":30,"msgr_recv_bytes":112351,"msgr_send_bytes":11445,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.006421765,"msgr_running_send_time":0.001403587,"msgr_running_recv_time":0.006320439,"msgr_running_fast_dispatch_time":0.000367586,"msgr_send_messages_queue_lat":{"avgcount":29,"sum":0.006471990,"avgtime":0.000223172},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":107104,"msgr_send_encrypted_bytes":7792},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":512,"complete_latency":{"avgcount":76,"sum":1.057936676,"avgtime":0.013920219}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000081109,"avgtime":0.000020277}},"mds":{"request":3287,"reply":3284,"reply_latency":{"avgcount":3284,"sum":4.089336975,"avgtime":0.001245230},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":3211,"inodes_top":0,"inodes_bottom":3211,"inodes_pin_tail":0,"inodes_pinned":3211,"inodes_expired":0,"inodes_with_caps":3202,"caps":3202,"subtrees":2,"traverse":3293,"traverse_hit":3292,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":3011,"root_rbytes":384000,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":51,"ceph_cap_op_grant":3198,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1152,"handle_client_caps_dirty":1074,"handle_client_cap_release":0,"process_request_cap_release":3351},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":75,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":75,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":4431,"evex":0,"evtrm":0,"ev":4434,"evexg":0,"evexd":0,"segadd":6,"segex":0,"segtrm":0,"seg":8,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":12948568,"rdpos":4195244,"jlat":{"avgcount":12,"sum":0.066228713,"avgtime":0.005519059},"replayed":3},"mds_mem":{"ino":3214,"ino+":3214,"ino-":0,"dir":13,"dir+":13,"dir-":0,"dn":3285,"dn+":3285,"dn-":0,"cap":3202,"cap+":3202,"cap-":0,"rss":78716,"heap":248116},"mds_server":{"dispatch_client_request":3290,"dispatch_server_request":0,"handle_client_request":3287,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.501283897,"avgtime":0.001094151},"req_getattr_latency":{"avgcount":6,"sum":0.001946066,"avgtime":0.000324344},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004077767,"avgtime":0.004077767},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.251883026,"avgtime":0.083961008},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":74,"sum":0.330146219,"avgtime":0.004461435},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":3123,"average_load":3123,"avg_session_uptime":1041,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":3255843,"buffer_anon_items":1065,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6040,"osdmap_items":99,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":8093960,"mds_co_items":38932,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":65,"op_send_bytes":8726180,"op_resend":0,"op_reply":65,"op_latency":{"avgcount":65,"sum":0.231997680,"avgtime":0.003569195},"op_inflight":0,"oplen_avg":{"avgcount":65,"sum":120},"op":65,"op_r":36,"op_w":29,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":12,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":7,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":103,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":48,"omap_del":2},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":304,"max":104857600,"get_started":0,"get":4543,"get_sum":1294564,"get_or_fail_fail":0,"get_or_fail_success":4543,"take":0,"take_sum":0,"put":4542,"put_sum":1294260,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":65,"take_sum":8727299,"put":65,"put_sum":8727299,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":65,"take_sum":65,"put":65,"put_sum":65,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55eb22390a00":{"val":365656,"max":3758096384,"get_started":0,"get":4431,"get_sum":8752881,"get_or_fail_fail":0,"get_or_fail_success":4431,"take":0,"take_sum":0,"put":12,"put_sum":8387225,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T23:58:41.474 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 14766, "avgtime": 1.38e-07, "sum": 0.002042737 }, "msgr_recv_bytes": 1573542, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 4464, "msgr_running_fast_dispatch_time": 0.000774632, "msgr_running_recv_time": 0.252367158, "msgr_running_send_time": 0.24528271, "msgr_running_total_time": 0.459224691, "msgr_send_bytes": 6027651, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 10455, "msgr_send_messages_queue_lat": { "avgcount": 10454, "avgtime": 1.7465e-05, "sum": 0.182588573 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 20307, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 48, "msgr_running_fast_dispatch_time": 0.005995152, "msgr_running_recv_time": 0.004919972, "msgr_running_send_time": 0.017483988, "msgr_running_total_time": 0.028980861, "msgr_send_bytes": 8836229, "msgr_send_encrypted_bytes": 93728, "msgr_send_messages": 54, "msgr_send_messages_queue_lat": { "avgcount": 52, "avgtime": 0.000180183, "sum": 0.009369555 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 112351, "msgr_recv_encrypted_bytes": 107104, "msgr_recv_messages": 35, "msgr_running_fast_dispatch_time": 0.000367586, "msgr_running_recv_time": 0.006320439, "msgr_running_send_time": 0.001403587, "msgr_running_total_time": 0.006421765, "msgr_send_bytes": 11445, "msgr_send_encrypted_bytes": 7792, "msgr_send_messages": 30, "msgr_send_messages_queue_lat": { "avgcount": 29, "avgtime": 0.000223172, "sum": 0.00647199 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 76, "avgtime": 0.013920219, "sum": 1.057936676 }, "queue_len": 512 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.0277e-05, "sum": 8.1109e-05 }, "queue_len": 0 }, "mds": { "caps": 3202, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 3198, "ceph_cap_op_revoke": 51, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1152, "handle_client_caps_dirty": 1074, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 3211, "inodes_bottom": 3211, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 3211, "inodes_top": 0, "inodes_with_caps": 3202, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 3351, "q": 0, "reply": 3284, "reply_latency": { "avgcount": 3284, "avgtime": 0.00124523, "sum": 4.089336975 }, "request": 3287, "root_rbytes": 384000, "root_rfiles": 3011, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 3293, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 3292, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 75, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 75, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 4434, "evadd": 4431, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 12, "avgtime": 0.005519059, "sum": 0.066228713 }, "rdpos": 4195244, "replayed": 3, "seg": 8, "segadd": 6, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 12948568 }, "mds_mem": { "cap": 3202, "cap+": 3202, "cap-": 0, "dir": 13, "dir+": 13, "dir-": 0, "dn": 3285, "dn+": 3285, "dn-": 0, "heap": 248116, "ino": 3214, "ino+": 3214, "ino-": 0, "rss": 78716 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3290, "dispatch_server_request": 0, "handle_client_request": 3287, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001094151, "sum": 3.501283897 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.000324344, "sum": 0.001946066 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004077767, "sum": 0.004077767 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.083961008, "sum": 0.251883026 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 74, "avgtime": 0.004461435, "sum": 0.330146219 } }, "mds_sessions": { "average_load": 3123, "avg_session_uptime": 1041, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 3123 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 3255843, "buffer_anon_items": 1065, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 8093960, "mds_co_items": 38932, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6040, "osdmap_items": 99, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 103, "map_full": 0, "map_inc": 2, "omap_del": 2, "omap_rd": 48, "omap_wr": 15, "op": 65, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 65, "avgtime": 0.003569195, "sum": 0.23199768 }, "op_pg": 0, "op_r": 36, "op_reply": 65, "op_resend": 0, "op_rmw": 0, "op_send": 65, "op_send_bytes": 8726180, "op_w": 29, "oplen_avg": { "avgcount": 65, "sum": 120 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 7, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 12, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 4543, "get_or_fail_fail": 0, "get_or_fail_success": 4543, "get_started": 0, "get_sum": 1294564, "max": 104857600, "put": 4542, "put_sum": 1294260, "take": 0, "take_sum": 0, "val": 304, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 65, "put_sum": 8727299, "take": 65, "take_sum": 8727299, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 65, "put_sum": 65, "take": 65, "take_sum": 65, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55eb22390a00": { "get": 4431, "get_or_fail_fail": 0, "get_or_fail_success": 4431, "get_started": 0, "get_sum": 8752881, "max": 3758096384, "put": 12, "put_sum": 8387225, "take": 0, "take_sum": 0, "val": 365656, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T23:58:41.474 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/75, 0/75 2024-09-15T23:58:42.476 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:42.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77ea9ff640 1 Processor -- start 2024-09-15T23:58:42.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77ea9ff640 1 -- start start 2024-09-15T23:58:42.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77ea9ff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e4156680 0x7f77e40afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:42.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77ea9ff640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77e415d940 con 0x7f77e4156a60 2024-09-15T23:58:42.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77ea9ff640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77e415dc00 con 0x7f77e40b02f0 2024-09-15T23:58:42.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77ea9ff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f77e415a3c0 con 0x7f77e4156680 2024-09-15T23:58:42.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77e37fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f77e4156a60 0x7f77e4072780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58608/0 (socket says 172.21.15.112:58608) 2024-09-15T23:58:42.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77e37fe640 1 -- 172.21.15.112:0/1542505105 learned_addr learned my addr 172.21.15.112:0/1542505105 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:42.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77e3fff640 1 --2- 172.21.15.112:0/1542505105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e4156680 0x7f77e40afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:42.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77e2ffd640 1 -- 172.21.15.112:0/1542505105 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1813379018 0 0) 0x7f77e415d940 con 0x7f77e4156a60 2024-09-15T23:58:42.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77e2ffd640 1 -- 172.21.15.112:0/1542505105 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77cc003530 con 0x7f77e4156a60 2024-09-15T23:58:42.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77e2ffd640 1 -- 172.21.15.112:0/1542505105 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2098413588 0 0) 0x7f77cc003530 con 0x7f77e4156a60 2024-09-15T23:58:42.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77e2ffd640 1 -- 172.21.15.112:0/1542505105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e4156680 msgr2=0x7f77e40afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:42.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77e2ffd640 1 --2- 172.21.15.112:0/1542505105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e4156680 0x7f77e40afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:42.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77e2ffd640 1 -- 172.21.15.112:0/1542505105 >> v1:172.21.15.169:6789/0 conn(0x7f77e40b02f0 legacy=0x7f77e415e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:42.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.600+0000 7f77e2ffd640 1 -- 172.21.15.112:0/1542505105 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e415dee0 con 0x7f77e4156a60 2024-09-15T23:58:42.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e2ffd640 1 -- 172.21.15.112:0/1542505105 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f77d8001680 con 0x7f77e4156a60 2024-09-15T23:58:42.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e2ffd640 1 -- 172.21.15.112:0/1542505105 >> v1:172.21.15.112:6789/0 conn(0x7f77e4156a60 legacy=0x7f77e4072780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:42.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e2ffd640 1 --2- 172.21.15.112:0/1542505105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77cc0039f0 0x7f77cc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:42.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e2ffd640 1 --2- 172.21.15.112:0/1542505105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77cc004810 0x7f77cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:42.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e2ffd640 1 --2- 172.21.15.112:0/1542505105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e4156680 0x7f77cc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:42.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e2ffd640 1 -- 172.21.15.112:0/1542505105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc00bad0 con 0x7f77cc0039f0 2024-09-15T23:58:42.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e2ffd640 1 -- 172.21.15.112:0/1542505105 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc00bc80 con 0x7f77cc004810 2024-09-15T23:58:42.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e2ffd640 1 -- 172.21.15.112:0/1542505105 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f77cc00be80 con 0x7f77e4156680 2024-09-15T23:58:42.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e3fff640 1 --2- 172.21.15.112:0/1542505105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77cc0039f0 0x7f77cc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:42.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e37fe640 1 --2- 172.21.15.112:0/1542505105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77cc004810 0x7f77cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:42.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e8f9c640 1 --2- 172.21.15.112:0/1542505105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e4156680 0x7f77cc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:42.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e3fff640 1 -- 172.21.15.112:0/1542505105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e4156680 msgr2=0x7f77cc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:42.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e3fff640 1 --2- 172.21.15.112:0/1542505105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e4156680 0x7f77cc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:42.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e3fff640 1 -- 172.21.15.112:0/1542505105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77cc004810 msgr2=0x7f77cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:42.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e3fff640 1 --2- 172.21.15.112:0/1542505105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77cc004810 0x7f77cc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:42.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e3fff640 1 -- 172.21.15.112:0/1542505105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77cc003530 con 0x7f77cc0039f0 2024-09-15T23:58:42.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e8f9c640 1 --2- 172.21.15.112:0/1542505105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e4156680 0x7f77cc005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:42.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e3fff640 1 --2- 172.21.15.112:0/1542505105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77cc0039f0 0x7f77cc003e10 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009ae0 tx=0x7f77d401ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7125b41d0304e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:42.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e2ffd640 1 -- 172.21.15.112:0/1542505105 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d40b2070 con 0x7f77cc0039f0 2024-09-15T23:58:42.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e2ffd640 1 -- 172.21.15.112:0/1542505105 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d40a5610 con 0x7f77cc0039f0 2024-09-15T23:58:42.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.604+0000 7f77e2ffd640 1 -- 172.21.15.112:0/1542505105 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d40096b0 con 0x7f77cc0039f0 2024-09-15T23:58:42.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77ea9ff640 1 -- 172.21.15.112:0/1542505105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77cc0039f0 msgr2=0x7f77cc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:42.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77ea9ff640 1 --2- 172.21.15.112:0/1542505105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77cc0039f0 0x7f77cc003e10 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009ae0 tx=0x7f77d401ca40 comp rx=0 tx=0).stop 2024-09-15T23:58:42.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77e8f9c640 1 -- 172.21.15.112:0/1542505105 reap_dead start 2024-09-15T23:58:42.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77ea9ff640 1 -- 172.21.15.112:0/1542505105 shutdown_connections 2024-09-15T23:58:42.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77ea9ff640 1 -- 172.21.15.112:0/1542505105 >> 172.21.15.112:0/1542505105 conn(0x7f77e40b2820 msgr2=0x7f77e40b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:42.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77ea9ff640 1 -- 172.21.15.112:0/1542505105 shutdown_connections 2024-09-15T23:58:42.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77ea9ff640 1 -- 172.21.15.112:0/1542505105 wait complete. 2024-09-15T23:58:42.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77ea9ff640 1 Processor -- start 2024-09-15T23:58:42.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77ea9ff640 1 -- start start 2024-09-15T23:58:42.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77ea9ff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77cc0039f0 0x7f77e4156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:42.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77ea9ff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77e4149620 0x7f77e414cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77ea9ff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e41490d0 0x7f77e4146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77ea9ff640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f77e4073010 con 0x7f77cc0039f0 2024-09-15T23:58:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77ea9ff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f77e4072e90 con 0x7f77e4149620 2024-09-15T23:58:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77ea9ff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f77e415f8e0 con 0x7f77e41490d0 2024-09-15T23:58:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77e3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77cc0039f0 0x7f77e4156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77e3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77cc0039f0 0x7f77e4156e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54708/0 (socket says 172.21.15.112:54708) 2024-09-15T23:58:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77e3fff640 1 -- 172.21.15.112:0/2829044775 learned_addr learned my addr 172.21.15.112:0/2829044775 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77e8f9c640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e41490d0 0x7f77e4146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77e37fe640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77e4149620 0x7f77e414cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77e3fff640 1 -- 172.21.15.112:0/2829044775 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e41490d0 msgr2=0x7f77e4146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77e3fff640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e41490d0 0x7f77e4146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:42.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77e3fff640 1 -- 172.21.15.112:0/2829044775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77e4149620 msgr2=0x7f77e414cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:42.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77e3fff640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77e4149620 0x7f77e414cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:42.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77e3fff640 1 -- 172.21.15.112:0/2829044775 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e41510f0 con 0x7f77cc0039f0 2024-09-15T23:58:42.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77e8f9c640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e41490d0 0x7f77e4146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:42.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.608+0000 7f77e37fe640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77e4149620 0x7f77e414cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:42.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.612+0000 7f77e3fff640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77cc0039f0 0x7f77e4156e40 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009ae0 tx=0x7f77cc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:42.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.612+0000 7f77e0ff9640 1 -- 172.21.15.112:0/2829044775 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d40bc030 con 0x7f77cc0039f0 2024-09-15T23:58:42.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.612+0000 7f77e0ff9640 1 -- 172.21.15.112:0/2829044775 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d40a5e40 con 0x7f77cc0039f0 2024-09-15T23:58:42.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.612+0000 7f77ea9ff640 1 -- 172.21.15.112:0/2829044775 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e41513d0 con 0x7f77cc0039f0 2024-09-15T23:58:42.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.612+0000 7f77e0ff9640 1 -- 172.21.15.112:0/2829044775 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d40b2040 con 0x7f77cc0039f0 2024-09-15T23:58:42.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.612+0000 7f77ea9ff640 1 -- 172.21.15.112:0/2829044775 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e4151990 con 0x7f77cc0039f0 2024-09-15T23:58:42.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.612+0000 7f77ea9ff640 1 -- 172.21.15.112:0/2829044775 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e40afdb0 con 0x7f77cc0039f0 2024-09-15T23:58:42.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.612+0000 7f77e0ff9640 1 -- 172.21.15.112:0/2829044775 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77d40bf070 con 0x7f77cc0039f0 2024-09-15T23:58:42.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.612+0000 7f77e0ff9640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f77d00678f0 0x7f77d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:42.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.612+0000 7f77e0ff9640 1 -- 172.21.15.112:0/2829044775 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f77d411fd30 con 0x7f77cc0039f0 2024-09-15T23:58:42.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.612+0000 7f77e37fe640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f77d00678f0 0x7f77d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:42.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.612+0000 7f77e37fe640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f77d00678f0 0x7f77d0069db0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f77e4150a00 tx=0x7f77d80014f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:42.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.616+0000 7f77e0ff9640 1 -- 172.21.15.112:0/2829044775 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f77d4016780 con 0x7f77cc0039f0 2024-09-15T23:58:42.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.864+0000 7f77ea9ff640 1 -- 172.21.15.112:0/2829044775 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77e40b2570 con 0x7f77cc0039f0 2024-09-15T23:58:42.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.864+0000 7f77e0ff9640 1 -- 172.21.15.112:0/2829044775 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7f77d40f06b0 con 0x7f77cc0039f0 2024-09-15T23:58:42.866 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:42.866 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:42.866 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:42.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.868+0000 7f77ea9ff640 1 -- 172.21.15.112:0/2829044775 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f77d00678f0 msgr2=0x7f77d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:42.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.868+0000 7f77ea9ff640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f77d00678f0 0x7f77d0069db0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f77e4150a00 tx=0x7f77d80014f0 comp rx=0 tx=0).stop 2024-09-15T23:58:42.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.868+0000 7f77ea9ff640 1 -- 172.21.15.112:0/2829044775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77cc0039f0 msgr2=0x7f77e4156e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:42.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.868+0000 7f77ea9ff640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77cc0039f0 0x7f77e4156e40 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009ae0 tx=0x7f77cc005840 comp rx=0 tx=0).stop 2024-09-15T23:58:42.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.868+0000 7f77ea9ff640 1 -- 172.21.15.112:0/2829044775 shutdown_connections 2024-09-15T23:58:42.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.868+0000 7f77ea9ff640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f77d00678f0 0x7f77d0069db0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:42.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.868+0000 7f77ea9ff640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77e41490d0 0x7f77e4146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:42.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.868+0000 7f77ea9ff640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77e4149620 0x7f77e414cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:42.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.868+0000 7f77ea9ff640 1 --2- 172.21.15.112:0/2829044775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77cc0039f0 0x7f77e4156e40 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:42.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.868+0000 7f77ea9ff640 1 -- 172.21.15.112:0/2829044775 >> 172.21.15.112:0/2829044775 conn(0x7f77e40b2820 msgr2=0x7f77e40b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:42.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.868+0000 7f77ea9ff640 1 -- 172.21.15.112:0/2829044775 shutdown_connections 2024-09-15T23:58:42.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:42.868+0000 7f77ea9ff640 1 -- 172.21.15.112:0/2829044775 wait complete. 2024-09-15T23:58:42.885 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-15T23:58:43.044 INFO:teuthology.orchestra.run.smithi112.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":6101,"msgr_send_messages":12131,"msgr_recv_bytes":2180391,"msgr_send_bytes":6766332,"msgr_created_connections":10,"msgr_active_connections":2,"msgr_running_total_time":0.564787653,"msgr_running_send_time":0.296696668,"msgr_running_recv_time":0.327830198,"msgr_running_fast_dispatch_time":0.000819665,"msgr_send_messages_queue_lat":{"avgcount":12130,"sum":0.206548524,"avgtime":0.000017027},"msgr_handle_ack_lat":{"avgcount":18010,"sum":0.002501565,"avgtime":0.000000138},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":52,"msgr_send_messages":58,"msgr_recv_bytes":21425,"msgr_send_bytes":9013869,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.043217467,"msgr_running_send_time":0.029702065,"msgr_running_recv_time":0.004992472,"msgr_running_fast_dispatch_time":0.007920480,"msgr_send_messages_queue_lat":{"avgcount":56,"sum":0.022232365,"avgtime":0.000397006},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":93728},"AsyncMessenger::Worker-2":{"msgr_recv_messages":36,"msgr_send_messages":31,"msgr_recv_bytes":112623,"msgr_send_bytes":12085,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.006481792,"msgr_running_send_time":0.001437013,"msgr_running_recv_time":0.006361359,"msgr_running_fast_dispatch_time":0.000367586,"msgr_send_messages_queue_lat":{"avgcount":30,"sum":0.006488907,"avgtime":0.000216296},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":107376,"msgr_send_encrypted_bytes":8432},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":1673,"complete_latency":{"avgcount":81,"sum":1.499515953,"avgtime":0.018512542}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000081109,"avgtime":0.000020277}},"mds":{"request":4042,"reply":4040,"reply_latency":{"avgcount":4040,"sum":5.183656975,"avgtime":0.001283083},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":4040,"inodes_top":0,"inodes_bottom":4040,"inodes_pin_tail":0,"inodes_pinned":4040,"inodes_expired":0,"inodes_with_caps":3202,"caps":3202,"subtrees":2,"traverse":4048,"traverse_hit":4047,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":3200,"root_rbytes":4368384,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":467,"ceph_cap_op_grant":3290,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":2033,"handle_client_caps_dirty":1904,"handle_client_cap_release":0,"process_request_cap_release":4861},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":830,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":830,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":6070,"evex":0,"evtrm":0,"ev":6073,"evexg":0,"evexd":0,"segadd":8,"segex":0,"segtrm":0,"seg":10,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":17083418,"rdpos":4195244,"jlat":{"avgcount":13,"sum":0.103886475,"avgtime":0.007991267},"replayed":3},"mds_mem":{"ino":3214,"ino+":3214,"ino-":0,"dir":13,"dir+":13,"dir-":0,"dn":4041,"dn+":4041,"dn-":0,"cap":3202,"cap+":3202,"cap-":0,"rss":97180,"heap":248116},"mds_server":{"dispatch_client_request":4045,"dispatch_server_request":0,"handle_client_request":4042,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.501283897,"avgtime":0.001094151},"req_getattr_latency":{"avgcount":6,"sum":0.001946066,"avgtime":0.000324344},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004077767,"avgtime":0.004077767},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.251883026,"avgtime":0.083961008},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":830,"sum":1.424466219,"avgtime":0.001716224},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":3816,"average_load":3816,"avg_session_uptime":1041,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":3255843,"buffer_anon_items":1065,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6040,"osdmap_items":99,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":8093960,"mds_co_items":38932,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":69,"op_send_bytes":12952248,"op_resend":0,"op_reply":69,"op_latency":{"avgcount":69,"sum":0.299997000,"avgtime":0.004347782},"op_inflight":0,"oplen_avg":{"avgcount":69,"sum":127},"op":69,"op_r":36,"op_w":33,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":13,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":8,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":103,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":18,"omap_rd":48,"omap_del":4},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":305,"max":104857600,"get_started":0,"get":6186,"get_sum":1755276,"get_or_fail_fail":0,"get_or_fail_success":6186,"take":0,"take_sum":0,"put":6185,"put_sum":1754971,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":69,"take_sum":12953367,"put":69,"put_sum":12953367,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":69,"take_sum":69,"put":69,"put_sum":69,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55eb22390a00":{"val":306202,"max":3758096384,"get_started":0,"get":6070,"get_sum":12887731,"get_or_fail_fail":0,"get_or_fail_success":6070,"take":0,"take_sum":0,"put":13,"put_sum":12581529,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T23:58:43.046 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 18010, "avgtime": 1.38e-07, "sum": 0.002501565 }, "msgr_recv_bytes": 2180391, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 6101, "msgr_running_fast_dispatch_time": 0.000819665, "msgr_running_recv_time": 0.327830198, "msgr_running_send_time": 0.296696668, "msgr_running_total_time": 0.564787653, "msgr_send_bytes": 6766332, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 12131, "msgr_send_messages_queue_lat": { "avgcount": 12130, "avgtime": 1.7027e-05, "sum": 0.206548524 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 21425, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 52, "msgr_running_fast_dispatch_time": 0.00792048, "msgr_running_recv_time": 0.004992472, "msgr_running_send_time": 0.029702065, "msgr_running_total_time": 0.043217467, "msgr_send_bytes": 9013869, "msgr_send_encrypted_bytes": 93728, "msgr_send_messages": 58, "msgr_send_messages_queue_lat": { "avgcount": 56, "avgtime": 0.000397006, "sum": 0.022232365 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 112623, "msgr_recv_encrypted_bytes": 107376, "msgr_recv_messages": 36, "msgr_running_fast_dispatch_time": 0.000367586, "msgr_running_recv_time": 0.006361359, "msgr_running_send_time": 0.001437013, "msgr_running_total_time": 0.006481792, "msgr_send_bytes": 12085, "msgr_send_encrypted_bytes": 8432, "msgr_send_messages": 31, "msgr_send_messages_queue_lat": { "avgcount": 30, "avgtime": 0.000216296, "sum": 0.006488907 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 81, "avgtime": 0.018512542, "sum": 1.499515953 }, "queue_len": 1673 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.0277e-05, "sum": 8.1109e-05 }, "queue_len": 0 }, "mds": { "caps": 3202, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 3290, "ceph_cap_op_revoke": 467, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 2033, "handle_client_caps_dirty": 1904, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 4040, "inodes_bottom": 4040, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 4040, "inodes_top": 0, "inodes_with_caps": 3202, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 4861, "q": 0, "reply": 4040, "reply_latency": { "avgcount": 4040, "avgtime": 0.001283083, "sum": 5.183656975 }, "request": 4042, "root_rbytes": 4368384, "root_rfiles": 3200, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4048, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4047, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 830, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 830, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6073, "evadd": 6070, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 13, "avgtime": 0.007991267, "sum": 0.103886475 }, "rdpos": 4195244, "replayed": 3, "seg": 10, "segadd": 8, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 17083418 }, "mds_mem": { "cap": 3202, "cap+": 3202, "cap-": 0, "dir": 13, "dir+": 13, "dir-": 0, "dn": 4041, "dn+": 4041, "dn-": 0, "heap": 248116, "ino": 3214, "ino+": 3214, "ino-": 0, "rss": 97180 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4045, "dispatch_server_request": 0, "handle_client_request": 4042, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001094151, "sum": 3.501283897 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.000324344, "sum": 0.001946066 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004077767, "sum": 0.004077767 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.083961008, "sum": 0.251883026 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 830, "avgtime": 0.001716224, "sum": 1.424466219 } }, "mds_sessions": { "average_load": 3816, "avg_session_uptime": 1041, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 3816 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 3255843, "buffer_anon_items": 1065, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 8093960, "mds_co_items": 38932, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6040, "osdmap_items": 99, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 103, "map_full": 0, "map_inc": 2, "omap_del": 4, "omap_rd": 48, "omap_wr": 18, "op": 69, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 69, "avgtime": 0.004347782, "sum": 0.299997 }, "op_pg": 0, "op_r": 36, "op_reply": 69, "op_resend": 0, "op_rmw": 0, "op_send": 69, "op_send_bytes": 12952248, "op_w": 33, "oplen_avg": { "avgcount": 69, "sum": 127 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 8, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 13, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 6186, "get_or_fail_fail": 0, "get_or_fail_success": 6186, "get_started": 0, "get_sum": 1755276, "max": 104857600, "put": 6185, "put_sum": 1754971, "take": 0, "take_sum": 0, "val": 305, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 69, "put_sum": 12953367, "take": 69, "take_sum": 12953367, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 69, "put_sum": 69, "take": 69, "take_sum": 69, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55eb22390a00": { "get": 6070, "get_or_fail_fail": 0, "get_or_fail_success": 6070, "get_started": 0, "get_sum": 12887731, "max": 3758096384, "put": 13, "put_sum": 12581529, "take": 0, "take_sum": 0, "val": 306202, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T23:58:43.046 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/830, 0/830 2024-09-15T23:58:44.047 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:44.145 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:58:44.147 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:58:44.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.180+0000 7faea325f640 1 Processor -- start 2024-09-15T23:58:44.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.180+0000 7faea325f640 1 -- start start 2024-09-15T23:58:44.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.180+0000 7faea325f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae9c0b0310 0x7fae9c072a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:44.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.180+0000 7faea325f640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae9c0b0730 con 0x7fae9c075030 2024-09-15T23:58:44.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.180+0000 7faea325f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae9c15e8a0 con 0x7fae9c15e4c0 2024-09-15T23:58:44.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.180+0000 7faea325f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fae9c072040 con 0x7fae9c0b0310 2024-09-15T23:58:44.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7faea17fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fae9c075030 0x7fae9c0aeb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58612/0 (socket says 172.21.15.112:58612) 2024-09-15T23:58:44.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7faea17fc640 1 -- 172.21.15.112:0/892226013 learned_addr learned my addr 172.21.15.112:0/892226013 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:44.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9bfff640 1 --2- 172.21.15.112:0/892226013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae9c0b0310 0x7fae9c072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:44.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 -- 172.21.15.112:0/892226013 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459596631 0 0) 0x7fae9c0b0730 con 0x7fae9c075030 2024-09-15T23:58:44.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 -- 172.21.15.112:0/892226013 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae84003530 con 0x7fae9c075030 2024-09-15T23:58:44.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 -- 172.21.15.112:0/892226013 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1255377514 0 0) 0x7fae84003530 con 0x7fae9c075030 2024-09-15T23:58:44.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 -- 172.21.15.112:0/892226013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae9c0b0310 msgr2=0x7fae9c072a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:44.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 --2- 172.21.15.112:0/892226013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae9c0b0310 0x7fae9c072a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:44.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 -- 172.21.15.112:0/892226013 >> v1:172.21.15.169:6789/0 conn(0x7fae9c15e4c0 legacy=0x7fae9c06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:44.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 -- 172.21.15.112:0/892226013 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae9c0b09a0 con 0x7fae9c075030 2024-09-15T23:58:44.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 -- 172.21.15.112:0/892226013 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fae94001a00 con 0x7fae9c075030 2024-09-15T23:58:44.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 -- 172.21.15.112:0/892226013 >> v1:172.21.15.112:6789/0 conn(0x7fae9c075030 legacy=0x7fae9c0aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:44.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 --2- 172.21.15.112:0/892226013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae840039f0 0x7fae84003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:44.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 --2- 172.21.15.112:0/892226013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae84004810 0x7fae84004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:44.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 --2- 172.21.15.112:0/892226013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae9c0b0310 0x7fae84005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:44.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 -- 172.21.15.112:0/892226013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c072040 con 0x7fae84004810 2024-09-15T23:58:44.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 -- 172.21.15.112:0/892226013 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae8400bb00 con 0x7fae840039f0 2024-09-15T23:58:44.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 -- 172.21.15.112:0/892226013 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fae8400bd00 con 0x7fae9c0b0310 2024-09-15T23:58:44.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9bfff640 1 --2- 172.21.15.112:0/892226013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae84004810 0x7fae84004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:44.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7faea0ffb640 1 --2- 172.21.15.112:0/892226013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae840039f0 0x7fae84003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:44.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7faea17fc640 1 --2- 172.21.15.112:0/892226013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae9c0b0310 0x7fae84005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:44.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9bfff640 1 -- 172.21.15.112:0/892226013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae9c0b0310 msgr2=0x7fae84005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:44.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9bfff640 1 --2- 172.21.15.112:0/892226013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae9c0b0310 0x7fae84005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:44.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9bfff640 1 -- 172.21.15.112:0/892226013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae840039f0 msgr2=0x7fae84003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:44.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9bfff640 1 --2- 172.21.15.112:0/892226013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae840039f0 0x7fae84003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:44.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9bfff640 1 -- 172.21.15.112:0/892226013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae84003530 con 0x7fae84004810 2024-09-15T23:58:44.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9bfff640 1 --2- 172.21.15.112:0/892226013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae84004810 0x7fae84004c90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fae90009ab0 tx=0x7fae9001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3097b7132e8a59a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:44.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 -- 172.21.15.112:0/892226013 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae900b2070 con 0x7fae84004810 2024-09-15T23:58:44.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 -- 172.21.15.112:0/892226013 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae900a5530 con 0x7fae84004810 2024-09-15T23:58:44.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.184+0000 7fae9b7fe640 1 -- 172.21.15.112:0/892226013 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae900096b0 con 0x7fae84004810 2024-09-15T23:58:44.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 -- 172.21.15.112:0/892226013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae84004810 msgr2=0x7fae84004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:44.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 --2- 172.21.15.112:0/892226013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae84004810 0x7fae84004c90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fae90009ab0 tx=0x7fae9001ca50 comp rx=0 tx=0).stop 2024-09-15T23:58:44.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea17fc640 1 -- 172.21.15.112:0/892226013 reap_dead start 2024-09-15T23:58:44.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 -- 172.21.15.112:0/892226013 shutdown_connections 2024-09-15T23:58:44.188 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 -- 172.21.15.112:0/892226013 >> 172.21.15.112:0/892226013 conn(0x7fae9c06bc80 msgr2=0x7fae9c06c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:44.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 -- 172.21.15.112:0/892226013 shutdown_connections 2024-09-15T23:58:44.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 -- 172.21.15.112:0/892226013 wait complete. 2024-09-15T23:58:44.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 Processor -- start 2024-09-15T23:58:44.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 -- start start 2024-09-15T23:58:44.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae84004810 0x7fae9c163050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:44.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae9c154a00 0x7fae9c0cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:44.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae9c0ce700 0x7fae9c168e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:44.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c16a120 con 0x7fae84004810 2024-09-15T23:58:44.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c075870 con 0x7fae9c0ce700 2024-09-15T23:58:44.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fae9c16a2a0 con 0x7fae9c154a00 2024-09-15T23:58:44.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea0ffb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae84004810 0x7fae9c163050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:44.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea0ffb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae84004810 0x7fae9c163050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54728/0 (socket says 172.21.15.112:54728) 2024-09-15T23:58:44.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea0ffb640 1 -- 172.21.15.112:0/1529000552 learned_addr learned my addr 172.21.15.112:0/1529000552 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:44.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7fae9bfff640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae9c154a00 0x7fae9c0cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:44.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea17fc640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae9c0ce700 0x7fae9c168e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:44.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea0ffb640 1 -- 172.21.15.112:0/1529000552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae9c154a00 msgr2=0x7fae9c0cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:44.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea0ffb640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae9c154a00 0x7fae9c0cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:44.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea0ffb640 1 -- 172.21.15.112:0/1529000552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae9c0ce700 msgr2=0x7fae9c168e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:44.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea0ffb640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae9c0ce700 0x7fae9c168e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:44.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea0ffb640 1 -- 172.21.15.112:0/1529000552 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae9c1689c0 con 0x7fae84004810 2024-09-15T23:58:44.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7fae9bfff640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae9c154a00 0x7fae9c0cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:58:44.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea0ffb640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae84004810 0x7fae9c163050 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00e550 tx=0x7fae8c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:44.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7fae997fa640 1 -- 172.21.15.112:0/1529000552 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0052e0 con 0x7fae84004810 2024-09-15T23:58:44.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7fae997fa640 1 -- 172.21.15.112:0/1529000552 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae8c018070 con 0x7fae84004810 2024-09-15T23:58:44.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7fae997fa640 1 -- 172.21.15.112:0/1529000552 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c003820 con 0x7fae84004810 2024-09-15T23:58:44.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 -- 172.21.15.112:0/1529000552 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae9c154e80 con 0x7fae84004810 2024-09-15T23:58:44.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.188+0000 7faea325f640 1 -- 172.21.15.112:0/1529000552 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae9c163940 con 0x7fae84004810 2024-09-15T23:58:44.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.192+0000 7faea325f640 1 -- 172.21.15.112:0/1529000552 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae9c0aeb30 con 0x7fae84004810 2024-09-15T23:58:44.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.192+0000 7fae997fa640 1 -- 172.21.15.112:0/1529000552 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fae8c0039c0 con 0x7fae84004810 2024-09-15T23:58:44.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.192+0000 7fae997fa640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fae880678c0 0x7fae88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:44.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.192+0000 7fae997fa640 1 -- 172.21.15.112:0/1529000552 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7fae8c085c80 con 0x7fae84004810 2024-09-15T23:58:44.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.192+0000 7fae9bfff640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fae880678c0 0x7fae88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:44.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.192+0000 7fae9bfff640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fae880678c0 0x7fae88069d80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fae900af000 tx=0x7fae90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:44.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.196+0000 7fae997fa640 1 -- 172.21.15.112:0/1529000552 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fae8c0564e0 con 0x7fae84004810 2024-09-15T23:58:44.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.424+0000 7faea325f640 1 -- 172.21.15.112:0/1529000552 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae9c160e20 con 0x7fae84004810 2024-09-15T23:58:44.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.424+0000 7fae997fa640 1 -- 172.21.15.112:0/1529000552 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7fae8c005480 con 0x7fae84004810 2024-09-15T23:58:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:44.427 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:44.427 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:44.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.428+0000 7faea325f640 1 -- 172.21.15.112:0/1529000552 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fae880678c0 msgr2=0x7fae88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:44.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.428+0000 7faea325f640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fae880678c0 0x7fae88069d80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fae900af000 tx=0x7fae90008040 comp rx=0 tx=0).stop 2024-09-15T23:58:44.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.428+0000 7faea325f640 1 -- 172.21.15.112:0/1529000552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae84004810 msgr2=0x7fae9c163050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:44.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.428+0000 7faea325f640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae84004810 0x7fae9c163050 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00e550 tx=0x7fae8c00ea10 comp rx=0 tx=0).stop 2024-09-15T23:58:44.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.428+0000 7faea325f640 1 -- 172.21.15.112:0/1529000552 shutdown_connections 2024-09-15T23:58:44.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.428+0000 7faea325f640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fae880678c0 0x7fae88069d80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:44.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.428+0000 7faea325f640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae9c0ce700 0x7fae9c168e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:44.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.428+0000 7faea325f640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae9c154a00 0x7fae9c0cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:44.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.428+0000 7faea325f640 1 --2- 172.21.15.112:0/1529000552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae84004810 0x7fae9c163050 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:44.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.428+0000 7faea325f640 1 -- 172.21.15.112:0/1529000552 >> 172.21.15.112:0/1529000552 conn(0x7fae9c06bc80 msgr2=0x7fae9c06c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:44.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.428+0000 7faea325f640 1 -- 172.21.15.112:0/1529000552 shutdown_connections 2024-09-15T23:58:44.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:44.428+0000 7faea325f640 1 -- 172.21.15.112:0/1529000552 wait complete. 2024-09-15T23:58:44.449 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-15T23:58:44.615 INFO:teuthology.orchestra.run.smithi112.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":7103,"msgr_send_messages":14146,"msgr_recv_bytes":2549704,"msgr_send_bytes":7429436,"msgr_created_connections":10,"msgr_active_connections":2,"msgr_running_total_time":0.672862410,"msgr_running_send_time":0.361468306,"msgr_running_recv_time":0.375303627,"msgr_running_fast_dispatch_time":0.000982860,"msgr_send_messages_queue_lat":{"avgcount":14145,"sum":0.253333762,"avgtime":0.000017909},"msgr_handle_ack_lat":{"avgcount":20566,"sum":0.003072210,"avgtime":0.000000149},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":57,"msgr_send_messages":64,"msgr_recv_bytes":22743,"msgr_send_bytes":9024099,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.043659775,"msgr_running_send_time":0.029881956,"msgr_running_recv_time":0.005085884,"msgr_running_fast_dispatch_time":0.008062246,"msgr_send_messages_queue_lat":{"avgcount":62,"sum":0.022431802,"avgtime":0.000361803},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":95536},"AsyncMessenger::Worker-2":{"msgr_recv_messages":39,"msgr_send_messages":34,"msgr_recv_bytes":113361,"msgr_send_bytes":122859,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.011326647,"msgr_running_send_time":0.005203402,"msgr_running_recv_time":0.006430097,"msgr_running_fast_dispatch_time":0.001352737,"msgr_send_messages_queue_lat":{"avgcount":33,"sum":0.007475911,"avgtime":0.000226542},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":107376,"msgr_send_encrypted_bytes":8432},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":1675,"complete_latency":{"avgcount":81,"sum":1.499515953,"avgtime":0.018512542}},"finisher-PurgeQueue":{"queue_len":81,"complete_latency":{"avgcount":11,"sum":0.000219530,"avgtime":0.000019957}},"mds":{"request":4244,"reply":4241,"reply_latency":{"avgcount":4241,"sum":6.536180126,"avgtime":0.001541188},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":4242,"inodes_top":0,"inodes_bottom":4242,"inodes_pin_tail":0,"inodes_pinned":4242,"inodes_expired":0,"inodes_with_caps":3122,"caps":3122,"subtrees":2,"traverse":4250,"traverse_hit":4248,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":2811,"root_rbytes":7496704,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":529,"ceph_cap_op_grant":3954,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":2826,"handle_client_caps_dirty":2645,"handle_client_cap_release":1,"process_request_cap_release":5265},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":1028,"num_strays_delayed":0,"num_strays_enqueuing":77,"strays_created":1031,"strays_enqueued":3,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":7068,"evex":0,"evtrm":0,"ev":7071,"evexg":0,"evexd":0,"segadd":9,"segex":0,"segtrm":0,"seg":11,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":19260891,"rdpos":4195244,"jlat":{"avgcount":13,"sum":0.103886475,"avgtime":0.007991267},"replayed":3},"mds_mem":{"ino":3214,"ino+":3214,"ino-":0,"dir":13,"dir+":13,"dir-":0,"dn":4242,"dn+":4242,"dn-":0,"cap":3122,"cap+":3202,"cap-":80,"rss":105628,"heap":248116},"mds_server":{"dispatch_client_request":4247,"dispatch_server_request":0,"handle_client_request":4244,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.501283897,"avgtime":0.001094151},"req_getattr_latency":{"avgcount":6,"sum":0.001946066,"avgtime":0.000324344},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004077767,"avgtime":0.004077767},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.251883026,"avgtime":0.083961008},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":1031,"sum":2.776989370,"avgtime":0.002693491},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":3948,"average_load":3948,"avg_session_uptime":1046,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":6692391,"buffer_anon_items":2278,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6040,"osdmap_items":99,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":15328789,"mds_co_items":116665,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":80,"op_send_bytes":13968005,"op_resend":0,"op_reply":80,"op_latency":{"avgcount":80,"sum":0.319996803,"avgtime":0.003999960},"op_inflight":0,"oplen_avg":{"avgcount":80,"sum":140},"op":80,"op_r":37,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":9,"osdop_write":15,"osdop_writefull":2,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":14,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":103,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":20,"omap_rd":48,"omap_del":5},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":565,"max":104857600,"get_started":0,"get":7195,"get_sum":2035440,"get_or_fail_fail":0,"get_or_fail_success":7195,"take":0,"take_sum":0,"put":7193,"put_sum":2034875,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":80,"take_sum":13977204,"put":80,"put_sum":13977204,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":80,"take_sum":80,"put":80,"put_sum":80,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":80,"get_sum":8080,"get_or_fail_fail":0,"get_or_fail_success":80,"take":0,"take_sum":0,"put":1,"put_sum":8080,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55eb22390a00":{"val":1482840,"max":3758096384,"get_started":0,"get":7068,"get_sum":15065204,"get_or_fail_fail":0,"get_or_fail_success":7068,"take":0,"take_sum":0,"put":14,"put_sum":13582364,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T23:58:44.618 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 20566, "avgtime": 1.49e-07, "sum": 0.00307221 }, "msgr_recv_bytes": 2549704, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 7103, "msgr_running_fast_dispatch_time": 0.00098286, "msgr_running_recv_time": 0.375303627, "msgr_running_send_time": 0.361468306, "msgr_running_total_time": 0.67286241, "msgr_send_bytes": 7429436, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 14146, "msgr_send_messages_queue_lat": { "avgcount": 14145, "avgtime": 1.7909e-05, "sum": 0.253333762 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 22743, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 57, "msgr_running_fast_dispatch_time": 0.008062246, "msgr_running_recv_time": 0.005085884, "msgr_running_send_time": 0.029881956, "msgr_running_total_time": 0.043659775, "msgr_send_bytes": 9024099, "msgr_send_encrypted_bytes": 95536, "msgr_send_messages": 64, "msgr_send_messages_queue_lat": { "avgcount": 62, "avgtime": 0.000361803, "sum": 0.022431802 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 113361, "msgr_recv_encrypted_bytes": 107376, "msgr_recv_messages": 39, "msgr_running_fast_dispatch_time": 0.001352737, "msgr_running_recv_time": 0.006430097, "msgr_running_send_time": 0.005203402, "msgr_running_total_time": 0.011326647, "msgr_send_bytes": 122859, "msgr_send_encrypted_bytes": 8432, "msgr_send_messages": 34, "msgr_send_messages_queue_lat": { "avgcount": 33, "avgtime": 0.000226542, "sum": 0.007475911 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 81, "avgtime": 0.018512542, "sum": 1.499515953 }, "queue_len": 1675 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 11, "avgtime": 1.9957e-05, "sum": 0.00021953 }, "queue_len": 81 }, "mds": { "caps": 3122, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 3954, "ceph_cap_op_revoke": 529, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 2826, "handle_client_caps_dirty": 2645, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 4242, "inodes_bottom": 4242, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 4242, "inodes_top": 0, "inodes_with_caps": 3122, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 5265, "q": 0, "reply": 4241, "reply_latency": { "avgcount": 4241, "avgtime": 0.001541188, "sum": 6.536180126 }, "request": 4244, "root_rbytes": 7496704, "root_rfiles": 2811, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4250, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4248, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 1028, "num_strays_delayed": 0, "num_strays_enqueuing": 77, "recovery_completed": 0, "recovery_started": 0, "strays_created": 1031, "strays_enqueued": 3, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7071, "evadd": 7068, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 13, "avgtime": 0.007991267, "sum": 0.103886475 }, "rdpos": 4195244, "replayed": 3, "seg": 11, "segadd": 9, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 19260891 }, "mds_mem": { "cap": 3122, "cap+": 3202, "cap-": 80, "dir": 13, "dir+": 13, "dir-": 0, "dn": 4242, "dn+": 4242, "dn-": 0, "heap": 248116, "ino": 3214, "ino+": 3214, "ino-": 0, "rss": 105628 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4247, "dispatch_server_request": 0, "handle_client_request": 4244, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001094151, "sum": 3.501283897 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.000324344, "sum": 0.001946066 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004077767, "sum": 0.004077767 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.083961008, "sum": 0.251883026 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 1031, "avgtime": 0.002693491, "sum": 2.77698937 } }, "mds_sessions": { "average_load": 3948, "avg_session_uptime": 1046, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 3948 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 6692391, "buffer_anon_items": 2278, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 15328789, "mds_co_items": 116665, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6040, "osdmap_items": 99, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 103, "map_full": 0, "map_inc": 2, "omap_del": 5, "omap_rd": 48, "omap_wr": 20, "op": 80, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 80, "avgtime": 0.00399996, "sum": 0.319996803 }, "op_pg": 0, "op_r": 37, "op_reply": 80, "op_resend": 0, "op_rmw": 0, "op_send": 80, "op_send_bytes": 13968005, "op_w": 43, "oplen_avg": { "avgcount": 80, "sum": 140 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 14, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 9, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 15, "osdop_writefull": 2, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 7195, "get_or_fail_fail": 0, "get_or_fail_success": 7195, "get_started": 0, "get_sum": 2035440, "max": 104857600, "put": 7193, "put_sum": 2034875, "take": 0, "take_sum": 0, "val": 565, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 80, "put_sum": 13977204, "take": 80, "take_sum": 13977204, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 80, "put_sum": 80, "take": 80, "take_sum": 80, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 80, "get_or_fail_fail": 0, "get_or_fail_success": 80, "get_started": 0, "get_sum": 8080, "max": 3758096384, "put": 1, "put_sum": 8080, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55eb22390a00": { "get": 7068, "get_or_fail_fail": 0, "get_or_fail_success": 7068, "get_started": 0, "get_sum": 15065204, "max": 3758096384, "put": 14, "put_sum": 13582364, "take": 0, "take_sum": 0, "val": 1482840, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T23:58:44.618 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/1028, 0/1031 2024-09-15T23:58:45.619 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:45.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.776+0000 7fa5d0ef5640 1 Processor -- start 2024-09-15T23:58:45.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.776+0000 7fa5d0ef5640 1 -- start start 2024-09-15T23:58:45.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.780+0000 7fa5d0ef5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa5cc0b4360 0x7fa5cc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:45.781 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.780+0000 7fa5d0ef5640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5cc0735a0 con 0x7fa5cc15e630 2024-09-15T23:58:45.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.780+0000 7fa5d0ef5640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5cc073880 con 0x7fa5cc0b4d10 2024-09-15T23:58:45.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.780+0000 7fa5d0ef5640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fa5cc073b60 con 0x7fa5cc0b4360 2024-09-15T23:58:45.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.780+0000 7fa5c9d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa5cc0b4360 0x7fa5cc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:45.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.780+0000 7fa5c9d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fa5cc0b4360 0x7fa5cc0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54742/0 (socket says 172.21.15.112:54742) 2024-09-15T23:58:45.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.780+0000 7fa5c9d9b640 1 -- 172.21.15.112:0/2172112878 learned_addr learned my addr 172.21.15.112:0/2172112878 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:45.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.780+0000 7fa5ca59c640 1 --1- 172.21.15.112:0/2172112878 >> v1:172.21.15.112:6789/0 conn(0x7fa5cc15e630 0x7fa5cc072d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:58622/0 (socket says 172.21.15.112:58622) 2024-09-15T23:58:45.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.780+0000 7fa5c9d9b640 1 -- 172.21.15.112:0/2172112878 >> v1:172.21.15.169:6789/0 conn(0x7fa5cc0b4d10 legacy=0x7fa5cc0afca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:58:45.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.780+0000 7fa5c9d9b640 1 -- 172.21.15.112:0/2172112878 >> v1:172.21.15.112:6789/0 conn(0x7fa5cc15e630 legacy=0x7fa5cc072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:45.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.780+0000 7fa5c9d9b640 1 -- 172.21.15.112:0/2172112878 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc073e40 con 0x7fa5cc0b4360 2024-09-15T23:58:45.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.784+0000 7fa5c9d9b640 1 --2- 172.21.15.112:0/2172112878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0b4360 0x7fa5cc0b47d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00098a0 tx=0x7fa5c001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13b5472d760a95a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:45.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.784+0000 7fa5c959a640 1 -- 172.21.15.112:0/2172112878 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c00b0070 con 0x7fa5cc0b4360 2024-09-15T23:58:45.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.784+0000 7fa5c959a640 1 -- 172.21.15.112:0/2172112878 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c00ab600 con 0x7fa5cc0b4360 2024-09-15T23:58:45.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.784+0000 7fa5c959a640 1 -- 172.21.15.112:0/2172112878 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c00ab9d0 con 0x7fa5cc0b4360 2024-09-15T23:58:45.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.784+0000 7fa5d0ef5640 1 -- 172.21.15.112:0/2172112878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0b4360 msgr2=0x7fa5cc0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:45.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.784+0000 7fa5d0ef5640 1 --2- 172.21.15.112:0/2172112878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0b4360 0x7fa5cc0b47d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00098a0 tx=0x7fa5c001c500 comp rx=0 tx=0).stop 2024-09-15T23:58:45.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.784+0000 7fa5d0ef5640 1 -- 172.21.15.112:0/2172112878 shutdown_connections 2024-09-15T23:58:45.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.784+0000 7fa5d0ef5640 1 --2- 172.21.15.112:0/2172112878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0b4360 0x7fa5cc0b47d0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:45.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.784+0000 7fa5d0ef5640 1 -- 172.21.15.112:0/2172112878 >> 172.21.15.112:0/2172112878 conn(0x7fa5cc0b1e60 msgr2=0x7fa5cc0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:45.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.784+0000 7fa5d0ef5640 1 -- 172.21.15.112:0/2172112878 shutdown_connections 2024-09-15T23:58:45.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.784+0000 7fa5d0ef5640 1 -- 172.21.15.112:0/2172112878 wait complete. 2024-09-15T23:58:45.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5d0ef5640 1 Processor -- start 2024-09-15T23:58:45.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5d0ef5640 1 -- start start 2024-09-15T23:58:45.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5d0ef5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5cc0b4360 0x7fa5cc1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:45.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5d0ef5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0b4d10 0x7fa5cc15c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:45.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5d0ef5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5cc15e630 0x7fa5cc150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:45.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5ca59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5cc0b4360 0x7fa5cc1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:45.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5ca59c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5cc0b4360 0x7fa5cc1565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:35406/0 (socket says 172.21.15.112:35406) 2024-09-15T23:58:45.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5ca59c640 1 -- 172.21.15.112:0/3631590427 learned_addr learned my addr 172.21.15.112:0/3631590427 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:45.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5d0ef5640 1 -- 172.21.15.112:0/3631590427 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc0b0f50 con 0x7fa5cc0b4d10 2024-09-15T23:58:45.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5d0ef5640 1 -- 172.21.15.112:0/3631590427 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc0b0dd0 con 0x7fa5cc15e630 2024-09-15T23:58:45.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5d0ef5640 1 -- 172.21.15.112:0/3631590427 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa5cc16c620 con 0x7fa5cc0b4360 2024-09-15T23:58:45.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5c9d9b640 1 --2- 172.21.15.112:0/3631590427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0b4d10 0x7fa5cc15c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:45.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5c9d9b640 1 -- 172.21.15.112:0/3631590427 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5cc0b4360 msgr2=0x7fa5cc1565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:45.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5c9d9b640 1 --2- 172.21.15.112:0/3631590427 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5cc0b4360 0x7fa5cc1565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:45.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5c9d9b640 1 -- 172.21.15.112:0/3631590427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5cc15e630 msgr2=0x7fa5cc150430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:58:45.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5c9d9b640 1 --2- 172.21.15.112:0/3631590427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5cc15e630 0x7fa5cc150430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:45.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.788+0000 7fa5c9d9b640 1 -- 172.21.15.112:0/3631590427 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc15b740 con 0x7fa5cc0b4d10 2024-09-15T23:58:45.797 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.792+0000 7fa5c9d9b640 1 --2- 172.21.15.112:0/3631590427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0b4d10 0x7fa5cc15c7e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00ab000 tx=0x7fa5c00192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:45.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.792+0000 7fa5baffd640 1 -- 172.21.15.112:0/3631590427 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c00b0040 con 0x7fa5cc0b4d10 2024-09-15T23:58:45.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.792+0000 7fa5baffd640 1 -- 172.21.15.112:0/3631590427 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c00ab400 con 0x7fa5cc0b4d10 2024-09-15T23:58:45.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.792+0000 7fa5baffd640 1 -- 172.21.15.112:0/3631590427 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c00aa8f0 con 0x7fa5cc0b4d10 2024-09-15T23:58:45.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.792+0000 7fa5d0ef5640 1 -- 172.21.15.112:0/3631590427 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5cc15ba20 con 0x7fa5cc0b4d10 2024-09-15T23:58:45.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.792+0000 7fa5d0ef5640 1 -- 172.21.15.112:0/3631590427 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5cc15bfe0 con 0x7fa5cc0b4d10 2024-09-15T23:58:45.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.796+0000 7fa5b8ff9640 1 -- 172.21.15.112:0/3631590427 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5cc0b47d0 con 0x7fa5cc0b4d10 2024-09-15T23:58:45.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.796+0000 7fa5baffd640 1 -- 172.21.15.112:0/3631590427 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5c00bb020 con 0x7fa5cc0b4d10 2024-09-15T23:58:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.804+0000 7fa5baffd640 1 --2- 172.21.15.112:0/3631590427 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa5ac067910 0x7fa5ac069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:45.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.804+0000 7fa5baffd640 1 -- 172.21.15.112:0/3631590427 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7fa5c011f650 con 0x7fa5cc0b4d10 2024-09-15T23:58:45.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.804+0000 7fa5ca59c640 1 --2- 172.21.15.112:0/3631590427 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa5ac067910 0x7fa5ac069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:45.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.804+0000 7fa5ca59c640 1 --2- 172.21.15.112:0/3631590427 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa5ac067910 0x7fa5ac069dd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc007fd0 tx=0x7fa5bc007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:45.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:45.804+0000 7fa5baffd640 1 -- 172.21.15.112:0/3631590427 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa5c00160f0 con 0x7fa5cc0b4d10 2024-09-15T23:58:46.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:46.068+0000 7fa5b8ff9640 1 -- 172.21.15.112:0/3631590427 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5cc15aed0 con 0x7fa5cc0b4d10 2024-09-15T23:58:46.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:46.072+0000 7fa5baffd640 1 -- 172.21.15.112:0/3631590427 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7fa5c00f0020 con 0x7fa5cc0b4d10 2024-09-15T23:58:46.072 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:46.072 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:46.072 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:46.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:46.072+0000 7fa5b8ff9640 1 -- 172.21.15.112:0/3631590427 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa5ac067910 msgr2=0x7fa5ac069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:46.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:46.072+0000 7fa5b8ff9640 1 --2- 172.21.15.112:0/3631590427 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa5ac067910 0x7fa5ac069dd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc007fd0 tx=0x7fa5bc007d80 comp rx=0 tx=0).stop 2024-09-15T23:58:46.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:46.072+0000 7fa5b8ff9640 1 -- 172.21.15.112:0/3631590427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0b4d10 msgr2=0x7fa5cc15c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:46.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:46.072+0000 7fa5b8ff9640 1 --2- 172.21.15.112:0/3631590427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0b4d10 0x7fa5cc15c7e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00ab000 tx=0x7fa5c00192a0 comp rx=0 tx=0).stop 2024-09-15T23:58:46.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:46.072+0000 7fa5b8ff9640 1 -- 172.21.15.112:0/3631590427 shutdown_connections 2024-09-15T23:58:46.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:46.072+0000 7fa5b8ff9640 1 --2- 172.21.15.112:0/3631590427 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa5ac067910 0x7fa5ac069dd0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:46.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:46.072+0000 7fa5b8ff9640 1 --2- 172.21.15.112:0/3631590427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5cc15e630 0x7fa5cc150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:46.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:46.072+0000 7fa5b8ff9640 1 --2- 172.21.15.112:0/3631590427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5cc0b4d10 0x7fa5cc15c7e0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:46.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:46.072+0000 7fa5b8ff9640 1 --2- 172.21.15.112:0/3631590427 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5cc0b4360 0x7fa5cc1565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:46.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:46.072+0000 7fa5b8ff9640 1 -- 172.21.15.112:0/3631590427 >> 172.21.15.112:0/3631590427 conn(0x7fa5cc0b1e60 msgr2=0x7fa5cc0afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:46.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:46.072+0000 7fa5b8ff9640 1 -- 172.21.15.112:0/3631590427 shutdown_connections 2024-09-15T23:58:46.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:46.072+0000 7fa5b8ff9640 1 -- 172.21.15.112:0/3631590427 wait complete. 2024-09-15T23:58:46.092 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-15T23:58:46.236 INFO:teuthology.orchestra.run.smithi112.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":8105,"msgr_send_messages":16870,"msgr_recv_bytes":2959015,"msgr_send_bytes":8404374,"msgr_created_connections":10,"msgr_active_connections":2,"msgr_running_total_time":0.794186614,"msgr_running_send_time":0.433312413,"msgr_running_recv_time":0.424270170,"msgr_running_fast_dispatch_time":0.004192453,"msgr_send_messages_queue_lat":{"avgcount":16869,"sum":0.332194245,"avgtime":0.000019692},"msgr_handle_ack_lat":{"avgcount":23444,"sum":0.003664072,"avgtime":0.000000156},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":192,"msgr_send_messages":199,"msgr_recv_bytes":57105,"msgr_send_bytes":9079135,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.053036331,"msgr_running_send_time":0.033118515,"msgr_running_recv_time":0.007383786,"msgr_running_fast_dispatch_time":0.011258471,"msgr_send_messages_queue_lat":{"avgcount":197,"sum":0.028588594,"avgtime":0.000145119},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":95536},"AsyncMessenger::Worker-2":{"msgr_recv_messages":204,"msgr_send_messages":199,"msgr_recv_bytes":155239,"msgr_send_bytes":1872161,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.037537204,"msgr_running_send_time":0.020035542,"msgr_running_recv_time":0.010373621,"msgr_running_fast_dispatch_time":0.007544217,"msgr_send_messages_queue_lat":{"avgcount":198,"sum":0.029190942,"avgtime":0.000147429},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":107376,"msgr_send_encrypted_bytes":8432},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":1514,"complete_latency":{"avgcount":89,"sum":4.316746064,"avgtime":0.048502764}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":723,"sum":0.276394704,"avgtime":0.000382288}},"mds":{"request":4742,"reply":4740,"reply_latency":{"avgcount":4740,"sum":7.744992154,"avgtime":0.001633964},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":4668,"inodes_top":0,"inodes_bottom":4668,"inodes_pin_tail":0,"inodes_pinned":4668,"inodes_expired":0,"inodes_with_caps":2793,"caps":2793,"subtrees":2,"traverse":4748,"traverse_hit":4747,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":2379,"root_rbytes":9353216,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":583,"ceph_cap_op_grant":4670,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":3177,"handle_client_caps_dirty":2973,"handle_client_cap_release":3,"process_request_cap_release":6261},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":1121,"num_strays_delayed":301,"num_strays_enqueuing":0,"strays_created":1530,"strays_enqueued":409,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":8326,"evex":0,"evtrm":0,"ev":8329,"evexg":0,"evexd":0,"segadd":11,"segex":0,"segtrm":0,"seg":13,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":21774778,"rdpos":4195244,"jlat":{"avgcount":16,"sum":1.796925493,"avgtime":0.112307843},"replayed":3},"mds_mem":{"ino":3214,"ino+":3214,"ino-":0,"dir":13,"dir+":13,"dir-":0,"dn":4741,"dn+":4741,"dn-":0,"cap":2492,"cap+":3202,"cap-":710,"rss":105628,"heap":248116},"mds_server":{"dispatch_client_request":4745,"dispatch_server_request":0,"handle_client_request":4742,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.501283897,"avgtime":0.001094151},"req_getattr_latency":{"avgcount":6,"sum":0.001946066,"avgtime":0.000324344},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004077767,"avgtime":0.004077767},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.251883026,"avgtime":0.083961008},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":1530,"sum":3.985801398,"avgtime":0.002605098},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":4372,"average_load":4372,"avg_session_uptime":1046,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":6692391,"buffer_anon_items":2278,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6040,"osdmap_items":99,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":15328789,"mds_co_items":116665,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":502,"op_send_bytes":17205845,"op_resend":0,"op_reply":502,"op_latency":{"avgcount":502,"sum":1.511984921,"avgtime":0.003011922},"op_inflight":0,"oplen_avg":{"avgcount":502,"sum":564},"op":502,"op_r":40,"op_w":462,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":12,"osdop_write":20,"osdop_writefull":5,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":424,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":103,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":22,"omap_rd":48,"omap_del":6},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":6,"pq_executing":0,"pq_executing_high_water":6,"pq_executed_ops":409,"pq_executed":409,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":7585,"max":104857600,"get_started":0,"get":8497,"get_sum":2403811,"get_or_fail_fail":0,"get_or_fail_success":8497,"take":0,"take_sum":0,"put":8468,"put_sum":2396226,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":502,"take_sum":17248273,"put":502,"put_sum":17248273,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":502,"take_sum":502,"put":502,"put_sum":502,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":409,"get_sum":41309,"get_or_fail_fail":0,"get_or_fail_success":409,"take":0,"take_sum":0,"put":4,"put_sum":41309,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55eb22390a00":{"val":805191,"max":3758096384,"get_started":0,"get":8327,"get_sum":17581024,"get_or_fail_fail":0,"get_or_fail_success":8327,"take":0,"take_sum":0,"put":16,"put_sum":16775833,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T23:58:46.238 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 23444, "avgtime": 1.56e-07, "sum": 0.003664072 }, "msgr_recv_bytes": 2959015, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 8105, "msgr_running_fast_dispatch_time": 0.004192453, "msgr_running_recv_time": 0.42427017, "msgr_running_send_time": 0.433312413, "msgr_running_total_time": 0.794186614, "msgr_send_bytes": 8404374, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 16870, "msgr_send_messages_queue_lat": { "avgcount": 16869, "avgtime": 1.9692e-05, "sum": 0.332194245 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 57105, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 192, "msgr_running_fast_dispatch_time": 0.011258471, "msgr_running_recv_time": 0.007383786, "msgr_running_send_time": 0.033118515, "msgr_running_total_time": 0.053036331, "msgr_send_bytes": 9079135, "msgr_send_encrypted_bytes": 95536, "msgr_send_messages": 199, "msgr_send_messages_queue_lat": { "avgcount": 197, "avgtime": 0.000145119, "sum": 0.028588594 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 155239, "msgr_recv_encrypted_bytes": 107376, "msgr_recv_messages": 204, "msgr_running_fast_dispatch_time": 0.007544217, "msgr_running_recv_time": 0.010373621, "msgr_running_send_time": 0.020035542, "msgr_running_total_time": 0.037537204, "msgr_send_bytes": 1872161, "msgr_send_encrypted_bytes": 8432, "msgr_send_messages": 199, "msgr_send_messages_queue_lat": { "avgcount": 198, "avgtime": 0.000147429, "sum": 0.029190942 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 89, "avgtime": 0.048502764, "sum": 4.316746064 }, "queue_len": 1514 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 723, "avgtime": 0.000382288, "sum": 0.276394704 }, "queue_len": 0 }, "mds": { "caps": 2793, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 4670, "ceph_cap_op_revoke": 583, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 3, "handle_client_caps": 3177, "handle_client_caps_dirty": 2973, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 4668, "inodes_bottom": 4668, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 4668, "inodes_top": 0, "inodes_with_caps": 2793, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 6261, "q": 0, "reply": 4740, "reply_latency": { "avgcount": 4740, "avgtime": 0.001633964, "sum": 7.744992154 }, "request": 4742, "root_rbytes": 9353216, "root_rfiles": 2379, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4748, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4747, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 1121, "num_strays_delayed": 301, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 1530, "strays_enqueued": 409, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 8329, "evadd": 8326, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 16, "avgtime": 0.112307843, "sum": 1.796925493 }, "rdpos": 4195244, "replayed": 3, "seg": 13, "segadd": 11, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 21774778 }, "mds_mem": { "cap": 2492, "cap+": 3202, "cap-": 710, "dir": 13, "dir+": 13, "dir-": 0, "dn": 4741, "dn+": 4741, "dn-": 0, "heap": 248116, "ino": 3214, "ino+": 3214, "ino-": 0, "rss": 105628 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 4745, "dispatch_server_request": 0, "handle_client_request": 4742, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001094151, "sum": 3.501283897 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.000324344, "sum": 0.001946066 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004077767, "sum": 0.004077767 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.083961008, "sum": 0.251883026 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 1530, "avgtime": 0.002605098, "sum": 3.985801398 } }, "mds_sessions": { "average_load": 4372, "avg_session_uptime": 1046, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 4372 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 6692391, "buffer_anon_items": 2278, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 15328789, "mds_co_items": 116665, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6040, "osdmap_items": 99, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 103, "map_full": 0, "map_inc": 2, "omap_del": 6, "omap_rd": 48, "omap_wr": 22, "op": 502, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 502, "avgtime": 0.003011922, "sum": 1.511984921 }, "op_pg": 0, "op_r": 40, "op_reply": 502, "op_resend": 0, "op_rmw": 0, "op_send": 502, "op_send_bytes": 17205845, "op_w": 462, "oplen_avg": { "avgcount": 502, "sum": 564 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 424, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 12, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 20, "osdop_writefull": 5, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 409, "pq_executed_ops": 409, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executing_ops": 0, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 8497, "get_or_fail_fail": 0, "get_or_fail_success": 8497, "get_started": 0, "get_sum": 2403811, "max": 104857600, "put": 8468, "put_sum": 2396226, "take": 0, "take_sum": 0, "val": 7585, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 502, "put_sum": 17248273, "take": 502, "take_sum": 17248273, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 502, "put_sum": 502, "take": 502, "take_sum": 502, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 409, "get_or_fail_fail": 0, "get_or_fail_success": 409, "get_started": 0, "get_sum": 41309, "max": 3758096384, "put": 4, "put_sum": 41309, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55eb22390a00": { "get": 8327, "get_or_fail_fail": 0, "get_or_fail_success": 8327, "get_started": 0, "get_sum": 17581024, "max": 3758096384, "put": 16, "put_sum": 16775833, "take": 0, "take_sum": 0, "val": 805191, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T23:58:46.239 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/1121, 409/1530 2024-09-15T23:58:47.240 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:47.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f54781a6640 1 Processor -- start 2024-09-15T23:58:47.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f54781a6640 1 -- start start 2024-09-15T23:58:47.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f54781a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5470161c70 0x7f5470075030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:47.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f54781a6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5470075570 0x7f54700d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:47.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f54781a6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f54700d0ac0 0x7f54700cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:47.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f54781a6640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f54700759b0 con 0x7f5470075570 2024-09-15T23:58:47.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f54781a6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f547015ec10 con 0x7f54700d0ac0 2024-09-15T23:58:47.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f54781a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f547015e980 con 0x7f5470161c70 2024-09-15T23:58:47.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f5475741640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5470075570 0x7f54700d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:47.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f5475741640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5470075570 0x7f54700d0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54756/0 (socket says 172.21.15.112:54756) 2024-09-15T23:58:47.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f5475741640 1 -- 172.21.15.112:0/4026968076 learned_addr learned my addr 172.21.15.112:0/4026968076 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:47.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f5476743640 1 --2- 172.21.15.112:0/4026968076 >> v2:172.21.15.169:3300/0 conn(0x7f54700d0ac0 0x7f54700cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:47.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f5475741640 1 -- 172.21.15.112:0/4026968076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5470161c70 msgr2=0x7f5470075030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:47.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f5475f42640 1 --2- 172.21.15.112:0/4026968076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5470161c70 0x7f5470075030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:47.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f5475741640 1 --2- 172.21.15.112:0/4026968076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5470161c70 0x7f5470075030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:47.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f5475741640 1 -- 172.21.15.112:0/4026968076 >> v2:172.21.15.169:3300/0 conn(0x7f54700d0ac0 msgr2=0x7f54700cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:47.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f5475741640 1 --2- 172.21.15.112:0/4026968076 >> v2:172.21.15.169:3300/0 conn(0x7f54700d0ac0 0x7f54700cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:47.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f5475741640 1 -- 172.21.15.112:0/4026968076 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547015ee80 con 0x7f5470075570 2024-09-15T23:58:47.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.352+0000 7f5476743640 1 --2- 172.21.15.112:0/4026968076 >> v2:172.21.15.169:3300/0 conn(0x7f54700d0ac0 0x7f54700cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:47.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f5475741640 1 --2- 172.21.15.112:0/4026968076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5470075570 0x7f54700d0580 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f54700b6b00 tx=0x7f546001c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269f56f733903350 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:47.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f5474f40640 1 -- 172.21.15.112:0/4026968076 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54600b0070 con 0x7f5470075570 2024-09-15T23:58:47.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f5474f40640 1 -- 172.21.15.112:0/4026968076 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54600ab600 con 0x7f5470075570 2024-09-15T23:58:47.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f5474f40640 1 -- 172.21.15.112:0/4026968076 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54600ab9d0 con 0x7f5470075570 2024-09-15T23:58:47.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f54781a6640 1 -- 172.21.15.112:0/4026968076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5470075570 msgr2=0x7f54700d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:47.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f54781a6640 1 --2- 172.21.15.112:0/4026968076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5470075570 0x7f54700d0580 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f54700b6b00 tx=0x7f546001c230 comp rx=0 tx=0).stop 2024-09-15T23:58:47.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f54781a6640 1 -- 172.21.15.112:0/4026968076 shutdown_connections 2024-09-15T23:58:47.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f54781a6640 1 --2- 172.21.15.112:0/4026968076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5470075570 0x7f54700d0580 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:47.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f54781a6640 1 --2- 172.21.15.112:0/4026968076 >> v2:172.21.15.169:3300/0 conn(0x7f54700d0ac0 0x7f54700cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:47.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f54781a6640 1 --2- 172.21.15.112:0/4026968076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5470161c70 0x7f5470075030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:47.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f54781a6640 1 -- 172.21.15.112:0/4026968076 >> 172.21.15.112:0/4026968076 conn(0x7f5470067a00 msgr2=0x7f5470067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:47.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f54781a6640 1 -- 172.21.15.112:0/4026968076 shutdown_connections 2024-09-15T23:58:47.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f54781a6640 1 -- 172.21.15.112:0/4026968076 wait complete. 2024-09-15T23:58:47.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f54781a6640 1 Processor -- start 2024-09-15T23:58:47.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.356+0000 7f54781a6640 1 -- start start 2024-09-15T23:58:47.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f54781a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5470075570 0x7f54701516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:47.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f54781a6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54700d0ac0 0x7f5470157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:47.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f54781a6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5470161c70 0x7f54700af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:47.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f54781a6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f54700d1050 con 0x7f54700d0ac0 2024-09-15T23:58:47.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f54781a6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f54700d0ed0 con 0x7f5470161c70 2024-09-15T23:58:47.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f54781a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f547015fcc0 con 0x7f5470075570 2024-09-15T23:58:47.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f5475741640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54700d0ac0 0x7f5470157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:47.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f5475741640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54700d0ac0 0x7f5470157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54758/0 (socket says 172.21.15.112:54758) 2024-09-15T23:58:47.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f5475741640 1 -- 172.21.15.112:0/527971312 learned_addr learned my addr 172.21.15.112:0/527971312 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:47.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f5476743640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5470161c70 0x7f54700af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:47.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f5475f42640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5470075570 0x7f54701516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:47.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f5475741640 1 -- 172.21.15.112:0/527971312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5470075570 msgr2=0x7f54701516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:47.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f5475741640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5470075570 0x7f54701516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:47.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f5475741640 1 -- 172.21.15.112:0/527971312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5470161c70 msgr2=0x7f54700af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:47.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f5475741640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5470161c70 0x7f54700af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:47.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f5475741640 1 -- 172.21.15.112:0/527971312 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5470156a70 con 0x7f54700d0ac0 2024-09-15T23:58:47.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f5475f42640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5470075570 0x7f54701516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:47.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f5475741640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54700d0ac0 0x7f5470157f60 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f54600ae040 tx=0x7f5460018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:47.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f54667fc640 1 -- 172.21.15.112:0/527971312 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54600b0040 con 0x7f54700d0ac0 2024-09-15T23:58:47.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f54667fc640 1 -- 172.21.15.112:0/527971312 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54600b9070 con 0x7f54700d0ac0 2024-09-15T23:58:47.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f54667fc640 1 -- 172.21.15.112:0/527971312 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54600b48a0 con 0x7f54700d0ac0 2024-09-15T23:58:47.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f54781a6640 1 -- 172.21.15.112:0/527971312 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5470156d50 con 0x7f54700d0ac0 2024-09-15T23:58:47.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f54781a6640 1 -- 172.21.15.112:0/527971312 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5470155990 con 0x7f54700d0ac0 2024-09-15T23:58:47.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f54781a6640 1 -- 172.21.15.112:0/527971312 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54700cf260 con 0x7f54700d0ac0 2024-09-15T23:58:47.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.360+0000 7f54667fc640 1 -- 172.21.15.112:0/527971312 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f54600ab4c0 con 0x7f54700d0ac0 2024-09-15T23:58:47.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.364+0000 7f54667fc640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f54540678c0 0x7f5454069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:47.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.364+0000 7f54667fc640 1 -- 172.21.15.112:0/527971312 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f546011fdb0 con 0x7f54700d0ac0 2024-09-15T23:58:47.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.364+0000 7f5475f42640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f54540678c0 0x7f5454069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:47.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.364+0000 7f5475f42640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f54540678c0 0x7f5454069d80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f54701553d0 tx=0x7f546c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:47.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.368+0000 7f54667fc640 1 -- 172.21.15.112:0/527971312 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5460016110 con 0x7f54700d0ac0 2024-09-15T23:58:47.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.648+0000 7f54781a6640 1 -- 172.21.15.112:0/527971312 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5470068900 con 0x7f54700d0ac0 2024-09-15T23:58:47.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.648+0000 7f54667fc640 1 -- 172.21.15.112:0/527971312 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7f54600f06a0 con 0x7f54700d0ac0 2024-09-15T23:58:47.650 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:47.650 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:47.651 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:47.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.652+0000 7f54781a6640 1 -- 172.21.15.112:0/527971312 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f54540678c0 msgr2=0x7f5454069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:47.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.652+0000 7f54781a6640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f54540678c0 0x7f5454069d80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f54701553d0 tx=0x7f546c008040 comp rx=0 tx=0).stop 2024-09-15T23:58:47.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.652+0000 7f54781a6640 1 -- 172.21.15.112:0/527971312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54700d0ac0 msgr2=0x7f5470157f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:47.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.652+0000 7f54781a6640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54700d0ac0 0x7f5470157f60 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f54600ae040 tx=0x7f5460018fd0 comp rx=0 tx=0).stop 2024-09-15T23:58:47.654 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.652+0000 7f54781a6640 1 -- 172.21.15.112:0/527971312 shutdown_connections 2024-09-15T23:58:47.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.652+0000 7f54781a6640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f54540678c0 0x7f5454069d80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:47.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.652+0000 7f54781a6640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5470161c70 0x7f54700af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:47.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.652+0000 7f54781a6640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f54700d0ac0 0x7f5470157f60 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:47.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.652+0000 7f54781a6640 1 --2- 172.21.15.112:0/527971312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5470075570 0x7f54701516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:47.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.652+0000 7f54781a6640 1 -- 172.21.15.112:0/527971312 >> 172.21.15.112:0/527971312 conn(0x7f5470067a00 msgr2=0x7f5470157070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:47.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.652+0000 7f54781a6640 1 -- 172.21.15.112:0/527971312 shutdown_connections 2024-09-15T23:58:47.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:47.652+0000 7f54781a6640 1 -- 172.21.15.112:0/527971312 wait complete. 2024-09-15T23:58:47.673 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-15T23:58:47.828 INFO:teuthology.orchestra.run.smithi112.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":8946,"msgr_send_messages":19591,"msgr_recv_bytes":3324123,"msgr_send_bytes":11815335,"msgr_created_connections":10,"msgr_active_connections":2,"msgr_running_total_time":0.898033573,"msgr_running_send_time":0.494302129,"msgr_running_recv_time":0.467937545,"msgr_running_fast_dispatch_time":0.008194731,"msgr_send_messages_queue_lat":{"avgcount":19590,"sum":0.393531709,"avgtime":0.000020088},"msgr_handle_ack_lat":{"avgcount":26038,"sum":0.004115909,"avgtime":0.000000158},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":281,"msgr_send_messages":288,"msgr_recv_bytes":79871,"msgr_send_bytes":9110319,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.058678435,"msgr_running_send_time":0.035054357,"msgr_running_recv_time":0.008741294,"msgr_running_fast_dispatch_time":0.013240684,"msgr_send_messages_queue_lat":{"avgcount":286,"sum":0.030511958,"avgtime":0.000106685},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":95536},"AsyncMessenger::Worker-2":{"msgr_recv_messages":334,"msgr_send_messages":329,"msgr_recv_bytes":188269,"msgr_send_bytes":1914937,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.045003189,"msgr_running_send_time":0.022703078,"msgr_running_recv_time":0.012298662,"msgr_running_fast_dispatch_time":0.009904887,"msgr_send_messages_queue_lat":{"avgcount":328,"sum":0.031753845,"avgtime":0.000096810},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":107648,"msgr_send_encrypted_bytes":9072},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":1158,"complete_latency":{"avgcount":91,"sum":5.806952954,"avgtime":0.063812669}},"finisher-PurgeQueue":{"queue_len":109,"complete_latency":{"avgcount":1255,"sum":0.699674641,"avgtime":0.000557509}},"mds":{"request":5483,"reply":5481,"reply_latency":{"avgcount":5481,"sum":8.984303405,"avgtime":0.001639172},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":5073,"inodes_top":0,"inodes_bottom":5073,"inodes_pin_tail":0,"inodes_pinned":5073,"inodes_expired":0,"inodes_with_caps":2241,"caps":2241,"subtrees":2,"traverse":5489,"traverse_hit":5488,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1844,"root_rbytes":13288448,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":583,"ceph_cap_op_grant":5434,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":3204,"handle_client_caps_dirty":3000,"handle_client_cap_release":4,"process_request_cap_release":7743},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":1456,"num_strays_delayed":0,"num_strays_enqueuing":146,"strays_created":2271,"strays_enqueued":815,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":9503,"evex":0,"evtrm":0,"ev":9506,"evexg":0,"evexd":0,"segadd":12,"segex":0,"segtrm":0,"seg":14,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":24434374,"rdpos":4195244,"jlat":{"avgcount":17,"sum":1.810610321,"avgtime":0.106506489},"replayed":3},"mds_mem":{"ino":2805,"ino+":3214,"ino-":409,"dir":13,"dir+":13,"dir-":0,"dn":5073,"dn+":5482,"dn-":409,"cap":2241,"cap+":3202,"cap-":961,"rss":101840,"heap":248116},"mds_server":{"dispatch_client_request":5486,"dispatch_server_request":0,"handle_client_request":5483,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.501283897,"avgtime":0.001094151},"req_getattr_latency":{"avgcount":6,"sum":0.001946066,"avgtime":0.000324344},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004077767,"avgtime":0.004077767},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.251883026,"avgtime":0.083961008},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":2271,"sum":5.225112649,"avgtime":0.002300798},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":5023,"average_load":5023,"avg_session_uptime":1046,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":6692391,"buffer_anon_items":2278,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6040,"osdmap_items":99,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":15328789,"mds_co_items":116665,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":818,"op_send_bytes":19669780,"op_resend":0,"op_reply":818,"op_latency":{"avgcount":818,"sum":2.283977231,"avgtime":0.002792148},"op_inflight":0,"oplen_avg":{"avgcount":818,"sum":884},"op":818,"op_r":45,"op_w":773,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":17,"osdop_write":27,"osdop_writefull":6,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":725,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":103,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":26,"omap_rd":48,"omap_del":8},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":6,"pq_executing":0,"pq_executing_high_water":6,"pq_executed_ops":710,"pq_executed":710,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":304,"max":104857600,"get_started":0,"get":9557,"get_sum":2729263,"get_or_fail_fail":0,"get_or_fail_success":9557,"take":0,"take_sum":0,"put":9556,"put_sum":2728959,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":818,"take_sum":19753416,"put":818,"put_sum":19753416,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":818,"take_sum":818,"put":818,"put_sum":818,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":961,"get_sum":97061,"get_or_fail_fail":0,"get_or_fail_success":961,"take":0,"take_sum":0,"put":10,"put_sum":97061,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55eb22390a00":{"val":1057386,"max":3758096384,"get_started":0,"get":9504,"get_sum":20239286,"get_or_fail_fail":0,"get_or_fail_success":9504,"take":0,"take_sum":0,"put":17,"put_sum":19181900,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T23:58:47.831 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 26038, "avgtime": 1.58e-07, "sum": 0.004115909 }, "msgr_recv_bytes": 3324123, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 8946, "msgr_running_fast_dispatch_time": 0.008194731, "msgr_running_recv_time": 0.467937545, "msgr_running_send_time": 0.494302129, "msgr_running_total_time": 0.898033573, "msgr_send_bytes": 11815335, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 19591, "msgr_send_messages_queue_lat": { "avgcount": 19590, "avgtime": 2.0088e-05, "sum": 0.393531709 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 79871, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 281, "msgr_running_fast_dispatch_time": 0.013240684, "msgr_running_recv_time": 0.008741294, "msgr_running_send_time": 0.035054357, "msgr_running_total_time": 0.058678435, "msgr_send_bytes": 9110319, "msgr_send_encrypted_bytes": 95536, "msgr_send_messages": 288, "msgr_send_messages_queue_lat": { "avgcount": 286, "avgtime": 0.000106685, "sum": 0.030511958 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 188269, "msgr_recv_encrypted_bytes": 107648, "msgr_recv_messages": 334, "msgr_running_fast_dispatch_time": 0.009904887, "msgr_running_recv_time": 0.012298662, "msgr_running_send_time": 0.022703078, "msgr_running_total_time": 0.045003189, "msgr_send_bytes": 1914937, "msgr_send_encrypted_bytes": 9072, "msgr_send_messages": 329, "msgr_send_messages_queue_lat": { "avgcount": 328, "avgtime": 9.681e-05, "sum": 0.031753845 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 91, "avgtime": 0.063812669, "sum": 5.806952954 }, "queue_len": 1158 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 1255, "avgtime": 0.000557509, "sum": 0.699674641 }, "queue_len": 109 }, "mds": { "caps": 2241, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 5434, "ceph_cap_op_revoke": 583, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 4, "handle_client_caps": 3204, "handle_client_caps_dirty": 3000, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 5073, "inodes_bottom": 5073, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 5073, "inodes_top": 0, "inodes_with_caps": 2241, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 7743, "q": 0, "reply": 5481, "reply_latency": { "avgcount": 5481, "avgtime": 0.001639172, "sum": 8.984303405 }, "request": 5483, "root_rbytes": 13288448, "root_rfiles": 1844, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 5489, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 5488, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 1456, "num_strays_delayed": 0, "num_strays_enqueuing": 146, "recovery_completed": 0, "recovery_started": 0, "strays_created": 2271, "strays_enqueued": 815, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 9506, "evadd": 9503, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 17, "avgtime": 0.106506489, "sum": 1.810610321 }, "rdpos": 4195244, "replayed": 3, "seg": 14, "segadd": 12, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 24434374 }, "mds_mem": { "cap": 2241, "cap+": 3202, "cap-": 961, "dir": 13, "dir+": 13, "dir-": 0, "dn": 5073, "dn+": 5482, "dn-": 409, "heap": 248116, "ino": 2805, "ino+": 3214, "ino-": 409, "rss": 101840 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 5486, "dispatch_server_request": 0, "handle_client_request": 5483, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001094151, "sum": 3.501283897 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.000324344, "sum": 0.001946066 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004077767, "sum": 0.004077767 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.083961008, "sum": 0.251883026 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 2271, "avgtime": 0.002300798, "sum": 5.225112649 } }, "mds_sessions": { "average_load": 5023, "avg_session_uptime": 1046, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5023 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 6692391, "buffer_anon_items": 2278, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 15328789, "mds_co_items": 116665, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6040, "osdmap_items": 99, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 103, "map_full": 0, "map_inc": 2, "omap_del": 8, "omap_rd": 48, "omap_wr": 26, "op": 818, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 818, "avgtime": 0.002792148, "sum": 2.283977231 }, "op_pg": 0, "op_r": 45, "op_reply": 818, "op_resend": 0, "op_rmw": 0, "op_send": 818, "op_send_bytes": 19669780, "op_w": 773, "oplen_avg": { "avgcount": 818, "sum": 884 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 725, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 17, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 27, "osdop_writefull": 6, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 710, "pq_executed_ops": 710, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executing_ops": 0, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 9557, "get_or_fail_fail": 0, "get_or_fail_success": 9557, "get_started": 0, "get_sum": 2729263, "max": 104857600, "put": 9556, "put_sum": 2728959, "take": 0, "take_sum": 0, "val": 304, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 818, "put_sum": 19753416, "take": 818, "take_sum": 19753416, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 818, "put_sum": 818, "take": 818, "take_sum": 818, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 961, "get_or_fail_fail": 0, "get_or_fail_success": 961, "get_started": 0, "get_sum": 97061, "max": 3758096384, "put": 10, "put_sum": 97061, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55eb22390a00": { "get": 9504, "get_or_fail_fail": 0, "get_or_fail_success": 9504, "get_started": 0, "get_sum": 20239286, "max": 3758096384, "put": 17, "put_sum": 19181900, "take": 0, "take_sum": 0, "val": 1057386, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T23:58:47.832 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/1456, 710/2271 2024-09-15T23:58:48.833 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:48.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.972+0000 7f068f598640 1 Processor -- start 2024-09-15T23:58:48.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.972+0000 7f068f598640 1 -- start start 2024-09-15T23:58:48.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.972+0000 7f068f598640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f068815e6f0 0x7f06880cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:48.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.972+0000 7f068f598640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06880d15d0 0x7f06880b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:48.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.972+0000 7f068f598640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06880b7740 con 0x7f06880cfc00 2024-09-15T23:58:48.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.972+0000 7f068f598640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f06880d3850 con 0x7f06880d15d0 2024-09-15T23:58:48.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.972+0000 7f068f598640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f06880d3b30 con 0x7f068815e6f0 2024-09-15T23:58:48.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.972+0000 7f068db35640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f06880d15d0 0x7f06880b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:48.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.972+0000 7f068cb33640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f06880cfc00 0x7f06880d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56252/0 (socket says 172.21.15.112:56252) 2024-09-15T23:58:48.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.972+0000 7f068cb33640 1 -- 172.21.15.112:0/2971846649 learned_addr learned my addr 172.21.15.112:0/2971846649 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:48.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.972+0000 7f068db35640 1 -- 172.21.15.112:0/2971846649 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f068815e6f0 msgr2=0x7f06880cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:48.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.972+0000 7f068db35640 1 --2- 172.21.15.112:0/2971846649 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f068815e6f0 0x7f06880cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:48.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.972+0000 7f068db35640 1 -- 172.21.15.112:0/2971846649 >> v1:172.21.15.112:6789/0 conn(0x7f06880cfc00 legacy=0x7f06880d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:48.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.972+0000 7f068db35640 1 -- 172.21.15.112:0/2971846649 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06880d3e10 con 0x7f06880d15d0 2024-09-15T23:58:48.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.976+0000 7f068db35640 1 --2- 172.21.15.112:0/2971846649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06880d15d0 0x7f06880b7c20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f06800097c0 tx=0x7f068001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b036895d58114f78 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:48.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.976+0000 7f067ffff640 1 -- 172.21.15.112:0/2971846649 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06800b0070 con 0x7f06880d15d0 2024-09-15T23:58:48.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.976+0000 7f067ffff640 1 -- 172.21.15.112:0/2971846649 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06800ab600 con 0x7f06880d15d0 2024-09-15T23:58:48.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.976+0000 7f067ffff640 1 -- 172.21.15.112:0/2971846649 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06800ab9d0 con 0x7f06880d15d0 2024-09-15T23:58:48.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.976+0000 7f068f598640 1 -- 172.21.15.112:0/2971846649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06880d15d0 msgr2=0x7f06880b7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:48.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.976+0000 7f068f598640 1 --2- 172.21.15.112:0/2971846649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06880d15d0 0x7f06880b7c20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f06800097c0 tx=0x7f068001c3e0 comp rx=0 tx=0).stop 2024-09-15T23:58:48.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.976+0000 7f068f598640 1 -- 172.21.15.112:0/2971846649 shutdown_connections 2024-09-15T23:58:48.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.976+0000 7f068f598640 1 --2- 172.21.15.112:0/2971846649 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06880d15d0 0x7f06880b7c20 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:48.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.976+0000 7f068f598640 1 --2- 172.21.15.112:0/2971846649 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f068815e6f0 0x7f06880cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:48.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.976+0000 7f068f598640 1 -- 172.21.15.112:0/2971846649 >> 172.21.15.112:0/2971846649 conn(0x7f06880722a0 msgr2=0x7f06880726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:48.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.976+0000 7f068f598640 1 -- 172.21.15.112:0/2971846649 shutdown_connections 2024-09-15T23:58:48.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.976+0000 7f068f598640 1 -- 172.21.15.112:0/2971846649 wait complete. 2024-09-15T23:58:48.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068f598640 1 Processor -- start 2024-09-15T23:58:48.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068f598640 1 -- start start 2024-09-15T23:58:48.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068f598640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f06880d15d0 0x7f0688151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:48.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068f598640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f068815e6f0 0x7f06881421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:48.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068f598640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0688151db0 0x7f06881426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:48.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068f598640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f06880b8d40 con 0x7f0688151db0 2024-09-15T23:58:48.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068f598640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f06880b8bc0 con 0x7f068815e6f0 2024-09-15T23:58:48.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068f598640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f06880b8ec0 con 0x7f06880d15d0 2024-09-15T23:58:48.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068db35640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0688151db0 0x7f06881426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:48.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068db35640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0688151db0 0x7f06881426e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43140/0 (socket says 172.21.15.112:43140) 2024-09-15T23:58:48.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068db35640 1 -- 172.21.15.112:0/329424667 learned_addr learned my addr 172.21.15.112:0/329424667 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:48.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068cb33640 1 --2- 172.21.15.112:0/329424667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f068815e6f0 0x7f06881421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:48.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068db35640 1 -- 172.21.15.112:0/329424667 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f06880d15d0 msgr2=0x7f0688151870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:58:48.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068db35640 1 --2- 172.21.15.112:0/329424667 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f06880d15d0 0x7f0688151870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:48.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068db35640 1 -- 172.21.15.112:0/329424667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f068815e6f0 msgr2=0x7f06881421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:48.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068db35640 1 --2- 172.21.15.112:0/329424667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f068815e6f0 0x7f06881421a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:48.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.980+0000 7f068db35640 1 -- 172.21.15.112:0/329424667 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0688150dd0 con 0x7f0688151db0 2024-09-15T23:58:48.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.984+0000 7f068db35640 1 --2- 172.21.15.112:0/329424667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0688151db0 0x7f06881426e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f06800097c0 tx=0x7f068001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:48.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.984+0000 7f067dffb640 1 -- 172.21.15.112:0/329424667 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06800b0050 con 0x7f0688151db0 2024-09-15T23:58:48.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.984+0000 7f068f598640 1 -- 172.21.15.112:0/329424667 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06880cb6e0 con 0x7f0688151db0 2024-09-15T23:58:48.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.984+0000 7f068f598640 1 -- 172.21.15.112:0/329424667 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0688151350 con 0x7f0688151db0 2024-09-15T23:58:48.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.984+0000 7f067dffb640 1 -- 172.21.15.112:0/329424667 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06800bc070 con 0x7f0688151db0 2024-09-15T23:58:48.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.984+0000 7f067dffb640 1 -- 172.21.15.112:0/329424667 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06800b5830 con 0x7f0688151db0 2024-09-15T23:58:48.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.984+0000 7f068f598640 1 -- 172.21.15.112:0/329424667 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06680052a0 con 0x7f0688151db0 2024-09-15T23:58:48.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.984+0000 7f067dffb640 1 -- 172.21.15.112:0/329424667 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f06800b59d0 con 0x7f0688151db0 2024-09-15T23:58:48.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.988+0000 7f067dffb640 1 --2- 172.21.15.112:0/329424667 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f066c067990 0x7f066c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:48.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.988+0000 7f067dffb640 1 -- 172.21.15.112:0/329424667 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f0680121310 con 0x7f0688151db0 2024-09-15T23:58:48.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.992+0000 7f068d334640 1 --2- 172.21.15.112:0/329424667 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f066c067990 0x7f066c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:48.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.992+0000 7f068d334640 1 --2- 172.21.15.112:0/329424667 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f066c067990 0x7f066c069e50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f068400ab90 tx=0x7f0684009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:48.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:48.992+0000 7f067dffb640 1 -- 172.21.15.112:0/329424667 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0680016090 con 0x7f0688151db0 2024-09-15T23:58:49.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:49.272+0000 7f068f598640 1 -- 172.21.15.112:0/329424667 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0668005590 con 0x7f0688151db0 2024-09-15T23:58:49.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:49.272+0000 7f067dffb640 1 -- 172.21.15.112:0/329424667 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7f06800f1d00 con 0x7f0688151db0 2024-09-15T23:58:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:49.275 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:49.275 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:49.276+0000 7f068f598640 1 -- 172.21.15.112:0/329424667 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f066c067990 msgr2=0x7f066c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:49.276+0000 7f068f598640 1 --2- 172.21.15.112:0/329424667 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f066c067990 0x7f066c069e50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f068400ab90 tx=0x7f0684009250 comp rx=0 tx=0).stop 2024-09-15T23:58:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:49.276+0000 7f068f598640 1 -- 172.21.15.112:0/329424667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0688151db0 msgr2=0x7f06881426e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:49.276+0000 7f068f598640 1 --2- 172.21.15.112:0/329424667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0688151db0 0x7f06881426e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f06800097c0 tx=0x7f068001ac20 comp rx=0 tx=0).stop 2024-09-15T23:58:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:49.276+0000 7f068f598640 1 -- 172.21.15.112:0/329424667 shutdown_connections 2024-09-15T23:58:49.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:49.276+0000 7f068f598640 1 --2- 172.21.15.112:0/329424667 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f066c067990 0x7f066c069e50 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:49.276+0000 7f068f598640 1 --2- 172.21.15.112:0/329424667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0688151db0 0x7f06881426e0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:49.276+0000 7f068f598640 1 --2- 172.21.15.112:0/329424667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f068815e6f0 0x7f06881421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:49.276+0000 7f068f598640 1 --2- 172.21.15.112:0/329424667 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f06880d15d0 0x7f0688151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:49.276+0000 7f068f598640 1 -- 172.21.15.112:0/329424667 >> 172.21.15.112:0/329424667 conn(0x7f06880722a0 msgr2=0x7f06880b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:49.276+0000 7f068f598640 1 -- 172.21.15.112:0/329424667 shutdown_connections 2024-09-15T23:58:49.278 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:49.276+0000 7f068f598640 1 -- 172.21.15.112:0/329424667 wait complete. 2024-09-15T23:58:49.294 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-15T23:58:49.445 INFO:teuthology.orchestra.run.smithi112.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":9889,"msgr_send_messages":22332,"msgr_recv_bytes":3743021,"msgr_send_bytes":14551341,"msgr_created_connections":10,"msgr_active_connections":2,"msgr_running_total_time":0.997913726,"msgr_running_send_time":0.549730089,"msgr_running_recv_time":0.513302882,"msgr_running_fast_dispatch_time":0.013132874,"msgr_send_messages_queue_lat":{"avgcount":22331,"sum":0.461289378,"avgtime":0.000020656},"msgr_handle_ack_lat":{"avgcount":28411,"sum":0.004505376,"avgtime":0.000000158},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":475,"msgr_send_messages":483,"msgr_recv_bytes":129203,"msgr_send_bytes":9696482,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.071602151,"msgr_running_send_time":0.040050652,"msgr_running_recv_time":0.011736519,"msgr_running_fast_dispatch_time":0.017330393,"msgr_send_messages_queue_lat":{"avgcount":481,"sum":0.038183182,"avgtime":0.000079382},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":97344},"AsyncMessenger::Worker-2":{"msgr_recv_messages":587,"msgr_send_messages":582,"msgr_recv_bytes":252515,"msgr_send_bytes":1997579,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.059887228,"msgr_running_send_time":0.027776319,"msgr_running_recv_time":0.016060761,"msgr_running_fast_dispatch_time":0.014864633,"msgr_send_messages_queue_lat":{"avgcount":581,"sum":0.039709125,"avgtime":0.000068346},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":107648,"msgr_send_encrypted_bytes":9072},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":164,"complete_latency":{"avgcount":95,"sum":7.867184954,"avgtime":0.082812473}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2333,"sum":1.423395830,"avgtime":0.000610113}},"mds":{"request":6249,"reply":6246,"reply_latency":{"avgcount":6246,"sum":10.167007133,"avgtime":0.001627762},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":5286,"inodes_top":0,"inodes_bottom":5286,"inodes_pin_tail":0,"inodes_pinned":5286,"inodes_expired":0,"inodes_with_caps":1358,"caps":1358,"subtrees":2,"traverse":6255,"traverse_hit":6254,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":669,"root_rbytes":5262336,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":583,"ceph_cap_op_grant":6335,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":3204,"handle_client_caps_dirty":3000,"handle_client_cap_release":6,"process_request_cap_release":9275},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":1720,"num_strays_delayed":527,"num_strays_enqueuing":0,"strays_created":3037,"strays_enqueued":1317,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":10772,"evex":0,"evtrm":0,"ev":10775,"evexg":0,"evexd":0,"segadd":13,"segex":0,"segtrm":0,"seg":15,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":27178041,"rdpos":4195244,"jlat":{"avgcount":20,"sum":3.392459285,"avgtime":0.169622964},"replayed":3},"mds_mem":{"ino":2253,"ino+":3214,"ino-":961,"dir":13,"dir+":13,"dir-":0,"dn":5286,"dn+":6247,"dn-":961,"cap":1358,"cap+":3202,"cap-":1844,"rss":101840,"heap":248116},"mds_server":{"dispatch_client_request":6252,"dispatch_server_request":0,"handle_client_request":6249,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.501283897,"avgtime":0.001094151},"req_getattr_latency":{"avgcount":6,"sum":0.001946066,"avgtime":0.000324344},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004077767,"avgtime":0.004077767},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.251883026,"avgtime":0.083961008},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":3036,"sum":6.407816377,"avgtime":0.002110611},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":5688,"average_load":5688,"avg_session_uptime":1051,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":3626085,"buffer_anon_items":1452,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6040,"osdmap_items":99,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":11878306,"mds_co_items":137194,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":1439,"op_send_bytes":22015216,"op_resend":0,"op_reply":1439,"op_latency":{"avgcount":1439,"sum":4.283957309,"avgtime":0.002977037},"op_inflight":0,"oplen_avg":{"avgcount":1439,"sum":1507},"op":1439,"op_r":49,"op_w":1390,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":21,"osdop_write":33,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":1333,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":103,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":28,"omap_rd":48,"omap_del":9},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":6,"pq_executing":0,"pq_executing_high_water":6,"pq_executed_ops":1317,"pq_executed":1317,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":305,"max":104857600,"get_started":0,"get":10947,"get_sum":3136639,"get_or_fail_fail":0,"get_or_fail_success":10947,"take":0,"take_sum":0,"put":10946,"put_sum":3136334,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":1439,"take_sum":22149352,"put":1439,"put_sum":22149352,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":1439,"take_sum":1439,"put":1439,"put_sum":1439,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":1317,"get_sum":133017,"get_or_fail_fail":0,"get_or_fail_success":1317,"take":0,"take_sum":0,"put":13,"put_sum":133017,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55eb22390a00":{"val":1491267,"max":3758096384,"get_started":0,"get":10772,"get_sum":22982354,"get_or_fail_fail":0,"get_or_fail_success":10772,"take":0,"take_sum":0,"put":20,"put_sum":21491087,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T23:58:49.447 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 28411, "avgtime": 1.58e-07, "sum": 0.004505376 }, "msgr_recv_bytes": 3743021, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 9889, "msgr_running_fast_dispatch_time": 0.013132874, "msgr_running_recv_time": 0.513302882, "msgr_running_send_time": 0.549730089, "msgr_running_total_time": 0.997913726, "msgr_send_bytes": 14551341, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 22332, "msgr_send_messages_queue_lat": { "avgcount": 22331, "avgtime": 2.0656e-05, "sum": 0.461289378 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 129203, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 475, "msgr_running_fast_dispatch_time": 0.017330393, "msgr_running_recv_time": 0.011736519, "msgr_running_send_time": 0.040050652, "msgr_running_total_time": 0.071602151, "msgr_send_bytes": 9696482, "msgr_send_encrypted_bytes": 97344, "msgr_send_messages": 483, "msgr_send_messages_queue_lat": { "avgcount": 481, "avgtime": 7.9382e-05, "sum": 0.038183182 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 252515, "msgr_recv_encrypted_bytes": 107648, "msgr_recv_messages": 587, "msgr_running_fast_dispatch_time": 0.014864633, "msgr_running_recv_time": 0.016060761, "msgr_running_send_time": 0.027776319, "msgr_running_total_time": 0.059887228, "msgr_send_bytes": 1997579, "msgr_send_encrypted_bytes": 9072, "msgr_send_messages": 582, "msgr_send_messages_queue_lat": { "avgcount": 581, "avgtime": 6.8346e-05, "sum": 0.039709125 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 95, "avgtime": 0.082812473, "sum": 7.867184954 }, "queue_len": 164 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2333, "avgtime": 0.000610113, "sum": 1.42339583 }, "queue_len": 0 }, "mds": { "caps": 1358, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 6335, "ceph_cap_op_revoke": 583, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 6, "handle_client_caps": 3204, "handle_client_caps_dirty": 3000, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 5286, "inodes_bottom": 5286, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 5286, "inodes_top": 0, "inodes_with_caps": 1358, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 9275, "q": 0, "reply": 6246, "reply_latency": { "avgcount": 6246, "avgtime": 0.001627762, "sum": 10.167007133 }, "request": 6249, "root_rbytes": 5262336, "root_rfiles": 669, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 6255, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 6254, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 1720, "num_strays_delayed": 527, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 3037, "strays_enqueued": 1317, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 10775, "evadd": 10772, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 20, "avgtime": 0.169622964, "sum": 3.392459285 }, "rdpos": 4195244, "replayed": 3, "seg": 15, "segadd": 13, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 27178041 }, "mds_mem": { "cap": 1358, "cap+": 3202, "cap-": 1844, "dir": 13, "dir+": 13, "dir-": 0, "dn": 5286, "dn+": 6247, "dn-": 961, "heap": 248116, "ino": 2253, "ino+": 3214, "ino-": 961, "rss": 101840 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 6252, "dispatch_server_request": 0, "handle_client_request": 6249, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001094151, "sum": 3.501283897 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.000324344, "sum": 0.001946066 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004077767, "sum": 0.004077767 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.083961008, "sum": 0.251883026 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 3036, "avgtime": 0.002110611, "sum": 6.407816377 } }, "mds_sessions": { "average_load": 5688, "avg_session_uptime": 1051, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5688 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 3626085, "buffer_anon_items": 1452, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 11878306, "mds_co_items": 137194, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6040, "osdmap_items": 99, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 103, "map_full": 0, "map_inc": 2, "omap_del": 9, "omap_rd": 48, "omap_wr": 28, "op": 1439, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 1439, "avgtime": 0.002977037, "sum": 4.283957309 }, "op_pg": 0, "op_r": 49, "op_reply": 1439, "op_resend": 0, "op_rmw": 0, "op_send": 1439, "op_send_bytes": 22015216, "op_w": 1390, "oplen_avg": { "avgcount": 1439, "sum": 1507 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 1333, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 21, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 33, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 1317, "pq_executed_ops": 1317, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executing_ops": 0, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 10947, "get_or_fail_fail": 0, "get_or_fail_success": 10947, "get_started": 0, "get_sum": 3136639, "max": 104857600, "put": 10946, "put_sum": 3136334, "take": 0, "take_sum": 0, "val": 305, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 1439, "put_sum": 22149352, "take": 1439, "take_sum": 22149352, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 1439, "put_sum": 1439, "take": 1439, "take_sum": 1439, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 1317, "get_or_fail_fail": 0, "get_or_fail_success": 1317, "get_started": 0, "get_sum": 133017, "max": 3758096384, "put": 13, "put_sum": 133017, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55eb22390a00": { "get": 10772, "get_or_fail_fail": 0, "get_or_fail_success": 10772, "get_started": 0, "get_sum": 22982354, "max": 3758096384, "put": 20, "put_sum": 21491087, "take": 0, "take_sum": 0, "val": 1491267, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T23:58:49.447 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/1720, 1317/3037 2024-09-15T23:58:50.087 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:50.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33e25bc640 1 Processor -- start 2024-09-15T23:58:50.200 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33e25bc640 1 -- start start 2024-09-15T23:58:50.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33e25bc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f33dc0d0420 0x7f33dc0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:50.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33e25bc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33dc0b4a60 0x7f33dc0cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:50.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33e25bc640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33dc15c6b0 con 0x7f33dc0b3160 2024-09-15T23:58:50.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33e25bc640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f33dc0b5240 con 0x7f33dc0d0420 2024-09-15T23:58:50.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33e25bc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f33dc0b4f60 con 0x7f33dc0b4a60 2024-09-15T23:58:50.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33dbfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f33dc0d0420 0x7f33dc0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:50.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33dbfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f33dc0d0420 0x7f33dc0d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43144/0 (socket says 172.21.15.112:43144) 2024-09-15T23:58:50.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33dbfff640 1 -- 172.21.15.112:0/2710241882 learned_addr learned my addr 172.21.15.112:0/2710241882 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:50.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33db7fe640 1 --2- 172.21.15.112:0/2710241882 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33dc0b4a60 0x7f33dc0cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:50.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33dbfff640 1 -- 172.21.15.112:0/2710241882 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33dc0b4a60 msgr2=0x7f33dc0cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:50.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33dbfff640 1 --2- 172.21.15.112:0/2710241882 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33dc0b4a60 0x7f33dc0cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33dbfff640 1 -- 172.21.15.112:0/2710241882 >> v1:172.21.15.169:6789/0 conn(0x7f33dc0b3160 legacy=0x7f33dc0b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:50.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33dbfff640 1 -- 172.21.15.112:0/2710241882 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33dc06dab0 con 0x7f33dc0d0420 2024-09-15T23:58:50.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33dbfff640 1 --2- 172.21.15.112:0/2710241882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33dc0d0420 0x7f33dc0d0800 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009870 tx=0x7f33cc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb2a5610c4834f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:50.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.200+0000 7f33daffd640 1 -- 172.21.15.112:0/2710241882 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc0b1070 con 0x7f33dc0d0420 2024-09-15T23:58:50.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33daffd640 1 -- 172.21.15.112:0/2710241882 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33cc0ac630 con 0x7f33dc0d0420 2024-09-15T23:58:50.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33daffd640 1 -- 172.21.15.112:0/2710241882 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc0a8050 con 0x7f33dc0d0420 2024-09-15T23:58:50.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 -- 172.21.15.112:0/2710241882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33dc0d0420 msgr2=0x7f33dc0d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:50.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 --2- 172.21.15.112:0/2710241882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33dc0d0420 0x7f33dc0d0800 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009870 tx=0x7f33cc01c520 comp rx=0 tx=0).stop 2024-09-15T23:58:50.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 -- 172.21.15.112:0/2710241882 shutdown_connections 2024-09-15T23:58:50.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 --2- 172.21.15.112:0/2710241882 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33dc0b4a60 0x7f33dc0cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 --2- 172.21.15.112:0/2710241882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33dc0d0420 0x7f33dc0d0800 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 -- 172.21.15.112:0/2710241882 >> 172.21.15.112:0/2710241882 conn(0x7f33dc075200 msgr2=0x7f33dc075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:50.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 -- 172.21.15.112:0/2710241882 shutdown_connections 2024-09-15T23:58:50.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 -- 172.21.15.112:0/2710241882 wait complete. 2024-09-15T23:58:50.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 Processor -- start 2024-09-15T23:58:50.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 -- start start 2024-09-15T23:58:50.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33dc0b3160 0x7f33dc09ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:50.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33dc0b4a60 0x7f33dc09beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:50.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33dc0d0420 0x7f33dc14c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:50.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc0ccff0 con 0x7f33dc0b4a60 2024-09-15T23:58:50.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc0cce70 con 0x7f33dc0d0420 2024-09-15T23:58:50.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f33dc1696d0 con 0x7f33dc0b3160 2024-09-15T23:58:50.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33dc0b4a60 0x7f33dc09beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:50.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33dc0b4a60 0x7f33dc09beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43154/0 (socket says 172.21.15.112:43154) 2024-09-15T23:58:50.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33db7fe640 1 -- 172.21.15.112:0/827636061 learned_addr learned my addr 172.21.15.112:0/827636061 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:50.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33dbfff640 1 --2- 172.21.15.112:0/827636061 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33dc0b3160 0x7f33dc09ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:50.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33db7fe640 1 -- 172.21.15.112:0/827636061 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33dc0b3160 msgr2=0x7f33dc09ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:50.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33db7fe640 1 --2- 172.21.15.112:0/827636061 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33dc0b3160 0x7f33dc09ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33db7fe640 1 -- 172.21.15.112:0/827636061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33dc0d0420 msgr2=0x7f33dc14c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:50.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33db7fe640 1 --2- 172.21.15.112:0/827636061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33dc0d0420 0x7f33dc14c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33db7fe640 1 -- 172.21.15.112:0/827636061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33dc14d590 con 0x7f33dc0b4a60 2024-09-15T23:58:50.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33db7fe640 1 --2- 172.21.15.112:0/827636061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33dc0b4a60 0x7f33dc09beb0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f33d000c7f0 tx=0x7f33d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:50.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33d8ff9640 1 -- 172.21.15.112:0/827636061 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d0015070 con 0x7f33dc0b4a60 2024-09-15T23:58:50.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33d8ff9640 1 -- 172.21.15.112:0/827636061 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33d0004240 con 0x7f33dc0b4a60 2024-09-15T23:58:50.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 -- 172.21.15.112:0/827636061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33dc14d870 con 0x7f33dc0b4a60 2024-09-15T23:58:50.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33d8ff9640 1 -- 172.21.15.112:0/827636061 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d0003620 con 0x7f33dc0b4a60 2024-09-15T23:58:50.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.204+0000 7f33e25bc640 1 -- 172.21.15.112:0/827636061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33dc14de30 con 0x7f33dc0b4a60 2024-09-15T23:58:50.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.208+0000 7f33e25bc640 1 -- 172.21.15.112:0/827636061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33dc0b1aa0 con 0x7f33dc0b4a60 2024-09-15T23:58:50.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.208+0000 7f33d8ff9640 1 -- 172.21.15.112:0/827636061 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f33d00039d0 con 0x7f33dc0b4a60 2024-09-15T23:58:50.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.208+0000 7f33d8ff9640 1 --2- 172.21.15.112:0/827636061 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f33c80678c0 0x7f33c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:50.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.208+0000 7f33d8ff9640 1 -- 172.21.15.112:0/827636061 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f33d0086380 con 0x7f33dc0b4a60 2024-09-15T23:58:50.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.208+0000 7f33dbfff640 1 --2- 172.21.15.112:0/827636061 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f33c80678c0 0x7f33c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:50.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.208+0000 7f33dbfff640 1 --2- 172.21.15.112:0/827636061 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f33c80678c0 0x7f33c8069d80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0ae000 tx=0x7f33cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:50.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.212+0000 7f33d8ff9640 1 -- 172.21.15.112:0/827636061 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f33d0056d50 con 0x7f33dc0b4a60 2024-09-15T23:58:50.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.396+0000 7f33e25bc640 1 -- 172.21.15.112:0/827636061 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33dc14d280 con 0x7f33dc0b4a60 2024-09-15T23:58:50.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.396+0000 7f33d8ff9640 1 -- 172.21.15.112:0/827636061 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7f33d0056650 con 0x7f33dc0b4a60 2024-09-15T23:58:50.397 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:50.397 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:50.397 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:50.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.396+0000 7f33e25bc640 1 -- 172.21.15.112:0/827636061 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f33c80678c0 msgr2=0x7f33c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:50.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.400+0000 7f33e25bc640 1 --2- 172.21.15.112:0/827636061 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f33c80678c0 0x7f33c8069d80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0ae000 tx=0x7f33cc008040 comp rx=0 tx=0).stop 2024-09-15T23:58:50.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.400+0000 7f33e25bc640 1 -- 172.21.15.112:0/827636061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33dc0b4a60 msgr2=0x7f33dc09beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:50.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.400+0000 7f33e25bc640 1 --2- 172.21.15.112:0/827636061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33dc0b4a60 0x7f33dc09beb0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f33d000c7f0 tx=0x7f33d000ccb0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.400+0000 7f33e25bc640 1 -- 172.21.15.112:0/827636061 shutdown_connections 2024-09-15T23:58:50.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.400+0000 7f33e25bc640 1 --2- 172.21.15.112:0/827636061 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f33c80678c0 0x7f33c8069d80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.400+0000 7f33e25bc640 1 --2- 172.21.15.112:0/827636061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33dc0d0420 0x7f33dc14c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.400+0000 7f33e25bc640 1 --2- 172.21.15.112:0/827636061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33dc0b4a60 0x7f33dc09beb0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.400+0000 7f33e25bc640 1 --2- 172.21.15.112:0/827636061 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f33dc0b3160 0x7f33dc09ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.400+0000 7f33e25bc640 1 -- 172.21.15.112:0/827636061 >> 172.21.15.112:0/827636061 conn(0x7f33dc075200 msgr2=0x7f33dc0755e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:50.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.400+0000 7f33e25bc640 1 -- 172.21.15.112:0/827636061 shutdown_connections 2024-09-15T23:58:50.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.400+0000 7f33e25bc640 1 -- 172.21.15.112:0/827636061 wait complete. 2024-09-15T23:58:50.414 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-15T23:58:50.447 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:50.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.564+0000 7fb8f9f35640 1 Processor -- start 2024-09-15T23:58:50.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.564+0000 7fb8f9f35640 1 -- start start 2024-09-15T23:58:50.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f9f35640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f415f1a0 0x7fb8f4072c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:50.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f9f35640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f415fa60 con 0x7fb8f406feb0 2024-09-15T23:58:50.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f9f35640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f415f780 con 0x7fb8f4072780 2024-09-15T23:58:50.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f9f35640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f40b3c30 con 0x7fb8f415f1a0 2024-09-15T23:58:50.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f37fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb8f406feb0 0x7fb8f40b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56268/0 (socket says 172.21.15.112:56268) 2024-09-15T23:58:50.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f37fe640 1 -- 172.21.15.112:0/2708034650 learned_addr learned my addr 172.21.15.112:0/2708034650 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:50.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f3fff640 1 --2- 172.21.15.112:0/2708034650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f415f1a0 0x7fb8f4072c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:50.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 -- 172.21.15.112:0/2708034650 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1453483845 0 0) 0x7fb8f415fa60 con 0x7fb8f406feb0 2024-09-15T23:58:50.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 -- 172.21.15.112:0/2708034650 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8dc003530 con 0x7fb8f406feb0 2024-09-15T23:58:50.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 -- 172.21.15.112:0/2708034650 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1866185832 0 0) 0x7fb8dc003530 con 0x7fb8f406feb0 2024-09-15T23:58:50.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 -- 172.21.15.112:0/2708034650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f415f1a0 msgr2=0x7fb8f4072c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:50.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 --2- 172.21.15.112:0/2708034650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f415f1a0 0x7fb8f4072c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 -- 172.21.15.112:0/2708034650 >> v1:172.21.15.169:6789/0 conn(0x7fb8f4072780 legacy=0x7fb8f415ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:50.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 -- 172.21.15.112:0/2708034650 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f40b3f10 con 0x7fb8f406feb0 2024-09-15T23:58:50.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 -- 172.21.15.112:0/2708034650 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fb8e40016a0 con 0x7fb8f406feb0 2024-09-15T23:58:50.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 -- 172.21.15.112:0/2708034650 >> v1:172.21.15.112:6789/0 conn(0x7fb8f406feb0 legacy=0x7fb8f40b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:50.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 --2- 172.21.15.112:0/2708034650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc0039f0 0x7fb8dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:50.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 --2- 172.21.15.112:0/2708034650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8dc004810 0x7fb8dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:50.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 --2- 172.21.15.112:0/2708034650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f415f1a0 0x7fb8dc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:50.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 -- 172.21.15.112:0/2708034650 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f40b3c30 con 0x7fb8dc0039f0 2024-09-15T23:58:50.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 -- 172.21.15.112:0/2708034650 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8dc00bb30 con 0x7fb8dc004810 2024-09-15T23:58:50.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f27fc640 1 -- 172.21.15.112:0/2708034650 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb8dc00bd30 con 0x7fb8f415f1a0 2024-09-15T23:58:50.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f37fe640 1 --2- 172.21.15.112:0/2708034650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc0039f0 0x7fb8dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:50.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f2ffd640 1 --2- 172.21.15.112:0/2708034650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8dc004810 0x7fb8dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:50.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f3fff640 1 --2- 172.21.15.112:0/2708034650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f415f1a0 0x7fb8dc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:50.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f37fe640 1 -- 172.21.15.112:0/2708034650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f415f1a0 msgr2=0x7fb8dc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:50.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f37fe640 1 --2- 172.21.15.112:0/2708034650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f415f1a0 0x7fb8dc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f37fe640 1 -- 172.21.15.112:0/2708034650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8dc004810 msgr2=0x7fb8dc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:50.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f37fe640 1 --2- 172.21.15.112:0/2708034650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8dc004810 0x7fb8dc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.568+0000 7fb8f37fe640 1 -- 172.21.15.112:0/2708034650 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8dc003530 con 0x7fb8dc0039f0 2024-09-15T23:58:50.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f37fe640 1 --2- 172.21.15.112:0/2708034650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc0039f0 0x7fb8dc003dd0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c210 tx=0x7fb8e401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a61822825f5580 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f27fc640 1 -- 172.21.15.112:0/2708034650 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4007d40 con 0x7fb8dc0039f0 2024-09-15T23:58:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f27fc640 1 -- 172.21.15.112:0/2708034650 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e40a9020 con 0x7fb8dc0039f0 2024-09-15T23:58:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f27fc640 1 -- 172.21.15.112:0/2708034650 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4005ae0 con 0x7fb8dc0039f0 2024-09-15T23:58:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 -- 172.21.15.112:0/2708034650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc0039f0 msgr2=0x7fb8dc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 --2- 172.21.15.112:0/2708034650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc0039f0 0x7fb8dc003dd0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c210 tx=0x7fb8e401cc60 comp rx=0 tx=0).stop 2024-09-15T23:58:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f3fff640 1 -- 172.21.15.112:0/2708034650 reap_dead start 2024-09-15T23:58:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 -- 172.21.15.112:0/2708034650 shutdown_connections 2024-09-15T23:58:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 -- 172.21.15.112:0/2708034650 >> 172.21.15.112:0/2708034650 conn(0x7fb8f40b2820 msgr2=0x7fb8f40b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:50.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 -- 172.21.15.112:0/2708034650 shutdown_connections 2024-09-15T23:58:50.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 -- 172.21.15.112:0/2708034650 wait complete. 2024-09-15T23:58:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 Processor -- start 2024-09-15T23:58:50.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 -- start start 2024-09-15T23:58:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc0039f0 0x7fb8f4153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f41f71c0 0x7fb8f4153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f415dbe0 0x7fb8f40cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f406f280 con 0x7fb8dc0039f0 2024-09-15T23:58:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f406f100 con 0x7fb8f415dbe0 2024-09-15T23:58:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f416a0d0 con 0x7fb8f41f71c0 2024-09-15T23:58:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc0039f0 0x7fb8f4153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc0039f0 0x7fb8f4153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43170/0 (socket says 172.21.15.112:43170) 2024-09-15T23:58:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f37fe640 1 -- 172.21.15.112:0/1920890215 learned_addr learned my addr 172.21.15.112:0/1920890215 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:50.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f2ffd640 1 --2- 172.21.15.112:0/1920890215 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f41f71c0 0x7fb8f4153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:50.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f3fff640 1 --2- 172.21.15.112:0/1920890215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f415dbe0 0x7fb8f40cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:50.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f37fe640 1 -- 172.21.15.112:0/1920890215 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f41f71c0 msgr2=0x7fb8f4153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:50.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f37fe640 1 --2- 172.21.15.112:0/1920890215 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f41f71c0 0x7fb8f4153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f37fe640 1 -- 172.21.15.112:0/1920890215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f415dbe0 msgr2=0x7fb8f40cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:50.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f37fe640 1 --2- 172.21.15.112:0/1920890215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f415dbe0 0x7fb8f40cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f37fe640 1 -- 172.21.15.112:0/1920890215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f4153560 con 0x7fb8dc0039f0 2024-09-15T23:58:50.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f37fe640 1 --2- 172.21.15.112:0/1920890215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc0039f0 0x7fb8f4153750 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fb8e401ca90 tx=0x7fb8dc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:50.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8dbfff640 1 -- 172.21.15.112:0/1920890215 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4007d40 con 0x7fb8dc0039f0 2024-09-15T23:58:50.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8dbfff640 1 -- 172.21.15.112:0/1920890215 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e40072d0 con 0x7fb8dc0039f0 2024-09-15T23:58:50.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 -- 172.21.15.112:0/1920890215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f415e430 con 0x7fb8dc0039f0 2024-09-15T23:58:50.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8dbfff640 1 -- 172.21.15.112:0/1920890215 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4001c80 con 0x7fb8dc0039f0 2024-09-15T23:58:50.577 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.572+0000 7fb8f9f35640 1 -- 172.21.15.112:0/1920890215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f415b330 con 0x7fb8dc0039f0 2024-09-15T23:58:50.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.576+0000 7fb8f9f35640 1 -- 172.21.15.112:0/1920890215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f41f75a0 con 0x7fb8dc0039f0 2024-09-15T23:58:50.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.576+0000 7fb8dbfff640 1 -- 172.21.15.112:0/1920890215 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb8e40a5630 con 0x7fb8dc0039f0 2024-09-15T23:58:50.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.576+0000 7fb8dbfff640 1 --2- 172.21.15.112:0/1920890215 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8e00678f0 0x7fb8e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:50.578 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.576+0000 7fb8dbfff640 1 -- 172.21.15.112:0/1920890215 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7fb8e411f870 con 0x7fb8dc0039f0 2024-09-15T23:58:50.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.576+0000 7fb8f2ffd640 1 --2- 172.21.15.112:0/1920890215 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8e00678f0 0x7fb8e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:50.579 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.576+0000 7fb8f2ffd640 1 --2- 172.21.15.112:0/1920890215 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8e00678f0 0x7fb8e0069db0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4069d80 tx=0x7fb8e8007b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:50.581 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.580+0000 7fb8dbfff640 1 -- 172.21.15.112:0/1920890215 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb8e40be060 con 0x7fb8dc0039f0 2024-09-15T23:58:50.832 INFO:teuthology.orchestra.run.smithi112.stdout:{"message":"","return_code":0} 2024-09-15T23:58:50.832 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-15T23:58:50.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.892+0000 7fb8f9f35640 1 -- 172.21.15.112:0/1920890215 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8f40b4710 con 0x7fb8dc0039f0 2024-09-15T23:58:50.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.892+0000 7fb8dbfff640 1 -- 172.21.15.112:0/1920890215 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7fb8e4016970 con 0x7fb8dc0039f0 2024-09-15T23:58:50.893 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:50.893 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:50.893 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:50.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.892+0000 7fb8f9f35640 1 -- 172.21.15.112:0/1920890215 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8e00678f0 msgr2=0x7fb8e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:50.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.892+0000 7fb8f9f35640 1 --2- 172.21.15.112:0/1920890215 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8e00678f0 0x7fb8e0069db0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4069d80 tx=0x7fb8e8007b80 comp rx=0 tx=0).stop 2024-09-15T23:58:50.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.892+0000 7fb8f9f35640 1 -- 172.21.15.112:0/1920890215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc0039f0 msgr2=0x7fb8f4153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:50.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.892+0000 7fb8f9f35640 1 --2- 172.21.15.112:0/1920890215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc0039f0 0x7fb8f4153750 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fb8e401ca90 tx=0x7fb8dc005840 comp rx=0 tx=0).stop 2024-09-15T23:58:50.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.892+0000 7fb8f9f35640 1 -- 172.21.15.112:0/1920890215 shutdown_connections 2024-09-15T23:58:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.892+0000 7fb8f9f35640 1 --2- 172.21.15.112:0/1920890215 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb8e00678f0 0x7fb8e0069db0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.892+0000 7fb8f9f35640 1 --2- 172.21.15.112:0/1920890215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f415dbe0 0x7fb8f40cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.892+0000 7fb8f9f35640 1 --2- 172.21.15.112:0/1920890215 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8f41f71c0 0x7fb8f4153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.892+0000 7fb8f9f35640 1 --2- 172.21.15.112:0/1920890215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8dc0039f0 0x7fb8f4153750 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.892+0000 7fb8f9f35640 1 -- 172.21.15.112:0/1920890215 >> 172.21.15.112:0/1920890215 conn(0x7fb8f40b2820 msgr2=0x7fb8f40cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.896+0000 7fb8f9f35640 1 -- 172.21.15.112:0/1920890215 shutdown_connections 2024-09-15T23:58:50.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:50.896+0000 7fb8f9f35640 1 -- 172.21.15.112:0/1920890215 wait complete. 2024-09-15T23:58:50.910 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-15T23:58:51.035 INFO:teuthology.orchestra.run.smithi112.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":10630,"msgr_send_messages":24359,"msgr_recv_bytes":4055552,"msgr_send_bytes":15277910,"msgr_created_connections":10,"msgr_active_connections":2,"msgr_running_total_time":1.074248542,"msgr_running_send_time":0.590224677,"msgr_running_recv_time":0.533717786,"msgr_running_fast_dispatch_time":0.024061353,"msgr_send_messages_queue_lat":{"avgcount":24358,"sum":0.741954296,"avgtime":0.000030460},"msgr_handle_ack_lat":{"avgcount":29375,"sum":0.004732798,"avgtime":0.000000161},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":1068,"msgr_send_messages":1076,"msgr_recv_bytes":315966,"msgr_send_bytes":13040221,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.127574424,"msgr_running_send_time":0.069066630,"msgr_running_recv_time":0.018110854,"msgr_running_fast_dispatch_time":0.036903117,"msgr_send_messages_queue_lat":{"avgcount":1074,"sum":3.243839787,"avgtime":0.003020334},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":97344},"AsyncMessenger::Worker-2":{"msgr_recv_messages":1352,"msgr_send_messages":1347,"msgr_recv_bytes":492217,"msgr_send_bytes":2397781,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.097573301,"msgr_running_send_time":0.039219150,"msgr_running_recv_time":0.025011807,"msgr_running_fast_dispatch_time":0.029938791,"msgr_send_messages_queue_lat":{"avgcount":1346,"sum":0.366954841,"avgtime":0.000272626},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":107920,"msgr_send_encrypted_bytes":9712},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":125,"sum":8.647495537,"avgtime":0.069179964}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":3258,"sum":1.516668605,"avgtime":0.000465521}},"mds":{"request":6413,"reply":6411,"reply_latency":{"avgcount":6411,"sum":10.748950201,"avgtime":0.001676641},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":4568,"inodes_top":0,"inodes_bottom":4568,"inodes_pin_tail":0,"inodes_pinned":4568,"inodes_expired":0,"inodes_with_caps":777,"caps":777,"subtrees":2,"traverse":6419,"traverse_hit":6418,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":585,"ceph_cap_op_grant":6979,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":3206,"handle_client_caps_dirty":3000,"handle_client_cap_release":7,"process_request_cap_release":9603},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":1357,"num_strays_delayed":1357,"num_strays_enqueuing":0,"strays_created":3201,"strays_enqueued":1844,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":11468,"evex":11468,"evtrm":11468,"ev":11470,"evexg":0,"evexd":11467,"segadd":15,"segex":16,"segtrm":16,"seg":1,"segmjr":1,"segexg":0,"segexd":15,"expos":28019708,"wrpos":28022876,"rdpos":4195244,"jlat":{"avgcount":24,"sum":3.481395252,"avgtime":0.145058135},"replayed":3},"mds_mem":{"ino":1370,"ino+":3214,"ino-":1844,"dir":13,"dir+":13,"dir-":0,"dn":1368,"dn+":6412,"dn-":5044,"cap":777,"cap+":3202,"cap-":2425,"rss":111608,"heap":248116},"mds_server":{"dispatch_client_request":6419,"dispatch_server_request":0,"handle_client_request":6413,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.501283897,"avgtime":0.001094151},"req_getattr_latency":{"avgcount":6,"sum":0.001946066,"avgtime":0.000324344},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004077767,"avgtime":0.004077767},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.251883026,"avgtime":0.083961008},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":1,"sum":0.379202617,"avgtime":0.379202617},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":3200,"sum":6.610556828,"avgtime":0.002065799},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":5809,"average_load":5809,"avg_session_uptime":1051,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":3626085,"buffer_anon_items":1452,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6040,"osdmap_items":99,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":11878306,"mds_co_items":137194,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":3369,"op_send_bytes":25357090,"op_resend":0,"op_reply":3369,"op_latency":{"avgcount":3369,"sum":192.234086093,"avgtime":0.057059687},"op_inflight":0,"oplen_avg":{"avgcount":3369,"sum":6192},"op":3369,"op_r":52,"op_w":3317,"op_rmw":0,"op_pg":0,"osdop_stat":12,"osdop_create":1367,"osdop_read":24,"osdop_write":40,"osdop_writefull":14,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":1865,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":2734,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":103,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":51,"omap_rd":48,"omap_del":12},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":6,"pq_executing":0,"pq_executing_high_water":6,"pq_executed_ops":1844,"pq_executed":1844,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":13046,"get_sum":3686673,"get_or_fail_fail":0,"get_or_fail_success":13046,"take":0,"take_sum":0,"put":13046,"put_sum":3686673,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":3369,"take_sum":25544453,"put":3369,"put_sum":25544453,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":3369,"take_sum":3369,"put":3369,"put_sum":3369,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":1844,"get_sum":186244,"get_or_fail_fail":0,"get_or_fail_success":1844,"take":0,"take_sum":0,"put":16,"put_sum":186244,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55eb22390a00":{"val":0,"max":3758096384,"get_started":0,"get":11468,"get_sum":23827189,"get_or_fail_fail":0,"get_or_fail_success":11468,"take":0,"take_sum":0,"put":24,"put_sum":23827189,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T23:58:51.037 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 29375, "avgtime": 1.61e-07, "sum": 0.004732798 }, "msgr_recv_bytes": 4055552, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 10630, "msgr_running_fast_dispatch_time": 0.024061353, "msgr_running_recv_time": 0.533717786, "msgr_running_send_time": 0.590224677, "msgr_running_total_time": 1.074248542, "msgr_send_bytes": 15277910, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 24359, "msgr_send_messages_queue_lat": { "avgcount": 24358, "avgtime": 3.046e-05, "sum": 0.741954296 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 315966, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 1068, "msgr_running_fast_dispatch_time": 0.036903117, "msgr_running_recv_time": 0.018110854, "msgr_running_send_time": 0.06906663, "msgr_running_total_time": 0.127574424, "msgr_send_bytes": 13040221, "msgr_send_encrypted_bytes": 97344, "msgr_send_messages": 1076, "msgr_send_messages_queue_lat": { "avgcount": 1074, "avgtime": 0.003020334, "sum": 3.243839787 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 492217, "msgr_recv_encrypted_bytes": 107920, "msgr_recv_messages": 1352, "msgr_running_fast_dispatch_time": 0.029938791, "msgr_running_recv_time": 0.025011807, "msgr_running_send_time": 0.03921915, "msgr_running_total_time": 0.097573301, "msgr_send_bytes": 2397781, "msgr_send_encrypted_bytes": 9712, "msgr_send_messages": 1347, "msgr_send_messages_queue_lat": { "avgcount": 1346, "avgtime": 0.000272626, "sum": 0.366954841 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 125, "avgtime": 0.069179964, "sum": 8.647495537 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 3258, "avgtime": 0.000465521, "sum": 1.516668605 }, "queue_len": 0 }, "mds": { "caps": 777, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 6979, "ceph_cap_op_revoke": 585, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 7, "handle_client_caps": 3206, "handle_client_caps_dirty": 3000, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 4568, "inodes_bottom": 4568, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 4568, "inodes_top": 0, "inodes_with_caps": 777, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 9603, "q": 0, "reply": 6411, "reply_latency": { "avgcount": 6411, "avgtime": 0.001676641, "sum": 10.748950201 }, "request": 6413, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 6419, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 6418, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 1357, "num_strays_delayed": 1357, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 3201, "strays_enqueued": 1844, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 11470, "evadd": 11468, "evex": 11468, "evexd": 11467, "evexg": 0, "evlrg": 0, "evtrm": 11468, "expos": 28019708, "jlat": { "avgcount": 24, "avgtime": 0.145058135, "sum": 3.481395252 }, "rdpos": 4195244, "replayed": 3, "seg": 1, "segadd": 15, "segex": 16, "segexd": 15, "segexg": 0, "segmjr": 1, "segtrm": 16, "wrpos": 28022876 }, "mds_mem": { "cap": 777, "cap+": 3202, "cap-": 2425, "dir": 13, "dir+": 13, "dir-": 0, "dn": 1368, "dn+": 6412, "dn-": 5044, "heap": 248116, "ino": 1370, "ino+": 3214, "ino-": 1844, "rss": 111608 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 6419, "dispatch_server_request": 0, "handle_client_request": 6413, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001094151, "sum": 3.501283897 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.000324344, "sum": 0.001946066 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004077767, "sum": 0.004077767 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.083961008, "sum": 0.251883026 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 1, "avgtime": 0.379202617, "sum": 0.379202617 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 3200, "avgtime": 0.002065799, "sum": 6.610556828 } }, "mds_sessions": { "average_load": 5809, "avg_session_uptime": 1051, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5809 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 3626085, "buffer_anon_items": 1452, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 11878306, "mds_co_items": 137194, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6040, "osdmap_items": 99, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 103, "map_full": 0, "map_inc": 2, "omap_del": 12, "omap_rd": 48, "omap_wr": 51, "op": 3369, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 3369, "avgtime": 0.057059687, "sum": 192.234086093 }, "op_pg": 0, "op_r": 52, "op_reply": 3369, "op_resend": 0, "op_rmw": 0, "op_send": 3369, "op_send_bytes": 25357090, "op_w": 3317, "oplen_avg": { "avgcount": 3369, "sum": 6192 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 1367, "osdop_delete": 1865, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 24, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 2734, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 12, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 40, "osdop_writefull": 14, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 1844, "pq_executed_ops": 1844, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executing_ops": 0, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 13046, "get_or_fail_fail": 0, "get_or_fail_success": 13046, "get_started": 0, "get_sum": 3686673, "max": 104857600, "put": 13046, "put_sum": 3686673, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 3369, "put_sum": 25544453, "take": 3369, "take_sum": 25544453, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 3369, "put_sum": 3369, "take": 3369, "take_sum": 3369, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 1844, "get_or_fail_fail": 0, "get_or_fail_success": 1844, "get_started": 0, "get_sum": 186244, "max": 3758096384, "put": 16, "put_sum": 186244, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55eb22390a00": { "get": 11468, "get_or_fail_fail": 0, "get_or_fail_success": 11468, "get_started": 0, "get_sum": 23827189, "max": 3758096384, "put": 24, "put_sum": 23827189, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T23:58:51.037 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/1357, 1844/3201 2024-09-15T23:58:52.038 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:52.210 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.208+0000 7ff354b34640 1 Processor -- start 2024-09-15T23:58:52.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.208+0000 7ff354b34640 1 -- start start 2024-09-15T23:58:52.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.212+0000 7ff354b34640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff3500ce1b0 0x7ff3500ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:52.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.212+0000 7ff354b34640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff35006ff30 con 0x7ff350075030 2024-09-15T23:58:52.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.212+0000 7ff354b34640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff35006f970 con 0x7ff3500d0940 2024-09-15T23:58:52.211 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.212+0000 7ff354b34640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff35006fc50 con 0x7ff3500ce1b0 2024-09-15T23:58:52.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.212+0000 7ff34e59c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff350075030 0x7ff3500b44f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56282/0 (socket says 172.21.15.112:56282) 2024-09-15T23:58:52.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.212+0000 7ff34e59c640 1 -- 172.21.15.112:0/1640226178 learned_addr learned my addr 172.21.15.112:0/1640226178 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:52.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.212+0000 7ff34ed9d640 1 --2- 172.21.15.112:0/1640226178 >> v2:172.21.15.112:3300/0 conn(0x7ff3500ce1b0 0x7ff3500ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:52.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.212+0000 7ff345d9b640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7ff3500d0940 0x7ff350075410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:51532/0 (socket says 172.21.15.112:51532) 2024-09-15T23:58:52.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.212+0000 7ff34ed9d640 1 -- 172.21.15.112:0/1640226178 >> v1:172.21.15.169:6789/0 conn(0x7ff3500d0940 legacy=0x7ff350075410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:52.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.212+0000 7ff34ed9d640 1 -- 172.21.15.112:0/1640226178 >> v1:172.21.15.112:6789/0 conn(0x7ff350075030 legacy=0x7ff3500b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:52.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.212+0000 7ff34ed9d640 1 -- 172.21.15.112:0/1640226178 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3500b50a0 con 0x7ff3500ce1b0 2024-09-15T23:58:52.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.216+0000 7ff34ed9d640 1 --2- 172.21.15.112:0/1640226178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3500ce1b0 0x7ff3500ce640 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7ff348009d90 tx=0x7ff34801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fecfeae48d50ecb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:52.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.216+0000 7ff34dd9b640 1 -- 172.21.15.112:0/1640226178 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3480b2070 con 0x7ff3500ce1b0 2024-09-15T23:58:52.216 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.216+0000 7ff34dd9b640 1 -- 172.21.15.112:0/1640226178 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff350162e80 con 0x7ff3500ce1b0 2024-09-15T23:58:52.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.216+0000 7ff354b34640 1 -- 172.21.15.112:0/1640226178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3500ce1b0 msgr2=0x7ff3500ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:52.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.216+0000 7ff354b34640 1 --2- 172.21.15.112:0/1640226178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3500ce1b0 0x7ff3500ce640 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7ff348009d90 tx=0x7ff34801c900 comp rx=0 tx=0).stop 2024-09-15T23:58:52.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.216+0000 7ff354b34640 1 -- 172.21.15.112:0/1640226178 shutdown_connections 2024-09-15T23:58:52.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.216+0000 7ff354b34640 1 --2- 172.21.15.112:0/1640226178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3500ce1b0 0x7ff3500ce640 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:52.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.216+0000 7ff354b34640 1 -- 172.21.15.112:0/1640226178 >> 172.21.15.112:0/1640226178 conn(0x7ff35006bc80 msgr2=0x7ff35006c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:52.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.216+0000 7ff354b34640 1 -- 172.21.15.112:0/1640226178 shutdown_connections 2024-09-15T23:58:52.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.216+0000 7ff354b34640 1 -- 172.21.15.112:0/1640226178 wait complete. 2024-09-15T23:58:52.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff354b34640 1 Processor -- start 2024-09-15T23:58:52.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff354b34640 1 -- start start 2024-09-15T23:58:52.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff354b34640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff350075030 0x7ff35015cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:52.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff354b34640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3500ce1b0 0x7ff3500af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:52.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff354b34640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3500d0940 0x7ff3500af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:52.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff354b34640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff350170920 con 0x7ff350075030 2024-09-15T23:58:52.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff354b34640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff3501707a0 con 0x7ff3500ce1b0 2024-09-15T23:58:52.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff354b34640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff350170aa0 con 0x7ff3500d0940 2024-09-15T23:58:52.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff34e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff350075030 0x7ff35015cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:52.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff34e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff350075030 0x7ff35015cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43182/0 (socket says 172.21.15.112:43182) 2024-09-15T23:58:52.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff34e59c640 1 -- 172.21.15.112:0/3983174724 learned_addr learned my addr 172.21.15.112:0/3983174724 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:52.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff345d9b640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3500ce1b0 0x7ff3500af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:52.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff34ed9d640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3500d0940 0x7ff3500af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:52.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff34e59c640 1 -- 172.21.15.112:0/3983174724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3500d0940 msgr2=0x7ff3500af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:52.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff34e59c640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3500d0940 0x7ff3500af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:52.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff34e59c640 1 -- 172.21.15.112:0/3983174724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3500ce1b0 msgr2=0x7ff3500af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:52.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff34e59c640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3500ce1b0 0x7ff3500af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:52.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff34e59c640 1 -- 172.21.15.112:0/3983174724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3501600e0 con 0x7ff350075030 2024-09-15T23:58:52.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff34ed9d640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3500d0940 0x7ff3500af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:58:52.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff34e59c640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff350075030 0x7ff35015cd10 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff34000c470 tx=0x7ff34000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:52.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff3477fe640 1 -- 172.21.15.112:0/3983174724 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff340005cf0 con 0x7ff350075030 2024-09-15T23:58:52.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff3477fe640 1 -- 172.21.15.112:0/3983174724 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff340007070 con 0x7ff350075030 2024-09-15T23:58:52.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff3477fe640 1 -- 172.21.15.112:0/3983174724 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3400074a0 con 0x7ff350075030 2024-09-15T23:58:52.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff354b34640 1 -- 172.21.15.112:0/3983174724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3501603c0 con 0x7ff350075030 2024-09-15T23:58:52.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.220+0000 7ff354b34640 1 -- 172.21.15.112:0/3983174724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff350160980 con 0x7ff350075030 2024-09-15T23:58:52.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.224+0000 7ff354b34640 1 -- 172.21.15.112:0/3983174724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3500ce640 con 0x7ff350075030 2024-09-15T23:58:52.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.224+0000 7ff3477fe640 1 -- 172.21.15.112:0/3983174724 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff34001b400 con 0x7ff350075030 2024-09-15T23:58:52.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.228+0000 7ff3477fe640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff3300678c0 0x7ff330069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:52.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.228+0000 7ff345d9b640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff3300678c0 0x7ff330069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:52.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.228+0000 7ff345d9b640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff3300678c0 0x7ff330069d80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff3500aa880 tx=0x7ff338007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:52.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.236+0000 7ff3477fe640 1 -- 172.21.15.112:0/3983174724 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7ff340053e90 con 0x7ff350075030 2024-09-15T23:58:52.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.236+0000 7ff3477fe640 1 -- 172.21.15.112:0/3983174724 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff3400564f0 con 0x7ff350075030 2024-09-15T23:58:52.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.444+0000 7ff354b34640 1 -- 172.21.15.112:0/3983174724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff35015d8c0 con 0x7ff350075030 2024-09-15T23:58:52.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.444+0000 7ff3477fe640 1 -- 172.21.15.112:0/3983174724 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7ff340055df0 con 0x7ff350075030 2024-09-15T23:58:52.445 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:52.445 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:52.445 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:52.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.444+0000 7ff354b34640 1 -- 172.21.15.112:0/3983174724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff3300678c0 msgr2=0x7ff330069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:52.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.444+0000 7ff354b34640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff3300678c0 0x7ff330069d80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff3500aa880 tx=0x7ff338007e90 comp rx=0 tx=0).stop 2024-09-15T23:58:52.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.444+0000 7ff354b34640 1 -- 172.21.15.112:0/3983174724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff350075030 msgr2=0x7ff35015cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:52.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.444+0000 7ff354b34640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff350075030 0x7ff35015cd10 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff34000c470 tx=0x7ff34000c930 comp rx=0 tx=0).stop 2024-09-15T23:58:52.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.444+0000 7ff354b34640 1 -- 172.21.15.112:0/3983174724 shutdown_connections 2024-09-15T23:58:52.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.444+0000 7ff354b34640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff3300678c0 0x7ff330069d80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:52.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.444+0000 7ff354b34640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3500d0940 0x7ff3500af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:52.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.444+0000 7ff354b34640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3500ce1b0 0x7ff3500af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:52.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.444+0000 7ff354b34640 1 --2- 172.21.15.112:0/3983174724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff350075030 0x7ff35015cd10 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:52.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.444+0000 7ff354b34640 1 -- 172.21.15.112:0/3983174724 >> 172.21.15.112:0/3983174724 conn(0x7ff35006bc80 msgr2=0x7ff3500b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:52.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.448+0000 7ff354b34640 1 -- 172.21.15.112:0/3983174724 shutdown_connections 2024-09-15T23:58:52.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:52.448+0000 7ff354b34640 1 -- 172.21.15.112:0/3983174724 wait complete. 2024-09-15T23:58:52.463 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-15T23:58:52.597 INFO:teuthology.orchestra.run.smithi112.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":11041,"msgr_send_messages":24766,"msgr_recv_bytes":4315494,"msgr_send_bytes":15547500,"msgr_created_connections":10,"msgr_active_connections":2,"msgr_running_total_time":1.108000841,"msgr_running_send_time":0.603037207,"msgr_running_recv_time":0.541689609,"msgr_running_fast_dispatch_time":0.034624554,"msgr_send_messages_queue_lat":{"avgcount":24765,"sum":0.758622284,"avgtime":0.000030632},"msgr_handle_ack_lat":{"avgcount":29379,"sum":0.004733203,"avgtime":0.000000161},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":1488,"msgr_send_messages":1496,"msgr_recv_bytes":422684,"msgr_send_bytes":13177235,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.160538612,"msgr_running_send_time":0.080192124,"msgr_running_recv_time":0.025705951,"msgr_running_fast_dispatch_time":0.047318730,"msgr_send_messages_queue_lat":{"avgcount":1494,"sum":3.258953715,"avgtime":0.002181361},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":97344},"AsyncMessenger::Worker-2":{"msgr_recv_messages":1890,"msgr_send_messages":1885,"msgr_recv_bytes":628853,"msgr_send_bytes":2573333,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.135783494,"msgr_running_send_time":0.052250606,"msgr_running_recv_time":0.034647227,"msgr_running_fast_dispatch_time":0.042404270,"msgr_send_messages_queue_lat":{"avgcount":1884,"sum":0.396148592,"avgtime":0.000210269},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":107920,"msgr_send_encrypted_bytes":9712},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":126,"sum":8.647516090,"avgtime":0.068631080}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":5514,"sum":1.758859903,"avgtime":0.000318980}},"mds":{"request":6413,"reply":6411,"reply_latency":{"avgcount":6411,"sum":10.748950201,"avgtime":0.001676641},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":4568,"inodes_top":0,"inodes_bottom":4568,"inodes_pin_tail":0,"inodes_pinned":4568,"inodes_expired":0,"inodes_with_caps":777,"caps":777,"subtrees":2,"traverse":6419,"traverse_hit":6418,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":585,"ceph_cap_op_grant":6979,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":3206,"handle_client_caps_dirty":3000,"handle_client_cap_release":9,"process_request_cap_release":9603},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":1,"num_strays_delayed":1,"num_strays_enqueuing":0,"strays_created":3201,"strays_enqueued":3200,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":12825,"evex":11468,"evtrm":11468,"ev":1360,"evexg":0,"evexd":11467,"segadd":16,"segex":16,"segtrm":16,"seg":2,"segmjr":1,"segexg":0,"segexd":15,"expos":28019708,"wrpos":28838564,"rdpos":4195244,"jlat":{"avgcount":24,"sum":3.481395252,"avgtime":0.145058135},"replayed":3},"mds_mem":{"ino":1370,"ino+":3214,"ino-":1844,"dir":13,"dir+":13,"dir-":0,"dn":1368,"dn+":6412,"dn-":5044,"cap":1,"cap+":3202,"cap-":3201,"rss":111608,"heap":248116},"mds_server":{"dispatch_client_request":6419,"dispatch_server_request":0,"handle_client_request":6413,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.501283897,"avgtime":0.001094151},"req_getattr_latency":{"avgcount":6,"sum":0.001946066,"avgtime":0.000324344},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004077767,"avgtime":0.004077767},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.251883026,"avgtime":0.083961008},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":1,"sum":0.379202617,"avgtime":0.379202617},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":3200,"sum":6.610556828,"avgtime":0.002065799},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":5809,"average_load":5809,"avg_session_uptime":1051,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":3626085,"buffer_anon_items":1452,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6040,"osdmap_items":99,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":11878306,"mds_co_items":137194,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":4734,"op_send_bytes":25494286,"op_resend":0,"op_reply":4734,"op_latency":{"avgcount":4734,"sum":194.730061240,"avgtime":0.041134360},"op_inflight":0,"oplen_avg":{"avgcount":4734,"sum":7558},"op":4734,"op_r":55,"op_w":4679,"op_rmw":0,"op_pg":0,"osdop_stat":12,"osdop_create":1367,"osdop_read":27,"osdop_write":43,"osdop_writefull":16,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":3221,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":2734,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":103,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":52,"omap_rd":48,"omap_del":13},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":6,"pq_executing":0,"pq_executing_high_water":6,"pq_executed_ops":3200,"pq_executed":3200,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":14415,"get_sum":4066759,"get_or_fail_fail":0,"get_or_fail_success":14415,"take":0,"take_sum":0,"put":14415,"put_sum":4066759,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":4734,"take_sum":25818605,"put":4734,"put_sum":25818605,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":4734,"take_sum":4734,"put":4734,"put_sum":4734,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":3200,"get_sum":323200,"get_or_fail_fail":0,"get_or_fail_success":3200,"take":0,"take_sum":0,"put":19,"put_sum":323200,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55eb22390a00":{"val":815688,"max":3758096384,"get_started":0,"get":12825,"get_sum":24642877,"get_or_fail_fail":0,"get_or_fail_success":12825,"take":0,"take_sum":0,"put":24,"put_sum":23827189,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T23:58:52.598 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 29379, "avgtime": 1.61e-07, "sum": 0.004733203 }, "msgr_recv_bytes": 4315494, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 11041, "msgr_running_fast_dispatch_time": 0.034624554, "msgr_running_recv_time": 0.541689609, "msgr_running_send_time": 0.603037207, "msgr_running_total_time": 1.108000841, "msgr_send_bytes": 15547500, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 24766, "msgr_send_messages_queue_lat": { "avgcount": 24765, "avgtime": 3.0632e-05, "sum": 0.758622284 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 422684, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 1488, "msgr_running_fast_dispatch_time": 0.04731873, "msgr_running_recv_time": 0.025705951, "msgr_running_send_time": 0.080192124, "msgr_running_total_time": 0.160538612, "msgr_send_bytes": 13177235, "msgr_send_encrypted_bytes": 97344, "msgr_send_messages": 1496, "msgr_send_messages_queue_lat": { "avgcount": 1494, "avgtime": 0.002181361, "sum": 3.258953715 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 628853, "msgr_recv_encrypted_bytes": 107920, "msgr_recv_messages": 1890, "msgr_running_fast_dispatch_time": 0.04240427, "msgr_running_recv_time": 0.034647227, "msgr_running_send_time": 0.052250606, "msgr_running_total_time": 0.135783494, "msgr_send_bytes": 2573333, "msgr_send_encrypted_bytes": 9712, "msgr_send_messages": 1885, "msgr_send_messages_queue_lat": { "avgcount": 1884, "avgtime": 0.000210269, "sum": 0.396148592 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 126, "avgtime": 0.06863108, "sum": 8.64751609 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 5514, "avgtime": 0.00031898, "sum": 1.758859903 }, "queue_len": 0 }, "mds": { "caps": 777, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 6979, "ceph_cap_op_revoke": 585, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 9, "handle_client_caps": 3206, "handle_client_caps_dirty": 3000, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 4568, "inodes_bottom": 4568, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 4568, "inodes_top": 0, "inodes_with_caps": 777, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 9603, "q": 0, "reply": 6411, "reply_latency": { "avgcount": 6411, "avgtime": 0.001676641, "sum": 10.748950201 }, "request": 6413, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 6419, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 6418, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 1, "num_strays_delayed": 1, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 3201, "strays_enqueued": 3200, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 1360, "evadd": 12825, "evex": 11468, "evexd": 11467, "evexg": 0, "evlrg": 0, "evtrm": 11468, "expos": 28019708, "jlat": { "avgcount": 24, "avgtime": 0.145058135, "sum": 3.481395252 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 16, "segex": 16, "segexd": 15, "segexg": 0, "segmjr": 1, "segtrm": 16, "wrpos": 28838564 }, "mds_mem": { "cap": 1, "cap+": 3202, "cap-": 3201, "dir": 13, "dir+": 13, "dir-": 0, "dn": 1368, "dn+": 6412, "dn-": 5044, "heap": 248116, "ino": 1370, "ino+": 3214, "ino-": 1844, "rss": 111608 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 6419, "dispatch_server_request": 0, "handle_client_request": 6413, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001094151, "sum": 3.501283897 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.000324344, "sum": 0.001946066 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004077767, "sum": 0.004077767 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.083961008, "sum": 0.251883026 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 1, "avgtime": 0.379202617, "sum": 0.379202617 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 3200, "avgtime": 0.002065799, "sum": 6.610556828 } }, "mds_sessions": { "average_load": 5809, "avg_session_uptime": 1051, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5809 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 3626085, "buffer_anon_items": 1452, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 11878306, "mds_co_items": 137194, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6040, "osdmap_items": 99, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 103, "map_full": 0, "map_inc": 2, "omap_del": 13, "omap_rd": 48, "omap_wr": 52, "op": 4734, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 4734, "avgtime": 0.04113436, "sum": 194.73006124 }, "op_pg": 0, "op_r": 55, "op_reply": 4734, "op_resend": 0, "op_rmw": 0, "op_send": 4734, "op_send_bytes": 25494286, "op_w": 4679, "oplen_avg": { "avgcount": 4734, "sum": 7558 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 1367, "osdop_delete": 3221, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 27, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 2734, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 12, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 43, "osdop_writefull": 16, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 3200, "pq_executed_ops": 3200, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executing_ops": 0, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 14415, "get_or_fail_fail": 0, "get_or_fail_success": 14415, "get_started": 0, "get_sum": 4066759, "max": 104857600, "put": 14415, "put_sum": 4066759, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 4734, "put_sum": 25818605, "take": 4734, "take_sum": 25818605, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 4734, "put_sum": 4734, "take": 4734, "take_sum": 4734, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 3200, "get_or_fail_fail": 0, "get_or_fail_success": 3200, "get_started": 0, "get_sum": 323200, "max": 3758096384, "put": 19, "put_sum": 323200, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55eb22390a00": { "get": 12825, "get_or_fail_fail": 0, "get_or_fail_success": 12825, "get_started": 0, "get_sum": 24642877, "max": 3758096384, "put": 24, "put_sum": 23827189, "take": 0, "take_sum": 0, "val": 815688, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T23:58:52.599 INFO:tasks.cephfs.test_strays:Waiting for purge to complete 0/1, 3200/3201 2024-09-15T23:58:53.600 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:53.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.728+0000 7f35ed56e640 1 Processor -- start 2024-09-15T23:58:53.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.728+0000 7f35ed56e640 1 -- start start 2024-09-15T23:58:53.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.728+0000 7f35ed56e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f35e815c110 0x7f35e80b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:53.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35ed56e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f35e806de60 0x7f35e80d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:53.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35ed56e640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e806e360 con 0x7f35e80d08f0 2024-09-15T23:58:53.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35ed56e640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f35e80d1270 con 0x7f35e815c110 2024-09-15T23:58:53.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35ed56e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f35e80b3ac0 con 0x7f35e806de60 2024-09-15T23:58:53.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35e6ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f35e815c110 0x7f35e80b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:53.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35de7fc640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f35e80d08f0 0x7f35e806d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56298/0 (socket says 172.21.15.112:56298) 2024-09-15T23:58:53.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35de7fc640 1 -- 172.21.15.112:0/2303551145 learned_addr learned my addr 172.21.15.112:0/2303551145 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:53.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35e6ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f35e815c110 0x7f35e80b45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43196/0 (socket says 172.21.15.112:43196) 2024-09-15T23:58:53.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35e77fe640 1 --2- 172.21.15.112:0/2303551145 >> v2:172.21.15.169:3300/0 conn(0x7f35e806de60 0x7f35e80d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:53.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35e6ffd640 1 -- 172.21.15.112:0/2303551145 >> v2:172.21.15.169:3300/0 conn(0x7f35e806de60 msgr2=0x7f35e80d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:53.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35e6ffd640 1 --2- 172.21.15.112:0/2303551145 >> v2:172.21.15.169:3300/0 conn(0x7f35e806de60 0x7f35e80d0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:53.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35e6ffd640 1 -- 172.21.15.112:0/2303551145 >> v1:172.21.15.112:6789/0 conn(0x7f35e80d08f0 legacy=0x7f35e806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:53.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35e67fc640 1 -- 172.21.15.112:0/2303551145 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 371029570 0 0) 0x7f35e806e360 con 0x7f35e80d08f0 2024-09-15T23:58:53.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35e6ffd640 1 -- 172.21.15.112:0/2303551145 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e80b3da0 con 0x7f35e815c110 2024-09-15T23:58:53.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35e6ffd640 1 --2- 172.21.15.112:0/2303551145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e815c110 0x7f35e80b45a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f35e8068240 tx=0x7f35d801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804a543b1e999e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:53.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35e67fc640 1 -- 172.21.15.112:0/2303551145 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d80b0070 con 0x7f35e815c110 2024-09-15T23:58:53.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35e67fc640 1 -- 172.21.15.112:0/2303551145 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d80ab600 con 0x7f35e815c110 2024-09-15T23:58:53.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35e67fc640 1 -- 172.21.15.112:0/2303551145 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d80ab9d0 con 0x7f35e815c110 2024-09-15T23:58:53.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35ed56e640 1 -- 172.21.15.112:0/2303551145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e815c110 msgr2=0x7f35e80b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:53.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35ed56e640 1 --2- 172.21.15.112:0/2303551145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e815c110 0x7f35e80b45a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f35e8068240 tx=0x7f35d801c480 comp rx=0 tx=0).stop 2024-09-15T23:58:53.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35ed56e640 1 -- 172.21.15.112:0/2303551145 shutdown_connections 2024-09-15T23:58:53.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35ed56e640 1 --2- 172.21.15.112:0/2303551145 >> v2:172.21.15.169:3300/0 conn(0x7f35e806de60 0x7f35e80d0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:53.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35ed56e640 1 --2- 172.21.15.112:0/2303551145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e815c110 0x7f35e80b45a0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:53.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35ed56e640 1 -- 172.21.15.112:0/2303551145 >> 172.21.15.112:0/2303551145 conn(0x7f35e806bc80 msgr2=0x7f35e806c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:53.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35ed56e640 1 -- 172.21.15.112:0/2303551145 shutdown_connections 2024-09-15T23:58:53.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.732+0000 7f35ed56e640 1 -- 172.21.15.112:0/2303551145 wait complete. 2024-09-15T23:58:53.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35ed56e640 1 Processor -- start 2024-09-15T23:58:53.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35ed56e640 1 -- start start 2024-09-15T23:58:53.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35ed56e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e806de60 0x7f35e8153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:53.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35ed56e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35e80d08f0 0x7f35e815b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:53.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35ed56e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e815c110 0x7f35e814cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:53.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35ed56e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f35e815c670 con 0x7f35e806de60 2024-09-15T23:58:53.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35ed56e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f35e815c4f0 con 0x7f35e815c110 2024-09-15T23:58:53.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35ed56e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f35e80cee00 con 0x7f35e80d08f0 2024-09-15T23:58:53.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e806de60 0x7f35e8153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:53.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e806de60 0x7f35e8153e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43204/0 (socket says 172.21.15.112:43204) 2024-09-15T23:58:53.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35e6ffd640 1 -- 172.21.15.112:0/64249682 learned_addr learned my addr 172.21.15.112:0/64249682 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:53.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35e6ffd640 1 -- 172.21.15.112:0/64249682 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35e80d08f0 msgr2=0x7f35e815b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:53.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35e77fe640 1 --2- 172.21.15.112:0/64249682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e815c110 0x7f35e814cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:53.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35e6ffd640 1 --2- 172.21.15.112:0/64249682 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35e80d08f0 0x7f35e815b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:53.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35e6ffd640 1 -- 172.21.15.112:0/64249682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e815c110 msgr2=0x7f35e814cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:53.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35e6ffd640 1 --2- 172.21.15.112:0/64249682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e815c110 0x7f35e814cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:53.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35e6ffd640 1 -- 172.21.15.112:0/64249682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e8161870 con 0x7f35e806de60 2024-09-15T23:58:53.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35e6ffd640 1 --2- 172.21.15.112:0/64249682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e806de60 0x7f35e8153e60 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f35d80ae040 tx=0x7f35d8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:53.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35dffff640 1 -- 172.21.15.112:0/64249682 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d80b0040 con 0x7f35e806de60 2024-09-15T23:58:53.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35dffff640 1 -- 172.21.15.112:0/64249682 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d80bb070 con 0x7f35e806de60 2024-09-15T23:58:53.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35ed56e640 1 -- 172.21.15.112:0/64249682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e8161b50 con 0x7f35e806de60 2024-09-15T23:58:53.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35dffff640 1 -- 172.21.15.112:0/64249682 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d80b4630 con 0x7f35e806de60 2024-09-15T23:58:53.740 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35ed56e640 1 -- 172.21.15.112:0/64249682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e8164250 con 0x7f35e806de60 2024-09-15T23:58:53.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.736+0000 7f35ed56e640 1 -- 172.21.15.112:0/64249682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e80d0d30 con 0x7f35e806de60 2024-09-15T23:58:53.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.740+0000 7f35dffff640 1 -- 172.21.15.112:0/64249682 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35d80b47d0 con 0x7f35e806de60 2024-09-15T23:58:53.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.740+0000 7f35dffff640 1 --2- 172.21.15.112:0/64249682 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f35c80678f0 0x7f35c8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:53.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.740+0000 7f35dffff640 1 -- 172.21.15.112:0/64249682 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f35d811faf0 con 0x7f35e806de60 2024-09-15T23:58:53.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.740+0000 7f35de7fc640 1 --2- 172.21.15.112:0/64249682 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f35c80678f0 0x7f35c8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:53.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.740+0000 7f35de7fc640 1 --2- 172.21.15.112:0/64249682 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f35c80678f0 0x7f35c8069db0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f35d00011f0 tx=0x7f35d0007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:53.744 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.744+0000 7f35dffff640 1 -- 172.21.15.112:0/64249682 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f35d8016070 con 0x7f35e806de60 2024-09-15T23:58:53.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.932+0000 7f35ed56e640 1 -- 172.21.15.112:0/64249682 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35e81550e0 con 0x7f35e806de60 2024-09-15T23:58:53.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.932+0000 7f35dffff640 1 -- 172.21.15.112:0/64249682 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7f35d80f0470 con 0x7f35e806de60 2024-09-15T23:58:53.934 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:53.934 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:53.934 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:53.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.936+0000 7f35ed56e640 1 -- 172.21.15.112:0/64249682 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f35c80678f0 msgr2=0x7f35c8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:53.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.936+0000 7f35ed56e640 1 --2- 172.21.15.112:0/64249682 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f35c80678f0 0x7f35c8069db0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f35d00011f0 tx=0x7f35d0007930 comp rx=0 tx=0).stop 2024-09-15T23:58:53.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.936+0000 7f35ed56e640 1 -- 172.21.15.112:0/64249682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e806de60 msgr2=0x7f35e8153e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:53.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.936+0000 7f35ed56e640 1 --2- 172.21.15.112:0/64249682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e806de60 0x7f35e8153e60 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f35d80ae040 tx=0x7f35d8019220 comp rx=0 tx=0).stop 2024-09-15T23:58:53.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.936+0000 7f35ed56e640 1 -- 172.21.15.112:0/64249682 shutdown_connections 2024-09-15T23:58:53.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.936+0000 7f35ed56e640 1 --2- 172.21.15.112:0/64249682 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f35c80678f0 0x7f35c8069db0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:53.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.936+0000 7f35ed56e640 1 --2- 172.21.15.112:0/64249682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e815c110 0x7f35e814cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:53.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.936+0000 7f35ed56e640 1 --2- 172.21.15.112:0/64249682 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35e80d08f0 0x7f35e815b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:53.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.936+0000 7f35ed56e640 1 --2- 172.21.15.112:0/64249682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e806de60 0x7f35e8153e60 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:53.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.936+0000 7f35ed56e640 1 -- 172.21.15.112:0/64249682 >> 172.21.15.112:0/64249682 conn(0x7f35e806bc80 msgr2=0x7f35e81558e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:53.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.936+0000 7f35ed56e640 1 -- 172.21.15.112:0/64249682 shutdown_connections 2024-09-15T23:58:53.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:53.936+0000 7f35ed56e640 1 -- 172.21.15.112:0/64249682 wait complete. 2024-09-15T23:58:53.951 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-15T23:58:54.074 INFO:teuthology.orchestra.run.smithi112.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":11044,"msgr_send_messages":24768,"msgr_recv_bytes":4316505,"msgr_send_bytes":15548237,"msgr_created_connections":10,"msgr_active_connections":2,"msgr_running_total_time":1.108597653,"msgr_running_send_time":0.603259375,"msgr_running_recv_time":0.541824749,"msgr_running_fast_dispatch_time":0.034834343,"msgr_send_messages_queue_lat":{"avgcount":24767,"sum":0.758741137,"avgtime":0.000030635},"msgr_handle_ack_lat":{"avgcount":29380,"sum":0.004733516,"avgtime":0.000000161},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":1491,"msgr_send_messages":1499,"msgr_recv_bytes":423476,"msgr_send_bytes":13994601,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.167540451,"msgr_running_send_time":0.085531503,"msgr_running_recv_time":0.025842381,"msgr_running_fast_dispatch_time":0.048800059,"msgr_send_messages_queue_lat":{"avgcount":1497,"sum":3.259723890,"avgtime":0.002177504},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":97344},"AsyncMessenger::Worker-2":{"msgr_recv_messages":1891,"msgr_send_messages":1886,"msgr_recv_bytes":629099,"msgr_send_bytes":2573741,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.135962515,"msgr_running_send_time":0.052310222,"msgr_running_recv_time":0.034690813,"msgr_running_fast_dispatch_time":0.042468223,"msgr_send_messages_queue_lat":{"avgcount":1885,"sum":0.396194518,"avgtime":0.000210182},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":107920,"msgr_send_encrypted_bytes":9712},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":129,"sum":8.754921650,"avgtime":0.067867609}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":5521,"sum":1.759218672,"avgtime":0.000318641}},"mds":{"request":6413,"reply":6411,"reply_latency":{"avgcount":6411,"sum":10.748950201,"avgtime":0.001676641},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":1368,"inodes_top":0,"inodes_bottom":1368,"inodes_pin_tail":0,"inodes_pinned":1368,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":6419,"traverse_hit":6418,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":585,"ceph_cap_op_grant":6979,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":3206,"handle_client_caps_dirty":3000,"handle_client_cap_release":9,"process_request_cap_release":9603},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":3201,"strays_enqueued":3201,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":12826,"evex":11468,"evtrm":11468,"ev":1361,"evexg":0,"evexd":11467,"segadd":16,"segex":16,"segtrm":16,"seg":2,"segmjr":1,"segexg":0,"segexd":15,"expos":28019708,"wrpos":28839163,"rdpos":4195244,"jlat":{"avgcount":25,"sum":3.495409076,"avgtime":0.139816363},"replayed":3},"mds_mem":{"ino":13,"ino+":3214,"ino-":3201,"dir":12,"dir+":13,"dir-":1,"dn":1368,"dn+":6412,"dn-":5044,"cap":1,"cap+":3202,"cap-":3201,"rss":111608,"heap":248116},"mds_server":{"dispatch_client_request":6419,"dispatch_server_request":0,"handle_client_request":6413,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.501283897,"avgtime":0.001094151},"req_getattr_latency":{"avgcount":6,"sum":0.001946066,"avgtime":0.000324344},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004077767,"avgtime":0.004077767},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.251883026,"avgtime":0.083961008},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":1,"sum":0.379202617,"avgtime":0.379202617},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":3200,"sum":6.610556828,"avgtime":0.002065799},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":5809,"average_load":5809,"avg_session_uptime":1056,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":11181332,"buffer_anon_items":2810,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6040,"osdmap_items":99,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":4438380,"mds_co_items":72167,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":4740,"op_send_bytes":26310839,"op_resend":0,"op_reply":4740,"op_latency":{"avgcount":4740,"sum":194.754060999,"avgtime":0.041087354},"op_inflight":0,"oplen_avg":{"avgcount":4740,"sum":7565},"op":4740,"op_r":56,"op_w":4684,"op_rmw":0,"op_pg":0,"osdop_stat":12,"osdop_create":1367,"osdop_read":28,"osdop_write":45,"osdop_writefull":17,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":3222,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":2734,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":103,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":53,"omap_rd":48,"omap_del":14},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":6,"pq_executing":0,"pq_executing_high_water":6,"pq_executed_ops":3201,"pq_executed":3201,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":14422,"get_sum":4068178,"get_or_fail_fail":0,"get_or_fail_success":14422,"take":0,"take_sum":0,"put":14422,"put_sum":4068178,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":4740,"take_sum":26635259,"put":4740,"put_sum":26635259,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":4740,"take_sum":4740,"put":4740,"put_sum":4740,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":3201,"get_sum":323301,"get_or_fail_fail":0,"get_or_fail_success":3201,"take":0,"take_sum":0,"put":20,"put_sum":323301,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55eb22390a00":{"val":0,"max":3758096384,"get_started":0,"get":12826,"get_sum":24643476,"get_or_fail_fail":0,"get_or_fail_success":12826,"take":0,"take_sum":0,"put":25,"put_sum":24643476,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T23:58:54.075 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 29380, "avgtime": 1.61e-07, "sum": 0.004733516 }, "msgr_recv_bytes": 4316505, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 11044, "msgr_running_fast_dispatch_time": 0.034834343, "msgr_running_recv_time": 0.541824749, "msgr_running_send_time": 0.603259375, "msgr_running_total_time": 1.108597653, "msgr_send_bytes": 15548237, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 24768, "msgr_send_messages_queue_lat": { "avgcount": 24767, "avgtime": 3.0635e-05, "sum": 0.758741137 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 423476, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 1491, "msgr_running_fast_dispatch_time": 0.048800059, "msgr_running_recv_time": 0.025842381, "msgr_running_send_time": 0.085531503, "msgr_running_total_time": 0.167540451, "msgr_send_bytes": 13994601, "msgr_send_encrypted_bytes": 97344, "msgr_send_messages": 1499, "msgr_send_messages_queue_lat": { "avgcount": 1497, "avgtime": 0.002177504, "sum": 3.25972389 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 629099, "msgr_recv_encrypted_bytes": 107920, "msgr_recv_messages": 1891, "msgr_running_fast_dispatch_time": 0.042468223, "msgr_running_recv_time": 0.034690813, "msgr_running_send_time": 0.052310222, "msgr_running_total_time": 0.135962515, "msgr_send_bytes": 2573741, "msgr_send_encrypted_bytes": 9712, "msgr_send_messages": 1886, "msgr_send_messages_queue_lat": { "avgcount": 1885, "avgtime": 0.000210182, "sum": 0.396194518 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 129, "avgtime": 0.067867609, "sum": 8.75492165 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 5521, "avgtime": 0.000318641, "sum": 1.759218672 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 6979, "ceph_cap_op_revoke": 585, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 9, "handle_client_caps": 3206, "handle_client_caps_dirty": 3000, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 1368, "inodes_bottom": 1368, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 1368, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 9603, "q": 0, "reply": 6411, "reply_latency": { "avgcount": 6411, "avgtime": 0.001676641, "sum": 10.748950201 }, "request": 6413, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 6419, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 6418, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 3201, "strays_enqueued": 3201, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 1361, "evadd": 12826, "evex": 11468, "evexd": 11467, "evexg": 0, "evlrg": 0, "evtrm": 11468, "expos": 28019708, "jlat": { "avgcount": 25, "avgtime": 0.139816363, "sum": 3.495409076 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 16, "segex": 16, "segexd": 15, "segexg": 0, "segmjr": 1, "segtrm": 16, "wrpos": 28839163 }, "mds_mem": { "cap": 1, "cap+": 3202, "cap-": 3201, "dir": 12, "dir+": 13, "dir-": 1, "dn": 1368, "dn+": 6412, "dn-": 5044, "heap": 248116, "ino": 13, "ino+": 3214, "ino-": 3201, "rss": 111608 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 6419, "dispatch_server_request": 0, "handle_client_request": 6413, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001094151, "sum": 3.501283897 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.000324344, "sum": 0.001946066 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004077767, "sum": 0.004077767 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.083961008, "sum": 0.251883026 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 1, "avgtime": 0.379202617, "sum": 0.379202617 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 3200, "avgtime": 0.002065799, "sum": 6.610556828 } }, "mds_sessions": { "average_load": 5809, "avg_session_uptime": 1056, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5809 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 11181332, "buffer_anon_items": 2810, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 4438380, "mds_co_items": 72167, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6040, "osdmap_items": 99, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 103, "map_full": 0, "map_inc": 2, "omap_del": 14, "omap_rd": 48, "omap_wr": 53, "op": 4740, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 4740, "avgtime": 0.041087354, "sum": 194.754060999 }, "op_pg": 0, "op_r": 56, "op_reply": 4740, "op_resend": 0, "op_rmw": 0, "op_send": 4740, "op_send_bytes": 26310839, "op_w": 4684, "oplen_avg": { "avgcount": 4740, "sum": 7565 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 1367, "osdop_delete": 3222, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 28, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 2734, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 12, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 45, "osdop_writefull": 17, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 3201, "pq_executed_ops": 3201, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executing_ops": 0, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 14422, "get_or_fail_fail": 0, "get_or_fail_success": 14422, "get_started": 0, "get_sum": 4068178, "max": 104857600, "put": 14422, "put_sum": 4068178, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 4740, "put_sum": 26635259, "take": 4740, "take_sum": 26635259, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 4740, "put_sum": 4740, "take": 4740, "take_sum": 4740, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 3201, "get_or_fail_fail": 0, "get_or_fail_success": 3201, "get_started": 0, "get_sum": 323301, "max": 3758096384, "put": 20, "put_sum": 323301, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55eb22390a00": { "get": 12826, "get_or_fail_fail": 0, "get_or_fail_success": 12826, "get_started": 0, "get_sum": 24643476, "max": 3758096384, "put": 25, "put_sum": 24643476, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T23:58:54.075 INFO:tasks.cephfs.test_strays:Complete purge in 8 seconds 2024-09-15T23:58:54.075 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:54.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.180+0000 7f87b395a640 1 Processor -- start 2024-09-15T23:58:54.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.180+0000 7f87b395a640 1 -- start start 2024-09-15T23:58:54.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.184+0000 7f87b395a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87ac148000 0x7f87ac0b5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:54.184 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.184+0000 7f87b395a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f87ac06eaa0 0x7f87ac0ae950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.184+0000 7f87b395a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87ac06ef20 con 0x7f87ac06e660 2024-09-15T23:58:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.184+0000 7f87b395a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f87ac06f200 con 0x7f87ac06eaa0 2024-09-15T23:58:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.184+0000 7f87b395a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f87ac06f4e0 con 0x7f87ac148000 2024-09-15T23:58:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.184+0000 7f87b16f6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87ac148000 0x7f87ac0b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.184+0000 7f87b1ef7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f87ac06eaa0 0x7f87ac0ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.184+0000 7f87b16f6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87ac148000 0x7f87ac0b5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:33268/0 (socket says 172.21.15.112:33268) 2024-09-15T23:58:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.184+0000 7f87b16f6640 1 -- 172.21.15.112:0/3967049979 learned_addr learned my addr 172.21.15.112:0/3967049979 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.184+0000 7f87b1ef7640 1 -- 172.21.15.112:0/3967049979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87ac148000 msgr2=0x7f87ac0b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.184+0000 7f87b1ef7640 1 --2- 172.21.15.112:0/3967049979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87ac148000 0x7f87ac0b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.184+0000 7f87b1ef7640 1 -- 172.21.15.112:0/3967049979 >> v1:172.21.15.169:6789/0 conn(0x7f87ac06e660 legacy=0x7f87ac15eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:54.185 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.184+0000 7f87b1ef7640 1 -- 172.21.15.112:0/3967049979 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ac06f7c0 con 0x7f87ac06eaa0 2024-09-15T23:58:54.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.188+0000 7f87b1ef7640 1 --2- 172.21.15.112:0/3967049979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87ac06eaa0 0x7f87ac0ae950 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009d90 tx=0x7f87a401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=572ed6e22b816500 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:54.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.188+0000 7f87a3fff640 1 -- 172.21.15.112:0/3967049979 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a40b2070 con 0x7f87ac06eaa0 2024-09-15T23:58:54.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.188+0000 7f87a3fff640 1 -- 172.21.15.112:0/3967049979 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a40a5940 con 0x7f87ac06eaa0 2024-09-15T23:58:54.190 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.188+0000 7f87a3fff640 1 -- 172.21.15.112:0/3967049979 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a40a5d10 con 0x7f87ac06eaa0 2024-09-15T23:58:54.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.188+0000 7f87b395a640 1 -- 172.21.15.112:0/3967049979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87ac06eaa0 msgr2=0x7f87ac0ae950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:54.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.188+0000 7f87b395a640 1 --2- 172.21.15.112:0/3967049979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87ac06eaa0 0x7f87ac0ae950 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009d90 tx=0x7f87a401c8e0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.188+0000 7f87b395a640 1 -- 172.21.15.112:0/3967049979 shutdown_connections 2024-09-15T23:58:54.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.188+0000 7f87b395a640 1 --2- 172.21.15.112:0/3967049979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87ac06eaa0 0x7f87ac0ae950 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.188+0000 7f87b395a640 1 --2- 172.21.15.112:0/3967049979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87ac148000 0x7f87ac0b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.188+0000 7f87b395a640 1 -- 172.21.15.112:0/3967049979 >> 172.21.15.112:0/3967049979 conn(0x7f87ac0b23f0 msgr2=0x7f87ac0b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:54.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.188+0000 7f87b395a640 1 -- 172.21.15.112:0/3967049979 shutdown_connections 2024-09-15T23:58:54.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.188+0000 7f87b395a640 1 -- 172.21.15.112:0/3967049979 wait complete. 2024-09-15T23:58:54.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b395a640 1 Processor -- start 2024-09-15T23:58:54.192 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b395a640 1 -- start start 2024-09-15T23:58:54.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b395a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac06e660 0x7f87ac15c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:54.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b395a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87ac06eaa0 0x7f87ac1608d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:54.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b395a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87ac148000 0x7f87ac0cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:54.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b395a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f87ac0afa30 con 0x7f87ac06e660 2024-09-15T23:58:54.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b395a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f87ac0af8b0 con 0x7f87ac148000 2024-09-15T23:58:54.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b395a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f87ac0afbb0 con 0x7f87ac06eaa0 2024-09-15T23:58:54.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b16f6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac06e660 0x7f87ac15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:54.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b16f6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac06e660 0x7f87ac15c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43218/0 (socket says 172.21.15.112:43218) 2024-09-15T23:58:54.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b16f6640 1 -- 172.21.15.112:0/3175765245 learned_addr learned my addr 172.21.15.112:0/3175765245 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:54.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b1ef7640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87ac148000 0x7f87ac0cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:54.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b0ef5640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87ac06eaa0 0x7f87ac1608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:54.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b16f6640 1 -- 172.21.15.112:0/3175765245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87ac06eaa0 msgr2=0x7f87ac1608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:54.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b16f6640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87ac06eaa0 0x7f87ac1608d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b16f6640 1 -- 172.21.15.112:0/3175765245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87ac148000 msgr2=0x7f87ac0cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:54.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b16f6640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87ac148000 0x7f87ac0cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b16f6640 1 -- 172.21.15.112:0/3175765245 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ac15c850 con 0x7f87ac06e660 2024-09-15T23:58:54.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b1ef7640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87ac148000 0x7f87ac0cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:54.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b16f6640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac06e660 0x7f87ac15c310 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f87a800e890 tx=0x7f87a800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:54.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87a1ffb640 1 -- 172.21.15.112:0/3175765245 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8017070 con 0x7f87ac06e660 2024-09-15T23:58:54.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87a1ffb640 1 -- 172.21.15.112:0/3175765245 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a800c940 con 0x7f87ac06e660 2024-09-15T23:58:54.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b395a640 1 -- 172.21.15.112:0/3175765245 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87ac13f340 con 0x7f87ac06e660 2024-09-15T23:58:54.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87a1ffb640 1 -- 172.21.15.112:0/3175765245 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a800cd30 con 0x7f87ac06e660 2024-09-15T23:58:54.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b395a640 1 -- 172.21.15.112:0/3175765245 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87ac13f900 con 0x7f87ac06e660 2024-09-15T23:58:54.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87b395a640 1 -- 172.21.15.112:0/3175765245 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87ac0ae950 con 0x7f87ac06e660 2024-09-15T23:58:54.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.192+0000 7f87a1ffb640 1 -- 172.21.15.112:0/3175765245 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87a801a070 con 0x7f87ac06e660 2024-09-15T23:58:54.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.196+0000 7f87a1ffb640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f87900678f0 0x7f8790069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:54.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.196+0000 7f87a1ffb640 1 -- 172.21.15.112:0/3175765245 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f87a8085ed0 con 0x7f87ac06e660 2024-09-15T23:58:54.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.196+0000 7f87b0ef5640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f87900678f0 0x7f8790069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:54.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.196+0000 7f87b0ef5640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f87900678f0 0x7f8790069db0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f879c007fd0 tx=0x7f879c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:54.199 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.200+0000 7f87a1ffb640 1 -- 172.21.15.112:0/3175765245 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f87a8056720 con 0x7f87ac06e660 2024-09-15T23:58:54.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.388+0000 7f87b395a640 1 -- 172.21.15.112:0/3175765245 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87ac15f960 con 0x7f87ac06e660 2024-09-15T23:58:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.388+0000 7f87a1ffb640 1 -- 172.21.15.112:0/3175765245 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7f87a8056020 con 0x7f87ac06e660 2024-09-15T23:58:54.389 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:54.389 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:54.389 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.388+0000 7f87b395a640 1 -- 172.21.15.112:0/3175765245 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f87900678f0 msgr2=0x7f8790069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.388+0000 7f87b395a640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f87900678f0 0x7f8790069db0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f879c007fd0 tx=0x7f879c009040 comp rx=0 tx=0).stop 2024-09-15T23:58:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.388+0000 7f87b395a640 1 -- 172.21.15.112:0/3175765245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac06e660 msgr2=0x7f87ac15c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.388+0000 7f87b395a640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac06e660 0x7f87ac15c310 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f87a800e890 tx=0x7f87a800ed50 comp rx=0 tx=0).stop 2024-09-15T23:58:54.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.392+0000 7f87b395a640 1 -- 172.21.15.112:0/3175765245 shutdown_connections 2024-09-15T23:58:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.392+0000 7f87b395a640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f87900678f0 0x7f8790069db0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.392+0000 7f87b395a640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87ac148000 0x7f87ac0cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.392+0000 7f87b395a640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87ac06eaa0 0x7f87ac1608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.392+0000 7f87b395a640 1 --2- 172.21.15.112:0/3175765245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87ac06e660 0x7f87ac15c310 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.392+0000 7f87b395a640 1 -- 172.21.15.112:0/3175765245 >> 172.21.15.112:0/3175765245 conn(0x7f87ac0b23f0 msgr2=0x7f87ac0b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.392+0000 7f87b395a640 1 -- 172.21.15.112:0/3175765245 shutdown_connections 2024-09-15T23:58:54.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.392+0000 7f87b395a640 1 -- 172.21.15.112:0/3175765245 wait complete. 2024-09-15T23:58:54.406 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-15T23:58:54.541 INFO:teuthology.orchestra.run.smithi112.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":11045,"msgr_send_messages":24768,"msgr_recv_bytes":4316923,"msgr_send_bytes":15548237,"msgr_created_connections":10,"msgr_active_connections":2,"msgr_running_total_time":1.108696802,"msgr_running_send_time":0.603291401,"msgr_running_recv_time":0.541850980,"msgr_running_fast_dispatch_time":0.034872699,"msgr_send_messages_queue_lat":{"avgcount":24767,"sum":0.758741137,"avgtime":0.000030635},"msgr_handle_ack_lat":{"avgcount":29381,"sum":0.004733661,"avgtime":0.000000161},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":1491,"msgr_send_messages":1500,"msgr_recv_bytes":423476,"msgr_send_bytes":13996409,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.167600023,"msgr_running_send_time":0.085583925,"msgr_running_recv_time":0.025842381,"msgr_running_fast_dispatch_time":0.048800059,"msgr_send_messages_queue_lat":{"avgcount":1498,"sum":3.259782788,"avgtime":0.002176089},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":99152},"AsyncMessenger::Worker-2":{"msgr_recv_messages":1891,"msgr_send_messages":1886,"msgr_recv_bytes":629099,"msgr_send_bytes":2573741,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.135962515,"msgr_running_send_time":0.052310222,"msgr_running_recv_time":0.034690813,"msgr_running_fast_dispatch_time":0.042468223,"msgr_send_messages_queue_lat":{"avgcount":1885,"sum":0.396194518,"avgtime":0.000210182},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":107920,"msgr_send_encrypted_bytes":9712},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":129,"sum":8.754921650,"avgtime":0.067867609}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":5521,"sum":1.759218672,"avgtime":0.000318641}},"mds":{"request":6413,"reply":6411,"reply_latency":{"avgcount":6411,"sum":10.748950201,"avgtime":0.001676641},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":1368,"inodes_top":0,"inodes_bottom":1368,"inodes_pin_tail":0,"inodes_pinned":1368,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":6419,"traverse_hit":6418,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":585,"ceph_cap_op_grant":6979,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":3206,"handle_client_caps_dirty":3000,"handle_client_cap_release":9,"process_request_cap_release":9603},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":3201,"strays_enqueued":3201,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":12826,"evex":11468,"evtrm":11468,"ev":1361,"evexg":0,"evexd":11467,"segadd":16,"segex":16,"segtrm":16,"seg":2,"segmjr":1,"segexg":0,"segexd":15,"expos":28019708,"wrpos":28839163,"rdpos":4195244,"jlat":{"avgcount":25,"sum":3.495409076,"avgtime":0.139816363},"replayed":3},"mds_mem":{"ino":13,"ino+":3214,"ino-":3201,"dir":12,"dir+":13,"dir-":1,"dn":1368,"dn+":6412,"dn-":5044,"cap":1,"cap+":3202,"cap-":3201,"rss":111608,"heap":248116},"mds_server":{"dispatch_client_request":6419,"dispatch_server_request":0,"handle_client_request":6413,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":3200,"sum":3.501283897,"avgtime":0.001094151},"req_getattr_latency":{"avgcount":6,"sum":0.001946066,"avgtime":0.000324344},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":1,"sum":0.004077767,"avgtime":0.004077767},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":3,"sum":0.251883026,"avgtime":0.083961008},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":1,"sum":0.379202617,"avgtime":0.379202617},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":3200,"sum":6.610556828,"avgtime":0.002065799},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":5809,"average_load":5809,"avg_session_uptime":1056,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":11181332,"buffer_anon_items":2810,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6040,"osdmap_items":99,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":4438380,"mds_co_items":72167,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":4740,"op_send_bytes":26310839,"op_resend":0,"op_reply":4740,"op_latency":{"avgcount":4740,"sum":194.754060999,"avgtime":0.041087354},"op_inflight":0,"oplen_avg":{"avgcount":4740,"sum":7565},"op":4740,"op_r":56,"op_w":4684,"op_rmw":0,"op_pg":0,"osdop_stat":12,"osdop_create":1367,"osdop_read":28,"osdop_write":45,"osdop_writefull":17,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":3222,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":2734,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":103,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":53,"omap_rd":48,"omap_del":14},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":6,"pq_executing":0,"pq_executing_high_water":6,"pq_executed_ops":3201,"pq_executed":3201,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":14423,"get_sum":4068506,"get_or_fail_fail":0,"get_or_fail_success":14423,"take":0,"take_sum":0,"put":14423,"put_sum":4068506,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":4740,"take_sum":26635259,"put":4740,"put_sum":26635259,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":4740,"take_sum":4740,"put":4740,"put_sum":4740,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":3201,"get_sum":323301,"get_or_fail_fail":0,"get_or_fail_success":3201,"take":0,"take_sum":0,"put":20,"put_sum":323301,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55eb22390a00":{"val":0,"max":3758096384,"get_started":0,"get":12826,"get_sum":24643476,"get_or_fail_fail":0,"get_or_fail_success":12826,"take":0,"take_sum":0,"put":25,"put_sum":24643476,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T23:58:54.543 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 29381, "avgtime": 1.61e-07, "sum": 0.004733661 }, "msgr_recv_bytes": 4316923, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 11045, "msgr_running_fast_dispatch_time": 0.034872699, "msgr_running_recv_time": 0.54185098, "msgr_running_send_time": 0.603291401, "msgr_running_total_time": 1.108696802, "msgr_send_bytes": 15548237, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 24768, "msgr_send_messages_queue_lat": { "avgcount": 24767, "avgtime": 3.0635e-05, "sum": 0.758741137 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 423476, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 1491, "msgr_running_fast_dispatch_time": 0.048800059, "msgr_running_recv_time": 0.025842381, "msgr_running_send_time": 0.085583925, "msgr_running_total_time": 0.167600023, "msgr_send_bytes": 13996409, "msgr_send_encrypted_bytes": 99152, "msgr_send_messages": 1500, "msgr_send_messages_queue_lat": { "avgcount": 1498, "avgtime": 0.002176089, "sum": 3.259782788 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 629099, "msgr_recv_encrypted_bytes": 107920, "msgr_recv_messages": 1891, "msgr_running_fast_dispatch_time": 0.042468223, "msgr_running_recv_time": 0.034690813, "msgr_running_send_time": 0.052310222, "msgr_running_total_time": 0.135962515, "msgr_send_bytes": 2573741, "msgr_send_encrypted_bytes": 9712, "msgr_send_messages": 1886, "msgr_send_messages_queue_lat": { "avgcount": 1885, "avgtime": 0.000210182, "sum": 0.396194518 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 129, "avgtime": 0.067867609, "sum": 8.75492165 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 5521, "avgtime": 0.000318641, "sum": 1.759218672 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 6979, "ceph_cap_op_revoke": 585, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 9, "handle_client_caps": 3206, "handle_client_caps_dirty": 3000, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 1368, "inodes_bottom": 1368, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 1368, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 9603, "q": 0, "reply": 6411, "reply_latency": { "avgcount": 6411, "avgtime": 0.001676641, "sum": 10.748950201 }, "request": 6413, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 6419, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 6418, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 3201, "strays_enqueued": 3201, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 1361, "evadd": 12826, "evex": 11468, "evexd": 11467, "evexg": 0, "evlrg": 0, "evtrm": 11468, "expos": 28019708, "jlat": { "avgcount": 25, "avgtime": 0.139816363, "sum": 3.495409076 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 16, "segex": 16, "segexd": 15, "segexg": 0, "segmjr": 1, "segtrm": 16, "wrpos": 28839163 }, "mds_mem": { "cap": 1, "cap+": 3202, "cap-": 3201, "dir": 12, "dir+": 13, "dir-": 1, "dn": 1368, "dn+": 6412, "dn-": 5044, "heap": 248116, "ino": 13, "ino+": 3214, "ino-": 3201, "rss": 111608 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 6419, "dispatch_server_request": 0, "handle_client_request": 6413, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 3200, "avgtime": 0.001094151, "sum": 3.501283897 }, "req_getattr_latency": { "avgcount": 6, "avgtime": 0.000324344, "sum": 0.001946066 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 1, "avgtime": 0.004077767, "sum": 0.004077767 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 3, "avgtime": 0.083961008, "sum": 0.251883026 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 1, "avgtime": 0.379202617, "sum": 0.379202617 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 3200, "avgtime": 0.002065799, "sum": 6.610556828 } }, "mds_sessions": { "average_load": 5809, "avg_session_uptime": 1056, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 5809 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 11181332, "buffer_anon_items": 2810, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 4438380, "mds_co_items": 72167, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6040, "osdmap_items": 99, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 103, "map_full": 0, "map_inc": 2, "omap_del": 14, "omap_rd": 48, "omap_wr": 53, "op": 4740, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 4740, "avgtime": 0.041087354, "sum": 194.754060999 }, "op_pg": 0, "op_r": 56, "op_reply": 4740, "op_resend": 0, "op_rmw": 0, "op_send": 4740, "op_send_bytes": 26310839, "op_w": 4684, "oplen_avg": { "avgcount": 4740, "sum": 7565 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 1367, "osdop_delete": 3222, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 28, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 2734, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 12, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 45, "osdop_writefull": 17, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 3201, "pq_executed_ops": 3201, "pq_executing": 0, "pq_executing_high_water": 6, "pq_executing_ops": 0, "pq_executing_ops_high_water": 6, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 14423, "get_or_fail_fail": 0, "get_or_fail_success": 14423, "get_started": 0, "get_sum": 4068506, "max": 104857600, "put": 14423, "put_sum": 4068506, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 4740, "put_sum": 26635259, "take": 4740, "take_sum": 26635259, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 4740, "put_sum": 4740, "take": 4740, "take_sum": 4740, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 3201, "get_or_fail_fail": 0, "get_or_fail_success": 3201, "get_started": 0, "get_sum": 323301, "max": 3758096384, "put": 20, "put_sum": 323301, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55eb22390a00": { "get": 12826, "get_or_fail_fail": 0, "get_or_fail_success": 12826, "get_started": 0, "get_sum": 24643476, "max": 3758096384, "put": 25, "put_sum": 24643476, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T23:58:54.543 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:58:54.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:58:54.625 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:58:54.712 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:58:54.712 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:58:54.712 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:58:54.712 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:58:54.719 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:58:54.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd6926d2640 1 Processor -- start 2024-09-15T23:58:54.893 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd6926d2640 1 -- start start 2024-09-15T23:58:54.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd6926d2640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd68c158bd0 0x7fd68c072040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:54.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd6926d2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd68c0b5450 0x7fd68c072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:54.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd6926d2640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd68c0b4690 con 0x7fd68c0b5b50 2024-09-15T23:58:54.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd6926d2640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd68c0d0230 con 0x7fd68c158bd0 2024-09-15T23:58:54.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd6926d2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd68c0b4970 con 0x7fd68c0b5450 2024-09-15T23:58:54.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd68bfff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd68c158bd0 0x7fd68c072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:54.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd690c6f640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd68c0b5b50 0x7fd68c0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56300/0 (socket says 172.21.15.112:56300) 2024-09-15T23:58:54.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd690c6f640 1 -- 172.21.15.112:0/3267235915 learned_addr learned my addr 172.21.15.112:0/3267235915 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:54.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd683fff640 1 --2- 172.21.15.112:0/3267235915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd68c0b5450 0x7fd68c072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:54.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd68bfff640 1 -- 172.21.15.112:0/3267235915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd68c0b5450 msgr2=0x7fd68c072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:54.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd68bfff640 1 --2- 172.21.15.112:0/3267235915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd68c0b5450 0x7fd68c072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd68bfff640 1 -- 172.21.15.112:0/3267235915 >> v1:172.21.15.112:6789/0 conn(0x7fd68c0b5b50 legacy=0x7fd68c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:54.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.892+0000 7fd68bfff640 1 -- 172.21.15.112:0/3267235915 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c0b4c50 con 0x7fd68c158bd0 2024-09-15T23:58:54.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.896+0000 7fd68bfff640 1 --2- 172.21.15.112:0/3267235915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd68c158bd0 0x7fd68c072040 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0097c0 tx=0x7fd67c01e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a162b0aa28dd1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:54.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.896+0000 7fd68b7fe640 1 -- 172.21.15.112:0/3267235915 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0b2600 con 0x7fd68c158bd0 2024-09-15T23:58:54.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.896+0000 7fd68b7fe640 1 -- 172.21.15.112:0/3267235915 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67c0b27a0 con 0x7fd68c158bd0 2024-09-15T23:58:54.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.896+0000 7fd68b7fe640 1 -- 172.21.15.112:0/3267235915 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0b2b70 con 0x7fd68c158bd0 2024-09-15T23:58:54.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.896+0000 7fd6926d2640 1 -- 172.21.15.112:0/3267235915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd68c158bd0 msgr2=0x7fd68c072040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:54.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.896+0000 7fd6926d2640 1 --2- 172.21.15.112:0/3267235915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd68c158bd0 0x7fd68c072040 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0097c0 tx=0x7fd67c01e6b0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.896+0000 7fd6926d2640 1 -- 172.21.15.112:0/3267235915 shutdown_connections 2024-09-15T23:58:54.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.896+0000 7fd6926d2640 1 --2- 172.21.15.112:0/3267235915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd68c0b5450 0x7fd68c072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.896+0000 7fd6926d2640 1 --2- 172.21.15.112:0/3267235915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd68c158bd0 0x7fd68c072040 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.896+0000 7fd6926d2640 1 -- 172.21.15.112:0/3267235915 >> 172.21.15.112:0/3267235915 conn(0x7fd68c06bc80 msgr2=0x7fd68c06c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:54.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.896+0000 7fd6926d2640 1 -- 172.21.15.112:0/3267235915 shutdown_connections 2024-09-15T23:58:54.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.896+0000 7fd6926d2640 1 -- 172.21.15.112:0/3267235915 wait complete. 2024-09-15T23:58:54.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.896+0000 7fd6926d2640 1 Processor -- start 2024-09-15T23:58:54.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6926d2640 1 -- start start 2024-09-15T23:58:54.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6926d2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd68c0b5450 0x7fd68c14d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:54.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6926d2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd68c0b5b50 0x7fd68c149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:54.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6926d2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd68c158bd0 0x7fd68c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:54.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6926d2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c0cfdc0 con 0x7fd68c0b5b50 2024-09-15T23:58:54.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6926d2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c0cfc40 con 0x7fd68c0b5450 2024-09-15T23:58:54.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6926d2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd68c0cff40 con 0x7fd68c158bd0 2024-09-15T23:58:54.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd683fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd68c0b5b50 0x7fd68c149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:54.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd683fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd68c0b5b50 0x7fd68c149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43242/0 (socket says 172.21.15.112:43242) 2024-09-15T23:58:54.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd683fff640 1 -- 172.21.15.112:0/4094562764 learned_addr learned my addr 172.21.15.112:0/4094562764 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:54.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd68bfff640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd68c0b5450 0x7fd68c14d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:54.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd690c6f640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd68c158bd0 0x7fd68c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:54.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd683fff640 1 -- 172.21.15.112:0/4094562764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd68c158bd0 msgr2=0x7fd68c06f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:54.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd683fff640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd68c158bd0 0x7fd68c06f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd683fff640 1 -- 172.21.15.112:0/4094562764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd68c0b5450 msgr2=0x7fd68c14d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:54.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd683fff640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd68c0b5450 0x7fd68c14d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:54.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd683fff640 1 -- 172.21.15.112:0/4094562764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c06f860 con 0x7fd68c0b5b50 2024-09-15T23:58:54.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd690c6f640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd68c158bd0 0x7fd68c06f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:54.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd68bfff640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd68c0b5450 0x7fd68c14d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:54.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd683fff640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd68c0b5b50 0x7fd68c149f30 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd67400d800 tx=0x7fd67400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:54.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6897fa640 1 -- 172.21.15.112:0/4094562764 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67400b6c0 con 0x7fd68c0b5b50 2024-09-15T23:58:54.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6897fa640 1 -- 172.21.15.112:0/4094562764 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd674019070 con 0x7fd68c0b5b50 2024-09-15T23:58:54.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6926d2640 1 -- 172.21.15.112:0/4094562764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68c06fb40 con 0x7fd68c0b5b50 2024-09-15T23:58:54.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6897fa640 1 -- 172.21.15.112:0/4094562764 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67400ba60 con 0x7fd68c0b5b50 2024-09-15T23:58:54.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6926d2640 1 -- 172.21.15.112:0/4094562764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd68c14cc90 con 0x7fd68c0b5b50 2024-09-15T23:58:54.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6926d2640 1 -- 172.21.15.112:0/4094562764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd68c0b5fe0 con 0x7fd68c0b5b50 2024-09-15T23:58:54.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6897fa640 1 -- 172.21.15.112:0/4094562764 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd67400bc00 con 0x7fd68c0b5b50 2024-09-15T23:58:54.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6897fa640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd66c0678c0 0x7fd66c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:54.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd6897fa640 1 -- 172.21.15.112:0/4094562764 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7fd6740863d0 con 0x7fd68c0b5b50 2024-09-15T23:58:54.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.900+0000 7fd68bfff640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd66c0678c0 0x7fd66c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:54.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.904+0000 7fd68bfff640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd66c0678c0 0x7fd66c069d80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0b1000 tx=0x7fd67c0a9000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:54.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:54.904+0000 7fd6897fa640 1 -- 172.21.15.112:0/4094562764 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd674056cc0 con 0x7fd68c0b5b50 2024-09-15T23:58:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.084+0000 7fd6926d2640 1 -- 172.21.15.112:0/4094562764 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd68c0cda30 con 0x7fd68c0b5b50 2024-09-15T23:58:55.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.084+0000 7fd6897fa640 1 -- 172.21.15.112:0/4094562764 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v103) ==== 80+0+124 (secure 0 0 0) 0x7fd6740565c0 con 0x7fd68c0b5b50 2024-09-15T23:58:55.085 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6837/2378546307 2024-09-16T23:58:27.547962+0000 2024-09-15T23:58:55.085 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112:6835/2378546307 2024-09-16T23:58:27.547962+0000 2024-09-15T23:58:55.085 INFO:teuthology.orchestra.run.smithi112.stderr:listed 2 entries 2024-09-15T23:58:55.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.084+0000 7fd6926d2640 1 -- 172.21.15.112:0/4094562764 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd66c0678c0 msgr2=0x7fd66c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:55.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.084+0000 7fd6926d2640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd66c0678c0 0x7fd66c069d80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0b1000 tx=0x7fd67c0a9000 comp rx=0 tx=0).stop 2024-09-15T23:58:55.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.084+0000 7fd6926d2640 1 -- 172.21.15.112:0/4094562764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd68c0b5b50 msgr2=0x7fd68c149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:55.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.084+0000 7fd6926d2640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd68c0b5b50 0x7fd68c149f30 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd67400d800 tx=0x7fd67400dcc0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.084+0000 7fd6926d2640 1 -- 172.21.15.112:0/4094562764 shutdown_connections 2024-09-15T23:58:55.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.084+0000 7fd6926d2640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd66c0678c0 0x7fd66c069d80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.084+0000 7fd6926d2640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd68c158bd0 0x7fd68c06f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.084+0000 7fd6926d2640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd68c0b5b50 0x7fd68c149f30 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.084+0000 7fd6926d2640 1 --2- 172.21.15.112:0/4094562764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd68c0b5450 0x7fd68c14d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.084+0000 7fd6926d2640 1 -- 172.21.15.112:0/4094562764 >> 172.21.15.112:0/4094562764 conn(0x7fd68c06bc80 msgr2=0x7fd68c0b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:55.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.084+0000 7fd6926d2640 1 -- 172.21.15.112:0/4094562764 shutdown_connections 2024-09-15T23:58:55.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.084+0000 7fd6926d2640 1 -- 172.21.15.112:0/4094562764 wait complete. 2024-09-15T23:58:55.103 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2024-09-15T23:58:55.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:55.104 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:58:55.114 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[44835]: fuse finished with error 0 and tester_r 0 2024-09-15T23:58:55.115 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:58:55.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:55.116 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:58:55.282 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:58:55.282 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:58:55.282 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:58:55.289 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:58:55.289 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:58:55.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:55.289 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:58:55.335 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-15T23:58:55.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:58:55.336 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:58:55.337 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:58:55.337 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:58:55.343 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:58:55.343 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:58:55.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:55.344 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-15T23:58:55.392 INFO:teuthology.orchestra.run.smithi112.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-15T23:58:55.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:58:55.393 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:58:55.393 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:58:55.393 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:58:55.399 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:58:55.399 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:58:55.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:58:55.400 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-15T23:58:55.447 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-15T23:58:55.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:58:55.448 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:55.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b10e62640 1 Processor -- start 2024-09-15T23:58:55.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b10e62640 1 -- start start 2024-09-15T23:58:55.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b10e62640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b0c15e4a0 0x7f9b0c0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b10e62640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9b0c15e880 0x7f9b0c0d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b10e62640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b0c0afbc0 con 0x7f9b0c0b3160 2024-09-15T23:58:55.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b10e62640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9b0c162b60 con 0x7f9b0c15e880 2024-09-15T23:58:55.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b10e62640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0c06df10 con 0x7f9b0c15e4a0 2024-09-15T23:58:55.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0ad9d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f9b0c0b3160 0x7f9b0c0b3730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56314/0 (socket says 172.21.15.112:56314) 2024-09-15T23:58:55.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0ad9d640 1 -- 172.21.15.112:0/1057132600 learned_addr learned my addr 172.21.15.112:0/1057132600 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:55.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b09d9b640 1 --2- 172.21.15.112:0/1057132600 >> v2:172.21.15.169:3300/0 conn(0x7f9b0c15e880 0x7f9b0c0d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 -- 172.21.15.112:0/1057132600 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2263012099 0 0) 0x7f9b0c0afbc0 con 0x7f9b0c0b3160 2024-09-15T23:58:55.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 -- 172.21.15.112:0/1057132600 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9af8003530 con 0x7f9b0c0b3160 2024-09-15T23:58:55.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0a59c640 1 --2- 172.21.15.112:0/1057132600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b0c15e4a0 0x7f9b0c0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 -- 172.21.15.112:0/1057132600 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3603730058 0 0) 0x7f9af8003530 con 0x7f9b0c0b3160 2024-09-15T23:58:55.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 -- 172.21.15.112:0/1057132600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b0c15e4a0 msgr2=0x7f9b0c0af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:55.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 --2- 172.21.15.112:0/1057132600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b0c15e4a0 0x7f9b0c0af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 -- 172.21.15.112:0/1057132600 >> v2:172.21.15.169:3300/0 conn(0x7f9b0c15e880 msgr2=0x7f9b0c0d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:55.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 --2- 172.21.15.112:0/1057132600 >> v2:172.21.15.169:3300/0 conn(0x7f9b0c15e880 0x7f9b0c0d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 -- 172.21.15.112:0/1057132600 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c162ff0 con 0x7f9b0c0b3160 2024-09-15T23:58:55.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 -- 172.21.15.112:0/1057132600 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f9b04001a00 con 0x7f9b0c0b3160 2024-09-15T23:58:55.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 -- 172.21.15.112:0/1057132600 >> v1:172.21.15.112:6789/0 conn(0x7f9b0c0b3160 legacy=0x7f9b0c0b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:55.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 --2- 172.21.15.112:0/1057132600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af80039c0 0x7f9af8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 --2- 172.21.15.112:0/1057132600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b0c15e4a0 0x7f9af8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 --2- 172.21.15.112:0/1057132600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9af8004d50 0x7f9af80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 -- 172.21.15.112:0/1057132600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c162b60 con 0x7f9af80039c0 2024-09-15T23:58:55.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 -- 172.21.15.112:0/1057132600 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c06df10 con 0x7f9af8004d50 2024-09-15T23:58:55.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0959a640 1 -- 172.21.15.112:0/1057132600 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9af800bbe0 con 0x7f9b0c15e4a0 2024-09-15T23:58:55.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0a59c640 1 --2- 172.21.15.112:0/1057132600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af80039c0 0x7f9af8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0ad9d640 1 --2- 172.21.15.112:0/1057132600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9af8004d50 0x7f9af80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b09d9b640 1 --2- 172.21.15.112:0/1057132600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b0c15e4a0 0x7f9af8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0a59c640 1 -- 172.21.15.112:0/1057132600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b0c15e4a0 msgr2=0x7f9af8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:55.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0a59c640 1 --2- 172.21.15.112:0/1057132600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b0c15e4a0 0x7f9af8004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0a59c640 1 -- 172.21.15.112:0/1057132600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9af8004d50 msgr2=0x7f9af80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0a59c640 1 --2- 172.21.15.112:0/1057132600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9af8004d50 0x7f9af80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.576+0000 7f9b0a59c640 1 -- 172.21.15.112:0/1057132600 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af8003530 con 0x7f9af80039c0 2024-09-15T23:58:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.580+0000 7f9b0a59c640 1 --2- 172.21.15.112:0/1057132600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af80039c0 0x7f9af8003de0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00ba30 tx=0x7f9afc01c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65350adf65ea470 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.580+0000 7f9b0959a640 1 -- 172.21.15.112:0/1057132600 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0b2070 con 0x7f9af80039c0 2024-09-15T23:58:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.580+0000 7f9b0959a640 1 -- 172.21.15.112:0/1057132600 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc0ad640 con 0x7f9af80039c0 2024-09-15T23:58:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.580+0000 7f9b0959a640 1 -- 172.21.15.112:0/1057132600 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc00b600 con 0x7f9af80039c0 2024-09-15T23:58:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.580+0000 7f9b10e62640 1 -- 172.21.15.112:0/1057132600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af80039c0 msgr2=0x7f9af8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.580+0000 7f9b10e62640 1 --2- 172.21.15.112:0/1057132600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af80039c0 0x7f9af8003de0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00ba30 tx=0x7f9afc01c670 comp rx=0 tx=0).stop 2024-09-15T23:58:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.580+0000 7f9b0ad9d640 1 -- 172.21.15.112:0/1057132600 reap_dead start 2024-09-15T23:58:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.580+0000 7f9b10e62640 1 -- 172.21.15.112:0/1057132600 shutdown_connections 2024-09-15T23:58:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.580+0000 7f9b10e62640 1 -- 172.21.15.112:0/1057132600 >> 172.21.15.112:0/1057132600 conn(0x7f9b0c075200 msgr2=0x7f9b0c075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:55.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.580+0000 7f9b10e62640 1 -- 172.21.15.112:0/1057132600 shutdown_connections 2024-09-15T23:58:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.580+0000 7f9b10e62640 1 -- 172.21.15.112:0/1057132600 wait complete. 2024-09-15T23:58:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.580+0000 7f9b10e62640 1 Processor -- start 2024-09-15T23:58:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.580+0000 7f9b10e62640 1 -- start start 2024-09-15T23:58:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b10e62640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af80039c0 0x7f9b0c14dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b10e62640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b0c14e740 0x7f9b0c160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b10e62640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b0c152480 0x7f9b0c072280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b10e62640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c0b3fc0 con 0x7f9af80039c0 2024-09-15T23:58:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b10e62640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c0b3e40 con 0x7f9b0c152480 2024-09-15T23:58:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b10e62640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0c0b4140 con 0x7f9b0c14e740 2024-09-15T23:58:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b0a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af80039c0 0x7f9b0c14dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b0a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af80039c0 0x7f9b0c14dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43258/0 (socket says 172.21.15.112:43258) 2024-09-15T23:58:55.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b0a59c640 1 -- 172.21.15.112:0/531284608 learned_addr learned my addr 172.21.15.112:0/531284608 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b0ad9d640 1 --2- 172.21.15.112:0/531284608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b0c152480 0x7f9b0c072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b09d9b640 1 --2- 172.21.15.112:0/531284608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b0c14e740 0x7f9b0c160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b0a59c640 1 -- 172.21.15.112:0/531284608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b0c14e740 msgr2=0x7f9b0c160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b0a59c640 1 --2- 172.21.15.112:0/531284608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b0c14e740 0x7f9b0c160ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b0a59c640 1 -- 172.21.15.112:0/531284608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b0c152480 msgr2=0x7f9b0c072280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b0a59c640 1 --2- 172.21.15.112:0/531284608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b0c152480 0x7f9b0c072280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b0a59c640 1 -- 172.21.15.112:0/531284608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c1516c0 con 0x7f9af80039c0 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b0a59c640 1 --2- 172.21.15.112:0/531284608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af80039c0 0x7f9b0c14dec0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f9afc01cb50 tx=0x7f9af8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b02ffd640 1 -- 172.21.15.112:0/531284608 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0b2040 con 0x7f9af80039c0 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b02ffd640 1 -- 172.21.15.112:0/531284608 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc0ad440 con 0x7f9af80039c0 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b02ffd640 1 -- 172.21.15.112:0/531284608 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0a7070 con 0x7f9af80039c0 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b10e62640 1 -- 172.21.15.112:0/531284608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0c1519a0 con 0x7f9af80039c0 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b10e62640 1 -- 172.21.15.112:0/531284608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b0c14e400 con 0x7f9af80039c0 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b10e62640 1 -- 172.21.15.112:0/531284608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b0c0d0420 con 0x7f9af80039c0 2024-09-15T23:58:55.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b02ffd640 1 -- 172.21.15.112:0/531284608 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9afc0c0020 con 0x7f9af80039c0 2024-09-15T23:58:55.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b02ffd640 1 --2- 172.21.15.112:0/531284608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9aec0678f0 0x7f9aec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b02ffd640 1 -- 172.21.15.112:0/531284608 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f9afc120230 con 0x7f9af80039c0 2024-09-15T23:58:55.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b09d9b640 1 --2- 172.21.15.112:0/531284608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9aec0678f0 0x7f9aec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.584+0000 7f9b09d9b640 1 --2- 172.21.15.112:0/531284608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9aec0678f0 0x7f9aec069db0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c1fab50 tx=0x7f9af4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:55.627 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.588+0000 7f9b02ffd640 1 -- 172.21.15.112:0/531284608 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9afc0163b0 con 0x7f9af80039c0 2024-09-15T23:58:55.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.792+0000 7f9b10e62640 1 -- 172.21.15.112:0/531284608 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b0c0adde0 con 0x7f9af80039c0 2024-09-15T23:58:55.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.796+0000 7f9b02ffd640 1 -- 172.21.15.112:0/531284608 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7f9afc0f0b20 con 0x7f9af80039c0 2024-09-15T23:58:55.795 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:55.795 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:55.796 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:55.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.796+0000 7f9b10e62640 1 -- 172.21.15.112:0/531284608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9aec0678f0 msgr2=0x7f9aec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:55.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.796+0000 7f9b10e62640 1 --2- 172.21.15.112:0/531284608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9aec0678f0 0x7f9aec069db0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c1fab50 tx=0x7f9af4008040 comp rx=0 tx=0).stop 2024-09-15T23:58:55.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.796+0000 7f9b10e62640 1 -- 172.21.15.112:0/531284608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af80039c0 msgr2=0x7f9b0c14dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:55.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.796+0000 7f9b10e62640 1 --2- 172.21.15.112:0/531284608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af80039c0 0x7f9b0c14dec0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f9afc01cb50 tx=0x7f9af8005840 comp rx=0 tx=0).stop 2024-09-15T23:58:55.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.796+0000 7f9b10e62640 1 -- 172.21.15.112:0/531284608 shutdown_connections 2024-09-15T23:58:55.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.796+0000 7f9b10e62640 1 --2- 172.21.15.112:0/531284608 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9aec0678f0 0x7f9aec069db0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.796+0000 7f9b10e62640 1 --2- 172.21.15.112:0/531284608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b0c152480 0x7f9b0c072280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.796+0000 7f9b10e62640 1 --2- 172.21.15.112:0/531284608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b0c14e740 0x7f9b0c160ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.796+0000 7f9b10e62640 1 --2- 172.21.15.112:0/531284608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9af80039c0 0x7f9b0c14dec0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.796+0000 7f9b10e62640 1 -- 172.21.15.112:0/531284608 >> 172.21.15.112:0/531284608 conn(0x7f9b0c075200 msgr2=0x7f9b0c0afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:55.798 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.796+0000 7f9b10e62640 1 -- 172.21.15.112:0/531284608 shutdown_connections 2024-09-15T23:58:55.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.796+0000 7f9b10e62640 1 -- 172.21.15.112:0/531284608 wait complete. 2024-09-15T23:58:55.815 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:55.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.936+0000 7f9bbe816640 1 Processor -- start 2024-09-15T23:58:55.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.936+0000 7f9bbe816640 1 -- start start 2024-09-15T23:58:55.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.936+0000 7f9bbe816640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9bb80d0420 0x7f9bb80d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.936+0000 7f9bbe816640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9bb80b3440 0x7f9bb80b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.936+0000 7f9bbe816640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bb806d2c0 con 0x7f9bb80cf5e0 2024-09-15T23:58:55.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.936+0000 7f9bbe816640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f9bb80d0da0 con 0x7f9bb80b3440 2024-09-15T23:58:55.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.936+0000 7f9bbe816640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9bb806d5a0 con 0x7f9bb80d0420 2024-09-15T23:58:55.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.936+0000 7f9bbcdb3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9bb80b3440 0x7f9bb80b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.936+0000 7f9bbcdb3640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f9bb80b3440 0x7f9bb80b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43268/0 (socket says 172.21.15.112:43268) 2024-09-15T23:58:55.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.936+0000 7f9bbcdb3640 1 -- 172.21.15.112:0/3726224442 learned_addr learned my addr 172.21.15.112:0/3726224442 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:55.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.936+0000 7f9bb77fe640 1 --2- 172.21.15.112:0/3726224442 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9bb80d0420 0x7f9bb80d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bbcdb3640 1 -- 172.21.15.112:0/3726224442 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9bb80d0420 msgr2=0x7f9bb80d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:55.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bbcdb3640 1 --2- 172.21.15.112:0/3726224442 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9bb80d0420 0x7f9bb80d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bbcdb3640 1 -- 172.21.15.112:0/3726224442 >> v1:172.21.15.169:6789/0 conn(0x7f9bb80cf5e0 legacy=0x7f9bb80af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:55.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bbcdb3640 1 -- 172.21.15.112:0/3726224442 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb806d880 con 0x7f9bb80b3440 2024-09-15T23:58:55.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bbcdb3640 1 --2- 172.21.15.112:0/3726224442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bb80b3440 0x7f9bb80b38b0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009e50 tx=0x7f9bb001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d7f358fdf4a1cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:55.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bb6ffd640 1 -- 172.21.15.112:0/3726224442 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb00a5810 con 0x7f9bb80b3440 2024-09-15T23:58:55.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bb6ffd640 1 -- 172.21.15.112:0/3726224442 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb00a59b0 con 0x7f9bb80b3440 2024-09-15T23:58:55.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bb6ffd640 1 -- 172.21.15.112:0/3726224442 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb00a5d80 con 0x7f9bb80b3440 2024-09-15T23:58:55.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bbe816640 1 -- 172.21.15.112:0/3726224442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bb80b3440 msgr2=0x7f9bb80b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:55.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bbe816640 1 --2- 172.21.15.112:0/3726224442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bb80b3440 0x7f9bb80b38b0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009e50 tx=0x7f9bb001ca30 comp rx=0 tx=0).stop 2024-09-15T23:58:55.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bbe816640 1 -- 172.21.15.112:0/3726224442 shutdown_connections 2024-09-15T23:58:55.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bbe816640 1 --2- 172.21.15.112:0/3726224442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bb80b3440 0x7f9bb80b38b0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bbe816640 1 --2- 172.21.15.112:0/3726224442 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9bb80d0420 0x7f9bb80d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bbe816640 1 -- 172.21.15.112:0/3726224442 >> 172.21.15.112:0/3726224442 conn(0x7f9bb8075200 msgr2=0x7f9bb8075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:55.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bbe816640 1 -- 172.21.15.112:0/3726224442 shutdown_connections 2024-09-15T23:58:55.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.940+0000 7f9bbe816640 1 -- 172.21.15.112:0/3726224442 wait complete. 2024-09-15T23:58:55.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bbe816640 1 Processor -- start 2024-09-15T23:58:55.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bbe816640 1 -- start start 2024-09-15T23:58:55.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bbe816640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bb80b3440 0x7f9bb815b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bbe816640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9bb80cf5e0 0x7f9bb8158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bbe816640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9bb80d0420 0x7f9bb8160ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bbe816640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb816f730 con 0x7f9bb80b3440 2024-09-15T23:58:55.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bbe816640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb816f5b0 con 0x7f9bb80d0420 2024-09-15T23:58:55.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bbe816640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9bb816f8b0 con 0x7f9bb80cf5e0 2024-09-15T23:58:55.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bb80b3440 0x7f9bb815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bb80b3440 0x7f9bb815b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43278/0 (socket says 172.21.15.112:43278) 2024-09-15T23:58:55.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb7fff640 1 -- 172.21.15.112:0/3820761350 learned_addr learned my addr 172.21.15.112:0/3820761350 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:55.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb77fe640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9bb80cf5e0 0x7f9bb8158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bbcdb3640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9bb80d0420 0x7f9bb8160ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb7fff640 1 -- 172.21.15.112:0/3820761350 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9bb80cf5e0 msgr2=0x7f9bb8158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:55.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb7fff640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9bb80cf5e0 0x7f9bb8158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb7fff640 1 -- 172.21.15.112:0/3820761350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9bb80d0420 msgr2=0x7f9bb8160ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:55.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb7fff640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9bb80d0420 0x7f9bb8160ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:55.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb7fff640 1 -- 172.21.15.112:0/3820761350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb815f430 con 0x7f9bb80b3440 2024-09-15T23:58:55.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bbcdb3640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9bb80d0420 0x7f9bb8160ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:55.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb7fff640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bb80b3440 0x7f9bb815b310 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800c450 tx=0x7f9ba800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:55.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb4ff9640 1 -- 172.21.15.112:0/3820761350 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8016020 con 0x7f9bb80b3440 2024-09-15T23:58:55.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb4ff9640 1 -- 172.21.15.112:0/3820761350 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ba80052d0 con 0x7f9bb80b3440 2024-09-15T23:58:55.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bbe816640 1 -- 172.21.15.112:0/3820761350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb8071b30 con 0x7f9bb80b3440 2024-09-15T23:58:55.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb4ff9640 1 -- 172.21.15.112:0/3820761350 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8007260 con 0x7f9bb80b3440 2024-09-15T23:58:55.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bbe816640 1 -- 172.21.15.112:0/3820761350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb815f9d0 con 0x7f9bb80b3440 2024-09-15T23:58:55.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bbe816640 1 -- 172.21.15.112:0/3820761350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb80b38b0 con 0x7f9bb80b3440 2024-09-15T23:58:55.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb4ff9640 1 -- 172.21.15.112:0/3820761350 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ba8007400 con 0x7f9bb80b3440 2024-09-15T23:58:55.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb4ff9640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9ba40678c0 0x7f9ba4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:55.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb4ff9640 1 -- 172.21.15.112:0/3820761350 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f9ba8085800 con 0x7f9bb80b3440 2024-09-15T23:58:55.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.944+0000 7f9bb77fe640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9ba40678c0 0x7f9ba4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:55.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.948+0000 7f9bb77fe640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9ba40678c0 0x7f9ba4069d80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9bb815d0f0 tx=0x7f9bac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:55.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:55.952+0000 7f9bb4ff9640 1 -- 172.21.15.112:0/3820761350 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9ba8020020 con 0x7f9bb80b3440 2024-09-15T23:58:56.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.148+0000 7f9bbe816640 1 -- 172.21.15.112:0/3820761350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bb8068f60 con 0x7f9bb80b3440 2024-09-15T23:58:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.148+0000 7f9bb4ff9640 1 -- 172.21.15.112:0/3820761350 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7f9ba8005480 con 0x7f9bb80b3440 2024-09-15T23:58:56.149 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:56.149 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:56.149 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.152+0000 7f9bbe816640 1 -- 172.21.15.112:0/3820761350 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9ba40678c0 msgr2=0x7f9ba4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.152+0000 7f9bbe816640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9ba40678c0 0x7f9ba4069d80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9bb815d0f0 tx=0x7f9bac008040 comp rx=0 tx=0).stop 2024-09-15T23:58:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.152+0000 7f9bbe816640 1 -- 172.21.15.112:0/3820761350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bb80b3440 msgr2=0x7f9bb815b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.152+0000 7f9bbe816640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bb80b3440 0x7f9bb815b310 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800c450 tx=0x7f9ba800c910 comp rx=0 tx=0).stop 2024-09-15T23:58:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.152+0000 7f9bbe816640 1 -- 172.21.15.112:0/3820761350 shutdown_connections 2024-09-15T23:58:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.152+0000 7f9bbe816640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f9ba40678c0 0x7f9ba4069d80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.152+0000 7f9bbe816640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9bb80d0420 0x7f9bb8160ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.152+0000 7f9bbe816640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9bb80cf5e0 0x7f9bb8158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.152+0000 7f9bbe816640 1 --2- 172.21.15.112:0/3820761350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bb80b3440 0x7f9bb815b310 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.152+0000 7f9bbe816640 1 -- 172.21.15.112:0/3820761350 >> 172.21.15.112:0/3820761350 conn(0x7f9bb8075200 msgr2=0x7f9bb80755e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.152+0000 7f9bbe816640 1 -- 172.21.15.112:0/3820761350 shutdown_connections 2024-09-15T23:58:56.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.152+0000 7f9bbe816640 1 -- 172.21.15.112:0/3820761350 wait complete. 2024-09-15T23:58:56.169 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:58:56.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.284+0000 7f8d8b329640 1 Processor -- start 2024-09-15T23:58:56.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.284+0000 7f8d8b329640 1 -- start start 2024-09-15T23:58:56.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d8b329640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8d8415e6f0 0x7f8d840cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d8b329640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8d840d15d0 0x7f8d840b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d8b329640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d840b7740 con 0x7f8d840cfc00 2024-09-15T23:58:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d8b329640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8d840d3850 con 0x7f8d840d15d0 2024-09-15T23:58:56.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d8b329640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8d840d3b30 con 0x7f8d8415e6f0 2024-09-15T23:58:56.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d898c6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8d840d15d0 0x7f8d840b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d898c6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8d840d15d0 0x7f8d840b7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43282/0 (socket says 172.21.15.112:43282) 2024-09-15T23:58:56.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d898c6640 1 -- 172.21.15.112:0/3892239719 learned_addr learned my addr 172.21.15.112:0/3892239719 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:56.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d890c5640 1 --2- 172.21.15.112:0/3892239719 >> v2:172.21.15.169:3300/0 conn(0x7f8d8415e6f0 0x7f8d840cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d898c6640 1 -- 172.21.15.112:0/3892239719 >> v2:172.21.15.169:3300/0 conn(0x7f8d8415e6f0 msgr2=0x7f8d840cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:56.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d898c6640 1 --2- 172.21.15.112:0/3892239719 >> v2:172.21.15.169:3300/0 conn(0x7f8d8415e6f0 0x7f8d840cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d898c6640 1 -- 172.21.15.112:0/3892239719 >> v1:172.21.15.169:6789/0 conn(0x7f8d840cfc00 legacy=0x7f8d840d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:56.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d898c6640 1 -- 172.21.15.112:0/3892239719 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d840d3e10 con 0x7f8d840d15d0 2024-09-15T23:58:56.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d898c6640 1 --2- 172.21.15.112:0/3892239719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d840d15d0 0x7f8d840b7c20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8d84074480 tx=0x7f8d7c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46476554597e94f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:56.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d7bfff640 1 -- 172.21.15.112:0/3892239719 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c0a5740 con 0x7f8d840d15d0 2024-09-15T23:58:56.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d7bfff640 1 -- 172.21.15.112:0/3892239719 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d7c0a58e0 con 0x7f8d840d15d0 2024-09-15T23:58:56.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d7bfff640 1 -- 172.21.15.112:0/3892239719 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c0a5cb0 con 0x7f8d840d15d0 2024-09-15T23:58:56.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d8b329640 1 -- 172.21.15.112:0/3892239719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d840d15d0 msgr2=0x7f8d840b7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d8b329640 1 --2- 172.21.15.112:0/3892239719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d840d15d0 0x7f8d840b7c20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8d84074480 tx=0x7f8d7c01c8f0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d8b329640 1 -- 172.21.15.112:0/3892239719 shutdown_connections 2024-09-15T23:58:56.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d8b329640 1 --2- 172.21.15.112:0/3892239719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d840d15d0 0x7f8d840b7c20 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d8b329640 1 --2- 172.21.15.112:0/3892239719 >> v2:172.21.15.169:3300/0 conn(0x7f8d8415e6f0 0x7f8d840cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d8b329640 1 -- 172.21.15.112:0/3892239719 >> 172.21.15.112:0/3892239719 conn(0x7f8d840722a0 msgr2=0x7f8d840726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:56.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d8b329640 1 -- 172.21.15.112:0/3892239719 shutdown_connections 2024-09-15T23:58:56.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.288+0000 7f8d8b329640 1 -- 172.21.15.112:0/3892239719 wait complete. 2024-09-15T23:58:56.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d8b329640 1 Processor -- start 2024-09-15T23:58:56.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d8b329640 1 -- start start 2024-09-15T23:58:56.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d8b329640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d840d15d0 0x7f8d84151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d8b329640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d8415e6f0 0x7f8d84158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d8b329640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d840cb6e0 0x7f8d840cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d8b329640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8d840b8d40 con 0x7f8d8415e6f0 2024-09-15T23:58:56.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d8b329640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8d840b8bc0 con 0x7f8d840cb6e0 2024-09-15T23:58:56.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d8b329640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8d840b8ec0 con 0x7f8d840d15d0 2024-09-15T23:58:56.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d888c4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d8415e6f0 0x7f8d84158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d888c4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d8415e6f0 0x7f8d84158780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43290/0 (socket says 172.21.15.112:43290) 2024-09-15T23:58:56.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d888c4640 1 -- 172.21.15.112:0/3534894107 learned_addr learned my addr 172.21.15.112:0/3534894107 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:56.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d898c6640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d840cb6e0 0x7f8d840cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d890c5640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d840d15d0 0x7f8d84151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d888c4640 1 -- 172.21.15.112:0/3534894107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d840d15d0 msgr2=0x7f8d84151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d888c4640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d840d15d0 0x7f8d84151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d888c4640 1 -- 172.21.15.112:0/3534894107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d840cb6e0 msgr2=0x7f8d840cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d888c4640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d840cb6e0 0x7f8d840cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d888c4640 1 -- 172.21.15.112:0/3534894107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d840b6b00 con 0x7f8d8415e6f0 2024-09-15T23:58:56.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d898c6640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d840cb6e0 0x7f8d840cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:56.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d888c4640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d8415e6f0 0x7f8d84158780 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000c450 tx=0x7f8d8000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:56.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d79ffb640 1 -- 172.21.15.112:0/3534894107 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80007020 con 0x7f8d8415e6f0 2024-09-15T23:58:56.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d79ffb640 1 -- 172.21.15.112:0/3534894107 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d800071c0 con 0x7f8d8415e6f0 2024-09-15T23:58:56.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d8b329640 1 -- 172.21.15.112:0/3534894107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d840b6de0 con 0x7f8d8415e6f0 2024-09-15T23:58:56.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d79ffb640 1 -- 172.21.15.112:0/3534894107 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d800075f0 con 0x7f8d8415e6f0 2024-09-15T23:58:56.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d8b329640 1 -- 172.21.15.112:0/3534894107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8415f450 con 0x7f8d8415e6f0 2024-09-15T23:58:56.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.292+0000 7f8d8b329640 1 -- 172.21.15.112:0/3534894107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d840b6fb0 con 0x7f8d8415e6f0 2024-09-15T23:58:56.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.296+0000 7f8d79ffb640 1 -- 172.21.15.112:0/3534894107 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8d80019020 con 0x7f8d8415e6f0 2024-09-15T23:58:56.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.296+0000 7f8d79ffb640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8d680678c0 0x7f8d68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.296+0000 7f8d79ffb640 1 -- 172.21.15.112:0/3534894107 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f8d800860f0 con 0x7f8d8415e6f0 2024-09-15T23:58:56.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.296+0000 7f8d890c5640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8d680678c0 0x7f8d68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.296+0000 7f8d890c5640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8d680678c0 0x7f8d68069d80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400a8d0 tx=0x7f8d74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:56.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.300+0000 7f8d79ffb640 1 -- 172.21.15.112:0/3534894107 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8d80056ac0 con 0x7f8d8415e6f0 2024-09-15T23:58:56.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.460+0000 7f8d8b329640 1 -- 172.21.15.112:0/3534894107 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d840b7c20 con 0x7f8d8415e6f0 2024-09-15T23:58:56.465 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.464+0000 7f8d79ffb640 1 -- 172.21.15.112:0/3534894107 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+17287 (secure 0 0 0) 0x7f8d800563c0 con 0x7f8d8415e6f0 2024-09-15T23:58:56.465 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:56.466 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":103,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:58:33.602970+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:58:04.747828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-15T23:58:06.072735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.14","mappings":[{"from":4,"to":3}]},{"pgid":"16.2a","mappings":[{"from":2,"to":3}]},{"pgid":"16.39","mappings":[{"from":4,"to":5}]},{"pgid":"16.3c","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/2378546307":"2024-09-16T23:58:27.547962+0000","172.21.15.112:6835/2378546307":"2024-09-16T23:58:27.547962+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:58:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.468+0000 7f8d8b329640 1 -- 172.21.15.112:0/3534894107 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8d680678c0 msgr2=0x7f8d68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.468+0000 7f8d8b329640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8d680678c0 0x7f8d68069d80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400a8d0 tx=0x7f8d74008040 comp rx=0 tx=0).stop 2024-09-15T23:58:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.468+0000 7f8d8b329640 1 -- 172.21.15.112:0/3534894107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d8415e6f0 msgr2=0x7f8d84158780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.468+0000 7f8d8b329640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d8415e6f0 0x7f8d84158780 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000c450 tx=0x7f8d8000c910 comp rx=0 tx=0).stop 2024-09-15T23:58:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.468+0000 7f8d8b329640 1 -- 172.21.15.112:0/3534894107 shutdown_connections 2024-09-15T23:58:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.468+0000 7f8d8b329640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8d680678c0 0x7f8d68069d80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.468+0000 7f8d8b329640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d840cb6e0 0x7f8d840cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.468+0000 7f8d8b329640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d8415e6f0 0x7f8d84158780 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.468+0000 7f8d8b329640 1 --2- 172.21.15.112:0/3534894107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8d840d15d0 0x7f8d84151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.468+0000 7f8d8b329640 1 -- 172.21.15.112:0/3534894107 >> 172.21.15.112:0/3534894107 conn(0x7f8d840722a0 msgr2=0x7f8d840cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:56.468 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.468+0000 7f8d8b329640 1 -- 172.21.15.112:0/3534894107 shutdown_connections 2024-09-15T23:58:56.469 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.468+0000 7f8d8b329640 1 -- 172.21.15.112:0/3534894107 wait complete. 2024-09-15T23:58:56.486 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:58:56.486 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:56.607 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f506dc8c640 1 Processor -- start 2024-09-15T23:58:56.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f506dc8c640 1 -- start start 2024-09-15T23:58:56.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f506dc8c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f50680ce690 0x7f50680cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f506dc8c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f506806c7a0 0x7f50680d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f506dc8c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f506815d180 0x7f5068075030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f506dc8c640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f506815c9c0 con 0x7f506806c7a0 2024-09-15T23:58:56.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f506dc8c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f50680d0850 con 0x7f50680ce690 2024-09-15T23:58:56.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f506dc8c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f50680d0af0 con 0x7f506815d180 2024-09-15T23:58:56.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f5066ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f506806c7a0 0x7f50680d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f5066ffd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f506806c7a0 0x7f50680d0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43300/0 (socket says 172.21.15.112:43300) 2024-09-15T23:58:56.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f5066ffd640 1 -- 172.21.15.112:0/476755133 learned_addr learned my addr 172.21.15.112:0/476755133 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:56.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f50677fe640 1 --2- 172.21.15.112:0/476755133 >> v2:172.21.15.169:3300/0 conn(0x7f50680ce690 0x7f50680cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f5067fff640 1 --2- 172.21.15.112:0/476755133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f506815d180 0x7f5068075030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f5066ffd640 1 -- 172.21.15.112:0/476755133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f506815d180 msgr2=0x7f5068075030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:56.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f5066ffd640 1 --2- 172.21.15.112:0/476755133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f506815d180 0x7f5068075030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f5066ffd640 1 -- 172.21.15.112:0/476755133 >> v2:172.21.15.169:3300/0 conn(0x7f50680ce690 msgr2=0x7f50680cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:56.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f5066ffd640 1 --2- 172.21.15.112:0/476755133 >> v2:172.21.15.169:3300/0 conn(0x7f50680ce690 0x7f50680cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.608+0000 7f5066ffd640 1 -- 172.21.15.112:0/476755133 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50680d0dd0 con 0x7f506806c7a0 2024-09-15T23:58:56.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f5066ffd640 1 --2- 172.21.15.112:0/476755133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506806c7a0 0x7f50680d0310 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f506806df10 tx=0x7f505c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9435d431e3275006 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:56.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f50667fc640 1 -- 172.21.15.112:0/476755133 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c0b1070 con 0x7f506806c7a0 2024-09-15T23:58:56.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f50667fc640 1 -- 172.21.15.112:0/476755133 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f505c0ac630 con 0x7f506806c7a0 2024-09-15T23:58:56.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f50667fc640 1 -- 172.21.15.112:0/476755133 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c0a8050 con 0x7f506806c7a0 2024-09-15T23:58:56.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 -- 172.21.15.112:0/476755133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506806c7a0 msgr2=0x7f50680d0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 --2- 172.21.15.112:0/476755133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506806c7a0 0x7f50680d0310 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f506806df10 tx=0x7f505c01c520 comp rx=0 tx=0).stop 2024-09-15T23:58:56.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 -- 172.21.15.112:0/476755133 shutdown_connections 2024-09-15T23:58:56.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 --2- 172.21.15.112:0/476755133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506806c7a0 0x7f50680d0310 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 --2- 172.21.15.112:0/476755133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f506815d180 0x7f5068075030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 --2- 172.21.15.112:0/476755133 >> v2:172.21.15.169:3300/0 conn(0x7f50680ce690 0x7f50680cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 -- 172.21.15.112:0/476755133 >> 172.21.15.112:0/476755133 conn(0x7f506806bc80 msgr2=0x7f506806c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:56.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 -- 172.21.15.112:0/476755133 shutdown_connections 2024-09-15T23:58:56.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 -- 172.21.15.112:0/476755133 wait complete. 2024-09-15T23:58:56.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 Processor -- start 2024-09-15T23:58:56.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 -- start start 2024-09-15T23:58:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f506806c7a0 0x7f506813dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50680ce690 0x7f506814c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506815d180 0x7f506806f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5068075980 con 0x7f506815d180 2024-09-15T23:58:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f506815ff40 con 0x7f50680ce690 2024-09-15T23:58:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f506dc8c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f50681600c0 con 0x7f506806c7a0 2024-09-15T23:58:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f5067fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506815d180 0x7f506806f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f5067fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506815d180 0x7f506806f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43316/0 (socket says 172.21.15.112:43316) 2024-09-15T23:58:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f5067fff640 1 -- 172.21.15.112:0/2201274279 learned_addr learned my addr 172.21.15.112:0/2201274279 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f5066ffd640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50680ce690 0x7f506814c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.612+0000 7f50677fe640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f506806c7a0 0x7f506813dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f5067fff640 1 -- 172.21.15.112:0/2201274279 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f506806c7a0 msgr2=0x7f506813dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f5067fff640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f506806c7a0 0x7f506813dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f5067fff640 1 -- 172.21.15.112:0/2201274279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50680ce690 msgr2=0x7f506814c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f5067fff640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50680ce690 0x7f506814c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f5067fff640 1 -- 172.21.15.112:0/2201274279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5068151830 con 0x7f506815d180 2024-09-15T23:58:56.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f5066ffd640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50680ce690 0x7f506814c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:56.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f5067fff640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506815d180 0x7f506806f4c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f5060007e90 tx=0x7f506000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:56.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f504ffff640 1 -- 172.21.15.112:0/2201274279 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060014420 con 0x7f506815d180 2024-09-15T23:58:56.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f504ffff640 1 -- 172.21.15.112:0/2201274279 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5060019070 con 0x7f506815d180 2024-09-15T23:58:56.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f506dc8c640 1 -- 172.21.15.112:0/2201274279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5068150f90 con 0x7f506815d180 2024-09-15T23:58:56.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f504ffff640 1 -- 172.21.15.112:0/2201274279 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060014800 con 0x7f506815d180 2024-09-15T23:58:56.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f506dc8c640 1 -- 172.21.15.112:0/2201274279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5068151550 con 0x7f506815d180 2024-09-15T23:58:56.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f506dc8c640 1 -- 172.21.15.112:0/2201274279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50680d0310 con 0x7f506815d180 2024-09-15T23:58:56.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f504ffff640 1 -- 172.21.15.112:0/2201274279 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f50600149a0 con 0x7f506815d180 2024-09-15T23:58:56.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f504ffff640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50540678f0 0x7f5054069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f504ffff640 1 -- 172.21.15.112:0/2201274279 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f50600867c0 con 0x7f506815d180 2024-09-15T23:58:56.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f50677fe640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50540678f0 0x7f5054069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.616+0000 7f50677fe640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50540678f0 0x7f5054069db0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5058009710 tx=0x7f5058008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:56.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.620+0000 7f504ffff640 1 -- 172.21.15.112:0/2201274279 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5060057010 con 0x7f506815d180 2024-09-15T23:58:56.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.812+0000 7f506dc8c640 1 -- 172.21.15.112:0/2201274279 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5068075e00 con 0x7f506815d180 2024-09-15T23:58:56.813 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.812+0000 7f504ffff640 1 -- 172.21.15.112:0/2201274279 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7f5060056910 con 0x7f506815d180 2024-09-15T23:58:56.813 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:56.813 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:56.813 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:56.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.812+0000 7f506dc8c640 1 -- 172.21.15.112:0/2201274279 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50540678f0 msgr2=0x7f5054069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.812+0000 7f506dc8c640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50540678f0 0x7f5054069db0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5058009710 tx=0x7f5058008040 comp rx=0 tx=0).stop 2024-09-15T23:58:56.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.812+0000 7f506dc8c640 1 -- 172.21.15.112:0/2201274279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506815d180 msgr2=0x7f506806f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.812+0000 7f506dc8c640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506815d180 0x7f506806f4c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f5060007e90 tx=0x7f506000e4b0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.812+0000 7f506dc8c640 1 -- 172.21.15.112:0/2201274279 shutdown_connections 2024-09-15T23:58:56.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.812+0000 7f506dc8c640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50540678f0 0x7f5054069db0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.812+0000 7f506dc8c640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f506815d180 0x7f506806f4c0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.812+0000 7f506dc8c640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50680ce690 0x7f506814c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.812+0000 7f506dc8c640 1 --2- 172.21.15.112:0/2201274279 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f506806c7a0 0x7f506813dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.812+0000 7f506dc8c640 1 -- 172.21.15.112:0/2201274279 >> 172.21.15.112:0/2201274279 conn(0x7f506806bc80 msgr2=0x7f506815da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:56.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.812+0000 7f506dc8c640 1 -- 172.21.15.112:0/2201274279 shutdown_connections 2024-09-15T23:58:56.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.812+0000 7f506dc8c640 1 -- 172.21.15.112:0/2201274279 wait complete. 2024-09-15T23:58:56.831 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:56.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.936+0000 7f2733cae640 1 Processor -- start 2024-09-15T23:58:56.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.936+0000 7f2733cae640 1 -- start start 2024-09-15T23:58:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2733cae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f272c0d3350 0x7f272c0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2733cae640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f272c0d1400 0x7f272c0b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2733cae640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f272c0b7740 con 0x7f272c15e6f0 2024-09-15T23:58:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2733cae640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f272c0d1870 con 0x7f272c0d1400 2024-09-15T23:58:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2733cae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f272c0cfdd0 con 0x7f272c0d3350 2024-09-15T23:58:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2731a4a640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f272c15e6f0 0x7f272c0cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56316/0 (socket says 172.21.15.112:56316) 2024-09-15T23:58:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2731a4a640 1 -- 172.21.15.112:0/480354009 learned_addr learned my addr 172.21.15.112:0/480354009 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f273224b640 1 --2- 172.21.15.112:0/480354009 >> v2:172.21.15.169:3300/0 conn(0x7f272c0d1400 0x7f272c0b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2731249640 1 --2- 172.21.15.112:0/480354009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f272c0d3350 0x7f272c0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 -- 172.21.15.112:0/480354009 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128479337 0 0) 0x7f272c0b7740 con 0x7f272c15e6f0 2024-09-15T23:58:56.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 -- 172.21.15.112:0/480354009 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2718003530 con 0x7f272c15e6f0 2024-09-15T23:58:56.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 -- 172.21.15.112:0/480354009 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1852262919 0 0) 0x7f2718003530 con 0x7f272c15e6f0 2024-09-15T23:58:56.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 -- 172.21.15.112:0/480354009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f272c0d3350 msgr2=0x7f272c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:56.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 --2- 172.21.15.112:0/480354009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f272c0d3350 0x7f272c0d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 -- 172.21.15.112:0/480354009 >> v2:172.21.15.169:3300/0 conn(0x7f272c0d1400 msgr2=0x7f272c0b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:56.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 --2- 172.21.15.112:0/480354009 >> v2:172.21.15.169:3300/0 conn(0x7f272c0d1400 0x7f272c0b7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 -- 172.21.15.112:0/480354009 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272c0d3850 con 0x7f272c15e6f0 2024-09-15T23:58:56.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 -- 172.21.15.112:0/480354009 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f271c001680 con 0x7f272c15e6f0 2024-09-15T23:58:56.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 -- 172.21.15.112:0/480354009 >> v1:172.21.15.112:6789/0 conn(0x7f272c15e6f0 legacy=0x7f272c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 --2- 172.21.15.112:0/480354009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27180039c0 0x7f2718003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 --2- 172.21.15.112:0/480354009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2718004810 0x7f2718004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 --2- 172.21.15.112:0/480354009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f272c0d3350 0x7f27180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 -- 172.21.15.112:0/480354009 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f272c0d1870 con 0x7f2718004810 2024-09-15T23:58:56.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 -- 172.21.15.112:0/480354009 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f272c0cfdd0 con 0x7f27180039c0 2024-09-15T23:58:56.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2730a48640 1 -- 172.21.15.112:0/480354009 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f271800ba00 con 0x7f272c0d3350 2024-09-15T23:58:56.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2731249640 1 --2- 172.21.15.112:0/480354009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2718004810 0x7f2718004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f273224b640 1 --2- 172.21.15.112:0/480354009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f272c0d3350 0x7f27180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2731249640 1 -- 172.21.15.112:0/480354009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f272c0d3350 msgr2=0x7f27180051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:56.943 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2731249640 1 --2- 172.21.15.112:0/480354009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f272c0d3350 0x7f27180051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2731249640 1 -- 172.21.15.112:0/480354009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27180039c0 msgr2=0x7f2718003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:56.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2731249640 1 --2- 172.21.15.112:0/480354009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27180039c0 0x7f2718003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.940+0000 7f2731249640 1 -- 172.21.15.112:0/480354009 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2718003530 con 0x7f2718004810 2024-09-15T23:58:56.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2731249640 1 --2- 172.21.15.112:0/480354009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2718004810 0x7f2718004c90 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f2728009fc0 tx=0x7f272801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5acfcda09687327 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:56.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2730a48640 1 -- 172.21.15.112:0/480354009 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27280b2070 con 0x7f2718004810 2024-09-15T23:58:56.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2730a48640 1 -- 172.21.15.112:0/480354009 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27280a5a70 con 0x7f2718004810 2024-09-15T23:58:56.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2730a48640 1 -- 172.21.15.112:0/480354009 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728009c10 con 0x7f2718004810 2024-09-15T23:58:56.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 -- 172.21.15.112:0/480354009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2718004810 msgr2=0x7f2718004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 --2- 172.21.15.112:0/480354009 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2718004810 0x7f2718004c90 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f2728009fc0 tx=0x7f272801cbf0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f273224b640 1 -- 172.21.15.112:0/480354009 reap_dead start 2024-09-15T23:58:56.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 -- 172.21.15.112:0/480354009 shutdown_connections 2024-09-15T23:58:56.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 -- 172.21.15.112:0/480354009 >> 172.21.15.112:0/480354009 conn(0x7f272c0722a0 msgr2=0x7f272c0726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:56.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 -- 172.21.15.112:0/480354009 shutdown_connections 2024-09-15T23:58:56.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 -- 172.21.15.112:0/480354009 wait complete. 2024-09-15T23:58:56.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 Processor -- start 2024-09-15T23:58:56.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 -- start start 2024-09-15T23:58:56.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2718004810 0x7f272c14bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f272c1604c0 0x7f272c15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f272c160940 0x7f272c15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f272c0b8970 con 0x7f272c1604c0 2024-09-15T23:58:56.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f272c15ead0 con 0x7f2718004810 2024-09-15T23:58:56.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f272c0b8af0 con 0x7f272c160940 2024-09-15T23:58:56.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2731249640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f272c1604c0 0x7f272c15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2731249640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f272c1604c0 0x7f272c15b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43336/0 (socket says 172.21.15.112:43336) 2024-09-15T23:58:56.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2731249640 1 -- 172.21.15.112:0/487286048 learned_addr learned my addr 172.21.15.112:0/487286048 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:56.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2731a4a640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2718004810 0x7f272c14bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f273224b640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f272c160940 0x7f272c15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2731249640 1 -- 172.21.15.112:0/487286048 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f272c160940 msgr2=0x7f272c15bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2731249640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f272c160940 0x7f272c15bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2731249640 1 -- 172.21.15.112:0/487286048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2718004810 msgr2=0x7f272c14bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2731249640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2718004810 0x7f272c14bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2731249640 1 -- 172.21.15.112:0/487286048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272c0ce060 con 0x7f272c1604c0 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f273224b640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f272c160940 0x7f272c15bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2731249640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f272c1604c0 0x7f272c15b7a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f27280b0040 tx=0x7f2728009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f27227fc640 1 -- 172.21.15.112:0/487286048 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27280bd070 con 0x7f272c1604c0 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f27227fc640 1 -- 172.21.15.112:0/487286048 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27280039a0 con 0x7f272c1604c0 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 -- 172.21.15.112:0/487286048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f272c15f700 con 0x7f272c1604c0 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f27227fc640 1 -- 172.21.15.112:0/487286048 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27280b2040 con 0x7f272c1604c0 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.944+0000 7f2733cae640 1 -- 172.21.15.112:0/487286048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f272c15fcc0 con 0x7f272c1604c0 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.948+0000 7f2733cae640 1 -- 172.21.15.112:0/487286048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f272c0b8ea0 con 0x7f272c1604c0 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.948+0000 7f27227fc640 1 -- 172.21.15.112:0/487286048 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f27280c0070 con 0x7f272c1604c0 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.948+0000 7f27227fc640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f27100678c0 0x7f2710069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:56.950 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.948+0000 7f27227fc640 1 -- 172.21.15.112:0/487286048 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f272811ff10 con 0x7f272c1604c0 2024-09-15T23:58:56.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.948+0000 7f2731a4a640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f27100678c0 0x7f2710069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:56.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.948+0000 7f2731a4a640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f27100678c0 0x7f2710069d80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f271c000f70 tx=0x7f271c001d20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:56.953 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:56.952+0000 7f27227fc640 1 -- 172.21.15.112:0/487286048 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2728016990 con 0x7f272c1604c0 2024-09-15T23:58:57.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.144+0000 7f2733cae640 1 -- 172.21.15.112:0/487286048 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f272c0b36f0 con 0x7f272c1604c0 2024-09-15T23:58:57.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.144+0000 7f27227fc640 1 -- 172.21.15.112:0/487286048 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5230 (secure 0 0 0) 0x7f27280f0110 con 0x7f272c1604c0 2024-09-15T23:58:57.145 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:57.145 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":64,"btime":"2024-09-15T23:58:31:580904+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:58:07.063973+0000","modified":"2024-09-15T23:58:31.580890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"c","rank":0,"incarnation":60,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6835/960124820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":960124820},{"type":"v1","addr":"172.21.15.112:6835","nonce":960124820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6936,"qdb_cluster":[6936]},"id":7}]} 2024-09-15T23:58:57.145 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 64 2024-09-15T23:58:57.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.148+0000 7f2733cae640 1 -- 172.21.15.112:0/487286048 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f27100678c0 msgr2=0x7f2710069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.148+0000 7f2733cae640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f27100678c0 0x7f2710069d80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f271c000f70 tx=0x7f271c001d20 comp rx=0 tx=0).stop 2024-09-15T23:58:57.147 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.148+0000 7f2733cae640 1 -- 172.21.15.112:0/487286048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f272c1604c0 msgr2=0x7f272c15b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.148+0000 7f2733cae640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f272c1604c0 0x7f272c15b7a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f27280b0040 tx=0x7f2728009750 comp rx=0 tx=0).stop 2024-09-15T23:58:57.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.148+0000 7f2733cae640 1 -- 172.21.15.112:0/487286048 shutdown_connections 2024-09-15T23:58:57.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.148+0000 7f2733cae640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f27100678c0 0x7f2710069d80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.148+0000 7f2733cae640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f272c160940 0x7f272c15bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.148+0000 7f2733cae640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f272c1604c0 0x7f272c15b7a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.148+0000 7f2733cae640 1 --2- 172.21.15.112:0/487286048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2718004810 0x7f272c14bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.148+0000 7f2733cae640 1 -- 172.21.15.112:0/487286048 >> 172.21.15.112:0/487286048 conn(0x7f272c0722a0 msgr2=0x7f272c164080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:57.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.148+0000 7f2733cae640 1 -- 172.21.15.112:0/487286048 shutdown_connections 2024-09-15T23:58:57.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.148+0000 7f2733cae640 1 -- 172.21.15.112:0/487286048 wait complete. 2024-09-15T23:58:57.163 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:58:57.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.284+0000 7f8db3a6d640 1 Processor -- start 2024-09-15T23:58:57.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.284+0000 7f8db3a6d640 1 -- start start 2024-09-15T23:58:57.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.284+0000 7f8db3a6d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8dac0d0420 0x7f8dac0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.284+0000 7f8db3a6d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8dac0b4a60 0x7f8dac0cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.284+0000 7f8db3a6d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dac15c6b0 con 0x7f8dac0b3160 2024-09-15T23:58:57.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.284+0000 7f8db3a6d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f8dac0b5240 con 0x7f8dac0d0420 2024-09-15T23:58:57.286 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.284+0000 7f8db3a6d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f8dac0b4f60 con 0x7f8dac0b4a60 2024-09-15T23:58:57.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.284+0000 7f8db1809640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8dac0d0420 0x7f8dac0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.284+0000 7f8db1809640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f8dac0d0420 0x7f8dac0d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43342/0 (socket says 172.21.15.112:43342) 2024-09-15T23:58:57.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.284+0000 7f8db1809640 1 -- 172.21.15.112:0/2372273737 learned_addr learned my addr 172.21.15.112:0/2372273737 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:57.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.284+0000 7f8db200a640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8dac0b3160 0x7f8dac0b3610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56330/0 (socket says 172.21.15.112:56330) 2024-09-15T23:58:57.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db1008640 1 --2- 172.21.15.112:0/2372273737 >> v2:172.21.15.169:3300/0 conn(0x7f8dac0b4a60 0x7f8dac0cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db1809640 1 -- 172.21.15.112:0/2372273737 >> v2:172.21.15.169:3300/0 conn(0x7f8dac0b4a60 msgr2=0x7f8dac0cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:57.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db1809640 1 --2- 172.21.15.112:0/2372273737 >> v2:172.21.15.169:3300/0 conn(0x7f8dac0b4a60 0x7f8dac0cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db1809640 1 -- 172.21.15.112:0/2372273737 >> v1:172.21.15.112:6789/0 conn(0x7f8dac0b3160 legacy=0x7f8dac0b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db1809640 1 -- 172.21.15.112:0/2372273737 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac06dab0 con 0x7f8dac0d0420 2024-09-15T23:58:57.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db1008640 1 --2- 172.21.15.112:0/2372273737 >> v2:172.21.15.169:3300/0 conn(0x7f8dac0b4a60 0x7f8dac0cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:57.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db1809640 1 --2- 172.21.15.112:0/2372273737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac0d0420 0x7f8dac0d0800 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f8dac15fdd0 tx=0x7f8da801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ccdcf1144743f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:57.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db0807640 1 -- 172.21.15.112:0/2372273737 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da80ab610 con 0x7f8dac0d0420 2024-09-15T23:58:57.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db0807640 1 -- 172.21.15.112:0/2372273737 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da80b0070 con 0x7f8dac0d0420 2024-09-15T23:58:57.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db0807640 1 -- 172.21.15.112:0/2372273737 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da80ab9d0 con 0x7f8dac0d0420 2024-09-15T23:58:57.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db3a6d640 1 -- 172.21.15.112:0/2372273737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac0d0420 msgr2=0x7f8dac0d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db3a6d640 1 --2- 172.21.15.112:0/2372273737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac0d0420 0x7f8dac0d0800 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f8dac15fdd0 tx=0x7f8da801c520 comp rx=0 tx=0).stop 2024-09-15T23:58:57.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db3a6d640 1 -- 172.21.15.112:0/2372273737 shutdown_connections 2024-09-15T23:58:57.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db3a6d640 1 --2- 172.21.15.112:0/2372273737 >> v2:172.21.15.169:3300/0 conn(0x7f8dac0b4a60 0x7f8dac0cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db3a6d640 1 --2- 172.21.15.112:0/2372273737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac0d0420 0x7f8dac0d0800 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db3a6d640 1 -- 172.21.15.112:0/2372273737 >> 172.21.15.112:0/2372273737 conn(0x7f8dac075200 msgr2=0x7f8dac075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:57.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db3a6d640 1 -- 172.21.15.112:0/2372273737 shutdown_connections 2024-09-15T23:58:57.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.288+0000 7f8db3a6d640 1 -- 172.21.15.112:0/2372273737 wait complete. 2024-09-15T23:58:57.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db3a6d640 1 Processor -- start 2024-09-15T23:58:57.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db3a6d640 1 -- start start 2024-09-15T23:58:57.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db3a6d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8dac0b3160 0x7f8dac146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db3a6d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dac0b4a60 0x7f8dac0adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db3a6d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac0d0420 0x7f8dac148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db3a6d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac0ccff0 con 0x7f8dac0d0420 2024-09-15T23:58:57.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db3a6d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac0cce70 con 0x7f8dac0b3160 2024-09-15T23:58:57.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db3a6d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8dac1696d0 con 0x7f8dac0b4a60 2024-09-15T23:58:57.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db200a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac0d0420 0x7f8dac148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db200a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac0d0420 0x7f8dac148350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43346/0 (socket says 172.21.15.112:43346) 2024-09-15T23:58:57.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db200a640 1 -- 172.21.15.112:0/1111456420 learned_addr learned my addr 172.21.15.112:0/1111456420 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:57.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db1008640 1 --2- 172.21.15.112:0/1111456420 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dac0b4a60 0x7f8dac0adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db1809640 1 --2- 172.21.15.112:0/1111456420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8dac0b3160 0x7f8dac146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db200a640 1 -- 172.21.15.112:0/1111456420 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dac0b4a60 msgr2=0x7f8dac0adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db200a640 1 --2- 172.21.15.112:0/1111456420 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dac0b4a60 0x7f8dac0adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db200a640 1 -- 172.21.15.112:0/1111456420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8dac0b3160 msgr2=0x7f8dac146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db200a640 1 --2- 172.21.15.112:0/1111456420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8dac0b3160 0x7f8dac146ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db200a640 1 -- 172.21.15.112:0/1111456420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac15cad0 con 0x7f8dac0d0420 2024-09-15T23:58:57.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db200a640 1 --2- 172.21.15.112:0/1111456420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac0d0420 0x7f8dac148350 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f8da400c740 tx=0x7f8da400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:57.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8da27fc640 1 -- 172.21.15.112:0/1111456420 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4017070 con 0x7f8dac0d0420 2024-09-15T23:58:57.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8da27fc640 1 -- 172.21.15.112:0/1111456420 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da400ce50 con 0x7f8dac0d0420 2024-09-15T23:58:57.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8da27fc640 1 -- 172.21.15.112:0/1111456420 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da400a800 con 0x7f8dac0d0420 2024-09-15T23:58:57.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db3a6d640 1 -- 172.21.15.112:0/1111456420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dac15cdb0 con 0x7f8dac0d0420 2024-09-15T23:58:57.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db3a6d640 1 -- 172.21.15.112:0/1111456420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dac15d370 con 0x7f8dac0d0420 2024-09-15T23:58:57.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8db3a6d640 1 -- 172.21.15.112:0/1111456420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dac0b2d00 con 0x7f8dac0d0420 2024-09-15T23:58:57.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8da27fc640 1 -- 172.21.15.112:0/1111456420 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8da401a070 con 0x7f8dac0d0420 2024-09-15T23:58:57.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.292+0000 7f8da27fc640 1 --2- 172.21.15.112:0/1111456420 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8d900678c0 0x7f8d90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.296+0000 7f8da27fc640 1 -- 172.21.15.112:0/1111456420 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f8da4085520 con 0x7f8dac0d0420 2024-09-15T23:58:57.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.296+0000 7f8db1809640 1 --2- 172.21.15.112:0/1111456420 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8d900678c0 0x7f8d90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.296+0000 7f8db1809640 1 --2- 172.21.15.112:0/1111456420 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8d900678c0 0x7f8d90069d80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8da80af000 tx=0x7f8da80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:57.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.300+0000 7f8da27fc640 1 -- 172.21.15.112:0/1111456420 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8da4055e10 con 0x7f8dac0d0420 2024-09-15T23:58:57.462 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.460+0000 7f8db3a6d640 1 -- 172.21.15.112:0/1111456420 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8dac0cc930 con 0x7f8dac0d0420 2024-09-15T23:58:57.464 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.464+0000 7f8da27fc640 1 -- 172.21.15.112:0/1111456420 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+17287 (secure 0 0 0) 0x7f8da4055710 con 0x7f8dac0d0420 2024-09-15T23:58:57.465 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:58:57.465 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":103,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:58:33.602970+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:58:04.747828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-15T23:58:06.072735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.14","mappings":[{"from":4,"to":3}]},{"pgid":"16.2a","mappings":[{"from":2,"to":3}]},{"pgid":"16.39","mappings":[{"from":4,"to":5}]},{"pgid":"16.3c","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/2378546307":"2024-09-16T23:58:27.547962+0000","172.21.15.112:6835/2378546307":"2024-09-16T23:58:27.547962+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:58:57.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.464+0000 7f8db3a6d640 1 -- 172.21.15.112:0/1111456420 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8d900678c0 msgr2=0x7f8d90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.464+0000 7f8db3a6d640 1 --2- 172.21.15.112:0/1111456420 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8d900678c0 0x7f8d90069d80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8da80af000 tx=0x7f8da80a7000 comp rx=0 tx=0).stop 2024-09-15T23:58:57.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.464+0000 7f8db3a6d640 1 -- 172.21.15.112:0/1111456420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac0d0420 msgr2=0x7f8dac148350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.464+0000 7f8db3a6d640 1 --2- 172.21.15.112:0/1111456420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac0d0420 0x7f8dac148350 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f8da400c740 tx=0x7f8da400cc00 comp rx=0 tx=0).stop 2024-09-15T23:58:57.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.464+0000 7f8db3a6d640 1 -- 172.21.15.112:0/1111456420 shutdown_connections 2024-09-15T23:58:57.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.464+0000 7f8db3a6d640 1 --2- 172.21.15.112:0/1111456420 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8d900678c0 0x7f8d90069d80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.464+0000 7f8db3a6d640 1 --2- 172.21.15.112:0/1111456420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac0d0420 0x7f8dac148350 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.464+0000 7f8db3a6d640 1 --2- 172.21.15.112:0/1111456420 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8dac0b4a60 0x7f8dac0adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.464+0000 7f8db3a6d640 1 --2- 172.21.15.112:0/1111456420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8dac0b3160 0x7f8dac146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.464+0000 7f8db3a6d640 1 -- 172.21.15.112:0/1111456420 >> 172.21.15.112:0/1111456420 conn(0x7f8dac075200 msgr2=0x7f8dac0755e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:57.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.464+0000 7f8db3a6d640 1 -- 172.21.15.112:0/1111456420 shutdown_connections 2024-09-15T23:58:57.467 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.464+0000 7f8db3a6d640 1 -- 172.21.15.112:0/1111456420 wait complete. 2024-09-15T23:58:57.483 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:58:57.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f53100bb640 1 Processor -- start 2024-09-15T23:58:57.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f53100bb640 1 -- start start 2024-09-15T23:58:57.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f53100bb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f53080cf820 0x7f5308166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f53100bb640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530815c6b0 con 0x7f53080d0420 2024-09-15T23:58:57.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f53100bb640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53080b4f60 con 0x7f53080b4a60 2024-09-15T23:58:57.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f53100bb640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f53080b5240 con 0x7f53080cf820 2024-09-15T23:58:57.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f530de57640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f53080d0420 0x7f53080d0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56332/0 (socket says 172.21.15.112:56332) 2024-09-15T23:58:57.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f530de57640 1 -- 172.21.15.112:0/713317880 learned_addr learned my addr 172.21.15.112:0/713317880 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:57.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f530e658640 1 --2- 172.21.15.112:0/713317880 >> v2:172.21.15.112:3300/0 conn(0x7f53080cf820 0x7f5308166eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f530ce55640 1 -- 172.21.15.112:0/713317880 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747914658 0 0) 0x7f530815c6b0 con 0x7f53080d0420 2024-09-15T23:58:57.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f530ce55640 1 -- 172.21.15.112:0/713317880 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52f4003530 con 0x7f53080d0420 2024-09-15T23:58:57.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f530ce55640 1 -- 172.21.15.112:0/713317880 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 542769634 0 0) 0x7f52f4003530 con 0x7f53080d0420 2024-09-15T23:58:57.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f530e658640 1 -- 172.21.15.112:0/713317880 >> v1:172.21.15.169:6789/0 conn(0x7f53080b4a60 legacy=0x7f53080cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f530e658640 1 -- 172.21.15.112:0/713317880 >> v1:172.21.15.112:6789/0 conn(0x7f53080d0420 legacy=0x7f53080d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.600+0000 7f530e658640 1 -- 172.21.15.112:0/713317880 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530806dab0 con 0x7f53080cf820 2024-09-15T23:58:57.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.604+0000 7f530e658640 1 --2- 172.21.15.112:0/713317880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53080cf820 0x7f5308166eb0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f5300009d90 tx=0x7f530001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e4263b15869674 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:57.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.604+0000 7f530ce55640 1 -- 172.21.15.112:0/713317880 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f8001680 con 0x7f53080cf820 2024-09-15T23:58:57.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.604+0000 7f530ce55640 1 -- 172.21.15.112:0/713317880 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53000a64e0 con 0x7f53080cf820 2024-09-15T23:58:57.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.604+0000 7f530ce55640 1 -- 172.21.15.112:0/713317880 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53000a68b0 con 0x7f53080cf820 2024-09-15T23:58:57.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.604+0000 7f53100bb640 1 -- 172.21.15.112:0/713317880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53080cf820 msgr2=0x7f5308166eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.604+0000 7f53100bb640 1 --2- 172.21.15.112:0/713317880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53080cf820 0x7f5308166eb0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f5300009d90 tx=0x7f530001c890 comp rx=0 tx=0).stop 2024-09-15T23:58:57.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.604+0000 7f53100bb640 1 -- 172.21.15.112:0/713317880 shutdown_connections 2024-09-15T23:58:57.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.604+0000 7f53100bb640 1 --2- 172.21.15.112:0/713317880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53080cf820 0x7f5308166eb0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.604+0000 7f53100bb640 1 -- 172.21.15.112:0/713317880 >> 172.21.15.112:0/713317880 conn(0x7f5308075200 msgr2=0x7f5308075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:57.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.604+0000 7f53100bb640 1 -- 172.21.15.112:0/713317880 shutdown_connections 2024-09-15T23:58:57.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.604+0000 7f53100bb640 1 -- 172.21.15.112:0/713317880 wait complete. 2024-09-15T23:58:57.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.604+0000 7f53100bb640 1 Processor -- start 2024-09-15T23:58:57.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.604+0000 7f53100bb640 1 -- start start 2024-09-15T23:58:57.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f53100bb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53080b4a60 0x7f53080cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f53100bb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53080cf820 0x7f53080ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f53100bb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53080d0420 0x7f53080ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f53100bb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5308169fa0 con 0x7f53080d0420 2024-09-15T23:58:57.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f53100bb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5308169e20 con 0x7f53080b4a60 2024-09-15T23:58:57.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f53100bb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f530816a120 con 0x7f53080cf820 2024-09-15T23:58:57.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f530e658640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53080d0420 0x7f53080ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f530e658640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53080d0420 0x7f53080ad4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43358/0 (socket says 172.21.15.112:43358) 2024-09-15T23:58:57.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f530e658640 1 -- 172.21.15.112:0/2123485155 learned_addr learned my addr 172.21.15.112:0/2123485155 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:57.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f530de57640 1 --2- 172.21.15.112:0/2123485155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53080b4a60 0x7f53080cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f530d656640 1 --2- 172.21.15.112:0/2123485155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53080cf820 0x7f53080ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f530e658640 1 -- 172.21.15.112:0/2123485155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53080cf820 msgr2=0x7f53080ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f530e658640 1 --2- 172.21.15.112:0/2123485155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53080cf820 0x7f53080ae060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f530e658640 1 -- 172.21.15.112:0/2123485155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53080b4a60 msgr2=0x7f53080cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f530e658640 1 --2- 172.21.15.112:0/2123485155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53080b4a60 0x7f53080cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f530e658640 1 -- 172.21.15.112:0/2123485155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53080cbed0 con 0x7f53080d0420 2024-09-15T23:58:57.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f530e658640 1 --2- 172.21.15.112:0/2123485155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53080d0420 0x7f53080ad4c0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f53000b0040 tx=0x7f5300019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:57.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f52fe7fc640 1 -- 172.21.15.112:0/2123485155 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53000c2070 con 0x7f53080d0420 2024-09-15T23:58:57.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f52fe7fc640 1 -- 172.21.15.112:0/2123485155 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5300003bc0 con 0x7f53080d0420 2024-09-15T23:58:57.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f53100bb640 1 -- 172.21.15.112:0/2123485155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f530814cbf0 con 0x7f53080d0420 2024-09-15T23:58:57.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f52fe7fc640 1 -- 172.21.15.112:0/2123485155 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300009450 con 0x7f53080d0420 2024-09-15T23:58:57.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f53100bb640 1 -- 172.21.15.112:0/2123485155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f530814d1b0 con 0x7f53080d0420 2024-09-15T23:58:57.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f53100bb640 1 -- 172.21.15.112:0/2123485155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f530815c6b0 con 0x7f53080d0420 2024-09-15T23:58:57.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f52fe7fc640 1 -- 172.21.15.112:0/2123485155 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53000c5070 con 0x7f53080d0420 2024-09-15T23:58:57.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f52fe7fc640 1 --2- 172.21.15.112:0/2123485155 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f52ec0678e0 0x7f52ec069da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f530de57640 1 --2- 172.21.15.112:0/2123485155 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f52ec0678e0 0x7f52ec069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f52fe7fc640 1 -- 172.21.15.112:0/2123485155 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6303+0+0 (secure 0 0 0) 0x7f5300120470 con 0x7f53080d0420 2024-09-15T23:58:57.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.608+0000 7f530de57640 1 --2- 172.21.15.112:0/2123485155 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f52ec0678e0 0x7f52ec069da0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f52f8005890 tx=0x7f52f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:57.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.612+0000 7f52fe7fc640 1 -- 172.21.15.112:0/2123485155 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5300016480 con 0x7f53080d0420 2024-09-15T23:58:57.800 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.800+0000 7f53100bb640 1 -- 172.21.15.112:0/2123485155 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f53080b2800 con 0x7f53080d0420 2024-09-15T23:58:57.801 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-15T23:58:57.800+0000 7fae14e39640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:58:57.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.804+0000 7f52fe7fc640 1 -- 172.21.15.112:0/2123485155 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v65) ==== 161+0+0 (secure 0 0 0) 0x7f53000f0df0 con 0x7f53080d0420 2024-09-15T23:58:57.804 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:58:57.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.804+0000 7f53100bb640 1 -- 172.21.15.112:0/2123485155 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f52ec0678e0 msgr2=0x7f52ec069da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.804+0000 7f53100bb640 1 --2- 172.21.15.112:0/2123485155 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f52ec0678e0 0x7f52ec069da0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f52f8005890 tx=0x7f52f8009040 comp rx=0 tx=0).stop 2024-09-15T23:58:57.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.804+0000 7f53100bb640 1 -- 172.21.15.112:0/2123485155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53080d0420 msgr2=0x7f53080ad4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.804+0000 7f53100bb640 1 --2- 172.21.15.112:0/2123485155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53080d0420 0x7f53080ad4c0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f53000b0040 tx=0x7f5300019630 comp rx=0 tx=0).stop 2024-09-15T23:58:57.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.808+0000 7f53100bb640 1 -- 172.21.15.112:0/2123485155 shutdown_connections 2024-09-15T23:58:57.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.808+0000 7f53100bb640 1 --2- 172.21.15.112:0/2123485155 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f52ec0678e0 0x7f52ec069da0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.808+0000 7f53100bb640 1 --2- 172.21.15.112:0/2123485155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53080d0420 0x7f53080ad4c0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.808+0000 7f53100bb640 1 --2- 172.21.15.112:0/2123485155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53080cf820 0x7f53080ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.808+0000 7f53100bb640 1 --2- 172.21.15.112:0/2123485155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53080b4a60 0x7f53080cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.808+0000 7f53100bb640 1 -- 172.21.15.112:0/2123485155 >> 172.21.15.112:0/2123485155 conn(0x7f5308075200 msgr2=0x7f5308159980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:57.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.808+0000 7f53100bb640 1 -- 172.21.15.112:0/2123485155 shutdown_connections 2024-09-15T23:58:57.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.808+0000 7f53100bb640 1 -- 172.21.15.112:0/2123485155 wait complete. 2024-09-15T23:58:57.825 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:58:57.847 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-15T23:58:57.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e42e8640 1 Processor -- start 2024-09-15T23:58:57.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e42e8640 1 -- start start 2024-09-15T23:58:57.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e42e8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f38dc15c150 0x7f38dc0ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e42e8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38dc0d0ab0 0x7f38dc0b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e42e8640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38dc0b38d0 con 0x7f38dc0cc950 2024-09-15T23:58:57.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e42e8640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f38dc0b36a0 con 0x7f38dc15c150 2024-09-15T23:58:57.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e42e8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f38dc0ad270 con 0x7f38dc0d0ab0 2024-09-15T23:58:57.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e2084640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f38dc15c150 0x7f38dc0ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e2084640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f38dc15c150 0x7f38dc0ce2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43386/0 (socket says 172.21.15.112:43386) 2024-09-15T23:58:57.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e2084640 1 -- 172.21.15.112:0/939848395 learned_addr learned my addr 172.21.15.112:0/939848395 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:57.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e1883640 1 --1- 172.21.15.112:0/939848395 >> v1:172.21.15.112:6789/0 conn(0x7f38dc0cc950 0x7f38dc0d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:56344/0 (socket says 172.21.15.112:56344) 2024-09-15T23:58:57.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e2885640 1 --2- 172.21.15.112:0/939848395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38dc0d0ab0 0x7f38dc0b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e2084640 1 -- 172.21.15.112:0/939848395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38dc0d0ab0 msgr2=0x7f38dc0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:57.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e2084640 1 --2- 172.21.15.112:0/939848395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38dc0d0ab0 0x7f38dc0b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e2084640 1 -- 172.21.15.112:0/939848395 >> v1:172.21.15.112:6789/0 conn(0x7f38dc0cc950 legacy=0x7f38dc0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.936+0000 7f38e2084640 1 -- 172.21.15.112:0/939848395 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38dc0b3bb0 con 0x7f38dc15c150 2024-09-15T23:58:57.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.940+0000 7f38e2084640 1 --2- 172.21.15.112:0/939848395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38dc15c150 0x7f38dc0ce2b0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009870 tx=0x7f38d801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33749eed8d4153b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.940+0000 7f38e1082640 1 -- 172.21.15.112:0/939848395 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d80b1070 con 0x7f38dc15c150 2024-09-15T23:58:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.940+0000 7f38e1082640 1 -- 172.21.15.112:0/939848395 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d80a8050 con 0x7f38dc15c150 2024-09-15T23:58:57.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.940+0000 7f38e1082640 1 -- 172.21.15.112:0/939848395 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d80ac860 con 0x7f38dc15c150 2024-09-15T23:58:57.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.940+0000 7f38e42e8640 1 -- 172.21.15.112:0/939848395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38dc15c150 msgr2=0x7f38dc0ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.940+0000 7f38e42e8640 1 --2- 172.21.15.112:0/939848395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38dc15c150 0x7f38dc0ce2b0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009870 tx=0x7f38d801c560 comp rx=0 tx=0).stop 2024-09-15T23:58:57.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.940+0000 7f38e42e8640 1 -- 172.21.15.112:0/939848395 shutdown_connections 2024-09-15T23:58:57.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.940+0000 7f38e42e8640 1 --2- 172.21.15.112:0/939848395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38dc0d0ab0 0x7f38dc0b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.940+0000 7f38e42e8640 1 --2- 172.21.15.112:0/939848395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38dc15c150 0x7f38dc0ce2b0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.940+0000 7f38e42e8640 1 -- 172.21.15.112:0/939848395 >> 172.21.15.112:0/939848395 conn(0x7f38dc075200 msgr2=0x7f38dc075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:57.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.940+0000 7f38e42e8640 1 -- 172.21.15.112:0/939848395 shutdown_connections 2024-09-15T23:58:57.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.940+0000 7f38e42e8640 1 -- 172.21.15.112:0/939848395 wait complete. 2024-09-15T23:58:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.940+0000 7f38e42e8640 1 Processor -- start 2024-09-15T23:58:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.940+0000 7f38e42e8640 1 -- start start 2024-09-15T23:58:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e42e8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38dc0cc950 0x7f38dc09aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e42e8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38dc0d0ab0 0x7f38dc09d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e42e8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38dc15c150 0x7f38dc152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e42e8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f38dc0ae090 con 0x7f38dc0d0ab0 2024-09-15T23:58:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e42e8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f38dc0adf10 con 0x7f38dc15c150 2024-09-15T23:58:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e42e8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f38dc0ae210 con 0x7f38dc0cc950 2024-09-15T23:58:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e1883640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38dc0d0ab0 0x7f38dc09d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e1883640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38dc0d0ab0 0x7f38dc09d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43388/0 (socket says 172.21.15.112:43388) 2024-09-15T23:58:57.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e1883640 1 -- 172.21.15.112:0/3832888792 learned_addr learned my addr 172.21.15.112:0/3832888792 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:57.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e2885640 1 --2- 172.21.15.112:0/3832888792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38dc15c150 0x7f38dc152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e2084640 1 --2- 172.21.15.112:0/3832888792 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38dc0cc950 0x7f38dc09aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e1883640 1 -- 172.21.15.112:0/3832888792 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38dc0cc950 msgr2=0x7f38dc09aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e1883640 1 --2- 172.21.15.112:0/3832888792 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38dc0cc950 0x7f38dc09aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e1883640 1 -- 172.21.15.112:0/3832888792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38dc15c150 msgr2=0x7f38dc152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:57.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e1883640 1 --2- 172.21.15.112:0/3832888792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38dc15c150 0x7f38dc152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:57.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e1883640 1 -- 172.21.15.112:0/3832888792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38dc09b000 con 0x7f38dc0d0ab0 2024-09-15T23:58:57.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e1883640 1 --2- 172.21.15.112:0/3832888792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38dc0d0ab0 0x7f38dc09d8e0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00c4c0 tx=0x7f38cc00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:57.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38d2ffd640 1 -- 172.21.15.112:0/3832888792 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc018070 con 0x7f38dc0d0ab0 2024-09-15T23:58:57.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38d2ffd640 1 -- 172.21.15.112:0/3832888792 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38cc007480 con 0x7f38dc0d0ab0 2024-09-15T23:58:57.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e42e8640 1 -- 172.21.15.112:0/3832888792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38dc09b2e0 con 0x7f38dc0d0ab0 2024-09-15T23:58:57.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38d2ffd640 1 -- 172.21.15.112:0/3832888792 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0047f0 con 0x7f38dc0d0ab0 2024-09-15T23:58:57.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e42e8640 1 -- 172.21.15.112:0/3832888792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38dc09de20 con 0x7f38dc0d0ab0 2024-09-15T23:58:57.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e42e8640 1 -- 172.21.15.112:0/3832888792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38dc0721f0 con 0x7f38dc0d0ab0 2024-09-15T23:58:57.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38d2ffd640 1 -- 172.21.15.112:0/3832888792 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f38cc01b070 con 0x7f38dc0d0ab0 2024-09-15T23:58:57.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38d2ffd640 1 --2- 172.21.15.112:0/3832888792 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38c00678c0 0x7f38c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:57.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38d2ffd640 1 -- 172.21.15.112:0/3832888792 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6389+0+0 (secure 0 0 0) 0x7f38cc0854e0 con 0x7f38dc0d0ab0 2024-09-15T23:58:57.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e2084640 1 --2- 172.21.15.112:0/3832888792 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38c00678c0 0x7f38c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:57.948 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.944+0000 7f38e2084640 1 --2- 172.21.15.112:0/3832888792 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38c00678c0 0x7f38c0069d80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f38d80ae000 tx=0x7f38d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:57.949 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:57.948+0000 7f38d2ffd640 1 -- 172.21.15.112:0/3832888792 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f38cc055e60 con 0x7f38dc0d0ab0 2024-09-15T23:58:58.130 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:58.128+0000 7f38e42e8640 1 -- 172.21.15.112:0/3832888792 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f38dc160b90 con 0x7f38dc0d0ab0 2024-09-15T23:58:58.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:58.804+0000 7f38d2ffd640 1 -- 172.21.15.112:0/3832888792 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v66) ==== 104+0+0 (secure 0 0 0) 0x7f38cc055760 con 0x7f38dc0d0ab0 2024-09-15T23:58:58.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:58.808+0000 7f38e42e8640 1 -- 172.21.15.112:0/3832888792 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38c00678c0 msgr2=0x7f38c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:58.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:58.808+0000 7f38e42e8640 1 --2- 172.21.15.112:0/3832888792 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38c00678c0 0x7f38c0069d80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f38d80ae000 tx=0x7f38d8008040 comp rx=0 tx=0).stop 2024-09-15T23:58:58.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:58.808+0000 7f38e42e8640 1 -- 172.21.15.112:0/3832888792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38dc0d0ab0 msgr2=0x7f38dc09d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:58.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:58.808+0000 7f38e42e8640 1 --2- 172.21.15.112:0/3832888792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38dc0d0ab0 0x7f38dc09d8e0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00c4c0 tx=0x7f38cc00c980 comp rx=0 tx=0).stop 2024-09-15T23:58:58.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:58.808+0000 7f38e42e8640 1 -- 172.21.15.112:0/3832888792 shutdown_connections 2024-09-15T23:58:58.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:58.808+0000 7f38e42e8640 1 --2- 172.21.15.112:0/3832888792 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38c00678c0 0x7f38c0069d80 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:58.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:58.808+0000 7f38e42e8640 1 --2- 172.21.15.112:0/3832888792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38dc15c150 0x7f38dc152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:58.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:58.808+0000 7f38e42e8640 1 --2- 172.21.15.112:0/3832888792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38dc0d0ab0 0x7f38dc09d8e0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:58.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:58.808+0000 7f38e42e8640 1 --2- 172.21.15.112:0/3832888792 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38dc0cc950 0x7f38dc09aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:58.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:58.808+0000 7f38e42e8640 1 -- 172.21.15.112:0/3832888792 >> 172.21.15.112:0/3832888792 conn(0x7f38dc075200 msgr2=0x7f38dc0b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:58.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:58.808+0000 7f38e42e8640 1 -- 172.21.15.112:0/3832888792 shutdown_connections 2024-09-15T23:58:58.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:58.808+0000 7f38e42e8640 1 -- 172.21.15.112:0/3832888792 wait complete. 2024-09-15T23:58:58.829 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:58:59.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa12f89c640 1 Processor -- start 2024-09-15T23:58:59.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa12f89c640 1 -- start start 2024-09-15T23:58:59.003 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa12f89c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1280d0430 0x7fa12806dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa12f89c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa12815fec0 0x7fa1280cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa12f89c640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa12806eda0 con 0x7fa12815c510 2024-09-15T23:58:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa12f89c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa1280cb6b0 con 0x7fa12815fec0 2024-09-15T23:58:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa12f89c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa12806e2d0 con 0x7fa1280d0430 2024-09-15T23:58:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa12ce37640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fa12815c510 0x7fa1280d0810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44910/0 (socket says 172.21.15.112:44910) 2024-09-15T23:58:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa12ce37640 1 -- 172.21.15.112:0/3936787972 learned_addr learned my addr 172.21.15.112:0/3936787972 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa12de39640 1 --2- 172.21.15.112:0/3936787972 >> v2:172.21.15.169:3300/0 conn(0x7fa12815fec0 0x7fa1280cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa12d638640 1 --2- 172.21.15.112:0/3936787972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1280d0430 0x7fa12806dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 -- 172.21.15.112:0/3936787972 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 211060010 0 0) 0x7fa12806eda0 con 0x7fa12815c510 2024-09-15T23:58:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 -- 172.21.15.112:0/3936787972 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa114003530 con 0x7fa12815c510 2024-09-15T23:58:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 -- 172.21.15.112:0/3936787972 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 276859033 0 0) 0x7fa114003530 con 0x7fa12815c510 2024-09-15T23:58:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 -- 172.21.15.112:0/3936787972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1280d0430 msgr2=0x7fa12806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:59.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 --2- 172.21.15.112:0/3936787972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1280d0430 0x7fa12806dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 -- 172.21.15.112:0/3936787972 >> v2:172.21.15.169:3300/0 conn(0x7fa12815fec0 msgr2=0x7fa1280cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 --2- 172.21.15.112:0/3936787972 >> v2:172.21.15.169:3300/0 conn(0x7fa12815fec0 0x7fa1280cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 -- 172.21.15.112:0/3936787972 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12806e500 con 0x7fa12815c510 2024-09-15T23:58:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 -- 172.21.15.112:0/3936787972 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fa11c001680 con 0x7fa12815c510 2024-09-15T23:58:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 -- 172.21.15.112:0/3936787972 >> v1:172.21.15.112:6789/0 conn(0x7fa12815c510 legacy=0x7fa1280d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 --2- 172.21.15.112:0/3936787972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1140039f0 0x7fa114003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 --2- 172.21.15.112:0/3936787972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa114004810 0x7fa114004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 --2- 172.21.15.112:0/3936787972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1280d0430 0x7fa1140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 -- 172.21.15.112:0/3936787972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa11400b9d0 con 0x7fa114004810 2024-09-15T23:58:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 -- 172.21.15.112:0/3936787972 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa11400bb50 con 0x7fa1140039f0 2024-09-15T23:58:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa11bfff640 1 -- 172.21.15.112:0/3936787972 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa11400bd00 con 0x7fa1280d0430 2024-09-15T23:58:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa12ce37640 1 --2- 172.21.15.112:0/3936787972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa114004810 0x7fa114004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa12d638640 1 --2- 172.21.15.112:0/3936787972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1140039f0 0x7fa114003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.000+0000 7fa12ce37640 1 -- 172.21.15.112:0/3936787972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1280d0430 msgr2=0x7fa1140051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:59.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa12de39640 1 --2- 172.21.15.112:0/3936787972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1280d0430 0x7fa1140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa12ce37640 1 --2- 172.21.15.112:0/3936787972 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1280d0430 0x7fa1140051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa12ce37640 1 -- 172.21.15.112:0/3936787972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1140039f0 msgr2=0x7fa114003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:59.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa12ce37640 1 --2- 172.21.15.112:0/3936787972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1140039f0 0x7fa114003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa12ce37640 1 -- 172.21.15.112:0/3936787972 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa114003530 con 0x7fa114004810 2024-09-15T23:58:59.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa12d638640 1 --2- 172.21.15.112:0/3936787972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1140039f0 0x7fa114003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:58:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa12ce37640 1 --2- 172.21.15.112:0/3936787972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa114004810 0x7fa114004c90 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa12815c910 tx=0x7fa11c01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec18d496f40db8a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa11bfff640 1 -- 172.21.15.112:0/3936787972 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c007d40 con 0x7fa114004810 2024-09-15T23:58:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa11bfff640 1 -- 172.21.15.112:0/3936787972 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa11c0ac070 con 0x7fa114004810 2024-09-15T23:58:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa11bfff640 1 -- 172.21.15.112:0/3936787972 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c005b20 con 0x7fa114004810 2024-09-15T23:58:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa12f89c640 1 -- 172.21.15.112:0/3936787972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa114004810 msgr2=0x7fa114004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa12f89c640 1 --2- 172.21.15.112:0/3936787972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa114004810 0x7fa114004c90 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa12815c910 tx=0x7fa11c01f3d0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa12de39640 1 -- 172.21.15.112:0/3936787972 reap_dead start 2024-09-15T23:58:59.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa12f89c640 1 -- 172.21.15.112:0/3936787972 shutdown_connections 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa12f89c640 1 -- 172.21.15.112:0/3936787972 >> 172.21.15.112:0/3936787972 conn(0x7fa128075200 msgr2=0x7fa128075610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa12f89c640 1 -- 172.21.15.112:0/3936787972 shutdown_connections 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.004+0000 7fa12f89c640 1 -- 172.21.15.112:0/3936787972 wait complete. 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12f89c640 1 Processor -- start 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12f89c640 1 -- start start 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12f89c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa114004810 0x7fa128154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12f89c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1281f6200 0x7fa1281f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12f89c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1280718e0 0x7fa1281f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12f89c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa1280cb8e0 con 0x7fa1280718e0 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12f89c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa12806eac0 con 0x7fa114004810 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12f89c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa12806dd90 con 0x7fa1281f6200 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12de39640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1280718e0 0x7fa1281f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12de39640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1280718e0 0x7fa1281f5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54652/0 (socket says 172.21.15.112:54652) 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12de39640 1 -- 172.21.15.112:0/3714664571 learned_addr learned my addr 172.21.15.112:0/3714664571 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:59.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12d638640 1 --2- 172.21.15.112:0/3714664571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa114004810 0x7fa128154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12ce37640 1 --2- 172.21.15.112:0/3714664571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1281f6200 0x7fa1281f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12de39640 1 -- 172.21.15.112:0/3714664571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1281f6200 msgr2=0x7fa1281f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12de39640 1 --2- 172.21.15.112:0/3714664571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1281f6200 0x7fa1281f2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12de39640 1 -- 172.21.15.112:0/3714664571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa114004810 msgr2=0x7fa128154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12de39640 1 --2- 172.21.15.112:0/3714664571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa114004810 0x7fa128154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12de39640 1 -- 172.21.15.112:0/3714664571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1280721e0 con 0x7fa1280718e0 2024-09-15T23:58:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12de39640 1 --2- 172.21.15.112:0/3714664571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1280718e0 0x7fa1281f5620 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fa128160370 tx=0x7fa12000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa119ffb640 1 -- 172.21.15.112:0/3714664571 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa120016420 con 0x7fa1280718e0 2024-09-15T23:58:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa119ffb640 1 -- 172.21.15.112:0/3714664571 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa12001b070 con 0x7fa1280718e0 2024-09-15T23:58:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12f89c640 1 -- 172.21.15.112:0/3714664571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa12815ca20 con 0x7fa1280718e0 2024-09-15T23:58:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa119ffb640 1 -- 172.21.15.112:0/3714664571 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa120016820 con 0x7fa1280718e0 2024-09-15T23:58:59.011 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12f89c640 1 -- 172.21.15.112:0/3714664571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa128071d70 con 0x7fa1280718e0 2024-09-15T23:58:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa12f89c640 1 -- 172.21.15.112:0/3714664571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa12806e150 con 0x7fa1280718e0 2024-09-15T23:58:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa119ffb640 1 -- 172.21.15.112:0/3714664571 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1200169c0 con 0x7fa1280718e0 2024-09-15T23:58:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.008+0000 7fa119ffb640 1 --2- 172.21.15.112:0/3714664571 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa10c0678f0 0x7fa10c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.012+0000 7fa12d638640 1 --2- 172.21.15.112:0/3714664571 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa10c0678f0 0x7fa10c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.012+0000 7fa119ffb640 1 -- 172.21.15.112:0/3714664571 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6389+0+0 (secure 0 0 0) 0x7fa120086c00 con 0x7fa1280718e0 2024-09-15T23:58:59.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.012+0000 7fa12d638640 1 --2- 172.21.15.112:0/3714664571 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa10c0678f0 0x7fa10c069db0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa12400e7d0 tx=0x7fa124008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:59.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.016+0000 7fa119ffb640 1 -- 172.21.15.112:0/3714664571 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa12008d080 con 0x7fa1280718e0 2024-09-15T23:58:59.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.168+0000 7fa12f89c640 1 -- 172.21.15.112:0/3714664571 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa12815fc30 con 0x7fa1280718e0 2024-09-15T23:58:59.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.812+0000 7fa119ffb640 1 -- 172.21.15.112:0/3714664571 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) ==== 181+0+0 (secure 0 0 0) 0x7fa120025020 con 0x7fa1280718e0 2024-09-15T23:58:59.814 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:58:59.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.816+0000 7fa12f89c640 1 -- 172.21.15.112:0/3714664571 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa10c0678f0 msgr2=0x7fa10c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:59.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.816+0000 7fa12f89c640 1 --2- 172.21.15.112:0/3714664571 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa10c0678f0 0x7fa10c069db0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa12400e7d0 tx=0x7fa124008040 comp rx=0 tx=0).stop 2024-09-15T23:58:59.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.816+0000 7fa12f89c640 1 -- 172.21.15.112:0/3714664571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1280718e0 msgr2=0x7fa1281f5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:59.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.816+0000 7fa12f89c640 1 --2- 172.21.15.112:0/3714664571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1280718e0 0x7fa1281f5620 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fa128160370 tx=0x7fa12000f520 comp rx=0 tx=0).stop 2024-09-15T23:58:59.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.816+0000 7fa12f89c640 1 -- 172.21.15.112:0/3714664571 shutdown_connections 2024-09-15T23:58:59.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.816+0000 7fa12f89c640 1 --2- 172.21.15.112:0/3714664571 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fa10c0678f0 0x7fa10c069db0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.816+0000 7fa12f89c640 1 --2- 172.21.15.112:0/3714664571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1280718e0 0x7fa1281f5620 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.816+0000 7fa12f89c640 1 --2- 172.21.15.112:0/3714664571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1281f6200 0x7fa1281f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.816+0000 7fa12f89c640 1 --2- 172.21.15.112:0/3714664571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa114004810 0x7fa128154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.816+0000 7fa12f89c640 1 -- 172.21.15.112:0/3714664571 >> 172.21.15.112:0/3714664571 conn(0x7fa128075200 msgr2=0x7fa1280b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:59.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.816+0000 7fa12f89c640 1 -- 172.21.15.112:0/3714664571 shutdown_connections 2024-09-15T23:58:59.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.816+0000 7fa12f89c640 1 -- 172.21.15.112:0/3714664571 wait complete. 2024-09-15T23:58:59.838 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:58:59.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f2370a2d640 1 Processor -- start 2024-09-15T23:58:59.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f2370a2d640 1 -- start start 2024-09-15T23:58:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f2370a2d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f236c0b4b20 0x7f236c072490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f2370a2d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f236c0b5020 con 0x7f236c072020 2024-09-15T23:58:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f2370a2d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f236c0b5300 con 0x7f236c158d20 2024-09-15T23:58:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f2370a2d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f236c159100 con 0x7f236c0b4b20 2024-09-15T23:58:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f2369d9b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f236c072020 0x7f236c0b4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44920/0 (socket says 172.21.15.112:44920) 2024-09-15T23:58:59.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f2369d9b640 1 -- 172.21.15.112:0/472921383 learned_addr learned my addr 172.21.15.112:0/472921383 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:58:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236ad9d640 1 --2- 172.21.15.112:0/472921383 >> v2:172.21.15.169:3300/0 conn(0x7f236c0b4b20 0x7f236c072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 -- 172.21.15.112:0/472921383 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913411496 0 0) 0x7f236c0b5020 con 0x7f236c072020 2024-09-15T23:58:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 -- 172.21.15.112:0/472921383 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2354003530 con 0x7f236c072020 2024-09-15T23:58:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 -- 172.21.15.112:0/472921383 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 251601423 0 0) 0x7f2354003530 con 0x7f236c072020 2024-09-15T23:58:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 -- 172.21.15.112:0/472921383 >> v2:172.21.15.169:3300/0 conn(0x7f236c0b4b20 msgr2=0x7f236c072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:59.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 --2- 172.21.15.112:0/472921383 >> v2:172.21.15.169:3300/0 conn(0x7f236c0b4b20 0x7f236c072490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 -- 172.21.15.112:0/472921383 >> v1:172.21.15.169:6789/0 conn(0x7f236c158d20 legacy=0x7f236c0700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:59.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 -- 172.21.15.112:0/472921383 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c06f8e0 con 0x7f236c072020 2024-09-15T23:58:59.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 -- 172.21.15.112:0/472921383 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f2360001680 con 0x7f236c072020 2024-09-15T23:58:59.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 -- 172.21.15.112:0/472921383 >> v1:172.21.15.112:6789/0 conn(0x7f236c072020 legacy=0x7f236c0b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:59.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 --2- 172.21.15.112:0/472921383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23540039c0 0x7f2354003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 --2- 172.21.15.112:0/472921383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2354004810 0x7f2354004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 --2- 172.21.15.112:0/472921383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23540051d0 0x7f235400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 -- 172.21.15.112:0/472921383 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f236c159100 con 0x7f23540051d0 2024-09-15T23:58:59.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 -- 172.21.15.112:0/472921383 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f235400c170 con 0x7f23540039c0 2024-09-15T23:58:59.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236959a640 1 -- 172.21.15.112:0/472921383 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f235400c370 con 0x7f2354004810 2024-09-15T23:58:59.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236ad9d640 1 --2- 172.21.15.112:0/472921383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23540051d0 0x7f235400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f2369d9b640 1 --2- 172.21.15.112:0/472921383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2354004810 0x7f2354004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236ad9d640 1 -- 172.21.15.112:0/472921383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2354004810 msgr2=0x7f2354004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:59.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236ad9d640 1 --2- 172.21.15.112:0/472921383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2354004810 0x7f2354004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236ad9d640 1 -- 172.21.15.112:0/472921383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23540039c0 msgr2=0x7f2354003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:58:59.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236ad9d640 1 --2- 172.21.15.112:0/472921383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23540039c0 0x7f2354003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.968+0000 7f236ad9d640 1 -- 172.21.15.112:0/472921383 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2354003530 con 0x7f23540051d0 2024-09-15T23:58:59.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.972+0000 7f236ad9d640 1 -- 172.21.15.112:0/472921383 reap_dead start 2024-09-15T23:58:59.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.972+0000 7f236ad9d640 1 --2- 172.21.15.112:0/472921383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23540051d0 0x7f235400b9d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2364009f90 tx=0x7f236401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43a7bc7464413f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:59.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.972+0000 7f236959a640 1 -- 172.21.15.112:0/472921383 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23640b2070 con 0x7f23540051d0 2024-09-15T23:58:59.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.972+0000 7f236959a640 1 -- 172.21.15.112:0/472921383 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23640a5c90 con 0x7f23540051d0 2024-09-15T23:58:59.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.972+0000 7f236959a640 1 -- 172.21.15.112:0/472921383 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364009c10 con 0x7f23540051d0 2024-09-15T23:58:59.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.972+0000 7f2370a2d640 1 -- 172.21.15.112:0/472921383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23540051d0 msgr2=0x7f235400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:59.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.972+0000 7f2370a2d640 1 --2- 172.21.15.112:0/472921383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23540051d0 0x7f235400b9d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2364009f90 tx=0x7f236401cc80 comp rx=0 tx=0).stop 2024-09-15T23:58:59.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.972+0000 7f2370a2d640 1 -- 172.21.15.112:0/472921383 shutdown_connections 2024-09-15T23:58:59.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.972+0000 7f2370a2d640 1 --2- 172.21.15.112:0/472921383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23540051d0 0x7f235400b9d0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.972+0000 7f2370a2d640 1 -- 172.21.15.112:0/472921383 >> 172.21.15.112:0/472921383 conn(0x7f236c06be50 msgr2=0x7f236c06c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:59.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.972+0000 7f2370a2d640 1 -- 172.21.15.112:0/472921383 shutdown_connections 2024-09-15T23:58:59.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.972+0000 7f2370a2d640 1 -- 172.21.15.112:0/472921383 wait complete. 2024-09-15T23:58:59.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.972+0000 7f2370a2d640 1 Processor -- start 2024-09-15T23:58:59.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.972+0000 7f2370a2d640 1 -- start start 2024-09-15T23:58:59.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f2370a2d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23540051d0 0x7f236c157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f2370a2d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f236c13fc20 0x7f236c156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f2370a2d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f236c1566d0 0x7f236c1e7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f2370a2d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f236c06f690 con 0x7f23540051d0 2024-09-15T23:58:59.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f2370a2d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f236c0729d0 con 0x7f236c13fc20 2024-09-15T23:58:59.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f2370a2d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f236c072490 con 0x7f236c1566d0 2024-09-15T23:58:59.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f236a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23540051d0 0x7f236c157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f236a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23540051d0 0x7f236c157cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54662/0 (socket says 172.21.15.112:54662) 2024-09-15T23:58:59.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f236a59c640 1 -- 172.21.15.112:0/2569698473 learned_addr learned my addr 172.21.15.112:0/2569698473 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:58:59.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f236ad9d640 1 --2- 172.21.15.112:0/2569698473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f236c1566d0 0x7f236c1e7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f2369d9b640 1 --2- 172.21.15.112:0/2569698473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f236c13fc20 0x7f236c156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f236a59c640 1 -- 172.21.15.112:0/2569698473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f236c1566d0 msgr2=0x7f236c1e7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:59.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f236a59c640 1 --2- 172.21.15.112:0/2569698473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f236c1566d0 0x7f236c1e7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f236a59c640 1 -- 172.21.15.112:0/2569698473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f236c13fc20 msgr2=0x7f236c156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:59.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f236a59c640 1 --2- 172.21.15.112:0/2569698473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f236c13fc20 0x7f236c156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:59.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f236a59c640 1 -- 172.21.15.112:0/2569698473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c156c50 con 0x7f23540051d0 2024-09-15T23:58:59.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f236a59c640 1 --2- 172.21.15.112:0/2569698473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23540051d0 0x7f236c157cf0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f235c00c480 tx=0x7f235c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:59.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f235affd640 1 -- 172.21.15.112:0/2569698473 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c0052d0 con 0x7f23540051d0 2024-09-15T23:58:59.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f235affd640 1 -- 172.21.15.112:0/2569698473 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f235c005470 con 0x7f23540051d0 2024-09-15T23:58:59.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f2370a2d640 1 -- 172.21.15.112:0/2569698473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236c156f30 con 0x7f23540051d0 2024-09-15T23:58:59.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f235affd640 1 -- 172.21.15.112:0/2569698473 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c012870 con 0x7f23540051d0 2024-09-15T23:58:59.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f2370a2d640 1 -- 172.21.15.112:0/2569698473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f236c1574f0 con 0x7f23540051d0 2024-09-15T23:58:59.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f2370a2d640 1 -- 172.21.15.112:0/2569698473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236c0b4fe0 con 0x7f23540051d0 2024-09-15T23:58:59.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f235affd640 1 -- 172.21.15.112:0/2569698473 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f235c012a10 con 0x7f23540051d0 2024-09-15T23:58:59.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f235affd640 1 --2- 172.21.15.112:0/2569698473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f234c0678c0 0x7f234c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:59.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f235affd640 1 -- 172.21.15.112:0/2569698473 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5951+0+0 (secure 0 0 0) 0x7f235c085880 con 0x7f23540051d0 2024-09-15T23:58:59.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f2369d9b640 1 --2- 172.21.15.112:0/2569698473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f234c0678c0 0x7f234c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:59.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.976+0000 7f2369d9b640 1 --2- 172.21.15.112:0/2569698473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f234c0678c0 0x7f234c069d80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2360004880 tx=0x7f23600011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:59.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:58:59.980+0000 7f235affd640 1 -- 172.21.15.112:0/2569698473 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f235c0182b0 con 0x7f23540051d0 2024-09-15T23:59:00.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:00.144+0000 7f2370a2d640 1 -- 172.21.15.112:0/2569698473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f236c14fc70 con 0x7f23540051d0 2024-09-15T23:59:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:00.816+0000 7f235affd640 1 -- 172.21.15.112:0/2569698473 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) ==== 169+0+0 (secure 0 0 0) 0x7f235c056360 con 0x7f23540051d0 2024-09-15T23:59:00.816 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-15T23:59:00.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:00.820+0000 7f2370a2d640 1 -- 172.21.15.112:0/2569698473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f234c0678c0 msgr2=0x7f234c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:00.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:00.820+0000 7f2370a2d640 1 --2- 172.21.15.112:0/2569698473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f234c0678c0 0x7f234c069d80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2360004880 tx=0x7f23600011a0 comp rx=0 tx=0).stop 2024-09-15T23:59:00.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:00.820+0000 7f2370a2d640 1 -- 172.21.15.112:0/2569698473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23540051d0 msgr2=0x7f236c157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:00.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:00.820+0000 7f2370a2d640 1 --2- 172.21.15.112:0/2569698473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23540051d0 0x7f236c157cf0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f235c00c480 tx=0x7f235c00c940 comp rx=0 tx=0).stop 2024-09-15T23:59:00.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:00.820+0000 7f2370a2d640 1 -- 172.21.15.112:0/2569698473 shutdown_connections 2024-09-15T23:59:00.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:00.820+0000 7f2370a2d640 1 --2- 172.21.15.112:0/2569698473 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f234c0678c0 0x7f234c069d80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:00.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:00.820+0000 7f2370a2d640 1 --2- 172.21.15.112:0/2569698473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f236c1566d0 0x7f236c1e7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:00.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:00.820+0000 7f2370a2d640 1 --2- 172.21.15.112:0/2569698473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f236c13fc20 0x7f236c156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:00.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:00.820+0000 7f2370a2d640 1 --2- 172.21.15.112:0/2569698473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23540051d0 0x7f236c157cf0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:00.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:00.820+0000 7f2370a2d640 1 -- 172.21.15.112:0/2569698473 >> 172.21.15.112:0/2569698473 conn(0x7f236c06be50 msgr2=0x7f236c0b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:00.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:00.820+0000 7f2370a2d640 1 -- 172.21.15.112:0/2569698473 shutdown_connections 2024-09-15T23:59:00.823 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:00.820+0000 7f2370a2d640 1 -- 172.21.15.112:0/2569698473 wait complete. 2024-09-15T23:59:00.848 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:59:00.850 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:59:00.875 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-15T23:59:00.875 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-09-15T23:59:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:59:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-09-15T23:59:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-09-15T23:59:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-09-15T23:59:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-09-15T23:59:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-09-15T23:59:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-09-15T23:59:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-09-15T23:59:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.876 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:59:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-09-15T23:59:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:59:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:59:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-09-15T23:59:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-09-15T23:59:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-09-15T23:59:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:59:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:59:00.877 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-09-15T23:59:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:59:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-09-15T23:59:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:59:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:59:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-09-15T23:59:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:59:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.880 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-09-15T23:59:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-09-15T23:59:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-09-15T23:59:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-09-15T23:59:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-09-15T23:59:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-15T23:59:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:59:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.881 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-09-15T23:59:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-09-15T23:59:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-09-15T23:59:00.881 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-09-15T23:59:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:59:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-09-15T23:59:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-09-15T23:59:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-09-15T23:59:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-09-15T23:59:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-09-15T23:59:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-09-15T23:59:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-09-15T23:59:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-09-15T23:59:00.882 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:59:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-09-15T23:59:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-09-15T23:59:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:59:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-09-15T23:59:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-09-15T23:59:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-09-15T23:59:00.883 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-09-15T23:59:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-09-15T23:59:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 20 2024-09-15T23:59:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 20 2024-09-15T23:59:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-09-15T23:59:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 10 2024-09-15T23:59:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:59:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-09-15T23:59:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:59:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:59:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-09-15T23:59:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-15T23:59:00.884 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.885 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-09-15T23:59:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-09-15T23:59:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-15T23:59:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-15T23:59:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:59:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:59:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-09-15T23:59:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-15T23:59:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.885 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-09-15T23:59:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:00.885 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-15T23:59:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-09-15T23:59:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-15T23:59:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-09-15T23:59:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-09-15T23:59:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:59:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-09-15T23:59:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-09-15T23:59:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:59:00.886 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:59:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:59:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:59:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:59:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:59:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:59:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-09-15T23:59:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:59:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.887 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:59:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: mon down mkfs grace = 300 2024-09-15T23:59:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2024-09-15T23:59:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on pool no app = False 2024-09-15T23:59:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.888 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-09-15T23:59:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-09-15T23:59:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-09-15T23:59:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-09-15T23:59:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:59:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:59:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2024-09-15T23:59:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-15T23:59:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:00.888 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2024-09-15T23:59:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-15T23:59:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-15T23:59:00.889 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-09-15T23:59:00.889 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-09-15T23:59:00.889 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-09-15T23:59:00.889 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-15T23:59:00.889 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-09-15T23:59:00.889 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-09-15T23:59:00.889 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-09-15T23:59:00.889 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2024-09-15T23:59:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2024-09-15T23:59:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds balancer = 20 2024-09-15T23:59:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:00.889 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2024-09-15T23:59:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2024-09-15T23:59:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2024-09-15T23:59:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2024-09-15T23:59:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-15T23:59:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-15T23:59:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-15T23:59:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: mds_max_purge_ops = 100000000 2024-09-15T23:59:00.890 INFO:teuthology.orchestra.run.smithi112.stdout: mds_max_purge_ops_per_pg = 1562500.0 2024-09-15T23:59:00.892 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-09-15T23:59:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-09-15T23:59:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:59:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-09-15T23:59:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-09-15T23:59:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-09-15T23:59:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-09-15T23:59:00.892 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-09-15T23:59:00.893 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:59:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:59:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-09-15T23:59:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:59:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-09-15T23:59:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:59:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:59:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-09-15T23:59:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:59:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-09-15T23:59:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.894 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-09-15T23:59:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-09-15T23:59:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-09-15T23:59:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-09-15T23:59:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-15T23:59:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:59:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.895 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-09-15T23:59:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-09-15T23:59:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-09-15T23:59:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-09-15T23:59:00.895 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:59:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-09-15T23:59:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-09-15T23:59:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-09-15T23:59:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-09-15T23:59:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-09-15T23:59:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-09-15T23:59:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-09-15T23:59:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-09-15T23:59:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:59:00.896 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.897 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-09-15T23:59:00.897 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.897 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-09-15T23:59:00.897 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.897 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:59:00.897 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-09-15T23:59:00.897 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.897 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-09-15T23:59:00.897 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-09-15T23:59:00.897 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-09-15T23:59:00.897 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-09-15T23:59:00.897 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 20 2024-09-15T23:59:00.897 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 20 2024-09-15T23:59:00.897 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:00.898 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-09-15T23:59:00.898 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 10 2024-09-15T23:59:00.898 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:59:00.898 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-09-15T23:59:00.898 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:59:00.898 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:59:00.898 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-09-15T23:59:00.898 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-15T23:59:00.898 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.898 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-09-15T23:59:00.898 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:00.898 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-09-15T23:59:00.898 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-15T23:59:00.898 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-15T23:59:00.899 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:59:00.899 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:59:00.899 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-09-15T23:59:00.899 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-15T23:59:00.899 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.899 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-09-15T23:59:00.899 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:00.899 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-15T23:59:00.899 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-09-15T23:59:00.899 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-15T23:59:00.899 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-09-15T23:59:00.899 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-09-15T23:59:00.899 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:59:00.899 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.900 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:59:00.901 INFO:teuthology.orchestra.run.smithi169.stdout: mon down mkfs grace = 300 2024-09-15T23:59:00.901 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2024-09-15T23:59:00.901 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on pool no app = False 2024-09-15T23:59:00.901 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.901 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-09-15T23:59:00.901 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-09-15T23:59:00.901 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-09-15T23:59:00.901 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-09-15T23:59:00.901 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:59:00.901 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:59:00.901 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2024-09-15T23:59:00.901 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-15T23:59:00.901 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:00.901 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = "" 2024-09-15T23:59:00.902 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-15T23:59:00.902 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-15T23:59:00.902 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-09-15T23:59:00.902 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2024-09-15T23:59:00.902 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2024-09-15T23:59:00.902 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-09-15T23:59:00.902 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-09-15T23:59:00.902 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-09-15T23:59:00.902 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-09-15T23:59:00.902 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2024-09-15T23:59:00.903 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2024-09-15T23:59:00.903 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds balancer = 20 2024-09-15T23:59:00.903 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:00.903 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2024-09-15T23:59:00.903 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2024-09-15T23:59:00.903 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2024-09-15T23:59:00.903 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2024-09-15T23:59:00.903 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-15T23:59:00.903 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-15T23:59:00.903 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-15T23:59:00.903 INFO:teuthology.orchestra.run.smithi169.stdout: mds_max_purge_ops = 100000000 2024-09-15T23:59:00.903 INFO:teuthology.orchestra.run.smithi169.stdout: mds_max_purge_ops_per_pg = 1562500.0 2024-09-15T23:59:00.904 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:59:00.936 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:59:00.961 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-15T23:59:00.961 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-09-15T23:59:00.961 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:59:00.961 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.962 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:59:00.963 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:59:00.963 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.963 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-09-15T23:59:00.963 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.963 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-09-15T23:59:00.963 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-09-15T23:59:00.963 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:59:00.963 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:59:00.963 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-09-15T23:59:00.963 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:59:00.963 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-09-15T23:59:00.963 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:59:00.963 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:59:00.963 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-09-15T23:59:00.964 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-09-15T23:59:00.965 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-09-15T23:59:00.966 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 20 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 20 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 10 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-09-15T23:59:00.967 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-09-15T23:59:00.968 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:59:00.969 INFO:teuthology.orchestra.run.smithi112.stdout: mon down mkfs grace = 300 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on pool no app = False 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-09-15T23:59:00.970 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds balancer = 20 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-15T23:59:00.971 INFO:teuthology.orchestra.run.smithi112.stdout: mds_max_purge_ops_per_pg = 1562500.0 2024-09-15T23:59:00.972 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-09-15T23:59:00.972 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-09-15T23:59:00.972 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:59:00.972 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-09-15T23:59:00.972 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.972 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-09-15T23:59:00.972 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.973 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-09-15T23:59:00.974 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:59:00.975 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.976 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-09-15T23:59:00.976 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-09-15T23:59:00.976 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.976 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-09-15T23:59:00.976 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-09-15T23:59:00.976 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-09-15T23:59:00.976 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-09-15T23:59:00.976 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.976 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-09-15T23:59:00.976 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-09-15T23:59:00.976 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.976 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:59:00.976 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.976 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 20 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 20 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-09-15T23:59:00.977 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 10 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-09-15T23:59:00.978 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:59:00.979 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout: mon down mkfs grace = 300 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on pool no app = False 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-09-15T23:59:00.980 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = "" 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-09-15T23:59:00.981 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-09-15T23:59:00.982 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-09-15T23:59:00.982 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2024-09-15T23:59:00.982 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2024-09-15T23:59:00.982 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds balancer = 20 2024-09-15T23:59:00.982 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:00.982 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2024-09-15T23:59:00.982 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2024-09-15T23:59:00.982 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2024-09-15T23:59:00.982 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2024-09-15T23:59:00.982 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-15T23:59:00.982 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-15T23:59:00.982 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-15T23:59:00.982 INFO:teuthology.orchestra.run.smithi169.stdout: mds_max_purge_ops_per_pg = 1562500.0 2024-09-15T23:59:00.984 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:59:01.028 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:59:01.061 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-09-15T23:59:01.061 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-09-15T23:59:01.061 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:59:01.061 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.062 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-09-15T23:59:01.063 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.064 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:59:01.064 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.064 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-09-15T23:59:01.064 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.064 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-09-15T23:59:01.064 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.064 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-09-15T23:59:01.064 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-09-15T23:59:01.064 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-09-15T23:59:01.064 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-15T23:59:01.064 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:59:01.064 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.064 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-09-15T23:59:01.065 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-09-15T23:59:01.065 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.065 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-09-15T23:59:01.065 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-09-15T23:59:01.065 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:59:01.065 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.065 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-09-15T23:59:01.065 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-09-15T23:59:01.065 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.065 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-09-15T23:59:01.065 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-09-15T23:59:01.065 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-09-15T23:59:01.066 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-09-15T23:59:01.066 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.066 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-09-15T23:59:01.066 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-09-15T23:59:01.066 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.066 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:59:01.066 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.066 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-09-15T23:59:01.066 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.066 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-09-15T23:59:01.066 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.066 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:59:01.066 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-09-15T23:59:01.066 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.067 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-09-15T23:59:01.067 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-09-15T23:59:01.067 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-09-15T23:59:01.067 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-09-15T23:59:01.067 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 20 2024-09-15T23:59:01.067 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 20 2024-09-15T23:59:01.067 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:01.067 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-09-15T23:59:01.067 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 10 2024-09-15T23:59:01.067 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:59:01.067 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-09-15T23:59:01.067 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:59:01.067 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:59:01.067 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-09-15T23:59:01.068 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:59:01.069 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: mon down mkfs grace = 300 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on pool no app = False 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:59:01.070 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = "" 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds balancer = 20 2024-09-15T23:59:01.071 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-09-15T23:59:01.072 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2024-09-15T23:59:01.072 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2024-09-15T23:59:01.072 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2024-09-15T23:59:01.072 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2024-09-15T23:59:01.072 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-09-15T23:59:01.072 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-09-15T23:59:01.072 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-09-15T23:59:01.073 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-15T23:59:01.074 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-09-15T23:59:01.074 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:59:01.074 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-09-15T23:59:01.074 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.074 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-09-15T23:59:01.074 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.074 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-09-15T23:59:01.074 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.074 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-09-15T23:59:01.074 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-09-15T23:59:01.074 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.074 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-09-15T23:59:01.074 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-09-15T23:59:01.074 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:59:01.075 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-09-15T23:59:01.076 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:59:01.076 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:59:01.076 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-09-15T23:59:01.076 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.076 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:59:01.076 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.076 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-09-15T23:59:01.076 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.076 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-09-15T23:59:01.076 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.076 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-09-15T23:59:01.076 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-09-15T23:59:01.076 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-09-15T23:59:01.076 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.112,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-09-15T23:59:01.077 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 1af6b673-4d40-4109-af4e-78662faa7df8 2024-09-15T23:59:01.077 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.077 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-09-15T23:59:01.077 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-09-15T23:59:01.077 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.077 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-09-15T23:59:01.077 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-09-15T23:59:01.077 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:59:01.077 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.077 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-09-15T23:59:01.077 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-09-15T23:59:01.077 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.077 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:59:01.078 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-09-15T23:59:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-09-15T23:59:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-09-15T23:59:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-09-15T23:59:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-09-15T23:59:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 20 2024-09-15T23:59:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 20 2024-09-15T23:59:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-09-15T23:59:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 10 2024-09-15T23:59:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:59:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-09-15T23:59:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:59:01.079 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:59:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-09-15T23:59:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-15T23:59:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.080 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-09-15T23:59:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-09-15T23:59:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-15T23:59:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-15T23:59:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:59:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:59:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-09-15T23:59:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-15T23:59:01.080 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.080 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:59:01.081 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: mon down mkfs grace = 300 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: mon op complaint time = 120 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on pool no app = False 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-09-15T23:59:01.082 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout: client mount timeout = 600 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout: debug client = 20 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-09-15T23:59:01.083 INFO:teuthology.orchestra.run.smithi112.stdout:[mds] 2024-09-15T23:59:01.084 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds = 20 2024-09-15T23:59:01.084 INFO:teuthology.orchestra.run.smithi112.stdout: debug mds balancer = 20 2024-09-15T23:59:01.084 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-15T23:59:01.084 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug frag = True 2024-09-15T23:59:01.084 INFO:teuthology.orchestra.run.smithi112.stdout: mds debug scatterstat = True 2024-09-15T23:59:01.084 INFO:teuthology.orchestra.run.smithi112.stdout: mds op complaint time = 180 2024-09-15T23:59:01.084 INFO:teuthology.orchestra.run.smithi112.stdout: mds verify scatter = True 2024-09-15T23:59:01.084 INFO:teuthology.orchestra.run.smithi112.stdout: osd op complaint time = 180 2024-09-15T23:59:01.084 INFO:teuthology.orchestra.run.smithi112.stdout: rados mon op timeout = 900 2024-09-15T23:59:01.084 INFO:teuthology.orchestra.run.smithi112.stdout: rados osd op timeout = 900 2024-09-15T23:59:01.084 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:59:01.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.232+0000 7fcc08a28640 1 Processor -- start 2024-09-15T23:59:01.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.232+0000 7fcc08a28640 1 -- start start 2024-09-15T23:59:01.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.232+0000 7fcc08a28640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0415c2a0 0x7fcc040aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.232+0000 7fcc08a28640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc040b3290 con 0x7fcc0415bec0 2024-09-15T23:59:01.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.232+0000 7fcc08a28640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc040b3570 con 0x7fcc040af2a0 2024-09-15T23:59:01.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.232+0000 7fcc08a28640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcc040b3850 con 0x7fcc0415c2a0 2024-09-15T23:59:01.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.232+0000 7fcc0259c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fcc0415bec0 0x7fcc040ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44922/0 (socket says 172.21.15.112:44922) 2024-09-15T23:59:01.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.232+0000 7fcc0259c640 1 -- 172.21.15.112:0/4197095255 learned_addr learned my addr 172.21.15.112:0/4197095255 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:01.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.232+0000 7fcc01d9b640 1 --2- 172.21.15.112:0/4197095255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0415c2a0 0x7fcc040aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 -- 172.21.15.112:0/4197095255 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3748723370 0 0) 0x7fcc040b3290 con 0x7fcc0415bec0 2024-09-15T23:59:01.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 -- 172.21.15.112:0/4197095255 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbf0003530 con 0x7fcc0415bec0 2024-09-15T23:59:01.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 -- 172.21.15.112:0/4197095255 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3994896992 0 0) 0x7fcbf0003530 con 0x7fcc0415bec0 2024-09-15T23:59:01.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 -- 172.21.15.112:0/4197095255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0415c2a0 msgr2=0x7fcc040aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:01.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 --2- 172.21.15.112:0/4197095255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0415c2a0 0x7fcc040aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 -- 172.21.15.112:0/4197095255 >> v1:172.21.15.169:6789/0 conn(0x7fcc040af2a0 legacy=0x7fcc0406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 -- 172.21.15.112:0/4197095255 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc040b3b30 con 0x7fcc0415bec0 2024-09-15T23:59:01.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 -- 172.21.15.112:0/4197095255 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fcbf4001680 con 0x7fcc0415bec0 2024-09-15T23:59:01.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 -- 172.21.15.112:0/4197095255 >> v1:172.21.15.112:6789/0 conn(0x7fcc0415bec0 legacy=0x7fcc040ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 --2- 172.21.15.112:0/4197095255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0415c2a0 0x7fcbf00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 --2- 172.21.15.112:0/4197095255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf0003f30 0x7fcbf0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 --2- 172.21.15.112:0/4197095255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbf0004d50 0x7fcbf00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 -- 172.21.15.112:0/4197095255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcc040b3850 con 0x7fcbf0003f30 2024-09-15T23:59:01.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 -- 172.21.15.112:0/4197095255 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf000ba80 con 0x7fcbf0004d50 2024-09-15T23:59:01.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 -- 172.21.15.112:0/4197095255 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf000bc80 con 0x7fcc0415c2a0 2024-09-15T23:59:01.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc01d9b640 1 --2- 172.21.15.112:0/4197095255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf0003f30 0x7fcbf0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0259c640 1 --2- 172.21.15.112:0/4197095255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0415c2a0 0x7fcbf00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc02d9d640 1 --2- 172.21.15.112:0/4197095255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbf0004d50 0x7fcbf00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc01d9b640 1 -- 172.21.15.112:0/4197095255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0415c2a0 msgr2=0x7fcbf00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:01.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc01d9b640 1 --2- 172.21.15.112:0/4197095255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0415c2a0 0x7fcbf00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc01d9b640 1 -- 172.21.15.112:0/4197095255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbf0004d50 msgr2=0x7fcbf00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:01.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc01d9b640 1 --2- 172.21.15.112:0/4197095255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbf0004d50 0x7fcbf00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.238 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc01d9b640 1 -- 172.21.15.112:0/4197095255 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf0003530 con 0x7fcbf0003f30 2024-09-15T23:59:01.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc01d9b640 1 --2- 172.21.15.112:0/4197095255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf0003f30 0x7fcbf0004810 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009ac0 tx=0x7fcbec01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4856badd4e95eb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:01.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 -- 172.21.15.112:0/4197095255 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0b2070 con 0x7fcbf0003f30 2024-09-15T23:59:01.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 -- 172.21.15.112:0/4197095255 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbec0a5640 con 0x7fcbf0003f30 2024-09-15T23:59:01.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc0159a640 1 -- 172.21.15.112:0/4197095255 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec009690 con 0x7fcbf0003f30 2024-09-15T23:59:01.239 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc08a28640 1 -- 172.21.15.112:0/4197095255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf0003f30 msgr2=0x7fcbf0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc08a28640 1 --2- 172.21.15.112:0/4197095255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf0003f30 0x7fcbf0004810 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009ac0 tx=0x7fcbec01ca50 comp rx=0 tx=0).stop 2024-09-15T23:59:01.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc02d9d640 1 -- 172.21.15.112:0/4197095255 reap_dead start 2024-09-15T23:59:01.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc08a28640 1 -- 172.21.15.112:0/4197095255 shutdown_connections 2024-09-15T23:59:01.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.236+0000 7fcc08a28640 1 -- 172.21.15.112:0/4197095255 >> 172.21.15.112:0/4197095255 conn(0x7fcc040b1f90 msgr2=0x7fcc040b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:01.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc08a28640 1 -- 172.21.15.112:0/4197095255 shutdown_connections 2024-09-15T23:59:01.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc08a28640 1 -- 172.21.15.112:0/4197095255 wait complete. 2024-09-15T23:59:01.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc08a28640 1 Processor -- start 2024-09-15T23:59:01.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc08a28640 1 -- start start 2024-09-15T23:59:01.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc08a28640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf0003f30 0x7fcc041e4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc08a28640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0414fba0 0x7fcc041f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc08a28640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc0414f2d0 0x7fcc04157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc08a28640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcc040af730 con 0x7fcbf0003f30 2024-09-15T23:59:01.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc08a28640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcc040b40f0 con 0x7fcc0414f2d0 2024-09-15T23:59:01.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc08a28640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcc040afc90 con 0x7fcc0414fba0 2024-09-15T23:59:01.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc0259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf0003f30 0x7fcc041e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc0259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf0003f30 0x7fcc041e4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54676/0 (socket says 172.21.15.112:54676) 2024-09-15T23:59:01.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc0259c640 1 -- 172.21.15.112:0/1892935799 learned_addr learned my addr 172.21.15.112:0/1892935799 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:01.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc01d9b640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0414fba0 0x7fcc041f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc02d9d640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc0414f2d0 0x7fcc04157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc0259c640 1 -- 172.21.15.112:0/1892935799 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0414fba0 msgr2=0x7fcc041f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc0259c640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0414fba0 0x7fcc041f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc0259c640 1 -- 172.21.15.112:0/1892935799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc0414f2d0 msgr2=0x7fcc04157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc0259c640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc0414f2d0 0x7fcc04157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc0259c640 1 -- 172.21.15.112:0/1892935799 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc041f5af0 con 0x7fcbf0003f30 2024-09-15T23:59:01.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc02d9d640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc0414f2d0 0x7fcc04157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:01.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc0259c640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf0003f30 0x7fcc041e4430 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400e7b0 tx=0x7fcbf400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:01.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcbfaffd640 1 -- 172.21.15.112:0/1892935799 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf400c870 con 0x7fcbf0003f30 2024-09-15T23:59:01.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcbfaffd640 1 -- 172.21.15.112:0/1892935799 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf4018070 con 0x7fcbf0003f30 2024-09-15T23:59:01.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc08a28640 1 -- 172.21.15.112:0/1892935799 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc041e5030 con 0x7fcbf0003f30 2024-09-15T23:59:01.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcbfaffd640 1 -- 172.21.15.112:0/1892935799 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf400cc70 con 0x7fcbf0003f30 2024-09-15T23:59:01.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc08a28640 1 -- 172.21.15.112:0/1892935799 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc04153200 con 0x7fcbf0003f30 2024-09-15T23:59:01.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.240+0000 7fcc08a28640 1 -- 172.21.15.112:0/1892935799 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc040aed60 con 0x7fcbf0003f30 2024-09-15T23:59:01.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.244+0000 7fcbfaffd640 1 -- 172.21.15.112:0/1892935799 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcbf4013420 con 0x7fcbf0003f30 2024-09-15T23:59:01.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.244+0000 7fcbfaffd640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcbe40678f0 0x7fcbe4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.244+0000 7fcc01d9b640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcbe40678f0 0x7fcbe4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.244+0000 7fcbfaffd640 1 -- 172.21.15.112:0/1892935799 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5421+0+0 (secure 0 0 0) 0x7fcbf4085710 con 0x7fcbf0003f30 2024-09-15T23:59:01.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.244+0000 7fcc01d9b640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcbe40678f0 0x7fcbe4069db0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009ac0 tx=0x7fcbec0046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:01.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.248+0000 7fcbfaffd640 1 -- 172.21.15.112:0/1892935799 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcbf4056370 con 0x7fcbf0003f30 2024-09-15T23:59:01.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.408+0000 7fcc08a28640 1 -- 172.21.15.112:0/1892935799 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fcc0406fcd0 con 0x7fcbf0003f30 2024-09-15T23:59:01.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.412+0000 7fcbfaffd640 1 -- 172.21.15.112:0/1892935799 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7fcbf405c070 con 0x7fcbf0003f30 2024-09-15T23:59:01.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.416+0000 7fcc08a28640 1 -- 172.21.15.112:0/1892935799 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcbe40678f0 msgr2=0x7fcbe4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.416+0000 7fcc08a28640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcbe40678f0 0x7fcbe4069db0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009ac0 tx=0x7fcbec0046d0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.416+0000 7fcc08a28640 1 -- 172.21.15.112:0/1892935799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf0003f30 msgr2=0x7fcc041e4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.416+0000 7fcc08a28640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf0003f30 0x7fcc041e4430 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400e7b0 tx=0x7fcbf400ec70 comp rx=0 tx=0).stop 2024-09-15T23:59:01.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.416+0000 7fcc08a28640 1 -- 172.21.15.112:0/1892935799 shutdown_connections 2024-09-15T23:59:01.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.416+0000 7fcc08a28640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcbe40678f0 0x7fcbe4069db0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.416+0000 7fcc08a28640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcc0414f2d0 0x7fcc04157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.416+0000 7fcc08a28640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcc0414fba0 0x7fcc041f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.416+0000 7fcc08a28640 1 --2- 172.21.15.112:0/1892935799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbf0003f30 0x7fcc041e4430 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.416+0000 7fcc08a28640 1 -- 172.21.15.112:0/1892935799 >> 172.21.15.112:0/1892935799 conn(0x7fcc040b1f90 msgr2=0x7fcc041597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:01.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.416+0000 7fcc08a28640 1 -- 172.21.15.112:0/1892935799 shutdown_connections 2024-09-15T23:59:01.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.416+0000 7fcc08a28640 1 -- 172.21.15.112:0/1892935799 wait complete. 2024-09-15T23:59:01.435 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_files_throttle' 2024-09-15T23:59:01.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa372c640 1 Processor -- start 2024-09-15T23:59:01.556 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa372c640 1 -- start start 2024-09-15T23:59:01.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa372c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f9c0b4b20 0x7f8f9c141030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa372c640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f9c13fb30 con 0x7f8f9c140bd0 2024-09-15T23:59:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa372c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f9c13fe10 con 0x7f8f9c156720 2024-09-15T23:59:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa372c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8f9c141570 con 0x7f8f9c0b4b20 2024-09-15T23:59:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa0cc7640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f8f9c140bd0 0x7f8f9c0b4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44938/0 (socket says 172.21.15.112:44938) 2024-09-15T23:59:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa0cc7640 1 -- 172.21.15.112:0/99920066 learned_addr learned my addr 172.21.15.112:0/99920066 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa1cc9640 1 --2- 172.21.15.112:0/99920066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f9c0b4b20 0x7f8f9c141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 -- 172.21.15.112:0/99920066 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4062541750 0 0) 0x7f8f9c13fb30 con 0x7f8f9c140bd0 2024-09-15T23:59:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 -- 172.21.15.112:0/99920066 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f84003530 con 0x7f8f9c140bd0 2024-09-15T23:59:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 -- 172.21.15.112:0/99920066 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1912500928 0 0) 0x7f8f84003530 con 0x7f8f9c140bd0 2024-09-15T23:59:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 -- 172.21.15.112:0/99920066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f9c0b4b20 msgr2=0x7f8f9c141030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 --2- 172.21.15.112:0/99920066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f9c0b4b20 0x7f8f9c141030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 -- 172.21.15.112:0/99920066 >> v1:172.21.15.169:6789/0 conn(0x7f8f9c156720 legacy=0x7f8f9c0b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 -- 172.21.15.112:0/99920066 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9c1400f0 con 0x7f8f9c140bd0 2024-09-15T23:59:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 -- 172.21.15.112:0/99920066 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f8f90001680 con 0x7f8f9c140bd0 2024-09-15T23:59:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 -- 172.21.15.112:0/99920066 >> v1:172.21.15.112:6789/0 conn(0x7f8f9c140bd0 legacy=0x7f8f9c0b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 --2- 172.21.15.112:0/99920066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f9c0b4b20 0x7f8f840039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 --2- 172.21.15.112:0/99920066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f84003f30 0x7f8f84004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 --2- 172.21.15.112:0/99920066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f84004d50 0x7f8f840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 -- 172.21.15.112:0/99920066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8400ba00 con 0x7f8f84003f30 2024-09-15T23:59:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 -- 172.21.15.112:0/99920066 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8400bbb0 con 0x7f8f84004d50 2024-09-15T23:59:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8f9bfff640 1 -- 172.21.15.112:0/99920066 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8f8400bdb0 con 0x7f8f9c0b4b20 2024-09-15T23:59:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa0cc7640 1 --2- 172.21.15.112:0/99920066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f84003f30 0x7f8f84004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa14c8640 1 --2- 172.21.15.112:0/99920066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f9c0b4b20 0x7f8f840039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa1cc9640 1 --2- 172.21.15.112:0/99920066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f84004d50 0x7f8f840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa0cc7640 1 -- 172.21.15.112:0/99920066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f9c0b4b20 msgr2=0x7f8f840039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa0cc7640 1 --2- 172.21.15.112:0/99920066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f9c0b4b20 0x7f8f840039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa0cc7640 1 -- 172.21.15.112:0/99920066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f84004d50 msgr2=0x7f8f840051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:01.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa0cc7640 1 --2- 172.21.15.112:0/99920066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f84004d50 0x7f8f840051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa0cc7640 1 -- 172.21.15.112:0/99920066 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f84003530 con 0x7f8f84003f30 2024-09-15T23:59:01.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.556+0000 7f8fa14c8640 1 --2- 172.21.15.112:0/99920066 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f9c0b4b20 0x7f8f840039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:01.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8fa0cc7640 1 --2- 172.21.15.112:0/99920066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f84003f30 0x7f8f84004810 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000c240 tx=0x7f8f9001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc2f9d5b4378bc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:01.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8f9bfff640 1 -- 172.21.15.112:0/99920066 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90007d40 con 0x7f8f84003f30 2024-09-15T23:59:01.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8f9bfff640 1 -- 172.21.15.112:0/99920066 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f900a9070 con 0x7f8f84003f30 2024-09-15T23:59:01.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8f9bfff640 1 -- 172.21.15.112:0/99920066 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90005d80 con 0x7f8f84003f30 2024-09-15T23:59:01.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8fa372c640 1 -- 172.21.15.112:0/99920066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f84003f30 msgr2=0x7f8f84004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8fa372c640 1 --2- 172.21.15.112:0/99920066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f84003f30 0x7f8f84004810 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000c240 tx=0x7f8f9001cbc0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8fa1cc9640 1 -- 172.21.15.112:0/99920066 reap_dead start 2024-09-15T23:59:01.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8fa372c640 1 -- 172.21.15.112:0/99920066 shutdown_connections 2024-09-15T23:59:01.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8fa372c640 1 -- 172.21.15.112:0/99920066 >> 172.21.15.112:0/99920066 conn(0x7f8f9c06c0c0 msgr2=0x7f8f9c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:01.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8fa372c640 1 -- 172.21.15.112:0/99920066 shutdown_connections 2024-09-15T23:59:01.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8fa372c640 1 -- 172.21.15.112:0/99920066 wait complete. 2024-09-15T23:59:01.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8fa372c640 1 Processor -- start 2024-09-15T23:59:01.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8fa372c640 1 -- start start 2024-09-15T23:59:01.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8fa372c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f84003f30 0x7f8f9c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.560+0000 7f8fa372c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f9c0cbc50 0x7f8f9c15d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa372c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f9c15dd30 0x7f8f9c1f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa372c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c0728d0 con 0x7f8f9c0cbc50 2024-09-15T23:59:01.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa372c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c140740 con 0x7f8f9c15dd30 2024-09-15T23:59:01.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa372c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8f9c0b5d20 con 0x7f8f84003f30 2024-09-15T23:59:01.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa0cc7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f9c0cbc50 0x7f8f9c15d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa0cc7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f9c0cbc50 0x7f8f9c15d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54702/0 (socket says 172.21.15.112:54702) 2024-09-15T23:59:01.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa0cc7640 1 -- 172.21.15.112:0/2474906930 learned_addr learned my addr 172.21.15.112:0/2474906930 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:01.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa1cc9640 1 --2- 172.21.15.112:0/2474906930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f9c15dd30 0x7f8f9c1f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa14c8640 1 --2- 172.21.15.112:0/2474906930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f84003f30 0x7f8f9c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa0cc7640 1 -- 172.21.15.112:0/2474906930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f84003f30 msgr2=0x7f8f9c155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa0cc7640 1 --2- 172.21.15.112:0/2474906930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f84003f30 0x7f8f9c155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa0cc7640 1 -- 172.21.15.112:0/2474906930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f9c15dd30 msgr2=0x7f8f9c1f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa0cc7640 1 --2- 172.21.15.112:0/2474906930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f9c15dd30 0x7f8f9c1f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa0cc7640 1 -- 172.21.15.112:0/2474906930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9c0cda10 con 0x7f8f9c0cbc50 2024-09-15T23:59:01.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa0cc7640 1 --2- 172.21.15.112:0/2474906930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f9c0cbc50 0x7f8f9c15d7f0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000c240 tx=0x7f8f84005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:01.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8f99ffb640 1 -- 172.21.15.112:0/2474906930 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90007d40 con 0x7f8f9c0cbc50 2024-09-15T23:59:01.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8f99ffb640 1 -- 172.21.15.112:0/2474906930 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f900a6e10 con 0x7f8f9c0cbc50 2024-09-15T23:59:01.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa372c640 1 -- 172.21.15.112:0/2474906930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9c0cdcf0 con 0x7f8f9c0cbc50 2024-09-15T23:59:01.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8f99ffb640 1 -- 172.21.15.112:0/2474906930 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90004a30 con 0x7f8f9c0cbc50 2024-09-15T23:59:01.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa372c640 1 -- 172.21.15.112:0/2474906930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9c0ce2b0 con 0x7f8f9c0cbc50 2024-09-15T23:59:01.566 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa372c640 1 -- 172.21.15.112:0/2474906930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f9c13f6e0 con 0x7f8f9c0cbc50 2024-09-15T23:59:01.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8f99ffb640 1 -- 172.21.15.112:0/2474906930 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f90004bd0 con 0x7f8f9c0cbc50 2024-09-15T23:59:01.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8f99ffb640 1 --2- 172.21.15.112:0/2474906930 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f880678c0 0x7f8f88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa14c8640 1 --2- 172.21.15.112:0/2474906930 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f880678c0 0x7f8f88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8f99ffb640 1 -- 172.21.15.112:0/2474906930 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5421+0+0 (secure 0 0 0) 0x7f8f9011f7b0 con 0x7f8f9c0cbc50 2024-09-15T23:59:01.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.564+0000 7f8fa14c8640 1 --2- 172.21.15.112:0/2474906930 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f880678c0 0x7f8f88069d80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c1ef580 tx=0x7f8f9400a290 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:01.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.568+0000 7f8f99ffb640 1 -- 172.21.15.112:0/2474906930 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8f900168d0 con 0x7f8f9c0cbc50 2024-09-15T23:59:01.790 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.788+0000 7f8fa372c640 1 -- 172.21.15.112:0/2474906930 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_files_throttle"]} v 0) -- 0x7f8f9c15e110 con 0x7f8f9c0cbc50 2024-09-15T23:59:01.825 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.824+0000 7f8f99ffb640 1 -- 172.21.15.112:0/2474906930 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_files_throttle"]}]=0 v278) ==== 134+0+0 (secure 0 0 0) 0x7f8f900f6030 con 0x7f8f9c0cbc50 2024-09-15T23:59:01.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.828+0000 7f8fa372c640 1 -- 172.21.15.112:0/2474906930 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f880678c0 msgr2=0x7f8f88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.828+0000 7f8fa372c640 1 --2- 172.21.15.112:0/2474906930 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f880678c0 0x7f8f88069d80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c1ef580 tx=0x7f8f9400a290 comp rx=0 tx=0).stop 2024-09-15T23:59:01.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.828+0000 7f8fa372c640 1 -- 172.21.15.112:0/2474906930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f9c0cbc50 msgr2=0x7f8f9c15d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.828+0000 7f8fa372c640 1 --2- 172.21.15.112:0/2474906930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f9c0cbc50 0x7f8f9c15d7f0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000c240 tx=0x7f8f84005840 comp rx=0 tx=0).stop 2024-09-15T23:59:01.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.828+0000 7f8fa372c640 1 -- 172.21.15.112:0/2474906930 shutdown_connections 2024-09-15T23:59:01.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.828+0000 7f8fa372c640 1 --2- 172.21.15.112:0/2474906930 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f8f880678c0 0x7f8f88069d80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.828+0000 7f8fa372c640 1 --2- 172.21.15.112:0/2474906930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f9c15dd30 0x7f8f9c1f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.828+0000 7f8fa372c640 1 --2- 172.21.15.112:0/2474906930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f9c0cbc50 0x7f8f9c15d7f0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.828+0000 7f8fa372c640 1 --2- 172.21.15.112:0/2474906930 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f84003f30 0x7f8f9c155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.828+0000 7f8fa372c640 1 -- 172.21.15.112:0/2474906930 >> 172.21.15.112:0/2474906930 conn(0x7f8f9c06c0c0 msgr2=0x7f8f9c156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:01.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.828+0000 7f8fa372c640 1 -- 172.21.15.112:0/2474906930 shutdown_connections 2024-09-15T23:59:01.829 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.828+0000 7f8fa372c640 1 -- 172.21.15.112:0/2474906930 wait complete. 2024-09-15T23:59:01.844 INFO:tasks.cephfs_test_runner:test_files_throttle (tasks.cephfs.test_strays.TestStrays) ... ok 2024-09-15T23:59:01.844 INFO:tasks.cephfs_test_runner:Starting test: test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays) That removal of primary dentry of hardlinked inode results 2024-09-15T23:59:01.844 INFO:tasks.cephfs_test_runner:test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays) 2024-09-15T23:59:01.845 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:59:01.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.960+0000 7f046839d640 1 Processor -- start 2024-09-15T23:59:01.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.960+0000 7f046839d640 1 -- start start 2024-09-15T23:59:01.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f046839d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f04600b51b0 0x7f04600b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f046839d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f046015b570 0x7f046015b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f046839d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f046015bee0 con 0x7f04600b3330 2024-09-15T23:59:01.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f046839d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f04600d0b80 con 0x7f04600b51b0 2024-09-15T23:59:01.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f046839d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f04600d0e60 con 0x7f046015b570 2024-09-15T23:59:01.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f0465938640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f04600b51b0 0x7f04600b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f0465938640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f04600b51b0 0x7f04600b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54706/0 (socket says 172.21.15.112:54706) 2024-09-15T23:59:01.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f0465938640 1 -- 172.21.15.112:0/1096050719 learned_addr learned my addr 172.21.15.112:0/1096050719 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:01.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f046693a640 1 --2- 172.21.15.112:0/1096050719 >> v2:172.21.15.169:3300/0 conn(0x7f046015b570 0x7f046015b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f0465938640 1 -- 172.21.15.112:0/1096050719 >> v2:172.21.15.169:3300/0 conn(0x7f046015b570 msgr2=0x7f046015b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:01.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f0465938640 1 --2- 172.21.15.112:0/1096050719 >> v2:172.21.15.169:3300/0 conn(0x7f046015b570 0x7f046015b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f0465938640 1 -- 172.21.15.112:0/1096050719 >> v1:172.21.15.169:6789/0 conn(0x7f04600b3330 legacy=0x7f04600b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:01.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f0465938640 1 -- 172.21.15.112:0/1096050719 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04600b46d0 con 0x7f04600b51b0 2024-09-15T23:59:01.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f0465938640 1 --2- 172.21.15.112:0/1096050719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04600b51b0 0x7f04600b55d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f04600b3ef0 tx=0x7f045c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4191bfb88ac6bb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:01.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f0465137640 1 -- 172.21.15.112:0/1096050719 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c0b0070 con 0x7f04600b51b0 2024-09-15T23:59:01.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f0465137640 1 -- 172.21.15.112:0/1096050719 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f045c0ab600 con 0x7f04600b51b0 2024-09-15T23:59:01.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.964+0000 7f0465137640 1 -- 172.21.15.112:0/1096050719 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c0ab9d0 con 0x7f04600b51b0 2024-09-15T23:59:01.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 -- 172.21.15.112:0/1096050719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04600b51b0 msgr2=0x7f04600b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 --2- 172.21.15.112:0/1096050719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04600b51b0 0x7f04600b55d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f04600b3ef0 tx=0x7f045c01c450 comp rx=0 tx=0).stop 2024-09-15T23:59:01.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 -- 172.21.15.112:0/1096050719 shutdown_connections 2024-09-15T23:59:01.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 --2- 172.21.15.112:0/1096050719 >> v2:172.21.15.169:3300/0 conn(0x7f046015b570 0x7f046015b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 --2- 172.21.15.112:0/1096050719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04600b51b0 0x7f04600b55d0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 -- 172.21.15.112:0/1096050719 >> 172.21.15.112:0/1096050719 conn(0x7f04600b6870 msgr2=0x7f04600b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:01.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 -- 172.21.15.112:0/1096050719 shutdown_connections 2024-09-15T23:59:01.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 -- 172.21.15.112:0/1096050719 wait complete. 2024-09-15T23:59:01.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 Processor -- start 2024-09-15T23:59:01.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 -- start start 2024-09-15T23:59:01.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04600b3330 0x7f046015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04600b51b0 0x7f04600af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046015b570 0x7f04600afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f04600d05f0 con 0x7f046015b570 2024-09-15T23:59:01.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0460144f10 con 0x7f04600b3330 2024-09-15T23:59:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f04600d0770 con 0x7f04600b51b0 2024-09-15T23:59:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046693a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046015b570 0x7f04600afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046693a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046015b570 0x7f04600afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54710/0 (socket says 172.21.15.112:54710) 2024-09-15T23:59:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046693a640 1 -- 172.21.15.112:0/3930639478 learned_addr learned my addr 172.21.15.112:0/3930639478 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046693a640 1 -- 172.21.15.112:0/3930639478 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04600b51b0 msgr2=0x7f04600af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046693a640 1 --2- 172.21.15.112:0/3930639478 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04600b51b0 0x7f04600af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046693a640 1 -- 172.21.15.112:0/3930639478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04600b3330 msgr2=0x7f046015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046693a640 1 --2- 172.21.15.112:0/3930639478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04600b3330 0x7f046015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046693a640 1 -- 172.21.15.112:0/3930639478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04600b0450 con 0x7f046015b570 2024-09-15T23:59:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046693a640 1 --2- 172.21.15.112:0/3930639478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046015b570 0x7f04600afe20 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f0458007e40 tx=0x7f045800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f0456ffd640 1 -- 172.21.15.112:0/3930639478 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458014620 con 0x7f046015b570 2024-09-15T23:59:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f0456ffd640 1 -- 172.21.15.112:0/3930639478 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0458019070 con 0x7f046015b570 2024-09-15T23:59:01.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 -- 172.21.15.112:0/3930639478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04600aae40 con 0x7f046015b570 2024-09-15T23:59:01.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f0456ffd640 1 -- 172.21.15.112:0/3930639478 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458014a20 con 0x7f046015b570 2024-09-15T23:59:01.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.968+0000 7f046839d640 1 -- 172.21.15.112:0/3930639478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04600ab400 con 0x7f046015b570 2024-09-15T23:59:01.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.972+0000 7f046839d640 1 -- 172.21.15.112:0/3930639478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04600b55d0 con 0x7f046015b570 2024-09-15T23:59:01.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.972+0000 7f0456ffd640 1 -- 172.21.15.112:0/3930639478 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0458014bc0 con 0x7f046015b570 2024-09-15T23:59:01.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.972+0000 7f0456ffd640 1 --2- 172.21.15.112:0/3930639478 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f04440678c0 0x7f0444069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:01.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.972+0000 7f0456ffd640 1 -- 172.21.15.112:0/3930639478 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5421+0+0 (secure 0 0 0) 0x7f04580863f0 con 0x7f046015b570 2024-09-15T23:59:01.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.972+0000 7f0466139640 1 --2- 172.21.15.112:0/3930639478 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f04440678c0 0x7f0444069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:01.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.972+0000 7f0466139640 1 --2- 172.21.15.112:0/3930639478 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f04440678c0 0x7f0444069d80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0450009670 tx=0x7f0450006bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:01.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:01.976+0000 7f0456ffd640 1 -- 172.21.15.112:0/3930639478 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f04580570e0 con 0x7f046015b570 2024-09-15T23:59:02.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.136+0000 7f046839d640 1 -- 172.21.15.112:0/3930639478 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04600cd980 con 0x7f046015b570 2024-09-15T23:59:02.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.140+0000 7f0456ffd640 1 -- 172.21.15.112:0/3930639478 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+13455 (secure 0 0 0) 0x7f04600cd980 con 0x7f046015b570 2024-09-15T23:59:02.140 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:02.141 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":106,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:59:00.816989+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6835/960124820":"2024-09-16T23:58:57.804599+0000","172.21.15.112:6834/960124820":"2024-09-16T23:58:57.804599+0000","172.21.15.112:6837/2378546307":"2024-09-16T23:58:27.547962+0000","172.21.15.112:6835/2378546307":"2024-09-16T23:58:27.547962+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:59:02.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.140+0000 7f046839d640 1 -- 172.21.15.112:0/3930639478 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f04440678c0 msgr2=0x7f0444069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.140+0000 7f046839d640 1 --2- 172.21.15.112:0/3930639478 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f04440678c0 0x7f0444069d80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0450009670 tx=0x7f0450006bd0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.140+0000 7f046839d640 1 -- 172.21.15.112:0/3930639478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046015b570 msgr2=0x7f04600afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.140+0000 7f046839d640 1 --2- 172.21.15.112:0/3930639478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046015b570 0x7f04600afe20 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f0458007e40 tx=0x7f045800e4b0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.140+0000 7f046839d640 1 -- 172.21.15.112:0/3930639478 shutdown_connections 2024-09-15T23:59:02.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.140+0000 7f046839d640 1 --2- 172.21.15.112:0/3930639478 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f04440678c0 0x7f0444069d80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.140+0000 7f046839d640 1 --2- 172.21.15.112:0/3930639478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f046015b570 0x7f04600afe20 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.140+0000 7f046839d640 1 --2- 172.21.15.112:0/3930639478 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04600b51b0 0x7f04600af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.140+0000 7f046839d640 1 --2- 172.21.15.112:0/3930639478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04600b3330 0x7f046015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.140+0000 7f046839d640 1 -- 172.21.15.112:0/3930639478 >> 172.21.15.112:0/3930639478 conn(0x7f04600b6870 msgr2=0x7f04600b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:02.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.140+0000 7f046839d640 1 -- 172.21.15.112:0/3930639478 shutdown_connections 2024-09-15T23:59:02.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.140+0000 7f046839d640 1 -- 172.21.15.112:0/3930639478 wait complete. 2024-09-15T23:59:02.160 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:53:39.301069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:59:02.160 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:59:02.279 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.280+0000 7fc65d3f5640 1 Processor -- start 2024-09-15T23:59:02.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.280+0000 7fc65d3f5640 1 -- start start 2024-09-15T23:59:02.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.280+0000 7fc65d3f5640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc6580d3060 0x7fc6580cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.280+0000 7fc65d3f5640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6580d0300 con 0x7fc658161a60 2024-09-15T23:59:02.280 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.280+0000 7fc65d3f5640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6580b0f60 con 0x7fc6580cf450 2024-09-15T23:59:02.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.280+0000 7fc65d3f5640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc6580cfd40 con 0x7fc6580d3060 2024-09-15T23:59:02.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.280+0000 7fc656ffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc658161a60 0x7fc6580d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44944/0 (socket says 172.21.15.112:44944) 2024-09-15T23:59:02.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.280+0000 7fc656ffd640 1 -- 172.21.15.112:0/322700332 learned_addr learned my addr 172.21.15.112:0/322700332 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:02.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.280+0000 7fc6567fc640 1 --2- 172.21.15.112:0/322700332 >> v2:172.21.15.112:3300/0 conn(0x7fc6580d3060 0x7fc6580cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.280+0000 7fc6567fc640 1 -- 172.21.15.112:0/322700332 >> v1:172.21.15.169:6789/0 conn(0x7fc6580cf450 legacy=0x7fc65806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:02.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.280+0000 7fc6567fc640 1 -- 172.21.15.112:0/322700332 >> v1:172.21.15.112:6789/0 conn(0x7fc658161a60 legacy=0x7fc6580d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.281 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.280+0000 7fc6567fc640 1 -- 172.21.15.112:0/322700332 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6580d0020 con 0x7fc6580d3060 2024-09-15T23:59:02.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc6567fc640 1 --2- 172.21.15.112:0/322700332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6580d3060 0x7fc6580cef10 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc6480097c0 tx=0x7fc64801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9307f55f12deecd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:02.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc655ffb640 1 -- 172.21.15.112:0/322700332 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6480b1070 con 0x7fc6580d3060 2024-09-15T23:59:02.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc655ffb640 1 -- 172.21.15.112:0/322700332 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6480ac600 con 0x7fc6580d3060 2024-09-15T23:59:02.283 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc655ffb640 1 -- 172.21.15.112:0/322700332 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6480ac9d0 con 0x7fc6580d3060 2024-09-15T23:59:02.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 -- 172.21.15.112:0/322700332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6580d3060 msgr2=0x7fc6580cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 --2- 172.21.15.112:0/322700332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6580d3060 0x7fc6580cef10 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc6480097c0 tx=0x7fc64801c3a0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 -- 172.21.15.112:0/322700332 shutdown_connections 2024-09-15T23:59:02.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 --2- 172.21.15.112:0/322700332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6580d3060 0x7fc6580cef10 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 -- 172.21.15.112:0/322700332 >> 172.21.15.112:0/322700332 conn(0x7fc65808bf90 msgr2=0x7fc65809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:02.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 -- 172.21.15.112:0/322700332 shutdown_connections 2024-09-15T23:59:02.284 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 -- 172.21.15.112:0/322700332 wait complete. 2024-09-15T23:59:02.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 Processor -- start 2024-09-15T23:59:02.285 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 -- start start 2024-09-15T23:59:02.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6580cf450 0x7fc658155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6580d3060 0x7fc6580b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc658161a60 0x7fc658157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc65816bf30 con 0x7fc658161a60 2024-09-15T23:59:02.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc65816c0b0 con 0x7fc6580cf450 2024-09-15T23:59:02.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc65d3f5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc65816c230 con 0x7fc6580d3060 2024-09-15T23:59:02.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc6577fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc658161a60 0x7fc658157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc6577fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc658161a60 0x7fc658157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54726/0 (socket says 172.21.15.112:54726) 2024-09-15T23:59:02.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc6577fe640 1 -- 172.21.15.112:0/1620984397 learned_addr learned my addr 172.21.15.112:0/1620984397 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:02.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc656ffd640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6580cf450 0x7fc658155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc6577fe640 1 -- 172.21.15.112:0/1620984397 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6580d3060 msgr2=0x7fc6580b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc6567fc640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6580d3060 0x7fc6580b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc6577fe640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6580d3060 0x7fc6580b7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc6577fe640 1 -- 172.21.15.112:0/1620984397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6580cf450 msgr2=0x7fc658155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc6577fe640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6580cf450 0x7fc658155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc6577fe640 1 -- 172.21.15.112:0/1620984397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc658068ce0 con 0x7fc658161a60 2024-09-15T23:59:02.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc656ffd640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6580cf450 0x7fc658155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:02.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.284+0000 7fc6577fe640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc658161a60 0x7fc658157b00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc65000c780 tx=0x7fc65000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:02.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.288+0000 7fc63f7fe640 1 -- 172.21.15.112:0/1620984397 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc650004b70 con 0x7fc658161a60 2024-09-15T23:59:02.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.288+0000 7fc63f7fe640 1 -- 172.21.15.112:0/1620984397 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc650004d10 con 0x7fc658161a60 2024-09-15T23:59:02.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.288+0000 7fc63f7fe640 1 -- 172.21.15.112:0/1620984397 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65000aa90 con 0x7fc658161a60 2024-09-15T23:59:02.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.288+0000 7fc65d3f5640 1 -- 172.21.15.112:0/1620984397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6580d1bd0 con 0x7fc658161a60 2024-09-15T23:59:02.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.288+0000 7fc65d3f5640 1 -- 172.21.15.112:0/1620984397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6580b8520 con 0x7fc658161a60 2024-09-15T23:59:02.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.288+0000 7fc65d3f5640 1 -- 172.21.15.112:0/1620984397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6580cef10 con 0x7fc658161a60 2024-09-15T23:59:02.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.288+0000 7fc63f7fe640 1 -- 172.21.15.112:0/1620984397 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc65000ac30 con 0x7fc658161a60 2024-09-15T23:59:02.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.288+0000 7fc63f7fe640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc6440678f0 0x7fc644069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.288+0000 7fc63f7fe640 1 -- 172.21.15.112:0/1620984397 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5421+0+0 (secure 0 0 0) 0x7fc650085ed0 con 0x7fc658161a60 2024-09-15T23:59:02.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.288+0000 7fc656ffd640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc6440678f0 0x7fc644069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.288+0000 7fc656ffd640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc6440678f0 0x7fc644069db0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc64c007fd0 tx=0x7fc64c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:02.294 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.292+0000 7fc63f7fe640 1 -- 172.21.15.112:0/1620984397 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc650020070 con 0x7fc658161a60 2024-09-15T23:59:02.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.444+0000 7fc65d3f5640 1 -- 172.21.15.112:0/1620984397 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc65809da10 con 0x7fc658161a60 2024-09-15T23:59:02.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.444+0000 7fc63f7fe640 1 -- 172.21.15.112:0/1620984397 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) ==== 93+0+10 (secure 0 0 0) 0x7fc650056aa0 con 0x7fc658161a60 2024-09-15T23:59:02.445 INFO:teuthology.orchestra.run.smithi112.stdout:pg_num: 1 2024-09-15T23:59:02.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.448+0000 7fc65d3f5640 1 -- 172.21.15.112:0/1620984397 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc6440678f0 msgr2=0x7fc644069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.448+0000 7fc65d3f5640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc6440678f0 0x7fc644069db0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc64c007fd0 tx=0x7fc64c009040 comp rx=0 tx=0).stop 2024-09-15T23:59:02.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.448+0000 7fc65d3f5640 1 -- 172.21.15.112:0/1620984397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc658161a60 msgr2=0x7fc658157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.448+0000 7fc65d3f5640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc658161a60 0x7fc658157b00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc65000c780 tx=0x7fc65000cc40 comp rx=0 tx=0).stop 2024-09-15T23:59:02.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.448+0000 7fc65d3f5640 1 -- 172.21.15.112:0/1620984397 shutdown_connections 2024-09-15T23:59:02.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.448+0000 7fc65d3f5640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc6440678f0 0x7fc644069db0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.448+0000 7fc65d3f5640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc658161a60 0x7fc658157b00 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.448+0000 7fc65d3f5640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6580d3060 0x7fc6580b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.448+0000 7fc65d3f5640 1 --2- 172.21.15.112:0/1620984397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6580cf450 0x7fc658155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.448+0000 7fc65d3f5640 1 -- 172.21.15.112:0/1620984397 >> 172.21.15.112:0/1620984397 conn(0x7fc65808bf90 msgr2=0x7fc6580d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:02.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.448+0000 7fc65d3f5640 1 -- 172.21.15.112:0/1620984397 shutdown_connections 2024-09-15T23:59:02.448 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.448+0000 7fc65d3f5640 1 -- 172.21.15.112:0/1620984397 wait complete. 2024-09-15T23:59:02.464 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration' 2024-09-15T23:59:02.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.584+0000 7f0762cf9640 1 Processor -- start 2024-09-15T23:59:02.583 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.584+0000 7f0762cf9640 1 -- start start 2024-09-15T23:59:02.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.584+0000 7f0762cf9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f075c15bec0 0x7f075c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.584+0000 7f0762cf9640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f075c0b3290 con 0x7f075c0af470 2024-09-15T23:59:02.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.584+0000 7f0762cf9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f075c0b3570 con 0x7f075c15c2a0 2024-09-15T23:59:02.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.584+0000 7f0762cf9640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f075c0b3850 con 0x7f075c15bec0 2024-09-15T23:59:02.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.584+0000 7f0760a95640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f075c15bec0 0x7f075c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.584+0000 7f0761296640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f075c0af470 0x7f075c06e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44954/0 (socket says 172.21.15.112:44954) 2024-09-15T23:59:02.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.584+0000 7f0761296640 1 -- 172.21.15.112:0/4006375308 learned_addr learned my addr 172.21.15.112:0/4006375308 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:02.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.584+0000 7f0760a95640 1 -- 172.21.15.112:0/4006375308 >> v1:172.21.15.169:6789/0 conn(0x7f075c15c2a0 legacy=0x7f075c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:02.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.584+0000 7f075b7fe640 1 -- 172.21.15.112:0/4006375308 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2720782467 0 0) 0x7f075c0b3290 con 0x7f075c0af470 2024-09-15T23:59:02.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.584+0000 7f0760a95640 1 -- 172.21.15.112:0/4006375308 >> v1:172.21.15.112:6789/0 conn(0x7f075c0af470 legacy=0x7f075c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.584+0000 7f0760a95640 1 -- 172.21.15.112:0/4006375308 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075c0b3b30 con 0x7f075c15bec0 2024-09-15T23:59:02.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0760a95640 1 --2- 172.21.15.112:0/4006375308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c15bec0 0x7f075c0ad200 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f07500097c0 tx=0x7f075001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86258f507f33f3ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:02.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f075b7fe640 1 -- 172.21.15.112:0/4006375308 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07500a7070 con 0x7f075c15bec0 2024-09-15T23:59:02.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f075b7fe640 1 -- 172.21.15.112:0/4006375308 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07500b0070 con 0x7f075c15bec0 2024-09-15T23:59:02.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f075b7fe640 1 -- 172.21.15.112:0/4006375308 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07500ab890 con 0x7f075c15bec0 2024-09-15T23:59:02.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 -- 172.21.15.112:0/4006375308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c15bec0 msgr2=0x7f075c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 --2- 172.21.15.112:0/4006375308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c15bec0 0x7f075c0ad200 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f07500097c0 tx=0x7f075001c470 comp rx=0 tx=0).stop 2024-09-15T23:59:02.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 -- 172.21.15.112:0/4006375308 shutdown_connections 2024-09-15T23:59:02.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 --2- 172.21.15.112:0/4006375308 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c15bec0 0x7f075c0ad200 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 -- 172.21.15.112:0/4006375308 >> 172.21.15.112:0/4006375308 conn(0x7f075c0b1f90 msgr2=0x7f075c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:02.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 -- 172.21.15.112:0/4006375308 shutdown_connections 2024-09-15T23:59:02.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 -- 172.21.15.112:0/4006375308 wait complete. 2024-09-15T23:59:02.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 Processor -- start 2024-09-15T23:59:02.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 -- start start 2024-09-15T23:59:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c0af470 0x7f075c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f075c15bec0 0x7f075c14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f075c15c2a0 0x7f075c1f8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f075c06ef20 con 0x7f075c0af470 2024-09-15T23:59:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f075c0ad740 con 0x7f075c15bec0 2024-09-15T23:59:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f075c06f0a0 con 0x7f075c15c2a0 2024-09-15T23:59:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0760a95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c0af470 0x7f075c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0760a95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c0af470 0x7f075c154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54752/0 (socket says 172.21.15.112:54752) 2024-09-15T23:59:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0760a95640 1 -- 172.21.15.112:0/2413571781 learned_addr learned my addr 172.21.15.112:0/2413571781 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:02.591 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f075bfff640 1 --2- 172.21.15.112:0/2413571781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f075c15bec0 0x7f075c14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0760a95640 1 -- 172.21.15.112:0/2413571781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f075c15c2a0 msgr2=0x7f075c1f8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0760a95640 1 --2- 172.21.15.112:0/2413571781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f075c15c2a0 0x7f075c1f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0760a95640 1 -- 172.21.15.112:0/2413571781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f075c15bec0 msgr2=0x7f075c14d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0760a95640 1 --2- 172.21.15.112:0/2413571781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f075c15bec0 0x7f075c14d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0760a95640 1 -- 172.21.15.112:0/2413571781 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075c14a640 con 0x7f075c0af470 2024-09-15T23:59:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0760a95640 1 --2- 172.21.15.112:0/2413571781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c0af470 0x7f075c154f10 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f07500ad040 tx=0x7f075001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f07597fa640 1 -- 172.21.15.112:0/2413571781 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07500bf610 con 0x7f075c0af470 2024-09-15T23:59:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f07597fa640 1 -- 172.21.15.112:0/2413571781 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07500bf7b0 con 0x7f075c0af470 2024-09-15T23:59:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f0762cf9640 1 -- 172.21.15.112:0/2413571781 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f075c157f20 con 0x7f075c0af470 2024-09-15T23:59:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.588+0000 7f07597fa640 1 -- 172.21.15.112:0/2413571781 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07500bfba0 con 0x7f075c0af470 2024-09-15T23:59:02.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.592+0000 7f0762cf9640 1 -- 172.21.15.112:0/2413571781 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f075c14c0f0 con 0x7f075c0af470 2024-09-15T23:59:02.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.592+0000 7f0762cf9640 1 -- 172.21.15.112:0/2413571781 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f075c0ad200 con 0x7f075c0af470 2024-09-15T23:59:02.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.592+0000 7f07597fa640 1 -- 172.21.15.112:0/2413571781 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f07500bd020 con 0x7f075c0af470 2024-09-15T23:59:02.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.592+0000 7f07597fa640 1 --2- 172.21.15.112:0/2413571781 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f07480678f0 0x7f0748069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.592+0000 7f07597fa640 1 -- 172.21.15.112:0/2413571781 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5421+0+0 (secure 0 0 0) 0x7f0750120470 con 0x7f075c0af470 2024-09-15T23:59:02.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.592+0000 7f075bfff640 1 --2- 172.21.15.112:0/2413571781 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f07480678f0 0x7f0748069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.592+0000 7f075bfff640 1 --2- 172.21.15.112:0/2413571781 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f07480678f0 0x7f0748069db0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f075c09e550 tx=0x7f074c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:02.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.596+0000 7f07597fa640 1 -- 172.21.15.112:0/2413571781 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0750016090 con 0x7f075c0af470 2024-09-15T23:59:02.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.816+0000 7f0762cf9640 1 -- 172.21.15.112:0/2413571781 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration"]} v 0) -- 0x7f075c06fcd0 con 0x7f075c0af470 2024-09-15T23:59:02.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.828+0000 7f07597fa640 1 -- 172.21.15.112:0/2413571781 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration"]}]=0 v279) ==== 145+0+0 (secure 0 0 0) 0x7f07500f1030 con 0x7f075c0af470 2024-09-15T23:59:02.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.828+0000 7f0762cf9640 1 -- 172.21.15.112:0/2413571781 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f07480678f0 msgr2=0x7f0748069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.828+0000 7f0762cf9640 1 --2- 172.21.15.112:0/2413571781 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f07480678f0 0x7f0748069db0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f075c09e550 tx=0x7f074c009040 comp rx=0 tx=0).stop 2024-09-15T23:59:02.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.828+0000 7f0762cf9640 1 -- 172.21.15.112:0/2413571781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c0af470 msgr2=0x7f075c154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.828+0000 7f0762cf9640 1 --2- 172.21.15.112:0/2413571781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c0af470 0x7f075c154f10 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f07500ad040 tx=0x7f075001acb0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.828+0000 7f0762cf9640 1 -- 172.21.15.112:0/2413571781 shutdown_connections 2024-09-15T23:59:02.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.828+0000 7f0762cf9640 1 --2- 172.21.15.112:0/2413571781 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f07480678f0 0x7f0748069db0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.828+0000 7f0762cf9640 1 --2- 172.21.15.112:0/2413571781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f075c15c2a0 0x7f075c1f8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.828+0000 7f0762cf9640 1 --2- 172.21.15.112:0/2413571781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f075c15bec0 0x7f075c14d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.828+0000 7f0762cf9640 1 --2- 172.21.15.112:0/2413571781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f075c0af470 0x7f075c154f10 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.828+0000 7f0762cf9640 1 -- 172.21.15.112:0/2413571781 >> 172.21.15.112:0/2413571781 conn(0x7f075c0b1f90 msgr2=0x7f075c159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.828+0000 7f0762cf9640 1 -- 172.21.15.112:0/2413571781 shutdown_connections 2024-09-15T23:59:02.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.828+0000 7f0762cf9640 1 -- 172.21.15.112:0/2413571781 wait complete. 2024-09-15T23:59:02.846 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:59:02.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab7c41a640 1 Processor -- start 2024-09-15T23:59:02.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab7c41a640 1 -- start start 2024-09-15T23:59:02.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab7c41a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab741520a0 0x7fab7406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab7c41a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fab7415f3a0 0x7fab740adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab7c41a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab74070250 con 0x7fab7406fe50 2024-09-15T23:59:02.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab7c41a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fab74152480 con 0x7fab7415f3a0 2024-09-15T23:59:02.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab7c41a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fab740aede0 con 0x7fab741520a0 2024-09-15T23:59:02.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab7a1b6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab741520a0 0x7fab7406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab7a9b7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fab7415f3a0 0x7fab740adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab799b5640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fab7406fe50 0x7fab7415ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:48996/0 (socket says 172.21.15.112:48996) 2024-09-15T23:59:02.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab799b5640 1 -- 172.21.15.112:0/3527220174 learned_addr learned my addr 172.21.15.112:0/3527220174 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:02.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab7a1b6640 1 -- 172.21.15.112:0/3527220174 >> v2:172.21.15.169:3300/0 conn(0x7fab7415f3a0 msgr2=0x7fab740adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:02.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab7a1b6640 1 --2- 172.21.15.112:0/3527220174 >> v2:172.21.15.169:3300/0 conn(0x7fab7415f3a0 0x7fab740adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab7a1b6640 1 -- 172.21.15.112:0/3527220174 >> v1:172.21.15.169:6789/0 conn(0x7fab7406fe50 legacy=0x7fab7415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab7a1b6640 1 -- 172.21.15.112:0/3527220174 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7415fa10 con 0x7fab741520a0 2024-09-15T23:59:02.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.968+0000 7fab7a9b7640 1 --2- 172.21.15.112:0/3527220174 >> v2:172.21.15.169:3300/0 conn(0x7fab7415f3a0 0x7fab740adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:59:02.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7a1b6640 1 --2- 172.21.15.112:0/3527220174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab741520a0 0x7fab7406f910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fab640097c0 tx=0x7fab6401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afe82366233a2f1c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:02.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab791b4640 1 -- 172.21.15.112:0/3527220174 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab640aa600 con 0x7fab741520a0 2024-09-15T23:59:02.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab791b4640 1 -- 172.21.15.112:0/3527220174 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab640af070 con 0x7fab741520a0 2024-09-15T23:59:02.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab791b4640 1 -- 172.21.15.112:0/3527220174 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab640aa9c0 con 0x7fab741520a0 2024-09-15T23:59:02.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 -- 172.21.15.112:0/3527220174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab741520a0 msgr2=0x7fab7406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 --2- 172.21.15.112:0/3527220174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab741520a0 0x7fab7406f910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fab640097c0 tx=0x7fab6401c4a0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 -- 172.21.15.112:0/3527220174 shutdown_connections 2024-09-15T23:59:02.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 --2- 172.21.15.112:0/3527220174 >> v2:172.21.15.169:3300/0 conn(0x7fab7415f3a0 0x7fab740adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 --2- 172.21.15.112:0/3527220174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab741520a0 0x7fab7406f910 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 -- 172.21.15.112:0/3527220174 >> 172.21.15.112:0/3527220174 conn(0x7fab740b1f90 msgr2=0x7fab740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:02.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 -- 172.21.15.112:0/3527220174 shutdown_connections 2024-09-15T23:59:02.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 -- 172.21.15.112:0/3527220174 wait complete. 2024-09-15T23:59:02.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 Processor -- start 2024-09-15T23:59:02.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 -- start start 2024-09-15T23:59:02.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab7406fe50 0x7fab74151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab741520a0 0x7fab740cf820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab7415f3a0 0x7fab74145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fab74073d30 con 0x7fab741520a0 2024-09-15T23:59:02.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fab74073a50 con 0x7fab7415f3a0 2024-09-15T23:59:02.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7c41a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fab74167f10 con 0x7fab7406fe50 2024-09-15T23:59:02.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab799b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab741520a0 0x7fab740cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab799b5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab741520a0 0x7fab740cf820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54760/0 (socket says 172.21.15.112:54760) 2024-09-15T23:59:02.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab799b5640 1 -- 172.21.15.112:0/2398911396 learned_addr learned my addr 172.21.15.112:0/2398911396 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:02.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7a9b7640 1 --2- 172.21.15.112:0/2398911396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab7415f3a0 0x7fab74145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.972+0000 7fab7a1b6640 1 --2- 172.21.15.112:0/2398911396 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab7406fe50 0x7fab74151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab799b5640 1 -- 172.21.15.112:0/2398911396 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab7406fe50 msgr2=0x7fab74151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab799b5640 1 --2- 172.21.15.112:0/2398911396 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab7406fe50 0x7fab74151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab799b5640 1 -- 172.21.15.112:0/2398911396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab7415f3a0 msgr2=0x7fab74145280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:02.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab799b5640 1 --2- 172.21.15.112:0/2398911396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab7415f3a0 0x7fab74145280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:02.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab799b5640 1 -- 172.21.15.112:0/2398911396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab741507d0 con 0x7fab741520a0 2024-09-15T23:59:02.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab799b5640 1 --2- 172.21.15.112:0/2398911396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab741520a0 0x7fab740cf820 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fab70001ec0 tx=0x7fab7000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:02.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab6affd640 1 -- 172.21.15.112:0/2398911396 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70017070 con 0x7fab741520a0 2024-09-15T23:59:02.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab6affd640 1 -- 172.21.15.112:0/2398911396 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab70005cf0 con 0x7fab741520a0 2024-09-15T23:59:02.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab6affd640 1 -- 172.21.15.112:0/2398911396 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab700072d0 con 0x7fab741520a0 2024-09-15T23:59:02.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab7c41a640 1 -- 172.21.15.112:0/2398911396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab74150ab0 con 0x7fab741520a0 2024-09-15T23:59:02.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab7c41a640 1 -- 172.21.15.112:0/2398911396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab74151350 con 0x7fab741520a0 2024-09-15T23:59:02.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab7c41a640 1 -- 172.21.15.112:0/2398911396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab74150c80 con 0x7fab741520a0 2024-09-15T23:59:02.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab6affd640 1 -- 172.21.15.112:0/2398911396 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fab7001a070 con 0x7fab741520a0 2024-09-15T23:59:02.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab6affd640 1 --2- 172.21.15.112:0/2398911396 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fab580678c0 0x7fab58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:02.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab6affd640 1 -- 172.21.15.112:0/2398911396 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5421+0+0 (secure 0 0 0) 0x7fab70084db0 con 0x7fab741520a0 2024-09-15T23:59:02.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab7a1b6640 1 --2- 172.21.15.112:0/2398911396 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fab580678c0 0x7fab58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:02.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.976+0000 7fab7a1b6640 1 --2- 172.21.15.112:0/2398911396 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fab580678c0 0x7fab58069d80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fab640ae000 tx=0x7fab640a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:02.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:02.980+0000 7fab6affd640 1 -- 172.21.15.112:0/2398911396 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fab700553c0 con 0x7fab741520a0 2024-09-15T23:59:03.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.140+0000 7fab7c41a640 1 -- 172.21.15.112:0/2398911396 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fab7406f910 con 0x7fab741520a0 2024-09-15T23:59:03.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.148+0000 7fab6affd640 1 -- 172.21.15.112:0/2398911396 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7fab700596c0 con 0x7fab741520a0 2024-09-15T23:59:03.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.148+0000 7fab7c41a640 1 -- 172.21.15.112:0/2398911396 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fab580678c0 msgr2=0x7fab58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:03.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.148+0000 7fab7c41a640 1 --2- 172.21.15.112:0/2398911396 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fab580678c0 0x7fab58069d80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fab640ae000 tx=0x7fab640a7000 comp rx=0 tx=0).stop 2024-09-15T23:59:03.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.148+0000 7fab7c41a640 1 -- 172.21.15.112:0/2398911396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab741520a0 msgr2=0x7fab740cf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:03.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.148+0000 7fab7c41a640 1 --2- 172.21.15.112:0/2398911396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab741520a0 0x7fab740cf820 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fab70001ec0 tx=0x7fab7000c890 comp rx=0 tx=0).stop 2024-09-15T23:59:03.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.148+0000 7fab7c41a640 1 -- 172.21.15.112:0/2398911396 shutdown_connections 2024-09-15T23:59:03.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.148+0000 7fab7c41a640 1 --2- 172.21.15.112:0/2398911396 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fab580678c0 0x7fab58069d80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.148+0000 7fab7c41a640 1 --2- 172.21.15.112:0/2398911396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab7415f3a0 0x7fab74145280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.148+0000 7fab7c41a640 1 --2- 172.21.15.112:0/2398911396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab741520a0 0x7fab740cf820 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.148+0000 7fab7c41a640 1 --2- 172.21.15.112:0/2398911396 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab7406fe50 0x7fab74151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.148+0000 7fab7c41a640 1 -- 172.21.15.112:0/2398911396 >> 172.21.15.112:0/2398911396 conn(0x7fab740b1f90 msgr2=0x7fab740b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:03.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.148+0000 7fab7c41a640 1 -- 172.21.15.112:0/2398911396 shutdown_connections 2024-09-15T23:59:03.152 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.148+0000 7fab7c41a640 1 -- 172.21.15.112:0/2398911396 wait complete. 2024-09-15T23:59:03.166 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:59:03.166 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:59:03.236 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:59:03.315 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:59:03.316 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:59:03.316 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:59:03.321 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:59:03.321 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:59:03.322 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:59:03.327 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:59:03.327 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:59:03.327 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:59:03.367 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:59:03.368 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:59:03.368 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:59:03.375 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:59:03.375 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:59:03.375 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:59:03.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcf3d1640 1 Processor -- start 2024-09-15T23:59:03.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcf3d1640 1 -- start start 2024-09-15T23:59:03.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcf3d1640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdbc81587a0 0x7fdbc80b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:03.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcf3d1640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdbc806e680 0x7fdbc8072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:03.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcf3d1640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc806ec60 con 0x7fdbc80b37d0 2024-09-15T23:59:03.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcf3d1640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fdbc80b3c40 con 0x7fdbc806e680 2024-09-15T23:59:03.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcf3d1640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fdbc806f870 con 0x7fdbc81587a0 2024-09-15T23:59:03.537 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcd96e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdbc806e680 0x7fdbc8072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:03.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcd96e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fdbc806e680 0x7fdbc8072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54766/0 (socket says 172.21.15.112:54766) 2024-09-15T23:59:03.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcd96e640 1 -- 172.21.15.112:0/468423718 learned_addr learned my addr 172.21.15.112:0/468423718 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:03.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcd16d640 1 --2- 172.21.15.112:0/468423718 >> v2:172.21.15.169:3300/0 conn(0x7fdbc81587a0 0x7fdbc80b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:03.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcd96e640 1 -- 172.21.15.112:0/468423718 >> v2:172.21.15.169:3300/0 conn(0x7fdbc81587a0 msgr2=0x7fdbc80b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:03.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcd96e640 1 --2- 172.21.15.112:0/468423718 >> v2:172.21.15.169:3300/0 conn(0x7fdbc81587a0 0x7fdbc80b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcd96e640 1 -- 172.21.15.112:0/468423718 >> v1:172.21.15.169:6789/0 conn(0x7fdbc80b37d0 legacy=0x7fdbc806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:03.538 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.536+0000 7fdbcd96e640 1 -- 172.21.15.112:0/468423718 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc806ef40 con 0x7fdbc806e680 2024-09-15T23:59:03.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcd96e640 1 --2- 172.21.15.112:0/468423718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc806e680 0x7fdbc8072160 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8071710 tx=0x7fdbc001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d080dc3e3609c45 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:03.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbbffff640 1 -- 172.21.15.112:0/468423718 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc00a5840 con 0x7fdbc806e680 2024-09-15T23:59:03.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbbffff640 1 -- 172.21.15.112:0/468423718 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc00a59e0 con 0x7fdbc806e680 2024-09-15T23:59:03.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbbffff640 1 -- 172.21.15.112:0/468423718 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc00a5db0 con 0x7fdbc806e680 2024-09-15T23:59:03.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/468423718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc806e680 msgr2=0x7fdbc8072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:03.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 --2- 172.21.15.112:0/468423718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc806e680 0x7fdbc8072160 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8071710 tx=0x7fdbc001c980 comp rx=0 tx=0).stop 2024-09-15T23:59:03.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/468423718 shutdown_connections 2024-09-15T23:59:03.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 --2- 172.21.15.112:0/468423718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc806e680 0x7fdbc8072160 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 --2- 172.21.15.112:0/468423718 >> v2:172.21.15.169:3300/0 conn(0x7fdbc81587a0 0x7fdbc80b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/468423718 >> 172.21.15.112:0/468423718 conn(0x7fdbc80b1f90 msgr2=0x7fdbc80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:03.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/468423718 shutdown_connections 2024-09-15T23:59:03.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/468423718 wait complete. 2024-09-15T23:59:03.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 Processor -- start 2024-09-15T23:59:03.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 -- start start 2024-09-15T23:59:03.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc806e680 0x7fdbc8147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:03.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbc80b37d0 0x7fdbc809ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:03.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbc81587a0 0x7fdbc81f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:03.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc8073030 con 0x7fdbc806e680 2024-09-15T23:59:03.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc8072eb0 con 0x7fdbc80b37d0 2024-09-15T23:59:03.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc80731b0 con 0x7fdbc81587a0 2024-09-15T23:59:03.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcd16d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc806e680 0x7fdbc8147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:03.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcd16d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc806e680 0x7fdbc8147130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54776/0 (socket says 172.21.15.112:54776) 2024-09-15T23:59:03.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcd16d640 1 -- 172.21.15.112:0/1256618905 learned_addr learned my addr 172.21.15.112:0/1256618905 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:03.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcd16d640 1 -- 172.21.15.112:0/1256618905 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbc81587a0 msgr2=0x7fdbc81f0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:03.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcd16d640 1 --2- 172.21.15.112:0/1256618905 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbc81587a0 0x7fdbc81f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcd16d640 1 -- 172.21.15.112:0/1256618905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbc80b37d0 msgr2=0x7fdbc809ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:03.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcd16d640 1 --2- 172.21.15.112:0/1256618905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbc80b37d0 0x7fdbc809ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcd16d640 1 -- 172.21.15.112:0/1256618905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc815b5e0 con 0x7fdbc806e680 2024-09-15T23:59:03.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcd16d640 1 --2- 172.21.15.112:0/1256618905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc806e680 0x7fdbc8147130 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400d5f0 tx=0x7fdbc400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:03.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbbdffb640 1 -- 172.21.15.112:0/1256618905 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40125f0 con 0x7fdbc806e680 2024-09-15T23:59:03.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbbdffb640 1 -- 172.21.15.112:0/1256618905 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc4019070 con 0x7fdbc806e680 2024-09-15T23:59:03.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/1256618905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc815b8c0 con 0x7fdbc806e680 2024-09-15T23:59:03.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbbdffb640 1 -- 172.21.15.112:0/1256618905 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40129b0 con 0x7fdbc806e680 2024-09-15T23:59:03.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.540+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/1256618905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc815c160 con 0x7fdbc806e680 2024-09-15T23:59:03.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.544+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/1256618905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc8072160 con 0x7fdbc806e680 2024-09-15T23:59:03.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.544+0000 7fdbbdffb640 1 -- 172.21.15.112:0/1256618905 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdbc4012b50 con 0x7fdbc806e680 2024-09-15T23:59:03.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.544+0000 7fdbbdffb640 1 --2- 172.21.15.112:0/1256618905 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdbac0678c0 0x7fdbac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:03.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.544+0000 7fdbbdffb640 1 -- 172.21.15.112:0/1256618905 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5421+0+0 (secure 0 0 0) 0x7fdbc4085f00 con 0x7fdbc806e680 2024-09-15T23:59:03.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.544+0000 7fdbcc96c640 1 --2- 172.21.15.112:0/1256618905 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdbac0678c0 0x7fdbac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:03.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.544+0000 7fdbcc96c640 1 --2- 172.21.15.112:0/1256618905 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdbac0678c0 0x7fdbac069d80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80999f0 tx=0x7fdbb80079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:03.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.548+0000 7fdbbdffb640 1 -- 172.21.15.112:0/1256618905 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdbc4011340 con 0x7fdbc806e680 2024-09-15T23:59:03.729 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.728+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/1256618905 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdbc8070080 con 0x7fdbc806e680 2024-09-15T23:59:03.730 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.728+0000 7fdbbdffb640 1 -- 172.21.15.112:0/1256618905 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+3917 (secure 0 0 0) 0x7fdbc4056bf0 con 0x7fdbc806e680 2024-09-15T23:59:03.730 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:03.730 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":66,"btime":"2024-09-15T23:58:58:807210+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/4137960922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":4137960922},{"type":"v1","addr":"172.21.15.169:6833","nonce":4137960922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":5710,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/142213197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":142213197},{"type":"v1","addr":"172.21.15.169:6835","nonce":142213197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6948,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/891271609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":891271609},{"type":"v1","addr":"172.21.15.112:6837","nonce":891271609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7128,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3976424798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3976424798},{"type":"v1","addr":"172.21.15.112:6835","nonce":3976424798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[]} 2024-09-15T23:59:03.730 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 66 2024-09-15T23:59:03.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.732+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/1256618905 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdbac0678c0 msgr2=0x7fdbac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:03.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.732+0000 7fdbcf3d1640 1 --2- 172.21.15.112:0/1256618905 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdbac0678c0 0x7fdbac069d80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80999f0 tx=0x7fdbb80079c0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.732+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/1256618905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc806e680 msgr2=0x7fdbc8147130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:03.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.732+0000 7fdbcf3d1640 1 --2- 172.21.15.112:0/1256618905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc806e680 0x7fdbc8147130 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400d5f0 tx=0x7fdbc400dab0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.732+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/1256618905 shutdown_connections 2024-09-15T23:59:03.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.732+0000 7fdbcf3d1640 1 --2- 172.21.15.112:0/1256618905 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdbac0678c0 0x7fdbac069d80 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.732+0000 7fdbcf3d1640 1 --2- 172.21.15.112:0/1256618905 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbc81587a0 0x7fdbc81f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.732+0000 7fdbcf3d1640 1 --2- 172.21.15.112:0/1256618905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbc80b37d0 0x7fdbc809ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.732+0000 7fdbcf3d1640 1 --2- 172.21.15.112:0/1256618905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc806e680 0x7fdbc8147130 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.732+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/1256618905 >> 172.21.15.112:0/1256618905 conn(0x7fdbc80b1f90 msgr2=0x7fdbc815f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:03.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.732+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/1256618905 shutdown_connections 2024-09-15T23:59:03.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.732+0000 7fdbcf3d1640 1 -- 172.21.15.112:0/1256618905 wait complete. 2024-09-15T23:59:03.748 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:59:03.748 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:59:03.749 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:59:03.749 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:03.749 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:59:03.749 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:59:03.749 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:59:03.749 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:03.749 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:59:03.750 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:59:03.750 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:59:03.750 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:03.750 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:59:03.750 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:59:03.750 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:59:03.750 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:03.760 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:59:03.760 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:59:03.761 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:59:03.761 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:59:03.763 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:59:03.764 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:59:03.764 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:59:03.764 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:59:03.804 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:59:03.804 DEBUG:teuthology.parallel:result is None 2024-09-15T23:59:03.805 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:59:03.805 DEBUG:teuthology.parallel:result is None 2024-09-15T23:59:03.811 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:59:03.812 DEBUG:teuthology.parallel:result is None 2024-09-15T23:59:03.812 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:59:03.812 DEBUG:teuthology.parallel:result is None 2024-09-15T23:59:03.812 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:59:03.864 INFO:tasks.ceph.mds.c.smithi112.stdout:starting mds.c at 2024-09-15T23:59:03.870 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-15T23:59:03.885 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-09-15T23:59:03.886 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-09-15T23:59:03.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.924+0000 7f5a6e1c8640 1 Processor -- start 2024-09-15T23:59:03.926 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.924+0000 7f5a6e1c8640 1 -- start start 2024-09-15T23:59:03.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.924+0000 7f5a6e1c8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5a68073e60 0x7f5a6806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:03.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.924+0000 7f5a6e1c8640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a6806ee50 con 0x7f5a680b3d50 2024-09-15T23:59:03.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.924+0000 7f5a6e1c8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a6806f130 con 0x7f5a6806fef0 2024-09-15T23:59:03.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.924+0000 7f5a6e1c8640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5a6806f410 con 0x7f5a68073e60 2024-09-15T23:59:03.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.924+0000 7f5a677fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5a68073e60 0x7f5a6806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:03.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.924+0000 7f5a67fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f5a680b3d50 0x7f5a680b4130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:44986/0 (socket says 172.21.15.112:44986) 2024-09-15T23:59:03.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.924+0000 7f5a67fff640 1 -- 172.21.15.112:0/2263404612 learned_addr learned my addr 172.21.15.112:0/2263404612 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:03.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a677fe640 1 -- 172.21.15.112:0/2263404612 >> v1:172.21.15.169:6789/0 conn(0x7f5a6806fef0 legacy=0x7f5a6815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:03.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a677fe640 1 -- 172.21.15.112:0/2263404612 >> v1:172.21.15.112:6789/0 conn(0x7f5a680b3d50 legacy=0x7f5a680b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:03.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a677fe640 1 -- 172.21.15.112:0/2263404612 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6806f6f0 con 0x7f5a68073e60 2024-09-15T23:59:03.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a667fc640 1 -- 172.21.15.112:0/2263404612 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2677906563 0 0) 0x7f5a6806ee50 con 0x7f5a680b3d50 2024-09-15T23:59:03.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a677fe640 1 --2- 172.21.15.112:0/2263404612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a68073e60 0x7f5a6806e800 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f5a580097c0 tx=0x7f5a5801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90027491e25ec777 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:03.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a667fc640 1 -- 172.21.15.112:0/2263404612 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a580b0070 con 0x7f5a68073e60 2024-09-15T23:59:03.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a667fc640 1 -- 172.21.15.112:0/2263404612 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a580ab600 con 0x7f5a68073e60 2024-09-15T23:59:03.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a667fc640 1 -- 172.21.15.112:0/2263404612 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a580ab9d0 con 0x7f5a68073e60 2024-09-15T23:59:03.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/2263404612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a68073e60 msgr2=0x7f5a6806e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:03.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a6e1c8640 1 --2- 172.21.15.112:0/2263404612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a68073e60 0x7f5a6806e800 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f5a580097c0 tx=0x7f5a5801c410 comp rx=0 tx=0).stop 2024-09-15T23:59:03.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/2263404612 shutdown_connections 2024-09-15T23:59:03.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a6e1c8640 1 --2- 172.21.15.112:0/2263404612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a68073e60 0x7f5a6806e800 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/2263404612 >> 172.21.15.112:0/2263404612 conn(0x7f5a680b1f90 msgr2=0x7f5a680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:03.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/2263404612 shutdown_connections 2024-09-15T23:59:03.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/2263404612 wait complete. 2024-09-15T23:59:03.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.928+0000 7f5a6e1c8640 1 Processor -- start 2024-09-15T23:59:03.931 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a6e1c8640 1 -- start start 2024-09-15T23:59:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a6e1c8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a6806fef0 0x7f5a6814c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a6e1c8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a68073e60 0x7f5a68151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a6e1c8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a680b3d50 0x7f5a68098980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a6e1c8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6806e300 con 0x7f5a68073e60 2024-09-15T23:59:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a6e1c8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6806e180 con 0x7f5a6806fef0 2024-09-15T23:59:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a6e1c8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5a6806e480 con 0x7f5a680b3d50 2024-09-15T23:59:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a66ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a68073e60 0x7f5a68151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a66ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a68073e60 0x7f5a68151030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54826/0 (socket says 172.21.15.112:54826) 2024-09-15T23:59:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a66ffd640 1 -- 172.21.15.112:0/3284596989 learned_addr learned my addr 172.21.15.112:0/3284596989 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:03.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a677fe640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a6806fef0 0x7f5a6814c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a67fff640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a680b3d50 0x7f5a68098980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a66ffd640 1 -- 172.21.15.112:0/3284596989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a680b3d50 msgr2=0x7f5a68098980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a66ffd640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a680b3d50 0x7f5a68098980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a66ffd640 1 -- 172.21.15.112:0/3284596989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a6806fef0 msgr2=0x7f5a6814c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a66ffd640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a6806fef0 0x7f5a6814c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a66ffd640 1 -- 172.21.15.112:0/3284596989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a68151570 con 0x7f5a68073e60 2024-09-15T23:59:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a677fe640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a6806fef0 0x7f5a6814c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:59:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a66ffd640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a68073e60 0x7f5a68151030 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00c390 tx=0x7f5a5c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a4ffff640 1 -- 172.21.15.112:0/3284596989 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c017070 con 0x7f5a68073e60 2024-09-15T23:59:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a4ffff640 1 -- 172.21.15.112:0/3284596989 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5c0052d0 con 0x7f5a68073e60 2024-09-15T23:59:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/3284596989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a6809bf90 con 0x7f5a68073e60 2024-09-15T23:59:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a4ffff640 1 -- 172.21.15.112:0/3284596989 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c003820 con 0x7f5a68073e60 2024-09-15T23:59:03.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/3284596989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a6809c550 con 0x7f5a68073e60 2024-09-15T23:59:03.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/3284596989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a6806e7b0 con 0x7f5a68073e60 2024-09-15T23:59:03.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a4ffff640 1 -- 172.21.15.112:0/3284596989 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a5c01a070 con 0x7f5a68073e60 2024-09-15T23:59:03.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a4ffff640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a540678c0 0x7f5a54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:03.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a677fe640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a540678c0 0x7f5a54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:03.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.932+0000 7f5a4ffff640 1 -- 172.21.15.112:0/3284596989 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5421+0+0 (secure 0 0 0) 0x7f5a5c084e30 con 0x7f5a68073e60 2024-09-15T23:59:03.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.936+0000 7f5a677fe640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a540678c0 0x7f5a54069d80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5a580ad000 tx=0x7f5a580a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:03.939 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:03.940+0000 7f5a4ffff640 1 -- 172.21.15.112:0/3284596989 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5a5c005480 con 0x7f5a68073e60 2024-09-15T23:59:04.111 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:04.108+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/3284596989 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f5a680b5430 con 0x7f5a68073e60 2024-09-15T23:59:05.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.176+0000 7f5a4ffff640 1 -- 172.21.15.112:0/3284596989 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v111) ==== 97+0+0 (secure 0 0 0) 0x7f5a5c055440 con 0x7f5a68073e60 2024-09-15T23:59:05.176 INFO:teuthology.orchestra.run.smithi112.stderr: removed all blocklist entries 2024-09-15T23:59:05.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.180+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/3284596989 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a540678c0 msgr2=0x7f5a54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.180+0000 7f5a6e1c8640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a540678c0 0x7f5a54069d80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5a580ad000 tx=0x7f5a580a6000 comp rx=0 tx=0).stop 2024-09-15T23:59:05.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.180+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/3284596989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a68073e60 msgr2=0x7f5a68151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.180+0000 7f5a6e1c8640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a68073e60 0x7f5a68151030 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00c390 tx=0x7f5a5c00c850 comp rx=0 tx=0).stop 2024-09-15T23:59:05.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.180+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/3284596989 shutdown_connections 2024-09-15T23:59:05.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.180+0000 7f5a6e1c8640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a540678c0 0x7f5a54069d80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.180+0000 7f5a6e1c8640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a680b3d50 0x7f5a68098980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.180+0000 7f5a6e1c8640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a68073e60 0x7f5a68151030 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.180+0000 7f5a6e1c8640 1 --2- 172.21.15.112:0/3284596989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a6806fef0 0x7f5a6814c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.180+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/3284596989 >> 172.21.15.112:0/3284596989 conn(0x7f5a680b1f90 msgr2=0x7f5a68075230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:05.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.180+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/3284596989 shutdown_connections 2024-09-15T23:59:05.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.180+0000 7f5a6e1c8640 1 -- 172.21.15.112:0/3284596989 wait complete. 2024-09-15T23:59:05.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:59:05.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f994b475640 1 Processor -- start 2024-09-15T23:59:05.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f994b475640 1 -- start start 2024-09-15T23:59:05.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f994b475640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f99440d4920 0x7f99441691f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f994b475640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99440d2b20 con 0x7f99440b38e0 2024-09-15T23:59:05.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f994b475640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99440d2e00 con 0x7f994415e470 2024-09-15T23:59:05.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f994b475640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f99440d3bc0 con 0x7f99440d4920 2024-09-15T23:59:05.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f9948a10640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f99440b38e0 0x7f99440d4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45000/0 (socket says 172.21.15.112:45000) 2024-09-15T23:59:05.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f9948a10640 1 -- 172.21.15.112:0/762436208 learned_addr learned my addr 172.21.15.112:0/762436208 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:05.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 -- 172.21.15.112:0/762436208 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 505829937 0 0) 0x7f99440d2b20 con 0x7f99440b38e0 2024-09-15T23:59:05.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f9949a12640 1 --2- 172.21.15.112:0/762436208 >> v2:172.21.15.169:3300/0 conn(0x7f99440d4920 0x7f99441691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 -- 172.21.15.112:0/762436208 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9930003530 con 0x7f99440b38e0 2024-09-15T23:59:05.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 -- 172.21.15.112:0/762436208 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3456506957 0 0) 0x7f9930003530 con 0x7f99440b38e0 2024-09-15T23:59:05.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 -- 172.21.15.112:0/762436208 >> v2:172.21.15.169:3300/0 conn(0x7f99440d4920 msgr2=0x7f99441691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:05.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 --2- 172.21.15.112:0/762436208 >> v2:172.21.15.169:3300/0 conn(0x7f99440d4920 0x7f99441691f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 -- 172.21.15.112:0/762436208 >> v1:172.21.15.169:6789/0 conn(0x7f994415e470 legacy=0x7f99440d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 -- 172.21.15.112:0/762436208 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99440d30e0 con 0x7f99440b38e0 2024-09-15T23:59:05.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 -- 172.21.15.112:0/762436208 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f99340016d0 con 0x7f99440b38e0 2024-09-15T23:59:05.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 -- 172.21.15.112:0/762436208 >> v1:172.21.15.112:6789/0 conn(0x7f99440b38e0 legacy=0x7f99440d4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 --2- 172.21.15.112:0/762436208 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99300039c0 0x7f9930003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 --2- 172.21.15.112:0/762436208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9930004810 0x7f9930004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 --2- 172.21.15.112:0/762436208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99300051d0 0x7f993000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 -- 172.21.15.112:0/762436208 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f99440d3bc0 con 0x7f99300051d0 2024-09-15T23:59:05.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 -- 172.21.15.112:0/762436208 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f993000c170 con 0x7f9930004810 2024-09-15T23:59:05.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f993bfff640 1 -- 172.21.15.112:0/762436208 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f993000c370 con 0x7f99300039c0 2024-09-15T23:59:05.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f9949a12640 1 --2- 172.21.15.112:0/762436208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99300051d0 0x7f993000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f9948a10640 1 --2- 172.21.15.112:0/762436208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9930004810 0x7f9930004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f9949211640 1 --2- 172.21.15.112:0/762436208 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99300039c0 0x7f9930003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f9949a12640 1 -- 172.21.15.112:0/762436208 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99300039c0 msgr2=0x7f9930003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:05.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f9949a12640 1 --2- 172.21.15.112:0/762436208 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99300039c0 0x7f9930003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f9949a12640 1 -- 172.21.15.112:0/762436208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9930004810 msgr2=0x7f9930004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:05.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f9949a12640 1 --2- 172.21.15.112:0/762436208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9930004810 0x7f9930004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.316+0000 7f9949a12640 1 -- 172.21.15.112:0/762436208 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9930003530 con 0x7f99300051d0 2024-09-15T23:59:05.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f9949a12640 1 -- 172.21.15.112:0/762436208 reap_dead start 2024-09-15T23:59:05.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f9949a12640 1 --2- 172.21.15.112:0/762436208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99300051d0 0x7f993000b9d0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f993c009f70 tx=0x7f993c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fbb9a422c33b90 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:05.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f993bfff640 1 -- 172.21.15.112:0/762436208 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c0b2070 con 0x7f99300051d0 2024-09-15T23:59:05.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f993bfff640 1 -- 172.21.15.112:0/762436208 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993c0a5c20 con 0x7f99300051d0 2024-09-15T23:59:05.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f993bfff640 1 -- 172.21.15.112:0/762436208 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c009bf0 con 0x7f99300051d0 2024-09-15T23:59:05.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 -- 172.21.15.112:0/762436208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99300051d0 msgr2=0x7f993000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 --2- 172.21.15.112:0/762436208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99300051d0 0x7f993000b9d0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f993c009f70 tx=0x7f993c01cc60 comp rx=0 tx=0).stop 2024-09-15T23:59:05.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 -- 172.21.15.112:0/762436208 shutdown_connections 2024-09-15T23:59:05.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 --2- 172.21.15.112:0/762436208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99300051d0 0x7f993000b9d0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 -- 172.21.15.112:0/762436208 >> 172.21.15.112:0/762436208 conn(0x7f994409d730 msgr2=0x7f994408bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:05.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 -- 172.21.15.112:0/762436208 shutdown_connections 2024-09-15T23:59:05.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 -- 172.21.15.112:0/762436208 wait complete. 2024-09-15T23:59:05.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 Processor -- start 2024-09-15T23:59:05.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 -- start start 2024-09-15T23:59:05.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99300051d0 0x7f9944155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99441566d0 0x7f9944152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99441f5550 0x7f994415fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f99440d4210 con 0x7f99300051d0 2024-09-15T23:59:05.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f99440d3730 con 0x7f99441f5550 2024-09-15T23:59:05.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f994b475640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f99440d4390 con 0x7f99441566d0 2024-09-15T23:59:05.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f9949211640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99300051d0 0x7f9944155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f9949211640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99300051d0 0x7f9944155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54844/0 (socket says 172.21.15.112:54844) 2024-09-15T23:59:05.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.320+0000 7f9949211640 1 -- 172.21.15.112:0/140375516 learned_addr learned my addr 172.21.15.112:0/140375516 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:05.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9948a10640 1 --2- 172.21.15.112:0/140375516 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99441566d0 0x7f9944152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9949211640 1 -- 172.21.15.112:0/140375516 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99441566d0 msgr2=0x7f9944152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9949211640 1 --2- 172.21.15.112:0/140375516 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99441566d0 0x7f9944152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9949211640 1 -- 172.21.15.112:0/140375516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99441f5550 msgr2=0x7f994415fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9949211640 1 --2- 172.21.15.112:0/140375516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99441f5550 0x7f994415fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9949211640 1 -- 172.21.15.112:0/140375516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99441f44a0 con 0x7f99300051d0 2024-09-15T23:59:05.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9949211640 1 --2- 172.21.15.112:0/140375516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99300051d0 0x7f9944155d90 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f994000e4e0 tx=0x7f994000e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:05.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9939ffb640 1 -- 172.21.15.112:0/140375516 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99400052e0 con 0x7f99300051d0 2024-09-15T23:59:05.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9939ffb640 1 -- 172.21.15.112:0/140375516 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9940018070 con 0x7f99300051d0 2024-09-15T23:59:05.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9939ffb640 1 -- 172.21.15.112:0/140375516 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9940003840 con 0x7f99300051d0 2024-09-15T23:59:05.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f994b475640 1 -- 172.21.15.112:0/140375516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9944152aa0 con 0x7f99300051d0 2024-09-15T23:59:05.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f994b475640 1 -- 172.21.15.112:0/140375516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99441574f0 con 0x7f99300051d0 2024-09-15T23:59:05.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f994b475640 1 -- 172.21.15.112:0/140375516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99440d2a80 con 0x7f99300051d0 2024-09-15T23:59:05.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9939ffb640 1 -- 172.21.15.112:0/140375516 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99400039e0 con 0x7f99300051d0 2024-09-15T23:59:05.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9939ffb640 1 --2- 172.21.15.112:0/140375516 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f99280678f0 0x7f9928069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9939ffb640 1 -- 172.21.15.112:0/140375516 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5249+0+0 (secure 0 0 0) 0x7f9940085310 con 0x7f99300051d0 2024-09-15T23:59:05.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9948a10640 1 --2- 172.21.15.112:0/140375516 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f99280678f0 0x7f9928069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.324+0000 7f9948a10640 1 --2- 172.21.15.112:0/140375516 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f99280678f0 0x7f9928069db0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f99440b17a0 tx=0x7f9934000bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:05.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.328+0000 7f9939ffb640 1 -- 172.21.15.112:0/140375516 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f99400560a0 con 0x7f99300051d0 2024-09-15T23:59:05.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.548+0000 7f994b475640 1 -- 172.21.15.112:0/140375516 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f99440d2420 con 0x7f99300051d0 2024-09-15T23:59:05.548 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.548+0000 7f9939ffb640 1 -- 172.21.15.112:0/140375516 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7f9940083e20 con 0x7f99300051d0 2024-09-15T23:59:05.548 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:05.548 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:59:05.548 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_dump": [ 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.a", 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmPvLEFBAA/WS7KNQ60+LzhOcQyCVWoQ==", 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.b", 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmN/+jIxAAiXM9onNC3twhiZrqCdWtUQ==", 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.549 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.c", 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmEbNbHRAAjP+2Z2XYc0tarO48R/ocIQ==", 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mds.d", 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmg6AqLBAAZ3PKcarPcPfvIWSTnE5uLA==", 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.0", 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBRc+dmnOKMBxAAdaIaYmXKAFGIPTxfYt2apQ==", 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:59:05.551 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:59:05.552 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.552 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.552 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.1", 2024-09-15T23:59:05.552 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBUc+dmnowGFhAAa3jXrvZ0An+9IwM9988mvQ==", 2024-09-15T23:59:05.552 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.552 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:59:05.552 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:59:05.552 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.552 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.552 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.2", 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBXc+dmnj9kJRAAZbpx5TM2ukiLKqi+iZAE5g==", 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.3", 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBac+dmAdXtNxAA8g+Nxz1RyVf+P8KOtkw5qw==", 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.553 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.4", 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBhc+dmyOApAhAA9Cv9nW1b5JvO9cH9emao4A==", 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.5", 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBkc+dmFIDwDxAAR/59kfrjiLU4emIqtthfRg==", 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.554 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.6", 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBnc+dmZVB/IRAAFbvodnxisklCL/yuD+F5ew==", 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.555 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "osd.7", 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBqc+dmuty6LxAAHWB/GByU/hXOL/+dnRpcVA==", 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow profile osd", 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile osd", 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.0", 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw==", 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow r", 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:59:05.556 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.557 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.1", 2024-09-15T23:59:05.557 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmmP6vORAAqxzX3OjoHnionZo1koIqRQ==", 2024-09-15T23:59:05.557 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.557 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:59:05.557 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:59:05.557 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:59:05.557 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:59:05.557 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.557 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.2", 2024-09-15T23:59:05.557 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dmj2XtNhAAB5620fN0Kr8Cqgd2+1cebg==", 2024-09-15T23:59:05.558 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.558 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:59:05.558 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:59:05.558 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:59:05.558 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:59:05.558 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.558 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.3", 2024-09-15T23:59:05.558 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBOc+dmt+I7AxAA+eyV3eaThbjRNo0zJT9OQg==", 2024-09-15T23:59:05.559 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.559 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow", 2024-09-15T23:59:05.559 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow r", 2024-09-15T23:59:05.559 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow rw", 2024-09-15T23:59:05.559 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow rwx" 2024-09-15T23:59:05.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.559 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "client.admin", 2024-09-15T23:59:05.559 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBMc+dmDuzBORAAzpiXmO3QO+1RKRvPGQLViQ==", 2024-09-15T23:59:05.559 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.559 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:59:05.559 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr": "allow *", 2024-09-15T23:59:05.560 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow *", 2024-09-15T23:59:05.560 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.560 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.560 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.x", 2024-09-15T23:59:05.560 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dm4JK5ERAA3d3OABWXchejCqjJRrhTfQ==", 2024-09-15T23:59:05.560 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.560 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:59:05.560 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-15T23:59:05.560 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.560 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:05.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.561 INFO:teuthology.orchestra.run.smithi112.stdout: "entity": "mgr.y", 2024-09-15T23:59:05.561 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "AQBNc+dm5nULDxAAi9UvgPZ7sU/Zz2jLKsu4ng==", 2024-09-15T23:59:05.561 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": { 2024-09-15T23:59:05.561 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": "allow *", 2024-09-15T23:59:05.561 INFO:teuthology.orchestra.run.smithi112.stdout: "mon": "allow profile mgr", 2024-09-15T23:59:05.561 INFO:teuthology.orchestra.run.smithi112.stdout: "osd": "allow *" 2024-09-15T23:59:05.561 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.561 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.561 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-15T23:59:05.561 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:59:05.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.548+0000 7f994b475640 1 -- 172.21.15.112:0/140375516 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f99280678f0 msgr2=0x7f9928069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.548+0000 7f994b475640 1 --2- 172.21.15.112:0/140375516 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f99280678f0 0x7f9928069db0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f99440b17a0 tx=0x7f9934000bd0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.548+0000 7f994b475640 1 -- 172.21.15.112:0/140375516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99300051d0 msgr2=0x7f9944155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.548+0000 7f994b475640 1 --2- 172.21.15.112:0/140375516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99300051d0 0x7f9944155d90 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f994000e4e0 tx=0x7f994000e9a0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.548+0000 7f994b475640 1 -- 172.21.15.112:0/140375516 shutdown_connections 2024-09-15T23:59:05.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.548+0000 7f994b475640 1 --2- 172.21.15.112:0/140375516 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f99280678f0 0x7f9928069db0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.548+0000 7f994b475640 1 --2- 172.21.15.112:0/140375516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99441f5550 0x7f994415fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.548+0000 7f994b475640 1 --2- 172.21.15.112:0/140375516 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99441566d0 0x7f9944152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.548+0000 7f994b475640 1 --2- 172.21.15.112:0/140375516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99300051d0 0x7f9944155d90 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.548+0000 7f994b475640 1 -- 172.21.15.112:0/140375516 >> 172.21.15.112:0/140375516 conn(0x7f994409d730 msgr2=0x7f9944074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:05.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.548+0000 7f994b475640 1 -- 172.21.15.112:0/140375516 shutdown_connections 2024-09-15T23:59:05.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.548+0000 7f994b475640 1 -- 172.21.15.112:0/140375516 wait complete. 2024-09-15T23:59:05.566 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:59:05.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.672+0000 7f83860a6640 1 Processor -- start 2024-09-15T23:59:05.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.672+0000 7f83860a6640 1 -- start start 2024-09-15T23:59:05.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f83860a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f838006f010 0x7f8380166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f83860a6640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83800b3290 con 0x7f838015c2a0 2024-09-15T23:59:05.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f83860a6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83800b3570 con 0x7f838015bec0 2024-09-15T23:59:05.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f83860a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f83800b3850 con 0x7f838006f010 2024-09-15T23:59:05.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837effd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f838015c2a0 0x7f83800aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:45016/0 (socket says 172.21.15.112:45016) 2024-09-15T23:59:05.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837effd640 1 -- 172.21.15.112:0/1686103604 learned_addr learned my addr 172.21.15.112:0/1686103604 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:05.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837ffff640 1 --2- 172.21.15.112:0/1686103604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f838006f010 0x7f8380166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 -- 172.21.15.112:0/1686103604 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2817250444 0 0) 0x7f83800b3290 con 0x7f838015c2a0 2024-09-15T23:59:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 -- 172.21.15.112:0/1686103604 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8368003530 con 0x7f838015c2a0 2024-09-15T23:59:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 -- 172.21.15.112:0/1686103604 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2017038550 0 0) 0x7f8368003530 con 0x7f838015c2a0 2024-09-15T23:59:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 -- 172.21.15.112:0/1686103604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f838006f010 msgr2=0x7f8380166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 --2- 172.21.15.112:0/1686103604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f838006f010 0x7f8380166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 -- 172.21.15.112:0/1686103604 >> v1:172.21.15.169:6789/0 conn(0x7f838015bec0 legacy=0x7f83800ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 -- 172.21.15.112:0/1686103604 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83800b3b30 con 0x7f838015c2a0 2024-09-15T23:59:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 -- 172.21.15.112:0/1686103604 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f8370001680 con 0x7f838015c2a0 2024-09-15T23:59:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 -- 172.21.15.112:0/1686103604 >> v1:172.21.15.112:6789/0 conn(0x7f838015c2a0 legacy=0x7f83800aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 --2- 172.21.15.112:0/1686103604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83680039f0 0x7f8368003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 --2- 172.21.15.112:0/1686103604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8368004810 0x7f8368004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 --2- 172.21.15.112:0/1686103604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f838006f010 0x7f83680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 -- 172.21.15.112:0/1686103604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f83800b3850 con 0x7f83680039f0 2024-09-15T23:59:05.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 -- 172.21.15.112:0/1686103604 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f836800ba80 con 0x7f8368004810 2024-09-15T23:59:05.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 -- 172.21.15.112:0/1686103604 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f836800bc80 con 0x7f838006f010 2024-09-15T23:59:05.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837f7fe640 1 --2- 172.21.15.112:0/1686103604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83680039f0 0x7f8368003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837effd640 1 --2- 172.21.15.112:0/1686103604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8368004810 0x7f8368004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837f7fe640 1 -- 172.21.15.112:0/1686103604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f838006f010 msgr2=0x7f83680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:05.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837ffff640 1 --2- 172.21.15.112:0/1686103604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f838006f010 0x7f83680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837f7fe640 1 --2- 172.21.15.112:0/1686103604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f838006f010 0x7f83680051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837f7fe640 1 -- 172.21.15.112:0/1686103604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8368004810 msgr2=0x7f8368004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:05.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837f7fe640 1 --2- 172.21.15.112:0/1686103604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8368004810 0x7f8368004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837f7fe640 1 -- 172.21.15.112:0/1686103604 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8368003530 con 0x7f83680039f0 2024-09-15T23:59:05.679 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837effd640 1 --2- 172.21.15.112:0/1686103604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8368004810 0x7f8368004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:05.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837f7fe640 1 --2- 172.21.15.112:0/1686103604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83680039f0 0x7f8368003e10 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8374001750 tx=0x7f837401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc29da190eb7488c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:05.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 -- 172.21.15.112:0/1686103604 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83740013a0 con 0x7f83680039f0 2024-09-15T23:59:05.680 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.676+0000 7f837e7fc640 1 -- 172.21.15.112:0/1686103604 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83740a4e50 con 0x7f83680039f0 2024-09-15T23:59:05.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f837e7fc640 1 -- 172.21.15.112:0/1686103604 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8374003600 con 0x7f83680039f0 2024-09-15T23:59:05.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 -- 172.21.15.112:0/1686103604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83680039f0 msgr2=0x7f8368003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 --2- 172.21.15.112:0/1686103604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83680039f0 0x7f8368003e10 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8374001750 tx=0x7f837401c390 comp rx=0 tx=0).stop 2024-09-15T23:59:05.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f837ffff640 1 -- 172.21.15.112:0/1686103604 reap_dead start 2024-09-15T23:59:05.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 -- 172.21.15.112:0/1686103604 shutdown_connections 2024-09-15T23:59:05.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 -- 172.21.15.112:0/1686103604 >> 172.21.15.112:0/1686103604 conn(0x7f83800b1f90 msgr2=0x7f83800b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:05.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 -- 172.21.15.112:0/1686103604 shutdown_connections 2024-09-15T23:59:05.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 -- 172.21.15.112:0/1686103604 wait complete. 2024-09-15T23:59:05.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 Processor -- start 2024-09-15T23:59:05.681 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 -- start start 2024-09-15T23:59:05.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83680039f0 0x7f83800998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8380154110 0x7f8380154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f838015c7c0 0x7f838015cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8380167980 con 0x7f83680039f0 2024-09-15T23:59:05.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8380167800 con 0x7f8380154110 2024-09-15T23:59:05.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8380167b00 con 0x7f838015c7c0 2024-09-15T23:59:05.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f837f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83680039f0 0x7f83800998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f837f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83680039f0 0x7f83800998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54852/0 (socket says 172.21.15.112:54852) 2024-09-15T23:59:05.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f837f7fe640 1 -- 172.21.15.112:0/3528247288 learned_addr learned my addr 172.21.15.112:0/3528247288 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:05.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f837ffff640 1 --2- 172.21.15.112:0/3528247288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f838015c7c0 0x7f838015cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f837effd640 1 --2- 172.21.15.112:0/3528247288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8380154110 0x7f8380154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f837f7fe640 1 -- 172.21.15.112:0/3528247288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f838015c7c0 msgr2=0x7f838015cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f837f7fe640 1 --2- 172.21.15.112:0/3528247288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f838015c7c0 0x7f838015cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f837f7fe640 1 -- 172.21.15.112:0/3528247288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8380154110 msgr2=0x7f8380154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f837f7fe640 1 --2- 172.21.15.112:0/3528247288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8380154110 0x7f8380154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f837f7fe640 1 -- 172.21.15.112:0/3528247288 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838015d530 con 0x7f83680039f0 2024-09-15T23:59:05.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f837f7fe640 1 --2- 172.21.15.112:0/3528247288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83680039f0 0x7f83800998d0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f8374005040 tx=0x7f8368005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:05.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f8367fff640 1 -- 172.21.15.112:0/3528247288 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8374007040 con 0x7f83680039f0 2024-09-15T23:59:05.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f8367fff640 1 -- 172.21.15.112:0/3528247288 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83740bb070 con 0x7f83680039f0 2024-09-15T23:59:05.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 -- 172.21.15.112:0/3528247288 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838015d810 con 0x7f83680039f0 2024-09-15T23:59:05.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f8367fff640 1 -- 172.21.15.112:0/3528247288 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8374007400 con 0x7f83680039f0 2024-09-15T23:59:05.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.680+0000 7f83860a6640 1 -- 172.21.15.112:0/3528247288 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838015ddd0 con 0x7f83680039f0 2024-09-15T23:59:05.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.684+0000 7f83860a6640 1 -- 172.21.15.112:0/3528247288 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83800ad200 con 0x7f83680039f0 2024-09-15T23:59:05.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.684+0000 7f8367fff640 1 -- 172.21.15.112:0/3528247288 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83740b4040 con 0x7f83680039f0 2024-09-15T23:59:05.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.684+0000 7f8367fff640 1 --2- 172.21.15.112:0/3528247288 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f836c0678c0 0x7f836c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.684+0000 7f8367fff640 1 -- 172.21.15.112:0/3528247288 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5249+0+0 (secure 0 0 0) 0x7f837411f890 con 0x7f83680039f0 2024-09-15T23:59:05.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.684+0000 7f837effd640 1 --2- 172.21.15.112:0/3528247288 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f836c0678c0 0x7f836c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.684+0000 7f837effd640 1 --2- 172.21.15.112:0/3528247288 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f836c0678c0 0x7f836c069d80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f83800cf520 tx=0x7f8370009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:05.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.688+0000 7f8367fff640 1 -- 172.21.15.112:0/3528247288 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f83740160d0 con 0x7f83680039f0 2024-09-15T23:59:05.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.848+0000 7f83860a6640 1 -- 172.21.15.112:0/3528247288 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f838006fcd0 con 0x7f83680039f0 2024-09-15T23:59:05.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.852+0000 7f8367fff640 1 -- 172.21.15.112:0/3528247288 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v111) ==== 84+0+65 (secure 0 0 0) 0x7f83740f05a0 con 0x7f83680039f0 2024-09-15T23:59:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:05.851 INFO:teuthology.orchestra.run.smithi112.stdout:[ 2024-09-15T23:59:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-15T23:59:05.851 INFO:teuthology.orchestra.run.smithi112.stdout: "poolnum": 1, 2024-09-15T23:59:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: "poolname": ".mgr" 2024-09-15T23:59:05.852 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:05.852 INFO:teuthology.orchestra.run.smithi112.stdout:] 2024-09-15T23:59:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.852+0000 7f83860a6640 1 -- 172.21.15.112:0/3528247288 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f836c0678c0 msgr2=0x7f836c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.852+0000 7f83860a6640 1 --2- 172.21.15.112:0/3528247288 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f836c0678c0 0x7f836c069d80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f83800cf520 tx=0x7f8370009040 comp rx=0 tx=0).stop 2024-09-15T23:59:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.852+0000 7f83860a6640 1 -- 172.21.15.112:0/3528247288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83680039f0 msgr2=0x7f83800998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.852+0000 7f83860a6640 1 --2- 172.21.15.112:0/3528247288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83680039f0 0x7f83800998d0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f8374005040 tx=0x7f8368005840 comp rx=0 tx=0).stop 2024-09-15T23:59:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.852+0000 7f83860a6640 1 -- 172.21.15.112:0/3528247288 shutdown_connections 2024-09-15T23:59:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.852+0000 7f83860a6640 1 --2- 172.21.15.112:0/3528247288 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f836c0678c0 0x7f836c069d80 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.852+0000 7f83860a6640 1 --2- 172.21.15.112:0/3528247288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f838015c7c0 0x7f838015cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.852+0000 7f83860a6640 1 --2- 172.21.15.112:0/3528247288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8380154110 0x7f8380154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.852+0000 7f83860a6640 1 --2- 172.21.15.112:0/3528247288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83680039f0 0x7f83800998d0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.852+0000 7f83860a6640 1 -- 172.21.15.112:0/3528247288 >> 172.21.15.112:0/3528247288 conn(0x7f83800b1f90 msgr2=0x7f83800b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:05.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.852+0000 7f83860a6640 1 -- 172.21.15.112:0/3528247288 shutdown_connections 2024-09-15T23:59:05.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.852+0000 7f83860a6640 1 -- 172.21.15.112:0/3528247288 wait complete. 2024-09-15T23:59:05.870 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:59:05.870 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:59:05.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.984+0000 7fe893607640 1 Processor -- start 2024-09-15T23:59:05.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.984+0000 7fe893607640 1 -- start start 2024-09-15T23:59:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.984+0000 7fe893607640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe88c1520a0 0x7fe88c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.984+0000 7fe893607640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe88c06fe50 0x7fe88c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.984+0000 7fe893607640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe88c15f1d0 0x7fe88c071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.984+0000 7fe893607640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fe88c152480 con 0x7fe88c15f1d0 2024-09-15T23:59:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.984+0000 7fe893607640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe88c070250 con 0x7fe88c06fe50 2024-09-15T23:59:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.984+0000 7fe893607640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe88c0aede0 con 0x7fe88c1520a0 2024-09-15T23:59:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.984+0000 7fe891ba4640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe88c15f1d0 0x7fe88c071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.984+0000 7fe891ba4640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fe88c15f1d0 0x7fe88c071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54858/0 (socket says 172.21.15.112:54858) 2024-09-15T23:59:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.984+0000 7fe891ba4640 1 -- 172.21.15.112:0/2496228265 learned_addr learned my addr 172.21.15.112:0/2496228265 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.984+0000 7fe890ba2640 1 --2- 172.21.15.112:0/2496228265 >> v2:172.21.15.169:3300/0 conn(0x7fe88c06fe50 0x7fe88c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe8913a3640 1 --2- 172.21.15.112:0/2496228265 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe88c1520a0 0x7fe88c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe891ba4640 1 -- 172.21.15.112:0/2496228265 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe88c1520a0 msgr2=0x7fe88c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe891ba4640 1 --2- 172.21.15.112:0/2496228265 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe88c1520a0 0x7fe88c06f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe891ba4640 1 -- 172.21.15.112:0/2496228265 >> v2:172.21.15.169:3300/0 conn(0x7fe88c06fe50 msgr2=0x7fe88c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe891ba4640 1 --2- 172.21.15.112:0/2496228265 >> v2:172.21.15.169:3300/0 conn(0x7fe88c06fe50 0x7fe88c15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe891ba4640 1 -- 172.21.15.112:0/2496228265 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88c15fa10 con 0x7fe88c15f1d0 2024-09-15T23:59:05.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe890ba2640 1 --2- 172.21.15.112:0/2496228265 >> v2:172.21.15.169:3300/0 conn(0x7fe88c06fe50 0x7fe88c15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:05.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe891ba4640 1 --2- 172.21.15.112:0/2496228265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe88c15f1d0 0x7fe88c071f10 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fe88c06de20 tx=0x7fe88401c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3b7d5cf8593592 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:05.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe883fff640 1 -- 172.21.15.112:0/2496228265 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8840a5590 con 0x7fe88c15f1d0 2024-09-15T23:59:05.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe883fff640 1 -- 172.21.15.112:0/2496228265 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8840a5730 con 0x7fe88c15f1d0 2024-09-15T23:59:05.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe883fff640 1 -- 172.21.15.112:0/2496228265 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8840a5b00 con 0x7fe88c15f1d0 2024-09-15T23:59:05.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe893607640 1 -- 172.21.15.112:0/2496228265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe88c15f1d0 msgr2=0x7fe88c071f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe893607640 1 --2- 172.21.15.112:0/2496228265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe88c15f1d0 0x7fe88c071f10 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fe88c06de20 tx=0x7fe88401c710 comp rx=0 tx=0).stop 2024-09-15T23:59:05.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe893607640 1 -- 172.21.15.112:0/2496228265 shutdown_connections 2024-09-15T23:59:05.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe893607640 1 --2- 172.21.15.112:0/2496228265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe88c15f1d0 0x7fe88c071f10 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe893607640 1 --2- 172.21.15.112:0/2496228265 >> v2:172.21.15.169:3300/0 conn(0x7fe88c06fe50 0x7fe88c15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe893607640 1 --2- 172.21.15.112:0/2496228265 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe88c1520a0 0x7fe88c06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe893607640 1 -- 172.21.15.112:0/2496228265 >> 172.21.15.112:0/2496228265 conn(0x7fe88c0b1f90 msgr2=0x7fe88c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:05.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe893607640 1 -- 172.21.15.112:0/2496228265 shutdown_connections 2024-09-15T23:59:05.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.988+0000 7fe893607640 1 -- 172.21.15.112:0/2496228265 wait complete. 2024-09-15T23:59:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe893607640 1 Processor -- start 2024-09-15T23:59:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe893607640 1 -- start start 2024-09-15T23:59:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe893607640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe88c06fe50 0x7fe88c14f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe893607640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe88c1520a0 0x7fe88c14ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe893607640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe88c15f1d0 0x7fe88c15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe893607640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c073d30 con 0x7fe88c15f1d0 2024-09-15T23:59:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe893607640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c073a50 con 0x7fe88c1520a0 2024-09-15T23:59:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe893607640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe88c15f680 con 0x7fe88c06fe50 2024-09-15T23:59:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe891ba4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe88c15f1d0 0x7fe88c15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe891ba4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe88c15f1d0 0x7fe88c15c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54868/0 (socket says 172.21.15.112:54868) 2024-09-15T23:59:05.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe891ba4640 1 -- 172.21.15.112:0/865073444 learned_addr learned my addr 172.21.15.112:0/865073444 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:05.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe8913a3640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe88c06fe50 0x7fe88c14f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe891ba4640 1 -- 172.21.15.112:0/865073444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe88c06fe50 msgr2=0x7fe88c14f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe890ba2640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe88c1520a0 0x7fe88c14ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe891ba4640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe88c06fe50 0x7fe88c14f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe891ba4640 1 -- 172.21.15.112:0/865073444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe88c1520a0 msgr2=0x7fe88c14ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:05.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe891ba4640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe88c1520a0 0x7fe88c14ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:05.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe891ba4640 1 -- 172.21.15.112:0/865073444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88c09c0b0 con 0x7fe88c15f1d0 2024-09-15T23:59:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe890ba2640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe88c1520a0 0x7fe88c14ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe891ba4640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe88c15f1d0 0x7fe88c15c6b0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fe8840af040 tx=0x7fe8840194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe881ffb640 1 -- 172.21.15.112:0/865073444 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8840b8440 con 0x7fe88c15f1d0 2024-09-15T23:59:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe881ffb640 1 -- 172.21.15.112:0/865073444 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8840b8620 con 0x7fe88c15f1d0 2024-09-15T23:59:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe893607640 1 -- 172.21.15.112:0/865073444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88c09c390 con 0x7fe88c15f1d0 2024-09-15T23:59:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe881ffb640 1 -- 172.21.15.112:0/865073444 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8840b8a10 con 0x7fe88c15f1d0 2024-09-15T23:59:05.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe893607640 1 -- 172.21.15.112:0/865073444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe88c09c950 con 0x7fe88c15f1d0 2024-09-15T23:59:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe893607640 1 -- 172.21.15.112:0/865073444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe88c06f910 con 0x7fe88c15f1d0 2024-09-15T23:59:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe881ffb640 1 -- 172.21.15.112:0/865073444 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe8840c1020 con 0x7fe88c15f1d0 2024-09-15T23:59:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe881ffb640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8700678c0 0x7fe870069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe881ffb640 1 -- 172.21.15.112:0/865073444 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5249+0+0 (secure 0 0 0) 0x7fe884120220 con 0x7fe88c15f1d0 2024-09-15T23:59:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe8913a3640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8700678c0 0x7fe870069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:05.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.992+0000 7fe8913a3640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8700678c0 0x7fe870069d80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe88c15d380 tx=0x7fe888008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:05.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:05.996+0000 7fe881ffb640 1 -- 172.21.15.112:0/865073444 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe8840165c0 con 0x7fe88c15f1d0 2024-09-15T23:59:06.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:06.148+0000 7fe893607640 1 -- 172.21.15.112:0/865073444 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe88c0721d0 con 0x7fe88c15f1d0 2024-09-15T23:59:06.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:06.852+0000 7fe881ffb640 1 -- 172.21.15.112:0/865073444 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v112) ==== 138+0+0 (secure 0 0 0) 0x7fe8840f0f20 con 0x7fe88c15f1d0 2024-09-15T23:59:06.851 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' created 2024-09-15T23:59:06.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:06.852+0000 7fe893607640 1 -- 172.21.15.112:0/865073444 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8700678c0 msgr2=0x7fe870069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:06.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:06.852+0000 7fe893607640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8700678c0 0x7fe870069d80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe88c15d380 tx=0x7fe888008040 comp rx=0 tx=0).stop 2024-09-15T23:59:06.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:06.852+0000 7fe893607640 1 -- 172.21.15.112:0/865073444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe88c15f1d0 msgr2=0x7fe88c15c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:06.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:06.852+0000 7fe893607640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe88c15f1d0 0x7fe88c15c6b0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fe8840af040 tx=0x7fe8840194b0 comp rx=0 tx=0).stop 2024-09-15T23:59:06.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:06.852+0000 7fe893607640 1 -- 172.21.15.112:0/865073444 shutdown_connections 2024-09-15T23:59:06.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:06.852+0000 7fe893607640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fe8700678c0 0x7fe870069d80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:06.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:06.852+0000 7fe893607640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe88c15f1d0 0x7fe88c15c6b0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:06.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:06.852+0000 7fe893607640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe88c1520a0 0x7fe88c14ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:06.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:06.852+0000 7fe893607640 1 --2- 172.21.15.112:0/865073444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe88c06fe50 0x7fe88c14f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:06.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:06.852+0000 7fe893607640 1 -- 172.21.15.112:0/865073444 >> 172.21.15.112:0/865073444 conn(0x7fe88c0b1f90 msgr2=0x7fe88c0ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:06.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:06.852+0000 7fe893607640 1 -- 172.21.15.112:0/865073444 shutdown_connections 2024-09-15T23:59:06.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:06.852+0000 7fe893607640 1 -- 172.21.15.112:0/865073444 wait complete. 2024-09-15T23:59:06.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:59:07.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd221930640 1 Processor -- start 2024-09-15T23:59:07.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd221930640 1 -- start start 2024-09-15T23:59:07.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd221930640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd21c15e4f0 0x7fd21c0d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd221930640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c0d4e20 0x7fd21c0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd221930640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd21c162070 0x7fd21c162500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd221930640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd21c0d0350 con 0x7fd21c15e4f0 2024-09-15T23:59:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd221930640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd21c0cf070 con 0x7fd21c162070 2024-09-15T23:59:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd221930640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c0d1c20 con 0x7fd21c0d4e20 2024-09-15T23:59:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd21affd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd21c15e4f0 0x7fd21c0d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd21affd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd21c15e4f0 0x7fd21c0d15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54878/0 (socket says 172.21.15.112:54878) 2024-09-15T23:59:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd21affd640 1 -- 172.21.15.112:0/4072295175 learned_addr learned my addr 172.21.15.112:0/4072295175 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd21b7fe640 1 --2- 172.21.15.112:0/4072295175 >> v2:172.21.15.169:3300/0 conn(0x7fd21c162070 0x7fd21c162500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd21a7fc640 1 --2- 172.21.15.112:0/4072295175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c0d4e20 0x7fd21c0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd21affd640 1 -- 172.21.15.112:0/4072295175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c0d4e20 msgr2=0x7fd21c0cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd21affd640 1 --2- 172.21.15.112:0/4072295175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c0d4e20 0x7fd21c0cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd21affd640 1 -- 172.21.15.112:0/4072295175 >> v2:172.21.15.169:3300/0 conn(0x7fd21c162070 msgr2=0x7fd21c162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:07.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd21affd640 1 --2- 172.21.15.112:0/4072295175 >> v2:172.21.15.169:3300/0 conn(0x7fd21c162070 0x7fd21c162500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:07.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.012+0000 7fd21affd640 1 -- 172.21.15.112:0/4072295175 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c0cf330 con 0x7fd21c15e4f0 2024-09-15T23:59:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.016+0000 7fd21affd640 1 --2- 172.21.15.112:0/4072295175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c15e4f0 0x7fd21c0d15d0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fd21c08c4a0 tx=0x7fd20c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787b6159f67ec17 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.016+0000 7fd219ffb640 1 -- 172.21.15.112:0/4072295175 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0b5070 con 0x7fd21c15e4f0 2024-09-15T23:59:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.016+0000 7fd219ffb640 1 -- 172.21.15.112:0/4072295175 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20c0a89d0 con 0x7fd21c15e4f0 2024-09-15T23:59:07.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.016+0000 7fd219ffb640 1 -- 172.21.15.112:0/4072295175 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0a8da0 con 0x7fd21c15e4f0 2024-09-15T23:59:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.016+0000 7fd221930640 1 -- 172.21.15.112:0/4072295175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c15e4f0 msgr2=0x7fd21c0d15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.016+0000 7fd221930640 1 --2- 172.21.15.112:0/4072295175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c15e4f0 0x7fd21c0d15d0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fd21c08c4a0 tx=0x7fd20c01ed10 comp rx=0 tx=0).stop 2024-09-15T23:59:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.016+0000 7fd221930640 1 -- 172.21.15.112:0/4072295175 shutdown_connections 2024-09-15T23:59:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.016+0000 7fd221930640 1 --2- 172.21.15.112:0/4072295175 >> v2:172.21.15.169:3300/0 conn(0x7fd21c162070 0x7fd21c162500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.016+0000 7fd221930640 1 --2- 172.21.15.112:0/4072295175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c0d4e20 0x7fd21c0cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.016+0000 7fd221930640 1 --2- 172.21.15.112:0/4072295175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c15e4f0 0x7fd21c0d15d0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:07.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.016+0000 7fd221930640 1 -- 172.21.15.112:0/4072295175 >> 172.21.15.112:0/4072295175 conn(0x7fd21c08bf90 msgr2=0x7fd21c0d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:07.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.016+0000 7fd221930640 1 -- 172.21.15.112:0/4072295175 shutdown_connections 2024-09-15T23:59:07.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.016+0000 7fd221930640 1 -- 172.21.15.112:0/4072295175 wait complete. 2024-09-15T23:59:07.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd221930640 1 Processor -- start 2024-09-15T23:59:07.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd221930640 1 -- start start 2024-09-15T23:59:07.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd221930640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c0d4e20 0x7fd21c1610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:07.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd221930640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c15e4f0 0x7fd21c0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:07.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd221930640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd21c162070 0x7fd21c1511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:07.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd221930640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c15e8d0 con 0x7fd21c15e4f0 2024-09-15T23:59:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd221930640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c0cf8f0 con 0x7fd21c162070 2024-09-15T23:59:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd221930640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c0d5270 con 0x7fd21c0d4e20 2024-09-15T23:59:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd21a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c15e4f0 0x7fd21c0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd21a7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c15e4f0 0x7fd21c0ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54890/0 (socket says 172.21.15.112:54890) 2024-09-15T23:59:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd21a7fc640 1 -- 172.21.15.112:0/955789974 learned_addr learned my addr 172.21.15.112:0/955789974 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd21b7fe640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd21c162070 0x7fd21c1511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd21affd640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c0d4e20 0x7fd21c1610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd21a7fc640 1 -- 172.21.15.112:0/955789974 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c0d4e20 msgr2=0x7fd21c1610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd21a7fc640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c0d4e20 0x7fd21c1610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd21a7fc640 1 -- 172.21.15.112:0/955789974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd21c162070 msgr2=0x7fd21c1511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd21a7fc640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd21c162070 0x7fd21c1511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd21a7fc640 1 -- 172.21.15.112:0/955789974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c160010 con 0x7fd21c15e4f0 2024-09-15T23:59:07.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd21affd640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c0d4e20 0x7fd21c1610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:59:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd21b7fe640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd21c162070 0x7fd21c1511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:59:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd21a7fc640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c15e4f0 0x7fd21c0ca080 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fd21000d800 tx=0x7fd21000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd203fff640 1 -- 172.21.15.112:0/955789974 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd210018030 con 0x7fd21c15e4f0 2024-09-15T23:59:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd203fff640 1 -- 172.21.15.112:0/955789974 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2100096a0 con 0x7fd21c15e4f0 2024-09-15T23:59:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd221930640 1 -- 172.21.15.112:0/955789974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c1602f0 con 0x7fd21c15e4f0 2024-09-15T23:59:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd203fff640 1 -- 172.21.15.112:0/955789974 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd210009870 con 0x7fd21c15e4f0 2024-09-15T23:59:07.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd221930640 1 -- 172.21.15.112:0/955789974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c1608b0 con 0x7fd21c15e4f0 2024-09-15T23:59:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd221930640 1 -- 172.21.15.112:0/955789974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21c0cfe10 con 0x7fd21c15e4f0 2024-09-15T23:59:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd203fff640 1 -- 172.21.15.112:0/955789974 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd21001b070 con 0x7fd21c15e4f0 2024-09-15T23:59:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.020+0000 7fd203fff640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2080678c0 0x7fd208069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.024+0000 7fd203fff640 1 -- 172.21.15.112:0/955789974 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5619+0+0 (secure 0 0 0) 0x7fd210085ea0 con 0x7fd21c15e4f0 2024-09-15T23:59:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.024+0000 7fd21affd640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2080678c0 0x7fd208069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:07.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.024+0000 7fd21affd640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2080678c0 0x7fd208069d80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0b2000 tx=0x7fd20c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:07.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.028+0000 7fd203fff640 1 -- 172.21.15.112:0/955789974 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd210056ac0 con 0x7fd21c15e4f0 2024-09-15T23:59:07.189 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.188+0000 7fd221930640 1 -- 172.21.15.112:0/955789974 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd21c0b9d00 con 0x7fd21c15e4f0 2024-09-15T23:59:07.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.864+0000 7fd203fff640 1 -- 172.21.15.112:0/955789974 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v113) ==== 170+0+0 (secure 0 0 0) 0x7fd2100563c0 con 0x7fd21c15e4f0 2024-09-15T23:59:07.864 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' created 2024-09-15T23:59:07.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.868+0000 7fd221930640 1 -- 172.21.15.112:0/955789974 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2080678c0 msgr2=0x7fd208069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.868+0000 7fd221930640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2080678c0 0x7fd208069d80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0b2000 tx=0x7fd20c008040 comp rx=0 tx=0).stop 2024-09-15T23:59:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.868+0000 7fd221930640 1 -- 172.21.15.112:0/955789974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c15e4f0 msgr2=0x7fd21c0ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.868+0000 7fd221930640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c15e4f0 0x7fd21c0ca080 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fd21000d800 tx=0x7fd21000dcc0 comp rx=0 tx=0).stop 2024-09-15T23:59:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.868+0000 7fd221930640 1 -- 172.21.15.112:0/955789974 shutdown_connections 2024-09-15T23:59:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.868+0000 7fd221930640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd2080678c0 0x7fd208069d80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.868+0000 7fd221930640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd21c162070 0x7fd21c1511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.868+0000 7fd221930640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c15e4f0 0x7fd21c0ca080 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.868+0000 7fd221930640 1 --2- 172.21.15.112:0/955789974 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd21c0d4e20 0x7fd21c1610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.868+0000 7fd221930640 1 -- 172.21.15.112:0/955789974 >> 172.21.15.112:0/955789974 conn(0x7fd21c08bf90 msgr2=0x7fd21c0d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.868+0000 7fd221930640 1 -- 172.21.15.112:0/955789974 shutdown_connections 2024-09-15T23:59:07.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:07.868+0000 7fd221930640 1 -- 172.21.15.112:0/955789974 wait complete. 2024-09-15T23:59:07.900 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:59:08.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.020+0000 7f4594e25640 1 Processor -- start 2024-09-15T23:59:08.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.020+0000 7f4594e25640 1 -- start start 2024-09-15T23:59:08.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f4594e25640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f459015bec0 0x7f45900ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:08.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f4594e25640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45900af470 0x7f459006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:08.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f4594e25640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45900b3290 con 0x7f459015c2a0 2024-09-15T23:59:08.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f4594e25640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f45900b3570 con 0x7f45900af470 2024-09-15T23:59:08.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f4594e25640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f45900b3850 con 0x7f459015bec0 2024-09-15T23:59:08.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f458ed9d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45900af470 0x7f459006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:08.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f458ed9d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f45900af470 0x7f459006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54900/0 (socket says 172.21.15.112:54900) 2024-09-15T23:59:08.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f458ed9d640 1 -- 172.21.15.112:0/3617652199 learned_addr learned my addr 172.21.15.112:0/3617652199 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:08.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f458e59c640 1 --2- 172.21.15.112:0/3617652199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f459015bec0 0x7f45900ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:08.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f458ed9d640 1 -- 172.21.15.112:0/3617652199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f459015bec0 msgr2=0x7f45900ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:08.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f458ed9d640 1 --2- 172.21.15.112:0/3617652199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f459015bec0 0x7f45900ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:08.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f458ed9d640 1 -- 172.21.15.112:0/3617652199 >> v1:172.21.15.169:6789/0 conn(0x7f459015c2a0 legacy=0x7f45900aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:08.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f458ed9d640 1 -- 172.21.15.112:0/3617652199 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45900b3b30 con 0x7f45900af470 2024-09-15T23:59:08.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f458ed9d640 1 --2- 172.21.15.112:0/3617652199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45900af470 0x7f459006e000 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f4588009e50 tx=0x7f458801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dda97df9ce8fe08 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:08.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f458d59a640 1 -- 172.21.15.112:0/3617652199 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880a5840 con 0x7f45900af470 2024-09-15T23:59:08.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f458d59a640 1 -- 172.21.15.112:0/3617652199 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45880a59e0 con 0x7f45900af470 2024-09-15T23:59:08.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.024+0000 7f458d59a640 1 -- 172.21.15.112:0/3617652199 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880a5db0 con 0x7f45900af470 2024-09-15T23:59:08.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 -- 172.21.15.112:0/3617652199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45900af470 msgr2=0x7f459006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:08.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 --2- 172.21.15.112:0/3617652199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45900af470 0x7f459006e000 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f4588009e50 tx=0x7f458801c9c0 comp rx=0 tx=0).stop 2024-09-15T23:59:08.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 -- 172.21.15.112:0/3617652199 shutdown_connections 2024-09-15T23:59:08.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 --2- 172.21.15.112:0/3617652199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45900af470 0x7f459006e000 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:08.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 --2- 172.21.15.112:0/3617652199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f459015bec0 0x7f45900ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:08.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 -- 172.21.15.112:0/3617652199 >> 172.21.15.112:0/3617652199 conn(0x7f45900b1f90 msgr2=0x7f45900b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:08.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 -- 172.21.15.112:0/3617652199 shutdown_connections 2024-09-15T23:59:08.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 -- 172.21.15.112:0/3617652199 wait complete. 2024-09-15T23:59:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 Processor -- start 2024-09-15T23:59:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 -- start start 2024-09-15T23:59:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45900af470 0x7f4590150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f459015bec0 0x7f459014c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:08.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f459015c2a0 0x7f459013b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:08.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f459006ed50 con 0x7f459015c2a0 2024-09-15T23:59:08.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f45900ad740 con 0x7f45900af470 2024-09-15T23:59:08.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f459006eed0 con 0x7f459015bec0 2024-09-15T23:59:08.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f458ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f459015c2a0 0x7f459013b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:08.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f458ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f459015c2a0 0x7f459013b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:54916/0 (socket says 172.21.15.112:54916) 2024-09-15T23:59:08.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f458ed9d640 1 -- 172.21.15.112:0/2321184219 learned_addr learned my addr 172.21.15.112:0/2321184219 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:08.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f458e59c640 1 --2- 172.21.15.112:0/2321184219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45900af470 0x7f4590150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:08.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f458dd9b640 1 --2- 172.21.15.112:0/2321184219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f459015bec0 0x7f459014c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:08.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f458ed9d640 1 -- 172.21.15.112:0/2321184219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f459015bec0 msgr2=0x7f459014c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:08.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f458ed9d640 1 --2- 172.21.15.112:0/2321184219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f459015bec0 0x7f459014c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:08.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f458ed9d640 1 -- 172.21.15.112:0/2321184219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45900af470 msgr2=0x7f4590150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:08.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f458ed9d640 1 --2- 172.21.15.112:0/2321184219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45900af470 0x7f4590150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:08.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f458ed9d640 1 -- 172.21.15.112:0/2321184219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4590155f40 con 0x7f459015c2a0 2024-09-15T23:59:08.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f458ed9d640 1 --2- 172.21.15.112:0/2321184219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f459015c2a0 0x7f459013b050 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f458801b070 tx=0x7f4588019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:08.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f457effd640 1 -- 172.21.15.112:0/2321184219 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588009270 con 0x7f459015c2a0 2024-09-15T23:59:08.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f457effd640 1 -- 172.21.15.112:0/2321184219 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45880be070 con 0x7f459015c2a0 2024-09-15T23:59:08.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 -- 172.21.15.112:0/2321184219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459014a340 con 0x7f459015c2a0 2024-09-15T23:59:08.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f457effd640 1 -- 172.21.15.112:0/2321184219 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880b8ae0 con 0x7f459015c2a0 2024-09-15T23:59:08.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.028+0000 7f4594e25640 1 -- 172.21.15.112:0/2321184219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f459014a900 con 0x7f459015c2a0 2024-09-15T23:59:08.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.032+0000 7f4594e25640 1 -- 172.21.15.112:0/2321184219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f459006f220 con 0x7f459015c2a0 2024-09-15T23:59:08.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.032+0000 7f457effd640 1 -- 172.21.15.112:0/2321184219 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f45880b8c80 con 0x7f459015c2a0 2024-09-15T23:59:08.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.032+0000 7f457effd640 1 --2- 172.21.15.112:0/2321184219 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f45700678c0 0x7f4570069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:08.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.032+0000 7f457effd640 1 -- 172.21.15.112:0/2321184219 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6001+0+0 (secure 0 0 0) 0x7f4588121b80 con 0x7f459015c2a0 2024-09-15T23:59:08.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.032+0000 7f458e59c640 1 --2- 172.21.15.112:0/2321184219 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f45700678c0 0x7f4570069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:08.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.032+0000 7f458e59c640 1 --2- 172.21.15.112:0/2321184219 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f45700678c0 0x7f4570069d80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f458400a970 tx=0x7f4584008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:08.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.036+0000 7f457effd640 1 -- 172.21.15.112:0/2321184219 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f45880165e0 con 0x7f459015c2a0 2024-09-15T23:59:08.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.236+0000 7f4594e25640 1 -- 172.21.15.112:0/2321184219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f459006fcd0 con 0x7f459015c2a0 2024-09-15T23:59:08.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.896+0000 7f457effd640 1 -- 172.21.15.112:0/2321184219 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v68) ==== 174+0+0 (secure 0 0 0) 0x7f45880c23c0 con 0x7f459015c2a0 2024-09-15T23:59:08.900 INFO:teuthology.orchestra.run.smithi112.stderr:new fs with metadata pool 17 and data pool 18 2024-09-15T23:59:08.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.904+0000 7f4594e25640 1 -- 172.21.15.112:0/2321184219 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f45700678c0 msgr2=0x7f4570069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:08.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.908+0000 7f4594e25640 1 --2- 172.21.15.112:0/2321184219 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f45700678c0 0x7f4570069d80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f458400a970 tx=0x7f4584008040 comp rx=0 tx=0).stop 2024-09-15T23:59:08.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.908+0000 7f4594e25640 1 -- 172.21.15.112:0/2321184219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f459015c2a0 msgr2=0x7f459013b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:08.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.908+0000 7f4594e25640 1 --2- 172.21.15.112:0/2321184219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f459015c2a0 0x7f459013b050 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f458801b070 tx=0x7f4588019760 comp rx=0 tx=0).stop 2024-09-15T23:59:08.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.908+0000 7f4594e25640 1 -- 172.21.15.112:0/2321184219 shutdown_connections 2024-09-15T23:59:08.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.908+0000 7f4594e25640 1 --2- 172.21.15.112:0/2321184219 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f45700678c0 0x7f4570069d80 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:08.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.912+0000 7f4594e25640 1 --2- 172.21.15.112:0/2321184219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f459015c2a0 0x7f459013b050 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:08.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.912+0000 7f4594e25640 1 --2- 172.21.15.112:0/2321184219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f459015bec0 0x7f459014c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:08.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.912+0000 7f4594e25640 1 --2- 172.21.15.112:0/2321184219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45900af470 0x7f4590150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:08.917 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.912+0000 7f4594e25640 1 -- 172.21.15.112:0/2321184219 >> 172.21.15.112:0/2321184219 conn(0x7f45900b1f90 msgr2=0x7f45900b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.916+0000 7f4594e25640 1 -- 172.21.15.112:0/2321184219 shutdown_connections 2024-09-15T23:59:08.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:08.916+0000 7f4594e25640 1 -- 172.21.15.112:0/2321184219 wait complete. 2024-09-15T23:59:08.943 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:59:09.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.052+0000 7fac1dcda640 1 Processor -- start 2024-09-15T23:59:09.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.052+0000 7fac1dcda640 1 -- start start 2024-09-15T23:59:09.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.052+0000 7fac1dcda640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fac1815e450 0x7fac180b7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.052+0000 7fac1dcda640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fac180d4840 0x7fac180d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.052+0000 7fac1dcda640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac180d1f70 con 0x7fac180b7670 2024-09-15T23:59:09.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.052+0000 7fac1dcda640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fac180b58d0 con 0x7fac180d4840 2024-09-15T23:59:09.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.052+0000 7fac1dcda640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fac180b55f0 con 0x7fac1815e450 2024-09-15T23:59:09.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.052+0000 7fac17fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fac180d4840 0x7fac180d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.052+0000 7fac16ffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fac180b7670 0x7fac180d4130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57706/0 (socket says 172.21.15.112:57706) 2024-09-15T23:59:09.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.052+0000 7fac16ffd640 1 -- 172.21.15.112:0/802332509 learned_addr learned my addr 172.21.15.112:0/802332509 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:09.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.052+0000 7fac177fe640 1 --2- 172.21.15.112:0/802332509 >> v2:172.21.15.169:3300/0 conn(0x7fac1815e450 0x7fac180b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.052+0000 7fac167fc640 1 -- 172.21.15.112:0/802332509 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2550765774 0 0) 0x7fac180d1f70 con 0x7fac180b7670 2024-09-15T23:59:09.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.052+0000 7fac167fc640 1 -- 172.21.15.112:0/802332509 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac00003530 con 0x7fac180b7670 2024-09-15T23:59:09.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac17fff640 1 -- 172.21.15.112:0/802332509 >> v2:172.21.15.169:3300/0 conn(0x7fac1815e450 msgr2=0x7fac180b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:09.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac17fff640 1 --2- 172.21.15.112:0/802332509 >> v2:172.21.15.169:3300/0 conn(0x7fac1815e450 0x7fac180b7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac17fff640 1 -- 172.21.15.112:0/802332509 >> v1:172.21.15.112:6789/0 conn(0x7fac180b7670 legacy=0x7fac180d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac17fff640 1 -- 172.21.15.112:0/802332509 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac180d2210 con 0x7fac180d4840 2024-09-15T23:59:09.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac17fff640 1 --2- 172.21.15.112:0/802332509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180d4840 0x7fac180d2a10 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fac1808c4c0 tx=0x7fac1001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927253aad5dfd73 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:09.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac167fc640 1 -- 172.21.15.112:0/802332509 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac100b2070 con 0x7fac180d4840 2024-09-15T23:59:09.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac167fc640 1 -- 172.21.15.112:0/802332509 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac100a59e0 con 0x7fac180d4840 2024-09-15T23:59:09.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac167fc640 1 -- 172.21.15.112:0/802332509 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac100a5db0 con 0x7fac180d4840 2024-09-15T23:59:09.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac1dcda640 1 -- 172.21.15.112:0/802332509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180d4840 msgr2=0x7fac180d2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac1dcda640 1 --2- 172.21.15.112:0/802332509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180d4840 0x7fac180d2a10 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fac1808c4c0 tx=0x7fac1001c900 comp rx=0 tx=0).stop 2024-09-15T23:59:09.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac1dcda640 1 -- 172.21.15.112:0/802332509 shutdown_connections 2024-09-15T23:59:09.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac1dcda640 1 --2- 172.21.15.112:0/802332509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac180d4840 0x7fac180d2a10 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac1dcda640 1 --2- 172.21.15.112:0/802332509 >> v2:172.21.15.169:3300/0 conn(0x7fac1815e450 0x7fac180b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac1dcda640 1 -- 172.21.15.112:0/802332509 >> 172.21.15.112:0/802332509 conn(0x7fac1808bf90 msgr2=0x7fac1809d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:09.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac1dcda640 1 -- 172.21.15.112:0/802332509 shutdown_connections 2024-09-15T23:59:09.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.056+0000 7fac1dcda640 1 -- 172.21.15.112:0/802332509 wait complete. 2024-09-15T23:59:09.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac1dcda640 1 Processor -- start 2024-09-15T23:59:09.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac1dcda640 1 -- start start 2024-09-15T23:59:09.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac1dcda640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac180b7670 0x7fac18161510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac1dcda640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac180d4840 0x7fac180b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac1dcda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac1815e450 0x7fac180b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac1dcda640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fac180b51b0 con 0x7fac1815e450 2024-09-15T23:59:09.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac1dcda640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fac180b5030 con 0x7fac180d4840 2024-09-15T23:59:09.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac1dcda640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fac180b5330 con 0x7fac180b7670 2024-09-15T23:59:09.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac17fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac1815e450 0x7fac180b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac17fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac1815e450 0x7fac180b30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48270/0 (socket says 172.21.15.112:48270) 2024-09-15T23:59:09.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac17fff640 1 -- 172.21.15.112:0/841856295 learned_addr learned my addr 172.21.15.112:0/841856295 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:09.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac16ffd640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac180d4840 0x7fac180b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac177fe640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac180b7670 0x7fac18161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac17fff640 1 -- 172.21.15.112:0/841856295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac180b7670 msgr2=0x7fac18161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac17fff640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac180b7670 0x7fac18161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac17fff640 1 -- 172.21.15.112:0/841856295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac180d4840 msgr2=0x7fac180b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac17fff640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac180d4840 0x7fac180b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac17fff640 1 -- 172.21.15.112:0/841856295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac180b23d0 con 0x7fac1815e450 2024-09-15T23:59:09.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac177fe640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac180b7670 0x7fac18161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:09.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac17fff640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac1815e450 0x7fac180b30c0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fac10019510 tx=0x7fac100196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:09.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fabfffff640 1 -- 172.21.15.112:0/841856295 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac100b2050 con 0x7fac1815e450 2024-09-15T23:59:09.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fabfffff640 1 -- 172.21.15.112:0/841856295 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac100b3040 con 0x7fac1815e450 2024-09-15T23:59:09.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fabfffff640 1 -- 172.21.15.112:0/841856295 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac100ad890 con 0x7fac1815e450 2024-09-15T23:59:09.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac1dcda640 1 -- 172.21.15.112:0/841856295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac1815ebb0 con 0x7fac1815e450 2024-09-15T23:59:09.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac1dcda640 1 -- 172.21.15.112:0/841856295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac1815f170 con 0x7fac1815e450 2024-09-15T23:59:09.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac1dcda640 1 -- 172.21.15.112:0/841856295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac180d2a10 con 0x7fac1815e450 2024-09-15T23:59:09.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fabfffff640 1 -- 172.21.15.112:0/841856295 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac100c0020 con 0x7fac1815e450 2024-09-15T23:59:09.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fabfffff640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fac040678c0 0x7fac04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fabfffff640 1 -- 172.21.15.112:0/841856295 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7fac10120830 con 0x7fac1815e450 2024-09-15T23:59:09.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.060+0000 7fac177fe640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fac040678c0 0x7fac04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.064+0000 7fac177fe640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fac040678c0 0x7fac04069d80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fac080097a0 tx=0x7fac08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:09.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.068+0000 7fabfffff640 1 -- 172.21.15.112:0/841856295 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fac100c7020 con 0x7fac1815e450 2024-09-15T23:59:09.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.228+0000 7fac1dcda640 1 -- 172.21.15.112:0/841856295 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac180b9c90 con 0x7fac1815e450 2024-09-15T23:59:09.231 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.232+0000 7fabfffff640 1 -- 172.21.15.112:0/841856295 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+17041 (secure 0 0 0) 0x7fac10016520 con 0x7fac1815e450 2024-09-15T23:59:09.232 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:09.232 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":114,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:59:08.241010+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:59:06.192257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-15T23:59:07.224686+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:59:09.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.232+0000 7fac1dcda640 1 -- 172.21.15.112:0/841856295 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fac040678c0 msgr2=0x7fac04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.232+0000 7fac1dcda640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fac040678c0 0x7fac04069d80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fac080097a0 tx=0x7fac08008040 comp rx=0 tx=0).stop 2024-09-15T23:59:09.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.232+0000 7fac1dcda640 1 -- 172.21.15.112:0/841856295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac1815e450 msgr2=0x7fac180b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.232+0000 7fac1dcda640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac1815e450 0x7fac180b30c0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fac10019510 tx=0x7fac100196a0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.232+0000 7fac1dcda640 1 -- 172.21.15.112:0/841856295 shutdown_connections 2024-09-15T23:59:09.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.232+0000 7fac1dcda640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fac040678c0 0x7fac04069d80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.232+0000 7fac1dcda640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac1815e450 0x7fac180b30c0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.232+0000 7fac1dcda640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac180d4840 0x7fac180b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.232+0000 7fac1dcda640 1 --2- 172.21.15.112:0/841856295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac180b7670 0x7fac18161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.232+0000 7fac1dcda640 1 -- 172.21.15.112:0/841856295 >> 172.21.15.112:0/841856295 conn(0x7fac1808bf90 msgr2=0x7fac180d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:09.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.232+0000 7fac1dcda640 1 -- 172.21.15.112:0/841856295 shutdown_connections 2024-09-15T23:59:09.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.232+0000 7fac1dcda640 1 -- 172.21.15.112:0/841856295 wait complete. 2024-09-15T23:59:09.251 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:59:09.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f966af640 1 Processor -- start 2024-09-15T23:59:09.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f966af640 1 -- start start 2024-09-15T23:59:09.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f966af640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f9015bec0 0x7f4f900ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f966af640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f9015c2a0 0x7f4f900aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f966af640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4f900af2a0 0x7f4f9015fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f966af640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4f900b3290 con 0x7f4f9015c2a0 2024-09-15T23:59:09.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f966af640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f4f900b3570 con 0x7f4f900af2a0 2024-09-15T23:59:09.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f966af640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4f900b3850 con 0x7f4f9015bec0 2024-09-15T23:59:09.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f8f7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f9015c2a0 0x7f4f900aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f8f7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4f9015c2a0 0x7f4f900aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48284/0 (socket says 172.21.15.112:48284) 2024-09-15T23:59:09.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f8f7fe640 1 -- 172.21.15.112:0/2359179898 learned_addr learned my addr 172.21.15.112:0/2359179898 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:09.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f94c4c640 1 --2- 172.21.15.112:0/2359179898 >> v2:172.21.15.169:3300/0 conn(0x7f4f900af2a0 0x7f4f9015fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f8ffff640 1 --2- 172.21.15.112:0/2359179898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f9015bec0 0x7f4f900ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f8f7fe640 1 -- 172.21.15.112:0/2359179898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f9015bec0 msgr2=0x7f4f900ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:09.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f8f7fe640 1 --2- 172.21.15.112:0/2359179898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f9015bec0 0x7f4f900ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f8f7fe640 1 -- 172.21.15.112:0/2359179898 >> v2:172.21.15.169:3300/0 conn(0x7f4f900af2a0 msgr2=0x7f4f9015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:09.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f8f7fe640 1 --2- 172.21.15.112:0/2359179898 >> v2:172.21.15.169:3300/0 conn(0x7f4f900af2a0 0x7f4f9015fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.368+0000 7f4f8f7fe640 1 -- 172.21.15.112:0/2359179898 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f900b3b30 con 0x7f4f9015c2a0 2024-09-15T23:59:09.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f8f7fe640 1 --2- 172.21.15.112:0/2359179898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f9015c2a0 0x7f4f900aed60 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4f900ada40 tx=0x7f4f8401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739670fe6550a3e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:09.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f8effd640 1 -- 172.21.15.112:0/2359179898 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f840b0070 con 0x7f4f9015c2a0 2024-09-15T23:59:09.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f8effd640 1 -- 172.21.15.112:0/2359179898 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f840ab600 con 0x7f4f9015c2a0 2024-09-15T23:59:09.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f8effd640 1 -- 172.21.15.112:0/2359179898 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f840ab9d0 con 0x7f4f9015c2a0 2024-09-15T23:59:09.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 -- 172.21.15.112:0/2359179898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f9015c2a0 msgr2=0x7f4f900aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 --2- 172.21.15.112:0/2359179898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f9015c2a0 0x7f4f900aed60 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4f900ada40 tx=0x7f4f8401c230 comp rx=0 tx=0).stop 2024-09-15T23:59:09.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 -- 172.21.15.112:0/2359179898 shutdown_connections 2024-09-15T23:59:09.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 --2- 172.21.15.112:0/2359179898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f9015c2a0 0x7f4f900aed60 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 --2- 172.21.15.112:0/2359179898 >> v2:172.21.15.169:3300/0 conn(0x7f4f900af2a0 0x7f4f9015fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 --2- 172.21.15.112:0/2359179898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f9015bec0 0x7f4f900ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 -- 172.21.15.112:0/2359179898 >> 172.21.15.112:0/2359179898 conn(0x7f4f900b1f90 msgr2=0x7f4f900b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:09.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 -- 172.21.15.112:0/2359179898 shutdown_connections 2024-09-15T23:59:09.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 -- 172.21.15.112:0/2359179898 wait complete. 2024-09-15T23:59:09.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 Processor -- start 2024-09-15T23:59:09.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 -- start start 2024-09-15T23:59:09.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f900af2a0 0x7f4f9014d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f9015bec0 0x7f4f9015d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f9015c2a0 0x7f4f90151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f900af6b0 con 0x7f4f9015c2a0 2024-09-15T23:59:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4f900ad740 con 0x7f4f900af2a0 2024-09-15T23:59:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f966af640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9006e000 con 0x7f4f9015bec0 2024-09-15T23:59:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f94c4c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f9015c2a0 0x7f4f90151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f94c4c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f9015c2a0 0x7f4f90151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48288/0 (socket says 172.21.15.112:48288) 2024-09-15T23:59:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f94c4c640 1 -- 172.21.15.112:0/3602446042 learned_addr learned my addr 172.21.15.112:0/3602446042 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f8ffff640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f900af2a0 0x7f4f9014d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f8f7fe640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f9015bec0 0x7f4f9015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f94c4c640 1 -- 172.21.15.112:0/3602446042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f9015bec0 msgr2=0x7f4f9015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f94c4c640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f9015bec0 0x7f4f9015d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f94c4c640 1 -- 172.21.15.112:0/3602446042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f900af2a0 msgr2=0x7f4f9014d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f94c4c640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f900af2a0 0x7f4f9014d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f94c4c640 1 -- 172.21.15.112:0/3602446042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f900749e0 con 0x7f4f9015c2a0 2024-09-15T23:59:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.372+0000 7f4f8f7fe640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f9015bec0 0x7f4f9015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:09.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.376+0000 7f4f94c4c640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f9015c2a0 0x7f4f90151ee0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009dd0 tx=0x7f4f8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:09.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.376+0000 7f4f8cff9640 1 -- 172.21.15.112:0/3602446042 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f88018020 con 0x7f4f9015c2a0 2024-09-15T23:59:09.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.376+0000 7f4f8cff9640 1 -- 172.21.15.112:0/3602446042 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f88014480 con 0x7f4f9015c2a0 2024-09-15T23:59:09.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.376+0000 7f4f966af640 1 -- 172.21.15.112:0/3602446042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9015b740 con 0x7f4f9015c2a0 2024-09-15T23:59:09.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.376+0000 7f4f8cff9640 1 -- 172.21.15.112:0/3602446042 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f88014870 con 0x7f4f9015c2a0 2024-09-15T23:59:09.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.376+0000 7f4f966af640 1 -- 172.21.15.112:0/3602446042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f90150260 con 0x7f4f9015c2a0 2024-09-15T23:59:09.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.376+0000 7f4f966af640 1 -- 172.21.15.112:0/3602446042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f90156ce0 con 0x7f4f9015c2a0 2024-09-15T23:59:09.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.376+0000 7f4f8cff9640 1 -- 172.21.15.112:0/3602446042 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f8801b020 con 0x7f4f9015c2a0 2024-09-15T23:59:09.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.376+0000 7f4f8cff9640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4f7c0678c0 0x7f4f7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.376+0000 7f4f8cff9640 1 -- 172.21.15.112:0/3602446042 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f4f880868d0 con 0x7f4f9015c2a0 2024-09-15T23:59:09.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.376+0000 7f4f8ffff640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4f7c0678c0 0x7f4f7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.378 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.376+0000 7f4f8ffff640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4f7c0678c0 0x7f4f7c069d80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009a70 tx=0x7f4f80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:09.381 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.380+0000 7f4f8cff9640 1 -- 172.21.15.112:0/3602446042 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4f90156ce0 con 0x7f4f9015c2a0 2024-09-15T23:59:09.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.540+0000 7f4f966af640 1 -- 172.21.15.112:0/3602446042 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f900ad200 con 0x7f4f9015c2a0 2024-09-15T23:59:09.541 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.540+0000 7f4f8cff9640 1 -- 172.21.15.112:0/3602446042 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+17041 (secure 0 0 0) 0x7f4f88022070 con 0x7f4f9015c2a0 2024-09-15T23:59:09.541 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:09.541 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":114,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:59:08.241010+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:59:06.192257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-15T23:59:07.224686+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:59:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.540+0000 7f4f966af640 1 -- 172.21.15.112:0/3602446042 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4f7c0678c0 msgr2=0x7f4f7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.540+0000 7f4f966af640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4f7c0678c0 0x7f4f7c069d80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009a70 tx=0x7f4f80008040 comp rx=0 tx=0).stop 2024-09-15T23:59:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.540+0000 7f4f966af640 1 -- 172.21.15.112:0/3602446042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f9015c2a0 msgr2=0x7f4f90151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.540+0000 7f4f966af640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f9015c2a0 0x7f4f90151ee0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009dd0 tx=0x7f4f8800c490 comp rx=0 tx=0).stop 2024-09-15T23:59:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.540+0000 7f4f966af640 1 -- 172.21.15.112:0/3602446042 shutdown_connections 2024-09-15T23:59:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.540+0000 7f4f966af640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4f7c0678c0 0x7f4f7c069d80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.540+0000 7f4f966af640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f9015c2a0 0x7f4f90151ee0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.540+0000 7f4f966af640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4f9015bec0 0x7f4f9015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.540+0000 7f4f966af640 1 --2- 172.21.15.112:0/3602446042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4f900af2a0 0x7f4f9014d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.544+0000 7f4f966af640 1 -- 172.21.15.112:0/3602446042 >> 172.21.15.112:0/3602446042 conn(0x7f4f900b1f90 msgr2=0x7f4f900b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:09.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.544+0000 7f4f966af640 1 -- 172.21.15.112:0/3602446042 shutdown_connections 2024-09-15T23:59:09.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.544+0000 7f4f966af640 1 -- 172.21.15.112:0/3602446042 wait complete. 2024-09-15T23:59:09.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:59:09.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.684+0000 7f4a4104e640 1 Processor -- start 2024-09-15T23:59:09.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.684+0000 7f4a4104e640 1 -- start start 2024-09-15T23:59:09.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.684+0000 7f4a4104e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4a3c15f3a0 0x7f4a3c165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.684+0000 7f4a4104e640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3c0aede0 con 0x7f4a3c1520a0 2024-09-15T23:59:09.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.684+0000 7f4a4104e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3c15fa10 con 0x7f4a3c070020 2024-09-15T23:59:09.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.684+0000 7f4a4104e640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4a3c152480 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.684 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.684+0000 7f4a3ad9d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f4a3c1520a0 0x7f4a3c06f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57720/0 (socket says 172.21.15.112:57720) 2024-09-15T23:59:09.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.684+0000 7f4a3ad9d640 1 -- 172.21.15.112:0/58612696 learned_addr learned my addr 172.21.15.112:0/58612696 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:09.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.684+0000 7f4a3b59e640 1 --2- 172.21.15.112:0/58612696 >> v2:172.21.15.112:3300/0 conn(0x7f4a3c15f3a0 0x7f4a3c165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.684+0000 7f4a3a59c640 1 -- 172.21.15.112:0/58612696 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3401136027 0 0) 0x7f4a3c0aede0 con 0x7f4a3c1520a0 2024-09-15T23:59:09.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.684+0000 7f4a3a59c640 1 -- 172.21.15.112:0/58612696 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a28003530 con 0x7f4a3c1520a0 2024-09-15T23:59:09.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.684+0000 7f4a3b59e640 1 -- 172.21.15.112:0/58612696 >> v1:172.21.15.169:6789/0 conn(0x7f4a3c070020 legacy=0x7f4a3c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.685 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.684+0000 7f4a3b59e640 1 -- 172.21.15.112:0/58612696 >> v1:172.21.15.112:6789/0 conn(0x7f4a3c1520a0 legacy=0x7f4a3c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.686 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.684+0000 7f4a3b59e640 1 -- 172.21.15.112:0/58612696 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c074250 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a3b59e640 1 --2- 172.21.15.112:0/58612696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a3c15f3a0 0x7f4a3c165f00 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009d90 tx=0x7f4a3401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33e3f7faa8064ff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:09.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a3a59c640 1 -- 172.21.15.112:0/58612696 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340b2070 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a3a59c640 1 -- 172.21.15.112:0/58612696 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a340a5a30 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.687 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a3a59c640 1 -- 172.21.15.112:0/58612696 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340a5de0 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 -- 172.21.15.112:0/58612696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a3c15f3a0 msgr2=0x7f4a3c165f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 --2- 172.21.15.112:0/58612696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a3c15f3a0 0x7f4a3c165f00 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009d90 tx=0x7f4a3401c970 comp rx=0 tx=0).stop 2024-09-15T23:59:09.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 -- 172.21.15.112:0/58612696 shutdown_connections 2024-09-15T23:59:09.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 --2- 172.21.15.112:0/58612696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a3c15f3a0 0x7f4a3c165f00 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 -- 172.21.15.112:0/58612696 >> 172.21.15.112:0/58612696 conn(0x7f4a3c0b1f90 msgr2=0x7f4a3c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:09.688 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 -- 172.21.15.112:0/58612696 shutdown_connections 2024-09-15T23:59:09.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 -- 172.21.15.112:0/58612696 wait complete. 2024-09-15T23:59:09.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 Processor -- start 2024-09-15T23:59:09.689 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 -- start start 2024-09-15T23:59:09.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a3c070020 0x7f4a3c1fb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a3c1520a0 0x7f4a3c146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a3c15f3a0 0x7f4a3c14e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c168c60 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c073d30 con 0x7f4a3c070020 2024-09-15T23:59:09.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a4104e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3c168de0 con 0x7f4a3c1520a0 2024-09-15T23:59:09.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a3b59e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a3c15f3a0 0x7f4a3c14e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a3b59e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a3c15f3a0 0x7f4a3c14e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48312/0 (socket says 172.21.15.112:48312) 2024-09-15T23:59:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a3b59e640 1 -- 172.21.15.112:0/427832896 learned_addr learned my addr 172.21.15.112:0/427832896 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a3ad9d640 1 --2- 172.21.15.112:0/427832896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a3c070020 0x7f4a3c1fb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a33fff640 1 --2- 172.21.15.112:0/427832896 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a3c1520a0 0x7f4a3c146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a3b59e640 1 -- 172.21.15.112:0/427832896 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a3c1520a0 msgr2=0x7f4a3c146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a3b59e640 1 --2- 172.21.15.112:0/427832896 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a3c1520a0 0x7f4a3c146dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a3b59e640 1 -- 172.21.15.112:0/427832896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a3c070020 msgr2=0x7f4a3c1fb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a3b59e640 1 --2- 172.21.15.112:0/427832896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a3c070020 0x7f4a3c1fb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a3b59e640 1 -- 172.21.15.112:0/427832896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c147300 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a3b59e640 1 --2- 172.21.15.112:0/427832896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a3c15f3a0 0x7f4a3c14e190 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f4a340b0040 tx=0x7f4a34019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.688+0000 7f4a337fe640 1 -- 172.21.15.112:0/427832896 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340b2050 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.692+0000 7f4a337fe640 1 -- 172.21.15.112:0/427832896 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a340b3040 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.692+0000 7f4a337fe640 1 -- 172.21.15.112:0/427832896 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a34004040 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.692 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.692+0000 7f4a4104e640 1 -- 172.21.15.112:0/427832896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3c14fd50 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.692+0000 7f4a4104e640 1 -- 172.21.15.112:0/427832896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a3c150310 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.692+0000 7f4a4104e640 1 -- 172.21.15.112:0/427832896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a3c15ec90 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.692+0000 7f4a337fe640 1 -- 172.21.15.112:0/427832896 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a340c0020 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.692+0000 7f4a337fe640 1 --2- 172.21.15.112:0/427832896 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4a1c0678c0 0x7f4a1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:09.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.692+0000 7f4a337fe640 1 -- 172.21.15.112:0/427832896 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f4a341205f0 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.692+0000 7f4a3ad9d640 1 --2- 172.21.15.112:0/427832896 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4a1c0678c0 0x7f4a1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:09.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.692+0000 7f4a3ad9d640 1 --2- 172.21.15.112:0/427832896 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4a1c0678c0 0x7f4a1c069d80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0011f0 tx=0x7f4a2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:09.697 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.696+0000 7f4a337fe640 1 -- 172.21.15.112:0/427832896 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4a340c7020 con 0x7f4a3c15f3a0 2024-09-15T23:59:09.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:09.900+0000 7f4a4104e640 1 -- 172.21.15.112:0/427832896 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4a3c06e540 con 0x7f4a3c15f3a0 2024-09-15T23:59:10.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:10.904+0000 7f4a337fe640 1 -- 172.21.15.112:0/427832896 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) ==== 118+0+0 (secure 0 0 0) 0x7f4a34016560 con 0x7f4a3c15f3a0 2024-09-15T23:59:10.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:10.908+0000 7f4a4104e640 1 -- 172.21.15.112:0/427832896 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4a1c0678c0 msgr2=0x7f4a1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:10.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:10.908+0000 7f4a4104e640 1 --2- 172.21.15.112:0/427832896 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4a1c0678c0 0x7f4a1c069d80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0011f0 tx=0x7f4a2c009040 comp rx=0 tx=0).stop 2024-09-15T23:59:10.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:10.908+0000 7f4a4104e640 1 -- 172.21.15.112:0/427832896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a3c15f3a0 msgr2=0x7f4a3c14e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:10.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:10.908+0000 7f4a4104e640 1 --2- 172.21.15.112:0/427832896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a3c15f3a0 0x7f4a3c14e190 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f4a340b0040 tx=0x7f4a34019710 comp rx=0 tx=0).stop 2024-09-15T23:59:10.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:10.908+0000 7f4a4104e640 1 -- 172.21.15.112:0/427832896 shutdown_connections 2024-09-15T23:59:10.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:10.908+0000 7f4a4104e640 1 --2- 172.21.15.112:0/427832896 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4a1c0678c0 0x7f4a1c069d80 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:10.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:10.908+0000 7f4a4104e640 1 --2- 172.21.15.112:0/427832896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4a3c15f3a0 0x7f4a3c14e190 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:10.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:10.908+0000 7f4a4104e640 1 --2- 172.21.15.112:0/427832896 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a3c1520a0 0x7f4a3c146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:10.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:10.908+0000 7f4a4104e640 1 --2- 172.21.15.112:0/427832896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a3c070020 0x7f4a3c1fb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:10.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:10.908+0000 7f4a4104e640 1 -- 172.21.15.112:0/427832896 >> 172.21.15.112:0/427832896 conn(0x7f4a3c0b1f90 msgr2=0x7f4a3c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:10.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:10.908+0000 7f4a4104e640 1 -- 172.21.15.112:0/427832896 shutdown_connections 2024-09-15T23:59:10.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:10.908+0000 7f4a4104e640 1 -- 172.21.15.112:0/427832896 wait complete. 2024-09-15T23:59:10.927 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:59:10.927 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:59:11.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd88d31b640 1 Processor -- start 2024-09-15T23:59:11.047 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd88d31b640 1 -- start start 2024-09-15T23:59:11.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd88d31b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd8880cd580 0x7fd88815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:11.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd88d31b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8880b3bd0 con 0x7fd88806ccd0 2024-09-15T23:59:11.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd88d31b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd88815b550 con 0x7fd8880b4360 2024-09-15T23:59:11.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd88d31b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd88815b830 con 0x7fd8880cd580 2024-09-15T23:59:11.050 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd886ffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fd88806ccd0 0x7fd88806d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57728/0 (socket says 172.21.15.112:57728) 2024-09-15T23:59:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd886ffd640 1 -- 172.21.15.112:0/827648945 learned_addr learned my addr 172.21.15.112:0/827648945 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 -- 172.21.15.112:0/827648945 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3126973485 0 0) 0x7fd8880b3bd0 con 0x7fd88806ccd0 2024-09-15T23:59:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 -- 172.21.15.112:0/827648945 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd874004640 con 0x7fd88806ccd0 2024-09-15T23:59:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd87ffff640 1 --2- 172.21.15.112:0/827648945 >> v2:172.21.15.169:3300/0 conn(0x7fd8880cd580 0x7fd88815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 -- 172.21.15.112:0/827648945 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1322177435 0 0) 0x7fd874004640 con 0x7fd88806ccd0 2024-09-15T23:59:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 -- 172.21.15.112:0/827648945 >> v2:172.21.15.169:3300/0 conn(0x7fd8880cd580 msgr2=0x7fd88815ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 --2- 172.21.15.112:0/827648945 >> v2:172.21.15.169:3300/0 conn(0x7fd8880cd580 0x7fd88815ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 -- 172.21.15.112:0/827648945 >> v1:172.21.15.169:6789/0 conn(0x7fd8880b4360 legacy=0x7fd8880ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 -- 172.21.15.112:0/827648945 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8880b3e40 con 0x7fd88806ccd0 2024-09-15T23:59:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 -- 172.21.15.112:0/827648945 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fd878001680 con 0x7fd88806ccd0 2024-09-15T23:59:11.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 -- 172.21.15.112:0/827648945 >> v1:172.21.15.112:6789/0 conn(0x7fd88806ccd0 legacy=0x7fd88806d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:11.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 --2- 172.21.15.112:0/827648945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd874004ad0 0x7fd874004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:11.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 --2- 172.21.15.112:0/827648945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd874005920 0x7fd874005da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:11.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 --2- 172.21.15.112:0/827648945 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8740062e0 0x7fd87400cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:11.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 -- 172.21.15.112:0/827648945 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd88815b830 con 0x7fd874004ad0 2024-09-15T23:59:11.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 -- 172.21.15.112:0/827648945 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd87400d210 con 0x7fd874005920 2024-09-15T23:59:11.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8867fc640 1 -- 172.21.15.112:0/827648945 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd87400d410 con 0x7fd8740062e0 2024-09-15T23:59:11.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd886ffd640 1 --2- 172.21.15.112:0/827648945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd874004ad0 0x7fd874004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:11.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd886ffd640 1 -- 172.21.15.112:0/827648945 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8740062e0 msgr2=0x7fd87400cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:11.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8877fe640 1 --2- 172.21.15.112:0/827648945 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8740062e0 0x7fd87400cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:11.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd886ffd640 1 --2- 172.21.15.112:0/827648945 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8740062e0 0x7fd87400cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:11.052 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd886ffd640 1 -- 172.21.15.112:0/827648945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd874005920 msgr2=0x7fd874005da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:11.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd886ffd640 1 --2- 172.21.15.112:0/827648945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd874005920 0x7fd874005da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:11.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd886ffd640 1 -- 172.21.15.112:0/827648945 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd874004640 con 0x7fd874004ad0 2024-09-15T23:59:11.053 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.048+0000 7fd8877fe640 1 -- 172.21.15.112:0/827648945 reap_dead start 2024-09-15T23:59:11.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd886ffd640 1 --2- 172.21.15.112:0/827648945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd874004ad0 0x7fd874004ed0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c210 tx=0x7fd87801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc595a2b6b31e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:11.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd8867fc640 1 -- 172.21.15.112:0/827648945 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd878007d20 con 0x7fd874004ad0 2024-09-15T23:59:11.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd8867fc640 1 -- 172.21.15.112:0/827648945 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8780a9020 con 0x7fd874004ad0 2024-09-15T23:59:11.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd8867fc640 1 -- 172.21.15.112:0/827648945 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd878005ae0 con 0x7fd874004ad0 2024-09-15T23:59:11.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 -- 172.21.15.112:0/827648945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd874004ad0 msgr2=0x7fd874004ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:11.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 --2- 172.21.15.112:0/827648945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd874004ad0 0x7fd874004ed0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c210 tx=0x7fd87801cc40 comp rx=0 tx=0).stop 2024-09-15T23:59:11.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 -- 172.21.15.112:0/827648945 shutdown_connections 2024-09-15T23:59:11.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 --2- 172.21.15.112:0/827648945 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd874004ad0 0x7fd874004ed0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:11.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 -- 172.21.15.112:0/827648945 >> 172.21.15.112:0/827648945 conn(0x7fd888072690 msgr2=0x7fd888072aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:11.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 -- 172.21.15.112:0/827648945 shutdown_connections 2024-09-15T23:59:11.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 -- 172.21.15.112:0/827648945 wait complete. 2024-09-15T23:59:11.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 Processor -- start 2024-09-15T23:59:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 -- start start 2024-09-15T23:59:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd874004ad0 0x7fd8881f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd888148460 0x7fd888156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd888157490 0x7fd88814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd888067a00 con 0x7fd888148460 2024-09-15T23:59:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd888155140 con 0x7fd888157490 2024-09-15T23:59:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd88d31b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd888067b80 con 0x7fd874004ad0 2024-09-15T23:59:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd87ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd888148460 0x7fd888156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd87ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd888148460 0x7fd888156f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48324/0 (socket says 172.21.15.112:48324) 2024-09-15T23:59:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd87ffff640 1 -- 172.21.15.112:0/1952517724 learned_addr learned my addr 172.21.15.112:0/1952517724 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:11.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd886ffd640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd874004ad0 0x7fd8881f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd8877fe640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd888157490 0x7fd88814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd87ffff640 1 -- 172.21.15.112:0/1952517724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd874004ad0 msgr2=0x7fd8881f33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd87ffff640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd874004ad0 0x7fd8881f33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd87ffff640 1 -- 172.21.15.112:0/1952517724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd888157490 msgr2=0x7fd88814c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd87ffff640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd888157490 0x7fd88814c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd87ffff640 1 -- 172.21.15.112:0/1952517724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88815d340 con 0x7fd888148460 2024-09-15T23:59:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd8877fe640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd888157490 0x7fd88814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.052+0000 7fd87ffff640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd888148460 0x7fd888156f50 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fd87000fa90 tx=0x7fd87000ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.056+0000 7fd87f7fe640 1 -- 172.21.15.112:0/1952517724 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870015070 con 0x7fd888148460 2024-09-15T23:59:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.056+0000 7fd87f7fe640 1 -- 172.21.15.112:0/1952517724 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd870007d10 con 0x7fd888148460 2024-09-15T23:59:11.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.056+0000 7fd88d31b640 1 -- 172.21.15.112:0/1952517724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd88815d620 con 0x7fd888148460 2024-09-15T23:59:11.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.056+0000 7fd87f7fe640 1 -- 172.21.15.112:0/1952517724 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87001a6a0 con 0x7fd888148460 2024-09-15T23:59:11.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.056+0000 7fd88d31b640 1 -- 172.21.15.112:0/1952517724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8881579d0 con 0x7fd888148460 2024-09-15T23:59:11.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.056+0000 7fd88d31b640 1 -- 172.21.15.112:0/1952517724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd888067f10 con 0x7fd888148460 2024-09-15T23:59:11.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.056+0000 7fd87f7fe640 1 -- 172.21.15.112:0/1952517724 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd870011450 con 0x7fd888148460 2024-09-15T23:59:11.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.056+0000 7fd87f7fe640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd8680678c0 0x7fd868069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:11.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.056+0000 7fd87f7fe640 1 -- 172.21.15.112:0/1952517724 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7fd870088660 con 0x7fd888148460 2024-09-15T23:59:11.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.056+0000 7fd886ffd640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd8680678c0 0x7fd868069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:11.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.056+0000 7fd886ffd640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd8680678c0 0x7fd868069d80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd8780aa000 tx=0x7fd88806e7c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:11.062 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.060+0000 7fd87f7fe640 1 -- 172.21.15.112:0/1952517724 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd870059010 con 0x7fd888148460 2024-09-15T23:59:11.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.244+0000 7fd88d31b640 1 -- 172.21.15.112:0/1952517724 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd888151670 con 0x7fd888148460 2024-09-15T23:59:11.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.912+0000 7fd87f7fe640 1 -- 172.21.15.112:0/1952517724 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v72) ==== 122+0+0 (secure 0 0 0) 0x7fd870086e20 con 0x7fd888148460 2024-09-15T23:59:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.916+0000 7fd88d31b640 1 -- 172.21.15.112:0/1952517724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd8680678c0 msgr2=0x7fd868069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.916+0000 7fd88d31b640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd8680678c0 0x7fd868069d80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd8780aa000 tx=0x7fd88806e7c0 comp rx=0 tx=0).stop 2024-09-15T23:59:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.916+0000 7fd88d31b640 1 -- 172.21.15.112:0/1952517724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd888148460 msgr2=0x7fd888156f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.916+0000 7fd88d31b640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd888148460 0x7fd888156f50 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fd87000fa90 tx=0x7fd87000ff50 comp rx=0 tx=0).stop 2024-09-15T23:59:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.916+0000 7fd88d31b640 1 -- 172.21.15.112:0/1952517724 shutdown_connections 2024-09-15T23:59:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.916+0000 7fd88d31b640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd8680678c0 0x7fd868069d80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.916+0000 7fd88d31b640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd888157490 0x7fd88814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.916+0000 7fd88d31b640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd888148460 0x7fd888156f50 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.916+0000 7fd88d31b640 1 --2- 172.21.15.112:0/1952517724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd874004ad0 0x7fd8881f33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:11.918 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.916+0000 7fd88d31b640 1 -- 172.21.15.112:0/1952517724 >> 172.21.15.112:0/1952517724 conn(0x7fd888072690 msgr2=0x7fd888158840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:11.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.916+0000 7fd88d31b640 1 -- 172.21.15.112:0/1952517724 shutdown_connections 2024-09-15T23:59:11.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:11.916+0000 7fd88d31b640 1 -- 172.21.15.112:0/1952517724 wait complete. 2024-09-15T23:59:11.937 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:59:11.938 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:59:12.055 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.056+0000 7f68cf5a2640 1 Processor -- start 2024-09-15T23:59:12.056 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.056+0000 7f68cf5a2640 1 -- start start 2024-09-15T23:59:12.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.056+0000 7f68cf5a2640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f68c815e5f0 0x7f68c806d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.056+0000 7f68cf5a2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f68c80ce9d0 0x7f68c80cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.056+0000 7f68cf5a2640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c806d9c0 con 0x7f68c80cf920 2024-09-15T23:59:12.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.056+0000 7f68cf5a2640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f68c80cfd90 con 0x7f68c815e5f0 2024-09-15T23:59:12.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.056+0000 7f68cf5a2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f68c806dca0 con 0x7f68c80ce9d0 2024-09-15T23:59:12.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.056+0000 7f68cd33e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f68c815e5f0 0x7f68c806d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:12.057 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.056+0000 7f68cd33e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f68c815e5f0 0x7f68c806d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48326/0 (socket says 172.21.15.112:48326) 2024-09-15T23:59:12.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.056+0000 7f68cd33e640 1 -- 172.21.15.112:0/2549079493 learned_addr learned my addr 172.21.15.112:0/2549079493 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:12.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.056+0000 7f68cd33e640 1 -- 172.21.15.112:0/2549079493 >> v2:172.21.15.169:3300/0 conn(0x7f68c80ce9d0 msgr2=0x7f68c80cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:12.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.056+0000 7f68cd33e640 1 --2- 172.21.15.112:0/2549079493 >> v2:172.21.15.169:3300/0 conn(0x7f68c80ce9d0 0x7f68c80cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.056+0000 7f68cd33e640 1 -- 172.21.15.112:0/2549079493 >> v1:172.21.15.169:6789/0 conn(0x7f68c80cf920 legacy=0x7f68c80d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:12.058 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.056+0000 7f68cd33e640 1 -- 172.21.15.112:0/2549079493 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c806df80 con 0x7f68c815e5f0 2024-09-15T23:59:12.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cd33e640 1 --2- 172.21.15.112:0/2549079493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c815e5f0 0x7f68c806d090 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f68c80ce980 tx=0x7f68c401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b800465254135547 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:12.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68bffff640 1 -- 172.21.15.112:0/2549079493 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c40b1070 con 0x7f68c815e5f0 2024-09-15T23:59:12.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68bffff640 1 -- 172.21.15.112:0/2549079493 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c40ac640 con 0x7f68c815e5f0 2024-09-15T23:59:12.059 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68bffff640 1 -- 172.21.15.112:0/2549079493 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c40aca10 con 0x7f68c815e5f0 2024-09-15T23:59:12.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2549079493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c815e5f0 msgr2=0x7f68c806d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 --2- 172.21.15.112:0/2549079493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c815e5f0 0x7f68c806d090 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f68c80ce980 tx=0x7f68c401c4e0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.060 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2549079493 shutdown_connections 2024-09-15T23:59:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 --2- 172.21.15.112:0/2549079493 >> v2:172.21.15.169:3300/0 conn(0x7f68c80ce9d0 0x7f68c80cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 --2- 172.21.15.112:0/2549079493 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c815e5f0 0x7f68c806d090 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2549079493 >> 172.21.15.112:0/2549079493 conn(0x7f68c8074030 msgr2=0x7f68c809d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2549079493 shutdown_connections 2024-09-15T23:59:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2549079493 wait complete. 2024-09-15T23:59:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 Processor -- start 2024-09-15T23:59:12.061 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 -- start start 2024-09-15T23:59:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68c80cf920 0x7f68c815a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68c8154b20 0x7f68c8155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c80b5e50 0x7f68c80b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f68c816b120 con 0x7f68c80b5e50 2024-09-15T23:59:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f68c816afa0 con 0x7f68c80cf920 2024-09-15T23:59:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cf5a2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f68c816b2a0 con 0x7f68c8154b20 2024-09-15T23:59:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cdb3f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c80b5e50 0x7f68c80b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cdb3f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c80b5e50 0x7f68c80b62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48330/0 (socket says 172.21.15.112:48330) 2024-09-15T23:59:12.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cdb3f640 1 -- 172.21.15.112:0/2786055963 learned_addr learned my addr 172.21.15.112:0/2786055963 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:12.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cd33e640 1 --2- 172.21.15.112:0/2786055963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68c80cf920 0x7f68c815a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:12.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cdb3f640 1 -- 172.21.15.112:0/2786055963 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68c8154b20 msgr2=0x7f68c8155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cdb3f640 1 --2- 172.21.15.112:0/2786055963 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68c8154b20 0x7f68c8155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cdb3f640 1 -- 172.21.15.112:0/2786055963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68c80cf920 msgr2=0x7f68c815a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cdb3f640 1 --2- 172.21.15.112:0/2786055963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68c80cf920 0x7f68c815a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.060+0000 7f68cdb3f640 1 -- 172.21.15.112:0/2786055963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c81558d0 con 0x7f68c80b5e50 2024-09-15T23:59:12.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.064+0000 7f68cdb3f640 1 --2- 172.21.15.112:0/2786055963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c80b5e50 0x7f68c80b62d0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f68c000c7e0 tx=0x7f68c000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:12.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.064+0000 7f68bdffb640 1 -- 172.21.15.112:0/2786055963 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c0017070 con 0x7f68c80b5e50 2024-09-15T23:59:12.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.064+0000 7f68bdffb640 1 -- 172.21.15.112:0/2786055963 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c0003db0 con 0x7f68c80b5e50 2024-09-15T23:59:12.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.064+0000 7f68bdffb640 1 -- 172.21.15.112:0/2786055963 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c00052b0 con 0x7f68c80b5e50 2024-09-15T23:59:12.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.064+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2786055963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c8155b50 con 0x7f68c80b5e50 2024-09-15T23:59:12.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.064+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2786055963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c8156110 con 0x7f68c80b5e50 2024-09-15T23:59:12.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.064+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2786055963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c815b1e0 con 0x7f68c80b5e50 2024-09-15T23:59:12.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.064+0000 7f68bdffb640 1 -- 172.21.15.112:0/2786055963 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f68c0005450 con 0x7f68c80b5e50 2024-09-15T23:59:12.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.064+0000 7f68bdffb640 1 --2- 172.21.15.112:0/2786055963 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68ac0678c0 0x7f68ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.064+0000 7f68cd33e640 1 --2- 172.21.15.112:0/2786055963 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68ac0678c0 0x7f68ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:12.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.064+0000 7f68bdffb640 1 -- 172.21.15.112:0/2786055963 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f68c0085150 con 0x7f68c80b5e50 2024-09-15T23:59:12.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.064+0000 7f68cd33e640 1 --2- 172.21.15.112:0/2786055963 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68ac0678c0 0x7f68ac069d80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f68c40ae000 tx=0x7f68c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:12.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.068+0000 7f68bdffb640 1 -- 172.21.15.112:0/2786055963 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f68c81558d0 con 0x7f68c80b5e50 2024-09-15T23:59:12.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.252+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2786055963 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68c815af00 con 0x7f68c80b5e50 2024-09-15T23:59:12.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.252+0000 7f68bdffb640 1 -- 172.21.15.112:0/2786055963 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5237 (secure 0 0 0) 0x7f68c0055b90 con 0x7f68c80b5e50 2024-09-15T23:59:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:12.255 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":72,"btime":"2024-09-15T23:59:11:908708+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2146678161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2146678161},{"type":"v1","addr":"172.21.15.169:6835","nonce":2146678161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1904671431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1904671431},{"type":"v1","addr":"172.21.15.169:6833","nonce":1904671431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3435773285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3435773285},{"type":"v1","addr":"172.21.15.112:6835","nonce":3435773285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:59:08.241764+0000","modified":"2024-09-15T23:59:11.248014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7209":{"gid":7209,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2554639091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2554639091},{"type":"v1","addr":"172.21.15.112:6837","nonce":2554639091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7209,"qdb_cluster":[7209]},"id":8}]} 2024-09-15T23:59:12.255 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 72 2024-09-15T23:59:12.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.256+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2786055963 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68ac0678c0 msgr2=0x7f68ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.256+0000 7f68cf5a2640 1 --2- 172.21.15.112:0/2786055963 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68ac0678c0 0x7f68ac069d80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f68c40ae000 tx=0x7f68c4008040 comp rx=0 tx=0).stop 2024-09-15T23:59:12.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.256+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2786055963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c80b5e50 msgr2=0x7f68c80b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.256+0000 7f68cf5a2640 1 --2- 172.21.15.112:0/2786055963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c80b5e50 0x7f68c80b62d0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f68c000c7e0 tx=0x7f68c000cca0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.256+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2786055963 shutdown_connections 2024-09-15T23:59:12.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.256+0000 7f68cf5a2640 1 --2- 172.21.15.112:0/2786055963 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f68ac0678c0 0x7f68ac069d80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.256+0000 7f68cf5a2640 1 --2- 172.21.15.112:0/2786055963 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68c80b5e50 0x7f68c80b62d0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.256+0000 7f68cf5a2640 1 --2- 172.21.15.112:0/2786055963 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68c8154b20 0x7f68c8155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.256+0000 7f68cf5a2640 1 --2- 172.21.15.112:0/2786055963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68c80cf920 0x7f68c815a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.256+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2786055963 >> 172.21.15.112:0/2786055963 conn(0x7f68c80ce9d0 msgr2=0x7f68c815b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:12.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.256+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2786055963 shutdown_connections 2024-09-15T23:59:12.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.256+0000 7f68cf5a2640 1 -- 172.21.15.112:0/2786055963 wait complete. 2024-09-15T23:59:12.273 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:59:12.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.392+0000 7f5b242be640 1 Processor -- start 2024-09-15T23:59:12.394 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.392+0000 7f5b242be640 1 -- start start 2024-09-15T23:59:12.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b242be640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b1c15bec0 0x7f5b1c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b242be640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5b1c15c2a0 0x7f5b1c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b242be640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b1c0b3290 con 0x7f5b1c0af2a0 2024-09-15T23:59:12.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b242be640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f5b1c0b3570 con 0x7f5b1c15c2a0 2024-09-15T23:59:12.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b242be640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1c0b3850 con 0x7f5b1c15bec0 2024-09-15T23:59:12.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b21859640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5b1c15c2a0 0x7f5b1c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:12.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b21859640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f5b1c15c2a0 0x7f5b1c0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48334/0 (socket says 172.21.15.112:48334) 2024-09-15T23:59:12.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b21859640 1 -- 172.21.15.112:0/3793022703 learned_addr learned my addr 172.21.15.112:0/3793022703 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:12.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b2205a640 1 --2- 172.21.15.112:0/3793022703 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b1c15bec0 0x7f5b1c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:12.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b21859640 1 -- 172.21.15.112:0/3793022703 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b1c15bec0 msgr2=0x7f5b1c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:12.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b21859640 1 --2- 172.21.15.112:0/3793022703 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b1c15bec0 0x7f5b1c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b21859640 1 -- 172.21.15.112:0/3793022703 >> v1:172.21.15.169:6789/0 conn(0x7f5b1c0af2a0 legacy=0x7f5b1c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b21859640 1 -- 172.21.15.112:0/3793022703 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1c0b3b30 con 0x7f5b1c15c2a0 2024-09-15T23:59:12.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b21859640 1 --2- 172.21.15.112:0/3793022703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b1c15c2a0 0x7f5b1c0aed60 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009870 tx=0x7f5b1801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0a6e73a789a6ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:12.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b21058640 1 -- 172.21.15.112:0/3793022703 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b180a95f0 con 0x7f5b1c15c2a0 2024-09-15T23:59:12.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b21058640 1 -- 172.21.15.112:0/3793022703 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b180a9790 con 0x7f5b1c15c2a0 2024-09-15T23:59:12.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b21058640 1 -- 172.21.15.112:0/3793022703 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b180a9b60 con 0x7f5b1c15c2a0 2024-09-15T23:59:12.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b242be640 1 -- 172.21.15.112:0/3793022703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b1c15c2a0 msgr2=0x7f5b1c0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b242be640 1 --2- 172.21.15.112:0/3793022703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b1c15c2a0 0x7f5b1c0aed60 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009870 tx=0x7f5b1801c530 comp rx=0 tx=0).stop 2024-09-15T23:59:12.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b242be640 1 -- 172.21.15.112:0/3793022703 shutdown_connections 2024-09-15T23:59:12.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b242be640 1 --2- 172.21.15.112:0/3793022703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b1c15c2a0 0x7f5b1c0aed60 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b242be640 1 --2- 172.21.15.112:0/3793022703 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b1c15bec0 0x7f5b1c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.396+0000 7f5b242be640 1 -- 172.21.15.112:0/3793022703 >> 172.21.15.112:0/3793022703 conn(0x7f5b1c0b1f90 msgr2=0x7f5b1c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:12.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b242be640 1 -- 172.21.15.112:0/3793022703 shutdown_connections 2024-09-15T23:59:12.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b242be640 1 -- 172.21.15.112:0/3793022703 wait complete. 2024-09-15T23:59:12.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b242be640 1 Processor -- start 2024-09-15T23:59:12.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b242be640 1 -- start start 2024-09-15T23:59:12.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b242be640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b1c0af2a0 0x7f5b1c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b242be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b1c15bec0 0x7f5b1c15e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b242be640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b1c15c2a0 0x7f5b1c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b242be640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c0af6b0 con 0x7f5b1c15bec0 2024-09-15T23:59:12.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b242be640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c0ad740 con 0x7f5b1c0af2a0 2024-09-15T23:59:12.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b242be640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1c169000 con 0x7f5b1c15c2a0 2024-09-15T23:59:12.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b21859640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b1c15bec0 0x7f5b1c15e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:12.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b21859640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b1c15bec0 0x7f5b1c15e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48342/0 (socket says 172.21.15.112:48342) 2024-09-15T23:59:12.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b21859640 1 -- 172.21.15.112:0/653164829 learned_addr learned my addr 172.21.15.112:0/653164829 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:12.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b2205a640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b1c0af2a0 0x7f5b1c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:12.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b2285b640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b1c15c2a0 0x7f5b1c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:12.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b21859640 1 -- 172.21.15.112:0/653164829 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b1c15c2a0 msgr2=0x7f5b1c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b21859640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b1c15c2a0 0x7f5b1c15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b21859640 1 -- 172.21.15.112:0/653164829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b1c0af2a0 msgr2=0x7f5b1c153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b21859640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b1c0af2a0 0x7f5b1c153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b21859640 1 -- 172.21.15.112:0/653164829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1c154050 con 0x7f5b1c15bec0 2024-09-15T23:59:12.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b2205a640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b1c0af2a0 0x7f5b1c153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:59:12.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b21859640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b1c15bec0 0x7f5b1c15e010 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f5b1801a160 tx=0x7f5b180192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:12.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b12ffd640 1 -- 172.21.15.112:0/653164829 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b180bf070 con 0x7f5b1c15bec0 2024-09-15T23:59:12.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b12ffd640 1 -- 172.21.15.112:0/653164829 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b180ba410 con 0x7f5b1c15bec0 2024-09-15T23:59:12.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b12ffd640 1 -- 172.21.15.112:0/653164829 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b180ba800 con 0x7f5b1c15bec0 2024-09-15T23:59:12.403 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b242be640 1 -- 172.21.15.112:0/653164829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1c071f10 con 0x7f5b1c15bec0 2024-09-15T23:59:12.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b242be640 1 -- 172.21.15.112:0/653164829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b1c0724b0 con 0x7f5b1c15bec0 2024-09-15T23:59:12.404 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.400+0000 7f5b242be640 1 -- 172.21.15.112:0/653164829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b1c15c6c0 con 0x7f5b1c15bec0 2024-09-15T23:59:12.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.404+0000 7f5b12ffd640 1 -- 172.21.15.112:0/653164829 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5b180c2070 con 0x7f5b1c15bec0 2024-09-15T23:59:12.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.404+0000 7f5b12ffd640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5b000678c0 0x7f5b00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.404+0000 7f5b12ffd640 1 -- 172.21.15.112:0/653164829 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f5b18120190 con 0x7f5b1c15bec0 2024-09-15T23:59:12.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.404+0000 7f5b2205a640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5b000678c0 0x7f5b00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:12.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.404+0000 7f5b2205a640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5b000678c0 0x7f5b00069d80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c1fae20 tx=0x7f5b0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:12.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.408+0000 7f5b12ffd640 1 -- 172.21.15.112:0/653164829 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5b1c154050 con 0x7f5b1c15bec0 2024-09-15T23:59:12.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.568+0000 7f5b242be640 1 -- 172.21.15.112:0/653164829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b1c072e40 con 0x7f5b1c15bec0 2024-09-15T23:59:12.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.572+0000 7f5b12ffd640 1 -- 172.21.15.112:0/653164829 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+17028 (secure 0 0 0) 0x7f5b180ad020 con 0x7f5b1c15bec0 2024-09-15T23:59:12.572 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:12.572 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":115,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:59:09.897781+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:59:06.192257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-15T23:59:07.224686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:59:12.574 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.572+0000 7f5b242be640 1 -- 172.21.15.112:0/653164829 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5b000678c0 msgr2=0x7f5b00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.572+0000 7f5b242be640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5b000678c0 0x7f5b00069d80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c1fae20 tx=0x7f5b0c008040 comp rx=0 tx=0).stop 2024-09-15T23:59:12.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.572+0000 7f5b242be640 1 -- 172.21.15.112:0/653164829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b1c15bec0 msgr2=0x7f5b1c15e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.572+0000 7f5b242be640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b1c15bec0 0x7f5b1c15e010 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f5b1801a160 tx=0x7f5b180192d0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.572+0000 7f5b242be640 1 -- 172.21.15.112:0/653164829 shutdown_connections 2024-09-15T23:59:12.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.572+0000 7f5b242be640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5b000678c0 0x7f5b00069d80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.572+0000 7f5b242be640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b1c15c2a0 0x7f5b1c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.572+0000 7f5b242be640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b1c15bec0 0x7f5b1c15e010 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.572+0000 7f5b242be640 1 --2- 172.21.15.112:0/653164829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b1c0af2a0 0x7f5b1c153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.572+0000 7f5b242be640 1 -- 172.21.15.112:0/653164829 >> 172.21.15.112:0/653164829 conn(0x7f5b1c0b1f90 msgr2=0x7f5b1c154370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:12.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.572+0000 7f5b242be640 1 -- 172.21.15.112:0/653164829 shutdown_connections 2024-09-15T23:59:12.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.572+0000 7f5b242be640 1 -- 172.21.15.112:0/653164829 wait complete. 2024-09-15T23:59:12.592 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:59:12.592 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:59:12.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d49d59640 1 Processor -- start 2024-09-15T23:59:12.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d49d59640 1 -- start start 2024-09-15T23:59:12.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d49d59640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f3d4406c3d0 0x7f3d4415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d49d59640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d4415d290 0x7f3d4415e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d49d59640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4415fc10 con 0x7f3d4415f830 2024-09-15T23:59:12.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d49d59640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f3d4415da40 con 0x7f3d4406c3d0 2024-09-15T23:59:12.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d49d59640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4415d800 con 0x7f3d4415d290 2024-09-15T23:59:12.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d437fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3d4415f830 0x7f3d4406bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57732/0 (socket says 172.21.15.112:57732) 2024-09-15T23:59:12.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d437fe640 1 -- 172.21.15.112:0/1896957476 learned_addr learned my addr 172.21.15.112:0/1896957476 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:12.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d42ffd640 1 --2- 172.21.15.112:0/1896957476 >> v2:172.21.15.112:3300/0 conn(0x7f3d4406c3d0 0x7f3d4415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:12.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d427fc640 1 -- 172.21.15.112:0/1896957476 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 228747541 0 0) 0x7f3d4415fc10 con 0x7f3d4415f830 2024-09-15T23:59:12.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d43fff640 1 --2- 172.21.15.112:0/1896957476 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d4415d290 0x7f3d4415e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:12.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d427fc640 1 -- 172.21.15.112:0/1896957476 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d2c003530 con 0x7f3d4415f830 2024-09-15T23:59:12.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d42ffd640 1 -- 172.21.15.112:0/1896957476 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d4415d290 msgr2=0x7f3d4415e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:12.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d42ffd640 1 --2- 172.21.15.112:0/1896957476 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d4415d290 0x7f3d4415e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d42ffd640 1 -- 172.21.15.112:0/1896957476 >> v1:172.21.15.112:6789/0 conn(0x7f3d4415f830 legacy=0x7f3d4406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.712+0000 7f3d42ffd640 1 -- 172.21.15.112:0/1896957476 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d440b3570 con 0x7f3d4406c3d0 2024-09-15T23:59:12.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d42ffd640 1 --2- 172.21.15.112:0/1896957476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d4406c3d0 0x7f3d4415ded0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f3d380097c0 tx=0x7f3d3801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d997eb3fa68556 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:12.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d427fc640 1 -- 172.21.15.112:0/1896957476 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d380a7070 con 0x7f3d4406c3d0 2024-09-15T23:59:12.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d427fc640 1 -- 172.21.15.112:0/1896957476 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d380b0070 con 0x7f3d4406c3d0 2024-09-15T23:59:12.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d427fc640 1 -- 172.21.15.112:0/1896957476 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d380ab870 con 0x7f3d4406c3d0 2024-09-15T23:59:12.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 -- 172.21.15.112:0/1896957476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d4406c3d0 msgr2=0x7f3d4415ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 --2- 172.21.15.112:0/1896957476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d4406c3d0 0x7f3d4415ded0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f3d380097c0 tx=0x7f3d3801c470 comp rx=0 tx=0).stop 2024-09-15T23:59:12.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 -- 172.21.15.112:0/1896957476 shutdown_connections 2024-09-15T23:59:12.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 --2- 172.21.15.112:0/1896957476 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d4415d290 0x7f3d4415e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 --2- 172.21.15.112:0/1896957476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d4406c3d0 0x7f3d4415ded0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 -- 172.21.15.112:0/1896957476 >> 172.21.15.112:0/1896957476 conn(0x7f3d440b6800 msgr2=0x7f3d440b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:12.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 -- 172.21.15.112:0/1896957476 shutdown_connections 2024-09-15T23:59:12.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 -- 172.21.15.112:0/1896957476 wait complete. 2024-09-15T23:59:12.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 Processor -- start 2024-09-15T23:59:12.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 -- start start 2024-09-15T23:59:12.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d4406c3d0 0x7f3d44145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d4415d290 0x7f3d441478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d4415f830 0x7f3d4414b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3d44169390 con 0x7f3d4415f830 2024-09-15T23:59:12.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3d44169210 con 0x7f3d4415d290 2024-09-15T23:59:12.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d49d59640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3d44169510 con 0x7f3d4406c3d0 2024-09-15T23:59:12.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d43fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d4415f830 0x7f3d4414b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:12.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d43fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d4415f830 0x7f3d4414b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48358/0 (socket says 172.21.15.112:48358) 2024-09-15T23:59:12.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d43fff640 1 -- 172.21.15.112:0/1237897725 learned_addr learned my addr 172.21.15.112:0/1237897725 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:12.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d43fff640 1 -- 172.21.15.112:0/1237897725 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d4406c3d0 msgr2=0x7f3d44145940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d43fff640 1 --2- 172.21.15.112:0/1237897725 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d4406c3d0 0x7f3d44145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d43fff640 1 -- 172.21.15.112:0/1237897725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d4415d290 msgr2=0x7f3d441478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d43fff640 1 --2- 172.21.15.112:0/1237897725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d4415d290 0x7f3d441478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.716+0000 7f3d43fff640 1 -- 172.21.15.112:0/1237897725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4414a530 con 0x7f3d4415f830 2024-09-15T23:59:12.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.720+0000 7f3d43fff640 1 --2- 172.21.15.112:0/1237897725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d4415f830 0x7f3d4414b5f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c007e60 tx=0x7f3d3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:12.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.720+0000 7f3d2bfff640 1 -- 172.21.15.112:0/1237897725 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c014420 con 0x7f3d4415f830 2024-09-15T23:59:12.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.720+0000 7f3d2bfff640 1 -- 172.21.15.112:0/1237897725 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d3c019070 con 0x7f3d4415f830 2024-09-15T23:59:12.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.720+0000 7f3d49d59640 1 -- 172.21.15.112:0/1237897725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d4414a810 con 0x7f3d4415f830 2024-09-15T23:59:12.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.720+0000 7f3d2bfff640 1 -- 172.21.15.112:0/1237897725 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c014820 con 0x7f3d4415f830 2024-09-15T23:59:12.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.720+0000 7f3d49d59640 1 -- 172.21.15.112:0/1237897725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d4414b0d0 con 0x7f3d4415f830 2024-09-15T23:59:12.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.720+0000 7f3d49d59640 1 -- 172.21.15.112:0/1237897725 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d4414abe0 con 0x7f3d4415f830 2024-09-15T23:59:12.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.720+0000 7f3d2bfff640 1 -- 172.21.15.112:0/1237897725 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d3c0149c0 con 0x7f3d4415f830 2024-09-15T23:59:12.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.720+0000 7f3d2bfff640 1 --2- 172.21.15.112:0/1237897725 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3d300678c0 0x7f3d30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:12.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.720+0000 7f3d2bfff640 1 -- 172.21.15.112:0/1237897725 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f3d3c086620 con 0x7f3d4415f830 2024-09-15T23:59:12.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.720+0000 7f3d437fe640 1 --2- 172.21.15.112:0/1237897725 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3d300678c0 0x7f3d30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:12.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.720+0000 7f3d437fe640 1 --2- 172.21.15.112:0/1237897725 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3d300678c0 0x7f3d30069d80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3d34007fd0 tx=0x7f3d34007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:12.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.724+0000 7f3d2bfff640 1 -- 172.21.15.112:0/1237897725 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3d3c057060 con 0x7f3d4415f830 2024-09-15T23:59:12.880 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.880+0000 7f3d49d59640 1 -- 172.21.15.112:0/1237897725 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3d4406bcc0 con 0x7f3d300678c0 2024-09-15T23:59:12.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.888+0000 7f3d2bfff640 1 -- 172.21.15.112:0/1237897725 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250540 (secure 0 0 0) 0x7f3d4406bcc0 con 0x7f3d300678c0 2024-09-15T23:59:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:12.893 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:59:12.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.892+0000 7f3d49d59640 1 -- 172.21.15.112:0/1237897725 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3d300678c0 msgr2=0x7f3d30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.892+0000 7f3d49d59640 1 --2- 172.21.15.112:0/1237897725 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3d300678c0 0x7f3d30069d80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3d34007fd0 tx=0x7f3d34007900 comp rx=0 tx=0).stop 2024-09-15T23:59:12.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.892+0000 7f3d49d59640 1 -- 172.21.15.112:0/1237897725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d4415f830 msgr2=0x7f3d4414b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:12.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.892+0000 7f3d49d59640 1 --2- 172.21.15.112:0/1237897725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d4415f830 0x7f3d4414b5f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c007e60 tx=0x7f3d3c00e4b0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.892+0000 7f3d49d59640 1 -- 172.21.15.112:0/1237897725 shutdown_connections 2024-09-15T23:59:12.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.892+0000 7f3d49d59640 1 --2- 172.21.15.112:0/1237897725 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3d300678c0 0x7f3d30069d80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.892+0000 7f3d49d59640 1 --2- 172.21.15.112:0/1237897725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d4415f830 0x7f3d4414b5f0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.892+0000 7f3d49d59640 1 --2- 172.21.15.112:0/1237897725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3d4415d290 0x7f3d441478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.892+0000 7f3d49d59640 1 --2- 172.21.15.112:0/1237897725 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3d4406c3d0 0x7f3d44145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:12.894 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.892+0000 7f3d49d59640 1 -- 172.21.15.112:0/1237897725 >> 172.21.15.112:0/1237897725 conn(0x7f3d440b6800 msgr2=0x7f3d4406ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:12.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.892+0000 7f3d49d59640 1 -- 172.21.15.112:0/1237897725 shutdown_connections 2024-09-15T23:59:12.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:12.892+0000 7f3d49d59640 1 -- 172.21.15.112:0/1237897725 wait complete. 2024-09-15T23:59:12.909 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2024-09-15T23:59:11.330261+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":328268,"kb_used_data":12168,"kb_used_omap":12,"kb_used_meta":315891,"kb_avail":754646452,"statfs":{"total":773094113280,"available":772757966848,"internally_reserved":0,"allocated":12460032,"data_stored":6366474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":323472944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.474452"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916343+0000","last_change":"2024-09-15T23:59:08.910824+0000","last_active":"2024-09-15T23:59:08.916343+0000","last_peered":"2024-09-15T23:59:08.916343+0000","last_clean":"2024-09-15T23:59:08.916343+0000","last_became_active":"2024-09-15T23:59:08.910492+0000","last_became_peered":"2024-09-15T23:59:08.910492+0000","last_unstale":"2024-09-15T23:59:08.916343+0000","last_undegraded":"2024-09-15T23:59:08.916343+0000","last_fullsized":"2024-09-15T23:59:08.916343+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:26.132557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.907170+0000","last_change":"2024-09-15T23:59:08.905338+0000","last_active":"2024-09-15T23:59:08.907170+0000","last_peered":"2024-09-15T23:59:08.907170+0000","last_clean":"2024-09-15T23:59:08.907170+0000","last_became_active":"2024-09-15T23:59:08.904840+0000","last_became_peered":"2024-09-15T23:59:08.904840+0000","last_unstale":"2024-09-15T23:59:08.907170+0000","last_undegraded":"2024-09-15T23:59:08.907170+0000","last_fullsized":"2024-09-15T23:59:08.907170+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:27.610620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.923113+0000","last_change":"2024-09-15T23:59:08.919911+0000","last_active":"2024-09-15T23:59:08.923113+0000","last_peered":"2024-09-15T23:59:08.923113+0000","last_clean":"2024-09-15T23:59:08.923113+0000","last_became_active":"2024-09-15T23:59:08.919627+0000","last_became_peered":"2024-09-15T23:59:08.919627+0000","last_unstale":"2024-09-15T23:59:08.923113+0000","last_undegraded":"2024-09-15T23:59:08.923113+0000","last_fullsized":"2024-09-15T23:59:08.923113+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:55.470024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918567+0000","last_change":"2024-09-15T23:59:08.912292+0000","last_active":"2024-09-15T23:59:08.918567+0000","last_peered":"2024-09-15T23:59:08.918567+0000","last_clean":"2024-09-15T23:59:08.918567+0000","last_became_active":"2024-09-15T23:59:08.912022+0000","last_became_peered":"2024-09-15T23:59:08.912022+0000","last_unstale":"2024-09-15T23:59:08.918567+0000","last_undegraded":"2024-09-15T23:59:08.918567+0000","last_fullsized":"2024-09-15T23:59:08.918567+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:18.856942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906492+0000","last_change":"2024-09-15T23:59:08.904341+0000","last_active":"2024-09-15T23:59:08.906492+0000","last_peered":"2024-09-15T23:59:08.906492+0000","last_clean":"2024-09-15T23:59:08.906492+0000","last_became_active":"2024-09-15T23:59:08.896726+0000","last_became_peered":"2024-09-15T23:59:08.896726+0000","last_unstale":"2024-09-15T23:59:08.906492+0000","last_undegraded":"2024-09-15T23:59:08.906492+0000","last_fullsized":"2024-09-15T23:59:08.906492+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:23.974413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904722+0000","last_change":"2024-09-15T23:59:08.896463+0000","last_active":"2024-09-15T23:59:08.904722+0000","last_peered":"2024-09-15T23:59:08.904722+0000","last_clean":"2024-09-15T23:59:08.904722+0000","last_became_active":"2024-09-15T23:59:08.895705+0000","last_became_peered":"2024-09-15T23:59:08.895705+0000","last_unstale":"2024-09-15T23:59:08.904722+0000","last_undegraded":"2024-09-15T23:59:08.904722+0000","last_fullsized":"2024-09-15T23:59:08.904722+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:18.856942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916258+0000","last_change":"2024-09-15T23:59:08.912390+0000","last_active":"2024-09-15T23:59:08.916258+0000","last_peered":"2024-09-15T23:59:08.916258+0000","last_clean":"2024-09-15T23:59:08.916258+0000","last_became_active":"2024-09-15T23:59:08.912057+0000","last_became_peered":"2024-09-15T23:59:08.912057+0000","last_unstale":"2024-09-15T23:59:08.916258+0000","last_undegraded":"2024-09-15T23:59:08.916258+0000","last_fullsized":"2024-09-15T23:59:08.916258+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.847623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906275+0000","last_change":"2024-09-15T23:59:08.900744+0000","last_active":"2024-09-15T23:59:08.906275+0000","last_peered":"2024-09-15T23:59:08.906275+0000","last_clean":"2024-09-15T23:59:08.906275+0000","last_became_active":"2024-09-15T23:59:08.900042+0000","last_became_peered":"2024-09-15T23:59:08.900042+0000","last_unstale":"2024-09-15T23:59:08.906275+0000","last_undegraded":"2024-09-15T23:59:08.906275+0000","last_fullsized":"2024-09-15T23:59:08.906275+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:49.417010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906644+0000","last_change":"2024-09-15T23:59:08.902975+0000","last_active":"2024-09-15T23:59:08.906644+0000","last_peered":"2024-09-15T23:59:08.906644+0000","last_clean":"2024-09-15T23:59:08.906644+0000","last_became_active":"2024-09-15T23:59:08.902404+0000","last_became_peered":"2024-09-15T23:59:08.902404+0000","last_unstale":"2024-09-15T23:59:08.906644+0000","last_undegraded":"2024-09-15T23:59:08.906644+0000","last_fullsized":"2024-09-15T23:59:08.906644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:35.096541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918240+0000","last_change":"2024-09-15T23:59:08.910158+0000","last_active":"2024-09-15T23:59:08.918240+0000","last_peered":"2024-09-15T23:59:08.918240+0000","last_clean":"2024-09-15T23:59:08.918240+0000","last_became_active":"2024-09-15T23:59:08.909683+0000","last_became_peered":"2024-09-15T23:59:08.909683+0000","last_unstale":"2024-09-15T23:59:08.918240+0000","last_undegraded":"2024-09-15T23:59:08.918240+0000","last_fullsized":"2024-09-15T23:59:08.918240+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:45.378330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906207+0000","last_change":"2024-09-15T23:59:08.898580+0000","last_active":"2024-09-15T23:59:08.906207+0000","last_peered":"2024-09-15T23:59:08.906207+0000","last_clean":"2024-09-15T23:59:08.906207+0000","last_became_active":"2024-09-15T23:59:08.898198+0000","last_became_peered":"2024-09-15T23:59:08.898198+0000","last_unstale":"2024-09-15T23:59:08.906207+0000","last_undegraded":"2024-09-15T23:59:08.906207+0000","last_fullsized":"2024-09-15T23:59:08.906207+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:23.922497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906259+0000","last_change":"2024-09-15T23:59:08.898848+0000","last_active":"2024-09-15T23:59:08.906259+0000","last_peered":"2024-09-15T23:59:08.906259+0000","last_clean":"2024-09-15T23:59:08.906259+0000","last_became_active":"2024-09-15T23:59:08.897597+0000","last_became_peered":"2024-09-15T23:59:08.897597+0000","last_unstale":"2024-09-15T23:59:08.906259+0000","last_undegraded":"2024-09-15T23:59:08.906259+0000","last_fullsized":"2024-09-15T23:59:08.906259+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:21.050253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.897813+0000","last_change":"2024-09-15T23:59:08.885617+0000","last_active":"2024-09-15T23:59:08.897813+0000","last_peered":"2024-09-15T23:59:08.897813+0000","last_clean":"2024-09-15T23:59:08.897813+0000","last_became_active":"2024-09-15T23:59:08.884879+0000","last_became_peered":"2024-09-15T23:59:08.884879+0000","last_unstale":"2024-09-15T23:59:08.897813+0000","last_undegraded":"2024-09-15T23:59:08.897813+0000","last_fullsized":"2024-09-15T23:59:08.897813+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:33.635213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.919272+0000","last_change":"2024-09-15T23:59:08.900479+0000","last_active":"2024-09-15T23:59:08.919272+0000","last_peered":"2024-09-15T23:59:08.919272+0000","last_clean":"2024-09-15T23:59:08.919272+0000","last_became_active":"2024-09-15T23:59:08.899654+0000","last_became_peered":"2024-09-15T23:59:08.899654+0000","last_unstale":"2024-09-15T23:59:08.919272+0000","last_undegraded":"2024-09-15T23:59:08.919272+0000","last_fullsized":"2024-09-15T23:59:08.919272+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:02.210062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920451+0000","last_change":"2024-09-15T23:59:08.917290+0000","last_active":"2024-09-15T23:59:08.920451+0000","last_peered":"2024-09-15T23:59:08.920451+0000","last_clean":"2024-09-15T23:59:08.920451+0000","last_became_active":"2024-09-15T23:59:08.916943+0000","last_became_peered":"2024-09-15T23:59:08.916943+0000","last_unstale":"2024-09-15T23:59:08.920451+0000","last_undegraded":"2024-09-15T23:59:08.920451+0000","last_fullsized":"2024-09-15T23:59:08.920451+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:23.940640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.905582+0000","last_change":"2024-09-15T23:59:08.903844+0000","last_active":"2024-09-15T23:59:08.905582+0000","last_peered":"2024-09-15T23:59:08.905582+0000","last_clean":"2024-09-15T23:59:08.905582+0000","last_became_active":"2024-09-15T23:59:08.903464+0000","last_became_peered":"2024-09-15T23:59:08.903464+0000","last_unstale":"2024-09-15T23:59:08.905582+0000","last_undegraded":"2024-09-15T23:59:08.905582+0000","last_fullsized":"2024-09-15T23:59:08.905582+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:55.470024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918216+0000","last_change":"2024-09-15T23:59:08.909943+0000","last_active":"2024-09-15T23:59:08.918216+0000","last_peered":"2024-09-15T23:59:08.918216+0000","last_clean":"2024-09-15T23:59:08.918216+0000","last_became_active":"2024-09-15T23:59:08.909343+0000","last_became_peered":"2024-09-15T23:59:08.909343+0000","last_unstale":"2024-09-15T23:59:08.918216+0000","last_undegraded":"2024-09-15T23:59:08.918216+0000","last_fullsized":"2024-09-15T23:59:08.918216+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:01.161528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904756+0000","last_change":"2024-09-15T23:59:08.893198+0000","last_active":"2024-09-15T23:59:08.904756+0000","last_peered":"2024-09-15T23:59:08.904756+0000","last_clean":"2024-09-15T23:59:08.904756+0000","last_became_active":"2024-09-15T23:59:08.892419+0000","last_became_peered":"2024-09-15T23:59:08.892419+0000","last_unstale":"2024-09-15T23:59:08.904756+0000","last_undegraded":"2024-09-15T23:59:08.904756+0000","last_fullsized":"2024-09-15T23:59:08.904756+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:58.451266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916317+0000","last_change":"2024-09-15T23:59:08.910520+0000","last_active":"2024-09-15T23:59:08.916317+0000","last_peered":"2024-09-15T23:59:08.916317+0000","last_clean":"2024-09-15T23:59:08.916317+0000","last_became_active":"2024-09-15T23:59:08.903811+0000","last_became_peered":"2024-09-15T23:59:08.903811+0000","last_unstale":"2024-09-15T23:59:08.916317+0000","last_undegraded":"2024-09-15T23:59:08.916317+0000","last_fullsized":"2024-09-15T23:59:08.916317+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:31.638956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.933927+0000","last_change":"2024-09-15T23:59:08.932649+0000","last_active":"2024-09-15T23:59:08.933927+0000","last_peered":"2024-09-15T23:59:08.933927+0000","last_clean":"2024-09-15T23:59:08.933927+0000","last_became_active":"2024-09-15T23:59:08.932168+0000","last_became_peered":"2024-09-15T23:59:08.932168+0000","last_unstale":"2024-09-15T23:59:08.933927+0000","last_undegraded":"2024-09-15T23:59:08.933927+0000","last_fullsized":"2024-09-15T23:59:08.933927+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:50.616580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.924316+0000","last_change":"2024-09-15T23:59:08.919491+0000","last_active":"2024-09-15T23:59:08.924316+0000","last_peered":"2024-09-15T23:59:08.924316+0000","last_clean":"2024-09-15T23:59:08.924316+0000","last_became_active":"2024-09-15T23:59:08.919162+0000","last_became_peered":"2024-09-15T23:59:08.919162+0000","last_unstale":"2024-09-15T23:59:08.924316+0000","last_undegraded":"2024-09-15T23:59:08.924316+0000","last_fullsized":"2024-09-15T23:59:08.924316+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:58.451266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906248+0000","last_change":"2024-09-15T23:59:08.900424+0000","last_active":"2024-09-15T23:59:08.906248+0000","last_peered":"2024-09-15T23:59:08.906248+0000","last_clean":"2024-09-15T23:59:08.906248+0000","last_became_active":"2024-09-15T23:59:08.899537+0000","last_became_peered":"2024-09-15T23:59:08.899537+0000","last_unstale":"2024-09-15T23:59:08.906248+0000","last_undegraded":"2024-09-15T23:59:08.906248+0000","last_fullsized":"2024-09-15T23:59:08.906248+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:27.163354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918006+0000","last_change":"2024-09-15T23:59:08.912709+0000","last_active":"2024-09-15T23:59:08.918006+0000","last_peered":"2024-09-15T23:59:08.918006+0000","last_clean":"2024-09-15T23:59:08.918006+0000","last_became_active":"2024-09-15T23:59:08.912001+0000","last_became_peered":"2024-09-15T23:59:08.912001+0000","last_unstale":"2024-09-15T23:59:08.918006+0000","last_undegraded":"2024-09-15T23:59:08.918006+0000","last_fullsized":"2024-09-15T23:59:08.918006+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:44.176477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.912057+0000","last_change":"2024-09-15T23:59:08.908502+0000","last_active":"2024-09-15T23:59:08.912057+0000","last_peered":"2024-09-15T23:59:08.912057+0000","last_clean":"2024-09-15T23:59:08.912057+0000","last_became_active":"2024-09-15T23:59:08.907710+0000","last_became_peered":"2024-09-15T23:59:08.907710+0000","last_unstale":"2024-09-15T23:59:08.912057+0000","last_undegraded":"2024-09-15T23:59:08.912057+0000","last_fullsized":"2024-09-15T23:59:08.912057+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:38.007875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916167+0000","last_change":"2024-09-15T23:59:08.903256+0000","last_active":"2024-09-15T23:59:08.916167+0000","last_peered":"2024-09-15T23:59:08.916167+0000","last_clean":"2024-09-15T23:59:08.916167+0000","last_became_active":"2024-09-15T23:59:08.902744+0000","last_became_peered":"2024-09-15T23:59:08.902744+0000","last_unstale":"2024-09-15T23:59:08.916167+0000","last_undegraded":"2024-09-15T23:59:08.916167+0000","last_fullsized":"2024-09-15T23:59:08.916167+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:02.116106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916171+0000","last_change":"2024-09-15T23:59:08.911546+0000","last_active":"2024-09-15T23:59:08.916171+0000","last_peered":"2024-09-15T23:59:08.916171+0000","last_clean":"2024-09-15T23:59:08.916171+0000","last_became_active":"2024-09-15T23:59:08.910654+0000","last_became_peered":"2024-09-15T23:59:08.910654+0000","last_unstale":"2024-09-15T23:59:08.916171+0000","last_undegraded":"2024-09-15T23:59:08.916171+0000","last_fullsized":"2024-09-15T23:59:08.916171+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:49.245433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.900159+0000","last_change":"2024-09-15T23:59:08.896783+0000","last_active":"2024-09-15T23:59:08.900159+0000","last_peered":"2024-09-15T23:59:08.900159+0000","last_clean":"2024-09-15T23:59:08.900159+0000","last_became_active":"2024-09-15T23:59:08.895801+0000","last_became_peered":"2024-09-15T23:59:08.895801+0000","last_unstale":"2024-09-15T23:59:08.900159+0000","last_undegraded":"2024-09-15T23:59:08.900159+0000","last_fullsized":"2024-09-15T23:59:08.900159+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:58:34.531614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"114'4","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.927768+0000","last_change":"2024-09-15T23:59:07.897150+0000","last_active":"2024-09-15T23:59:08.927768+0000","last_peered":"2024-09-15T23:59:08.927768+0000","last_clean":"2024-09-15T23:59:08.927768+0000","last_became_active":"2024-09-15T23:59:07.896874+0000","last_became_peered":"2024-09-15T23:59:07.896874+0000","last_unstale":"2024-09-15T23:59:08.927768+0000","last_undegraded":"2024-09-15T23:59:08.927768+0000","last_fullsized":"2024-09-15T23:59:08.927768+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:33.693308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918980+0000","last_change":"2024-09-15T23:59:07.899334+0000","last_active":"2024-09-15T23:59:08.918980+0000","last_peered":"2024-09-15T23:59:08.918980+0000","last_clean":"2024-09-15T23:59:08.918980+0000","last_became_active":"2024-09-15T23:59:07.897881+0000","last_became_peered":"2024-09-15T23:59:07.897881+0000","last_unstale":"2024-09-15T23:59:08.918980+0000","last_undegraded":"2024-09-15T23:59:08.918980+0000","last_fullsized":"2024-09-15T23:59:08.918980+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:14.214987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916898+0000","last_change":"2024-09-15T23:59:08.915142+0000","last_active":"2024-09-15T23:59:08.916898+0000","last_peered":"2024-09-15T23:59:08.916898+0000","last_clean":"2024-09-15T23:59:08.916898+0000","last_became_active":"2024-09-15T23:59:08.914779+0000","last_became_peered":"2024-09-15T23:59:08.914779+0000","last_unstale":"2024-09-15T23:59:08.916898+0000","last_undegraded":"2024-09-15T23:59:08.916898+0000","last_fullsized":"2024-09-15T23:59:08.916898+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:09.562090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.924156+0000","last_change":"2024-09-15T23:59:07.902457+0000","last_active":"2024-09-15T23:59:08.924156+0000","last_peered":"2024-09-15T23:59:08.924156+0000","last_clean":"2024-09-15T23:59:08.924156+0000","last_became_active":"2024-09-15T23:59:07.902170+0000","last_became_peered":"2024-09-15T23:59:07.902170+0000","last_unstale":"2024-09-15T23:59:08.924156+0000","last_undegraded":"2024-09-15T23:59:08.924156+0000","last_fullsized":"2024-09-15T23:59:08.924156+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:25.178922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920812+0000","last_change":"2024-09-15T23:59:08.913433+0000","last_active":"2024-09-15T23:59:08.920812+0000","last_peered":"2024-09-15T23:59:08.920812+0000","last_clean":"2024-09-15T23:59:08.920812+0000","last_became_active":"2024-09-15T23:59:08.913093+0000","last_became_peered":"2024-09-15T23:59:08.913093+0000","last_unstale":"2024-09-15T23:59:08.920812+0000","last_undegraded":"2024-09-15T23:59:08.920812+0000","last_fullsized":"2024-09-15T23:59:08.920812+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:07.152472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:59:06.867660+0000","last_change":"2024-09-15T23:59:06.867660+0000","last_active":"2024-09-15T23:59:06.845650+0000","last_peered":"2024-09-15T23:59:06.845650+0000","last_clean":"2024-09-15T23:59:06.845650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:06.867660+0000","last_undegraded":"2024-09-15T23:59:06.867660+0000","last_fullsized":"2024-09-15T23:59:06.867660+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916487+0000","last_change":"2024-09-15T23:59:08.911675+0000","last_active":"2024-09-15T23:59:08.916487+0000","last_peered":"2024-09-15T23:59:08.916487+0000","last_clean":"2024-09-15T23:59:08.916487+0000","last_became_active":"2024-09-15T23:59:08.910468+0000","last_became_peered":"2024-09-15T23:59:08.910468+0000","last_unstale":"2024-09-15T23:59:08.916487+0000","last_undegraded":"2024-09-15T23:59:08.916487+0000","last_fullsized":"2024-09-15T23:59:08.916487+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:31.279980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.922479+0000","last_change":"2024-09-15T23:59:07.901742+0000","last_active":"2024-09-15T23:59:08.922479+0000","last_peered":"2024-09-15T23:59:08.922479+0000","last_clean":"2024-09-15T23:59:08.922479+0000","last_became_active":"2024-09-15T23:59:07.901438+0000","last_became_peered":"2024-09-15T23:59:07.901438+0000","last_unstale":"2024-09-15T23:59:08.922479+0000","last_undegraded":"2024-09-15T23:59:08.922479+0000","last_fullsized":"2024-09-15T23:59:08.922479+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:18.840142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916096+0000","last_change":"2024-09-15T23:59:08.903023+0000","last_active":"2024-09-15T23:59:08.916096+0000","last_peered":"2024-09-15T23:59:08.916096+0000","last_clean":"2024-09-15T23:59:08.916096+0000","last_became_active":"2024-09-15T23:59:08.902108+0000","last_became_peered":"2024-09-15T23:59:08.902108+0000","last_unstale":"2024-09-15T23:59:08.916096+0000","last_undegraded":"2024-09-15T23:59:08.916096+0000","last_fullsized":"2024-09-15T23:59:08.916096+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:39.717345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918702+0000","last_change":"2024-09-15T23:59:07.911259+0000","last_active":"2024-09-15T23:59:08.918702+0000","last_peered":"2024-09-15T23:59:08.918702+0000","last_clean":"2024-09-15T23:59:08.918702+0000","last_became_active":"2024-09-15T23:59:07.910417+0000","last_became_peered":"2024-09-15T23:59:07.910417+0000","last_unstale":"2024-09-15T23:59:08.918702+0000","last_undegraded":"2024-09-15T23:59:08.918702+0000","last_fullsized":"2024-09-15T23:59:08.918702+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:50.138286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.900126+0000","last_change":"2024-09-15T23:59:08.898567+0000","last_active":"2024-09-15T23:59:08.900126+0000","last_peered":"2024-09-15T23:59:08.900126+0000","last_clean":"2024-09-15T23:59:08.900126+0000","last_became_active":"2024-09-15T23:59:08.898219+0000","last_became_peered":"2024-09-15T23:59:08.898219+0000","last_unstale":"2024-09-15T23:59:08.900126+0000","last_undegraded":"2024-09-15T23:59:08.900126+0000","last_fullsized":"2024-09-15T23:59:08.900126+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:01.864690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.896506+0000","last_change":"2024-09-15T23:59:07.891090+0000","last_active":"2024-09-15T23:59:08.896506+0000","last_peered":"2024-09-15T23:59:08.896506+0000","last_clean":"2024-09-15T23:59:08.896506+0000","last_became_active":"2024-09-15T23:59:07.890684+0000","last_became_peered":"2024-09-15T23:59:07.890684+0000","last_unstale":"2024-09-15T23:59:08.896506+0000","last_undegraded":"2024-09-15T23:59:08.896506+0000","last_fullsized":"2024-09-15T23:59:08.896506+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:12.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.897585+0000","last_change":"2024-09-15T23:59:08.894805+0000","last_active":"2024-09-15T23:59:08.897585+0000","last_peered":"2024-09-15T23:59:08.897585+0000","last_clean":"2024-09-15T23:59:08.897585+0000","last_became_active":"2024-09-15T23:59:08.893503+0000","last_became_peered":"2024-09-15T23:59:08.893503+0000","last_unstale":"2024-09-15T23:59:08.897585+0000","last_undegraded":"2024-09-15T23:59:08.897585+0000","last_fullsized":"2024-09-15T23:59:08.897585+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:12.946708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.889159+0000","last_change":"2024-09-15T23:59:07.904298+0000","last_active":"2024-09-15T23:59:08.889159+0000","last_peered":"2024-09-15T23:59:08.889159+0000","last_clean":"2024-09-15T23:59:08.889159+0000","last_became_active":"2024-09-15T23:59:07.903534+0000","last_became_peered":"2024-09-15T23:59:07.903534+0000","last_unstale":"2024-09-15T23:59:08.889159+0000","last_undegraded":"2024-09-15T23:59:08.889159+0000","last_fullsized":"2024-09-15T23:59:08.889159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:55.141179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.923960+0000","last_change":"2024-09-15T23:59:08.918009+0000","last_active":"2024-09-15T23:59:08.923960+0000","last_peered":"2024-09-15T23:59:08.923960+0000","last_clean":"2024-09-15T23:59:08.923960+0000","last_became_active":"2024-09-15T23:59:08.917739+0000","last_became_peered":"2024-09-15T23:59:08.917739+0000","last_unstale":"2024-09-15T23:59:08.923960+0000","last_undegraded":"2024-09-15T23:59:08.923960+0000","last_fullsized":"2024-09-15T23:59:08.923960+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:15.224990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.875559+0000","last_change":"2024-09-15T23:59:07.904677+0000","last_active":"2024-09-15T23:59:08.875559+0000","last_peered":"2024-09-15T23:59:08.875559+0000","last_clean":"2024-09-15T23:59:08.875559+0000","last_became_active":"2024-09-15T23:59:07.904276+0000","last_became_peered":"2024-09-15T23:59:07.904276+0000","last_unstale":"2024-09-15T23:59:08.875559+0000","last_undegraded":"2024-09-15T23:59:08.875559+0000","last_fullsized":"2024-09-15T23:59:08.875559+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:55.211122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920845+0000","last_change":"2024-09-15T23:59:08.913519+0000","last_active":"2024-09-15T23:59:08.920845+0000","last_peered":"2024-09-15T23:59:08.920845+0000","last_clean":"2024-09-15T23:59:08.920845+0000","last_became_active":"2024-09-15T23:59:08.913190+0000","last_became_peered":"2024-09-15T23:59:08.913190+0000","last_unstale":"2024-09-15T23:59:08.920845+0000","last_undegraded":"2024-09-15T23:59:08.920845+0000","last_fullsized":"2024-09-15T23:59:08.920845+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:58.451266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.874397+0000","last_change":"2024-09-15T23:59:07.892077+0000","last_active":"2024-09-15T23:59:08.874397+0000","last_peered":"2024-09-15T23:59:08.874397+0000","last_clean":"2024-09-15T23:59:08.874397+0000","last_became_active":"2024-09-15T23:59:07.891329+0000","last_became_peered":"2024-09-15T23:59:07.891329+0000","last_unstale":"2024-09-15T23:59:08.874397+0000","last_undegraded":"2024-09-15T23:59:08.874397+0000","last_fullsized":"2024-09-15T23:59:08.874397+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:33.693308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916402+0000","last_change":"2024-09-15T23:59:08.910417+0000","last_active":"2024-09-15T23:59:08.916402+0000","last_peered":"2024-09-15T23:59:08.916402+0000","last_clean":"2024-09-15T23:59:08.916402+0000","last_became_active":"2024-09-15T23:59:08.907523+0000","last_became_peered":"2024-09-15T23:59:08.907523+0000","last_unstale":"2024-09-15T23:59:08.916402+0000","last_undegraded":"2024-09-15T23:59:08.916402+0000","last_fullsized":"2024-09-15T23:59:08.916402+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:30.138860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"114'3","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.925138+0000","last_change":"2024-09-15T23:59:07.898178+0000","last_active":"2024-09-15T23:59:08.925138+0000","last_peered":"2024-09-15T23:59:08.925138+0000","last_clean":"2024-09-15T23:59:08.925138+0000","last_became_active":"2024-09-15T23:59:07.897591+0000","last_became_peered":"2024-09-15T23:59:07.897591+0000","last_unstale":"2024-09-15T23:59:08.925138+0000","last_undegraded":"2024-09-15T23:59:08.925138+0000","last_fullsized":"2024-09-15T23:59:08.925138+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:42.591070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920347+0000","last_change":"2024-09-15T23:59:08.917685+0000","last_active":"2024-09-15T23:59:08.920347+0000","last_peered":"2024-09-15T23:59:08.920347+0000","last_clean":"2024-09-15T23:59:08.920347+0000","last_became_active":"2024-09-15T23:59:08.917472+0000","last_became_peered":"2024-09-15T23:59:08.917472+0000","last_unstale":"2024-09-15T23:59:08.920347+0000","last_undegraded":"2024-09-15T23:59:08.920347+0000","last_fullsized":"2024-09-15T23:59:08.920347+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:07.152472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:59:06.866306+0000","last_change":"2024-09-15T23:59:06.866306+0000","last_active":"2024-09-15T23:59:06.845650+0000","last_peered":"2024-09-15T23:59:06.845650+0000","last_clean":"2024-09-15T23:59:06.845650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:06.866306+0000","last_undegraded":"2024-09-15T23:59:06.866306+0000","last_fullsized":"2024-09-15T23:59:06.866306+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918442+0000","last_change":"2024-09-15T23:59:08.911790+0000","last_active":"2024-09-15T23:59:08.918442+0000","last_peered":"2024-09-15T23:59:08.918442+0000","last_clean":"2024-09-15T23:59:08.918442+0000","last_became_active":"2024-09-15T23:59:08.911525+0000","last_became_peered":"2024-09-15T23:59:08.911525+0000","last_unstale":"2024-09-15T23:59:08.918442+0000","last_undegraded":"2024-09-15T23:59:08.918442+0000","last_fullsized":"2024-09-15T23:59:08.918442+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:56.221125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.922686+0000","last_change":"2024-09-15T23:59:07.901494+0000","last_active":"2024-09-15T23:59:08.922686+0000","last_peered":"2024-09-15T23:59:08.922686+0000","last_clean":"2024-09-15T23:59:08.922686+0000","last_became_active":"2024-09-15T23:59:07.900634+0000","last_became_peered":"2024-09-15T23:59:07.900634+0000","last_unstale":"2024-09-15T23:59:08.922686+0000","last_undegraded":"2024-09-15T23:59:08.922686+0000","last_fullsized":"2024-09-15T23:59:08.922686+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:45.156139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.890590+0000","last_change":"2024-09-15T23:59:07.900377+0000","last_active":"2024-09-15T23:59:08.890590+0000","last_peered":"2024-09-15T23:59:08.890590+0000","last_clean":"2024-09-15T23:59:08.890590+0000","last_became_active":"2024-09-15T23:59:07.899640+0000","last_became_peered":"2024-09-15T23:59:07.899640+0000","last_unstale":"2024-09-15T23:59:08.890590+0000","last_undegraded":"2024-09-15T23:59:08.890590+0000","last_fullsized":"2024-09-15T23:59:08.890590+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:38.375055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904437+0000","last_change":"2024-09-15T23:59:08.893917+0000","last_active":"2024-09-15T23:59:08.904437+0000","last_peered":"2024-09-15T23:59:08.904437+0000","last_clean":"2024-09-15T23:59:08.904437+0000","last_became_active":"2024-09-15T23:59:08.893372+0000","last_became_peered":"2024-09-15T23:59:08.893372+0000","last_unstale":"2024-09-15T23:59:08.904437+0000","last_undegraded":"2024-09-15T23:59:08.904437+0000","last_fullsized":"2024-09-15T23:59:08.904437+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:28.439286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.874321+0000","last_change":"2024-09-15T23:59:07.899745+0000","last_active":"2024-09-15T23:59:08.874321+0000","last_peered":"2024-09-15T23:59:08.874321+0000","last_clean":"2024-09-15T23:59:08.874321+0000","last_became_active":"2024-09-15T23:59:07.898602+0000","last_became_peered":"2024-09-15T23:59:07.898602+0000","last_unstale":"2024-09-15T23:59:08.874321+0000","last_undegraded":"2024-09-15T23:59:08.874321+0000","last_fullsized":"2024-09-15T23:59:08.874321+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:39.506591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918213+0000","last_change":"2024-09-15T23:59:08.905590+0000","last_active":"2024-09-15T23:59:08.918213+0000","last_peered":"2024-09-15T23:59:08.918213+0000","last_clean":"2024-09-15T23:59:08.918213+0000","last_became_active":"2024-09-15T23:59:08.904800+0000","last_became_peered":"2024-09-15T23:59:08.904800+0000","last_unstale":"2024-09-15T23:59:08.918213+0000","last_undegraded":"2024-09-15T23:59:08.918213+0000","last_fullsized":"2024-09-15T23:59:08.918213+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:23.940640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.919186+0000","last_change":"2024-09-15T23:59:07.898098+0000","last_active":"2024-09-15T23:59:08.919186+0000","last_peered":"2024-09-15T23:59:08.919186+0000","last_clean":"2024-09-15T23:59:08.919186+0000","last_became_active":"2024-09-15T23:59:07.897362+0000","last_became_peered":"2024-09-15T23:59:07.897362+0000","last_unstale":"2024-09-15T23:59:08.919186+0000","last_undegraded":"2024-09-15T23:59:08.919186+0000","last_fullsized":"2024-09-15T23:59:08.919186+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:50.535811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.932551+0000","last_change":"2024-09-15T23:59:08.932023+0000","last_active":"2024-09-15T23:59:08.932551+0000","last_peered":"2024-09-15T23:59:08.932551+0000","last_clean":"2024-09-15T23:59:08.932551+0000","last_became_active":"2024-09-15T23:59:08.931681+0000","last_became_peered":"2024-09-15T23:59:08.931681+0000","last_unstale":"2024-09-15T23:59:08.932551+0000","last_undegraded":"2024-09-15T23:59:08.932551+0000","last_fullsized":"2024-09-15T23:59:08.932551+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:45.141866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.936023+0000","last_change":"2024-09-15T23:59:07.908611+0000","last_active":"2024-09-15T23:59:08.936023+0000","last_peered":"2024-09-15T23:59:08.936023+0000","last_clean":"2024-09-15T23:59:08.936023+0000","last_became_active":"2024-09-15T23:59:07.906983+0000","last_became_peered":"2024-09-15T23:59:07.906983+0000","last_unstale":"2024-09-15T23:59:08.936023+0000","last_undegraded":"2024-09-15T23:59:08.936023+0000","last_fullsized":"2024-09-15T23:59:08.936023+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:30.303746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.925623+0000","last_change":"2024-09-15T23:59:07.895016+0000","last_active":"2024-09-15T23:59:08.925623+0000","last_peered":"2024-09-15T23:59:08.925623+0000","last_clean":"2024-09-15T23:59:08.925623+0000","last_became_active":"2024-09-15T23:59:07.894480+0000","last_became_peered":"2024-09-15T23:59:07.894480+0000","last_unstale":"2024-09-15T23:59:08.925623+0000","last_undegraded":"2024-09-15T23:59:08.925623+0000","last_fullsized":"2024-09-15T23:59:08.925623+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:35.445956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920325+0000","last_change":"2024-09-15T23:59:08.917111+0000","last_active":"2024-09-15T23:59:08.920325+0000","last_peered":"2024-09-15T23:59:08.920325+0000","last_clean":"2024-09-15T23:59:08.920325+0000","last_became_active":"2024-09-15T23:59:08.915164+0000","last_became_peered":"2024-09-15T23:59:08.915164+0000","last_unstale":"2024-09-15T23:59:08.920325+0000","last_undegraded":"2024-09-15T23:59:08.920325+0000","last_fullsized":"2024-09-15T23:59:08.920325+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:26.188926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.886635+0000","last_change":"2024-09-15T23:59:07.894577+0000","last_active":"2024-09-15T23:59:08.886635+0000","last_peered":"2024-09-15T23:59:08.886635+0000","last_clean":"2024-09-15T23:59:08.886635+0000","last_became_active":"2024-09-15T23:59:07.894225+0000","last_became_peered":"2024-09-15T23:59:07.894225+0000","last_unstale":"2024-09-15T23:59:08.886635+0000","last_undegraded":"2024-09-15T23:59:08.886635+0000","last_fullsized":"2024-09-15T23:59:08.886635+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:57.333706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.921415+0000","last_change":"2024-09-15T23:59:07.888210+0000","last_active":"2024-09-15T23:59:08.921415+0000","last_peered":"2024-09-15T23:59:08.921415+0000","last_clean":"2024-09-15T23:59:08.921415+0000","last_became_active":"2024-09-15T23:59:07.886924+0000","last_became_peered":"2024-09-15T23:59:07.886924+0000","last_unstale":"2024-09-15T23:59:08.921415+0000","last_undegraded":"2024-09-15T23:59:08.921415+0000","last_fullsized":"2024-09-15T23:59:08.921415+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:44.368326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906037+0000","last_change":"2024-09-15T23:59:08.898377+0000","last_active":"2024-09-15T23:59:08.906037+0000","last_peered":"2024-09-15T23:59:08.906037+0000","last_clean":"2024-09-15T23:59:08.906037+0000","last_became_active":"2024-09-15T23:59:08.897554+0000","last_became_peered":"2024-09-15T23:59:08.897554+0000","last_unstale":"2024-09-15T23:59:08.906037+0000","last_undegraded":"2024-09-15T23:59:08.906037+0000","last_fullsized":"2024-09-15T23:59:08.906037+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:32.768826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.886070+0000","last_change":"2024-09-15T23:59:07.895677+0000","last_active":"2024-09-15T23:59:08.886070+0000","last_peered":"2024-09-15T23:59:08.886070+0000","last_clean":"2024-09-15T23:59:08.886070+0000","last_became_active":"2024-09-15T23:59:07.895385+0000","last_became_peered":"2024-09-15T23:59:07.895385+0000","last_unstale":"2024-09-15T23:59:08.886070+0000","last_undegraded":"2024-09-15T23:59:08.886070+0000","last_fullsized":"2024-09-15T23:59:08.886070+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:22.930636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.919182+0000","last_change":"2024-09-15T23:59:08.917054+0000","last_active":"2024-09-15T23:59:08.919182+0000","last_peered":"2024-09-15T23:59:08.919182+0000","last_clean":"2024-09-15T23:59:08.919182+0000","last_became_active":"2024-09-15T23:59:08.912975+0000","last_became_peered":"2024-09-15T23:59:08.912975+0000","last_unstale":"2024-09-15T23:59:08.919182+0000","last_undegraded":"2024-09-15T23:59:08.919182+0000","last_fullsized":"2024-09-15T23:59:08.919182+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:35:33.829330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.889220+0000","last_change":"2024-09-15T23:59:07.904775+0000","last_active":"2024-09-15T23:59:08.889220+0000","last_peered":"2024-09-15T23:59:08.889220+0000","last_clean":"2024-09-15T23:59:08.889220+0000","last_became_active":"2024-09-15T23:59:07.903906+0000","last_became_peered":"2024-09-15T23:59:07.903906+0000","last_unstale":"2024-09-15T23:59:08.889220+0000","last_undegraded":"2024-09-15T23:59:08.889220+0000","last_fullsized":"2024-09-15T23:59:08.889220+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:39.108011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916530+0000","last_change":"2024-09-15T23:59:08.911830+0000","last_active":"2024-09-15T23:59:08.916530+0000","last_peered":"2024-09-15T23:59:08.916530+0000","last_clean":"2024-09-15T23:59:08.916530+0000","last_became_active":"2024-09-15T23:59:08.911561+0000","last_became_peered":"2024-09-15T23:59:08.911561+0000","last_unstale":"2024-09-15T23:59:08.916530+0000","last_undegraded":"2024-09-15T23:59:08.916530+0000","last_fullsized":"2024-09-15T23:59:08.916530+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:38.472909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.899976+0000","last_change":"2024-09-15T23:59:07.888011+0000","last_active":"2024-09-15T23:59:08.899976+0000","last_peered":"2024-09-15T23:59:08.899976+0000","last_clean":"2024-09-15T23:59:08.899976+0000","last_became_active":"2024-09-15T23:59:07.887633+0000","last_became_peered":"2024-09-15T23:59:07.887633+0000","last_unstale":"2024-09-15T23:59:08.899976+0000","last_undegraded":"2024-09-15T23:59:08.899976+0000","last_fullsized":"2024-09-15T23:59:08.899976+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:32.340184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904453+0000","last_change":"2024-09-15T23:59:08.894213+0000","last_active":"2024-09-15T23:59:08.904453+0000","last_peered":"2024-09-15T23:59:08.904453+0000","last_clean":"2024-09-15T23:59:08.904453+0000","last_became_active":"2024-09-15T23:59:08.893860+0000","last_became_peered":"2024-09-15T23:59:08.893860+0000","last_unstale":"2024-09-15T23:59:08.904453+0000","last_undegraded":"2024-09-15T23:59:08.904453+0000","last_fullsized":"2024-09-15T23:59:08.904453+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:04.492508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:59:06.866483+0000","last_change":"2024-09-15T23:59:06.866483+0000","last_active":"2024-09-15T23:59:06.845650+0000","last_peered":"2024-09-15T23:59:06.845650+0000","last_clean":"2024-09-15T23:59:06.845650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:06.866483+0000","last_undegraded":"2024-09-15T23:59:06.866483+0000","last_fullsized":"2024-09-15T23:59:06.866483+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904028+0000","last_change":"2024-09-15T23:59:08.902565+0000","last_active":"2024-09-15T23:59:08.904028+0000","last_peered":"2024-09-15T23:59:08.904028+0000","last_clean":"2024-09-15T23:59:08.904028+0000","last_became_active":"2024-09-15T23:59:08.902160+0000","last_became_peered":"2024-09-15T23:59:08.902160+0000","last_unstale":"2024-09-15T23:59:08.904028+0000","last_undegraded":"2024-09-15T23:59:08.904028+0000","last_fullsized":"2024-09-15T23:59:08.904028+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:54.782717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.908782+0000","last_change":"2024-09-15T23:59:07.893449+0000","last_active":"2024-09-15T23:59:08.908782+0000","last_peered":"2024-09-15T23:59:08.908782+0000","last_clean":"2024-09-15T23:59:08.908782+0000","last_became_active":"2024-09-15T23:59:07.893086+0000","last_became_peered":"2024-09-15T23:59:07.893086+0000","last_unstale":"2024-09-15T23:59:08.908782+0000","last_undegraded":"2024-09-15T23:59:08.908782+0000","last_fullsized":"2024-09-15T23:59:08.908782+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:39.302221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.905375+0000","last_change":"2024-09-15T23:59:08.903181+0000","last_active":"2024-09-15T23:59:08.905375+0000","last_peered":"2024-09-15T23:59:08.905375+0000","last_clean":"2024-09-15T23:59:08.905375+0000","last_became_active":"2024-09-15T23:59:08.902453+0000","last_became_peered":"2024-09-15T23:59:08.902453+0000","last_unstale":"2024-09-15T23:59:08.905375+0000","last_undegraded":"2024-09-15T23:59:08.905375+0000","last_fullsized":"2024-09-15T23:59:08.905375+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:26.188926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.908423+0000","last_change":"2024-09-15T23:59:07.913163+0000","last_active":"2024-09-15T23:59:08.908423+0000","last_peered":"2024-09-15T23:59:08.908423+0000","last_clean":"2024-09-15T23:59:08.908423+0000","last_became_active":"2024-09-15T23:59:07.912890+0000","last_became_peered":"2024-09-15T23:59:07.912890+0000","last_unstale":"2024-09-15T23:59:08.908423+0000","last_undegraded":"2024-09-15T23:59:08.908423+0000","last_fullsized":"2024-09-15T23:59:08.908423+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:01.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918090+0000","last_change":"2024-09-15T23:59:08.916865+0000","last_active":"2024-09-15T23:59:08.918090+0000","last_peered":"2024-09-15T23:59:08.918090+0000","last_clean":"2024-09-15T23:59:08.918090+0000","last_became_active":"2024-09-15T23:59:08.916205+0000","last_became_peered":"2024-09-15T23:59:08.916205+0000","last_unstale":"2024-09-15T23:59:08.918090+0000","last_undegraded":"2024-09-15T23:59:08.918090+0000","last_fullsized":"2024-09-15T23:59:08.918090+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:52.891063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.878744+0000","last_change":"2024-09-15T23:59:07.905993+0000","last_active":"2024-09-15T23:59:08.878744+0000","last_peered":"2024-09-15T23:59:08.878744+0000","last_clean":"2024-09-15T23:59:08.878744+0000","last_became_active":"2024-09-15T23:59:07.905239+0000","last_became_peered":"2024-09-15T23:59:07.905239+0000","last_unstale":"2024-09-15T23:59:08.878744+0000","last_undegraded":"2024-09-15T23:59:08.878744+0000","last_fullsized":"2024-09-15T23:59:08.878744+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:06.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.889752+0000","last_change":"2024-09-15T23:59:08.885109+0000","last_active":"2024-09-15T23:59:08.889752+0000","last_peered":"2024-09-15T23:59:08.889752+0000","last_clean":"2024-09-15T23:59:08.889752+0000","last_became_active":"2024-09-15T23:59:08.884262+0000","last_became_peered":"2024-09-15T23:59:08.884262+0000","last_unstale":"2024-09-15T23:59:08.889752+0000","last_undegraded":"2024-09-15T23:59:08.889752+0000","last_fullsized":"2024-09-15T23:59:08.889752+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:16.349140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.908358+0000","last_change":"2024-09-15T23:59:07.901979+0000","last_active":"2024-09-15T23:59:08.908358+0000","last_peered":"2024-09-15T23:59:08.908358+0000","last_clean":"2024-09-15T23:59:08.908358+0000","last_became_active":"2024-09-15T23:59:07.901442+0000","last_became_peered":"2024-09-15T23:59:07.901442+0000","last_unstale":"2024-09-15T23:59:08.908358+0000","last_undegraded":"2024-09-15T23:59:08.908358+0000","last_fullsized":"2024-09-15T23:59:08.908358+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:25.844482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.886421+0000","last_change":"2024-09-15T23:59:07.903057+0000","last_active":"2024-09-15T23:59:08.886421+0000","last_peered":"2024-09-15T23:59:08.886421+0000","last_clean":"2024-09-15T23:59:08.886421+0000","last_became_active":"2024-09-15T23:59:07.902837+0000","last_became_peered":"2024-09-15T23:59:07.902837+0000","last_unstale":"2024-09-15T23:59:08.886421+0000","last_undegraded":"2024-09-15T23:59:08.886421+0000","last_fullsized":"2024-09-15T23:59:08.886421+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:06.142468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.917076+0000","last_change":"2024-09-15T23:59:08.907407+0000","last_active":"2024-09-15T23:59:08.917076+0000","last_peered":"2024-09-15T23:59:08.917076+0000","last_clean":"2024-09-15T23:59:08.917076+0000","last_became_active":"2024-09-15T23:59:08.901378+0000","last_became_peered":"2024-09-15T23:59:08.901378+0000","last_unstale":"2024-09-15T23:59:08.917076+0000","last_undegraded":"2024-09-15T23:59:08.917076+0000","last_fullsized":"2024-09-15T23:59:08.917076+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:35.937408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:59:06.866468+0000","last_change":"2024-09-15T23:59:06.866468+0000","last_active":"2024-09-15T23:59:06.845650+0000","last_peered":"2024-09-15T23:59:06.845650+0000","last_clean":"2024-09-15T23:59:06.845650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:06.866468+0000","last_undegraded":"2024-09-15T23:59:06.866468+0000","last_fullsized":"2024-09-15T23:59:06.866468+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.897525+0000","last_change":"2024-09-15T23:59:08.894211+0000","last_active":"2024-09-15T23:59:08.897525+0000","last_peered":"2024-09-15T23:59:08.897525+0000","last_clean":"2024-09-15T23:59:08.897525+0000","last_became_active":"2024-09-15T23:59:08.892497+0000","last_became_peered":"2024-09-15T23:59:08.892497+0000","last_unstale":"2024-09-15T23:59:08.897525+0000","last_undegraded":"2024-09-15T23:59:08.897525+0000","last_fullsized":"2024-09-15T23:59:08.897525+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:12.973144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.900371+0000","last_change":"2024-09-15T23:59:07.893526+0000","last_active":"2024-09-15T23:59:08.900371+0000","last_peered":"2024-09-15T23:59:08.900371+0000","last_clean":"2024-09-15T23:59:08.900371+0000","last_became_active":"2024-09-15T23:59:07.893154+0000","last_became_peered":"2024-09-15T23:59:07.893154+0000","last_unstale":"2024-09-15T23:59:08.900371+0000","last_undegraded":"2024-09-15T23:59:08.900371+0000","last_fullsized":"2024-09-15T23:59:08.900371+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:20.891939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.917181+0000","last_change":"2024-09-15T23:59:08.907791+0000","last_active":"2024-09-15T23:59:08.917181+0000","last_peered":"2024-09-15T23:59:08.917181+0000","last_clean":"2024-09-15T23:59:08.917181+0000","last_became_active":"2024-09-15T23:59:08.907398+0000","last_became_peered":"2024-09-15T23:59:08.907398+0000","last_unstale":"2024-09-15T23:59:08.917181+0000","last_undegraded":"2024-09-15T23:59:08.917181+0000","last_fullsized":"2024-09-15T23:59:08.917181+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:23.907421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"114'8","reported_seq":20,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.925244+0000","last_change":"2024-09-15T23:59:07.900278+0000","last_active":"2024-09-15T23:59:08.925244+0000","last_peered":"2024-09-15T23:59:08.925244+0000","last_clean":"2024-09-15T23:59:08.925244+0000","last_became_active":"2024-09-15T23:59:07.897567+0000","last_became_peered":"2024-09-15T23:59:07.897567+0000","last_unstale":"2024-09-15T23:59:08.925244+0000","last_undegraded":"2024-09-15T23:59:08.925244+0000","last_fullsized":"2024-09-15T23:59:08.925244+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:45.089067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":338,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.884400+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:59:08.884400+0000","last_peered":"2024-09-15T23:59:08.884400+0000","last_clean":"2024-09-15T23:59:08.884400+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:59:08.884400+0000","last_undegraded":"2024-09-15T23:59:08.884400+0000","last_fullsized":"2024-09-15T23:59:08.884400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509510,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":1400832,"data_stored":645852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40876,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330964,"statfs":{"total":96636764160,"available":96594907136,"internally_reserved":0,"allocated":1400832,"data_stored":645852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40880,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330960,"statfs":{"total":96636764160,"available":96594903040,"internally_reserved":0,"allocated":1400832,"data_stored":645852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40900,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330940,"statfs":{"total":96636764160,"available":96594882560,"internally_reserved":0,"allocated":1417216,"data_stored":653109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509511,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40908,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330932,"statfs":{"total":96636764160,"available":96594874368,"internally_reserved":0,"allocated":1429504,"data_stored":655213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509510,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41484,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330356,"statfs":{"total":96636764160,"available":96594284544,"internally_reserved":0,"allocated":2015232,"data_stored":1243547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40900,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330940,"statfs":{"total":96636764160,"available":96594882560,"internally_reserved":0,"allocated":1425408,"data_stored":653705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41436,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330404,"statfs":{"total":96636764160,"available":96594333696,"internally_reserved":0,"allocated":1970176,"data_stored":1223344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:59:12.913 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:59:13.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf76600640 1 Processor -- start 2024-09-15T23:59:13.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf76600640 1 -- start start 2024-09-15T23:59:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf76600640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcf701587a0 0x7fcf700b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf76600640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcf700b37d0 0x7fcf7006df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf76600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf7006e4b0 0x7fcf70161e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf76600640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fcf700b3c40 con 0x7fcf700b37d0 2024-09-15T23:59:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf76600640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fcf7006f870 con 0x7fcf701587a0 2024-09-15T23:59:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf76600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcf7006ec60 con 0x7fcf7006e4b0 2024-09-15T23:59:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf6f7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcf700b37d0 0x7fcf7006df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf6f7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fcf700b37d0 0x7fcf7006df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48372/0 (socket says 172.21.15.112:48372) 2024-09-15T23:59:13.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf6f7fe640 1 -- 172.21.15.112:0/1114800710 learned_addr learned my addr 172.21.15.112:0/1114800710 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:13.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf6ffff640 1 --2- 172.21.15.112:0/1114800710 >> v2:172.21.15.169:3300/0 conn(0x7fcf701587a0 0x7fcf700b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf6f7fe640 1 -- 172.21.15.112:0/1114800710 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf7006e4b0 msgr2=0x7fcf70161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:13.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf74b9d640 1 --2- 172.21.15.112:0/1114800710 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf7006e4b0 0x7fcf70161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf6f7fe640 1 --2- 172.21.15.112:0/1114800710 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf7006e4b0 0x7fcf70161e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf6f7fe640 1 -- 172.21.15.112:0/1114800710 >> v2:172.21.15.169:3300/0 conn(0x7fcf701587a0 msgr2=0x7fcf700b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:13.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf6f7fe640 1 --2- 172.21.15.112:0/1114800710 >> v2:172.21.15.169:3300/0 conn(0x7fcf701587a0 0x7fcf700b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf6f7fe640 1 -- 172.21.15.112:0/1114800710 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7006ef40 con 0x7fcf700b37d0 2024-09-15T23:59:13.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.072+0000 7fcf6ffff640 1 --2- 172.21.15.112:0/1114800710 >> v2:172.21.15.169:3300/0 conn(0x7fcf701587a0 0x7fcf700b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:13.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6f7fe640 1 --2- 172.21.15.112:0/1114800710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf700b37d0 0x7fcf7006df70 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fcf70071710 tx=0x7fcf6401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5565caefc6fc67 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:13.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6effd640 1 -- 172.21.15.112:0/1114800710 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf640b0070 con 0x7fcf700b37d0 2024-09-15T23:59:13.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6effd640 1 -- 172.21.15.112:0/1114800710 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf640ab600 con 0x7fcf700b37d0 2024-09-15T23:59:13.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6effd640 1 -- 172.21.15.112:0/1114800710 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf640ab9d0 con 0x7fcf700b37d0 2024-09-15T23:59:13.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 -- 172.21.15.112:0/1114800710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf700b37d0 msgr2=0x7fcf7006df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 --2- 172.21.15.112:0/1114800710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf700b37d0 0x7fcf7006df70 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fcf70071710 tx=0x7fcf6401c230 comp rx=0 tx=0).stop 2024-09-15T23:59:13.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 -- 172.21.15.112:0/1114800710 shutdown_connections 2024-09-15T23:59:13.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 --2- 172.21.15.112:0/1114800710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf700b37d0 0x7fcf7006df70 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 --2- 172.21.15.112:0/1114800710 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf7006e4b0 0x7fcf70161e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 --2- 172.21.15.112:0/1114800710 >> v2:172.21.15.169:3300/0 conn(0x7fcf701587a0 0x7fcf700b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 -- 172.21.15.112:0/1114800710 >> 172.21.15.112:0/1114800710 conn(0x7fcf700b1f90 msgr2=0x7fcf700b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:13.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 -- 172.21.15.112:0/1114800710 shutdown_connections 2024-09-15T23:59:13.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 -- 172.21.15.112:0/1114800710 wait complete. 2024-09-15T23:59:13.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 Processor -- start 2024-09-15T23:59:13.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 -- start start 2024-09-15T23:59:13.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf7006e4b0 0x7fcf70151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf700b37d0 0x7fcf701455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf701587a0 0x7fcf70152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcf70158b80 con 0x7fcf700b37d0 2024-09-15T23:59:13.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcf70072160 con 0x7fcf701587a0 2024-09-15T23:59:13.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf76600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcf70150f80 con 0x7fcf7006e4b0 2024-09-15T23:59:13.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf700b37d0 0x7fcf701455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf700b37d0 0x7fcf701455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48374/0 (socket says 172.21.15.112:48374) 2024-09-15T23:59:13.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6f7fe640 1 -- 172.21.15.112:0/2376724475 learned_addr learned my addr 172.21.15.112:0/2376724475 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:13.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf74b9d640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf701587a0 0x7fcf70152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6ffff640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf7006e4b0 0x7fcf70151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6f7fe640 1 -- 172.21.15.112:0/2376724475 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf7006e4b0 msgr2=0x7fcf70151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6f7fe640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf7006e4b0 0x7fcf70151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6f7fe640 1 -- 172.21.15.112:0/2376724475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf701587a0 msgr2=0x7fcf70152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6f7fe640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf701587a0 0x7fcf70152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6f7fe640 1 -- 172.21.15.112:0/2376724475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf70145b30 con 0x7fcf700b37d0 2024-09-15T23:59:13.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf74b9d640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf701587a0 0x7fcf70152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:13.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6f7fe640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf700b37d0 0x7fcf701455f0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fcf6401a8e0 tx=0x7fcf64018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:13.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6cff9640 1 -- 172.21.15.112:0/2376724475 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf640b9070 con 0x7fcf700b37d0 2024-09-15T23:59:13.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6cff9640 1 -- 172.21.15.112:0/2376724475 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf640b4600 con 0x7fcf700b37d0 2024-09-15T23:59:13.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.076+0000 7fcf6cff9640 1 -- 172.21.15.112:0/2376724475 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf640b0040 con 0x7fcf700b37d0 2024-09-15T23:59:13.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.080+0000 7fcf76600640 1 -- 172.21.15.112:0/2376724475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf70156510 con 0x7fcf700b37d0 2024-09-15T23:59:13.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.080+0000 7fcf76600640 1 -- 172.21.15.112:0/2376724475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf70156db0 con 0x7fcf700b37d0 2024-09-15T23:59:13.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.080+0000 7fcf76600640 1 -- 172.21.15.112:0/2376724475 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf701566e0 con 0x7fcf700b37d0 2024-09-15T23:59:13.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.080+0000 7fcf6cff9640 1 -- 172.21.15.112:0/2376724475 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf640ab4c0 con 0x7fcf700b37d0 2024-09-15T23:59:13.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.080+0000 7fcf6cff9640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcf5c0678c0 0x7fcf5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.080+0000 7fcf6cff9640 1 -- 172.21.15.112:0/2376724475 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7fcf6411f1a0 con 0x7fcf700b37d0 2024-09-15T23:59:13.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.080+0000 7fcf6ffff640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcf5c0678c0 0x7fcf5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.080+0000 7fcf6ffff640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcf5c0678c0 0x7fcf5c069d80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fcf60006fd0 tx=0x7fcf60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:13.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.084+0000 7fcf6cff9640 1 -- 172.21.15.112:0/2376724475 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcf64016110 con 0x7fcf700b37d0 2024-09-15T23:59:13.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.228+0000 7fcf76600640 1 -- 172.21.15.112:0/2376724475 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcf70156910 con 0x7fcf5c0678c0 2024-09-15T23:59:13.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.236+0000 7fcf6cff9640 1 -- 172.21.15.112:0/2376724475 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250540 (secure 0 0 0) 0x7fcf6000bdd0 con 0x7fcf5c0678c0 2024-09-15T23:59:13.238 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:13.239 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:59:13.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.240+0000 7fcf76600640 1 -- 172.21.15.112:0/2376724475 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcf5c0678c0 msgr2=0x7fcf5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.240+0000 7fcf76600640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcf5c0678c0 0x7fcf5c069d80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fcf60006fd0 tx=0x7fcf60008040 comp rx=0 tx=0).stop 2024-09-15T23:59:13.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.240+0000 7fcf76600640 1 -- 172.21.15.112:0/2376724475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf700b37d0 msgr2=0x7fcf701455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.240+0000 7fcf76600640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf700b37d0 0x7fcf701455f0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fcf6401a8e0 tx=0x7fcf64018fd0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.240 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.240+0000 7fcf76600640 1 -- 172.21.15.112:0/2376724475 shutdown_connections 2024-09-15T23:59:13.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.240+0000 7fcf76600640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fcf5c0678c0 0x7fcf5c069d80 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.240+0000 7fcf76600640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf701587a0 0x7fcf70152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.240+0000 7fcf76600640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf700b37d0 0x7fcf701455f0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.240+0000 7fcf76600640 1 --2- 172.21.15.112:0/2376724475 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf7006e4b0 0x7fcf70151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.240+0000 7fcf76600640 1 -- 172.21.15.112:0/2376724475 >> 172.21.15.112:0/2376724475 conn(0x7fcf700b1f90 msgr2=0x7fcf700b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:13.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.240+0000 7fcf76600640 1 -- 172.21.15.112:0/2376724475 shutdown_connections 2024-09-15T23:59:13.241 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.240+0000 7fcf76600640 1 -- 172.21.15.112:0/2376724475 wait complete. 2024-09-15T23:59:13.255 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2024-09-15T23:59:11.330261+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":328268,"kb_used_data":12168,"kb_used_omap":12,"kb_used_meta":315891,"kb_avail":754646452,"statfs":{"total":773094113280,"available":772757966848,"internally_reserved":0,"allocated":12460032,"data_stored":6366474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":323472944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.474452"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916343+0000","last_change":"2024-09-15T23:59:08.910824+0000","last_active":"2024-09-15T23:59:08.916343+0000","last_peered":"2024-09-15T23:59:08.916343+0000","last_clean":"2024-09-15T23:59:08.916343+0000","last_became_active":"2024-09-15T23:59:08.910492+0000","last_became_peered":"2024-09-15T23:59:08.910492+0000","last_unstale":"2024-09-15T23:59:08.916343+0000","last_undegraded":"2024-09-15T23:59:08.916343+0000","last_fullsized":"2024-09-15T23:59:08.916343+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:26.132557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.907170+0000","last_change":"2024-09-15T23:59:08.905338+0000","last_active":"2024-09-15T23:59:08.907170+0000","last_peered":"2024-09-15T23:59:08.907170+0000","last_clean":"2024-09-15T23:59:08.907170+0000","last_became_active":"2024-09-15T23:59:08.904840+0000","last_became_peered":"2024-09-15T23:59:08.904840+0000","last_unstale":"2024-09-15T23:59:08.907170+0000","last_undegraded":"2024-09-15T23:59:08.907170+0000","last_fullsized":"2024-09-15T23:59:08.907170+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:27.610620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.923113+0000","last_change":"2024-09-15T23:59:08.919911+0000","last_active":"2024-09-15T23:59:08.923113+0000","last_peered":"2024-09-15T23:59:08.923113+0000","last_clean":"2024-09-15T23:59:08.923113+0000","last_became_active":"2024-09-15T23:59:08.919627+0000","last_became_peered":"2024-09-15T23:59:08.919627+0000","last_unstale":"2024-09-15T23:59:08.923113+0000","last_undegraded":"2024-09-15T23:59:08.923113+0000","last_fullsized":"2024-09-15T23:59:08.923113+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:55.470024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918567+0000","last_change":"2024-09-15T23:59:08.912292+0000","last_active":"2024-09-15T23:59:08.918567+0000","last_peered":"2024-09-15T23:59:08.918567+0000","last_clean":"2024-09-15T23:59:08.918567+0000","last_became_active":"2024-09-15T23:59:08.912022+0000","last_became_peered":"2024-09-15T23:59:08.912022+0000","last_unstale":"2024-09-15T23:59:08.918567+0000","last_undegraded":"2024-09-15T23:59:08.918567+0000","last_fullsized":"2024-09-15T23:59:08.918567+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:18.856942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906492+0000","last_change":"2024-09-15T23:59:08.904341+0000","last_active":"2024-09-15T23:59:08.906492+0000","last_peered":"2024-09-15T23:59:08.906492+0000","last_clean":"2024-09-15T23:59:08.906492+0000","last_became_active":"2024-09-15T23:59:08.896726+0000","last_became_peered":"2024-09-15T23:59:08.896726+0000","last_unstale":"2024-09-15T23:59:08.906492+0000","last_undegraded":"2024-09-15T23:59:08.906492+0000","last_fullsized":"2024-09-15T23:59:08.906492+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:23.974413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904722+0000","last_change":"2024-09-15T23:59:08.896463+0000","last_active":"2024-09-15T23:59:08.904722+0000","last_peered":"2024-09-15T23:59:08.904722+0000","last_clean":"2024-09-15T23:59:08.904722+0000","last_became_active":"2024-09-15T23:59:08.895705+0000","last_became_peered":"2024-09-15T23:59:08.895705+0000","last_unstale":"2024-09-15T23:59:08.904722+0000","last_undegraded":"2024-09-15T23:59:08.904722+0000","last_fullsized":"2024-09-15T23:59:08.904722+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:18.856942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916258+0000","last_change":"2024-09-15T23:59:08.912390+0000","last_active":"2024-09-15T23:59:08.916258+0000","last_peered":"2024-09-15T23:59:08.916258+0000","last_clean":"2024-09-15T23:59:08.916258+0000","last_became_active":"2024-09-15T23:59:08.912057+0000","last_became_peered":"2024-09-15T23:59:08.912057+0000","last_unstale":"2024-09-15T23:59:08.916258+0000","last_undegraded":"2024-09-15T23:59:08.916258+0000","last_fullsized":"2024-09-15T23:59:08.916258+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.847623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906275+0000","last_change":"2024-09-15T23:59:08.900744+0000","last_active":"2024-09-15T23:59:08.906275+0000","last_peered":"2024-09-15T23:59:08.906275+0000","last_clean":"2024-09-15T23:59:08.906275+0000","last_became_active":"2024-09-15T23:59:08.900042+0000","last_became_peered":"2024-09-15T23:59:08.900042+0000","last_unstale":"2024-09-15T23:59:08.906275+0000","last_undegraded":"2024-09-15T23:59:08.906275+0000","last_fullsized":"2024-09-15T23:59:08.906275+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:49.417010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906644+0000","last_change":"2024-09-15T23:59:08.902975+0000","last_active":"2024-09-15T23:59:08.906644+0000","last_peered":"2024-09-15T23:59:08.906644+0000","last_clean":"2024-09-15T23:59:08.906644+0000","last_became_active":"2024-09-15T23:59:08.902404+0000","last_became_peered":"2024-09-15T23:59:08.902404+0000","last_unstale":"2024-09-15T23:59:08.906644+0000","last_undegraded":"2024-09-15T23:59:08.906644+0000","last_fullsized":"2024-09-15T23:59:08.906644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:35.096541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918240+0000","last_change":"2024-09-15T23:59:08.910158+0000","last_active":"2024-09-15T23:59:08.918240+0000","last_peered":"2024-09-15T23:59:08.918240+0000","last_clean":"2024-09-15T23:59:08.918240+0000","last_became_active":"2024-09-15T23:59:08.909683+0000","last_became_peered":"2024-09-15T23:59:08.909683+0000","last_unstale":"2024-09-15T23:59:08.918240+0000","last_undegraded":"2024-09-15T23:59:08.918240+0000","last_fullsized":"2024-09-15T23:59:08.918240+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:45.378330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906207+0000","last_change":"2024-09-15T23:59:08.898580+0000","last_active":"2024-09-15T23:59:08.906207+0000","last_peered":"2024-09-15T23:59:08.906207+0000","last_clean":"2024-09-15T23:59:08.906207+0000","last_became_active":"2024-09-15T23:59:08.898198+0000","last_became_peered":"2024-09-15T23:59:08.898198+0000","last_unstale":"2024-09-15T23:59:08.906207+0000","last_undegraded":"2024-09-15T23:59:08.906207+0000","last_fullsized":"2024-09-15T23:59:08.906207+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:23.922497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906259+0000","last_change":"2024-09-15T23:59:08.898848+0000","last_active":"2024-09-15T23:59:08.906259+0000","last_peered":"2024-09-15T23:59:08.906259+0000","last_clean":"2024-09-15T23:59:08.906259+0000","last_became_active":"2024-09-15T23:59:08.897597+0000","last_became_peered":"2024-09-15T23:59:08.897597+0000","last_unstale":"2024-09-15T23:59:08.906259+0000","last_undegraded":"2024-09-15T23:59:08.906259+0000","last_fullsized":"2024-09-15T23:59:08.906259+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:21.050253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.897813+0000","last_change":"2024-09-15T23:59:08.885617+0000","last_active":"2024-09-15T23:59:08.897813+0000","last_peered":"2024-09-15T23:59:08.897813+0000","last_clean":"2024-09-15T23:59:08.897813+0000","last_became_active":"2024-09-15T23:59:08.884879+0000","last_became_peered":"2024-09-15T23:59:08.884879+0000","last_unstale":"2024-09-15T23:59:08.897813+0000","last_undegraded":"2024-09-15T23:59:08.897813+0000","last_fullsized":"2024-09-15T23:59:08.897813+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:33.635213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.919272+0000","last_change":"2024-09-15T23:59:08.900479+0000","last_active":"2024-09-15T23:59:08.919272+0000","last_peered":"2024-09-15T23:59:08.919272+0000","last_clean":"2024-09-15T23:59:08.919272+0000","last_became_active":"2024-09-15T23:59:08.899654+0000","last_became_peered":"2024-09-15T23:59:08.899654+0000","last_unstale":"2024-09-15T23:59:08.919272+0000","last_undegraded":"2024-09-15T23:59:08.919272+0000","last_fullsized":"2024-09-15T23:59:08.919272+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:02.210062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920451+0000","last_change":"2024-09-15T23:59:08.917290+0000","last_active":"2024-09-15T23:59:08.920451+0000","last_peered":"2024-09-15T23:59:08.920451+0000","last_clean":"2024-09-15T23:59:08.920451+0000","last_became_active":"2024-09-15T23:59:08.916943+0000","last_became_peered":"2024-09-15T23:59:08.916943+0000","last_unstale":"2024-09-15T23:59:08.920451+0000","last_undegraded":"2024-09-15T23:59:08.920451+0000","last_fullsized":"2024-09-15T23:59:08.920451+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:23.940640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.905582+0000","last_change":"2024-09-15T23:59:08.903844+0000","last_active":"2024-09-15T23:59:08.905582+0000","last_peered":"2024-09-15T23:59:08.905582+0000","last_clean":"2024-09-15T23:59:08.905582+0000","last_became_active":"2024-09-15T23:59:08.903464+0000","last_became_peered":"2024-09-15T23:59:08.903464+0000","last_unstale":"2024-09-15T23:59:08.905582+0000","last_undegraded":"2024-09-15T23:59:08.905582+0000","last_fullsized":"2024-09-15T23:59:08.905582+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:55.470024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918216+0000","last_change":"2024-09-15T23:59:08.909943+0000","last_active":"2024-09-15T23:59:08.918216+0000","last_peered":"2024-09-15T23:59:08.918216+0000","last_clean":"2024-09-15T23:59:08.918216+0000","last_became_active":"2024-09-15T23:59:08.909343+0000","last_became_peered":"2024-09-15T23:59:08.909343+0000","last_unstale":"2024-09-15T23:59:08.918216+0000","last_undegraded":"2024-09-15T23:59:08.918216+0000","last_fullsized":"2024-09-15T23:59:08.918216+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:01.161528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904756+0000","last_change":"2024-09-15T23:59:08.893198+0000","last_active":"2024-09-15T23:59:08.904756+0000","last_peered":"2024-09-15T23:59:08.904756+0000","last_clean":"2024-09-15T23:59:08.904756+0000","last_became_active":"2024-09-15T23:59:08.892419+0000","last_became_peered":"2024-09-15T23:59:08.892419+0000","last_unstale":"2024-09-15T23:59:08.904756+0000","last_undegraded":"2024-09-15T23:59:08.904756+0000","last_fullsized":"2024-09-15T23:59:08.904756+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:58.451266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916317+0000","last_change":"2024-09-15T23:59:08.910520+0000","last_active":"2024-09-15T23:59:08.916317+0000","last_peered":"2024-09-15T23:59:08.916317+0000","last_clean":"2024-09-15T23:59:08.916317+0000","last_became_active":"2024-09-15T23:59:08.903811+0000","last_became_peered":"2024-09-15T23:59:08.903811+0000","last_unstale":"2024-09-15T23:59:08.916317+0000","last_undegraded":"2024-09-15T23:59:08.916317+0000","last_fullsized":"2024-09-15T23:59:08.916317+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:31.638956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.933927+0000","last_change":"2024-09-15T23:59:08.932649+0000","last_active":"2024-09-15T23:59:08.933927+0000","last_peered":"2024-09-15T23:59:08.933927+0000","last_clean":"2024-09-15T23:59:08.933927+0000","last_became_active":"2024-09-15T23:59:08.932168+0000","last_became_peered":"2024-09-15T23:59:08.932168+0000","last_unstale":"2024-09-15T23:59:08.933927+0000","last_undegraded":"2024-09-15T23:59:08.933927+0000","last_fullsized":"2024-09-15T23:59:08.933927+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:50.616580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.924316+0000","last_change":"2024-09-15T23:59:08.919491+0000","last_active":"2024-09-15T23:59:08.924316+0000","last_peered":"2024-09-15T23:59:08.924316+0000","last_clean":"2024-09-15T23:59:08.924316+0000","last_became_active":"2024-09-15T23:59:08.919162+0000","last_became_peered":"2024-09-15T23:59:08.919162+0000","last_unstale":"2024-09-15T23:59:08.924316+0000","last_undegraded":"2024-09-15T23:59:08.924316+0000","last_fullsized":"2024-09-15T23:59:08.924316+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:58.451266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906248+0000","last_change":"2024-09-15T23:59:08.900424+0000","last_active":"2024-09-15T23:59:08.906248+0000","last_peered":"2024-09-15T23:59:08.906248+0000","last_clean":"2024-09-15T23:59:08.906248+0000","last_became_active":"2024-09-15T23:59:08.899537+0000","last_became_peered":"2024-09-15T23:59:08.899537+0000","last_unstale":"2024-09-15T23:59:08.906248+0000","last_undegraded":"2024-09-15T23:59:08.906248+0000","last_fullsized":"2024-09-15T23:59:08.906248+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:27.163354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918006+0000","last_change":"2024-09-15T23:59:08.912709+0000","last_active":"2024-09-15T23:59:08.918006+0000","last_peered":"2024-09-15T23:59:08.918006+0000","last_clean":"2024-09-15T23:59:08.918006+0000","last_became_active":"2024-09-15T23:59:08.912001+0000","last_became_peered":"2024-09-15T23:59:08.912001+0000","last_unstale":"2024-09-15T23:59:08.918006+0000","last_undegraded":"2024-09-15T23:59:08.918006+0000","last_fullsized":"2024-09-15T23:59:08.918006+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:44.176477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.912057+0000","last_change":"2024-09-15T23:59:08.908502+0000","last_active":"2024-09-15T23:59:08.912057+0000","last_peered":"2024-09-15T23:59:08.912057+0000","last_clean":"2024-09-15T23:59:08.912057+0000","last_became_active":"2024-09-15T23:59:08.907710+0000","last_became_peered":"2024-09-15T23:59:08.907710+0000","last_unstale":"2024-09-15T23:59:08.912057+0000","last_undegraded":"2024-09-15T23:59:08.912057+0000","last_fullsized":"2024-09-15T23:59:08.912057+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:38.007875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916167+0000","last_change":"2024-09-15T23:59:08.903256+0000","last_active":"2024-09-15T23:59:08.916167+0000","last_peered":"2024-09-15T23:59:08.916167+0000","last_clean":"2024-09-15T23:59:08.916167+0000","last_became_active":"2024-09-15T23:59:08.902744+0000","last_became_peered":"2024-09-15T23:59:08.902744+0000","last_unstale":"2024-09-15T23:59:08.916167+0000","last_undegraded":"2024-09-15T23:59:08.916167+0000","last_fullsized":"2024-09-15T23:59:08.916167+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:02.116106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916171+0000","last_change":"2024-09-15T23:59:08.911546+0000","last_active":"2024-09-15T23:59:08.916171+0000","last_peered":"2024-09-15T23:59:08.916171+0000","last_clean":"2024-09-15T23:59:08.916171+0000","last_became_active":"2024-09-15T23:59:08.910654+0000","last_became_peered":"2024-09-15T23:59:08.910654+0000","last_unstale":"2024-09-15T23:59:08.916171+0000","last_undegraded":"2024-09-15T23:59:08.916171+0000","last_fullsized":"2024-09-15T23:59:08.916171+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:49.245433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.900159+0000","last_change":"2024-09-15T23:59:08.896783+0000","last_active":"2024-09-15T23:59:08.900159+0000","last_peered":"2024-09-15T23:59:08.900159+0000","last_clean":"2024-09-15T23:59:08.900159+0000","last_became_active":"2024-09-15T23:59:08.895801+0000","last_became_peered":"2024-09-15T23:59:08.895801+0000","last_unstale":"2024-09-15T23:59:08.900159+0000","last_undegraded":"2024-09-15T23:59:08.900159+0000","last_fullsized":"2024-09-15T23:59:08.900159+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:58:34.531614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"114'4","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.927768+0000","last_change":"2024-09-15T23:59:07.897150+0000","last_active":"2024-09-15T23:59:08.927768+0000","last_peered":"2024-09-15T23:59:08.927768+0000","last_clean":"2024-09-15T23:59:08.927768+0000","last_became_active":"2024-09-15T23:59:07.896874+0000","last_became_peered":"2024-09-15T23:59:07.896874+0000","last_unstale":"2024-09-15T23:59:08.927768+0000","last_undegraded":"2024-09-15T23:59:08.927768+0000","last_fullsized":"2024-09-15T23:59:08.927768+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:33.693308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918980+0000","last_change":"2024-09-15T23:59:07.899334+0000","last_active":"2024-09-15T23:59:08.918980+0000","last_peered":"2024-09-15T23:59:08.918980+0000","last_clean":"2024-09-15T23:59:08.918980+0000","last_became_active":"2024-09-15T23:59:07.897881+0000","last_became_peered":"2024-09-15T23:59:07.897881+0000","last_unstale":"2024-09-15T23:59:08.918980+0000","last_undegraded":"2024-09-15T23:59:08.918980+0000","last_fullsized":"2024-09-15T23:59:08.918980+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:14.214987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916898+0000","last_change":"2024-09-15T23:59:08.915142+0000","last_active":"2024-09-15T23:59:08.916898+0000","last_peered":"2024-09-15T23:59:08.916898+0000","last_clean":"2024-09-15T23:59:08.916898+0000","last_became_active":"2024-09-15T23:59:08.914779+0000","last_became_peered":"2024-09-15T23:59:08.914779+0000","last_unstale":"2024-09-15T23:59:08.916898+0000","last_undegraded":"2024-09-15T23:59:08.916898+0000","last_fullsized":"2024-09-15T23:59:08.916898+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:09.562090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.924156+0000","last_change":"2024-09-15T23:59:07.902457+0000","last_active":"2024-09-15T23:59:08.924156+0000","last_peered":"2024-09-15T23:59:08.924156+0000","last_clean":"2024-09-15T23:59:08.924156+0000","last_became_active":"2024-09-15T23:59:07.902170+0000","last_became_peered":"2024-09-15T23:59:07.902170+0000","last_unstale":"2024-09-15T23:59:08.924156+0000","last_undegraded":"2024-09-15T23:59:08.924156+0000","last_fullsized":"2024-09-15T23:59:08.924156+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:25.178922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920812+0000","last_change":"2024-09-15T23:59:08.913433+0000","last_active":"2024-09-15T23:59:08.920812+0000","last_peered":"2024-09-15T23:59:08.920812+0000","last_clean":"2024-09-15T23:59:08.920812+0000","last_became_active":"2024-09-15T23:59:08.913093+0000","last_became_peered":"2024-09-15T23:59:08.913093+0000","last_unstale":"2024-09-15T23:59:08.920812+0000","last_undegraded":"2024-09-15T23:59:08.920812+0000","last_fullsized":"2024-09-15T23:59:08.920812+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:07.152472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:59:06.867660+0000","last_change":"2024-09-15T23:59:06.867660+0000","last_active":"2024-09-15T23:59:06.845650+0000","last_peered":"2024-09-15T23:59:06.845650+0000","last_clean":"2024-09-15T23:59:06.845650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:06.867660+0000","last_undegraded":"2024-09-15T23:59:06.867660+0000","last_fullsized":"2024-09-15T23:59:06.867660+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916487+0000","last_change":"2024-09-15T23:59:08.911675+0000","last_active":"2024-09-15T23:59:08.916487+0000","last_peered":"2024-09-15T23:59:08.916487+0000","last_clean":"2024-09-15T23:59:08.916487+0000","last_became_active":"2024-09-15T23:59:08.910468+0000","last_became_peered":"2024-09-15T23:59:08.910468+0000","last_unstale":"2024-09-15T23:59:08.916487+0000","last_undegraded":"2024-09-15T23:59:08.916487+0000","last_fullsized":"2024-09-15T23:59:08.916487+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:31.279980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.922479+0000","last_change":"2024-09-15T23:59:07.901742+0000","last_active":"2024-09-15T23:59:08.922479+0000","last_peered":"2024-09-15T23:59:08.922479+0000","last_clean":"2024-09-15T23:59:08.922479+0000","last_became_active":"2024-09-15T23:59:07.901438+0000","last_became_peered":"2024-09-15T23:59:07.901438+0000","last_unstale":"2024-09-15T23:59:08.922479+0000","last_undegraded":"2024-09-15T23:59:08.922479+0000","last_fullsized":"2024-09-15T23:59:08.922479+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:18.840142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916096+0000","last_change":"2024-09-15T23:59:08.903023+0000","last_active":"2024-09-15T23:59:08.916096+0000","last_peered":"2024-09-15T23:59:08.916096+0000","last_clean":"2024-09-15T23:59:08.916096+0000","last_became_active":"2024-09-15T23:59:08.902108+0000","last_became_peered":"2024-09-15T23:59:08.902108+0000","last_unstale":"2024-09-15T23:59:08.916096+0000","last_undegraded":"2024-09-15T23:59:08.916096+0000","last_fullsized":"2024-09-15T23:59:08.916096+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:39.717345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918702+0000","last_change":"2024-09-15T23:59:07.911259+0000","last_active":"2024-09-15T23:59:08.918702+0000","last_peered":"2024-09-15T23:59:08.918702+0000","last_clean":"2024-09-15T23:59:08.918702+0000","last_became_active":"2024-09-15T23:59:07.910417+0000","last_became_peered":"2024-09-15T23:59:07.910417+0000","last_unstale":"2024-09-15T23:59:08.918702+0000","last_undegraded":"2024-09-15T23:59:08.918702+0000","last_fullsized":"2024-09-15T23:59:08.918702+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:50.138286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.900126+0000","last_change":"2024-09-15T23:59:08.898567+0000","last_active":"2024-09-15T23:59:08.900126+0000","last_peered":"2024-09-15T23:59:08.900126+0000","last_clean":"2024-09-15T23:59:08.900126+0000","last_became_active":"2024-09-15T23:59:08.898219+0000","last_became_peered":"2024-09-15T23:59:08.898219+0000","last_unstale":"2024-09-15T23:59:08.900126+0000","last_undegraded":"2024-09-15T23:59:08.900126+0000","last_fullsized":"2024-09-15T23:59:08.900126+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:01.864690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.896506+0000","last_change":"2024-09-15T23:59:07.891090+0000","last_active":"2024-09-15T23:59:08.896506+0000","last_peered":"2024-09-15T23:59:08.896506+0000","last_clean":"2024-09-15T23:59:08.896506+0000","last_became_active":"2024-09-15T23:59:07.890684+0000","last_became_peered":"2024-09-15T23:59:07.890684+0000","last_unstale":"2024-09-15T23:59:08.896506+0000","last_undegraded":"2024-09-15T23:59:08.896506+0000","last_fullsized":"2024-09-15T23:59:08.896506+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:12.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.897585+0000","last_change":"2024-09-15T23:59:08.894805+0000","last_active":"2024-09-15T23:59:08.897585+0000","last_peered":"2024-09-15T23:59:08.897585+0000","last_clean":"2024-09-15T23:59:08.897585+0000","last_became_active":"2024-09-15T23:59:08.893503+0000","last_became_peered":"2024-09-15T23:59:08.893503+0000","last_unstale":"2024-09-15T23:59:08.897585+0000","last_undegraded":"2024-09-15T23:59:08.897585+0000","last_fullsized":"2024-09-15T23:59:08.897585+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:12.946708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.889159+0000","last_change":"2024-09-15T23:59:07.904298+0000","last_active":"2024-09-15T23:59:08.889159+0000","last_peered":"2024-09-15T23:59:08.889159+0000","last_clean":"2024-09-15T23:59:08.889159+0000","last_became_active":"2024-09-15T23:59:07.903534+0000","last_became_peered":"2024-09-15T23:59:07.903534+0000","last_unstale":"2024-09-15T23:59:08.889159+0000","last_undegraded":"2024-09-15T23:59:08.889159+0000","last_fullsized":"2024-09-15T23:59:08.889159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:55.141179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.923960+0000","last_change":"2024-09-15T23:59:08.918009+0000","last_active":"2024-09-15T23:59:08.923960+0000","last_peered":"2024-09-15T23:59:08.923960+0000","last_clean":"2024-09-15T23:59:08.923960+0000","last_became_active":"2024-09-15T23:59:08.917739+0000","last_became_peered":"2024-09-15T23:59:08.917739+0000","last_unstale":"2024-09-15T23:59:08.923960+0000","last_undegraded":"2024-09-15T23:59:08.923960+0000","last_fullsized":"2024-09-15T23:59:08.923960+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:15.224990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.875559+0000","last_change":"2024-09-15T23:59:07.904677+0000","last_active":"2024-09-15T23:59:08.875559+0000","last_peered":"2024-09-15T23:59:08.875559+0000","last_clean":"2024-09-15T23:59:08.875559+0000","last_became_active":"2024-09-15T23:59:07.904276+0000","last_became_peered":"2024-09-15T23:59:07.904276+0000","last_unstale":"2024-09-15T23:59:08.875559+0000","last_undegraded":"2024-09-15T23:59:08.875559+0000","last_fullsized":"2024-09-15T23:59:08.875559+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:55.211122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920845+0000","last_change":"2024-09-15T23:59:08.913519+0000","last_active":"2024-09-15T23:59:08.920845+0000","last_peered":"2024-09-15T23:59:08.920845+0000","last_clean":"2024-09-15T23:59:08.920845+0000","last_became_active":"2024-09-15T23:59:08.913190+0000","last_became_peered":"2024-09-15T23:59:08.913190+0000","last_unstale":"2024-09-15T23:59:08.920845+0000","last_undegraded":"2024-09-15T23:59:08.920845+0000","last_fullsized":"2024-09-15T23:59:08.920845+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:58.451266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.874397+0000","last_change":"2024-09-15T23:59:07.892077+0000","last_active":"2024-09-15T23:59:08.874397+0000","last_peered":"2024-09-15T23:59:08.874397+0000","last_clean":"2024-09-15T23:59:08.874397+0000","last_became_active":"2024-09-15T23:59:07.891329+0000","last_became_peered":"2024-09-15T23:59:07.891329+0000","last_unstale":"2024-09-15T23:59:08.874397+0000","last_undegraded":"2024-09-15T23:59:08.874397+0000","last_fullsized":"2024-09-15T23:59:08.874397+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:33.693308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916402+0000","last_change":"2024-09-15T23:59:08.910417+0000","last_active":"2024-09-15T23:59:08.916402+0000","last_peered":"2024-09-15T23:59:08.916402+0000","last_clean":"2024-09-15T23:59:08.916402+0000","last_became_active":"2024-09-15T23:59:08.907523+0000","last_became_peered":"2024-09-15T23:59:08.907523+0000","last_unstale":"2024-09-15T23:59:08.916402+0000","last_undegraded":"2024-09-15T23:59:08.916402+0000","last_fullsized":"2024-09-15T23:59:08.916402+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:30.138860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"114'3","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.925138+0000","last_change":"2024-09-15T23:59:07.898178+0000","last_active":"2024-09-15T23:59:08.925138+0000","last_peered":"2024-09-15T23:59:08.925138+0000","last_clean":"2024-09-15T23:59:08.925138+0000","last_became_active":"2024-09-15T23:59:07.897591+0000","last_became_peered":"2024-09-15T23:59:07.897591+0000","last_unstale":"2024-09-15T23:59:08.925138+0000","last_undegraded":"2024-09-15T23:59:08.925138+0000","last_fullsized":"2024-09-15T23:59:08.925138+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:42.591070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920347+0000","last_change":"2024-09-15T23:59:08.917685+0000","last_active":"2024-09-15T23:59:08.920347+0000","last_peered":"2024-09-15T23:59:08.920347+0000","last_clean":"2024-09-15T23:59:08.920347+0000","last_became_active":"2024-09-15T23:59:08.917472+0000","last_became_peered":"2024-09-15T23:59:08.917472+0000","last_unstale":"2024-09-15T23:59:08.920347+0000","last_undegraded":"2024-09-15T23:59:08.920347+0000","last_fullsized":"2024-09-15T23:59:08.920347+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:07.152472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:59:06.866306+0000","last_change":"2024-09-15T23:59:06.866306+0000","last_active":"2024-09-15T23:59:06.845650+0000","last_peered":"2024-09-15T23:59:06.845650+0000","last_clean":"2024-09-15T23:59:06.845650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:06.866306+0000","last_undegraded":"2024-09-15T23:59:06.866306+0000","last_fullsized":"2024-09-15T23:59:06.866306+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918442+0000","last_change":"2024-09-15T23:59:08.911790+0000","last_active":"2024-09-15T23:59:08.918442+0000","last_peered":"2024-09-15T23:59:08.918442+0000","last_clean":"2024-09-15T23:59:08.918442+0000","last_became_active":"2024-09-15T23:59:08.911525+0000","last_became_peered":"2024-09-15T23:59:08.911525+0000","last_unstale":"2024-09-15T23:59:08.918442+0000","last_undegraded":"2024-09-15T23:59:08.918442+0000","last_fullsized":"2024-09-15T23:59:08.918442+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:56.221125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.922686+0000","last_change":"2024-09-15T23:59:07.901494+0000","last_active":"2024-09-15T23:59:08.922686+0000","last_peered":"2024-09-15T23:59:08.922686+0000","last_clean":"2024-09-15T23:59:08.922686+0000","last_became_active":"2024-09-15T23:59:07.900634+0000","last_became_peered":"2024-09-15T23:59:07.900634+0000","last_unstale":"2024-09-15T23:59:08.922686+0000","last_undegraded":"2024-09-15T23:59:08.922686+0000","last_fullsized":"2024-09-15T23:59:08.922686+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:45.156139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.890590+0000","last_change":"2024-09-15T23:59:07.900377+0000","last_active":"2024-09-15T23:59:08.890590+0000","last_peered":"2024-09-15T23:59:08.890590+0000","last_clean":"2024-09-15T23:59:08.890590+0000","last_became_active":"2024-09-15T23:59:07.899640+0000","last_became_peered":"2024-09-15T23:59:07.899640+0000","last_unstale":"2024-09-15T23:59:08.890590+0000","last_undegraded":"2024-09-15T23:59:08.890590+0000","last_fullsized":"2024-09-15T23:59:08.890590+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:38.375055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904437+0000","last_change":"2024-09-15T23:59:08.893917+0000","last_active":"2024-09-15T23:59:08.904437+0000","last_peered":"2024-09-15T23:59:08.904437+0000","last_clean":"2024-09-15T23:59:08.904437+0000","last_became_active":"2024-09-15T23:59:08.893372+0000","last_became_peered":"2024-09-15T23:59:08.893372+0000","last_unstale":"2024-09-15T23:59:08.904437+0000","last_undegraded":"2024-09-15T23:59:08.904437+0000","last_fullsized":"2024-09-15T23:59:08.904437+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:28.439286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.874321+0000","last_change":"2024-09-15T23:59:07.899745+0000","last_active":"2024-09-15T23:59:08.874321+0000","last_peered":"2024-09-15T23:59:08.874321+0000","last_clean":"2024-09-15T23:59:08.874321+0000","last_became_active":"2024-09-15T23:59:07.898602+0000","last_became_peered":"2024-09-15T23:59:07.898602+0000","last_unstale":"2024-09-15T23:59:08.874321+0000","last_undegraded":"2024-09-15T23:59:08.874321+0000","last_fullsized":"2024-09-15T23:59:08.874321+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:39.506591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918213+0000","last_change":"2024-09-15T23:59:08.905590+0000","last_active":"2024-09-15T23:59:08.918213+0000","last_peered":"2024-09-15T23:59:08.918213+0000","last_clean":"2024-09-15T23:59:08.918213+0000","last_became_active":"2024-09-15T23:59:08.904800+0000","last_became_peered":"2024-09-15T23:59:08.904800+0000","last_unstale":"2024-09-15T23:59:08.918213+0000","last_undegraded":"2024-09-15T23:59:08.918213+0000","last_fullsized":"2024-09-15T23:59:08.918213+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:23.940640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.919186+0000","last_change":"2024-09-15T23:59:07.898098+0000","last_active":"2024-09-15T23:59:08.919186+0000","last_peered":"2024-09-15T23:59:08.919186+0000","last_clean":"2024-09-15T23:59:08.919186+0000","last_became_active":"2024-09-15T23:59:07.897362+0000","last_became_peered":"2024-09-15T23:59:07.897362+0000","last_unstale":"2024-09-15T23:59:08.919186+0000","last_undegraded":"2024-09-15T23:59:08.919186+0000","last_fullsized":"2024-09-15T23:59:08.919186+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:50.535811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.932551+0000","last_change":"2024-09-15T23:59:08.932023+0000","last_active":"2024-09-15T23:59:08.932551+0000","last_peered":"2024-09-15T23:59:08.932551+0000","last_clean":"2024-09-15T23:59:08.932551+0000","last_became_active":"2024-09-15T23:59:08.931681+0000","last_became_peered":"2024-09-15T23:59:08.931681+0000","last_unstale":"2024-09-15T23:59:08.932551+0000","last_undegraded":"2024-09-15T23:59:08.932551+0000","last_fullsized":"2024-09-15T23:59:08.932551+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:45.141866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.936023+0000","last_change":"2024-09-15T23:59:07.908611+0000","last_active":"2024-09-15T23:59:08.936023+0000","last_peered":"2024-09-15T23:59:08.936023+0000","last_clean":"2024-09-15T23:59:08.936023+0000","last_became_active":"2024-09-15T23:59:07.906983+0000","last_became_peered":"2024-09-15T23:59:07.906983+0000","last_unstale":"2024-09-15T23:59:08.936023+0000","last_undegraded":"2024-09-15T23:59:08.936023+0000","last_fullsized":"2024-09-15T23:59:08.936023+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:30.303746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.925623+0000","last_change":"2024-09-15T23:59:07.895016+0000","last_active":"2024-09-15T23:59:08.925623+0000","last_peered":"2024-09-15T23:59:08.925623+0000","last_clean":"2024-09-15T23:59:08.925623+0000","last_became_active":"2024-09-15T23:59:07.894480+0000","last_became_peered":"2024-09-15T23:59:07.894480+0000","last_unstale":"2024-09-15T23:59:08.925623+0000","last_undegraded":"2024-09-15T23:59:08.925623+0000","last_fullsized":"2024-09-15T23:59:08.925623+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:35.445956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920325+0000","last_change":"2024-09-15T23:59:08.917111+0000","last_active":"2024-09-15T23:59:08.920325+0000","last_peered":"2024-09-15T23:59:08.920325+0000","last_clean":"2024-09-15T23:59:08.920325+0000","last_became_active":"2024-09-15T23:59:08.915164+0000","last_became_peered":"2024-09-15T23:59:08.915164+0000","last_unstale":"2024-09-15T23:59:08.920325+0000","last_undegraded":"2024-09-15T23:59:08.920325+0000","last_fullsized":"2024-09-15T23:59:08.920325+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:26.188926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.886635+0000","last_change":"2024-09-15T23:59:07.894577+0000","last_active":"2024-09-15T23:59:08.886635+0000","last_peered":"2024-09-15T23:59:08.886635+0000","last_clean":"2024-09-15T23:59:08.886635+0000","last_became_active":"2024-09-15T23:59:07.894225+0000","last_became_peered":"2024-09-15T23:59:07.894225+0000","last_unstale":"2024-09-15T23:59:08.886635+0000","last_undegraded":"2024-09-15T23:59:08.886635+0000","last_fullsized":"2024-09-15T23:59:08.886635+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:57.333706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.921415+0000","last_change":"2024-09-15T23:59:07.888210+0000","last_active":"2024-09-15T23:59:08.921415+0000","last_peered":"2024-09-15T23:59:08.921415+0000","last_clean":"2024-09-15T23:59:08.921415+0000","last_became_active":"2024-09-15T23:59:07.886924+0000","last_became_peered":"2024-09-15T23:59:07.886924+0000","last_unstale":"2024-09-15T23:59:08.921415+0000","last_undegraded":"2024-09-15T23:59:08.921415+0000","last_fullsized":"2024-09-15T23:59:08.921415+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:44.368326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906037+0000","last_change":"2024-09-15T23:59:08.898377+0000","last_active":"2024-09-15T23:59:08.906037+0000","last_peered":"2024-09-15T23:59:08.906037+0000","last_clean":"2024-09-15T23:59:08.906037+0000","last_became_active":"2024-09-15T23:59:08.897554+0000","last_became_peered":"2024-09-15T23:59:08.897554+0000","last_unstale":"2024-09-15T23:59:08.906037+0000","last_undegraded":"2024-09-15T23:59:08.906037+0000","last_fullsized":"2024-09-15T23:59:08.906037+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:32.768826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.886070+0000","last_change":"2024-09-15T23:59:07.895677+0000","last_active":"2024-09-15T23:59:08.886070+0000","last_peered":"2024-09-15T23:59:08.886070+0000","last_clean":"2024-09-15T23:59:08.886070+0000","last_became_active":"2024-09-15T23:59:07.895385+0000","last_became_peered":"2024-09-15T23:59:07.895385+0000","last_unstale":"2024-09-15T23:59:08.886070+0000","last_undegraded":"2024-09-15T23:59:08.886070+0000","last_fullsized":"2024-09-15T23:59:08.886070+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:22.930636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.919182+0000","last_change":"2024-09-15T23:59:08.917054+0000","last_active":"2024-09-15T23:59:08.919182+0000","last_peered":"2024-09-15T23:59:08.919182+0000","last_clean":"2024-09-15T23:59:08.919182+0000","last_became_active":"2024-09-15T23:59:08.912975+0000","last_became_peered":"2024-09-15T23:59:08.912975+0000","last_unstale":"2024-09-15T23:59:08.919182+0000","last_undegraded":"2024-09-15T23:59:08.919182+0000","last_fullsized":"2024-09-15T23:59:08.919182+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:35:33.829330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.889220+0000","last_change":"2024-09-15T23:59:07.904775+0000","last_active":"2024-09-15T23:59:08.889220+0000","last_peered":"2024-09-15T23:59:08.889220+0000","last_clean":"2024-09-15T23:59:08.889220+0000","last_became_active":"2024-09-15T23:59:07.903906+0000","last_became_peered":"2024-09-15T23:59:07.903906+0000","last_unstale":"2024-09-15T23:59:08.889220+0000","last_undegraded":"2024-09-15T23:59:08.889220+0000","last_fullsized":"2024-09-15T23:59:08.889220+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:39.108011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916530+0000","last_change":"2024-09-15T23:59:08.911830+0000","last_active":"2024-09-15T23:59:08.916530+0000","last_peered":"2024-09-15T23:59:08.916530+0000","last_clean":"2024-09-15T23:59:08.916530+0000","last_became_active":"2024-09-15T23:59:08.911561+0000","last_became_peered":"2024-09-15T23:59:08.911561+0000","last_unstale":"2024-09-15T23:59:08.916530+0000","last_undegraded":"2024-09-15T23:59:08.916530+0000","last_fullsized":"2024-09-15T23:59:08.916530+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:38.472909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.899976+0000","last_change":"2024-09-15T23:59:07.888011+0000","last_active":"2024-09-15T23:59:08.899976+0000","last_peered":"2024-09-15T23:59:08.899976+0000","last_clean":"2024-09-15T23:59:08.899976+0000","last_became_active":"2024-09-15T23:59:07.887633+0000","last_became_peered":"2024-09-15T23:59:07.887633+0000","last_unstale":"2024-09-15T23:59:08.899976+0000","last_undegraded":"2024-09-15T23:59:08.899976+0000","last_fullsized":"2024-09-15T23:59:08.899976+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:32.340184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904453+0000","last_change":"2024-09-15T23:59:08.894213+0000","last_active":"2024-09-15T23:59:08.904453+0000","last_peered":"2024-09-15T23:59:08.904453+0000","last_clean":"2024-09-15T23:59:08.904453+0000","last_became_active":"2024-09-15T23:59:08.893860+0000","last_became_peered":"2024-09-15T23:59:08.893860+0000","last_unstale":"2024-09-15T23:59:08.904453+0000","last_undegraded":"2024-09-15T23:59:08.904453+0000","last_fullsized":"2024-09-15T23:59:08.904453+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:04.492508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:59:06.866483+0000","last_change":"2024-09-15T23:59:06.866483+0000","last_active":"2024-09-15T23:59:06.845650+0000","last_peered":"2024-09-15T23:59:06.845650+0000","last_clean":"2024-09-15T23:59:06.845650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:06.866483+0000","last_undegraded":"2024-09-15T23:59:06.866483+0000","last_fullsized":"2024-09-15T23:59:06.866483+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904028+0000","last_change":"2024-09-15T23:59:08.902565+0000","last_active":"2024-09-15T23:59:08.904028+0000","last_peered":"2024-09-15T23:59:08.904028+0000","last_clean":"2024-09-15T23:59:08.904028+0000","last_became_active":"2024-09-15T23:59:08.902160+0000","last_became_peered":"2024-09-15T23:59:08.902160+0000","last_unstale":"2024-09-15T23:59:08.904028+0000","last_undegraded":"2024-09-15T23:59:08.904028+0000","last_fullsized":"2024-09-15T23:59:08.904028+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:54.782717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.908782+0000","last_change":"2024-09-15T23:59:07.893449+0000","last_active":"2024-09-15T23:59:08.908782+0000","last_peered":"2024-09-15T23:59:08.908782+0000","last_clean":"2024-09-15T23:59:08.908782+0000","last_became_active":"2024-09-15T23:59:07.893086+0000","last_became_peered":"2024-09-15T23:59:07.893086+0000","last_unstale":"2024-09-15T23:59:08.908782+0000","last_undegraded":"2024-09-15T23:59:08.908782+0000","last_fullsized":"2024-09-15T23:59:08.908782+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:39.302221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.905375+0000","last_change":"2024-09-15T23:59:08.903181+0000","last_active":"2024-09-15T23:59:08.905375+0000","last_peered":"2024-09-15T23:59:08.905375+0000","last_clean":"2024-09-15T23:59:08.905375+0000","last_became_active":"2024-09-15T23:59:08.902453+0000","last_became_peered":"2024-09-15T23:59:08.902453+0000","last_unstale":"2024-09-15T23:59:08.905375+0000","last_undegraded":"2024-09-15T23:59:08.905375+0000","last_fullsized":"2024-09-15T23:59:08.905375+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:26.188926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.908423+0000","last_change":"2024-09-15T23:59:07.913163+0000","last_active":"2024-09-15T23:59:08.908423+0000","last_peered":"2024-09-15T23:59:08.908423+0000","last_clean":"2024-09-15T23:59:08.908423+0000","last_became_active":"2024-09-15T23:59:07.912890+0000","last_became_peered":"2024-09-15T23:59:07.912890+0000","last_unstale":"2024-09-15T23:59:08.908423+0000","last_undegraded":"2024-09-15T23:59:08.908423+0000","last_fullsized":"2024-09-15T23:59:08.908423+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:01.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918090+0000","last_change":"2024-09-15T23:59:08.916865+0000","last_active":"2024-09-15T23:59:08.918090+0000","last_peered":"2024-09-15T23:59:08.918090+0000","last_clean":"2024-09-15T23:59:08.918090+0000","last_became_active":"2024-09-15T23:59:08.916205+0000","last_became_peered":"2024-09-15T23:59:08.916205+0000","last_unstale":"2024-09-15T23:59:08.918090+0000","last_undegraded":"2024-09-15T23:59:08.918090+0000","last_fullsized":"2024-09-15T23:59:08.918090+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:52.891063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.878744+0000","last_change":"2024-09-15T23:59:07.905993+0000","last_active":"2024-09-15T23:59:08.878744+0000","last_peered":"2024-09-15T23:59:08.878744+0000","last_clean":"2024-09-15T23:59:08.878744+0000","last_became_active":"2024-09-15T23:59:07.905239+0000","last_became_peered":"2024-09-15T23:59:07.905239+0000","last_unstale":"2024-09-15T23:59:08.878744+0000","last_undegraded":"2024-09-15T23:59:08.878744+0000","last_fullsized":"2024-09-15T23:59:08.878744+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:06.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.889752+0000","last_change":"2024-09-15T23:59:08.885109+0000","last_active":"2024-09-15T23:59:08.889752+0000","last_peered":"2024-09-15T23:59:08.889752+0000","last_clean":"2024-09-15T23:59:08.889752+0000","last_became_active":"2024-09-15T23:59:08.884262+0000","last_became_peered":"2024-09-15T23:59:08.884262+0000","last_unstale":"2024-09-15T23:59:08.889752+0000","last_undegraded":"2024-09-15T23:59:08.889752+0000","last_fullsized":"2024-09-15T23:59:08.889752+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:16.349140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.908358+0000","last_change":"2024-09-15T23:59:07.901979+0000","last_active":"2024-09-15T23:59:08.908358+0000","last_peered":"2024-09-15T23:59:08.908358+0000","last_clean":"2024-09-15T23:59:08.908358+0000","last_became_active":"2024-09-15T23:59:07.901442+0000","last_became_peered":"2024-09-15T23:59:07.901442+0000","last_unstale":"2024-09-15T23:59:08.908358+0000","last_undegraded":"2024-09-15T23:59:08.908358+0000","last_fullsized":"2024-09-15T23:59:08.908358+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:25.844482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:59:07.855653+0000","last_change":"2024-09-15T23:59:07.855653+0000","last_active":"2024-09-15T23:59:07.855653+0000","last_peered":"2024-09-15T23:59:07.855653+0000","last_clean":"2024-09-15T23:59:07.855653+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:07.855653+0000","last_undegraded":"2024-09-15T23:59:07.855653+0000","last_fullsized":"2024-09-15T23:59:07.855653+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.886421+0000","last_change":"2024-09-15T23:59:07.903057+0000","last_active":"2024-09-15T23:59:08.886421+0000","last_peered":"2024-09-15T23:59:08.886421+0000","last_clean":"2024-09-15T23:59:08.886421+0000","last_became_active":"2024-09-15T23:59:07.902837+0000","last_became_peered":"2024-09-15T23:59:07.902837+0000","last_unstale":"2024-09-15T23:59:08.886421+0000","last_undegraded":"2024-09-15T23:59:08.886421+0000","last_fullsized":"2024-09-15T23:59:08.886421+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:06.142468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.917076+0000","last_change":"2024-09-15T23:59:08.907407+0000","last_active":"2024-09-15T23:59:08.917076+0000","last_peered":"2024-09-15T23:59:08.917076+0000","last_clean":"2024-09-15T23:59:08.917076+0000","last_became_active":"2024-09-15T23:59:08.901378+0000","last_became_peered":"2024-09-15T23:59:08.901378+0000","last_unstale":"2024-09-15T23:59:08.917076+0000","last_undegraded":"2024-09-15T23:59:08.917076+0000","last_fullsized":"2024-09-15T23:59:08.917076+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:35.937408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:59:06.866468+0000","last_change":"2024-09-15T23:59:06.866468+0000","last_active":"2024-09-15T23:59:06.845650+0000","last_peered":"2024-09-15T23:59:06.845650+0000","last_clean":"2024-09-15T23:59:06.845650+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:59:06.866468+0000","last_undegraded":"2024-09-15T23:59:06.866468+0000","last_fullsized":"2024-09-15T23:59:06.866468+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.897525+0000","last_change":"2024-09-15T23:59:08.894211+0000","last_active":"2024-09-15T23:59:08.897525+0000","last_peered":"2024-09-15T23:59:08.897525+0000","last_clean":"2024-09-15T23:59:08.897525+0000","last_became_active":"2024-09-15T23:59:08.892497+0000","last_became_peered":"2024-09-15T23:59:08.892497+0000","last_unstale":"2024-09-15T23:59:08.897525+0000","last_undegraded":"2024-09-15T23:59:08.897525+0000","last_fullsized":"2024-09-15T23:59:08.897525+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:12.973144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.900371+0000","last_change":"2024-09-15T23:59:07.893526+0000","last_active":"2024-09-15T23:59:08.900371+0000","last_peered":"2024-09-15T23:59:08.900371+0000","last_clean":"2024-09-15T23:59:08.900371+0000","last_became_active":"2024-09-15T23:59:07.893154+0000","last_became_peered":"2024-09-15T23:59:07.893154+0000","last_unstale":"2024-09-15T23:59:08.900371+0000","last_undegraded":"2024-09-15T23:59:08.900371+0000","last_fullsized":"2024-09-15T23:59:08.900371+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:20.891939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.917181+0000","last_change":"2024-09-15T23:59:08.907791+0000","last_active":"2024-09-15T23:59:08.917181+0000","last_peered":"2024-09-15T23:59:08.917181+0000","last_clean":"2024-09-15T23:59:08.917181+0000","last_became_active":"2024-09-15T23:59:08.907398+0000","last_became_peered":"2024-09-15T23:59:08.907398+0000","last_unstale":"2024-09-15T23:59:08.917181+0000","last_undegraded":"2024-09-15T23:59:08.917181+0000","last_fullsized":"2024-09-15T23:59:08.917181+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:23.907421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"114'8","reported_seq":20,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.925244+0000","last_change":"2024-09-15T23:59:07.900278+0000","last_active":"2024-09-15T23:59:08.925244+0000","last_peered":"2024-09-15T23:59:08.925244+0000","last_clean":"2024-09-15T23:59:08.925244+0000","last_became_active":"2024-09-15T23:59:07.897567+0000","last_became_peered":"2024-09-15T23:59:07.897567+0000","last_unstale":"2024-09-15T23:59:08.925244+0000","last_undegraded":"2024-09-15T23:59:08.925244+0000","last_fullsized":"2024-09-15T23:59:08.925244+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:45.089067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":338,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.884400+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:59:08.884400+0000","last_peered":"2024-09-15T23:59:08.884400+0000","last_clean":"2024-09-15T23:59:08.884400+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:59:08.884400+0000","last_undegraded":"2024-09-15T23:59:08.884400+0000","last_fullsized":"2024-09-15T23:59:08.884400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509510,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":1400832,"data_stored":645852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40876,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330964,"statfs":{"total":96636764160,"available":96594907136,"internally_reserved":0,"allocated":1400832,"data_stored":645852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40880,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330960,"statfs":{"total":96636764160,"available":96594903040,"internally_reserved":0,"allocated":1400832,"data_stored":645852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40900,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330940,"statfs":{"total":96636764160,"available":96594882560,"internally_reserved":0,"allocated":1417216,"data_stored":653109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509511,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40908,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330932,"statfs":{"total":96636764160,"available":96594874368,"internally_reserved":0,"allocated":1429504,"data_stored":655213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509510,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41484,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330356,"statfs":{"total":96636764160,"available":96594284544,"internally_reserved":0,"allocated":2015232,"data_stored":1243547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40900,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330940,"statfs":{"total":96636764160,"available":96594882560,"internally_reserved":0,"allocated":1425408,"data_stored":653705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41436,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330404,"statfs":{"total":96636764160,"available":96594333696,"internally_reserved":0,"allocated":1970176,"data_stored":1223344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:59:13.259 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:59:13.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff7a19640 1 Processor -- start 2024-09-15T23:59:13.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff7a19640 1 -- start start 2024-09-15T23:59:13.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff7a19640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff0070020 0x7f1ff015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.416 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff7a19640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1ff015f1d0 0x7f1ff00adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff7a19640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ff00aede0 con 0x7f1ff01520a0 2024-09-15T23:59:13.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff7a19640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1ff0152480 con 0x7f1ff015f1d0 2024-09-15T23:59:13.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff7a19640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff015fa10 con 0x7f1ff0070020 2024-09-15T23:59:13.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff5fb6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1ff015f1d0 0x7f1ff00adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff5fb6640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1ff015f1d0 0x7f1ff00adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48380/0 (socket says 172.21.15.112:48380) 2024-09-15T23:59:13.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff5fb6640 1 -- 172.21.15.112:0/1995680125 learned_addr learned my addr 172.21.15.112:0/1995680125 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:13.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff4fb4640 1 --2- 172.21.15.112:0/1995680125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff0070020 0x7f1ff015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff5fb6640 1 -- 172.21.15.112:0/1995680125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff0070020 msgr2=0x7f1ff015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:13.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff5fb6640 1 --2- 172.21.15.112:0/1995680125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff0070020 0x7f1ff015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff5fb6640 1 -- 172.21.15.112:0/1995680125 >> v1:172.21.15.169:6789/0 conn(0x7f1ff01520a0 legacy=0x7f1ff006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.417 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.416+0000 7f1ff5fb6640 1 -- 172.21.15.112:0/1995680125 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff0074250 con 0x7f1ff015f1d0 2024-09-15T23:59:13.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff5fb6640 1 --2- 172.21.15.112:0/1995680125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff015f1d0 0x7f1ff00adc80 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009e80 tx=0x7f1fe801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85aaeb571a0cf61 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:13.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1fe7fff640 1 -- 172.21.15.112:0/1995680125 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80a58a0 con 0x7f1ff015f1d0 2024-09-15T23:59:13.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1fe7fff640 1 -- 172.21.15.112:0/1995680125 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe80a5a40 con 0x7f1ff015f1d0 2024-09-15T23:59:13.419 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1fe7fff640 1 -- 172.21.15.112:0/1995680125 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80a5e10 con 0x7f1ff015f1d0 2024-09-15T23:59:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 -- 172.21.15.112:0/1995680125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff015f1d0 msgr2=0x7f1ff00adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 --2- 172.21.15.112:0/1995680125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff015f1d0 0x7f1ff00adc80 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009e80 tx=0x7f1fe801c9e0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 -- 172.21.15.112:0/1995680125 shutdown_connections 2024-09-15T23:59:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 --2- 172.21.15.112:0/1995680125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff015f1d0 0x7f1ff00adc80 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 --2- 172.21.15.112:0/1995680125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff0070020 0x7f1ff015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 -- 172.21.15.112:0/1995680125 >> 172.21.15.112:0/1995680125 conn(0x7f1ff00b1f90 msgr2=0x7f1ff00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 -- 172.21.15.112:0/1995680125 shutdown_connections 2024-09-15T23:59:13.420 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 -- 172.21.15.112:0/1995680125 wait complete. 2024-09-15T23:59:13.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 Processor -- start 2024-09-15T23:59:13.421 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 -- start start 2024-09-15T23:59:13.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff0070020 0x7f1ff014d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff01520a0 0x7f1ff00ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ff015f1d0 0x7f1ff00ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff015f680 con 0x7f1ff01520a0 2024-09-15T23:59:13.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff0073d30 con 0x7f1ff015f1d0 2024-09-15T23:59:13.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff7a19640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff006e800 con 0x7f1ff0070020 2024-09-15T23:59:13.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff4fb4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff01520a0 0x7f1ff00ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff4fb4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff01520a0 0x7f1ff00ce2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48390/0 (socket says 172.21.15.112:48390) 2024-09-15T23:59:13.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff4fb4640 1 -- 172.21.15.112:0/3397390469 learned_addr learned my addr 172.21.15.112:0/3397390469 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:13.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff57b5640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff0070020 0x7f1ff014d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff5fb6640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ff015f1d0 0x7f1ff00ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff4fb4640 1 -- 172.21.15.112:0/3397390469 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff0070020 msgr2=0x7f1ff014d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff4fb4640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff0070020 0x7f1ff014d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff4fb4640 1 -- 172.21.15.112:0/3397390469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ff015f1d0 msgr2=0x7f1ff00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff4fb4640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ff015f1d0 0x7f1ff00ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff4fb4640 1 -- 172.21.15.112:0/3397390469 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff00cd9e0 con 0x7f1ff01520a0 2024-09-15T23:59:13.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff5fb6640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ff015f1d0 0x7f1ff00ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:13.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1ff4fb4640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff01520a0 0x7f1ff00ce2b0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000d5d0 tx=0x7f1fe000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:13.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1fe5ffb640 1 -- 172.21.15.112:0/3397390469 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0004240 con 0x7f1ff01520a0 2024-09-15T23:59:13.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1fe5ffb640 1 -- 172.21.15.112:0/3397390469 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe00043e0 con 0x7f1ff01520a0 2024-09-15T23:59:13.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.420+0000 7f1fe5ffb640 1 -- 172.21.15.112:0/3397390469 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0003840 con 0x7f1ff01520a0 2024-09-15T23:59:13.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.424+0000 7f1ff7a19640 1 -- 172.21.15.112:0/3397390469 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff015c7a0 con 0x7f1ff01520a0 2024-09-15T23:59:13.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.424+0000 7f1ff7a19640 1 -- 172.21.15.112:0/3397390469 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff015cd60 con 0x7f1ff01520a0 2024-09-15T23:59:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.424+0000 7f1ff7a19640 1 -- 172.21.15.112:0/3397390469 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff00cdd80 con 0x7f1ff01520a0 2024-09-15T23:59:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.424+0000 7f1fe5ffb640 1 -- 172.21.15.112:0/3397390469 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1fe00039e0 con 0x7f1ff01520a0 2024-09-15T23:59:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.424+0000 7f1fe5ffb640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1fd40678c0 0x7f1fd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.424+0000 7f1fe5ffb640 1 -- 172.21.15.112:0/3397390469 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f1fe00860c0 con 0x7f1ff01520a0 2024-09-15T23:59:13.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.424+0000 7f1ff57b5640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1fd40678c0 0x7f1fd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.424+0000 7f1ff57b5640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1fd40678c0 0x7f1fd4069d80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1fec001650 tx=0x7f1fec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:13.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.428+0000 7f1fe5ffb640 1 -- 172.21.15.112:0/3397390469 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1fe001c360 con 0x7f1ff01520a0 2024-09-15T23:59:13.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.588+0000 7f1ff7a19640 1 -- 172.21.15.112:0/3397390469 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ff015ec90 con 0x7f1fd40678c0 2024-09-15T23:59:13.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.592+0000 7f1fe5ffb640 1 -- 172.21.15.112:0/3397390469 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252427 (secure 0 0 0) 0x7f1ff015ec90 con 0x7f1fd40678c0 2024-09-15T23:59:13.597 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:13.598 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:59:13.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.596+0000 7f1ff7a19640 1 -- 172.21.15.112:0/3397390469 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1fd40678c0 msgr2=0x7f1fd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.596+0000 7f1ff7a19640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1fd40678c0 0x7f1fd4069d80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1fec001650 tx=0x7f1fec009040 comp rx=0 tx=0).stop 2024-09-15T23:59:13.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.596+0000 7f1ff7a19640 1 -- 172.21.15.112:0/3397390469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff01520a0 msgr2=0x7f1ff00ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.596+0000 7f1ff7a19640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff01520a0 0x7f1ff00ce2b0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000d5d0 tx=0x7f1fe000da90 comp rx=0 tx=0).stop 2024-09-15T23:59:13.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.596+0000 7f1ff7a19640 1 -- 172.21.15.112:0/3397390469 shutdown_connections 2024-09-15T23:59:13.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.596+0000 7f1ff7a19640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1fd40678c0 0x7f1fd4069d80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.596+0000 7f1ff7a19640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ff015f1d0 0x7f1ff00ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.596+0000 7f1ff7a19640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff01520a0 0x7f1ff00ce2b0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.596+0000 7f1ff7a19640 1 --2- 172.21.15.112:0/3397390469 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ff0070020 0x7f1ff014d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.596+0000 7f1ff7a19640 1 -- 172.21.15.112:0/3397390469 >> 172.21.15.112:0/3397390469 conn(0x7f1ff00b1f90 msgr2=0x7f1ff00aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:13.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.596+0000 7f1ff7a19640 1 -- 172.21.15.112:0/3397390469 shutdown_connections 2024-09-15T23:59:13.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.596+0000 7f1ff7a19640 1 -- 172.21.15.112:0/3397390469 wait complete. 2024-09-15T23:59:13.615 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":276,"stamp":"2024-09-15T23:59:13.330752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":328332,"kb_used_data":12228,"kb_used_omap":12,"kb_used_meta":315891,"kb_avail":754646388,"statfs":{"total":773094113280,"available":772757901312,"internally_reserved":0,"allocated":12521472,"data_stored":6394821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":323472944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001784"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916343+0000","last_change":"2024-09-15T23:59:08.910824+0000","last_active":"2024-09-15T23:59:08.916343+0000","last_peered":"2024-09-15T23:59:08.916343+0000","last_clean":"2024-09-15T23:59:08.916343+0000","last_became_active":"2024-09-15T23:59:08.910492+0000","last_became_peered":"2024-09-15T23:59:08.910492+0000","last_unstale":"2024-09-15T23:59:08.916343+0000","last_undegraded":"2024-09-15T23:59:08.916343+0000","last_fullsized":"2024-09-15T23:59:08.916343+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:26.132557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990996+0000","last_change":"2024-09-15T23:59:08.923818+0000","last_active":"2024-09-15T23:59:09.990996+0000","last_peered":"2024-09-15T23:59:09.990996+0000","last_clean":"2024-09-15T23:59:09.990996+0000","last_became_active":"2024-09-15T23:59:08.903210+0000","last_became_peered":"2024-09-15T23:59:08.903210+0000","last_unstale":"2024-09-15T23:59:09.990996+0000","last_undegraded":"2024-09-15T23:59:09.990996+0000","last_fullsized":"2024-09-15T23:59:09.990996+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:10.994341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.907170+0000","last_change":"2024-09-15T23:59:08.905338+0000","last_active":"2024-09-15T23:59:08.907170+0000","last_peered":"2024-09-15T23:59:08.907170+0000","last_clean":"2024-09-15T23:59:08.907170+0000","last_became_active":"2024-09-15T23:59:08.904840+0000","last_became_peered":"2024-09-15T23:59:08.904840+0000","last_unstale":"2024-09-15T23:59:08.907170+0000","last_undegraded":"2024-09-15T23:59:08.907170+0000","last_fullsized":"2024-09-15T23:59:08.907170+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:27.610620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.923113+0000","last_change":"2024-09-15T23:59:08.919911+0000","last_active":"2024-09-15T23:59:08.923113+0000","last_peered":"2024-09-15T23:59:08.923113+0000","last_clean":"2024-09-15T23:59:08.923113+0000","last_became_active":"2024-09-15T23:59:08.919627+0000","last_became_peered":"2024-09-15T23:59:08.919627+0000","last_unstale":"2024-09-15T23:59:08.923113+0000","last_undegraded":"2024-09-15T23:59:08.923113+0000","last_fullsized":"2024-09-15T23:59:08.923113+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:55.470024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918567+0000","last_change":"2024-09-15T23:59:08.912292+0000","last_active":"2024-09-15T23:59:08.918567+0000","last_peered":"2024-09-15T23:59:08.918567+0000","last_clean":"2024-09-15T23:59:08.918567+0000","last_became_active":"2024-09-15T23:59:08.912022+0000","last_became_peered":"2024-09-15T23:59:08.912022+0000","last_unstale":"2024-09-15T23:59:08.918567+0000","last_undegraded":"2024-09-15T23:59:08.918567+0000","last_fullsized":"2024-09-15T23:59:08.918567+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:18.856942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989106+0000","last_change":"2024-09-15T23:59:08.927943+0000","last_active":"2024-09-15T23:59:09.989106+0000","last_peered":"2024-09-15T23:59:09.989106+0000","last_clean":"2024-09-15T23:59:09.989106+0000","last_became_active":"2024-09-15T23:59:08.923823+0000","last_became_peered":"2024-09-15T23:59:08.923823+0000","last_unstale":"2024-09-15T23:59:09.989106+0000","last_undegraded":"2024-09-15T23:59:09.989106+0000","last_fullsized":"2024-09-15T23:59:09.989106+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:46.929197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.988695+0000","last_change":"2024-09-15T23:59:08.903169+0000","last_active":"2024-09-15T23:59:09.988695+0000","last_peered":"2024-09-15T23:59:09.988695+0000","last_clean":"2024-09-15T23:59:09.988695+0000","last_became_active":"2024-09-15T23:59:08.901604+0000","last_became_peered":"2024-09-15T23:59:08.901604+0000","last_unstale":"2024-09-15T23:59:09.988695+0000","last_undegraded":"2024-09-15T23:59:09.988695+0000","last_fullsized":"2024-09-15T23:59:09.988695+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:32.323776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906492+0000","last_change":"2024-09-15T23:59:08.904341+0000","last_active":"2024-09-15T23:59:08.906492+0000","last_peered":"2024-09-15T23:59:08.906492+0000","last_clean":"2024-09-15T23:59:08.906492+0000","last_became_active":"2024-09-15T23:59:08.896726+0000","last_became_peered":"2024-09-15T23:59:08.896726+0000","last_unstale":"2024-09-15T23:59:08.906492+0000","last_undegraded":"2024-09-15T23:59:08.906492+0000","last_fullsized":"2024-09-15T23:59:08.906492+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:23.974413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904722+0000","last_change":"2024-09-15T23:59:08.896463+0000","last_active":"2024-09-15T23:59:08.904722+0000","last_peered":"2024-09-15T23:59:08.904722+0000","last_clean":"2024-09-15T23:59:08.904722+0000","last_became_active":"2024-09-15T23:59:08.895705+0000","last_became_peered":"2024-09-15T23:59:08.895705+0000","last_unstale":"2024-09-15T23:59:08.904722+0000","last_undegraded":"2024-09-15T23:59:08.904722+0000","last_fullsized":"2024-09-15T23:59:08.904722+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:18.856942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990811+0000","last_change":"2024-09-15T23:59:08.929553+0000","last_active":"2024-09-15T23:59:09.990811+0000","last_peered":"2024-09-15T23:59:09.990811+0000","last_clean":"2024-09-15T23:59:09.990811+0000","last_became_active":"2024-09-15T23:59:08.924862+0000","last_became_peered":"2024-09-15T23:59:08.924862+0000","last_unstale":"2024-09-15T23:59:09.990811+0000","last_undegraded":"2024-09-15T23:59:09.990811+0000","last_fullsized":"2024-09-15T23:59:09.990811+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:59.714972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916258+0000","last_change":"2024-09-15T23:59:08.912390+0000","last_active":"2024-09-15T23:59:08.916258+0000","last_peered":"2024-09-15T23:59:08.916258+0000","last_clean":"2024-09-15T23:59:08.916258+0000","last_became_active":"2024-09-15T23:59:08.912057+0000","last_became_peered":"2024-09-15T23:59:08.912057+0000","last_unstale":"2024-09-15T23:59:08.916258+0000","last_undegraded":"2024-09-15T23:59:08.916258+0000","last_fullsized":"2024-09-15T23:59:08.916258+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.847623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906275+0000","last_change":"2024-09-15T23:59:08.900744+0000","last_active":"2024-09-15T23:59:08.906275+0000","last_peered":"2024-09-15T23:59:08.906275+0000","last_clean":"2024-09-15T23:59:08.906275+0000","last_became_active":"2024-09-15T23:59:08.900042+0000","last_became_peered":"2024-09-15T23:59:08.900042+0000","last_unstale":"2024-09-15T23:59:08.906275+0000","last_undegraded":"2024-09-15T23:59:08.906275+0000","last_fullsized":"2024-09-15T23:59:08.906275+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:49.417010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990450+0000","last_change":"2024-09-15T23:59:08.924796+0000","last_active":"2024-09-15T23:59:09.990450+0000","last_peered":"2024-09-15T23:59:09.990450+0000","last_clean":"2024-09-15T23:59:09.990450+0000","last_became_active":"2024-09-15T23:59:08.924347+0000","last_became_peered":"2024-09-15T23:59:08.924347+0000","last_unstale":"2024-09-15T23:59:09.990450+0000","last_undegraded":"2024-09-15T23:59:09.990450+0000","last_fullsized":"2024-09-15T23:59:09.990450+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:29.190130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906644+0000","last_change":"2024-09-15T23:59:08.902975+0000","last_active":"2024-09-15T23:59:08.906644+0000","last_peered":"2024-09-15T23:59:08.906644+0000","last_clean":"2024-09-15T23:59:08.906644+0000","last_became_active":"2024-09-15T23:59:08.902404+0000","last_became_peered":"2024-09-15T23:59:08.902404+0000","last_unstale":"2024-09-15T23:59:08.906644+0000","last_undegraded":"2024-09-15T23:59:08.906644+0000","last_fullsized":"2024-09-15T23:59:08.906644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:35.096541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918240+0000","last_change":"2024-09-15T23:59:08.910158+0000","last_active":"2024-09-15T23:59:08.918240+0000","last_peered":"2024-09-15T23:59:08.918240+0000","last_clean":"2024-09-15T23:59:08.918240+0000","last_became_active":"2024-09-15T23:59:08.909683+0000","last_became_peered":"2024-09-15T23:59:08.909683+0000","last_unstale":"2024-09-15T23:59:08.918240+0000","last_undegraded":"2024-09-15T23:59:08.918240+0000","last_fullsized":"2024-09-15T23:59:08.918240+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:45.378330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906207+0000","last_change":"2024-09-15T23:59:08.898580+0000","last_active":"2024-09-15T23:59:08.906207+0000","last_peered":"2024-09-15T23:59:08.906207+0000","last_clean":"2024-09-15T23:59:08.906207+0000","last_became_active":"2024-09-15T23:59:08.898198+0000","last_became_peered":"2024-09-15T23:59:08.898198+0000","last_unstale":"2024-09-15T23:59:08.906207+0000","last_undegraded":"2024-09-15T23:59:08.906207+0000","last_fullsized":"2024-09-15T23:59:08.906207+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:23.922497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906259+0000","last_change":"2024-09-15T23:59:08.898848+0000","last_active":"2024-09-15T23:59:08.906259+0000","last_peered":"2024-09-15T23:59:08.906259+0000","last_clean":"2024-09-15T23:59:08.906259+0000","last_became_active":"2024-09-15T23:59:08.897597+0000","last_became_peered":"2024-09-15T23:59:08.897597+0000","last_unstale":"2024-09-15T23:59:08.906259+0000","last_undegraded":"2024-09-15T23:59:08.906259+0000","last_fullsized":"2024-09-15T23:59:08.906259+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:21.050253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.897813+0000","last_change":"2024-09-15T23:59:08.885617+0000","last_active":"2024-09-15T23:59:08.897813+0000","last_peered":"2024-09-15T23:59:08.897813+0000","last_clean":"2024-09-15T23:59:08.897813+0000","last_became_active":"2024-09-15T23:59:08.884879+0000","last_became_peered":"2024-09-15T23:59:08.884879+0000","last_unstale":"2024-09-15T23:59:08.897813+0000","last_undegraded":"2024-09-15T23:59:08.897813+0000","last_fullsized":"2024-09-15T23:59:08.897813+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:33.635213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.919272+0000","last_change":"2024-09-15T23:59:08.900479+0000","last_active":"2024-09-15T23:59:08.919272+0000","last_peered":"2024-09-15T23:59:08.919272+0000","last_clean":"2024-09-15T23:59:08.919272+0000","last_became_active":"2024-09-15T23:59:08.899654+0000","last_became_peered":"2024-09-15T23:59:08.899654+0000","last_unstale":"2024-09-15T23:59:08.919272+0000","last_undegraded":"2024-09-15T23:59:08.919272+0000","last_fullsized":"2024-09-15T23:59:08.919272+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:02.210062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990268+0000","last_change":"2024-09-15T23:59:08.910123+0000","last_active":"2024-09-15T23:59:09.990268+0000","last_peered":"2024-09-15T23:59:09.990268+0000","last_clean":"2024-09-15T23:59:09.990268+0000","last_became_active":"2024-09-15T23:59:08.909462+0000","last_became_peered":"2024-09-15T23:59:08.909462+0000","last_unstale":"2024-09-15T23:59:09.990268+0000","last_undegraded":"2024-09-15T23:59:09.990268+0000","last_fullsized":"2024-09-15T23:59:09.990268+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:42.877663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920451+0000","last_change":"2024-09-15T23:59:08.917290+0000","last_active":"2024-09-15T23:59:08.920451+0000","last_peered":"2024-09-15T23:59:08.920451+0000","last_clean":"2024-09-15T23:59:08.920451+0000","last_became_active":"2024-09-15T23:59:08.916943+0000","last_became_peered":"2024-09-15T23:59:08.916943+0000","last_unstale":"2024-09-15T23:59:08.920451+0000","last_undegraded":"2024-09-15T23:59:08.920451+0000","last_fullsized":"2024-09-15T23:59:08.920451+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:23.940640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.905582+0000","last_change":"2024-09-15T23:59:08.903844+0000","last_active":"2024-09-15T23:59:08.905582+0000","last_peered":"2024-09-15T23:59:08.905582+0000","last_clean":"2024-09-15T23:59:08.905582+0000","last_became_active":"2024-09-15T23:59:08.903464+0000","last_became_peered":"2024-09-15T23:59:08.903464+0000","last_unstale":"2024-09-15T23:59:08.905582+0000","last_undegraded":"2024-09-15T23:59:08.905582+0000","last_fullsized":"2024-09-15T23:59:08.905582+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:55.470024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918216+0000","last_change":"2024-09-15T23:59:08.909943+0000","last_active":"2024-09-15T23:59:08.918216+0000","last_peered":"2024-09-15T23:59:08.918216+0000","last_clean":"2024-09-15T23:59:08.918216+0000","last_became_active":"2024-09-15T23:59:08.909343+0000","last_became_peered":"2024-09-15T23:59:08.909343+0000","last_unstale":"2024-09-15T23:59:08.918216+0000","last_undegraded":"2024-09-15T23:59:08.918216+0000","last_fullsized":"2024-09-15T23:59:08.918216+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:01.161528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904756+0000","last_change":"2024-09-15T23:59:08.893198+0000","last_active":"2024-09-15T23:59:08.904756+0000","last_peered":"2024-09-15T23:59:08.904756+0000","last_clean":"2024-09-15T23:59:08.904756+0000","last_became_active":"2024-09-15T23:59:08.892419+0000","last_became_peered":"2024-09-15T23:59:08.892419+0000","last_unstale":"2024-09-15T23:59:08.904756+0000","last_undegraded":"2024-09-15T23:59:08.904756+0000","last_fullsized":"2024-09-15T23:59:08.904756+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:58.451266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916317+0000","last_change":"2024-09-15T23:59:08.910520+0000","last_active":"2024-09-15T23:59:08.916317+0000","last_peered":"2024-09-15T23:59:08.916317+0000","last_clean":"2024-09-15T23:59:08.916317+0000","last_became_active":"2024-09-15T23:59:08.903811+0000","last_became_peered":"2024-09-15T23:59:08.903811+0000","last_unstale":"2024-09-15T23:59:08.916317+0000","last_undegraded":"2024-09-15T23:59:08.916317+0000","last_fullsized":"2024-09-15T23:59:08.916317+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:31.638956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.933927+0000","last_change":"2024-09-15T23:59:08.932649+0000","last_active":"2024-09-15T23:59:08.933927+0000","last_peered":"2024-09-15T23:59:08.933927+0000","last_clean":"2024-09-15T23:59:08.933927+0000","last_became_active":"2024-09-15T23:59:08.932168+0000","last_became_peered":"2024-09-15T23:59:08.932168+0000","last_unstale":"2024-09-15T23:59:08.933927+0000","last_undegraded":"2024-09-15T23:59:08.933927+0000","last_fullsized":"2024-09-15T23:59:08.933927+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:50.616580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.924316+0000","last_change":"2024-09-15T23:59:08.919491+0000","last_active":"2024-09-15T23:59:08.924316+0000","last_peered":"2024-09-15T23:59:08.924316+0000","last_clean":"2024-09-15T23:59:08.924316+0000","last_became_active":"2024-09-15T23:59:08.919162+0000","last_became_peered":"2024-09-15T23:59:08.919162+0000","last_unstale":"2024-09-15T23:59:08.924316+0000","last_undegraded":"2024-09-15T23:59:08.924316+0000","last_fullsized":"2024-09-15T23:59:08.924316+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:58.451266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906248+0000","last_change":"2024-09-15T23:59:08.900424+0000","last_active":"2024-09-15T23:59:08.906248+0000","last_peered":"2024-09-15T23:59:08.906248+0000","last_clean":"2024-09-15T23:59:08.906248+0000","last_became_active":"2024-09-15T23:59:08.899537+0000","last_became_peered":"2024-09-15T23:59:08.899537+0000","last_unstale":"2024-09-15T23:59:08.906248+0000","last_undegraded":"2024-09-15T23:59:08.906248+0000","last_fullsized":"2024-09-15T23:59:08.906248+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:27.163354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918006+0000","last_change":"2024-09-15T23:59:08.912709+0000","last_active":"2024-09-15T23:59:08.918006+0000","last_peered":"2024-09-15T23:59:08.918006+0000","last_clean":"2024-09-15T23:59:08.918006+0000","last_became_active":"2024-09-15T23:59:08.912001+0000","last_became_peered":"2024-09-15T23:59:08.912001+0000","last_unstale":"2024-09-15T23:59:08.918006+0000","last_undegraded":"2024-09-15T23:59:08.918006+0000","last_fullsized":"2024-09-15T23:59:08.918006+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:44.176477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.912057+0000","last_change":"2024-09-15T23:59:08.908502+0000","last_active":"2024-09-15T23:59:08.912057+0000","last_peered":"2024-09-15T23:59:08.912057+0000","last_clean":"2024-09-15T23:59:08.912057+0000","last_became_active":"2024-09-15T23:59:08.907710+0000","last_became_peered":"2024-09-15T23:59:08.907710+0000","last_unstale":"2024-09-15T23:59:08.912057+0000","last_undegraded":"2024-09-15T23:59:08.912057+0000","last_fullsized":"2024-09-15T23:59:08.912057+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:38.007875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916167+0000","last_change":"2024-09-15T23:59:08.903256+0000","last_active":"2024-09-15T23:59:08.916167+0000","last_peered":"2024-09-15T23:59:08.916167+0000","last_clean":"2024-09-15T23:59:08.916167+0000","last_became_active":"2024-09-15T23:59:08.902744+0000","last_became_peered":"2024-09-15T23:59:08.902744+0000","last_unstale":"2024-09-15T23:59:08.916167+0000","last_undegraded":"2024-09-15T23:59:08.916167+0000","last_fullsized":"2024-09-15T23:59:08.916167+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:02.116106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916171+0000","last_change":"2024-09-15T23:59:08.911546+0000","last_active":"2024-09-15T23:59:08.916171+0000","last_peered":"2024-09-15T23:59:08.916171+0000","last_clean":"2024-09-15T23:59:08.916171+0000","last_became_active":"2024-09-15T23:59:08.910654+0000","last_became_peered":"2024-09-15T23:59:08.910654+0000","last_unstale":"2024-09-15T23:59:08.916171+0000","last_undegraded":"2024-09-15T23:59:08.916171+0000","last_fullsized":"2024-09-15T23:59:08.916171+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:49.245433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.900159+0000","last_change":"2024-09-15T23:59:08.896783+0000","last_active":"2024-09-15T23:59:08.900159+0000","last_peered":"2024-09-15T23:59:08.900159+0000","last_clean":"2024-09-15T23:59:08.900159+0000","last_became_active":"2024-09-15T23:59:08.895801+0000","last_became_peered":"2024-09-15T23:59:08.895801+0000","last_unstale":"2024-09-15T23:59:08.900159+0000","last_undegraded":"2024-09-15T23:59:08.900159+0000","last_fullsized":"2024-09-15T23:59:08.900159+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:58:34.531614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"114'4","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.927768+0000","last_change":"2024-09-15T23:59:07.897150+0000","last_active":"2024-09-15T23:59:08.927768+0000","last_peered":"2024-09-15T23:59:08.927768+0000","last_clean":"2024-09-15T23:59:08.927768+0000","last_became_active":"2024-09-15T23:59:07.896874+0000","last_became_peered":"2024-09-15T23:59:07.896874+0000","last_unstale":"2024-09-15T23:59:08.927768+0000","last_undegraded":"2024-09-15T23:59:08.927768+0000","last_fullsized":"2024-09-15T23:59:08.927768+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:33.693308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990601+0000","last_change":"2024-09-15T23:59:08.928146+0000","last_active":"2024-09-15T23:59:09.990601+0000","last_peered":"2024-09-15T23:59:09.990601+0000","last_clean":"2024-09-15T23:59:09.990601+0000","last_became_active":"2024-09-15T23:59:08.901145+0000","last_became_peered":"2024-09-15T23:59:08.901145+0000","last_unstale":"2024-09-15T23:59:09.990601+0000","last_undegraded":"2024-09-15T23:59:09.990601+0000","last_fullsized":"2024-09-15T23:59:09.990601+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:40.169821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1e","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918980+0000","last_change":"2024-09-15T23:59:07.899334+0000","last_active":"2024-09-15T23:59:08.918980+0000","last_peered":"2024-09-15T23:59:08.918980+0000","last_clean":"2024-09-15T23:59:08.918980+0000","last_became_active":"2024-09-15T23:59:07.897881+0000","last_became_peered":"2024-09-15T23:59:07.897881+0000","last_unstale":"2024-09-15T23:59:08.918980+0000","last_undegraded":"2024-09-15T23:59:08.918980+0000","last_fullsized":"2024-09-15T23:59:08.918980+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:14.214987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916898+0000","last_change":"2024-09-15T23:59:08.915142+0000","last_active":"2024-09-15T23:59:08.916898+0000","last_peered":"2024-09-15T23:59:08.916898+0000","last_clean":"2024-09-15T23:59:08.916898+0000","last_became_active":"2024-09-15T23:59:08.914779+0000","last_became_peered":"2024-09-15T23:59:08.914779+0000","last_unstale":"2024-09-15T23:59:08.916898+0000","last_undegraded":"2024-09-15T23:59:08.916898+0000","last_fullsized":"2024-09-15T23:59:08.916898+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:09.562090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.924156+0000","last_change":"2024-09-15T23:59:07.902457+0000","last_active":"2024-09-15T23:59:08.924156+0000","last_peered":"2024-09-15T23:59:08.924156+0000","last_clean":"2024-09-15T23:59:08.924156+0000","last_became_active":"2024-09-15T23:59:07.902170+0000","last_became_peered":"2024-09-15T23:59:07.902170+0000","last_unstale":"2024-09-15T23:59:08.924156+0000","last_undegraded":"2024-09-15T23:59:08.924156+0000","last_fullsized":"2024-09-15T23:59:08.924156+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:25.178922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920812+0000","last_change":"2024-09-15T23:59:08.913433+0000","last_active":"2024-09-15T23:59:08.920812+0000","last_peered":"2024-09-15T23:59:08.920812+0000","last_clean":"2024-09-15T23:59:08.920812+0000","last_became_active":"2024-09-15T23:59:08.913093+0000","last_became_peered":"2024-09-15T23:59:08.913093+0000","last_unstale":"2024-09-15T23:59:08.920812+0000","last_undegraded":"2024-09-15T23:59:08.920812+0000","last_fullsized":"2024-09-15T23:59:08.920812+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:07.152472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990104+0000","last_change":"2024-09-15T23:59:07.915372+0000","last_active":"2024-09-15T23:59:09.990104+0000","last_peered":"2024-09-15T23:59:09.990104+0000","last_clean":"2024-09-15T23:59:09.990104+0000","last_became_active":"2024-09-15T23:59:07.914552+0000","last_became_peered":"2024-09-15T23:59:07.914552+0000","last_unstale":"2024-09-15T23:59:09.990104+0000","last_undegraded":"2024-09-15T23:59:09.990104+0000","last_fullsized":"2024-09-15T23:59:09.990104+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:37.113885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916487+0000","last_change":"2024-09-15T23:59:08.911675+0000","last_active":"2024-09-15T23:59:08.916487+0000","last_peered":"2024-09-15T23:59:08.916487+0000","last_clean":"2024-09-15T23:59:08.916487+0000","last_became_active":"2024-09-15T23:59:08.910468+0000","last_became_peered":"2024-09-15T23:59:08.910468+0000","last_unstale":"2024-09-15T23:59:08.916487+0000","last_undegraded":"2024-09-15T23:59:08.916487+0000","last_fullsized":"2024-09-15T23:59:08.916487+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:31.279980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.922479+0000","last_change":"2024-09-15T23:59:07.901742+0000","last_active":"2024-09-15T23:59:08.922479+0000","last_peered":"2024-09-15T23:59:08.922479+0000","last_clean":"2024-09-15T23:59:08.922479+0000","last_became_active":"2024-09-15T23:59:07.901438+0000","last_became_peered":"2024-09-15T23:59:07.901438+0000","last_unstale":"2024-09-15T23:59:08.922479+0000","last_undegraded":"2024-09-15T23:59:08.922479+0000","last_fullsized":"2024-09-15T23:59:08.922479+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:18.840142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916096+0000","last_change":"2024-09-15T23:59:08.903023+0000","last_active":"2024-09-15T23:59:08.916096+0000","last_peered":"2024-09-15T23:59:08.916096+0000","last_clean":"2024-09-15T23:59:08.916096+0000","last_became_active":"2024-09-15T23:59:08.902108+0000","last_became_peered":"2024-09-15T23:59:08.902108+0000","last_unstale":"2024-09-15T23:59:08.916096+0000","last_undegraded":"2024-09-15T23:59:08.916096+0000","last_fullsized":"2024-09-15T23:59:08.916096+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:39.717345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918702+0000","last_change":"2024-09-15T23:59:07.911259+0000","last_active":"2024-09-15T23:59:08.918702+0000","last_peered":"2024-09-15T23:59:08.918702+0000","last_clean":"2024-09-15T23:59:08.918702+0000","last_became_active":"2024-09-15T23:59:07.910417+0000","last_became_peered":"2024-09-15T23:59:07.910417+0000","last_unstale":"2024-09-15T23:59:08.918702+0000","last_undegraded":"2024-09-15T23:59:08.918702+0000","last_fullsized":"2024-09-15T23:59:08.918702+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:50.138286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.900126+0000","last_change":"2024-09-15T23:59:08.898567+0000","last_active":"2024-09-15T23:59:08.900126+0000","last_peered":"2024-09-15T23:59:08.900126+0000","last_clean":"2024-09-15T23:59:08.900126+0000","last_became_active":"2024-09-15T23:59:08.898219+0000","last_became_peered":"2024-09-15T23:59:08.898219+0000","last_unstale":"2024-09-15T23:59:08.900126+0000","last_undegraded":"2024-09-15T23:59:08.900126+0000","last_fullsized":"2024-09-15T23:59:08.900126+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:01.864690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.896506+0000","last_change":"2024-09-15T23:59:07.891090+0000","last_active":"2024-09-15T23:59:08.896506+0000","last_peered":"2024-09-15T23:59:08.896506+0000","last_clean":"2024-09-15T23:59:08.896506+0000","last_became_active":"2024-09-15T23:59:07.890684+0000","last_became_peered":"2024-09-15T23:59:07.890684+0000","last_unstale":"2024-09-15T23:59:08.896506+0000","last_undegraded":"2024-09-15T23:59:08.896506+0000","last_fullsized":"2024-09-15T23:59:08.896506+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:12.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.897585+0000","last_change":"2024-09-15T23:59:08.894805+0000","last_active":"2024-09-15T23:59:08.897585+0000","last_peered":"2024-09-15T23:59:08.897585+0000","last_clean":"2024-09-15T23:59:08.897585+0000","last_became_active":"2024-09-15T23:59:08.893503+0000","last_became_peered":"2024-09-15T23:59:08.893503+0000","last_unstale":"2024-09-15T23:59:08.897585+0000","last_undegraded":"2024-09-15T23:59:08.897585+0000","last_fullsized":"2024-09-15T23:59:08.897585+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:12.946708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.889159+0000","last_change":"2024-09-15T23:59:07.904298+0000","last_active":"2024-09-15T23:59:08.889159+0000","last_peered":"2024-09-15T23:59:08.889159+0000","last_clean":"2024-09-15T23:59:08.889159+0000","last_became_active":"2024-09-15T23:59:07.903534+0000","last_became_peered":"2024-09-15T23:59:07.903534+0000","last_unstale":"2024-09-15T23:59:08.889159+0000","last_undegraded":"2024-09-15T23:59:08.889159+0000","last_fullsized":"2024-09-15T23:59:08.889159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:55.141179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.923960+0000","last_change":"2024-09-15T23:59:08.918009+0000","last_active":"2024-09-15T23:59:08.923960+0000","last_peered":"2024-09-15T23:59:08.923960+0000","last_clean":"2024-09-15T23:59:08.923960+0000","last_became_active":"2024-09-15T23:59:08.917739+0000","last_became_peered":"2024-09-15T23:59:08.917739+0000","last_unstale":"2024-09-15T23:59:08.923960+0000","last_undegraded":"2024-09-15T23:59:08.923960+0000","last_fullsized":"2024-09-15T23:59:08.923960+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:15.224990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.875559+0000","last_change":"2024-09-15T23:59:07.904677+0000","last_active":"2024-09-15T23:59:08.875559+0000","last_peered":"2024-09-15T23:59:08.875559+0000","last_clean":"2024-09-15T23:59:08.875559+0000","last_became_active":"2024-09-15T23:59:07.904276+0000","last_became_peered":"2024-09-15T23:59:07.904276+0000","last_unstale":"2024-09-15T23:59:08.875559+0000","last_undegraded":"2024-09-15T23:59:08.875559+0000","last_fullsized":"2024-09-15T23:59:08.875559+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:55.211122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920845+0000","last_change":"2024-09-15T23:59:08.913519+0000","last_active":"2024-09-15T23:59:08.920845+0000","last_peered":"2024-09-15T23:59:08.920845+0000","last_clean":"2024-09-15T23:59:08.920845+0000","last_became_active":"2024-09-15T23:59:08.913190+0000","last_became_peered":"2024-09-15T23:59:08.913190+0000","last_unstale":"2024-09-15T23:59:08.920845+0000","last_undegraded":"2024-09-15T23:59:08.920845+0000","last_fullsized":"2024-09-15T23:59:08.920845+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:58.451266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.874397+0000","last_change":"2024-09-15T23:59:07.892077+0000","last_active":"2024-09-15T23:59:08.874397+0000","last_peered":"2024-09-15T23:59:08.874397+0000","last_clean":"2024-09-15T23:59:08.874397+0000","last_became_active":"2024-09-15T23:59:07.891329+0000","last_became_peered":"2024-09-15T23:59:07.891329+0000","last_unstale":"2024-09-15T23:59:08.874397+0000","last_undegraded":"2024-09-15T23:59:08.874397+0000","last_fullsized":"2024-09-15T23:59:08.874397+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:33.693308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916402+0000","last_change":"2024-09-15T23:59:08.910417+0000","last_active":"2024-09-15T23:59:08.916402+0000","last_peered":"2024-09-15T23:59:08.916402+0000","last_clean":"2024-09-15T23:59:08.916402+0000","last_became_active":"2024-09-15T23:59:08.907523+0000","last_became_peered":"2024-09-15T23:59:08.907523+0000","last_unstale":"2024-09-15T23:59:08.916402+0000","last_undegraded":"2024-09-15T23:59:08.916402+0000","last_fullsized":"2024-09-15T23:59:08.916402+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:30.138860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"114'3","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.925138+0000","last_change":"2024-09-15T23:59:07.898178+0000","last_active":"2024-09-15T23:59:08.925138+0000","last_peered":"2024-09-15T23:59:08.925138+0000","last_clean":"2024-09-15T23:59:08.925138+0000","last_became_active":"2024-09-15T23:59:07.897591+0000","last_became_peered":"2024-09-15T23:59:07.897591+0000","last_unstale":"2024-09-15T23:59:08.925138+0000","last_undegraded":"2024-09-15T23:59:08.925138+0000","last_fullsized":"2024-09-15T23:59:08.925138+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:42.591070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920347+0000","last_change":"2024-09-15T23:59:08.917685+0000","last_active":"2024-09-15T23:59:08.920347+0000","last_peered":"2024-09-15T23:59:08.920347+0000","last_clean":"2024-09-15T23:59:08.920347+0000","last_became_active":"2024-09-15T23:59:08.917472+0000","last_became_peered":"2024-09-15T23:59:08.917472+0000","last_unstale":"2024-09-15T23:59:08.920347+0000","last_undegraded":"2024-09-15T23:59:08.920347+0000","last_fullsized":"2024-09-15T23:59:08.920347+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:07.152472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"114'6","reported_seq":20,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990459+0000","last_change":"2024-09-15T23:59:07.902665+0000","last_active":"2024-09-15T23:59:09.990459+0000","last_peered":"2024-09-15T23:59:09.990459+0000","last_clean":"2024-09-15T23:59:09.990459+0000","last_became_active":"2024-09-15T23:59:07.901953+0000","last_became_peered":"2024-09-15T23:59:07.901953+0000","last_unstale":"2024-09-15T23:59:09.990459+0000","last_undegraded":"2024-09-15T23:59:09.990459+0000","last_fullsized":"2024-09-15T23:59:09.990459+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:15.022749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918442+0000","last_change":"2024-09-15T23:59:08.911790+0000","last_active":"2024-09-15T23:59:08.918442+0000","last_peered":"2024-09-15T23:59:08.918442+0000","last_clean":"2024-09-15T23:59:08.918442+0000","last_became_active":"2024-09-15T23:59:08.911525+0000","last_became_peered":"2024-09-15T23:59:08.911525+0000","last_unstale":"2024-09-15T23:59:08.918442+0000","last_undegraded":"2024-09-15T23:59:08.918442+0000","last_fullsized":"2024-09-15T23:59:08.918442+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:56.221125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.922686+0000","last_change":"2024-09-15T23:59:07.901494+0000","last_active":"2024-09-15T23:59:08.922686+0000","last_peered":"2024-09-15T23:59:08.922686+0000","last_clean":"2024-09-15T23:59:08.922686+0000","last_became_active":"2024-09-15T23:59:07.900634+0000","last_became_peered":"2024-09-15T23:59:07.900634+0000","last_unstale":"2024-09-15T23:59:08.922686+0000","last_undegraded":"2024-09-15T23:59:08.922686+0000","last_fullsized":"2024-09-15T23:59:08.922686+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:45.156139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989326+0000","last_change":"2024-09-15T23:59:08.924769+0000","last_active":"2024-09-15T23:59:09.989326+0000","last_peered":"2024-09-15T23:59:09.989326+0000","last_clean":"2024-09-15T23:59:09.989326+0000","last_became_active":"2024-09-15T23:59:08.923876+0000","last_became_peered":"2024-09-15T23:59:08.923876+0000","last_unstale":"2024-09-15T23:59:09.989326+0000","last_undegraded":"2024-09-15T23:59:09.989326+0000","last_fullsized":"2024-09-15T23:59:09.989326+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:47.207350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.890590+0000","last_change":"2024-09-15T23:59:07.900377+0000","last_active":"2024-09-15T23:59:08.890590+0000","last_peered":"2024-09-15T23:59:08.890590+0000","last_clean":"2024-09-15T23:59:08.890590+0000","last_became_active":"2024-09-15T23:59:07.899640+0000","last_became_peered":"2024-09-15T23:59:07.899640+0000","last_unstale":"2024-09-15T23:59:08.890590+0000","last_undegraded":"2024-09-15T23:59:08.890590+0000","last_fullsized":"2024-09-15T23:59:08.890590+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:38.375055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904437+0000","last_change":"2024-09-15T23:59:08.893917+0000","last_active":"2024-09-15T23:59:08.904437+0000","last_peered":"2024-09-15T23:59:08.904437+0000","last_clean":"2024-09-15T23:59:08.904437+0000","last_became_active":"2024-09-15T23:59:08.893372+0000","last_became_peered":"2024-09-15T23:59:08.893372+0000","last_unstale":"2024-09-15T23:59:08.904437+0000","last_undegraded":"2024-09-15T23:59:08.904437+0000","last_fullsized":"2024-09-15T23:59:08.904437+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:28.439286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.874321+0000","last_change":"2024-09-15T23:59:07.899745+0000","last_active":"2024-09-15T23:59:08.874321+0000","last_peered":"2024-09-15T23:59:08.874321+0000","last_clean":"2024-09-15T23:59:08.874321+0000","last_became_active":"2024-09-15T23:59:07.898602+0000","last_became_peered":"2024-09-15T23:59:07.898602+0000","last_unstale":"2024-09-15T23:59:08.874321+0000","last_undegraded":"2024-09-15T23:59:08.874321+0000","last_fullsized":"2024-09-15T23:59:08.874321+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:39.506591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918213+0000","last_change":"2024-09-15T23:59:08.905590+0000","last_active":"2024-09-15T23:59:08.918213+0000","last_peered":"2024-09-15T23:59:08.918213+0000","last_clean":"2024-09-15T23:59:08.918213+0000","last_became_active":"2024-09-15T23:59:08.904800+0000","last_became_peered":"2024-09-15T23:59:08.904800+0000","last_unstale":"2024-09-15T23:59:08.918213+0000","last_undegraded":"2024-09-15T23:59:08.918213+0000","last_fullsized":"2024-09-15T23:59:08.918213+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:23.940640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.919186+0000","last_change":"2024-09-15T23:59:07.898098+0000","last_active":"2024-09-15T23:59:08.919186+0000","last_peered":"2024-09-15T23:59:08.919186+0000","last_clean":"2024-09-15T23:59:08.919186+0000","last_became_active":"2024-09-15T23:59:07.897362+0000","last_became_peered":"2024-09-15T23:59:07.897362+0000","last_unstale":"2024-09-15T23:59:08.919186+0000","last_undegraded":"2024-09-15T23:59:08.919186+0000","last_fullsized":"2024-09-15T23:59:08.919186+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:50.535811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.932551+0000","last_change":"2024-09-15T23:59:08.932023+0000","last_active":"2024-09-15T23:59:08.932551+0000","last_peered":"2024-09-15T23:59:08.932551+0000","last_clean":"2024-09-15T23:59:08.932551+0000","last_became_active":"2024-09-15T23:59:08.931681+0000","last_became_peered":"2024-09-15T23:59:08.931681+0000","last_unstale":"2024-09-15T23:59:08.932551+0000","last_undegraded":"2024-09-15T23:59:08.932551+0000","last_fullsized":"2024-09-15T23:59:08.932551+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:45.141866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.936023+0000","last_change":"2024-09-15T23:59:07.908611+0000","last_active":"2024-09-15T23:59:08.936023+0000","last_peered":"2024-09-15T23:59:08.936023+0000","last_clean":"2024-09-15T23:59:08.936023+0000","last_became_active":"2024-09-15T23:59:07.906983+0000","last_became_peered":"2024-09-15T23:59:07.906983+0000","last_unstale":"2024-09-15T23:59:08.936023+0000","last_undegraded":"2024-09-15T23:59:08.936023+0000","last_fullsized":"2024-09-15T23:59:08.936023+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:30.303746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990787+0000","last_change":"2024-09-15T23:59:08.928009+0000","last_active":"2024-09-15T23:59:09.990787+0000","last_peered":"2024-09-15T23:59:09.990787+0000","last_clean":"2024-09-15T23:59:09.990787+0000","last_became_active":"2024-09-15T23:59:08.910386+0000","last_became_peered":"2024-09-15T23:59:08.910386+0000","last_unstale":"2024-09-15T23:59:09.990787+0000","last_undegraded":"2024-09-15T23:59:09.990787+0000","last_fullsized":"2024-09-15T23:59:09.990787+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:25.078488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.925623+0000","last_change":"2024-09-15T23:59:07.895016+0000","last_active":"2024-09-15T23:59:08.925623+0000","last_peered":"2024-09-15T23:59:08.925623+0000","last_clean":"2024-09-15T23:59:08.925623+0000","last_became_active":"2024-09-15T23:59:07.894480+0000","last_became_peered":"2024-09-15T23:59:07.894480+0000","last_unstale":"2024-09-15T23:59:08.925623+0000","last_undegraded":"2024-09-15T23:59:08.925623+0000","last_fullsized":"2024-09-15T23:59:08.925623+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:35.445956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920325+0000","last_change":"2024-09-15T23:59:08.917111+0000","last_active":"2024-09-15T23:59:08.920325+0000","last_peered":"2024-09-15T23:59:08.920325+0000","last_clean":"2024-09-15T23:59:08.920325+0000","last_became_active":"2024-09-15T23:59:08.915164+0000","last_became_peered":"2024-09-15T23:59:08.915164+0000","last_unstale":"2024-09-15T23:59:08.920325+0000","last_undegraded":"2024-09-15T23:59:08.920325+0000","last_fullsized":"2024-09-15T23:59:08.920325+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:26.188926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.886635+0000","last_change":"2024-09-15T23:59:07.894577+0000","last_active":"2024-09-15T23:59:08.886635+0000","last_peered":"2024-09-15T23:59:08.886635+0000","last_clean":"2024-09-15T23:59:08.886635+0000","last_became_active":"2024-09-15T23:59:07.894225+0000","last_became_peered":"2024-09-15T23:59:07.894225+0000","last_unstale":"2024-09-15T23:59:08.886635+0000","last_undegraded":"2024-09-15T23:59:08.886635+0000","last_fullsized":"2024-09-15T23:59:08.886635+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:57.333706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.988694+0000","last_change":"2024-09-15T23:59:08.928343+0000","last_active":"2024-09-15T23:59:09.988694+0000","last_peered":"2024-09-15T23:59:09.988694+0000","last_clean":"2024-09-15T23:59:09.988694+0000","last_became_active":"2024-09-15T23:59:08.924611+0000","last_became_peered":"2024-09-15T23:59:08.924611+0000","last_unstale":"2024-09-15T23:59:09.988694+0000","last_undegraded":"2024-09-15T23:59:09.988694+0000","last_fullsized":"2024-09-15T23:59:09.988694+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:19.620558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.b","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.921415+0000","last_change":"2024-09-15T23:59:07.888210+0000","last_active":"2024-09-15T23:59:08.921415+0000","last_peered":"2024-09-15T23:59:08.921415+0000","last_clean":"2024-09-15T23:59:08.921415+0000","last_became_active":"2024-09-15T23:59:07.886924+0000","last_became_peered":"2024-09-15T23:59:07.886924+0000","last_unstale":"2024-09-15T23:59:08.921415+0000","last_undegraded":"2024-09-15T23:59:08.921415+0000","last_fullsized":"2024-09-15T23:59:08.921415+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:44.368326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906037+0000","last_change":"2024-09-15T23:59:08.898377+0000","last_active":"2024-09-15T23:59:08.906037+0000","last_peered":"2024-09-15T23:59:08.906037+0000","last_clean":"2024-09-15T23:59:08.906037+0000","last_became_active":"2024-09-15T23:59:08.897554+0000","last_became_peered":"2024-09-15T23:59:08.897554+0000","last_unstale":"2024-09-15T23:59:08.906037+0000","last_undegraded":"2024-09-15T23:59:08.906037+0000","last_fullsized":"2024-09-15T23:59:08.906037+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:32.768826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.886070+0000","last_change":"2024-09-15T23:59:07.895677+0000","last_active":"2024-09-15T23:59:08.886070+0000","last_peered":"2024-09-15T23:59:08.886070+0000","last_clean":"2024-09-15T23:59:08.886070+0000","last_became_active":"2024-09-15T23:59:07.895385+0000","last_became_peered":"2024-09-15T23:59:07.895385+0000","last_unstale":"2024-09-15T23:59:08.886070+0000","last_undegraded":"2024-09-15T23:59:08.886070+0000","last_fullsized":"2024-09-15T23:59:08.886070+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:22.930636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.919182+0000","last_change":"2024-09-15T23:59:08.917054+0000","last_active":"2024-09-15T23:59:08.919182+0000","last_peered":"2024-09-15T23:59:08.919182+0000","last_clean":"2024-09-15T23:59:08.919182+0000","last_became_active":"2024-09-15T23:59:08.912975+0000","last_became_peered":"2024-09-15T23:59:08.912975+0000","last_unstale":"2024-09-15T23:59:08.919182+0000","last_undegraded":"2024-09-15T23:59:08.919182+0000","last_fullsized":"2024-09-15T23:59:08.919182+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:35:33.829330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.889220+0000","last_change":"2024-09-15T23:59:07.904775+0000","last_active":"2024-09-15T23:59:08.889220+0000","last_peered":"2024-09-15T23:59:08.889220+0000","last_clean":"2024-09-15T23:59:08.889220+0000","last_became_active":"2024-09-15T23:59:07.903906+0000","last_became_peered":"2024-09-15T23:59:07.903906+0000","last_unstale":"2024-09-15T23:59:08.889220+0000","last_undegraded":"2024-09-15T23:59:08.889220+0000","last_fullsized":"2024-09-15T23:59:08.889220+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:39.108011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916530+0000","last_change":"2024-09-15T23:59:08.911830+0000","last_active":"2024-09-15T23:59:08.916530+0000","last_peered":"2024-09-15T23:59:08.916530+0000","last_clean":"2024-09-15T23:59:08.916530+0000","last_became_active":"2024-09-15T23:59:08.911561+0000","last_became_peered":"2024-09-15T23:59:08.911561+0000","last_unstale":"2024-09-15T23:59:08.916530+0000","last_undegraded":"2024-09-15T23:59:08.916530+0000","last_fullsized":"2024-09-15T23:59:08.916530+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:38.472909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.899976+0000","last_change":"2024-09-15T23:59:07.888011+0000","last_active":"2024-09-15T23:59:08.899976+0000","last_peered":"2024-09-15T23:59:08.899976+0000","last_clean":"2024-09-15T23:59:08.899976+0000","last_became_active":"2024-09-15T23:59:07.887633+0000","last_became_peered":"2024-09-15T23:59:07.887633+0000","last_unstale":"2024-09-15T23:59:08.899976+0000","last_undegraded":"2024-09-15T23:59:08.899976+0000","last_fullsized":"2024-09-15T23:59:08.899976+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:32.340184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904453+0000","last_change":"2024-09-15T23:59:08.894213+0000","last_active":"2024-09-15T23:59:08.904453+0000","last_peered":"2024-09-15T23:59:08.904453+0000","last_clean":"2024-09-15T23:59:08.904453+0000","last_became_active":"2024-09-15T23:59:08.893860+0000","last_became_peered":"2024-09-15T23:59:08.893860+0000","last_unstale":"2024-09-15T23:59:08.904453+0000","last_undegraded":"2024-09-15T23:59:08.904453+0000","last_fullsized":"2024-09-15T23:59:08.904453+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:04.492508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990838+0000","last_change":"2024-09-15T23:59:07.903649+0000","last_active":"2024-09-15T23:59:09.990838+0000","last_peered":"2024-09-15T23:59:09.990838+0000","last_clean":"2024-09-15T23:59:09.990838+0000","last_became_active":"2024-09-15T23:59:07.902956+0000","last_became_peered":"2024-09-15T23:59:07.902956+0000","last_unstale":"2024-09-15T23:59:09.990838+0000","last_undegraded":"2024-09-15T23:59:09.990838+0000","last_fullsized":"2024-09-15T23:59:09.990838+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:07.466223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904028+0000","last_change":"2024-09-15T23:59:08.902565+0000","last_active":"2024-09-15T23:59:08.904028+0000","last_peered":"2024-09-15T23:59:08.904028+0000","last_clean":"2024-09-15T23:59:08.904028+0000","last_became_active":"2024-09-15T23:59:08.902160+0000","last_became_peered":"2024-09-15T23:59:08.902160+0000","last_unstale":"2024-09-15T23:59:08.904028+0000","last_undegraded":"2024-09-15T23:59:08.904028+0000","last_fullsized":"2024-09-15T23:59:08.904028+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:54.782717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.908782+0000","last_change":"2024-09-15T23:59:07.893449+0000","last_active":"2024-09-15T23:59:08.908782+0000","last_peered":"2024-09-15T23:59:08.908782+0000","last_clean":"2024-09-15T23:59:08.908782+0000","last_became_active":"2024-09-15T23:59:07.893086+0000","last_became_peered":"2024-09-15T23:59:07.893086+0000","last_unstale":"2024-09-15T23:59:08.908782+0000","last_undegraded":"2024-09-15T23:59:08.908782+0000","last_fullsized":"2024-09-15T23:59:08.908782+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:39.302221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.905375+0000","last_change":"2024-09-15T23:59:08.903181+0000","last_active":"2024-09-15T23:59:08.905375+0000","last_peered":"2024-09-15T23:59:08.905375+0000","last_clean":"2024-09-15T23:59:08.905375+0000","last_became_active":"2024-09-15T23:59:08.902453+0000","last_became_peered":"2024-09-15T23:59:08.902453+0000","last_unstale":"2024-09-15T23:59:08.905375+0000","last_undegraded":"2024-09-15T23:59:08.905375+0000","last_fullsized":"2024-09-15T23:59:08.905375+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:26.188926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.908423+0000","last_change":"2024-09-15T23:59:07.913163+0000","last_active":"2024-09-15T23:59:08.908423+0000","last_peered":"2024-09-15T23:59:08.908423+0000","last_clean":"2024-09-15T23:59:08.908423+0000","last_became_active":"2024-09-15T23:59:07.912890+0000","last_became_peered":"2024-09-15T23:59:07.912890+0000","last_unstale":"2024-09-15T23:59:08.908423+0000","last_undegraded":"2024-09-15T23:59:08.908423+0000","last_fullsized":"2024-09-15T23:59:08.908423+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:01.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918090+0000","last_change":"2024-09-15T23:59:08.916865+0000","last_active":"2024-09-15T23:59:08.918090+0000","last_peered":"2024-09-15T23:59:08.918090+0000","last_clean":"2024-09-15T23:59:08.918090+0000","last_became_active":"2024-09-15T23:59:08.916205+0000","last_became_peered":"2024-09-15T23:59:08.916205+0000","last_unstale":"2024-09-15T23:59:08.918090+0000","last_undegraded":"2024-09-15T23:59:08.918090+0000","last_fullsized":"2024-09-15T23:59:08.918090+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:52.891063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.878744+0000","last_change":"2024-09-15T23:59:07.905993+0000","last_active":"2024-09-15T23:59:08.878744+0000","last_peered":"2024-09-15T23:59:08.878744+0000","last_clean":"2024-09-15T23:59:08.878744+0000","last_became_active":"2024-09-15T23:59:07.905239+0000","last_became_peered":"2024-09-15T23:59:07.905239+0000","last_unstale":"2024-09-15T23:59:08.878744+0000","last_undegraded":"2024-09-15T23:59:08.878744+0000","last_fullsized":"2024-09-15T23:59:08.878744+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:06.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.889752+0000","last_change":"2024-09-15T23:59:08.885109+0000","last_active":"2024-09-15T23:59:08.889752+0000","last_peered":"2024-09-15T23:59:08.889752+0000","last_clean":"2024-09-15T23:59:08.889752+0000","last_became_active":"2024-09-15T23:59:08.884262+0000","last_became_peered":"2024-09-15T23:59:08.884262+0000","last_unstale":"2024-09-15T23:59:08.889752+0000","last_undegraded":"2024-09-15T23:59:08.889752+0000","last_fullsized":"2024-09-15T23:59:08.889752+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:16.349140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.908358+0000","last_change":"2024-09-15T23:59:07.901979+0000","last_active":"2024-09-15T23:59:08.908358+0000","last_peered":"2024-09-15T23:59:08.908358+0000","last_clean":"2024-09-15T23:59:08.908358+0000","last_became_active":"2024-09-15T23:59:07.901442+0000","last_became_peered":"2024-09-15T23:59:07.901442+0000","last_unstale":"2024-09-15T23:59:08.908358+0000","last_undegraded":"2024-09-15T23:59:08.908358+0000","last_fullsized":"2024-09-15T23:59:08.908358+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:25.844482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989112+0000","last_change":"2024-09-15T23:59:08.924323+0000","last_active":"2024-09-15T23:59:09.989112+0000","last_peered":"2024-09-15T23:59:09.989112+0000","last_clean":"2024-09-15T23:59:09.989112+0000","last_became_active":"2024-09-15T23:59:08.923812+0000","last_became_peered":"2024-09-15T23:59:08.923812+0000","last_unstale":"2024-09-15T23:59:09.989112+0000","last_undegraded":"2024-09-15T23:59:09.989112+0000","last_fullsized":"2024-09-15T23:59:09.989112+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:04.502167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.886421+0000","last_change":"2024-09-15T23:59:07.903057+0000","last_active":"2024-09-15T23:59:08.886421+0000","last_peered":"2024-09-15T23:59:08.886421+0000","last_clean":"2024-09-15T23:59:08.886421+0000","last_became_active":"2024-09-15T23:59:07.902837+0000","last_became_peered":"2024-09-15T23:59:07.902837+0000","last_unstale":"2024-09-15T23:59:08.886421+0000","last_undegraded":"2024-09-15T23:59:08.886421+0000","last_fullsized":"2024-09-15T23:59:08.886421+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:06.142468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.917076+0000","last_change":"2024-09-15T23:59:08.907407+0000","last_active":"2024-09-15T23:59:08.917076+0000","last_peered":"2024-09-15T23:59:08.917076+0000","last_clean":"2024-09-15T23:59:08.917076+0000","last_became_active":"2024-09-15T23:59:08.901378+0000","last_became_peered":"2024-09-15T23:59:08.901378+0000","last_unstale":"2024-09-15T23:59:08.917076+0000","last_undegraded":"2024-09-15T23:59:08.917076+0000","last_fullsized":"2024-09-15T23:59:08.917076+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:35.937408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989397+0000","last_change":"2024-09-15T23:59:07.915062+0000","last_active":"2024-09-15T23:59:09.989397+0000","last_peered":"2024-09-15T23:59:09.989397+0000","last_clean":"2024-09-15T23:59:09.989397+0000","last_became_active":"2024-09-15T23:59:07.914472+0000","last_became_peered":"2024-09-15T23:59:07.914472+0000","last_unstale":"2024-09-15T23:59:09.989397+0000","last_undegraded":"2024-09-15T23:59:09.989397+0000","last_fullsized":"2024-09-15T23:59:09.989397+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:31.840453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.897525+0000","last_change":"2024-09-15T23:59:08.894211+0000","last_active":"2024-09-15T23:59:08.897525+0000","last_peered":"2024-09-15T23:59:08.897525+0000","last_clean":"2024-09-15T23:59:08.897525+0000","last_became_active":"2024-09-15T23:59:08.892497+0000","last_became_peered":"2024-09-15T23:59:08.892497+0000","last_unstale":"2024-09-15T23:59:08.897525+0000","last_undegraded":"2024-09-15T23:59:08.897525+0000","last_fullsized":"2024-09-15T23:59:08.897525+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:12.973144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.900371+0000","last_change":"2024-09-15T23:59:07.893526+0000","last_active":"2024-09-15T23:59:08.900371+0000","last_peered":"2024-09-15T23:59:08.900371+0000","last_clean":"2024-09-15T23:59:08.900371+0000","last_became_active":"2024-09-15T23:59:07.893154+0000","last_became_peered":"2024-09-15T23:59:07.893154+0000","last_unstale":"2024-09-15T23:59:08.900371+0000","last_undegraded":"2024-09-15T23:59:08.900371+0000","last_fullsized":"2024-09-15T23:59:08.900371+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:20.891939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.917181+0000","last_change":"2024-09-15T23:59:08.907791+0000","last_active":"2024-09-15T23:59:08.917181+0000","last_peered":"2024-09-15T23:59:08.917181+0000","last_clean":"2024-09-15T23:59:08.917181+0000","last_became_active":"2024-09-15T23:59:08.907398+0000","last_became_peered":"2024-09-15T23:59:08.907398+0000","last_unstale":"2024-09-15T23:59:08.917181+0000","last_undegraded":"2024-09-15T23:59:08.917181+0000","last_fullsized":"2024-09-15T23:59:08.917181+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:23.907421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"114'8","reported_seq":20,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.925244+0000","last_change":"2024-09-15T23:59:07.900278+0000","last_active":"2024-09-15T23:59:08.925244+0000","last_peered":"2024-09-15T23:59:08.925244+0000","last_clean":"2024-09-15T23:59:08.925244+0000","last_became_active":"2024-09-15T23:59:07.897567+0000","last_became_peered":"2024-09-15T23:59:07.897567+0000","last_unstale":"2024-09-15T23:59:08.925244+0000","last_undegraded":"2024-09-15T23:59:08.925244+0000","last_fullsized":"2024-09-15T23:59:08.925244+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:45.089067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":338,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.884400+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:59:08.884400+0000","last_peered":"2024-09-15T23:59:08.884400+0000","last_clean":"2024-09-15T23:59:08.884400+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:59:08.884400+0000","last_undegraded":"2024-09-15T23:59:08.884400+0000","last_fullsized":"2024-09-15T23:59:08.884400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509510,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":1400832,"data_stored":645852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40876,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330964,"statfs":{"total":96636764160,"available":96594907136,"internally_reserved":0,"allocated":1400832,"data_stored":645852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40880,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330960,"statfs":{"total":96636764160,"available":96594903040,"internally_reserved":0,"allocated":1400832,"data_stored":645852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40900,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330940,"statfs":{"total":96636764160,"available":96594882560,"internally_reserved":0,"allocated":1417216,"data_stored":653109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509511,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40908,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330932,"statfs":{"total":96636764160,"available":96594874368,"internally_reserved":0,"allocated":1429504,"data_stored":655213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509510,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41484,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330356,"statfs":{"total":96636764160,"available":96594284544,"internally_reserved":0,"allocated":2015232,"data_stored":1243547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40900,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330940,"statfs":{"total":96636764160,"available":96594882560,"internally_reserved":0,"allocated":1425408,"data_stored":653705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41500,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330340,"statfs":{"total":96636764160,"available":96594268160,"internally_reserved":0,"allocated":2031616,"data_stored":1251691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:59:13.619 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:59:13.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.776+0000 7ff88dd7d640 1 Processor -- start 2024-09-15T23:59:13.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.776+0000 7ff88dd7d640 1 -- start start 2024-09-15T23:59:13.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff88dd7d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8881457a0 0x7ff8880d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff88dd7d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8880b4510 0x7ff8880d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff88dd7d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8880d27a0 con 0x7ff8880cf800 2024-09-15T23:59:13.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff88dd7d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff8880d2a80 con 0x7ff8881457a0 2024-09-15T23:59:13.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff88dd7d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff8880d2d60 con 0x7ff8880b4510 2024-09-15T23:59:13.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff8877fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8881457a0 0x7ff8880d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff8877fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff8881457a0 0x7ff8880d1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48400/0 (socket says 172.21.15.112:48400) 2024-09-15T23:59:13.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff8877fe640 1 -- 172.21.15.112:0/2154888563 learned_addr learned my addr 172.21.15.112:0/2154888563 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:13.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff887fff640 1 --2- 172.21.15.112:0/2154888563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8880b4510 0x7ff8880d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff8877fe640 1 -- 172.21.15.112:0/2154888563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8880b4510 msgr2=0x7ff8880d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:13.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff8877fe640 1 --2- 172.21.15.112:0/2154888563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8880b4510 0x7ff8880d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff8877fe640 1 -- 172.21.15.112:0/2154888563 >> v1:172.21.15.112:6789/0 conn(0x7ff8880cf800 legacy=0x7ff8880b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff8877fe640 1 -- 172.21.15.112:0/2154888563 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8880d01f0 con 0x7ff8881457a0 2024-09-15T23:59:13.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff8867fc640 1 -- 172.21.15.112:0/2154888563 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1872967617 0 0) 0x7ff8880d27a0 con 0x7ff8880cf800 2024-09-15T23:59:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff8877fe640 1 --2- 172.21.15.112:0/2154888563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8881457a0 0x7ff8880d1ea0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7ff878009e50 tx=0x7ff87801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74076c4f5693bcbe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff8867fc640 1 -- 172.21.15.112:0/2154888563 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8780a5660 con 0x7ff8881457a0 2024-09-15T23:59:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff8867fc640 1 -- 172.21.15.112:0/2154888563 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8780a5800 con 0x7ff8881457a0 2024-09-15T23:59:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff8867fc640 1 -- 172.21.15.112:0/2154888563 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8780a5bd0 con 0x7ff8881457a0 2024-09-15T23:59:13.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff88dd7d640 1 -- 172.21.15.112:0/2154888563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8881457a0 msgr2=0x7ff8880d1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff88dd7d640 1 --2- 172.21.15.112:0/2154888563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8881457a0 0x7ff8880d1ea0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7ff878009e50 tx=0x7ff87801c9a0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff88dd7d640 1 -- 172.21.15.112:0/2154888563 shutdown_connections 2024-09-15T23:59:13.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff88dd7d640 1 --2- 172.21.15.112:0/2154888563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8880b4510 0x7ff8880d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff88dd7d640 1 --2- 172.21.15.112:0/2154888563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8881457a0 0x7ff8880d1ea0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff88dd7d640 1 -- 172.21.15.112:0/2154888563 >> 172.21.15.112:0/2154888563 conn(0x7ff88806bcc0 msgr2=0x7ff88806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:13.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff88dd7d640 1 -- 172.21.15.112:0/2154888563 shutdown_connections 2024-09-15T23:59:13.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.780+0000 7ff88dd7d640 1 -- 172.21.15.112:0/2154888563 wait complete. 2024-09-15T23:59:13.783 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff88dd7d640 1 Processor -- start 2024-09-15T23:59:13.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff88dd7d640 1 -- start start 2024-09-15T23:59:13.785 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff88dd7d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8880b4510 0x7ff88813fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff88dd7d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8880cf800 0x7ff8880cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff88dd7d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8881457a0 0x7ff888137a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff88dd7d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff8881690b0 con 0x7ff8880b4510 2024-09-15T23:59:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff88dd7d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff8880d1670 con 0x7ff8881457a0 2024-09-15T23:59:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff88dd7d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff888169230 con 0x7ff8880cf800 2024-09-15T23:59:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff8877fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8880b4510 0x7ff88813fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff8877fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8880b4510 0x7ff88813fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48410/0 (socket says 172.21.15.112:48410) 2024-09-15T23:59:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff8877fe640 1 -- 172.21.15.112:0/3593150726 learned_addr learned my addr 172.21.15.112:0/3593150726 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff887fff640 1 --2- 172.21.15.112:0/3593150726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8881457a0 0x7ff888137a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff8877fe640 1 -- 172.21.15.112:0/3593150726 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8880cf800 msgr2=0x7ff8880cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff8877fe640 1 --2- 172.21.15.112:0/3593150726 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8880cf800 0x7ff8880cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.786 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff8877fe640 1 -- 172.21.15.112:0/3593150726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8881457a0 msgr2=0x7ff888137a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff8877fe640 1 --2- 172.21.15.112:0/3593150726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8881457a0 0x7ff888137a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff8877fe640 1 -- 172.21.15.112:0/3593150726 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88806ce70 con 0x7ff8880b4510 2024-09-15T23:59:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff8877fe640 1 --2- 172.21.15.112:0/3593150726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8880b4510 0x7ff88813fa00 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7ff87801a5d0 tx=0x7ff878019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff87ffff640 1 -- 172.21.15.112:0/3593150726 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8780bc020 con 0x7ff8880b4510 2024-09-15T23:59:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff87ffff640 1 -- 172.21.15.112:0/3593150726 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8780b8670 con 0x7ff8880b4510 2024-09-15T23:59:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff88dd7d640 1 -- 172.21.15.112:0/3593150726 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff888138430 con 0x7ff8880b4510 2024-09-15T23:59:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff87ffff640 1 -- 172.21.15.112:0/3593150726 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8780b8a40 con 0x7ff8880b4510 2024-09-15T23:59:13.787 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff88dd7d640 1 -- 172.21.15.112:0/3593150726 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88806d110 con 0x7ff8880b4510 2024-09-15T23:59:13.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff88dd7d640 1 -- 172.21.15.112:0/3593150726 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8880d0710 con 0x7ff8880b4510 2024-09-15T23:59:13.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.784+0000 7ff87ffff640 1 -- 172.21.15.112:0/3593150726 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8780bf020 con 0x7ff8880b4510 2024-09-15T23:59:13.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.788+0000 7ff87ffff640 1 --2- 172.21.15.112:0/3593150726 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff8680678c0 0x7ff868069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:13.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.788+0000 7ff87ffff640 1 -- 172.21.15.112:0/3593150726 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7ff878120dc0 con 0x7ff8880b4510 2024-09-15T23:59:13.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.788+0000 7ff886ffd640 1 --2- 172.21.15.112:0/3593150726 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff8680678c0 0x7ff868069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:13.788 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.788+0000 7ff886ffd640 1 --2- 172.21.15.112:0/3593150726 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff8680678c0 0x7ff868069d80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff870007fd0 tx=0x7ff870007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:13.791 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:13.792+0000 7ff87ffff640 1 -- 172.21.15.112:0/3593150726 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff8780c6030 con 0x7ff8880b4510 2024-09-15T23:59:14.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.012+0000 7ff88dd7d640 1 -- 172.21.15.112:0/3593150726 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff88815ce20 con 0x7ff8880b4510 2024-09-15T23:59:14.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.016+0000 7ff87ffff640 1 -- 172.21.15.112:0/3593150726 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1475 (secure 0 0 0) 0x7ff878016620 con 0x7ff8880b4510 2024-09-15T23:59:14.015 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:14.015 INFO:teuthology.orchestra.run.smithi112.stdout:{"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":347,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":115,"num_osds":8,"num_up_osds":8,"osd_up_since":1726444419,"num_in_osds":8,"osd_in_since":1726444408,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":336211968,"bytes_avail":772757901312,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":72,"btime":"2024-09-15T23:59:11:908708+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":7209}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-15T23:58:23.317557+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:59:14.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.016+0000 7ff88dd7d640 1 -- 172.21.15.112:0/3593150726 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff8680678c0 msgr2=0x7ff868069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:14.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.016+0000 7ff88dd7d640 1 --2- 172.21.15.112:0/3593150726 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff8680678c0 0x7ff868069d80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff870007fd0 tx=0x7ff870007920 comp rx=0 tx=0).stop 2024-09-15T23:59:14.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.016+0000 7ff88dd7d640 1 -- 172.21.15.112:0/3593150726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8880b4510 msgr2=0x7ff88813fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:14.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.016+0000 7ff88dd7d640 1 --2- 172.21.15.112:0/3593150726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8880b4510 0x7ff88813fa00 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7ff87801a5d0 tx=0x7ff878019740 comp rx=0 tx=0).stop 2024-09-15T23:59:14.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.016+0000 7ff88dd7d640 1 -- 172.21.15.112:0/3593150726 shutdown_connections 2024-09-15T23:59:14.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.016+0000 7ff88dd7d640 1 --2- 172.21.15.112:0/3593150726 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff8680678c0 0x7ff868069d80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:14.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.016+0000 7ff88dd7d640 1 --2- 172.21.15.112:0/3593150726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8881457a0 0x7ff888137a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:14.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.016+0000 7ff88dd7d640 1 --2- 172.21.15.112:0/3593150726 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8880cf800 0x7ff8880cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:14.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.016+0000 7ff88dd7d640 1 --2- 172.21.15.112:0/3593150726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8880b4510 0x7ff88813fa00 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:14.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.016+0000 7ff88dd7d640 1 -- 172.21.15.112:0/3593150726 >> 172.21.15.112:0/3593150726 conn(0x7ff88806bcc0 msgr2=0x7ff88813f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:14.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.016+0000 7ff88dd7d640 1 -- 172.21.15.112:0/3593150726 shutdown_connections 2024-09-15T23:59:14.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.016+0000 7ff88dd7d640 1 -- 172.21.15.112:0/3593150726 wait complete. 2024-09-15T23:59:14.033 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:59:14.033 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:59:14.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.152+0000 7fd38ce7d640 1 Processor -- start 2024-09-15T23:59:14.154 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.152+0000 7fd38ce7d640 1 -- start start 2024-09-15T23:59:14.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.156+0000 7fd38ce7d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd38815bec0 0x7fd3880ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:14.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.156+0000 7fd38ce7d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd38815c2a0 0x7fd3880aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:14.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.156+0000 7fd38ce7d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3880b3290 con 0x7fd3880af2a0 2024-09-15T23:59:14.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.156+0000 7fd38ce7d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd3880b3570 con 0x7fd38815c2a0 2024-09-15T23:59:14.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.156+0000 7fd38ce7d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd3880b3850 con 0x7fd38815bec0 2024-09-15T23:59:14.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.156+0000 7fd38659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd38815bec0 0x7fd3880ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:14.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.156+0000 7fd385d9b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd38815c2a0 0x7fd3880aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:14.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.156+0000 7fd38659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd38815bec0 0x7fd3880ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:58638/0 (socket says 172.21.15.112:58638) 2024-09-15T23:59:14.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.156+0000 7fd38659c640 1 -- 172.21.15.112:0/2764926895 learned_addr learned my addr 172.21.15.112:0/2764926895 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:14.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.156+0000 7fd38659c640 1 -- 172.21.15.112:0/2764926895 >> v2:172.21.15.169:3300/0 conn(0x7fd38815c2a0 msgr2=0x7fd3880aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:14.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.156+0000 7fd38659c640 1 --2- 172.21.15.112:0/2764926895 >> v2:172.21.15.169:3300/0 conn(0x7fd38815c2a0 0x7fd3880aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:14.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.156+0000 7fd38659c640 1 -- 172.21.15.112:0/2764926895 >> v1:172.21.15.169:6789/0 conn(0x7fd3880af2a0 legacy=0x7fd38815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:14.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.156+0000 7fd38659c640 1 -- 172.21.15.112:0/2764926895 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3880b3b30 con 0x7fd38815bec0 2024-09-15T23:59:14.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38659c640 1 --2- 172.21.15.112:0/2764926895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd38815bec0 0x7fd3880ad200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd378009870 tx=0x7fd37801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63f6b733a511fe2b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:14.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38559a640 1 -- 172.21.15.112:0/2764926895 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780a95f0 con 0x7fd38815bec0 2024-09-15T23:59:14.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38559a640 1 -- 172.21.15.112:0/2764926895 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3780a9790 con 0x7fd38815bec0 2024-09-15T23:59:14.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38559a640 1 -- 172.21.15.112:0/2764926895 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780a9b60 con 0x7fd38815bec0 2024-09-15T23:59:14.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 -- 172.21.15.112:0/2764926895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd38815bec0 msgr2=0x7fd3880ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:14.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 --2- 172.21.15.112:0/2764926895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd38815bec0 0x7fd3880ad200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd378009870 tx=0x7fd37801c530 comp rx=0 tx=0).stop 2024-09-15T23:59:14.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 -- 172.21.15.112:0/2764926895 shutdown_connections 2024-09-15T23:59:14.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 --2- 172.21.15.112:0/2764926895 >> v2:172.21.15.169:3300/0 conn(0x7fd38815c2a0 0x7fd3880aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:14.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 --2- 172.21.15.112:0/2764926895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd38815bec0 0x7fd3880ad200 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:14.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 -- 172.21.15.112:0/2764926895 >> 172.21.15.112:0/2764926895 conn(0x7fd3880b1f90 msgr2=0x7fd3880b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:14.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 -- 172.21.15.112:0/2764926895 shutdown_connections 2024-09-15T23:59:14.161 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 -- 172.21.15.112:0/2764926895 wait complete. 2024-09-15T23:59:14.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 Processor -- start 2024-09-15T23:59:14.162 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 -- start start 2024-09-15T23:59:14.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3880af2a0 0x7fd3880997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:14.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd38815bec0 0x7fd388145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:14.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd38815c2a0 0x7fd3881459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:14.163 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd3880af6b0 con 0x7fd3880af2a0 2024-09-15T23:59:14.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd3880ad740 con 0x7fd38815c2a0 2024-09-15T23:59:14.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38ce7d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd388169000 con 0x7fd38815bec0 2024-09-15T23:59:14.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3880af2a0 0x7fd3880997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:14.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3880af2a0 0x7fd3880997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48418/0 (socket says 172.21.15.112:48418) 2024-09-15T23:59:14.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38659c640 1 -- 172.21.15.112:0/3883844164 learned_addr learned my addr 172.21.15.112:0/3883844164 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:14.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd385d9b640 1 --2- 172.21.15.112:0/3883844164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd38815bec0 0x7fd388145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:14.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd386d9d640 1 --2- 172.21.15.112:0/3883844164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd38815c2a0 0x7fd3881459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:14.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38659c640 1 -- 172.21.15.112:0/3883844164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd38815bec0 msgr2=0x7fd388145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:14.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38659c640 1 --2- 172.21.15.112:0/3883844164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd38815bec0 0x7fd388145470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:14.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38659c640 1 -- 172.21.15.112:0/3883844164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd38815c2a0 msgr2=0x7fd3881459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:14.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38659c640 1 --2- 172.21.15.112:0/3883844164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd38815c2a0 0x7fd3881459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:14.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.160+0000 7fd38659c640 1 -- 172.21.15.112:0/3883844164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd388150ce0 con 0x7fd3880af2a0 2024-09-15T23:59:14.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.164+0000 7fd38659c640 1 --2- 172.21.15.112:0/3883844164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3880af2a0 0x7fd3880997a0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd37801a160 tx=0x7fd37801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:14.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.164+0000 7fd376ffd640 1 -- 172.21.15.112:0/3883844164 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780b1800 con 0x7fd3880af2a0 2024-09-15T23:59:14.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.164+0000 7fd376ffd640 1 -- 172.21.15.112:0/3883844164 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3780b19a0 con 0x7fd3880af2a0 2024-09-15T23:59:14.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.164+0000 7fd38ce7d640 1 -- 172.21.15.112:0/3883844164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38814dde0 con 0x7fd3880af2a0 2024-09-15T23:59:14.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.164+0000 7fd376ffd640 1 -- 172.21.15.112:0/3883844164 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780b1d90 con 0x7fd3880af2a0 2024-09-15T23:59:14.165 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.164+0000 7fd38ce7d640 1 -- 172.21.15.112:0/3883844164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3881504e0 con 0x7fd3880af2a0 2024-09-15T23:59:14.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.164+0000 7fd38ce7d640 1 -- 172.21.15.112:0/3883844164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3880ad200 con 0x7fd3880af2a0 2024-09-15T23:59:14.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.164+0000 7fd376ffd640 1 -- 172.21.15.112:0/3883844164 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd3780a95b0 con 0x7fd3880af2a0 2024-09-15T23:59:14.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.164+0000 7fd376ffd640 1 --2- 172.21.15.112:0/3883844164 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd3680678c0 0x7fd368069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:14.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.164+0000 7fd376ffd640 1 -- 172.21.15.112:0/3883844164 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7fd378120750 con 0x7fd3880af2a0 2024-09-15T23:59:14.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.164+0000 7fd385d9b640 1 --2- 172.21.15.112:0/3883844164 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd3680678c0 0x7fd368069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:14.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.164+0000 7fd385d9b640 1 --2- 172.21.15.112:0/3883844164 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd3680678c0 0x7fd368069d80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd38815cb90 tx=0x7fd37c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:14.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.168+0000 7fd376ffd640 1 -- 172.21.15.112:0/3883844164 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd3780ad020 con 0x7fd3880af2a0 2024-09-15T23:59:14.260 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:59:14.262 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:59:14.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.316+0000 7fd38ce7d640 1 -- 172.21.15.112:0/3883844164 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd38806fcd0 con 0x7fd3680678c0 2024-09-15T23:59:14.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.324+0000 7fd376ffd640 1 -- 172.21.15.112:0/3883844164 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252427 (secure 0 0 0) 0x7fd38806fcd0 con 0x7fd3680678c0 2024-09-15T23:59:14.326 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:14.329 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:59:14.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.328+0000 7fd38ce7d640 1 -- 172.21.15.112:0/3883844164 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd3680678c0 msgr2=0x7fd368069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:14.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.328+0000 7fd38ce7d640 1 --2- 172.21.15.112:0/3883844164 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd3680678c0 0x7fd368069d80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd38815cb90 tx=0x7fd37c008040 comp rx=0 tx=0).stop 2024-09-15T23:59:14.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.328+0000 7fd38ce7d640 1 -- 172.21.15.112:0/3883844164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3880af2a0 msgr2=0x7fd3880997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:14.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.328+0000 7fd38ce7d640 1 --2- 172.21.15.112:0/3883844164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3880af2a0 0x7fd3880997a0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd37801a160 tx=0x7fd37801ad70 comp rx=0 tx=0).stop 2024-09-15T23:59:14.330 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.328+0000 7fd38ce7d640 1 -- 172.21.15.112:0/3883844164 shutdown_connections 2024-09-15T23:59:14.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.328+0000 7fd38ce7d640 1 --2- 172.21.15.112:0/3883844164 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd3680678c0 0x7fd368069d80 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:14.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.328+0000 7fd38ce7d640 1 --2- 172.21.15.112:0/3883844164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd38815c2a0 0x7fd3881459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:14.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.328+0000 7fd38ce7d640 1 --2- 172.21.15.112:0/3883844164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd38815bec0 0x7fd388145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:14.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.328+0000 7fd38ce7d640 1 --2- 172.21.15.112:0/3883844164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3880af2a0 0x7fd3880997a0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:14.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.328+0000 7fd38ce7d640 1 -- 172.21.15.112:0/3883844164 >> 172.21.15.112:0/3883844164 conn(0x7fd3880b1f90 msgr2=0x7fd3880751c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:14.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.328+0000 7fd38ce7d640 1 -- 172.21.15.112:0/3883844164 shutdown_connections 2024-09-15T23:59:14.331 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:14.328+0000 7fd38ce7d640 1 -- 172.21.15.112:0/3883844164 wait complete. 2024-09-15T23:59:14.344 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":276,"stamp":"2024-09-15T23:59:13.330752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":328332,"kb_used_data":12228,"kb_used_omap":12,"kb_used_meta":315891,"kb_avail":754646388,"statfs":{"total":773094113280,"available":772757901312,"internally_reserved":0,"allocated":12521472,"data_stored":6394821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":323472944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001784"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916343+0000","last_change":"2024-09-15T23:59:08.910824+0000","last_active":"2024-09-15T23:59:08.916343+0000","last_peered":"2024-09-15T23:59:08.916343+0000","last_clean":"2024-09-15T23:59:08.916343+0000","last_became_active":"2024-09-15T23:59:08.910492+0000","last_became_peered":"2024-09-15T23:59:08.910492+0000","last_unstale":"2024-09-15T23:59:08.916343+0000","last_undegraded":"2024-09-15T23:59:08.916343+0000","last_fullsized":"2024-09-15T23:59:08.916343+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:26.132557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990996+0000","last_change":"2024-09-15T23:59:08.923818+0000","last_active":"2024-09-15T23:59:09.990996+0000","last_peered":"2024-09-15T23:59:09.990996+0000","last_clean":"2024-09-15T23:59:09.990996+0000","last_became_active":"2024-09-15T23:59:08.903210+0000","last_became_peered":"2024-09-15T23:59:08.903210+0000","last_unstale":"2024-09-15T23:59:09.990996+0000","last_undegraded":"2024-09-15T23:59:09.990996+0000","last_fullsized":"2024-09-15T23:59:09.990996+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:10.994341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.907170+0000","last_change":"2024-09-15T23:59:08.905338+0000","last_active":"2024-09-15T23:59:08.907170+0000","last_peered":"2024-09-15T23:59:08.907170+0000","last_clean":"2024-09-15T23:59:08.907170+0000","last_became_active":"2024-09-15T23:59:08.904840+0000","last_became_peered":"2024-09-15T23:59:08.904840+0000","last_unstale":"2024-09-15T23:59:08.907170+0000","last_undegraded":"2024-09-15T23:59:08.907170+0000","last_fullsized":"2024-09-15T23:59:08.907170+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:27.610620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.923113+0000","last_change":"2024-09-15T23:59:08.919911+0000","last_active":"2024-09-15T23:59:08.923113+0000","last_peered":"2024-09-15T23:59:08.923113+0000","last_clean":"2024-09-15T23:59:08.923113+0000","last_became_active":"2024-09-15T23:59:08.919627+0000","last_became_peered":"2024-09-15T23:59:08.919627+0000","last_unstale":"2024-09-15T23:59:08.923113+0000","last_undegraded":"2024-09-15T23:59:08.923113+0000","last_fullsized":"2024-09-15T23:59:08.923113+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:55.470024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918567+0000","last_change":"2024-09-15T23:59:08.912292+0000","last_active":"2024-09-15T23:59:08.918567+0000","last_peered":"2024-09-15T23:59:08.918567+0000","last_clean":"2024-09-15T23:59:08.918567+0000","last_became_active":"2024-09-15T23:59:08.912022+0000","last_became_peered":"2024-09-15T23:59:08.912022+0000","last_unstale":"2024-09-15T23:59:08.918567+0000","last_undegraded":"2024-09-15T23:59:08.918567+0000","last_fullsized":"2024-09-15T23:59:08.918567+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:18.856942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989106+0000","last_change":"2024-09-15T23:59:08.927943+0000","last_active":"2024-09-15T23:59:09.989106+0000","last_peered":"2024-09-15T23:59:09.989106+0000","last_clean":"2024-09-15T23:59:09.989106+0000","last_became_active":"2024-09-15T23:59:08.923823+0000","last_became_peered":"2024-09-15T23:59:08.923823+0000","last_unstale":"2024-09-15T23:59:09.989106+0000","last_undegraded":"2024-09-15T23:59:09.989106+0000","last_fullsized":"2024-09-15T23:59:09.989106+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:46.929197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.988695+0000","last_change":"2024-09-15T23:59:08.903169+0000","last_active":"2024-09-15T23:59:09.988695+0000","last_peered":"2024-09-15T23:59:09.988695+0000","last_clean":"2024-09-15T23:59:09.988695+0000","last_became_active":"2024-09-15T23:59:08.901604+0000","last_became_peered":"2024-09-15T23:59:08.901604+0000","last_unstale":"2024-09-15T23:59:09.988695+0000","last_undegraded":"2024-09-15T23:59:09.988695+0000","last_fullsized":"2024-09-15T23:59:09.988695+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:32.323776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906492+0000","last_change":"2024-09-15T23:59:08.904341+0000","last_active":"2024-09-15T23:59:08.906492+0000","last_peered":"2024-09-15T23:59:08.906492+0000","last_clean":"2024-09-15T23:59:08.906492+0000","last_became_active":"2024-09-15T23:59:08.896726+0000","last_became_peered":"2024-09-15T23:59:08.896726+0000","last_unstale":"2024-09-15T23:59:08.906492+0000","last_undegraded":"2024-09-15T23:59:08.906492+0000","last_fullsized":"2024-09-15T23:59:08.906492+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:23.974413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904722+0000","last_change":"2024-09-15T23:59:08.896463+0000","last_active":"2024-09-15T23:59:08.904722+0000","last_peered":"2024-09-15T23:59:08.904722+0000","last_clean":"2024-09-15T23:59:08.904722+0000","last_became_active":"2024-09-15T23:59:08.895705+0000","last_became_peered":"2024-09-15T23:59:08.895705+0000","last_unstale":"2024-09-15T23:59:08.904722+0000","last_undegraded":"2024-09-15T23:59:08.904722+0000","last_fullsized":"2024-09-15T23:59:08.904722+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:18.856942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990811+0000","last_change":"2024-09-15T23:59:08.929553+0000","last_active":"2024-09-15T23:59:09.990811+0000","last_peered":"2024-09-15T23:59:09.990811+0000","last_clean":"2024-09-15T23:59:09.990811+0000","last_became_active":"2024-09-15T23:59:08.924862+0000","last_became_peered":"2024-09-15T23:59:08.924862+0000","last_unstale":"2024-09-15T23:59:09.990811+0000","last_undegraded":"2024-09-15T23:59:09.990811+0000","last_fullsized":"2024-09-15T23:59:09.990811+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:59.714972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916258+0000","last_change":"2024-09-15T23:59:08.912390+0000","last_active":"2024-09-15T23:59:08.916258+0000","last_peered":"2024-09-15T23:59:08.916258+0000","last_clean":"2024-09-15T23:59:08.916258+0000","last_became_active":"2024-09-15T23:59:08.912057+0000","last_became_peered":"2024-09-15T23:59:08.912057+0000","last_unstale":"2024-09-15T23:59:08.916258+0000","last_undegraded":"2024-09-15T23:59:08.916258+0000","last_fullsized":"2024-09-15T23:59:08.916258+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.847623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906275+0000","last_change":"2024-09-15T23:59:08.900744+0000","last_active":"2024-09-15T23:59:08.906275+0000","last_peered":"2024-09-15T23:59:08.906275+0000","last_clean":"2024-09-15T23:59:08.906275+0000","last_became_active":"2024-09-15T23:59:08.900042+0000","last_became_peered":"2024-09-15T23:59:08.900042+0000","last_unstale":"2024-09-15T23:59:08.906275+0000","last_undegraded":"2024-09-15T23:59:08.906275+0000","last_fullsized":"2024-09-15T23:59:08.906275+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:49.417010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990450+0000","last_change":"2024-09-15T23:59:08.924796+0000","last_active":"2024-09-15T23:59:09.990450+0000","last_peered":"2024-09-15T23:59:09.990450+0000","last_clean":"2024-09-15T23:59:09.990450+0000","last_became_active":"2024-09-15T23:59:08.924347+0000","last_became_peered":"2024-09-15T23:59:08.924347+0000","last_unstale":"2024-09-15T23:59:09.990450+0000","last_undegraded":"2024-09-15T23:59:09.990450+0000","last_fullsized":"2024-09-15T23:59:09.990450+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:29.190130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906644+0000","last_change":"2024-09-15T23:59:08.902975+0000","last_active":"2024-09-15T23:59:08.906644+0000","last_peered":"2024-09-15T23:59:08.906644+0000","last_clean":"2024-09-15T23:59:08.906644+0000","last_became_active":"2024-09-15T23:59:08.902404+0000","last_became_peered":"2024-09-15T23:59:08.902404+0000","last_unstale":"2024-09-15T23:59:08.906644+0000","last_undegraded":"2024-09-15T23:59:08.906644+0000","last_fullsized":"2024-09-15T23:59:08.906644+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:35.096541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918240+0000","last_change":"2024-09-15T23:59:08.910158+0000","last_active":"2024-09-15T23:59:08.918240+0000","last_peered":"2024-09-15T23:59:08.918240+0000","last_clean":"2024-09-15T23:59:08.918240+0000","last_became_active":"2024-09-15T23:59:08.909683+0000","last_became_peered":"2024-09-15T23:59:08.909683+0000","last_unstale":"2024-09-15T23:59:08.918240+0000","last_undegraded":"2024-09-15T23:59:08.918240+0000","last_fullsized":"2024-09-15T23:59:08.918240+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:45.378330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906207+0000","last_change":"2024-09-15T23:59:08.898580+0000","last_active":"2024-09-15T23:59:08.906207+0000","last_peered":"2024-09-15T23:59:08.906207+0000","last_clean":"2024-09-15T23:59:08.906207+0000","last_became_active":"2024-09-15T23:59:08.898198+0000","last_became_peered":"2024-09-15T23:59:08.898198+0000","last_unstale":"2024-09-15T23:59:08.906207+0000","last_undegraded":"2024-09-15T23:59:08.906207+0000","last_fullsized":"2024-09-15T23:59:08.906207+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:23.922497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906259+0000","last_change":"2024-09-15T23:59:08.898848+0000","last_active":"2024-09-15T23:59:08.906259+0000","last_peered":"2024-09-15T23:59:08.906259+0000","last_clean":"2024-09-15T23:59:08.906259+0000","last_became_active":"2024-09-15T23:59:08.897597+0000","last_became_peered":"2024-09-15T23:59:08.897597+0000","last_unstale":"2024-09-15T23:59:08.906259+0000","last_undegraded":"2024-09-15T23:59:08.906259+0000","last_fullsized":"2024-09-15T23:59:08.906259+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:21.050253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.897813+0000","last_change":"2024-09-15T23:59:08.885617+0000","last_active":"2024-09-15T23:59:08.897813+0000","last_peered":"2024-09-15T23:59:08.897813+0000","last_clean":"2024-09-15T23:59:08.897813+0000","last_became_active":"2024-09-15T23:59:08.884879+0000","last_became_peered":"2024-09-15T23:59:08.884879+0000","last_unstale":"2024-09-15T23:59:08.897813+0000","last_undegraded":"2024-09-15T23:59:08.897813+0000","last_fullsized":"2024-09-15T23:59:08.897813+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:33.635213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.919272+0000","last_change":"2024-09-15T23:59:08.900479+0000","last_active":"2024-09-15T23:59:08.919272+0000","last_peered":"2024-09-15T23:59:08.919272+0000","last_clean":"2024-09-15T23:59:08.919272+0000","last_became_active":"2024-09-15T23:59:08.899654+0000","last_became_peered":"2024-09-15T23:59:08.899654+0000","last_unstale":"2024-09-15T23:59:08.919272+0000","last_undegraded":"2024-09-15T23:59:08.919272+0000","last_fullsized":"2024-09-15T23:59:08.919272+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:02.210062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990268+0000","last_change":"2024-09-15T23:59:08.910123+0000","last_active":"2024-09-15T23:59:09.990268+0000","last_peered":"2024-09-15T23:59:09.990268+0000","last_clean":"2024-09-15T23:59:09.990268+0000","last_became_active":"2024-09-15T23:59:08.909462+0000","last_became_peered":"2024-09-15T23:59:08.909462+0000","last_unstale":"2024-09-15T23:59:09.990268+0000","last_undegraded":"2024-09-15T23:59:09.990268+0000","last_fullsized":"2024-09-15T23:59:09.990268+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:42.877663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920451+0000","last_change":"2024-09-15T23:59:08.917290+0000","last_active":"2024-09-15T23:59:08.920451+0000","last_peered":"2024-09-15T23:59:08.920451+0000","last_clean":"2024-09-15T23:59:08.920451+0000","last_became_active":"2024-09-15T23:59:08.916943+0000","last_became_peered":"2024-09-15T23:59:08.916943+0000","last_unstale":"2024-09-15T23:59:08.920451+0000","last_undegraded":"2024-09-15T23:59:08.920451+0000","last_fullsized":"2024-09-15T23:59:08.920451+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:23.940640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.905582+0000","last_change":"2024-09-15T23:59:08.903844+0000","last_active":"2024-09-15T23:59:08.905582+0000","last_peered":"2024-09-15T23:59:08.905582+0000","last_clean":"2024-09-15T23:59:08.905582+0000","last_became_active":"2024-09-15T23:59:08.903464+0000","last_became_peered":"2024-09-15T23:59:08.903464+0000","last_unstale":"2024-09-15T23:59:08.905582+0000","last_undegraded":"2024-09-15T23:59:08.905582+0000","last_fullsized":"2024-09-15T23:59:08.905582+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:55.470024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918216+0000","last_change":"2024-09-15T23:59:08.909943+0000","last_active":"2024-09-15T23:59:08.918216+0000","last_peered":"2024-09-15T23:59:08.918216+0000","last_clean":"2024-09-15T23:59:08.918216+0000","last_became_active":"2024-09-15T23:59:08.909343+0000","last_became_peered":"2024-09-15T23:59:08.909343+0000","last_unstale":"2024-09-15T23:59:08.918216+0000","last_undegraded":"2024-09-15T23:59:08.918216+0000","last_fullsized":"2024-09-15T23:59:08.918216+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:01.161528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904756+0000","last_change":"2024-09-15T23:59:08.893198+0000","last_active":"2024-09-15T23:59:08.904756+0000","last_peered":"2024-09-15T23:59:08.904756+0000","last_clean":"2024-09-15T23:59:08.904756+0000","last_became_active":"2024-09-15T23:59:08.892419+0000","last_became_peered":"2024-09-15T23:59:08.892419+0000","last_unstale":"2024-09-15T23:59:08.904756+0000","last_undegraded":"2024-09-15T23:59:08.904756+0000","last_fullsized":"2024-09-15T23:59:08.904756+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:58.451266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916317+0000","last_change":"2024-09-15T23:59:08.910520+0000","last_active":"2024-09-15T23:59:08.916317+0000","last_peered":"2024-09-15T23:59:08.916317+0000","last_clean":"2024-09-15T23:59:08.916317+0000","last_became_active":"2024-09-15T23:59:08.903811+0000","last_became_peered":"2024-09-15T23:59:08.903811+0000","last_unstale":"2024-09-15T23:59:08.916317+0000","last_undegraded":"2024-09-15T23:59:08.916317+0000","last_fullsized":"2024-09-15T23:59:08.916317+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:31.638956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.933927+0000","last_change":"2024-09-15T23:59:08.932649+0000","last_active":"2024-09-15T23:59:08.933927+0000","last_peered":"2024-09-15T23:59:08.933927+0000","last_clean":"2024-09-15T23:59:08.933927+0000","last_became_active":"2024-09-15T23:59:08.932168+0000","last_became_peered":"2024-09-15T23:59:08.932168+0000","last_unstale":"2024-09-15T23:59:08.933927+0000","last_undegraded":"2024-09-15T23:59:08.933927+0000","last_fullsized":"2024-09-15T23:59:08.933927+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:50.616580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.924316+0000","last_change":"2024-09-15T23:59:08.919491+0000","last_active":"2024-09-15T23:59:08.924316+0000","last_peered":"2024-09-15T23:59:08.924316+0000","last_clean":"2024-09-15T23:59:08.924316+0000","last_became_active":"2024-09-15T23:59:08.919162+0000","last_became_peered":"2024-09-15T23:59:08.919162+0000","last_unstale":"2024-09-15T23:59:08.924316+0000","last_undegraded":"2024-09-15T23:59:08.924316+0000","last_fullsized":"2024-09-15T23:59:08.924316+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:58.451266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906248+0000","last_change":"2024-09-15T23:59:08.900424+0000","last_active":"2024-09-15T23:59:08.906248+0000","last_peered":"2024-09-15T23:59:08.906248+0000","last_clean":"2024-09-15T23:59:08.906248+0000","last_became_active":"2024-09-15T23:59:08.899537+0000","last_became_peered":"2024-09-15T23:59:08.899537+0000","last_unstale":"2024-09-15T23:59:08.906248+0000","last_undegraded":"2024-09-15T23:59:08.906248+0000","last_fullsized":"2024-09-15T23:59:08.906248+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:27.163354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918006+0000","last_change":"2024-09-15T23:59:08.912709+0000","last_active":"2024-09-15T23:59:08.918006+0000","last_peered":"2024-09-15T23:59:08.918006+0000","last_clean":"2024-09-15T23:59:08.918006+0000","last_became_active":"2024-09-15T23:59:08.912001+0000","last_became_peered":"2024-09-15T23:59:08.912001+0000","last_unstale":"2024-09-15T23:59:08.918006+0000","last_undegraded":"2024-09-15T23:59:08.918006+0000","last_fullsized":"2024-09-15T23:59:08.918006+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:44.176477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.912057+0000","last_change":"2024-09-15T23:59:08.908502+0000","last_active":"2024-09-15T23:59:08.912057+0000","last_peered":"2024-09-15T23:59:08.912057+0000","last_clean":"2024-09-15T23:59:08.912057+0000","last_became_active":"2024-09-15T23:59:08.907710+0000","last_became_peered":"2024-09-15T23:59:08.907710+0000","last_unstale":"2024-09-15T23:59:08.912057+0000","last_undegraded":"2024-09-15T23:59:08.912057+0000","last_fullsized":"2024-09-15T23:59:08.912057+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:38.007875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916167+0000","last_change":"2024-09-15T23:59:08.903256+0000","last_active":"2024-09-15T23:59:08.916167+0000","last_peered":"2024-09-15T23:59:08.916167+0000","last_clean":"2024-09-15T23:59:08.916167+0000","last_became_active":"2024-09-15T23:59:08.902744+0000","last_became_peered":"2024-09-15T23:59:08.902744+0000","last_unstale":"2024-09-15T23:59:08.916167+0000","last_undegraded":"2024-09-15T23:59:08.916167+0000","last_fullsized":"2024-09-15T23:59:08.916167+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:02.116106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916171+0000","last_change":"2024-09-15T23:59:08.911546+0000","last_active":"2024-09-15T23:59:08.916171+0000","last_peered":"2024-09-15T23:59:08.916171+0000","last_clean":"2024-09-15T23:59:08.916171+0000","last_became_active":"2024-09-15T23:59:08.910654+0000","last_became_peered":"2024-09-15T23:59:08.910654+0000","last_unstale":"2024-09-15T23:59:08.916171+0000","last_undegraded":"2024-09-15T23:59:08.916171+0000","last_fullsized":"2024-09-15T23:59:08.916171+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:21:49.245433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.900159+0000","last_change":"2024-09-15T23:59:08.896783+0000","last_active":"2024-09-15T23:59:08.900159+0000","last_peered":"2024-09-15T23:59:08.900159+0000","last_clean":"2024-09-15T23:59:08.900159+0000","last_became_active":"2024-09-15T23:59:08.895801+0000","last_became_peered":"2024-09-15T23:59:08.895801+0000","last_unstale":"2024-09-15T23:59:08.900159+0000","last_undegraded":"2024-09-15T23:59:08.900159+0000","last_fullsized":"2024-09-15T23:59:08.900159+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:58:34.531614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"114'4","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.927768+0000","last_change":"2024-09-15T23:59:07.897150+0000","last_active":"2024-09-15T23:59:08.927768+0000","last_peered":"2024-09-15T23:59:08.927768+0000","last_clean":"2024-09-15T23:59:08.927768+0000","last_became_active":"2024-09-15T23:59:07.896874+0000","last_became_peered":"2024-09-15T23:59:07.896874+0000","last_unstale":"2024-09-15T23:59:08.927768+0000","last_undegraded":"2024-09-15T23:59:08.927768+0000","last_fullsized":"2024-09-15T23:59:08.927768+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:33.693308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990601+0000","last_change":"2024-09-15T23:59:08.928146+0000","last_active":"2024-09-15T23:59:09.990601+0000","last_peered":"2024-09-15T23:59:09.990601+0000","last_clean":"2024-09-15T23:59:09.990601+0000","last_became_active":"2024-09-15T23:59:08.901145+0000","last_became_peered":"2024-09-15T23:59:08.901145+0000","last_unstale":"2024-09-15T23:59:09.990601+0000","last_undegraded":"2024-09-15T23:59:09.990601+0000","last_fullsized":"2024-09-15T23:59:09.990601+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:40.169821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1e","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918980+0000","last_change":"2024-09-15T23:59:07.899334+0000","last_active":"2024-09-15T23:59:08.918980+0000","last_peered":"2024-09-15T23:59:08.918980+0000","last_clean":"2024-09-15T23:59:08.918980+0000","last_became_active":"2024-09-15T23:59:07.897881+0000","last_became_peered":"2024-09-15T23:59:07.897881+0000","last_unstale":"2024-09-15T23:59:08.918980+0000","last_undegraded":"2024-09-15T23:59:08.918980+0000","last_fullsized":"2024-09-15T23:59:08.918980+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:14.214987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916898+0000","last_change":"2024-09-15T23:59:08.915142+0000","last_active":"2024-09-15T23:59:08.916898+0000","last_peered":"2024-09-15T23:59:08.916898+0000","last_clean":"2024-09-15T23:59:08.916898+0000","last_became_active":"2024-09-15T23:59:08.914779+0000","last_became_peered":"2024-09-15T23:59:08.914779+0000","last_unstale":"2024-09-15T23:59:08.916898+0000","last_undegraded":"2024-09-15T23:59:08.916898+0000","last_fullsized":"2024-09-15T23:59:08.916898+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:09.562090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.924156+0000","last_change":"2024-09-15T23:59:07.902457+0000","last_active":"2024-09-15T23:59:08.924156+0000","last_peered":"2024-09-15T23:59:08.924156+0000","last_clean":"2024-09-15T23:59:08.924156+0000","last_became_active":"2024-09-15T23:59:07.902170+0000","last_became_peered":"2024-09-15T23:59:07.902170+0000","last_unstale":"2024-09-15T23:59:08.924156+0000","last_undegraded":"2024-09-15T23:59:08.924156+0000","last_fullsized":"2024-09-15T23:59:08.924156+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:25.178922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920812+0000","last_change":"2024-09-15T23:59:08.913433+0000","last_active":"2024-09-15T23:59:08.920812+0000","last_peered":"2024-09-15T23:59:08.920812+0000","last_clean":"2024-09-15T23:59:08.920812+0000","last_became_active":"2024-09-15T23:59:08.913093+0000","last_became_peered":"2024-09-15T23:59:08.913093+0000","last_unstale":"2024-09-15T23:59:08.920812+0000","last_undegraded":"2024-09-15T23:59:08.920812+0000","last_fullsized":"2024-09-15T23:59:08.920812+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:07.152472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990104+0000","last_change":"2024-09-15T23:59:07.915372+0000","last_active":"2024-09-15T23:59:09.990104+0000","last_peered":"2024-09-15T23:59:09.990104+0000","last_clean":"2024-09-15T23:59:09.990104+0000","last_became_active":"2024-09-15T23:59:07.914552+0000","last_became_peered":"2024-09-15T23:59:07.914552+0000","last_unstale":"2024-09-15T23:59:09.990104+0000","last_undegraded":"2024-09-15T23:59:09.990104+0000","last_fullsized":"2024-09-15T23:59:09.990104+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:37.113885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916487+0000","last_change":"2024-09-15T23:59:08.911675+0000","last_active":"2024-09-15T23:59:08.916487+0000","last_peered":"2024-09-15T23:59:08.916487+0000","last_clean":"2024-09-15T23:59:08.916487+0000","last_became_active":"2024-09-15T23:59:08.910468+0000","last_became_peered":"2024-09-15T23:59:08.910468+0000","last_unstale":"2024-09-15T23:59:08.916487+0000","last_undegraded":"2024-09-15T23:59:08.916487+0000","last_fullsized":"2024-09-15T23:59:08.916487+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:31.279980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.922479+0000","last_change":"2024-09-15T23:59:07.901742+0000","last_active":"2024-09-15T23:59:08.922479+0000","last_peered":"2024-09-15T23:59:08.922479+0000","last_clean":"2024-09-15T23:59:08.922479+0000","last_became_active":"2024-09-15T23:59:07.901438+0000","last_became_peered":"2024-09-15T23:59:07.901438+0000","last_unstale":"2024-09-15T23:59:08.922479+0000","last_undegraded":"2024-09-15T23:59:08.922479+0000","last_fullsized":"2024-09-15T23:59:08.922479+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:18.840142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916096+0000","last_change":"2024-09-15T23:59:08.903023+0000","last_active":"2024-09-15T23:59:08.916096+0000","last_peered":"2024-09-15T23:59:08.916096+0000","last_clean":"2024-09-15T23:59:08.916096+0000","last_became_active":"2024-09-15T23:59:08.902108+0000","last_became_peered":"2024-09-15T23:59:08.902108+0000","last_unstale":"2024-09-15T23:59:08.916096+0000","last_undegraded":"2024-09-15T23:59:08.916096+0000","last_fullsized":"2024-09-15T23:59:08.916096+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:39.717345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918702+0000","last_change":"2024-09-15T23:59:07.911259+0000","last_active":"2024-09-15T23:59:08.918702+0000","last_peered":"2024-09-15T23:59:08.918702+0000","last_clean":"2024-09-15T23:59:08.918702+0000","last_became_active":"2024-09-15T23:59:07.910417+0000","last_became_peered":"2024-09-15T23:59:07.910417+0000","last_unstale":"2024-09-15T23:59:08.918702+0000","last_undegraded":"2024-09-15T23:59:08.918702+0000","last_fullsized":"2024-09-15T23:59:08.918702+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:50.138286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.900126+0000","last_change":"2024-09-15T23:59:08.898567+0000","last_active":"2024-09-15T23:59:08.900126+0000","last_peered":"2024-09-15T23:59:08.900126+0000","last_clean":"2024-09-15T23:59:08.900126+0000","last_became_active":"2024-09-15T23:59:08.898219+0000","last_became_peered":"2024-09-15T23:59:08.898219+0000","last_unstale":"2024-09-15T23:59:08.900126+0000","last_undegraded":"2024-09-15T23:59:08.900126+0000","last_fullsized":"2024-09-15T23:59:08.900126+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:01.864690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.896506+0000","last_change":"2024-09-15T23:59:07.891090+0000","last_active":"2024-09-15T23:59:08.896506+0000","last_peered":"2024-09-15T23:59:08.896506+0000","last_clean":"2024-09-15T23:59:08.896506+0000","last_became_active":"2024-09-15T23:59:07.890684+0000","last_became_peered":"2024-09-15T23:59:07.890684+0000","last_unstale":"2024-09-15T23:59:08.896506+0000","last_undegraded":"2024-09-15T23:59:08.896506+0000","last_fullsized":"2024-09-15T23:59:08.896506+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:12.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.897585+0000","last_change":"2024-09-15T23:59:08.894805+0000","last_active":"2024-09-15T23:59:08.897585+0000","last_peered":"2024-09-15T23:59:08.897585+0000","last_clean":"2024-09-15T23:59:08.897585+0000","last_became_active":"2024-09-15T23:59:08.893503+0000","last_became_peered":"2024-09-15T23:59:08.893503+0000","last_unstale":"2024-09-15T23:59:08.897585+0000","last_undegraded":"2024-09-15T23:59:08.897585+0000","last_fullsized":"2024-09-15T23:59:08.897585+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:12.946708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.889159+0000","last_change":"2024-09-15T23:59:07.904298+0000","last_active":"2024-09-15T23:59:08.889159+0000","last_peered":"2024-09-15T23:59:08.889159+0000","last_clean":"2024-09-15T23:59:08.889159+0000","last_became_active":"2024-09-15T23:59:07.903534+0000","last_became_peered":"2024-09-15T23:59:07.903534+0000","last_unstale":"2024-09-15T23:59:08.889159+0000","last_undegraded":"2024-09-15T23:59:08.889159+0000","last_fullsized":"2024-09-15T23:59:08.889159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:55.141179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.923960+0000","last_change":"2024-09-15T23:59:08.918009+0000","last_active":"2024-09-15T23:59:08.923960+0000","last_peered":"2024-09-15T23:59:08.923960+0000","last_clean":"2024-09-15T23:59:08.923960+0000","last_became_active":"2024-09-15T23:59:08.917739+0000","last_became_peered":"2024-09-15T23:59:08.917739+0000","last_unstale":"2024-09-15T23:59:08.923960+0000","last_undegraded":"2024-09-15T23:59:08.923960+0000","last_fullsized":"2024-09-15T23:59:08.923960+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:15.224990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.875559+0000","last_change":"2024-09-15T23:59:07.904677+0000","last_active":"2024-09-15T23:59:08.875559+0000","last_peered":"2024-09-15T23:59:08.875559+0000","last_clean":"2024-09-15T23:59:08.875559+0000","last_became_active":"2024-09-15T23:59:07.904276+0000","last_became_peered":"2024-09-15T23:59:07.904276+0000","last_unstale":"2024-09-15T23:59:08.875559+0000","last_undegraded":"2024-09-15T23:59:08.875559+0000","last_fullsized":"2024-09-15T23:59:08.875559+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:55.211122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920845+0000","last_change":"2024-09-15T23:59:08.913519+0000","last_active":"2024-09-15T23:59:08.920845+0000","last_peered":"2024-09-15T23:59:08.920845+0000","last_clean":"2024-09-15T23:59:08.920845+0000","last_became_active":"2024-09-15T23:59:08.913190+0000","last_became_peered":"2024-09-15T23:59:08.913190+0000","last_unstale":"2024-09-15T23:59:08.920845+0000","last_undegraded":"2024-09-15T23:59:08.920845+0000","last_fullsized":"2024-09-15T23:59:08.920845+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:58.451266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.874397+0000","last_change":"2024-09-15T23:59:07.892077+0000","last_active":"2024-09-15T23:59:08.874397+0000","last_peered":"2024-09-15T23:59:08.874397+0000","last_clean":"2024-09-15T23:59:08.874397+0000","last_became_active":"2024-09-15T23:59:07.891329+0000","last_became_peered":"2024-09-15T23:59:07.891329+0000","last_unstale":"2024-09-15T23:59:08.874397+0000","last_undegraded":"2024-09-15T23:59:08.874397+0000","last_fullsized":"2024-09-15T23:59:08.874397+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:33.693308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916402+0000","last_change":"2024-09-15T23:59:08.910417+0000","last_active":"2024-09-15T23:59:08.916402+0000","last_peered":"2024-09-15T23:59:08.916402+0000","last_clean":"2024-09-15T23:59:08.916402+0000","last_became_active":"2024-09-15T23:59:08.907523+0000","last_became_peered":"2024-09-15T23:59:08.907523+0000","last_unstale":"2024-09-15T23:59:08.916402+0000","last_undegraded":"2024-09-15T23:59:08.916402+0000","last_fullsized":"2024-09-15T23:59:08.916402+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:30.138860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"114'3","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.925138+0000","last_change":"2024-09-15T23:59:07.898178+0000","last_active":"2024-09-15T23:59:08.925138+0000","last_peered":"2024-09-15T23:59:08.925138+0000","last_clean":"2024-09-15T23:59:08.925138+0000","last_became_active":"2024-09-15T23:59:07.897591+0000","last_became_peered":"2024-09-15T23:59:07.897591+0000","last_unstale":"2024-09-15T23:59:08.925138+0000","last_undegraded":"2024-09-15T23:59:08.925138+0000","last_fullsized":"2024-09-15T23:59:08.925138+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:42.591070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920347+0000","last_change":"2024-09-15T23:59:08.917685+0000","last_active":"2024-09-15T23:59:08.920347+0000","last_peered":"2024-09-15T23:59:08.920347+0000","last_clean":"2024-09-15T23:59:08.920347+0000","last_became_active":"2024-09-15T23:59:08.917472+0000","last_became_peered":"2024-09-15T23:59:08.917472+0000","last_unstale":"2024-09-15T23:59:08.920347+0000","last_undegraded":"2024-09-15T23:59:08.920347+0000","last_fullsized":"2024-09-15T23:59:08.920347+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:07.152472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"114'6","reported_seq":20,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990459+0000","last_change":"2024-09-15T23:59:07.902665+0000","last_active":"2024-09-15T23:59:09.990459+0000","last_peered":"2024-09-15T23:59:09.990459+0000","last_clean":"2024-09-15T23:59:09.990459+0000","last_became_active":"2024-09-15T23:59:07.901953+0000","last_became_peered":"2024-09-15T23:59:07.901953+0000","last_unstale":"2024-09-15T23:59:09.990459+0000","last_undegraded":"2024-09-15T23:59:09.990459+0000","last_fullsized":"2024-09-15T23:59:09.990459+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:15.022749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918442+0000","last_change":"2024-09-15T23:59:08.911790+0000","last_active":"2024-09-15T23:59:08.918442+0000","last_peered":"2024-09-15T23:59:08.918442+0000","last_clean":"2024-09-15T23:59:08.918442+0000","last_became_active":"2024-09-15T23:59:08.911525+0000","last_became_peered":"2024-09-15T23:59:08.911525+0000","last_unstale":"2024-09-15T23:59:08.918442+0000","last_undegraded":"2024-09-15T23:59:08.918442+0000","last_fullsized":"2024-09-15T23:59:08.918442+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:56.221125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.922686+0000","last_change":"2024-09-15T23:59:07.901494+0000","last_active":"2024-09-15T23:59:08.922686+0000","last_peered":"2024-09-15T23:59:08.922686+0000","last_clean":"2024-09-15T23:59:08.922686+0000","last_became_active":"2024-09-15T23:59:07.900634+0000","last_became_peered":"2024-09-15T23:59:07.900634+0000","last_unstale":"2024-09-15T23:59:08.922686+0000","last_undegraded":"2024-09-15T23:59:08.922686+0000","last_fullsized":"2024-09-15T23:59:08.922686+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:45.156139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989326+0000","last_change":"2024-09-15T23:59:08.924769+0000","last_active":"2024-09-15T23:59:09.989326+0000","last_peered":"2024-09-15T23:59:09.989326+0000","last_clean":"2024-09-15T23:59:09.989326+0000","last_became_active":"2024-09-15T23:59:08.923876+0000","last_became_peered":"2024-09-15T23:59:08.923876+0000","last_unstale":"2024-09-15T23:59:09.989326+0000","last_undegraded":"2024-09-15T23:59:09.989326+0000","last_fullsized":"2024-09-15T23:59:09.989326+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:47.207350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.890590+0000","last_change":"2024-09-15T23:59:07.900377+0000","last_active":"2024-09-15T23:59:08.890590+0000","last_peered":"2024-09-15T23:59:08.890590+0000","last_clean":"2024-09-15T23:59:08.890590+0000","last_became_active":"2024-09-15T23:59:07.899640+0000","last_became_peered":"2024-09-15T23:59:07.899640+0000","last_unstale":"2024-09-15T23:59:08.890590+0000","last_undegraded":"2024-09-15T23:59:08.890590+0000","last_fullsized":"2024-09-15T23:59:08.890590+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:38.375055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904437+0000","last_change":"2024-09-15T23:59:08.893917+0000","last_active":"2024-09-15T23:59:08.904437+0000","last_peered":"2024-09-15T23:59:08.904437+0000","last_clean":"2024-09-15T23:59:08.904437+0000","last_became_active":"2024-09-15T23:59:08.893372+0000","last_became_peered":"2024-09-15T23:59:08.893372+0000","last_unstale":"2024-09-15T23:59:08.904437+0000","last_undegraded":"2024-09-15T23:59:08.904437+0000","last_fullsized":"2024-09-15T23:59:08.904437+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:28.439286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.874321+0000","last_change":"2024-09-15T23:59:07.899745+0000","last_active":"2024-09-15T23:59:08.874321+0000","last_peered":"2024-09-15T23:59:08.874321+0000","last_clean":"2024-09-15T23:59:08.874321+0000","last_became_active":"2024-09-15T23:59:07.898602+0000","last_became_peered":"2024-09-15T23:59:07.898602+0000","last_unstale":"2024-09-15T23:59:08.874321+0000","last_undegraded":"2024-09-15T23:59:08.874321+0000","last_fullsized":"2024-09-15T23:59:08.874321+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:39.506591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918213+0000","last_change":"2024-09-15T23:59:08.905590+0000","last_active":"2024-09-15T23:59:08.918213+0000","last_peered":"2024-09-15T23:59:08.918213+0000","last_clean":"2024-09-15T23:59:08.918213+0000","last_became_active":"2024-09-15T23:59:08.904800+0000","last_became_peered":"2024-09-15T23:59:08.904800+0000","last_unstale":"2024-09-15T23:59:08.918213+0000","last_undegraded":"2024-09-15T23:59:08.918213+0000","last_fullsized":"2024-09-15T23:59:08.918213+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:23.940640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.919186+0000","last_change":"2024-09-15T23:59:07.898098+0000","last_active":"2024-09-15T23:59:08.919186+0000","last_peered":"2024-09-15T23:59:08.919186+0000","last_clean":"2024-09-15T23:59:08.919186+0000","last_became_active":"2024-09-15T23:59:07.897362+0000","last_became_peered":"2024-09-15T23:59:07.897362+0000","last_unstale":"2024-09-15T23:59:08.919186+0000","last_undegraded":"2024-09-15T23:59:08.919186+0000","last_fullsized":"2024-09-15T23:59:08.919186+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:50.535811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.932551+0000","last_change":"2024-09-15T23:59:08.932023+0000","last_active":"2024-09-15T23:59:08.932551+0000","last_peered":"2024-09-15T23:59:08.932551+0000","last_clean":"2024-09-15T23:59:08.932551+0000","last_became_active":"2024-09-15T23:59:08.931681+0000","last_became_peered":"2024-09-15T23:59:08.931681+0000","last_unstale":"2024-09-15T23:59:08.932551+0000","last_undegraded":"2024-09-15T23:59:08.932551+0000","last_fullsized":"2024-09-15T23:59:08.932551+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:45.141866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.936023+0000","last_change":"2024-09-15T23:59:07.908611+0000","last_active":"2024-09-15T23:59:08.936023+0000","last_peered":"2024-09-15T23:59:08.936023+0000","last_clean":"2024-09-15T23:59:08.936023+0000","last_became_active":"2024-09-15T23:59:07.906983+0000","last_became_peered":"2024-09-15T23:59:07.906983+0000","last_unstale":"2024-09-15T23:59:08.936023+0000","last_undegraded":"2024-09-15T23:59:08.936023+0000","last_fullsized":"2024-09-15T23:59:08.936023+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:30.303746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990787+0000","last_change":"2024-09-15T23:59:08.928009+0000","last_active":"2024-09-15T23:59:09.990787+0000","last_peered":"2024-09-15T23:59:09.990787+0000","last_clean":"2024-09-15T23:59:09.990787+0000","last_became_active":"2024-09-15T23:59:08.910386+0000","last_became_peered":"2024-09-15T23:59:08.910386+0000","last_unstale":"2024-09-15T23:59:09.990787+0000","last_undegraded":"2024-09-15T23:59:09.990787+0000","last_fullsized":"2024-09-15T23:59:09.990787+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:25.078488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.925623+0000","last_change":"2024-09-15T23:59:07.895016+0000","last_active":"2024-09-15T23:59:08.925623+0000","last_peered":"2024-09-15T23:59:08.925623+0000","last_clean":"2024-09-15T23:59:08.925623+0000","last_became_active":"2024-09-15T23:59:07.894480+0000","last_became_peered":"2024-09-15T23:59:07.894480+0000","last_unstale":"2024-09-15T23:59:08.925623+0000","last_undegraded":"2024-09-15T23:59:08.925623+0000","last_fullsized":"2024-09-15T23:59:08.925623+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:35.445956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.920325+0000","last_change":"2024-09-15T23:59:08.917111+0000","last_active":"2024-09-15T23:59:08.920325+0000","last_peered":"2024-09-15T23:59:08.920325+0000","last_clean":"2024-09-15T23:59:08.920325+0000","last_became_active":"2024-09-15T23:59:08.915164+0000","last_became_peered":"2024-09-15T23:59:08.915164+0000","last_unstale":"2024-09-15T23:59:08.920325+0000","last_undegraded":"2024-09-15T23:59:08.920325+0000","last_fullsized":"2024-09-15T23:59:08.920325+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:26.188926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.886635+0000","last_change":"2024-09-15T23:59:07.894577+0000","last_active":"2024-09-15T23:59:08.886635+0000","last_peered":"2024-09-15T23:59:08.886635+0000","last_clean":"2024-09-15T23:59:08.886635+0000","last_became_active":"2024-09-15T23:59:07.894225+0000","last_became_peered":"2024-09-15T23:59:07.894225+0000","last_unstale":"2024-09-15T23:59:08.886635+0000","last_undegraded":"2024-09-15T23:59:08.886635+0000","last_fullsized":"2024-09-15T23:59:08.886635+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:57.333706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.988694+0000","last_change":"2024-09-15T23:59:08.928343+0000","last_active":"2024-09-15T23:59:09.988694+0000","last_peered":"2024-09-15T23:59:09.988694+0000","last_clean":"2024-09-15T23:59:09.988694+0000","last_became_active":"2024-09-15T23:59:08.924611+0000","last_became_peered":"2024-09-15T23:59:08.924611+0000","last_unstale":"2024-09-15T23:59:09.988694+0000","last_undegraded":"2024-09-15T23:59:09.988694+0000","last_fullsized":"2024-09-15T23:59:09.988694+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:19.620558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.b","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.921415+0000","last_change":"2024-09-15T23:59:07.888210+0000","last_active":"2024-09-15T23:59:08.921415+0000","last_peered":"2024-09-15T23:59:08.921415+0000","last_clean":"2024-09-15T23:59:08.921415+0000","last_became_active":"2024-09-15T23:59:07.886924+0000","last_became_peered":"2024-09-15T23:59:07.886924+0000","last_unstale":"2024-09-15T23:59:08.921415+0000","last_undegraded":"2024-09-15T23:59:08.921415+0000","last_fullsized":"2024-09-15T23:59:08.921415+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:44.368326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.906037+0000","last_change":"2024-09-15T23:59:08.898377+0000","last_active":"2024-09-15T23:59:08.906037+0000","last_peered":"2024-09-15T23:59:08.906037+0000","last_clean":"2024-09-15T23:59:08.906037+0000","last_became_active":"2024-09-15T23:59:08.897554+0000","last_became_peered":"2024-09-15T23:59:08.897554+0000","last_unstale":"2024-09-15T23:59:08.906037+0000","last_undegraded":"2024-09-15T23:59:08.906037+0000","last_fullsized":"2024-09-15T23:59:08.906037+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:32.768826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.886070+0000","last_change":"2024-09-15T23:59:07.895677+0000","last_active":"2024-09-15T23:59:08.886070+0000","last_peered":"2024-09-15T23:59:08.886070+0000","last_clean":"2024-09-15T23:59:08.886070+0000","last_became_active":"2024-09-15T23:59:07.895385+0000","last_became_peered":"2024-09-15T23:59:07.895385+0000","last_unstale":"2024-09-15T23:59:08.886070+0000","last_undegraded":"2024-09-15T23:59:08.886070+0000","last_fullsized":"2024-09-15T23:59:08.886070+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:22.930636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.919182+0000","last_change":"2024-09-15T23:59:08.917054+0000","last_active":"2024-09-15T23:59:08.919182+0000","last_peered":"2024-09-15T23:59:08.919182+0000","last_clean":"2024-09-15T23:59:08.919182+0000","last_became_active":"2024-09-15T23:59:08.912975+0000","last_became_peered":"2024-09-15T23:59:08.912975+0000","last_unstale":"2024-09-15T23:59:08.919182+0000","last_undegraded":"2024-09-15T23:59:08.919182+0000","last_fullsized":"2024-09-15T23:59:08.919182+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:35:33.829330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.889220+0000","last_change":"2024-09-15T23:59:07.904775+0000","last_active":"2024-09-15T23:59:08.889220+0000","last_peered":"2024-09-15T23:59:08.889220+0000","last_clean":"2024-09-15T23:59:08.889220+0000","last_became_active":"2024-09-15T23:59:07.903906+0000","last_became_peered":"2024-09-15T23:59:07.903906+0000","last_unstale":"2024-09-15T23:59:08.889220+0000","last_undegraded":"2024-09-15T23:59:08.889220+0000","last_fullsized":"2024-09-15T23:59:08.889220+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:39.108011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.916530+0000","last_change":"2024-09-15T23:59:08.911830+0000","last_active":"2024-09-15T23:59:08.916530+0000","last_peered":"2024-09-15T23:59:08.916530+0000","last_clean":"2024-09-15T23:59:08.916530+0000","last_became_active":"2024-09-15T23:59:08.911561+0000","last_became_peered":"2024-09-15T23:59:08.911561+0000","last_unstale":"2024-09-15T23:59:08.916530+0000","last_undegraded":"2024-09-15T23:59:08.916530+0000","last_fullsized":"2024-09-15T23:59:08.916530+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:38.472909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.899976+0000","last_change":"2024-09-15T23:59:07.888011+0000","last_active":"2024-09-15T23:59:08.899976+0000","last_peered":"2024-09-15T23:59:08.899976+0000","last_clean":"2024-09-15T23:59:08.899976+0000","last_became_active":"2024-09-15T23:59:07.887633+0000","last_became_peered":"2024-09-15T23:59:07.887633+0000","last_unstale":"2024-09-15T23:59:08.899976+0000","last_undegraded":"2024-09-15T23:59:08.899976+0000","last_fullsized":"2024-09-15T23:59:08.899976+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:32.340184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904453+0000","last_change":"2024-09-15T23:59:08.894213+0000","last_active":"2024-09-15T23:59:08.904453+0000","last_peered":"2024-09-15T23:59:08.904453+0000","last_clean":"2024-09-15T23:59:08.904453+0000","last_became_active":"2024-09-15T23:59:08.893860+0000","last_became_peered":"2024-09-15T23:59:08.893860+0000","last_unstale":"2024-09-15T23:59:08.904453+0000","last_undegraded":"2024-09-15T23:59:08.904453+0000","last_fullsized":"2024-09-15T23:59:08.904453+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:04.492508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990838+0000","last_change":"2024-09-15T23:59:07.903649+0000","last_active":"2024-09-15T23:59:09.990838+0000","last_peered":"2024-09-15T23:59:09.990838+0000","last_clean":"2024-09-15T23:59:09.990838+0000","last_became_active":"2024-09-15T23:59:07.902956+0000","last_became_peered":"2024-09-15T23:59:07.902956+0000","last_unstale":"2024-09-15T23:59:09.990838+0000","last_undegraded":"2024-09-15T23:59:09.990838+0000","last_fullsized":"2024-09-15T23:59:09.990838+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:07.466223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.904028+0000","last_change":"2024-09-15T23:59:08.902565+0000","last_active":"2024-09-15T23:59:08.904028+0000","last_peered":"2024-09-15T23:59:08.904028+0000","last_clean":"2024-09-15T23:59:08.904028+0000","last_became_active":"2024-09-15T23:59:08.902160+0000","last_became_peered":"2024-09-15T23:59:08.902160+0000","last_unstale":"2024-09-15T23:59:08.904028+0000","last_undegraded":"2024-09-15T23:59:08.904028+0000","last_fullsized":"2024-09-15T23:59:08.904028+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:54.782717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.908782+0000","last_change":"2024-09-15T23:59:07.893449+0000","last_active":"2024-09-15T23:59:08.908782+0000","last_peered":"2024-09-15T23:59:08.908782+0000","last_clean":"2024-09-15T23:59:08.908782+0000","last_became_active":"2024-09-15T23:59:07.893086+0000","last_became_peered":"2024-09-15T23:59:07.893086+0000","last_unstale":"2024-09-15T23:59:08.908782+0000","last_undegraded":"2024-09-15T23:59:08.908782+0000","last_fullsized":"2024-09-15T23:59:08.908782+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:39.302221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.905375+0000","last_change":"2024-09-15T23:59:08.903181+0000","last_active":"2024-09-15T23:59:08.905375+0000","last_peered":"2024-09-15T23:59:08.905375+0000","last_clean":"2024-09-15T23:59:08.905375+0000","last_became_active":"2024-09-15T23:59:08.902453+0000","last_became_peered":"2024-09-15T23:59:08.902453+0000","last_unstale":"2024-09-15T23:59:08.905375+0000","last_undegraded":"2024-09-15T23:59:08.905375+0000","last_fullsized":"2024-09-15T23:59:08.905375+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:26.188926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.908423+0000","last_change":"2024-09-15T23:59:07.913163+0000","last_active":"2024-09-15T23:59:08.908423+0000","last_peered":"2024-09-15T23:59:08.908423+0000","last_clean":"2024-09-15T23:59:08.908423+0000","last_became_active":"2024-09-15T23:59:07.912890+0000","last_became_peered":"2024-09-15T23:59:07.912890+0000","last_unstale":"2024-09-15T23:59:08.908423+0000","last_undegraded":"2024-09-15T23:59:08.908423+0000","last_fullsized":"2024-09-15T23:59:08.908423+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:01.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.918090+0000","last_change":"2024-09-15T23:59:08.916865+0000","last_active":"2024-09-15T23:59:08.918090+0000","last_peered":"2024-09-15T23:59:08.918090+0000","last_clean":"2024-09-15T23:59:08.918090+0000","last_became_active":"2024-09-15T23:59:08.916205+0000","last_became_peered":"2024-09-15T23:59:08.916205+0000","last_unstale":"2024-09-15T23:59:08.918090+0000","last_undegraded":"2024-09-15T23:59:08.918090+0000","last_fullsized":"2024-09-15T23:59:08.918090+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:52.891063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.878744+0000","last_change":"2024-09-15T23:59:07.905993+0000","last_active":"2024-09-15T23:59:08.878744+0000","last_peered":"2024-09-15T23:59:08.878744+0000","last_clean":"2024-09-15T23:59:08.878744+0000","last_became_active":"2024-09-15T23:59:07.905239+0000","last_became_peered":"2024-09-15T23:59:07.905239+0000","last_unstale":"2024-09-15T23:59:08.878744+0000","last_undegraded":"2024-09-15T23:59:08.878744+0000","last_fullsized":"2024-09-15T23:59:08.878744+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:06.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.889752+0000","last_change":"2024-09-15T23:59:08.885109+0000","last_active":"2024-09-15T23:59:08.889752+0000","last_peered":"2024-09-15T23:59:08.889752+0000","last_clean":"2024-09-15T23:59:08.889752+0000","last_became_active":"2024-09-15T23:59:08.884262+0000","last_became_peered":"2024-09-15T23:59:08.884262+0000","last_unstale":"2024-09-15T23:59:08.889752+0000","last_undegraded":"2024-09-15T23:59:08.889752+0000","last_fullsized":"2024-09-15T23:59:08.889752+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:16.349140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.908358+0000","last_change":"2024-09-15T23:59:07.901979+0000","last_active":"2024-09-15T23:59:08.908358+0000","last_peered":"2024-09-15T23:59:08.908358+0000","last_clean":"2024-09-15T23:59:08.908358+0000","last_became_active":"2024-09-15T23:59:07.901442+0000","last_became_peered":"2024-09-15T23:59:07.901442+0000","last_unstale":"2024-09-15T23:59:08.908358+0000","last_undegraded":"2024-09-15T23:59:08.908358+0000","last_fullsized":"2024-09-15T23:59:08.908358+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:25.844482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989112+0000","last_change":"2024-09-15T23:59:08.924323+0000","last_active":"2024-09-15T23:59:09.989112+0000","last_peered":"2024-09-15T23:59:09.989112+0000","last_clean":"2024-09-15T23:59:09.989112+0000","last_became_active":"2024-09-15T23:59:08.923812+0000","last_became_peered":"2024-09-15T23:59:08.923812+0000","last_unstale":"2024-09-15T23:59:09.989112+0000","last_undegraded":"2024-09-15T23:59:09.989112+0000","last_fullsized":"2024-09-15T23:59:09.989112+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:04.502167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.886421+0000","last_change":"2024-09-15T23:59:07.903057+0000","last_active":"2024-09-15T23:59:08.886421+0000","last_peered":"2024-09-15T23:59:08.886421+0000","last_clean":"2024-09-15T23:59:08.886421+0000","last_became_active":"2024-09-15T23:59:07.902837+0000","last_became_peered":"2024-09-15T23:59:07.902837+0000","last_unstale":"2024-09-15T23:59:08.886421+0000","last_undegraded":"2024-09-15T23:59:08.886421+0000","last_fullsized":"2024-09-15T23:59:08.886421+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:06.142468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.917076+0000","last_change":"2024-09-15T23:59:08.907407+0000","last_active":"2024-09-15T23:59:08.917076+0000","last_peered":"2024-09-15T23:59:08.917076+0000","last_clean":"2024-09-15T23:59:08.917076+0000","last_became_active":"2024-09-15T23:59:08.901378+0000","last_became_peered":"2024-09-15T23:59:08.901378+0000","last_unstale":"2024-09-15T23:59:08.917076+0000","last_undegraded":"2024-09-15T23:59:08.917076+0000","last_fullsized":"2024-09-15T23:59:08.917076+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:35.937408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989397+0000","last_change":"2024-09-15T23:59:07.915062+0000","last_active":"2024-09-15T23:59:09.989397+0000","last_peered":"2024-09-15T23:59:09.989397+0000","last_clean":"2024-09-15T23:59:09.989397+0000","last_became_active":"2024-09-15T23:59:07.914472+0000","last_became_peered":"2024-09-15T23:59:07.914472+0000","last_unstale":"2024-09-15T23:59:09.989397+0000","last_undegraded":"2024-09-15T23:59:09.989397+0000","last_fullsized":"2024-09-15T23:59:09.989397+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:31.840453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.897525+0000","last_change":"2024-09-15T23:59:08.894211+0000","last_active":"2024-09-15T23:59:08.897525+0000","last_peered":"2024-09-15T23:59:08.897525+0000","last_clean":"2024-09-15T23:59:08.897525+0000","last_became_active":"2024-09-15T23:59:08.892497+0000","last_became_peered":"2024-09-15T23:59:08.892497+0000","last_unstale":"2024-09-15T23:59:08.897525+0000","last_undegraded":"2024-09-15T23:59:08.897525+0000","last_fullsized":"2024-09-15T23:59:08.897525+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:12.973144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.900371+0000","last_change":"2024-09-15T23:59:07.893526+0000","last_active":"2024-09-15T23:59:08.900371+0000","last_peered":"2024-09-15T23:59:08.900371+0000","last_clean":"2024-09-15T23:59:08.900371+0000","last_became_active":"2024-09-15T23:59:07.893154+0000","last_became_peered":"2024-09-15T23:59:07.893154+0000","last_unstale":"2024-09-15T23:59:08.900371+0000","last_undegraded":"2024-09-15T23:59:08.900371+0000","last_fullsized":"2024-09-15T23:59:08.900371+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:20.891939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.917181+0000","last_change":"2024-09-15T23:59:08.907791+0000","last_active":"2024-09-15T23:59:08.917181+0000","last_peered":"2024-09-15T23:59:08.917181+0000","last_clean":"2024-09-15T23:59:08.917181+0000","last_became_active":"2024-09-15T23:59:08.907398+0000","last_became_peered":"2024-09-15T23:59:08.907398+0000","last_unstale":"2024-09-15T23:59:08.917181+0000","last_undegraded":"2024-09-15T23:59:08.917181+0000","last_fullsized":"2024-09-15T23:59:08.917181+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:23.907421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"114'8","reported_seq":20,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.925244+0000","last_change":"2024-09-15T23:59:07.900278+0000","last_active":"2024-09-15T23:59:08.925244+0000","last_peered":"2024-09-15T23:59:08.925244+0000","last_clean":"2024-09-15T23:59:08.925244+0000","last_became_active":"2024-09-15T23:59:07.897567+0000","last_became_peered":"2024-09-15T23:59:07.897567+0000","last_unstale":"2024-09-15T23:59:08.925244+0000","last_undegraded":"2024-09-15T23:59:08.925244+0000","last_fullsized":"2024-09-15T23:59:08.925244+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:45.089067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":338,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:59:08.884400+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:59:08.884400+0000","last_peered":"2024-09-15T23:59:08.884400+0000","last_clean":"2024-09-15T23:59:08.884400+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:59:08.884400+0000","last_undegraded":"2024-09-15T23:59:08.884400+0000","last_fullsized":"2024-09-15T23:59:08.884400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509510,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40884,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330956,"statfs":{"total":96636764160,"available":96594898944,"internally_reserved":0,"allocated":1400832,"data_stored":645852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40876,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330964,"statfs":{"total":96636764160,"available":96594907136,"internally_reserved":0,"allocated":1400832,"data_stored":645852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40880,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330960,"statfs":{"total":96636764160,"available":96594903040,"internally_reserved":0,"allocated":1400832,"data_stored":645852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40900,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330940,"statfs":{"total":96636764160,"available":96594882560,"internally_reserved":0,"allocated":1417216,"data_stored":653109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509511,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40908,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330932,"statfs":{"total":96636764160,"available":96594874368,"internally_reserved":0,"allocated":1429504,"data_stored":655213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509510,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41484,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330356,"statfs":{"total":96636764160,"available":96594284544,"internally_reserved":0,"allocated":2015232,"data_stored":1243547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40900,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330940,"statfs":{"total":96636764160,"available":96594882560,"internally_reserved":0,"allocated":1425408,"data_stored":653705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41500,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330340,"statfs":{"total":96636764160,"available":96594268160,"internally_reserved":0,"allocated":2031616,"data_stored":1251691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:59:14.850 INFO:tasks.ceph.mds.a.smithi112.stderr:2024-09-15T23:59:14.848+0000 7f1454ed7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:59:17.349 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:59:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.480+0000 7f0f68880640 1 Processor -- start 2024-09-15T23:59:17.482 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.480+0000 7f0f68880640 1 -- start start 2024-09-15T23:59:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f68880640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f6415c2a0 0x7f0f640aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f68880640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f640af2a0 0x7f0f6406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f68880640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f640b3290 con 0x7f0f6415bec0 2024-09-15T23:59:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f68880640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f0f640b3570 con 0x7f0f6415c2a0 2024-09-15T23:59:17.483 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f68880640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0f640b3850 con 0x7f0f640af2a0 2024-09-15T23:59:17.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f61d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f6415c2a0 0x7f0f640aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:17.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f61d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f0f6415c2a0 0x7f0f640aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48426/0 (socket says 172.21.15.112:48426) 2024-09-15T23:59:17.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f61d9b640 1 -- 172.21.15.112:0/1227146768 learned_addr learned my addr 172.21.15.112:0/1227146768 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:17.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f62d9d640 1 --2- 172.21.15.112:0/1227146768 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f640af2a0 0x7f0f6406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:17.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f61d9b640 1 -- 172.21.15.112:0/1227146768 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f640af2a0 msgr2=0x7f0f6406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:17.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f61d9b640 1 --2- 172.21.15.112:0/1227146768 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f640af2a0 0x7f0f6406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f61d9b640 1 -- 172.21.15.112:0/1227146768 >> v1:172.21.15.169:6789/0 conn(0x7f0f6415bec0 legacy=0x7f0f640ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:17.485 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f61d9b640 1 -- 172.21.15.112:0/1227146768 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f640b3b30 con 0x7f0f6415c2a0 2024-09-15T23:59:17.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f61d9b640 1 --2- 172.21.15.112:0/1227146768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f6415c2a0 0x7f0f640aed60 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009870 tx=0x7f0f5401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88396674c007928 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:17.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f6159a640 1 -- 172.21.15.112:0/1227146768 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f540aa610 con 0x7f0f6415c2a0 2024-09-15T23:59:17.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f6159a640 1 -- 172.21.15.112:0/1227146768 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f540af070 con 0x7f0f6415c2a0 2024-09-15T23:59:17.486 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.484+0000 7f0f6159a640 1 -- 172.21.15.112:0/1227146768 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f540aa9d0 con 0x7f0f6415c2a0 2024-09-15T23:59:17.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 -- 172.21.15.112:0/1227146768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f6415c2a0 msgr2=0x7f0f640aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:17.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 --2- 172.21.15.112:0/1227146768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f6415c2a0 0x7f0f640aed60 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009870 tx=0x7f0f5401c4f0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 -- 172.21.15.112:0/1227146768 shutdown_connections 2024-09-15T23:59:17.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 --2- 172.21.15.112:0/1227146768 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f640af2a0 0x7f0f6406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 --2- 172.21.15.112:0/1227146768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f6415c2a0 0x7f0f640aed60 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 -- 172.21.15.112:0/1227146768 >> 172.21.15.112:0/1227146768 conn(0x7f0f640b1f90 msgr2=0x7f0f640b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:17.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 -- 172.21.15.112:0/1227146768 shutdown_connections 2024-09-15T23:59:17.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 -- 172.21.15.112:0/1227146768 wait complete. 2024-09-15T23:59:17.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 Processor -- start 2024-09-15T23:59:17.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 -- start start 2024-09-15T23:59:17.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f640af2a0 0x7f0f6414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:17.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f6415bec0 0x7f0f64151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:17.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f6415c2a0 0x7f0f6415a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:17.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6406ed50 con 0x7f0f640af2a0 2024-09-15T23:59:17.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f640af6b0 con 0x7f0f6415c2a0 2024-09-15T23:59:17.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6406eed0 con 0x7f0f6415bec0 2024-09-15T23:59:17.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f6259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f640af2a0 0x7f0f6414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:17.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f6259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f640af2a0 0x7f0f6414b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48434/0 (socket says 172.21.15.112:48434) 2024-09-15T23:59:17.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f6259c640 1 -- 172.21.15.112:0/986082553 learned_addr learned my addr 172.21.15.112:0/986082553 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:17.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f61d9b640 1 --2- 172.21.15.112:0/986082553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f6415bec0 0x7f0f64151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:17.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f62d9d640 1 --2- 172.21.15.112:0/986082553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f6415c2a0 0x7f0f6415a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:17.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f6259c640 1 -- 172.21.15.112:0/986082553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f6415bec0 msgr2=0x7f0f64151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:17.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f6259c640 1 --2- 172.21.15.112:0/986082553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f6415bec0 0x7f0f64151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f6259c640 1 -- 172.21.15.112:0/986082553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f6415c2a0 msgr2=0x7f0f6415a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:17.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f6259c640 1 --2- 172.21.15.112:0/986082553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f6415c2a0 0x7f0f6415a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f6259c640 1 -- 172.21.15.112:0/986082553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f641508a0 con 0x7f0f640af2a0 2024-09-15T23:59:17.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f6259c640 1 --2- 172.21.15.112:0/986082553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f640af2a0 0x7f0f6414b140 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800c450 tx=0x7f0f5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:17.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f52ffd640 1 -- 172.21.15.112:0/986082553 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f58012830 con 0x7f0f640af2a0 2024-09-15T23:59:17.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f52ffd640 1 -- 172.21.15.112:0/986082553 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f58017070 con 0x7f0f640af2a0 2024-09-15T23:59:17.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 -- 172.21.15.112:0/986082553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f64150b80 con 0x7f0f640af2a0 2024-09-15T23:59:17.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f52ffd640 1 -- 172.21.15.112:0/986082553 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f58012c30 con 0x7f0f640af2a0 2024-09-15T23:59:17.492 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.488+0000 7f0f68880640 1 -- 172.21.15.112:0/986082553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f64151140 con 0x7f0f640af2a0 2024-09-15T23:59:17.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.492+0000 7f0f68880640 1 -- 172.21.15.112:0/986082553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f6406e000 con 0x7f0f640af2a0 2024-09-15T23:59:17.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.492+0000 7f0f52ffd640 1 -- 172.21.15.112:0/986082553 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f5801c460 con 0x7f0f640af2a0 2024-09-15T23:59:17.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.492+0000 7f0f52ffd640 1 --2- 172.21.15.112:0/986082553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0f440678f0 0x7f0f44069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:17.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.492+0000 7f0f52ffd640 1 -- 172.21.15.112:0/986082553 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f0f58085b90 con 0x7f0f640af2a0 2024-09-15T23:59:17.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.492+0000 7f0f61d9b640 1 --2- 172.21.15.112:0/986082553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0f440678f0 0x7f0f44069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:17.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.492+0000 7f0f61d9b640 1 --2- 172.21.15.112:0/986082553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0f440678f0 0x7f0f44069db0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0f540ae000 tx=0x7f0f540a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:17.498 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.496+0000 7f0f52ffd640 1 -- 172.21.15.112:0/986082553 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0f580565d0 con 0x7f0f640af2a0 2024-09-15T23:59:17.657 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.656+0000 7f0f68880640 1 -- 172.21.15.112:0/986082553 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f6406fcd0 con 0x7f0f440678f0 2024-09-15T23:59:17.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.664+0000 7f0f52ffd640 1 -- 172.21.15.112:0/986082553 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252447 (secure 0 0 0) 0x7f0f6406fcd0 con 0x7f0f440678f0 2024-09-15T23:59:17.666 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:17.668 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:59:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.668+0000 7f0f68880640 1 -- 172.21.15.112:0/986082553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0f440678f0 msgr2=0x7f0f44069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.668+0000 7f0f68880640 1 --2- 172.21.15.112:0/986082553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0f440678f0 0x7f0f44069db0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0f540ae000 tx=0x7f0f540a7000 comp rx=0 tx=0).stop 2024-09-15T23:59:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.668+0000 7f0f68880640 1 -- 172.21.15.112:0/986082553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f640af2a0 msgr2=0x7f0f6414b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.668+0000 7f0f68880640 1 --2- 172.21.15.112:0/986082553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f640af2a0 0x7f0f6414b140 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800c450 tx=0x7f0f5800c910 comp rx=0 tx=0).stop 2024-09-15T23:59:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.668+0000 7f0f68880640 1 -- 172.21.15.112:0/986082553 shutdown_connections 2024-09-15T23:59:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.668+0000 7f0f68880640 1 --2- 172.21.15.112:0/986082553 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0f440678f0 0x7f0f44069db0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.668+0000 7f0f68880640 1 --2- 172.21.15.112:0/986082553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f6415c2a0 0x7f0f6415a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.668+0000 7f0f68880640 1 --2- 172.21.15.112:0/986082553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f6415bec0 0x7f0f64151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.668+0000 7f0f68880640 1 --2- 172.21.15.112:0/986082553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f640af2a0 0x7f0f6414b140 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.668+0000 7f0f68880640 1 -- 172.21.15.112:0/986082553 >> 172.21.15.112:0/986082553 conn(0x7f0f640b1f90 msgr2=0x7f0f6414f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.668+0000 7f0f68880640 1 -- 172.21.15.112:0/986082553 shutdown_connections 2024-09-15T23:59:17.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.668+0000 7f0f68880640 1 -- 172.21.15.112:0/986082553 wait complete. 2024-09-15T23:59:17.685 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-15T23:59:17.332269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332620,"kb_used_data":12360,"kb_used_omap":12,"kb_used_meta":320051,"kb_avail":754642100,"statfs":{"total":773094113280,"available":772753510400,"internally_reserved":0,"allocated":12656640,"data_stored":6463244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":327732784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.461497"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.992293+0000","last_change":"2024-09-15T23:59:08.910824+0000","last_active":"2024-09-15T23:59:09.992293+0000","last_peered":"2024-09-15T23:59:09.992293+0000","last_clean":"2024-09-15T23:59:09.992293+0000","last_became_active":"2024-09-15T23:59:08.910492+0000","last_became_peered":"2024-09-15T23:59:08.910492+0000","last_unstale":"2024-09-15T23:59:09.992293+0000","last_undegraded":"2024-09-15T23:59:09.992293+0000","last_fullsized":"2024-09-15T23:59:09.992293+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:34:46.313382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990996+0000","last_change":"2024-09-15T23:59:08.923818+0000","last_active":"2024-09-15T23:59:09.990996+0000","last_peered":"2024-09-15T23:59:09.990996+0000","last_clean":"2024-09-15T23:59:09.990996+0000","last_became_active":"2024-09-15T23:59:08.903210+0000","last_became_peered":"2024-09-15T23:59:08.903210+0000","last_unstale":"2024-09-15T23:59:09.990996+0000","last_undegraded":"2024-09-15T23:59:09.990996+0000","last_fullsized":"2024-09-15T23:59:09.990996+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:10.994341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989346+0000","last_change":"2024-09-15T23:59:08.905338+0000","last_active":"2024-09-15T23:59:09.989346+0000","last_peered":"2024-09-15T23:59:09.989346+0000","last_clean":"2024-09-15T23:59:09.989346+0000","last_became_active":"2024-09-15T23:59:08.904840+0000","last_became_peered":"2024-09-15T23:59:08.904840+0000","last_unstale":"2024-09-15T23:59:09.989346+0000","last_undegraded":"2024-09-15T23:59:09.989346+0000","last_fullsized":"2024-09-15T23:59:09.989346+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:49:03.338864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.908621+0000","last_change":"2024-09-15T23:59:08.919911+0000","last_active":"2024-09-15T23:59:09.908621+0000","last_peered":"2024-09-15T23:59:09.908621+0000","last_clean":"2024-09-15T23:59:09.908621+0000","last_became_active":"2024-09-15T23:59:08.919627+0000","last_became_peered":"2024-09-15T23:59:08.919627+0000","last_unstale":"2024-09-15T23:59:09.908621+0000","last_undegraded":"2024-09-15T23:59:09.908621+0000","last_fullsized":"2024-09-15T23:59:09.908621+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:15.224990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.913414+0000","last_change":"2024-09-15T23:59:08.912292+0000","last_active":"2024-09-15T23:59:09.913414+0000","last_peered":"2024-09-15T23:59:09.913414+0000","last_clean":"2024-09-15T23:59:09.913414+0000","last_became_active":"2024-09-15T23:59:08.912022+0000","last_became_peered":"2024-09-15T23:59:08.912022+0000","last_unstale":"2024-09-15T23:59:09.913414+0000","last_undegraded":"2024-09-15T23:59:09.913414+0000","last_fullsized":"2024-09-15T23:59:09.913414+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:45.378330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989106+0000","last_change":"2024-09-15T23:59:08.927943+0000","last_active":"2024-09-15T23:59:09.989106+0000","last_peered":"2024-09-15T23:59:09.989106+0000","last_clean":"2024-09-15T23:59:09.989106+0000","last_became_active":"2024-09-15T23:59:08.923823+0000","last_became_peered":"2024-09-15T23:59:08.923823+0000","last_unstale":"2024-09-15T23:59:09.989106+0000","last_undegraded":"2024-09-15T23:59:09.989106+0000","last_fullsized":"2024-09-15T23:59:09.989106+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:46.929197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.988695+0000","last_change":"2024-09-15T23:59:08.903169+0000","last_active":"2024-09-15T23:59:09.988695+0000","last_peered":"2024-09-15T23:59:09.988695+0000","last_clean":"2024-09-15T23:59:09.988695+0000","last_became_active":"2024-09-15T23:59:08.901604+0000","last_became_peered":"2024-09-15T23:59:08.901604+0000","last_unstale":"2024-09-15T23:59:09.988695+0000","last_undegraded":"2024-09-15T23:59:09.988695+0000","last_fullsized":"2024-09-15T23:59:09.988695+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:32.323776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.908425+0000","last_change":"2024-09-15T23:59:08.904341+0000","last_active":"2024-09-15T23:59:09.908425+0000","last_peered":"2024-09-15T23:59:09.908425+0000","last_clean":"2024-09-15T23:59:09.908425+0000","last_became_active":"2024-09-15T23:59:08.896726+0000","last_became_peered":"2024-09-15T23:59:08.896726+0000","last_unstale":"2024-09-15T23:59:09.908425+0000","last_undegraded":"2024-09-15T23:59:09.908425+0000","last_fullsized":"2024-09-15T23:59:09.908425+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:38.230930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.909101+0000","last_change":"2024-09-15T23:59:08.896463+0000","last_active":"2024-09-15T23:59:09.909101+0000","last_peered":"2024-09-15T23:59:09.909101+0000","last_clean":"2024-09-15T23:59:09.909101+0000","last_became_active":"2024-09-15T23:59:08.895705+0000","last_became_peered":"2024-09-15T23:59:08.895705+0000","last_unstale":"2024-09-15T23:59:09.909101+0000","last_undegraded":"2024-09-15T23:59:09.909101+0000","last_fullsized":"2024-09-15T23:59:09.909101+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:07.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990811+0000","last_change":"2024-09-15T23:59:08.929553+0000","last_active":"2024-09-15T23:59:09.990811+0000","last_peered":"2024-09-15T23:59:09.990811+0000","last_clean":"2024-09-15T23:59:09.990811+0000","last_became_active":"2024-09-15T23:59:08.924862+0000","last_became_peered":"2024-09-15T23:59:08.924862+0000","last_unstale":"2024-09-15T23:59:09.990811+0000","last_undegraded":"2024-09-15T23:59:09.990811+0000","last_fullsized":"2024-09-15T23:59:09.990811+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:59.714972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.992194+0000","last_change":"2024-09-15T23:59:08.912390+0000","last_active":"2024-09-15T23:59:09.992194+0000","last_peered":"2024-09-15T23:59:09.992194+0000","last_clean":"2024-09-15T23:59:09.992194+0000","last_became_active":"2024-09-15T23:59:08.912057+0000","last_became_peered":"2024-09-15T23:59:08.912057+0000","last_unstale":"2024-09-15T23:59:09.992194+0000","last_undegraded":"2024-09-15T23:59:09.992194+0000","last_fullsized":"2024-09-15T23:59:09.992194+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:12:21.761686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.910710+0000","last_change":"2024-09-15T23:59:08.900744+0000","last_active":"2024-09-15T23:59:09.910710+0000","last_peered":"2024-09-15T23:59:09.910710+0000","last_clean":"2024-09-15T23:59:09.910710+0000","last_became_active":"2024-09-15T23:59:08.900042+0000","last_became_peered":"2024-09-15T23:59:08.900042+0000","last_unstale":"2024-09-15T23:59:09.910710+0000","last_undegraded":"2024-09-15T23:59:09.910710+0000","last_fullsized":"2024-09-15T23:59:09.910710+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:12.946708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990450+0000","last_change":"2024-09-15T23:59:08.924796+0000","last_active":"2024-09-15T23:59:09.990450+0000","last_peered":"2024-09-15T23:59:09.990450+0000","last_clean":"2024-09-15T23:59:09.990450+0000","last_became_active":"2024-09-15T23:59:08.924347+0000","last_became_peered":"2024-09-15T23:59:08.924347+0000","last_unstale":"2024-09-15T23:59:09.990450+0000","last_undegraded":"2024-09-15T23:59:09.990450+0000","last_fullsized":"2024-09-15T23:59:09.990450+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:29.190130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.909287+0000","last_change":"2024-09-15T23:59:08.902975+0000","last_active":"2024-09-15T23:59:09.909287+0000","last_peered":"2024-09-15T23:59:09.909287+0000","last_clean":"2024-09-15T23:59:09.909287+0000","last_became_active":"2024-09-15T23:59:08.902404+0000","last_became_peered":"2024-09-15T23:59:08.902404+0000","last_unstale":"2024-09-15T23:59:09.909287+0000","last_undegraded":"2024-09-15T23:59:09.909287+0000","last_fullsized":"2024-09-15T23:59:09.909287+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:17.498765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.991424+0000","last_change":"2024-09-15T23:59:08.910158+0000","last_active":"2024-09-15T23:59:09.991424+0000","last_peered":"2024-09-15T23:59:09.991424+0000","last_clean":"2024-09-15T23:59:09.991424+0000","last_became_active":"2024-09-15T23:59:08.909683+0000","last_became_peered":"2024-09-15T23:59:08.909683+0000","last_unstale":"2024-09-15T23:59:09.991424+0000","last_undegraded":"2024-09-15T23:59:09.991424+0000","last_fullsized":"2024-09-15T23:59:09.991424+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:16.349140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.909654+0000","last_change":"2024-09-15T23:59:08.898580+0000","last_active":"2024-09-15T23:59:09.909654+0000","last_peered":"2024-09-15T23:59:09.909654+0000","last_clean":"2024-09-15T23:59:09.909654+0000","last_became_active":"2024-09-15T23:59:08.898198+0000","last_became_peered":"2024-09-15T23:59:08.898198+0000","last_unstale":"2024-09-15T23:59:09.909654+0000","last_undegraded":"2024-09-15T23:59:09.909654+0000","last_fullsized":"2024-09-15T23:59:09.909654+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:40.516594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.910549+0000","last_change":"2024-09-15T23:59:08.898848+0000","last_active":"2024-09-15T23:59:09.910549+0000","last_peered":"2024-09-15T23:59:09.910549+0000","last_clean":"2024-09-15T23:59:09.910549+0000","last_became_active":"2024-09-15T23:59:08.897597+0000","last_became_peered":"2024-09-15T23:59:08.897597+0000","last_unstale":"2024-09-15T23:59:09.910549+0000","last_undegraded":"2024-09-15T23:59:09.910549+0000","last_fullsized":"2024-09-15T23:59:09.910549+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:12.973144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.910290+0000","last_change":"2024-09-15T23:59:08.885617+0000","last_active":"2024-09-15T23:59:09.910290+0000","last_peered":"2024-09-15T23:59:09.910290+0000","last_clean":"2024-09-15T23:59:09.910290+0000","last_became_active":"2024-09-15T23:59:08.884879+0000","last_became_peered":"2024-09-15T23:59:08.884879+0000","last_unstale":"2024-09-15T23:59:09.910290+0000","last_undegraded":"2024-09-15T23:59:09.910290+0000","last_fullsized":"2024-09-15T23:59:09.910290+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:46.166142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.913828+0000","last_change":"2024-09-15T23:59:08.900479+0000","last_active":"2024-09-15T23:59:09.913828+0000","last_peered":"2024-09-15T23:59:09.913828+0000","last_clean":"2024-09-15T23:59:09.913828+0000","last_became_active":"2024-09-15T23:59:08.899654+0000","last_became_peered":"2024-09-15T23:59:08.899654+0000","last_unstale":"2024-09-15T23:59:09.913828+0000","last_undegraded":"2024-09-15T23:59:09.913828+0000","last_fullsized":"2024-09-15T23:59:09.913828+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:51.545814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990268+0000","last_change":"2024-09-15T23:59:08.910123+0000","last_active":"2024-09-15T23:59:09.990268+0000","last_peered":"2024-09-15T23:59:09.990268+0000","last_clean":"2024-09-15T23:59:09.990268+0000","last_became_active":"2024-09-15T23:59:08.909462+0000","last_became_peered":"2024-09-15T23:59:08.909462+0000","last_unstale":"2024-09-15T23:59:09.990268+0000","last_undegraded":"2024-09-15T23:59:09.990268+0000","last_fullsized":"2024-09-15T23:59:09.990268+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:42.877663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.913721+0000","last_change":"2024-09-15T23:59:08.917290+0000","last_active":"2024-09-15T23:59:09.913721+0000","last_peered":"2024-09-15T23:59:09.913721+0000","last_clean":"2024-09-15T23:59:09.913721+0000","last_became_active":"2024-09-15T23:59:08.916943+0000","last_became_peered":"2024-09-15T23:59:08.916943+0000","last_unstale":"2024-09-15T23:59:09.913721+0000","last_undegraded":"2024-09-15T23:59:09.913721+0000","last_fullsized":"2024-09-15T23:59:09.913721+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:07.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.991024+0000","last_change":"2024-09-15T23:59:08.903844+0000","last_active":"2024-09-15T23:59:09.991024+0000","last_peered":"2024-09-15T23:59:09.991024+0000","last_clean":"2024-09-15T23:59:09.991024+0000","last_became_active":"2024-09-15T23:59:08.903464+0000","last_became_peered":"2024-09-15T23:59:08.903464+0000","last_unstale":"2024-09-15T23:59:09.991024+0000","last_undegraded":"2024-09-15T23:59:09.991024+0000","last_fullsized":"2024-09-15T23:59:09.991024+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:07.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.991665+0000","last_change":"2024-09-15T23:59:08.909943+0000","last_active":"2024-09-15T23:59:09.991665+0000","last_peered":"2024-09-15T23:59:09.991665+0000","last_clean":"2024-09-15T23:59:09.991665+0000","last_became_active":"2024-09-15T23:59:08.909343+0000","last_became_peered":"2024-09-15T23:59:08.909343+0000","last_unstale":"2024-09-15T23:59:09.991665+0000","last_undegraded":"2024-09-15T23:59:09.991665+0000","last_fullsized":"2024-09-15T23:59:09.991665+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:33.635213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990645+0000","last_change":"2024-09-15T23:59:08.893198+0000","last_active":"2024-09-15T23:59:09.990645+0000","last_peered":"2024-09-15T23:59:09.990645+0000","last_clean":"2024-09-15T23:59:09.990645+0000","last_became_active":"2024-09-15T23:59:08.892419+0000","last_became_peered":"2024-09-15T23:59:08.892419+0000","last_unstale":"2024-09-15T23:59:09.990645+0000","last_undegraded":"2024-09-15T23:59:09.990645+0000","last_fullsized":"2024-09-15T23:59:09.990645+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:31.313750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.992676+0000","last_change":"2024-09-15T23:59:08.910520+0000","last_active":"2024-09-15T23:59:09.992676+0000","last_peered":"2024-09-15T23:59:09.992676+0000","last_clean":"2024-09-15T23:59:09.992676+0000","last_became_active":"2024-09-15T23:59:08.903811+0000","last_became_peered":"2024-09-15T23:59:08.903811+0000","last_unstale":"2024-09-15T23:59:09.992676+0000","last_undegraded":"2024-09-15T23:59:09.992676+0000","last_fullsized":"2024-09-15T23:59:09.992676+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:58:39.393418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.910232+0000","last_change":"2024-09-15T23:59:08.932649+0000","last_active":"2024-09-15T23:59:09.910232+0000","last_peered":"2024-09-15T23:59:09.910232+0000","last_clean":"2024-09-15T23:59:09.910232+0000","last_became_active":"2024-09-15T23:59:08.932168+0000","last_became_peered":"2024-09-15T23:59:08.932168+0000","last_unstale":"2024-09-15T23:59:09.910232+0000","last_undegraded":"2024-09-15T23:59:09.910232+0000","last_fullsized":"2024-09-15T23:59:09.910232+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:40.035182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.913704+0000","last_change":"2024-09-15T23:59:08.919491+0000","last_active":"2024-09-15T23:59:09.913704+0000","last_peered":"2024-09-15T23:59:09.913704+0000","last_clean":"2024-09-15T23:59:09.913704+0000","last_became_active":"2024-09-15T23:59:08.919162+0000","last_became_peered":"2024-09-15T23:59:08.919162+0000","last_unstale":"2024-09-15T23:59:09.913704+0000","last_undegraded":"2024-09-15T23:59:09.913704+0000","last_fullsized":"2024-09-15T23:59:09.913704+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:15.224990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.910796+0000","last_change":"2024-09-15T23:59:08.900424+0000","last_active":"2024-09-15T23:59:09.910796+0000","last_peered":"2024-09-15T23:59:09.910796+0000","last_clean":"2024-09-15T23:59:09.910796+0000","last_became_active":"2024-09-15T23:59:08.899537+0000","last_became_peered":"2024-09-15T23:59:08.899537+0000","last_unstale":"2024-09-15T23:59:09.910796+0000","last_undegraded":"2024-09-15T23:59:09.910796+0000","last_fullsized":"2024-09-15T23:59:09.910796+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:58:34.531614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989267+0000","last_change":"2024-09-15T23:59:08.912709+0000","last_active":"2024-09-15T23:59:09.989267+0000","last_peered":"2024-09-15T23:59:09.989267+0000","last_clean":"2024-09-15T23:59:09.989267+0000","last_became_active":"2024-09-15T23:59:08.912001+0000","last_became_peered":"2024-09-15T23:59:08.912001+0000","last_unstale":"2024-09-15T23:59:09.989267+0000","last_undegraded":"2024-09-15T23:59:09.989267+0000","last_fullsized":"2024-09-15T23:59:09.989267+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:55.999002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.988712+0000","last_change":"2024-09-15T23:59:08.908502+0000","last_active":"2024-09-15T23:59:09.988712+0000","last_peered":"2024-09-15T23:59:09.988712+0000","last_clean":"2024-09-15T23:59:09.988712+0000","last_became_active":"2024-09-15T23:59:08.907710+0000","last_became_peered":"2024-09-15T23:59:08.907710+0000","last_unstale":"2024-09-15T23:59:09.988712+0000","last_undegraded":"2024-09-15T23:59:09.988712+0000","last_fullsized":"2024-09-15T23:59:09.988712+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:44.749105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990582+0000","last_change":"2024-09-15T23:59:08.903256+0000","last_active":"2024-09-15T23:59:09.990582+0000","last_peered":"2024-09-15T23:59:09.990582+0000","last_clean":"2024-09-15T23:59:09.990582+0000","last_became_active":"2024-09-15T23:59:08.902744+0000","last_became_peered":"2024-09-15T23:59:08.902744+0000","last_unstale":"2024-09-15T23:59:09.990582+0000","last_undegraded":"2024-09-15T23:59:09.990582+0000","last_fullsized":"2024-09-15T23:59:09.990582+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:18.692983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990721+0000","last_change":"2024-09-15T23:59:08.911546+0000","last_active":"2024-09-15T23:59:09.990721+0000","last_peered":"2024-09-15T23:59:09.990721+0000","last_clean":"2024-09-15T23:59:09.990721+0000","last_became_active":"2024-09-15T23:59:08.910654+0000","last_became_peered":"2024-09-15T23:59:08.910654+0000","last_unstale":"2024-09-15T23:59:09.990721+0000","last_undegraded":"2024-09-15T23:59:09.990721+0000","last_fullsized":"2024-09-15T23:59:09.990721+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:25.235751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.909794+0000","last_change":"2024-09-15T23:59:08.896783+0000","last_active":"2024-09-15T23:59:09.909794+0000","last_peered":"2024-09-15T23:59:09.909794+0000","last_clean":"2024-09-15T23:59:09.909794+0000","last_became_active":"2024-09-15T23:59:08.895801+0000","last_became_peered":"2024-09-15T23:59:08.895801+0000","last_unstale":"2024-09-15T23:59:09.909794+0000","last_undegraded":"2024-09-15T23:59:09.909794+0000","last_fullsized":"2024-09-15T23:59:09.909794+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:45.600267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"114'4","reported_seq":18,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.914489+0000","last_change":"2024-09-15T23:59:07.897150+0000","last_active":"2024-09-15T23:59:09.914489+0000","last_peered":"2024-09-15T23:59:09.914489+0000","last_clean":"2024-09-15T23:59:09.914489+0000","last_became_active":"2024-09-15T23:59:07.896874+0000","last_became_peered":"2024-09-15T23:59:07.896874+0000","last_unstale":"2024-09-15T23:59:09.914489+0000","last_undegraded":"2024-09-15T23:59:09.914489+0000","last_fullsized":"2024-09-15T23:59:09.914489+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:33.693308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990601+0000","last_change":"2024-09-15T23:59:08.928146+0000","last_active":"2024-09-15T23:59:09.990601+0000","last_peered":"2024-09-15T23:59:09.990601+0000","last_clean":"2024-09-15T23:59:09.990601+0000","last_became_active":"2024-09-15T23:59:08.901145+0000","last_became_peered":"2024-09-15T23:59:08.901145+0000","last_unstale":"2024-09-15T23:59:09.990601+0000","last_undegraded":"2024-09-15T23:59:09.990601+0000","last_fullsized":"2024-09-15T23:59:09.990601+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:40.169821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1e","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.910696+0000","last_change":"2024-09-15T23:59:07.899334+0000","last_active":"2024-09-15T23:59:09.910696+0000","last_peered":"2024-09-15T23:59:09.910696+0000","last_clean":"2024-09-15T23:59:09.910696+0000","last_became_active":"2024-09-15T23:59:07.897881+0000","last_became_peered":"2024-09-15T23:59:07.897881+0000","last_unstale":"2024-09-15T23:59:09.910696+0000","last_undegraded":"2024-09-15T23:59:09.910696+0000","last_fullsized":"2024-09-15T23:59:09.910696+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:14.214987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.992470+0000","last_change":"2024-09-15T23:59:08.915142+0000","last_active":"2024-09-15T23:59:09.992470+0000","last_peered":"2024-09-15T23:59:09.992470+0000","last_clean":"2024-09-15T23:59:09.992470+0000","last_became_active":"2024-09-15T23:59:08.914779+0000","last_became_peered":"2024-09-15T23:59:08.914779+0000","last_unstale":"2024-09-15T23:59:09.992470+0000","last_undegraded":"2024-09-15T23:59:09.992470+0000","last_fullsized":"2024-09-15T23:59:09.992470+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:19.272907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.992494+0000","last_change":"2024-09-15T23:59:07.902457+0000","last_active":"2024-09-15T23:59:09.992494+0000","last_peered":"2024-09-15T23:59:09.992494+0000","last_clean":"2024-09-15T23:59:09.992494+0000","last_became_active":"2024-09-15T23:59:07.902170+0000","last_became_peered":"2024-09-15T23:59:07.902170+0000","last_unstale":"2024-09-15T23:59:09.992494+0000","last_undegraded":"2024-09-15T23:59:09.992494+0000","last_fullsized":"2024-09-15T23:59:09.992494+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:25.178922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.909553+0000","last_change":"2024-09-15T23:59:08.913433+0000","last_active":"2024-09-15T23:59:09.909553+0000","last_peered":"2024-09-15T23:59:09.909553+0000","last_clean":"2024-09-15T23:59:09.909553+0000","last_became_active":"2024-09-15T23:59:08.913093+0000","last_became_peered":"2024-09-15T23:59:08.913093+0000","last_unstale":"2024-09-15T23:59:09.909553+0000","last_undegraded":"2024-09-15T23:59:09.909553+0000","last_fullsized":"2024-09-15T23:59:09.909553+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:51.545814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990104+0000","last_change":"2024-09-15T23:59:07.915372+0000","last_active":"2024-09-15T23:59:09.990104+0000","last_peered":"2024-09-15T23:59:09.990104+0000","last_clean":"2024-09-15T23:59:09.990104+0000","last_became_active":"2024-09-15T23:59:07.914552+0000","last_became_peered":"2024-09-15T23:59:07.914552+0000","last_unstale":"2024-09-15T23:59:09.990104+0000","last_undegraded":"2024-09-15T23:59:09.990104+0000","last_fullsized":"2024-09-15T23:59:09.990104+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:37.113885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.908856+0000","last_change":"2024-09-15T23:59:08.911675+0000","last_active":"2024-09-15T23:59:09.908856+0000","last_peered":"2024-09-15T23:59:09.908856+0000","last_clean":"2024-09-15T23:59:09.908856+0000","last_became_active":"2024-09-15T23:59:08.910468+0000","last_became_peered":"2024-09-15T23:59:08.910468+0000","last_unstale":"2024-09-15T23:59:09.908856+0000","last_undegraded":"2024-09-15T23:59:09.908856+0000","last_fullsized":"2024-09-15T23:59:09.908856+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:59.398249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.991585+0000","last_change":"2024-09-15T23:59:07.901742+0000","last_active":"2024-09-15T23:59:09.991585+0000","last_peered":"2024-09-15T23:59:09.991585+0000","last_clean":"2024-09-15T23:59:09.991585+0000","last_became_active":"2024-09-15T23:59:07.901438+0000","last_became_peered":"2024-09-15T23:59:07.901438+0000","last_unstale":"2024-09-15T23:59:09.991585+0000","last_undegraded":"2024-09-15T23:59:09.991585+0000","last_fullsized":"2024-09-15T23:59:09.991585+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:18.840142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.991005+0000","last_change":"2024-09-15T23:59:08.903023+0000","last_active":"2024-09-15T23:59:09.991005+0000","last_peered":"2024-09-15T23:59:09.991005+0000","last_clean":"2024-09-15T23:59:09.991005+0000","last_became_active":"2024-09-15T23:59:08.902108+0000","last_became_peered":"2024-09-15T23:59:08.902108+0000","last_unstale":"2024-09-15T23:59:09.991005+0000","last_undegraded":"2024-09-15T23:59:09.991005+0000","last_fullsized":"2024-09-15T23:59:09.991005+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:18.527088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.908745+0000","last_change":"2024-09-15T23:59:07.911259+0000","last_active":"2024-09-15T23:59:09.908745+0000","last_peered":"2024-09-15T23:59:09.908745+0000","last_clean":"2024-09-15T23:59:09.908745+0000","last_became_active":"2024-09-15T23:59:07.910417+0000","last_became_peered":"2024-09-15T23:59:07.910417+0000","last_unstale":"2024-09-15T23:59:09.908745+0000","last_undegraded":"2024-09-15T23:59:09.908745+0000","last_fullsized":"2024-09-15T23:59:09.908745+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:50.138286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990067+0000","last_change":"2024-09-15T23:59:08.898567+0000","last_active":"2024-09-15T23:59:09.990067+0000","last_peered":"2024-09-15T23:59:09.990067+0000","last_clean":"2024-09-15T23:59:09.990067+0000","last_became_active":"2024-09-15T23:59:08.898219+0000","last_became_peered":"2024-09-15T23:59:08.898219+0000","last_unstale":"2024-09-15T23:59:09.990067+0000","last_undegraded":"2024-09-15T23:59:09.990067+0000","last_fullsized":"2024-09-15T23:59:09.990067+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:21.901942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.991234+0000","last_change":"2024-09-15T23:59:07.891090+0000","last_active":"2024-09-15T23:59:09.991234+0000","last_peered":"2024-09-15T23:59:09.991234+0000","last_clean":"2024-09-15T23:59:09.991234+0000","last_became_active":"2024-09-15T23:59:07.890684+0000","last_became_peered":"2024-09-15T23:59:07.890684+0000","last_unstale":"2024-09-15T23:59:09.991234+0000","last_undegraded":"2024-09-15T23:59:09.991234+0000","last_fullsized":"2024-09-15T23:59:09.991234+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:12.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.908213+0000","last_change":"2024-09-15T23:59:08.894805+0000","last_active":"2024-09-15T23:59:09.908213+0000","last_peered":"2024-09-15T23:59:09.908213+0000","last_clean":"2024-09-15T23:59:09.908213+0000","last_became_active":"2024-09-15T23:59:08.893503+0000","last_became_peered":"2024-09-15T23:59:08.893503+0000","last_unstale":"2024-09-15T23:59:09.908213+0000","last_undegraded":"2024-09-15T23:59:09.908213+0000","last_fullsized":"2024-09-15T23:59:09.908213+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:21.875573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.988463+0000","last_change":"2024-09-15T23:59:07.904298+0000","last_active":"2024-09-15T23:59:09.988463+0000","last_peered":"2024-09-15T23:59:09.988463+0000","last_clean":"2024-09-15T23:59:09.988463+0000","last_became_active":"2024-09-15T23:59:07.903534+0000","last_became_peered":"2024-09-15T23:59:07.903534+0000","last_unstale":"2024-09-15T23:59:09.988463+0000","last_undegraded":"2024-09-15T23:59:09.988463+0000","last_fullsized":"2024-09-15T23:59:09.988463+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:55.141179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.991397+0000","last_change":"2024-09-15T23:59:08.918009+0000","last_active":"2024-09-15T23:59:09.991397+0000","last_peered":"2024-09-15T23:59:09.991397+0000","last_clean":"2024-09-15T23:59:09.991397+0000","last_became_active":"2024-09-15T23:59:08.917739+0000","last_became_peered":"2024-09-15T23:59:08.917739+0000","last_unstale":"2024-09-15T23:59:09.991397+0000","last_undegraded":"2024-09-15T23:59:09.991397+0000","last_fullsized":"2024-09-15T23:59:09.991397+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:51.545814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.909562+0000","last_change":"2024-09-15T23:59:07.904677+0000","last_active":"2024-09-15T23:59:09.909562+0000","last_peered":"2024-09-15T23:59:09.909562+0000","last_clean":"2024-09-15T23:59:09.909562+0000","last_became_active":"2024-09-15T23:59:07.904276+0000","last_became_peered":"2024-09-15T23:59:07.904276+0000","last_unstale":"2024-09-15T23:59:09.909562+0000","last_undegraded":"2024-09-15T23:59:09.909562+0000","last_fullsized":"2024-09-15T23:59:09.909562+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:55.211122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.908573+0000","last_change":"2024-09-15T23:59:08.913519+0000","last_active":"2024-09-15T23:59:09.908573+0000","last_peered":"2024-09-15T23:59:09.908573+0000","last_clean":"2024-09-15T23:59:09.908573+0000","last_became_active":"2024-09-15T23:59:08.913190+0000","last_became_peered":"2024-09-15T23:59:08.913190+0000","last_unstale":"2024-09-15T23:59:09.908573+0000","last_undegraded":"2024-09-15T23:59:09.908573+0000","last_fullsized":"2024-09-15T23:59:09.908573+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:01.161528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.908753+0000","last_change":"2024-09-15T23:59:07.892077+0000","last_active":"2024-09-15T23:59:09.908753+0000","last_peered":"2024-09-15T23:59:09.908753+0000","last_clean":"2024-09-15T23:59:09.908753+0000","last_became_active":"2024-09-15T23:59:07.891329+0000","last_became_peered":"2024-09-15T23:59:07.891329+0000","last_unstale":"2024-09-15T23:59:09.908753+0000","last_undegraded":"2024-09-15T23:59:09.908753+0000","last_fullsized":"2024-09-15T23:59:09.908753+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:33.693308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989338+0000","last_change":"2024-09-15T23:59:08.910417+0000","last_active":"2024-09-15T23:59:09.989338+0000","last_peered":"2024-09-15T23:59:09.989338+0000","last_clean":"2024-09-15T23:59:09.989338+0000","last_became_active":"2024-09-15T23:59:08.907523+0000","last_became_peered":"2024-09-15T23:59:08.907523+0000","last_unstale":"2024-09-15T23:59:09.989338+0000","last_undegraded":"2024-09-15T23:59:09.989338+0000","last_fullsized":"2024-09-15T23:59:09.989338+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:06.989246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"114'3","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.992736+0000","last_change":"2024-09-15T23:59:07.898178+0000","last_active":"2024-09-15T23:59:09.992736+0000","last_peered":"2024-09-15T23:59:09.992736+0000","last_clean":"2024-09-15T23:59:09.992736+0000","last_became_active":"2024-09-15T23:59:07.897591+0000","last_became_peered":"2024-09-15T23:59:07.897591+0000","last_unstale":"2024-09-15T23:59:09.992736+0000","last_undegraded":"2024-09-15T23:59:09.992736+0000","last_fullsized":"2024-09-15T23:59:09.992736+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:42.591070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.913845+0000","last_change":"2024-09-15T23:59:08.917685+0000","last_active":"2024-09-15T23:59:09.913845+0000","last_peered":"2024-09-15T23:59:09.913845+0000","last_clean":"2024-09-15T23:59:09.913845+0000","last_became_active":"2024-09-15T23:59:08.917472+0000","last_became_peered":"2024-09-15T23:59:08.917472+0000","last_unstale":"2024-09-15T23:59:09.913845+0000","last_undegraded":"2024-09-15T23:59:09.913845+0000","last_fullsized":"2024-09-15T23:59:09.913845+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:16.349140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"114'6","reported_seq":20,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990459+0000","last_change":"2024-09-15T23:59:07.902665+0000","last_active":"2024-09-15T23:59:09.990459+0000","last_peered":"2024-09-15T23:59:09.990459+0000","last_clean":"2024-09-15T23:59:09.990459+0000","last_became_active":"2024-09-15T23:59:07.901953+0000","last_became_peered":"2024-09-15T23:59:07.901953+0000","last_unstale":"2024-09-15T23:59:09.990459+0000","last_undegraded":"2024-09-15T23:59:09.990459+0000","last_fullsized":"2024-09-15T23:59:09.990459+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:15.022749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.913298+0000","last_change":"2024-09-15T23:59:08.911790+0000","last_active":"2024-09-15T23:59:09.913298+0000","last_peered":"2024-09-15T23:59:09.913298+0000","last_clean":"2024-09-15T23:59:09.913298+0000","last_became_active":"2024-09-15T23:59:08.911525+0000","last_became_peered":"2024-09-15T23:59:08.911525+0000","last_unstale":"2024-09-15T23:59:09.913298+0000","last_undegraded":"2024-09-15T23:59:09.913298+0000","last_fullsized":"2024-09-15T23:59:09.913298+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:55.470024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.908728+0000","last_change":"2024-09-15T23:59:07.901494+0000","last_active":"2024-09-15T23:59:09.908728+0000","last_peered":"2024-09-15T23:59:09.908728+0000","last_clean":"2024-09-15T23:59:09.908728+0000","last_became_active":"2024-09-15T23:59:07.900634+0000","last_became_peered":"2024-09-15T23:59:07.900634+0000","last_unstale":"2024-09-15T23:59:09.908728+0000","last_undegraded":"2024-09-15T23:59:09.908728+0000","last_fullsized":"2024-09-15T23:59:09.908728+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:45.156139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989326+0000","last_change":"2024-09-15T23:59:08.924769+0000","last_active":"2024-09-15T23:59:09.989326+0000","last_peered":"2024-09-15T23:59:09.989326+0000","last_clean":"2024-09-15T23:59:09.989326+0000","last_became_active":"2024-09-15T23:59:08.923876+0000","last_became_peered":"2024-09-15T23:59:08.923876+0000","last_unstale":"2024-09-15T23:59:09.989326+0000","last_undegraded":"2024-09-15T23:59:09.989326+0000","last_fullsized":"2024-09-15T23:59:09.989326+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:47.207350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990306+0000","last_change":"2024-09-15T23:59:07.900377+0000","last_active":"2024-09-15T23:59:09.990306+0000","last_peered":"2024-09-15T23:59:09.990306+0000","last_clean":"2024-09-15T23:59:09.990306+0000","last_became_active":"2024-09-15T23:59:07.899640+0000","last_became_peered":"2024-09-15T23:59:07.899640+0000","last_unstale":"2024-09-15T23:59:09.990306+0000","last_undegraded":"2024-09-15T23:59:09.990306+0000","last_fullsized":"2024-09-15T23:59:09.990306+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:38.375055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.909379+0000","last_change":"2024-09-15T23:59:08.893917+0000","last_active":"2024-09-15T23:59:09.909379+0000","last_peered":"2024-09-15T23:59:09.909379+0000","last_clean":"2024-09-15T23:59:09.909379+0000","last_became_active":"2024-09-15T23:59:08.893372+0000","last_became_peered":"2024-09-15T23:59:08.893372+0000","last_unstale":"2024-09-15T23:59:09.909379+0000","last_undegraded":"2024-09-15T23:59:09.909379+0000","last_fullsized":"2024-09-15T23:59:09.909379+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:51.148289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.907923+0000","last_change":"2024-09-15T23:59:07.899745+0000","last_active":"2024-09-15T23:59:09.907923+0000","last_peered":"2024-09-15T23:59:09.907923+0000","last_clean":"2024-09-15T23:59:09.907923+0000","last_became_active":"2024-09-15T23:59:07.898602+0000","last_became_peered":"2024-09-15T23:59:07.898602+0000","last_unstale":"2024-09-15T23:59:09.907923+0000","last_undegraded":"2024-09-15T23:59:09.907923+0000","last_fullsized":"2024-09-15T23:59:09.907923+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:39.506591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.908607+0000","last_change":"2024-09-15T23:59:08.905590+0000","last_active":"2024-09-15T23:59:09.908607+0000","last_peered":"2024-09-15T23:59:09.908607+0000","last_clean":"2024-09-15T23:59:09.908607+0000","last_became_active":"2024-09-15T23:59:08.904800+0000","last_became_peered":"2024-09-15T23:59:08.904800+0000","last_unstale":"2024-09-15T23:59:09.908607+0000","last_undegraded":"2024-09-15T23:59:09.908607+0000","last_fullsized":"2024-09-15T23:59:09.908607+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:45.378330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.910612+0000","last_change":"2024-09-15T23:59:07.898098+0000","last_active":"2024-09-15T23:59:09.910612+0000","last_peered":"2024-09-15T23:59:09.910612+0000","last_clean":"2024-09-15T23:59:09.910612+0000","last_became_active":"2024-09-15T23:59:07.897362+0000","last_became_peered":"2024-09-15T23:59:07.897362+0000","last_unstale":"2024-09-15T23:59:09.910612+0000","last_undegraded":"2024-09-15T23:59:09.910612+0000","last_fullsized":"2024-09-15T23:59:09.910612+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:50.535811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.992556+0000","last_change":"2024-09-15T23:59:08.932023+0000","last_active":"2024-09-15T23:59:09.992556+0000","last_peered":"2024-09-15T23:59:09.992556+0000","last_clean":"2024-09-15T23:59:09.992556+0000","last_became_active":"2024-09-15T23:59:08.931681+0000","last_became_peered":"2024-09-15T23:59:08.931681+0000","last_unstale":"2024-09-15T23:59:09.992556+0000","last_undegraded":"2024-09-15T23:59:09.992556+0000","last_fullsized":"2024-09-15T23:59:09.992556+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:20.450988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.910829+0000","last_change":"2024-09-15T23:59:07.908611+0000","last_active":"2024-09-15T23:59:09.910829+0000","last_peered":"2024-09-15T23:59:09.910829+0000","last_clean":"2024-09-15T23:59:09.910829+0000","last_became_active":"2024-09-15T23:59:07.906983+0000","last_became_peered":"2024-09-15T23:59:07.906983+0000","last_unstale":"2024-09-15T23:59:09.910829+0000","last_undegraded":"2024-09-15T23:59:09.910829+0000","last_fullsized":"2024-09-15T23:59:09.910829+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:30.303746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990787+0000","last_change":"2024-09-15T23:59:08.928009+0000","last_active":"2024-09-15T23:59:09.990787+0000","last_peered":"2024-09-15T23:59:09.990787+0000","last_clean":"2024-09-15T23:59:09.990787+0000","last_became_active":"2024-09-15T23:59:08.910386+0000","last_became_peered":"2024-09-15T23:59:08.910386+0000","last_unstale":"2024-09-15T23:59:09.990787+0000","last_undegraded":"2024-09-15T23:59:09.990787+0000","last_fullsized":"2024-09-15T23:59:09.990787+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:25.078488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"114'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.913784+0000","last_change":"2024-09-15T23:59:07.895016+0000","last_active":"2024-09-15T23:59:09.913784+0000","last_peered":"2024-09-15T23:59:09.913784+0000","last_clean":"2024-09-15T23:59:09.913784+0000","last_became_active":"2024-09-15T23:59:07.894480+0000","last_became_peered":"2024-09-15T23:59:07.894480+0000","last_unstale":"2024-09-15T23:59:09.913784+0000","last_undegraded":"2024-09-15T23:59:09.913784+0000","last_fullsized":"2024-09-15T23:59:09.913784+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:35.445956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.914230+0000","last_change":"2024-09-15T23:59:08.917111+0000","last_active":"2024-09-15T23:59:09.914230+0000","last_peered":"2024-09-15T23:59:09.914230+0000","last_clean":"2024-09-15T23:59:09.914230+0000","last_became_active":"2024-09-15T23:59:08.915164+0000","last_became_peered":"2024-09-15T23:59:08.915164+0000","last_unstale":"2024-09-15T23:59:09.914230+0000","last_undegraded":"2024-09-15T23:59:09.914230+0000","last_fullsized":"2024-09-15T23:59:09.914230+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:33.635213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.992059+0000","last_change":"2024-09-15T23:59:07.894577+0000","last_active":"2024-09-15T23:59:09.992059+0000","last_peered":"2024-09-15T23:59:09.992059+0000","last_clean":"2024-09-15T23:59:09.992059+0000","last_became_active":"2024-09-15T23:59:07.894225+0000","last_became_peered":"2024-09-15T23:59:07.894225+0000","last_unstale":"2024-09-15T23:59:09.992059+0000","last_undegraded":"2024-09-15T23:59:09.992059+0000","last_fullsized":"2024-09-15T23:59:09.992059+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:57.333706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.988694+0000","last_change":"2024-09-15T23:59:08.928343+0000","last_active":"2024-09-15T23:59:09.988694+0000","last_peered":"2024-09-15T23:59:09.988694+0000","last_clean":"2024-09-15T23:59:09.988694+0000","last_became_active":"2024-09-15T23:59:08.924611+0000","last_became_peered":"2024-09-15T23:59:08.924611+0000","last_unstale":"2024-09-15T23:59:09.988694+0000","last_undegraded":"2024-09-15T23:59:09.988694+0000","last_fullsized":"2024-09-15T23:59:09.988694+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:19.620558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.b","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.909558+0000","last_change":"2024-09-15T23:59:07.888210+0000","last_active":"2024-09-15T23:59:09.909558+0000","last_peered":"2024-09-15T23:59:09.909558+0000","last_clean":"2024-09-15T23:59:09.909558+0000","last_became_active":"2024-09-15T23:59:07.886924+0000","last_became_peered":"2024-09-15T23:59:07.886924+0000","last_unstale":"2024-09-15T23:59:09.909558+0000","last_undegraded":"2024-09-15T23:59:09.909558+0000","last_fullsized":"2024-09-15T23:59:09.909558+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:44.368326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.909843+0000","last_change":"2024-09-15T23:59:08.898377+0000","last_active":"2024-09-15T23:59:09.909843+0000","last_peered":"2024-09-15T23:59:09.909843+0000","last_clean":"2024-09-15T23:59:09.909843+0000","last_became_active":"2024-09-15T23:59:08.897554+0000","last_became_peered":"2024-09-15T23:59:08.897554+0000","last_unstale":"2024-09-15T23:59:09.909843+0000","last_undegraded":"2024-09-15T23:59:09.909843+0000","last_fullsized":"2024-09-15T23:59:09.909843+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:46.099070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.991255+0000","last_change":"2024-09-15T23:59:07.895677+0000","last_active":"2024-09-15T23:59:09.991255+0000","last_peered":"2024-09-15T23:59:09.991255+0000","last_clean":"2024-09-15T23:59:09.991255+0000","last_became_active":"2024-09-15T23:59:07.895385+0000","last_became_peered":"2024-09-15T23:59:07.895385+0000","last_unstale":"2024-09-15T23:59:09.991255+0000","last_undegraded":"2024-09-15T23:59:09.991255+0000","last_fullsized":"2024-09-15T23:59:09.991255+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:22.930636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989915+0000","last_change":"2024-09-15T23:59:08.917054+0000","last_active":"2024-09-15T23:59:09.989915+0000","last_peered":"2024-09-15T23:59:09.989915+0000","last_clean":"2024-09-15T23:59:09.989915+0000","last_became_active":"2024-09-15T23:59:08.912975+0000","last_became_peered":"2024-09-15T23:59:08.912975+0000","last_unstale":"2024-09-15T23:59:09.989915+0000","last_undegraded":"2024-09-15T23:59:09.989915+0000","last_fullsized":"2024-09-15T23:59:09.989915+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:33.350187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.988536+0000","last_change":"2024-09-15T23:59:07.904775+0000","last_active":"2024-09-15T23:59:09.988536+0000","last_peered":"2024-09-15T23:59:09.988536+0000","last_clean":"2024-09-15T23:59:09.988536+0000","last_became_active":"2024-09-15T23:59:07.903906+0000","last_became_peered":"2024-09-15T23:59:07.903906+0000","last_unstale":"2024-09-15T23:59:09.988536+0000","last_undegraded":"2024-09-15T23:59:09.988536+0000","last_fullsized":"2024-09-15T23:59:09.988536+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:39.108011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.991340+0000","last_change":"2024-09-15T23:59:08.911830+0000","last_active":"2024-09-15T23:59:09.991340+0000","last_peered":"2024-09-15T23:59:09.991340+0000","last_clean":"2024-09-15T23:59:09.991340+0000","last_became_active":"2024-09-15T23:59:08.911561+0000","last_became_peered":"2024-09-15T23:59:08.911561+0000","last_unstale":"2024-09-15T23:59:09.991340+0000","last_undegraded":"2024-09-15T23:59:09.991340+0000","last_fullsized":"2024-09-15T23:59:09.991340+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:55.285245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.913369+0000","last_change":"2024-09-15T23:59:07.888011+0000","last_active":"2024-09-15T23:59:09.913369+0000","last_peered":"2024-09-15T23:59:09.913369+0000","last_clean":"2024-09-15T23:59:09.913369+0000","last_became_active":"2024-09-15T23:59:07.887633+0000","last_became_peered":"2024-09-15T23:59:07.887633+0000","last_unstale":"2024-09-15T23:59:09.913369+0000","last_undegraded":"2024-09-15T23:59:09.913369+0000","last_fullsized":"2024-09-15T23:59:09.913369+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:32.340184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.910991+0000","last_change":"2024-09-15T23:59:08.894213+0000","last_active":"2024-09-15T23:59:09.910991+0000","last_peered":"2024-09-15T23:59:09.910991+0000","last_clean":"2024-09-15T23:59:09.910991+0000","last_became_active":"2024-09-15T23:59:08.893860+0000","last_became_peered":"2024-09-15T23:59:08.893860+0000","last_unstale":"2024-09-15T23:59:09.910991+0000","last_undegraded":"2024-09-15T23:59:09.910991+0000","last_fullsized":"2024-09-15T23:59:09.910991+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:23.974413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"114'2","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990838+0000","last_change":"2024-09-15T23:59:07.903649+0000","last_active":"2024-09-15T23:59:09.990838+0000","last_peered":"2024-09-15T23:59:09.990838+0000","last_clean":"2024-09-15T23:59:09.990838+0000","last_became_active":"2024-09-15T23:59:07.902956+0000","last_became_peered":"2024-09-15T23:59:07.902956+0000","last_unstale":"2024-09-15T23:59:09.990838+0000","last_undegraded":"2024-09-15T23:59:09.990838+0000","last_fullsized":"2024-09-15T23:59:09.990838+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:07.466223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989443+0000","last_change":"2024-09-15T23:59:08.902565+0000","last_active":"2024-09-15T23:59:09.989443+0000","last_peered":"2024-09-15T23:59:09.989443+0000","last_clean":"2024-09-15T23:59:09.989443+0000","last_became_active":"2024-09-15T23:59:08.902160+0000","last_became_peered":"2024-09-15T23:59:08.902160+0000","last_unstale":"2024-09-15T23:59:09.989443+0000","last_undegraded":"2024-09-15T23:59:09.989443+0000","last_fullsized":"2024-09-15T23:59:09.989443+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:24.413418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"115'1","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.913647+0000","last_change":"2024-09-15T23:59:07.893449+0000","last_active":"2024-09-15T23:59:09.913647+0000","last_peered":"2024-09-15T23:59:09.913647+0000","last_clean":"2024-09-15T23:59:09.913647+0000","last_became_active":"2024-09-15T23:59:07.893086+0000","last_became_peered":"2024-09-15T23:59:07.893086+0000","last_unstale":"2024-09-15T23:59:09.913647+0000","last_undegraded":"2024-09-15T23:59:09.913647+0000","last_fullsized":"2024-09-15T23:59:09.913647+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:39.302221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.908685+0000","last_change":"2024-09-15T23:59:08.903181+0000","last_active":"2024-09-15T23:59:09.908685+0000","last_peered":"2024-09-15T23:59:09.908685+0000","last_clean":"2024-09-15T23:59:09.908685+0000","last_became_active":"2024-09-15T23:59:08.902453+0000","last_became_peered":"2024-09-15T23:59:08.902453+0000","last_unstale":"2024-09-15T23:59:09.908685+0000","last_undegraded":"2024-09-15T23:59:09.908685+0000","last_fullsized":"2024-09-15T23:59:09.908685+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:31.313750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.913866+0000","last_change":"2024-09-15T23:59:07.913163+0000","last_active":"2024-09-15T23:59:09.913866+0000","last_peered":"2024-09-15T23:59:09.913866+0000","last_clean":"2024-09-15T23:59:09.913866+0000","last_became_active":"2024-09-15T23:59:07.912890+0000","last_became_peered":"2024-09-15T23:59:07.912890+0000","last_unstale":"2024-09-15T23:59:09.913866+0000","last_undegraded":"2024-09-15T23:59:09.913866+0000","last_fullsized":"2024-09-15T23:59:09.913866+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:01.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989696+0000","last_change":"2024-09-15T23:59:08.916865+0000","last_active":"2024-09-15T23:59:09.989696+0000","last_peered":"2024-09-15T23:59:09.989696+0000","last_clean":"2024-09-15T23:59:09.989696+0000","last_became_active":"2024-09-15T23:59:08.916205+0000","last_became_peered":"2024-09-15T23:59:08.916205+0000","last_unstale":"2024-09-15T23:59:09.989696+0000","last_undegraded":"2024-09-15T23:59:09.989696+0000","last_fullsized":"2024-09-15T23:59:09.989696+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:02.250201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.910981+0000","last_change":"2024-09-15T23:59:07.905993+0000","last_active":"2024-09-15T23:59:09.910981+0000","last_peered":"2024-09-15T23:59:09.910981+0000","last_clean":"2024-09-15T23:59:09.910981+0000","last_became_active":"2024-09-15T23:59:07.905239+0000","last_became_peered":"2024-09-15T23:59:07.905239+0000","last_unstale":"2024-09-15T23:59:09.910981+0000","last_undegraded":"2024-09-15T23:59:09.910981+0000","last_fullsized":"2024-09-15T23:59:09.910981+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:06.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.909105+0000","last_change":"2024-09-15T23:59:08.885109+0000","last_active":"2024-09-15T23:59:09.909105+0000","last_peered":"2024-09-15T23:59:09.909105+0000","last_clean":"2024-09-15T23:59:09.909105+0000","last_became_active":"2024-09-15T23:59:08.884262+0000","last_became_peered":"2024-09-15T23:59:08.884262+0000","last_unstale":"2024-09-15T23:59:09.909105+0000","last_undegraded":"2024-09-15T23:59:09.909105+0000","last_fullsized":"2024-09-15T23:59:09.909105+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:21.517762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.913811+0000","last_change":"2024-09-15T23:59:07.901979+0000","last_active":"2024-09-15T23:59:09.913811+0000","last_peered":"2024-09-15T23:59:09.913811+0000","last_clean":"2024-09-15T23:59:09.913811+0000","last_became_active":"2024-09-15T23:59:07.901442+0000","last_became_peered":"2024-09-15T23:59:07.901442+0000","last_unstale":"2024-09-15T23:59:09.913811+0000","last_undegraded":"2024-09-15T23:59:09.913811+0000","last_fullsized":"2024-09-15T23:59:09.913811+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:25.844482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989112+0000","last_change":"2024-09-15T23:59:08.924323+0000","last_active":"2024-09-15T23:59:09.989112+0000","last_peered":"2024-09-15T23:59:09.989112+0000","last_clean":"2024-09-15T23:59:09.989112+0000","last_became_active":"2024-09-15T23:59:08.923812+0000","last_became_peered":"2024-09-15T23:59:08.923812+0000","last_unstale":"2024-09-15T23:59:09.989112+0000","last_undegraded":"2024-09-15T23:59:09.989112+0000","last_fullsized":"2024-09-15T23:59:09.989112+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:04.502167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.991693+0000","last_change":"2024-09-15T23:59:07.903057+0000","last_active":"2024-09-15T23:59:09.991693+0000","last_peered":"2024-09-15T23:59:09.991693+0000","last_clean":"2024-09-15T23:59:09.991693+0000","last_became_active":"2024-09-15T23:59:07.902837+0000","last_became_peered":"2024-09-15T23:59:07.902837+0000","last_unstale":"2024-09-15T23:59:09.991693+0000","last_undegraded":"2024-09-15T23:59:09.991693+0000","last_fullsized":"2024-09-15T23:59:09.991693+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:06.142468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.913372+0000","last_change":"2024-09-15T23:59:08.907407+0000","last_active":"2024-09-15T23:59:09.913372+0000","last_peered":"2024-09-15T23:59:09.913372+0000","last_clean":"2024-09-15T23:59:09.913372+0000","last_became_active":"2024-09-15T23:59:08.901378+0000","last_became_peered":"2024-09-15T23:59:08.901378+0000","last_unstale":"2024-09-15T23:59:09.913372+0000","last_undegraded":"2024-09-15T23:59:09.913372+0000","last_fullsized":"2024-09-15T23:59:09.913372+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:01.161528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.989397+0000","last_change":"2024-09-15T23:59:07.915062+0000","last_active":"2024-09-15T23:59:09.989397+0000","last_peered":"2024-09-15T23:59:09.989397+0000","last_clean":"2024-09-15T23:59:09.989397+0000","last_became_active":"2024-09-15T23:59:07.914472+0000","last_became_peered":"2024-09-15T23:59:07.914472+0000","last_unstale":"2024-09-15T23:59:09.989397+0000","last_undegraded":"2024-09-15T23:59:09.989397+0000","last_fullsized":"2024-09-15T23:59:09.989397+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:31.840453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.908662+0000","last_change":"2024-09-15T23:59:08.894211+0000","last_active":"2024-09-15T23:59:09.908662+0000","last_peered":"2024-09-15T23:59:09.908662+0000","last_clean":"2024-09-15T23:59:09.908662+0000","last_became_active":"2024-09-15T23:59:08.892497+0000","last_became_peered":"2024-09-15T23:59:08.892497+0000","last_unstale":"2024-09-15T23:59:09.908662+0000","last_undegraded":"2024-09-15T23:59:09.908662+0000","last_fullsized":"2024-09-15T23:59:09.908662+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:58:16.577106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.913413+0000","last_change":"2024-09-15T23:59:07.893526+0000","last_active":"2024-09-15T23:59:09.913413+0000","last_peered":"2024-09-15T23:59:09.913413+0000","last_clean":"2024-09-15T23:59:09.913413+0000","last_became_active":"2024-09-15T23:59:07.893154+0000","last_became_peered":"2024-09-15T23:59:07.893154+0000","last_unstale":"2024-09-15T23:59:09.913413+0000","last_undegraded":"2024-09-15T23:59:09.913413+0000","last_fullsized":"2024-09-15T23:59:09.913413+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:20.891939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.913694+0000","last_change":"2024-09-15T23:59:08.907791+0000","last_active":"2024-09-15T23:59:09.913694+0000","last_peered":"2024-09-15T23:59:09.913694+0000","last_clean":"2024-09-15T23:59:09.913694+0000","last_became_active":"2024-09-15T23:59:08.907398+0000","last_became_peered":"2024-09-15T23:59:08.907398+0000","last_unstale":"2024-09-15T23:59:09.913694+0000","last_undegraded":"2024-09-15T23:59:09.913694+0000","last_fullsized":"2024-09-15T23:59:09.913694+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:07.855653+0000","last_clean_scrub_stamp":"2024-09-15T23:59:07.855653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:31.313750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"114'8","reported_seq":22,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.909130+0000","last_change":"2024-09-15T23:59:07.900278+0000","last_active":"2024-09-15T23:59:09.909130+0000","last_peered":"2024-09-15T23:59:09.909130+0000","last_clean":"2024-09-15T23:59:09.909130+0000","last_became_active":"2024-09-15T23:59:07.897567+0000","last_became_peered":"2024-09-15T23:59:07.897567+0000","last_unstale":"2024-09-15T23:59:09.909130+0000","last_undegraded":"2024-09-15T23:59:09.909130+0000","last_fullsized":"2024-09-15T23:59:09.909130+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:59:06.845650+0000","last_clean_scrub_stamp":"2024-09-15T23:59:06.845650+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:45.089067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":340,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-15T23:59:09.990641+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:59:09.990641+0000","last_peered":"2024-09-15T23:59:09.990641+0000","last_clean":"2024-09-15T23:59:09.990641+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:59:09.990641+0000","last_undegraded":"2024-09-15T23:59:09.990641+0000","last_fullsized":"2024-09-15T23:59:09.990641+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509511,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40904,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330936,"statfs":{"total":96636764160,"available":96594878464,"internally_reserved":0,"allocated":1425408,"data_stored":659711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509510,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40912,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330928,"statfs":{"total":96636764160,"available":96594870272,"internally_reserved":0,"allocated":1429504,"data_stored":659733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509511,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45072,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326768,"statfs":{"total":96636764160,"available":96590610432,"internally_reserved":0,"allocated":1433600,"data_stored":659767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509511,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40904,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330936,"statfs":{"total":96636764160,"available":96594878464,"internally_reserved":0,"allocated":1429504,"data_stored":659801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40924,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330916,"statfs":{"total":96636764160,"available":96594857984,"internally_reserved":0,"allocated":1441792,"data_stored":661905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509511,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41488,"kb_used_data":1980,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330352,"statfs":{"total":96636764160,"available":96594280448,"internally_reserved":0,"allocated":2027520,"data_stored":1250239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509510,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40916,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330924,"statfs":{"total":96636764160,"available":96594866176,"internally_reserved":0,"allocated":1437696,"data_stored":660397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41500,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330340,"statfs":{"total":96636764160,"available":96594268160,"internally_reserved":0,"allocated":2031616,"data_stored":1251691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:59:17.689 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:59:17.689 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:59:17.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa39aaf640 1 Processor -- start 2024-09-15T23:59:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa39aaf640 1 -- start start 2024-09-15T23:59:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa39aaf640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffa3415e640 0x7ffa340ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa39aaf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa340b4ab0 0x7ffa34072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa39aaf640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa340cf3c0 con 0x7ffa340cef20 2024-09-15T23:59:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa39aaf640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ffa3415ea20 con 0x7ffa3415e640 2024-09-15T23:59:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa39aaf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ffa340cf6a0 con 0x7ffa340b4ab0 2024-09-15T23:59:17.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa337fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffa3415e640 0x7ffa340ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa337fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffa3415e640 0x7ffa340ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48436/0 (socket says 172.21.15.112:48436) 2024-09-15T23:59:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa32ffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ffa340cef20 0x7ffa340b43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:57748/0 (socket says 172.21.15.112:57748) 2024-09-15T23:59:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa337fe640 1 -- 172.21.15.112:0/2714311643 learned_addr learned my addr 172.21.15.112:0/2714311643 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa33fff640 1 --2- 172.21.15.112:0/2714311643 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa340b4ab0 0x7ffa34072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa337fe640 1 -- 172.21.15.112:0/2714311643 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa340b4ab0 msgr2=0x7ffa34072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa337fe640 1 --2- 172.21.15.112:0/2714311643 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa340b4ab0 0x7ffa34072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa337fe640 1 -- 172.21.15.112:0/2714311643 >> v1:172.21.15.112:6789/0 conn(0x7ffa340cef20 legacy=0x7ffa340b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:17.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa337fe640 1 -- 172.21.15.112:0/2714311643 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa340cf980 con 0x7ffa3415e640 2024-09-15T23:59:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.860+0000 7ffa337fe640 1 --2- 172.21.15.112:0/2714311643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa3415e640 0x7ffa340ce9e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009870 tx=0x7ffa2401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6989e773134e74be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa327fc640 1 -- 172.21.15.112:0/2714311643 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa240b2070 con 0x7ffa3415e640 2024-09-15T23:59:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa327fc640 1 -- 172.21.15.112:0/2714311643 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa240a9070 con 0x7ffa3415e640 2024-09-15T23:59:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa327fc640 1 -- 172.21.15.112:0/2714311643 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa240ad880 con 0x7ffa3415e640 2024-09-15T23:59:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2714311643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa3415e640 msgr2=0x7ffa340ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 --2- 172.21.15.112:0/2714311643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa3415e640 0x7ffa340ce9e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009870 tx=0x7ffa2401c560 comp rx=0 tx=0).stop 2024-09-15T23:59:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2714311643 shutdown_connections 2024-09-15T23:59:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 --2- 172.21.15.112:0/2714311643 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa340b4ab0 0x7ffa34072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 --2- 172.21.15.112:0/2714311643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa3415e640 0x7ffa340ce9e0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2714311643 >> 172.21.15.112:0/2714311643 conn(0x7ffa340b1c80 msgr2=0x7ffa340b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2714311643 shutdown_connections 2024-09-15T23:59:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2714311643 wait complete. 2024-09-15T23:59:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 Processor -- start 2024-09-15T23:59:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 -- start start 2024-09-15T23:59:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa340b4ab0 0x7ffa3414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa340cef20 0x7ffa34159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa3415e640 0x7ffa340afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffa34073190 con 0x7ffa340b4ab0 2024-09-15T23:59:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3406f170 con 0x7ffa340cef20 2024-09-15T23:59:17.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ffa34073310 con 0x7ffa3415e640 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa337fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa340b4ab0 0x7ffa3414a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa337fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa340b4ab0 0x7ffa3414a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48440/0 (socket says 172.21.15.112:48440) 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa337fe640 1 -- 172.21.15.112:0/2748626683 learned_addr learned my addr 172.21.15.112:0/2748626683 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa337fe640 1 -- 172.21.15.112:0/2748626683 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa3415e640 msgr2=0x7ffa340afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa337fe640 1 --2- 172.21.15.112:0/2748626683 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa3415e640 0x7ffa340afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa337fe640 1 -- 172.21.15.112:0/2748626683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa340cef20 msgr2=0x7ffa34159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa32ffd640 1 --2- 172.21.15.112:0/2748626683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa340cef20 0x7ffa34159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa337fe640 1 --2- 172.21.15.112:0/2748626683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa340cef20 0x7ffa34159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa337fe640 1 -- 172.21.15.112:0/2748626683 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa34158c90 con 0x7ffa340b4ab0 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa337fe640 1 --2- 172.21.15.112:0/2748626683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa340b4ab0 0x7ffa3414a730 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7ffa240b0040 tx=0x7ffa24019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa1bfff640 1 -- 172.21.15.112:0/2748626683 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa240bb070 con 0x7ffa340b4ab0 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa1bfff640 1 -- 172.21.15.112:0/2748626683 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa240addf0 con 0x7ffa340b4ab0 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2748626683 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa34158f70 con 0x7ffa340b4ab0 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa1bfff640 1 -- 172.21.15.112:0/2748626683 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa240b2040 con 0x7ffa340b4ab0 2024-09-15T23:59:17.870 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.864+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2748626683 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa3414baa0 con 0x7ffa340b4ab0 2024-09-15T23:59:17.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.868+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2748626683 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa34072230 con 0x7ffa340b4ab0 2024-09-15T23:59:17.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.868+0000 7ffa1bfff640 1 -- 172.21.15.112:0/2748626683 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffa240be070 con 0x7ffa340b4ab0 2024-09-15T23:59:17.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.868+0000 7ffa1bfff640 1 --2- 172.21.15.112:0/2748626683 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffa200678c0 0x7ffa20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:17.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.868+0000 7ffa1bfff640 1 -- 172.21.15.112:0/2748626683 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7ffa2411edd0 con 0x7ffa340b4ab0 2024-09-15T23:59:17.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.868+0000 7ffa32ffd640 1 --2- 172.21.15.112:0/2748626683 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffa200678c0 0x7ffa20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:17.871 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.868+0000 7ffa32ffd640 1 --2- 172.21.15.112:0/2748626683 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffa200678c0 0x7ffa20069d80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ffa3414d600 tx=0x7ffa28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:17.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:17.872+0000 7ffa1bfff640 1 -- 172.21.15.112:0/2748626683 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffa24016150 con 0x7ffa340b4ab0 2024-09-15T23:59:18.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.076+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2748626683 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ffa34158190 con 0x7ffa340b4ab0 2024-09-15T23:59:18.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.080+0000 7ffa1bfff640 1 -- 172.21.15.112:0/2748626683 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7ffa240ef7f0 con 0x7ffa340b4ab0 2024-09-15T23:59:18.079 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-15T23:59:18.079 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBNc+dmObPUMRAAA0uNRTs2Is9y5hQJLD00zw== 2024-09-15T23:59:18.079 INFO:teuthology.orchestra.run.smithi112.stdout: caps mds = "allow" 2024-09-15T23:59:18.079 INFO:teuthology.orchestra.run.smithi112.stdout: caps mon = "allow r" 2024-09-15T23:59:18.079 INFO:teuthology.orchestra.run.smithi112.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:59:18.080 INFO:teuthology.orchestra.run.smithi112.stderr:updated caps for client.0 2024-09-15T23:59:18.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.080+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2748626683 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffa200678c0 msgr2=0x7ffa20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.080+0000 7ffa39aaf640 1 --2- 172.21.15.112:0/2748626683 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffa200678c0 0x7ffa20069d80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ffa3414d600 tx=0x7ffa28009040 comp rx=0 tx=0).stop 2024-09-15T23:59:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.080+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2748626683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa340b4ab0 msgr2=0x7ffa3414a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.080+0000 7ffa39aaf640 1 --2- 172.21.15.112:0/2748626683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa340b4ab0 0x7ffa3414a730 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7ffa240b0040 tx=0x7ffa24019300 comp rx=0 tx=0).stop 2024-09-15T23:59:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.080+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2748626683 shutdown_connections 2024-09-15T23:59:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.080+0000 7ffa39aaf640 1 --2- 172.21.15.112:0/2748626683 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffa200678c0 0x7ffa20069d80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.080+0000 7ffa39aaf640 1 --2- 172.21.15.112:0/2748626683 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa3415e640 0x7ffa340afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.080+0000 7ffa39aaf640 1 --2- 172.21.15.112:0/2748626683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa340cef20 0x7ffa34159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.080+0000 7ffa39aaf640 1 --2- 172.21.15.112:0/2748626683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa340b4ab0 0x7ffa3414a730 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.080+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2748626683 >> 172.21.15.112:0/2748626683 conn(0x7ffa340b1c80 msgr2=0x7ffa340ad0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.080+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2748626683 shutdown_connections 2024-09-15T23:59:18.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.080+0000 7ffa39aaf640 1 -- 172.21.15.112:0/2748626683 wait complete. 2024-09-15T23:59:18.097 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:59:18.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.216+0000 7f4b993d8640 1 Processor -- start 2024-09-15T23:59:18.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.216+0000 7f4b993d8640 1 -- start start 2024-09-15T23:59:18.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.216+0000 7f4b993d8640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4b9415c2a0 0x7f4b940aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.216+0000 7f4b993d8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b940af2a0 0x7f4b9406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.216+0000 7f4b993d8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b940b3290 con 0x7f4b9415bec0 2024-09-15T23:59:18.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.216+0000 7f4b993d8640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4b940b3570 con 0x7f4b9415c2a0 2024-09-15T23:59:18.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.216+0000 7f4b993d8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4b940b3850 con 0x7f4b940af2a0 2024-09-15T23:59:18.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.216+0000 7f4b927fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4b9415c2a0 0x7f4b940aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.216+0000 7f4b927fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4b9415c2a0 0x7f4b940aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48452/0 (socket says 172.21.15.112:48452) 2024-09-15T23:59:18.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.216+0000 7f4b927fc640 1 -- 172.21.15.112:0/2573696941 learned_addr learned my addr 172.21.15.112:0/2573696941 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:18.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.216+0000 7f4b937fe640 1 --2- 172.21.15.112:0/2573696941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b940af2a0 0x7f4b9406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.220+0000 7f4b927fc640 1 -- 172.21.15.112:0/2573696941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b940af2a0 msgr2=0x7f4b9406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:18.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.220+0000 7f4b927fc640 1 --2- 172.21.15.112:0/2573696941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b940af2a0 0x7f4b9406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.220+0000 7f4b927fc640 1 -- 172.21.15.112:0/2573696941 >> v1:172.21.15.169:6789/0 conn(0x7f4b9415bec0 legacy=0x7f4b940ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.219 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.220+0000 7f4b927fc640 1 -- 172.21.15.112:0/2573696941 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b940b3b30 con 0x7f4b9415c2a0 2024-09-15T23:59:18.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.220+0000 7f4b927fc640 1 --2- 172.21.15.112:0/2573696941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9415c2a0 0x7f4b940aed60 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009870 tx=0x7f4b8801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3f1244d096f259 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:18.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.220+0000 7f4b91ffb640 1 -- 172.21.15.112:0/2573696941 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b880a95f0 con 0x7f4b9415c2a0 2024-09-15T23:59:18.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.220+0000 7f4b91ffb640 1 -- 172.21.15.112:0/2573696941 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b880a9790 con 0x7f4b9415c2a0 2024-09-15T23:59:18.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.220+0000 7f4b91ffb640 1 -- 172.21.15.112:0/2573696941 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b880a9b60 con 0x7f4b9415c2a0 2024-09-15T23:59:18.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.220+0000 7f4b993d8640 1 -- 172.21.15.112:0/2573696941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9415c2a0 msgr2=0x7f4b940aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.220+0000 7f4b993d8640 1 --2- 172.21.15.112:0/2573696941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9415c2a0 0x7f4b940aed60 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009870 tx=0x7f4b8801c530 comp rx=0 tx=0).stop 2024-09-15T23:59:18.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 -- 172.21.15.112:0/2573696941 shutdown_connections 2024-09-15T23:59:18.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 --2- 172.21.15.112:0/2573696941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b940af2a0 0x7f4b9406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 --2- 172.21.15.112:0/2573696941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9415c2a0 0x7f4b940aed60 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 -- 172.21.15.112:0/2573696941 >> 172.21.15.112:0/2573696941 conn(0x7f4b940b1f90 msgr2=0x7f4b940b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:18.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 -- 172.21.15.112:0/2573696941 shutdown_connections 2024-09-15T23:59:18.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 -- 172.21.15.112:0/2573696941 wait complete. 2024-09-15T23:59:18.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 Processor -- start 2024-09-15T23:59:18.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 -- start start 2024-09-15T23:59:18.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b940af2a0 0x7f4b940998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b9415bec0 0x7f4b9414a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9415c2a0 0x7f4b9414c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9406ed50 con 0x7f4b9415c2a0 2024-09-15T23:59:18.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b940af6b0 con 0x7f4b940af2a0 2024-09-15T23:59:18.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9406eed0 con 0x7f4b9415bec0 2024-09-15T23:59:18.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b937fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9415c2a0 0x7f4b9414c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b937fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9415c2a0 0x7f4b9414c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48456/0 (socket says 172.21.15.112:48456) 2024-09-15T23:59:18.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b937fe640 1 -- 172.21.15.112:0/101874841 learned_addr learned my addr 172.21.15.112:0/101874841 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:18.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b927fc640 1 --2- 172.21.15.112:0/101874841 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b9415bec0 0x7f4b9414a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b92ffd640 1 --2- 172.21.15.112:0/101874841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b940af2a0 0x7f4b940998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b937fe640 1 -- 172.21.15.112:0/101874841 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b9415bec0 msgr2=0x7f4b9414a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b937fe640 1 --2- 172.21.15.112:0/101874841 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b9415bec0 0x7f4b9414a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b937fe640 1 -- 172.21.15.112:0/101874841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b940af2a0 msgr2=0x7f4b940998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b937fe640 1 --2- 172.21.15.112:0/101874841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b940af2a0 0x7f4b940998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b937fe640 1 -- 172.21.15.112:0/101874841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b94154a10 con 0x7f4b9415c2a0 2024-09-15T23:59:18.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b937fe640 1 --2- 172.21.15.112:0/101874841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9415c2a0 0x7f4b9414c260 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c007e40 tx=0x7f4b8c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:18.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b7b7fe640 1 -- 172.21.15.112:0/101874841 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c014620 con 0x7f4b9415c2a0 2024-09-15T23:59:18.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b7b7fe640 1 -- 172.21.15.112:0/101874841 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8c019070 con 0x7f4b9415c2a0 2024-09-15T23:59:18.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 -- 172.21.15.112:0/101874841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b941499a0 con 0x7f4b9415c2a0 2024-09-15T23:59:18.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b7b7fe640 1 -- 172.21.15.112:0/101874841 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c014a20 con 0x7f4b9415c2a0 2024-09-15T23:59:18.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.224+0000 7f4b993d8640 1 -- 172.21.15.112:0/101874841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b94099e10 con 0x7f4b9415c2a0 2024-09-15T23:59:18.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.228+0000 7f4b993d8640 1 -- 172.21.15.112:0/101874841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9406e000 con 0x7f4b9415c2a0 2024-09-15T23:59:18.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.228+0000 7f4b7b7fe640 1 -- 172.21.15.112:0/101874841 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b8c014bc0 con 0x7f4b9415c2a0 2024-09-15T23:59:18.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.228+0000 7f4b7b7fe640 1 --2- 172.21.15.112:0/101874841 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b800678f0 0x7f4b80069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.228+0000 7f4b7b7fe640 1 -- 172.21.15.112:0/101874841 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f4b8c086650 con 0x7f4b9415c2a0 2024-09-15T23:59:18.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.228+0000 7f4b92ffd640 1 --2- 172.21.15.112:0/101874841 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b800678f0 0x7f4b80069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.228+0000 7f4b92ffd640 1 --2- 172.21.15.112:0/101874841 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b800678f0 0x7f4b80069db0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4b84001650 tx=0x7f4b84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:18.232 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.232+0000 7f4b7b7fe640 1 -- 172.21.15.112:0/101874841 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4b8c057090 con 0x7f4b9415c2a0 2024-09-15T23:59:18.414 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.412+0000 7f4b993d8640 1 -- 172.21.15.112:0/101874841 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b9415f990 con 0x7f4b9415c2a0 2024-09-15T23:59:18.415 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.416+0000 7f4b7b7fe640 1 -- 172.21.15.112:0/101874841 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5237 (secure 0 0 0) 0x7f4b8c056990 con 0x7f4b9415c2a0 2024-09-15T23:59:18.416 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:18.416 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":72,"btime":"2024-09-15T23:59:11:908708+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2146678161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2146678161},{"type":"v1","addr":"172.21.15.169:6835","nonce":2146678161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1904671431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1904671431},{"type":"v1","addr":"172.21.15.169:6833","nonce":1904671431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3435773285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3435773285},{"type":"v1","addr":"172.21.15.112:6835","nonce":3435773285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:59:08.241764+0000","modified":"2024-09-15T23:59:11.248014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7209":{"gid":7209,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2554639091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2554639091},{"type":"v1","addr":"172.21.15.112:6837","nonce":2554639091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7209,"qdb_cluster":[7209]},"id":8}]} 2024-09-15T23:59:18.416 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 72 2024-09-15T23:59:18.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.416+0000 7f4b993d8640 1 -- 172.21.15.112:0/101874841 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b800678f0 msgr2=0x7f4b80069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.416+0000 7f4b993d8640 1 --2- 172.21.15.112:0/101874841 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b800678f0 0x7f4b80069db0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4b84001650 tx=0x7f4b84009040 comp rx=0 tx=0).stop 2024-09-15T23:59:18.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.416+0000 7f4b993d8640 1 -- 172.21.15.112:0/101874841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9415c2a0 msgr2=0x7f4b9414c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.416+0000 7f4b993d8640 1 --2- 172.21.15.112:0/101874841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9415c2a0 0x7f4b9414c260 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c007e40 tx=0x7f4b8c00e4b0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.416+0000 7f4b993d8640 1 -- 172.21.15.112:0/101874841 shutdown_connections 2024-09-15T23:59:18.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.416+0000 7f4b993d8640 1 --2- 172.21.15.112:0/101874841 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b800678f0 0x7f4b80069db0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.416+0000 7f4b993d8640 1 --2- 172.21.15.112:0/101874841 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b9415c2a0 0x7f4b9414c260 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.416+0000 7f4b993d8640 1 --2- 172.21.15.112:0/101874841 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b9415bec0 0x7f4b9414a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.416+0000 7f4b993d8640 1 --2- 172.21.15.112:0/101874841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b940af2a0 0x7f4b940998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.416+0000 7f4b993d8640 1 -- 172.21.15.112:0/101874841 >> 172.21.15.112:0/101874841 conn(0x7f4b940b1f90 msgr2=0x7f4b940b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:18.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.416+0000 7f4b993d8640 1 -- 172.21.15.112:0/101874841 shutdown_connections 2024-09-15T23:59:18.418 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.416+0000 7f4b993d8640 1 -- 172.21.15.112:0/101874841 wait complete. 2024-09-15T23:59:18.835 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:59:08.241764+0000', 'modified': '2024-09-15T23:59:11.248014+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7209}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7209': {'gid': 7209, 'name': 'a', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6837/2554639091', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 2554639091}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 2554639091}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7209, 'qdb_cluster': [7209]} 2024-09-15T23:59:18.835 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:59:18.835 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T23:59:18.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.968+0000 7fc08b2bf640 1 Processor -- start 2024-09-15T23:59:18.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.968+0000 7fc08b2bf640 1 -- start start 2024-09-15T23:59:18.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.968+0000 7fc08b2bf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0841520a0 0x7fc08406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.968+0000 7fc08b2bf640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc084070250 con 0x7fc08415f3a0 2024-09-15T23:59:18.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.968+0000 7fc08b2bf640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0840aede0 con 0x7fc08406fe50 2024-09-15T23:59:18.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.968+0000 7fc08b2bf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc084152480 con 0x7fc0841520a0 2024-09-15T23:59:18.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.968+0000 7fc08985c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fc08415f3a0 0x7fc0840adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47892/0 (socket says 172.21.15.112:47892) 2024-09-15T23:59:18.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.968+0000 7fc08985c640 1 -- 172.21.15.112:0/3872583691 learned_addr learned my addr 172.21.15.112:0/3872583691 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:18.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.968+0000 7fc08905b640 1 --2- 172.21.15.112:0/3872583691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0841520a0 0x7fc08406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 -- 172.21.15.112:0/3872583691 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 42250412 0 0) 0x7fc084070250 con 0x7fc08415f3a0 2024-09-15T23:59:18.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 -- 172.21.15.112:0/3872583691 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc070003530 con 0x7fc08415f3a0 2024-09-15T23:59:18.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 -- 172.21.15.112:0/3872583691 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2513957245 0 0) 0x7fc070003530 con 0x7fc08415f3a0 2024-09-15T23:59:18.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 -- 172.21.15.112:0/3872583691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0841520a0 msgr2=0x7fc08406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:18.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 --2- 172.21.15.112:0/3872583691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0841520a0 0x7fc08406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 -- 172.21.15.112:0/3872583691 >> v1:172.21.15.169:6789/0 conn(0x7fc08406fe50 legacy=0x7fc08415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 -- 172.21.15.112:0/3872583691 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08415fa10 con 0x7fc08415f3a0 2024-09-15T23:59:18.973 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 -- 172.21.15.112:0/3872583691 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fc07c001680 con 0x7fc08415f3a0 2024-09-15T23:59:18.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 -- 172.21.15.112:0/3872583691 >> v1:172.21.15.112:6789/0 conn(0x7fc08415f3a0 legacy=0x7fc0840adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 --2- 172.21.15.112:0/3872583691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0700039f0 0x7fc070003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 --2- 172.21.15.112:0/3872583691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0841520a0 0x7fc070004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 --2- 172.21.15.112:0/3872583691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc070004d50 0x7fc0700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 -- 172.21.15.112:0/3872583691 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc07000b9d0 con 0x7fc070004d50 2024-09-15T23:59:18.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 -- 172.21.15.112:0/3872583691 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc07000bb50 con 0x7fc0700039f0 2024-09-15T23:59:18.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 -- 172.21.15.112:0/3872583691 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc07000bd50 con 0x7fc0841520a0 2024-09-15T23:59:18.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08985c640 1 --2- 172.21.15.112:0/3872583691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc070004d50 0x7fc0700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08905b640 1 --2- 172.21.15.112:0/3872583691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0700039f0 0x7fc070003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08985c640 1 -- 172.21.15.112:0/3872583691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0841520a0 msgr2=0x7fc070004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:18.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08885a640 1 --2- 172.21.15.112:0/3872583691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0841520a0 0x7fc070004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08985c640 1 --2- 172.21.15.112:0/3872583691 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0841520a0 0x7fc070004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08985c640 1 -- 172.21.15.112:0/3872583691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0700039f0 msgr2=0x7fc070003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:18.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08985c640 1 --2- 172.21.15.112:0/3872583691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0700039f0 0x7fc070003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08985c640 1 -- 172.21.15.112:0/3872583691 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc070003530 con 0x7fc070004d50 2024-09-15T23:59:18.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08905b640 1 --2- 172.21.15.112:0/3872583691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0700039f0 0x7fc070003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:18.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08985c640 1 --2- 172.21.15.112:0/3872583691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc070004d50 0x7fc0700051d0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00c240 tx=0x7fc07c01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34dbe2a1ccc41d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:18.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 -- 172.21.15.112:0/3872583691 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c007d20 con 0x7fc070004d50 2024-09-15T23:59:18.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 -- 172.21.15.112:0/3872583691 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07c005ae0 con 0x7fc070004d50 2024-09-15T23:59:18.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc07bfff640 1 -- 172.21.15.112:0/3872583691 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c007070 con 0x7fc070004d50 2024-09-15T23:59:18.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08b2bf640 1 -- 172.21.15.112:0/3872583691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc070004d50 msgr2=0x7fc0700051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08b2bf640 1 --2- 172.21.15.112:0/3872583691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc070004d50 0x7fc0700051d0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00c240 tx=0x7fc07c01f3d0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08985c640 1 -- 172.21.15.112:0/3872583691 reap_dead start 2024-09-15T23:59:18.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08b2bf640 1 -- 172.21.15.112:0/3872583691 shutdown_connections 2024-09-15T23:59:18.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08b2bf640 1 -- 172.21.15.112:0/3872583691 >> 172.21.15.112:0/3872583691 conn(0x7fc0840b1f90 msgr2=0x7fc0840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:18.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08b2bf640 1 -- 172.21.15.112:0/3872583691 shutdown_connections 2024-09-15T23:59:18.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.972+0000 7fc08b2bf640 1 -- 172.21.15.112:0/3872583691 wait complete. 2024-09-15T23:59:18.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08b2bf640 1 Processor -- start 2024-09-15T23:59:18.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08b2bf640 1 -- start start 2024-09-15T23:59:18.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08b2bf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0841f3850 0x7fc08414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08b2bf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc08414f610 0x7fc0840b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08b2bf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0840b37d0 0x7fc0840b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08b2bf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc084073770 con 0x7fc08414f610 2024-09-15T23:59:18.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08b2bf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc084073490 con 0x7fc0841f3850 2024-09-15T23:59:18.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08b2bf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc084073a50 con 0x7fc0840b37d0 2024-09-15T23:59:18.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08885a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc08414f610 0x7fc0840b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08885a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc08414f610 0x7fc0840b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34162/0 (socket says 172.21.15.112:34162) 2024-09-15T23:59:18.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08885a640 1 -- 172.21.15.112:0/592810164 learned_addr learned my addr 172.21.15.112:0/592810164 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:18.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08985c640 1 --2- 172.21.15.112:0/592810164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0840b37d0 0x7fc0840b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08905b640 1 --2- 172.21.15.112:0/592810164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0841f3850 0x7fc08414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08885a640 1 -- 172.21.15.112:0/592810164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0840b37d0 msgr2=0x7fc0840b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08885a640 1 --2- 172.21.15.112:0/592810164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0840b37d0 0x7fc0840b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08885a640 1 -- 172.21.15.112:0/592810164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0841f3850 msgr2=0x7fc08414f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08885a640 1 --2- 172.21.15.112:0/592810164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0841f3850 0x7fc08414f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08885a640 1 -- 172.21.15.112:0/592810164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08414fc50 con 0x7fc08414f610 2024-09-15T23:59:18.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08885a640 1 --2- 172.21.15.112:0/592810164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc08414f610 0x7fc0840b3290 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fc07400d5f0 tx=0x7fc07400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:18.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc079ffb640 1 -- 172.21.15.112:0/592810164 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074005480 con 0x7fc08414f610 2024-09-15T23:59:18.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc079ffb640 1 -- 172.21.15.112:0/592810164 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc074017070 con 0x7fc08414f610 2024-09-15T23:59:18.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08b2bf640 1 -- 172.21.15.112:0/592810164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08414ff30 con 0x7fc08414f610 2024-09-15T23:59:18.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc079ffb640 1 -- 172.21.15.112:0/592810164 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074003840 con 0x7fc08414f610 2024-09-15T23:59:18.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.976+0000 7fc08b2bf640 1 -- 172.21.15.112:0/592810164 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0841504f0 con 0x7fc08414f610 2024-09-15T23:59:18.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc079ffb640 1 -- 172.21.15.112:0/592810164 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc0740039e0 con 0x7fc08414f610 2024-09-15T23:59:18.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc079ffb640 1 --2- 172.21.15.112:0/592810164 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc0680678f0 0x7fc068069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc079ffb640 1 -- 172.21.15.112:0/592810164 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7fc074085c90 con 0x7fc08414f610 2024-09-15T23:59:18.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08905b640 1 --2- 172.21.15.112:0/592810164 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc0680678f0 0x7fc068069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08905b640 1 --2- 172.21.15.112:0/592810164 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc0680678f0 0x7fc068069db0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc080007520 tx=0x7fc08000d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:18.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 Processor -- start 2024-09-15T23:59:18.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 -- start start 2024-09-15T23:59:18.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c25967db20 0x55c25967df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c259633d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259634290 0x55c259634670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c25951bb60 con 0x55c25967e440 2024-09-15T23:59:18.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c259482c70 con 0x55c259634290 2024-09-15T23:59:18.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55c259428ed0 con 0x55c25967db20 2024-09-15T23:59:18.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08885a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c259633d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08885a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c259633d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34170/0 (socket says 172.21.15.112:34170) 2024-09-15T23:59:18.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08885a640 1 -- 172.21.15.112:0/3922147728 learned_addr learned my addr 172.21.15.112:0/3922147728 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:18.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08905b640 1 --2- 172.21.15.112:0/3922147728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c25967db20 0x55c25967df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08985c640 1 --2- 172.21.15.112:0/3922147728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259634290 0x55c259634670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08885a640 1 -- 172.21.15.112:0/3922147728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c25967db20 msgr2=0x55c25967df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:18.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08885a640 1 --2- 172.21.15.112:0/3922147728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c25967db20 0x55c25967df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08885a640 1 -- 172.21.15.112:0/3922147728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259634290 msgr2=0x55c259634670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:18.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08885a640 1 --2- 172.21.15.112:0/3922147728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259634290 0x55c259634670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08885a640 1 -- 172.21.15.112:0/3922147728 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c25943ae50 con 0x55c25967e440 2024-09-15T23:59:18.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08885a640 1 --2- 172.21.15.112:0/3922147728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c259633d50 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fc074084030 tx=0x7fc074001240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2595be7a7dc268c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:18.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc06effd640 1 -- 172.21.15.112:0/3922147728 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07405eb20 con 0x55c25967e440 2024-09-15T23:59:18.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc06effd640 1 -- 172.21.15.112:0/3922147728 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc074084140 con 0x55c25967e440 2024-09-15T23:59:18.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc06effd640 1 -- 172.21.15.112:0/3922147728 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0740541b0 con 0x55c25967e440 2024-09-15T23:59:18.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 -- 172.21.15.112:0/3922147728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 msgr2=0x55c259633d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 --2- 172.21.15.112:0/3922147728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c259633d50 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fc074084030 tx=0x7fc074001240 comp rx=0 tx=0).stop 2024-09-15T23:59:18.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 -- 172.21.15.112:0/3922147728 shutdown_connections 2024-09-15T23:59:18.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 --2- 172.21.15.112:0/3922147728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259634290 0x55c259634670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.990 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 --2- 172.21.15.112:0/3922147728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c259633d50 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 --2- 172.21.15.112:0/3922147728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c25967db20 0x55c25967df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 -- 172.21.15.112:0/3922147728 >> 172.21.15.112:0/3922147728 conn(0x55c25963a600 msgr2=0x55c259632630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 -- 172.21.15.112:0/3922147728 shutdown_connections 2024-09-15T23:59:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.980+0000 7fc08e37b000 1 -- 172.21.15.112:0/3922147728 wait complete. 2024-09-15T23:59:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 -- start start 2024-09-15T23:59:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 Processor -- start 2024-09-15T23:59:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967db20 0x55c259638e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c25967e440 0x55c25963ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259639390 0x55c25963f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c2594e4b00 con 0x55c25967db20 2024-09-15T23:59:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c25945d360 con 0x55c259639390 2024-09-15T23:59:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55c25945a2d0 con 0x55c25967e440 2024-09-15T23:59:18.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 10 client.0 _ll_register_callbacks cb 0x55c25961f820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:59:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08905b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967db20 0x55c259638e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08905b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967db20 0x55c259638e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34186/0 (socket says 172.21.15.112:34186) 2024-09-15T23:59:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08905b640 1 -- 172.21.15.112:0/3580102142 learned_addr learned my addr 172.21.15.112:0/3580102142 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08985c640 1 --2- 172.21.15.112:0/3580102142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259639390 0x55c25963f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08905b640 1 -- 172.21.15.112:0/3580102142 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c25967e440 msgr2=0x55c25963ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08905b640 1 --2- 172.21.15.112:0/3580102142 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c25967e440 0x55c25963ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08905b640 1 -- 172.21.15.112:0/3580102142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259639390 msgr2=0x55c25963f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08905b640 1 --2- 172.21.15.112:0/3580102142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259639390 0x55c25963f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08905b640 1 -- 172.21.15.112:0/3580102142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c259429120 con 0x55c25967db20 2024-09-15T23:59:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08905b640 1 --2- 172.21.15.112:0/3580102142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967db20 0x55c259638e50 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc080018b10 tx=0x7fc080004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b15aa0f0a54087 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc063fff640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:59:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc063fff640 1 -- 172.21.15.112:0/3580102142 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080016df0 con 0x55c25967db20 2024-09-15T23:59:18.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 -- 172.21.15.112:0/3580102142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc074084140 con 0x55c25967db20 2024-09-15T23:59:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc063fff640 1 -- 172.21.15.112:0/3580102142 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7fc080023410 con 0x55c25967db20 2024-09-15T23:59:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc063fff640 1 -- 172.21.15.112:0/3580102142 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fc080030050 con 0x55c25967db20 2024-09-15T23:59:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 10 client.7365 fetch_fsmap learned FSMap version 72 2024-09-15T23:59:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 -- 172.21.15.112:0/3580102142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55c259422450 con 0x55c25967db20 2024-09-15T23:59:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc063fff640 1 -- 172.21.15.112:0/3580102142 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc074084140 con 0x55c25967db20 2024-09-15T23:59:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc063fff640 1 -- 172.21.15.112:0/3580102142 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7fc080033020 con 0x55c25967db20 2024-09-15T23:59:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 10 client.7365 fetch_fsmap finished waiting for FSMap version 72 2024-09-15T23:59:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 10 client.7365 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:59:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 20 client.7365 populate_metadata read hostname 'smithi112' 2024-09-15T23:59:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 --2- 172.21.15.112:0/3580102142 >> [v2:172.21.15.112:6836/2554639091,v1:172.21.15.112:6837/2554639091] conn(0x55c25968c280 0x55c25968e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 4 client.7365 mds_command: new command op to 7209 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:59:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 -- 172.21.15.112:0/3580102142 --> [v2:172.21.15.112:6836/2554639091,v1:172.21.15.112:6837/2554639091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c25941cc00 con 0x55c25968c280 2024-09-15T23:59:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08885a640 1 --2- 172.21.15.112:0/3580102142 >> [v2:172.21.15.112:6836/2554639091,v1:172.21.15.112:6837/2554639091] conn(0x55c25968c280 0x55c25968e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:18.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08885a640 1 --2- 172.21.15.112:0/3580102142 >> [v2:172.21.15.112:6836/2554639091,v1:172.21.15.112:6837/2554639091] conn(0x55c25968c280 0x55c25968e670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e982e6317ba623d server_cookie=cee7be5a6568ba62 in_seq=0 out_seq=0 2024-09-15T23:59:18.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc063fff640 10 client.7365 ms_handle_connect on v2:172.21.15.112:6836/2554639091 2024-09-15T23:59:18.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc063fff640 1 -- 172.21.15.112:0/3580102142 <== mds.0 v2:172.21.15.112:6836/2554639091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c25941cc00 con 0x55c25968c280 2024-09-15T23:59:18.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc063fff640 10 client.7365 handle_command_reply: tid=0 2024-09-15T23:59:18.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 client.7365 shutdown 2024-09-15T23:59:18.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 -- 172.21.15.112:0/3580102142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967db20 msgr2=0x55c259638e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:18.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 --2- 172.21.15.112:0/3580102142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967db20 0x55c259638e50 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc080018b10 tx=0x7fc080004ac0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 -- 172.21.15.112:0/3580102142 shutdown_connections 2024-09-15T23:59:18.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 --2- 172.21.15.112:0/3580102142 >> [v2:172.21.15.112:6836/2554639091,v1:172.21.15.112:6837/2554639091] conn(0x55c25968c280 0x55c25968e670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 --2- 172.21.15.112:0/3580102142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259639390 0x55c25963f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 --2- 172.21.15.112:0/3580102142 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c25967e440 0x55c25963ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc063fff640 0 client.7365 ms_handle_reset on v2:172.21.15.112:6836/2554639091 2024-09-15T23:59:18.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 --2- 172.21.15.112:0/3580102142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967db20 0x55c259638e50 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:18.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.984+0000 7fc08e37b000 1 -- 172.21.15.112:0/3580102142 >> 172.21.15.112:0/3580102142 conn(0x55c259634290 msgr2=0x55c259632d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:18.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.988+0000 7fc08e37b000 1 -- 172.21.15.112:0/3580102142 shutdown_connections 2024-09-15T23:59:18.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.988+0000 7fc08e37b000 1 -- 172.21.15.112:0/3580102142 wait complete. 2024-09-15T23:59:18.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:18.988+0000 7fc08e37b000 20 client.7365 trim_cache size 0 max 16384 2024-09-15T23:59:19.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08e37b000 1 Processor -- start 2024-09-15T23:59:19.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08e37b000 1 -- start start 2024-09-15T23:59:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08e37b000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259639390 0x55c25967ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08e37b000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c25967db20 0x55c25967d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08e37b000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c25968e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08e37b000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc084200970 con 0x55c25967e440 2024-09-15T23:59:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08e37b000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc084153b80 con 0x55c259639390 2024-09-15T23:59:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08e37b000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc084200320 con 0x55c25967db20 2024-09-15T23:59:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08985c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c25968e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08985c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c25968e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34202/0 (socket says 172.21.15.112:34202) 2024-09-15T23:59:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08985c640 1 -- 172.21.15.112:0/922934219 learned_addr learned my addr 172.21.15.112:0/922934219 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08885a640 1 --2- 172.21.15.112:0/922934219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c25967db20 0x55c25967d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08905b640 1 --2- 172.21.15.112:0/922934219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259639390 0x55c25967ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08985c640 1 -- 172.21.15.112:0/922934219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c25967db20 msgr2=0x55c25967d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:19.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08985c640 1 --2- 172.21.15.112:0/922934219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c25967db20 0x55c25967d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08985c640 1 -- 172.21.15.112:0/922934219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259639390 msgr2=0x55c25967ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:19.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08985c640 1 --2- 172.21.15.112:0/922934219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259639390 0x55c25967ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08985c640 1 -- 172.21.15.112:0/922934219 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c259409fd0 con 0x55c25967e440 2024-09-15T23:59:19.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.004+0000 7fc08985c640 1 --2- 172.21.15.112:0/922934219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c25968e670 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00c240 tx=0x7fc08415b580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b2fce08925b951 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:19.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc06e7fc640 1 -- 172.21.15.112:0/922934219 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c001c60 con 0x55c25967e440 2024-09-15T23:59:19.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc06e7fc640 1 -- 172.21.15.112:0/922934219 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07c001440 con 0x55c25967e440 2024-09-15T23:59:19.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc06e7fc640 1 -- 172.21.15.112:0/922934219 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c0048b0 con 0x55c25967e440 2024-09-15T23:59:19.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 -- 172.21.15.112:0/922934219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 msgr2=0x55c25968e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:19.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 --2- 172.21.15.112:0/922934219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c25968e670 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00c240 tx=0x7fc08415b580 comp rx=0 tx=0).stop 2024-09-15T23:59:19.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 -- 172.21.15.112:0/922934219 shutdown_connections 2024-09-15T23:59:19.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 --2- 172.21.15.112:0/922934219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c25968e670 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 --2- 172.21.15.112:0/922934219 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c25967db20 0x55c25967d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 --2- 172.21.15.112:0/922934219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c259639390 0x55c25967ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 -- 172.21.15.112:0/922934219 >> 172.21.15.112:0/922934219 conn(0x55c259634290 msgr2=0x55c259638650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:19.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 -- 172.21.15.112:0/922934219 shutdown_connections 2024-09-15T23:59:19.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 -- 172.21.15.112:0/922934219 wait complete. 2024-09-15T23:59:19.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 -- start start 2024-09-15T23:59:19.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 Processor -- start 2024-09-15T23:59:19.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c259639390 0x55c259691590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:19.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c25967db20 0x55c2596ac960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:19.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c2596acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:19.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c259481f80 con 0x55c25967e440 2024-09-15T23:59:19.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c25943aca0 con 0x55c25967db20 2024-09-15T23:59:19.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55c2594872a0 con 0x55c259639390 2024-09-15T23:59:19.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 10 client.0 _ll_register_callbacks cb 0x7fc080009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:59:19.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08985c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c2596acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:19.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08985c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c2596acea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34216/0 (socket says 172.21.15.112:34216) 2024-09-15T23:59:19.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08985c640 1 -- 172.21.15.112:0/2912552907 learned_addr learned my addr 172.21.15.112:0/2912552907 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:19.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08885a640 1 --2- 172.21.15.112:0/2912552907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c25967db20 0x55c2596ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:19.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08985c640 1 -- 172.21.15.112:0/2912552907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c259639390 msgr2=0x55c259691590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:19.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08905b640 1 --2- 172.21.15.112:0/2912552907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c259639390 0x55c259691590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:19.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08985c640 1 --2- 172.21.15.112:0/2912552907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c259639390 0x55c259691590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08985c640 1 -- 172.21.15.112:0/2912552907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c25967db20 msgr2=0x55c2596ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:19.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08985c640 1 --2- 172.21.15.112:0/2912552907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c25967db20 0x55c2596ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08985c640 1 -- 172.21.15.112:0/2912552907 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c259505750 con 0x55c25967e440 2024-09-15T23:59:19.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08885a640 1 --2- 172.21.15.112:0/2912552907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c25967db20 0x55c2596ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:19.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08985c640 1 --2- 172.21.15.112:0/2912552907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c2596acea0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fc07c01fc70 tx=0x7fc07c01dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d638ca36fe83ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:19.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc063fff640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-15T23:59:19.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc063fff640 1 -- 172.21.15.112:0/2912552907 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c0c9060 con 0x55c25967e440 2024-09-15T23:59:19.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc063fff640 1 -- 172.21.15.112:0/2912552907 <== mon.0 v2:172.21.15.112:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7fc07c007d20 con 0x55c25967e440 2024-09-15T23:59:19.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 -- 172.21.15.112:0/2912552907 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc07c001440 con 0x55c25967e440 2024-09-15T23:59:19.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc063fff640 1 -- 172.21.15.112:0/2912552907 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fc07c0cf050 con 0x55c25967e440 2024-09-15T23:59:19.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 10 client.7371 fetch_fsmap learned FSMap version 72 2024-09-15T23:59:19.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 -- 172.21.15.112:0/2912552907 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55c259410a30 con 0x55c25967e440 2024-09-15T23:59:19.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc063fff640 1 -- 172.21.15.112:0/2912552907 <== mon.0 v2:172.21.15.112:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07c001440 con 0x55c25967e440 2024-09-15T23:59:19.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc063fff640 1 -- 172.21.15.112:0/2912552907 <== mon.0 v2:172.21.15.112:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7fc07c0d2020 con 0x55c25967e440 2024-09-15T23:59:19.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 10 client.7371 fetch_fsmap finished waiting for FSMap version 72 2024-09-15T23:59:19.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 10 client.7371 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:59:19.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 20 client.7371 populate_metadata read hostname 'smithi112' 2024-09-15T23:59:19.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 --2- 172.21.15.112:0/2912552907 >> [v2:172.21.15.112:6836/2554639091,v1:172.21.15.112:6837/2554639091] conn(0x55c2596ad3e0 0x55c2596f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:19.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 4 client.7371 mds_command: new command op to 7209 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:59:19.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08e37b000 1 -- 172.21.15.112:0/2912552907 --> [v2:172.21.15.112:6836/2554639091,v1:172.21.15.112:6837/2554639091] -- command(tid 0: {"prefix": "status"}) -- 0x55c2594903a0 con 0x55c2596ad3e0 2024-09-15T23:59:19.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08905b640 1 --2- 172.21.15.112:0/2912552907 >> [v2:172.21.15.112:6836/2554639091,v1:172.21.15.112:6837/2554639091] conn(0x55c2596ad3e0 0x55c2596f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:19.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc063fff640 10 client.7371 ms_handle_connect on v2:172.21.15.112:6836/2554639091 2024-09-15T23:59:19.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.008+0000 7fc08905b640 1 --2- 172.21.15.112:0/2912552907 >> [v2:172.21.15.112:6836/2554639091,v1:172.21.15.112:6837/2554639091] conn(0x55c2596ad3e0 0x55c2596f0c00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c45351a162e47d0 server_cookie=18f3be73f0eac4c7 in_seq=0 out_seq=0 2024-09-15T23:59:19.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc063fff640 1 -- 172.21.15.112:0/2912552907 <== mds.0 v2:172.21.15.112:6836/2554639091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x55c2594903a0 con 0x55c2596ad3e0 2024-09-15T23:59:19.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc063fff640 10 client.7371 handle_command_reply: tid=0 2024-09-15T23:59:19.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08e37b000 1 client.7371 shutdown 2024-09-15T23:59:19.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08e37b000 1 -- 172.21.15.112:0/2912552907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 msgr2=0x55c2596acea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:19.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08e37b000 1 --2- 172.21.15.112:0/2912552907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c2596acea0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fc07c01fc70 tx=0x7fc07c01dc10 comp rx=0 tx=0).stop 2024-09-15T23:59:19.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08e37b000 1 -- 172.21.15.112:0/2912552907 shutdown_connections 2024-09-15T23:59:19.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08e37b000 1 --2- 172.21.15.112:0/2912552907 >> [v2:172.21.15.112:6836/2554639091,v1:172.21.15.112:6837/2554639091] conn(0x55c2596ad3e0 0x55c2596f0c00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08e37b000 1 --2- 172.21.15.112:0/2912552907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c25967e440 0x55c2596acea0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08e37b000 1 --2- 172.21.15.112:0/2912552907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c25967db20 0x55c2596ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc063fff640 0 client.7371 ms_handle_reset on v2:172.21.15.112:6836/2554639091 2024-09-15T23:59:19.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08e37b000 1 --2- 172.21.15.112:0/2912552907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c259639390 0x55c259691590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08e37b000 1 -- 172.21.15.112:0/2912552907 >> 172.21.15.112:0/2912552907 conn(0x55c259634290 msgr2=0x55c25967bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:19.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08e37b000 1 -- 172.21.15.112:0/2912552907 shutdown_connections 2024-09-15T23:59:19.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08e37b000 1 -- 172.21.15.112:0/2912552907 wait complete. 2024-09-15T23:59:19.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08e37b000 20 client.7371 trim_cache size 0 max 16384 2024-09-15T23:59:19.017 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:59:19.018 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_fsid": "1af6b673-4d40-4109-af4e-78662faa7df8", 2024-09-15T23:59:19.018 INFO:teuthology.orchestra.run.smithi112.stdout: "whoami": 0, 2024-09-15T23:59:19.018 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 7209, 2024-09-15T23:59:19.018 INFO:teuthology.orchestra.run.smithi112.stdout: "want_state": "up:active", 2024-09-15T23:59:19.018 INFO:teuthology.orchestra.run.smithi112.stdout: "state": "up:active", 2024-09-15T23:59:19.018 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs", 2024-09-15T23:59:19.018 INFO:teuthology.orchestra.run.smithi112.stdout: "rank_uptime": 10.107308624, 2024-09-15T23:59:19.018 INFO:teuthology.orchestra.run.smithi112.stdout: "mdsmap_epoch": 72, 2024-09-15T23:59:19.018 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch": 115, 2024-09-15T23:59:19.018 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_epoch_barrier": 115, 2024-09-15T23:59:19.018 INFO:teuthology.orchestra.run.smithi112.stdout: "uptime": 15.13975855 2024-09-15T23:59:19.018 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:59:19.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08b2bf640 1 -- 172.21.15.112:0/592810164 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc0680678f0 msgr2=0x7fc068069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:19.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08b2bf640 1 --2- 172.21.15.112:0/592810164 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc0680678f0 0x7fc068069db0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc080007520 tx=0x7fc08000d040 comp rx=0 tx=0).stop 2024-09-15T23:59:19.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08b2bf640 1 -- 172.21.15.112:0/592810164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc08414f610 msgr2=0x7fc0840b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:19.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08b2bf640 1 --2- 172.21.15.112:0/592810164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc08414f610 0x7fc0840b3290 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fc07400d5f0 tx=0x7fc07400dab0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08b2bf640 1 -- 172.21.15.112:0/592810164 shutdown_connections 2024-09-15T23:59:19.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08b2bf640 1 --2- 172.21.15.112:0/592810164 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc0680678f0 0x7fc068069db0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08b2bf640 1 --2- 172.21.15.112:0/592810164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0840b37d0 0x7fc0840b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08b2bf640 1 --2- 172.21.15.112:0/592810164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc08414f610 0x7fc0840b3290 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08b2bf640 1 --2- 172.21.15.112:0/592810164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0841f3850 0x7fc08414f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08b2bf640 1 -- 172.21.15.112:0/592810164 >> 172.21.15.112:0/592810164 conn(0x7fc0840b1f90 msgr2=0x7fc084154690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:19.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08b2bf640 1 -- 172.21.15.112:0/592810164 shutdown_connections 2024-09-15T23:59:19.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.012+0000 7fc08b2bf640 1 -- 172.21.15.112:0/592810164 wait complete. 2024-09-15T23:59:19.027 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:59:19.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.140+0000 7f47fa178640 1 Processor -- start 2024-09-15T23:59:19.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.140+0000 7f47fa178640 1 -- start start 2024-09-15T23:59:19.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.140+0000 7f47fa178640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f47f40cf620 0x7f47f4168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:19.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.140+0000 7f47fa178640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f40d0300 con 0x7f47f40d3060 2024-09-15T23:59:19.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.140+0000 7f47fa178640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f406e6c0 con 0x7f47f4161a60 2024-09-15T23:59:19.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.140+0000 7f47fa178640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f47f40cfa90 con 0x7f47f40cf620 2024-09-15T23:59:19.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.140+0000 7f47f3fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f47f40cf620 0x7f47f4168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:19.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.140+0000 7f47f2ffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f47f40d3060 0x7f47f40cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47904/0 (socket says 172.21.15.112:47904) 2024-09-15T23:59:19.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.140+0000 7f47f2ffd640 1 -- 172.21.15.112:0/3426265543 learned_addr learned my addr 172.21.15.112:0/3426265543 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:19.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.140+0000 7f47f3fff640 1 -- 172.21.15.112:0/3426265543 >> v1:172.21.15.169:6789/0 conn(0x7f47f4161a60 legacy=0x7f47f40d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:19.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.140+0000 7f47f3fff640 1 -- 172.21.15.112:0/3426265543 >> v1:172.21.15.112:6789/0 conn(0x7f47f40d3060 legacy=0x7f47f40cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:19.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.140+0000 7f47f3fff640 1 -- 172.21.15.112:0/3426265543 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f40b0f60 con 0x7f47f40cf620 2024-09-15T23:59:19.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.140+0000 7f47f3fff640 1 --2- 172.21.15.112:0/3426265543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f40cf620 0x7f47f4168f10 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f47e40097c0 tx=0x7f47e401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e018e2f9835b00a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:19.142 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47f27fc640 1 -- 172.21.15.112:0/3426265543 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e40b1070 con 0x7f47f40cf620 2024-09-15T23:59:19.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47f27fc640 1 -- 172.21.15.112:0/3426265543 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e40ac600 con 0x7f47f40cf620 2024-09-15T23:59:19.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47f27fc640 1 -- 172.21.15.112:0/3426265543 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e40ac9d0 con 0x7f47f40cf620 2024-09-15T23:59:19.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 -- 172.21.15.112:0/3426265543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f40cf620 msgr2=0x7f47f4168f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:19.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 --2- 172.21.15.112:0/3426265543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f40cf620 0x7f47f4168f10 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f47e40097c0 tx=0x7f47e401c3a0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 -- 172.21.15.112:0/3426265543 shutdown_connections 2024-09-15T23:59:19.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 --2- 172.21.15.112:0/3426265543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f40cf620 0x7f47f4168f10 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 -- 172.21.15.112:0/3426265543 >> 172.21.15.112:0/3426265543 conn(0x7f47f408bf90 msgr2=0x7f47f409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:19.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 -- 172.21.15.112:0/3426265543 shutdown_connections 2024-09-15T23:59:19.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 -- 172.21.15.112:0/3426265543 wait complete. 2024-09-15T23:59:19.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 Processor -- start 2024-09-15T23:59:19.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 -- start start 2024-09-15T23:59:19.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47f40cf620 0x7f47f4159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:19.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47f40d3060 0x7f47f40d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:19.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f4161a60 0x7f47f40d1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:19.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f47f416bc70 con 0x7f47f4161a60 2024-09-15T23:59:19.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f47f406d190 con 0x7f47f40d3060 2024-09-15T23:59:19.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47fa178640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f47f416bdf0 con 0x7f47f40cf620 2024-09-15T23:59:19.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47f3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f4161a60 0x7f47f40d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:19.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47f3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f4161a60 0x7f47f40d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34226/0 (socket says 172.21.15.112:34226) 2024-09-15T23:59:19.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47f3fff640 1 -- 172.21.15.112:0/3276790684 learned_addr learned my addr 172.21.15.112:0/3276790684 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:19.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47f2ffd640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47f40d3060 0x7f47f40d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:19.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.144+0000 7f47f37fe640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47f40cf620 0x7f47f4159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:19.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47f3fff640 1 -- 172.21.15.112:0/3276790684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47f40cf620 msgr2=0x7f47f4159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:19.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47f3fff640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47f40cf620 0x7f47f4159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47f3fff640 1 -- 172.21.15.112:0/3276790684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47f40d3060 msgr2=0x7f47f40d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:19.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47f3fff640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47f40d3060 0x7f47f40d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47f3fff640 1 -- 172.21.15.112:0/3276790684 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f41611f0 con 0x7f47f4161a60 2024-09-15T23:59:19.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47f2ffd640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47f40d3060 0x7f47f40d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:19.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47f37fe640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47f40cf620 0x7f47f4159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:19.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47f3fff640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f4161a60 0x7f47f40d1100 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f47e4018fb0 tx=0x7f47e401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:19.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47ebfff640 1 -- 172.21.15.112:0/3276790684 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e40bb020 con 0x7f47f4161a60 2024-09-15T23:59:19.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47ebfff640 1 -- 172.21.15.112:0/3276790684 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e40b7620 con 0x7f47f4161a60 2024-09-15T23:59:19.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47fa178640 1 -- 172.21.15.112:0/3276790684 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f40c9610 con 0x7f47f4161a60 2024-09-15T23:59:19.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47ebfff640 1 -- 172.21.15.112:0/3276790684 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e40b1040 con 0x7f47f4161a60 2024-09-15T23:59:19.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47fa178640 1 -- 172.21.15.112:0/3276790684 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f40c9bd0 con 0x7f47f4161a60 2024-09-15T23:59:19.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47fa178640 1 -- 172.21.15.112:0/3276790684 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f40cef10 con 0x7f47f4161a60 2024-09-15T23:59:19.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47ebfff640 1 -- 172.21.15.112:0/3276790684 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f47e40be020 con 0x7f47f4161a60 2024-09-15T23:59:19.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47ebfff640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f47d40678c0 0x7f47d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:19.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47f37fe640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f47d40678c0 0x7f47d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:19.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47ebfff640 1 -- 172.21.15.112:0/3276790684 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f47e4120250 con 0x7f47f4161a60 2024-09-15T23:59:19.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.148+0000 7f47f37fe640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f47d40678c0 0x7f47d4069d80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f47f40c7d70 tx=0x7f47ec0073c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:19.155 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.156+0000 7f47ebfff640 1 -- 172.21.15.112:0/3276790684 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f47e40c5030 con 0x7f47f4161a60 2024-09-15T23:59:19.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.348+0000 7f47fa178640 1 -- 172.21.15.112:0/3276790684 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f47f40d2c30 con 0x7f47f4161a60 2024-09-15T23:59:19.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.348+0000 7f47ebfff640 1 -- 172.21.15.112:0/3276790684 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) ==== 53+0+73 (secure 0 0 0) 0x7f47e4016050 con 0x7f47f4161a60 2024-09-15T23:59:19.350 INFO:teuthology.orchestra.run.smithi112.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:59:19.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.352+0000 7f47fa178640 1 -- 172.21.15.112:0/3276790684 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f47d40678c0 msgr2=0x7f47d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:19.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.352+0000 7f47fa178640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f47d40678c0 0x7f47d4069d80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f47f40c7d70 tx=0x7f47ec0073c0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.352+0000 7f47fa178640 1 -- 172.21.15.112:0/3276790684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f4161a60 msgr2=0x7f47f40d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:19.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.352+0000 7f47fa178640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f4161a60 0x7f47f40d1100 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f47e4018fb0 tx=0x7f47e401abe0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.352+0000 7f47fa178640 1 -- 172.21.15.112:0/3276790684 shutdown_connections 2024-09-15T23:59:19.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.352+0000 7f47fa178640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f47d40678c0 0x7f47d4069d80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.352+0000 7f47fa178640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47f4161a60 0x7f47f40d1100 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.352+0000 7f47fa178640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47f40d3060 0x7f47f40d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.352+0000 7f47fa178640 1 --2- 172.21.15.112:0/3276790684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47f40cf620 0x7f47f4159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:19.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.352+0000 7f47fa178640 1 -- 172.21.15.112:0/3276790684 >> 172.21.15.112:0/3276790684 conn(0x7f47f408bf90 msgr2=0x7f47f406de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:19.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.352+0000 7f47fa178640 1 -- 172.21.15.112:0/3276790684 shutdown_connections 2024-09-15T23:59:19.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19.352+0000 7f47fa178640 1 -- 172.21.15.112:0/3276790684 wait complete. 2024-09-15T23:59:19.367 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:59:19.368 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:59:19.368 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-15T23:59:19.368 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:59:19.368 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:59:19.368 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:59:19.368 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:59:19.368 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:59:19.368 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:59:19.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:19.368 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-15T23:59:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:59:19.374 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:59:19.374 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:59:19.374 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:59:19.374 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-15T23:59:19.374 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:59:19.374 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:59:19.374 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:59:19.375 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-15T23:59:19.375 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:59:19.375 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:59:19.375 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-15T23:59:19.375 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T23:59:19.375 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:59:19.375 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:59:19.375 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:59:19.375 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T23:59:19.375 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42137sec preferred_lft 42137sec 2024-09-15T23:59:19.375 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link 2024-09-15T23:59:19.375 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:59:19.375 INFO:teuthology.orchestra.run.smithi112.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T23:59:19.375 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 02:42:5c:cd:1e:d6 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:59:19.376 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T23:59:19.376 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:59:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:59:19.376 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T23:59:19.376 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:59:19.376 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:59:19.376 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T23:59:19.376 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:59:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:59:19.376 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:59:19.376 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T23:59:19.376 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:59:19.376 INFO:teuthology.orchestra.run.smithi112.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:59:19.376 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:59:19.377 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T23:59:19.377 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:59:19.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:19.377 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:59:19.428 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-15T23:59:19.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:19.430 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-15T23:59:19.479 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-15T23:59:19.479 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:59:19.479 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T23:59:19.479 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:59:19.479 INFO:teuthology.orchestra.run.smithi112.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T23:59:19.479 INFO:teuthology.orchestra.run.smithi112.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T23:59:19.479 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:59:19.479 INFO:teuthology.orchestra.run.smithi112.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:59:19.479 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:59:19.479 INFO:teuthology.orchestra.run.smithi112.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T23:59:19.479 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:59:19.480 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:59:19.480 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-15T23:59:19.480 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:59:19.480 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:59:19.480 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:59:19.480 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-15T23:59:19.565 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:59:19.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:59:19.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:19.600 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-15T23:59:19.646 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:59:19.647 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:59:19.647 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:59:19.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:19.647 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-15T23:59:19.702 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T23:59:19.702 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:59:19.702 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:59:19.751 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:59:19.751 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:59:19.751 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:59:19.798 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:59:19.857 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:59:19.908 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:59:19.908 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:59:19.908 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:59:19.908 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:59:19.908 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:59:19.909 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:59:19.909 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:59:19.909 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:59:19.909 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:59:19.909 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:59:19.909 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:59:19.909 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:59:19.909 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:59:19.909 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:59:19.909 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:59:19.909 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:59:19.909 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:59:19.909 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:59:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:59:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:59:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:59:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:59:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:59:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:59:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:59:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:59:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:59:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:59:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:59:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:59:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:59:19.910 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:59:19.911 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:59:19.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:19.911 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:59:19.963 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:59:19.964 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T23:59:20.012 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:59:20.026 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:59:20.076 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:59:20.076 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:59:20.076 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:59:20.076 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:59:20.077 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:59:20.077 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:59:20.077 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:59:20.077 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:59:20.077 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:59:20.077 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:59:20.078 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:59:20.078 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:59:20.078 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:59:20.078 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:59:20.078 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:59:20.078 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:59:20.078 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:59:20.078 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:59:20.078 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:59:20.078 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:59:20.078 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:59:20.079 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:59:20.079 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:59:20.079 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:59:20.079 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:59:20.079 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:59:20.079 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:59:20.079 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:59:20.079 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:59:20.079 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:59:20.079 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:59:20.079 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:59:20.079 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:59:20.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:20.080 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:59:20.091 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:2024-09-15T23:59:20.092+0000 7fbe433e0580 -1 init, newargv = 0x556e22df1e50 newargc=15 2024-09-15T23:59:20.091 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[46841]: starting ceph client 2024-09-15T23:59:20.097 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[46841]: starting fuse 2024-09-15T23:59:21.197 DEBUG:teuthology.orchestra.run.smithi112:> sudo modprobe fuse 2024-09-15T23:59:21.213 DEBUG:teuthology.orchestra.run.smithi112:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:59:21.264 INFO:teuthology.orchestra.run.smithi112.stdout:/sys 2024-09-15T23:59:21.264 INFO:teuthology.orchestra.run.smithi112.stdout:/proc 2024-09-15T23:59:21.264 INFO:teuthology.orchestra.run.smithi112.stdout:/dev 2024-09-15T23:59:21.264 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/pts 2024-09-15T23:59:21.264 INFO:teuthology.orchestra.run.smithi112.stdout:/run 2024-09-15T23:59:21.264 INFO:teuthology.orchestra.run.smithi112.stdout:/ 2024-09-15T23:59:21.265 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/security 2024-09-15T23:59:21.265 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/shm 2024-09-15T23:59:21.265 INFO:teuthology.orchestra.run.smithi112.stdout:/run/lock 2024-09-15T23:59:21.265 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/cgroup 2024-09-15T23:59:21.265 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/pstore 2024-09-15T23:59:21.265 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/bpf 2024-09-15T23:59:21.265 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:59:21.265 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/hugepages 2024-09-15T23:59:21.265 INFO:teuthology.orchestra.run.smithi112.stdout:/dev/mqueue 2024-09-15T23:59:21.265 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/debug 2024-09-15T23:59:21.265 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/tracing 2024-09-15T23:59:21.265 INFO:teuthology.orchestra.run.smithi112.stdout:/proc/fs/nfsd 2024-09-15T23:59:21.265 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/fs/fuse/connections 2024-09-15T23:59:21.266 INFO:teuthology.orchestra.run.smithi112.stdout:/sys/kernel/config 2024-09-15T23:59:21.266 INFO:teuthology.orchestra.run.smithi112.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T23:59:21.266 INFO:teuthology.orchestra.run.smithi112.stdout:/run/rpc_pipefs 2024-09-15T23:59:21.266 INFO:teuthology.orchestra.run.smithi112.stdout:/run/user/1000 2024-09-15T23:59:21.266 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph 2024-09-15T23:59:21.266 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:59:21.266 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:59:21.266 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:59:21.266 INFO:teuthology.orchestra.run.smithi112.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T23:59:21.266 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns 2024-09-15T23:59:21.266 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:59:21.267 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:59:21.267 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:59:21.267 INFO:teuthology.orchestra.run.smithi112.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:59:21.267 INFO:teuthology.orchestra.run.smithi112.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:59:21.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:21.268 DEBUG:teuthology.orchestra.run.smithi112:> ls /sys/fs/fuse/connections 2024-09-15T23:59:21.315 INFO:teuthology.orchestra.run.smithi112.stdout:45 2024-09-15T23:59:21.315 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T23:59:21.315 DEBUG:teuthology.orchestra.run.smithi112:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:59:21.315 DEBUG:teuthology.orchestra.run.smithi112:> import glob 2024-09-15T23:59:21.315 DEBUG:teuthology.orchestra.run.smithi112:> import re 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> import subprocess 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> def _find_admin_socket(client_name): 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> files = glob.glob(asok_path) 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> # Given a non-glob path, it better be there 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> if "*" not in asok_path: 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> assert(len(files) == 1) 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> return files[0] 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> for f in files: 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:59:21.316 DEBUG:teuthology.orchestra.run.smithi112:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:59:21.317 DEBUG:teuthology.orchestra.run.smithi112:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:59:21.317 DEBUG:teuthology.orchestra.run.smithi112:> contents = proc_f.read() 2024-09-15T23:59:21.317 DEBUG:teuthology.orchestra.run.smithi112:> if mountpoint in contents: 2024-09-15T23:59:21.317 DEBUG:teuthology.orchestra.run.smithi112:> return f 2024-09-15T23:59:21.317 DEBUG:teuthology.orchestra.run.smithi112:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:59:21.317 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:59:21.317 DEBUG:teuthology.orchestra.run.smithi112:> print(_find_admin_socket("client.0")) 2024-09-15T23:59:21.317 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:59:21.443 INFO:teuthology.orchestra.run.smithi112.stdout:/var/run/ceph/ceph-client.0.46841.asok 2024-09-15T23:59:21.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:59:21.456 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46841.asok 2024-09-15T23:59:21.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:21.456 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46841.asok status 2024-09-15T23:59:21.613 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:59:21.613 INFO:teuthology.orchestra.run.smithi112.stdout: "metadata": { 2024-09-15T23:59:21.613 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:59:21.613 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:59:21.613 INFO:teuthology.orchestra.run.smithi112.stdout: "entity_id": "0", 2024-09-15T23:59:21.613 INFO:teuthology.orchestra.run.smithi112.stdout: "hostname": "smithi112", 2024-09-15T23:59:21.614 INFO:teuthology.orchestra.run.smithi112.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:59:21.614 INFO:teuthology.orchestra.run.smithi112.stdout: "pid": "46841", 2024-09-15T23:59:21.614 INFO:teuthology.orchestra.run.smithi112.stdout: "root": "/" 2024-09-15T23:59:21.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:21.614 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_count": 0, 2024-09-15T23:59:21.614 INFO:teuthology.orchestra.run.smithi112.stdout: "dentry_pinned_count": 0, 2024-09-15T23:59:21.614 INFO:teuthology.orchestra.run.smithi112.stdout: "id": 7389, 2024-09-15T23:59:21.614 INFO:teuthology.orchestra.run.smithi112.stdout: "inst": { 2024-09-15T23:59:21.614 INFO:teuthology.orchestra.run.smithi112.stdout: "name": { 2024-09-15T23:59:21.614 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "client", 2024-09-15T23:59:21.614 INFO:teuthology.orchestra.run.smithi112.stdout: "num": 7389 2024-09-15T23:59:21.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:21.614 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:59:21.615 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:59:21.615 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:59:21.615 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2054761061 2024-09-15T23:59:21.615 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:59:21.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:21.615 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": { 2024-09-15T23:59:21.615 INFO:teuthology.orchestra.run.smithi112.stdout: "type": "v1", 2024-09-15T23:59:21.615 INFO:teuthology.orchestra.run.smithi112.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:59:21.615 INFO:teuthology.orchestra.run.smithi112.stdout: "nonce": 2054761061 2024-09-15T23:59:21.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:59:21.615 INFO:teuthology.orchestra.run.smithi112.stdout: "inst_str": "client.7389 192.168.0.1:0/2054761061", 2024-09-15T23:59:21.615 INFO:teuthology.orchestra.run.smithi112.stdout: "addr_str": "192.168.0.1:0/2054761061", 2024-09-15T23:59:21.615 INFO:teuthology.orchestra.run.smithi112.stdout: "inode_count": 1, 2024-09-15T23:59:21.615 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_epoch": 72, 2024-09-15T23:59:21.616 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch": 115, 2024-09-15T23:59:21.616 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:59:21.616 INFO:teuthology.orchestra.run.smithi112.stdout: "blocklisted": false, 2024-09-15T23:59:21.616 INFO:teuthology.orchestra.run.smithi112.stdout: "fs_name": "cephfs" 2024-09-15T23:59:21.616 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:59:21.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:21.627 DEBUG:teuthology.orchestra.run.smithi112:> stat --file-system '--printf=%T 2024-09-15T23:59:21.627 DEBUG:teuthology.orchestra.run.smithi112:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:59:21.633 INFO:teuthology.orchestra.run.smithi112.stdout:fuseblk 2024-09-15T23:59:21.633 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:59:21.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:21.633 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:59:21.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:21.688 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_1) 2024-09-15T23:59:21.745 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:59:21.745 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:59:21.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:21.796 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=dir_1/file_a bs=1M conv=fdatasync count=8 seek=0) 2024-09-15T23:59:21.946 INFO:teuthology.orchestra.run.smithi112.stderr:8+0 records in 2024-09-15T23:59:21.946 INFO:teuthology.orchestra.run.smithi112.stderr:8+0 records out 2024-09-15T23:59:21.946 INFO:teuthology.orchestra.run.smithi112.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0991431 s, 84.6 MB/s 2024-09-15T23:59:21.947 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-15T23:59:21.947 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:59:21.948 DEBUG:teuthology.orchestra.run.smithi112:> import stat 2024-09-15T23:59:21.948 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:59:21.948 DEBUG:teuthology.orchestra.run.smithi112:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_1/file_a").st_ino) 2024-09-15T23:59:21.948 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:59:22.013 INFO:teuthology.orchestra.run.smithi112.stdout:1099511627777 2024-09-15T23:59:22.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:59:22.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:22.023 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_2) 2024-09-15T23:59:22.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:22.080 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir_1/file_a dir_2/file_b) 2024-09-15T23:59:22.138 DEBUG:teuthology.orchestra.run.smithi112:> stdin-killer -- python3 -c ' 2024-09-15T23:59:22.138 DEBUG:teuthology.orchestra.run.smithi112:> import os 2024-09-15T23:59:22.138 DEBUG:teuthology.orchestra.run.smithi112:> import stat 2024-09-15T23:59:22.138 DEBUG:teuthology.orchestra.run.smithi112:> 2024-09-15T23:59:22.139 DEBUG:teuthology.orchestra.run.smithi112:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_2/file_b").st_ino) 2024-09-15T23:59:22.139 DEBUG:teuthology.orchestra.run.smithi112:> ' 2024-09-15T23:59:22.247 INFO:teuthology.orchestra.run.smithi112.stdout:1099511627777 2024-09-15T23:59:22.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:59:22.257 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:59:22.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f4179a0b640 1 Processor -- start 2024-09-15T23:59:22.423 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f4179a0b640 1 -- start start 2024-09-15T23:59:22.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f4179a0b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f417415bec0 0x7f41740ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f4179a0b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f417415c2a0 0x7f41740aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f4179a0b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f41740af2a0 0x7f417415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f4179a0b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f41740b3290 con 0x7f41740af2a0 2024-09-15T23:59:22.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f4179a0b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f41740b3570 con 0x7f417415c2a0 2024-09-15T23:59:22.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f4179a0b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f41740b3850 con 0x7f417415bec0 2024-09-15T23:59:22.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f41737fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f41740af2a0 0x7f417415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f41737fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f41740af2a0 0x7f417415fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34240/0 (socket says 172.21.15.112:34240) 2024-09-15T23:59:22.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f41737fe640 1 -- 172.21.15.112:0/100700820 learned_addr learned my addr 172.21.15.112:0/100700820 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:22.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f41727fc640 1 --2- 172.21.15.112:0/100700820 >> v2:172.21.15.169:3300/0 conn(0x7f417415c2a0 0x7f41740aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f4172ffd640 1 --2- 172.21.15.112:0/100700820 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f417415bec0 0x7f41740ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f41737fe640 1 -- 172.21.15.112:0/100700820 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f417415bec0 msgr2=0x7f41740ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:22.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f41737fe640 1 --2- 172.21.15.112:0/100700820 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f417415bec0 0x7f41740ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f41737fe640 1 -- 172.21.15.112:0/100700820 >> v2:172.21.15.169:3300/0 conn(0x7f417415c2a0 msgr2=0x7f41740aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:22.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f41737fe640 1 --2- 172.21.15.112:0/100700820 >> v2:172.21.15.169:3300/0 conn(0x7f417415c2a0 0x7f41740aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f41737fe640 1 -- 172.21.15.112:0/100700820 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41740b3b30 con 0x7f41740af2a0 2024-09-15T23:59:22.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f4172ffd640 1 --2- 172.21.15.112:0/100700820 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f417415bec0 0x7f41740ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:22.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.424+0000 7f41727fc640 1 --2- 172.21.15.112:0/100700820 >> v2:172.21.15.169:3300/0 conn(0x7f417415c2a0 0x7f41740aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:22.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f41737fe640 1 --2- 172.21.15.112:0/100700820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41740af2a0 0x7f417415fc60 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f417406de20 tx=0x7f416c01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db97b6bf9c62853d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:22.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4171ffb640 1 -- 172.21.15.112:0/100700820 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c0a5580 con 0x7f41740af2a0 2024-09-15T23:59:22.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4171ffb640 1 -- 172.21.15.112:0/100700820 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416c0a5720 con 0x7f41740af2a0 2024-09-15T23:59:22.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4171ffb640 1 -- 172.21.15.112:0/100700820 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c0a5af0 con 0x7f41740af2a0 2024-09-15T23:59:22.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 -- 172.21.15.112:0/100700820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41740af2a0 msgr2=0x7f417415fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:22.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 --2- 172.21.15.112:0/100700820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41740af2a0 0x7f417415fc60 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f417406de20 tx=0x7f416c01c700 comp rx=0 tx=0).stop 2024-09-15T23:59:22.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 -- 172.21.15.112:0/100700820 shutdown_connections 2024-09-15T23:59:22.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 --2- 172.21.15.112:0/100700820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41740af2a0 0x7f417415fc60 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 --2- 172.21.15.112:0/100700820 >> v2:172.21.15.169:3300/0 conn(0x7f417415c2a0 0x7f41740aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 --2- 172.21.15.112:0/100700820 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f417415bec0 0x7f41740ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 -- 172.21.15.112:0/100700820 >> 172.21.15.112:0/100700820 conn(0x7f41740b1f90 msgr2=0x7f41740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:22.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 -- 172.21.15.112:0/100700820 shutdown_connections 2024-09-15T23:59:22.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 -- 172.21.15.112:0/100700820 wait complete. 2024-09-15T23:59:22.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 Processor -- start 2024-09-15T23:59:22.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 -- start start 2024-09-15T23:59:22.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41740af2a0 0x7f417409ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f417415bec0 0x7f41741511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f417415c2a0 0x7f41740998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f41740ad740 con 0x7f417415c2a0 2024-09-15T23:59:22.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41740afc90 con 0x7f41740af2a0 2024-09-15T23:59:22.431 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f417406e000 con 0x7f417415bec0 2024-09-15T23:59:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f41737fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f417415c2a0 0x7f41740998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f41737fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f417415c2a0 0x7f41740998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34250/0 (socket says 172.21.15.112:34250) 2024-09-15T23:59:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f41737fe640 1 -- 172.21.15.112:0/1543041871 learned_addr learned my addr 172.21.15.112:0/1543041871 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f41727fc640 1 --2- 172.21.15.112:0/1543041871 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f417415bec0 0x7f41741511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4172ffd640 1 --2- 172.21.15.112:0/1543041871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41740af2a0 0x7f417409ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f41737fe640 1 -- 172.21.15.112:0/1543041871 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f417415bec0 msgr2=0x7f41741511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f41737fe640 1 --2- 172.21.15.112:0/1543041871 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f417415bec0 0x7f41741511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f41737fe640 1 -- 172.21.15.112:0/1543041871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41740af2a0 msgr2=0x7f417409ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f41737fe640 1 --2- 172.21.15.112:0/1543041871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41740af2a0 0x7f417409ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f41737fe640 1 -- 172.21.15.112:0/1543041871 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4174152a50 con 0x7f417415c2a0 2024-09-15T23:59:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f41737fe640 1 --2- 172.21.15.112:0/1543041871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f417415c2a0 0x7f41740998d0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f416c0af040 tx=0x7f416c0194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f415bfff640 1 -- 172.21.15.112:0/1543041871 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c009510 con 0x7f417415c2a0 2024-09-15T23:59:22.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f415bfff640 1 -- 172.21.15.112:0/1543041871 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416c0be070 con 0x7f417415c2a0 2024-09-15T23:59:22.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 -- 172.21.15.112:0/1543041871 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41741518f0 con 0x7f417415c2a0 2024-09-15T23:59:22.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f415bfff640 1 -- 172.21.15.112:0/1543041871 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c0b8890 con 0x7f417415c2a0 2024-09-15T23:59:22.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.428+0000 7f4179a0b640 1 -- 172.21.15.112:0/1543041871 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4174151eb0 con 0x7f417415c2a0 2024-09-15T23:59:22.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.432+0000 7f4179a0b640 1 -- 172.21.15.112:0/1543041871 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f417409c590 con 0x7f417415c2a0 2024-09-15T23:59:22.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.432+0000 7f415bfff640 1 -- 172.21.15.112:0/1543041871 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f416c0b8a30 con 0x7f417415c2a0 2024-09-15T23:59:22.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.432+0000 7f415bfff640 1 --2- 172.21.15.112:0/1543041871 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f41600678c0 0x7f4160069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.432+0000 7f415bfff640 1 -- 172.21.15.112:0/1543041871 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f416c120ed0 con 0x7f417415c2a0 2024-09-15T23:59:22.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.432+0000 7f4172ffd640 1 --2- 172.21.15.112:0/1543041871 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f41600678c0 0x7f4160069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.432+0000 7f4172ffd640 1 --2- 172.21.15.112:0/1543041871 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f41600678c0 0x7f4160069d80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f416400a9a0 tx=0x7f4164008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:22.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.436+0000 7f415bfff640 1 -- 172.21.15.112:0/1543041871 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f416c0165e0 con 0x7f417415c2a0 2024-09-15T23:59:22.632 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.632+0000 7f4179a0b640 1 -- 172.21.15.112:0/1543041871 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41740ad200 con 0x7f417415c2a0 2024-09-15T23:59:22.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.632+0000 7f415bfff640 1 -- 172.21.15.112:0/1543041871 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5237 (secure 0 0 0) 0x7f416c0f19a0 con 0x7f417415c2a0 2024-09-15T23:59:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:22.633 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":72,"btime":"2024-09-15T23:59:11:908708+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2146678161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2146678161},{"type":"v1","addr":"172.21.15.169:6835","nonce":2146678161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1904671431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1904671431},{"type":"v1","addr":"172.21.15.169:6833","nonce":1904671431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3435773285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3435773285},{"type":"v1","addr":"172.21.15.112:6835","nonce":3435773285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:59:08.241764+0000","modified":"2024-09-15T23:59:11.248014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7209":{"gid":7209,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2554639091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2554639091},{"type":"v1","addr":"172.21.15.112:6837","nonce":2554639091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7209,"qdb_cluster":[7209]},"id":8}]} 2024-09-15T23:59:22.633 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 72 2024-09-15T23:59:22.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.636+0000 7f4179a0b640 1 -- 172.21.15.112:0/1543041871 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f41600678c0 msgr2=0x7f4160069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:22.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.636+0000 7f4179a0b640 1 --2- 172.21.15.112:0/1543041871 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f41600678c0 0x7f4160069d80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f416400a9a0 tx=0x7f4164008040 comp rx=0 tx=0).stop 2024-09-15T23:59:22.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.636+0000 7f4179a0b640 1 -- 172.21.15.112:0/1543041871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f417415c2a0 msgr2=0x7f41740998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:22.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.636+0000 7f4179a0b640 1 --2- 172.21.15.112:0/1543041871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f417415c2a0 0x7f41740998d0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f416c0af040 tx=0x7f416c0194a0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.636+0000 7f4179a0b640 1 -- 172.21.15.112:0/1543041871 shutdown_connections 2024-09-15T23:59:22.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.636+0000 7f4179a0b640 1 --2- 172.21.15.112:0/1543041871 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f41600678c0 0x7f4160069d80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.636+0000 7f4179a0b640 1 --2- 172.21.15.112:0/1543041871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f417415c2a0 0x7f41740998d0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.636+0000 7f4179a0b640 1 --2- 172.21.15.112:0/1543041871 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f417415bec0 0x7f41741511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.636+0000 7f4179a0b640 1 --2- 172.21.15.112:0/1543041871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41740af2a0 0x7f417409ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.636+0000 7f4179a0b640 1 -- 172.21.15.112:0/1543041871 >> 172.21.15.112:0/1543041871 conn(0x7f41740b1f90 msgr2=0x7f417406e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:22.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.636+0000 7f4179a0b640 1 -- 172.21.15.112:0/1543041871 shutdown_connections 2024-09-15T23:59:22.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.636+0000 7f4179a0b640 1 -- 172.21.15.112:0/1543041871 wait complete. 2024-09-15T23:59:22.652 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-15T23:59:22.810 INFO:teuthology.orchestra.run.smithi112.stdout:{"message":"","return_code":0} 2024-09-15T23:59:22.810 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-15T23:59:22.810 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-15T23:59:22.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 Processor -- start 2024-09-15T23:59:22.847 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 -- start start 2024-09-15T23:59:22.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f1adb79e0 0x559f1ae581e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.849 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f1adce9d0 0x559f1ae53980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1ae5c1b0 0x559f1ae53ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559f1ae5d4f0 con 0x559f1ae5c1b0 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f1acd81b0 con 0x559f1adce9d0 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x559f1ae5d670 con 0x559f1adb79e0 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a1f5f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1ae5c1b0 0x559f1ae53ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a1f5f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1ae5c1b0 0x559f1ae53ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34272/0 (socket says 172.21.15.112:34272) 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a1f5f9640 1 -- 172.21.15.112:0/2493089183 learned_addr learned my addr 172.21.15.112:0/2493089183 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a1e5f7640 1 --2- 172.21.15.112:0/2493089183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f1adce9d0 0x559f1ae53980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a1edf8640 1 --2- 172.21.15.112:0/2493089183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f1adb79e0 0x559f1ae581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a1f5f9640 1 -- 172.21.15.112:0/2493089183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f1adb79e0 msgr2=0x559f1ae581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a1f5f9640 1 --2- 172.21.15.112:0/2493089183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f1adb79e0 0x559f1ae581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a1f5f9640 1 -- 172.21.15.112:0/2493089183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f1adce9d0 msgr2=0x559f1ae53980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a1f5f9640 1 --2- 172.21.15.112:0/2493089183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f1adce9d0 0x559f1ae53980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a1f5f9640 1 -- 172.21.15.112:0/2493089183 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f1ae56fb0 con 0x559f1ae5c1b0 2024-09-15T23:59:22.850 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a1f5f9640 1 --2- 172.21.15.112:0/2493089183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1ae5c1b0 0x559f1ae53ec0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000a540 tx=0x7f0a1000aa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bff6b5ecbc704d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:22.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a1d5f5640 1 -- 172.21.15.112:0/2493089183 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10008a50 con 0x559f1ae5c1b0 2024-09-15T23:59:22.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a1d5f5640 1 -- 172.21.15.112:0/2493089183 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10008bf0 con 0x559f1ae5c1b0 2024-09-15T23:59:22.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a1d5f5640 1 -- 172.21.15.112:0/2493089183 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10013440 con 0x559f1ae5c1b0 2024-09-15T23:59:22.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 -- 172.21.15.112:0/2493089183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1ae5c1b0 msgr2=0x559f1ae53ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:22.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 --2- 172.21.15.112:0/2493089183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1ae5c1b0 0x559f1ae53ec0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000a540 tx=0x7f0a1000aa00 comp rx=0 tx=0).stop 2024-09-15T23:59:22.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 -- 172.21.15.112:0/2493089183 shutdown_connections 2024-09-15T23:59:22.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 --2- 172.21.15.112:0/2493089183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1ae5c1b0 0x559f1ae53ec0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 --2- 172.21.15.112:0/2493089183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f1adce9d0 0x559f1ae53980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 --2- 172.21.15.112:0/2493089183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f1adb79e0 0x559f1ae581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 -- 172.21.15.112:0/2493089183 >> 172.21.15.112:0/2493089183 conn(0x559f1adb2220 msgr2=0x559f1adb2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:22.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 -- 172.21.15.112:0/2493089183 shutdown_connections 2024-09-15T23:59:22.851 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 -- 172.21.15.112:0/2493089183 wait complete. 2024-09-15T23:59:22.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 Processor -- start 2024-09-15T23:59:22.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.848+0000 7f0a212e5080 1 -- start start 2024-09-15T23:59:22.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a212e5080 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1adb79e0 0x559f1ae50980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a212e5080 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f1adce9d0 0x559f1ae52df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a212e5080 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f1ae5c1b0 0x559f1ae53330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a212e5080 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559f1ae574f0 con 0x559f1adb79e0 2024-09-15T23:59:22.853 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a212e5080 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f1ae57250 con 0x559f1adce9d0 2024-09-15T23:59:22.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a212e5080 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x559f1ae57790 con 0x559f1ae5c1b0 2024-09-15T23:59:22.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1edf8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1adb79e0 0x559f1ae50980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1edf8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1adb79e0 0x559f1ae50980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34286/0 (socket says 172.21.15.112:34286) 2024-09-15T23:59:22.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1edf8640 1 -- 172.21.15.112:0/4016774785 learned_addr learned my addr 172.21.15.112:0/4016774785 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:22.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1e5f7640 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f1adce9d0 0x559f1ae52df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1f5f9640 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f1ae5c1b0 0x559f1ae53330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1edf8640 1 -- 172.21.15.112:0/4016774785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f1ae5c1b0 msgr2=0x559f1ae53330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:22.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1edf8640 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f1ae5c1b0 0x559f1ae53330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1edf8640 1 -- 172.21.15.112:0/4016774785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f1adce9d0 msgr2=0x559f1ae52df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:22.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1edf8640 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f1adce9d0 0x559f1ae52df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1edf8640 1 -- 172.21.15.112:0/4016774785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f1ae5a3f0 con 0x559f1adb79e0 2024-09-15T23:59:22.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1e5f7640 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f1adce9d0 0x559f1ae52df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:22.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1f5f9640 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f1ae5c1b0 0x559f1ae53330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:22.854 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1edf8640 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1adb79e0 0x559f1ae50980 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f0a180091e0 tx=0x7f0a180096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:22.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a17fff640 1 -- 172.21.15.112:0/4016774785 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18014020 con 0x559f1adb79e0 2024-09-15T23:59:22.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a17fff640 1 -- 172.21.15.112:0/4016774785 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a18010840 con 0x559f1adb79e0 2024-09-15T23:59:22.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a212e5080 1 -- 172.21.15.112:0/4016774785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f1ae5a690 con 0x559f1adb79e0 2024-09-15T23:59:22.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a17fff640 1 -- 172.21.15.112:0/4016774785 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18010c30 con 0x559f1adb79e0 2024-09-15T23:59:22.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a212e5080 1 -- 172.21.15.112:0/4016774785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f1ae5abd0 con 0x559f1adb79e0 2024-09-15T23:59:22.855 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a17fff640 1 -- 172.21.15.112:0/4016774785 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0a18017020 con 0x559f1adb79e0 2024-09-15T23:59:22.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a17fff640 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0a000662d0 0x7f0a00068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a17fff640 1 -- 172.21.15.112:0/4016774785 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f0a18084c30 con 0x559f1adb79e0 2024-09-15T23:59:22.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1e5f7640 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0a000662d0 0x7f0a00068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a212e5080 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x559f1adb5610 0x559f1adb59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:22.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a212e5080 1 -- 172.21.15.112:0/4016774785 --> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] -- osd_op(unknown.0.0:1 18.7 18:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x559f1adb5f30 con 0x559f1adb5610 2024-09-15T23:59:22.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1e5f7640 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0a000662d0 0x7f0a00068790 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0a080ac000 tx=0x7f0a080a5000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:22.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.852+0000 7f0a1f5f9640 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x559f1adb5610 0x559f1adb59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:22.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.856+0000 7f0a1f5f9640 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x559f1adb5610 0x559f1adb59f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:22.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.856+0000 7f0a1f5f9640 1 -- 172.21.15.112:0/4016774785 <== osd.7 v2:172.21.15.169:6808/189050588 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (93) out=93b] v0'0 uv3 ondisk = 0) ==== 164+0+93 (crc 0 0 0) 0x7f0a10008850 con 0x559f1adb5610 2024-09-15T23:59:22.857 INFO:teuthology.orchestra.run.smithi112.stdout:Wfile_a 2024-09-15T23:59:22.857 INFO:teuthology.orchestra.run.smithi112.stdout:dir_1 2024-09-15T23:59:22.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.856+0000 7f0a212e5080 1 -- 172.21.15.112:0/4016774785 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x559f1adb5610 msgr2=0x559f1adb59f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:22.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.856+0000 7f0a212e5080 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x559f1adb5610 0x559f1adb59f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.856+0000 7f0a212e5080 1 -- 172.21.15.112:0/4016774785 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0a000662d0 msgr2=0x7f0a00068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:22.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.856+0000 7f0a212e5080 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f0a000662d0 0x7f0a00068790 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0a080ac000 tx=0x7f0a080a5000 comp rx=0 tx=0).stop 2024-09-15T23:59:22.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.856+0000 7f0a212e5080 1 -- 172.21.15.112:0/4016774785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1adb79e0 msgr2=0x559f1ae50980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:22.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.856+0000 7f0a212e5080 1 --2- 172.21.15.112:0/4016774785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559f1adb79e0 0x559f1ae50980 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f0a180091e0 tx=0x7f0a180096a0 comp rx=0 tx=0).stop 2024-09-15T23:59:22.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.856+0000 7f0a1f5f9640 1 -- 172.21.15.112:0/4016774785 reap_dead start 2024-09-15T23:59:22.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.856+0000 7f0a212e5080 1 -- 172.21.15.112:0/4016774785 shutdown_connections 2024-09-15T23:59:22.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.856+0000 7f0a212e5080 1 -- 172.21.15.112:0/4016774785 >> 172.21.15.112:0/4016774785 conn(0x559f1adb2220 msgr2=0x559f1ae581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:22.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.856+0000 7f0a212e5080 1 -- 172.21.15.112:0/4016774785 shutdown_connections 2024-09-15T23:59:22.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:22.856+0000 7f0a212e5080 1 -- 172.21.15.112:0/4016774785 wait complete. 2024-09-15T23:59:22.860 DEBUG:teuthology.orchestra.run.smithi112:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-15T23:59:22.950 INFO:teuthology.orchestra.run.smithi112.stderr:error: stray data at end of buffer, offset 93 2024-09-15T23:59:22.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:59:22.954 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:59:22.954 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:59:23.052 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:59:23.135 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:59:23.136 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:59:23.136 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:59:23.136 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:59:23.142 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:59:23.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.316+0000 7f7becc98640 1 Processor -- start 2024-09-15T23:59:23.317 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.316+0000 7f7becc98640 1 -- start start 2024-09-15T23:59:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.316+0000 7f7becc98640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be815c2a0 0x7f7be80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.316+0000 7f7becc98640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7be80af2a0 0x7f7be806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.316+0000 7f7becc98640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be80b3290 con 0x7f7be815bec0 2024-09-15T23:59:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.316+0000 7f7becc98640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7be80b3570 con 0x7f7be80af2a0 2024-09-15T23:59:23.318 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.316+0000 7f7becc98640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7be80b3850 con 0x7f7be815c2a0 2024-09-15T23:59:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.316+0000 7f7bddd9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be815c2a0 0x7f7be80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.316+0000 7f7bddd9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be815c2a0 0x7f7be80aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:54700/0 (socket says 172.21.15.112:54700) 2024-09-15T23:59:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.316+0000 7f7be6d9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7be80af2a0 0x7f7be806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7bddd9b640 1 -- 172.21.15.112:0/4200980185 learned_addr learned my addr 172.21.15.112:0/4200980185 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7bddd9b640 1 -- 172.21.15.112:0/4200980185 >> v2:172.21.15.169:3300/0 conn(0x7f7be80af2a0 msgr2=0x7f7be806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:23.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7bddd9b640 1 --2- 172.21.15.112:0/4200980185 >> v2:172.21.15.169:3300/0 conn(0x7f7be80af2a0 0x7f7be806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7be5d9b640 1 -- 172.21.15.112:0/4200980185 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2292048039 0 0) 0x7f7be80b3290 con 0x7f7be815bec0 2024-09-15T23:59:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7bddd9b640 1 -- 172.21.15.112:0/4200980185 >> v1:172.21.15.169:6789/0 conn(0x7f7be815bec0 legacy=0x7f7be80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:23.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7bddd9b640 1 -- 172.21.15.112:0/4200980185 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be80b3b30 con 0x7f7be815c2a0 2024-09-15T23:59:23.321 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7bddd9b640 1 --2- 172.21.15.112:0/4200980185 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be815c2a0 0x7f7be80aed60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009870 tx=0x7f7bd001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2c627c613a495cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:23.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7be5d9b640 1 -- 172.21.15.112:0/4200980185 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00a95f0 con 0x7f7be815c2a0 2024-09-15T23:59:23.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7be5d9b640 1 -- 172.21.15.112:0/4200980185 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd00a9790 con 0x7f7be815c2a0 2024-09-15T23:59:23.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7be5d9b640 1 -- 172.21.15.112:0/4200980185 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00a9b60 con 0x7f7be815c2a0 2024-09-15T23:59:23.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7becc98640 1 -- 172.21.15.112:0/4200980185 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be815c2a0 msgr2=0x7f7be80aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:23.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7becc98640 1 --2- 172.21.15.112:0/4200980185 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be815c2a0 0x7f7be80aed60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009870 tx=0x7f7bd001c530 comp rx=0 tx=0).stop 2024-09-15T23:59:23.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7becc98640 1 -- 172.21.15.112:0/4200980185 shutdown_connections 2024-09-15T23:59:23.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7becc98640 1 --2- 172.21.15.112:0/4200980185 >> v2:172.21.15.169:3300/0 conn(0x7f7be80af2a0 0x7f7be806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7becc98640 1 --2- 172.21.15.112:0/4200980185 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be815c2a0 0x7f7be80aed60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7becc98640 1 -- 172.21.15.112:0/4200980185 >> 172.21.15.112:0/4200980185 conn(0x7f7be80b1f90 msgr2=0x7f7be80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:23.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7becc98640 1 -- 172.21.15.112:0/4200980185 shutdown_connections 2024-09-15T23:59:23.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.320+0000 7f7becc98640 1 -- 172.21.15.112:0/4200980185 wait complete. 2024-09-15T23:59:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7becc98640 1 Processor -- start 2024-09-15T23:59:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7becc98640 1 -- start start 2024-09-15T23:59:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7becc98640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7be80af2a0 0x7f7be81640e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7becc98640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be815bec0 0x7f7be8157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7becc98640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be815c2a0 0x7f7be814e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7becc98640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7be806ed50 con 0x7f7be815bec0 2024-09-15T23:59:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7becc98640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7be80af6b0 con 0x7f7be80af2a0 2024-09-15T23:59:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7becc98640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7be806eed0 con 0x7f7be815c2a0 2024-09-15T23:59:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7bddd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be815bec0 0x7f7be8157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7bddd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be815bec0 0x7f7be8157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34296/0 (socket says 172.21.15.112:34296) 2024-09-15T23:59:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7bddd9b640 1 -- 172.21.15.112:0/2479509168 learned_addr learned my addr 172.21.15.112:0/2479509168 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:23.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7be659c640 1 --2- 172.21.15.112:0/2479509168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7be80af2a0 0x7f7be81640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7be6d9d640 1 --2- 172.21.15.112:0/2479509168 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be815c2a0 0x7f7be814e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7bddd9b640 1 -- 172.21.15.112:0/2479509168 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be815c2a0 msgr2=0x7f7be814e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7bddd9b640 1 --2- 172.21.15.112:0/2479509168 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be815c2a0 0x7f7be814e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7bddd9b640 1 -- 172.21.15.112:0/2479509168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7be80af2a0 msgr2=0x7f7be81640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7bddd9b640 1 --2- 172.21.15.112:0/2479509168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7be80af2a0 0x7f7be81640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7bddd9b640 1 -- 172.21.15.112:0/2479509168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be80af930 con 0x7f7be815bec0 2024-09-15T23:59:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7bddd9b640 1 --2- 172.21.15.112:0/2479509168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be815bec0 0x7f7be8157c00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f7bd001a160 tx=0x7f7bd00192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7bdf7fe640 1 -- 172.21.15.112:0/2479509168 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0004220 con 0x7f7be815bec0 2024-09-15T23:59:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7bdf7fe640 1 -- 172.21.15.112:0/2479509168 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd00043c0 con 0x7f7be815bec0 2024-09-15T23:59:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7becc98640 1 -- 172.21.15.112:0/2479509168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be8155fe0 con 0x7f7be815bec0 2024-09-15T23:59:23.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7bdf7fe640 1 -- 172.21.15.112:0/2479509168 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0003820 con 0x7f7be815bec0 2024-09-15T23:59:23.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7becc98640 1 -- 172.21.15.112:0/2479509168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be81565a0 con 0x7f7be815bec0 2024-09-15T23:59:23.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.324+0000 7f7becc98640 1 -- 172.21.15.112:0/2479509168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be806f280 con 0x7f7be815bec0 2024-09-15T23:59:23.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.328+0000 7f7bdf7fe640 1 -- 172.21.15.112:0/2479509168 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7bd00039c0 con 0x7f7be815bec0 2024-09-15T23:59:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.328+0000 7f7bdf7fe640 1 --2- 172.21.15.112:0/2479509168 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7bc80678c0 0x7f7bc8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.328+0000 7f7be659c640 1 --2- 172.21.15.112:0/2479509168 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7bc80678c0 0x7f7bc8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.328+0000 7f7bdf7fe640 1 -- 172.21.15.112:0/2479509168 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f7bd01203f0 con 0x7f7be815bec0 2024-09-15T23:59:23.329 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.328+0000 7f7be659c640 1 --2- 172.21.15.112:0/2479509168 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7bc80678c0 0x7f7bc8069d80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8000f70 tx=0x7f7bd8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:23.332 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.332+0000 7f7bdf7fe640 1 -- 172.21.15.112:0/2479509168 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7bd00c9080 con 0x7f7be815bec0 2024-09-15T23:59:23.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.504+0000 7f7becc98640 1 -- 172.21.15.112:0/2479509168 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7be806fcd0 con 0x7f7be815bec0 2024-09-15T23:59:23.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.508+0000 7f7bdf7fe640 1 -- 172.21.15.112:0/2479509168 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v115) ==== 80+0+0 (secure 0 0 0) 0x7f7bd00ad020 con 0x7f7be815bec0 2024-09-15T23:59:23.507 INFO:teuthology.orchestra.run.smithi112.stderr:listed 0 entries 2024-09-15T23:59:23.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.508+0000 7f7becc98640 1 -- 172.21.15.112:0/2479509168 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7bc80678c0 msgr2=0x7f7bc8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:23.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.508+0000 7f7becc98640 1 --2- 172.21.15.112:0/2479509168 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7bc80678c0 0x7f7bc8069d80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8000f70 tx=0x7f7bd8009040 comp rx=0 tx=0).stop 2024-09-15T23:59:23.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.508+0000 7f7becc98640 1 -- 172.21.15.112:0/2479509168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be815bec0 msgr2=0x7f7be8157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:23.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.508+0000 7f7becc98640 1 --2- 172.21.15.112:0/2479509168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be815bec0 0x7f7be8157c00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f7bd001a160 tx=0x7f7bd00192d0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.508+0000 7f7becc98640 1 -- 172.21.15.112:0/2479509168 shutdown_connections 2024-09-15T23:59:23.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.508+0000 7f7becc98640 1 --2- 172.21.15.112:0/2479509168 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f7bc80678c0 0x7f7bc8069d80 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.508+0000 7f7becc98640 1 --2- 172.21.15.112:0/2479509168 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be815c2a0 0x7f7be814e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.508+0000 7f7becc98640 1 --2- 172.21.15.112:0/2479509168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7be815bec0 0x7f7be8157c00 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.508+0000 7f7becc98640 1 --2- 172.21.15.112:0/2479509168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7be80af2a0 0x7f7be81640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.508+0000 7f7becc98640 1 -- 172.21.15.112:0/2479509168 >> 172.21.15.112:0/2479509168 conn(0x7f7be80b1f90 msgr2=0x7f7be80b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:23.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.508+0000 7f7becc98640 1 -- 172.21.15.112:0/2479509168 shutdown_connections 2024-09-15T23:59:23.510 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.508+0000 7f7becc98640 1 -- 172.21.15.112:0/2479509168 wait complete. 2024-09-15T23:59:23.526 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi112.front.sepia.ceph.com... 2024-09-15T23:59:23.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:23.526 DEBUG:teuthology.orchestra.run.smithi112:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:59:23.538 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi112.stderr:ceph-fuse[46841]: fuse finished with error 0 and tester_r 0 2024-09-15T23:59:23.540 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:59:23.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:23.540 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:59:23.689 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:59:23.690 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:59:23.690 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:59:23.696 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:59:23.696 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:59:23.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:23.697 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:59:23.742 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-15T23:59:23.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:59:23.743 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:59:23.743 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:59:23.744 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:59:23.750 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:59:23.750 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:59:23.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:23.750 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-15T23:59:23.797 INFO:teuthology.orchestra.run.smithi112.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-15T23:59:23.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:59:23.798 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:59:23.798 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:59:23.798 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:59:23.804 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:59:23.804 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-09-15T23:59:23.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:23.804 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-15T23:59:23.850 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-15T23:59:23.851 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:59:23.851 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:59:23.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe35403640 1 Processor -- start 2024-09-15T23:59:23.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe35403640 1 -- start start 2024-09-15T23:59:23.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe35403640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efe300d3060 0x7efe300cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:23.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe35403640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efe300cf450 0x7efe3006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:23.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe35403640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe300d0300 con 0x7efe30161a60 2024-09-15T23:59:23.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe35403640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7efe300b0f60 con 0x7efe300d3060 2024-09-15T23:59:23.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe35403640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7efe300cfd40 con 0x7efe300cf450 2024-09-15T23:59:23.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe2effd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efe30161a60 0x7efe300d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47908/0 (socket says 172.21.15.112:47908) 2024-09-15T23:59:23.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe2effd640 1 -- 172.21.15.112:0/2919234801 learned_addr learned my addr 172.21.15.112:0/2919234801 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:23.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe2e7fc640 1 --2- 172.21.15.112:0/2919234801 >> v2:172.21.15.112:3300/0 conn(0x7efe300d3060 0x7efe300cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:23.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe2f7fe640 1 --2- 172.21.15.112:0/2919234801 >> v2:172.21.15.169:3300/0 conn(0x7efe300cf450 0x7efe3006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:23.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe2dffb640 1 -- 172.21.15.112:0/2919234801 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2605401150 0 0) 0x7efe280014a0 con 0x7efe30161a60 2024-09-15T23:59:23.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe2dffb640 1 -- 172.21.15.112:0/2919234801 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe1c003530 con 0x7efe30161a60 2024-09-15T23:59:23.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe2e7fc640 1 -- 172.21.15.112:0/2919234801 >> v2:172.21.15.169:3300/0 conn(0x7efe300cf450 msgr2=0x7efe3006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:23.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe2e7fc640 1 --2- 172.21.15.112:0/2919234801 >> v2:172.21.15.169:3300/0 conn(0x7efe300cf450 0x7efe3006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe2e7fc640 1 -- 172.21.15.112:0/2919234801 >> v1:172.21.15.112:6789/0 conn(0x7efe30161a60 legacy=0x7efe300d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:23.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe2e7fc640 1 -- 172.21.15.112:0/2919234801 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe300d0020 con 0x7efe300d3060 2024-09-15T23:59:23.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.984+0000 7efe2f7fe640 1 --2- 172.21.15.112:0/2919234801 >> v2:172.21.15.169:3300/0 conn(0x7efe300cf450 0x7efe3006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:59:23.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe2e7fc640 1 --2- 172.21.15.112:0/2919234801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe300d3060 0x7efe300cef10 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7efe300ce950 tx=0x7efe1801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48cd0c59f8c1f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:23.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe2dffb640 1 -- 172.21.15.112:0/2919234801 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe180b1070 con 0x7efe300d3060 2024-09-15T23:59:23.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe2dffb640 1 -- 172.21.15.112:0/2919234801 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe180ac620 con 0x7efe300d3060 2024-09-15T23:59:23.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe2dffb640 1 -- 172.21.15.112:0/2919234801 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe180ac9d0 con 0x7efe300d3060 2024-09-15T23:59:23.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 -- 172.21.15.112:0/2919234801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe300d3060 msgr2=0x7efe300cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:23.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 --2- 172.21.15.112:0/2919234801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe300d3060 0x7efe300cef10 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7efe300ce950 tx=0x7efe1801c3c0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 -- 172.21.15.112:0/2919234801 shutdown_connections 2024-09-15T23:59:23.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 --2- 172.21.15.112:0/2919234801 >> v2:172.21.15.169:3300/0 conn(0x7efe300cf450 0x7efe3006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 --2- 172.21.15.112:0/2919234801 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe300d3060 0x7efe300cef10 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 -- 172.21.15.112:0/2919234801 >> 172.21.15.112:0/2919234801 conn(0x7efe3008bf90 msgr2=0x7efe3009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:23.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 -- 172.21.15.112:0/2919234801 shutdown_connections 2024-09-15T23:59:23.989 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 -- 172.21.15.112:0/2919234801 wait complete. 2024-09-15T23:59:23.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 Processor -- start 2024-09-15T23:59:23.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 -- start start 2024-09-15T23:59:23.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe300cf450 0x7efe30151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:23.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe300d3060 0x7efe300ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:23.991 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe30161a60 0x7efe30158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:23.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efe3016af20 con 0x7efe300d3060 2024-09-15T23:59:23.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efe3006e650 con 0x7efe300cf450 2024-09-15T23:59:23.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe35403640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efe3016b0a0 con 0x7efe30161a60 2024-09-15T23:59:23.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe2e7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe300d3060 0x7efe300ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:23.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe2e7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe300d3060 0x7efe300ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34320/0 (socket says 172.21.15.112:34320) 2024-09-15T23:59:23.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.988+0000 7efe2e7fc640 1 -- 172.21.15.112:0/1801581527 learned_addr learned my addr 172.21.15.112:0/1801581527 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:23.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe2e7fc640 1 -- 172.21.15.112:0/1801581527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe30161a60 msgr2=0x7efe30158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:23.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe2effd640 1 --2- 172.21.15.112:0/1801581527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe300cf450 0x7efe30151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:23.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe2e7fc640 1 --2- 172.21.15.112:0/1801581527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe30161a60 0x7efe30158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe2e7fc640 1 -- 172.21.15.112:0/1801581527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe300cf450 msgr2=0x7efe30151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:23.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe2e7fc640 1 --2- 172.21.15.112:0/1801581527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe300cf450 0x7efe30151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:23.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe2e7fc640 1 -- 172.21.15.112:0/1801581527 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe300b7f70 con 0x7efe300d3060 2024-09-15T23:59:23.992 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe2e7fc640 1 --2- 172.21.15.112:0/1801581527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe300d3060 0x7efe300ce090 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7efe18019ff0 tx=0x7efe18019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:23.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe277fe640 1 -- 172.21.15.112:0/1801581527 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe180bb070 con 0x7efe300d3060 2024-09-15T23:59:23.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe277fe640 1 -- 172.21.15.112:0/1801581527 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe180ac7d0 con 0x7efe300d3060 2024-09-15T23:59:23.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe35403640 1 -- 172.21.15.112:0/1801581527 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe300b8250 con 0x7efe300d3060 2024-09-15T23:59:23.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe277fe640 1 -- 172.21.15.112:0/1801581527 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe180b1040 con 0x7efe300d3060 2024-09-15T23:59:23.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe35403640 1 -- 172.21.15.112:0/1801581527 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe300b8810 con 0x7efe300d3060 2024-09-15T23:59:23.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe35403640 1 -- 172.21.15.112:0/1801581527 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe3006d6b0 con 0x7efe300d3060 2024-09-15T23:59:23.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe277fe640 1 -- 172.21.15.112:0/1801581527 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe180be070 con 0x7efe300d3060 2024-09-15T23:59:23.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe277fe640 1 --2- 172.21.15.112:0/1801581527 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe100678c0 0x7efe10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:23.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe2effd640 1 --2- 172.21.15.112:0/1801581527 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe100678c0 0x7efe10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:23.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe277fe640 1 -- 172.21.15.112:0/1801581527 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7efe1811f230 con 0x7efe300d3060 2024-09-15T23:59:23.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.992+0000 7efe2effd640 1 --2- 172.21.15.112:0/1801581527 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe100678c0 0x7efe10069d80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efe28001640 tx=0x7efe28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:23.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:23.996+0000 7efe277fe640 1 -- 172.21.15.112:0/1801581527 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe18016070 con 0x7efe300d3060 2024-09-15T23:59:24.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.192+0000 7efe35403640 1 -- 172.21.15.112:0/1801581527 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe300cace0 con 0x7efe300d3060 2024-09-15T23:59:24.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.196+0000 7efe277fe640 1 -- 172.21.15.112:0/1801581527 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5237 (secure 0 0 0) 0x7efe180efbe0 con 0x7efe300d3060 2024-09-15T23:59:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:24.195 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":72,"btime":"2024-09-15T23:59:11:908708+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2146678161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2146678161},{"type":"v1","addr":"172.21.15.169:6835","nonce":2146678161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1904671431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1904671431},{"type":"v1","addr":"172.21.15.169:6833","nonce":1904671431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3435773285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3435773285},{"type":"v1","addr":"172.21.15.112:6835","nonce":3435773285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:59:08.241764+0000","modified":"2024-09-15T23:59:11.248014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7209":{"gid":7209,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2554639091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2554639091},{"type":"v1","addr":"172.21.15.112:6837","nonce":2554639091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7209,"qdb_cluster":[7209]},"id":8}]} 2024-09-15T23:59:24.195 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 72 2024-09-15T23:59:24.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.196+0000 7efe35403640 1 -- 172.21.15.112:0/1801581527 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe100678c0 msgr2=0x7efe10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:24.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.196+0000 7efe35403640 1 --2- 172.21.15.112:0/1801581527 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe100678c0 0x7efe10069d80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efe28001640 tx=0x7efe28009040 comp rx=0 tx=0).stop 2024-09-15T23:59:24.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.196+0000 7efe35403640 1 -- 172.21.15.112:0/1801581527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe300d3060 msgr2=0x7efe300ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:24.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.196+0000 7efe35403640 1 --2- 172.21.15.112:0/1801581527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe300d3060 0x7efe300ce090 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7efe18019ff0 tx=0x7efe18019160 comp rx=0 tx=0).stop 2024-09-15T23:59:24.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.196+0000 7efe35403640 1 -- 172.21.15.112:0/1801581527 shutdown_connections 2024-09-15T23:59:24.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.196+0000 7efe35403640 1 --2- 172.21.15.112:0/1801581527 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe100678c0 0x7efe10069d80 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.196+0000 7efe35403640 1 --2- 172.21.15.112:0/1801581527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe30161a60 0x7efe30158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.196+0000 7efe35403640 1 --2- 172.21.15.112:0/1801581527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe300d3060 0x7efe300ce090 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.196+0000 7efe35403640 1 --2- 172.21.15.112:0/1801581527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe300cf450 0x7efe30151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.196+0000 7efe35403640 1 -- 172.21.15.112:0/1801581527 >> 172.21.15.112:0/1801581527 conn(0x7efe3008bf90 msgr2=0x7efe300d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:24.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.196+0000 7efe35403640 1 -- 172.21.15.112:0/1801581527 shutdown_connections 2024-09-15T23:59:24.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.196+0000 7efe35403640 1 -- 172.21.15.112:0/1801581527 wait complete. 2024-09-15T23:59:24.214 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:59:24.333 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.332+0000 7f5ab732c640 1 Processor -- start 2024-09-15T23:59:24.334 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.332+0000 7f5ab732c640 1 -- start start 2024-09-15T23:59:24.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.332+0000 7f5ab732c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab0073e60 0x7f5ab006e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:24.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.332+0000 7f5ab732c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5ab00b3d50 0x7f5ab00b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:24.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.332+0000 7f5ab732c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab006ee50 con 0x7f5ab006fef0 2024-09-15T23:59:24.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.332+0000 7f5ab732c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f5ab00b46c0 con 0x7f5ab00b3d50 2024-09-15T23:59:24.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.332+0000 7f5ab732c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5ab006f130 con 0x7f5ab0073e60 2024-09-15T23:59:24.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.336+0000 7f5ab58c9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5ab00b3d50 0x7f5ab00b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:24.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.336+0000 7f5ab50c8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab0073e60 0x7f5ab006e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:24.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.336+0000 7f5ab50c8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab0073e60 0x7f5ab006e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:54708/0 (socket says 172.21.15.112:54708) 2024-09-15T23:59:24.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.336+0000 7f5ab58c9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5ab00b3d50 0x7f5ab00b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:58820/0 (socket says 172.21.15.112:58820) 2024-09-15T23:59:24.335 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.336+0000 7f5ab50c8640 1 -- 172.21.15.112:0/191092125 learned_addr learned my addr 172.21.15.112:0/191092125 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:24.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.336+0000 7f5ab48c7640 1 --1- 172.21.15.112:0/191092125 >> v1:172.21.15.169:6789/0 conn(0x7f5ab006fef0 0x7f5ab015b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:44036/0 (socket says 172.21.15.112:44036) 2024-09-15T23:59:24.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.336+0000 7f5ab50c8640 1 -- 172.21.15.112:0/191092125 >> v2:172.21.15.169:3300/0 conn(0x7f5ab00b3d50 msgr2=0x7f5ab00b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:24.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.336+0000 7f5ab50c8640 1 --2- 172.21.15.112:0/191092125 >> v2:172.21.15.169:3300/0 conn(0x7f5ab00b3d50 0x7f5ab00b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.336+0000 7f5ab50c8640 1 -- 172.21.15.112:0/191092125 >> v1:172.21.15.169:6789/0 conn(0x7f5ab006fef0 legacy=0x7f5ab015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:24.336 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.336+0000 7f5ab50c8640 1 -- 172.21.15.112:0/191092125 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab006f410 con 0x7f5ab0073e60 2024-09-15T23:59:24.337 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.336+0000 7f5ab50c8640 1 --2- 172.21.15.112:0/191092125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab0073e60 0x7f5ab006e800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8009870 tx=0x7f5aa801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=451a3b16e5d2e57b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:24.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.336+0000 7f5aa7fff640 1 -- 172.21.15.112:0/191092125 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa80b0070 con 0x7f5ab0073e60 2024-09-15T23:59:24.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.336+0000 7f5aa7fff640 1 -- 172.21.15.112:0/191092125 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aa80ab600 con 0x7f5ab0073e60 2024-09-15T23:59:24.338 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.336+0000 7f5aa7fff640 1 -- 172.21.15.112:0/191092125 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa80ab9d0 con 0x7f5ab0073e60 2024-09-15T23:59:24.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 -- 172.21.15.112:0/191092125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab0073e60 msgr2=0x7f5ab006e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:24.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 --2- 172.21.15.112:0/191092125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab0073e60 0x7f5ab006e800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8009870 tx=0x7f5aa801c4d0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 -- 172.21.15.112:0/191092125 shutdown_connections 2024-09-15T23:59:24.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 --2- 172.21.15.112:0/191092125 >> v2:172.21.15.169:3300/0 conn(0x7f5ab00b3d50 0x7f5ab00b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.339 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 --2- 172.21.15.112:0/191092125 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab0073e60 0x7f5ab006e800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 -- 172.21.15.112:0/191092125 >> 172.21.15.112:0/191092125 conn(0x7f5ab00b1f90 msgr2=0x7f5ab00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:24.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 -- 172.21.15.112:0/191092125 shutdown_connections 2024-09-15T23:59:24.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 -- 172.21.15.112:0/191092125 wait complete. 2024-09-15T23:59:24.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 Processor -- start 2024-09-15T23:59:24.340 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 -- start start 2024-09-15T23:59:24.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ab006fef0 0x7f5ab009dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:24.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ab0073e60 0x7f5ab01578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:24.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab00b3d50 0x7f5ab014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:24.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab00729a0 con 0x7f5ab006fef0 2024-09-15T23:59:24.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab0072820 con 0x7f5ab0073e60 2024-09-15T23:59:24.342 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5ab0072b20 con 0x7f5ab00b3d50 2024-09-15T23:59:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab50c8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ab006fef0 0x7f5ab009dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab50c8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ab006fef0 0x7f5ab009dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34332/0 (socket says 172.21.15.112:34332) 2024-09-15T23:59:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab50c8640 1 -- 172.21.15.112:0/2364560013 learned_addr learned my addr 172.21.15.112:0/2364560013 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab50c8640 1 -- 172.21.15.112:0/2364560013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab00b3d50 msgr2=0x7f5ab014bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab58c9640 1 --2- 172.21.15.112:0/2364560013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab00b3d50 0x7f5ab014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab48c7640 1 --2- 172.21.15.112:0/2364560013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ab0073e60 0x7f5ab01578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab50c8640 1 --2- 172.21.15.112:0/2364560013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab00b3d50 0x7f5ab014bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab50c8640 1 -- 172.21.15.112:0/2364560013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ab0073e60 msgr2=0x7f5ab01578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab50c8640 1 --2- 172.21.15.112:0/2364560013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ab0073e60 0x7f5ab01578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab50c8640 1 -- 172.21.15.112:0/2364560013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab014c270 con 0x7f5ab006fef0 2024-09-15T23:59:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab50c8640 1 --2- 172.21.15.112:0/2364560013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ab006fef0 0x7f5ab009dd20 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80ae040 tx=0x7f5aa8019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5aa5ffb640 1 -- 172.21.15.112:0/2364560013 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa80b0040 con 0x7f5ab006fef0 2024-09-15T23:59:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5aa5ffb640 1 -- 172.21.15.112:0/2364560013 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aa80b9070 con 0x7f5ab006fef0 2024-09-15T23:59:24.343 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 -- 172.21.15.112:0/2364560013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab0158020 con 0x7f5ab006fef0 2024-09-15T23:59:24.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5aa5ffb640 1 -- 172.21.15.112:0/2364560013 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa80b4660 con 0x7f5ab006fef0 2024-09-15T23:59:24.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.340+0000 7f5ab732c640 1 -- 172.21.15.112:0/2364560013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab01585e0 con 0x7f5ab006fef0 2024-09-15T23:59:24.344 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.344+0000 7f5ab732c640 1 -- 172.21.15.112:0/2364560013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab006e800 con 0x7f5ab006fef0 2024-09-15T23:59:24.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.344+0000 7f5aa5ffb640 1 -- 172.21.15.112:0/2364560013 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5aa80b4800 con 0x7f5ab006fef0 2024-09-15T23:59:24.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.344+0000 7f5aa5ffb640 1 --2- 172.21.15.112:0/2364560013 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a940678f0 0x7f5a94069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:24.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.344+0000 7f5aa5ffb640 1 -- 172.21.15.112:0/2364560013 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f5aa811fab0 con 0x7f5ab006fef0 2024-09-15T23:59:24.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.344+0000 7f5ab48c7640 1 --2- 172.21.15.112:0/2364560013 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a940678f0 0x7f5a94069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:24.345 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.344+0000 7f5ab48c7640 1 --2- 172.21.15.112:0/2364560013 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a940678f0 0x7f5a94069db0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5ab01f83c0 tx=0x7f5aa0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:24.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.348+0000 7f5aa5ffb640 1 -- 172.21.15.112:0/2364560013 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5aa8016150 con 0x7f5ab006fef0 2024-09-15T23:59:24.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.544+0000 7f5ab732c640 1 -- 172.21.15.112:0/2364560013 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ab00723f0 con 0x7f5ab006fef0 2024-09-15T23:59:24.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.544+0000 7f5aa5ffb640 1 -- 172.21.15.112:0/2364560013 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5237 (secure 0 0 0) 0x7f5aa80f03c0 con 0x7f5ab006fef0 2024-09-15T23:59:24.546 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:24.547 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":72,"btime":"2024-09-15T23:59:11:908708+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2146678161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2146678161},{"type":"v1","addr":"172.21.15.169:6835","nonce":2146678161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1904671431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1904671431},{"type":"v1","addr":"172.21.15.169:6833","nonce":1904671431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3435773285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3435773285},{"type":"v1","addr":"172.21.15.112:6835","nonce":3435773285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:59:08.241764+0000","modified":"2024-09-15T23:59:11.248014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7209":{"gid":7209,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2554639091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2554639091},{"type":"v1","addr":"172.21.15.112:6837","nonce":2554639091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7209,"qdb_cluster":[7209]},"id":8}]} 2024-09-15T23:59:24.547 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 72 2024-09-15T23:59:24.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.548+0000 7f5ab732c640 1 -- 172.21.15.112:0/2364560013 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a940678f0 msgr2=0x7f5a94069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:24.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.548+0000 7f5ab732c640 1 --2- 172.21.15.112:0/2364560013 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a940678f0 0x7f5a94069db0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5ab01f83c0 tx=0x7f5aa0009040 comp rx=0 tx=0).stop 2024-09-15T23:59:24.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.548+0000 7f5ab732c640 1 -- 172.21.15.112:0/2364560013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ab006fef0 msgr2=0x7f5ab009dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:24.549 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.548+0000 7f5ab732c640 1 --2- 172.21.15.112:0/2364560013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ab006fef0 0x7f5ab009dd20 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80ae040 tx=0x7f5aa8019270 comp rx=0 tx=0).stop 2024-09-15T23:59:24.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.548+0000 7f5ab732c640 1 -- 172.21.15.112:0/2364560013 shutdown_connections 2024-09-15T23:59:24.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.548+0000 7f5ab732c640 1 --2- 172.21.15.112:0/2364560013 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f5a940678f0 0x7f5a94069db0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.548+0000 7f5ab732c640 1 --2- 172.21.15.112:0/2364560013 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab00b3d50 0x7f5ab014bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.548+0000 7f5ab732c640 1 --2- 172.21.15.112:0/2364560013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ab0073e60 0x7f5ab01578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.548+0000 7f5ab732c640 1 --2- 172.21.15.112:0/2364560013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5ab006fef0 0x7f5ab009dd20 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.548+0000 7f5ab732c640 1 -- 172.21.15.112:0/2364560013 >> 172.21.15.112:0/2364560013 conn(0x7f5ab00b1f90 msgr2=0x7f5ab00ae730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:24.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.548+0000 7f5ab732c640 1 -- 172.21.15.112:0/2364560013 shutdown_connections 2024-09-15T23:59:24.550 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.548+0000 7f5ab732c640 1 -- 172.21.15.112:0/2364560013 wait complete. 2024-09-15T23:59:24.566 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:59:24.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c3d1d640 1 Processor -- start 2024-09-15T23:59:24.691 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c3d1d640 1 -- start start 2024-09-15T23:59:24.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c3d1d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc4bc15bec0 0x7fc4bc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:24.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c3d1d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4bc15c2a0 0x7fc4bc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:24.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c3d1d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc4bc0af2a0 0x7fc4bc15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:24.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c3d1d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fc4bc0b3290 con 0x7fc4bc15bec0 2024-09-15T23:59:24.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c3d1d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc4bc0b3570 con 0x7fc4bc0af2a0 2024-09-15T23:59:24.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c3d1d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc4bc0b3850 con 0x7fc4bc15c2a0 2024-09-15T23:59:24.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c1ab9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc4bc15bec0 0x7fc4bc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:24.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c1ab9640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fc4bc15bec0 0x7fc4bc0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34334/0 (socket says 172.21.15.112:34334) 2024-09-15T23:59:24.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c1ab9640 1 -- 172.21.15.112:0/4087794536 learned_addr learned my addr 172.21.15.112:0/4087794536 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:24.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c22ba640 1 --2- 172.21.15.112:0/4087794536 >> v2:172.21.15.169:3300/0 conn(0x7fc4bc0af2a0 0x7fc4bc15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:24.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c12b8640 1 --2- 172.21.15.112:0/4087794536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4bc15c2a0 0x7fc4bc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:24.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c1ab9640 1 -- 172.21.15.112:0/4087794536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4bc15c2a0 msgr2=0x7fc4bc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:24.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c1ab9640 1 --2- 172.21.15.112:0/4087794536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4bc15c2a0 0x7fc4bc0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c1ab9640 1 -- 172.21.15.112:0/4087794536 >> v2:172.21.15.169:3300/0 conn(0x7fc4bc0af2a0 msgr2=0x7fc4bc15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:24.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c1ab9640 1 --2- 172.21.15.112:0/4087794536 >> v2:172.21.15.169:3300/0 conn(0x7fc4bc0af2a0 0x7fc4bc15fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c1ab9640 1 -- 172.21.15.112:0/4087794536 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc0b3b30 con 0x7fc4bc15bec0 2024-09-15T23:59:24.694 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c22ba640 1 --2- 172.21.15.112:0/4087794536 >> v2:172.21.15.169:3300/0 conn(0x7fc4bc0af2a0 0x7fc4bc15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:24.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.692+0000 7fc4c1ab9640 1 --2- 172.21.15.112:0/4087794536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc15bec0 0x7fc4bc0ad200 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc06dc90 tx=0x7fc4b801c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee271c6cdb12da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:24.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c0ab7640 1 -- 172.21.15.112:0/4087794536 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80b0070 con 0x7fc4bc15bec0 2024-09-15T23:59:24.695 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c0ab7640 1 -- 172.21.15.112:0/4087794536 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b80ab600 con 0x7fc4bc15bec0 2024-09-15T23:59:24.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c0ab7640 1 -- 172.21.15.112:0/4087794536 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80ab9d0 con 0x7fc4bc15bec0 2024-09-15T23:59:24.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/4087794536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc15bec0 msgr2=0x7fc4bc0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:24.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 --2- 172.21.15.112:0/4087794536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc15bec0 0x7fc4bc0ad200 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc06dc90 tx=0x7fc4b801c230 comp rx=0 tx=0).stop 2024-09-15T23:59:24.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/4087794536 shutdown_connections 2024-09-15T23:59:24.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 --2- 172.21.15.112:0/4087794536 >> v2:172.21.15.169:3300/0 conn(0x7fc4bc0af2a0 0x7fc4bc15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 --2- 172.21.15.112:0/4087794536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4bc15c2a0 0x7fc4bc0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 --2- 172.21.15.112:0/4087794536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc15bec0 0x7fc4bc0ad200 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/4087794536 >> 172.21.15.112:0/4087794536 conn(0x7fc4bc0b1f90 msgr2=0x7fc4bc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:24.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/4087794536 shutdown_connections 2024-09-15T23:59:24.696 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/4087794536 wait complete. 2024-09-15T23:59:24.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 Processor -- start 2024-09-15T23:59:24.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 -- start start 2024-09-15T23:59:24.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc0af2a0 0x7fc4bc14f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:24.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4bc15bec0 0x7fc4bc152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:24.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4bc15c2a0 0x7fc4bc1526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:24.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc0af6b0 con 0x7fc4bc0af2a0 2024-09-15T23:59:24.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc0ad740 con 0x7fc4bc15c2a0 2024-09-15T23:59:24.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc4bc06e000 con 0x7fc4bc15bec0 2024-09-15T23:59:24.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c1ab9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc0af2a0 0x7fc4bc14f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:24.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c1ab9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc0af2a0 0x7fc4bc14f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34350/0 (socket says 172.21.15.112:34350) 2024-09-15T23:59:24.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c1ab9640 1 -- 172.21.15.112:0/2999033451 learned_addr learned my addr 172.21.15.112:0/2999033451 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:24.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c22ba640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4bc15c2a0 0x7fc4bc1526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:24.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c12b8640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4bc15bec0 0x7fc4bc152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:24.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c1ab9640 1 -- 172.21.15.112:0/2999033451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4bc15bec0 msgr2=0x7fc4bc152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:24.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c1ab9640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4bc15bec0 0x7fc4bc152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c1ab9640 1 -- 172.21.15.112:0/2999033451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4bc15c2a0 msgr2=0x7fc4bc1526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:24.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c1ab9640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4bc15c2a0 0x7fc4bc1526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c1ab9640 1 -- 172.21.15.112:0/2999033451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc150590 con 0x7fc4bc0af2a0 2024-09-15T23:59:24.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c12b8640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4bc15bec0 0x7fc4bc152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:24.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c1ab9640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc0af2a0 0x7fc4bc14f950 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80ae040 tx=0x7fc4b801aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:24.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4b27fc640 1 -- 172.21.15.112:0/2999033451 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80b0040 con 0x7fc4bc0af2a0 2024-09-15T23:59:24.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4b27fc640 1 -- 172.21.15.112:0/2999033451 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b80bc070 con 0x7fc4bc0af2a0 2024-09-15T23:59:24.700 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/2999033451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4bc09dd20 con 0x7fc4bc0af2a0 2024-09-15T23:59:24.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4b27fc640 1 -- 172.21.15.112:0/2999033451 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80b6880 con 0x7fc4bc0af2a0 2024-09-15T23:59:24.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.696+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/2999033451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4bc150870 con 0x7fc4bc0af2a0 2024-09-15T23:59:24.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.700+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/2999033451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4bc0ad200 con 0x7fc4bc0af2a0 2024-09-15T23:59:24.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.700+0000 7fc4b27fc640 1 -- 172.21.15.112:0/2999033451 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4b80b6a20 con 0x7fc4bc0af2a0 2024-09-15T23:59:24.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.700+0000 7fc4b27fc640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc4a00678c0 0x7fc4a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:24.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.700+0000 7fc4b27fc640 1 -- 172.21.15.112:0/2999033451 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7fc4b8120330 con 0x7fc4bc0af2a0 2024-09-15T23:59:24.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.700+0000 7fc4c12b8640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc4a00678c0 0x7fc4a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:24.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.700+0000 7fc4c12b8640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc4a00678c0 0x7fc4a0069d80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac006fd0 tx=0x7fc4ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:24.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.704+0000 7fc4b27fc640 1 -- 172.21.15.112:0/2999033451 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc4b8016110 con 0x7fc4bc0af2a0 2024-09-15T23:59:24.869 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.868+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/2999033451 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4bc06fcd0 con 0x7fc4bc0af2a0 2024-09-15T23:59:24.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.872+0000 7fc4b27fc640 1 -- 172.21.15.112:0/2999033451 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+17028 (secure 0 0 0) 0x7fc4b80f0d70 con 0x7fc4bc0af2a0 2024-09-15T23:59:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:24.873 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":115,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:59:09.897781+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:59:06.192257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-15T23:59:07.224686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:59:24.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.876+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/2999033451 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc4a00678c0 msgr2=0x7fc4a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:24.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.876+0000 7fc4c3d1d640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc4a00678c0 0x7fc4a0069d80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac006fd0 tx=0x7fc4ac008040 comp rx=0 tx=0).stop 2024-09-15T23:59:24.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.876+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/2999033451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc0af2a0 msgr2=0x7fc4bc14f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:24.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.876+0000 7fc4c3d1d640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc0af2a0 0x7fc4bc14f950 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80ae040 tx=0x7fc4b801aa70 comp rx=0 tx=0).stop 2024-09-15T23:59:24.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.876+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/2999033451 shutdown_connections 2024-09-15T23:59:24.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.876+0000 7fc4c3d1d640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fc4a00678c0 0x7fc4a0069d80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.875 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.876+0000 7fc4c3d1d640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4bc15c2a0 0x7fc4bc1526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.876+0000 7fc4c3d1d640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4bc15bec0 0x7fc4bc152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.876+0000 7fc4c3d1d640 1 --2- 172.21.15.112:0/2999033451 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4bc0af2a0 0x7fc4bc14f950 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.876+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/2999033451 >> 172.21.15.112:0/2999033451 conn(0x7fc4bc0b1f90 msgr2=0x7fc4bc0b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.876+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/2999033451 shutdown_connections 2024-09-15T23:59:24.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:24.876+0000 7fc4c3d1d640 1 -- 172.21.15.112:0/2999033451 wait complete. 2024-09-15T23:59:24.892 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:59:24.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:59:25.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.016+0000 7f616cf62640 1 Processor -- start 2024-09-15T23:59:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.016+0000 7f616cf62640 1 -- start start 2024-09-15T23:59:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.016+0000 7f616cf62640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f616815c2a0 0x7f61680aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.016+0000 7f616cf62640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61680b3290 con 0x7f61680af2a0 2024-09-15T23:59:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.016+0000 7f616cf62640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61680b3570 con 0x7f616815bec0 2024-09-15T23:59:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.016+0000 7f616cf62640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f61680b3850 con 0x7f616815c2a0 2024-09-15T23:59:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.016+0000 7f6165d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f616815c2a0 0x7f61680aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.016+0000 7f6166d9d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f61680af2a0 0x7f616806e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47922/0 (socket says 172.21.15.112:47922) 2024-09-15T23:59:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.016+0000 7f6166d9d640 1 -- 172.21.15.112:0/4290925985 learned_addr learned my addr 172.21.15.112:0/4290925985 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.016+0000 7f6165d9b640 1 --2- 172.21.15.112:0/4290925985 >> v2:172.21.15.112:3300/0 conn(0x7f616815c2a0 0x7f61680aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34356/0 (socket says 172.21.15.112:34356) 2024-09-15T23:59:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.016+0000 7f6165d9b640 1 -- 172.21.15.112:0/4290925985 >> v1:172.21.15.169:6789/0 conn(0x7f616815bec0 legacy=0x7f61680ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.016+0000 7f6165d9b640 1 -- 172.21.15.112:0/4290925985 >> v1:172.21.15.112:6789/0 conn(0x7f61680af2a0 legacy=0x7f616806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.016+0000 7f6165d9b640 1 -- 172.21.15.112:0/4290925985 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61680b3b30 con 0x7f616815c2a0 2024-09-15T23:59:25.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.016+0000 7f616559a640 1 -- 172.21.15.112:0/4290925985 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 630758698 0 0) 0x7f61680b3290 con 0x7f61680af2a0 2024-09-15T23:59:25.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f6165d9b640 1 --2- 172.21.15.112:0/4290925985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616815c2a0 0x7f61680aed60 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f61580097c0 tx=0x7f615801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16fb84d759db219 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:25.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616559a640 1 -- 172.21.15.112:0/4290925985 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61580a7070 con 0x7f616815c2a0 2024-09-15T23:59:25.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616559a640 1 -- 172.21.15.112:0/4290925985 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61580b0070 con 0x7f616815c2a0 2024-09-15T23:59:25.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616559a640 1 -- 172.21.15.112:0/4290925985 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61580ab890 con 0x7f616815c2a0 2024-09-15T23:59:25.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 -- 172.21.15.112:0/4290925985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616815c2a0 msgr2=0x7f61680aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 --2- 172.21.15.112:0/4290925985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616815c2a0 0x7f61680aed60 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f61580097c0 tx=0x7f615801c470 comp rx=0 tx=0).stop 2024-09-15T23:59:25.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 -- 172.21.15.112:0/4290925985 shutdown_connections 2024-09-15T23:59:25.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 --2- 172.21.15.112:0/4290925985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616815c2a0 0x7f61680aed60 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 -- 172.21.15.112:0/4290925985 >> 172.21.15.112:0/4290925985 conn(0x7f61680b1f90 msgr2=0x7f61680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:25.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 -- 172.21.15.112:0/4290925985 shutdown_connections 2024-09-15T23:59:25.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 -- 172.21.15.112:0/4290925985 wait complete. 2024-09-15T23:59:25.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 Processor -- start 2024-09-15T23:59:25.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 -- start start 2024-09-15T23:59:25.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61680af2a0 0x7f6168148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616815bec0 0x7f61681495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f616815c2a0 0x7f616815a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f616806ef20 con 0x7f616815bec0 2024-09-15T23:59:25.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61680af6d0 con 0x7f61680af2a0 2024-09-15T23:59:25.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616cf62640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f616806f0a0 con 0x7f616815c2a0 2024-09-15T23:59:25.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f6165d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616815bec0 0x7f61681495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f6165d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616815bec0 0x7f61681495c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34364/0 (socket says 172.21.15.112:34364) 2024-09-15T23:59:25.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f6165d9b640 1 -- 172.21.15.112:0/261409018 learned_addr learned my addr 172.21.15.112:0/261409018 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:25.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f6165d9b640 1 -- 172.21.15.112:0/261409018 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f616815c2a0 msgr2=0x7f616815a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f6165d9b640 1 --2- 172.21.15.112:0/261409018 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f616815c2a0 0x7f616815a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f6165d9b640 1 -- 172.21.15.112:0/261409018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61680af2a0 msgr2=0x7f6168148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f616659c640 1 --2- 172.21.15.112:0/261409018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61680af2a0 0x7f6168148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.020+0000 7f6165d9b640 1 --2- 172.21.15.112:0/261409018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61680af2a0 0x7f6168148d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.024+0000 7f6165d9b640 1 -- 172.21.15.112:0/261409018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61681515c0 con 0x7f616815bec0 2024-09-15T23:59:25.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.024+0000 7f6165d9b640 1 --2- 172.21.15.112:0/261409018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616815bec0 0x7f61681495c0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f61580097c0 tx=0x7f6158019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:25.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.024+0000 7f6156ffd640 1 -- 172.21.15.112:0/261409018 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61580bf450 con 0x7f616815bec0 2024-09-15T23:59:25.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.024+0000 7f6156ffd640 1 -- 172.21.15.112:0/261409018 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61580bf5f0 con 0x7f616815bec0 2024-09-15T23:59:25.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.024+0000 7f6156ffd640 1 -- 172.21.15.112:0/261409018 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61580bf9e0 con 0x7f616815bec0 2024-09-15T23:59:25.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.024+0000 7f616cf62640 1 -- 172.21.15.112:0/261409018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6168150520 con 0x7f616815bec0 2024-09-15T23:59:25.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.024+0000 7f616cf62640 1 -- 172.21.15.112:0/261409018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6168150ae0 con 0x7f616815bec0 2024-09-15T23:59:25.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.024+0000 7f616cf62640 1 -- 172.21.15.112:0/261409018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61680aed60 con 0x7f616815bec0 2024-09-15T23:59:25.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.024+0000 7f6156ffd640 1 -- 172.21.15.112:0/261409018 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f61580bfb80 con 0x7f616815bec0 2024-09-15T23:59:25.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.024+0000 7f6156ffd640 1 --2- 172.21.15.112:0/261409018 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f61480678c0 0x7f6148069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.024+0000 7f6156ffd640 1 -- 172.21.15.112:0/261409018 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f61581206c0 con 0x7f616815bec0 2024-09-15T23:59:25.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.024+0000 7f616659c640 1 --2- 172.21.15.112:0/261409018 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f61480678c0 0x7f6148069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.024+0000 7f616659c640 1 --2- 172.21.15.112:0/261409018 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f61480678c0 0x7f6148069d80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f615c000f70 tx=0x7f615c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:25.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.028+0000 7f6156ffd640 1 -- 172.21.15.112:0/261409018 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6158016090 con 0x7f616815bec0 2024-09-15T23:59:25.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.224+0000 7f616cf62640 1 -- 172.21.15.112:0/261409018 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f616806fcd0 con 0x7f616815bec0 2024-09-15T23:59:25.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.224+0000 7f6156ffd640 1 -- 172.21.15.112:0/261409018 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5237 (secure 0 0 0) 0x7f61580f1070 con 0x7f616815bec0 2024-09-15T23:59:25.225 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:25.225 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":72,"btime":"2024-09-15T23:59:11:908708+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2146678161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2146678161},{"type":"v1","addr":"172.21.15.169:6835","nonce":2146678161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1904671431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1904671431},{"type":"v1","addr":"172.21.15.169:6833","nonce":1904671431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3435773285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3435773285},{"type":"v1","addr":"172.21.15.112:6835","nonce":3435773285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:59:08.241764+0000","modified":"2024-09-15T23:59:11.248014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7209":{"gid":7209,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2554639091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2554639091},{"type":"v1","addr":"172.21.15.112:6837","nonce":2554639091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7209,"qdb_cluster":[7209]},"id":8}]} 2024-09-15T23:59:25.226 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 72 2024-09-15T23:59:25.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.228+0000 7f616cf62640 1 -- 172.21.15.112:0/261409018 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f61480678c0 msgr2=0x7f6148069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.228+0000 7f616cf62640 1 --2- 172.21.15.112:0/261409018 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f61480678c0 0x7f6148069d80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f615c000f70 tx=0x7f615c009040 comp rx=0 tx=0).stop 2024-09-15T23:59:25.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.228+0000 7f616cf62640 1 -- 172.21.15.112:0/261409018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616815bec0 msgr2=0x7f61681495c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.228+0000 7f616cf62640 1 --2- 172.21.15.112:0/261409018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616815bec0 0x7f61681495c0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f61580097c0 tx=0x7f6158019210 comp rx=0 tx=0).stop 2024-09-15T23:59:25.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.228+0000 7f616cf62640 1 -- 172.21.15.112:0/261409018 shutdown_connections 2024-09-15T23:59:25.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.228+0000 7f616cf62640 1 --2- 172.21.15.112:0/261409018 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f61480678c0 0x7f6148069d80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.228+0000 7f616cf62640 1 --2- 172.21.15.112:0/261409018 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f616815c2a0 0x7f616815a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.228+0000 7f616cf62640 1 --2- 172.21.15.112:0/261409018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f616815bec0 0x7f61681495c0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.228+0000 7f616cf62640 1 --2- 172.21.15.112:0/261409018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61680af2a0 0x7f6168148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.228+0000 7f616cf62640 1 -- 172.21.15.112:0/261409018 >> 172.21.15.112:0/261409018 conn(0x7f61680b1f90 msgr2=0x7f6168159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:25.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.228+0000 7f616cf62640 1 -- 172.21.15.112:0/261409018 shutdown_connections 2024-09-15T23:59:25.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.228+0000 7f616cf62640 1 -- 172.21.15.112:0/261409018 wait complete. 2024-09-15T23:59:25.244 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:59:25.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.364+0000 7ff06cef4640 1 Processor -- start 2024-09-15T23:59:25.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.364+0000 7ff06cef4640 1 -- start start 2024-09-15T23:59:25.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.364+0000 7ff06cef4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff06815c2a0 0x7ff0680aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.364+0000 7ff06cef4640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0680b3290 con 0x7ff0680af2a0 2024-09-15T23:59:25.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.364+0000 7ff06cef4640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0680b3570 con 0x7ff06815bec0 2024-09-15T23:59:25.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.364+0000 7ff06cef4640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff0680b3850 con 0x7ff06815c2a0 2024-09-15T23:59:25.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.364+0000 7ff066d9d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ff0680af2a0 0x7ff06806e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47932/0 (socket says 172.21.15.112:47932) 2024-09-15T23:59:25.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.364+0000 7ff066d9d640 1 -- 172.21.15.112:0/2033894093 learned_addr learned my addr 172.21.15.112:0/2033894093 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:25.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.364+0000 7ff065d9b640 1 --2- 172.21.15.112:0/2033894093 >> v2:172.21.15.169:3300/0 conn(0x7ff06815c2a0 0x7ff0680aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.364+0000 7ff06559a640 1 -- 172.21.15.112:0/2033894093 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3539700998 0 0) 0x7ff0680b3290 con 0x7ff0680af2a0 2024-09-15T23:59:25.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.364+0000 7ff06559a640 1 -- 172.21.15.112:0/2033894093 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff050003530 con 0x7ff0680af2a0 2024-09-15T23:59:25.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 -- 172.21.15.112:0/2033894093 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1161024149 0 0) 0x7ff050003530 con 0x7ff0680af2a0 2024-09-15T23:59:25.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 -- 172.21.15.112:0/2033894093 >> v2:172.21.15.169:3300/0 conn(0x7ff06815c2a0 msgr2=0x7ff0680aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:25.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 --2- 172.21.15.112:0/2033894093 >> v2:172.21.15.169:3300/0 conn(0x7ff06815c2a0 0x7ff0680aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 -- 172.21.15.112:0/2033894093 >> v1:172.21.15.169:6789/0 conn(0x7ff06815bec0 legacy=0x7ff0680ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 -- 172.21.15.112:0/2033894093 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0680b3b30 con 0x7ff0680af2a0 2024-09-15T23:59:25.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 -- 172.21.15.112:0/2033894093 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7ff060001a00 con 0x7ff0680af2a0 2024-09-15T23:59:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 -- 172.21.15.112:0/2033894093 >> v1:172.21.15.112:6789/0 conn(0x7ff0680af2a0 legacy=0x7ff06806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 --2- 172.21.15.112:0/2033894093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff050003a10 0x7ff050003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 --2- 172.21.15.112:0/2033894093 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff050004810 0x7ff050004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 --2- 172.21.15.112:0/2033894093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0500051d0 0x7ff05000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 -- 172.21.15.112:0/2033894093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680b3850 con 0x7ff050003a10 2024-09-15T23:59:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 -- 172.21.15.112:0/2033894093 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff05000c0d0 con 0x7ff0500051d0 2024-09-15T23:59:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 -- 172.21.15.112:0/2033894093 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff05000c2d0 con 0x7ff050004810 2024-09-15T23:59:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06659c640 1 --2- 172.21.15.112:0/2033894093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff050003a10 0x7ff050003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff065d9b640 1 --2- 172.21.15.112:0/2033894093 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff050004810 0x7ff050004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06659c640 1 -- 172.21.15.112:0/2033894093 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff050004810 msgr2=0x7ff050004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06659c640 1 --2- 172.21.15.112:0/2033894093 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff050004810 0x7ff050004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06659c640 1 -- 172.21.15.112:0/2033894093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0500051d0 msgr2=0x7ff05000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06659c640 1 --2- 172.21.15.112:0/2033894093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0500051d0 0x7ff05000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff066d9d640 1 -- 172.21.15.112:0/2033894093 reap_dead start 2024-09-15T23:59:25.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06659c640 1 -- 172.21.15.112:0/2033894093 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff050003530 con 0x7ff050003a10 2024-09-15T23:59:25.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff065d9b640 1 --2- 172.21.15.112:0/2033894093 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff050004810 0x7ff050004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:25.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06659c640 1 --2- 172.21.15.112:0/2033894093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff050003a10 0x7ff050003e30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7ff058001780 tx=0x7ff05801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8a042e4a0bc024 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 -- 172.21.15.112:0/2033894093 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0580013a0 con 0x7ff050003a10 2024-09-15T23:59:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 -- 172.21.15.112:0/2033894093 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0580052f0 con 0x7ff050003a10 2024-09-15T23:59:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06559a640 1 -- 172.21.15.112:0/2033894093 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058003840 con 0x7ff050003a10 2024-09-15T23:59:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06cef4640 1 -- 172.21.15.112:0/2033894093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff050003a10 msgr2=0x7ff050003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06cef4640 1 --2- 172.21.15.112:0/2033894093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff050003a10 0x7ff050003e30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7ff058001780 tx=0x7ff05801c3d0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06cef4640 1 -- 172.21.15.112:0/2033894093 shutdown_connections 2024-09-15T23:59:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06cef4640 1 --2- 172.21.15.112:0/2033894093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff050003a10 0x7ff050003e30 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06cef4640 1 -- 172.21.15.112:0/2033894093 >> 172.21.15.112:0/2033894093 conn(0x7ff0680b1f90 msgr2=0x7ff0680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06cef4640 1 -- 172.21.15.112:0/2033894093 shutdown_connections 2024-09-15T23:59:25.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.368+0000 7ff06cef4640 1 -- 172.21.15.112:0/2033894093 wait complete. 2024-09-15T23:59:25.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff06cef4640 1 Processor -- start 2024-09-15T23:59:25.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff06cef4640 1 -- start start 2024-09-15T23:59:25.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff06cef4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff050003a10 0x7ff0681ea840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff06cef4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0681f90e0 0x7ff06815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff06cef4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff06815a8a0 0x7ff0681f9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff06cef4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680af680 con 0x7ff06815a8a0 2024-09-15T23:59:25.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff06cef4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680ad610 con 0x7ff050003a10 2024-09-15T23:59:25.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff06cef4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff0681e8d60 con 0x7ff0681f90e0 2024-09-15T23:59:25.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff066d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff06815a8a0 0x7ff0681f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff066d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff06815a8a0 0x7ff0681f9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34376/0 (socket says 172.21.15.112:34376) 2024-09-15T23:59:25.374 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff066d9d640 1 -- 172.21.15.112:0/2019985904 learned_addr learned my addr 172.21.15.112:0/2019985904 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff06659c640 1 --2- 172.21.15.112:0/2019985904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff050003a10 0x7ff0681ea840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff065d9b640 1 --2- 172.21.15.112:0/2019985904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0681f90e0 0x7ff06815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff066d9d640 1 -- 172.21.15.112:0/2019985904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0681f90e0 msgr2=0x7ff06815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff066d9d640 1 --2- 172.21.15.112:0/2019985904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0681f90e0 0x7ff06815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff066d9d640 1 -- 172.21.15.112:0/2019985904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff050003a10 msgr2=0x7ff0681ea840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff066d9d640 1 --2- 172.21.15.112:0/2019985904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff050003a10 0x7ff0681ea840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff066d9d640 1 -- 172.21.15.112:0/2019985904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0681e8fb0 con 0x7ff06815a8a0 2024-09-15T23:59:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff066d9d640 1 --2- 172.21.15.112:0/2019985904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff06815a8a0 0x7ff0681f9640 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7ff060007fd0 tx=0x7ff06000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff056ffd640 1 -- 172.21.15.112:0/2019985904 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06000ce70 con 0x7ff06815a8a0 2024-09-15T23:59:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff056ffd640 1 -- 172.21.15.112:0/2019985904 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06000a5b0 con 0x7ff06815a8a0 2024-09-15T23:59:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff06cef4640 1 -- 172.21.15.112:0/2019985904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0681e9290 con 0x7ff06815a8a0 2024-09-15T23:59:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff056ffd640 1 -- 172.21.15.112:0/2019985904 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06000a9c0 con 0x7ff06815a8a0 2024-09-15T23:59:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff06cef4640 1 -- 172.21.15.112:0/2019985904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0681e9850 con 0x7ff06815a8a0 2024-09-15T23:59:25.375 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.372+0000 7ff06cef4640 1 -- 172.21.15.112:0/2019985904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff068160470 con 0x7ff06815a8a0 2024-09-15T23:59:25.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.376+0000 7ff056ffd640 1 -- 172.21.15.112:0/2019985904 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff060011070 con 0x7ff06815a8a0 2024-09-15T23:59:25.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.376+0000 7ff056ffd640 1 --2- 172.21.15.112:0/2019985904 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff0480678f0 0x7ff048069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.376+0000 7ff056ffd640 1 -- 172.21.15.112:0/2019985904 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7ff060085770 con 0x7ff06815a8a0 2024-09-15T23:59:25.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.376+0000 7ff06659c640 1 --2- 172.21.15.112:0/2019985904 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff0480678f0 0x7ff048069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.376+0000 7ff06659c640 1 --2- 172.21.15.112:0/2019985904 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff0480678f0 0x7ff048069db0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff058001750 tx=0x7ff0580011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:25.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.380+0000 7ff056ffd640 1 -- 172.21.15.112:0/2019985904 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff06001a060 con 0x7ff06815a8a0 2024-09-15T23:59:25.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.572+0000 7ff06cef4640 1 -- 172.21.15.112:0/2019985904 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff06806fcd0 con 0x7ff06815a8a0 2024-09-15T23:59:25.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.572+0000 7ff056ffd640 1 -- 172.21.15.112:0/2019985904 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5237 (secure 0 0 0) 0x7ff060056120 con 0x7ff06815a8a0 2024-09-15T23:59:25.573 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:25.573 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":72,"btime":"2024-09-15T23:59:11:908708+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2146678161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2146678161},{"type":"v1","addr":"172.21.15.169:6835","nonce":2146678161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1904671431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1904671431},{"type":"v1","addr":"172.21.15.169:6833","nonce":1904671431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3435773285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3435773285},{"type":"v1","addr":"172.21.15.112:6835","nonce":3435773285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:59:08.241764+0000","modified":"2024-09-15T23:59:11.248014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7209":{"gid":7209,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6837/2554639091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2554639091},{"type":"v1","addr":"172.21.15.112:6837","nonce":2554639091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7209,"qdb_cluster":[7209]},"id":8}]} 2024-09-15T23:59:25.573 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 72 2024-09-15T23:59:25.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.576+0000 7ff06cef4640 1 -- 172.21.15.112:0/2019985904 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff0480678f0 msgr2=0x7ff048069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.576+0000 7ff06cef4640 1 --2- 172.21.15.112:0/2019985904 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff0480678f0 0x7ff048069db0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff058001750 tx=0x7ff0580011a0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.576+0000 7ff06cef4640 1 -- 172.21.15.112:0/2019985904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff06815a8a0 msgr2=0x7ff0681f9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.576+0000 7ff06cef4640 1 --2- 172.21.15.112:0/2019985904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff06815a8a0 0x7ff0681f9640 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7ff060007fd0 tx=0x7ff06000cc20 comp rx=0 tx=0).stop 2024-09-15T23:59:25.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.576+0000 7ff06cef4640 1 -- 172.21.15.112:0/2019985904 shutdown_connections 2024-09-15T23:59:25.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.576+0000 7ff06cef4640 1 --2- 172.21.15.112:0/2019985904 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff0480678f0 0x7ff048069db0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.575 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.576+0000 7ff06cef4640 1 --2- 172.21.15.112:0/2019985904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff06815a8a0 0x7ff0681f9640 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.576+0000 7ff06cef4640 1 --2- 172.21.15.112:0/2019985904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff0681f90e0 0x7ff06815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.576+0000 7ff06cef4640 1 --2- 172.21.15.112:0/2019985904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff050003a10 0x7ff0681ea840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.576+0000 7ff06cef4640 1 -- 172.21.15.112:0/2019985904 >> 172.21.15.112:0/2019985904 conn(0x7ff0680b1f90 msgr2=0x7ff0680b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:25.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.576+0000 7ff06cef4640 1 -- 172.21.15.112:0/2019985904 shutdown_connections 2024-09-15T23:59:25.576 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.576+0000 7ff06cef4640 1 -- 172.21.15.112:0/2019985904 wait complete. 2024-09-15T23:59:25.590 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:59:25.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.704+0000 7f799c342640 1 Processor -- start 2024-09-15T23:59:25.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.704+0000 7f799c342640 1 -- start start 2024-09-15T23:59:25.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f799c342640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f79941587a0 0x7f79940b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f799c342640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f79940b37d0 0x7f799406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f799c342640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799406ec60 con 0x7f799406e4b0 2024-09-15T23:59:25.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f799c342640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f79940b3c40 con 0x7f79940b37d0 2024-09-15T23:59:25.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f799c342640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f799406f870 con 0x7f79941587a0 2024-09-15T23:59:25.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f79998dd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f79940b37d0 0x7f799406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f79998dd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f79940b37d0 0x7f799406df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34384/0 (socket says 172.21.15.112:34384) 2024-09-15T23:59:25.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f79998dd640 1 -- 172.21.15.112:0/403149254 learned_addr learned my addr 172.21.15.112:0/403149254 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:25.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f799a0de640 1 --2- 172.21.15.112:0/403149254 >> v2:172.21.15.169:3300/0 conn(0x7f79941587a0 0x7f79940b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f79998dd640 1 -- 172.21.15.112:0/403149254 >> v2:172.21.15.169:3300/0 conn(0x7f79941587a0 msgr2=0x7f79940b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:25.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f79998dd640 1 --2- 172.21.15.112:0/403149254 >> v2:172.21.15.169:3300/0 conn(0x7f79941587a0 0x7f79940b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f79998dd640 1 -- 172.21.15.112:0/403149254 >> v1:172.21.15.169:6789/0 conn(0x7f799406e4b0 legacy=0x7f7994161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:25.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f79998dd640 1 -- 172.21.15.112:0/403149254 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799406ef40 con 0x7f79940b37d0 2024-09-15T23:59:25.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f79998dd640 1 --2- 172.21.15.112:0/403149254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79940b37d0 0x7f799406df70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f7994071710 tx=0x7f799001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35ac9f4ad9932ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:25.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f79990dc640 1 -- 172.21.15.112:0/403149254 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79900b1070 con 0x7f79940b37d0 2024-09-15T23:59:25.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f79990dc640 1 -- 172.21.15.112:0/403149254 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79900ac630 con 0x7f79940b37d0 2024-09-15T23:59:25.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.708+0000 7f79990dc640 1 -- 172.21.15.112:0/403149254 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79900a8050 con 0x7f79940b37d0 2024-09-15T23:59:25.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 -- 172.21.15.112:0/403149254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79940b37d0 msgr2=0x7f799406df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 --2- 172.21.15.112:0/403149254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79940b37d0 0x7f799406df70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f7994071710 tx=0x7f799001c4b0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 -- 172.21.15.112:0/403149254 shutdown_connections 2024-09-15T23:59:25.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 --2- 172.21.15.112:0/403149254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79940b37d0 0x7f799406df70 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 --2- 172.21.15.112:0/403149254 >> v2:172.21.15.169:3300/0 conn(0x7f79941587a0 0x7f79940b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 -- 172.21.15.112:0/403149254 >> 172.21.15.112:0/403149254 conn(0x7f79940b1f90 msgr2=0x7f79940b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:25.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 -- 172.21.15.112:0/403149254 shutdown_connections 2024-09-15T23:59:25.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 -- 172.21.15.112:0/403149254 wait complete. 2024-09-15T23:59:25.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 Processor -- start 2024-09-15T23:59:25.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 -- start start 2024-09-15T23:59:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f799406e4b0 0x7f7994145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79940b37d0 0x7f799414c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79941587a0 0x7f7994146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7994158b80 con 0x7f79941587a0 2024-09-15T23:59:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7994073170 con 0x7f79940b37d0 2024-09-15T23:59:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799c342640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7994146180 con 0x7f799406e4b0 2024-09-15T23:59:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799a8df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79941587a0 0x7f7994146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799a8df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79941587a0 0x7f7994146d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34398/0 (socket says 172.21.15.112:34398) 2024-09-15T23:59:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799a8df640 1 -- 172.21.15.112:0/1491516140 learned_addr learned my addr 172.21.15.112:0/1491516140 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f79998dd640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79940b37d0 0x7f799414c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799a0de640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f799406e4b0 0x7f7994145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799a8df640 1 -- 172.21.15.112:0/1491516140 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f799406e4b0 msgr2=0x7f7994145c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.715 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799a8df640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f799406e4b0 0x7f7994145c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799a8df640 1 -- 172.21.15.112:0/1491516140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79940b37d0 msgr2=0x7f799414c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799a8df640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79940b37d0 0x7f799414c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799a8df640 1 -- 172.21.15.112:0/1491516140 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7994154890 con 0x7f79941587a0 2024-09-15T23:59:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f79998dd640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79940b37d0 0x7f799414c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f799a8df640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79941587a0 0x7f7994146d50 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f798c00c780 tx=0x7f798c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.712+0000 7f7986ffd640 1 -- 172.21.15.112:0/1491516140 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c004b70 con 0x7f79941587a0 2024-09-15T23:59:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.716+0000 7f7986ffd640 1 -- 172.21.15.112:0/1491516140 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c004d10 con 0x7f79941587a0 2024-09-15T23:59:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.716+0000 7f7986ffd640 1 -- 172.21.15.112:0/1491516140 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c00aa30 con 0x7f79941587a0 2024-09-15T23:59:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.716+0000 7f799c342640 1 -- 172.21.15.112:0/1491516140 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7994154b70 con 0x7f79941587a0 2024-09-15T23:59:25.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.716+0000 7f799c342640 1 -- 172.21.15.112:0/1491516140 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7994155130 con 0x7f79941587a0 2024-09-15T23:59:25.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.716+0000 7f799c342640 1 -- 172.21.15.112:0/1491516140 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7994070080 con 0x7f79941587a0 2024-09-15T23:59:25.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.716+0000 7f7986ffd640 1 -- 172.21.15.112:0/1491516140 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f798c00abd0 con 0x7f79941587a0 2024-09-15T23:59:25.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.716+0000 7f7986ffd640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f79780678c0 0x7f7978069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:25.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.716+0000 7f7986ffd640 1 -- 172.21.15.112:0/1491516140 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7f798c086020 con 0x7f79941587a0 2024-09-15T23:59:25.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.716+0000 7f799a0de640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f79780678c0 0x7f7978069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:25.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.716+0000 7f799a0de640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f79780678c0 0x7f7978069d80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f79880096f0 tx=0x7f7988008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:25.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.720+0000 7f7986ffd640 1 -- 172.21.15.112:0/1491516140 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f798c020070 con 0x7f79941587a0 2024-09-15T23:59:25.886 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.884+0000 7f799c342640 1 -- 172.21.15.112:0/1491516140 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7994075040 con 0x7f79941587a0 2024-09-15T23:59:25.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.888+0000 7f7986ffd640 1 -- 172.21.15.112:0/1491516140 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+17028 (secure 0 0 0) 0x7f798c0569d0 con 0x7f79941587a0 2024-09-15T23:59:25.888 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:25.888 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":115,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:59:09.897781+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:59:06.192257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-15T23:59:07.224686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:59:25.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.888+0000 7f799c342640 1 -- 172.21.15.112:0/1491516140 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f79780678c0 msgr2=0x7f7978069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.888+0000 7f799c342640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f79780678c0 0x7f7978069d80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f79880096f0 tx=0x7f7988008040 comp rx=0 tx=0).stop 2024-09-15T23:59:25.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.888+0000 7f799c342640 1 -- 172.21.15.112:0/1491516140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79941587a0 msgr2=0x7f7994146d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:25.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.888+0000 7f799c342640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79941587a0 0x7f7994146d50 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f798c00c780 tx=0x7f798c00cc40 comp rx=0 tx=0).stop 2024-09-15T23:59:25.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.888+0000 7f799c342640 1 -- 172.21.15.112:0/1491516140 shutdown_connections 2024-09-15T23:59:25.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.888+0000 7f799c342640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f79780678c0 0x7f7978069d80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.890 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.888+0000 7f799c342640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79941587a0 0x7f7994146d50 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.888+0000 7f799c342640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79940b37d0 0x7f799414c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.888+0000 7f799c342640 1 --2- 172.21.15.112:0/1491516140 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f799406e4b0 0x7f7994145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:25.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.888+0000 7f799c342640 1 -- 172.21.15.112:0/1491516140 >> 172.21.15.112:0/1491516140 conn(0x7f79940b1f90 msgr2=0x7f79940aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:25.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.888+0000 7f799c342640 1 -- 172.21.15.112:0/1491516140 shutdown_connections 2024-09-15T23:59:25.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:25.888+0000 7f799c342640 1 -- 172.21.15.112:0/1491516140 wait complete. 2024-09-15T23:59:25.907 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:59:26.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb584b4e640 1 Processor -- start 2024-09-15T23:59:26.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb584b4e640 1 -- start start 2024-09-15T23:59:26.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb584b4e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb580160520 0x7fb580071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:26.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb584b4e640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb580160900 0x7fb580071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:26.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb584b4e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb58015c5f0 0x7fb58015ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:26.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb584b4e640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fb5800d1640 con 0x7fb580160900 2024-09-15T23:59:26.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb584b4e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb5800d0d70 con 0x7fb58015c5f0 2024-09-15T23:59:26.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb584b4e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb58015d390 con 0x7fb580160520 2024-09-15T23:59:26.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb57dd9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb580160900 0x7fb580071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:26.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb57dd9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fb580160900 0x7fb580071c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34410/0 (socket says 172.21.15.112:34410) 2024-09-15T23:59:26.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb57dd9b640 1 -- 172.21.15.112:0/1136679012 learned_addr learned my addr 172.21.15.112:0/1136679012 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:26.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb57e59c640 1 --2- 172.21.15.112:0/1136679012 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb580160520 0x7fb580071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:26.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb57ed9d640 1 --2- 172.21.15.112:0/1136679012 >> v2:172.21.15.169:3300/0 conn(0x7fb58015c5f0 0x7fb58015ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:26.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb57dd9b640 1 -- 172.21.15.112:0/1136679012 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb580160520 msgr2=0x7fb580071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:26.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb57dd9b640 1 --2- 172.21.15.112:0/1136679012 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb580160520 0x7fb580071750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb57dd9b640 1 -- 172.21.15.112:0/1136679012 >> v2:172.21.15.169:3300/0 conn(0x7fb58015c5f0 msgr2=0x7fb58015ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:26.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb57dd9b640 1 --2- 172.21.15.112:0/1136679012 >> v2:172.21.15.169:3300/0 conn(0x7fb58015c5f0 0x7fb58015ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb57dd9b640 1 -- 172.21.15.112:0/1136679012 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5800d0ff0 con 0x7fb580160900 2024-09-15T23:59:26.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb57e59c640 1 --2- 172.21.15.112:0/1136679012 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb580160520 0x7fb580071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:26.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.024+0000 7fb57ed9d640 1 --2- 172.21.15.112:0/1136679012 >> v2:172.21.15.169:3300/0 conn(0x7fb58015c5f0 0x7fb58015ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:26.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb57dd9b640 1 --2- 172.21.15.112:0/1136679012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb580160900 0x7fb580071c90 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb580072940 tx=0x7fb57401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdd8ecd76200a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:26.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb57d59a640 1 -- 172.21.15.112:0/1136679012 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5740b2070 con 0x7fb580160900 2024-09-15T23:59:26.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb57d59a640 1 -- 172.21.15.112:0/1136679012 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5740a9070 con 0x7fb580160900 2024-09-15T23:59:26.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb57d59a640 1 -- 172.21.15.112:0/1136679012 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5740ad880 con 0x7fb580160900 2024-09-15T23:59:26.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 -- 172.21.15.112:0/1136679012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb580160900 msgr2=0x7fb580071c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:26.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 --2- 172.21.15.112:0/1136679012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb580160900 0x7fb580071c90 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb580072940 tx=0x7fb57401c490 comp rx=0 tx=0).stop 2024-09-15T23:59:26.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 -- 172.21.15.112:0/1136679012 shutdown_connections 2024-09-15T23:59:26.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 --2- 172.21.15.112:0/1136679012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb580160900 0x7fb580071c90 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 --2- 172.21.15.112:0/1136679012 >> v2:172.21.15.169:3300/0 conn(0x7fb58015c5f0 0x7fb58015ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 --2- 172.21.15.112:0/1136679012 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb580160520 0x7fb580071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 -- 172.21.15.112:0/1136679012 >> 172.21.15.112:0/1136679012 conn(0x7fb58006c0c0 msgr2=0x7fb58006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:26.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 -- 172.21.15.112:0/1136679012 shutdown_connections 2024-09-15T23:59:26.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 -- 172.21.15.112:0/1136679012 wait complete. 2024-09-15T23:59:26.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 Processor -- start 2024-09-15T23:59:26.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 -- start start 2024-09-15T23:59:26.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58015c5f0 0x7fb580137510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:26.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb580160520 0x7fb5801528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:26.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb580160900 0x7fb58013c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:26.031 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb5800d2440 con 0x7fb58015c5f0 2024-09-15T23:59:26.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb5800d22c0 con 0x7fb580160900 2024-09-15T23:59:26.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb584b4e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb5800d25c0 con 0x7fb580160520 2024-09-15T23:59:26.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb57e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58015c5f0 0x7fb580137510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:26.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb57e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58015c5f0 0x7fb580137510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34418/0 (socket says 172.21.15.112:34418) 2024-09-15T23:59:26.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb57e59c640 1 -- 172.21.15.112:0/3828820530 learned_addr learned my addr 172.21.15.112:0/3828820530 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:26.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb57e59c640 1 -- 172.21.15.112:0/3828820530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb580160520 msgr2=0x7fb5801528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:26.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb57e59c640 1 --2- 172.21.15.112:0/3828820530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb580160520 0x7fb5801528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb57e59c640 1 -- 172.21.15.112:0/3828820530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb580160900 msgr2=0x7fb58013c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:26.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb57e59c640 1 --2- 172.21.15.112:0/3828820530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb580160900 0x7fb58013c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.032 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.028+0000 7fb57e59c640 1 -- 172.21.15.112:0/3828820530 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb580152e10 con 0x7fb58015c5f0 2024-09-15T23:59:26.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.032+0000 7fb57e59c640 1 --2- 172.21.15.112:0/3828820530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58015c5f0 0x7fb580137510 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb57800c7f0 tx=0x7fb57800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:26.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.032+0000 7fb56effd640 1 -- 172.21.15.112:0/3828820530 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578007a30 con 0x7fb58015c5f0 2024-09-15T23:59:26.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.032+0000 7fb56effd640 1 -- 172.21.15.112:0/3828820530 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb578007bd0 con 0x7fb58015c5f0 2024-09-15T23:59:26.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.032+0000 7fb584b4e640 1 -- 172.21.15.112:0/3828820530 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb580139db0 con 0x7fb58015c5f0 2024-09-15T23:59:26.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.032+0000 7fb56effd640 1 -- 172.21.15.112:0/3828820530 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5780113f0 con 0x7fb58015c5f0 2024-09-15T23:59:26.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.032+0000 7fb584b4e640 1 -- 172.21.15.112:0/3828820530 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb580134220 con 0x7fb58015c5f0 2024-09-15T23:59:26.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.032+0000 7fb584b4e640 1 -- 172.21.15.112:0/3828820530 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb58015ca60 con 0x7fb58015c5f0 2024-09-15T23:59:26.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.032+0000 7fb56effd640 1 -- 172.21.15.112:0/3828820530 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb578011590 con 0x7fb58015c5f0 2024-09-15T23:59:26.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.032+0000 7fb56effd640 1 --2- 172.21.15.112:0/3828820530 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb5600678f0 0x7fb560069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:26.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.032+0000 7fb56effd640 1 -- 172.21.15.112:0/3828820530 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6101+0+0 (secure 0 0 0) 0x7fb578085ea0 con 0x7fb58015c5f0 2024-09-15T23:59:26.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.032+0000 7fb57dd9b640 1 --2- 172.21.15.112:0/3828820530 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb5600678f0 0x7fb560069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:26.037 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.032+0000 7fb57dd9b640 1 --2- 172.21.15.112:0/3828820530 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb5600678f0 0x7fb560069db0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb5740af000 tx=0x7fb574004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:26.038 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.036+0000 7fb56effd640 1 -- 172.21.15.112:0/3828820530 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb578015020 con 0x7fb58015c5f0 2024-09-15T23:59:26.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.228+0000 7fb584b4e640 1 -- 172.21.15.112:0/3828820530 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb58013cb20 con 0x7fb58015c5f0 2024-09-15T23:59:26.228 INFO:tasks.ceph.mon.a.smithi112.stderr:2024-09-15T23:59:26.228+0000 7fae14e39640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:59:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.228+0000 7fb56effd640 1 -- 172.21.15.112:0/3828820530 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) ==== 161+0+0 (secure 0 0 0) 0x7fb5780568e0 con 0x7fb58015c5f0 2024-09-15T23:59:26.230 INFO:teuthology.orchestra.run.smithi112.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:59:26.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.232+0000 7fb584b4e640 1 -- 172.21.15.112:0/3828820530 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb5600678f0 msgr2=0x7fb560069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:26.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.232+0000 7fb584b4e640 1 --2- 172.21.15.112:0/3828820530 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb5600678f0 0x7fb560069db0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb5740af000 tx=0x7fb574004740 comp rx=0 tx=0).stop 2024-09-15T23:59:26.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.232+0000 7fb584b4e640 1 -- 172.21.15.112:0/3828820530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58015c5f0 msgr2=0x7fb580137510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:26.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.232+0000 7fb584b4e640 1 --2- 172.21.15.112:0/3828820530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58015c5f0 0x7fb580137510 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb57800c7f0 tx=0x7fb57800ccb0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.232+0000 7fb584b4e640 1 -- 172.21.15.112:0/3828820530 shutdown_connections 2024-09-15T23:59:26.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.232+0000 7fb584b4e640 1 --2- 172.21.15.112:0/3828820530 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb5600678f0 0x7fb560069db0 secure :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb5740af000 tx=0x7fb574004740 comp rx=0 tx=0).stop 2024-09-15T23:59:26.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.232+0000 7fb584b4e640 1 --2- 172.21.15.112:0/3828820530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb580160900 0x7fb58013c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.232+0000 7fb584b4e640 1 --2- 172.21.15.112:0/3828820530 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb580160520 0x7fb5801528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.232+0000 7fb584b4e640 1 --2- 172.21.15.112:0/3828820530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb58015c5f0 0x7fb580137510 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.232+0000 7fb584b4e640 1 -- 172.21.15.112:0/3828820530 >> 172.21.15.112:0/3828820530 conn(0x7fb58006c0c0 msgr2=0x7fb5801382e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:26.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.232+0000 7fb584b4e640 1 -- 172.21.15.112:0/3828820530 shutdown_connections 2024-09-15T23:59:26.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.232+0000 7fb584b4e640 1 -- 172.21.15.112:0/3828820530 wait complete. 2024-09-15T23:59:26.240 INFO:tasks.ceph.mds.a.smithi112.stderr: -4122> 2024-09-15T23:59:14.848+0000 7f1454ed7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:59:26.251 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:59:26.276 INFO:tasks.ceph.mds.a.smithi112.stdout:starting mds.a at 2024-09-15T23:59:26.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c9b59640 1 Processor -- start 2024-09-15T23:59:26.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c9b59640 1 -- start start 2024-09-15T23:59:26.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c9b59640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f38c415e450 0x7f38c40b7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:26.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c9b59640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38c40b7670 0x7f38c40d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:26.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c9b59640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38c40d1f70 con 0x7f38c40d4670 2024-09-15T23:59:26.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c9b59640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f38c40b58d0 con 0x7f38c415e450 2024-09-15T23:59:26.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c9b59640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f38c40b55f0 con 0x7f38c40b7670 2024-09-15T23:59:26.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c37fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f38c415e450 0x7f38c40b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:26.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c3fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f38c40d4670 0x7f38c40d2a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47946/0 (socket says 172.21.15.112:47946) 2024-09-15T23:59:26.362 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c37fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f38c415e450 0x7f38c40b7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34436/0 (socket says 172.21.15.112:34436) 2024-09-15T23:59:26.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c3fff640 1 -- 172.21.15.112:0/2723302395 learned_addr learned my addr 172.21.15.112:0/2723302395 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:26.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38bbfff640 1 --2- 172.21.15.112:0/2723302395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38c40b7670 0x7f38c40d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:26.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c37fe640 1 -- 172.21.15.112:0/2723302395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38c40b7670 msgr2=0x7f38c40d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:26.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c37fe640 1 --2- 172.21.15.112:0/2723302395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38c40b7670 0x7f38c40d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c37fe640 1 -- 172.21.15.112:0/2723302395 >> v1:172.21.15.112:6789/0 conn(0x7f38c40d4670 legacy=0x7f38c40d2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:26.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c2ffd640 1 -- 172.21.15.112:0/2723302395 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1945071208 0 0) 0x7f38c40d1f70 con 0x7f38c40d4670 2024-09-15T23:59:26.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.360+0000 7f38c37fe640 1 -- 172.21.15.112:0/2723302395 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c40d2210 con 0x7f38c415e450 2024-09-15T23:59:26.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.364+0000 7f38c37fe640 1 --2- 172.21.15.112:0/2723302395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415e450 0x7f38c40b7130 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f38b40097c0 tx=0x7f38b401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4be649cecadc48 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:26.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.364+0000 7f38c2ffd640 1 -- 172.21.15.112:0/2723302395 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b40aa5f0 con 0x7f38c415e450 2024-09-15T23:59:26.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.364+0000 7f38c2ffd640 1 -- 172.21.15.112:0/2723302395 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b40af070 con 0x7f38c415e450 2024-09-15T23:59:26.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.364+0000 7f38c2ffd640 1 -- 172.21.15.112:0/2723302395 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b40aa9b0 con 0x7f38c415e450 2024-09-15T23:59:26.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.364+0000 7f38c9b59640 1 -- 172.21.15.112:0/2723302395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415e450 msgr2=0x7f38c40b7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:26.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.364+0000 7f38c9b59640 1 --2- 172.21.15.112:0/2723302395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415e450 0x7f38c40b7130 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f38b40097c0 tx=0x7f38b401c470 comp rx=0 tx=0).stop 2024-09-15T23:59:26.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.364+0000 7f38c9b59640 1 -- 172.21.15.112:0/2723302395 shutdown_connections 2024-09-15T23:59:26.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.364+0000 7f38c9b59640 1 --2- 172.21.15.112:0/2723302395 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38c40b7670 0x7f38c40d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.364+0000 7f38c9b59640 1 --2- 172.21.15.112:0/2723302395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415e450 0x7f38c40b7130 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.364+0000 7f38c9b59640 1 -- 172.21.15.112:0/2723302395 >> 172.21.15.112:0/2723302395 conn(0x7f38c408bf90 msgr2=0x7f38c409d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:26.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.364+0000 7f38c9b59640 1 -- 172.21.15.112:0/2723302395 shutdown_connections 2024-09-15T23:59:26.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.364+0000 7f38c9b59640 1 -- 172.21.15.112:0/2723302395 wait complete. 2024-09-15T23:59:26.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.364+0000 7f38c9b59640 1 Processor -- start 2024-09-15T23:59:26.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.364+0000 7f38c9b59640 1 -- start start 2024-09-15T23:59:26.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c9b59640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38c40b7670 0x7f38c4148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:26.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c9b59640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38c40d4670 0x7f38c4149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:26.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c9b59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415e450 0x7f38c4149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:26.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c9b59640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f38c40b5030 con 0x7f38c415e450 2024-09-15T23:59:26.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c9b59640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f38c415ea40 con 0x7f38c40b7670 2024-09-15T23:59:26.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c9b59640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f38c40b51b0 con 0x7f38c40d4670 2024-09-15T23:59:26.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415e450 0x7f38c4149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:26.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415e450 0x7f38c4149870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34446/0 (socket says 172.21.15.112:34446) 2024-09-15T23:59:26.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c3fff640 1 -- 172.21.15.112:0/160736394 learned_addr learned my addr 172.21.15.112:0/160736394 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:26.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38bbfff640 1 --2- 172.21.15.112:0/160736394 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38c40d4670 0x7f38c4149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:26.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c37fe640 1 --2- 172.21.15.112:0/160736394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38c40b7670 0x7f38c4148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:26.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c3fff640 1 -- 172.21.15.112:0/160736394 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38c40d4670 msgr2=0x7f38c4149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:26.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c3fff640 1 --2- 172.21.15.112:0/160736394 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38c40d4670 0x7f38c4149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c3fff640 1 -- 172.21.15.112:0/160736394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38c40b7670 msgr2=0x7f38c4148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:26.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c3fff640 1 --2- 172.21.15.112:0/160736394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38c40b7670 0x7f38c4148260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:26.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c3fff640 1 -- 172.21.15.112:0/160736394 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c415ee30 con 0x7f38c415e450 2024-09-15T23:59:26.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c3fff640 1 --2- 172.21.15.112:0/160736394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415e450 0x7f38c4149870 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f38bc00cb20 tx=0x7f38bc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:26.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c0ff9640 1 -- 172.21.15.112:0/160736394 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00aca0 con 0x7f38c415e450 2024-09-15T23:59:26.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c0ff9640 1 -- 172.21.15.112:0/160736394 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38bc012400 con 0x7f38c415e450 2024-09-15T23:59:26.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c9b59640 1 -- 172.21.15.112:0/160736394 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c415f110 con 0x7f38c415e450 2024-09-15T23:59:26.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c0ff9640 1 -- 172.21.15.112:0/160736394 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00ae60 con 0x7f38c415e450 2024-09-15T23:59:26.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c9b59640 1 -- 172.21.15.112:0/160736394 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c415f6d0 con 0x7f38c415e450 2024-09-15T23:59:26.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c9b59640 1 -- 172.21.15.112:0/160736394 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c40d0610 con 0x7f38c415e450 2024-09-15T23:59:26.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c0ff9640 1 -- 172.21.15.112:0/160736394 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f38bc0127f0 con 0x7f38c415e450 2024-09-15T23:59:26.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c0ff9640 1 --2- 172.21.15.112:0/160736394 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38a40678c0 0x7f38a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:26.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c0ff9640 1 -- 172.21.15.112:0/160736394 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6187+0+0 (secure 0 0 0) 0x7f38bc086580 con 0x7f38c415e450 2024-09-15T23:59:26.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c37fe640 1 --2- 172.21.15.112:0/160736394 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38a40678c0 0x7f38a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:26.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.368+0000 7f38c37fe640 1 --2- 172.21.15.112:0/160736394 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38a40678c0 0x7f38a4069d80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f38b40ae000 tx=0x7f38b40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:26.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.372+0000 7f38c0ff9640 1 -- 172.21.15.112:0/160736394 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f38bc056ee0 con 0x7f38c415e450 2024-09-15T23:59:26.558 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:26.556+0000 7f38c9b59640 1 -- 172.21.15.112:0/160736394 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f38c40d0330 con 0x7f38c415e450 2024-09-15T23:59:27.233 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.232+0000 7f38c0ff9640 1 -- 172.21.15.112:0/160736394 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) ==== 104+0+0 (secure 0 0 0) 0x7f38bc0567e0 con 0x7f38c415e450 2024-09-15T23:59:27.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.236+0000 7f38c9b59640 1 -- 172.21.15.112:0/160736394 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38a40678c0 msgr2=0x7f38a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:27.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.236+0000 7f38c9b59640 1 --2- 172.21.15.112:0/160736394 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38a40678c0 0x7f38a4069d80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f38b40ae000 tx=0x7f38b40a7000 comp rx=0 tx=0).stop 2024-09-15T23:59:27.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.236+0000 7f38c9b59640 1 -- 172.21.15.112:0/160736394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415e450 msgr2=0x7f38c4149870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:27.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.236+0000 7f38c9b59640 1 --2- 172.21.15.112:0/160736394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415e450 0x7f38c4149870 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f38bc00cb20 tx=0x7f38bc00a060 comp rx=0 tx=0).stop 2024-09-15T23:59:27.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.236+0000 7f38c9b59640 1 -- 172.21.15.112:0/160736394 shutdown_connections 2024-09-15T23:59:27.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.236+0000 7f38c9b59640 1 --2- 172.21.15.112:0/160736394 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f38a40678c0 0x7f38a4069d80 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:27.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.236+0000 7f38c9b59640 1 --2- 172.21.15.112:0/160736394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c415e450 0x7f38c4149870 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:27.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.236+0000 7f38c9b59640 1 --2- 172.21.15.112:0/160736394 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f38c40d4670 0x7f38c4149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:27.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.236+0000 7f38c9b59640 1 --2- 172.21.15.112:0/160736394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38c40b7670 0x7f38c4148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:27.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.236+0000 7f38c9b59640 1 -- 172.21.15.112:0/160736394 >> 172.21.15.112:0/160736394 conn(0x7f38c408bf90 msgr2=0x7f38c415c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:27.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.236+0000 7f38c9b59640 1 -- 172.21.15.112:0/160736394 shutdown_connections 2024-09-15T23:59:27.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.236+0000 7f38c9b59640 1 -- 172.21.15.112:0/160736394 wait complete. 2024-09-15T23:59:27.260 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:59:27.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c869fc640 1 Processor -- start 2024-09-15T23:59:27.432 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c869fc640 1 -- start start 2024-09-15T23:59:27.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c869fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c800b50c0 0x7f3c800b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:27.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c869fc640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c800ae780 con 0x7f3c8006d3e0 2024-09-15T23:59:27.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c869fc640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c80158ce0 con 0x7f3c80158900 2024-09-15T23:59:27.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c869fc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3c800b5730 con 0x7f3c800b50c0 2024-09-15T23:59:27.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7f7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f3c8006d3e0 0x7f3c800b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:47950/0 (socket says 172.21.15.112:47950) 2024-09-15T23:59:27.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7f7fe640 1 -- 172.21.15.112:0/3539577031 learned_addr learned my addr 172.21.15.112:0/3539577031 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:27.433 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c84f99640 1 --2- 172.21.15.112:0/3539577031 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c800b50c0 0x7f3c800b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:27.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 -- 172.21.15.112:0/3539577031 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4064445030 0 0) 0x7f3c68001120 con 0x7f3c8006d3e0 2024-09-15T23:59:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 -- 172.21.15.112:0/3539577031 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c6c003530 con 0x7f3c8006d3e0 2024-09-15T23:59:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 -- 172.21.15.112:0/3539577031 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3069499281 0 0) 0x7f3c6c003530 con 0x7f3c8006d3e0 2024-09-15T23:59:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 -- 172.21.15.112:0/3539577031 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c800b50c0 msgr2=0x7f3c800b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 --2- 172.21.15.112:0/3539577031 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c800b50c0 0x7f3c800b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 -- 172.21.15.112:0/3539577031 >> v1:172.21.15.169:6789/0 conn(0x7f3c80158900 legacy=0x7f3c8006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 -- 172.21.15.112:0/3539577031 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8015e960 con 0x7f3c8006d3e0 2024-09-15T23:59:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 -- 172.21.15.112:0/3539577031 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f3c68001850 con 0x7f3c8006d3e0 2024-09-15T23:59:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 -- 172.21.15.112:0/3539577031 >> v1:172.21.15.112:6789/0 conn(0x7f3c8006d3e0 legacy=0x7f3c800b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 --2- 172.21.15.112:0/3539577031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c6c0039f0 0x7f3c6c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 --2- 172.21.15.112:0/3539577031 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c800b50c0 0x7f3c6c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 --2- 172.21.15.112:0/3539577031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c6c004d50 0x7f3c6c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 -- 172.21.15.112:0/3539577031 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3c800b5730 con 0x7f3c6c004d50 2024-09-15T23:59:27.435 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 -- 172.21.15.112:0/3539577031 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c00bab0 con 0x7f3c6c0039f0 2024-09-15T23:59:27.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7effd640 1 -- 172.21.15.112:0/3539577031 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3c6c00bcb0 con 0x7f3c800b50c0 2024-09-15T23:59:27.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7f7fe640 1 --2- 172.21.15.112:0/3539577031 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c800b50c0 0x7f3c6c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:27.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c7ffff640 1 --2- 172.21.15.112:0/3539577031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c6c0039f0 0x7f3c6c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:27.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.432+0000 7f3c84f99640 1 --2- 172.21.15.112:0/3539577031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c6c004d50 0x7f3c6c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:27.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c7f7fe640 1 -- 172.21.15.112:0/3539577031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c6c0039f0 msgr2=0x7f3c6c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:27.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c7f7fe640 1 --2- 172.21.15.112:0/3539577031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c6c0039f0 0x7f3c6c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:27.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c7f7fe640 1 -- 172.21.15.112:0/3539577031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c6c004d50 msgr2=0x7f3c6c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:27.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c7f7fe640 1 --2- 172.21.15.112:0/3539577031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c6c004d50 0x7f3c6c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:27.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c7f7fe640 1 -- 172.21.15.112:0/3539577031 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c003530 con 0x7f3c800b50c0 2024-09-15T23:59:27.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c7f7fe640 1 --2- 172.21.15.112:0/3539577031 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c800b50c0 0x7f3c6c004810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800c2f0 tx=0x7f3c6801cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0b8f23fb9704de9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:27.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c7effd640 1 -- 172.21.15.112:0/3539577031 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c68007e20 con 0x7f3c800b50c0 2024-09-15T23:59:27.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c7effd640 1 -- 172.21.15.112:0/3539577031 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c680a9070 con 0x7f3c800b50c0 2024-09-15T23:59:27.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c7effd640 1 -- 172.21.15.112:0/3539577031 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c68005d40 con 0x7f3c800b50c0 2024-09-15T23:59:27.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c869fc640 1 -- 172.21.15.112:0/3539577031 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c800b50c0 msgr2=0x7f3c6c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:27.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c869fc640 1 --2- 172.21.15.112:0/3539577031 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c800b50c0 0x7f3c6c004810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800c2f0 tx=0x7f3c6801cb80 comp rx=0 tx=0).stop 2024-09-15T23:59:27.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c84f99640 1 -- 172.21.15.112:0/3539577031 reap_dead start 2024-09-15T23:59:27.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c869fc640 1 -- 172.21.15.112:0/3539577031 shutdown_connections 2024-09-15T23:59:27.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c869fc640 1 -- 172.21.15.112:0/3539577031 >> 172.21.15.112:0/3539577031 conn(0x7f3c80072670 msgr2=0x7f3c80072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:27.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c869fc640 1 -- 172.21.15.112:0/3539577031 shutdown_connections 2024-09-15T23:59:27.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.436+0000 7f3c869fc640 1 -- 172.21.15.112:0/3539577031 wait complete. 2024-09-15T23:59:27.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c869fc640 1 Processor -- start 2024-09-15T23:59:27.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c869fc640 1 -- start start 2024-09-15T23:59:27.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c869fc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c800b50c0 0x7f3c801e4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:27.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c869fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c80155550 0x7f3c801473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:27.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c869fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c80154d10 0x7f3c8006ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:27.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c869fc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8015f200 con 0x7f3c80155550 2024-09-15T23:59:27.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c869fc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8015ef20 con 0x7f3c800b50c0 2024-09-15T23:59:27.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c869fc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3c8015f720 con 0x7f3c80154d10 2024-09-15T23:59:27.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c7f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c80155550 0x7f3c801473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c7f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c80155550 0x7f3c801473a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34460/0 (socket says 172.21.15.112:34460) 2024-09-15T23:59:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c7f7fe640 1 -- 172.21.15.112:0/1928550990 learned_addr learned my addr 172.21.15.112:0/1928550990 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c84f99640 1 --2- 172.21.15.112:0/1928550990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c80154d10 0x7f3c8006ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c7ffff640 1 --2- 172.21.15.112:0/1928550990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c800b50c0 0x7f3c801e4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c7f7fe640 1 -- 172.21.15.112:0/1928550990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c80154d10 msgr2=0x7f3c8006ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c7f7fe640 1 --2- 172.21.15.112:0/1928550990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c80154d10 0x7f3c8006ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c7f7fe640 1 -- 172.21.15.112:0/1928550990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c800b50c0 msgr2=0x7f3c801e4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c7f7fe640 1 --2- 172.21.15.112:0/1928550990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c800b50c0 0x7f3c801e4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c7f7fe640 1 -- 172.21.15.112:0/1928550990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c80155b10 con 0x7f3c80155550 2024-09-15T23:59:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c7f7fe640 1 --2- 172.21.15.112:0/1928550990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c80155550 0x7f3c801473a0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f3c6801c9b0 tx=0x7f3c6c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:27.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c7cff9640 1 -- 172.21.15.112:0/1928550990 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c680a5a90 con 0x7f3c80155550 2024-09-15T23:59:27.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c7cff9640 1 -- 172.21.15.112:0/1928550990 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c680a5c30 con 0x7f3c80155550 2024-09-15T23:59:27.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c869fc640 1 -- 172.21.15.112:0/1928550990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c80155df0 con 0x7f3c80155550 2024-09-15T23:59:27.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c7cff9640 1 -- 172.21.15.112:0/1928550990 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c680047f0 con 0x7f3c80155550 2024-09-15T23:59:27.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c869fc640 1 -- 172.21.15.112:0/1928550990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c80155190 con 0x7f3c80155550 2024-09-15T23:59:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c869fc640 1 -- 172.21.15.112:0/1928550990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c800b5b70 con 0x7f3c80155550 2024-09-15T23:59:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.440+0000 7f3c7cff9640 1 -- 172.21.15.112:0/1928550990 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3c68004990 con 0x7f3c80155550 2024-09-15T23:59:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.444+0000 7f3c7cff9640 1 --2- 172.21.15.112:0/1928550990 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3c600678c0 0x7f3c60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.444+0000 7f3c7cff9640 1 -- 172.21.15.112:0/1928550990 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6187+0+0 (secure 0 0 0) 0x7f3c6811f820 con 0x7f3c80155550 2024-09-15T23:59:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.444+0000 7f3c7ffff640 1 --2- 172.21.15.112:0/1928550990 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3c600678c0 0x7f3c60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:27.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.444+0000 7f3c7ffff640 1 --2- 172.21.15.112:0/1928550990 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3c600678c0 0x7f3c60069d80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3c70003fc0 tx=0x7f3c70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:27.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.448+0000 7f3c7cff9640 1 -- 172.21.15.112:0/1928550990 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3c800ae780 con 0x7f3c80155550 2024-09-15T23:59:27.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:27.596+0000 7f3c869fc640 1 -- 172.21.15.112:0/1928550990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3c8006fe30 con 0x7f3c80155550 2024-09-15T23:59:28.436 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.436+0000 7f3c7cff9640 1 -- 172.21.15.112:0/1928550990 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v117) ==== 181+0+0 (secure 0 0 0) 0x7f3c680f0210 con 0x7f3c80155550 2024-09-15T23:59:28.436 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:59:28.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.440+0000 7f3c869fc640 1 -- 172.21.15.112:0/1928550990 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3c600678c0 msgr2=0x7f3c60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:28.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.440+0000 7f3c869fc640 1 --2- 172.21.15.112:0/1928550990 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3c600678c0 0x7f3c60069d80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3c70003fc0 tx=0x7f3c70009040 comp rx=0 tx=0).stop 2024-09-15T23:59:28.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.440+0000 7f3c869fc640 1 -- 172.21.15.112:0/1928550990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c80155550 msgr2=0x7f3c801473a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:28.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.440+0000 7f3c869fc640 1 --2- 172.21.15.112:0/1928550990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c80155550 0x7f3c801473a0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f3c6801c9b0 tx=0x7f3c6c005840 comp rx=0 tx=0).stop 2024-09-15T23:59:28.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.440+0000 7f3c869fc640 1 -- 172.21.15.112:0/1928550990 shutdown_connections 2024-09-15T23:59:28.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.440+0000 7f3c869fc640 1 --2- 172.21.15.112:0/1928550990 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f3c600678c0 0x7f3c60069d80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:28.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.440+0000 7f3c869fc640 1 --2- 172.21.15.112:0/1928550990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c80154d10 0x7f3c8006ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:28.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.440+0000 7f3c869fc640 1 --2- 172.21.15.112:0/1928550990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c80155550 0x7f3c801473a0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:28.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.440+0000 7f3c869fc640 1 --2- 172.21.15.112:0/1928550990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c800b50c0 0x7f3c801e4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:28.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.440+0000 7f3c869fc640 1 -- 172.21.15.112:0/1928550990 >> 172.21.15.112:0/1928550990 conn(0x7f3c80072670 msgr2=0x7f3c8006e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:28.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.440+0000 7f3c869fc640 1 -- 172.21.15.112:0/1928550990 shutdown_connections 2024-09-15T23:59:28.442 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.440+0000 7f3c869fc640 1 -- 172.21.15.112:0/1928550990 wait complete. 2024-09-15T23:59:28.461 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:59:28.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59b6787640 1 Processor -- start 2024-09-15T23:59:28.588 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59b6787640 1 -- start start 2024-09-15T23:59:28.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59b6787640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f59b015c2a0 0x7f59b00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:28.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59b6787640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f59b00af2a0 0x7f59b006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:28.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59b6787640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59b00b3290 con 0x7f59b015bec0 2024-09-15T23:59:28.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59b6787640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f59b00b3570 con 0x7f59b015c2a0 2024-09-15T23:59:28.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59b6787640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f59b00b3850 con 0x7f59b00af2a0 2024-09-15T23:59:28.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59af7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f59b015c2a0 0x7f59b00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:28.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59affff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f59b015bec0 0x7f59b00ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:50994/0 (socket says 172.21.15.112:50994) 2024-09-15T23:59:28.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59affff640 1 -- 172.21.15.112:0/2065535586 learned_addr learned my addr 172.21.15.112:0/2065535586 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:28.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59b4d24640 1 --2- 172.21.15.112:0/2065535586 >> v2:172.21.15.169:3300/0 conn(0x7f59b00af2a0 0x7f59b006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:28.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59af7fe640 1 -- 172.21.15.112:0/2065535586 >> v2:172.21.15.169:3300/0 conn(0x7f59b00af2a0 msgr2=0x7f59b006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:28.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59af7fe640 1 --2- 172.21.15.112:0/2065535586 >> v2:172.21.15.169:3300/0 conn(0x7f59b00af2a0 0x7f59b006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:28.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59af7fe640 1 -- 172.21.15.112:0/2065535586 >> v1:172.21.15.112:6789/0 conn(0x7f59b015bec0 legacy=0x7f59b00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:28.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59af7fe640 1 -- 172.21.15.112:0/2065535586 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b00b3b30 con 0x7f59b015c2a0 2024-09-15T23:59:28.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59aeffd640 1 -- 172.21.15.112:0/2065535586 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2444125071 0 0) 0x7f59b00b3290 con 0x7f59b015bec0 2024-09-15T23:59:28.590 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.588+0000 7f59b4d24640 1 --2- 172.21.15.112:0/2065535586 >> v2:172.21.15.169:3300/0 conn(0x7f59b00af2a0 0x7f59b006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:28.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59af7fe640 1 --2- 172.21.15.112:0/2065535586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b015c2a0 0x7f59b00aed60 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f59b00b2fb0 tx=0x7f59a001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6d1ab16c33e0cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:28.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59aeffd640 1 -- 172.21.15.112:0/2065535586 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a00ab650 con 0x7f59b015c2a0 2024-09-15T23:59:28.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59aeffd640 1 -- 172.21.15.112:0/2065535586 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a00b0070 con 0x7f59b015c2a0 2024-09-15T23:59:28.592 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59aeffd640 1 -- 172.21.15.112:0/2065535586 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a00aba10 con 0x7f59b015c2a0 2024-09-15T23:59:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 -- 172.21.15.112:0/2065535586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b015c2a0 msgr2=0x7f59b00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 --2- 172.21.15.112:0/2065535586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b015c2a0 0x7f59b00aed60 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f59b00b2fb0 tx=0x7f59a001c450 comp rx=0 tx=0).stop 2024-09-15T23:59:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 -- 172.21.15.112:0/2065535586 shutdown_connections 2024-09-15T23:59:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 --2- 172.21.15.112:0/2065535586 >> v2:172.21.15.169:3300/0 conn(0x7f59b00af2a0 0x7f59b006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 --2- 172.21.15.112:0/2065535586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b015c2a0 0x7f59b00aed60 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 -- 172.21.15.112:0/2065535586 >> 172.21.15.112:0/2065535586 conn(0x7f59b00b1f90 msgr2=0x7f59b00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 -- 172.21.15.112:0/2065535586 shutdown_connections 2024-09-15T23:59:28.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 -- 172.21.15.112:0/2065535586 wait complete. 2024-09-15T23:59:28.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 Processor -- start 2024-09-15T23:59:28.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 -- start start 2024-09-15T23:59:28.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59b00af2a0 0x7f59b014c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:28.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b015bec0 0x7f59b014e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:28.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59b015c2a0 0x7f59b014e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:28.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f59b006ed50 con 0x7f59b015bec0 2024-09-15T23:59:28.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f59b00af6b0 con 0x7f59b015c2a0 2024-09-15T23:59:28.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.592+0000 7f59b6787640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f59b006eed0 con 0x7f59b00af2a0 2024-09-15T23:59:28.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59af7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b015bec0 0x7f59b014e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:28.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59af7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b015bec0 0x7f59b014e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38354/0 (socket says 172.21.15.112:38354) 2024-09-15T23:59:28.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59af7fe640 1 -- 172.21.15.112:0/3025339620 learned_addr learned my addr 172.21.15.112:0/3025339620 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:28.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59af7fe640 1 -- 172.21.15.112:0/3025339620 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59b00af2a0 msgr2=0x7f59b014c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:28.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59af7fe640 1 --2- 172.21.15.112:0/3025339620 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59b00af2a0 0x7f59b014c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:28.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59b4d24640 1 --2- 172.21.15.112:0/3025339620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59b015c2a0 0x7f59b014e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:28.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59af7fe640 1 -- 172.21.15.112:0/3025339620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59b015c2a0 msgr2=0x7f59b014e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:28.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59af7fe640 1 --2- 172.21.15.112:0/3025339620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59b015c2a0 0x7f59b014e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:28.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59af7fe640 1 -- 172.21.15.112:0/3025339620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b0150a80 con 0x7f59b015bec0 2024-09-15T23:59:28.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59af7fe640 1 --2- 172.21.15.112:0/3025339620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b015bec0 0x7f59b014e090 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f59a001ab00 tx=0x7f59a00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:28.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59acff9640 1 -- 172.21.15.112:0/3025339620 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a0004220 con 0x7f59b015bec0 2024-09-15T23:59:28.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59acff9640 1 -- 172.21.15.112:0/3025339620 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a00043c0 con 0x7f59b015bec0 2024-09-15T23:59:28.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59b6787640 1 -- 172.21.15.112:0/3025339620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b015cc70 con 0x7f59b015bec0 2024-09-15T23:59:28.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59acff9640 1 -- 172.21.15.112:0/3025339620 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a00abaf0 con 0x7f59b015bec0 2024-09-15T23:59:28.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59b6787640 1 -- 172.21.15.112:0/3025339620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b015d230 con 0x7f59b015bec0 2024-09-15T23:59:28.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59b6787640 1 -- 172.21.15.112:0/3025339620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b006f1d0 con 0x7f59b015bec0 2024-09-15T23:59:28.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59acff9640 1 -- 172.21.15.112:0/3025339620 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59a00abc90 con 0x7f59b015bec0 2024-09-15T23:59:28.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59acff9640 1 --2- 172.21.15.112:0/3025339620 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f599c0678c0 0x7f599c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:28.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59acff9640 1 -- 172.21.15.112:0/3025339620 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5749+0+0 (secure 0 0 0) 0x7f59a0120270 con 0x7f59b015bec0 2024-09-15T23:59:28.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59affff640 1 --2- 172.21.15.112:0/3025339620 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f599c0678c0 0x7f599c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:28.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.596+0000 7f59affff640 1 --2- 172.21.15.112:0/3025339620 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f599c0678c0 0x7f599c069d80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f59a40011f0 tx=0x7f59a4007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:28.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.600+0000 7f59acff9640 1 -- 172.21.15.112:0/3025339620 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f59a00c4060 con 0x7f59b015bec0 2024-09-15T23:59:28.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:28.764+0000 7f59b6787640 1 -- 172.21.15.112:0/3025339620 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f59b006fcd0 con 0x7f59b015bec0 2024-09-15T23:59:29.446 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.444+0000 7f59acff9640 1 -- 172.21.15.112:0/3025339620 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v118) ==== 169+0+0 (secure 0 0 0) 0x7f59a00b9070 con 0x7f59b015bec0 2024-09-15T23:59:29.446 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'cephfs_data' removed 2024-09-15T23:59:29.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.452+0000 7f59b6787640 1 -- 172.21.15.112:0/3025339620 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f599c0678c0 msgr2=0x7f599c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:29.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.452+0000 7f59b6787640 1 --2- 172.21.15.112:0/3025339620 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f599c0678c0 0x7f599c069d80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f59a40011f0 tx=0x7f59a4007930 comp rx=0 tx=0).stop 2024-09-15T23:59:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.452+0000 7f59b6787640 1 -- 172.21.15.112:0/3025339620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b015bec0 msgr2=0x7f59b014e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.452+0000 7f59b6787640 1 --2- 172.21.15.112:0/3025339620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b015bec0 0x7f59b014e090 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f59a001ab00 tx=0x7f59a00191f0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.452+0000 7f59b6787640 1 -- 172.21.15.112:0/3025339620 shutdown_connections 2024-09-15T23:59:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.452+0000 7f59b6787640 1 --2- 172.21.15.112:0/3025339620 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f599c0678c0 0x7f599c069d80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.452+0000 7f59b6787640 1 --2- 172.21.15.112:0/3025339620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59b015c2a0 0x7f59b014e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.452+0000 7f59b6787640 1 --2- 172.21.15.112:0/3025339620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59b015bec0 0x7f59b014e090 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.452+0000 7f59b6787640 1 --2- 172.21.15.112:0/3025339620 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59b00af2a0 0x7f59b014c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.452+0000 7f59b6787640 1 -- 172.21.15.112:0/3025339620 >> 172.21.15.112:0/3025339620 conn(0x7f59b00b1f90 msgr2=0x7f59b00b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:29.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.452+0000 7f59b6787640 1 -- 172.21.15.112:0/3025339620 shutdown_connections 2024-09-15T23:59:29.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.452+0000 7f59b6787640 1 -- 172.21.15.112:0/3025339620 wait complete. 2024-09-15T23:59:29.473 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:59:29.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61e5578640 1 Processor -- start 2024-09-15T23:59:29.596 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61e5578640 1 -- start start 2024-09-15T23:59:29.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61e5578640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f61e0070a50 0x7f61e006d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:29.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61e5578640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f61e006d820 0x7f61e015f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:29.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61e5578640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e006e590 con 0x7f61e0147e40 2024-09-15T23:59:29.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61e5578640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f61e006dfd0 con 0x7f61e006d820 2024-09-15T23:59:29.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61e5578640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f61e006e2b0 con 0x7f61e0070a50 2024-09-15T23:59:29.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61df7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f61e006d820 0x7f61e015f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:29.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61deffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f61e0147e40 0x7f61e0070340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:50998/0 (socket says 172.21.15.112:50998) 2024-09-15T23:59:29.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61deffd640 1 -- 172.21.15.112:0/375083472 learned_addr learned my addr 172.21.15.112:0/375083472 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:29.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61de7fc640 1 --2- 172.21.15.112:0/375083472 >> v2:172.21.15.169:3300/0 conn(0x7f61e0070a50 0x7f61e006d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:29.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61df7fe640 1 -- 172.21.15.112:0/375083472 >> v2:172.21.15.169:3300/0 conn(0x7f61e0070a50 msgr2=0x7f61e006d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:29.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61df7fe640 1 --2- 172.21.15.112:0/375083472 >> v2:172.21.15.169:3300/0 conn(0x7f61e0070a50 0x7f61e006d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61df7fe640 1 -- 172.21.15.112:0/375083472 >> v1:172.21.15.112:6789/0 conn(0x7f61e0147e40 legacy=0x7f61e0070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:29.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61df7fe640 1 -- 172.21.15.112:0/375083472 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e015eb30 con 0x7f61e006d820 2024-09-15T23:59:29.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.596+0000 7f61ddffb640 1 -- 172.21.15.112:0/375083472 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3088732333 0 0) 0x7f61e006e590 con 0x7f61e0147e40 2024-09-15T23:59:29.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61df7fe640 1 --2- 172.21.15.112:0/375083472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61e006d820 0x7f61e015f330 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f61e00b1e00 tx=0x7f61d001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb916992e1436bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:29.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61ddffb640 1 -- 172.21.15.112:0/375083472 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d00b0070 con 0x7f61e006d820 2024-09-15T23:59:29.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61ddffb640 1 -- 172.21.15.112:0/375083472 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d00ab600 con 0x7f61e006d820 2024-09-15T23:59:29.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61ddffb640 1 -- 172.21.15.112:0/375083472 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d00ab9d0 con 0x7f61e006d820 2024-09-15T23:59:29.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 -- 172.21.15.112:0/375083472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61e006d820 msgr2=0x7f61e015f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:29.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 --2- 172.21.15.112:0/375083472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61e006d820 0x7f61e015f330 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f61e00b1e00 tx=0x7f61d001c480 comp rx=0 tx=0).stop 2024-09-15T23:59:29.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 -- 172.21.15.112:0/375083472 shutdown_connections 2024-09-15T23:59:29.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 --2- 172.21.15.112:0/375083472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61e006d820 0x7f61e015f330 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 --2- 172.21.15.112:0/375083472 >> v2:172.21.15.169:3300/0 conn(0x7f61e0070a50 0x7f61e006d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 -- 172.21.15.112:0/375083472 >> 172.21.15.112:0/375083472 conn(0x7f61e006be90 msgr2=0x7f61e006c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:29.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 -- 172.21.15.112:0/375083472 shutdown_connections 2024-09-15T23:59:29.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 -- 172.21.15.112:0/375083472 wait complete. 2024-09-15T23:59:29.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 Processor -- start 2024-09-15T23:59:29.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 -- start start 2024-09-15T23:59:29.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61e006d820 0x7f61e015c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:29.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61e0070a50 0x7f61e015ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:29.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61e0147e40 0x7f61e015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:29.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f61e0160410 con 0x7f61e0070a50 2024-09-15T23:59:29.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61e0160290 con 0x7f61e006d820 2024-09-15T23:59:29.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.600+0000 7f61e5578640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f61e0160590 con 0x7f61e0147e40 2024-09-15T23:59:29.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61de7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61e0070a50 0x7f61e015ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:29.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61de7fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61e0070a50 0x7f61e015ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38368/0 (socket says 172.21.15.112:38368) 2024-09-15T23:59:29.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61de7fc640 1 -- 172.21.15.112:0/808553139 learned_addr learned my addr 172.21.15.112:0/808553139 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:29.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61de7fc640 1 -- 172.21.15.112:0/808553139 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61e0147e40 msgr2=0x7f61e015cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:29.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61de7fc640 1 --2- 172.21.15.112:0/808553139 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61e0147e40 0x7f61e015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61de7fc640 1 -- 172.21.15.112:0/808553139 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61e006d820 msgr2=0x7f61e015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:29.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61de7fc640 1 --2- 172.21.15.112:0/808553139 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61e006d820 0x7f61e015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61de7fc640 1 -- 172.21.15.112:0/808553139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e0163fb0 con 0x7f61e0070a50 2024-09-15T23:59:29.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61de7fc640 1 --2- 172.21.15.112:0/808553139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61e0070a50 0x7f61e015ca30 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f61d4007ec0 tx=0x7f61d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:29.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61c77fe640 1 -- 172.21.15.112:0/808553139 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4014620 con 0x7f61e0070a50 2024-09-15T23:59:29.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61c77fe640 1 -- 172.21.15.112:0/808553139 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d4019070 con 0x7f61e0070a50 2024-09-15T23:59:29.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61e5578640 1 -- 172.21.15.112:0/808553139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e0164290 con 0x7f61e0070a50 2024-09-15T23:59:29.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61c77fe640 1 -- 172.21.15.112:0/808553139 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4014a20 con 0x7f61e0070a50 2024-09-15T23:59:29.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61e5578640 1 -- 172.21.15.112:0/808553139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e013fe00 con 0x7f61e0070a50 2024-09-15T23:59:29.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61e5578640 1 -- 172.21.15.112:0/808553139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e015f330 con 0x7f61e0070a50 2024-09-15T23:59:29.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61c77fe640 1 -- 172.21.15.112:0/808553139 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f61d4014bc0 con 0x7f61e0070a50 2024-09-15T23:59:29.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61c77fe640 1 --2- 172.21.15.112:0/808553139 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f61cc0678c0 0x7f61cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:29.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61c77fe640 1 -- 172.21.15.112:0/808553139 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f61d4086520 con 0x7f61e0070a50 2024-09-15T23:59:29.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61deffd640 1 --2- 172.21.15.112:0/808553139 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f61cc0678c0 0x7f61cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:29.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.604+0000 7f61deffd640 1 --2- 172.21.15.112:0/808553139 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f61cc0678c0 0x7f61cc069d80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f61d80015a0 tx=0x7f61d8007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:29.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.608+0000 7f61c77fe640 1 -- 172.21.15.112:0/808553139 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f61d4057140 con 0x7f61e0070a50 2024-09-15T23:59:29.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.772+0000 7f61e5578640 1 -- 172.21.15.112:0/808553139 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f61e006d480 con 0x7f61e0070a50 2024-09-15T23:59:29.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.776+0000 7f61c77fe640 1 -- 172.21.15.112:0/808553139 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7f61d4056a40 con 0x7f61e0070a50 2024-09-15T23:59:29.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.776+0000 7f61e5578640 1 -- 172.21.15.112:0/808553139 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f61cc0678c0 msgr2=0x7f61cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:29.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.776+0000 7f61e5578640 1 --2- 172.21.15.112:0/808553139 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f61cc0678c0 0x7f61cc069d80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f61d80015a0 tx=0x7f61d8007970 comp rx=0 tx=0).stop 2024-09-15T23:59:29.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.776+0000 7f61e5578640 1 -- 172.21.15.112:0/808553139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61e0070a50 msgr2=0x7f61e015ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:29.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.776+0000 7f61e5578640 1 --2- 172.21.15.112:0/808553139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61e0070a50 0x7f61e015ca30 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f61d4007ec0 tx=0x7f61d400e4b0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.776+0000 7f61e5578640 1 -- 172.21.15.112:0/808553139 shutdown_connections 2024-09-15T23:59:29.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.776+0000 7f61e5578640 1 --2- 172.21.15.112:0/808553139 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f61cc0678c0 0x7f61cc069d80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.776+0000 7f61e5578640 1 --2- 172.21.15.112:0/808553139 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61e0147e40 0x7f61e015cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.776+0000 7f61e5578640 1 --2- 172.21.15.112:0/808553139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61e0070a50 0x7f61e015ca30 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.776+0000 7f61e5578640 1 --2- 172.21.15.112:0/808553139 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61e006d820 0x7f61e015c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.776+0000 7f61e5578640 1 -- 172.21.15.112:0/808553139 >> 172.21.15.112:0/808553139 conn(0x7f61e006be90 msgr2=0x7f61e0161910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:29.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.776+0000 7f61e5578640 1 -- 172.21.15.112:0/808553139 shutdown_connections 2024-09-15T23:59:29.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.776+0000 7f61e5578640 1 -- 172.21.15.112:0/808553139 wait complete. 2024-09-15T23:59:29.795 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration' 2024-09-15T23:59:29.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff236952640 1 Processor -- start 2024-09-15T23:59:29.919 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff236952640 1 -- start start 2024-09-15T23:59:29.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff236952640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff2301520a0 0x7ff23006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:29.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff236952640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff23006fe50 0x7ff23015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:29.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff236952640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff23015f1d0 0x7ff230071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:29.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff236952640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ff230152480 con 0x7ff23015f1d0 2024-09-15T23:59:29.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff236952640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff230070250 con 0x7ff2301520a0 2024-09-15T23:59:29.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff236952640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff2300aede0 con 0x7ff23006fe50 2024-09-15T23:59:29.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff234eef640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff23015f1d0 0x7ff230071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:29.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff234eef640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ff23015f1d0 0x7ff230071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38372/0 (socket says 172.21.15.112:38372) 2024-09-15T23:59:29.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff234eef640 1 -- 172.21.15.112:0/1367441340 learned_addr learned my addr 172.21.15.112:0/1367441340 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:29.921 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff22f7fe640 1 --2- 172.21.15.112:0/1367441340 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff23006fe50 0x7ff23015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:29.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff22ffff640 1 --2- 172.21.15.112:0/1367441340 >> v2:172.21.15.169:3300/0 conn(0x7ff2301520a0 0x7ff23006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:29.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff234eef640 1 -- 172.21.15.112:0/1367441340 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff23006fe50 msgr2=0x7ff23015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:29.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff234eef640 1 --2- 172.21.15.112:0/1367441340 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff23006fe50 0x7ff23015ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff234eef640 1 -- 172.21.15.112:0/1367441340 >> v2:172.21.15.169:3300/0 conn(0x7ff2301520a0 msgr2=0x7ff23006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:29.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff234eef640 1 --2- 172.21.15.112:0/1367441340 >> v2:172.21.15.169:3300/0 conn(0x7ff2301520a0 0x7ff23006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff234eef640 1 -- 172.21.15.112:0/1367441340 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23015fa10 con 0x7ff23015f1d0 2024-09-15T23:59:29.922 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff22ffff640 1 --2- 172.21.15.112:0/1367441340 >> v2:172.21.15.169:3300/0 conn(0x7ff2301520a0 0x7ff23006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:29.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.920+0000 7ff234eef640 1 --2- 172.21.15.112:0/1367441340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff23015f1d0 0x7ff230071f10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7ff230071710 tx=0x7ff22801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2b0734f322a114 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:29.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff22effd640 1 -- 172.21.15.112:0/1367441340 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2280a5590 con 0x7ff23015f1d0 2024-09-15T23:59:29.923 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff22effd640 1 -- 172.21.15.112:0/1367441340 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2280a5730 con 0x7ff23015f1d0 2024-09-15T23:59:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff22effd640 1 -- 172.21.15.112:0/1367441340 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2280a5b00 con 0x7ff23015f1d0 2024-09-15T23:59:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 -- 172.21.15.112:0/1367441340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff23015f1d0 msgr2=0x7ff230071f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 --2- 172.21.15.112:0/1367441340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff23015f1d0 0x7ff230071f10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7ff230071710 tx=0x7ff22801c710 comp rx=0 tx=0).stop 2024-09-15T23:59:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 -- 172.21.15.112:0/1367441340 shutdown_connections 2024-09-15T23:59:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 --2- 172.21.15.112:0/1367441340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff23015f1d0 0x7ff230071f10 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 --2- 172.21.15.112:0/1367441340 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff23006fe50 0x7ff23015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 --2- 172.21.15.112:0/1367441340 >> v2:172.21.15.169:3300/0 conn(0x7ff2301520a0 0x7ff23006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 -- 172.21.15.112:0/1367441340 >> 172.21.15.112:0/1367441340 conn(0x7ff2300b1f90 msgr2=0x7ff2300b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 -- 172.21.15.112:0/1367441340 shutdown_connections 2024-09-15T23:59:29.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 -- 172.21.15.112:0/1367441340 wait complete. 2024-09-15T23:59:29.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 Processor -- start 2024-09-15T23:59:29.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 -- start start 2024-09-15T23:59:29.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff23006fe50 0x7ff2300ce660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:29.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2301520a0 0x7ff23015c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:29.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff23015f1d0 0x7ff230099540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:29.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff230073d30 con 0x7ff2301520a0 2024-09-15T23:59:29.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff230073a50 con 0x7ff23006fe50 2024-09-15T23:59:29.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff236952640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff23015f680 con 0x7ff23015f1d0 2024-09-15T23:59:29.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff22f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2301520a0 0x7ff23015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:29.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff22f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2301520a0 0x7ff23015c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38384/0 (socket says 172.21.15.112:38384) 2024-09-15T23:59:29.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff22f7fe640 1 -- 172.21.15.112:0/1214780987 learned_addr learned my addr 172.21.15.112:0/1214780987 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:29.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff234eef640 1 --2- 172.21.15.112:0/1214780987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff23015f1d0 0x7ff230099540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:29.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff22ffff640 1 --2- 172.21.15.112:0/1214780987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff23006fe50 0x7ff2300ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:29.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff22f7fe640 1 -- 172.21.15.112:0/1214780987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff23015f1d0 msgr2=0x7ff230099540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:29.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff22f7fe640 1 --2- 172.21.15.112:0/1214780987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff23015f1d0 0x7ff230099540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff22f7fe640 1 -- 172.21.15.112:0/1214780987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff23006fe50 msgr2=0x7ff2300ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:29.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff22f7fe640 1 --2- 172.21.15.112:0/1214780987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff23006fe50 0x7ff2300ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:29.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.924+0000 7ff22f7fe640 1 -- 172.21.15.112:0/1214780987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2300cd760 con 0x7ff2301520a0 2024-09-15T23:59:29.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.928+0000 7ff22f7fe640 1 --2- 172.21.15.112:0/1214780987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2301520a0 0x7ff23015c910 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7ff22400c580 tx=0x7ff22400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:29.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.928+0000 7ff22cff9640 1 -- 172.21.15.112:0/1214780987 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff224004230 con 0x7ff2301520a0 2024-09-15T23:59:29.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.928+0000 7ff22cff9640 1 -- 172.21.15.112:0/1214780987 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2240043d0 con 0x7ff2301520a0 2024-09-15T23:59:29.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.928+0000 7ff22cff9640 1 -- 172.21.15.112:0/1214780987 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff224003860 con 0x7ff2301520a0 2024-09-15T23:59:29.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.928+0000 7ff236952640 1 -- 172.21.15.112:0/1214780987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2300cda00 con 0x7ff2301520a0 2024-09-15T23:59:29.929 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.928+0000 7ff236952640 1 -- 172.21.15.112:0/1214780987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2301642e0 con 0x7ff2301520a0 2024-09-15T23:59:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.928+0000 7ff236952640 1 -- 172.21.15.112:0/1214780987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2301644e0 con 0x7ff2301520a0 2024-09-15T23:59:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.928+0000 7ff22cff9640 1 -- 172.21.15.112:0/1214780987 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff224003a00 con 0x7ff2301520a0 2024-09-15T23:59:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.928+0000 7ff22cff9640 1 --2- 172.21.15.112:0/1214780987 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff21c0678c0 0x7ff21c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.928+0000 7ff22ffff640 1 --2- 172.21.15.112:0/1214780987 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff21c0678c0 0x7ff21c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.928+0000 7ff22cff9640 1 -- 172.21.15.112:0/1214780987 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7ff224085ab0 con 0x7ff2301520a0 2024-09-15T23:59:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.928+0000 7ff22ffff640 1 --2- 172.21.15.112:0/1214780987 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff21c0678c0 0x7ff21c069d80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff22000a9a0 tx=0x7ff220008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:29.933 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:29.932+0000 7ff22cff9640 1 -- 172.21.15.112:0/1214780987 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff2301644e0 con 0x7ff2301520a0 2024-09-15T23:59:30.164 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:30.164+0000 7ff236952640 1 -- 172.21.15.112:0/1214780987 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration"]} v 0) -- 0x7ff23006f910 con 0x7ff2301520a0 2024-09-15T23:59:30.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:30.448+0000 7ff22cff9640 1 -- 172.21.15.112:0/1214780987 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_strays.TestStrays.test_hardlink_reintegration"]}]=0 v304) ==== 142+0+0 (secure 0 0 0) 0x7ff224015020 con 0x7ff2301520a0 2024-09-15T23:59:30.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:30.452+0000 7ff236952640 1 -- 172.21.15.112:0/1214780987 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff21c0678c0 msgr2=0x7ff21c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:30.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:30.452+0000 7ff236952640 1 --2- 172.21.15.112:0/1214780987 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff21c0678c0 0x7ff21c069d80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff22000a9a0 tx=0x7ff220008040 comp rx=0 tx=0).stop 2024-09-15T23:59:30.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:30.452+0000 7ff236952640 1 -- 172.21.15.112:0/1214780987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2301520a0 msgr2=0x7ff23015c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:30.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:30.452+0000 7ff236952640 1 --2- 172.21.15.112:0/1214780987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2301520a0 0x7ff23015c910 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7ff22400c580 tx=0x7ff22400ca40 comp rx=0 tx=0).stop 2024-09-15T23:59:30.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:30.452+0000 7ff236952640 1 -- 172.21.15.112:0/1214780987 shutdown_connections 2024-09-15T23:59:30.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:30.452+0000 7ff236952640 1 --2- 172.21.15.112:0/1214780987 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ff21c0678c0 0x7ff21c069d80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:30.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:30.452+0000 7ff236952640 1 --2- 172.21.15.112:0/1214780987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff23015f1d0 0x7ff230099540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:30.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:30.452+0000 7ff236952640 1 --2- 172.21.15.112:0/1214780987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2301520a0 0x7ff23015c910 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:30.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:30.452+0000 7ff236952640 1 --2- 172.21.15.112:0/1214780987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff23006fe50 0x7ff2300ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:30.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:30.452+0000 7ff236952640 1 -- 172.21.15.112:0/1214780987 >> 172.21.15.112:0/1214780987 conn(0x7ff2300b1f90 msgr2=0x7ff23015b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:30.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:30.452+0000 7ff236952640 1 -- 172.21.15.112:0/1214780987 shutdown_connections 2024-09-15T23:59:30.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:30.452+0000 7ff236952640 1 -- 172.21.15.112:0/1214780987 wait complete. 2024-09-15T23:59:30.474 INFO:tasks.cephfs_test_runner:That removal of primary dentry of hardlinked inode results ... ERROR 2024-09-15T23:59:30.475 INFO:tasks.cephfs_test_runner: 2024-09-15T23:59:30.475 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-15T23:59:30.475 INFO:tasks.cephfs_test_runner:ERROR: test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays) 2024-09-15T23:59:30.475 INFO:tasks.cephfs_test_runner:That removal of primary dentry of hardlinked inode results 2024-09-15T23:59:30.475 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-15T23:59:30.475 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-15T23:59:30.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_strays.py", line 398, in test_hardlink_reintegration 2024-09-15T23:59:30.475 INFO:tasks.cephfs_test_runner: pre_unlink_bt = self.fs.read_backtrace(ino) 2024-09-15T23:59:30.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-15T23:59:30.475 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-15T23:59:30.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-15T23:59:30.475 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-15T23:59:30.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-15T23:59:30.476 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-15T23:59:30.476 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-15T23:59:30.476 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-15T23:59:30.476 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-15T23:59:30.476 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-15T23:59:30.476 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-15T23:59:30.476 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-15T23:59:30.476 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-15T23:59:30.476 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-15T23:59:30.476 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi112 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-15T23:59:30.476 INFO:tasks.cephfs_test_runner: 2024-09-15T23:59:30.476 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-15T23:59:30.476 INFO:tasks.cephfs_test_runner:Ran 7 tests in 306.977s 2024-09-15T23:59:30.476 INFO:tasks.cephfs_test_runner: 2024-09-15T23:59:30.477 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-09-15T23:59:30.477 INFO:tasks.cephfs_test_runner: 2024-09-15T23:59:30.477 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-15T23:59:30.477 INFO:tasks.cephfs_test_runner:ERROR: test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays) 2024-09-15T23:59:30.477 INFO:tasks.cephfs_test_runner:That removal of primary dentry of hardlinked inode results 2024-09-15T23:59:30.477 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-15T23:59:30.477 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-15T23:59:30.477 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_strays.py", line 398, in test_hardlink_reintegration 2024-09-15T23:59:30.477 INFO:tasks.cephfs_test_runner: pre_unlink_bt = self.fs.read_backtrace(ino) 2024-09-15T23:59:30.477 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-15T23:59:30.477 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-15T23:59:30.477 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-15T23:59:30.477 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-15T23:59:30.477 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-15T23:59:30.478 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-15T23:59:30.478 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-15T23:59:30.478 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-15T23:59:30.478 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-15T23:59:30.478 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-15T23:59:30.478 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-15T23:59:30.478 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-15T23:59:30.478 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-15T23:59:30.478 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-15T23:59:30.478 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi112 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-15T23:59:30.478 INFO:tasks.cephfs_test_runner: 2024-09-15T23:59:30.479 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays) 2024-09-15T23:59:31.145 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=36ee89ad5cf04cb2b3459ad1528eb12d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays) 2024-09-15T23:59:31.147 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-15T23:59:31.155 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-15T23:59:31.247 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-15T23:59:31.248 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:59:31.248 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:59:31.262 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:59:31.262 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:59:31.262 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:59:31.307 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336412k,nr_inodes=4084103,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:59:31.308 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:59:31.308 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:59:31.314 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:59:31.314 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-15T23:59:31.315 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:59:31.363 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15764 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:59:31.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:31.363 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-15T23:59:31.369 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:59:31.370 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:59:31.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:31.370 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:59:31.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:31.425 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:59:31.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:31.484 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-15T23:59:31.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:31.641 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-09-15T23:59:31.648 INFO:teuthology.orchestra.run.smithi169.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T23:59:31.648 INFO:teuthology.orchestra.run.smithi169.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T23:59:31.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:31.649 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T23:59:31.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:31.704 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:59:31.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:59:31.762 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link delete ceph-brx 2024-09-15T23:59:31.924 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-15T23:59:31.936 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:59:31.936 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:59:32.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe38be640 1 Processor -- start 2024-09-15T23:59:32.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe38be640 1 -- start start 2024-09-15T23:59:32.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe38be640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7effdc073e60 0x7effdc06e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe38be640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7effdc06fef0 0x7effdc15b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe38be640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effdc15bda0 con 0x7effdc0b3d50 2024-09-15T23:59:32.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe38be640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7effdc06ee50 con 0x7effdc06fef0 2024-09-15T23:59:32.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe38be640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7effdc06f130 con 0x7effdc073e60 2024-09-15T23:59:32.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe165a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7effdc073e60 0x7effdc06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe165a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7effdc073e60 0x7effdc06e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.112:46114/0 (socket says 172.21.15.112:46114) 2024-09-15T23:59:32.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe165a640 1 -- 172.21.15.112:0/1082006267 learned_addr learned my addr 172.21.15.112:0/1082006267 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:32.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe0e59640 1 --2- 172.21.15.112:0/1082006267 >> v2:172.21.15.169:3300/0 conn(0x7effdc06fef0 0x7effdc15b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe165a640 1 -- 172.21.15.112:0/1082006267 >> v2:172.21.15.169:3300/0 conn(0x7effdc06fef0 msgr2=0x7effdc15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:32.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe165a640 1 --2- 172.21.15.112:0/1082006267 >> v2:172.21.15.169:3300/0 conn(0x7effdc06fef0 0x7effdc15b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe165a640 1 -- 172.21.15.112:0/1082006267 >> v1:172.21.15.169:6789/0 conn(0x7effdc0b3d50 legacy=0x7effdc0b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.074 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.072+0000 7effe165a640 1 -- 172.21.15.112:0/1082006267 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc06f410 con 0x7effdc073e60 2024-09-15T23:59:32.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.076+0000 7effe165a640 1 --2- 172.21.15.112:0/1082006267 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7effdc073e60 0x7effdc06e800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7effd8006fd0 tx=0x7effd801e960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1e42a9c0dc4d858 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:32.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.076+0000 7effd3fff640 1 -- 172.21.15.112:0/1082006267 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd80ad070 con 0x7effdc073e60 2024-09-15T23:59:32.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.076+0000 7effd3fff640 1 -- 172.21.15.112:0/1082006267 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd8004230 con 0x7effdc073e60 2024-09-15T23:59:32.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.076+0000 7effd3fff640 1 -- 172.21.15.112:0/1082006267 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd80a7640 con 0x7effdc073e60 2024-09-15T23:59:32.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.076+0000 7effe38be640 1 -- 172.21.15.112:0/1082006267 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7effdc073e60 msgr2=0x7effdc06e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.076+0000 7effe38be640 1 --2- 172.21.15.112:0/1082006267 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7effdc073e60 0x7effdc06e800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7effd8006fd0 tx=0x7effd801e960 comp rx=0 tx=0).stop 2024-09-15T23:59:32.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.076+0000 7effe38be640 1 -- 172.21.15.112:0/1082006267 shutdown_connections 2024-09-15T23:59:32.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.076+0000 7effe38be640 1 --2- 172.21.15.112:0/1082006267 >> v2:172.21.15.169:3300/0 conn(0x7effdc06fef0 0x7effdc15b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.076+0000 7effe38be640 1 --2- 172.21.15.112:0/1082006267 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7effdc073e60 0x7effdc06e800 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.076+0000 7effe38be640 1 -- 172.21.15.112:0/1082006267 >> 172.21.15.112:0/1082006267 conn(0x7effdc0b1f90 msgr2=0x7effdc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:32.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.076+0000 7effe38be640 1 -- 172.21.15.112:0/1082006267 shutdown_connections 2024-09-15T23:59:32.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.076+0000 7effe38be640 1 -- 172.21.15.112:0/1082006267 wait complete. 2024-09-15T23:59:32.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.076+0000 7effe38be640 1 Processor -- start 2024-09-15T23:59:32.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.076+0000 7effe38be640 1 -- start start 2024-09-15T23:59:32.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe38be640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7effdc06fef0 0x7effdc147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe38be640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7effdc073e60 0x7effdc099810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe38be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effdc0b3d50 0x7effdc15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe38be640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7effdc0729a0 con 0x7effdc0b3d50 2024-09-15T23:59:32.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe38be640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7effdc072820 con 0x7effdc06fef0 2024-09-15T23:59:32.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe38be640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7effdc072b20 con 0x7effdc073e60 2024-09-15T23:59:32.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe1e5b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effdc0b3d50 0x7effdc15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe1e5b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effdc0b3d50 0x7effdc15bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38390/0 (socket says 172.21.15.112:38390) 2024-09-15T23:59:32.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe1e5b640 1 -- 172.21.15.112:0/2734826094 learned_addr learned my addr 172.21.15.112:0/2734826094 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:32.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe165a640 1 --2- 172.21.15.112:0/2734826094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7effdc06fef0 0x7effdc147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe0e59640 1 --2- 172.21.15.112:0/2734826094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7effdc073e60 0x7effdc099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe1e5b640 1 -- 172.21.15.112:0/2734826094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7effdc073e60 msgr2=0x7effdc099810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe1e5b640 1 --2- 172.21.15.112:0/2734826094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7effdc073e60 0x7effdc099810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.081 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe1e5b640 1 -- 172.21.15.112:0/2734826094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7effdc06fef0 msgr2=0x7effdc147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe1e5b640 1 --2- 172.21.15.112:0/2734826094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7effdc06fef0 0x7effdc147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe1e5b640 1 -- 172.21.15.112:0/2734826094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc1433b0 con 0x7effdc0b3d50 2024-09-15T23:59:32.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe1e5b640 1 --2- 172.21.15.112:0/2734826094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effdc0b3d50 0x7effdc15bfb0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7effd400c7a0 tx=0x7effd400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:32.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effd1ffb640 1 -- 172.21.15.112:0/2734826094 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4003b80 con 0x7effdc0b3d50 2024-09-15T23:59:32.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effd1ffb640 1 -- 172.21.15.112:0/2734826094 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd4003d20 con 0x7effdc0b3d50 2024-09-15T23:59:32.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effd1ffb640 1 -- 172.21.15.112:0/2734826094 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd400aa90 con 0x7effdc0b3d50 2024-09-15T23:59:32.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe38be640 1 -- 172.21.15.112:0/2734826094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effdc146e80 con 0x7effdc0b3d50 2024-09-15T23:59:32.083 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe38be640 1 -- 172.21.15.112:0/2734826094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effdc147440 con 0x7effdc0b3d50 2024-09-15T23:59:32.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe38be640 1 -- 172.21.15.112:0/2734826094 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effdc15b860 con 0x7effdc0b3d50 2024-09-15T23:59:32.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effd1ffb640 1 -- 172.21.15.112:0/2734826094 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7effd400ac30 con 0x7effdc0b3d50 2024-09-15T23:59:32.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effd1ffb640 1 --2- 172.21.15.112:0/2734826094 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7effc00678c0 0x7effc0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effd1ffb640 1 -- 172.21.15.112:0/2734826094 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7effd40859b0 con 0x7effdc0b3d50 2024-09-15T23:59:32.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe165a640 1 --2- 172.21.15.112:0/2734826094 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7effc00678c0 0x7effc0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.080+0000 7effe165a640 1 --2- 172.21.15.112:0/2734826094 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7effc00678c0 0x7effc0069d80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7effd80b1000 tx=0x7effd80a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:32.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.084+0000 7effd1ffb640 1 -- 172.21.15.112:0/2734826094 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7effd40566f0 con 0x7effdc0b3d50 2024-09-15T23:59:32.243 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.244+0000 7effe38be640 1 -- 172.21.15.112:0/2734826094 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7effdc0723f0 con 0x7effc00678c0 2024-09-15T23:59:32.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.244+0000 7effd1ffb640 1 -- 172.21.15.112:0/2734826094 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13507 (secure 0 0 0) 0x7effdc0723f0 con 0x7effc00678c0 2024-09-15T23:59:32.245 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:32.245 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:59:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.248+0000 7effe38be640 1 -- 172.21.15.112:0/2734826094 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7effc00678c0 msgr2=0x7effc0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.248+0000 7effe38be640 1 --2- 172.21.15.112:0/2734826094 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7effc00678c0 0x7effc0069d80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7effd80b1000 tx=0x7effd80a9070 comp rx=0 tx=0).stop 2024-09-15T23:59:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.248+0000 7effe38be640 1 -- 172.21.15.112:0/2734826094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effdc0b3d50 msgr2=0x7effdc15bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.248+0000 7effe38be640 1 --2- 172.21.15.112:0/2734826094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effdc0b3d50 0x7effdc15bfb0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7effd400c7a0 tx=0x7effd400cc60 comp rx=0 tx=0).stop 2024-09-15T23:59:32.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.248+0000 7effe38be640 1 -- 172.21.15.112:0/2734826094 shutdown_connections 2024-09-15T23:59:32.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.248+0000 7effe38be640 1 --2- 172.21.15.112:0/2734826094 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7effc00678c0 0x7effc0069d80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.248+0000 7effe38be640 1 --2- 172.21.15.112:0/2734826094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effdc0b3d50 0x7effdc15bfb0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.248+0000 7effe38be640 1 --2- 172.21.15.112:0/2734826094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7effdc073e60 0x7effdc099810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.248+0000 7effe38be640 1 --2- 172.21.15.112:0/2734826094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7effdc06fef0 0x7effdc147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.248+0000 7effe38be640 1 -- 172.21.15.112:0/2734826094 >> 172.21.15.112:0/2734826094 conn(0x7effdc0b1f90 msgr2=0x7effdc15d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:32.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.248+0000 7effe38be640 1 -- 172.21.15.112:0/2734826094 shutdown_connections 2024-09-15T23:59:32.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.248+0000 7effe38be640 1 -- 172.21.15.112:0/2734826094 wait complete. 2024-09-15T23:59:32.264 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-15T23:59:31.336863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":349116,"kb_used_data":28888,"kb_used_omap":12,"kb_used_meta":320051,"kb_avail":754625604,"statfs":{"total":773094113280,"available":772736618496,"internally_reserved":0,"allocated":29581312,"data_stored":23340453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":327732784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8403327,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-76,"num_write_kb":-8227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002077"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":344,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-15T23:59:28.442824+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:59:28.442824+0000","last_peered":"2024-09-15T23:59:28.442824+0000","last_clean":"2024-09-15T23:59:28.442824+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:59:28.442824+0000","last_undegraded":"2024-09-15T23:59:28.442824+0000","last_fullsized":"2024-09-15T23:59:28.442824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509514,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45008,"kb_used_data":5500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326832,"statfs":{"total":96636764160,"available":96590675968,"internally_reserved":0,"allocated":5632000,"data_stored":4860488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509513,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45012,"kb_used_data":5504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326828,"statfs":{"total":96636764160,"available":96590671872,"internally_reserved":0,"allocated":5636096,"data_stored":4860510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509514,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45088,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326752,"statfs":{"total":96636764160,"available":96590594048,"internally_reserved":0,"allocated":1454080,"data_stored":672579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509514,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45024,"kb_used_data":5516,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326816,"statfs":{"total":96636764160,"available":96590659584,"internally_reserved":0,"allocated":5648384,"data_stored":4866883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509515,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40932,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330908,"statfs":{"total":96636764160,"available":96594849792,"internally_reserved":0,"allocated":1454080,"data_stored":672579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41508,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330332,"statfs":{"total":96636764160,"available":96594259968,"internally_reserved":0,"allocated":2048000,"data_stored":1262947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45024,"kb_used_data":5516,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326816,"statfs":{"total":96636764160,"available":96590659584,"internally_reserved":0,"allocated":5648384,"data_stored":4866883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41520,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330320,"statfs":{"total":96636764160,"available":96594247680,"internally_reserved":0,"allocated":2060288,"data_stored":1277584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:59:32.265 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:59:32.386 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefbb739640 1 Processor -- start 2024-09-15T23:59:32.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefbb739640 1 -- start start 2024-09-15T23:59:32.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefbb739640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fefb4153010 0x7fefb415d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefbb739640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fefb4072dd0 0x7fefb40731f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefbb739640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb41533f0 con 0x7fefb40b3280 2024-09-15T23:59:32.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefbb739640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fefb4073850 con 0x7fefb4072dd0 2024-09-15T23:59:32.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefbb739640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fefb4073b30 con 0x7fefb4153010 2024-09-15T23:59:32.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefb9cd6640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fefb40b3280 0x7fefb415fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51012/0 (socket says 172.21.15.112:51012) 2024-09-15T23:59:32.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefb9cd6640 1 -- 172.21.15.112:0/3772200840 learned_addr learned my addr 172.21.15.112:0/3772200840 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:32.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefb8cd4640 1 --2- 172.21.15.112:0/3772200840 >> v2:172.21.15.169:3300/0 conn(0x7fefb4072dd0 0x7fefb40731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefb94d5640 1 --2- 172.21.15.112:0/3772200840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fefb4153010 0x7fefb415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 -- 172.21.15.112:0/3772200840 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 264356037 0 0) 0x7fefac0014a0 con 0x7fefb40b3280 2024-09-15T23:59:32.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 -- 172.21.15.112:0/3772200840 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefa0003530 con 0x7fefb40b3280 2024-09-15T23:59:32.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 -- 172.21.15.112:0/3772200840 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 238840516 0 0) 0x7fefa0003530 con 0x7fefb40b3280 2024-09-15T23:59:32.390 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 -- 172.21.15.112:0/3772200840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fefb4153010 msgr2=0x7fefb415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:32.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 --2- 172.21.15.112:0/3772200840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fefb4153010 0x7fefb415d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 -- 172.21.15.112:0/3772200840 >> v2:172.21.15.169:3300/0 conn(0x7fefb4072dd0 msgr2=0x7fefb40731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:32.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 --2- 172.21.15.112:0/3772200840 >> v2:172.21.15.169:3300/0 conn(0x7fefb4072dd0 0x7fefb40731f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 -- 172.21.15.112:0/3772200840 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb415c890 con 0x7fefb40b3280 2024-09-15T23:59:32.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 -- 172.21.15.112:0/3772200840 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fefac001bd0 con 0x7fefb40b3280 2024-09-15T23:59:32.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 -- 172.21.15.112:0/3772200840 >> v1:172.21.15.112:6789/0 conn(0x7fefb40b3280 legacy=0x7fefb415fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 --2- 172.21.15.112:0/3772200840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fefb4153010 0x7fefa00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 --2- 172.21.15.112:0/3772200840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa0003f40 0x7fefa0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.391 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 --2- 172.21.15.112:0/3772200840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefa0004d50 0x7fefa00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 -- 172.21.15.112:0/3772200840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fefb4073850 con 0x7fefa0003f40 2024-09-15T23:59:32.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 -- 172.21.15.112:0/3772200840 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fefb4073b30 con 0x7fefa0004d50 2024-09-15T23:59:32.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefabfff640 1 -- 172.21.15.112:0/3772200840 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fefa000b9d0 con 0x7fefb4153010 2024-09-15T23:59:32.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefb8cd4640 1 --2- 172.21.15.112:0/3772200840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa0003f40 0x7fefa0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefb94d5640 1 --2- 172.21.15.112:0/3772200840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fefb4153010 0x7fefa00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefb9cd6640 1 --2- 172.21.15.112:0/3772200840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefa0004d50 0x7fefa00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefb8cd4640 1 -- 172.21.15.112:0/3772200840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fefb4153010 msgr2=0x7fefa00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:32.392 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefb8cd4640 1 --2- 172.21.15.112:0/3772200840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fefb4153010 0x7fefa00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefb8cd4640 1 -- 172.21.15.112:0/3772200840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefa0004d50 msgr2=0x7fefa00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:32.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefb8cd4640 1 --2- 172.21.15.112:0/3772200840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefa0004d50 0x7fefa00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.388+0000 7fefb8cd4640 1 -- 172.21.15.112:0/3772200840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa0003530 con 0x7fefa0003f40 2024-09-15T23:59:32.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefb8cd4640 1 --2- 172.21.15.112:0/3772200840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa0003f40 0x7fefa0004810 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009ae0 tx=0x7fefa401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57704b813d1a7839 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:32.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefabfff640 1 -- 172.21.15.112:0/3772200840 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa40b2070 con 0x7fefa0003f40 2024-09-15T23:59:32.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefabfff640 1 -- 172.21.15.112:0/3772200840 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa40a56a0 con 0x7fefa0003f40 2024-09-15T23:59:32.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefabfff640 1 -- 172.21.15.112:0/3772200840 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa40096b0 con 0x7fefa0003f40 2024-09-15T23:59:32.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefbb739640 1 -- 172.21.15.112:0/3772200840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa0003f40 msgr2=0x7fefa0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefbb739640 1 --2- 172.21.15.112:0/3772200840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefa0003f40 0x7fefa0004810 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009ae0 tx=0x7fefa401ca50 comp rx=0 tx=0).stop 2024-09-15T23:59:32.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefb9cd6640 1 -- 172.21.15.112:0/3772200840 reap_dead start 2024-09-15T23:59:32.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefbb739640 1 -- 172.21.15.112:0/3772200840 shutdown_connections 2024-09-15T23:59:32.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefbb739640 1 -- 172.21.15.112:0/3772200840 >> 172.21.15.112:0/3772200840 conn(0x7fefb40b6870 msgr2=0x7fefb40b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:32.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefbb739640 1 -- 172.21.15.112:0/3772200840 shutdown_connections 2024-09-15T23:59:32.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefbb739640 1 -- 172.21.15.112:0/3772200840 wait complete. 2024-09-15T23:59:32.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefbb739640 1 Processor -- start 2024-09-15T23:59:32.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefbb739640 1 -- start start 2024-09-15T23:59:32.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefbb739640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefa0003f40 0x7fefb4145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefbb739640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fefb414ac20 0x7fefb414b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefbb739640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb4147970 0x7fefb4147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefbb739640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fefb406fe00 con 0x7fefb4147970 2024-09-15T23:59:32.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefbb739640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fefb415c540 con 0x7fefa0003f40 2024-09-15T23:59:32.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefbb739640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fefb415d090 con 0x7fefb414ac20 2024-09-15T23:59:32.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefb9cd6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb4147970 0x7fefb4147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefb9cd6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb4147970 0x7fefb4147df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38402/0 (socket says 172.21.15.112:38402) 2024-09-15T23:59:32.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefb9cd6640 1 -- 172.21.15.112:0/3824488941 learned_addr learned my addr 172.21.15.112:0/3824488941 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:32.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefb94d5640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefa0003f40 0x7fefb4145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.392+0000 7fefb8cd4640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fefb414ac20 0x7fefb414b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefb9cd6640 1 -- 172.21.15.112:0/3824488941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fefb414ac20 msgr2=0x7fefb414b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefb9cd6640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fefb414ac20 0x7fefb414b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefb9cd6640 1 -- 172.21.15.112:0/3824488941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefa0003f40 msgr2=0x7fefb4145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefb9cd6640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefa0003f40 0x7fefb4145c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefb9cd6640 1 -- 172.21.15.112:0/3824488941 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb414f530 con 0x7fefb4147970 2024-09-15T23:59:32.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefb94d5640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefa0003f40 0x7fefb4145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:32.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefb9cd6640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb4147970 0x7fefb4147df0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fefac0013e0 tx=0x7fefac0108a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:32.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefa9ffb640 1 -- 172.21.15.112:0/3824488941 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac018020 con 0x7fefb4147970 2024-09-15T23:59:32.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefa9ffb640 1 -- 172.21.15.112:0/3824488941 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefac0148d0 con 0x7fefb4147970 2024-09-15T23:59:32.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefbb739640 1 -- 172.21.15.112:0/3824488941 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb414f7f0 con 0x7fefb4147970 2024-09-15T23:59:32.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefa9ffb640 1 -- 172.21.15.112:0/3824488941 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac014cc0 con 0x7fefb4147970 2024-09-15T23:59:32.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefbb739640 1 -- 172.21.15.112:0/3824488941 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb414fdb0 con 0x7fefb4147970 2024-09-15T23:59:32.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefbb739640 1 -- 172.21.15.112:0/3824488941 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb40731f0 con 0x7fefb4147970 2024-09-15T23:59:32.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefa9ffb640 1 -- 172.21.15.112:0/3824488941 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fefac01b020 con 0x7fefb4147970 2024-09-15T23:59:32.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefa9ffb640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fef980678f0 0x7fef98069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefa9ffb640 1 -- 172.21.15.112:0/3824488941 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7fefac088950 con 0x7fefb4147970 2024-09-15T23:59:32.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefb94d5640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fef980678f0 0x7fef98069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.396+0000 7fefb94d5640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fef980678f0 0x7fef98069db0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fefb0006d50 tx=0x7fefb0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:32.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.400+0000 7fefa9ffb640 1 -- 172.21.15.112:0/3824488941 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fefac022020 con 0x7fefb4147970 2024-09-15T23:59:32.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.560+0000 7fefbb739640 1 -- 172.21.15.112:0/3824488941 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fefb40cd720 con 0x7fef980678f0 2024-09-15T23:59:32.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.560+0000 7fefa9ffb640 1 -- 172.21.15.112:0/3824488941 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13507 (secure 0 0 0) 0x7fefb40cd720 con 0x7fef980678f0 2024-09-15T23:59:32.560 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:32.561 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:59:32.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.560+0000 7fefbb739640 1 -- 172.21.15.112:0/3824488941 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fef980678f0 msgr2=0x7fef98069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.562 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.560+0000 7fefbb739640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fef980678f0 0x7fef98069db0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fefb0006d50 tx=0x7fefb0008040 comp rx=0 tx=0).stop 2024-09-15T23:59:32.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.560+0000 7fefbb739640 1 -- 172.21.15.112:0/3824488941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb4147970 msgr2=0x7fefb4147df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.560+0000 7fefbb739640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb4147970 0x7fefb4147df0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fefac0013e0 tx=0x7fefac0108a0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.560+0000 7fefbb739640 1 -- 172.21.15.112:0/3824488941 shutdown_connections 2024-09-15T23:59:32.563 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.560+0000 7fefbb739640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fef980678f0 0x7fef98069db0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.560+0000 7fefbb739640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb4147970 0x7fefb4147df0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.560+0000 7fefbb739640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fefb414ac20 0x7fefb414b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.560+0000 7fefbb739640 1 --2- 172.21.15.112:0/3824488941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fefa0003f40 0x7fefb4145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.560+0000 7fefbb739640 1 -- 172.21.15.112:0/3824488941 >> 172.21.15.112:0/3824488941 conn(0x7fefb40b6870 msgr2=0x7fefb41601c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:32.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.560+0000 7fefbb739640 1 -- 172.21.15.112:0/3824488941 shutdown_connections 2024-09-15T23:59:32.564 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.560+0000 7fefbb739640 1 -- 172.21.15.112:0/3824488941 wait complete. 2024-09-15T23:59:32.578 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-15T23:59:31.336863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":349116,"kb_used_data":28888,"kb_used_omap":12,"kb_used_meta":320051,"kb_avail":754625604,"statfs":{"total":773094113280,"available":772736618496,"internally_reserved":0,"allocated":29581312,"data_stored":23340453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":327732784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8403327,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-76,"num_write_kb":-8227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002077"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":344,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-15T23:59:28.442824+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:59:28.442824+0000","last_peered":"2024-09-15T23:59:28.442824+0000","last_clean":"2024-09-15T23:59:28.442824+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:59:28.442824+0000","last_undegraded":"2024-09-15T23:59:28.442824+0000","last_fullsized":"2024-09-15T23:59:28.442824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509514,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45008,"kb_used_data":5500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326832,"statfs":{"total":96636764160,"available":96590675968,"internally_reserved":0,"allocated":5632000,"data_stored":4860488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509513,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45012,"kb_used_data":5504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326828,"statfs":{"total":96636764160,"available":96590671872,"internally_reserved":0,"allocated":5636096,"data_stored":4860510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509514,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45088,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326752,"statfs":{"total":96636764160,"available":96590594048,"internally_reserved":0,"allocated":1454080,"data_stored":672579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509514,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45024,"kb_used_data":5516,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326816,"statfs":{"total":96636764160,"available":96590659584,"internally_reserved":0,"allocated":5648384,"data_stored":4866883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509515,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40932,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330908,"statfs":{"total":96636764160,"available":96594849792,"internally_reserved":0,"allocated":1454080,"data_stored":672579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41508,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330332,"statfs":{"total":96636764160,"available":96594259968,"internally_reserved":0,"allocated":2048000,"data_stored":1262947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45024,"kb_used_data":5516,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326816,"statfs":{"total":96636764160,"available":96590659584,"internally_reserved":0,"allocated":5648384,"data_stored":4866883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41520,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330320,"statfs":{"total":96636764160,"available":96594247680,"internally_reserved":0,"allocated":2060288,"data_stored":1277584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:59:32.578 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:59:32.579 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:59:32.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf25748640 1 Processor -- start 2024-09-15T23:59:32.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf25748640 1 -- start start 2024-09-15T23:59:32.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf25748640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faf20161a60 0x7faf200d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf25748640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf200d2e90 0x7faf200cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf25748640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf200d32b0 con 0x7faf200cf450 2024-09-15T23:59:32.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf25748640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7faf200d0300 con 0x7faf20161a60 2024-09-15T23:59:32.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf25748640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faf2006e6c0 con 0x7faf200d2e90 2024-09-15T23:59:32.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf1effd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faf20161a60 0x7faf200d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf1effd640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7faf20161a60 0x7faf200d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38416/0 (socket says 172.21.15.112:38416) 2024-09-15T23:59:32.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf1effd640 1 -- 172.21.15.112:0/1337467095 learned_addr learned my addr 172.21.15.112:0/1337467095 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:32.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf1f7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7faf200cf450 0x7faf200d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51020/0 (socket says 172.21.15.112:51020) 2024-09-15T23:59:32.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf1e7fc640 1 --2- 172.21.15.112:0/1337467095 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf200d2e90 0x7faf200cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf1effd640 1 -- 172.21.15.112:0/1337467095 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf200d2e90 msgr2=0x7faf200cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:32.702 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf1effd640 1 --2- 172.21.15.112:0/1337467095 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf200d2e90 0x7faf200cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf1effd640 1 -- 172.21.15.112:0/1337467095 >> v1:172.21.15.112:6789/0 conn(0x7faf200cf450 legacy=0x7faf200d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf1effd640 1 -- 172.21.15.112:0/1337467095 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf200b0f60 con 0x7faf20161a60 2024-09-15T23:59:32.703 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.700+0000 7faf1dffb640 1 -- 172.21.15.112:0/1337467095 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525567366 0 0) 0x7faf200d32b0 con 0x7faf200cf450 2024-09-15T23:59:32.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf1effd640 1 --2- 172.21.15.112:0/1337467095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf20161a60 0x7faf200d2950 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7faf14009870 tx=0x7faf1401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216d5ad99f1a34f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:32.704 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf1dffb640 1 -- 172.21.15.112:0/1337467095 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf200d1930 con 0x7faf20161a60 2024-09-15T23:59:32.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf1dffb640 1 -- 172.21.15.112:0/1337467095 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf140af070 con 0x7faf20161a60 2024-09-15T23:59:32.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf1dffb640 1 -- 172.21.15.112:0/1337467095 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf140aa820 con 0x7faf20161a60 2024-09-15T23:59:32.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 -- 172.21.15.112:0/1337467095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf20161a60 msgr2=0x7faf200d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 --2- 172.21.15.112:0/1337467095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf20161a60 0x7faf200d2950 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7faf14009870 tx=0x7faf1401c4a0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 -- 172.21.15.112:0/1337467095 shutdown_connections 2024-09-15T23:59:32.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 --2- 172.21.15.112:0/1337467095 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf200d2e90 0x7faf200cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 --2- 172.21.15.112:0/1337467095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf20161a60 0x7faf200d2950 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.705 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 -- 172.21.15.112:0/1337467095 >> 172.21.15.112:0/1337467095 conn(0x7faf2008bf90 msgr2=0x7faf2009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:32.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 -- 172.21.15.112:0/1337467095 shutdown_connections 2024-09-15T23:59:32.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 -- 172.21.15.112:0/1337467095 wait complete. 2024-09-15T23:59:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 Processor -- start 2024-09-15T23:59:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 -- start start 2024-09-15T23:59:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf200cf450 0x7faf200b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf200d2e90 0x7faf20155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf20161a60 0x7faf20151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faf200cf8a0 con 0x7faf200cf450 2024-09-15T23:59:32.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf2006d190 con 0x7faf200d2e90 2024-09-15T23:59:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.704+0000 7faf25748640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faf200cfa20 con 0x7faf20161a60 2024-09-15T23:59:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf1effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf200cf450 0x7faf200b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf1effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf200cf450 0x7faf200b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38420/0 (socket says 172.21.15.112:38420) 2024-09-15T23:59:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf1effd640 1 -- 172.21.15.112:0/292542813 learned_addr learned my addr 172.21.15.112:0/292542813 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf1effd640 1 -- 172.21.15.112:0/292542813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf20161a60 msgr2=0x7faf20151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf1e7fc640 1 --2- 172.21.15.112:0/292542813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf200d2e90 0x7faf20155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf1effd640 1 --2- 172.21.15.112:0/292542813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf20161a60 0x7faf20151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf1effd640 1 -- 172.21.15.112:0/292542813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf200d2e90 msgr2=0x7faf20155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf1effd640 1 --2- 172.21.15.112:0/292542813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf200d2e90 0x7faf20155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf1effd640 1 -- 172.21.15.112:0/292542813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf20154df0 con 0x7faf200cf450 2024-09-15T23:59:32.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf1effd640 1 --2- 172.21.15.112:0/292542813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf200cf450 0x7faf200b2580 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7faf140ac040 tx=0x7faf1401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:32.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf077fe640 1 -- 172.21.15.112:0/292542813 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf140b9070 con 0x7faf200cf450 2024-09-15T23:59:32.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf077fe640 1 -- 172.21.15.112:0/292542813 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf14004220 con 0x7faf200cf450 2024-09-15T23:59:32.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf077fe640 1 -- 172.21.15.112:0/292542813 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf140aa970 con 0x7faf200cf450 2024-09-15T23:59:32.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf25748640 1 -- 172.21.15.112:0/292542813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf201550d0 con 0x7faf200cf450 2024-09-15T23:59:32.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf25748640 1 -- 172.21.15.112:0/292542813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf20155690 con 0x7faf200cf450 2024-09-15T23:59:32.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf25748640 1 -- 172.21.15.112:0/292542813 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf200cef10 con 0x7faf200cf450 2024-09-15T23:59:32.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf077fe640 1 -- 172.21.15.112:0/292542813 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf140a9070 con 0x7faf200cf450 2024-09-15T23:59:32.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf077fe640 1 --2- 172.21.15.112:0/292542813 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf0c0678c0 0x7faf0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:32.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf077fe640 1 -- 172.21.15.112:0/292542813 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7faf1411f880 con 0x7faf200cf450 2024-09-15T23:59:32.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf1e7fc640 1 --2- 172.21.15.112:0/292542813 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf0c0678c0 0x7faf0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:32.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.708+0000 7faf1e7fc640 1 --2- 172.21.15.112:0/292542813 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf0c0678c0 0x7faf0c069d80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7faf201541a0 tx=0x7faf10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:32.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.712+0000 7faf077fe640 1 -- 172.21.15.112:0/292542813 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faf14016150 con 0x7faf200cf450 2024-09-15T23:59:32.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.872+0000 7faf25748640 1 -- 172.21.15.112:0/292542813 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf201563d0 con 0x7faf0c0678c0 2024-09-15T23:59:32.873 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.872+0000 7faf077fe640 1 -- 172.21.15.112:0/292542813 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13507 (secure 0 0 0) 0x7faf201563d0 con 0x7faf0c0678c0 2024-09-15T23:59:32.874 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:32.874 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:59:32.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.876+0000 7faf25748640 1 -- 172.21.15.112:0/292542813 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf0c0678c0 msgr2=0x7faf0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.876+0000 7faf25748640 1 --2- 172.21.15.112:0/292542813 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf0c0678c0 0x7faf0c069d80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7faf201541a0 tx=0x7faf10008040 comp rx=0 tx=0).stop 2024-09-15T23:59:32.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.876+0000 7faf25748640 1 -- 172.21.15.112:0/292542813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf200cf450 msgr2=0x7faf200b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:32.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.876+0000 7faf25748640 1 --2- 172.21.15.112:0/292542813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf200cf450 0x7faf200b2580 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7faf140ac040 tx=0x7faf1401ace0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.876+0000 7faf25748640 1 -- 172.21.15.112:0/292542813 shutdown_connections 2024-09-15T23:59:32.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.876+0000 7faf25748640 1 --2- 172.21.15.112:0/292542813 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7faf0c0678c0 0x7faf0c069d80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.876 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.876+0000 7faf25748640 1 --2- 172.21.15.112:0/292542813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faf20161a60 0x7faf20151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.876+0000 7faf25748640 1 --2- 172.21.15.112:0/292542813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf200d2e90 0x7faf20155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.876+0000 7faf25748640 1 --2- 172.21.15.112:0/292542813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf200cf450 0x7faf200b2580 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:32.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.876+0000 7faf25748640 1 -- 172.21.15.112:0/292542813 >> 172.21.15.112:0/292542813 conn(0x7faf2008bf90 msgr2=0x7faf200ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:32.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.876+0000 7faf25748640 1 -- 172.21.15.112:0/292542813 shutdown_connections 2024-09-15T23:59:32.877 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:32.876+0000 7faf25748640 1 -- 172.21.15.112:0/292542813 wait complete. 2024-09-15T23:59:32.892 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-15T23:59:31.336863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":349116,"kb_used_data":28888,"kb_used_omap":12,"kb_used_meta":320051,"kb_avail":754625604,"statfs":{"total":773094113280,"available":772736618496,"internally_reserved":0,"allocated":29581312,"data_stored":23340453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":327732784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8403327,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-76,"num_write_kb":-8227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002077"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":344,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-15T23:59:28.442824+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:59:28.442824+0000","last_peered":"2024-09-15T23:59:28.442824+0000","last_clean":"2024-09-15T23:59:28.442824+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:59:28.442824+0000","last_undegraded":"2024-09-15T23:59:28.442824+0000","last_fullsized":"2024-09-15T23:59:28.442824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509514,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45008,"kb_used_data":5500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326832,"statfs":{"total":96636764160,"available":96590675968,"internally_reserved":0,"allocated":5632000,"data_stored":4860488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509513,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45012,"kb_used_data":5504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326828,"statfs":{"total":96636764160,"available":96590671872,"internally_reserved":0,"allocated":5636096,"data_stored":4860510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509514,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45088,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326752,"statfs":{"total":96636764160,"available":96590594048,"internally_reserved":0,"allocated":1454080,"data_stored":672579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509514,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45024,"kb_used_data":5516,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326816,"statfs":{"total":96636764160,"available":96590659584,"internally_reserved":0,"allocated":5648384,"data_stored":4866883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509515,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40932,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330908,"statfs":{"total":96636764160,"available":96594849792,"internally_reserved":0,"allocated":1454080,"data_stored":672579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41508,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330332,"statfs":{"total":96636764160,"available":96594259968,"internally_reserved":0,"allocated":2048000,"data_stored":1262947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45024,"kb_used_data":5516,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326816,"statfs":{"total":96636764160,"available":96590659584,"internally_reserved":0,"allocated":5648384,"data_stored":4866883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41520,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330320,"statfs":{"total":96636764160,"available":96594247680,"internally_reserved":0,"allocated":2060288,"data_stored":1277584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:59:32.893 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:59:33.014 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.012+0000 7f1e8c391640 1 Processor -- start 2024-09-15T23:59:33.015 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8c391640 1 -- start start 2024-09-15T23:59:33.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8c391640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e84161a60 0x7f1e840d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:33.016 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8c391640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1e840d2e90 0x7f1e840cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:33.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8c391640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e840d32b0 con 0x7f1e840cf450 2024-09-15T23:59:33.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8c391640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1e840d0300 con 0x7f1e840d2e90 2024-09-15T23:59:33.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8c391640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1e8406e6c0 con 0x7f1e84161a60 2024-09-15T23:59:33.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8992c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1e840d2e90 0x7f1e840cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:33.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8a92e640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1e840cf450 0x7f1e840d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51036/0 (socket says 172.21.15.112:51036) 2024-09-15T23:59:33.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8a92e640 1 -- 172.21.15.112:0/1012673326 learned_addr learned my addr 172.21.15.112:0/1012673326 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:33.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8a12d640 1 --2- 172.21.15.112:0/1012673326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e84161a60 0x7f1e840d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:33.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8992c640 1 -- 172.21.15.112:0/1012673326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e84161a60 msgr2=0x7f1e840d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:33.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8992c640 1 --2- 172.21.15.112:0/1012673326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e84161a60 0x7f1e840d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:33.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8992c640 1 -- 172.21.15.112:0/1012673326 >> v1:172.21.15.112:6789/0 conn(0x7f1e840cf450 legacy=0x7f1e840d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:33.018 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8992c640 1 -- 172.21.15.112:0/1012673326 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e840b0f60 con 0x7f1e840d2e90 2024-09-15T23:59:33.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8992c640 1 --2- 172.21.15.112:0/1012673326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e840d2e90 0x7f1e840cef10 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009d90 tx=0x7f1e8001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be15c2cd14fc4813 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:33.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8912b640 1 -- 172.21.15.112:0/1012673326 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e800b2070 con 0x7f1e840d2e90 2024-09-15T23:59:33.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8912b640 1 -- 172.21.15.112:0/1012673326 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e800a58f0 con 0x7f1e840d2e90 2024-09-15T23:59:33.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.016+0000 7f1e8912b640 1 -- 172.21.15.112:0/1012673326 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e840d1930 con 0x7f1e840d2e90 2024-09-15T23:59:33.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 -- 172.21.15.112:0/1012673326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e840d2e90 msgr2=0x7f1e840cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:33.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 --2- 172.21.15.112:0/1012673326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e840d2e90 0x7f1e840cef10 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009d90 tx=0x7f1e8001c870 comp rx=0 tx=0).stop 2024-09-15T23:59:33.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 -- 172.21.15.112:0/1012673326 shutdown_connections 2024-09-15T23:59:33.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 --2- 172.21.15.112:0/1012673326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e840d2e90 0x7f1e840cef10 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:33.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 --2- 172.21.15.112:0/1012673326 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e84161a60 0x7f1e840d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:33.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 -- 172.21.15.112:0/1012673326 >> 172.21.15.112:0/1012673326 conn(0x7f1e8408bf90 msgr2=0x7f1e8409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:33.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 -- 172.21.15.112:0/1012673326 shutdown_connections 2024-09-15T23:59:33.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 -- 172.21.15.112:0/1012673326 wait complete. 2024-09-15T23:59:33.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 Processor -- start 2024-09-15T23:59:33.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 -- start start 2024-09-15T23:59:33.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e840cf450 0x7f1e8414f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:33.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e840d2e90 0x7f1e840b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:33.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e84161a60 0x7f1e840b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:33.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1e840cf900 con 0x7f1e840d2e90 2024-09-15T23:59:33.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1e8406d190 con 0x7f1e84161a60 2024-09-15T23:59:33.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1e840cfa80 con 0x7f1e840cf450 2024-09-15T23:59:33.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8992c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e840d2e90 0x7f1e840b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:33.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8992c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e840d2e90 0x7f1e840b9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38446/0 (socket says 172.21.15.112:38446) 2024-09-15T23:59:33.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8992c640 1 -- 172.21.15.112:0/4182603932 learned_addr learned my addr 172.21.15.112:0/4182603932 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:33.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8a12d640 1 --2- 172.21.15.112:0/4182603932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e840cf450 0x7f1e8414f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:33.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8a92e640 1 --2- 172.21.15.112:0/4182603932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e84161a60 0x7f1e840b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:33.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8992c640 1 -- 172.21.15.112:0/4182603932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e840cf450 msgr2=0x7f1e8414f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:33.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8992c640 1 --2- 172.21.15.112:0/4182603932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e840cf450 0x7f1e8414f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:33.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8992c640 1 -- 172.21.15.112:0/4182603932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e84161a60 msgr2=0x7f1e840b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:33.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8992c640 1 --2- 172.21.15.112:0/4182603932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e84161a60 0x7f1e840b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:33.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8992c640 1 -- 172.21.15.112:0/4182603932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e840ba270 con 0x7f1e840d2e90 2024-09-15T23:59:33.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8992c640 1 --2- 172.21.15.112:0/4182603932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e840d2e90 0x7f1e840b9d30 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f1e8001af20 tx=0x7f1e80019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:33.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e7affd640 1 -- 172.21.15.112:0/4182603932 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e800b2050 con 0x7f1e840d2e90 2024-09-15T23:59:33.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e7affd640 1 -- 172.21.15.112:0/4182603932 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e800be070 con 0x7f1e840d2e90 2024-09-15T23:59:33.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 -- 172.21.15.112:0/4182603932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e84151db0 con 0x7f1e840d2e90 2024-09-15T23:59:33.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e7affd640 1 -- 172.21.15.112:0/4182603932 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e800ada50 con 0x7f1e840d2e90 2024-09-15T23:59:33.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.020+0000 7f1e8c391640 1 -- 172.21.15.112:0/4182603932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e840b84d0 con 0x7f1e840d2e90 2024-09-15T23:59:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.024+0000 7f1e8c391640 1 -- 172.21.15.112:0/4182603932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e840cef10 con 0x7f1e840d2e90 2024-09-15T23:59:33.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.024+0000 7f1e7affd640 1 -- 172.21.15.112:0/4182603932 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1e800adbf0 con 0x7f1e840d2e90 2024-09-15T23:59:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.024+0000 7f1e7affd640 1 --2- 172.21.15.112:0/4182603932 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1e680678c0 0x7f1e68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.024+0000 7f1e7affd640 1 -- 172.21.15.112:0/4182603932 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f1e80120f70 con 0x7f1e840d2e90 2024-09-15T23:59:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.024+0000 7f1e8a12d640 1 --2- 172.21.15.112:0/4182603932 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1e680678c0 0x7f1e68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:33.028 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.024+0000 7f1e8a12d640 1 --2- 172.21.15.112:0/4182603932 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1e680678c0 0x7f1e68069d80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1e840cb320 tx=0x7f1e74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:33.029 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.028+0000 7f1e7affd640 1 -- 172.21.15.112:0/4182603932 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1e840ba270 con 0x7f1e840d2e90 2024-09-15T23:59:33.191 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.192+0000 7f1e8c391640 1 -- 172.21.15.112:0/4182603932 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e8415a6c0 con 0x7f1e840d2e90 2024-09-15T23:59:33.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.192+0000 7f1e7affd640 1 -- 172.21.15.112:0/4182603932 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+13329 (secure 0 0 0) 0x7f1e80016520 con 0x7f1e840d2e90 2024-09-15T23:59:33.193 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:33.193 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":118,"fsid":"1af6b673-4d40-4109-af4e-78662faa7df8","created":"2024-09-15T23:53:26.610227+0000","modified":"2024-09-15T23:59:29.440211+0000","last_up_change":"2024-09-15T23:53:39.018885+0000","last_in_change":"2024-09-15T23:53:28.983018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:53:39.301069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5a8203b-84d3-480c-8ba8-57f2d5da689f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6809","nonce":537028791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6811","nonce":537028791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6815","nonce":537028791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":537028791},{"type":"v1","addr":"172.21.15.112:6813","nonce":537028791}]},"public_addr":"172.21.15.112:6809/537028791","cluster_addr":"172.21.15.112:6811/537028791","heartbeat_back_addr":"172.21.15.112:6815/537028791","heartbeat_front_addr":"172.21.15.112:6813/537028791","state":["exists","up"]},{"osd":1,"uuid":"af18f4ae-8712-4c44-803f-fcf9944ea2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6801","nonce":686325648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6803","nonce":686325648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6807","nonce":686325648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":686325648},{"type":"v1","addr":"172.21.15.112:6805","nonce":686325648}]},"public_addr":"172.21.15.112:6801/686325648","cluster_addr":"172.21.15.112:6803/686325648","heartbeat_back_addr":"172.21.15.112:6807/686325648","heartbeat_front_addr":"172.21.15.112:6805/686325648","state":["exists","up"]},{"osd":2,"uuid":"5b9bf4e7-3349-4a8d-a55e-7757568d13f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6817","nonce":4134332386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6819","nonce":4134332386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6823","nonce":4134332386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4134332386},{"type":"v1","addr":"172.21.15.112:6821","nonce":4134332386}]},"public_addr":"172.21.15.112:6817/4134332386","cluster_addr":"172.21.15.112:6819/4134332386","heartbeat_back_addr":"172.21.15.112:6823/4134332386","heartbeat_front_addr":"172.21.15.112:6821/4134332386","state":["exists","up"]},{"osd":3,"uuid":"f7bf128d-bf69-4f14-b258-4d9dc096e891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6825","nonce":79312720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6827","nonce":79312720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6831","nonce":79312720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":79312720},{"type":"v1","addr":"172.21.15.112:6829","nonce":79312720}]},"public_addr":"172.21.15.112:6825/79312720","cluster_addr":"172.21.15.112:6827/79312720","heartbeat_back_addr":"172.21.15.112:6831/79312720","heartbeat_front_addr":"172.21.15.112:6829/79312720","state":["exists","up"]},{"osd":4,"uuid":"265a62a2-174d-4639-a9a2-2da03049b6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6817","nonce":2075680198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6819","nonce":2075680198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6823","nonce":2075680198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2075680198},{"type":"v1","addr":"172.21.15.169:6821","nonce":2075680198}]},"public_addr":"172.21.15.169:6817/2075680198","cluster_addr":"172.21.15.169:6819/2075680198","heartbeat_back_addr":"172.21.15.169:6823/2075680198","heartbeat_front_addr":"172.21.15.169:6821/2075680198","state":["exists","up"]},{"osd":5,"uuid":"4d78bc68-38ca-4fd9-9e3f-c50c614a85c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6801","nonce":2810276484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6803","nonce":2810276484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6807","nonce":2810276484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2810276484},{"type":"v1","addr":"172.21.15.169:6805","nonce":2810276484}]},"public_addr":"172.21.15.169:6801/2810276484","cluster_addr":"172.21.15.169:6803/2810276484","heartbeat_back_addr":"172.21.15.169:6807/2810276484","heartbeat_front_addr":"172.21.15.169:6805/2810276484","state":["exists","up"]},{"osd":6,"uuid":"aab1f298-7384-4353-b144-2c8cf255f9d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6825","nonce":1324680124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6827","nonce":1324680124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6831","nonce":1324680124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1324680124},{"type":"v1","addr":"172.21.15.169:6829","nonce":1324680124}]},"public_addr":"172.21.15.169:6825/1324680124","cluster_addr":"172.21.15.169:6827/1324680124","heartbeat_back_addr":"172.21.15.169:6831/1324680124","heartbeat_front_addr":"172.21.15.169:6829/1324680124","state":["exists","up"]},{"osd":7,"uuid":"08c893d2-250a-4ee6-89df-5b02cfb0dcce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6809","nonce":189050588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6811","nonce":189050588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6815","nonce":189050588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":189050588},{"type":"v1","addr":"172.21.15.169:6813","nonce":189050588}]},"public_addr":"172.21.15.169:6809/189050588","cluster_addr":"172.21.15.169:6811/189050588","heartbeat_back_addr":"172.21.15.169:6815/189050588","heartbeat_front_addr":"172.21.15.169:6813/189050588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.515730+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.325232+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.856789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:36.281685+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.411985+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.081819+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.619543+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:53:35.258857+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6837/2554639091":"2024-09-16T23:59:26.231970+0000","172.21.15.112:6836/2554639091":"2024-09-16T23:59:26.231970+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:59:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.196+0000 7f1e8c391640 1 -- 172.21.15.112:0/4182603932 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1e680678c0 msgr2=0x7f1e68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:33.195 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.196+0000 7f1e8c391640 1 --2- 172.21.15.112:0/4182603932 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1e680678c0 0x7f1e68069d80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1e840cb320 tx=0x7f1e74008040 comp rx=0 tx=0).stop 2024-09-15T23:59:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.196+0000 7f1e8c391640 1 -- 172.21.15.112:0/4182603932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e840d2e90 msgr2=0x7f1e840b9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.196+0000 7f1e8c391640 1 --2- 172.21.15.112:0/4182603932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e840d2e90 0x7f1e840b9d30 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f1e8001af20 tx=0x7f1e80019610 comp rx=0 tx=0).stop 2024-09-15T23:59:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.196+0000 7f1e8c391640 1 -- 172.21.15.112:0/4182603932 shutdown_connections 2024-09-15T23:59:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.196+0000 7f1e8c391640 1 --2- 172.21.15.112:0/4182603932 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1e680678c0 0x7f1e68069d80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.196+0000 7f1e8c391640 1 --2- 172.21.15.112:0/4182603932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e84161a60 0x7f1e840b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.196+0000 7f1e8c391640 1 --2- 172.21.15.112:0/4182603932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e840d2e90 0x7f1e840b9d30 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:33.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.196+0000 7f1e8c391640 1 --2- 172.21.15.112:0/4182603932 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e840cf450 0x7f1e8414f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:33.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.196+0000 7f1e8c391640 1 -- 172.21.15.112:0/4182603932 >> 172.21.15.112:0/4182603932 conn(0x7f1e8408bf90 msgr2=0x7f1e840d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:33.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.196+0000 7f1e8c391640 1 -- 172.21.15.112:0/4182603932 shutdown_connections 2024-09-15T23:59:33.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:33.196+0000 7f1e8c391640 1 -- 172.21.15.112:0/4182603932 wait complete. 2024-09-15T23:59:34.213 INFO:tasks.ceph:Scrubbing osd.0 2024-09-15T23:59:34.214 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:59:34.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3b5774640 1 Processor -- start 2024-09-15T23:59:34.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3b5774640 1 -- start start 2024-09-15T23:59:34.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3b5774640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb3b0070020 0x7fb3b015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3b5774640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b00aede0 con 0x7fb3b01520a0 2024-09-15T23:59:34.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3b5774640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b015fa10 con 0x7fb3b015f1d0 2024-09-15T23:59:34.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3b5774640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb3b0152480 con 0x7fb3b0070020 2024-09-15T23:59:34.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3aeffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb3b01520a0 0x7fb3b006f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51042/0 (socket says 172.21.15.112:51042) 2024-09-15T23:59:34.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3aeffd640 1 -- 172.21.15.112:0/1107003968 learned_addr learned my addr 172.21.15.112:0/1107003968 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:34.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 -- 172.21.15.112:0/1107003968 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 190099023 0 0) 0x7fb3b00aede0 con 0x7fb3b01520a0 2024-09-15T23:59:34.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 -- 172.21.15.112:0/1107003968 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb39c005740 con 0x7fb3b01520a0 2024-09-15T23:59:34.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3ae7fc640 1 --2- 172.21.15.112:0/1107003968 >> v2:172.21.15.169:3300/0 conn(0x7fb3b0070020 0x7fb3b015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 -- 172.21.15.112:0/1107003968 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 274459516 0 0) 0x7fb39c005740 con 0x7fb3b01520a0 2024-09-15T23:59:34.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 -- 172.21.15.112:0/1107003968 >> v2:172.21.15.169:3300/0 conn(0x7fb3b0070020 msgr2=0x7fb3b015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:34.356 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 --2- 172.21.15.112:0/1107003968 >> v2:172.21.15.169:3300/0 conn(0x7fb3b0070020 0x7fb3b015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 -- 172.21.15.112:0/1107003968 >> v1:172.21.15.169:6789/0 conn(0x7fb3b015f1d0 legacy=0x7fb3b00adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 -- 172.21.15.112:0/1107003968 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b0074250 con 0x7fb3b01520a0 2024-09-15T23:59:34.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 -- 172.21.15.112:0/1107003968 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fb3a8001a00 con 0x7fb3b01520a0 2024-09-15T23:59:34.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 -- 172.21.15.112:0/1107003968 >> v1:172.21.15.112:6789/0 conn(0x7fb3b01520a0 legacy=0x7fb3b006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 --2- 172.21.15.112:0/1107003968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb39c005bd0 0x7fb39c005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 --2- 172.21.15.112:0/1107003968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb39c006a20 0x7fb39c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 --2- 172.21.15.112:0/1107003968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb39c0073e0 0x7fb39c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 -- 172.21.15.112:0/1107003968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c00e250 con 0x7fb39c005bd0 2024-09-15T23:59:34.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 -- 172.21.15.112:0/1107003968 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c00e400 con 0x7fb39c006a20 2024-09-15T23:59:34.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3adffb640 1 -- 172.21.15.112:0/1107003968 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb39c00e600 con 0x7fb39c0073e0 2024-09-15T23:59:34.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3aeffd640 1 --2- 172.21.15.112:0/1107003968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb39c005bd0 0x7fb39c005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3aeffd640 1 -- 172.21.15.112:0/1107003968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb39c0073e0 msgr2=0x7fb39c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:34.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3aeffd640 1 --2- 172.21.15.112:0/1107003968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb39c0073e0 0x7fb39c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3aeffd640 1 -- 172.21.15.112:0/1107003968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb39c006a20 msgr2=0x7fb39c006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:34.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3ae7fc640 1 --2- 172.21.15.112:0/1107003968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb39c006a20 0x7fb39c006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3aeffd640 1 --2- 172.21.15.112:0/1107003968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb39c006a20 0x7fb39c006ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3af7fe640 1 -- 172.21.15.112:0/1107003968 reap_dead start 2024-09-15T23:59:34.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.352+0000 7fb3aeffd640 1 -- 172.21.15.112:0/1107003968 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39c005740 con 0x7fb39c005bd0 2024-09-15T23:59:34.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.356+0000 7fb3aeffd640 1 --2- 172.21.15.112:0/1107003968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb39c005bd0 0x7fb39c005ff0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800a860 tx=0x7fb3a801d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25b8d9dc7f24259 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:34.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.356+0000 7fb3adffb640 1 -- 172.21.15.112:0/1107003968 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a800a480 con 0x7fb39c005bd0 2024-09-15T23:59:34.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.356+0000 7fb3adffb640 1 -- 172.21.15.112:0/1107003968 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a80ad630 con 0x7fb39c005bd0 2024-09-15T23:59:34.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.356+0000 7fb3adffb640 1 -- 172.21.15.112:0/1107003968 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a80ada40 con 0x7fb39c005bd0 2024-09-15T23:59:34.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.356+0000 7fb3b5774640 1 -- 172.21.15.112:0/1107003968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb39c005bd0 msgr2=0x7fb39c005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.356+0000 7fb3b5774640 1 --2- 172.21.15.112:0/1107003968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb39c005bd0 0x7fb39c005ff0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800a860 tx=0x7fb3a801d350 comp rx=0 tx=0).stop 2024-09-15T23:59:34.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.356+0000 7fb3b5774640 1 -- 172.21.15.112:0/1107003968 shutdown_connections 2024-09-15T23:59:34.364 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.356+0000 7fb3b5774640 1 --2- 172.21.15.112:0/1107003968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb39c005bd0 0x7fb39c005ff0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.356+0000 7fb3b5774640 1 -- 172.21.15.112:0/1107003968 >> 172.21.15.112:0/1107003968 conn(0x7fb3b00b1f90 msgr2=0x7fb3b00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:34.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.356+0000 7fb3b5774640 1 -- 172.21.15.112:0/1107003968 shutdown_connections 2024-09-15T23:59:34.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.356+0000 7fb3b5774640 1 -- 172.21.15.112:0/1107003968 wait complete. 2024-09-15T23:59:34.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3b5774640 1 Processor -- start 2024-09-15T23:59:34.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3b5774640 1 -- start start 2024-09-15T23:59:34.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3b5774640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb39c005bd0 0x7fb3b014a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.365 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3b5774640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3b01e6e20 0x7fb3b00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3b5774640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3b014e410 0x7fb3b014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3b5774640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b0073d30 con 0x7fb39c005bd0 2024-09-15T23:59:34.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3b5774640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b0073a50 con 0x7fb3b01e6e20 2024-09-15T23:59:34.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3b5774640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b015f5e0 con 0x7fb3b014e410 2024-09-15T23:59:34.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3aeffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb39c005bd0 0x7fb3b014a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3aeffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb39c005bd0 0x7fb3b014a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38476/0 (socket says 172.21.15.112:38476) 2024-09-15T23:59:34.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3aeffd640 1 -- 172.21.15.112:0/715854542 learned_addr learned my addr 172.21.15.112:0/715854542 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:34.366 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3af7fe640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3b014e410 0x7fb3b014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3ae7fc640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3b01e6e20 0x7fb3b00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3aeffd640 1 -- 172.21.15.112:0/715854542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3b014e410 msgr2=0x7fb3b014e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3aeffd640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3b014e410 0x7fb3b014e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3aeffd640 1 -- 172.21.15.112:0/715854542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3b01e6e20 msgr2=0x7fb3b00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3aeffd640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3b01e6e20 0x7fb3b00cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3aeffd640 1 -- 172.21.15.112:0/715854542 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b00ce8e0 con 0x7fb39c005bd0 2024-09-15T23:59:34.367 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3af7fe640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3b014e410 0x7fb3b014e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:34.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3aeffd640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb39c005bd0 0x7fb3b014a050 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fb3a801d180 tx=0x7fb39c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:34.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3a77fe640 1 -- 172.21.15.112:0/715854542 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a80017c0 con 0x7fb39c005bd0 2024-09-15T23:59:34.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3a77fe640 1 -- 172.21.15.112:0/715854542 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a80be070 con 0x7fb39c005bd0 2024-09-15T23:59:34.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3a77fe640 1 -- 172.21.15.112:0/715854542 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8001b60 con 0x7fb39c005bd0 2024-09-15T23:59:34.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3b5774640 1 -- 172.21.15.112:0/715854542 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b00cd880 con 0x7fb39c005bd0 2024-09-15T23:59:34.368 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3b5774640 1 -- 172.21.15.112:0/715854542 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b00cdb20 con 0x7fb39c005bd0 2024-09-15T23:59:34.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3b5774640 1 -- 172.21.15.112:0/715854542 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb3b0151420 con 0x7fb39c005bd0 2024-09-15T23:59:34.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3a77fe640 1 -- 172.21.15.112:0/715854542 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3a80ad630 con 0x7fb39c005bd0 2024-09-15T23:59:34.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3a77fe640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3900678f0 0x7fb390069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3a77fe640 1 -- 172.21.15.112:0/715854542 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7fb3a8121720 con 0x7fb39c005bd0 2024-09-15T23:59:34.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3ae7fc640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3900678f0 0x7fb390069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3a77fe640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.112:6808/537028791,v1:172.21.15.112:6809/537028791] conn(0x7fb39006dd90 0x7fb3900701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3a77fe640 1 -- 172.21.15.112:0/715854542 --> [v2:172.21.15.112:6808/537028791,v1:172.21.15.112:6809/537028791] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3900708a0 con 0x7fb39006dd90 2024-09-15T23:59:34.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.360+0000 7fb3a77fe640 1 -- 172.21.15.112:0/715854542 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7fb3a8121bb0 con 0x7fb39c005bd0 2024-09-15T23:59:34.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.364+0000 7fb3af7fe640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.112:6808/537028791,v1:172.21.15.112:6809/537028791] conn(0x7fb39006dd90 0x7fb3900701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.364+0000 7fb3ae7fc640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3900678f0 0x7fb390069db0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb3b006ec50 tx=0x7fb398008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:34.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.364+0000 7fb3af7fe640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.112:6808/537028791,v1:172.21.15.112:6809/537028791] conn(0x7fb39006dd90 0x7fb3900701d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:34.370 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.364+0000 7fb3a77fe640 1 -- 172.21.15.112:0/715854542 <== osd.0 v2:172.21.15.112:6808/537028791 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb3900708a0 con 0x7fb39006dd90 2024-09-15T23:59:34.376 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.376+0000 7fb3b5774640 1 -- 172.21.15.112:0/715854542 --> [v2:172.21.15.112:6808/537028791,v1:172.21.15.112:6809/537028791] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb3b0068e50 con 0x7fb39006dd90 2024-09-15T23:59:34.377 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.376+0000 7fb3a77fe640 1 -- 172.21.15.112:0/715854542 <== osd.0 v2:172.21.15.112:6808/537028791 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb3b0068e50 con 0x7fb39006dd90 2024-09-15T23:59:34.377 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:59:34.377 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:59:34.378 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:59:34.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.376+0000 7fb3b5774640 1 -- 172.21.15.112:0/715854542 >> [v2:172.21.15.112:6808/537028791,v1:172.21.15.112:6809/537028791] conn(0x7fb39006dd90 msgr2=0x7fb3900701d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.376+0000 7fb3b5774640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.112:6808/537028791,v1:172.21.15.112:6809/537028791] conn(0x7fb39006dd90 0x7fb3900701d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.376+0000 7fb3b5774640 1 -- 172.21.15.112:0/715854542 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3900678f0 msgr2=0x7fb390069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.376+0000 7fb3b5774640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb3900678f0 0x7fb390069db0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb3b006ec50 tx=0x7fb398008040 comp rx=0 tx=0).stop 2024-09-15T23:59:34.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.376+0000 7fb3b5774640 1 -- 172.21.15.112:0/715854542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb39c005bd0 msgr2=0x7fb3b014a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.376+0000 7fb3b5774640 1 --2- 172.21.15.112:0/715854542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb39c005bd0 0x7fb3b014a050 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fb3a801d180 tx=0x7fb39c007a50 comp rx=0 tx=0).stop 2024-09-15T23:59:34.379 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.376+0000 7fb3af7fe640 1 -- 172.21.15.112:0/715854542 reap_dead start 2024-09-15T23:59:34.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.376+0000 7fb3b5774640 1 -- 172.21.15.112:0/715854542 shutdown_connections 2024-09-15T23:59:34.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.376+0000 7fb3b5774640 1 -- 172.21.15.112:0/715854542 >> 172.21.15.112:0/715854542 conn(0x7fb3b00b1f90 msgr2=0x7fb3b00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:34.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.376+0000 7fb3b5774640 1 -- 172.21.15.112:0/715854542 shutdown_connections 2024-09-15T23:59:34.380 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.376+0000 7fb3b5774640 1 -- 172.21.15.112:0/715854542 wait complete. 2024-09-15T23:59:34.394 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-15T23:59:34.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34d5d14640 1 Processor -- start 2024-09-15T23:59:34.503 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34d5d14640 1 -- start start 2024-09-15T23:59:34.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34d5d14640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d00d3060 0x7f34d00cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.504 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34d5d14640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34d00cf450 0x7f34d006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34d5d14640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d00d0300 con 0x7f34d0161a60 2024-09-15T23:59:34.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34d5d14640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f34d00b0f60 con 0x7f34d00cf450 2024-09-15T23:59:34.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34d5d14640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f34d00cfd40 con 0x7f34d00d3060 2024-09-15T23:59:34.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34cffff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f34d00cf450 0x7f34d006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34cf7fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f34d0161a60 0x7f34d00d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51048/0 (socket says 172.21.15.112:51048) 2024-09-15T23:59:34.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34cf7fe640 1 -- 172.21.15.112:0/2100398857 learned_addr learned my addr 172.21.15.112:0/2100398857 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:34.505 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34ceffd640 1 --2- 172.21.15.112:0/2100398857 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d00d3060 0x7f34d00cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34cffff640 1 -- 172.21.15.112:0/2100398857 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d00d3060 msgr2=0x7f34d00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:34.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34cffff640 1 --2- 172.21.15.112:0/2100398857 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d00d3060 0x7f34d00cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34cffff640 1 -- 172.21.15.112:0/2100398857 >> v1:172.21.15.112:6789/0 conn(0x7f34d0161a60 legacy=0x7f34d00d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34ce7fc640 1 -- 172.21.15.112:0/2100398857 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2451206539 0 0) 0x7f34c0001120 con 0x7f34d0161a60 2024-09-15T23:59:34.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34cffff640 1 -- 172.21.15.112:0/2100398857 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d00d0020 con 0x7f34d00cf450 2024-09-15T23:59:34.506 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.504+0000 7f34ceffd640 1 --2- 172.21.15.112:0/2100398857 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d00d3060 0x7f34d00cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:34.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34cffff640 1 --2- 172.21.15.112:0/2100398857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d00cf450 0x7f34d006d6b0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009d90 tx=0x7f34c801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e19817a60f528 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:34.507 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34ce7fc640 1 -- 172.21.15.112:0/2100398857 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c80b2070 con 0x7f34d00cf450 2024-09-15T23:59:34.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34ce7fc640 1 -- 172.21.15.112:0/2100398857 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c80a5970 con 0x7f34d00cf450 2024-09-15T23:59:34.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34ce7fc640 1 -- 172.21.15.112:0/2100398857 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c80a5d40 con 0x7f34d00cf450 2024-09-15T23:59:34.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 -- 172.21.15.112:0/2100398857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d00cf450 msgr2=0x7f34d006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 --2- 172.21.15.112:0/2100398857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d00cf450 0x7f34d006d6b0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009d90 tx=0x7f34c801c8b0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 -- 172.21.15.112:0/2100398857 shutdown_connections 2024-09-15T23:59:34.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 --2- 172.21.15.112:0/2100398857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d00cf450 0x7f34d006d6b0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.508 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 --2- 172.21.15.112:0/2100398857 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d00d3060 0x7f34d00cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 -- 172.21.15.112:0/2100398857 >> 172.21.15.112:0/2100398857 conn(0x7f34d008bf90 msgr2=0x7f34d009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:34.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 -- 172.21.15.112:0/2100398857 shutdown_connections 2024-09-15T23:59:34.509 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 -- 172.21.15.112:0/2100398857 wait complete. 2024-09-15T23:59:34.511 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 Processor -- start 2024-09-15T23:59:34.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 -- start start 2024-09-15T23:59:34.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d00cf450 0x7f34d0154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34d00d3060 0x7f34d00b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d0161a60 0x7f34d0158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f34d006e400 con 0x7f34d0161a60 2024-09-15T23:59:34.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f34d00cfaf0 con 0x7f34d00d3060 2024-09-15T23:59:34.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f34d006e580 con 0x7f34d00cf450 2024-09-15T23:59:34.512 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34cffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d0161a60 0x7f34d0158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34cffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d0161a60 0x7f34d0158620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38492/0 (socket says 172.21.15.112:38492) 2024-09-15T23:59:34.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34cffff640 1 -- 172.21.15.112:0/1701509858 learned_addr learned my addr 172.21.15.112:0/1701509858 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:34.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34ceffd640 1 --2- 172.21.15.112:0/1701509858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34d00d3060 0x7f34d00b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34cffff640 1 -- 172.21.15.112:0/1701509858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d00cf450 msgr2=0x7f34d0154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34cffff640 1 --2- 172.21.15.112:0/1701509858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d00cf450 0x7f34d0154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.513 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34cffff640 1 -- 172.21.15.112:0/1701509858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34d00d3060 msgr2=0x7f34d00b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34cffff640 1 --2- 172.21.15.112:0/1701509858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34d00d3060 0x7f34d00b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34cffff640 1 -- 172.21.15.112:0/1701509858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d015abc0 con 0x7f34d0161a60 2024-09-15T23:59:34.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34cffff640 1 --2- 172.21.15.112:0/1701509858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d0161a60 0x7f34d0158620 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f34c801af60 tx=0x7f34c8019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:34.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34b7fff640 1 -- 172.21.15.112:0/1701509858 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c80b2050 con 0x7f34d0161a60 2024-09-15T23:59:34.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34b7fff640 1 -- 172.21.15.112:0/1701509858 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c80be070 con 0x7f34d0161a60 2024-09-15T23:59:34.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34b7fff640 1 -- 172.21.15.112:0/1701509858 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c80adad0 con 0x7f34d0161a60 2024-09-15T23:59:34.514 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 -- 172.21.15.112:0/1701509858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d015aea0 con 0x7f34d0161a60 2024-09-15T23:59:34.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.508+0000 7f34d5d14640 1 -- 172.21.15.112:0/1701509858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d015b460 con 0x7f34d0161a60 2024-09-15T23:59:34.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.512+0000 7f34d5d14640 1 -- 172.21.15.112:0/1701509858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d006d6b0 con 0x7f34d0161a60 2024-09-15T23:59:34.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.512+0000 7f34b7fff640 1 -- 172.21.15.112:0/1701509858 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f34c80adc70 con 0x7f34d0161a60 2024-09-15T23:59:34.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.512+0000 7f34b7fff640 1 --2- 172.21.15.112:0/1701509858 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34bc0678c0 0x7f34bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.512+0000 7f34b7fff640 1 -- 172.21.15.112:0/1701509858 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f34c8120ef0 con 0x7f34d0161a60 2024-09-15T23:59:34.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.512+0000 7f34cf7fe640 1 --2- 172.21.15.112:0/1701509858 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34bc0678c0 0x7f34bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.512+0000 7f34cf7fe640 1 --2- 172.21.15.112:0/1701509858 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34bc0678c0 0x7f34bc069d80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f34d01fa1e0 tx=0x7f34c0007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:34.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.516+0000 7f34b7fff640 1 -- 172.21.15.112:0/1701509858 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f34c8016560 con 0x7f34d0161a60 2024-09-15T23:59:34.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.668+0000 7f34d5d14640 1 -- 172.21.15.112:0/1701509858 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f34d00b3890 con 0x7f34bc0678c0 2024-09-15T23:59:34.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.668+0000 7f34b7fff640 1 -- 172.21.15.112:0/1701509858 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f34d00b3890 con 0x7f34bc0678c0 2024-09-15T23:59:34.669 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 0 to deep-scrub 2024-09-15T23:59:34.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.672+0000 7f34d5d14640 1 -- 172.21.15.112:0/1701509858 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34bc0678c0 msgr2=0x7f34bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.672+0000 7f34d5d14640 1 --2- 172.21.15.112:0/1701509858 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34bc0678c0 0x7f34bc069d80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f34d01fa1e0 tx=0x7f34c0007970 comp rx=0 tx=0).stop 2024-09-15T23:59:34.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.672+0000 7f34d5d14640 1 -- 172.21.15.112:0/1701509858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d0161a60 msgr2=0x7f34d0158620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.672+0000 7f34d5d14640 1 --2- 172.21.15.112:0/1701509858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d0161a60 0x7f34d0158620 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f34c801af60 tx=0x7f34c8019650 comp rx=0 tx=0).stop 2024-09-15T23:59:34.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.672+0000 7f34d5d14640 1 -- 172.21.15.112:0/1701509858 shutdown_connections 2024-09-15T23:59:34.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.672+0000 7f34d5d14640 1 --2- 172.21.15.112:0/1701509858 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f34bc0678c0 0x7f34bc069d80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.672+0000 7f34d5d14640 1 --2- 172.21.15.112:0/1701509858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34d0161a60 0x7f34d0158620 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.672+0000 7f34d5d14640 1 --2- 172.21.15.112:0/1701509858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34d00d3060 0x7f34d00b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.672+0000 7f34d5d14640 1 --2- 172.21.15.112:0/1701509858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34d00cf450 0x7f34d0154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.672+0000 7f34d5d14640 1 -- 172.21.15.112:0/1701509858 >> 172.21.15.112:0/1701509858 conn(0x7f34d008bf90 msgr2=0x7f34d0160cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:34.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.672+0000 7f34d5d14640 1 -- 172.21.15.112:0/1701509858 shutdown_connections 2024-09-15T23:59:34.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.672+0000 7f34d5d14640 1 -- 172.21.15.112:0/1701509858 wait complete. 2024-09-15T23:59:34.686 INFO:tasks.ceph:Scrubbing osd.1 2024-09-15T23:59:34.687 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:59:34.804 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d22ff640 1 Processor -- start 2024-09-15T23:59:34.805 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d22ff640 1 -- start start 2024-09-15T23:59:34.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d22ff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd6cc15bec0 0x7fd6cc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d22ff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6cc15c2a0 0x7fd6cc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d22ff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd6cc0af2a0 0x7fd6cc15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d22ff640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7fd6cc0b3290 con 0x7fd6cc0af2a0 2024-09-15T23:59:34.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d22ff640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd6cc0b3570 con 0x7fd6cc15bec0 2024-09-15T23:59:34.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d22ff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd6cc0b3850 con 0x7fd6cc15c2a0 2024-09-15T23:59:34.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d089c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd6cc0af2a0 0x7fd6cc15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d089c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7fd6cc0af2a0 0x7fd6cc15fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38506/0 (socket says 172.21.15.112:38506) 2024-09-15T23:59:34.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d089c640 1 -- 172.21.15.112:0/3005374928 learned_addr learned my addr 172.21.15.112:0/3005374928 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:34.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6cb7fe640 1 --2- 172.21.15.112:0/3005374928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6cc15c2a0 0x7fd6cc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6cbfff640 1 --2- 172.21.15.112:0/3005374928 >> v2:172.21.15.169:3300/0 conn(0x7fd6cc15bec0 0x7fd6cc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d089c640 1 -- 172.21.15.112:0/3005374928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6cc15c2a0 msgr2=0x7fd6cc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:34.807 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d089c640 1 --2- 172.21.15.112:0/3005374928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6cc15c2a0 0x7fd6cc0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d089c640 1 -- 172.21.15.112:0/3005374928 >> v2:172.21.15.169:3300/0 conn(0x7fd6cc15bec0 msgr2=0x7fd6cc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:34.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d089c640 1 --2- 172.21.15.112:0/3005374928 >> v2:172.21.15.169:3300/0 conn(0x7fd6cc15bec0 0x7fd6cc0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6d089c640 1 -- 172.21.15.112:0/3005374928 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc0b3b30 con 0x7fd6cc0af2a0 2024-09-15T23:59:34.808 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.804+0000 7fd6cbfff640 1 --2- 172.21.15.112:0/3005374928 >> v2:172.21.15.169:3300/0 conn(0x7fd6cc15bec0 0x7fd6cc0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:34.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6d089c640 1 --2- 172.21.15.112:0/3005374928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6cc0af2a0 0x7fd6cc15fc60 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc071710 tx=0x7fd6c401c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42094cf7d949c8f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:34.809 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6caffd640 1 -- 172.21.15.112:0/3005374928 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40a5580 con 0x7fd6cc0af2a0 2024-09-15T23:59:34.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6caffd640 1 -- 172.21.15.112:0/3005374928 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c40a5720 con 0x7fd6cc0af2a0 2024-09-15T23:59:34.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6caffd640 1 -- 172.21.15.112:0/3005374928 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40a5af0 con 0x7fd6cc0af2a0 2024-09-15T23:59:34.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3005374928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6cc0af2a0 msgr2=0x7fd6cc15fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6d22ff640 1 --2- 172.21.15.112:0/3005374928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6cc0af2a0 0x7fd6cc15fc60 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc071710 tx=0x7fd6c401c700 comp rx=0 tx=0).stop 2024-09-15T23:59:34.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3005374928 shutdown_connections 2024-09-15T23:59:34.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6d22ff640 1 --2- 172.21.15.112:0/3005374928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6cc0af2a0 0x7fd6cc15fc60 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6d22ff640 1 --2- 172.21.15.112:0/3005374928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6cc15c2a0 0x7fd6cc0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.810 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6d22ff640 1 --2- 172.21.15.112:0/3005374928 >> v2:172.21.15.169:3300/0 conn(0x7fd6cc15bec0 0x7fd6cc0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3005374928 >> 172.21.15.112:0/3005374928 conn(0x7fd6cc0b1f90 msgr2=0x7fd6cc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3005374928 shutdown_connections 2024-09-15T23:59:34.811 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3005374928 wait complete. 2024-09-15T23:59:34.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6d22ff640 1 Processor -- start 2024-09-15T23:59:34.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.808+0000 7fd6d22ff640 1 -- start start 2024-09-15T23:59:34.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d22ff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6cc0af2a0 0x7fd6cc098f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d22ff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6cc15bec0 0x7fd6cc14d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.814 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d22ff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6cc15c2a0 0x7fd6cc14daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d22ff640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc0ad740 con 0x7fd6cc15c2a0 2024-09-15T23:59:34.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d22ff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc0afc90 con 0x7fd6cc15bec0 2024-09-15T23:59:34.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d22ff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd6cc06e000 con 0x7fd6cc0af2a0 2024-09-15T23:59:34.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d089c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6cc15c2a0 0x7fd6cc14daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d089c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6cc15c2a0 0x7fd6cc14daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38514/0 (socket says 172.21.15.112:38514) 2024-09-15T23:59:34.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d089c640 1 -- 172.21.15.112:0/3695928711 learned_addr learned my addr 172.21.15.112:0/3695928711 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:34.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6cb7fe640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6cc15bec0 0x7fd6cc14d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.815 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6cbfff640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6cc0af2a0 0x7fd6cc098f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d089c640 1 -- 172.21.15.112:0/3695928711 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6cc0af2a0 msgr2=0x7fd6cc098f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d089c640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6cc0af2a0 0x7fd6cc098f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d089c640 1 -- 172.21.15.112:0/3695928711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6cc15bec0 msgr2=0x7fd6cc14d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d089c640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6cc15bec0 0x7fd6cc14d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d089c640 1 -- 172.21.15.112:0/3695928711 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc14f900 con 0x7fd6cc15c2a0 2024-09-15T23:59:34.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6cb7fe640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6cc15bec0 0x7fd6cc14d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:34.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d089c640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6cc15c2a0 0x7fd6cc14daa0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40af040 tx=0x7fd6c40194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:34.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6c8ff9640 1 -- 172.21.15.112:0/3695928711 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4009510 con 0x7fd6cc15c2a0 2024-09-15T23:59:34.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6c8ff9640 1 -- 172.21.15.112:0/3695928711 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c40be070 con 0x7fd6cc15c2a0 2024-09-15T23:59:34.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3695928711 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6cc14fbe0 con 0x7fd6cc15c2a0 2024-09-15T23:59:34.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6c8ff9640 1 -- 172.21.15.112:0/3695928711 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40b88d0 con 0x7fd6cc15c2a0 2024-09-15T23:59:34.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3695928711 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6cc1563e0 con 0x7fd6cc15c2a0 2024-09-15T23:59:34.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3695928711 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6cc0ad200 con 0x7fd6cc15c2a0 2024-09-15T23:59:34.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6c8ff9640 1 -- 172.21.15.112:0/3695928711 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd6c40b8a70 con 0x7fd6cc15c2a0 2024-09-15T23:59:34.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6c8ff9640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd6b80678f0 0x7fd6b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6c8ff9640 1 -- 172.21.15.112:0/3695928711 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7fd6c4121400 con 0x7fd6cc15c2a0 2024-09-15T23:59:34.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6cbfff640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd6b80678f0 0x7fd6b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6c8ff9640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.112:6800/686325648,v1:172.21.15.112:6801/686325648] conn(0x7fd6b806dd90 0x7fd6b80701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6c8ff9640 1 -- 172.21.15.112:0/3695928711 --> [v2:172.21.15.112:6800/686325648,v1:172.21.15.112:6801/686325648] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6c40020c0 con 0x7fd6b806dd90 2024-09-15T23:59:34.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6c8ff9640 1 -- 172.21.15.112:0/3695928711 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7fd6c4121890 con 0x7fd6cc15c2a0 2024-09-15T23:59:34.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6cb7fe640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.112:6800/686325648,v1:172.21.15.112:6801/686325648] conn(0x7fd6b806dd90 0x7fd6b80701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.812+0000 7fd6cbfff640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd6b80678f0 0x7fd6b8069db0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc006fd0 tx=0x7fd6bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:34.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.816+0000 7fd6cb7fe640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.112:6800/686325648,v1:172.21.15.112:6801/686325648] conn(0x7fd6b806dd90 0x7fd6b80701d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:34.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.816+0000 7fd6c8ff9640 1 -- 172.21.15.112:0/3695928711 <== osd.1 v2:172.21.15.112:6800/686325648 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6c40020c0 con 0x7fd6b806dd90 2024-09-15T23:59:34.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.828+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3695928711 --> [v2:172.21.15.112:6800/686325648,v1:172.21.15.112:6801/686325648] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd6cc06fcd0 con 0x7fd6b806dd90 2024-09-15T23:59:34.828 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.828+0000 7fd6c8ff9640 1 -- 172.21.15.112:0/3695928711 <== osd.1 v2:172.21.15.112:6800/686325648 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd6cc06fcd0 con 0x7fd6b806dd90 2024-09-15T23:59:34.829 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:59:34.829 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:59:34.829 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:59:34.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.828+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3695928711 >> [v2:172.21.15.112:6800/686325648,v1:172.21.15.112:6801/686325648] conn(0x7fd6b806dd90 msgr2=0x7fd6b80701d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.830 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.828+0000 7fd6d22ff640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.112:6800/686325648,v1:172.21.15.112:6801/686325648] conn(0x7fd6b806dd90 0x7fd6b80701d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.828+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3695928711 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd6b80678f0 msgr2=0x7fd6b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.828+0000 7fd6d22ff640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fd6b80678f0 0x7fd6b8069db0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc006fd0 tx=0x7fd6bc008040 comp rx=0 tx=0).stop 2024-09-15T23:59:34.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.828+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3695928711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6cc15c2a0 msgr2=0x7fd6cc14daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.828+0000 7fd6d22ff640 1 --2- 172.21.15.112:0/3695928711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6cc15c2a0 0x7fd6cc14daa0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40af040 tx=0x7fd6c40194a0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.828+0000 7fd6d089c640 1 -- 172.21.15.112:0/3695928711 reap_dead start 2024-09-15T23:59:34.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.828+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3695928711 shutdown_connections 2024-09-15T23:59:34.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.828+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3695928711 >> 172.21.15.112:0/3695928711 conn(0x7fd6cc0b1f90 msgr2=0x7fd6cc0750c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:34.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.828+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3695928711 shutdown_connections 2024-09-15T23:59:34.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.828+0000 7fd6d22ff640 1 -- 172.21.15.112:0/3695928711 wait complete. 2024-09-15T23:59:34.843 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-15T23:59:34.951 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c9802640 1 Processor -- start 2024-09-15T23:59:34.952 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c9802640 1 -- start start 2024-09-15T23:59:34.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c9802640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74c40b44d0 0x7f74c406bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c9802640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c40b1e30 con 0x7f74c4147d00 2024-09-15T23:59:34.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c9802640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c40b25b0 con 0x7f74c406c200 2024-09-15T23:59:34.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c9802640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f74c40b6500 con 0x7f74c40b44d0 2024-09-15T23:59:34.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c2ffd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f74c4147d00 0x7f74c40b1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51050/0 (socket says 172.21.15.112:51050) 2024-09-15T23:59:34.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c2ffd640 1 -- 172.21.15.112:0/534413533 learned_addr learned my addr 172.21.15.112:0/534413533 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:34.955 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 -- 172.21.15.112:0/534413533 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3193440199 0 0) 0x7f74c40b1e30 con 0x7f74c4147d00 2024-09-15T23:59:34.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 -- 172.21.15.112:0/534413533 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74ac003530 con 0x7f74c4147d00 2024-09-15T23:59:34.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c27fc640 1 --2- 172.21.15.112:0/534413533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74c40b44d0 0x7f74c406bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 -- 172.21.15.112:0/534413533 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1071984247 0 0) 0x7f74ac003530 con 0x7f74c4147d00 2024-09-15T23:59:34.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 -- 172.21.15.112:0/534413533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74c40b44d0 msgr2=0x7f74c406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:34.956 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 --2- 172.21.15.112:0/534413533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74c40b44d0 0x7f74c406bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 -- 172.21.15.112:0/534413533 >> v1:172.21.15.169:6789/0 conn(0x7f74c406c200 legacy=0x7f74c40ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 -- 172.21.15.112:0/534413533 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c40b2890 con 0x7f74c4147d00 2024-09-15T23:59:34.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 -- 172.21.15.112:0/534413533 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f74b4001680 con 0x7f74c4147d00 2024-09-15T23:59:34.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 -- 172.21.15.112:0/534413533 >> v1:172.21.15.112:6789/0 conn(0x7f74c4147d00 legacy=0x7f74c40b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 --2- 172.21.15.112:0/534413533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74ac0039f0 0x7f74ac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 --2- 172.21.15.112:0/534413533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74c40b44d0 0x7f74ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 --2- 172.21.15.112:0/534413533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74ac004d50 0x7f74ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.957 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 -- 172.21.15.112:0/534413533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40b6500 con 0x7f74ac004d50 2024-09-15T23:59:34.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 -- 172.21.15.112:0/534413533 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f74ac00bb60 con 0x7f74ac0039f0 2024-09-15T23:59:34.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c1ffb640 1 -- 172.21.15.112:0/534413533 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f74ac00bd60 con 0x7f74c40b44d0 2024-09-15T23:59:34.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c37fe640 1 --2- 172.21.15.112:0/534413533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74ac004d50 0x7f74ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c2ffd640 1 --2- 172.21.15.112:0/534413533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74ac0039f0 0x7f74ac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c27fc640 1 --2- 172.21.15.112:0/534413533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74c40b44d0 0x7f74ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c37fe640 1 -- 172.21.15.112:0/534413533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74c40b44d0 msgr2=0x7f74ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:34.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c37fe640 1 --2- 172.21.15.112:0/534413533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74c40b44d0 0x7f74ac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c37fe640 1 -- 172.21.15.112:0/534413533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74ac0039f0 msgr2=0x7f74ac003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:34.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c37fe640 1 --2- 172.21.15.112:0/534413533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74ac0039f0 0x7f74ac003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.952+0000 7f74c37fe640 1 -- 172.21.15.112:0/534413533 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ac003530 con 0x7f74ac004d50 2024-09-15T23:59:34.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.956+0000 7f74c37fe640 1 --2- 172.21.15.112:0/534413533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74ac004d50 0x7f74ac0051d0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f74bc001e70 tx=0x7f74bc01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33a22f6aeb5977f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:34.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.956+0000 7f74c1ffb640 1 -- 172.21.15.112:0/534413533 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc001a90 con 0x7f74ac004d50 2024-09-15T23:59:34.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.956+0000 7f74c1ffb640 1 -- 172.21.15.112:0/534413533 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74bc003b80 con 0x7f74ac004d50 2024-09-15T23:59:34.963 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.956+0000 7f74c1ffb640 1 -- 172.21.15.112:0/534413533 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc005080 con 0x7f74ac004d50 2024-09-15T23:59:34.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.956+0000 7f74c9802640 1 -- 172.21.15.112:0/534413533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74ac004d50 msgr2=0x7f74ac0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.956+0000 7f74c9802640 1 --2- 172.21.15.112:0/534413533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74ac004d50 0x7f74ac0051d0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f74bc001e70 tx=0x7f74bc01c780 comp rx=0 tx=0).stop 2024-09-15T23:59:34.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.956+0000 7f74c37fe640 1 -- 172.21.15.112:0/534413533 reap_dead start 2024-09-15T23:59:34.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.956+0000 7f74c9802640 1 -- 172.21.15.112:0/534413533 shutdown_connections 2024-09-15T23:59:34.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.956+0000 7f74c9802640 1 -- 172.21.15.112:0/534413533 >> 172.21.15.112:0/534413533 conn(0x7f74c409aa00 msgr2=0x7f74c40b66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:34.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.956+0000 7f74c9802640 1 -- 172.21.15.112:0/534413533 shutdown_connections 2024-09-15T23:59:34.964 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.956+0000 7f74c9802640 1 -- 172.21.15.112:0/534413533 wait complete. 2024-09-15T23:59:34.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.956+0000 7f74c9802640 1 Processor -- start 2024-09-15T23:59:34.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.956+0000 7f74c9802640 1 -- start start 2024-09-15T23:59:34.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c9802640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74c415de40 0x7f74c412bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c9802640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74c412c0a0 0x7f74c4160b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c9802640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74c4140950 0x7f74c4161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c9802640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40b5fe0 con 0x7f74c4140950 2024-09-15T23:59:34.965 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c9802640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f74c406c650 con 0x7f74c412c0a0 2024-09-15T23:59:34.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c9802640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f74c41480e0 con 0x7f74c415de40 2024-09-15T23:59:34.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74c4140950 0x7f74c4161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74c4140950 0x7f74c4161080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38534/0 (socket says 172.21.15.112:38534) 2024-09-15T23:59:34.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c37fe640 1 -- 172.21.15.112:0/2597116291 learned_addr learned my addr 172.21.15.112:0/2597116291 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:34.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c27fc640 1 --2- 172.21.15.112:0/2597116291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74c412c0a0 0x7f74c4160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c2ffd640 1 --2- 172.21.15.112:0/2597116291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74c415de40 0x7f74c412bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.966 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c37fe640 1 -- 172.21.15.112:0/2597116291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74c415de40 msgr2=0x7f74c412bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c37fe640 1 --2- 172.21.15.112:0/2597116291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74c415de40 0x7f74c412bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c37fe640 1 -- 172.21.15.112:0/2597116291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74c412c0a0 msgr2=0x7f74c4160b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:34.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c37fe640 1 --2- 172.21.15.112:0/2597116291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74c412c0a0 0x7f74c4160b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:34.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c37fe640 1 -- 172.21.15.112:0/2597116291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c413f8b0 con 0x7f74c4140950 2024-09-15T23:59:34.967 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c37fe640 1 --2- 172.21.15.112:0/2597116291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74c4140950 0x7f74c4161080 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f74bc01cc60 tx=0x7f74ac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74abfff640 1 -- 172.21.15.112:0/2597116291 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc0b8070 con 0x7f74c4140950 2024-09-15T23:59:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74abfff640 1 -- 172.21.15.112:0/2597116291 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74bc005820 con 0x7f74c4140950 2024-09-15T23:59:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c9802640 1 -- 172.21.15.112:0/2597116291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c413fb90 con 0x7f74c4140950 2024-09-15T23:59:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74abfff640 1 -- 172.21.15.112:0/2597116291 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc007dc0 con 0x7f74c4140950 2024-09-15T23:59:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c9802640 1 -- 172.21.15.112:0/2597116291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c4140150 con 0x7f74c4140950 2024-09-15T23:59:34.968 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c9802640 1 -- 172.21.15.112:0/2597116291 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c40b5c00 con 0x7f74c4140950 2024-09-15T23:59:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74abfff640 1 -- 172.21.15.112:0/2597116291 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f74bc0bb070 con 0x7f74c4140950 2024-09-15T23:59:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74abfff640 1 --2- 172.21.15.112:0/2597116291 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f74b00678c0 0x7f74b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74abfff640 1 -- 172.21.15.112:0/2597116291 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f74bc11ecc0 con 0x7f74c4140950 2024-09-15T23:59:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c2ffd640 1 --2- 172.21.15.112:0/2597116291 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f74b00678c0 0x7f74b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.960+0000 7f74c2ffd640 1 --2- 172.21.15.112:0/2597116291 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f74b00678c0 0x7f74b0069d80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f74c41f7940 tx=0x7f74b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:34.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:34.964+0000 7f74abfff640 1 -- 172.21.15.112:0/2597116291 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f74bc0ac020 con 0x7f74c4140950 2024-09-15T23:59:35.116 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.116+0000 7f74c9802640 1 -- 172.21.15.112:0/2597116291 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f74c406ffb0 con 0x7f74b00678c0 2024-09-15T23:59:35.117 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.116+0000 7f74abfff640 1 -- 172.21.15.112:0/2597116291 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f74c406ffb0 con 0x7f74b00678c0 2024-09-15T23:59:35.117 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 1 to deep-scrub 2024-09-15T23:59:35.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.116+0000 7f74c9802640 1 -- 172.21.15.112:0/2597116291 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f74b00678c0 msgr2=0x7f74b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.116+0000 7f74c9802640 1 --2- 172.21.15.112:0/2597116291 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f74b00678c0 0x7f74b0069d80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f74c41f7940 tx=0x7f74b4009040 comp rx=0 tx=0).stop 2024-09-15T23:59:35.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.116+0000 7f74c9802640 1 -- 172.21.15.112:0/2597116291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74c4140950 msgr2=0x7f74c4161080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.116+0000 7f74c9802640 1 --2- 172.21.15.112:0/2597116291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74c4140950 0x7f74c4161080 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f74bc01cc60 tx=0x7f74ac005840 comp rx=0 tx=0).stop 2024-09-15T23:59:35.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.120+0000 7f74c9802640 1 -- 172.21.15.112:0/2597116291 shutdown_connections 2024-09-15T23:59:35.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.120+0000 7f74c9802640 1 --2- 172.21.15.112:0/2597116291 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f74b00678c0 0x7f74b0069d80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.120+0000 7f74c9802640 1 --2- 172.21.15.112:0/2597116291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74c4140950 0x7f74c4161080 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.120+0000 7f74c9802640 1 --2- 172.21.15.112:0/2597116291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74c412c0a0 0x7f74c4160b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.120+0000 7f74c9802640 1 --2- 172.21.15.112:0/2597116291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74c415de40 0x7f74c412bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.120+0000 7f74c9802640 1 -- 172.21.15.112:0/2597116291 >> 172.21.15.112:0/2597116291 conn(0x7f74c409aa00 msgr2=0x7f74c40704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:35.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.120+0000 7f74c9802640 1 -- 172.21.15.112:0/2597116291 shutdown_connections 2024-09-15T23:59:35.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.120+0000 7f74c9802640 1 -- 172.21.15.112:0/2597116291 wait complete. 2024-09-15T23:59:35.134 INFO:tasks.ceph:Scrubbing osd.2 2024-09-15T23:59:35.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:59:35.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f271397b640 1 Processor -- start 2024-09-15T23:59:35.244 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f271397b640 1 -- start start 2024-09-15T23:59:35.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f271397b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f270c06cb70 0x7f270c0d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f271397b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f270c0b19f0 0x7f270c0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.245 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f271397b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f270c06df60 con 0x7f270c162200 2024-09-15T23:59:35.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f271397b640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f270c0d4fe0 con 0x7f270c06cb70 2024-09-15T23:59:35.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f271397b640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f270c0d52c0 con 0x7f270c0b19f0 2024-09-15T23:59:35.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f2711717640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f270c06cb70 0x7f270c0d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f2711f18640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f270c162200 0x7f270c162650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51052/0 (socket says 172.21.15.112:51052) 2024-09-15T23:59:35.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f2711f18640 1 -- 172.21.15.112:0/4213693279 learned_addr learned my addr 172.21.15.112:0/4213693279 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:35.246 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f2710f16640 1 --2- 172.21.15.112:0/4213693279 >> v2:172.21.15.169:3300/0 conn(0x7f270c0b19f0 0x7f270c0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f2711717640 1 -- 172.21.15.112:0/4213693279 >> v2:172.21.15.169:3300/0 conn(0x7f270c0b19f0 msgr2=0x7f270c0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:35.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f2711717640 1 --2- 172.21.15.112:0/4213693279 >> v2:172.21.15.169:3300/0 conn(0x7f270c0b19f0 0x7f270c0b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f2711717640 1 -- 172.21.15.112:0/4213693279 >> v1:172.21.15.112:6789/0 conn(0x7f270c162200 legacy=0x7f270c162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.247 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f2711717640 1 -- 172.21.15.112:0/4213693279 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270c0b38f0 con 0x7f270c06cb70 2024-09-15T23:59:35.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.244+0000 7f2703fff640 1 -- 172.21.15.112:0/4213693279 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3753610069 0 0) 0x7f27040014a0 con 0x7f270c162200 2024-09-15T23:59:35.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f2711717640 1 --2- 172.21.15.112:0/4213693279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f270c06cb70 0x7f270c0d2b90 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f27080097c0 tx=0x7f270801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fcfa237721dbaa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:35.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f2703fff640 1 -- 172.21.15.112:0/4213693279 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27080b0070 con 0x7f270c06cb70 2024-09-15T23:59:35.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f2703fff640 1 -- 172.21.15.112:0/4213693279 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2708004230 con 0x7f270c06cb70 2024-09-15T23:59:35.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f2703fff640 1 -- 172.21.15.112:0/4213693279 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2708003620 con 0x7f270c06cb70 2024-09-15T23:59:35.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 -- 172.21.15.112:0/4213693279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f270c06cb70 msgr2=0x7f270c0d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 --2- 172.21.15.112:0/4213693279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f270c06cb70 0x7f270c0d2b90 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f27080097c0 tx=0x7f270801c460 comp rx=0 tx=0).stop 2024-09-15T23:59:35.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 -- 172.21.15.112:0/4213693279 shutdown_connections 2024-09-15T23:59:35.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 --2- 172.21.15.112:0/4213693279 >> v2:172.21.15.169:3300/0 conn(0x7f270c0b19f0 0x7f270c0b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 --2- 172.21.15.112:0/4213693279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f270c06cb70 0x7f270c0d2b90 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 -- 172.21.15.112:0/4213693279 >> 172.21.15.112:0/4213693279 conn(0x7f270c08bf90 msgr2=0x7f270c0d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:35.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 -- 172.21.15.112:0/4213693279 shutdown_connections 2024-09-15T23:59:35.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 -- 172.21.15.112:0/4213693279 wait complete. 2024-09-15T23:59:35.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 Processor -- start 2024-09-15T23:59:35.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 -- start start 2024-09-15T23:59:35.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f270c06cb70 0x7f270c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f270c0b19f0 0x7f270c0b9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270c162200 0x7f270c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f270c161e40 con 0x7f270c06cb70 2024-09-15T23:59:35.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f270c0b23c0 con 0x7f270c0b19f0 2024-09-15T23:59:35.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f271397b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f270c161fc0 con 0x7f270c162200 2024-09-15T23:59:35.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f2711717640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f270c06cb70 0x7f270c15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f2711717640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f270c06cb70 0x7f270c15a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38546/0 (socket says 172.21.15.112:38546) 2024-09-15T23:59:35.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f2711717640 1 -- 172.21.15.112:0/806941046 learned_addr learned my addr 172.21.15.112:0/806941046 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:35.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f2710f16640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f270c0b19f0 0x7f270c0b9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.248+0000 7f2711f18640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270c162200 0x7f270c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2711717640 1 -- 172.21.15.112:0/806941046 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270c162200 msgr2=0x7f270c15e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2711717640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270c162200 0x7f270c15e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2711717640 1 -- 172.21.15.112:0/806941046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f270c0b19f0 msgr2=0x7f270c0b9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2711717640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f270c0b19f0 0x7f270c0b9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2711717640 1 -- 172.21.15.112:0/806941046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270c15a9e0 con 0x7f270c06cb70 2024-09-15T23:59:35.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2711f18640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f270c162200 0x7f270c15e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:35.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2711717640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f270c06cb70 0x7f270c15a4a0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f2708019070 tx=0x7f2708019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:35.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2701ffb640 1 -- 172.21.15.112:0/806941046 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27080b9070 con 0x7f270c06cb70 2024-09-15T23:59:35.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2701ffb640 1 -- 172.21.15.112:0/806941046 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27080043e0 con 0x7f270c06cb70 2024-09-15T23:59:35.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f271397b640 1 -- 172.21.15.112:0/806941046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f270c0b9d80 con 0x7f270c06cb70 2024-09-15T23:59:35.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2701ffb640 1 -- 172.21.15.112:0/806941046 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27080b0040 con 0x7f270c06cb70 2024-09-15T23:59:35.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f271397b640 1 -- 172.21.15.112:0/806941046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f270c1596e0 con 0x7f270c06cb70 2024-09-15T23:59:35.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f271397b640 1 -- 172.21.15.112:0/806941046 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f270c0b1e80 con 0x7f270c06cb70 2024-09-15T23:59:35.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2701ffb640 1 -- 172.21.15.112:0/806941046 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f27080bc070 con 0x7f270c06cb70 2024-09-15T23:59:35.257 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2701ffb640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26f00678f0 0x7f26f0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2701ffb640 1 -- 172.21.15.112:0/806941046 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f270811fff0 con 0x7f270c06cb70 2024-09-15T23:59:35.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2710f16640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26f00678f0 0x7f26f0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2701ffb640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x7f26f006dd90 0x7f26f00701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2701ffb640 1 -- 172.21.15.112:0/806941046 --> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27080b6e50 con 0x7f26f006dd90 2024-09-15T23:59:35.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2701ffb640 1 -- 172.21.15.112:0/806941046 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f2708120460 con 0x7f270c06cb70 2024-09-15T23:59:35.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2711f18640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x7f26f006dd90 0x7f26f00701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2710f16640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26f00678f0 0x7f26f0069db0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f270c0d47c0 tx=0x7f26fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:35.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2711f18640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x7f26f006dd90 0x7f26f00701d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:35.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.252+0000 7f2701ffb640 1 -- 172.21.15.112:0/806941046 <== osd.2 v2:172.21.15.112:6816/4134332386 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f27080b6e50 con 0x7f26f006dd90 2024-09-15T23:59:35.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.268+0000 7f271397b640 1 -- 172.21.15.112:0/806941046 --> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f270c0ba280 con 0x7f26f006dd90 2024-09-15T23:59:35.267 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.268+0000 7f2701ffb640 1 -- 172.21.15.112:0/806941046 <== osd.2 v2:172.21.15.112:6816/4134332386 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f270c0ba280 con 0x7f26f006dd90 2024-09-15T23:59:35.267 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:59:35.267 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:59:35.268 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:59:35.268 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.268+0000 7f271397b640 1 -- 172.21.15.112:0/806941046 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x7f26f006dd90 msgr2=0x7f26f00701d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.268+0000 7f271397b640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.112:6816/4134332386,v1:172.21.15.112:6817/4134332386] conn(0x7f26f006dd90 0x7f26f00701d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.268+0000 7f271397b640 1 -- 172.21.15.112:0/806941046 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26f00678f0 msgr2=0x7f26f0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.268+0000 7f271397b640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f26f00678f0 0x7f26f0069db0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f270c0d47c0 tx=0x7f26fc008040 comp rx=0 tx=0).stop 2024-09-15T23:59:35.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.268+0000 7f271397b640 1 -- 172.21.15.112:0/806941046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f270c06cb70 msgr2=0x7f270c15a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.268+0000 7f271397b640 1 --2- 172.21.15.112:0/806941046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f270c06cb70 0x7f270c15a4a0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f2708019070 tx=0x7f2708019200 comp rx=0 tx=0).stop 2024-09-15T23:59:35.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.268+0000 7f2711f18640 1 -- 172.21.15.112:0/806941046 reap_dead start 2024-09-15T23:59:35.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.268+0000 7f271397b640 1 -- 172.21.15.112:0/806941046 shutdown_connections 2024-09-15T23:59:35.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.268+0000 7f271397b640 1 -- 172.21.15.112:0/806941046 >> 172.21.15.112:0/806941046 conn(0x7f270c08bf90 msgr2=0x7f270c0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:35.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.268+0000 7f271397b640 1 -- 172.21.15.112:0/806941046 shutdown_connections 2024-09-15T23:59:35.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.268+0000 7f271397b640 1 -- 172.21.15.112:0/806941046 wait complete. 2024-09-15T23:59:35.282 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-15T23:59:35.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f8e06640 1 Processor -- start 2024-09-15T23:59:35.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f8e06640 1 -- start start 2024-09-15T23:59:35.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f8e06640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28f4160520 0x7f28f4071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f8e06640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f28f4160900 0x7f28f4071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f8e06640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f28f415c5f0 0x7f28f415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f8e06640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f28f40d1640 con 0x7f28f415c5f0 2024-09-15T23:59:35.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f8e06640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f28f40d0d70 con 0x7f28f4160900 2024-09-15T23:59:35.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f8e06640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f28f415d390 con 0x7f28f4160520 2024-09-15T23:59:35.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f2d9d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f28f415c5f0 0x7f28f415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f2d9d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f28f415c5f0 0x7f28f415ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38556/0 (socket says 172.21.15.112:38556) 2024-09-15T23:59:35.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f2d9d640 1 -- 172.21.15.112:0/1067325425 learned_addr learned my addr 172.21.15.112:0/1067325425 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:35.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f1d9b640 1 --2- 172.21.15.112:0/1067325425 >> v2:172.21.15.169:3300/0 conn(0x7f28f4160900 0x7f28f4071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f259c640 1 --2- 172.21.15.112:0/1067325425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28f4160520 0x7f28f4071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.398 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f2d9d640 1 -- 172.21.15.112:0/1067325425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28f4160520 msgr2=0x7f28f4071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:35.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f2d9d640 1 --2- 172.21.15.112:0/1067325425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28f4160520 0x7f28f4071750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f2d9d640 1 -- 172.21.15.112:0/1067325425 >> v2:172.21.15.169:3300/0 conn(0x7f28f4160900 msgr2=0x7f28f4071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:35.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f2d9d640 1 --2- 172.21.15.112:0/1067325425 >> v2:172.21.15.169:3300/0 conn(0x7f28f4160900 0x7f28f4071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f2d9d640 1 -- 172.21.15.112:0/1067325425 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f40d0ff0 con 0x7f28f415c5f0 2024-09-15T23:59:35.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.396+0000 7f28f259c640 1 --2- 172.21.15.112:0/1067325425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28f4160520 0x7f28f4071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:35.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f2d9d640 1 --2- 172.21.15.112:0/1067325425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f415c5f0 0x7f28f415ca60 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f28f4072b00 tx=0x7f28e401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee25dcd436fa73c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:35.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f159a640 1 -- 172.21.15.112:0/1067325425 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e40a56f0 con 0x7f28f415c5f0 2024-09-15T23:59:35.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f159a640 1 -- 172.21.15.112:0/1067325425 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e40a5890 con 0x7f28f415c5f0 2024-09-15T23:59:35.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f159a640 1 -- 172.21.15.112:0/1067325425 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e40a5c60 con 0x7f28f415c5f0 2024-09-15T23:59:35.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 -- 172.21.15.112:0/1067325425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f415c5f0 msgr2=0x7f28f415ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 --2- 172.21.15.112:0/1067325425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f415c5f0 0x7f28f415ca60 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f28f4072b00 tx=0x7f28e401c960 comp rx=0 tx=0).stop 2024-09-15T23:59:35.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 -- 172.21.15.112:0/1067325425 shutdown_connections 2024-09-15T23:59:35.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 --2- 172.21.15.112:0/1067325425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f415c5f0 0x7f28f415ca60 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 --2- 172.21.15.112:0/1067325425 >> v2:172.21.15.169:3300/0 conn(0x7f28f4160900 0x7f28f4071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 --2- 172.21.15.112:0/1067325425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28f4160520 0x7f28f4071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 -- 172.21.15.112:0/1067325425 >> 172.21.15.112:0/1067325425 conn(0x7f28f406c0c0 msgr2=0x7f28f406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:35.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 -- 172.21.15.112:0/1067325425 shutdown_connections 2024-09-15T23:59:35.402 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 -- 172.21.15.112:0/1067325425 wait complete. 2024-09-15T23:59:35.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 Processor -- start 2024-09-15T23:59:35.405 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 -- start start 2024-09-15T23:59:35.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28f415c5f0 0x7f28f406ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28f4160520 0x7f28f40b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f4160900 0x7f28f41375c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.406 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f28f40d2440 con 0x7f28f4160900 2024-09-15T23:59:35.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f28f40d22c0 con 0x7f28f4160520 2024-09-15T23:59:35.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f8e06640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f28f40d25c0 con 0x7f28f415c5f0 2024-09-15T23:59:35.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f4160900 0x7f28f41375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f4160900 0x7f28f41375c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38558/0 (socket says 172.21.15.112:38558) 2024-09-15T23:59:35.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f2d9d640 1 -- 172.21.15.112:0/367317044 learned_addr learned my addr 172.21.15.112:0/367317044 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:35.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f259c640 1 --2- 172.21.15.112:0/367317044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28f415c5f0 0x7f28f406ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f2d9d640 1 -- 172.21.15.112:0/367317044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28f415c5f0 msgr2=0x7f28f406ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f2d9d640 1 --2- 172.21.15.112:0/367317044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28f415c5f0 0x7f28f406ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.408 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f2d9d640 1 -- 172.21.15.112:0/367317044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28f4160520 msgr2=0x7f28f40b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f2d9d640 1 --2- 172.21.15.112:0/367317044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28f4160520 0x7f28f40b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.400+0000 7f28f2d9d640 1 -- 172.21.15.112:0/367317044 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f413c9c0 con 0x7f28f4160900 2024-09-15T23:59:35.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.404+0000 7f28f2d9d640 1 --2- 172.21.15.112:0/367317044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f4160900 0x7f28f41375c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f28e401d200 tx=0x7f28e4019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:35.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.404+0000 7f28eaffd640 1 -- 172.21.15.112:0/367317044 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e40bc020 con 0x7f28f4160900 2024-09-15T23:59:35.409 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.404+0000 7f28eaffd640 1 -- 172.21.15.112:0/367317044 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e40b8670 con 0x7f28f4160900 2024-09-15T23:59:35.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.404+0000 7f28f8e06640 1 -- 172.21.15.112:0/367317044 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f413c6e0 con 0x7f28f4160900 2024-09-15T23:59:35.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.404+0000 7f28eaffd640 1 -- 172.21.15.112:0/367317044 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e40b8a40 con 0x7f28f4160900 2024-09-15T23:59:35.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.404+0000 7f28f8e06640 1 -- 172.21.15.112:0/367317044 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f41654a0 con 0x7f28f4160900 2024-09-15T23:59:35.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.404+0000 7f28f8e06640 1 -- 172.21.15.112:0/367317044 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f415ca60 con 0x7f28f4160900 2024-09-15T23:59:35.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.404+0000 7f28eaffd640 1 -- 172.21.15.112:0/367317044 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f28e40bf020 con 0x7f28f4160900 2024-09-15T23:59:35.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.404+0000 7f28eaffd640 1 --2- 172.21.15.112:0/367317044 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f28d40678f0 0x7f28d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.410 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.404+0000 7f28eaffd640 1 -- 172.21.15.112:0/367317044 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f28e4120a10 con 0x7f28f4160900 2024-09-15T23:59:35.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.404+0000 7f28f259c640 1 --2- 172.21.15.112:0/367317044 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f28d40678f0 0x7f28d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.404+0000 7f28f259c640 1 --2- 172.21.15.112:0/367317044 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f28d40678f0 0x7f28d4069db0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00a9a0 tx=0x7f28ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:35.411 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.408+0000 7f28eaffd640 1 -- 172.21.15.112:0/367317044 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f28e40c6030 con 0x7f28f4160900 2024-09-15T23:59:35.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.568+0000 7f28f8e06640 1 -- 172.21.15.112:0/367317044 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f28f41670a0 con 0x7f28d40678f0 2024-09-15T23:59:35.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.568+0000 7f28eaffd640 1 -- 172.21.15.112:0/367317044 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f28f41670a0 con 0x7f28d40678f0 2024-09-15T23:59:35.569 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 2 to deep-scrub 2024-09-15T23:59:35.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.572+0000 7f28f8e06640 1 -- 172.21.15.112:0/367317044 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f28d40678f0 msgr2=0x7f28d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.572+0000 7f28f8e06640 1 --2- 172.21.15.112:0/367317044 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f28d40678f0 0x7f28d4069db0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00a9a0 tx=0x7f28ec008040 comp rx=0 tx=0).stop 2024-09-15T23:59:35.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.572+0000 7f28f8e06640 1 -- 172.21.15.112:0/367317044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f4160900 msgr2=0x7f28f41375c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.572+0000 7f28f8e06640 1 --2- 172.21.15.112:0/367317044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f4160900 0x7f28f41375c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f28e401d200 tx=0x7f28e4019700 comp rx=0 tx=0).stop 2024-09-15T23:59:35.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.572+0000 7f28f8e06640 1 -- 172.21.15.112:0/367317044 shutdown_connections 2024-09-15T23:59:35.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.572+0000 7f28f8e06640 1 --2- 172.21.15.112:0/367317044 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f28d40678f0 0x7f28d4069db0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.572 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.572+0000 7f28f8e06640 1 --2- 172.21.15.112:0/367317044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28f4160900 0x7f28f41375c0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.572+0000 7f28f8e06640 1 --2- 172.21.15.112:0/367317044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f28f4160520 0x7f28f40b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.572+0000 7f28f8e06640 1 --2- 172.21.15.112:0/367317044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f28f415c5f0 0x7f28f406ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.572+0000 7f28f8e06640 1 -- 172.21.15.112:0/367317044 >> 172.21.15.112:0/367317044 conn(0x7f28f406c0c0 msgr2=0x7f28f415ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:35.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.572+0000 7f28f8e06640 1 -- 172.21.15.112:0/367317044 shutdown_connections 2024-09-15T23:59:35.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.572+0000 7f28f8e06640 1 -- 172.21.15.112:0/367317044 wait complete. 2024-09-15T23:59:35.588 INFO:tasks.ceph:Scrubbing osd.3 2024-09-15T23:59:35.588 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:59:35.707 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b722d1640 1 Processor -- start 2024-09-15T23:59:35.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b722d1640 1 -- start start 2024-09-15T23:59:35.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b722d1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b6c15bec0 0x7f2b6c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b722d1640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2b6c0af470 0x7f2b6c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b722d1640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b6c0b3290 con 0x7f2b6c15c2a0 2024-09-15T23:59:35.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b722d1640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f2b6c0b3570 con 0x7f2b6c0af470 2024-09-15T23:59:35.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b722d1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6c0b3850 con 0x7f2b6c15bec0 2024-09-15T23:59:35.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b6bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b6c15bec0 0x7f2b6c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b7086e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2b6c0af470 0x7f2b6c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b6b7fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f2b6c15c2a0 0x7f2b6c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.112:48510/0 (socket says 172.21.15.112:48510) 2024-09-15T23:59:35.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b7086e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2b6c0af470 0x7f2b6c06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.112:42140/0 (socket says 172.21.15.112:42140) 2024-09-15T23:59:35.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b6b7fe640 1 -- 172.21.15.112:0/1966122457 learned_addr learned my addr 172.21.15.112:0/1966122457 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:35.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b6bfff640 1 -- 172.21.15.112:0/1966122457 >> v2:172.21.15.169:3300/0 conn(0x7f2b6c0af470 msgr2=0x7f2b6c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:35.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b6bfff640 1 --2- 172.21.15.112:0/1966122457 >> v2:172.21.15.169:3300/0 conn(0x7f2b6c0af470 0x7f2b6c06e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b6bfff640 1 -- 172.21.15.112:0/1966122457 >> v1:172.21.15.169:6789/0 conn(0x7f2b6c15c2a0 legacy=0x7f2b6c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b6bfff640 1 -- 172.21.15.112:0/1966122457 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6c0b3b30 con 0x7f2b6c15bec0 2024-09-15T23:59:35.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.708+0000 7f2b7086e640 1 --2- 172.21.15.112:0/1966122457 >> v2:172.21.15.169:3300/0 conn(0x7f2b6c0af470 0x7f2b6c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:59:35.711 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.712+0000 7f2b6bfff640 1 --2- 172.21.15.112:0/1966122457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b6c15bec0 0x7f2b6c0ad200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0097c0 tx=0x7f2b5c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f833b8ba367ea624 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:35.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.712+0000 7f2b6affd640 1 -- 172.21.15.112:0/1966122457 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c0a7070 con 0x7f2b6c15bec0 2024-09-15T23:59:35.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.712+0000 7f2b6affd640 1 -- 172.21.15.112:0/1966122457 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b5c0b0070 con 0x7f2b6c15bec0 2024-09-15T23:59:35.712 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.712+0000 7f2b6affd640 1 -- 172.21.15.112:0/1966122457 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c0ab890 con 0x7f2b6c15bec0 2024-09-15T23:59:35.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.712+0000 7f2b722d1640 1 -- 172.21.15.112:0/1966122457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b6c15bec0 msgr2=0x7f2b6c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.712+0000 7f2b722d1640 1 --2- 172.21.15.112:0/1966122457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b6c15bec0 0x7f2b6c0ad200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0097c0 tx=0x7f2b5c01c470 comp rx=0 tx=0).stop 2024-09-15T23:59:35.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.712+0000 7f2b722d1640 1 -- 172.21.15.112:0/1966122457 shutdown_connections 2024-09-15T23:59:35.713 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.712+0000 7f2b722d1640 1 --2- 172.21.15.112:0/1966122457 >> v2:172.21.15.169:3300/0 conn(0x7f2b6c0af470 0x7f2b6c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.712+0000 7f2b722d1640 1 --2- 172.21.15.112:0/1966122457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b6c15bec0 0x7f2b6c0ad200 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.712+0000 7f2b722d1640 1 -- 172.21.15.112:0/1966122457 >> 172.21.15.112:0/1966122457 conn(0x7f2b6c0b1f90 msgr2=0x7f2b6c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:35.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.712+0000 7f2b722d1640 1 -- 172.21.15.112:0/1966122457 shutdown_connections 2024-09-15T23:59:35.714 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.712+0000 7f2b722d1640 1 -- 172.21.15.112:0/1966122457 wait complete. 2024-09-15T23:59:35.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.712+0000 7f2b722d1640 1 Processor -- start 2024-09-15T23:59:35.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.712+0000 7f2b722d1640 1 -- start start 2024-09-15T23:59:35.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b722d1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b6c0af470 0x7f2b6c156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b722d1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b6c15bec0 0x7f2b6c09dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.716 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b722d1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b6c15c2a0 0x7f2b6c099810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b722d1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6c06ed50 con 0x7f2b6c15bec0 2024-09-15T23:59:35.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b722d1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6c0ad740 con 0x7f2b6c15c2a0 2024-09-15T23:59:35.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b722d1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6c06eed0 con 0x7f2b6c0af470 2024-09-15T23:59:35.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b6b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b6c15bec0 0x7f2b6c09dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b6b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b6c15bec0 0x7f2b6c09dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38560/0 (socket says 172.21.15.112:38560) 2024-09-15T23:59:35.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b6b7fe640 1 -- 172.21.15.112:0/659574067 learned_addr learned my addr 172.21.15.112:0/659574067 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:35.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b6bfff640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b6c0af470 0x7f2b6c156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b7086e640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b6c15c2a0 0x7f2b6c099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b6b7fe640 1 -- 172.21.15.112:0/659574067 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b6c0af470 msgr2=0x7f2b6c156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b6b7fe640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2b6c0af470 0x7f2b6c156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b6b7fe640 1 -- 172.21.15.112:0/659574067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b6c15c2a0 msgr2=0x7f2b6c099810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b6b7fe640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b6c15c2a0 0x7f2b6c099810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b6b7fe640 1 -- 172.21.15.112:0/659574067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6c09e1c0 con 0x7f2b6c15bec0 2024-09-15T23:59:35.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b7086e640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b6c15c2a0 0x7f2b6c099810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:35.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b6b7fe640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b6c15bec0 0x7f2b6c09dc80 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000c310 tx=0x7f2b6000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:35.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b68ff9640 1 -- 172.21.15.112:0/659574067 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60017070 con 0x7f2b6c15bec0 2024-09-15T23:59:35.719 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b68ff9640 1 -- 172.21.15.112:0/659574067 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b60005cf0 con 0x7f2b6c15bec0 2024-09-15T23:59:35.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b722d1640 1 -- 172.21.15.112:0/659574067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b6c156730 con 0x7f2b6c15bec0 2024-09-15T23:59:35.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b68ff9640 1 -- 172.21.15.112:0/659574067 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60007310 con 0x7f2b6c15bec0 2024-09-15T23:59:35.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b722d1640 1 -- 172.21.15.112:0/659574067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b6c09a420 con 0x7f2b6c15bec0 2024-09-15T23:59:35.720 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b722d1640 1 -- 172.21.15.112:0/659574067 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2b6c068e50 con 0x7f2b6c15bec0 2024-09-15T23:59:35.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b68ff9640 1 -- 172.21.15.112:0/659574067 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2b6001a070 con 0x7f2b6c15bec0 2024-09-15T23:59:35.721 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b68ff9640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2b580678c0 0x7f2b58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b68ff9640 1 -- 172.21.15.112:0/659574067 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f2b60085500 con 0x7f2b6c15bec0 2024-09-15T23:59:35.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b6bfff640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2b580678c0 0x7f2b58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b68ff9640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.112:6824/79312720,v1:172.21.15.112:6825/79312720] conn(0x7f2b5806dd60 0x7f2b580701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b68ff9640 1 -- 172.21.15.112:0/659574067 --> [v2:172.21.15.112:6824/79312720,v1:172.21.15.112:6825/79312720] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b58070870 con 0x7f2b5806dd60 2024-09-15T23:59:35.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b68ff9640 1 -- 172.21.15.112:0/659574067 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f2b60085990 con 0x7f2b6c15bec0 2024-09-15T23:59:35.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b7086e640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.112:6824/79312720,v1:172.21.15.112:6825/79312720] conn(0x7f2b5806dd60 0x7f2b580701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b6bfff640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2b580678c0 0x7f2b58069d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0af000 tx=0x7f2b5c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:35.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.716+0000 7f2b7086e640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.112:6824/79312720,v1:172.21.15.112:6825/79312720] conn(0x7f2b5806dd60 0x7f2b580701a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:35.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.720+0000 7f2b68ff9640 1 -- 172.21.15.112:0/659574067 <== osd.3 v2:172.21.15.112:6824/79312720 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2b58070870 con 0x7f2b5806dd60 2024-09-15T23:59:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.732+0000 7f2b722d1640 1 -- 172.21.15.112:0/659574067 --> [v2:172.21.15.112:6824/79312720,v1:172.21.15.112:6825/79312720] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2b6c06f270 con 0x7f2b5806dd60 2024-09-15T23:59:35.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.732+0000 7f2b68ff9640 1 -- 172.21.15.112:0/659574067 <== osd.3 v2:172.21.15.112:6824/79312720 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2b6c06f270 con 0x7f2b5806dd60 2024-09-15T23:59:35.733 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:59:35.733 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:59:35.733 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:59:35.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.732+0000 7f2b722d1640 1 -- 172.21.15.112:0/659574067 >> [v2:172.21.15.112:6824/79312720,v1:172.21.15.112:6825/79312720] conn(0x7f2b5806dd60 msgr2=0x7f2b580701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.732+0000 7f2b722d1640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.112:6824/79312720,v1:172.21.15.112:6825/79312720] conn(0x7f2b5806dd60 0x7f2b580701a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.732+0000 7f2b722d1640 1 -- 172.21.15.112:0/659574067 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2b580678c0 msgr2=0x7f2b58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.732+0000 7f2b722d1640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2b580678c0 0x7f2b58069d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0af000 tx=0x7f2b5c0a7000 comp rx=0 tx=0).stop 2024-09-15T23:59:35.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.732+0000 7f2b722d1640 1 -- 172.21.15.112:0/659574067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b6c15bec0 msgr2=0x7f2b6c09dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.732+0000 7f2b722d1640 1 --2- 172.21.15.112:0/659574067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b6c15bec0 0x7f2b6c09dc80 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000c310 tx=0x7f2b6000c7d0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.732+0000 7f2b7086e640 1 -- 172.21.15.112:0/659574067 reap_dead start 2024-09-15T23:59:35.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.732+0000 7f2b722d1640 1 -- 172.21.15.112:0/659574067 shutdown_connections 2024-09-15T23:59:35.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.732+0000 7f2b722d1640 1 -- 172.21.15.112:0/659574067 >> 172.21.15.112:0/659574067 conn(0x7f2b6c0b1f90 msgr2=0x7f2b6c153460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:35.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.732+0000 7f2b722d1640 1 -- 172.21.15.112:0/659574067 shutdown_connections 2024-09-15T23:59:35.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.732+0000 7f2b722d1640 1 -- 172.21.15.112:0/659574067 wait complete. 2024-09-15T23:59:35.749 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-15T23:59:35.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50c570c640 1 Processor -- start 2024-09-15T23:59:35.856 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50c570c640 1 -- start start 2024-09-15T23:59:35.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50c570c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c015bec0 0x7f50c00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50c570c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f50c015c2a0 0x7f50c00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.857 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50c570c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c00b3290 con 0x7f50c00af2a0 2024-09-15T23:59:35.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50c570c640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f50c00b3570 con 0x7f50c015c2a0 2024-09-15T23:59:35.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50c570c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f50c00b3850 con 0x7f50c015bec0 2024-09-15T23:59:35.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50be7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f50c015c2a0 0x7f50c00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50be7fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f50c015c2a0 0x7f50c00aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38572/0 (socket says 172.21.15.112:38572) 2024-09-15T23:59:35.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50be7fc640 1 -- 172.21.15.112:0/3290897354 learned_addr learned my addr 172.21.15.112:0/3290897354 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:35.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50beffd640 1 --2- 172.21.15.112:0/3290897354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c015bec0 0x7f50c00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50be7fc640 1 -- 172.21.15.112:0/3290897354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c015bec0 msgr2=0x7f50c00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:35.858 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50be7fc640 1 --2- 172.21.15.112:0/3290897354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c015bec0 0x7f50c00ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50be7fc640 1 -- 172.21.15.112:0/3290897354 >> v1:172.21.15.169:6789/0 conn(0x7f50c00af2a0 legacy=0x7f50c015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:35.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.856+0000 7f50be7fc640 1 -- 172.21.15.112:0/3290897354 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c00b3b30 con 0x7f50c015c2a0 2024-09-15T23:59:35.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50be7fc640 1 --2- 172.21.15.112:0/3290897354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c015c2a0 0x7f50c00aed60 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f50a8009870 tx=0x7f50a801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f5b5b2ff01ca01 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:35.859 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50bdffb640 1 -- 172.21.15.112:0/3290897354 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a80aa610 con 0x7f50c015c2a0 2024-09-15T23:59:35.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50bdffb640 1 -- 172.21.15.112:0/3290897354 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50a80af070 con 0x7f50c015c2a0 2024-09-15T23:59:35.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50bdffb640 1 -- 172.21.15.112:0/3290897354 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a80aa9d0 con 0x7f50c015c2a0 2024-09-15T23:59:35.860 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 -- 172.21.15.112:0/3290897354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c015c2a0 msgr2=0x7f50c00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 --2- 172.21.15.112:0/3290897354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c015c2a0 0x7f50c00aed60 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f50a8009870 tx=0x7f50a801c4f0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 -- 172.21.15.112:0/3290897354 shutdown_connections 2024-09-15T23:59:35.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 --2- 172.21.15.112:0/3290897354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c015c2a0 0x7f50c00aed60 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 --2- 172.21.15.112:0/3290897354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c015bec0 0x7f50c00ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 -- 172.21.15.112:0/3290897354 >> 172.21.15.112:0/3290897354 conn(0x7f50c00b1f90 msgr2=0x7f50c00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:35.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 -- 172.21.15.112:0/3290897354 shutdown_connections 2024-09-15T23:59:35.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 -- 172.21.15.112:0/3290897354 wait complete. 2024-09-15T23:59:35.863 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 Processor -- start 2024-09-15T23:59:35.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 -- start start 2024-09-15T23:59:35.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c00af2a0 0x7f50c0072320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c015bec0 0x7f50c0150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c015c2a0 0x7f50c0148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f50c00ad740 con 0x7f50c015c2a0 2024-09-15T23:59:35.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f50c00afc90 con 0x7f50c00af2a0 2024-09-15T23:59:35.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50c570c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f50c0169000 con 0x7f50c015bec0 2024-09-15T23:59:35.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50bf7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c015c2a0 0x7f50c0148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50bf7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c015c2a0 0x7f50c0148000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38578/0 (socket says 172.21.15.112:38578) 2024-09-15T23:59:35.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50bf7fe640 1 -- 172.21.15.112:0/457706846 learned_addr learned my addr 172.21.15.112:0/457706846 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:35.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.860+0000 7f50beffd640 1 --2- 172.21.15.112:0/457706846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c00af2a0 0x7f50c0072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50be7fc640 1 --2- 172.21.15.112:0/457706846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c015bec0 0x7f50c0150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50bf7fe640 1 -- 172.21.15.112:0/457706846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c015bec0 msgr2=0x7f50c0150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50bf7fe640 1 --2- 172.21.15.112:0/457706846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c015bec0 0x7f50c0150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50bf7fe640 1 -- 172.21.15.112:0/457706846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c00af2a0 msgr2=0x7f50c0072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:35.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50bf7fe640 1 --2- 172.21.15.112:0/457706846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c00af2a0 0x7f50c0072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50bf7fe640 1 -- 172.21.15.112:0/457706846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c0150750 con 0x7f50c015c2a0 2024-09-15T23:59:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50bf7fe640 1 --2- 172.21.15.112:0/457706846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c015c2a0 0x7f50c0148000 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f50b800c3f0 tx=0x7f50b800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50b77fe640 1 -- 172.21.15.112:0/457706846 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8011790 con 0x7f50c015c2a0 2024-09-15T23:59:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50b77fe640 1 -- 172.21.15.112:0/457706846 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b8017070 con 0x7f50c015c2a0 2024-09-15T23:59:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50c570c640 1 -- 172.21.15.112:0/457706846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c0150a50 con 0x7f50c015c2a0 2024-09-15T23:59:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50b77fe640 1 -- 172.21.15.112:0/457706846 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8011b70 con 0x7f50c015c2a0 2024-09-15T23:59:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50c570c640 1 -- 172.21.15.112:0/457706846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c0151290 con 0x7f50c015c2a0 2024-09-15T23:59:35.866 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50c570c640 1 -- 172.21.15.112:0/457706846 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c00ad200 con 0x7f50c015c2a0 2024-09-15T23:59:35.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50b77fe640 1 -- 172.21.15.112:0/457706846 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f50b8011d10 con 0x7f50c015c2a0 2024-09-15T23:59:35.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50b77fe640 1 --2- 172.21.15.112:0/457706846 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50a00678c0 0x7f50a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:35.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50b77fe640 1 -- 172.21.15.112:0/457706846 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f50b80858c0 con 0x7f50c015c2a0 2024-09-15T23:59:35.867 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50beffd640 1 --2- 172.21.15.112:0/457706846 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50a00678c0 0x7f50a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:35.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.864+0000 7f50beffd640 1 --2- 172.21.15.112:0/457706846 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50a00678c0 0x7f50a0069d80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f50c00b1f60 tx=0x7f50b00079a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:35.868 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:35.868+0000 7f50b77fe640 1 -- 172.21.15.112:0/457706846 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f50c0150a50 con 0x7f50c015c2a0 2024-09-15T23:59:36.020 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.020+0000 7f50c570c640 1 -- 172.21.15.112:0/457706846 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f50c00afff0 con 0x7f50a00678c0 2024-09-15T23:59:36.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.020+0000 7f50b77fe640 1 -- 172.21.15.112:0/457706846 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f50b0013070 con 0x7f50a00678c0 2024-09-15T23:59:36.022 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 3 to deep-scrub 2024-09-15T23:59:36.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.024+0000 7f50c570c640 1 -- 172.21.15.112:0/457706846 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50a00678c0 msgr2=0x7f50a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.024 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.024+0000 7f50c570c640 1 --2- 172.21.15.112:0/457706846 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50a00678c0 0x7f50a0069d80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f50c00b1f60 tx=0x7f50b00079a0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.024+0000 7f50c570c640 1 -- 172.21.15.112:0/457706846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c015c2a0 msgr2=0x7f50c0148000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.024+0000 7f50c570c640 1 --2- 172.21.15.112:0/457706846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c015c2a0 0x7f50c0148000 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f50b800c3f0 tx=0x7f50b800c8b0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.025 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.024+0000 7f50c570c640 1 -- 172.21.15.112:0/457706846 shutdown_connections 2024-09-15T23:59:36.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.024+0000 7f50c570c640 1 --2- 172.21.15.112:0/457706846 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f50a00678c0 0x7f50a0069d80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.024+0000 7f50c570c640 1 --2- 172.21.15.112:0/457706846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50c015c2a0 0x7f50c0148000 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.024+0000 7f50c570c640 1 --2- 172.21.15.112:0/457706846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50c015bec0 0x7f50c0150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.026 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.024+0000 7f50c570c640 1 --2- 172.21.15.112:0/457706846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50c00af2a0 0x7f50c0072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.024+0000 7f50c570c640 1 -- 172.21.15.112:0/457706846 >> 172.21.15.112:0/457706846 conn(0x7f50c00b1f90 msgr2=0x7f50c01544c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:36.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.024+0000 7f50c570c640 1 -- 172.21.15.112:0/457706846 shutdown_connections 2024-09-15T23:59:36.027 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.024+0000 7f50c570c640 1 -- 172.21.15.112:0/457706846 wait complete. 2024-09-15T23:59:36.039 INFO:tasks.ceph:Scrubbing osd.4 2024-09-15T23:59:36.040 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:59:36.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.152+0000 7f8911a95640 1 Processor -- start 2024-09-15T23:59:36.153 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.152+0000 7f8911a95640 1 -- start start 2024-09-15T23:59:36.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.152+0000 7f8911a95640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f890c073e60 0x7f890c06e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.152+0000 7f8911a95640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f890c0b3d50 0x7f890c0b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.152+0000 7f8911a95640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f890c0b4670 con 0x7f890c06fef0 2024-09-15T23:59:36.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.152+0000 7f8911a95640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f890c06ee50 con 0x7f890c073e60 2024-09-15T23:59:36.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.152+0000 7f8911a95640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f890c06f130 con 0x7f890c0b3d50 2024-09-15T23:59:36.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.152+0000 7f8903fff640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f890c06fef0 0x7f890c15b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51060/0 (socket says 172.21.15.112:51060) 2024-09-15T23:59:36.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.152+0000 7f8903fff640 1 -- 172.21.15.112:0/426462212 learned_addr learned my addr 172.21.15.112:0/426462212 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:36.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.152+0000 7f890b7fe640 1 --2- 172.21.15.112:0/426462212 >> v2:172.21.15.169:3300/0 conn(0x7f890c073e60 0x7f890c06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.152+0000 7f890affd640 1 -- 172.21.15.112:0/426462212 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399753906 0 0) 0x7f890c0b4670 con 0x7f890c06fef0 2024-09-15T23:59:36.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.152+0000 7f890affd640 1 -- 172.21.15.112:0/426462212 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88f8003530 con 0x7f890c06fef0 2024-09-15T23:59:36.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 -- 172.21.15.112:0/426462212 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 119056722 0 0) 0x7f88f8003530 con 0x7f890c06fef0 2024-09-15T23:59:36.157 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 -- 172.21.15.112:0/426462212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f890c0b3d50 msgr2=0x7f890c0b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:36.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 --2- 172.21.15.112:0/426462212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f890c0b3d50 0x7f890c0b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 -- 172.21.15.112:0/426462212 >> v2:172.21.15.169:3300/0 conn(0x7f890c073e60 msgr2=0x7f890c06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:36.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 --2- 172.21.15.112:0/426462212 >> v2:172.21.15.169:3300/0 conn(0x7f890c073e60 0x7f890c06e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 -- 172.21.15.112:0/426462212 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890c06f410 con 0x7f890c06fef0 2024-09-15T23:59:36.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 -- 172.21.15.112:0/426462212 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f88f4001680 con 0x7f890c06fef0 2024-09-15T23:59:36.158 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 -- 172.21.15.112:0/426462212 >> v1:172.21.15.112:6789/0 conn(0x7f890c06fef0 legacy=0x7f890c15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 --2- 172.21.15.112:0/426462212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88f80039f0 0x7f88f8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 --2- 172.21.15.112:0/426462212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88f8004810 0x7f88f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 --2- 172.21.15.112:0/426462212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f890c0b3d50 0x7f88f8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 -- 172.21.15.112:0/426462212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f890c06ee50 con 0x7f88f8004810 2024-09-15T23:59:36.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 -- 172.21.15.112:0/426462212 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f890c06f130 con 0x7f88f80039f0 2024-09-15T23:59:36.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 -- 172.21.15.112:0/426462212 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f88f800bbb0 con 0x7f890c0b3d50 2024-09-15T23:59:36.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f8903fff640 1 --2- 172.21.15.112:0/426462212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88f8004810 0x7f88f8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f8903fff640 1 -- 172.21.15.112:0/426462212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f890c0b3d50 msgr2=0x7f88f8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:36.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f8903fff640 1 --2- 172.21.15.112:0/426462212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f890c0b3d50 0x7f88f8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f8903fff640 1 -- 172.21.15.112:0/426462212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88f80039f0 msgr2=0x7f88f8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:36.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f8903fff640 1 --2- 172.21.15.112:0/426462212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88f80039f0 0x7f88f8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f8903fff640 1 -- 172.21.15.112:0/426462212 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f8003530 con 0x7f88f8004810 2024-09-15T23:59:36.166 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f8903fff640 1 --2- 172.21.15.112:0/426462212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88f8004810 0x7f88f8004c90 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f88f400c210 tx=0x7f88f401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2834ed5834c14ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:36.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 -- 172.21.15.112:0/426462212 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f4007d20 con 0x7f88f8004810 2024-09-15T23:59:36.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 -- 172.21.15.112:0/426462212 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f40a9070 con 0x7f88f8004810 2024-09-15T23:59:36.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890affd640 1 -- 172.21.15.112:0/426462212 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f4005d20 con 0x7f88f8004810 2024-09-15T23:59:36.167 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f8911a95640 1 -- 172.21.15.112:0/426462212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88f8004810 msgr2=0x7f88f8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f8911a95640 1 --2- 172.21.15.112:0/426462212 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88f8004810 0x7f88f8004c90 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f88f400c210 tx=0x7f88f401cc60 comp rx=0 tx=0).stop 2024-09-15T23:59:36.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f890bfff640 1 -- 172.21.15.112:0/426462212 reap_dead start 2024-09-15T23:59:36.168 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f8911a95640 1 -- 172.21.15.112:0/426462212 shutdown_connections 2024-09-15T23:59:36.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f8911a95640 1 -- 172.21.15.112:0/426462212 >> 172.21.15.112:0/426462212 conn(0x7f890c0b1f90 msgr2=0x7f890c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:36.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f8911a95640 1 -- 172.21.15.112:0/426462212 shutdown_connections 2024-09-15T23:59:36.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.156+0000 7f8911a95640 1 -- 172.21.15.112:0/426462212 wait complete. 2024-09-15T23:59:36.169 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8911a95640 1 Processor -- start 2024-09-15T23:59:36.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8911a95640 1 -- start start 2024-09-15T23:59:36.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8911a95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88f8004810 0x7f890c1fb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8911a95640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f890c150790 0x7f890c137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8911a95640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f890c1fabe0 0x7f890c1fb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8911a95640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f890c0729a0 con 0x7f88f8004810 2024-09-15T23:59:36.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8911a95640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f890c072820 con 0x7f890c150790 2024-09-15T23:59:36.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8911a95640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f890c072b20 con 0x7f890c1fabe0 2024-09-15T23:59:36.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f890b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88f8004810 0x7f890c1fb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f890b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88f8004810 0x7f890c1fb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38592/0 (socket says 172.21.15.112:38592) 2024-09-15T23:59:36.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f890b7fe640 1 -- 172.21.15.112:0/3368617237 learned_addr learned my addr 172.21.15.112:0/3368617237 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:36.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8903fff640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f890c150790 0x7f890c137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.172 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f890b7fe640 1 -- 172.21.15.112:0/3368617237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f890c1fabe0 msgr2=0x7f890c1fb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f890bfff640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f890c1fabe0 0x7f890c1fb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f890b7fe640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f890c1fabe0 0x7f890c1fb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f890b7fe640 1 -- 172.21.15.112:0/3368617237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f890c150790 msgr2=0x7f890c137cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f890b7fe640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f890c150790 0x7f890c137cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f890b7fe640 1 -- 172.21.15.112:0/3368617237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890c150c10 con 0x7f88f8004810 2024-09-15T23:59:36.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8903fff640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f890c150790 0x7f890c137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:36.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f890b7fe640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88f8004810 0x7f890c1fb780 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f88fc00e8a0 tx=0x7f88fc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:36.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8908ff9640 1 -- 172.21.15.112:0/3368617237 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc017070 con 0x7f88f8004810 2024-09-15T23:59:36.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8908ff9640 1 -- 172.21.15.112:0/3368617237 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88fc00c8e0 con 0x7f88f8004810 2024-09-15T23:59:36.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8911a95640 1 -- 172.21.15.112:0/3368617237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f890c138500 con 0x7f88f8004810 2024-09-15T23:59:36.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8908ff9640 1 -- 172.21.15.112:0/3368617237 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc00ccd0 con 0x7f88f8004810 2024-09-15T23:59:36.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8911a95640 1 -- 172.21.15.112:0/3368617237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f890c138ac0 con 0x7f88f8004810 2024-09-15T23:59:36.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8911a95640 1 -- 172.21.15.112:0/3368617237 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f890c138d00 con 0x7f88f8004810 2024-09-15T23:59:36.175 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8908ff9640 1 -- 172.21.15.112:0/3368617237 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88fc01a070 con 0x7f88f8004810 2024-09-15T23:59:36.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.160+0000 7f8908ff9640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f88ec0678c0 0x7f88ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.164+0000 7f8908ff9640 1 -- 172.21.15.112:0/3368617237 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f88fc0860c0 con 0x7f88f8004810 2024-09-15T23:59:36.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.164+0000 7f8903fff640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f88ec0678c0 0x7f88ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.176 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.164+0000 7f8908ff9640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.169:6816/2075680198,v1:172.21.15.169:6817/2075680198] conn(0x7f88ec06dd60 0x7f88ec0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.164+0000 7f8908ff9640 1 -- 172.21.15.112:0/3368617237 --> [v2:172.21.15.169:6816/2075680198,v1:172.21.15.169:6817/2075680198] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88ec070870 con 0x7f88ec06dd60 2024-09-15T23:59:36.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.164+0000 7f8908ff9640 1 -- 172.21.15.112:0/3368617237 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f88fc086550 con 0x7f88f8004810 2024-09-15T23:59:36.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.164+0000 7f890bfff640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.169:6816/2075680198,v1:172.21.15.169:6817/2075680198] conn(0x7f88ec06dd60 0x7f88ec0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.164+0000 7f8903fff640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f88ec0678c0 0x7f88ec069d80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f88f40ab000 tx=0x7f88f40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:36.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.164+0000 7f890bfff640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.169:6816/2075680198,v1:172.21.15.169:6817/2075680198] conn(0x7f88ec06dd60 0x7f88ec0701a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:36.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.164+0000 7f8908ff9640 1 -- 172.21.15.112:0/3368617237 <== osd.4 v2:172.21.15.169:6816/2075680198 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88ec070870 con 0x7f88ec06dd60 2024-09-15T23:59:36.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.176+0000 7f8911a95640 1 -- 172.21.15.112:0/3368617237 --> [v2:172.21.15.169:6816/2075680198,v1:172.21.15.169:6817/2075680198] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f890c06e800 con 0x7f88ec06dd60 2024-09-15T23:59:36.178 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.180+0000 7f8908ff9640 1 -- 172.21.15.112:0/3368617237 <== osd.4 v2:172.21.15.169:6816/2075680198 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f890c06e800 con 0x7f88ec06dd60 2024-09-15T23:59:36.179 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:59:36.179 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:59:36.179 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:59:36.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.180+0000 7f8911a95640 1 -- 172.21.15.112:0/3368617237 >> [v2:172.21.15.169:6816/2075680198,v1:172.21.15.169:6817/2075680198] conn(0x7f88ec06dd60 msgr2=0x7f88ec0701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.180+0000 7f8911a95640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.169:6816/2075680198,v1:172.21.15.169:6817/2075680198] conn(0x7f88ec06dd60 0x7f88ec0701a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.180+0000 7f8911a95640 1 -- 172.21.15.112:0/3368617237 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f88ec0678c0 msgr2=0x7f88ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.180+0000 7f8911a95640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f88ec0678c0 0x7f88ec069d80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f88f40ab000 tx=0x7f88f40a7070 comp rx=0 tx=0).stop 2024-09-15T23:59:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.180+0000 7f8911a95640 1 -- 172.21.15.112:0/3368617237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88f8004810 msgr2=0x7f890c1fb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.181 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.180+0000 7f8911a95640 1 --2- 172.21.15.112:0/3368617237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88f8004810 0x7f890c1fb780 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f88fc00e8a0 tx=0x7f88fc00ed60 comp rx=0 tx=0).stop 2024-09-15T23:59:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.180+0000 7f890bfff640 1 -- 172.21.15.112:0/3368617237 reap_dead start 2024-09-15T23:59:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.180+0000 7f8911a95640 1 -- 172.21.15.112:0/3368617237 shutdown_connections 2024-09-15T23:59:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.180+0000 7f8911a95640 1 -- 172.21.15.112:0/3368617237 >> 172.21.15.112:0/3368617237 conn(0x7f890c0b1f90 msgr2=0x7f890c15cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.180+0000 7f8911a95640 1 -- 172.21.15.112:0/3368617237 shutdown_connections 2024-09-15T23:59:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.180+0000 7f8911a95640 1 -- 172.21.15.112:0/3368617237 wait complete. 2024-09-15T23:59:36.193 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-15T23:59:36.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.312+0000 7f1b41ebb640 1 Processor -- start 2024-09-15T23:59:36.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.312+0000 7f1b41ebb640 1 -- start start 2024-09-15T23:59:36.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.312+0000 7f1b41ebb640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1b3c1567e0 0x7f1b3c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.312+0000 7f1b41ebb640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b3c0b4620 con 0x7f1b3c0b3c40 2024-09-15T23:59:36.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.312+0000 7f1b41ebb640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b3c0b4900 con 0x7f1b3c160460 2024-09-15T23:59:36.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.312+0000 7f1b41ebb640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f1b3c0b4be0 con 0x7f1b3c1567e0 2024-09-15T23:59:36.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.312+0000 7f1b3b7fe640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f1b3c1567e0 0x7f1b3c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.315 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.312+0000 7f1b3affd640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f1b3c0b3c40 0x7f1b3c15fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51064/0 (socket says 172.21.15.112:51064) 2024-09-15T23:59:36.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.312+0000 7f1b3affd640 1 -- 172.21.15.112:0/3246755615 learned_addr learned my addr 172.21.15.112:0/3246755615 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:36.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.312+0000 7f1b3b7fe640 1 -- 172.21.15.112:0/3246755615 >> v1:172.21.15.169:6789/0 conn(0x7f1b3c160460 legacy=0x7f1b3c15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:36.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.312+0000 7f1b3b7fe640 1 -- 172.21.15.112:0/3246755615 >> v1:172.21.15.112:6789/0 conn(0x7f1b3c0b3c40 legacy=0x7f1b3c15fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.312+0000 7f1b3b7fe640 1 -- 172.21.15.112:0/3246755615 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3c0b4ec0 con 0x7f1b3c1567e0 2024-09-15T23:59:36.316 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.312+0000 7f1b3a7fc640 1 -- 172.21.15.112:0/3246755615 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 208146097 0 0) 0x7f1b3c0b4620 con 0x7f1b3c0b3c40 2024-09-15T23:59:36.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.316+0000 7f1b3b7fe640 1 --2- 172.21.15.112:0/3246755615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b3c1567e0 0x7f1b3c0b56c0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009dc0 tx=0x7f1b3401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfa7531805ffc39 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:36.322 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.316+0000 7f1b3a7fc640 1 -- 172.21.15.112:0/3246755615 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b340b2070 con 0x7f1b3c1567e0 2024-09-15T23:59:36.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.316+0000 7f1b3a7fc640 1 -- 172.21.15.112:0/3246755615 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b340a5930 con 0x7f1b3c1567e0 2024-09-15T23:59:36.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.316+0000 7f1b3a7fc640 1 -- 172.21.15.112:0/3246755615 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b340a5d00 con 0x7f1b3c1567e0 2024-09-15T23:59:36.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.316+0000 7f1b41ebb640 1 -- 172.21.15.112:0/3246755615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b3c1567e0 msgr2=0x7f1b3c0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.316+0000 7f1b41ebb640 1 --2- 172.21.15.112:0/3246755615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b3c1567e0 0x7f1b3c0b56c0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009dc0 tx=0x7f1b3401c850 comp rx=0 tx=0).stop 2024-09-15T23:59:36.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.316+0000 7f1b41ebb640 1 -- 172.21.15.112:0/3246755615 shutdown_connections 2024-09-15T23:59:36.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.316+0000 7f1b41ebb640 1 --2- 172.21.15.112:0/3246755615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b3c1567e0 0x7f1b3c0b56c0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.316+0000 7f1b41ebb640 1 -- 172.21.15.112:0/3246755615 >> 172.21.15.112:0/3246755615 conn(0x7f1b3c073580 msgr2=0x7f1b3c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:36.323 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.316+0000 7f1b41ebb640 1 -- 172.21.15.112:0/3246755615 shutdown_connections 2024-09-15T23:59:36.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.316+0000 7f1b41ebb640 1 -- 172.21.15.112:0/3246755615 wait complete. 2024-09-15T23:59:36.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.316+0000 7f1b41ebb640 1 Processor -- start 2024-09-15T23:59:36.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.316+0000 7f1b41ebb640 1 -- start start 2024-09-15T23:59:36.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b41ebb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c0b3c40 0x7f1b3c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b41ebb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b3c1567e0 0x7f1b3c141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b41ebb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b3c160460 0x7f1b3c14dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b41ebb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c1609d0 con 0x7f1b3c160460 2024-09-15T23:59:36.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b41ebb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c0b5c00 con 0x7f1b3c0b3c40 2024-09-15T23:59:36.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b41ebb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1b3c160b50 con 0x7f1b3c1567e0 2024-09-15T23:59:36.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b3bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b3c160460 0x7f1b3c14dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b3bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b3c160460 0x7f1b3c14dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38606/0 (socket says 172.21.15.112:38606) 2024-09-15T23:59:36.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b3bfff640 1 -- 172.21.15.112:0/630914142 learned_addr learned my addr 172.21.15.112:0/630914142 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:36.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b3b7fe640 1 --2- 172.21.15.112:0/630914142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c0b3c40 0x7f1b3c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b3bfff640 1 -- 172.21.15.112:0/630914142 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b3c1567e0 msgr2=0x7f1b3c141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b3bfff640 1 --2- 172.21.15.112:0/630914142 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b3c1567e0 0x7f1b3c141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b3bfff640 1 -- 172.21.15.112:0/630914142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c0b3c40 msgr2=0x7f1b3c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b3bfff640 1 --2- 172.21.15.112:0/630914142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c0b3c40 0x7f1b3c06f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b3bfff640 1 -- 172.21.15.112:0/630914142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3c1532e0 con 0x7f1b3c160460 2024-09-15T23:59:36.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b3b7fe640 1 --2- 172.21.15.112:0/630914142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c0b3c40 0x7f1b3c06f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:36.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b3bfff640 1 --2- 172.21.15.112:0/630914142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b3c160460 0x7f1b3c14dcb0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00b410 tx=0x7f1b2c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:36.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b23fff640 1 -- 172.21.15.112:0/630914142 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c015030 con 0x7f1b3c160460 2024-09-15T23:59:36.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b23fff640 1 -- 172.21.15.112:0/630914142 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2c004020 con 0x7f1b3c160460 2024-09-15T23:59:36.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b41ebb640 1 -- 172.21.15.112:0/630914142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b3c070390 con 0x7f1b3c160460 2024-09-15T23:59:36.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b23fff640 1 -- 172.21.15.112:0/630914142 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c004410 con 0x7f1b3c160460 2024-09-15T23:59:36.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b41ebb640 1 -- 172.21.15.112:0/630914142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b3c141560 con 0x7f1b3c160460 2024-09-15T23:59:36.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b41ebb640 1 -- 172.21.15.112:0/630914142 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b3c14d5b0 con 0x7f1b3c160460 2024-09-15T23:59:36.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b23fff640 1 -- 172.21.15.112:0/630914142 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b2c018070 con 0x7f1b3c160460 2024-09-15T23:59:36.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.320+0000 7f1b23fff640 1 --2- 172.21.15.112:0/630914142 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1b280678c0 0x7f1b28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.324+0000 7f1b3b7fe640 1 --2- 172.21.15.112:0/630914142 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1b280678c0 0x7f1b28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.327 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.324+0000 7f1b23fff640 1 -- 172.21.15.112:0/630914142 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f1b2c0855d0 con 0x7f1b3c160460 2024-09-15T23:59:36.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.324+0000 7f1b3b7fe640 1 --2- 172.21.15.112:0/630914142 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1b280678c0 0x7f1b28069d80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1b340af000 tx=0x7f1b340a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:36.328 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.328+0000 7f1b23fff640 1 -- 172.21.15.112:0/630914142 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1b3c14d5b0 con 0x7f1b3c160460 2024-09-15T23:59:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.476+0000 7f1b41ebb640 1 -- 172.21.15.112:0/630914142 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f1b3c141b00 con 0x7f1b280678c0 2024-09-15T23:59:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.476+0000 7f1b23fff640 1 -- 172.21.15.112:0/630914142 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1b340a5ab0 con 0x7f1b280678c0 2024-09-15T23:59:36.476 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 4 to deep-scrub 2024-09-15T23:59:36.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.480+0000 7f1b41ebb640 1 -- 172.21.15.112:0/630914142 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1b280678c0 msgr2=0x7f1b28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.480+0000 7f1b41ebb640 1 --2- 172.21.15.112:0/630914142 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1b280678c0 0x7f1b28069d80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1b340af000 tx=0x7f1b340a7070 comp rx=0 tx=0).stop 2024-09-15T23:59:36.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.480+0000 7f1b41ebb640 1 -- 172.21.15.112:0/630914142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b3c160460 msgr2=0x7f1b3c14dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.480+0000 7f1b41ebb640 1 --2- 172.21.15.112:0/630914142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b3c160460 0x7f1b3c14dcb0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00b410 tx=0x7f1b2c00b8d0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.479 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.480+0000 7f1b41ebb640 1 -- 172.21.15.112:0/630914142 shutdown_connections 2024-09-15T23:59:36.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.480+0000 7f1b41ebb640 1 --2- 172.21.15.112:0/630914142 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f1b280678c0 0x7f1b28069d80 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.480+0000 7f1b41ebb640 1 --2- 172.21.15.112:0/630914142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b3c160460 0x7f1b3c14dcb0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.480+0000 7f1b41ebb640 1 --2- 172.21.15.112:0/630914142 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b3c1567e0 0x7f1b3c141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.480+0000 7f1b41ebb640 1 --2- 172.21.15.112:0/630914142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c0b3c40 0x7f1b3c06f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.480+0000 7f1b41ebb640 1 -- 172.21.15.112:0/630914142 >> 172.21.15.112:0/630914142 conn(0x7f1b3c073580 msgr2=0x7f1b3c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:36.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.480+0000 7f1b41ebb640 1 -- 172.21.15.112:0/630914142 shutdown_connections 2024-09-15T23:59:36.480 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.480+0000 7f1b41ebb640 1 -- 172.21.15.112:0/630914142 wait complete. 2024-09-15T23:59:36.495 INFO:tasks.ceph:Scrubbing osd.5 2024-09-15T23:59:36.495 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:59:36.609 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.608+0000 7ffac8a88640 1 Processor -- start 2024-09-15T23:59:36.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.608+0000 7ffac8a88640 1 -- start start 2024-09-15T23:59:36.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac8a88640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffac4161a60 0x7ffac40d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac8a88640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40d2e90 0x7ffac40cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac8a88640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac40d32b0 con 0x7ffac40cf450 2024-09-15T23:59:36.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac8a88640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7ffac40d0300 con 0x7ffac4161a60 2024-09-15T23:59:36.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac8a88640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ffac406e6c0 con 0x7ffac40d2e90 2024-09-15T23:59:36.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac259c640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7ffac4161a60 0x7ffac40d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac2d9d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7ffac40cf450 0x7ffac40d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51072/0 (socket says 172.21.15.112:51072) 2024-09-15T23:59:36.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac2d9d640 1 -- 172.21.15.112:0/1723992662 learned_addr learned my addr 172.21.15.112:0/1723992662 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:36.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffab9d9b640 1 --2- 172.21.15.112:0/1723992662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40d2e90 0x7ffac40cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac259c640 1 -- 172.21.15.112:0/1723992662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40d2e90 msgr2=0x7ffac40cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:36.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac259c640 1 --2- 172.21.15.112:0/1723992662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40d2e90 0x7ffac40cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac259c640 1 -- 172.21.15.112:0/1723992662 >> v1:172.21.15.112:6789/0 conn(0x7ffac40cf450 legacy=0x7ffac40d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac1d9b640 1 -- 172.21.15.112:0/1723992662 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1698145142 0 0) 0x7ffac40d32b0 con 0x7ffac40cf450 2024-09-15T23:59:36.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac259c640 1 -- 172.21.15.112:0/1723992662 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac40b0f60 con 0x7ffac4161a60 2024-09-15T23:59:36.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac259c640 1 --2- 172.21.15.112:0/1723992662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffac4161a60 0x7ffac40d2950 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7ffab40097c0 tx=0x7ffab401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aea4cc70d0559f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:36.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac1d9b640 1 -- 172.21.15.112:0/1723992662 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab40b1070 con 0x7ffac4161a60 2024-09-15T23:59:36.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac1d9b640 1 -- 172.21.15.112:0/1723992662 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab40a8050 con 0x7ffac4161a60 2024-09-15T23:59:36.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac1d9b640 1 -- 172.21.15.112:0/1723992662 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac40d1930 con 0x7ffac4161a60 2024-09-15T23:59:36.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac8a88640 1 -- 172.21.15.112:0/1723992662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffac4161a60 msgr2=0x7ffac40d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac8a88640 1 --2- 172.21.15.112:0/1723992662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffac4161a60 0x7ffac40d2950 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7ffab40097c0 tx=0x7ffab401c3e0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac8a88640 1 -- 172.21.15.112:0/1723992662 shutdown_connections 2024-09-15T23:59:36.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac8a88640 1 --2- 172.21.15.112:0/1723992662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40d2e90 0x7ffac40cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac8a88640 1 --2- 172.21.15.112:0/1723992662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffac4161a60 0x7ffac40d2950 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac8a88640 1 -- 172.21.15.112:0/1723992662 >> 172.21.15.112:0/1723992662 conn(0x7ffac408bf90 msgr2=0x7ffac409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:36.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac8a88640 1 -- 172.21.15.112:0/1723992662 shutdown_connections 2024-09-15T23:59:36.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.612+0000 7ffac8a88640 1 -- 172.21.15.112:0/1723992662 wait complete. 2024-09-15T23:59:36.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac8a88640 1 Processor -- start 2024-09-15T23:59:36.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac8a88640 1 -- start start 2024-09-15T23:59:36.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac8a88640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffac40cf450 0x7ffac41546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac8a88640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40d2e90 0x7ffac41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac8a88640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffac4161a60 0x7ffac415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac8a88640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffac40cf8a0 con 0x7ffac4161a60 2024-09-15T23:59:36.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac8a88640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffac406d190 con 0x7ffac40cf450 2024-09-15T23:59:36.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac8a88640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ffac40cfa20 con 0x7ffac40d2e90 2024-09-15T23:59:36.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffac4161a60 0x7ffac415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffac4161a60 0x7ffac415cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38612/0 (socket says 172.21.15.112:38612) 2024-09-15T23:59:36.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac2d9d640 1 -- 172.21.15.112:0/164878848 learned_addr learned my addr 172.21.15.112:0/164878848 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:36.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac259c640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffac40cf450 0x7ffac41546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffab9d9b640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40d2e90 0x7ffac41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac2d9d640 1 -- 172.21.15.112:0/164878848 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40d2e90 msgr2=0x7ffac41591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac2d9d640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffac40d2e90 0x7ffac41591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac2d9d640 1 -- 172.21.15.112:0/164878848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffac40cf450 msgr2=0x7ffac41546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac2d9d640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffac40cf450 0x7ffac41546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac2d9d640 1 -- 172.21.15.112:0/164878848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac4159c90 con 0x7ffac4161a60 2024-09-15T23:59:36.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac259c640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffac40cf450 0x7ffac41546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:36.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac2d9d640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffac4161a60 0x7ffac415cd50 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00c700 tx=0x7ffabc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:36.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffabb7fe640 1 -- 172.21.15.112:0/164878848 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc018070 con 0x7ffac4161a60 2024-09-15T23:59:36.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffabb7fe640 1 -- 172.21.15.112:0/164878848 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffabc00ce10 con 0x7ffac4161a60 2024-09-15T23:59:36.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffabb7fe640 1 -- 172.21.15.112:0/164878848 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc00a860 con 0x7ffac4161a60 2024-09-15T23:59:36.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac8a88640 1 -- 172.21.15.112:0/164878848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac4159f70 con 0x7ffac4161a60 2024-09-15T23:59:36.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac8a88640 1 -- 172.21.15.112:0/164878848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac415a530 con 0x7ffac4161a60 2024-09-15T23:59:36.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffac8a88640 1 -- 172.21.15.112:0/164878848 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffac40cef10 con 0x7ffac4161a60 2024-09-15T23:59:36.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.616+0000 7ffabb7fe640 1 -- 172.21.15.112:0/164878848 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffabc01b070 con 0x7ffac4161a60 2024-09-15T23:59:36.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.620+0000 7ffabb7fe640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffaa40678c0 0x7ffaa4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.620+0000 7ffabb7fe640 1 -- 172.21.15.112:0/164878848 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7ffabc0856d0 con 0x7ffac4161a60 2024-09-15T23:59:36.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.620+0000 7ffac259c640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffaa40678c0 0x7ffaa4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.620+0000 7ffabb7fe640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.169:6800/2810276484,v1:172.21.15.169:6801/2810276484] conn(0x7ffaa406dd60 0x7ffaa40701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.620+0000 7ffabb7fe640 1 -- 172.21.15.112:0/164878848 --> [v2:172.21.15.169:6800/2810276484,v1:172.21.15.169:6801/2810276484] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffaa4070870 con 0x7ffaa406dd60 2024-09-15T23:59:36.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.620+0000 7ffabb7fe640 1 -- 172.21.15.112:0/164878848 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7ffabc085b60 con 0x7ffac4161a60 2024-09-15T23:59:36.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.620+0000 7ffac259c640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffaa40678c0 0x7ffaa4069d80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ffab40ae000 tx=0x7ffab40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:36.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.620+0000 7ffab9d9b640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.169:6800/2810276484,v1:172.21.15.169:6801/2810276484] conn(0x7ffaa406dd60 0x7ffaa40701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.620+0000 7ffab9d9b640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.169:6800/2810276484,v1:172.21.15.169:6801/2810276484] conn(0x7ffaa406dd60 0x7ffaa40701a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:36.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.620+0000 7ffabb7fe640 1 -- 172.21.15.112:0/164878848 <== osd.5 v2:172.21.15.169:6800/2810276484 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffaa4070870 con 0x7ffaa406dd60 2024-09-15T23:59:36.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.632+0000 7ffac8a88640 1 -- 172.21.15.112:0/164878848 --> [v2:172.21.15.169:6800/2810276484,v1:172.21.15.169:6801/2810276484] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffac40b7200 con 0x7ffaa406dd60 2024-09-15T23:59:36.634 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.636+0000 7ffabb7fe640 1 -- 172.21.15.112:0/164878848 <== osd.5 v2:172.21.15.169:6800/2810276484 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffac40b7200 con 0x7ffaa406dd60 2024-09-15T23:59:36.635 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:59:36.635 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:59:36.635 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:59:36.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.636+0000 7ffac8a88640 1 -- 172.21.15.112:0/164878848 >> [v2:172.21.15.169:6800/2810276484,v1:172.21.15.169:6801/2810276484] conn(0x7ffaa406dd60 msgr2=0x7ffaa40701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.636+0000 7ffac8a88640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.169:6800/2810276484,v1:172.21.15.169:6801/2810276484] conn(0x7ffaa406dd60 0x7ffaa40701a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.636+0000 7ffac8a88640 1 -- 172.21.15.112:0/164878848 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffaa40678c0 msgr2=0x7ffaa4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.636+0000 7ffac8a88640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7ffaa40678c0 0x7ffaa4069d80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ffab40ae000 tx=0x7ffab40a7000 comp rx=0 tx=0).stop 2024-09-15T23:59:36.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.636+0000 7ffac8a88640 1 -- 172.21.15.112:0/164878848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffac4161a60 msgr2=0x7ffac415cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.636+0000 7ffac8a88640 1 --2- 172.21.15.112:0/164878848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffac4161a60 0x7ffac415cd50 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00c700 tx=0x7ffabc00cbc0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.636+0000 7ffac2d9d640 1 -- 172.21.15.112:0/164878848 reap_dead start 2024-09-15T23:59:36.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.636+0000 7ffac8a88640 1 -- 172.21.15.112:0/164878848 shutdown_connections 2024-09-15T23:59:36.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.636+0000 7ffac8a88640 1 -- 172.21.15.112:0/164878848 >> 172.21.15.112:0/164878848 conn(0x7ffac408bf90 msgr2=0x7ffac40b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:36.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.636+0000 7ffac8a88640 1 -- 172.21.15.112:0/164878848 shutdown_connections 2024-09-15T23:59:36.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.636+0000 7ffac8a88640 1 -- 172.21.15.112:0/164878848 wait complete. 2024-09-15T23:59:36.649 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-15T23:59:36.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f324b44e640 1 Processor -- start 2024-09-15T23:59:36.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f324b44e640 1 -- start start 2024-09-15T23:59:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f324b44e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f324415c2a0 0x7f32440aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f324b44e640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32440b3290 con 0x7f324415bec0 2024-09-15T23:59:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f324b44e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32440b3570 con 0x7f32440af2a0 2024-09-15T23:59:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f324b44e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f32440b3850 con 0x7f324415c2a0 2024-09-15T23:59:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f32491ea640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f324415bec0 0x7f32440ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51076/0 (socket says 172.21.15.112:51076) 2024-09-15T23:59:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f32491ea640 1 -- 172.21.15.112:0/519436105 learned_addr learned my addr 172.21.15.112:0/519436105 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:36.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 -- 172.21.15.112:0/519436105 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1820823102 0 0) 0x7f32440b3290 con 0x7f324415bec0 2024-09-15T23:59:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 -- 172.21.15.112:0/519436105 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3230003530 con 0x7f324415bec0 2024-09-15T23:59:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f32489e9640 1 --2- 172.21.15.112:0/519436105 >> v2:172.21.15.169:3300/0 conn(0x7f324415c2a0 0x7f32440aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 -- 172.21.15.112:0/519436105 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1581881347 0 0) 0x7f3230003530 con 0x7f324415bec0 2024-09-15T23:59:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 -- 172.21.15.112:0/519436105 >> v2:172.21.15.169:3300/0 conn(0x7f324415c2a0 msgr2=0x7f32440aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 --2- 172.21.15.112:0/519436105 >> v2:172.21.15.169:3300/0 conn(0x7f324415c2a0 0x7f32440aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 -- 172.21.15.112:0/519436105 >> v1:172.21.15.169:6789/0 conn(0x7f32440af2a0 legacy=0x7f324406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 -- 172.21.15.112:0/519436105 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32440b3b30 con 0x7f324415bec0 2024-09-15T23:59:36.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 -- 172.21.15.112:0/519436105 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7f3240001680 con 0x7f324415bec0 2024-09-15T23:59:36.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 -- 172.21.15.112:0/519436105 >> v1:172.21.15.112:6789/0 conn(0x7f324415bec0 legacy=0x7f32440ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 --2- 172.21.15.112:0/519436105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32300039c0 0x7f3230003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 --2- 172.21.15.112:0/519436105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3230004810 0x7f3230004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 --2- 172.21.15.112:0/519436105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32300051d0 0x7f323000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 -- 172.21.15.112:0/519436105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f32440b3850 con 0x7f32300039c0 2024-09-15T23:59:36.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 -- 172.21.15.112:0/519436105 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f323000c120 con 0x7f32300051d0 2024-09-15T23:59:36.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f323bfff640 1 -- 172.21.15.112:0/519436105 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f323000c320 con 0x7f3230004810 2024-09-15T23:59:36.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.764+0000 7f32491ea640 1 --2- 172.21.15.112:0/519436105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32300039c0 0x7f3230003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f32499eb640 1 --2- 172.21.15.112:0/519436105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32300051d0 0x7f323000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f32491ea640 1 -- 172.21.15.112:0/519436105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3230004810 msgr2=0x7f3230004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:36.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f32491ea640 1 --2- 172.21.15.112:0/519436105 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3230004810 0x7f3230004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f32491ea640 1 -- 172.21.15.112:0/519436105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32300051d0 msgr2=0x7f323000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:36.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f32491ea640 1 --2- 172.21.15.112:0/519436105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32300051d0 0x7f323000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f32491ea640 1 -- 172.21.15.112:0/519436105 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3230003530 con 0x7f32300039c0 2024-09-15T23:59:36.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f32499eb640 1 --2- 172.21.15.112:0/519436105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32300051d0 0x7f323000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:36.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f32499eb640 1 -- 172.21.15.112:0/519436105 reap_dead start 2024-09-15T23:59:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f32491ea640 1 --2- 172.21.15.112:0/519436105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32300039c0 0x7f3230003de0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f324000c1c0 tx=0x7f324001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff4c06f1b3b2ec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f323bfff640 1 -- 172.21.15.112:0/519436105 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240007d00 con 0x7f32300039c0 2024-09-15T23:59:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f323bfff640 1 -- 172.21.15.112:0/519436105 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32400a9020 con 0x7f32300039c0 2024-09-15T23:59:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f323bfff640 1 -- 172.21.15.112:0/519436105 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240005ae0 con 0x7f32300039c0 2024-09-15T23:59:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f324b44e640 1 -- 172.21.15.112:0/519436105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32300039c0 msgr2=0x7f3230003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f324b44e640 1 --2- 172.21.15.112:0/519436105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32300039c0 0x7f3230003de0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f324000c1c0 tx=0x7f324001cc30 comp rx=0 tx=0).stop 2024-09-15T23:59:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f324b44e640 1 -- 172.21.15.112:0/519436105 shutdown_connections 2024-09-15T23:59:36.774 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f324b44e640 1 --2- 172.21.15.112:0/519436105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32300039c0 0x7f3230003de0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f324b44e640 1 -- 172.21.15.112:0/519436105 >> 172.21.15.112:0/519436105 conn(0x7f32440b1f90 msgr2=0x7f32440b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:36.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f324b44e640 1 -- 172.21.15.112:0/519436105 shutdown_connections 2024-09-15T23:59:36.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.768+0000 7f324b44e640 1 -- 172.21.15.112:0/519436105 wait complete. 2024-09-15T23:59:36.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f324b44e640 1 Processor -- start 2024-09-15T23:59:36.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f324b44e640 1 -- start start 2024-09-15T23:59:36.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f324b44e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32300039c0 0x7f3244152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.775 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f324b44e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3244144ce0 0x7f324414f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f324b44e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3244150be0 0x7f324415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f324b44e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f32440af680 con 0x7f32300039c0 2024-09-15T23:59:36.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f324b44e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32440ad610 con 0x7f3244150be0 2024-09-15T23:59:36.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f324b44e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f32441532d0 con 0x7f3244144ce0 2024-09-15T23:59:36.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f32491ea640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32300039c0 0x7f3244152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f32491ea640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32300039c0 0x7f3244152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38624/0 (socket says 172.21.15.112:38624) 2024-09-15T23:59:36.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f32491ea640 1 -- 172.21.15.112:0/3751682665 learned_addr learned my addr 172.21.15.112:0/3751682665 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:36.776 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f32499eb640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3244150be0 0x7f324415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f32489e9640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3244144ce0 0x7f324414f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f32491ea640 1 -- 172.21.15.112:0/3751682665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3244144ce0 msgr2=0x7f324414f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f32491ea640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3244144ce0 0x7f324414f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f32491ea640 1 -- 172.21.15.112:0/3751682665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3244150be0 msgr2=0x7f324415ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f32491ea640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3244150be0 0x7f324415ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f32491ea640 1 -- 172.21.15.112:0/3751682665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324414fb40 con 0x7f32300039c0 2024-09-15T23:59:36.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f32489e9640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3244144ce0 0x7f324414f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:36.777 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f32491ea640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32300039c0 0x7f3244152d90 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f324001ca60 tx=0x7f3230005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:36.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f3239ffb640 1 -- 172.21.15.112:0/3751682665 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32400a5a20 con 0x7f32300039c0 2024-09-15T23:59:36.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f3239ffb640 1 -- 172.21.15.112:0/3751682665 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32400b2070 con 0x7f32300039c0 2024-09-15T23:59:36.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f3239ffb640 1 -- 172.21.15.112:0/3751682665 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32400a5dc0 con 0x7f32300039c0 2024-09-15T23:59:36.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f324b44e640 1 -- 172.21.15.112:0/3751682665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f324414fe20 con 0x7f32300039c0 2024-09-15T23:59:36.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f324b44e640 1 -- 172.21.15.112:0/3751682665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32441503e0 con 0x7f32300039c0 2024-09-15T23:59:36.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f324b44e640 1 -- 172.21.15.112:0/3751682665 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3244160470 con 0x7f32300039c0 2024-09-15T23:59:36.778 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f3239ffb640 1 -- 172.21.15.112:0/3751682665 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32400047f0 con 0x7f32300039c0 2024-09-15T23:59:36.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.772+0000 7f3239ffb640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f32280678f0 0x7f3228069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:36.779 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.776+0000 7f3239ffb640 1 -- 172.21.15.112:0/3751682665 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f324011f1a0 con 0x7f32300039c0 2024-09-15T23:59:36.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.776+0000 7f32489e9640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f32280678f0 0x7f3228069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:36.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.776+0000 7f32489e9640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f32280678f0 0x7f3228069db0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3234006aa0 tx=0x7f3234008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:36.780 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.780+0000 7f3239ffb640 1 -- 172.21.15.112:0/3751682665 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3240016970 con 0x7f32300039c0 2024-09-15T23:59:36.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.936+0000 7f324b44e640 1 -- 172.21.15.112:0/3751682665 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f324406ee20 con 0x7f32280678f0 2024-09-15T23:59:36.938 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.936+0000 7f3239ffb640 1 -- 172.21.15.112:0/3751682665 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f324406ee20 con 0x7f32280678f0 2024-09-15T23:59:36.938 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 5 to deep-scrub 2024-09-15T23:59:36.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.940+0000 7f324b44e640 1 -- 172.21.15.112:0/3751682665 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f32280678f0 msgr2=0x7f3228069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.940+0000 7f324b44e640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f32280678f0 0x7f3228069db0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3234006aa0 tx=0x7f3234008040 comp rx=0 tx=0).stop 2024-09-15T23:59:36.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.940+0000 7f324b44e640 1 -- 172.21.15.112:0/3751682665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32300039c0 msgr2=0x7f3244152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:36.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.940+0000 7f324b44e640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32300039c0 0x7f3244152d90 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f324001ca60 tx=0x7f3230005840 comp rx=0 tx=0).stop 2024-09-15T23:59:36.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.940+0000 7f324b44e640 1 -- 172.21.15.112:0/3751682665 shutdown_connections 2024-09-15T23:59:36.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.940+0000 7f324b44e640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f32280678f0 0x7f3228069db0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.940+0000 7f324b44e640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3244150be0 0x7f324415ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.940+0000 7f324b44e640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3244144ce0 0x7f324414f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.940+0000 7f324b44e640 1 --2- 172.21.15.112:0/3751682665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32300039c0 0x7f3244152d90 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:36.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.940+0000 7f324b44e640 1 -- 172.21.15.112:0/3751682665 >> 172.21.15.112:0/3751682665 conn(0x7f32440b1f90 msgr2=0x7f32441599f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:36.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.940+0000 7f324b44e640 1 -- 172.21.15.112:0/3751682665 shutdown_connections 2024-09-15T23:59:36.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:36.940+0000 7f324b44e640 1 -- 172.21.15.112:0/3751682665 wait complete. 2024-09-15T23:59:36.956 INFO:tasks.ceph:Scrubbing osd.6 2024-09-15T23:59:36.957 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:59:37.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b3b1c7640 1 Processor -- start 2024-09-15T23:59:37.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b3b1c7640 1 -- start start 2024-09-15T23:59:37.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b3b1c7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b3415bec0 0x7f4b340ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b3b1c7640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4b340af470 0x7f4b3406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b3b1c7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b340b3290 con 0x7f4b3415c2a0 2024-09-15T23:59:37.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b3b1c7640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f4b340b3570 con 0x7f4b340af470 2024-09-15T23:59:37.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b3b1c7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4b340b3850 con 0x7f4b3415bec0 2024-09-15T23:59:37.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b39764640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4b340af470 0x7f4b3406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b39764640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f4b340af470 0x7f4b3406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38632/0 (socket says 172.21.15.112:38632) 2024-09-15T23:59:37.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b39764640 1 -- 172.21.15.112:0/2249838346 learned_addr learned my addr 172.21.15.112:0/2249838346 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:37.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b38f63640 1 --2- 172.21.15.112:0/2249838346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b3415bec0 0x7f4b340ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b39764640 1 -- 172.21.15.112:0/2249838346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b3415bec0 msgr2=0x7f4b340ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:37.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b39764640 1 --2- 172.21.15.112:0/2249838346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b3415bec0 0x7f4b340ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b39764640 1 -- 172.21.15.112:0/2249838346 >> v1:172.21.15.169:6789/0 conn(0x7f4b3415c2a0 legacy=0x7f4b340aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.068+0000 7f4b39764640 1 -- 172.21.15.112:0/2249838346 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b340b3b30 con 0x7f4b340af470 2024-09-15T23:59:37.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b39764640 1 --2- 172.21.15.112:0/2249838346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b340af470 0x7f4b3406e000 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009e50 tx=0x7f4b2c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3adb2bf72b10310 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b337fe640 1 -- 172.21.15.112:0/2249838346 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0a58d0 con 0x7f4b340af470 2024-09-15T23:59:37.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b337fe640 1 -- 172.21.15.112:0/2249838346 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b2c0a5a70 con 0x7f4b340af470 2024-09-15T23:59:37.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b337fe640 1 -- 172.21.15.112:0/2249838346 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0a5e40 con 0x7f4b340af470 2024-09-15T23:59:37.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/2249838346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b340af470 msgr2=0x7f4b3406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 --2- 172.21.15.112:0/2249838346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b340af470 0x7f4b3406e000 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009e50 tx=0x7f4b2c01ca00 comp rx=0 tx=0).stop 2024-09-15T23:59:37.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/2249838346 shutdown_connections 2024-09-15T23:59:37.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 --2- 172.21.15.112:0/2249838346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b340af470 0x7f4b3406e000 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 --2- 172.21.15.112:0/2249838346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b3415bec0 0x7f4b340ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/2249838346 >> 172.21.15.112:0/2249838346 conn(0x7f4b340b1f90 msgr2=0x7f4b340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:37.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/2249838346 shutdown_connections 2024-09-15T23:59:37.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/2249838346 wait complete. 2024-09-15T23:59:37.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 Processor -- start 2024-09-15T23:59:37.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 -- start start 2024-09-15T23:59:37.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b340af470 0x7f4b341486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b3415bec0 0x7f4b3414c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b3415c2a0 0x7f4b34154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3406ed50 con 0x7f4b3415c2a0 2024-09-15T23:59:37.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b340ad740 con 0x7f4b340af470 2024-09-15T23:59:37.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4b3406eed0 con 0x7f4b3415bec0 2024-09-15T23:59:37.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b39764640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b3415c2a0 0x7f4b34154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b39764640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b3415c2a0 0x7f4b34154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38648/0 (socket says 172.21.15.112:38648) 2024-09-15T23:59:37.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b39764640 1 -- 172.21.15.112:0/3875907353 learned_addr learned my addr 172.21.15.112:0/3875907353 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:37.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b39764640 1 -- 172.21.15.112:0/3875907353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b3415bec0 msgr2=0x7f4b3414c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b39764640 1 --2- 172.21.15.112:0/3875907353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b3415bec0 0x7f4b3414c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b39764640 1 -- 172.21.15.112:0/3875907353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b340af470 msgr2=0x7f4b341486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b38f63640 1 --2- 172.21.15.112:0/3875907353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b340af470 0x7f4b341486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b39764640 1 --2- 172.21.15.112:0/3875907353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b340af470 0x7f4b341486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b39764640 1 -- 172.21.15.112:0/3875907353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b34153e00 con 0x7f4b3415c2a0 2024-09-15T23:59:37.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b39764640 1 --2- 172.21.15.112:0/3875907353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b3415c2a0 0x7f4b34154ea0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c01a630 tx=0x7f4b2c0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b317fa640 1 -- 172.21.15.112:0/3875907353 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0bc030 con 0x7f4b3415c2a0 2024-09-15T23:59:37.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b317fa640 1 -- 172.21.15.112:0/3875907353 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b2c007c20 con 0x7f4b3415c2a0 2024-09-15T23:59:37.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/3875907353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b341540e0 con 0x7f4b3415c2a0 2024-09-15T23:59:37.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b317fa640 1 -- 172.21.15.112:0/3875907353 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0a58d0 con 0x7f4b3415c2a0 2024-09-15T23:59:37.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.072+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/3875907353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b341546a0 con 0x7f4b3415c2a0 2024-09-15T23:59:37.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.076+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/3875907353 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b34153bb0 con 0x7f4b3415c2a0 2024-09-15T23:59:37.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.076+0000 7f4b317fa640 1 -- 172.21.15.112:0/3875907353 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b2c0bf070 con 0x7f4b3415c2a0 2024-09-15T23:59:37.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.076+0000 7f4b317fa640 1 --2- 172.21.15.112:0/3875907353 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b200678c0 0x7f4b20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.076+0000 7f4b317fa640 1 -- 172.21.15.112:0/3875907353 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f4b2c1216f0 con 0x7f4b3415c2a0 2024-09-15T23:59:37.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.076+0000 7f4b38f63640 1 --2- 172.21.15.112:0/3875907353 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b200678c0 0x7f4b20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.076+0000 7f4b317fa640 1 --2- 172.21.15.112:0/3875907353 >> [v2:172.21.15.169:6824/1324680124,v1:172.21.15.169:6825/1324680124] conn(0x7f4b2006dd60 0x7f4b200701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.076+0000 7f4b317fa640 1 -- 172.21.15.112:0/3875907353 --> [v2:172.21.15.169:6824/1324680124,v1:172.21.15.169:6825/1324680124] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b2c008ec0 con 0x7f4b2006dd60 2024-09-15T23:59:37.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.076+0000 7f4b317fa640 1 -- 172.21.15.112:0/3875907353 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f4b2c121b80 con 0x7f4b3415c2a0 2024-09-15T23:59:37.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.076+0000 7f4b33fff640 1 --2- 172.21.15.112:0/3875907353 >> [v2:172.21.15.169:6824/1324680124,v1:172.21.15.169:6825/1324680124] conn(0x7f4b2006dd60 0x7f4b200701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.076+0000 7f4b38f63640 1 --2- 172.21.15.112:0/3875907353 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b200678c0 0x7f4b20069d80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009790 tx=0x7f4b28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.076+0000 7f4b33fff640 1 --2- 172.21.15.112:0/3875907353 >> [v2:172.21.15.169:6824/1324680124,v1:172.21.15.169:6825/1324680124] conn(0x7f4b2006dd60 0x7f4b200701a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.080+0000 7f4b317fa640 1 -- 172.21.15.112:0/3875907353 <== osd.6 v2:172.21.15.169:6824/1324680124 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4b2c008ec0 con 0x7f4b2006dd60 2024-09-15T23:59:37.091 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.092+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/3875907353 --> [v2:172.21.15.169:6824/1324680124,v1:172.21.15.169:6825/1324680124] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4b3406f220 con 0x7f4b2006dd60 2024-09-15T23:59:37.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.092+0000 7f4b317fa640 1 -- 172.21.15.112:0/3875907353 <== osd.6 v2:172.21.15.169:6824/1324680124 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4b3406f220 con 0x7f4b2006dd60 2024-09-15T23:59:37.092 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:59:37.093 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:59:37.093 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:59:37.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.092+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/3875907353 >> [v2:172.21.15.169:6824/1324680124,v1:172.21.15.169:6825/1324680124] conn(0x7f4b2006dd60 msgr2=0x7f4b200701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.092+0000 7f4b3b1c7640 1 --2- 172.21.15.112:0/3875907353 >> [v2:172.21.15.169:6824/1324680124,v1:172.21.15.169:6825/1324680124] conn(0x7f4b2006dd60 0x7f4b200701a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.092+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/3875907353 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b200678c0 msgr2=0x7f4b20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.092+0000 7f4b3b1c7640 1 --2- 172.21.15.112:0/3875907353 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f4b200678c0 0x7f4b20069d80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009790 tx=0x7f4b28008040 comp rx=0 tx=0).stop 2024-09-15T23:59:37.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.092+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/3875907353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b3415c2a0 msgr2=0x7f4b34154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.094 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.092+0000 7f4b3b1c7640 1 --2- 172.21.15.112:0/3875907353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b3415c2a0 0x7f4b34154ea0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c01a630 tx=0x7f4b2c0197a0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.092+0000 7f4b39764640 1 -- 172.21.15.112:0/3875907353 reap_dead start 2024-09-15T23:59:37.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.092+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/3875907353 shutdown_connections 2024-09-15T23:59:37.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.092+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/3875907353 >> 172.21.15.112:0/3875907353 conn(0x7f4b340b1f90 msgr2=0x7f4b340b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:37.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.092+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/3875907353 shutdown_connections 2024-09-15T23:59:37.095 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.092+0000 7f4b3b1c7640 1 -- 172.21.15.112:0/3875907353 wait complete. 2024-09-15T23:59:37.106 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-15T23:59:37.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be9346640 1 Processor -- start 2024-09-15T23:59:37.212 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be9346640 1 -- start start 2024-09-15T23:59:37.213 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be9346640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2be41520a0 0x7f2be406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be9346640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2be406fe50 0x7f2be415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be9346640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2be4070250 con 0x7f2be415f1d0 2024-09-15T23:59:37.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be9346640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f2be4152480 con 0x7f2be406fe50 2024-09-15T23:59:37.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be9346640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2be40aede0 con 0x7f2be41520a0 2024-09-15T23:59:37.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be27fc640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f2be406fe50 0x7f2be415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be37fe640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f2be415f1d0 0x7f2be4071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51084/0 (socket says 172.21.15.112:51084) 2024-09-15T23:59:37.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be37fe640 1 -- 172.21.15.112:0/3054967147 learned_addr learned my addr 172.21.15.112:0/3054967147 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:37.214 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be2ffd640 1 --2- 172.21.15.112:0/3054967147 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2be41520a0 0x7f2be406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be1ffb640 1 -- 172.21.15.112:0/3054967147 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3338142210 0 0) 0x7f2be4070250 con 0x7f2be415f1d0 2024-09-15T23:59:37.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be1ffb640 1 -- 172.21.15.112:0/3054967147 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bd0003530 con 0x7f2be415f1d0 2024-09-15T23:59:37.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be27fc640 1 -- 172.21.15.112:0/3054967147 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2be41520a0 msgr2=0x7f2be406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:37.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be27fc640 1 --2- 172.21.15.112:0/3054967147 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2be41520a0 0x7f2be406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be27fc640 1 -- 172.21.15.112:0/3054967147 >> v1:172.21.15.112:6789/0 conn(0x7f2be415f1d0 legacy=0x7f2be4071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be27fc640 1 -- 172.21.15.112:0/3054967147 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be415fa10 con 0x7f2be406fe50 2024-09-15T23:59:37.215 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.212+0000 7f2be2ffd640 1 --2- 172.21.15.112:0/3054967147 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2be41520a0 0x7f2be406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:37.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be27fc640 1 --2- 172.21.15.112:0/3054967147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be406fe50 0x7f2be415ec90 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0097c0 tx=0x7f2bcc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c057683854c721 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be1ffb640 1 -- 172.21.15.112:0/3054967147 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc0b1070 con 0x7f2be406fe50 2024-09-15T23:59:37.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be1ffb640 1 -- 172.21.15.112:0/3054967147 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bcc0ac600 con 0x7f2be406fe50 2024-09-15T23:59:37.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be1ffb640 1 -- 172.21.15.112:0/3054967147 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc0ac9b0 con 0x7f2be406fe50 2024-09-15T23:59:37.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 -- 172.21.15.112:0/3054967147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be406fe50 msgr2=0x7f2be415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 --2- 172.21.15.112:0/3054967147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be406fe50 0x7f2be415ec90 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0097c0 tx=0x7f2bcc01c480 comp rx=0 tx=0).stop 2024-09-15T23:59:37.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 -- 172.21.15.112:0/3054967147 shutdown_connections 2024-09-15T23:59:37.217 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 --2- 172.21.15.112:0/3054967147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be406fe50 0x7f2be415ec90 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 --2- 172.21.15.112:0/3054967147 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2be41520a0 0x7f2be406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 -- 172.21.15.112:0/3054967147 >> 172.21.15.112:0/3054967147 conn(0x7f2be40b1f90 msgr2=0x7f2be40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:37.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 -- 172.21.15.112:0/3054967147 shutdown_connections 2024-09-15T23:59:37.218 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 -- 172.21.15.112:0/3054967147 wait complete. 2024-09-15T23:59:37.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 Processor -- start 2024-09-15T23:59:37.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 -- start start 2024-09-15T23:59:37.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2be406fe50 0x7f2be414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be41520a0 0x7f2be415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2be415f1d0 0x7f2be41605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2be4073d30 con 0x7f2be41520a0 2024-09-15T23:59:37.222 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2be4073a50 con 0x7f2be406fe50 2024-09-15T23:59:37.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be9346640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2be415f600 con 0x7f2be415f1d0 2024-09-15T23:59:37.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be27fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be41520a0 0x7f2be415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be27fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be41520a0 0x7f2be415a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38664/0 (socket says 172.21.15.112:38664) 2024-09-15T23:59:37.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.216+0000 7f2be27fc640 1 -- 172.21.15.112:0/2442463019 learned_addr learned my addr 172.21.15.112:0/2442463019 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:37.223 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2be27fc640 1 -- 172.21.15.112:0/2442463019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2be415f1d0 msgr2=0x7f2be41605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2be37fe640 1 --2- 172.21.15.112:0/2442463019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2be415f1d0 0x7f2be41605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2be27fc640 1 --2- 172.21.15.112:0/2442463019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2be415f1d0 0x7f2be41605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2be27fc640 1 -- 172.21.15.112:0/2442463019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2be406fe50 msgr2=0x7f2be414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2be2ffd640 1 --2- 172.21.15.112:0/2442463019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2be406fe50 0x7f2be414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.224 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2be27fc640 1 --2- 172.21.15.112:0/2442463019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2be406fe50 0x7f2be414f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2be27fc640 1 -- 172.21.15.112:0/2442463019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be4162680 con 0x7f2be41520a0 2024-09-15T23:59:37.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2be27fc640 1 --2- 172.21.15.112:0/2442463019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be41520a0 0x7f2be415a9c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc01a0b0 tx=0x7f2bcc01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2bdb7fe640 1 -- 172.21.15.112:0/2442463019 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc0bc070 con 0x7f2be41520a0 2024-09-15T23:59:37.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2bdb7fe640 1 -- 172.21.15.112:0/2442463019 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bcc0b7430 con 0x7f2be41520a0 2024-09-15T23:59:37.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2be9346640 1 -- 172.21.15.112:0/2442463019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be41505d0 con 0x7f2be41520a0 2024-09-15T23:59:37.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2bdb7fe640 1 -- 172.21.15.112:0/2442463019 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc0b1040 con 0x7f2be41520a0 2024-09-15T23:59:37.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2be9346640 1 -- 172.21.15.112:0/2442463019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be409c5d0 con 0x7f2be41520a0 2024-09-15T23:59:37.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2be9346640 1 -- 172.21.15.112:0/2442463019 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be415ec90 con 0x7f2be41520a0 2024-09-15T23:59:37.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2bdb7fe640 1 -- 172.21.15.112:0/2442463019 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2bcc0bf070 con 0x7f2be41520a0 2024-09-15T23:59:37.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2bdb7fe640 1 --2- 172.21.15.112:0/2442463019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2bc40678c0 0x7f2bc4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2bdb7fe640 1 -- 172.21.15.112:0/2442463019 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f2bcc11f3d0 con 0x7f2be41520a0 2024-09-15T23:59:37.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2be2ffd640 1 --2- 172.21.15.112:0/2442463019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2bc40678c0 0x7f2bc4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.220+0000 7f2be2ffd640 1 --2- 172.21.15.112:0/2442463019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2bc40678c0 0x7f2bc4069d80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc006fd0 tx=0x7f2bdc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.224+0000 7f2bdb7fe640 1 -- 172.21.15.112:0/2442463019 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2be4162680 con 0x7f2be41520a0 2024-09-15T23:59:37.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.384+0000 7f2be9346640 1 -- 172.21.15.112:0/2442463019 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f2be406ced0 con 0x7f2bc40678c0 2024-09-15T23:59:37.385 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.384+0000 7f2bdb7fe640 1 -- 172.21.15.112:0/2442463019 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2be406ced0 con 0x7f2bc40678c0 2024-09-15T23:59:37.386 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 6 to deep-scrub 2024-09-15T23:59:37.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.388+0000 7f2be9346640 1 -- 172.21.15.112:0/2442463019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2bc40678c0 msgr2=0x7f2bc4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.388+0000 7f2be9346640 1 --2- 172.21.15.112:0/2442463019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2bc40678c0 0x7f2bc4069d80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc006fd0 tx=0x7f2bdc008040 comp rx=0 tx=0).stop 2024-09-15T23:59:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.388+0000 7f2be9346640 1 -- 172.21.15.112:0/2442463019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be41520a0 msgr2=0x7f2be415a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.388+0000 7f2be9346640 1 --2- 172.21.15.112:0/2442463019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be41520a0 0x7f2be415a9c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc01a0b0 tx=0x7f2bcc01acc0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.388+0000 7f2be9346640 1 -- 172.21.15.112:0/2442463019 shutdown_connections 2024-09-15T23:59:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.388+0000 7f2be9346640 1 --2- 172.21.15.112:0/2442463019 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f2bc40678c0 0x7f2bc4069d80 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.388+0000 7f2be9346640 1 --2- 172.21.15.112:0/2442463019 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2be415f1d0 0x7f2be41605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.388+0000 7f2be9346640 1 --2- 172.21.15.112:0/2442463019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2be41520a0 0x7f2be415a9c0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.388+0000 7f2be9346640 1 --2- 172.21.15.112:0/2442463019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2be406fe50 0x7f2be414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.388 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.388+0000 7f2be9346640 1 -- 172.21.15.112:0/2442463019 >> 172.21.15.112:0/2442463019 conn(0x7f2be40b1f90 msgr2=0x7f2be40cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:37.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.388+0000 7f2be9346640 1 -- 172.21.15.112:0/2442463019 shutdown_connections 2024-09-15T23:59:37.389 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.388+0000 7f2be9346640 1 -- 172.21.15.112:0/2442463019 wait complete. 2024-09-15T23:59:37.403 INFO:tasks.ceph:Scrubbing osd.7 2024-09-15T23:59:37.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:59:37.515 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.516+0000 7efe94806640 1 Processor -- start 2024-09-15T23:59:37.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.516+0000 7efe94806640 1 -- start start 2024-09-15T23:59:37.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.516+0000 7efe94806640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efe9006c3d0 0x7efe9009aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.516+0000 7efe94806640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe900b5c90 con 0x7efe900b40c0 2024-09-15T23:59:37.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.516+0000 7efe94806640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe900b4580 con 0x7efe9015e450 2024-09-15T23:59:37.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.516+0000 7efe94806640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7efe900b4860 con 0x7efe9006c3d0 2024-09-15T23:59:37.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.516+0000 7efe8dd9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7efe9006c3d0 0x7efe9009aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.516+0000 7efe8ed9d640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7efe900b40c0 0x7efe90162370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51086/0 (socket says 172.21.15.112:51086) 2024-09-15T23:59:37.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.516+0000 7efe8ed9d640 1 -- 172.21.15.112:0/854114819 learned_addr learned my addr 172.21.15.112:0/854114819 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:37.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.516+0000 7efe8dd9b640 1 -- 172.21.15.112:0/854114819 >> v1:172.21.15.169:6789/0 conn(0x7efe9015e450 legacy=0x7efe9006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:37.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.516+0000 7efe8dd9b640 1 -- 172.21.15.112:0/854114819 >> v1:172.21.15.112:6789/0 conn(0x7efe900b40c0 legacy=0x7efe90162370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.516+0000 7efe8dd9b640 1 -- 172.21.15.112:0/854114819 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe900b5f10 con 0x7efe9006c3d0 2024-09-15T23:59:37.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe8dd9b640 1 --2- 172.21.15.112:0/854114819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe9006c3d0 0x7efe9009aa00 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7efe840097c0 tx=0x7efe8401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e11a7abb9e9a7d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe8d59a640 1 -- 172.21.15.112:0/854114819 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe840b0070 con 0x7efe9006c3d0 2024-09-15T23:59:37.519 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe8d59a640 1 -- 172.21.15.112:0/854114819 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe840ab600 con 0x7efe9006c3d0 2024-09-15T23:59:37.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe8d59a640 1 -- 172.21.15.112:0/854114819 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe840ab9d0 con 0x7efe9006c3d0 2024-09-15T23:59:37.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 -- 172.21.15.112:0/854114819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe9006c3d0 msgr2=0x7efe9009aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 --2- 172.21.15.112:0/854114819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe9006c3d0 0x7efe9009aa00 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7efe840097c0 tx=0x7efe8401c260 comp rx=0 tx=0).stop 2024-09-15T23:59:37.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 -- 172.21.15.112:0/854114819 shutdown_connections 2024-09-15T23:59:37.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 --2- 172.21.15.112:0/854114819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe9006c3d0 0x7efe9009aa00 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 -- 172.21.15.112:0/854114819 >> 172.21.15.112:0/854114819 conn(0x7efe900b6800 msgr2=0x7efe900b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:37.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 -- 172.21.15.112:0/854114819 shutdown_connections 2024-09-15T23:59:37.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 -- 172.21.15.112:0/854114819 wait complete. 2024-09-15T23:59:37.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 Processor -- start 2024-09-15T23:59:37.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 -- start start 2024-09-15T23:59:37.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe9006c3d0 0x7efe90156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe900b40c0 0x7efe9009d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe9015e450 0x7efe900aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efe90073720 con 0x7efe9006c3d0 2024-09-15T23:59:37.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efe900735a0 con 0x7efe900b40c0 2024-09-15T23:59:37.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe94806640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efe9015f840 con 0x7efe9015e450 2024-09-15T23:59:37.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe8e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe9006c3d0 0x7efe90156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe8e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe9006c3d0 0x7efe90156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38672/0 (socket says 172.21.15.112:38672) 2024-09-15T23:59:37.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe8e59c640 1 -- 172.21.15.112:0/337779940 learned_addr learned my addr 172.21.15.112:0/337779940 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:37.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe8dd9b640 1 --2- 172.21.15.112:0/337779940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe900b40c0 0x7efe9009d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe8ed9d640 1 --2- 172.21.15.112:0/337779940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe9015e450 0x7efe900aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe8e59c640 1 -- 172.21.15.112:0/337779940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe9015e450 msgr2=0x7efe900aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe8e59c640 1 --2- 172.21.15.112:0/337779940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe9015e450 0x7efe900aec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe8e59c640 1 -- 172.21.15.112:0/337779940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe900b40c0 msgr2=0x7efe9009d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe8e59c640 1 --2- 172.21.15.112:0/337779940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe900b40c0 0x7efe9009d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.520+0000 7efe8e59c640 1 -- 172.21.15.112:0/337779940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe901f3df0 con 0x7efe9006c3d0 2024-09-15T23:59:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe8e59c640 1 --2- 172.21.15.112:0/337779940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe9006c3d0 0x7efe90156e90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7efe8800ba50 tx=0x7efe8800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe7effd640 1 -- 172.21.15.112:0/337779940 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88019070 con 0x7efe9006c3d0 2024-09-15T23:59:37.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe7effd640 1 -- 172.21.15.112:0/337779940 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe8800cc20 con 0x7efe9006c3d0 2024-09-15T23:59:37.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe7effd640 1 -- 172.21.15.112:0/337779940 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88014680 con 0x7efe9006c3d0 2024-09-15T23:59:37.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe94806640 1 -- 172.21.15.112:0/337779940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe901f40b0 con 0x7efe9006c3d0 2024-09-15T23:59:37.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe94806640 1 -- 172.21.15.112:0/337779940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe901f4670 con 0x7efe9006c3d0 2024-09-15T23:59:37.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe94806640 1 -- 172.21.15.112:0/337779940 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efe900b0c60 con 0x7efe9006c3d0 2024-09-15T23:59:37.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe7effd640 1 -- 172.21.15.112:0/337779940 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe8801c070 con 0x7efe9006c3d0 2024-09-15T23:59:37.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe7effd640 1 --2- 172.21.15.112:0/337779940 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe700678c0 0x7efe70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.528 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe7effd640 1 -- 172.21.15.112:0/337779940 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7efe88086250 con 0x7efe9006c3d0 2024-09-15T23:59:37.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe8dd9b640 1 --2- 172.21.15.112:0/337779940 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe700678c0 0x7efe70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe7effd640 1 --2- 172.21.15.112:0/337779940 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x7efe7006dd60 0x7efe700701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe7effd640 1 -- 172.21.15.112:0/337779940 --> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe88010e50 con 0x7efe7006dd60 2024-09-15T23:59:37.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe7effd640 1 -- 172.21.15.112:0/337779940 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7efe880866e0 con 0x7efe9006c3d0 2024-09-15T23:59:37.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe8dd9b640 1 --2- 172.21.15.112:0/337779940 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe700678c0 0x7efe70069d80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efe840ad000 tx=0x7efe84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe8ed9d640 1 --2- 172.21.15.112:0/337779940 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x7efe7006dd60 0x7efe700701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.524+0000 7efe8ed9d640 1 --2- 172.21.15.112:0/337779940 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x7efe7006dd60 0x7efe700701a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.528+0000 7efe7effd640 1 -- 172.21.15.112:0/337779940 <== osd.7 v2:172.21.15.169:6808/189050588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efe88010e50 con 0x7efe7006dd60 2024-09-15T23:59:37.539 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.540+0000 7efe94806640 1 -- 172.21.15.112:0/337779940 --> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efe9009aa00 con 0x7efe7006dd60 2024-09-15T23:59:37.540 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.540+0000 7efe7effd640 1 -- 172.21.15.112:0/337779940 <== osd.7 v2:172.21.15.169:6808/189050588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efe9009aa00 con 0x7efe7006dd60 2024-09-15T23:59:37.540 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:59:37.541 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:59:37.541 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:59:37.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.540+0000 7efe94806640 1 -- 172.21.15.112:0/337779940 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x7efe7006dd60 msgr2=0x7efe700701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.540+0000 7efe94806640 1 --2- 172.21.15.112:0/337779940 >> [v2:172.21.15.169:6808/189050588,v1:172.21.15.169:6809/189050588] conn(0x7efe7006dd60 0x7efe700701a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.540+0000 7efe94806640 1 -- 172.21.15.112:0/337779940 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe700678c0 msgr2=0x7efe70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.540+0000 7efe94806640 1 --2- 172.21.15.112:0/337779940 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7efe700678c0 0x7efe70069d80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efe840ad000 tx=0x7efe84008040 comp rx=0 tx=0).stop 2024-09-15T23:59:37.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.540+0000 7efe94806640 1 -- 172.21.15.112:0/337779940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe9006c3d0 msgr2=0x7efe90156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.540+0000 7efe94806640 1 --2- 172.21.15.112:0/337779940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe9006c3d0 0x7efe90156e90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7efe8800ba50 tx=0x7efe8800bf10 comp rx=0 tx=0).stop 2024-09-15T23:59:37.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.540+0000 7efe8ed9d640 1 -- 172.21.15.112:0/337779940 reap_dead start 2024-09-15T23:59:37.542 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.540+0000 7efe94806640 1 -- 172.21.15.112:0/337779940 shutdown_connections 2024-09-15T23:59:37.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.540+0000 7efe94806640 1 -- 172.21.15.112:0/337779940 >> 172.21.15.112:0/337779940 conn(0x7efe900b6800 msgr2=0x7efe9015fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:37.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.540+0000 7efe94806640 1 -- 172.21.15.112:0/337779940 shutdown_connections 2024-09-15T23:59:37.543 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.540+0000 7efe94806640 1 -- 172.21.15.112:0/337779940 wait complete. 2024-09-15T23:59:37.555 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-15T23:59:37.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f6615640 1 Processor -- start 2024-09-15T23:59:37.660 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f6615640 1 -- start start 2024-09-15T23:59:37.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f6615640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb1f015bec0 0x7fb1f00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f6615640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f015c2a0 0x7fb1f00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f6615640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f00b3290 con 0x7fb1f00af2a0 2024-09-15T23:59:37.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f6615640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f00b3570 con 0x7fb1f015bec0 2024-09-15T23:59:37.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f6615640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f00b3850 con 0x7fb1f015c2a0 2024-09-15T23:59:37.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f4bb2640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fb1f00af2a0 0x7fb1f015fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51092/0 (socket says 172.21.15.112:51092) 2024-09-15T23:59:37.663 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f4bb2640 1 -- 172.21.15.112:0/3276709845 learned_addr learned my addr 172.21.15.112:0/3276709845 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:37.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1effff640 1 --2- 172.21.15.112:0/3276709845 >> v2:172.21.15.169:3300/0 conn(0x7fb1f015bec0 0x7fb1f00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 -- 172.21.15.112:0/3276709845 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732222557 0 0) 0x7fb1f00b3290 con 0x7fb1f00af2a0 2024-09-15T23:59:37.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 -- 172.21.15.112:0/3276709845 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1d8003530 con 0x7fb1f00af2a0 2024-09-15T23:59:37.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1ef7fe640 1 --2- 172.21.15.112:0/3276709845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f015c2a0 0x7fb1f00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 -- 172.21.15.112:0/3276709845 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 449036112 0 0) 0x7fb1d8003530 con 0x7fb1f00af2a0 2024-09-15T23:59:37.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 -- 172.21.15.112:0/3276709845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f015c2a0 msgr2=0x7fb1f00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:37.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 --2- 172.21.15.112:0/3276709845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f015c2a0 0x7fb1f00aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 -- 172.21.15.112:0/3276709845 >> v2:172.21.15.169:3300/0 conn(0x7fb1f015bec0 msgr2=0x7fb1f00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:37.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 --2- 172.21.15.112:0/3276709845 >> v2:172.21.15.169:3300/0 conn(0x7fb1f015bec0 0x7fb1f00ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 -- 172.21.15.112:0/3276709845 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f00b3b30 con 0x7fb1f00af2a0 2024-09-15T23:59:37.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 -- 172.21.15.112:0/3276709845 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fb1e8001a00 con 0x7fb1f00af2a0 2024-09-15T23:59:37.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1ef7fe640 1 --2- 172.21.15.112:0/3276709845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f015c2a0 0x7fb1f00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:59:37.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 -- 172.21.15.112:0/3276709845 >> v1:172.21.15.112:6789/0 conn(0x7fb1f00af2a0 legacy=0x7fb1f015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.665 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 --2- 172.21.15.112:0/3276709845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1d80039c0 0x7fb1d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 --2- 172.21.15.112:0/3276709845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f015c2a0 0x7fb1d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 --2- 172.21.15.112:0/3276709845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1d8004d50 0x7fb1d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 -- 172.21.15.112:0/3276709845 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f00b3570 con 0x7fb1d8004d50 2024-09-15T23:59:37.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 -- 172.21.15.112:0/3276709845 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f00b3850 con 0x7fb1d80039c0 2024-09-15T23:59:37.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1eeffd640 1 -- 172.21.15.112:0/3276709845 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d800b9d0 con 0x7fb1f015c2a0 2024-09-15T23:59:37.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f4bb2640 1 --2- 172.21.15.112:0/3276709845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1d8004d50 0x7fb1d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1ef7fe640 1 --2- 172.21.15.112:0/3276709845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f015c2a0 0x7fb1d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1effff640 1 --2- 172.21.15.112:0/3276709845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1d80039c0 0x7fb1d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f4bb2640 1 -- 172.21.15.112:0/3276709845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f015c2a0 msgr2=0x7fb1d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:37.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f4bb2640 1 --2- 172.21.15.112:0/3276709845 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f015c2a0 0x7fb1d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f4bb2640 1 -- 172.21.15.112:0/3276709845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1d80039c0 msgr2=0x7fb1d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:37.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f4bb2640 1 --2- 172.21.15.112:0/3276709845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1d80039c0 0x7fb1d8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.660+0000 7fb1f4bb2640 1 -- 172.21.15.112:0/3276709845 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d8003530 con 0x7fb1d8004d50 2024-09-15T23:59:37.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.664+0000 7fb1f4bb2640 1 --2- 172.21.15.112:0/3276709845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1d8004d50 0x7fb1d80051d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800a880 tx=0x7fb1e801d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3ad60b248bdb90 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.664+0000 7fb1eeffd640 1 -- 172.21.15.112:0/3276709845 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e800a4a0 con 0x7fb1d8004d50 2024-09-15T23:59:37.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.664+0000 7fb1eeffd640 1 -- 172.21.15.112:0/3276709845 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e80ad630 con 0x7fb1d8004d50 2024-09-15T23:59:37.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.664+0000 7fb1eeffd640 1 -- 172.21.15.112:0/3276709845 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80ada60 con 0x7fb1d8004d50 2024-09-15T23:59:37.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.664+0000 7fb1f6615640 1 -- 172.21.15.112:0/3276709845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1d8004d50 msgr2=0x7fb1d80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.664+0000 7fb1f6615640 1 --2- 172.21.15.112:0/3276709845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1d8004d50 0x7fb1d80051d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800a880 tx=0x7fb1e801d3a0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.664+0000 7fb1f4bb2640 1 -- 172.21.15.112:0/3276709845 reap_dead start 2024-09-15T23:59:37.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.664+0000 7fb1f6615640 1 -- 172.21.15.112:0/3276709845 shutdown_connections 2024-09-15T23:59:37.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.664+0000 7fb1f6615640 1 -- 172.21.15.112:0/3276709845 >> 172.21.15.112:0/3276709845 conn(0x7fb1f00b1f90 msgr2=0x7fb1f00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:37.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.664+0000 7fb1f6615640 1 -- 172.21.15.112:0/3276709845 shutdown_connections 2024-09-15T23:59:37.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.664+0000 7fb1f6615640 1 -- 172.21.15.112:0/3276709845 wait complete. 2024-09-15T23:59:37.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1f6615640 1 Processor -- start 2024-09-15T23:59:37.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1f6615640 1 -- start start 2024-09-15T23:59:37.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1f6615640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1f014d340 0x7fb1f0154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1f6615640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1f014d720 0x7fb1f014e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1f6615640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f0154a90 0x7fb1f014e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1f6615640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f00af730 con 0x7fb1f014d720 2024-09-15T23:59:37.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1f6615640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f00b40f0 con 0x7fb1f014d340 2024-09-15T23:59:37.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1f6615640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f00afc90 con 0x7fb1f0154a90 2024-09-15T23:59:37.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1ef7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1f014d720 0x7fb1f014e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1ef7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1f014d720 0x7fb1f014e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38692/0 (socket says 172.21.15.112:38692) 2024-09-15T23:59:37.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1ef7fe640 1 -- 172.21.15.112:0/3992609858 learned_addr learned my addr 172.21.15.112:0/3992609858 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:37.674 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1effff640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1f014d340 0x7fb1f0154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1f4bb2640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f0154a90 0x7fb1f014e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1ef7fe640 1 -- 172.21.15.112:0/3992609858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f0154a90 msgr2=0x7fb1f014e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1ef7fe640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f0154a90 0x7fb1f014e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1ef7fe640 1 -- 172.21.15.112:0/3992609858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1f014d340 msgr2=0x7fb1f0154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1ef7fe640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1f014d340 0x7fb1f0154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1ef7fe640 1 -- 172.21.15.112:0/3992609858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f014de70 con 0x7fb1f014d720 2024-09-15T23:59:37.675 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1effff640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1f014d340 0x7fb1f0154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:37.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1f4bb2640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f0154a90 0x7fb1f014e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:37.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1ef7fe640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1f014d720 0x7fb1f014e310 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4011700 tx=0x7fb1e4011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1ecff9640 1 -- 172.21.15.112:0/3992609858 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4019020 con 0x7fb1f014d720 2024-09-15T23:59:37.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1ecff9640 1 -- 172.21.15.112:0/3992609858 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e4004230 con 0x7fb1f014d720 2024-09-15T23:59:37.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1f6615640 1 -- 172.21.15.112:0/3992609858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f01f58e0 con 0x7fb1f014d720 2024-09-15T23:59:37.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1ecff9640 1 -- 172.21.15.112:0/3992609858 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e400c070 con 0x7fb1f014d720 2024-09-15T23:59:37.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1f6615640 1 -- 172.21.15.112:0/3992609858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f01f5ea0 con 0x7fb1f014d720 2024-09-15T23:59:37.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1f6615640 1 -- 172.21.15.112:0/3992609858 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f00aed60 con 0x7fb1f014d720 2024-09-15T23:59:37.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1ecff9640 1 -- 172.21.15.112:0/3992609858 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1e401c020 con 0x7fb1f014d720 2024-09-15T23:59:37.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.668+0000 7fb1ecff9640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb1dc0678c0 0x7fb1dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.672+0000 7fb1ecff9640 1 -- 172.21.15.112:0/3992609858 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7fb1e4085f40 con 0x7fb1f014d720 2024-09-15T23:59:37.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.672+0000 7fb1effff640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb1dc0678c0 0x7fb1dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.677 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.672+0000 7fb1effff640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb1dc0678c0 0x7fb1dc069d80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009b50 tx=0x7fb1e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.678 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.676+0000 7fb1ecff9640 1 -- 172.21.15.112:0/3992609858 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb1e4023020 con 0x7fb1f014d720 2024-09-15T23:59:37.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.836+0000 7fb1f6615640 1 -- 172.21.15.112:0/3992609858 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fb1f01f5690 con 0x7fb1dc0678c0 2024-09-15T23:59:37.836 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.836+0000 7fb1ecff9640 1 -- 172.21.15.112:0/3992609858 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb1f01f5690 con 0x7fb1dc0678c0 2024-09-15T23:59:37.836 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 7 to deep-scrub 2024-09-15T23:59:37.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.840+0000 7fb1f6615640 1 -- 172.21.15.112:0/3992609858 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb1dc0678c0 msgr2=0x7fb1dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.840+0000 7fb1f6615640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb1dc0678c0 0x7fb1dc069d80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009b50 tx=0x7fb1e0008040 comp rx=0 tx=0).stop 2024-09-15T23:59:37.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.840+0000 7fb1f6615640 1 -- 172.21.15.112:0/3992609858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1f014d720 msgr2=0x7fb1f014e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.840+0000 7fb1f6615640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1f014d720 0x7fb1f014e310 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4011700 tx=0x7fb1e4011bc0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.839 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.840+0000 7fb1f6615640 1 -- 172.21.15.112:0/3992609858 shutdown_connections 2024-09-15T23:59:37.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.840+0000 7fb1f6615640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fb1dc0678c0 0x7fb1dc069d80 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.840+0000 7fb1f6615640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1f0154a90 0x7fb1f014e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.840+0000 7fb1f6615640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1f014d720 0x7fb1f014e310 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.840+0000 7fb1f6615640 1 --2- 172.21.15.112:0/3992609858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1f014d340 0x7fb1f0154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.840+0000 7fb1f6615640 1 -- 172.21.15.112:0/3992609858 >> 172.21.15.112:0/3992609858 conn(0x7fb1f00b1f90 msgr2=0x7fb1f00b11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:37.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.840+0000 7fb1f6615640 1 -- 172.21.15.112:0/3992609858 shutdown_connections 2024-09-15T23:59:37.840 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.840+0000 7fb1f6615640 1 -- 172.21.15.112:0/3992609858 wait complete. 2024-09-15T23:59:37.857 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:59:37.974 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29ae32d640 1 Processor -- start 2024-09-15T23:59:37.975 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29ae32d640 1 -- start start 2024-09-15T23:59:37.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29ae32d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f29a815bec0 0x7f29a80ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.976 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29ae32d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29a815c2a0 0x7f29a80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29ae32d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a80b3290 con 0x7f29a80af2a0 2024-09-15T23:59:37.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29ae32d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f29a80b3570 con 0x7f29a815bec0 2024-09-15T23:59:37.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29ae32d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f29a80b3850 con 0x7f29a815c2a0 2024-09-15T23:59:37.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29a7fff640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f29a815bec0 0x7f29a80ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29ac8ca640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f29a80af2a0 0x7f29a815fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:51100/0 (socket says 172.21.15.112:51100) 2024-09-15T23:59:37.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29ac8ca640 1 -- 172.21.15.112:0/3567332264 learned_addr learned my addr 172.21.15.112:0/3567332264 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:37.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f299f7fe640 1 --2- 172.21.15.112:0/3567332264 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29a815c2a0 0x7f29a80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29a7fff640 1 -- 172.21.15.112:0/3567332264 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29a815c2a0 msgr2=0x7f29a80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:37.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29a7fff640 1 --2- 172.21.15.112:0/3567332264 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29a815c2a0 0x7f29a80aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29a7fff640 1 -- 172.21.15.112:0/3567332264 >> v1:172.21.15.112:6789/0 conn(0x7f29a80af2a0 legacy=0x7f29a815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29a7fff640 1 -- 172.21.15.112:0/3567332264 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a80b3b30 con 0x7f29a815bec0 2024-09-15T23:59:37.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29a77fe640 1 -- 172.21.15.112:0/3567332264 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 275755118 0 0) 0x7f29a80b3290 con 0x7f29a80af2a0 2024-09-15T23:59:37.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f299f7fe640 1 --2- 172.21.15.112:0/3567332264 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29a815c2a0 0x7f29a80aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:37.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.976+0000 7f29a7fff640 1 --2- 172.21.15.112:0/3567332264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a815bec0 0x7f29a80ad200 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f29980097c0 tx=0x7f299801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c05cdab7205a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29a77fe640 1 -- 172.21.15.112:0/3567332264 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29980a7070 con 0x7f29a815bec0 2024-09-15T23:59:37.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29a77fe640 1 -- 172.21.15.112:0/3567332264 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29980b0070 con 0x7f29a815bec0 2024-09-15T23:59:37.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29a77fe640 1 -- 172.21.15.112:0/3567332264 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29980ab890 con 0x7f29a815bec0 2024-09-15T23:59:37.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 -- 172.21.15.112:0/3567332264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a815bec0 msgr2=0x7f29a80ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 --2- 172.21.15.112:0/3567332264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a815bec0 0x7f29a80ad200 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f29980097c0 tx=0x7f299801c470 comp rx=0 tx=0).stop 2024-09-15T23:59:37.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 -- 172.21.15.112:0/3567332264 shutdown_connections 2024-09-15T23:59:37.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 --2- 172.21.15.112:0/3567332264 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29a815c2a0 0x7f29a80aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 --2- 172.21.15.112:0/3567332264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a815bec0 0x7f29a80ad200 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 -- 172.21.15.112:0/3567332264 >> 172.21.15.112:0/3567332264 conn(0x7f29a80b1f90 msgr2=0x7f29a80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:37.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 -- 172.21.15.112:0/3567332264 shutdown_connections 2024-09-15T23:59:37.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 -- 172.21.15.112:0/3567332264 wait complete. 2024-09-15T23:59:37.982 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 Processor -- start 2024-09-15T23:59:37.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 -- start start 2024-09-15T23:59:37.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29a80af2a0 0x7f29a8155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a815bec0 0x7f29a815e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29a815c2a0 0x7f29a8165080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f29a80af6f0 con 0x7f29a815bec0 2024-09-15T23:59:37.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29a80ad740 con 0x7f29a80af2a0 2024-09-15T23:59:37.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f29a8169000 con 0x7f29a815c2a0 2024-09-15T23:59:37.983 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f299f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a815bec0 0x7f29a815e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f299f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a815bec0 0x7f29a815e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38720/0 (socket says 172.21.15.112:38720) 2024-09-15T23:59:37.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f299f7fe640 1 -- 172.21.15.112:0/296315865 learned_addr learned my addr 172.21.15.112:0/296315865 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:37.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f299f7fe640 1 -- 172.21.15.112:0/296315865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29a815c2a0 msgr2=0x7f29a8165080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f299f7fe640 1 --2- 172.21.15.112:0/296315865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29a815c2a0 0x7f29a8165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f299f7fe640 1 -- 172.21.15.112:0/296315865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29a80af2a0 msgr2=0x7f29a8155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:37.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f299f7fe640 1 --2- 172.21.15.112:0/296315865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29a80af2a0 0x7f29a8155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:37.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f299f7fe640 1 -- 172.21.15.112:0/296315865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a815eaf0 con 0x7f29a815bec0 2024-09-15T23:59:37.984 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f299f7fe640 1 --2- 172.21.15.112:0/296315865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a815bec0 0x7f29a815e5b0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f299000c820 tx=0x7f299000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29a57fa640 1 -- 172.21.15.112:0/296315865 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990015070 con 0x7f29a815bec0 2024-09-15T23:59:37.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29a57fa640 1 -- 172.21.15.112:0/296315865 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2990007a30 con 0x7f29a815bec0 2024-09-15T23:59:37.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29a57fa640 1 -- 172.21.15.112:0/296315865 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990007e40 con 0x7f29a815bec0 2024-09-15T23:59:37.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 -- 172.21.15.112:0/296315865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a815edb0 con 0x7f29a815bec0 2024-09-15T23:59:37.985 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.980+0000 7f29ae32d640 1 -- 172.21.15.112:0/296315865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a815f370 con 0x7f29a815bec0 2024-09-15T23:59:37.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.984+0000 7f29ae32d640 1 -- 172.21.15.112:0/296315865 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a80ad200 con 0x7f29a815bec0 2024-09-15T23:59:37.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.984+0000 7f29a57fa640 1 -- 172.21.15.112:0/296315865 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2990018070 con 0x7f29a815bec0 2024-09-15T23:59:37.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.984+0000 7f29a57fa640 1 --2- 172.21.15.112:0/296315865 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f29880678c0 0x7f2988069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:37.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.984+0000 7f29a57fa640 1 -- 172.21.15.112:0/296315865 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f2990085960 con 0x7f29a815bec0 2024-09-15T23:59:37.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.984+0000 7f29a7fff640 1 --2- 172.21.15.112:0/296315865 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f29880678c0 0x7f2988069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:37.987 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.984+0000 7f29a7fff640 1 --2- 172.21.15.112:0/296315865 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f29880678c0 0x7f2988069d80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f29980af000 tx=0x7f2998004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:37.988 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:37.988+0000 7f29a57fa640 1 -- 172.21.15.112:0/296315865 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f29900566a0 con 0x7f29a815bec0 2024-09-15T23:59:38.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:38.132+0000 7f29ae32d640 1 -- 172.21.15.112:0/296315865 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29a806fcd0 con 0x7f29880678c0 2024-09-15T23:59:38.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:38.136+0000 7f29a57fa640 1 -- 172.21.15.112:0/296315865 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13488 (secure 0 0 0) 0x7f29a806fcd0 con 0x7f29880678c0 2024-09-15T23:59:38.135 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:38.136 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:59:38.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:38.136+0000 7f29ae32d640 1 -- 172.21.15.112:0/296315865 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f29880678c0 msgr2=0x7f2988069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:38.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:38.136+0000 7f29ae32d640 1 --2- 172.21.15.112:0/296315865 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f29880678c0 0x7f2988069d80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f29980af000 tx=0x7f2998004740 comp rx=0 tx=0).stop 2024-09-15T23:59:38.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:38.136+0000 7f29ae32d640 1 -- 172.21.15.112:0/296315865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a815bec0 msgr2=0x7f29a815e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:38.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:38.136+0000 7f29ae32d640 1 --2- 172.21.15.112:0/296315865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a815bec0 0x7f29a815e5b0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f299000c820 tx=0x7f299000cce0 comp rx=0 tx=0).stop 2024-09-15T23:59:38.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:38.136+0000 7f29ae32d640 1 -- 172.21.15.112:0/296315865 shutdown_connections 2024-09-15T23:59:38.138 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:38.136+0000 7f29ae32d640 1 --2- 172.21.15.112:0/296315865 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f29880678c0 0x7f2988069d80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:38.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:38.136+0000 7f29ae32d640 1 --2- 172.21.15.112:0/296315865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29a815c2a0 0x7f29a8165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:38.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:38.136+0000 7f29ae32d640 1 --2- 172.21.15.112:0/296315865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29a815bec0 0x7f29a815e5b0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:38.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:38.136+0000 7f29ae32d640 1 --2- 172.21.15.112:0/296315865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29a80af2a0 0x7f29a8155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:38.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:38.136+0000 7f29ae32d640 1 -- 172.21.15.112:0/296315865 >> 172.21.15.112:0/296315865 conn(0x7f29a80b1f90 msgr2=0x7f29a80b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:38.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:38.136+0000 7f29ae32d640 1 -- 172.21.15.112:0/296315865 shutdown_connections 2024-09-15T23:59:38.139 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:38.136+0000 7f29ae32d640 1 -- 172.21.15.112:0/296315865 wait complete. 2024-09-15T23:59:38.152 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-09-15T23:59:37.338094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":332876,"kb_used_data":12648,"kb_used_omap":12,"kb_used_meta":320051,"kb_avail":754641844,"statfs":{"total":773094113280,"available":772753248256,"internally_reserved":0,"allocated":12951552,"data_stored":6609024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":327732784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8388608,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-4,"num_write_kb":-8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.897389"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":346,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-15T23:59:29.453471+0000","last_change":"2024-09-15T23:53:41.154129+0000","last_active":"2024-09-15T23:59:29.453471+0000","last_peered":"2024-09-15T23:59:29.453471+0000","last_clean":"2024-09-15T23:59:29.453471+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:59:29.453471+0000","last_undegraded":"2024-09-15T23:59:29.453471+0000","last_fullsized":"2024-09-15T23:59:29.453471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:53:40.022158+0000","last_clean_scrub_stamp":"2024-09-15T23:53:40.022158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:06.697037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40944,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330896,"statfs":{"total":96636764160,"available":96594837504,"internally_reserved":0,"allocated":1470464,"data_stored":678536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509514,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40944,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330896,"statfs":{"total":96636764160,"available":96594837504,"internally_reserved":0,"allocated":1470464,"data_stored":678536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45104,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326736,"statfs":{"total":96636764160,"available":96590577664,"internally_reserved":0,"allocated":1470464,"data_stored":678536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40948,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330892,"statfs":{"total":96636764160,"available":96594833408,"internally_reserved":0,"allocated":1470464,"data_stored":678536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40944,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330896,"statfs":{"total":96636764160,"available":96594837504,"internally_reserved":0,"allocated":1470464,"data_stored":678536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41528,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330312,"statfs":{"total":96636764160,"available":96594239488,"internally_reserved":0,"allocated":2064384,"data_stored":1268904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509514,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40944,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330896,"statfs":{"total":96636764160,"available":96594837504,"internally_reserved":0,"allocated":1470464,"data_stored":678536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41520,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330320,"statfs":{"total":96636764160,"available":96594247680,"internally_reserved":0,"allocated":2064384,"data_stored":1268904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:59:38.155 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-15T23:53:40.022158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=23, tm_min=53, tm_sec=40, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=23, tm_min=59, tm_sec=33, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T23:59:38.155 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T23:59:44.368 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:59:44.371 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:59:58.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:59:58.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f990ca8d640 1 Processor -- start 2024-09-15T23:59:58.287 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f990ca8d640 1 -- start start 2024-09-15T23:59:58.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f990ca8d640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f990815c2a0 0x7f99080aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f990ca8d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f99080af2a0 0x7f990806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.288 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f990ca8d640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99080b3290 con 0x7f990815bec0 2024-09-15T23:59:58.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f990ca8d640 1 -- --> v2:172.21.15.112:3300/0 -- mon_getmap magic: 0 -- 0x7f99080b3570 con 0x7f990815c2a0 2024-09-15T23:59:58.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f990ca8d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f99080b3850 con 0x7f99080af2a0 2024-09-15T23:59:58.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f9905d9b640 1 --2- >> v2:172.21.15.112:3300/0 conn(0x7f990815c2a0 0x7f99080aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f990659c640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7f990815bec0 0x7f99080ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33992/0 (socket says 172.21.15.112:33992) 2024-09-15T23:59:58.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f990659c640 1 -- 172.21.15.112:0/3080204711 learned_addr learned my addr 172.21.15.112:0/3080204711 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:58.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f9905d9b640 1 -- 172.21.15.112:0/3080204711 >> v2:172.21.15.169:3300/0 conn(0x7f99080af2a0 msgr2=0x7f990806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:58.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f9906d9d640 1 --2- 172.21.15.112:0/3080204711 >> v2:172.21.15.169:3300/0 conn(0x7f99080af2a0 0x7f990806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.289 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f9905d9b640 1 --2- 172.21.15.112:0/3080204711 >> v2:172.21.15.169:3300/0 conn(0x7f99080af2a0 0x7f990806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f9905d9b640 1 -- 172.21.15.112:0/3080204711 >> v1:172.21.15.112:6789/0 conn(0x7f990815bec0 legacy=0x7f99080ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f9905d9b640 1 -- 172.21.15.112:0/3080204711 --> v2:172.21.15.112:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99080b3b30 con 0x7f990815c2a0 2024-09-15T23:59:58.290 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.288+0000 7f990559a640 1 -- 172.21.15.112:0/3080204711 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3169264166 0 0) 0x7f99080b3290 con 0x7f990815bec0 2024-09-15T23:59:58.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f9905d9b640 1 --2- 172.21.15.112:0/3080204711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990815c2a0 0x7f99080aed60 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f99080b2fb0 tx=0x7f98fc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04772fa84802deb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:58.291 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990559a640 1 -- 172.21.15.112:0/3080204711 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0ab650 con 0x7f990815c2a0 2024-09-15T23:59:58.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990559a640 1 -- 172.21.15.112:0/3080204711 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98fc0b0070 con 0x7f990815c2a0 2024-09-15T23:59:58.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990559a640 1 -- 172.21.15.112:0/3080204711 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0aba10 con 0x7f990815c2a0 2024-09-15T23:59:58.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 -- 172.21.15.112:0/3080204711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990815c2a0 msgr2=0x7f99080aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 --2- 172.21.15.112:0/3080204711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990815c2a0 0x7f99080aed60 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f99080b2fb0 tx=0x7f98fc01c450 comp rx=0 tx=0).stop 2024-09-15T23:59:58.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 -- 172.21.15.112:0/3080204711 shutdown_connections 2024-09-15T23:59:58.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 --2- 172.21.15.112:0/3080204711 >> v2:172.21.15.169:3300/0 conn(0x7f99080af2a0 0x7f990806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 --2- 172.21.15.112:0/3080204711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990815c2a0 0x7f99080aed60 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.292 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 -- 172.21.15.112:0/3080204711 >> 172.21.15.112:0/3080204711 conn(0x7f99080b1f90 msgr2=0x7f99080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:58.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 -- 172.21.15.112:0/3080204711 shutdown_connections 2024-09-15T23:59:58.293 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 -- 172.21.15.112:0/3080204711 wait complete. 2024-09-15T23:59:58.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 Processor -- start 2024-09-15T23:59:58.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 -- start start 2024-09-15T23:59:58.295 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99080af2a0 0x7f990814ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f990815bec0 0x7f990814a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990815c2a0 0x7f9908154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f990806ed50 con 0x7f990815c2a0 2024-09-15T23:59:58.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f99080af6b0 con 0x7f990815bec0 2024-09-15T23:59:58.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990ca8d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f990806eed0 con 0x7f99080af2a0 2024-09-15T23:59:58.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f9906d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990815c2a0 0x7f9908154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.296 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f9906d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990815c2a0 0x7f9908154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:34080/0 (socket says 172.21.15.112:34080) 2024-09-15T23:59:58.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f9906d9d640 1 -- 172.21.15.112:0/3276546776 learned_addr learned my addr 172.21.15.112:0/3276546776 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:58.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f9905d9b640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f990815bec0 0x7f990814a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990659c640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99080af2a0 0x7f990814ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f9906d9d640 1 -- 172.21.15.112:0/3276546776 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99080af2a0 msgr2=0x7f990814ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f9906d9d640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99080af2a0 0x7f990814ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f9906d9d640 1 -- 172.21.15.112:0/3276546776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f990815bec0 msgr2=0x7f990814a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f9906d9d640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f990815bec0 0x7f990814a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.297 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f9906d9d640 1 -- 172.21.15.112:0/3276546776 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990815d8d0 con 0x7f990815c2a0 2024-09-15T23:59:58.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f9905d9b640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f990815bec0 0x7f990814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:58.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.292+0000 7f990659c640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99080af2a0 0x7f990814ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:58.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.296+0000 7f9906d9d640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990815c2a0 0x7f9908154b90 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f990000cd70 tx=0x7f990000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:58.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.296+0000 7f98f6ffd640 1 -- 172.21.15.112:0/3276546776 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900003ba0 con 0x7f990815c2a0 2024-09-15T23:59:58.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.296+0000 7f98f6ffd640 1 -- 172.21.15.112:0/3276546776 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9900003d40 con 0x7f990815c2a0 2024-09-15T23:59:58.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.296+0000 7f990ca8d640 1 -- 172.21.15.112:0/3276546776 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9908156490 con 0x7f990815c2a0 2024-09-15T23:59:58.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.296+0000 7f98f6ffd640 1 -- 172.21.15.112:0/3276546776 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900004240 con 0x7f990815c2a0 2024-09-15T23:59:58.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.296+0000 7f990ca8d640 1 -- 172.21.15.112:0/3276546776 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9908156a50 con 0x7f990815c2a0 2024-09-15T23:59:58.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.296+0000 7f990ca8d640 1 -- 172.21.15.112:0/3276546776 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f990806f1d0 con 0x7f990815c2a0 2024-09-15T23:59:58.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.296+0000 7f98f6ffd640 1 -- 172.21.15.112:0/3276546776 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99000043e0 con 0x7f990815c2a0 2024-09-15T23:59:58.299 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.296+0000 7f98f6ffd640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f98e80678c0 0x7f98e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.296+0000 7f98f6ffd640 1 -- 172.21.15.112:0/3276546776 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7f99000865a0 con 0x7f990815c2a0 2024-09-15T23:59:58.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.296+0000 7f990659c640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f98e80678c0 0x7f98e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.296+0000 7f990659c640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f98e80678c0 0x7f98e8069d80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f98f8000f70 tx=0x7f98f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:58.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.300+0000 7f98f6ffd640 1 -- 172.21.15.112:0/3276546776 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f990001d340 con 0x7f990815c2a0 2024-09-15T23:59:58.455 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.456+0000 7f990ca8d640 1 -- 172.21.15.112:0/3276546776 --> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f990806fcd0 con 0x7f98e80678c0 2024-09-15T23:59:58.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.456+0000 7f98f6ffd640 1 -- 172.21.15.112:0/3276546776 <== mgr.4104 v2:172.21.15.112:6832/3086417580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13379 (secure 0 0 0) 0x7f990806fcd0 con 0x7f98e80678c0 2024-09-15T23:59:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:58.457 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-15T23:59:58.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.460+0000 7f990ca8d640 1 -- 172.21.15.112:0/3276546776 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f98e80678c0 msgr2=0x7f98e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.460+0000 7f990ca8d640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f98e80678c0 0x7f98e8069d80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f98f8000f70 tx=0x7f98f8009040 comp rx=0 tx=0).stop 2024-09-15T23:59:58.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.460+0000 7f990ca8d640 1 -- 172.21.15.112:0/3276546776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990815c2a0 msgr2=0x7f9908154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.460+0000 7f990ca8d640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990815c2a0 0x7f9908154b90 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f990000cd70 tx=0x7f990000a660 comp rx=0 tx=0).stop 2024-09-15T23:59:58.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.460+0000 7f990ca8d640 1 -- 172.21.15.112:0/3276546776 shutdown_connections 2024-09-15T23:59:58.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.460+0000 7f990ca8d640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7f98e80678c0 0x7f98e8069d80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.460+0000 7f990ca8d640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990815c2a0 0x7f9908154b90 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.460+0000 7f990ca8d640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f990815bec0 0x7f990814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.459 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.460+0000 7f990ca8d640 1 --2- 172.21.15.112:0/3276546776 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99080af2a0 0x7f990814ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.460+0000 7f990ca8d640 1 -- 172.21.15.112:0/3276546776 >> 172.21.15.112:0/3276546776 conn(0x7f99080b1f90 msgr2=0x7f99081597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:58.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.460+0000 7f990ca8d640 1 -- 172.21.15.112:0/3276546776 shutdown_connections 2024-09-15T23:59:58.460 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.460+0000 7f990ca8d640 1 -- 172.21.15.112:0/3276546776 wait complete. 2024-09-15T23:59:58.474 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2024-09-15T23:59:57.343194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":332868,"kb_used_data":12648,"kb_used_omap":12,"kb_used_meta":320051,"kb_avail":754641852,"statfs":{"total":773094113280,"available":772753256448,"internally_reserved":0,"allocated":12951552,"data_stored":6609024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":327732784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003070"},"pg_stats":[{"pgid":"1.0","version":"118'119","reported_seq":358,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-15T23:59:35.729505+0000","last_change":"2024-09-15T23:59:35.729505+0000","last_active":"2024-09-15T23:59:35.729505+0000","last_peered":"2024-09-15T23:59:35.729505+0000","last_clean":"2024-09-15T23:59:35.729505+0000","last_became_active":"2024-09-15T23:53:41.152321+0000","last_became_peered":"2024-09-15T23:53:41.152321+0000","last_unstale":"2024-09-15T23:59:35.729505+0000","last_undegraded":"2024-09-15T23:59:35.729505+0000","last_fullsized":"2024-09-15T23:59:35.729505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'119","last_scrub_stamp":"2024-09-15T23:59:35.729415+0000","last_deep_scrub":"118'119","last_deep_scrub_stamp":"2024-09-15T23:59:35.729415+0000","last_clean_scrub_stamp":"2024-09-15T23:59:35.729415+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:49.391524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509519,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40944,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330896,"statfs":{"total":96636764160,"available":96594837504,"internally_reserved":0,"allocated":1470464,"data_stored":678536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40944,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330896,"statfs":{"total":96636764160,"available":96594837504,"internally_reserved":0,"allocated":1470464,"data_stored":678536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509519,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45104,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326736,"statfs":{"total":96636764160,"available":96590577664,"internally_reserved":0,"allocated":1470464,"data_stored":678536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509519,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40948,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330892,"statfs":{"total":96636764160,"available":96594833408,"internally_reserved":0,"allocated":1470464,"data_stored":678536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40944,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330896,"statfs":{"total":96636764160,"available":96594837504,"internally_reserved":0,"allocated":1470464,"data_stored":678536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41520,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330320,"statfs":{"total":96636764160,"available":96594247680,"internally_reserved":0,"allocated":2064384,"data_stored":1268904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40944,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330896,"statfs":{"total":96636764160,"available":96594837504,"internally_reserved":0,"allocated":1470464,"data_stored":678536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41520,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330320,"statfs":{"total":96636764160,"available":96594247680,"internally_reserved":0,"allocated":2064384,"data_stored":1268904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:59:58.476 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-15T23:59:58.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec8959640 1 Processor -- start 2024-09-15T23:59:58.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec8959640 1 -- start start 2024-09-15T23:59:58.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec8959640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbec415f3a0 0x7fbec4165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec8959640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec40aede0 con 0x7fbec4070020 2024-09-15T23:59:58.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec8959640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec415fa10 con 0x7fbec41520a0 2024-09-15T23:59:58.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec8959640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fbec4152480 con 0x7fbec415f3a0 2024-09-15T23:59:58.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec1d9b640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fbec4070020 0x7fbec415ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33742/0 (socket says 172.21.15.112:33742) 2024-09-15T23:59:58.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec1d9b640 1 -- 172.21.15.112:0/2656967640 learned_addr learned my addr 172.21.15.112:0/2656967640 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:58.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec2d9d640 1 --2- 172.21.15.112:0/2656967640 >> v2:172.21.15.169:3300/0 conn(0x7fbec415f3a0 0x7fbec4165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2727855708 0 0) 0x7fbec40aede0 con 0x7fbec4070020 2024-09-15T23:59:58.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeac005740 con 0x7fbec4070020 2024-09-15T23:59:58.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086878337 0 0) 0x7fbec415fa10 con 0x7fbec41520a0 2024-09-15T23:59:58.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbec40aede0 con 0x7fbec41520a0 2024-09-15T23:59:58.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3873392151 0 0) 0x7fbeac005740 con 0x7fbec4070020 2024-09-15T23:59:58.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 >> v2:172.21.15.169:3300/0 conn(0x7fbec415f3a0 msgr2=0x7fbec4165f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:58.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 --2- 172.21.15.112:0/2656967640 >> v2:172.21.15.169:3300/0 conn(0x7fbec415f3a0 0x7fbec4165f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 >> v1:172.21.15.169:6789/0 conn(0x7fbec41520a0 legacy=0x7fbec406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec4074250 con 0x7fbec4070020 2024-09-15T23:59:58.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fbeb8001680 con 0x7fbec4070020 2024-09-15T23:59:58.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 >> v1:172.21.15.112:6789/0 conn(0x7fbec4070020 legacy=0x7fbec415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 --2- 172.21.15.112:0/2656967640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbeac005d60 0x7fbeac006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 --2- 172.21.15.112:0/2656967640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeac006a20 0x7fbeac006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 --2- 172.21.15.112:0/2656967640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbeac0073e0 0x7fbeac00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.602 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac00e230 con 0x7fbeac006a20 2024-09-15T23:59:58.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac00e3e0 con 0x7fbeac0073e0 2024-09-15T23:59:58.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac00e5e0 con 0x7fbeac005d60 2024-09-15T23:59:58.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec1d9b640 1 --2- 172.21.15.112:0/2656967640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeac006a20 0x7fbeac006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.603 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec259c640 1 --2- 172.21.15.112:0/2656967640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbeac005d60 0x7fbeac006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec2d9d640 1 --2- 172.21.15.112:0/2656967640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbeac0073e0 0x7fbeac00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec1d9b640 1 -- 172.21.15.112:0/2656967640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbeac005d60 msgr2=0x7fbeac006160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:58.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec1d9b640 1 --2- 172.21.15.112:0/2656967640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbeac005d60 0x7fbeac006160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.604 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec1d9b640 1 -- 172.21.15.112:0/2656967640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbeac0073e0 msgr2=0x7fbeac00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:58.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec1d9b640 1 --2- 172.21.15.112:0/2656967640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbeac0073e0 0x7fbeac00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec1d9b640 1 -- 172.21.15.112:0/2656967640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac005740 con 0x7fbeac006a20 2024-09-15T23:59:58.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec2d9d640 1 --2- 172.21.15.112:0/2656967640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbeac0073e0 0x7fbeac00dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:58.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.596+0000 7fbec2d9d640 1 -- 172.21.15.112:0/2656967640 reap_dead start 2024-09-15T23:59:58.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec1d9b640 1 --2- 172.21.15.112:0/2656967640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeac006a20 0x7fbeac006ea0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800c160 tx=0x7fbeb801cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d101dcf8620bab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:58.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8007cd0 con 0x7fbeac006a20 2024-09-15T23:59:58.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb80a9020 con 0x7fbeac006a20 2024-09-15T23:59:58.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec159a640 1 -- 172.21.15.112:0/2656967640 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8005ae0 con 0x7fbeac006a20 2024-09-15T23:59:58.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 -- 172.21.15.112:0/2656967640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeac006a20 msgr2=0x7fbeac006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 --2- 172.21.15.112:0/2656967640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeac006a20 0x7fbeac006ea0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800c160 tx=0x7fbeb801cb80 comp rx=0 tx=0).stop 2024-09-15T23:59:58.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 -- 172.21.15.112:0/2656967640 shutdown_connections 2024-09-15T23:59:58.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 --2- 172.21.15.112:0/2656967640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbeac006a20 0x7fbeac006ea0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 -- 172.21.15.112:0/2656967640 >> 172.21.15.112:0/2656967640 conn(0x7fbec40b1f90 msgr2=0x7fbec40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:58.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 -- 172.21.15.112:0/2656967640 shutdown_connections 2024-09-15T23:59:58.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 -- 172.21.15.112:0/2656967640 wait complete. 2024-09-15T23:59:58.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 Processor -- start 2024-09-15T23:59:58.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 -- start start 2024-09-15T23:59:58.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbeac006a20 0x7fbec413e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbec413e930 0x7fbec415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.617 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbec40cc810 0x7fbec41538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbec4073a50 con 0x7fbec413e930 2024-09-15T23:59:58.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbec4073770 con 0x7fbec40cc810 2024-09-15T23:59:58.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.600+0000 7fbec8959640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbec4073d30 con 0x7fbeac006a20 2024-09-15T23:59:58.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec1d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbec413e930 0x7fbec415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec1d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbec413e930 0x7fbec415dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60916/0 (socket says 172.21.15.112:60916) 2024-09-15T23:59:58.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec1d9b640 1 -- 172.21.15.112:0/2947031565 learned_addr learned my addr 172.21.15.112:0/2947031565 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:58.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec259c640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbeac006a20 0x7fbec413e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.619 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec2d9d640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbec40cc810 0x7fbec41538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec1d9b640 1 -- 172.21.15.112:0/2947031565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbeac006a20 msgr2=0x7fbec413e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.620 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec1d9b640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbeac006a20 0x7fbec413e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec1d9b640 1 -- 172.21.15.112:0/2947031565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbec40cc810 msgr2=0x7fbec41538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec1d9b640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbec40cc810 0x7fbec41538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec1d9b640 1 -- 172.21.15.112:0/2947031565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec415e1c0 con 0x7fbec413e930 2024-09-15T23:59:58.621 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec2d9d640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbec40cc810 0x7fbec41538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:58.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec259c640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbeac006a20 0x7fbec413e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:59:58.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec1d9b640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbec413e930 0x7fbec415dc80 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fbeb801c9b0 tx=0x7fbeac007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:58.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbeb2ffd640 1 -- 172.21.15.112:0/2947031565 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80a5d10 con 0x7fbec413e930 2024-09-15T23:59:58.622 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbeb2ffd640 1 -- 172.21.15.112:0/2947031565 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb80b2070 con 0x7fbec413e930 2024-09-15T23:59:58.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec8959640 1 -- 172.21.15.112:0/2947031565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec415e460 con 0x7fbec413e930 2024-09-15T23:59:58.623 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbeb2ffd640 1 -- 172.21.15.112:0/2947031565 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8004a10 con 0x7fbec413e930 2024-09-15T23:59:58.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec8959640 1 -- 172.21.15.112:0/2947031565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec40b0330 con 0x7fbec413e930 2024-09-15T23:59:58.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec8959640 1 -- 172.21.15.112:0/2947031565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec4068e50 con 0x7fbec413e930 2024-09-15T23:59:58.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbeb2ffd640 1 -- 172.21.15.112:0/2947031565 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbeb8004bb0 con 0x7fbec413e930 2024-09-15T23:59:58.624 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbeb2ffd640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbea40678c0 0x7fbea4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbeb2ffd640 1 -- 172.21.15.112:0/2947031565 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7fbeb811f340 con 0x7fbec413e930 2024-09-15T23:59:58.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec259c640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbea40678c0 0x7fbea4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.625 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.604+0000 7fbec259c640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbea40678c0 0x7fbea4069d80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4005630 tx=0x7fbeb4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:58.626 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.608+0000 7fbeb2ffd640 1 -- 172.21.15.112:0/2947031565 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbeb80168d0 con 0x7fbec413e930 2024-09-15T23:59:58.758 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.760+0000 7fbec8959640 1 -- 172.21.15.112:0/2947031565 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fbec4155920 con 0x7fbec413e930 2024-09-15T23:59:58.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.764+0000 7fbeb2ffd640 1 -- 172.21.15.112:0/2947031565 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v32)=0 v32) ==== 123+0+0 (secure 0 0 0) 0x7fbeb80b5e50 con 0x7fbec413e930 2024-09-15T23:59:58.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.768+0000 7fbeb2ffd640 1 -- 172.21.15.112:0/2947031565 <== mon.0 v2:172.21.15.112:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbeb80a9020 con 0x7fbec413e930 2024-09-15T23:59:58.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.768+0000 7fbec8959640 1 -- 172.21.15.112:0/2947031565 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbea40678c0 msgr2=0x7fbea4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.768+0000 7fbec8959640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbea40678c0 0x7fbea4069d80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4005630 tx=0x7fbeb4009040 comp rx=0 tx=0).stop 2024-09-15T23:59:58.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.768+0000 7fbec8959640 1 -- 172.21.15.112:0/2947031565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbec413e930 msgr2=0x7fbec415dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.768+0000 7fbec8959640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbec413e930 0x7fbec415dc80 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fbeb801c9b0 tx=0x7fbeac007a50 comp rx=0 tx=0).stop 2024-09-15T23:59:58.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.768+0000 7fbec8959640 1 -- 172.21.15.112:0/2947031565 shutdown_connections 2024-09-15T23:59:58.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.768+0000 7fbec8959640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fbea40678c0 0x7fbea4069d80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.768+0000 7fbec8959640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbec40cc810 0x7fbec41538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.768+0000 7fbec8959640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbec413e930 0x7fbec415dc80 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.768+0000 7fbec8959640 1 --2- 172.21.15.112:0/2947031565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbeac006a20 0x7fbec413e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.768+0000 7fbec8959640 1 -- 172.21.15.112:0/2947031565 >> 172.21.15.112:0/2947031565 conn(0x7fbec40b1f90 msgr2=0x7fbec406f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:58.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.768+0000 7fbec8959640 1 -- 172.21.15.112:0/2947031565 shutdown_connections 2024-09-15T23:59:58.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.768+0000 7fbec8959640 1 -- 172.21.15.112:0/2947031565 wait complete. 2024-09-15T23:59:58.784 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:59:58.784 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:59:58.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd5105b640 1 Processor -- start 2024-09-15T23:59:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd5105b640 1 -- start start 2024-09-15T23:59:58.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd5105b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c0b39a0 0x7fdd4c06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd5105b640 1 -- --> v1:172.21.15.112:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4c06ec60 con 0x7fdd4c06e4b0 2024-09-15T23:59:58.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd5105b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4c06ef40 con 0x7fdd4c1587a0 2024-09-15T23:59:58.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd5105b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c06f870 con 0x7fdd4c0b39a0 2024-09-15T23:59:58.895 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd4b59e640 1 --1- >> v1:172.21.15.112:6789/0 conn(0x7fdd4c06e4b0 0x7fdd4c072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.112:6789/0 says I am v1:172.21.15.112:33750/0 (socket says 172.21.15.112:33750) 2024-09-15T23:59:58.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd4b59e640 1 -- 172.21.15.112:0/1628685174 learned_addr learned my addr 172.21.15.112:0/1628685174 (peer_addr_for_me v1:172.21.15.112:0/0) 2024-09-15T23:59:58.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 -- 172.21.15.112:0/1628685174 <== mon.0 v1:172.21.15.112:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793378572 0 0) 0x7fdd4c06ec60 con 0x7fdd4c06e4b0 2024-09-15T23:59:58.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd4a59c640 1 --2- 172.21.15.112:0/1628685174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c0b39a0 0x7fdd4c06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 -- 172.21.15.112:0/1628685174 --> v1:172.21.15.112:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd34003530 con 0x7fdd4c06e4b0 2024-09-15T23:59:58.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 -- 172.21.15.112:0/1628685174 <== mon.0 v1:172.21.15.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4152596523 0 0) 0x7fdd34003530 con 0x7fdd4c06e4b0 2024-09-15T23:59:58.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 -- 172.21.15.112:0/1628685174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c0b39a0 msgr2=0x7fdd4c06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:58.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 --2- 172.21.15.112:0/1628685174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c0b39a0 0x7fdd4c06df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 -- 172.21.15.112:0/1628685174 >> v1:172.21.15.169:6789/0 conn(0x7fdd4c1587a0 legacy=0x7fdd4c0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 -- 172.21.15.112:0/1628685174 --> v1:172.21.15.112:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c06f220 con 0x7fdd4c06e4b0 2024-09-15T23:59:58.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 -- 172.21.15.112:0/1628685174 <== mon.0 v1:172.21.15.112:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3333235430 0 0) 0x7fdd44001a00 con 0x7fdd4c06e4b0 2024-09-15T23:59:58.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 -- 172.21.15.112:0/1628685174 >> v1:172.21.15.112:6789/0 conn(0x7fdd4c06e4b0 legacy=0x7fdd4c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 --2- 172.21.15.112:0/1628685174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd340039f0 0x7fdd34003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 --2- 172.21.15.112:0/1628685174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c0b39a0 0x7fdd34004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.897 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 --2- 172.21.15.112:0/1628685174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd34004d50 0x7fdd340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 -- 172.21.15.112:0/1628685174 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c06f870 con 0x7fdd340039f0 2024-09-15T23:59:58.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 -- 172.21.15.112:0/1628685174 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3400bb60 con 0x7fdd34004d50 2024-09-15T23:59:58.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd49d9b640 1 -- 172.21.15.112:0/1628685174 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3400bd60 con 0x7fdd4c0b39a0 2024-09-15T23:59:58.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd4ad9d640 1 --2- 172.21.15.112:0/1628685174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd340039f0 0x7fdd34003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd4b59e640 1 --2- 172.21.15.112:0/1628685174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd34004d50 0x7fdd340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd4a59c640 1 --2- 172.21.15.112:0/1628685174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c0b39a0 0x7fdd34004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd4ad9d640 1 -- 172.21.15.112:0/1628685174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c0b39a0 msgr2=0x7fdd34004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:58.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd4ad9d640 1 --2- 172.21.15.112:0/1628685174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c0b39a0 0x7fdd34004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd4ad9d640 1 -- 172.21.15.112:0/1628685174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd34004d50 msgr2=0x7fdd340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:59:58.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd4ad9d640 1 --2- 172.21.15.112:0/1628685174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd34004d50 0x7fdd340051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd4ad9d640 1 -- 172.21.15.112:0/1628685174 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd34003530 con 0x7fdd340039f0 2024-09-15T23:59:58.899 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.892+0000 7fdd4a59c640 1 --2- 172.21.15.112:0/1628685174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c0b39a0 0x7fdd34004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:58.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.896+0000 7fdd4ad9d640 1 --2- 172.21.15.112:0/1628685174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd340039f0 0x7fdd34003e10 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c001780 tx=0x7fdd3c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8370d276ba8d4a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:58.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.896+0000 7fdd49d9b640 1 -- 172.21.15.112:0/1628685174 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0013a0 con 0x7fdd340039f0 2024-09-15T23:59:58.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.896+0000 7fdd49d9b640 1 -- 172.21.15.112:0/1628685174 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdd3c0052f0 con 0x7fdd340039f0 2024-09-15T23:59:58.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.896+0000 7fdd49d9b640 1 -- 172.21.15.112:0/1628685174 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c003860 con 0x7fdd340039f0 2024-09-15T23:59:58.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.896+0000 7fdd5105b640 1 -- 172.21.15.112:0/1628685174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd340039f0 msgr2=0x7fdd34003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.896+0000 7fdd5105b640 1 --2- 172.21.15.112:0/1628685174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd340039f0 0x7fdd34003e10 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c001780 tx=0x7fdd3c01c3f0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.896+0000 7fdd4b59e640 1 -- 172.21.15.112:0/1628685174 reap_dead start 2024-09-15T23:59:58.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.896+0000 7fdd5105b640 1 -- 172.21.15.112:0/1628685174 shutdown_connections 2024-09-15T23:59:58.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.896+0000 7fdd5105b640 1 -- 172.21.15.112:0/1628685174 >> 172.21.15.112:0/1628685174 conn(0x7fdd4c0b1f90 msgr2=0x7fdd4c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:58.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.896+0000 7fdd5105b640 1 -- 172.21.15.112:0/1628685174 shutdown_connections 2024-09-15T23:59:58.904 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.896+0000 7fdd5105b640 1 -- 172.21.15.112:0/1628685174 wait complete. 2024-09-15T23:59:58.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd5105b640 1 Processor -- start 2024-09-15T23:59:58.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd5105b640 1 -- start start 2024-09-15T23:59:58.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd5105b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd340039f0 0x7fdd4c147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd5105b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd4c0b1ad0 0x7fdd4c1628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd5105b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c162de0 0x7fdd4c0b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd5105b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c073200 con 0x7fdd4c0b1ad0 2024-09-15T23:59:58.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd5105b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c073080 con 0x7fdd4c162de0 2024-09-15T23:59:58.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd5105b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c073380 con 0x7fdd340039f0 2024-09-15T23:59:58.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd4a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd4c0b1ad0 0x7fdd4c1628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd4a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd4c0b1ad0 0x7fdd4c1628a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60942/0 (socket says 172.21.15.112:60942) 2024-09-15T23:59:58.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd4a59c640 1 -- 172.21.15.112:0/2883824037 learned_addr learned my addr 172.21.15.112:0/2883824037 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:59:58.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd4b59e640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c162de0 0x7fdd4c0b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd4ad9d640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd340039f0 0x7fdd4c147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd4a59c640 1 -- 172.21.15.112:0/2883824037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd340039f0 msgr2=0x7fdd4c147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd4a59c640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd340039f0 0x7fdd4c147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd4a59c640 1 -- 172.21.15.112:0/2883824037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c162de0 msgr2=0x7fdd4c0b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:58.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd4a59c640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c162de0 0x7fdd4c0b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:58.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd4a59c640 1 -- 172.21.15.112:0/2883824037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c09c530 con 0x7fdd4c0b1ad0 2024-09-15T23:59:58.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd4b59e640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c162de0 0x7fdd4c0b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:58.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd4ad9d640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd340039f0 0x7fdd4c147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:59:58.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd4a59c640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd4c0b1ad0 0x7fdd4c1628a0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000e840 tx=0x7fdd4000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:58.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd337fe640 1 -- 172.21.15.112:0/2883824037 <== mon.0 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40017070 con 0x7fdd4c0b1ad0 2024-09-15T23:59:58.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd337fe640 1 -- 172.21.15.112:0/2883824037 <== mon.0 v2:172.21.15.112:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdd4000c6d0 con 0x7fdd4c0b1ad0 2024-09-15T23:59:58.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd5105b640 1 -- 172.21.15.112:0/2883824037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4c163280 con 0x7fdd4c0b1ad0 2024-09-15T23:59:58.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd337fe640 1 -- 172.21.15.112:0/2883824037 <== mon.0 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4000f040 con 0x7fdd4c0b1ad0 2024-09-15T23:59:58.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd5105b640 1 -- 172.21.15.112:0/2883824037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4c163840 con 0x7fdd4c0b1ad0 2024-09-15T23:59:58.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd5105b640 1 -- 172.21.15.112:0/2883824037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd4c072160 con 0x7fdd4c0b1ad0 2024-09-15T23:59:58.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.900+0000 7fdd337fe640 1 -- 172.21.15.112:0/2883824037 <== mon.0 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdd4001a070 con 0x7fdd4c0b1ad0 2024-09-15T23:59:58.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.904+0000 7fdd337fe640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdd380678f0 0x7fdd38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:59:58.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.904+0000 7fdd337fe640 1 -- 172.21.15.112:0/2883824037 <== mon.0 v2:172.21.15.112:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5335+0+0 (secure 0 0 0) 0x7fdd400856a0 con 0x7fdd4c0b1ad0 2024-09-15T23:59:58.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.904+0000 7fdd4ad9d640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdd380678f0 0x7fdd38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:59:58.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.904+0000 7fdd4ad9d640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdd380678f0 0x7fdd38069db0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0ac000 tx=0x7fdd3c0011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:59:58.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:58.908+0000 7fdd337fe640 1 -- 172.21.15.112:0/2883824037 <== mon.0 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdd400562c0 con 0x7fdd4c0b1ad0 2024-09-15T23:59:59.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:59.100+0000 7fdd5105b640 1 -- 172.21.15.112:0/2883824037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd4c156d90 con 0x7fdd4c0b1ad0 2024-09-15T23:59:59.101 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:59.100+0000 7fdd337fe640 1 -- 172.21.15.112:0/2883824037 <== mon.0 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+3923 (secure 0 0 0) 0x7fdd40055bc0 con 0x7fdd4c0b1ad0 2024-09-15T23:59:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:59:59.101 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":74,"btime":"2024-09-15T23:59:27:234337+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/2146678161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2146678161},{"type":"v1","addr":"172.21.15.169:6835","nonce":2146678161}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1904671431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1904671431},{"type":"v1","addr":"172.21.15.169:6833","nonce":1904671431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7203,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/3435773285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":3435773285},{"type":"v1","addr":"172.21.15.112:6835","nonce":3435773285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7458,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/2062728760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":2062728760},{"type":"v1","addr":"172.21.15.112:6837","nonce":2062728760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[]} 2024-09-15T23:59:59.102 INFO:teuthology.orchestra.run.smithi112.stderr:dumped fsmap epoch 74 2024-09-15T23:59:59.103 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:59.104+0000 7fdd5105b640 1 -- 172.21.15.112:0/2883824037 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdd380678f0 msgr2=0x7fdd38069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:59.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:59.104+0000 7fdd5105b640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdd380678f0 0x7fdd38069db0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0ac000 tx=0x7fdd3c0011a0 comp rx=0 tx=0).stop 2024-09-15T23:59:59.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:59.104+0000 7fdd5105b640 1 -- 172.21.15.112:0/2883824037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd4c0b1ad0 msgr2=0x7fdd4c1628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:59:59.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:59.104+0000 7fdd5105b640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd4c0b1ad0 0x7fdd4c1628a0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000e840 tx=0x7fdd4000ed00 comp rx=0 tx=0).stop 2024-09-15T23:59:59.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:59.104+0000 7fdd5105b640 1 -- 172.21.15.112:0/2883824037 shutdown_connections 2024-09-15T23:59:59.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:59.104+0000 7fdd5105b640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.112:6832/3086417580,v1:172.21.15.112:6833/3086417580] conn(0x7fdd380678f0 0x7fdd38069db0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:59.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:59.104+0000 7fdd5105b640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c162de0 0x7fdd4c0b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:59.104 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:59.104+0000 7fdd5105b640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd4c0b1ad0 0x7fdd4c1628a0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:59.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:59.104+0000 7fdd5105b640 1 --2- 172.21.15.112:0/2883824037 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd340039f0 0x7fdd4c147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:59:59.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:59.104+0000 7fdd5105b640 1 -- 172.21.15.112:0/2883824037 >> 172.21.15.112:0/2883824037 conn(0x7fdd4c0b1f90 msgr2=0x7fdd4c0ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:59:59.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:59.104+0000 7fdd5105b640 1 -- 172.21.15.112:0/2883824037 shutdown_connections 2024-09-15T23:59:59.105 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:59:59.104+0000 7fdd5105b640 1 -- 172.21.15.112:0/2883824037 wait complete. 2024-09-15T23:59:59.119 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-15T23:59:59.120 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-15T23:59:59.120 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:59:59.120 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:59.130 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:59:59.130 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:59:59.131 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:59.183 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:59:59.184 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:59:59.184 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:59.197 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:59:59.198 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:59:59.198 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:59.253 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:59:59.253 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-15T23:59:59.254 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-15T23:59:59.254 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:59.345 INFO:tasks.ceph.osd.0:Stopped 2024-09-15T23:59:59.345 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-15T23:59:59.345 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:59.437 INFO:tasks.ceph.osd.1:Stopped 2024-09-15T23:59:59.438 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-15T23:59:59.438 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:59.536 INFO:tasks.ceph.osd.2:Stopped 2024-09-15T23:59:59.536 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-15T23:59:59.536 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:59.621 INFO:tasks.ceph.osd.3:Stopped 2024-09-15T23:59:59.621 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-15T23:59:59.621 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:59.706 INFO:tasks.ceph.osd.4:Stopped 2024-09-15T23:59:59.707 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-15T23:59:59.707 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:59.775 INFO:tasks.ceph.osd.5:Stopped 2024-09-15T23:59:59.775 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-15T23:59:59.775 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:59.854 INFO:tasks.ceph.osd.6:Stopped 2024-09-15T23:59:59.855 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-15T23:59:59.855 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:59.947 INFO:tasks.ceph.osd.7:Stopped 2024-09-15T23:59:59.947 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-15T23:59:59.947 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-15T23:59:59.948 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:59:59.977 INFO:tasks.ceph.mgr.y:Stopped 2024-09-15T23:59:59.977 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-15T23:59:59.977 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T00:00:00.005 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T00:00:00.005 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T00:00:00.006 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T00:00:00.006 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T00:00:00.036 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T00:00:00.036 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-16T00:00:00.036 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T00:00:00.068 INFO:tasks.ceph.mon.b:Stopped 2024-09-16T00:00:00.069 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-16T00:00:00.069 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T00:00:00.130 INFO:tasks.ceph.mon.c:Stopped 2024-09-16T00:00:00.131 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T00:00:00.131 DEBUG:teuthology.orchestra.run.smithi112:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-16T00:00:00.148 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-16T00:00:00.148 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T00:00:00.504 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-16T00:00:00.504 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T00:00:00.813 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-16T00:00:00.813 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T00:00:01.132 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-16T00:00:01.132 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T00:00:01.409 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-16T00:00:01.409 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-16T00:00:01.771 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-16T00:00:01.772 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-16T00:00:02.050 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-16T00:00:02.050 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-16T00:00:02.259 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi169.front.sepia.ceph.com 2024-09-16T00:00:02.259 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-16T00:00:02.451 INFO:tasks.ceph:Archiving mon data... 2024-09-16T00:00:02.453 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906342/data/mon.a.tgz 2024-09-16T00:00:02.453 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-16T00:00:02.459 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.ojqbUULkK9 2024-09-16T00:00:02.459 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ojqbUULkK9 2024-09-16T00:00:02.628 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.ojqbUULkK9 2024-09-16T00:00:02.691 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.ojqbUULkK9 is 551KB 2024-09-16T00:00:02.752 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.ojqbUULkK9 2024-09-16T00:00:02.759 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906342/data/mon.b.tgz 2024-09-16T00:00:02.759 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-09-16T00:00:02.765 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.GFt4Mi1HzG 2024-09-16T00:00:02.765 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.GFt4Mi1HzG 2024-09-16T00:00:02.974 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.GFt4Mi1HzG 2024-09-16T00:00:03.037 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.GFt4Mi1HzG is 700KB 2024-09-16T00:00:03.099 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.GFt4Mi1HzG 2024-09-16T00:00:03.105 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906342/data/mon.c.tgz 2024-09-16T00:00:03.105 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-09-16T00:00:03.149 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.94f5U4z7iZ 2024-09-16T00:00:03.150 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.94f5U4z7iZ 2024-09-16T00:00:03.350 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.94f5U4z7iZ 2024-09-16T00:00:03.408 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.94f5U4z7iZ is 700KB 2024-09-16T00:00:03.471 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.94f5U4z7iZ 2024-09-16T00:00:03.476 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T00:00:03.477 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T00:00:03.479 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T00:00:03.535 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T00:00:03.577 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T00:00:03.578 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T00:00:03.579 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906342/remote/smithi112/crash 2024-09-16T00:00:03.580 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T00:00:03.592 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906342/remote/smithi169/crash 2024-09-16T00:00:03.593 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T00:00:03.631 INFO:tasks.ceph:Shutting down logrotate 2024-09-16T00:00:03.631 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T00:00:03.639 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T00:00:03.647 INFO:teuthology.orchestra.run.smithi112.stderr:error: state file /var/lib/logrotate/status is already locked 2024-09-16T00:00:03.648 INFO:teuthology.orchestra.run.smithi112.stderr:logrotate does not support parallel execution on the same set of logfiles. 2024-09-16T00:00:03.675 DEBUG:teuthology.orchestra.run:got remote process result: 3 2024-09-16T00:00:03.675 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi112 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-09-16T00:00:03.681 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/ceph.py", line 1908, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi112 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-09-16T00:00:03.725 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T00:00:03.735 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/ceph.py", line 1908, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi112 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-09-16T00:00:03.738 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T00:00:03.738 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T00:00:03.740 INFO:teuthology.orchestra.run.smithi169.stderr:error: state file /var/lib/logrotate/status is already locked 2024-09-16T00:00:03.740 INFO:teuthology.orchestra.run.smithi169.stderr:logrotate does not support parallel execution on the same set of logfiles. 2024-09-16T00:00:03.742 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T00:00:03.834 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T00:00:03.843 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T00:00:03.843 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T00:00:03.845 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T00:00:03.853 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T00:00:03.854 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2024-09-16T00:00:03.854 INFO:teuthology.orchestra.run.smithi112.stdout:*hv01.front.sepi 67.205.162.81 3 u 12 64 377 0.093 -0.844 2.077 2024-09-16T00:00:03.854 INFO:teuthology.orchestra.run.smithi112.stdout:+hv02.front.sepi 96.245.170.99 3 u 4 64 377 0.075 -0.246 1.602 2024-09-16T00:00:03.854 INFO:teuthology.orchestra.run.smithi112.stdout:+hv03.front.sepi 74.6.168.72 3 u 3 64 377 0.049 -3.428 1.540 2024-09-16T00:00:03.854 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-09-16T00:00:03.858 INFO:teuthology.orchestra.run.smithi169.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T00:00:03.859 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================== 2024-09-16T00:00:03.859 INFO:teuthology.orchestra.run.smithi169.stdout:*hv01.front.sepi 67.205.162.81 3 u 6 64 377 0.081 -1.712 0.429 2024-09-16T00:00:03.859 INFO:teuthology.orchestra.run.smithi169.stdout:+hv02.front.sepi 96.245.170.99 3 u 9 64 377 0.099 +0.104 0.525 2024-09-16T00:00:03.859 INFO:teuthology.orchestra.run.smithi169.stdout:+hv03.front.sepi 74.6.168.72 3 u 3 64 377 0.089 -2.923 0.723 2024-09-16T00:00:03.859 INFO:teuthology.orchestra.run.smithi169.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-09-16T00:00:03.860 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T00:00:03.880 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T00:00:03.881 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T00:00:03.945 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T00:00:03.980 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T00:00:04.039 INFO:teuthology.task.internal:Duration was 1056.782692 seconds 2024-09-16T00:00:04.040 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T00:00:04.063 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T00:00:04.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T00:00:04.067 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T00:00:04.101 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T00:00:04.101 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-09-16T00:00:04.101 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T00:00:04.151 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-09-16T00:00:04.152 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T00:00:04.160 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T00:00:04.160 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T00:00:04.195 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T00:00:04.330 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T00:00:04.330 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T00:00:04.333 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T00:00:04.412 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T00:00:04.429 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T00:00:04.429 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T00:00:04.440 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T00:00:04.451 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T00:00:04.463 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T00:00:04.483 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T00:00:04.490 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-09-16T00:00:04.502 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-09-16T00:00:04.512 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T00:00:04.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:00:04.550 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T00:00:04.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:00:04.557 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T00:00:04.568 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T00:00:04.569 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906342/remote/smithi112 2024-09-16T00:00:04.569 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T00:00:04.616 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906342/remote/smithi169 2024-09-16T00:00:04.617 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T00:00:04.634 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T00:00:04.634 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T00:00:04.655 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T00:00:04.677 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T00:00:04.688 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T00:00:04.689 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T00:00:04.713 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T00:00:04.713 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T00:00:04.715 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T00:00:04.719 INFO:teuthology.orchestra.run.smithi112.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 00:00 /home/ubuntu/cephtest 2024-09-16T00:00:04.725 INFO:teuthology.orchestra.run.smithi169.stdout: 658622 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 00:00 /home/ubuntu/cephtest 2024-09-16T00:00:04.727 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T00:00:04.751 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T00:00:04.793 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi112 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-09-16T00:00:04.796 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/strays} duration: 1056.7826917171478 failure_reason: 'Test failure: test_hardlink_reintegration (tasks.cephfs.test_strays.TestStrays)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=36ee89ad5cf04cb2b3459ad1528eb12d status: fail success: false 2024-09-16T00:00:04.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T00:00:04.874 INFO:teuthology.run:FAIL